WorldWideScience

Sample records for activate neural reward

  1. Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.

    Science.gov (United States)

    Kim, Sang Hee; Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

    2015-09-01

    In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment.

  2. Primary and secondary rewards differentially modulate neural activity dynamics during working memory.

    Directory of Open Access Journals (Sweden)

    Stefanie M Beck

    Full Text Available BACKGROUND: Cognitive control and working memory processes have been found to be influenced by changes in motivational state. Nevertheless, the impact of different motivational variables on behavior and brain activity remains unclear. METHODOLOGY/PRINCIPAL FINDINGS: The current study examined the impact of incentive category by varying on a within-subjects basis whether performance during a working memory task was reinforced with either secondary (monetary or primary (liquid rewards. The temporal dynamics of motivation-cognition interactions were investigated by employing an experimental design that enabled isolation of sustained and transient effects. Performance was dramatically and equivalently enhanced in each incentive condition, whereas neural activity dynamics differed between incentive categories. The monetary reward condition was associated with a tonic activation increase in primarily right-lateralized cognitive control regions including anterior prefrontal cortex (PFC, dorsolateral PFC, and parietal cortex. In the liquid condition, the identical regions instead showed a shift in transient activation from a reactive control pattern (primary probe-based activation during no-incentive trials to proactive control (primary cue-based activation during rewarded trials. Additionally, liquid-specific tonic activation increases were found in subcortical regions (amygdala, dorsal striatum, nucleus accumbens, indicating an anatomical double dissociation in the locus of sustained activation. CONCLUSIONS/SIGNIFICANCE: These different activation patterns suggest that primary and secondary rewards may produce similar behavioral changes through distinct neural mechanisms of reinforcement. Further, our results provide new evidence for the flexibility of cognitive control, in terms of the temporal dynamics of activation.

  3. Motivated to win: Relationship between anticipatory and outcome reward-related neural activity.

    Science.gov (United States)

    Pornpattananangkul, Narun; Nusslock, Robin

    2015-11-01

    Reward-processing involves two temporal stages characterized by two distinct neural processes: reward-anticipation and reward-outcome. Intriguingly, very little research has examined the relationship between neural processes involved in reward-anticipation and reward-outcome. To investigate this, one needs to consider the heterogeneity of reward-processing within each stage. To identify different stages of reward processing, we adapted a reward time-estimation task. While EEG data were recorded, participants were instructed to button-press 3.5s after the onset of an Anticipation-Cue and received monetary reward for good time-estimation on the Reward trials, but not on No-Reward trials. We first separated reward-anticipation into event related potentials (ERPs) occurring at three sub-stages: reward/no-reward cue-evaluation, motor-preparation and feedback-anticipation. During reward/no-reward cue-evaluation, the Reward-Anticipation Cue led to a smaller N2 and larger P3. During motor-preparation, we report, for the first time, that the Reward-Anticipation Cue enhanced the Readiness Potential (RP), starting approximately 1s before movement. At the subsequent feedback-anticipation stage, the Reward-Anticipation Cue elevated the Stimulus-Preceding Negativity (SPN). We also separated reward-outcome ERPs into different components occurring at different time-windows: the Feedback-Related Negativity (FRN), Feedback-P3 (FB-P3) and Late-Positive Potentials (LPP). Lastly, we examined the relationship between reward-anticipation and reward-outcome ERPs. We report that individual-differences in specific reward-anticipation ERPs uniquely predicted specific reward-outcome ERPs. In particular, the reward-anticipation Early-RP (1-.8s before movement) predicted early reward-outcome ERPs (FRN and FB-P3), whereas, the reward-anticipation SPN most strongly predicted a later reward-outcome ERP (LPP). Results have important implications for understanding the nature of the relationship

  4. Memory Consolidation and Neural Substrate of Reward

    Directory of Open Access Journals (Sweden)

    Redolar-Ripoll, Diego

    2012-08-01

    Full Text Available The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of goal-directed behavior. The neural substrate underling this processing of reward information is a reliable way of improving learning and memory processes. Evidence from several studies indicates that this neural system can facilitate memory consolidation in a wide variety of learning tasks. From a molecular perspective, certain cardinal features of reward have been described as forms of memory. Studies of human addicts and studies in animal models of addiction show that chronic drug exposure produces stable changes in the brain at the cellular and molecular levels that underlie the long-lasting behavioral plasticity associated with addiction. These molecular and cellular adaptations involved in addiction are also implicated in learning and memory processes. Dopamine seems to be a critical common signal to activate different genetic mechanisms that ultimately remodel synapses and circuits. Despite memory is an active and complex process mediated by different brain areas, the neural substrate of reward is able to improve memory consolidation in a several paradigms. We believe that there are many equivalent traits between reward and learning and memory processes.

  5. Neural networks involved in adolescent reward processing: An activation likelihood estimation meta-analysis of functional neuroimaging studies.

    Science.gov (United States)

    Silverman, Merav H; Jedd, Kelly; Luciana, Monica

    2015-11-15

    Behavioral responses to, and the neural processing of, rewards change dramatically during adolescence and may contribute to observed increases in risk-taking during this developmental period. Functional MRI (fMRI) studies suggest differences between adolescents and adults in neural activation during reward processing, but findings are contradictory, and effects have been found in non-predicted directions. The current study uses an activation likelihood estimation (ALE) approach for quantitative meta-analysis of functional neuroimaging studies to: (1) confirm the network of brain regions involved in adolescents' reward processing, (2) identify regions involved in specific stages (anticipation, outcome) and valence (positive, negative) of reward processing, and (3) identify differences in activation likelihood between adolescent and adult reward-related brain activation. Results reveal a subcortical network of brain regions involved in adolescent reward processing similar to that found in adults with major hubs including the ventral and dorsal striatum, insula, and posterior cingulate cortex (PCC). Contrast analyses find that adolescents exhibit greater likelihood of activation in the insula while processing anticipation relative to outcome and greater likelihood of activation in the putamen and amygdala during outcome relative to anticipation. While processing positive compared to negative valence, adolescents show increased likelihood for activation in the posterior cingulate cortex (PCC) and ventral striatum. Contrasting adolescent reward processing with the existing ALE of adult reward processing reveals increased likelihood for activation in limbic, frontolimbic, and striatal regions in adolescents compared with adults. Unlike adolescents, adults also activate executive control regions of the frontal and parietal lobes. These findings support hypothesized elevations in motivated activity during adolescence.

  6. Interactivity and reward-related neural activation during a serious videogame.

    Directory of Open Access Journals (Sweden)

    Steven W Cole

    Full Text Available This study sought to determine whether playing a "serious" interactive digital game (IDG--the Re-Mission videogame for cancer patients--activates mesolimbic neural circuits associated with incentive motivation, and if so, whether such effects stem from the participatory aspects of interactive gameplay, or from the complex sensory/perceptual engagement generated by its dynamic event-stream. Healthy undergraduates were randomized to groups in which they were scanned with functional magnetic resonance imaging (FMRI as they either actively played Re-Mission or as they passively observed a gameplay audio-visual stream generated by a yoked active group subject. Onset of interactive game play robustly activated mesolimbic projection regions including the caudate nucleus and nucleus accumbens, as well as a subregion of the parahippocampal gyrus. During interactive gameplay, subjects showed extended activation of the thalamus, anterior insula, putamen, and motor-related regions, accompanied by decreased activation in parietal and medial prefrontal cortex. Offset of interactive gameplay activated the anterior insula and anterior cingulate. Between-group comparisons of within-subject contrasts confirmed that mesolimbic activation was significantly more pronounced in the active playgroup than in the passive exposure control group. Individual difference analyses also found the magnitude of parahippocampal activation following gameplay onset to correlate with positive attitudes toward chemotherapy assessed both at the end of the scanning session and at an unannounced one-month follow-up. These findings suggest that IDG-induced activation of reward-related mesolimbic neural circuits stems primarily from participatory engagement in gameplay (interactivity, rather than from the effects of vivid and dynamic sensory stimulation.

  7. Interactivity and reward-related neural activation during a serious videogame.

    Science.gov (United States)

    Cole, Steven W; Yoo, Daniel J; Knutson, Brian

    2012-01-01

    This study sought to determine whether playing a "serious" interactive digital game (IDG)--the Re-Mission videogame for cancer patients--activates mesolimbic neural circuits associated with incentive motivation, and if so, whether such effects stem from the participatory aspects of interactive gameplay, or from the complex sensory/perceptual engagement generated by its dynamic event-stream. Healthy undergraduates were randomized to groups in which they were scanned with functional magnetic resonance imaging (FMRI) as they either actively played Re-Mission or as they passively observed a gameplay audio-visual stream generated by a yoked active group subject. Onset of interactive game play robustly activated mesolimbic projection regions including the caudate nucleus and nucleus accumbens, as well as a subregion of the parahippocampal gyrus. During interactive gameplay, subjects showed extended activation of the thalamus, anterior insula, putamen, and motor-related regions, accompanied by decreased activation in parietal and medial prefrontal cortex. Offset of interactive gameplay activated the anterior insula and anterior cingulate. Between-group comparisons of within-subject contrasts confirmed that mesolimbic activation was significantly more pronounced in the active playgroup than in the passive exposure control group. Individual difference analyses also found the magnitude of parahippocampal activation following gameplay onset to correlate with positive attitudes toward chemotherapy assessed both at the end of the scanning session and at an unannounced one-month follow-up. These findings suggest that IDG-induced activation of reward-related mesolimbic neural circuits stems primarily from participatory engagement in gameplay (interactivity), rather than from the effects of vivid and dynamic sensory stimulation.

  8. Neural processing of reward in adolescent rodents

    Directory of Open Access Journals (Sweden)

    Nicholas W. Simon

    2015-02-01

    Full Text Available Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.

  9. Preliminary Evidence for Impaired Brain Activity of Neural Reward Processing in Children and Adolescents with Reactive Attachment Disorder.

    Science.gov (United States)

    Tomoda, Akemi

    2016-01-01

    Childhood maltreatment, which markedly increases risks for psychopathology, is associated with structural and functional brain differences. Especially, exposure to parental verbal abuse (PVA) or interparental violence during childhood is associated with negative outcomes such as depression, posttraumatic stress disorder (PTSD), and reduced cognitive abilities. Other forms of childhood maltreatment have been associated with brain structure or developmental alteration. Our earlier studies elucidated potential discernible effects of PVA and witnessing domestic violence during childhood on brain morphology, including gray matter volume or cortical thickness. Brain regions that process and convey the adverse sensory input of the abuse might be modified specifically by such experiences, particularly in subjects exposed to a single type of maltreatment. Exposure to multiple types of maltreatment is more commonly associated with morphological alterations in the corticolimbic regions. These findings fit with preclinical studies showing that sensory cortices are highly plastic structures. Using tasks with high and low monetary rewards while subjects underwent functional MRI, we also examined whether neural activity during reward processing was altered, or not, in children and adolescents with reactive attachment disorder (RAD). Significantly reduced activity in the caudate and nucleus accumbens was observed during a high monetary reward condition in the RAD group compared to the typically developed group. The striatal neural reward activity in the RAD group was also markedly decreased. The present results suggest that dopaminergic dysfunction occurred in the striatum in children and adolescents with RAD, potentially leading to a future risk of psychiatric disorders such as dependence.

  10. Differentiating neural reward responsiveness in autism versus ADHD

    Directory of Open Access Journals (Sweden)

    Gregor Kohls

    2014-10-01

    Full Text Available Although attention deficit hyperactivity disorders (ADHD and autism spectrum disorders (ASD share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC. A significant group by reward type interaction effect emerged in the ventral striatum with greater activation to monetary versus social reward only in TDC, whereas subjects with ADHD responded equally strong to both reward types, and subjects with ASD showed low striatal reactivity across both reward conditions. Moreover, disorder-specific neural abnormalities were revealed, including medial prefrontal hyperactivation in response to social reward in ADHD versus ventral striatal hypoactivation in response to monetary reward in ASD. Shared dysfunction was characterized by fronto-striato-parietal hypoactivation in both clinical groups when money was at stake. Interestingly, lower neural activation within parietal circuitry was associated with higher autistic traits across the entire study sample. In sum, the present findings concur with the assumption that both ASD and ADHD display distinct and shared neural dysfunction in response to reward.

  11. Neural response to reward anticipation is modulated by Gray's impulsivity.

    Science.gov (United States)

    Hahn, Tim; Dresler, Thomas; Ehlis, Ann-Christine; Plichta, Michael M; Heinzel, Sebastian; Polak, Thomas; Lesch, Klaus-Peter; Breuer, Felix; Jakob, Peter M; Fallgatter, Andreas J

    2009-07-15

    According to the Reinforcement Sensitivity Theory (RST), Gray's dimension of impulsivity, reflecting human trait reward sensitivity, determines the extent to which stimuli activate the Behavioural Approach System (BAS). The potential neural underpinnings of the BAS, however, remain poorly understood. In the present study, we examined the association between Gray's impulsivity as defined by the RST and event-related fMRI BOLD-response to anticipation of reward in twenty healthy human subjects in brain regions previously associated with reward processing. Anticipation of reward during a Monetary Incentive Delay Task elicited activation in key components of the human reward circuitry such as the ventral striatum, the amygdala and the orbitofrontal cortex. Interindividual differences in Gray's impulsivity accounted for a significant amount of variance of the reward-related BOLD-response in the ventral striatum and the orbitofrontal cortex. Specifically, higher trait reward sensitivity was associated with increased activation in response to cues indicating potential reward. Extending previous evidence, here we show that variance in functional brain activation during anticipation of reward is attributed to interindividual differences regarding Gray's dimension of impulsivity. Thus, trait reward sensitivity contributes to the modulation of responsiveness in major components of the human reward system which thereby display a core property of the BAS. Generally, fostering our understanding of the neural underpinnings of the association of reward-related interindividual differences in affective traits might aid researchers in quest for custom-tailored treatments of psychiatric disorders, further disentangling the complex relationship between personality traits, emotion, and health.

  12. Stress and CRF gate neural activation of BDNF in the mesolimbic reward pathway.

    Science.gov (United States)

    Walsh, Jessica J; Friedman, Allyson K; Sun, Haosheng; Heller, Elizabeth A; Ku, Stacy M; Juarez, Barbara; Burnham, Veronica L; Mazei-Robison, Michelle S; Ferguson, Deveroux; Golden, Sam A; Koo, Ja Wook; Chaudhury, Dipesh; Christoffel, Daniel J; Pomeranz, Lisa; Friedman, Jeffrey M; Russo, Scott J; Nestler, Eric J; Han, Ming-Hu

    2014-01-01

    Mechanisms controlling release of brain-derived neurotrophic factor (BDNF) in the mesolimbic dopamine reward pathway remain unknown. We report that phasic optogenetic activation of this pathway increases BDNF amounts in the nucleus accumbens (NAc) of socially stressed mice but not of stress-naive mice. This stress gating of BDNF signaling is mediated by corticotrophin-releasing factor (CRF) acting in the NAc. These results unravel a stress context-detecting function of the brain's mesolimbic circuit.

  13. Effects of selective serotonin reuptake inhibition on neural activity related to risky decisions and monetary rewards in healthy males

    DEFF Research Database (Denmark)

    Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E

    2014-01-01

    Selective serotonin reuptake inhibitors (SSRIs) such as fluoxetine are commonly prescribed antidepressant drugs targeting the dysfunctional serotonin (5-HT) system, yet little is known about the functional effects of prolonged serotonin reuptake inhibition in healthy individuals. Here we used...... functional MRI (fMRI) to investigate how a three-week fluoxetine intervention influences neural activity related to risk taking and reward processing. Employing a double-blinded parallel-group design, 29 healthy young males were randomly assigned to receive 3 weeks of a daily dose of 40 mg fluoxetine...

  14. Motivational orientation modulates the neural response to reward.

    Science.gov (United States)

    Linke, Julia; Kirsch, Peter; King, Andrea V; Gass, Achim; Hennerici, Michael G; Bongers, André; Wessa, Michèle

    2010-02-01

    Motivational orientation defines the source of motivation for an individual to perform a particular action and can either originate from internal desires (e.g., interest) or external compensation (e.g., money). To this end, motivational orientation should influence the way positive or negative feedback is processed during learning situations and this might in turn have an impact on the learning process. In the present study, we thus investigated whether motivational orientation, i.e., extrinsic and intrinsic motivation modulates the neural response to reward and punishment as well as learning from reward and punishment in 33 healthy individuals. To assess neural responses to reward, punishment and learning of reward contingencies we employed a probabilistic reversal learning task during functional magnetic resonance imaging. Extrinsic and intrinsic motivation were assessed with a self-report questionnaire. Rewarding trials fostered activation in the medial orbitofrontal cortex and anterior cingulate gyrus (ACC) as well as the amygdala and nucleus accumbens, whereas for punishment an increased neural response was observed in the medial and inferior prefrontal cortex, the superior parietal cortex and the insula. High extrinsic motivation was positively correlated to increased neural responses to reward in the ACC, amygdala and putamen, whereas a negative relationship between intrinsic motivation and brain activation in these brain regions was observed. These findings show that motivational orientation indeed modulates the responsiveness to reward delivery in major components of the human reward system and therefore extends previous results showing a significant influence of individual differences in reward-related personality traits on the neural processing of reward.

  15. Acute Stress Influences Neural Circuits of Reward Processing

    Directory of Open Access Journals (Sweden)

    Anthony John Porcelli

    2012-11-01

    Full Text Available People often make decisions under aversive conditions such as acute stress. Yet, less is known about the process in which acute stress can influence decision-making. A growing body of research has established that reward-related information associated with the outcomes of decisions exerts a powerful influence over the choices people make and that an extensive network of brain regions, prominently featuring the striatum, is involved in the processing of this reward-related information. Thus, an important step in research on the nature of acute stress’ influence over decision-making is to examine how it may modulate responses to rewards and punishments within reward-processing neural circuitry. In the current experiment, we employed a simple reward processing paradigm – where participants received monetary rewards and punishments – known to evoke robust striatal responses. Immediately prior to performing each of two task runs, participants were exposed to acute stress (i.e., cold pressor or a no stress control procedure in a between-subjects fashion. No stress group participants exhibited a pattern of activity within the dorsal striatum and orbitofrontal cortex consistent with past research on outcome processing – specifically, differential responses for monetary rewards over punishments. In contrast, acute stress group participants’ dorsal striatum and orbitofrontal cortex demonstrated decreased sensitivity to monetary outcomes and a lack of differential activity. These findings provide insight into how neural circuits may process rewards and punishments associated with simple decisions under acutely stressful conditions.

  16. Reward-related neural responses are dependent on the beneficiary.

    Science.gov (United States)

    Braams, Barbara R; Güroğlu, Berna; de Water, Erik; Meuwese, Rosa; Koolschijn, P Cédric; Peper, Jiska S; Crone, Eveline A

    2014-07-01

    Prior studies have suggested that positive social interactions are experienced as rewarding. Yet, it is not well understood how social relationships influence neural responses to other persons' gains. In this study, we investigated neural responses during a gambling task in which healthy participants (N = 31; 18 females) could win or lose money for themselves, their best friend or a disliked other (antagonist). At the moment of receiving outcome, person-related activity was observed in the dorsal medial prefrontal cortex (dmPFC), precuneus and temporal parietal junction (TPJ), showing higher activity for friends and antagonists than for self, and this activity was independent of outcome. The only region showing an interaction between the person-participants played for and outcome was the ventral striatum. Specifically, the striatum was more active following gains than losses for self and friends, whereas for the antagonist this pattern was reversed. Together, these results show that, in a context with social and reward information, social aspects are processed in brain regions associated with social cognition (mPFC, TPJ), and reward aspects are processed in primary reward areas (striatum). Furthermore, there is an interaction of social and reward information in the striatum, such that reward-related activity was dependent on social relationship.

  17. RM-SORN: a reward-modulated self-organizing recurrent neural network.

    Science.gov (United States)

    Aswolinskiy, Witali; Pipa, Gordon

    2015-01-01

    Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain.

  18. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

    Science.gov (United States)

    Schultz, Wolfram

    2004-04-01

    Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.

  19. Neural dissociation of food- and money-related reward processing using an abstract incentive delay task.

    Science.gov (United States)

    Simon, Joe J; Skunde, Mandy; Wu, Mudan; Schnell, Knut; Herpertz, Sabine C; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

    2015-08-01

    Food is an innate reward stimulus related to energy homeostasis and survival, whereas money is considered a more general reward stimulus that gains a rewarding value through learning experiences. Although the underlying neural processing for both modalities of reward has been investigated independently from one another, a more detailed investigation of neural similarities and/or differences between food and monetary reward is still missing. Here, we investigated the neural processing of food compared with monetary-related rewards in 27 healthy, normal-weight women using functional magnetic resonance imaging. We developed a task distinguishing between the anticipation and the receipt of either abstract food or monetary reward. Both tasks activated the ventral striatum during the expectation of a reward. Compared with money, greater food-related activations were observed in prefrontal, parietal and central midline structures during the anticipation and lateral orbitofrontal cortex (lOFC) during the receipt of food reward. Furthermore, during the receipt of food reward, brain activation in the secondary taste cortex was positively related to the body mass index. These results indicate that food-dependent activations encompass to a greater extent brain regions involved in self-control and self-reflection during the anticipation and phylogenetically older parts of the lOFC during the receipt of reward.

  20. Neural correlates of reward and loss sensitivity in psychopathy.

    Science.gov (United States)

    Pujara, Maia; Motzkin, Julian C; Newman, Joseph P; Kiehl, Kent A; Koenigs, Michael

    2014-06-01

    Psychopathy is a personality disorder associated with callous and impulsive behavior and criminal recidivism. It has long been theorized that psychopaths have deficits in processing reward and punishment. Here, we use structural and functional magnetic resonance imaging to examine the neural correlates of reward and loss sensitivity in a group of criminal psychopaths. Forty-one adult male prison inmates (n = 18 psychopaths and n = 23 non-psychopaths) completed a functional magnetic resonance imaging task involving the gain or loss of money. Across the entire sample of participants, monetary gains elicited robust activation within the ventral striatum (VS). Although psychopaths and non-psychopaths did not significantly differ with respect to overall levels of VS response to reward vs loss, we observed significantly different correlations between VS responses and psychopathy severity within each group. Volumetric analyses of striatal subregions revealed a similar pattern of correlations, specifically for the right accumbens area within VS. In a separate sample of inmates (n = 93 psychopaths and n = 117 non-psychopaths) who completed a self-report measure of appetitive motivation, we again found that the correlation with psychopathy severity differed between groups. These convergent results offer novel insight into the neural substrates of reward and loss processing in psychopathy.

  1. Relief as a reward: hedonic and neural responses to safety from pain.

    Directory of Open Access Journals (Sweden)

    Siri Leknes

    Full Text Available Relief fits the definition of a reward. Unlike other reward types the pleasantness of relief depends on the violation of a negative expectation, yet this has not been investigated using neuroimaging approaches. We hypothesized that the degree of negative expectation depends on state (dread and trait (pessimism sensitivity. Of the brain regions that are involved in mediating pleasure, the nucleus accumbens also signals unexpected reward and positive prediction error. We hypothesized that accumbens activity reflects the level of negative expectation and subsequent pleasant relief. Using fMRI and two purpose-made tasks, we compared hedonic and BOLD responses to relief with responses during an appetitive reward task in 18 healthy volunteers. We expected some similarities in task responses, reflecting common neural substrates implicated across reward types. However, we also hypothesized that relief responses would differ from appetitive rewards in the nucleus accumbens, since only relief pleasantness depends on negative expectations. The results confirmed these hypotheses. Relief and appetitive reward task activity converged in the ventromedial prefrontal cortex, which also correlated with appetitive reward pleasantness ratings. In contrast, dread and pessimism scores correlated with relief but not with appetitive reward hedonics. Moreover, only relief pleasantness covaried with accumbens activation. Importantly, the accumbens signal appeared to specifically reflect individual differences in anticipation of the adverse event (dread, pessimism but was uncorrelated to appetitive reward hedonics. In conclusion, relief differs from appetitive rewards due to its reliance on negative expectations, the violation of which is reflected in relief-related accumbens activation.

  2. Relief as a Reward: Hedonic and Neural Responses to Safety from Pain

    Science.gov (United States)

    Leknes, Siri; Lee, Michael; Berna, Chantal; Andersson, Jesper; Tracey, Irene

    2011-01-01

    Relief fits the definition of a reward. Unlike other reward types the pleasantness of relief depends on the violation of a negative expectation, yet this has not been investigated using neuroimaging approaches. We hypothesized that the degree of negative expectation depends on state (dread) and trait (pessimism) sensitivity. Of the brain regions that are involved in mediating pleasure, the nucleus accumbens also signals unexpected reward and positive prediction error. We hypothesized that accumbens activity reflects the level of negative expectation and subsequent pleasant relief. Using fMRI and two purpose-made tasks, we compared hedonic and BOLD responses to relief with responses during an appetitive reward task in 18 healthy volunteers. We expected some similarities in task responses, reflecting common neural substrates implicated across reward types. However, we also hypothesized that relief responses would differ from appetitive rewards in the nucleus accumbens, since only relief pleasantness depends on negative expectations. The results confirmed these hypotheses. Relief and appetitive reward task activity converged in the ventromedial prefrontal cortex, which also correlated with appetitive reward pleasantness ratings. In contrast, dread and pessimism scores correlated with relief but not with appetitive reward hedonics. Moreover, only relief pleasantness covaried with accumbens activation. Importantly, the accumbens signal appeared to specifically reflect individual differences in anticipation of the adverse event (dread, pessimism) but was uncorrelated to appetitive reward hedonics. In conclusion, relief differs from appetitive rewards due to its reliance on negative expectations, the violation of which is reflected in relief-related accumbens activation. PMID:21490964

  3. Non-reward neural mechanisms in the orbitofrontal cortex.

    Science.gov (United States)

    Rolls, Edmund T; Deco, Gustavo

    2016-10-01

    Single neurons in the primate orbitofrontal cortex respond when an expected reward is not obtained, and behaviour must change. The human lateral orbitofrontal cortex is activated when non-reward, or loss occurs. The neuronal computation of this negative reward prediction error is fundamental for the emotional changes associated with non-reward, and with changing behaviour. Little is known about the neuronal mechanism. Here we propose a mechanism, which we formalize into a neuronal network model, which is simulated to enable the operation of the mechanism to be investigated. A single attractor network has a reward population (or pool) of neurons that is activated by expected reward, and maintain their firing until, after a time, synaptic depression reduces the firing rate in this neuronal population. If a reward outcome is not received, the decreasing firing in the reward neurons releases the inhibition implemented by inhibitory neurons, and this results in a second population of non-reward neurons to start and continue firing encouraged by the spiking-related noise in the network. If a reward outcome is received, this keeps the reward attractor active, and this through the inhibitory neurons prevents the non-reward attractor neurons from being activated. If an expected reward has been signalled, and the reward attractor neurons are active, their firing can be directly inhibited by a non-reward outcome, and the non-reward neurons become activated because the inhibition on them is released. The neuronal mechanisms in the orbitofrontal cortex for computing negative reward prediction error are important, for this system may be over-reactive in depression, under-reactive in impulsive behaviour, and may influence the dopaminergic 'prediction error' neurons.

  4. Response of neural reward regions to food cues in autism spectrum disorders

    Directory of Open Access Journals (Sweden)

    Cascio Carissa J

    2012-05-01

    Full Text Available Abstract Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our understanding of neural reward circuitry in ASD includes a characterization of the neural response to primary rewards. Method We asked 17 children with ASD and 18 children without ASD to abstain from eating for at least four hours before an MRI scan in which they viewed images of high-calorie foods. We assessed the neural reward network for increases in the blood oxygenation level dependent (BOLD signal in response to the food images Results We found very similar patterns of increased BOLD signal to these images in the two groups; both groups showed increased BOLD signal in the bilateral amygdala, as well as in the nucleus accumbens, orbitofrontal cortex, and insula. Direct group comparisons revealed that the ASD group showed a stronger response to food cues in bilateral insula along the anterior-posterior gradient and in the anterior cingulate cortex than the control group, whereas there were no neural reward regions that showed higher activation for controls than for ASD. Conclusion These results suggest that neural response to primary rewards is not diminished but in fact shows an aberrant enhancement in children with ASD.

  5. Neural evidence reveals the rapid effects of reward history on selective attention.

    Science.gov (United States)

    MacLean, Mary H; Giesbrecht, Barry

    2015-05-05

    Selective attention is often framed as being primarily driven by two factors: task-relevance and physical salience. However, factors like selection and reward history, which are neither currently task-relevant nor physically salient, can reliably and persistently influence visual selective attention. The current study investigated the nature of the persistent effects of irrelevant, physically non-salient, reward-associated features. These features affected one of the earliest reliable neural indicators of visual selective attention in humans, the P1 event-related potential, measured one week after the reward associations were learned. However, the effects of reward history were moderated by current task demands. The modulation of visually evoked activity supports the hypothesis that reward history influences the innate salience of reward associated features, such that even when no longer relevant, nor physically salient, these features have a rapid, persistent, and robust effect on early visual selective attention.

  6. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function.

    Science.gov (United States)

    Subramaniam, Karuna; Hooker, Christine I; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

    2015-01-01

    Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal-striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal-striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.

  7. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function

    Directory of Open Access Journals (Sweden)

    Karuna Subramaniam

    2015-01-01

    Full Text Available Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC participants, reward anticipation is associated with activity in frontal–striatal networks. By contrast, schizophrenia (SZ participants show hypoactivation within these frontal–striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.

  8. Impaired neural reward processing in children and adolescents with reactive attachment disorder: A pilot study.

    Science.gov (United States)

    Mizuno, Kei; Takiguchi, Shinichiro; Yamazaki, Mika; Asano, Mizuki; Kato, Shiho; Kuriyama, Kikuko; Watanabe, Yasuyoshi; Sadato, Norihiro; Tomoda, Akemi

    2015-10-01

    Reactive attachment disorder (RAD) is characterized by markedly disturbed and developmentally inappropriate social relatedness due to parental maltreatment. RAD patients often display a high number of comorbid attention deficit/hyperactivity disorder (ADHD) symptoms, and certain RAD symptoms are difficult to discriminate from ADHD. One of the core characteristics of ADHD is a decrease in neural reward processing due to dopamine dysfunction. The aim of the present study was to determine whether the brain activity involved in reward processing in RAD patients is impaired in comparison with ADHD patients and typically developed controls. Five RAD patients, 17 typically developed (TD) controls and 17 ADHD patients aged 10-16 years performed tasks with high and low monetary reward while undergoing functional magnetic resonance imaging. ADHD patients were tested before and after 3 months treatment with osmotic release oral system-methylphenidate. Before treatment, ADHD patients showed that striatal and thalamus activities only in the tasks with low monetary reward were lower than TD controls. RAD patients showed decrease in activity of the caudate, putamen and thalamus during both the high and low monetary reward conditions in comparison with all the other groups. In RAD patients, the activity of the putamen was associated with the severity of posttraumatic stress and overt dissociation. Reward sensitivity was markedly decreased in children and adolescents with RAD, as evidenced by a diminished neural response during reward perception. This suggests that dopaminergic dysfunction exists in these patients, and may inform future dopaminergic treatment strategies for RAD.

  9. Fairness influences early signatures of reward-related neural processing.

    Science.gov (United States)

    Massi, Bart; Luhmann, Christian C

    2015-12-01

    Many humans exhibit a strong preference for fairness during decision-making. Although there is evidence that social factors influence reward-related and affective neural processing, it is unclear if this effect is mediated by compulsory outcome evaluation processes or results from slower deliberate cognition. Here we show that the feedback-related negativity (FRN) and late positive potential (LPP), two signatures of early hedonic processing, are modulated by the fairness of rewards during a passive rating task. We find that unfair payouts elicit larger FRNs than fair payouts, whereas fair payouts elicit larger LPPs than unfair payouts. This is true both in the time-domain, where the FRN and LPP are related, and in the time-frequency domain, where the two signals are largely independent. Ultimately, this work demonstrates that fairness affects the early stages of reward and affective processing, suggesting a common biological mechanism for social and personal reward evaluation.

  10. Neural basis of reward anticipation and its genetic determinants.

    Science.gov (United States)

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-04-05

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature.

  11. Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning.

    Science.gov (United States)

    Daniel, Reka; Pollmann, Stefan

    2010-01-06

    The dopaminergic system is known to play a central role in reward-based learning (Schultz, 2006), yet it was also observed to be involved when only cognitive feedback is given (Aron et al., 2004). Within the domain of information-integration category learning, in which information from several stimulus dimensions has to be integrated predecisionally (Ashby and Maddox, 2005), the importance of contingent feedback is well established (Maddox et al., 2003). We examined the common neural correlates of reward anticipation and prediction error in this task. Sixteen subjects performed two parallel information-integration tasks within a single event-related functional magnetic resonance imaging session but received a monetary reward only for one of them. Similar functional areas including basal ganglia structures were activated in both task versions. In contrast, a single structure, the nucleus accumbens, showed higher activation during monetary reward anticipation compared with the anticipation of cognitive feedback in information-integration learning. Additionally, this activation was predicted by measures of intrinsic motivation in the cognitive feedback task and by measures of extrinsic motivation in the rewarded task. Our results indicate that, although all other structures implicated in category learning are not significantly affected by altering the type of reward, the nucleus accumbens responds to the positive incentive properties of an expected reward depending on the specific type of the reward.

  12. Perceptions of moral character modulate the neural systems of reward during the trust game.

    Science.gov (United States)

    Delgado, M R; Frank, R H; Phelps, E A

    2005-11-01

    Studies of reward learning have implicated the striatum as part of a neural circuit that guides and adjusts future behavior on the basis of reward feedback. Here we investigate whether prior social and moral information about potential trading partners affects this neural circuitry. Participants made risky choices about whether to trust hypothetical trading partners after having read vivid descriptions of life events indicating praiseworthy, neutral or suspect moral character. Despite equivalent reinforcement rates for all partners, participants were persistently more likely to make risky choices with the 'good' partner. As expected from previous studies, activation of the caudate nucleus differentiated between positive and negative feedback, but only for the 'neutral' partner. Notably, it did not do so for the 'good' partner and did so only weakly for the 'bad' partner, suggesting that prior social and moral perceptions can diminish reliance on feedback mechanisms in the neural circuitry of trial-and-error reward learning.

  13. What can the monetary incentive delay task tell us about the neural processing of reward and punishment?

    Directory of Open Access Journals (Sweden)

    Lutz K

    2014-04-01

    Full Text Available Kai Lutz,1–3 Mario Widmer1,2,41Department of Neurology, University Hospital Zürich, Zürich, 2Cereneo, Center for Neurology and Rehabilitation, Vitznau, 3Division of Neuropsychology, Institute of Psychology, University of Zürich, Zürich, 4Neural Control of Movement Lab, ETH Zürich, Zürich, SwitzerlandAbstract: Since its introduction in 2000, the monetary incentive delay (MID task has been used extensively to investigate changes in neural activity in response to the processing of reward and punishment in healthy, but also in clinical populations. Typically, the MID task requires an individual to react to a target stimulus presented after an incentive cue to win or to avoid losing the indicated reward. In doing so, this paradigm allows the detailed examination of different stages of reward processing like reward prediction, anticipation, outcome processing, and consumption as well as the processing of tasks under different reward conditions. This review gives an overview of different utilizations of the MID task by outlining the neuronal processes involved in distinct aspects of human reward processing, such as anticipation versus consumption, reward versus punishment, and, with a special focus, reward-based learning processes. Furthermore, literature on specific influences on reward processing like behavioral, clinical and developmental influences, is reviewed, describing current findings and possible future directions.Keywords: reward, punishment, dopamine, reward system

  14. Adolescent behavioral and neural reward sensitivity: a test of the differential susceptibility theory

    Science.gov (United States)

    Richards, J S; Arias Vásquez, A; von Rhein, D; van der Meer, D; Franke, B; Hoekstra, P J; Heslenfeld, D J; Oosterlaan, J; Faraone, S V; Buitelaar, J K; Hartman, C A

    2016-01-01

    Little is known about the causes of individual differences in reward sensitivity. We investigated gene–environment interactions (GxE) on behavioral and neural measures of reward sensitivity, in light of the differential susceptibility theory. This theory states that individuals carrying plasticity gene variants will be more disadvantaged in negative, but more advantaged in positive environments. Reward responses were assessed during a monetary incentive delay task in 178 participants with and 265 without attention-deficit/hyperactivity disorder (ADHD), from N=261 families. We examined interactions between variants in candidate plasticity genes (DAT1, 5-HTT and DRD4) and social environments (maternal expressed emotion and peer affiliation). HTTLPR short allele carriers showed the least reward speeding when exposed to high positive peer affiliation, but the most when faced with low positive peer affiliation or low maternal warmth. DAT1 10-repeat homozygotes displayed similar GxE patterns toward maternal warmth on general task performance. At the neural level, DRD4 7-repeat carriers showed the least striatal activation during reward anticipation when exposed to high maternal warmth, but the most when exposed to low warmth. Findings were independent of ADHD severity. Our results partially confirm the differential susceptibility theory and indicate the importance of positive social environments in reward sensitivity and general task performance for persons with specific genotypes. PMID:27045841

  15. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain.

    Science.gov (United States)

    Kim, Hackjin; Shimojo, Shinsuke; O'Doherty, John P

    2006-07-01

    Avoidance learning poses a challenge for reinforcement-based theories of instrumental conditioning, because once an aversive outcome is successfully avoided an individual may no longer experience extrinsic reinforcement for their behavior. One possible account for this is to propose that avoiding an aversive outcome is in itself a reward, and thus avoidance behavior is positively reinforced on each trial when the aversive outcome is successfully avoided. In the present study we aimed to test this possibility by determining whether avoidance of an aversive outcome recruits the same neural circuitry as that elicited by a reward itself. We scanned 16 human participants with functional MRI while they performed an instrumental choice task, in which on each trial they chose from one of two actions in order to either win money or else avoid losing money. Neural activity in a region previously implicated in encoding stimulus reward value, the medial orbitofrontal cortex, was found to increase, not only following receipt of reward, but also following successful avoidance of an aversive outcome. This neural signal may itself act as an intrinsic reward, thereby serving to reinforce actions during instrumental avoidance.

  16. Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards.

    Science.gov (United States)

    Miyazaki, Kayoko W; Miyazaki, Katsuhiko; Doya, Kenji

    2012-08-01

    The forebrain serotonergic system is a crucial component in the control of impulsive behaviors. We previously reported that the activity of serotonin neurons in the midbrain dorsal raphe nucleus increased when rats performed a task that required them to wait for delayed rewards. However, the causal relationship between serotonin neural activity and the tolerance for the delayed reward remained unclear. Here, we test whether the inhibition of serotonin neural activity by the local application of the 5-HT(1A) receptor agonist 8-hydroxy-2-(di-n-propylamino) tetralin in the dorsal raphe nucleus impairs rats' tolerance for delayed rewards. Rats performed a sequential food-water navigation task that required them to visit food and water sites alternately via a tone site to get rewards at both sites after delays. During the short (2 s) delayed reward condition, the inhibition of serotonin neural activity did not significantly influence the numbers of reward choice errors (nosepoke at an incorrect reward site following a conditioned reinforcer tone), reward wait errors (failure to wait for the delayed rewards), or total trials (sum of reward choice errors, reward wait errors, and acquired rewards). By contrast, during the long (7-11 s) delayed reward condition, the number of wait errors significantly increased while the numbers of total trials and choice errors did not significantly change. These results indicate that the activation of dorsal raphe serotonin neurons is necessary for waiting for long delayed rewards and suggest that elevated serotonin activity facilitates waiting behavior when there is the prospect of forthcoming rewards.

  17. Dynamics of neural coding in the accumbens during extinction and reinstatement of rewarded behavior.

    Science.gov (United States)

    Janak, Patricia H; Chen, Ming-Teh; Caulder, Tara

    2004-09-23

    Neural correlates of reward-seeking behavior are observed in the nucleus accumbens (NAC). The dependence of these correlates upon the presence of a reward was studied by comparing the behavioral correlates observed when the presence of the reward was manipulated within a single behavioral session. Rats were well-trained on a continuous reinforcement instrumental task reinforced by 0.1 ml drops of 5% sucrose. Extracellular single-unit neural activity was recorded from electrode arrays implanted into the NAC when instrumental behavior was and then was not reinforced with sucrose (within-session extinction). A variable delay between the instrumental response and the sucrose delivery allowed for separation of neural activity related to these task events. A spike activity increase around the time of the instrumental response was the most common behavioral correlate, while a decrease in spike activity upon sucrose delivery was the second most common behavioral correlate. Following removal of the reinforcer, subjects continued to perform the instrumental response, allowing for the examination of response-related spike activity under extinction conditions in which the response was no longer reinforced by sucrose. A majority of the response-related neural activity patterns were lost when sucrose was no longer available. New neural responses also were detected during this period. For some subjects, the reinforcer was again made available during the same session. Encoding of the primary behavioral events during this period of reinstated reinforcer was similar, but not identical, to that observed during the first period of reinforced responding. These findings reveal that instrumental task-associated spike activity within the NAC is partially dependent upon the presence of the reinforcer, and that encoding across the population is distinct under reinforced and extinction conditions.

  18. Neural basis of the undermining effect of monetary reward on intrinsic motivation.

    Science.gov (United States)

    Murayama, Kou; Matsumoto, Madoka; Izuma, Keise; Matsumoto, Kenji

    2010-12-07

    Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This "undermining effect" has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.

  19. Low putamen activity associated with poor reward sensitivity in childhood chronic fatigue syndrome

    Directory of Open Access Journals (Sweden)

    Kei Mizuno, Ph.D.

    2016-01-01

    Full Text Available Motivational signals influence a wide variety of cognitive processes and components of behavioral performance. Cognitive dysfunction in patients with childhood chronic fatigue syndrome (CCFS may be closely associated with a low motivation to learn induced by impaired neural reward processing. However, the extent to which reward processing is impaired in CCFS patients is unclear. The aim of the present functional magnetic resonance imaging (fMRI study was to determine whether brain activity in regions related to reward sensitivity is impaired in CCFS patients. fMRI data were collected from 13 CCFS patients (mean age, 13.6 ± 1.0 years and 13 healthy children and adolescents (HCA (mean age, 13.7 ± 1.3 years performing a monetary reward task. Neural activity in high- and low-monetary-reward conditions was compared between CCFS and HCA groups. Severity of fatigue and the reward obtained from learning in daily life were evaluated by questionnaires. Activity of the putamen was lower in the CCFS group than in the HCA group in the low-reward condition, but not in the high-reward condition. Activity of the putamen in the low-reward condition in CCFS patients was negatively and positively correlated with severity of fatigue and the reward from learning in daily life, respectively. We previously revealed that motivation to learn was correlated with striatal activity, particularly the neural activity in the putamen. This suggests that in CCFS patients low putamen activity, associated with altered dopaminergic function, decreases reward sensitivity and lowers motivation to learn.

  20. Low putamen activity associated with poor reward sensitivity in childhood chronic fatigue syndrome.

    Science.gov (United States)

    Mizuno, Kei; Kawatani, Junko; Tajima, Kanako; Sasaki, Akihiro T; Yoneda, Tetsuya; Komi, Masanori; Hirai, Toshinori; Tomoda, Akemi; Joudoi, Takako; Watanabe, Yasuyoshi

    2016-01-01

    Motivational signals influence a wide variety of cognitive processes and components of behavioral performance. Cognitive dysfunction in patients with childhood chronic fatigue syndrome (CCFS) may be closely associated with a low motivation to learn induced by impaired neural reward processing. However, the extent to which reward processing is impaired in CCFS patients is unclear. The aim of the present functional magnetic resonance imaging (fMRI) study was to determine whether brain activity in regions related to reward sensitivity is impaired in CCFS patients. fMRI data were collected from 13 CCFS patients (mean age, 13.6 ± 1.0 years) and 13 healthy children and adolescents (HCA) (mean age, 13.7 ± 1.3 years) performing a monetary reward task. Neural activity in high- and low-monetary-reward conditions was compared between CCFS and HCA groups. Severity of fatigue and the reward obtained from learning in daily life were evaluated by questionnaires. Activity of the putamen was lower in the CCFS group than in the HCA group in the low-reward condition, but not in the high-reward condition. Activity of the putamen in the low-reward condition in CCFS patients was negatively and positively correlated with severity of fatigue and the reward from learning in daily life, respectively. We previously revealed that motivation to learn was correlated with striatal activity, particularly the neural activity in the putamen. This suggests that in CCFS patients low putamen activity, associated with altered dopaminergic function, decreases reward sensitivity and lowers motivation to learn.

  1. BAS-drive trait modulates dorsomedial striatum activity during reward response-outcome associations.

    Science.gov (United States)

    Costumero, Víctor; Barrós-Loscertales, Alfonso; Fuentes, Paola; Rosell-Negre, Patricia; Bustamante, Juan Carlos; Ávila, César

    2016-09-01

    According to the Reinforcement Sensitivity Theory, behavioral studies have found that individuals with stronger reward sensitivity easily detect cues of reward and establish faster associations between instrumental responses and reward. Neuroimaging studies have shown that processing anticipatory cues of reward is accompanied by stronger ventral striatum activity in individuals with stronger reward sensitivity. Even though establishing response-outcome contingencies has been consistently associated with dorsal striatum, individual differences in this process are poorly understood. Here, we aimed to study the relation between reward sensitivity and brain activity while processing response-reward contingencies. Forty-five participants completed the BIS/BAS questionnaire and performed a gambling task paradigm in which they received monetary rewards or punishments. Overall, our task replicated previous results that have related processing high reward outcomes with activation of striatum and medial frontal areas, whereas processing high punishment outcomes was associated with stronger activity in insula and middle cingulate. As expected, the individual differences in the activity of dorsomedial striatum correlated positively with BAS-Drive. Our results agree with previous studies that have related the dorsomedial striatum with instrumental performance, and suggest that the individual differences in this area may form part of the neural substrate responsible for modulating instrumental conditioning by reward sensitivity.

  2. Age associations with neural processing of reward anticipation in adolescents with bipolar disorders.

    Science.gov (United States)

    Urošević, Snežana; Luciana, Monica; Jensen, Jonathan B; Youngstrom, Eric A; Thomas, Kathleen M

    2016-01-01

    Reward/behavioral approach system hypersensitivity is implicated in bipolar disorders (BD) and in normative development during adolescence. Pediatric onset of BD is associated with a more severe illness course. However, little is known about neural processing of rewards in adolescents with BD or developmental (i.e., age) associations with activation of these neural systems. The present study aims to address this knowledge gap. The present sample included 21 adolescents with BD and 26 healthy adolescents, ages 13 to 19. Participants completed a functional magnetic resonance imaging (fMRI) protocol using the Monetary Incentive Delay (MID) task. Behavioral performance was similar between groups. Group differences in BOLD activation during target anticipation and feedback anticipation periods of the task were examined using whole-brain analyses, as were group differences in age effects. During both target anticipation and feedback anticipation, adolescents with BD, compared to adolescents without psychopathology, exhibited decreased engagement of frontal regions involved in cognitive control (i.e., dorsolateral prefrontal cortex). Healthy adolescents exhibited age-related decreases, while adolescents with BD exhibited age-related increases, in activity of other cognitive control frontal areas (i.e., right inferior frontal gyrus), suggesting altered development in the BD group. Longitudinal research is needed to examine potentially abnormal development of cognitive control during reward pursuit in adolescent BD and whether early therapeutic interventions can prevent these potential deviations from normative development.

  3. Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans

    Directory of Open Access Journals (Sweden)

    Julie eThomas

    2013-11-01

    Full Text Available Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies.

  4. Dopamine, reward learning, and active inference

    Directory of Open Access Journals (Sweden)

    Thomas eFitzgerald

    2015-11-01

    Full Text Available Temporal difference learning models propose phasic dopamine signalling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behaviour. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings.

  5. Neural Coding of Reward Magnitude in the Orbitofrontal Cortex of the Rat during a Five-Odor Olfactory Discrimination Task

    Science.gov (United States)

    van Duuren, Esther; Nieto Escamez, Francisco A.; Joosten, Ruud N. J. M. A.; Visser, Rein; Mulder, Antonius B.; Pennartz, Cyriel M. A.

    2007-01-01

    The orbitofrontal cortex (OBFc) has been suggested to code the motivational value of environmental stimuli and to use this information for the flexible guidance of goal-directed behavior. To examine whether information regarding reward prediction is quantitatively represented in the rat OBFc, neural activity was recorded during an olfactory…

  6. Reduced neural response to reward following 7 days treatment with the cannabinoid CB1 antagonist rimonabant in healthy volunteers.

    Science.gov (United States)

    Horder, Jamie; Harmer, Catherine J; Cowen, Philip J; McCabe, Ciara

    2010-09-01

    Reduced subjective experience of reward (anhedonia) is a key symptom of major depression. The anti-obesity drug and cannabinoid type 1 receptor (CB(1)) antagonist, rimonabant, is associated with significant rates of depression and anxiety in clinical use and was recently withdrawn from the market because of these adverse effects. Using a functional magnetic resonance imaging (fMRI) model of reward we hypothesized that rimonabant would impair reward processing. Twenty-two healthy participants were randomly allocated to receive rimonabant (20 mg), or placebo, for 7 d in a double-blind, parallel group design. We used fMRI to measure the neural response to rewarding (sight and/or flavour of chocolate) and aversive (sight of mouldy strawberries and/or an unpleasant strawberry taste) stimuli on the final day of drug treatment. Rimonabant reduced the neural response to chocolate stimuli in key reward areas such as the ventral striatum and the orbitofrontal cortex. Rimonabant also decreased neural responses to the aversive stimulus condition in the caudate nucleus and ventral striatum, but increased lateral orbitofrontal activations to the aversive sight and taste of strawberry condition. Our findings are the first to show that the anti-obesity drug rimonabant inhibits the neural processing of rewarding food stimuli in humans. This plausibly underlies its ability to promote weight loss, but may also indicate a mechanism for inducing anhedonia which could lead to the increased risk of depressive symptomatology seen in clinical use. fMRI may be a useful method of screening novel agents for unwanted effects on reward and associated clinical adverse reactions.

  7. Perceiving active listening activates the reward system and improves the impression of relevant experiences

    OpenAIRE

    Kawamichi, Hiroaki; Yoshihara, Kazufumi; Sasaki, Akihiro T.; Sugawara, Sho K.; Hiroki C Tanabe; Shinohara, Ryoji; Sugisawa, Yuka; Tokutake, Kentaro; Mochizuki, Yukiko; Anme, Tokie; Sadato, Norihiro

    2014-01-01

    Although active listening is an influential behavior, which can affect the social responses of others, the neural correlates underlying its perception have remained unclear. Sensing active listening in social interactions is accompanied by an improvement in the recollected impressions of relevant experiences and is thought to arouse positive feelings. We therefore hypothesized that the recognition of active listening activates the reward system, and that the emotional appraisal of experiences...

  8. Adolescent behavioral and neural reward sensitivity : a test of the differential susceptibility theory

    NARCIS (Netherlands)

    Richards, J. S.; Vasquez, A. Arias; von Rhein, D.; van der Meer, D.; Franke, B.; Hoekstra, P. J.; Heslenfeld, D. J.; Oosterlaan, J.; Faraone, S. V.; Buitelaar, J. K.; Hartman, C. A.

    2016-01-01

    Little is known about the causes of individual differences in reward sensitivity. We investigated gene-environment interactions (GxE) on behavioral and neural measures of reward sensitivity, in light of the differential susceptibility theory. This theory states that individuals carrying plasticity g

  9. Monetary reward suppresses anterior insula activity during social pain.

    Science.gov (United States)

    Cristofori, Irene; Harquel, Sylvain; Isnard, Jean; Mauguière, François; Sirigu, Angela

    2015-12-01

    Social pain after exclusion by others activates brain regions also involved in physical pain. Here we evaluated whether monetary reward could compensate for the negative feeling of social pain in the brain. To address this question we used the unique technique of intracranial electroencephalography in subjects with drug resistant epilepsy. Specifically, we recorded theta activity from intracranial electrodes implanted in the insular cortex while subjects experienced conditions of social inclusion and exclusion associated with monetary gain and loss. Our study confirmed that theta rhythm in the insular cortex is the neural signature of social exclusion. We found that while monetary gain suppresses the effect of social pain in the anterior insula, there is no such effect in the posterior insula. These results imply that the anterior insula can use secondary reward signals to compensate for the negative feeling of social pain. Hence, here we propose that the anterior insula plays a pivotal role in integrating contingencies to update social pain feelings. Finally, the possibility to modulate the theta rhythm through the reward system might open new avenues of research for treating pathologies related to social exclusion.

  10. Increased Neural Responses to Reward in Adolescents and Young Adults With Attention-Deficit/Hyperactivity Disorder and Their Unaffected Siblings

    NARCIS (Netherlands)

    von Rhein, Daniel; Cools, Roshan; Zwiers, Marcel P.; van der Schaaf, Marieke; Franke, Barbara; Luman, Marjolein; Oosterlaan, Jaap; Heslenfeld, Dirk J.; Hoekstra, Pieter J.; Hartman, Catharina A.; Faraone, Stephen V.; van Rooij, Daan; van Dongen, Eelco V.; Lojowska, Maria; Mennes, Maarten; Buitelaar, Jan

    2015-01-01

    Objective: Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is not known whether reward processing is abnor

  11. Choice modulates the neural dynamics of prediction error processing during rewarded learning.

    Science.gov (United States)

    Peterson, David A; Lotz, Daniel T; Halgren, Eric; Sejnowski, Terrence J; Poizner, Howard

    2011-01-15

    Our ability to selectively engage with our environment enables us to guide our learning and to take advantage of its benefits. When facing multiple possible actions, our choices are a critical aspect of learning. In the case of learning from rewarding feedback, there has been substantial theoretical and empirical progress in elucidating the associated behavioral and neural processes, predominantly in terms of a reward prediction error, a measure of the discrepancy between actual versus expected reward. Nevertheless, the distinct influence of choice on prediction error processing and its neural dynamics remains relatively unexplored. In this study we used a novel paradigm to determine how choice influences prediction error processing and to examine whether there are correspondingly distinct neural dynamics. We recorded scalp electroencephalogram while healthy adults were administered a rewarded learning task in which choice trials were intermingled with control trials involving the same stimuli, motor responses, and probabilistic rewards. We used a temporal difference learning model of subjects' trial-by-trial choices to infer subjects' image valuations and corresponding prediction errors. As expected, choices were associated with lower overall prediction error magnitudes, most notably over the course of learning the stimulus-reward contingencies. Choices also induced a higher-amplitude relative positivity in the frontocentral event-related potential about 200 ms after reward signal onset that was negatively correlated with the differential effect of choice on the prediction error. Thus choice influences the neural dynamics associated with how reward signals are processed during learning. Behavioral, computational, and neurobiological models of rewarded learning should therefore accommodate a distinct influence for choice during rewarded learning.

  12. Rewards.

    Science.gov (United States)

    Gunderman, Richard B; Kamer, Aaron P

    2011-05-01

    For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today.

  13. Task-load-dependent activation of dopaminergic midbrain areas in the absence of reward.

    Science.gov (United States)

    Boehler, Carsten N; Hopf, Jens-Max; Krebs, Ruth M; Stoppel, Christian M; Schoenfeld, Mircea A; Heinze, Hans-Jochen; Noesselt, Toemme

    2011-03-30

    Dopamine release in cortical and subcortical structures plays a central role in reward-related neural processes. Within this context, dopaminergic inputs are commonly assumed to play an activating role, facilitating behavioral and cognitive operations necessary to obtain a prospective reward. Here, we provide evidence from human fMRI that this activating role can also be mediated by task-demand-related processes and thus extends beyond situations that only entail extrinsic motivating factors. Using a visual discrimination task in which varying levels of task demands were precued, we found enhanced hemodynamic activity in the substantia nigra (SN) for high task demands in the absence of reward or similar extrinsic motivating factors. This observation thus indicates that the SN can also be activated in an endogenous fashion. In parallel to its role in reward-related processes, reward-independent activation likely serves to recruit the processing resources needed to meet enhanced task demands. Simultaneously, activity in a wide network of cortical and subcortical control regions was enhanced in response to high task demands, whereas areas of the default-mode network were deactivated more strongly. The present observations suggest that the SN represents a core node within a broader neural network that adjusts the amount of available neural and behavioral resources to changing situational opportunities and task requirements, which is often driven by extrinsic factors but can also be controlled endogenously.

  14. Effects of direct social experience on trust decisions and neural reward circuitry

    Directory of Open Access Journals (Sweden)

    Dominic S. Fareri

    2012-10-01

    Full Text Available The human striatum is integral for reward-processing and supports learning by linking experienced outcomes with prior expectations. Recent endeavors implicate the striatum in processing outcomes of social interactions, such as social approval/rejection, as well as in learning reputations of others. Interestingly, social impressions often influence our behavior with others during interactions. Information about an interaction partner’s moral character acquired from biographical information hinders updating of expectations after interactions via top down modulation of reward circuitry. An outstanding question is whether initial impressions formed through experience similarly modulate the ability to update social impressions at the behavioral and neural level. We investigated the role of experienced social information on trust behavior and reward-related BOLD activity. Participants played a computerized ball tossing game with three fictional partners manipulated to be perceived as good, bad or neutral. Participants then played an iterated trust game as investors with these same partners while undergoing fMRI. Unbeknownst to participants, partner behavior in the trust game was random and unrelated to their ball-tossing behavior. Participants’ trust decisions were influenced by their prior experience in the ball tossing game, investing less often with the bad partner compared to the good and neutral. Reinforcement learning models revealed that participants were more sensitive to updating their beliefs about good and bad partners when experiencing outcomes consistent with initial experience. Increased striatal and anterior cingulate BOLD activity for positive versus negative trust game outcomes emerged, which further correlated with model-derived prediction-error (PE learning signals. These results suggest that initial impressions formed from direct social experience can be continually shaped by consistent information through reward learning

  15. Girls’ challenging social experiences in early adolescence predict neural response to rewards and depressive symptoms

    Directory of Open Access Journals (Sweden)

    Melynda D. Casement

    2014-04-01

    Full Text Available Developmental models of psychopathology posit that exposure to social stressors may confer risk for depression in adolescent girls by disrupting neural reward circuitry. The current study tested this hypothesis by examining the relationship between early adolescent social stressors and later neural reward processing and depressive symptoms. Participants were 120 girls from an ongoing longitudinal study of precursors to depression across adolescent development. Low parental warmth, peer victimization, and depressive symptoms were assessed when the girls were 11 and 12 years old, and participants completed a monetary reward guessing fMRI task and assessment of depressive symptoms at age 16. Results indicate that low parental warmth was associated with increased response to potential rewards in the medial prefrontal cortex (mPFC, striatum, and amygdala, whereas peer victimization was associated with decreased response to potential rewards in the mPFC. Furthermore, concurrent depressive symptoms were associated with increased reward anticipation response in mPFC and striatal regions that were also associated with early adolescent psychosocial stressors, with mPFC and striatal response mediating the association between social stressors and depressive symptoms. These findings are consistent with developmental models that emphasize the adverse impact of early psychosocial stressors on neural reward processing and risk for depression in adolescence.

  16. Learning to Produce Syllabic Speech Sounds via Reward-Modulated Neural Plasticity.

    Directory of Open Access Journals (Sweden)

    Anne S Warlaumont

    Full Text Available At around 7 months of age, human infants begin to reliably produce well-formed syllables containing both consonants and vowels, a behavior called canonical babbling. Over subsequent months, the frequency of canonical babbling continues to increase. How the infant's nervous system supports the acquisition of this ability is unknown. Here we present a computational model that combines a spiking neural network, reinforcement-modulated spike-timing-dependent plasticity, and a human-like vocal tract to simulate the acquisition of canonical babbling. Like human infants, the model's frequency of canonical babbling gradually increases. The model is rewarded when it produces a sound that is more auditorily salient than sounds it has previously produced. This is consistent with data from human infants indicating that contingent adult responses shape infant behavior and with data from deaf and tracheostomized infants indicating that hearing, including hearing one's own vocalizations, is critical for canonical babbling development. Reward receipt increases the level of dopamine in the neural network. The neural network contains a reservoir with recurrent connections and two motor neuron groups, one agonist and one antagonist, which control the masseter and orbicularis oris muscles, promoting or inhibiting mouth closure. The model learns to increase the number of salient, syllabic sounds it produces by adjusting the base level of muscle activation and increasing their range of activity. Our results support the possibility that through dopamine-modulated spike-timing-dependent plasticity, the motor cortex learns to harness its natural oscillations in activity in order to produce syllabic sounds. It thus suggests that learning to produce rhythmic mouth movements for speech production may be supported by general cortical learning mechanisms. The model makes several testable predictions and has implications for our understanding not only of how syllabic

  17. The neural dynamics of reward value and risk coding in the human orbitofrontal cortex.

    Science.gov (United States)

    Li, Yansong; Vanni-Mercier, Giovanna; Isnard, Jean; Mauguière, François; Dreher, Jean-Claude

    2016-04-01

    The orbitofrontal cortex is known to carry information regarding expected reward, risk and experienced outcome. Yet, due to inherent limitations in lesion and neuroimaging methods, the neural dynamics of these computations has remained elusive in humans. Here, taking advantage of the high temporal definition of intracranial recordings, we characterize the neurophysiological signatures of the intact orbitofrontal cortex in processing information relevant for risky decisions. Local field potentials were recorded from the intact orbitofrontal cortex of patients suffering from drug-refractory partial epilepsy with implanted depth electrodes as they performed a probabilistic reward learning task that required them to associate visual cues with distinct reward probabilities. We observed three successive signals: (i) around 400 ms after cue presentation, the amplitudes of the local field potentials increased with reward probability; (ii) a risk signal emerged during the late phase of reward anticipation and during the outcome phase; and (iii) an experienced value signal appeared at the time of reward delivery. Both the medial and lateral orbitofrontal cortex encoded risk and reward probability while the lateral orbitofrontal cortex played a dominant role in coding experienced value. The present study provides the first evidence from intracranial recordings that the human orbitofrontal cortex codes reward risk both during late reward anticipation and during the outcome phase at a time scale of milliseconds. Our findings offer insights into the rapid mechanisms underlying the ability to learn structural relationships from the environment.

  18. Remembering with gains and losses: effects of monetary reward and punishment on successful encoding activation of source memories.

    Science.gov (United States)

    Shigemune, Yayoi; Tsukiura, Takashi; Kambara, Toshimune; Kawashima, Ryuta

    2014-05-01

    The motivation of getting rewards or avoiding punishments reinforces learning behaviors. Although the neural mechanisms underlying the effect of rewards on episodic memory have been demonstrated, there is little evidence of the effect of punishments on this memory. Our functional magnetic resonance imaging (fMRI) study investigated the effects of monetary rewards and punishments on activation during the encoding of source memories. During encoding, participants memorized words (item) and locations of presented words (source) under 3 conditions (Reward, Punishment, and Control). During retrieval, participants retrieved item and source memories of the words and were rewarded or penalized according to their performance. Source memories encoded with rewards or punishments were remembered better than those without such encoding. fMRI data demonstrated that the ventral tegmental area and substantia nigra and nucleus accumbens activations reflected both the processes of reward and punishment, whereas insular activation increased as a linear function of punishment. Activation in the hippocampus and parahippocampal cortex predicted subsequent retrieval success of source memories. Additionally, correlations between these reward/punishment-related regions and the hippocampus were significant. The successful encoding of source memories could be enhanced by punishments and rewards, and interactions between reward/punishment-related regions and memory-related regions could contribute to memory enhancement by reward and/or punishment.

  19. Neural representation of reward probability: evidence from the illusion of control.

    Science.gov (United States)

    Kool, Wouter; Getz, Sarah J; Botvinick, Matthew M

    2013-06-01

    To support reward-based decision-making, the brain must encode potential outcomes both in terms of their incentive value and their probability of occurrence. Recent research has made it clear that the brain bears multiple representations of reward magnitude, meaning that a single choice option may be represented differently-and even inconsistently-in different brain areas. There are some hints that the same may be true for reward probability. Preliminary evidence hints that, even as systematic distortions of probability are expressed in behavior, these may not always be uniformly reflected at the neural level: Some neural representations of probability may be immune from such distortions. This study provides new evidence consistent with this possibility. Participants in a behavioral experiment displayed a classic "illusion of control," providing higher estimates of reward probability for gambles they had chosen than for identical gambles that were imposed on them. However, an fMRI study of the same task revealed that neural prediction error signals, arising when gamble outcomes were revealed, were unaffected by the illusion of control. The resulting behavioral-neural dissociation reinforces the case for multiple, inconsistent internal representations of reward probability, while also prompting a reinterpretation of the illusion of control effect itself.

  20. Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds.

    Science.gov (United States)

    Bunzeck, Nico; Doeller, Christian F; Fuentemilla, Lluis; Dolan, Raymond J; Duzel, Emrah

    2009-08-11

    The neural responses that distinguish novel from familiar items in recognition memory tasks are remarkably fast in both humans and nonhuman primates. In humans, the earliest onsets of neural novelty effects emerge at about approximately 150-200 ms after stimulus onset. However, in recognition memory studies with nonhuman primates, novelty effects can arise at as early as 70-80 ms. Here, we address the possibility that this large species difference in onset latencies is caused experimentally by the necessity of using reward reinforcement to motivate the detection of novel or familiar items in nonhuman primates but not in humans. Via magnetoencephalography in humans, we show in two experiments that the onset of neural novelty signals is accelerated from approximately 200 ms to approximately 85 ms if correct recognition memory for either novel or familiar items is rewarded. Importantly, this acceleration is independent of whether the detection of the novel or the familiar scenes is rewarded. Furthermore, this early novelty effect contributed to memory retrieval because neural reward responses, which were contingent upon novelty detection, followed approximately 100 ms later. Thus, under the contextual influence of reward motivation, behaviorally relevant novelty signals emerge much faster than previously held possible in humans.

  1. Perceiving active listening activates the reward system and improves the impression of relevant experiences.

    Science.gov (United States)

    Kawamichi, Hiroaki; Yoshihara, Kazufumi; Sasaki, Akihiro T; Sugawara, Sho K; Tanabe, Hiroki C; Shinohara, Ryoji; Sugisawa, Yuka; Tokutake, Kentaro; Mochizuki, Yukiko; Anme, Tokie; Sadato, Norihiro

    2015-01-01

    Although active listening is an influential behavior, which can affect the social responses of others, the neural correlates underlying its perception have remained unclear. Sensing active listening in social interactions is accompanied by an improvement in the recollected impressions of relevant experiences and is thought to arouse positive feelings. We therefore hypothesized that the recognition of active listening activates the reward system, and that the emotional appraisal of experiences that had been subject to active listening would be improved. To test these hypotheses, we conducted functional magnetic resonance imaging (fMRI) on participants viewing assessments of their own personal experiences made by evaluators with or without active listening attitude. Subjects rated evaluators who showed active listening more positively. Furthermore, they rated episodes more positively when they were evaluated by individuals showing active listening. Neural activation in the ventral striatum was enhanced by perceiving active listening, suggesting that this was processed as rewarding. It also activated the right anterior insula, representing positive emotional reappraisal processes. Furthermore, the mentalizing network was activated when participants were being evaluated, irrespective of active listening behavior. Therefore, perceiving active listening appeared to result in positive emotional appraisal and to invoke mental state attribution to the active listener.

  2. Altered brain activity during reward anticipation in pathological gambling and obsessive-compulsive disorder.

    Directory of Open Access Journals (Sweden)

    Jung-Seok Choi

    Full Text Available BACKGROUND: Pathological gambling (PG and obsessive-compulsive disorder (OCD are conceptualized as a behavioral addiction, with a dependency on repetitive gambling behavior and rewarding effects following compulsive behavior, respectively. However, no neuroimaging studies to date have examined reward circuitry during the anticipation phase of reward in PG compared with in OCD while considering repetitive gambling and compulsion as addictive behaviors. METHODS/PRINCIPAL FINDINGS: To elucidate the neural activities specific to the anticipation phase of reward, we performed event-related functional magnetic resonance imaging (fMRI in young adults with PG and compared them with those in patients with OCD and healthy controls. Fifteen male patients with PG, 13 patients with OCD, and 15 healthy controls, group-matched for age, gender, and IQ, participated in a monetary incentive delay task during fMRI scanning. Neural activation in the ventromedial caudate nucleus during anticipation of both gain and loss decreased in patients with PG compared with that in patients with OCD and healthy controls. Additionally, reduced activation in the anterior insula during anticipation of loss was observed in patients with PG compared with that in patients with OCD which was intermediate between that in OCD and healthy controls (healthy controls < PG < OCD, and a significant positive correlation between activity in the anterior insula and South Oaks Gambling Screen score was found in patients with PG. CONCLUSIONS: Decreased neural activity in the ventromedial caudate nucleus during anticipation may be a specific neurobiological feature for the pathophysiology of PG, distinguishing it from OCD and healthy controls. Correlation of anterior insular activity during loss anticipation with PG symptoms suggests that patients with PG fit the features of OCD associated with harm avoidance as PG symptoms deteriorate. Our findings have identified functional disparities and

  3. Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults

    Science.gov (United States)

    Nusslock, Robin; Almeida, Jorge RC; Forbes, Erika E; Versace, Amelia; Frank, Ellen; LaBarbara, Edmund J; Klein, Crystal R; Phillips, Mary L

    2012-01-01

    Objective Bipolar disorder may be characterized by a hypersensitivity to reward-relevant stimuli, potentially underlying the emotional lability and dysregulation that characterizes the illness. In parallel, research highlights the predominant role of striatal and orbitofrontal cortical (OFC) regions in reward-processing and approach-related affect. We aimed to examine whether bipolar disorder, relative to healthy, participants displayed elevated activity in these regions during reward processing. Methods Twenty-one euthymic bipolar I disorder and 20 healthy control participants with no lifetime history of psychiatric disorder underwent functional magnetic resonance imaging (fMRI) scanning during a card-guessing paradigm designed to examine reward-related brain function to anticipation and receipt of monetary reward and loss. Data were collected using a 3T Siemens Trio scanner. Results Region-of-interest analyses revealed that bipolar disorder participants displayed greater ventral striatal and right-sided orbitofrontal [Brodmann area (BA) 11] activity during anticipation, but not outcome, of monetary reward, relative to healthy controls (p < 0.05, corrected). Wholebrain analyses indicated that bipolar disorder, relative to healthy, participants also displayed elevated left-lateral OFC activity (BA 47) activity during reward anticipation (p < 0.05, corrected). Conclusions Elevated ventral striatal and OFC activity during reward anticipation may represent a neural mechanism for predisposition to expansive mood and hypo/mania in response to reward-relevant cues that characterizes bipolar disorder. Our findings contrast with research reporting blunted activity in the ventral striatum during reward processing in unipolar depressed individuals, relative to healthy controls. Examination of reward-related neural activity in bipolar disorder is a promising research focus to facilitate identification of biological markers of the illness. PMID:22548898

  4. Reward sensitivity is associated with brain activity during erotic stimulus processing.

    Directory of Open Access Journals (Sweden)

    Victor Costumero

    Full Text Available The behavioral approach system (BAS from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

  5. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Science.gov (United States)

    Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F

    2012-01-01

    Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  6. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Directory of Open Access Journals (Sweden)

    Carsten Murawski

    Full Text Available Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  7. Neural correlates of learning from induced insight: A case for reward-based episodic encoding

    Directory of Open Access Journals (Sweden)

    Jasmin M. Kizilirmak

    2016-11-01

    Full Text Available Experiencing insight when solving problems can improve memory formation for both the problem and its solution. The underlying neural processes involved in this kind of learning are, however, thus far insufficiently understood. Here, we conceptualized insight as the sudden understanding of a novel relationship between known stimuli that fits into existing knowledge and is accompanied by a positive emotional response. Hence, insight is thought to comprise associative novelty, schema congruency, and intrinsic reward, all of which are separately known to enhance memory performance. We examined the neural correlates of learning from induced insight with functional magnetic resonance imaging (fMRI using our own version of the Compound-Remote-Associates-Task (CRAT in which each item consists of three clue words and a solution word. (Pseudo-Solution words were presented after a brief period of problem-solving attempts to induce either sudden comprehension (CRA items or continued incomprehension (control items at a specific time point. By comparing processing of the solution words of CRA with control items, we found induced insight to elicit activation of the rostral anterior cingulate cortex / medial prefrontal cortex (rACC/mPFC and left hippocampus. This pattern of results lends support to the role of schema congruency (rACC/mPFC and associative novelty (hippocampus in the processing of induced insight. We propose that (1 the mPFC not only responds to schema-congruent information, but also to the detection of novel schemata, and (2 that the hippocampus responds to a form of associative novelty that is not just a novel constellation of familiar items, but rather comprises a novel meaningful relationship between the items—which was the only difference between our insight and no insight conditions. To investigate episodic long-term memory encoding, we compared CRA items whose solution word was recognized 24h after encoding to those with forgotten

  8. Neural Correlates of Learning from Induced Insight: A Case for Reward-Based Episodic Encoding

    Science.gov (United States)

    Kizilirmak, Jasmin M.; Thuerich, Hannes; Folta-Schoofs, Kristian; Schott, Björn H.; Richardson-Klavehn, Alan

    2016-01-01

    Experiencing insight when solving problems can improve memory formation for both the problem and its solution. The underlying neural processes involved in this kind of learning are, however, thus far insufficiently understood. Here, we conceptualized insight as the sudden understanding of a novel relationship between known stimuli that fits into existing knowledge and is accompanied by a positive emotional response. Hence, insight is thought to comprise associative novelty, schema congruency, and intrinsic reward, all of which are separately known to enhance memory performance. We examined the neural correlates of learning from induced insight with functional magnetic resonance imaging (fMRI) using our own version of the compound-remote-associates-task (CRAT) in which each item consists of three clue words and a solution word. (Pseudo-)Solution words were presented after a brief period of problem-solving attempts to induce either sudden comprehension (CRA items) or continued incomprehension (control items) at a specific time point. By comparing processing of the solution words of CRA with control items, we found induced insight to elicit activation of the rostral anterior cingulate cortex/medial prefrontal cortex (rACC/mPFC) and left hippocampus. This pattern of results lends support to the role of schema congruency (rACC/mPFC) and associative novelty (hippocampus) in the processing of induced insight. We propose that (1) the mPFC not only responds to schema-congruent information, but also to the detection of novel schemata, and (2) that the hippocampus responds to a form of associative novelty that is not just a novel constellation of familiar items, but rather comprises a novel meaningful relationship between the items—which was the only difference between our insight and no insight conditions. To investigate episodic long-term memory encoding, we compared CRA items whose solution word was recognized 24 h after encoding to those with forgotten solutions. We

  9. Evolving Neural Turing Machines for Reward-based Learning

    DEFF Research Database (Denmark)

    Jacobsen, Emil Juul; Risi, Sebastian; Greve, Rasmus Boll

    2016-01-01

    An unsolved problem in neuroevolution (NE) is to evolve artificial neural networks (ANN) that can store and use information to change their behavior online. While plastic neural networks have shown promise in this context, they have difficulties retaining information over longer periods of time...... Turing Machine (NTM) and show that such an approach greatly simplifies the neural model, generalizes better, and does not require accessing the entire memory content at each time-step. The Evolvable Neural Turing Machine (ENTM) is able to solve a simple copy tasks and for the first time, the continuous...... version of the double T-Maze, a complex reinforcement-like learning problem. In the T-Maze learning task the agent uses the memory bank to display adaptive behavior that normally requires a plastic ANN, thereby suggesting a complementary and effective mechanism for adaptive behavior in NE....

  10. A comparison of reward-contingent neuronal activity in monkey orbitofrontal cortex and ventral striatum: guiding actions toward rewards.

    Science.gov (United States)

    Simmons, Janine M; Ravel, Sabrina; Shidara, Munetaka; Richmond, Barry J

    2007-12-01

    We have investigated how neuronal activity in the orbitofrontal-ventral striatal circuit is related to reward-directed behavior by comparing activity in these two regions during a visually guided reward schedule task. When a set of visual cues provides information about reward contingency, that is, about whether or not a trial will be rewarded, significant subpopulations of neurons in both orbitofrontal cortex and ventral striatum encode this information. Orbitofrontal and ventral striatal neurons also differentiate between rewarding and non-rewarding trial outcomes, whether or not those outcomes were predicted. The size of the neuronal subpopulation encoding reward contingency is twice as large in orbitofrontal cortex (50% of neurons) as in ventral striatum (26%). Reward-contingency-dependent activity also appears earlier during a trial in orbitofrontal cortex than in ventral striatum. The peak reward-contingency representation in orbitofrontal cortex (31% of neurons), occurs during the wait period, a period of high anticipation prior to any action. The peak ventral striatal representation of reward contingency (18%) occurs during the go period, a time of action. We speculate that signals from orbitofrontal cortex bias ventral striatal activity, and that a flow of reward-contingency information from orbitofrontal cortex to ventral striatum serves to guide actions toward rewards.

  11. Neural signature of food reward processing in bulimic-type eating disorders.

    Science.gov (United States)

    Simon, Joe J; Skunde, Mandy; Walther, Stephan; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

    2016-09-01

    Clinical observations and similarities to addiction suggest heightened reward sensitivity to food in patients with bulimic-type eating (BTE) disorders. Therefore, we investigated the expectation and receipt of food reward compared with monetary reward in patients with BTE. Fifty-six patients with BTE (27 patients with binge eating disorder and 29 with bulimia nervosa) and 55 matched healthy control participants underwent event-related functional magnetic resonance imaging while performing both food and monetary incentive delay tasks. BTE patients exhibited reduced brain activation in the posterior cingulate cortex during the expectation of food and increased activity in the medial orbitofrontal cortex, anterior medial prefrontal cortex and posterior cingulate cortex during the receipt of food reward. These findings were relevant to food because we found no significant group differences related to monetary reward. In the patients, higher brain activity in the medial orbitofrontal cortex during the receipt of food reward was related to higher levels of trait food craving and external eating. BTE patients exhibited increased hedonic processing during the receipt of food reward. These findings corroborate the notion that an altered responsiveness of the reward network to food stimuli is associated with BTE.

  12. Neural correlates of reward processing in healthy siblings of patients with schizophrenia.

    Science.gov (United States)

    Hanssen, Esther; van der Velde, Jorien; Gromann, Paula M; Shergill, Sukhi S; de Haan, Lieuwe; Bruggeman, Richard; Krabbendam, Lydia; Aleman, André; van Atteveldt, Nienke

    2015-01-01

    Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be related to SZ. Studies in patients with SZ have found less activation in the ventral striatum (VS) during anticipation of reward, but these findings do not provide information on effect of the genetic load on reward processing. Therefore, this study investigated RP in healthy first-degree relatives of SZ patients. The sample consisted of 94 healthy siblings of SZ patients and 57 healthy controls. Participants completed a classic RP task, the Monetary Incentive Delay task, during functional magnetic resonance imaging (fMRI). As expected, there were no behavioral differences between groups. In contrast to our expectations, we found no differences in any of the anticipatory reward related brain areas (region of interest analyses). Whole-brain analyses did reveal group differences during both reward anticipation and reward consumption; during reward anticipation siblings showed less deactivation in the insula, posterior cingulate cortex (PCC) and medial frontal gyrus (MFG) than controls. During reward consumption siblings showed less deactivation in the PCC and the right MFG compared to controls and activation in contrast to deactivation in controls in the precuneus and the left MFG. Exclusively in siblings, MFG activity correlated positively with subclinical negative symptoms. These regions are typically associated with the default mode network (DMN), which normally shows decreases in activation during task-related cognitive processes. Thus, in contrast to prior literature in patients with SZ, the results do not point to altered brain activity in classical RP brain areas, such as the VS. However, the weaker deactivation found outside the reward-related network in siblings could

  13. Methylphenidate and brain activity in a reward/conflict paradigm: role of the insula in task performance.

    Science.gov (United States)

    Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Fan, Jin; Friston, Karl; London, Edythe D; Schwartz, Jeffrey; Newcorn, Jeffrey H

    2014-06-01

    Psychostimulants, such as methylphenidate, are thought to improve information processing in motivation-reward and attention-activation networks by enhancing the effects of more relevant signals and suppressing those of less relevant ones; however the nature of such reciprocal influences remains poorly understood. To explore this question, we tested the effect of methylphenidate on performance and associated brain activity in the Anticipation, Conflict, Reward (ACR) task. Sixteen healthy adult volunteers, ages 21-45, were scanned twice using functional magnetic resonance imaging (fMRI) as they performed the ACR task under placebo and methylphenidate conditions. A three-way repeated measures analysis of variance, with cue (reward vs. non-reward), target (congruent vs. incongruent) and medication condition (methylphenidate vs. placebo) as the factors, was used to analyze behaviors on the task. Blood oxygen level dependent (BOLD) signals, reflecting task-related neural activity, were evaluated using linear contrasts. Participants exhibited significantly greater accuracy in the methylphenidate condition than the placebo condition. Compared with placebo, the methylphenidate condition also was associated with lesser task-related activity in components of attention-activation systems irrespective of the reward cue, and less task-related activity in components of the reward-motivation system, particularly the insula, during reward trials irrespective of target difficulty. These results suggest that methylphenidate enhances task performance by improving efficiency of information processing in both reward-motivation and in attention-activation systems.

  14. Effects of emotion and reward motivation on neural correlates of episodic memory encoding: a PET study.

    Science.gov (United States)

    Shigemune, Yayoi; Abe, Nobuhito; Suzuki, Maki; Ueno, Aya; Mori, Etsuro; Tashiro, Manabu; Itoh, Masatoshi; Fujii, Toshikatsu

    2010-05-01

    It is known that emotion and reward motivation promote long-term memory formation. It remains unclear, however, how and where emotion and reward are integrated during episodic memory encoding. In the present study, subjects were engaged in intentional encoding of photographs under four different conditions that were made by combining two factors (emotional valence, negative or neutral; and monetary reward value, high or low for subsequent successful recognition) during H2 15O positron emission tomography (PET) scanning. As for recognition performance, we found significant main effects of emotional valence (negative>neutral) and reward value (high value>low value), without an interaction between the two factors. Imaging data showed that the left amygdala was activated during the encoding conditions of negative pictures relative to neutral pictures, and the left orbitofrontal cortex was activated during the encoding conditions of high reward pictures relative to low reward pictures. In addition, conjunction analysis of these two main effects detected right hippocampal activation. Although we could not find correlations between recognition performance and activity of these three regions, we speculate that the right hippocampus may integrate the effects of emotion (processed in the amygdala) and monetary reward (processed in the orbitofrontal cortex) on episodic memory encoding.

  15. Activation of prefrontal cortical parvalbumin interneurons facilitates extinction of reward-seeking behavior.

    Science.gov (United States)

    Sparta, Dennis R; Hovelsø, Nanna; Mason, Alex O; Kantak, Pranish A; Ung, Randall L; Decot, Heather K; Stuber, Garret D

    2014-03-05

    Forming and breaking associations between emotionally salient environmental stimuli and rewarding or aversive outcomes is an essential component of learned adaptive behavior. Importantly, when cue-reward contingencies degrade, animals must exhibit behavioral flexibility to extinguish prior learned associations. Understanding the specific neural circuit mechanisms that operate during the formation and extinction of conditioned behaviors is critical because dysregulation of these neural processes is hypothesized to underlie many of the maladaptive and pathological behaviors observed in various neuropsychiatric disorders in humans. The medial prefrontal cortex (mPFC) participates in the behavioral adaptations seen in both appetitive and aversive-cue-mediated responding, but the precise cell types and circuit mechanisms sufficient for driving these complex behavioral states remain largely unspecified. Here, we recorded and manipulated the activity of parvalbumin-positive fast spiking interneurons (PV+ FSIs) in the prelimbic area (PrL) of the mPFC in mice. In vivo photostimulation of PV+ FSIs resulted in a net inhibition of PrL neurons, providing a circuit blueprint for behavioral manipulations. Photostimulation of mPFC PV+ cells did not alter anticipatory or consummatory licking behavior during reinforced training sessions. However, optical activation of these inhibitory interneurons to cues associated with reward significantly accelerated the extinction of behavior during non-reinforced test sessions. These data suggest that suppression of excitatory mPFC networks via increased activity of PV+ FSIs may enhance reward-related behavioral flexibility.

  16. Age differences in the impact of peers on adolescents’ and adults’ neural response to reward

    Directory of Open Access Journals (Sweden)

    Ashley R. Smith

    2015-02-01

    Full Text Available Prior research suggests that increased adolescent risk-taking in the presence of peers may be linked to the influence of peers on the valuation and processing of rewards during decision-making. The current study explores this idea by examining how peer observation impacts the processing of rewards when such processing is isolated from other facets of risky decision-making (e.g. risk-perception and preference, inhibitory processing, etc.. In an fMRI paradigm, a sample of adolescents (ages 14–19 and adults (ages 25–35 completed a modified High/Low Card Guessing Task that included rewarded and un-rewarded trials. Social context was manipulated by having participants complete the task both alone and while being observed by two, same-age, same-sex peers. Results indicated an interaction of age and social context on the activation of reward circuitry during the receipt of reward; when observed by peers adolescents exhibited greater ventral striatal activation than adults, but no age-related differences were evinced when the task was completed alone. These findings suggest that, during adolescence, peers influence recruitment of reward-related regions even when they are engaged outside of the context of risk-taking. Implications for engagement in prosocial, as well as risky, behaviors during adolescence are discussed.

  17. Age differences in the impact of peers on adolescents' and adults' neural response to reward.

    Science.gov (United States)

    Smith, Ashley R; Steinberg, Laurence; Strang, Nicole; Chein, Jason

    2015-02-01

    Prior research suggests that increased adolescent risk-taking in the presence of peers may be linked to the influence of peers on the valuation and processing of rewards during decision-making. The current study explores this idea by examining how peer observation impacts the processing of rewards when such processing is isolated from other facets of risky decision-making (e.g. risk-perception and preference, inhibitory processing, etc.). In an fMRI paradigm, a sample of adolescents (ages 14-19) and adults (ages 25-35) completed a modified High/Low Card Guessing Task that included rewarded and un-rewarded trials. Social context was manipulated by having participants complete the task both alone and while being observed by two, same-age, same-sex peers. Results indicated an interaction of age and social context on the activation of reward circuitry during the receipt of reward; when observed by peers adolescents exhibited greater ventral striatal activation than adults, but no age-related differences were evinced when the task was completed alone. These findings suggest that, during adolescence, peers influence recruitment of reward-related regions even when they are engaged outside of the context of risk-taking. Implications for engagement in prosocial, as well as risky, behaviors during adolescence are discussed.

  18. Neural correlates of reward-based spatial learning in persons with cocaine dependence.

    Science.gov (United States)

    Tau, Gregory Z; Marsh, Rachel; Wang, Zhishun; Torres-Sanchez, Tania; Graniello, Barbara; Hao, Xuejun; Xu, Dongrong; Packard, Mark G; Duan, Yunsuo; Kangarlu, Alayar; Martinez, Diana; Peterson, Bradley S

    2014-02-01

    Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary rewards, allowing the functional assessment of the brain systems for spatial learning, a form of episodic memory. Whereas both groups performed similarly on the reward-based spatial learning task, we identified disturbances in brain regions involved in learning and reward in CD participants. In particular, CD was associated with impaired functioning of medial temporal lobe (MTL), a brain region that is crucial for spatial learning (and episodic memory) with concomitant recruitment of striatum (which normally participates in stimulus-response, or habit, learning), and prefrontal cortex. CD was also associated with enhanced sensitivity of the ventral striatum to unexpected rewards but not to expected rewards earned during spatial learning. We provide evidence that spatial learning in CD is characterized by disturbances in functioning of an MTL-based system for episodic memory and a striatum-based system for stimulus-response learning and reward. We have found additional abnormalities in distributed cortical regions. Consistent with findings from animal studies, we provide the first evidence in humans describing the disruptive effects of cocaine on the coordinated functioning of multiple neural systems for learning and memory.

  19. Neural connectivity during reward expectation dissociates psychopathic criminals from non-criminal individuals with high impulsive/antisocial psychopathic traits.

    Science.gov (United States)

    Geurts, Dirk E M; von Borries, Katinka; Volman, Inge; Bulten, Berend Hendrik; Cools, Roshan; Verkes, Robbert-Jan

    2016-08-01

    Criminal behaviour poses a big challenge for society. A thorough understanding of the neurobiological mechanisms underlying criminality could optimize its prevention and management. Specifically,elucidating the neural mechanisms underpinning reward expectation might be pivotal to understanding criminal behaviour. So far no study has assessed reward expectation and its mechanisms in a criminal sample. To fill this gap, we assessed reward expectation in incarcerated, psychopathic criminals. We compared this group to two groups of non-criminal individuals: one with high levels and another with low levels of impulsive/antisocial traits. Functional magnetic resonance imaging was used to quantify neural responses to reward expectancy. Psychophysiological interaction analyses were performed to examine differences in functional connectivity patterns of reward-related regions. The data suggest that overt criminality is characterized, not by abnormal reward expectation per se, but rather by enhanced communication between reward-related striatal regions and frontal brain regions. We establish that incarcerated psychopathic criminals can be dissociated from non-criminal individuals with comparable impulsive/antisocial personality tendencies based on the degree to which reward-related brain regions interact with brain regions that control behaviour. The present results help us understand why some people act according to their impulsive/antisocial personality while others are able to behave adaptively despite reward-related urges.

  20. Coordinated activation of premotor and ventromedial prefrontal cortices during vicarious reward.

    Science.gov (United States)

    Shimada, Sotaro; Matsumoto, Madoka; Takahashi, Hidefumi; Yomogida, Yukihito; Matsumoto, Kenji

    2016-03-01

    The vicarious reward we receive from watching likable others obtaining a positive outcome is a pervasive phenomenon, yet its neural correlates are poorly understood. Here, we conducted a series of functional magnetic resonance imaging experiments to test the hypothesis that the brain areas responsible for action observation and reward processing work in a coordinated fashion during vicarious reward. In the first experiment (manipulation phase), the participant was instructed to cheer for a particular player in a two-player competitive game (Rock-Paper-Scissors). This manipulation made participants feel more unity with that player and resulted in unity-related activation in the premotor area during action observation. In the following main experiment, the participant witnessed the previously cheered-for or non-cheered-for player succeed in a new solitary game (a stopwatch game). The ventromedial prefrontal cortex (vmPFC) was activated when the cheered-for player succeeded in the game but not when the other player did. Interestingly, this vmPFC activation was functionally connected with premotor activation only during the cheered-for player's success. These results suggest that vicarious reward is processed in the vmPFC-premotor network, which is activated specifically by the success of the other person with whom the individual feels unity and closeness.

  1. Reward Sensitivity Modulates Brain Activity in the Prefrontal Cortex, ACC and Striatum during Task Switching

    Science.gov (United States)

    Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Ventura-Campos, Noelia; Bustamante, Juan C.; Costumero, Víctor; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

    2015-01-01

    Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies. PMID:25875640

  2. Neural evidence for description dependent reward processing in the framing effect.

    Science.gov (United States)

    Yu, Rongjun; Zhang, Ping

    2014-01-01

    Human decision making can be influenced by emotionally valenced contexts, known as the framing effect. We used event-related brain potentials to investigate how framing influences the encoding of reward. We found that the feedback related negativity (FRN), which indexes the "worse than expected" negative prediction error in the anterior cingulate cortex (ACC), was more negative for the negative frame than for the positive frame in the win domain. Consistent with previous findings that the FRN is not sensitive to "better than expected" positive prediction error, the FRN did not differentiate the positive and negative frame in the loss domain. Our results provide neural evidence that the description invariance principle which states that reward representation and decision making are not influenced by how options are presented is violated in the framing effect.

  3. The D2 antagonist sulpiride modulates the neural processing of both rewarding and aversive stimuli in healthy volunteers

    OpenAIRE

    2011-01-01

    Rationale Animal studies indicate that dopamine pathways in the ventral striatum code for the motivational salience of both rewarding and aversive stimuli, but evidence for this mechanism in humans is less established. We have developed a functional magnetic resonance imaging (fMRI) model which permits examination of the neural processing of both rewarding and aversive stimuli. Objectives The aim of the study was to determine the effect of the dopamine receptor antagonist, sulpiride, on the n...

  4. Spatiotemporal dissociation of brain activity underlying threat and reward in social anxiety disorder.

    Science.gov (United States)

    A Richey, John; Ghane, Merage; Valdespino, Andrew; Coffman, Marika C; Strege, Marlene V; White, Susan W; Ollendick, Thomas H

    2016-10-19

    Social anxiety disorder (SAD) involves abnormalities in social motivation, which may be independent of well-documented differences in fear and arousal systems. Yet, the neurobiology underlying motivational difficulties in SAD is not well understood. The aim of the current study was to spatiotemporally dissociate reward circuitry dysfunction from alterations in fear and arousal-related neural activity during anticipation and notification of social and non-social reward and punishment. During fMRI acquisition, non-depressed adults with social anxiety disorder (SAD; N = 21) and age-, sex- and IQ-matched control subjects (N = 22) completed eight runs of an incentive delay task, alternating between social and monetary outcomes and interleaved in alternating order between gain and loss outcomes. Adults with SAD demonstrated significantly reduced neural activity in ventral striatum during the anticipation of positive but not negative social outcomes. No differences between the SAD and control groups were observed during anticipation of monetary gain or loss outcomes or during anticipation of negative social images. However, consistent with previous work, the SAD group demonstrated amygdala hyper-activity upon notification of negative social outcomes. Degraded anticipatory processing in bilateral ventral striatum in SAD was constrained exclusively to anticipation of positive social information and dissociable from the effects of negative social outcomes previously observed in the amygdala. Alterations in anticipation-related neural signals may represent a promising target for treatment that is not addressed by available evidence-based interventions, which focus primarily on fear extinction and habituation processes.

  5. For love or money: a common neural currency for social and monetary reward.

    Science.gov (United States)

    Saxe, Rebecca; Haushofer, Johannes

    2008-04-24

    Two papers in the current issue of Neuron (Izuma et al. and Zink et al.) report that activity in specific regions of the brain, especially the striatum, reflects a common signal of reward in both the economic (e.g., money) and social (e.g., praise and status) domains.

  6. Self-awareness in neurodegenerative disease relies on neural structures mediating reward-driven attention.

    Science.gov (United States)

    Shany-Ur, Tal; Lin, Nancy; Rosen, Howard J; Sollberger, Marc; Miller, Bruce L; Rankin, Katherine P

    2014-08-01

    Accurate self-awareness is essential for adapting one's tasks and goals to one's actual abilities. Patients with neurodegenerative diseases, particularly those with right frontal involvement, often present with poor self-awareness of their functional limitations that may exacerbate their already jeopardized decision-making and behaviour. We studied the structural neuroanatomical basis for impaired self-awareness among patients with neurodegenerative disease and healthy older adults. One hundred and twenty-four participants (78 patients with neurodegenerative diseases including Alzheimer's disease, behavioural variant frontotemporal dementia, right-temporal frontotemporal dementia, semantic variant and non-fluent variant primary progressive aphasia, and 46 healthy controls) described themselves on the Patient Competency Rating Scale, rating observable functioning across four domains (daily living activities, cognitive, emotional control, interpersonal). All participants underwent structural magnetic resonance imaging. Informants also described subjects' functioning on the same scale. Self-awareness was measured by comparing self and informant ratings. Group differences in discrepancy scores were analysed using general linear models, controlling for age, sex and disease severity. Compared with controls, patients with behavioural variant frontotemporal dementia overestimated their functioning in all domains, patients with Alzheimer's disease overestimated cognitive and emotional functioning, patients with right-temporal frontotemporal dementia overestimated interpersonal functioning, and patients with non-fluent aphasia overestimated emotional and interpersonal functioning. Patients with semantic variant aphasia did not overestimate functioning on any domain. To examine the neuroanatomic correlates of impaired self-awareness, discrepancy scores were correlated with brain volume using voxel-based morphometry. To identify the unique neural correlates of overlooking

  7. Longitudinal changes in adolescent risk-taking: a comprehensive study of neural responses to rewards, pubertal development, and risk-taking behavior.

    Science.gov (United States)

    Braams, Barbara R; van Duijvenvoorde, Anna C K; Peper, Jiska S; Crone, Eveline A

    2015-05-01

    Prior studies have highlighted adolescence as a period of increased risk-taking, which is postulated to result from an overactive reward system in the brain. Longitudinal studies are pivotal for testing these brain-behavior relations because individual slopes are more sensitive for detecting change. The aim of the current study was twofold: (1) to test patterns of age-related change (i.e., linear, quadratic, and cubic) in activity in the nucleus accumbens, a key reward region in the brain, in relation to change in puberty (self-report and testosterone levels), laboratory risk-taking and self-reported risk-taking tendency; and (2) to test whether individual differences in pubertal development and risk-taking behavior were contributors to longitudinal change in nucleus accumbens activity. We included 299 human participants at the first time point and 254 participants at the second time point, ranging between ages 8-27 years, time points were separated by a 2 year interval. Neural responses to rewards, pubertal development (self-report and testosterone levels), laboratory risk-taking (balloon analog risk task; BART), and self-reported risk-taking tendency (Behavior Inhibition System/Behavior Activation System questionnaire) were collected at both time points. The longitudinal analyses confirmed the quadratic age pattern for nucleus accumbens activity to rewards (peaking in adolescence), and the same quadratic pattern was found for laboratory risk-taking (BART). Nucleus accumbens activity change was further related to change in testosterone and self-reported reward-sensitivity (BAS Drive). Thus, this longitudinal analysis provides new insight in risk-taking and reward sensitivity in adolescence: (1) confirming an adolescent peak in nucleus accumbens activity, and (2) underlining a critical role for pubertal hormones and individual differences in risk-taking tendency.

  8. Neural activity of orbitofrontal cortex contributes to control of waiting.

    Science.gov (United States)

    Xiao, Xiong; Deng, Hanfei; Wei, Lei; Huang, Yanwang; Wang, Zuoren

    2016-09-01

    The willingness to wait for delayed reward and information is of fundamental importance for deliberative behaviors. The orbitofrontal cortex (OFC) is thought to be a core component of the neural circuitry underlying the capacity to control waiting. However, the neural correlates of active waiting and the causal role of the OFC in the control of waiting still remain largely unknown. Here, we trained rats to perform a waiting task (waiting for a pseudorandom time to obtain the water reward), and recorded neuronal ensembles in the OFC throughout the task. We observed that subset OFC neurons exhibited ramping activities throughout the waiting process. Receiver operating characteristic analysis showed that neural activities during the waiting period even predicted the trial outcomes (patient vs. impatient) on a trial-by-trial basis. Furthermore, optogenetic activation of the OFC during the waiting period improved the waiting performance, but did not influence rats' movement to obtain the reward. Taken together, these findings reveal that the neural activity in the OFC contributes to the control of waiting.

  9. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task.

    NARCIS (Netherlands)

    E. van Duuren; F.A.N. Escamez; R.N.J.M.A. Joosten; R. Visser; A.B. Mulder; C.M.A. Pennartz

    2007-01-01

    The orbitofrontal cortex (OBFc) has been suggested to code the motivational value of environmental stimuli and to use this information for the flexible guidance of goal-directed behavior. To examine whether information regarding reward prediction is quantitatively represented in the rat OBFc, neural

  10. Understanding overbidding: using the neural circuitry of reward to design economic auctions.

    Science.gov (United States)

    Delgado, Mauricio R; Schotter, Andrew; Ozbay, Erkut Y; Phelps, Elizabeth A

    2008-09-26

    We take advantage of our knowledge of the neural circuitry of reward to investigate a puzzling economic phenomenon: Why do people overbid in auctions? Using functional magnetic resonance imaging (fMRI), we observed that the social competition inherent in an auction results in a more pronounced blood oxygen level-dependent (BOLD) response to loss in the striatum, with greater overbidding correlated with the magnitude of this response. Leveraging these neuroimaging results, we design a behavioral experiment that demonstrates that framing an experimental auction to emphasize loss increases overbidding. These results highlight a role for the contemplation of loss in understanding the tendency to bid "too high." Current economic theories suggest overbidding may result from either "joy of winning" or risk aversion. By combining neuroeconomic and behavioral economic techniques, we find that another factor, namely loss contemplation in a social context, may mediate overbidding in auctions.

  11. Variation in TREK1 gene linked to depression-resistant phenotype is associated with potentiated neural responses to rewards in humans

    Science.gov (United States)

    Dillon, Daniel G.; Bogdan, Ryan; Fagerness, Jesen; Holmes, Avram J.; Perlis, Roy H.; Pizzagalli, Diego A.

    2010-01-01

    The TREK1 gene has been linked to a depression-resistant phenotype in rodents and antidepressant response in humans, but the neural mechanisms underlying these links are unclear. Because TREK1 is expressed in reward-related basal ganglia regions, it has been hypothesized that TREK1 genetic variation may be associated with anhedonic symptoms of depression. To investigate whether TREK1 genetic variation influences reward processing, we genotyped healthy individuals (n = 31) who completed a monetary incentive delay task during functional magnetic resonance imaging (fMRI). Three genotypes previously linked to positive antidepressant response were associated with potentiated basal ganglia activity to gains, but did not influence responses to penalties or no change feedback. TREK1 genetic variations did not affect basal ganglia volume, and fMRI group differences were confirmed when accounting for self-report measures of anhedonia. In addition, the total number of “protective” TREK1 alleles was associated with stronger responses to gains in several other reward-related regions, including the dorsal anterior cingulate cortex, orbitofrontal cortex, and mesial prefrontal cortex. In control analyses, associations between basal ganglia responses to gains and functional polymorphisms in the dopamine transporter (DAT1) and catechol-O-methyltransferase (COMT) genes were also explored. Results revealed that TREK1 and DAT/COMT genotypes were independently related to basal ganglia responses to gains. These findings indicate that TREK1 genotypes are associated with individual differences in reward-related brain activity. Future studies in depressed samples should evaluate whether variation in neural responses to rewards may contribute to the association between TREK1 and antidepressant response in humans. PMID:19621370

  12. Anger is associated with reward-related electrocortical activity: Evidence from the reward positivity

    NARCIS (Netherlands)

    Angus, D.J.; Kemkes, K.; Schutter, D.J.L.G.; Harmon-Jones, E.

    2015-01-01

    Previous research indicates that the reward positivity (RewP), an electrophysiological correlate of sensitivity and biases towards rewarding stimuli, is modulated by affective and motivational variables. Studies have provided evidence that states and traits associated with negative affect and reduce

  13. Neural correlates of reward processing in healthy siblings of patients with schizophrenia

    NARCIS (Netherlands)

    Hanssen, Esther; van der Velde, Jorien; Gromann, Paula M.; Shergill, Sukhi S.; de Haan, Lieuwe; Bruggeman, Richard; Krabbendam, Lydia; Aleman, Andre; van Atteveldt, Nienke

    2015-01-01

    Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be relat

  14. Pathological gambling and alcohol dependence: neural disturbances in reward and loss avoidance processing.

    Science.gov (United States)

    Romanczuk-Seiferth, Nina; Koehler, Saskia; Dreesen, Caspar; Wüstenberg, Torsten; Heinz, Andreas

    2015-05-01

    Pathological gambling (PG) shares clinical characteristics such as craving and loss of control with substance use disorders and is thus considered a behavioral addiction. While functional alterations in the mesolimbic reward system have been correlated with craving and relapse in substance use disorders, only a few studies have examined this brain circuit in PG, and no direct comparison has been conducted so far. Thus, we investigated the neuronal correlates of reward processing in PG in contrast to alcohol-dependent (AD) patients and healthy subjects. Eighteen PG patients, 15 AD patients and 17 controls were investigated with a monetary incentive delay task, in which visual cues predict the consequence (monetary gain, avoidance of loss, none) of a fast response to a subsequent target stimulus. Functional magnetic resonance imaging data were analyzed to account for possible confounding factors such as local gray matter volume. Activity in the right ventral striatum during loss anticipation was increased in PG patients compared with controls and AD patients. Moreover, PG patients showed decreased activation in the right ventral striatum and right medial prefrontal cortex during successful loss avoidance compared with controls, which was inversely associated with severity of gambling behavior. Thus, despite neurobiological similarities to substance use disorders in reward processing, as reported by previous studies, we found relevant differences with respect to the anticipation of loss as well as its avoidance (negative reinforcement), which further contributes to the understanding of PG.

  15. The Neural Correlates of Expectancy Deviation and Punishment and Reward:An EPR Study%预期背离下奖励与惩罚的ERPs研究

    Institute of Scientific and Technical Information of China (English)

    刘耀中; 唐志文; 叶海英

    2012-01-01

    Reward and punishment play an important role in the study of human cooperation today.In our daily lives,it often happens that a person deserves being rewarded but the reward does not come,or he deserves being punished but the punishment does not come, either.Previous studies did not discuss much about the situation in which a person makes the right response but does not receive the reward he deserves,or the wrong response but does not receive the punishment.In this study,we try to explore how individuals' brain will respond to both of the two conditions we mentioned above using the Flanker experimental paradigm and ERP(Event - related potential) technology in order to find out what the neural processing mechanisms are for those rewards and punishments,as well as their FRN effects.We also try to analyze the relationship between the individuals neural mechanism and the Reinforcement Sensitivity Theory using the behavioral inhibition system(BIS) / behavioral approach system(BAS) analytical methods to reveal the psychological processing mechanism of punishment and reward. Here,we selected 15 candidates and conducted a 2- stimulus type(reward vs.punishment)×2 expectation deviated(Yes vs. No) experiment.All the 15 candidates were induced to accept all of the four experimental treatments.The results showed that(1) the individual's expectation that was deviated caused higher FRN;(2) when the individual was punished,a higher FRN appeared,and when he was rewarded,a higher P3 appeared;(3) there was no significant relationship between FRN and individuals sensitivity of being punished or failing to be rewarded.All those results above indicate;(1) if a person does not receive the reward he deserves,the effect caused will be the same as being punished and the correlation between BIS and FRN is confirmed.Individuals will experience a negative emotion.So we suggest that such condition may be adjusted by the punishment system;(2) when the expected punishment does not appear

  16. Dopamine-signalled reward predictions generated by competitive excitation and inhibition in a spiking neural network model

    Directory of Open Access Journals (Sweden)

    Paul eChorley

    2011-05-01

    Full Text Available Dopaminergic neurons in the mammalian substantia nigra displaycharacteristic phasic responses to stimuli which reliably predict thereceipt of primary rewards. These responses have been suggested toencode reward prediction-errors similar to those used in reinforcementlearning. Here, we propose a model of dopaminergic activity in whichprediction error signals are generated by the joint action ofshort-latency excitation and long-latency inhibition, in a networkundergoing dopaminergic neuromodulation of both spike-timing dependentsynaptic plasticity and neuronal excitability. In contrast toprevious models, sensitivity to recent events is maintained by theselective modification of specific striatal synapses, efferent tocortical neurons exhibiting stimulus-specific, temporally extendedactivity patterns. Our model shows, in the presence of significantbackground activity, (i a shift in dopaminergic response from rewardto reward predicting stimuli, (ii preservation of a response tounexpected rewards, and (iii a precisely-timed below-baseline dip inactivity observed when expected rewards are omitted.

  17. Matching Behavior as a Tradeoff Between Reward Maximization and Demands on Neural Computation [version 2; referees: 2 approved

    Directory of Open Access Journals (Sweden)

    Jan Kubanek

    2015-10-01

    Full Text Available When faced with a choice, humans and animals commonly distribute their behavior in proportion to the frequency of payoff of each option. Such behavior is referred to as matching and has been captured by the matching law. However, matching is not a general law of economic choice. Matching in its strict sense seems to be specifically observed in tasks whose properties make matching an optimal or a near-optimal strategy. We engaged monkeys in a foraging task in which matching was not the optimal strategy. Over-matching the proportions of the mean offered reward magnitudes would yield more reward than matching, yet, surprisingly, the animals almost exactly matched them. To gain insight into this phenomenon, we modeled the animals' decision-making using a mechanistic model. The model accounted for the animals' macroscopic and microscopic choice behavior. When the models' three parameters were not constrained to mimic the monkeys' behavior, the model over-matched the reward proportions and in doing so, harvested substantially more reward than the monkeys. This optimized model revealed a marked bottleneck in the monkeys' choice function that compares the value of the two options. The model featured a very steep value comparison function relative to that of the monkeys. The steepness of the value comparison function had a profound effect on the earned reward and on the level of matching. We implemented this value comparison function through responses of simulated biological neurons. We found that due to the presence of neural noise, steepening the value comparison requires an exponential increase in the number of value-coding neurons. Matching may be a compromise between harvesting satisfactory reward and the high demands placed by neural noise on optimal neural computation.

  18. Changes in reward-induced brain activation in opiate addicts

    NARCIS (Netherlands)

    Martin-Soelch, C; Chevalley, AF; Kunig, G; Missimer, J; Magyar, S; Mino, A; Schultz, W; Leenders, KL

    2001-01-01

    Many studies indicate a role of the cerebral dopaminergic reward system in addiction. Motivated by these findings, we examined in opiate addicts whether brain regions involved in the reward circuitry also react to human prototypical rewards. We measured regional cerebral blood flow (rCBF) with (H2O)

  19. Application of fMRI to obesity research: differences in reward pathway activation measured with fMRI BOLD during visual presentation of high and low calorie foods

    Science.gov (United States)

    Tsao, Sinchai; Adam, Tanja C.; Goran, Michael I.; Singh, Manbir

    2012-03-01

    The factors behind the neural mechanisms that motivate food choice and obesity are not well known. Furthermore, it is not known when these neural mechanisms develop and how they are influenced by both genetic and environmental factors. This study uses fMRI together with clinical data to shed light on the aforementioned questions by investigating how appetite-related activation in the brain changes with low versus high caloric foods in pre-pubescent girls. Previous studies have shown that obese adults have less striatal D2 receptors and thus reduced Dopamine (DA) signaling leading to the reward-deficit theory of obesity. However, overeating in itself reduces D2 receptor density, D2 sensitivity and thus reward sensitivity. The results of this study will show how early these neural mechanisms develop and what effect the drastic endocrinological changes during puberty has on these mechanisms. Our preliminary results showed increased activations in the Putamen, Insula, Thalamus and Hippocampus when looking at activations where High Calorie > Low Calorie. When comparing High Calorie > Control and Low Calorie > Control, the High > Control test showed increased significant activation in the frontal lobe. The Low > Control also yielded significant activation in the Left and Right Fusiform Gyrus, which did not appear in the High > Control test. These results indicate that the reward pathway activations previously shown in post-puberty and adults are present in pre-pubescent teens. These results may suggest that some of the preferential neural mechanisms of reward are already present pre-puberty.

  20. Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

    Science.gov (United States)

    Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

    2015-12-10

    Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing.

  1. Reward prediction-related increases and decreases in tonic neuronal activity of the pedunculopontine tegmental nucleus

    Directory of Open Access Journals (Sweden)

    Ken-Ichi eOkada

    2013-05-01

    Full Text Available The neuromodulators serotonin, acetylcholine, and dopamine have been proposed to play important roles in the execution of movement, control of several forms of attentional behavior, and reinforcement learning. While the response pattern of midbrain dopaminergic neurons and its specific role in reinforcement learning have been revealed, the roles of the other neuromodulators remain elusive. Reportedly, neurons in the dorsal raphe nucleus, one major source of serotonin, continually track the state of expectation of future rewards by showing a correlated response to the start of a behavioral task, reward cue presentation, and reward delivery. Here, we show that neurons in the pedunculopontine tegmental nucleus (PPTN, one major source of acetylcholine, showed similar encoding of the expectation of future rewards by a systematic increase or decrease in tonic activity. We recorded and analyzed PPTN neuronal activity in monkeys during a reward conditioned visually guided saccade task. The firing patterns of many PPTN neurons were tonically increased or decreased throughout the task period. The tonic activity pattern of neurons was correlated with their encoding of the predicted reward value; neurons exhibiting an increase or decrease in tonic activity showed higher or lower activity in the large reward-predicted trials, respectively. Tonic activity and reward-related modulation ended around the time of reward delivery. Additionally, some tonic changes in activity started prior to the appearance of the initial stimulus, and were related to the anticipatory fixational behavior. A partially overlapping population of neurons showed both the initial anticipatory response and subsequent predicted reward value-dependent activity modulation by their systematic increase or decrease of tonic activity. These bi-directional reward- and anticipatory behavior-related modulation patterns are suitable for the presumed role of the PPTN in reward processing and

  2. The reward of a good joke: neural correlates of viewing dynamic displays of stand-up comedy.

    Science.gov (United States)

    Franklin, Robert G; Adams, Reginald B

    2011-12-01

    Humor is enjoyable, yet few studies to date have reported that humor engages brain regions involved in reward processing (i.e., the mesolimbic reward system). Even fewer have investigated socially relevant, dynamic displays of real actors telling jokes. Instead, many studies have focused on responses to static cartoons or written jokes in isolation. In the present investigation, we used functional magnetic resonance imaging (fMRI) to examine brain activation in response to video clips of comedians performing stand-up comedy, a more socially relevant task than reading jokes or cartoons in isolation. Participants watched video clips of eight stand-up comedians, half female/half male, that were prerated by a separate group of participants from the same population as eliciting either high or low levels of amusement, thereby allowing us to control for comedian attributes and comedic style. We found that high-funny clips elicited more activation in several brain regions involved with reward responses, including the nucleus accumbens, caudate, and putamen. A regression with participants' own ratings of humor revealed similar activity in reward areas as well as in regions involved in theory of mind. These findings indicate that dynamic social displays of humor do engage reward responses. The rewarding nature of humor may help explain why it is so valued socially.

  3. Do dopaminergic gene polymorphisms affect mesolimbic reward activation of music listening response? Therapeutic impact on Reward Deficiency Syndrome (RDS).

    Science.gov (United States)

    Blum, Kenneth; Chen, Thomas J H; Chen, Amanda L H; Madigan, Margaret; Downs, B William; Waite, Roger L; Braverman, Eric R; Kerner, Mallory; Bowirrat, Abdalla; Giordano, John; Henshaw, Harry; Gold, Mark S

    2010-03-01

    Using fMRI, Menon and Levitin [9] clearly found for the first time that listening to music strongly modulates activity in a network of mesolimbic structures involved in reward processing including the nucleus accumbens (NAc) and the ventral tegmental area (VTA), as well as the hypothalamus, and insula, which are thought to be involved in regulating autonomic and physiological responses to rewarding and emotional stimuli. Importantly, responses in the NAc and VTA were strongly correlated pointing to an association between dopamine release and NAc response to music. Listing to pleasant music induced a strong response and significant activation of the VTA-mediated interaction of the NAc with the hypothalamus, insula, and orbitofrontal cortex. Blum et al. [10] provided the first evidence that the dopamine D2 receptor gene (DRD2) Taq 1 A1 allele significantly associated with severe alcoholism whereby the author's suggested that they found the first "reward gene" located in the mesolimbic system. The enhanced functional and effective connectivity between brain regions mediating reward, autonomic, and cognitive processing provides insight into understanding why listening to music is one of the most rewarding and pleasurable human experiences. However, little is known about why some people have a more or less powerful mesolimbic experience when they are listening to music. It is well-known that music may induce an endorphinergic response that is blocked by naloxone, a known opioid antagonist (Goldstein [19]). Opioid transmission in the NAc is associated with dopamine release in the VTA. Moreover, dopamine release in the VTA is linked to polymorphisms of the DRD2 gene and even attention-deficit hyperactivity disorder (ADHD), whereby carriers of the DRD2 A1 allele show a reduced NAc release of dopamine (DA). Thus it is conjectured that similar mechanisms in terms of adequate dopamine release and subsequent activation of reward circuitry by listening to music might also be

  4. Reward salience and risk aversion underlie differential ACC activity in substance dependence

    Directory of Open Access Journals (Sweden)

    William H. Alexander

    2015-01-01

    Full Text Available The medial prefrontal cortex, especially the dorsal anterior cingulate cortex (ACC, has long been implicated in cognitive control and error processing. Although the association between ACC and behavior has been established, it is less clear how ACC contributes to dysfunctional behavior such as substance dependence. Evidence from neuroimaging studies investigating ACC function in substance users is mixed, with some studies showing disengagement of ACC in substance dependent individuals (SDs, while others show increased ACC activity related to substance use. In this study, we investigate ACC function in SDs and healthy individuals performing a change signal task for monetary rewards. Using a priori predictions derived from a recent computational model of ACC, we find that ACC activity differs between SDs and controls in factors related to reward salience and risk aversion between SDs and healthy individuals. Quantitative fits of a computational model to fMRI data reveal significant differences in best fit parameters for reward salience and risk preferences. Specifically, the ACC in SDs shows greater risk aversion, defined as concavity in the utility function, and greater attention to rewards relative to reward omission. Furthermore, across participants risk aversion and reward salience are positively correlated. The results clarify the role that ACC plays in both the reduced sensitivity to omitted rewards and greater reward valuation in SDs. Clinical implications of applying computational modeling in psychiatry are also discussed.

  5. The rewarding value of good motor performance in the context of monetary incentives.

    Science.gov (United States)

    Lutz, Kai; Pedroni, Andreas; Nadig, Karin; Luechinger, Roger; Jäncke, Lutz

    2012-07-01

    Whether an agent receives positive task feedback or a monetary reward, neural activity in their striatum increases. In the latter case striatal activity reflects extrinsic reward processing, while in the former, striatal activity reflects the intrinsically rewarding effects of performing well. There can be a "hidden cost of reward", which is a detrimental effect of extrinsic on intrinsic reward value. This raises the question how these two types of reward interact. To address this, we applied a monetary incentive delay task: in all trials participants received feedback depending on their performance. In half of the trials they could additionally receive monetary reward if they performed well. This resulted in high performance trials, which were monetarily rewarded and high performance trials that were not. This made it possible to dissociate the neural correlates of performance feedback from the neural correlates of monetary reward that comes with high performance. Performance feedback alone elicits activation increases in the ventral striatum. This activation increases due to additional monetary reward. Neural response in the dorsal striatum on the other hand is only significantly increased by feedback when a monetary incentive is present. The quality of performance does not significantly influence dorsal striatum activity. In conclusion, our results indicate that the dorsal striatum is primarily sensitive to optional or actually received external rewards, whereas the ventral striatum may be coding intrinsic reward due to positive performance feedback. Thus the ventral striatum is suggested to be involved in the processing of intrinsically motivated behavior.

  6. Acute stress-induced cortisol elevations mediate reward system activity during subconscious processing of sexual stimuli.

    Science.gov (United States)

    Oei, Nicole Y L; Both, Stephanie; van Heemst, Diana; van der Grond, Jeroen

    2014-01-01

    Stress is thought to alter motivational processes by increasing dopamine (DA) secretion in the brain's "reward system", and its key region, the nucleus accumbens (NAcc). However, stress studies using functional magnetic resonance imaging (fMRI), mainly found evidence for stress-induced decreases in NAcc responsiveness toward reward cues. Results from both animal and human PET studies indicate that the stress hormone cortisol may be crucial in the interaction between stress and dopaminergic actions. In the present study we therefore investigated whether cortisol mediated the effect of stress on DA-related responses to -subliminal-presentation of reward cues using the Trier Social Stress Test (TSST), which is known to reliably enhance cortisol levels. Young healthy males (n = 37) were randomly assigned to the TSST or control condition. After stress induction, brain activation was assessed using fMRI during a backward-masking paradigm in which potentially rewarding (sexual), emotionally negative and neutral stimuli were presented subliminally, masked by pictures of inanimate objects. A region of interest analysis showed that stress decreased activation in the NAcc in response to masked sexual cues (voxel-corrected, pcortisol levels were related to stronger NAcc activation, showing that cortisol acted as a suppressor variable in the negative relation between stress and NAcc activation. The present findings indicate that cortisol is crucially involved in the relation between stress and the responsiveness of the reward system. Although generally stress decreases activation in the NAcc in response to rewarding stimuli, high stress-induced cortisol levels suppress this relation, and are associated with stronger NAcc activation. Individuals with a high cortisol response to stress might on one hand be protected against reductions in reward sensitivity, which has been linked to anhedonia and depression, but they may ultimately be more vulnerable to increased reward

  7. Opioid-Induced Glial Activation: Mechanisms of Activation and Implications for Opioid Analgesia, Dependence, and Reward

    Directory of Open Access Journals (Sweden)

    Mark R. Hutchinson

    2007-01-01

    Full Text Available This review will introduce the concept of toll-like receptor (TLR–mediated glial activation as central to all of the following: neuropathic pain, compromised acute opioid analgesia, and unwanted opioid side effects (tolerance, dependence, and reward. Attenuation of glial activation has previously been demonstrated both to alleviate exaggerated pain states induced by experimental pain models and to reduce the development of opioid tolerance. Here we demonstrate that selective acute antagonism of TLR4 results in reversal of neuropathic pain as well as potentiation of opioid analgesia. Attenuating central nervous system glial activation was also found to reduce the development of opioid dependence, and opioid reward at a behavioral (conditioned place preference and neurochemical (nucleus accumbens microdialysis of morphine-induced elevations in dopamine level of analysis. Moreover, a novel antagonism of TLR4 by (+- and (˗-isomer opioid antagonists has now been characterized, and both antiallodynic and morphine analgesia potentiating activity shown. Opioid agonists were found to also possess TLR4 agonistic activity, predictive of glial activation. Targeting glial activation is a novel and as yet clinically unexploited method for treatment of neuropathic pain. Moreover, these data indicate that attenuation of glial activation, by general or selective TLR antagonistic mechanisms, may also be a clinical method for separating the beneficial (analgesia and unwanted (tolerance, dependence, and reward actions of opioids, thereby improving the safety and efficacy of their use.

  8. Prediction-error in the context of real social relationships modulates reward system activity

    Directory of Open Access Journals (Sweden)

    Joshua ePoore

    2012-08-01

    Full Text Available The human reward system is sensitive to both social (e.g., validation and non-social rewards (e.g., money and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward—social validation—and this activity’s relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants’ expectations for their romantic partners’ positive regard of them were confirmed (validated or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

  9. Associations of reward sensitivity with food consumption, activity pattern, and BMI in children.

    Science.gov (United States)

    De Decker, Annelies; Sioen, Isabelle; Verbeken, Sandra; Braet, Caroline; Michels, Nathalie; De Henauw, Stefaan

    2016-05-01

    In the current study, the associations of reward sensitivity with weight related behaviors and body mass index were investigated in a general population sample of 443 Flemish children (50.3% boys) aged 5.5-12 years. Cross-sectional data on palatable food consumption frequency, screen time, physical activity, parental education level and measured length and weight were collected. The Drive subscale of the 'Behavioral Inhibition Scale/Behavioral Activation Scale' was used as a short method to measure reward sensitivity. A significant positive association of reward sensitivity with the fast food and sweet drink consumption frequency was found. Furthermore, a significant positive association of reward sensitivity with the z-score of body mass index was demonstrated, which explained additional variance to the variance explained by palatable food consumption frequency, screen time, physical activity and parental education level. Hence, the assessment of reward sensitivity may have an added value to the assessment of weight-related behavior indicators when evaluating the determinants of overweight in a child. In sum, children high in reward sensitivity might be more attracted to fast food and sweet drinks, and hence, might be more vulnerable to develop unfavorable food habits and overweight. These findings suggest that considering inter-individual differences in reward sensitivity is of importance in future childhood obesity prevention campaigns.

  10. Planning activity for internally generated reward goals in monkey amygdala neurons.

    Science.gov (United States)

    Hernádi, István; Grabenhorst, Fabian; Schultz, Wolfram

    2015-03-01

    The best rewards are often distant and can only be achieved by planning and decision-making over several steps. We designed a multi-step choice task in which monkeys followed internal plans to save rewards toward self-defined goals. During this self-controlled behavior, amygdala neurons showed future-oriented activity that reflected the animal's plan to obtain specific rewards several trials ahead. This prospective activity encoded crucial components of the animal's plan, including value and length of the planned choice sequence. It began on initial trials when a plan would be formed, reappeared step by step until reward receipt, and readily updated with a new sequence. It predicted performance, including errors, and typically disappeared during instructed behavior. Such prospective activity could underlie the formation and pursuit of internal plans characteristic of goal-directed behavior. The existence of neuronal planning activity in the amygdala suggests that this structure is important in guiding behavior toward internally generated, distant goals.

  11. The neural correlates of priming emotion and reward systems for conflict processing in alcoholics.

    Science.gov (United States)

    Schulte, T; Jung, Y-C; Sullivan, E V; Pfefferbaum, A; Serventi, M; Müller-Oehring, E M

    2016-11-04

    Emotional dysregulation in alcoholism (ALC) may result from disturbed inhibitory mechanisms. We therefore tested emotion and alcohol cue reactivity and inhibitory processes using negative priming. To test the neural correlates of cue reactivity and negative priming, 26 ALC and 26 age-matched controls underwent functional MRI performing a Stroop color match-to-sample task. In cue reactivity trials, task-irrelevant emotion and alcohol-related pictures were interspersed between color samples and color words. In negative priming trials, pictures primed the semantic content of an alcohol or emotion Stroop word. Behaviorally, both groups showed response facilitation to picture cue trials and response inhibition to primed trials. For cue reactivity to emotion and alcohol pictures, ALC showed midbrain-limbic activation. By contrast, controls activated frontoparietal executive control regions. Greater midbrain-hippocampal activation in ALC correlated with higher amounts of lifetime alcohol consumption and higher anxiety. With negative priming, ALC exhibited frontal cortical but not midbrain-hippocampal activation, similar to the pattern observed in controls. Higher frontal activation to alcohol-priming correlated with less craving and to emotion-priming with fewer depressive symptoms. The findings suggest that neurofunctional systems in ALC can be primed to deal with upcoming emotion- and alcohol-related conflict and can overcome the prepotent midbrain-limbic cue reactivity response.

  12. Active reward processing during human sleep: insights from sleep-related eating disorder

    Directory of Open Access Journals (Sweden)

    Lampros ePerogamvros

    2012-11-01

    Full Text Available In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED, a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity on reward-related questionnaires. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating disorders, our findings suggest a role of an active reward system during sleep in the manifestation of SRED.

  13. Reward: From Basic Reinforcers to Anticipation of Social Cues.

    Science.gov (United States)

    Rademacher, Lena; Schulte-Rüther, Martin; Hanewald, Bernd; Lammertz, Sarah

    2017-01-01

    Reward processing plays a major role in goal-directed behavior and motivation. On the neural level, it is mediated by a complex network of brain structures called the dopaminergic reward system. In the last decade, neuroscientific researchers have become increasingly interested in aspects of social interaction that are experienced as rewarding. Recent neuroimaging studies have provided evidence that the reward system mediates the processing of social stimuli in a manner analogous to nonsocial rewards and thus motivates social behavior. In this context, the neuropeptide oxytocin is assumed to play a key role by activating dopaminergic reward pathways in response to social cues, inducing the rewarding quality of social interactions. Alterations in the dopaminergic reward system have been found in several psychiatric disorders that are accompanied by social interaction and motivation problems, for example autism, attention deficit/hyperactivity disorder, addiction disorders, and schizophrenia.

  14. Reward bias and lateralization in gambling behavior: behavioral activation system and alpha band analysis.

    Science.gov (United States)

    Balconi, Michela; Finocchiaro, Roberta; Canavesio, Ylenia; Messina, Rossella

    2014-11-30

    The present research explored the main factors that can influence subjects' choices in the case of decisions. In order to elucidate the individual differences that influence the decisional processes, making their strategies more or less advantageous, we tested the effect of a reward sensitivity in the behavioral activation system (BAS-Reward) constructed on the ability to distinguish between high- and low-risk decisions. Secondly, the lateralization effect, related to increased activation of the left (BAS-related) hemisphere, was explored. Thirty-one subjects were tested using the Iowa Gambling Task, and the BAS-Reward measure was applied to distinguish between high-BAS and low-BAS groups. Behavioral responses (gain/loss options) and alpha-band modulation were considered. It was found that high-BAS group increased their tendency to opt in favor of the immediate reward (loss strategy) rather than the long-term option (win strategy). Secondly, high-BAS subjects showed an increased left-hemisphere activation in response to losing (with immediate reward) choices in comparison with low-BAS subjects. A "reward bias" effect was supposed to explain both the bad strategy and the unbalanced hemispheric activation for high-BAS and more risk-taking subjects.

  15. Combining Correlation-Based and Reward-Based Learning in Neural Control for Policy Improvement

    DEFF Research Database (Denmark)

    Manoonpong, Poramate; Kolodziejski, Christoph; Wörgötter, Florentin;

    2013-01-01

    Classical conditioning (conventionally modeled as correlation-based learning) and operant conditioning (conventionally modeled as reinforcement learning or reward-based learning) have been found in biological systems. Evidence shows that these two mechanisms strongly involve learning about...... associations. Based on these biological findings, we propose a new learning model to achieve successful control policies for artificial systems. This model combines correlation-based learning using input correlation learning (ICO learning) and reward-based learning using continuous actor–critic reinforcement...... learning (RL), thereby working as a dual learner system. The model performance is evaluated by simulations of a cart-pole system as a dynamic motion control problem and a mobile robot system as a goal-directed behavior control problem. Results show that the model can strongly improve pole balancing control...

  16. Synchrony Can Destabilize Reward-Sensitive Networks

    Directory of Open Access Journals (Sweden)

    Michael eChary

    2014-04-01

    Full Text Available When exposed to rewarding stimuli, only some animals develop persistent craving. Others are resilient and do not. How the activity of neural populations relates to the development of persistent craving behavior is not fully understood. Previous computational studies suggest that synchrony helps a network embed certain patterns of activity, although the role of synchrony in reward-dependent learning has been less studied. Increased synchrony has been reported as a marker for both susceptibility and resilience to developing persistent craving. Here we use computational simulations to study the effect of reward salience on the ability of synchronous input to embed a new pattern of activity into a neural population. Our main finding is that weak stimulus-reward correlations can facilitate the short-term repetition of a pattern of neural activity, while blocking long-term embedding of that pattern. Interestingly, synchrony did not have this dual effect on all patterns, which suggests that synchrony is more effective at embedding some patterns of activity than others. Our results demonstrate that synchrony can have opposing effects in networks sensitive to the correlation structure of their inputs, in this case the correlation between stimulus and reward. This work contributes to an understanding of the interplay between synchrony and reward-dependent plasticity.

  17. Pain and suicidality: Insights from reward and addiction neuroscience

    OpenAIRE

    Elman, Igor; Borsook, David; Nora D Volkow

    2013-01-01

    Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system’s role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward cir...

  18. Pain relief produces negative reinforcement through activation of mesolimbic reward-valuation circuitry.

    Science.gov (United States)

    Navratilova, Edita; Xie, Jennifer Y; Okun, Alec; Qu, Chaoling; Eyde, Nathan; Ci, Shuang; Ossipov, Michael H; King, Tamara; Fields, Howard L; Porreca, Frank

    2012-12-11

    Relief of pain is rewarding. Using a model of experimental postsurgical pain we show that blockade of afferent input from the injury with local anesthetic elicits conditioned place preference, activates ventral tegmental dopaminergic cells, and increases dopamine release in the nucleus accumbens. Importantly, place preference is associated with increased activity in midbrain dopaminergic neurons and blocked by dopamine antagonists injected into the nucleus accumbens. The data directly support the hypothesis that relief of pain produces negative reinforcement through activation of the mesolimbic reward-valuation circuitry.

  19. Increased frequency of social interaction is associated with enjoyment enhancement and reward system activation.

    Science.gov (United States)

    Kawamichi, Hiroaki; Sugawara, Sho K; Hamano, Yuki H; Makita, Kai; Kochiyama, Takanori; Sadato, Norihiro

    2016-04-19

    Positive social interactions contribute to the sense that one's life has meaning. Enjoyment of feelings associated through social interaction motivates humans to build social connections according to their personal preferences. Therefore, we hypothesized that social interaction itself activates the reward system in a manner that depends upon individual interaction preferences. To test this hypothesis, we conducted a functional magnetic resonance imaging (fMRI) study in which 38 participants played a virtual ball-toss game in which the number of ball tosses to the participant was either similar to (normal-frequency condition) or higher than (high-frequency condition) the number of tosses to the other players. Participants reported greater-than-anticipated enjoyment during the high-frequency condition, suggesting that receiving a social reward led to unexpected positive feelings. Consistent with this, the high-frequency condition produced stronger activation in the ventral striatum, which is part of the reward system, and the precuneus, representing positive self-image, which might be translated to social reward. Furthermore, ventral striatal activation covaried with individual participants' preference for interactions with others. These findings suggest that an elevated frequency of social interaction is represented as a social reward, which might motivate individuals to promote social interaction in a manner that is modulated by personal preference.

  20. Future planning: default network activity couples with frontoparietal control network and reward-processing regions during process and outcome simulations.

    Science.gov (United States)

    Gerlach, Kathy D; Spreng, R Nathan; Madore, Kevin P; Schacter, Daniel L

    2014-12-01

    We spend much of our daily lives imagining how we can reach future goals and what will happen when we attain them. Despite the prevalence of such goal-directed simulations, neuroimaging studies on planning have mainly focused on executive processes in the frontal lobe. This experiment examined the neural basis of process simulations, during which participants imagined themselves going through steps toward attaining a goal, and outcome simulations, during which participants imagined events they associated with achieving a goal. In the scanner, participants engaged in these simulation tasks and an odd/even control task. We hypothesized that process simulations would recruit default and frontoparietal control network regions, and that outcome simulations, which allow us to anticipate the affective consequences of achieving goals, would recruit default and reward-processing regions. Our analysis of brain activity that covaried with process and outcome simulations confirmed these hypotheses. A functional connectivity analysis with posterior cingulate, dorsolateral prefrontal cortex and anterior inferior parietal lobule seeds showed that their activity was correlated during process simulations and associated with a distributed network of default and frontoparietal control network regions. During outcome simulations, medial prefrontal cortex and amygdala seeds covaried together and formed a functional network with default and reward-processing regions.

  1. Influence of dopaminergically mediated reward on somatosensory decision-making.

    Directory of Open Access Journals (Sweden)

    Burkhard Pleger

    2009-07-01

    Full Text Available Reward-related dopaminergic influences on learning and overt behaviour are well established, but any influence on sensory decision-making is largely unknown. We used functional magnetic resonance imaging (fMRI while participants judged electric somatosensory stimuli on one hand or other, before being rewarded for correct performance at trial end via a visual signal, at one of four anticipated financial levels. Prior to the procedure, participants received either placebo (saline, a dopamine agonist (levodopa, or an antagonist (haloperidol.higher anticipated reward improved tactile decisions. Visually signalled reward reactivated primary somatosensory cortex for the judged hand, more strongly for higher reward. After receiving a higher reward on one trial, somatosensory activations and decisions were enhanced on the next trial. These behavioural and neural effects were all enhanced by levodopa and attenuated by haloperidol, indicating dopaminergic dependency. Dopaminergic reward-related influences extend even to early somatosensory cortex and sensory decision-making.

  2. Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times.

    Science.gov (United States)

    Cavanagh, James F

    2015-04-15

    Recent work has suggested that reward prediction errors elicit a positive voltage deflection in the scalp-recorded electroencephalogram (EEG); an event sometimes termed a reward positivity. However, a strong test of this proposed relationship remains to be defined. Other important questions remain unaddressed: such as the role of the reward positivity in predicting future behavioral adjustments that maximize reward. To answer these questions, a three-armed bandit task was used to investigate the role of positive prediction errors during trial-by-trial exploration and task-set based exploitation. The feedback-locked reward positivity was characterized by delta band activities, and these related EEG features scaled with the degree of a computationally derived positive prediction error. However, these phenomena were also dissociated: the computational model predicted exploitative action selection and related response time speeding whereas the feedback-locked EEG features did not. Compellingly, delta band dynamics time-locked to the subsequent bandit (the P3) successfully predicted these behaviors. These bandit-locked findings included an enhanced parietal to motor cortex delta phase lag that correlated with the degree of response time speeding, suggesting a mechanistic role for delta band activities in motivating action selection. This dissociation in feedback vs. bandit locked EEG signals is interpreted as a differentiation in hierarchically distinct types of prediction error, yielding novel predictions about these dissociable delta band phenomena during reinforcement learning and decision making.

  3. Brain areas activated by uncertain reward-based decision-making in healthy volunteers

    Institute of Scientific and Technical Information of China (English)

    Zongjun Guo; Juan Chen; Shien Liu; Yuhuan Li; Bo Sun; Zhenbo Gao

    2013-01-01

    Reward-based decision-making has been found to activate several brain areas, including the ven-trolateral prefrontal lobe, orbitofrontal cortex, anterior cingulate cortex, ventral striatum, and meso-limbic dopaminergic system. In this study, we observed brain areas activated under three degrees of uncertainty in a reward-based decision-making task (certain, risky, and ambiguous). The tasks were presented using a brain function audiovisual stimulation system. We conducted brain scans of 15 healthy volunteers using a 3.0T magnetic resonance scanner. We used SPM8 to analyze the location and intensity of activation during the reward-based decision-making task, with respect to the three conditions. We found that the orbitofrontal cortex was activated in the certain reward con-dition, while the prefrontal cortex, precentral gyrus, occipital visual cortex, inferior parietal lobe, ce-rebel ar posterior lobe, middle temporal gyrus, inferior temporal gyrus, limbic lobe, and midbrain were activated during the ‘risk’ condition. The prefrontal cortex, temporal pole, inferior temporal gyrus, occipital visual cortex, and cerebel ar posterior lobe were activated during ambiguous deci-sion-making. The ventrolateral prefrontal lobe, frontal pole of the prefrontal lobe, orbitofrontal cortex, precentral gyrus, inferior temporal gyrus, fusiform gyrus, supramarginal gyrus, inferior parietal lo-bule, and cerebel ar posterior lobe exhibited greater activation in the‘risk’ than in the‘certain’ con-dition (P<0.05). The frontal pole and dorsolateral region of the prefrontal lobe, as wel as the ce-rebel ar posterior lobe, showed significantly greater activation in the ‘ambiguous’ condition com-pared to the ‘risk’ condition (P < 0.05). The prefrontal lobe, occipital lobe, parietal lobe, temporal lobe, limbic lobe, midbrain, and posterior lobe of the cerebel um were activated during deci-sion-making about uncertain rewards. Thus, we observed different levels and regions of

  4. Windowed active sampling for reliable neural learning

    NARCIS (Netherlands)

    Barakova, E.I; Spaanenburg, L

    1998-01-01

    The composition of the example set has a major impact on the quality of neural learning. The popular approach is focused on extensive pre-processing to bridge the representation gap between process measurement and neural presentation. In contrast, windowed active sampling attempts to solve these pro

  5. Insular activation during reward anticipation reflects duration of illness in abstinent pathological gamblers

    Directory of Open Access Journals (Sweden)

    Kosuke eTsurumi

    2014-09-01

    Full Text Available Pathological gambling (PG is a chronic mental disorder characterized by a difficulty restraining gambling behavior despite negative consequences. Although brain abnormalities in patients with substance use disorders are caused by repetitive drug use and recover partly with drug abstinence, the relationship between brain activity and duration of illness or abstinence of gambling behavior in PG patients remains unclear. Here, using functional magnetic resonance imaging, we compared the brain activity of 23 PG patients recruited from a treatment facility with 27 demographically-matched healthy control subjects during reward anticipation, and examined the correlations between brain activity and duration of illness or abstinence in PG patients. During reward anticipation, PG patients showed decreased activity compared to healthy controls in a broad range of the reward system regions, including the insula cortex. In PG patients, activation in the left insula showed a significant negative correlation with illness duration. Our findings suggest that insular activation during reward anticipation may serve as a marker of progression of pathological gambling.

  6. Stimulus-dependent adjustment of reward prediction error in the midbrain.

    Directory of Open Access Journals (Sweden)

    Hiromasa Takemura

    Full Text Available Previous reports have described that neural activities in midbrain dopamine areas are sensitive to unexpected reward delivery and omission. These activities are correlated with reward prediction error in reinforcement learning models, the difference between predicted reward values and the obtained reward outcome. These findings suggest that the reward prediction error signal in the brain updates reward prediction through stimulus-reward experiences. It remains unknown, however, how sensory processing of reward-predicting stimuli contributes to the computation of reward prediction error. To elucidate this issue, we examined the relation between stimulus discriminability of the reward-predicting stimuli and the reward prediction error signal in the brain using functional magnetic resonance imaging (fMRI. Before main experiments, subjects learned an association between the orientation of a perceptually salient (high-contrast Gabor patch and a juice reward. The subjects were then presented with lower-contrast Gabor patch stimuli to predict a reward. We calculated the correlation between fMRI signals and reward prediction error in two reinforcement learning models: a model including the modulation of reward prediction by stimulus discriminability and a model excluding this modulation. Results showed that fMRI signals in the midbrain are more highly correlated with reward prediction error in the model that includes stimulus discriminability than in the model that excludes stimulus discriminability. No regions showed higher correlation with the model that excludes stimulus discriminability. Moreover, results show that the difference in correlation between the two models was significant from the first session of the experiment, suggesting that the reward computation in the midbrain was modulated based on stimulus discriminability before learning a new contingency between perceptually ambiguous stimuli and a reward. These results suggest that the human

  7. Oscillatory activity in the medial prefrontal cortex and nucleus accumbens correlates with impulsivity and reward outcome.

    Directory of Open Access Journals (Sweden)

    Nicholas A Donnelly

    Full Text Available Actions expressed prematurely without regard for their consequences are considered impulsive. Such behaviour is governed by a network of brain regions including the prefrontal cortex (PFC and nucleus accumbens (NAcb and is prevalent in disorders including attention deficit hyperactivity disorder (ADHD and drug addiction. However, little is known of the relationship between neural activity in these regions and specific forms of impulsive behaviour. In the present study we investigated local field potential (LFP oscillations in distinct sub-regions of the PFC and NAcb on a 5-choice serial reaction time task (5-CSRTT, which measures sustained, spatially-divided visual attention and action restraint. The main findings show that power in gamma frequency (50-60 Hz LFP oscillations transiently increases in the PFC and NAcb during both the anticipation of a cue signalling the spatial location of a nose-poke response and again following correct responses. Gamma oscillations were coupled to low-frequency delta oscillations in both regions; this coupling strengthened specifically when an error response was made. Theta (7-9 Hz LFP power in the PFC and NAcb increased during the waiting period and was also related to response outcome. Additionally, both gamma and theta power were significantly affected by upcoming premature responses as rats waited for the visual cue to respond. In a subgroup of rats showing persistently high levels of impulsivity we found that impulsivity was associated with increased error signals following a nose-poke response, as well as reduced signals of previous trial outcome during the waiting period. Collectively, these in-vivo neurophysiological findings further implicate the PFC and NAcb in anticipatory impulsive responses and provide evidence that abnormalities in the encoding of rewarding outcomes may underlie trait-like impulsive behaviour.

  8. Dopamine agonist increases risk taking but blunts reward-related brain activity.

    Directory of Open Access Journals (Sweden)

    Jordi Riba

    Full Text Available The use of D2/D3 dopaminergic agonists in Parkinson's disease (PD may lead to pathological gambling. In a placebo-controlled double-blind study in healthy volunteers, we observed riskier choices in a lottery task after administration of the D3 receptor-preferring agonist pramipexole thus mimicking risk-taking behavior in PD. Moreover, we demonstrate decreased activation in the rostral basal ganglia and midbrain, key structures of the reward system, following unexpected high gains and therefore propose that pathological gambling in PD results from the need to seek higher rewards to overcome the blunted response in this system.

  9. Active Reward Processing during Human Sleep: Insights from Sleep-Related Eating Disorder.

    Science.gov (United States)

    Perogamvros, Lampros; Baud, Patrick; Hasler, Roland; Cloninger, Claude Robert; Schwartz, Sophie; Perrig, Stephen

    2012-01-01

    In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED), a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography, a dream diary and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating disorders, our findings suggest a role of an active reward system during sleep in the manifestation of SRED.

  10. Peers Increase Adolescent Risk Taking by Enhancing Activity in the Brain's Reward Circuitry

    Science.gov (United States)

    Chein, Jason; Albert, Dustin; O'Brien, Lia; Uckert, Kaitlyn; Steinberg, Laurence

    2011-01-01

    The presence of peers increases risk taking among adolescents but not adults. We posited that the presence of peers may promote adolescent risk taking by sensitizing brain regions associated with the anticipation of potential rewards. Using fMRI, we measured brain activity in adolescents, young adults, and adults as they made decisions in a…

  11. Blunted ventral striatal responses to anticipated rewards foreshadow problematic drug use in novelty-seeking adolescents

    Science.gov (United States)

    Büchel, Christian; Peters, Jan; Banaschewski, Tobias; Bokde, Arun L. W.; Bromberg, Uli; Conrod, Patricia J.; Flor, Herta; Papadopoulos, Dimitri; Garavan, Hugh; Gowland, Penny; Heinz, Andreas; Walter, Henrik; Ittermann, Bernd; Mann, Karl; Martinot, Jean-Luc; Paillère-Martinot, Marie-Laure; Nees, Frauke; Paus, Tomas; Pausova, Zdenka; Poustka, Luise; Rietschel, Marcella; Robbins, Trevor W.; Smolka, Michael N.; Gallinat, Juergen; Schumann, Gunter; Knutson, Brian; Arroyo, Mercedes; Artiges, Eric; Aydin, Semiha; Bach, Christine; Barbot, Alexis; Barker, Gareth; Bruehl, Ruediger; Cattrell, Anna; Constant, Patrick; Crombag, Hans; Czech, Katharina; Dalley, Jeffrey; Decideur, Benjamin; Desrivieres, Sylvane; Fadai, Tahmine; Fauth-Buhler, Mira; Feng, Jianfeng; Filippi, Irinia; Frouin, Vincent; Fuchs, Birgit; Gemmeke, Isabel; Genauck, Alexander; Hanratty, Eanna; Heinrichs, Bert; Heym, Nadja; Hubner, Thomas; Ihlenfeld, Albrecht; Ing, Alex; Ireland, James; Jia, Tianye; Jones, Jennifer; Jurk, Sarah; Kaviani, Mehri; Klaassen, Arno; Kruschwitz, Johann; Lalanne, Christophe; Lanzerath, Dirk; Lathrop, Mark; Lawrence, Claire; Lemaitre, Hervé; Macare, Christine; Mallik, Catherine; Mar, Adam; Martinez-Medina, Lourdes; Mennigen, Eva; de Carvahlo, Fabiana Mesquita; Mignon, Xavier; Millenet, Sabina; Miranda, Ruben; Müller, Kathrin; Nymberg, Charlotte; Parchetka, Caroline; Pena-Oliver, Yolanda; Pentilla, Jani; Poline, Jean-Baptiste; Quinlan, Erin Burke; Rapp, Michael; Ripke, Stephan; Ripley, Tamzin; Robert, Gabriel; Rogers, John; Romanowski, Alexander; Ruggeri, Barbara; Schmäl, Christine; Schmidt, Dirk; Schneider, Sophia; Schubert, Florian; Schwartz, Yannick; Sommer, Wolfgang; Spanagel, Rainer; Speiser, Claudia; Spranger, Tade; Stedman, Alicia; Stephens, Dai; Strache, Nicole; Ströhle, Andreas; Struve, Maren; Subramaniam, Naresh; Theobald, David; Vetter, Nora; Vulser, Helene; Weiss, Katharina; Whelan, Robert; Williams, Steve; Xu, Bing; Yacubian, Juliana; Yu, Tao; Ziesch, Veronika

    2017-01-01

    Novelty-seeking tendencies in adolescents may promote innovation as well as problematic impulsive behaviour, including drug abuse. Previous research has not clarified whether neural hyper- or hypo-responsiveness to anticipated rewards promotes vulnerability in these individuals. Here we use a longitudinal design to track 144 novelty-seeking adolescents at age 14 and 16 to determine whether neural activity in response to anticipated rewards predicts problematic drug use. We find that diminished BOLD activity in mesolimbic (ventral striatal and midbrain) and prefrontal cortical (dorsolateral prefrontal cortex) regions during reward anticipation at age 14 predicts problematic drug use at age 16. Lower psychometric conscientiousness and steeper discounting of future rewards at age 14 also predicts problematic drug use at age 16, but the neural responses independently predict more variance than psychometric measures. Together, these findings suggest that diminished neural responses to anticipated rewards in novelty-seeking adolescents may increase vulnerability to future problematic drug use. PMID:28221370

  12. Diminishing striatal activation across adolescent development during reward anticipation in offspring of schizophrenia patients.

    Science.gov (United States)

    Vink, Matthijs; de Leeuw, Max; Pouwels, Ruby; van den Munkhof, Hanna E; Kahn, René S; Hillegers, Manon

    2016-01-01

    Schizophrenia is a severe psychiatric disorder associated with impaired fronto-striatal functioning. Similar deficits are observed in unaffected siblings of patients, indicating that these deficits are linked to a familial risk for the disorder. Fronto-striatal deficits may arise during adolescence and precede clinical manifestation of the disorder. However, the development of the fronto-striatal network in adolescents at increased familial risk for schizophrenia is still poorly understood. In this cross-sectional study, we investigate the impact of familial risk on fronto-striatal functioning across age related to reward anticipation and receipt in 25 adolescent offspring of schizophrenia patients (SZ offspring) and 36 age-matched healthy controls (range 10-19years). Subjects performed a reward task while being scanned with functional MRI. Overall response times and the amount of money won did not differ between the groups. Striatal activation during reward anticipation decreased across age in the SZ offspring, while it did not in the healthy controls. Activation in the orbitofrontal cortex during reward receipt did not differ between the groups. These results, taken together with data from adult schizophrenia patients and their siblings, indicate that the diminishing striatal activation across adolescence may signify a familial vulnerability for schizophrenia.

  13. Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards.

    Science.gov (United States)

    Miyazaki, Kayoko W; Miyazaki, Katsuhiko; Tanaka, Kenji F; Yamanaka, Akihiro; Takahashi, Aki; Tabuchi, Sawako; Doya, Kenji

    2014-09-08

    Serotonin is a neuromodulator that is involved extensively in behavioral, affective, and cognitive functions in the brain. Previous recording studies of the midbrain dorsal raphe nucleus (DRN) revealed that the activation of putative serotonin neurons correlates with the levels of behavioral arousal [1], rhythmic motor outputs [2], salient sensory stimuli [3-6], reward, and conditioned cues [5-8]. The classic theory on serotonin states that it opposes dopamine and inhibits behaviors when aversive events are predicted [9-14]. However, the therapeutic effects of serotonin signal-enhancing medications have been difficult to reconcile with this theory [15, 16]. In contrast, a more recent theory states that serotonin facilitates long-term optimal behaviors and suppresses impulsive behaviors [17-21]. To test these theories, we developed optogenetic mice that selectively express channelrhodopsin in serotonin neurons and tested how the activation of serotonergic neurons in the DRN affects animal behavior during a delayed reward task. The activation of serotonin neurons reduced the premature cessation of waiting for conditioned cues and food rewards. In reward omission trials, serotonin neuron stimulation prolonged the time animals spent waiting. This effect was observed specifically when the animal was engaged in deciding whether to keep waiting and was not due to motor inhibition. Control experiments showed that the prolonged waiting times observed with optogenetic stimulation were not due to behavioral inhibition or the reinforcing effects of serotonergic activation. These results show, for the first time, that the timed activation of serotonin neurons during waiting promotes animals' patience to wait for a delayed reward.

  14. Operant behavior to obtain palatable food modifies ERK activity in the brain reward circuit

    OpenAIRE

    Guegan, Thomas, 1983-; Cutando, Laura; Gangarossa, Giuseppe; Santini, Emanuela; Fisone, Gilberto; Martínez, Albert; Valjent, Emmanuel; Maldonado, Rafael; Martín Sánchez, Miquel, 1971-

    2013-01-01

    Food palatability produces behavioral modifications that resemble those induced by drugs of abuse. Palatability-induced behavioral changes require both, the activation of the endogenous cannabinoid system, and changes in structural plasticity in neurons of the brain reward pathway. The ERK intracellular pathway is activated by CB1 receptors (CB1-R) and plays a crucial role in neuroplasticity. We investigated the activation of the ERK signaling cascade in the mesocorticolimbic system induced b...

  15. Prior fear conditioning and reward learning interact in fear and reward networks

    Directory of Open Access Journals (Sweden)

    Lisa eBulganin

    2014-03-01

    Full Text Available The ability to flexibly adapt responses to changes in the environment is important for survival. Previous research in humans separately examined the mechanisms underlying acquisition and extinction of aversive and appetitive conditioned responses. It is yet unclear how aversive and appetitive learning interact on a neural level during counterconditioning in humans. This functional magnetic resonance imaging (fMRI study investigated the interaction of fear conditioning and subsequent reward learning. In the first phase (fear acquisition, images predicted aversive electric shocks or no aversive outcome. In the second phase (counterconditioning, half of the CS+ and CS- were associated with monetary reward in the absence of electric stimulation. The third phase initiated reinstatement of fear through presentation of electric shocks, followed by CS presentation in the absence of shock or reward. Results indicate that participants were impaired at learning the reward contingencies for stimuli previously associated with shock. In the counterconditioning phase, prior fear association interacted with reward representation in the amygdala, where activation was decreased for rewarded compared to unrewarded CS- trials, while there was no reward-related difference in CS+ trials. In the reinstatement phase, an interaction of previous fear association and previous reward status was observed in a reward network consisting of substantia nigra / ventral tegmental area (SN/VTA, striatum and orbitofrontal cortex (OFC, where activation was increased by previous reward association only for CS- but not for CS+ trials. These findings suggest that during counterconditioning, prior fear conditioning interferes with reward learning, subsequently leading to lower activation of the reward network.

  16. Neural networks with discontinuous/impact activations

    CERN Document Server

    Akhmet, Marat

    2014-01-01

    This book presents as its main subject new models in mathematical neuroscience. A wide range of neural networks models with discontinuities are discussed, including impulsive differential equations, differential equations with piecewise constant arguments, and models of mixed type. These models involve discontinuities, which are natural because huge velocities and short distances are usually observed in devices modeling the networks. A discussion of the models, appropriate for the proposed applications, is also provided. This book also: Explores questions related to the biological underpinning for models of neural networks\\ Considers neural networks modeling using differential equations with impulsive and piecewise constant argument discontinuities Provides all necessary mathematical basics for application to the theory of neural networks Neural Networks with Discontinuous/Impact Activations is an ideal book for researchers and professionals in the field of engineering mathematics that have an interest in app...

  17. Optogenetic Activation of a Lateral Hypothalamic-Ventral Tegmental Drive-Reward Pathway.

    Science.gov (United States)

    Gigante, Eduardo D; Benaliouad, Faiza; Zamora-Olivencia, Veronica; Wise, Roy A

    2016-01-01

    Electrical stimulation of the lateral hypothalamus can motivate feeding or can serve as a reward in its own right. It remains unclear whether the same or independent but anatomically overlapping circuitries mediate the two effects. Electrical stimulation findings implicate medial forebrain bundle (MFB) fibers of passage in both effects, and optogenetic studies confirm a contribution from fibers originating in the lateral hypothalamic area and projecting to or through the ventral tegmental area. Here we report that optogenetic activation of ventral tegmental fibers from cells of origin in more anterior or posterior portions of the MFB failed to induce either reward or feeding. The feeding and reward induced by optogenetic activation of fibers from the lateral hypothalamic cells of origin were influenced similarly by variations in stimulation pulse width and pulse frequency, consistent with the hypothesis of a common substrate for the two effects. There were, however, several cases where feeding but not self-stimulation or self-stimulation but not feeding were induced, consistent with the hypothesis that distinct but anatomically overlapping systems mediate the two effects. Thus while optogenetic stimulation provides a more selective tool for characterizing the mechanisms of stimulation-induced feeding and reward, it does not yet resolve the question of common or independent substrates.

  18. Biological substrates of reward and aversion: a nucleus accumbens activity hypothesis.

    Science.gov (United States)

    Carlezon, William A; Thomas, Mark J

    2009-01-01

    The nucleus accumbens (NAc) is a critical element of the mesocorticolimbic system, a brain circuit implicated in reward and motivation. This basal forebrain structure receives dopamine (DA) input from the ventral tegmental area (VTA) and glutamate (GLU) input from regions including the prefrontal cortex (PFC), amygdala (AMG), and hippocampus (HIP). As such, it integrates inputs from limbic and cortical regions, linking motivation with action. The NAc has a well-established role in mediating the rewarding effects of drugs of abuse and natural rewards such as food and sexual behavior. However, accumulating pharmacological, molecular, and electrophysiological evidence has raised the possibility that it also plays an important (and sometimes underappreciated) role in mediating aversive states. Here we review evidence that rewarding and aversive states are encoded in the activity of NAc medium spiny GABAergic neurons, which account for the vast majority of the neurons in this region. While admittedly simple, this working hypothesis is testable using combinations of available and emerging technologies, including electrophysiology, genetic engineering, and functional brain imaging. A deeper understanding of the basic neurobiology of mood states will facilitate the development of well-tolerated medications that treat and prevent addiction and other conditions (e.g., mood disorders) associated with dysregulation of brain motivation systems.

  19. Food reward in active compared to inactive men: Roles for gastric emptying and body fat.

    Science.gov (United States)

    Horner, Katy M; Finlayson, Graham; Byrne, Nuala M; King, Neil A

    2016-06-01

    Habitual exercise could contribute to weight management by altering processes of food reward via the gut-brain axis. We investigated hedonic processes of food reward in active and inactive men and characterised relationships with gastric emptying and body fat. Forty-four men (active: n=22; inactive: n=22, BMI range 21-36kg/m(2); percent fat mass range 9-42%) were studied. Participants were provided with a standardised fixed breakfast and an ad libitum lunch meal 5h later. Explicit liking, implicit wanting and preference among high-fat, low-fat, sweet and savoury food items were assessed immediately post-breakfast (fed state) and again pre-lunch (hungry state) using the Leeds Food Preference Questionnaire. Gastric emptying was assessed by (13)C-octanoic acid breath test. Active individuals exhibited a lower liking for foods overall and a greater implicit wanting for low-fat savoury foods in the fed state, compared to inactive men. Differences in the fed state remained significant after adjusting for percent fat mass. Active men also had a greater increase in liking for savoury foods in the interval between breakfast and lunch. Faster gastric emptying was associated with liking for savoury foods and with an increase in liking for savoury foods in the postprandial interval. In contrast, greater implicit wanting for high-fat foods was associated with slower gastric emptying. These associations were independent of each other, activity status and body fat. In conclusion, active and inactive men differ in processes of food reward. The rate of gastric emptying may play a role in the association between physical activity status and food reward, via the gut-brain axis.

  20. Hippocampal neural activity reflects the economy of choices during goal-directed navigation.

    Science.gov (United States)

    Tryon, Valerie L; Penner, Marsha R; Heide, Shawn W; King, Hunter O; Larkin, Joshua; Mizumori, Sheri J Y

    2017-02-27

    Distinguishing spatial contexts is likely essential for the well-known role of the hippocampus in episodic memory. We studied whether types of hippocampal neural organization thought to underlie context discrimination are impacted by learned economic considerations of choice behavior. Hippocampal place cells and theta activity were recorded as rats performed a maze-based probability discounting task that involved choosing between a small certain reward or a large probabilistic reward. Different spatial distributions of place fields were observed in response to changes in probability, the outcome of the rats' choice, and whether or not rats were free to make that choice. The degree to which the reward location was represented by place cells scaled with the expected probability of rewards. Theta power increased around the goal location also in proportion to the expected probability of signaled rewards. Furthermore, theta power dynamically varied as specific econometric information was obtained "on the fly" during task performance. Such an economic perspective of memory processing by hippocampal place cells expands our view of the nature of context memories retrieved by hippocampus during adaptive navigation.

  1. Positive emotions and brain reward circuits in chronic pain.

    Science.gov (United States)

    Navratilova, Edita; Morimura, Kozo; Xie, Jennifer Y; Atcherley, Christopher W; Ossipov, Michael H; Porreca, Frank

    2016-06-01

    Chronic pain is an important public health problem that negatively impacts the quality of life of affected individuals and exacts enormous socioeconomic costs. Chronic pain is often accompanied by comorbid emotional disorders including anxiety, depression, and possibly anhedonia. The neural circuits underlying the intersection of pain and pleasure are not well understood. We summarize recent human and animal investigations and demonstrate that aversive aspects of pain are encoded in brain regions overlapping with areas processing reward and motivation. We highlight findings revealing anatomical and functional alterations of reward/motivation circuits in chronic pain. Finally, we review supporting evidence for the concept that pain relief is rewarding and activates brain reward/motivation circuits. Adaptations in brain reward circuits may be fundamental to the pathology of chronic pain. Knowledge of brain reward processing in the context of pain could lead to the development of new therapeutics for the treatment of emotional aspects of pain and comorbid conditions.

  2. Employee reward

    OpenAIRE

    2014-01-01

    Objectives: • To present the main historical and theoretical foundations underpinning contemporary employee reward practice. • To define employee reward and identify the key components of reward. • To explore the concept of reward management and the benefits and difficulties associated with introducing a strategic approach to reward. • To consider key employee reward choices facing organisations in the contemporary era. • To explore the economic and legal context for reward and the implicatio...

  3. SOVEREIGN: An autonomous neural system for incrementally learning planned action sequences to navigate towards a rewarded goal.

    Science.gov (United States)

    Gnadt, William; Grossberg, Stephen

    2008-06-01

    How do reactive and planned behaviors interact in real time? How are sequences of such behaviors released at appropriate times during autonomous navigation to realize valued goals? Controllers for both animals and mobile robots, or animats, need reactive mechanisms for exploration, and learned plans to reach goal objects once an environment becomes familiar. The SOVEREIGN (Self-Organizing, Vision, Expectation, Recognition, Emotion, Intelligent, Goal-oriented Navigation) animat model embodies these capabilities, and is tested in a 3D virtual reality environment. SOVEREIGN includes several interacting subsystems which model complementary properties of cortical What and Where processing streams and which clarify similarities between mechanisms for navigation and arm movement control. As the animat explores an environment, visual inputs are processed by networks that are sensitive to visual form and motion in the What and Where streams, respectively. Position-invariant and size-invariant recognition categories are learned by real-time incremental learning in the What stream. Estimates of target position relative to the animat are computed in the Where stream, and can activate approach movements toward the target. Motion cues from animat locomotion can elicit head-orienting movements to bring a new target into view. Approach and orienting movements are alternately performed during animat navigation. Cumulative estimates of each movement are derived from interacting proprioceptive and visual cues. Movement sequences are stored within a motor working memory. Sequences of visual categories are stored in a sensory working memory. These working memories trigger learning of sensory and motor sequence categories, or plans, which together control planned movements. Predictively effective chunk combinations are selectively enhanced via reinforcement learning when the animat is rewarded. Selected planning chunks effect a gradual transition from variable reactive exploratory

  4. The decision to engage cognitive control is driven by expected reward-value: neural and behavioral evidence.

    Directory of Open Access Journals (Sweden)

    Matthew L Dixon

    Full Text Available Cognitive control is a fundamental skill reflecting the active use of task-rules to guide behavior and suppress inappropriate automatic responses. Prior work has traditionally used paradigms in which subjects are told when to engage cognitive control. Thus, surprisingly little is known about the factors that influence individuals' initial decision of whether or not to act in a reflective, rule-based manner. To examine this, we took three classic cognitive control tasks (Stroop, Wisconsin Card Sorting Task, Go/No-Go task and created novel 'free-choice' versions in which human subjects were free to select an automatic, pre-potent action, or an action requiring rule-based cognitive control, and earned varying amounts of money based on their choices. Our findings demonstrated that subjects' decision to engage cognitive control was driven by an explicit representation of monetary rewards expected to be obtained from rule-use. Subjects rarely engaged cognitive control when the expected outcome was of equal or lesser value as compared to the value of the automatic response, but frequently engaged cognitive control when it was expected to yield a larger monetary outcome. Additionally, we exploited fMRI-adaptation to show that the lateral prefrontal cortex (LPFC represents associations between rules and expected reward outcomes. Together, these findings suggest that individuals are more likely to act in a reflective, rule-based manner when they expect that it will result in a desired outcome. Thus, choosing to exert cognitive control is not simply a matter of reason and willpower, but rather, conforms to standard mechanisms of value-based decision making. Finally, in contrast to current models of LPFC function, our results suggest that the LPFC plays a direct role in representing motivational incentives.

  5. When a good taste turns bad: Neural mechanisms underlying the emergence of negative affect and associated natural reward devaluation by cocaine.

    Science.gov (United States)

    Carelli, Regina M; West, Elizabeth A

    2014-01-01

    An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, research in the Carelli laboratory is reviewed that examined neurobiological mechanisms that may underlie these processes using a novel animal model. Oromotor responses (taste reactivity) were examined as rats learned that intraoral infusion of a sweet (e.g., saccharin) predicts impending but delayed access to cocaine self-administration. We showed that rats exhibit aversive taste reactivity (i.e., gapes/rejection responses) during infusion of the sweet paired with impending cocaine, similar to aversive responses observed during infusion of quinine, a bitter tastant. Critically, the expression of this pronounced aversion to the sweet predicted the subsequent motivation to self-administer cocaine. Electrophysiology studies show that this shift in palatability corresponds to an alteration in nucleus accumbens (NAc) cell firing; neurons that previously responded with inhibition during infusion of the palatable sweet shifted to excitatory activity during infusion of the cocaine-devalued tastant. This excitatory response profile is typically observed during infusion of quinine, indicating that the once palatable sweet becomes aversive following its association with impending but delayed cocaine, and NAc neurons encode this aversive state. We also review electrochemical studies showing a shift (from increase to decrease) in rapid NAc dopamine release during infusion of the cocaine-paired tastant as the aversive state developed, again, resulting in responses similar to quinine

  6. Neural Activities Underlying the Feedback Express Salience Prediction Errors for Appetitive and Aversive Stimuli

    Science.gov (United States)

    Gu, Yan; Hu, Xueping; Pan, Weigang; Yang, Chun; Wang, Lijun; Li, Yiyuan; Chen, Antao

    2016-01-01

    Feedback information is essential for us to adapt appropriately to the environment. The feedback-related negativity (FRN), a frontocentral negative deflection after the delivery of feedback, has been found to be larger for outcomes that are worse than expected, and it reflects a reward prediction error derived from the midbrain dopaminergic projections to the anterior cingulate cortex (ACC), as stated in reinforcement learning theory. In contrast, the prediction of response-outcome (PRO) model claims that the neural activity in the mediofrontal cortex (mPFC), especially the ACC, is sensitive to the violation of expectancy, irrespective of the valence of feedback. Additionally, increasing evidence has demonstrated significant activities in the striatum, anterior insula and occipital lobe for unexpected outcomes independently of their valence. Thus, the neural mechanism of the feedback remains under dispute. Here, we investigated the feedback with monetary reward and electrical pain shock in one task via functional magnetic resonance imaging. The results revealed significant prediction-error-related activities in the bilateral fusiform gyrus, right middle frontal gyrus and left cingulate gyrus for both money and pain. This implies that some regions underlying the feedback may signal a salience prediction error rather than a reward prediction error. PMID:27694920

  7. Relation of obesity to neural activation in response to food commercials.

    Science.gov (United States)

    Gearhardt, Ashley N; Yokum, Sonja; Stice, Eric; Harris, Jennifer L; Brownell, Kelly D

    2014-07-01

    Adolescents view thousands of food commercials annually, but the neural response to food advertising and its association with obesity is largely unknown. This study is the first to examine how neural response to food commercials differs from other stimuli (e.g. non-food commercials and television show) and to explore how this response may differ by weight status. The blood oxygen level-dependent functional magnetic resonance imaging activation was measured in 30 adolescents ranging from lean to obese in response to food and non-food commercials imbedded in a television show. Adolescents exhibited greater activation in regions implicated in visual processing (e.g. occipital gyrus), attention (e.g. parietal lobes), cognition (e.g. temporal gyrus and posterior cerebellar lobe), movement (e.g. anterior cerebellar cortex), somatosensory response (e.g. postcentral gyrus) and reward [e.g. orbitofrontal cortex and anterior cingulate cortex (ACC)] during food commercials. Obese participants exhibited less activation during food relative to non-food commercials in neural regions implicated in visual processing (e.g. cuneus), attention (e.g. posterior cerebellar lobe), reward (e.g. ventromedial prefrontal cortex and ACC) and salience detection (e.g. precuneus). Obese participants did exhibit greater activation in a region implicated in semantic control (e.g. medial temporal gyrus). These findings may inform current policy debates regarding the impact of food advertising to minors.

  8. Genetic control of active neural circuits

    Directory of Open Access Journals (Sweden)

    Leon Reijmers

    2009-12-01

    Full Text Available The use of molecular tools to study the neurobiology of complex behaviors has been hampered by an inability to target the desired changes to relevant groups of neurons. Specific memories and specific sensory representations are sparsely encoded by a small fraction of neurons embedded in a sea of morphologically and functionally similar cells. In this review we discuss genetics techniques that are being developed to address this difficulty. In several studies the use of promoter elements that are responsive to neural activity have been used to drive long lasting genetic alterations into neural ensembles that are activated by natural environmental stimuli. This approach has been used to examine neural activity patterns during learning and retrieval of a memory, to examine the regulation of receptor trafficking following learning and to functionally manipulate a specific memory trace. We suggest that these techniques will provide a general approach to experimentally investigate the link between patterns of environmentally activated neural firing and cognitive processes such as perception and memory.

  9. Resting-state EEG theta activity and risk learning: sensitivity to reward or punishment?

    Science.gov (United States)

    Massar, Stijn A A; Kenemans, J Leon; Schutter, Dennis J L G

    2014-03-01

    Increased theta (4-7 Hz)-beta (13-30 Hz) power ratio in resting state electroencephalography (EEG) has been associated with risky disadvantageous decision making and with impaired reinforcement learning. However, the specific contributions of theta and beta power in risky decision making remain unclear. The first aim of the present study was to replicate the earlier found relationship and examine the specific contributions of theta and beta power in risky decision making using the Iowa Gambling Task. The second aim of the study was to examine whether the relation were associated with differences in reward or punishment sensitivity. We replicated the earlier found relationship by showing a positive association between theta/beta ratio and risky decision making. This correlation was mainly driven by theta oscillations. Furthermore, theta power correlated with reward motivated learning, but not with punishment learning. The present results replicate and extend earlier findings by providing novel insights into the relation between thetabeta ratios and risky decision making. Specifically, findings show that resting-state theta activity is correlated with reinforcement learning, and that this association may be explained by differences in reward sensitivity.

  10. Differences in Neural Activation as a Function of Risk-taking Task Parameters

    Directory of Open Access Journals (Sweden)

    Eliza eCongdon

    2013-09-01

    Full Text Available Despite evidence supporting a relationship between impulsivity and naturalistic risk-taking, the relationship of impulsivity with laboratory-based measures of risky decision-making remains unclear. One factor contributing to this gap in our understanding is the degree to which different risky decision-making tasks vary in their details. We conducted an fMRI investigation of the Angling Risk Task (ART, which is an improved behavioral measure of risky decision-making. In order to examine whether the observed pattern of neural activation was specific to the ART or generalizable, we also examined correlates of the Balloon Analogue Risk Taking (BART task in the same sample of 23 healthy adults. Exploratory analyses were conducted to examine the relationship between neural activation, performance, impulsivity and self-reported risk-taking. While activation in a valuation network was associated with reward tracking during the ART but not the BART, increased fronto-cingulate activation was seen during risky choice trials in the BART as compared to the ART. Thus, neural activation during risky decision-making trials differed between the two tasks, and this observation was likely driven by differences in task parameters, namely the absence vs. presence of ambiguity and/or stationary vs. increasing probability of loss on the ART and BART, respectively. Exploratory association analyses suggest that sensitivity of neural response to the magnitude of potential reward during the ART was associated with a suboptimal performance strategy, higher scores on a scale of dysfunctional impulsivity and a greater likelihood of engaging in risky behaviors, while this pattern was not seen for the BART. Our results suggest that the ART is decomposable and associated with distinct patterns of neural activation; this represents a preliminary step towards characterizing a behavioral measure of risky decision-making that may support a better understanding of naturalistic risk-taking.

  11. Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder

    OpenAIRE

    Maria Luz Gonzalez-Gadea; Mariano Sigman; Alexia Rattazzi; Claudio Lavin; Alvaro Rivera-Rei; Julian Marino; Facundo Manes; Agustin Ibanez

    2016-01-01

    Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants’ brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation ...

  12. Early effects of reward anticipation are modulated by dopaminergic stimulation.

    Directory of Open Access Journals (Sweden)

    Thore Apitz

    Full Text Available The abilities to predict future rewards and assess the value of reward delivery are crucial aspects of adaptive behavior. While the mesolimbic system, including dopaminergic midbrain, ventral striatum and prefrontal cortex have long been associated with reward processing, recent studies also indicate a prominent role of early visual brain regions. However, the precise underlying neural mechanisms still remain unclear. To address this issue, we presented participants with visual cues predicting rewards of high and low magnitudes and probability (2 × 2 factorial design, while neural activity was scanned using magnetoencephalography. Importantly, one group of participants received 150 mg of the dopamine precursor levodopa prior to the experiment, while another group received a placebo. For the placebo group, neural signals of reward probability (but not magnitude emerged at ∼ 100 ms after cue presentation at occipital sensors in the event-related magnetic fields. Importantly, these probability signals were absent in the levodopa group indicating a close link. Moreover, levodopa administration reduced oscillatory power in the high (20-30 Hz and low (13-20 Hz beta band during both reward anticipation and delivery. Taken together, our findings indicate that visual brain regions are involved in coding prospective reward probability but not magnitude and that these effects are modulated by dopamine.

  13. A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages.

    Science.gov (United States)

    Sambrook, Thomas D; Goslin, Jeremy

    2015-01-01

    Economic approaches to decision making assume that people attach values to prospective goods and act to maximize their obtained value. Neuroeconomics strives to observe these values directly in the brain. A widely used valuation term in formal learning and decision-making models is the reward prediction error: the value of an outcome relative to its expected value. An influential theory (Holroyd & Coles, 2002) claims that an electrophysiological component, feedback related negativity (FRN), codes a reward prediction error in the human brain. Such a component should be sensitive to both the prior likelihood of reward and its magnitude on receipt. A number of studies have found the FRN to be insensitive to reward magnitude, thus questioning the Holroyd and Coles account. However, because of marked inconsistencies in how the FRN is measured, a meaningful synthesis of this evidence is highly problematic. We conducted a meta-analysis of the FRN's response to both reward magnitude and likelihood using a novel method in which published effect sizes were disregarded in favor of direct measurement of the published waveforms themselves, with these waveforms then averaged to produce "great grand averages." Under this standardized measure, the meta-analysis revealed strong effects of magnitude and likelihood on the FRN, consistent with it encoding a reward prediction error. In addition, it revealed strong main effects of reward magnitude and likelihood across much of the waveform, indicating sensitivity to unsigned prediction errors or "salience." The great grand average technique is proposed as a general method for meta-analysis of event-related potential (ERP).

  14. Pain and suicidality: insights from reward and addiction neuroscience.

    Science.gov (United States)

    Elman, Igor; Borsook, David; Volkow, Nora D

    2013-10-01

    Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk.

  15. Neural reactivity to monetary rewards and losses in childhood: longitudinal and concurrent associations with observed and self-reported positive emotionality.

    Science.gov (United States)

    Kujawa, Autumn; Proudfit, Greg Hajcak; Kessel, Ellen M; Dyson, Margaret; Olino, Thomas; Klein, Daniel N

    2015-01-01

    Reward reactivity and positive emotion are key components of a theoretical, early-emerging approach motivational system, yet few studies have examined associations between positive emotion and neural reactivity to reward across development. In this multi-method prospective study, we examined the association of laboratory observations of positive emotionality (PE) at age 3 and self-reported positive affect (PA) at age 9 with an event-related potential component sensitive to the relative response to winning vs. losing money, the feedback negativity (ΔFN), at age 9 (N=381). Males had a larger ΔFN than females, and both greater observed PE at age 3 and self-reported PA at age 9 significantly, but modestly, predicted an enhanced ΔFN at age 9. Negative emotionality and behavioral inhibition did not predict ΔFN. Results contribute to understanding the neural correlates of PE and suggest that the FN and PE may be related to the same biobehavioral approach system.

  16. The neural basis of decision-making and reward processing in adults with euthymic bipolar disorder or attention-deficit/hyperactivity disorder (ADHD.

    Directory of Open Access Journals (Sweden)

    Agustin Ibanez

    Full Text Available BACKGROUND: Attention-deficit/hyperactivity disorder (ADHD and bipolar disorder (BD share DSM-IV criteria in adults and cause problems in decision-making. Nevertheless, no previous report has assessed a decision-making task that includes the examination of the neural correlates of reward and gambling in adults with ADHD and those with BD. METHODOLOGY/PRINCIPAL FINDINGS: We used the Iowa gambling task (IGT, a task of rational decision-making under risk (RDMUR and a rapid-decision gambling task (RDGT which elicits behavioral measures as well as event-related potentials (ERPs: fERN and P3 in connection to the motivational impact of events. We did not observe between-group differences for decision-making under risk or ambiguity (RDMUR and IGT; however, there were significant differences for the ERP-assessed RDGT. Compared to controls, the ADHD group showed a pattern of impaired learning by feedback (fERN and insensitivity to reward magnitude (P3. This ERP pattern (fERN and P3 was associated with impulsivity, hyperactivity, executive function and working memory. Compared to controls, the BD group showed fERN- and P3-enhanced responses to reward magnitude regardless of valence. This ERP pattern (fERN and P3 was associated with mood and inhibitory control. Consistent with the ERP findings, an analysis of source location revealed reduced responses of the cingulate cortex to the valence and magnitude of rewards in patients with ADHD and BD. CONCLUSIONS/SIGNIFICANCE: Our data suggest that neurophysiological (ERPs paradigms such as the RDGT are well suited to assess subclinical decision-making processes in patients with ADHD and BD as well as for linking the cingulate cortex with action monitoring systems.

  17. The Neural Basis of Decision-Making and Reward Processing in Adults with Euthymic Bipolar Disorder or Attention-Deficit/Hyperactivity Disorder (ADHD)

    Science.gov (United States)

    Ibanez, Agustin; Cetkovich, Marcelo; Petroni, Agustin; Urquina, Hugo; Baez, Sandra; Gonzalez-Gadea, Maria Luz; Kamienkowski, Juan Esteban; Torralva, Teresa; Torrente, Fernando; Strejilevich, Sergio; Teitelbaum, Julia; Hurtado, Esteban; Guex, Raphael; Melloni, Margherita; Lischinsky, Alicia; Sigman, Mariano; Manes, Facundo

    2012-01-01

    Background Attention-deficit/hyperactivity disorder (ADHD) and bipolar disorder (BD) share DSM-IV criteria in adults and cause problems in decision-making. Nevertheless, no previous report has assessed a decision-making task that includes the examination of the neural correlates of reward and gambling in adults with ADHD and those with BD. Methodology/Principal Findings We used the Iowa gambling task (IGT), a task of rational decision-making under risk (RDMUR) and a rapid-decision gambling task (RDGT) which elicits behavioral measures as well as event-related potentials (ERPs: fERN and P3) in connection to the motivational impact of events. We did not observe between-group differences for decision-making under risk or ambiguity (RDMUR and IGT); however, there were significant differences for the ERP-assessed RDGT. Compared to controls, the ADHD group showed a pattern of impaired learning by feedback (fERN) and insensitivity to reward magnitude (P3). This ERP pattern (fERN and P3) was associated with impulsivity, hyperactivity, executive function and working memory. Compared to controls, the BD group showed fERN- and P3-enhanced responses to reward magnitude regardless of valence. This ERP pattern (fERN and P3) was associated with mood and inhibitory control. Consistent with the ERP findings, an analysis of source location revealed reduced responses of the cingulate cortex to the valence and magnitude of rewards in patients with ADHD and BD. Conclusions/Significance Our data suggest that neurophysiological (ERPs) paradigms such as the RDGT are well suited to assess subclinical decision-making processes in patients with ADHD and BD as well as for linking the cingulate cortex with action monitoring systems. PMID:22624011

  18. Selective Activation of Cholinergic Interneurons Enhances Accumbal Phasic Dopamine Release: Setting the Tone for Reward Processing

    Directory of Open Access Journals (Sweden)

    Roger Cachope

    2012-07-01

    Full Text Available Dopamine plays a critical role in motor control, addiction, and reward-seeking behaviors, and its release dynamics have traditionally been linked to changes in midbrain dopamine neuron activity. Here, we report that selective endogenous cholinergic activation achieved via in vitro optogenetic stimulation of nucleus accumbens, a terminal field of dopaminergic neurons, elicits real-time dopamine release. This mechanism occurs via direct actions on dopamine terminals, does not require changes in neuron firing within the midbrain, and is dependent on glutamatergic receptor activity. More importantly, we demonstrate that in vivo selective activation of cholinergic interneurons is sufficient to elicit dopamine release in the nucleus accumbens. Therefore, the control of accumbal extracellular dopamine levels by endogenous cholinergic activity results from a complex convergence of neurotransmitter/neuromodulator systems that may ultimately synergize to drive motivated behavior.

  19. Brain's reward circuits mediate itch relief. a functional MRI study of active scratching.

    Directory of Open Access Journals (Sweden)

    Alexandru D P Papoiu

    Full Text Available Previous brain imaging studies investigating the brain processing of scratching used an exogenous intervention mimicking scratching, performed not by the subjects themselves, but delivered by an investigator. In real life, scratching is a conscious, voluntary, controlled motor response to itching, which is directed to the perceived site of distress. In this study we aimed to visualize in real-time by brain imaging the core mechanisms of the itch-scratch cycle when scratching was performed by subjects themselves. Secondly, we aimed to assess the correlations between brain patterns of activation and psychophysical ratings of itch relief or pleasurability of scratching. We also compared the patterns of brain activity evoked by self-scratching vs. passive scratching. We used a robust tridimensional Arterial Spin Labeling fMRI technique that is less sensitive to motion artifacts: 3D gradient echo and spin echo (GRASE--Propeller. Active scratching was accompanied by a higher pleasurability and induced a more pronounced deactivation of the anterior cingulate cortex and insula, in comparison with passive scratching. A significant involvement of the reward system including the ventral tegmentum of the midbrain, coupled with a mechanism deactivating the periaqueductal gray matter (PAG, suggests that itch modulation operates in reverse to the mechanism known to suppress pain. Our findings not only confirm a role for the central networks processing reward in the pleasurable aspects of scratching, but also suggest they play a role in mediating itch relief.

  20. Information transmission in oscillatory neural activity

    CERN Document Server

    Koepsell, Kilian

    2008-01-01

    Periodic neural activity not locked to the stimulus or to motor responses is usually ignored. Here, we present new tools for modeling and quantifying the information transmission based on periodic neural activity that occurs with quasi-random phase relative to the stimulus. We propose a model to reproduce characteristic features of oscillatory spike trains, such as histograms of inter-spike intervals and phase locking of spikes to an oscillatory influence. The proposed model is based on an inhomogeneous Gamma process governed by a density function that is a product of the usual stimulus-dependent rate and a quasi-periodic function. Further, we present an analysis method generalizing the direct method (Rieke et al, 1999; Brenner et al, 2000) to assess the information content in such data. We demonstrate these tools on recordings from relay cells in the lateral geniculate nucleus of the cat.

  1. Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

    Science.gov (United States)

    Baskin-Sommers, Arielle R; Foti, Dan

    2015-11-01

    A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders.

  2. Dual reward prediction components yield Pavlovian sign- and goal-tracking.

    Science.gov (United States)

    Kaveri, Sivaramakrishnan; Nakahara, Hiroyuki

    2014-01-01

    Reinforcement learning (RL) has become a dominant paradigm for understanding animal behaviors and neural correlates of decision-making, in part because of its ability to explain Pavlovian conditioned behaviors and the role of midbrain dopamine activity as reward prediction error (RPE). However, recent experimental findings indicate that dopamine activity, contrary to the RL hypothesis, may not signal RPE and differs based on the type of Pavlovian response (e.g. sign- and goal-tracking responses). In this study, we address this discrepancy by introducing a new neural correlate for learning reward predictions; the correlate is called "cue-evoked reward". It refers to a recall of reward evoked by the cue that is learned through simple cue-reward associations. We introduce a temporal difference learning model, in which neural correlates of the cue itself and cue-evoked reward underlie learning of reward predictions. The animal's reward prediction supported by these two correlates is divided into sign and goal components respectively. We relate the sign and goal components to approach responses towards the cue (i.e. sign-tracking) and the food-tray (i.e. goal-tracking) respectively. We found a number of correspondences between simulated models and the experimental findings (i.e. behavior and neural responses). First, the development of modeled responses is consistent with those observed in the experimental task. Second, the model's RPEs were similar to dopamine activity in respective response groups. Finally, goal-tracking, but not sign-tracking, responses rapidly emerged when RPE was restored in the simulated models, similar to experiments with recovery from dopamine-antagonist. These results suggest two complementary neural correlates, corresponding to the cue and its evoked reward, form the basis for learning reward predictions in the sign- and goal-tracking rats.

  3. Witnessing hateful people in pain modulates brain activity in regions associated with physical pain and reward.

    Directory of Open Access Journals (Sweden)

    Glenn Ryan Fox

    2013-10-01

    Full Text Available How does witnessing a hateful person in pain compare to witnessing a likable person in pain? The current study compared the brain bases for how we perceive likable people in pain with those of viewing hateful people in pain. While social bonds are built through sharing the plight and pain of others in the name of empathy, viewing a hateful person in pain also has many potential ramifications. In this functional Magnetic Resonance Imaging (fMRI study, Caucasian Jewish male participants viewed videos of (1 disliked, hateful, anti-Semitic individuals, and (2 liked, non-hateful, tolerant individuals in pain. The results showed that, compared with viewing liked people, viewing hateful people in pain elicited increased responses in regions associated with observation of physical pain (the insular cortex, the anterior cingulate cortex, and the somatosensory cortex, reward processing (the striatum, and frontal regions associated with emotion regulation. Functional connectivity analyses revealed connections between seed regions in the left anterior cingulate cortex and right insular cortex with reward regions, the amygdala, and frontal regions associated with emotion regulation. These data indicate that regions of the brain active while viewing someone in pain may be more active in response to the danger or threat posed by witnessing the pain of a hateful individual more so than the desire to empathize with a likable person’s pain.

  4. Threat/reward-sensitivity and hypomanic-personality modulate cognitive-control and attentional neural processes to emotional stimuli.

    Science.gov (United States)

    Pornpattananangkul, Narun; Hu, Xiaoqing; Nusslock, Robin

    2015-11-01

    Temperamental-traits (e.g. threat/reward-sensitivity) are found to modulate cognitive-control and attentional-processes. Yet, it is unclear exactly how these traits interact with emotional-stimuli in the modulation of cognitive-control, as reflected by the N2 event-related potential (ERP), and attentional-processes, as reflected by the P2 and P3 ERPs. Here in an ERP emotional-Go/NoGo task, 36 participants were instructed to inhibit their response to Fearful- and Happy-faces. Individual-differences in threat-sensitivity, reward-sensitivity and hypomanic-personality were assessed through self-report. Hypomanic-personality was assessed, given its relationship with reward-sensitivity and relevance to mood-disorder symptoms. Concerning cognitive-control, individuals with elevated threat-sensitivity displayed more-negative N2s to Happy-NoGo (relative to Fearful-NoGo) faces, whereas both individuals with elevated reward-sensitivity and hypomanic-personality displayed more-negative N2s to Fearful-NoGo (relative to Happy-NoGo) faces. Accordingly, when cognitive-control is required (during Go/NoGo), a mismatch between one's temperament and the valence of the NoGo-stimulus elevates detection of the need for cognitive-control. Conversely, the modulation of attentional-processing was specific to threat-sensitivity, as there was no relationship between either reward-sensitivity or hypomanic-personality and attentional-processing. Elevated threat-sensitivity was associated with enhanced early (P2s) and later (P3s) attentional-processing to Fearful-NoGo (relative to Happy-NoGo) faces. These latter findings support the negative attentional-bias model relating elevated threat-sensitivity with attentional-biases toward negative-stimuli and away from positive-stimuli.

  5. Contextual interaction between novelty and reward processing within the mesolimbic system.

    Science.gov (United States)

    Bunzeck, Nico; Doeller, Christian F; Dolan, Ray J; Duzel, Emrah

    2012-06-01

    Medial temporal lobe (MTL) dependent long-term memory for novel events is modulated by a circuitry that also responds to reward and includes the ventral striatum, dopaminergic midbrain, and medial orbitofrontal cortex (mOFC). This common neural network may reflect a functional link between novelty and reward whereby novelty motivates exploration in the search for rewards; a link also termed novelty "exploration bonus." We used fMRI in a scene encoding paradigm to investigate the interaction between novelty and reward with a focus on neural signals akin to an exploration bonus. As expected, reward related long-term memory for the scenes (after 24 hours) strongly correlated with activity of MTL, ventral striatum, and substantia nigra/ventral tegmental area (SN/VTA). Furthermore, the hippocampus showed a main effect of novelty, the striatum showed a main effect of reward, and the mOFC signalled both novelty and reward. An interaction between novelty and reward akin to an exploration bonus was found in the hippocampus. These data suggest that MTL novelty signals are interpreted in terms of their reward-predicting properties in the mOFC, which biases striatal reward responses. The striatum together with the SN/VTA then regulates MTL-dependent long-term memory formation and contextual exploration bonus signals in the hippocampus.

  6. GLP-1 receptor activation modulates appetite- and reward-related brain areas in humans.

    Science.gov (United States)

    van Bloemendaal, Liselotte; IJzerman, Richard G; Ten Kulve, Jennifer S; Barkhof, Frederik; Konrad, Robert J; Drent, Madeleine L; Veltman, Dick J; Diamant, Michaela

    2014-12-01

    Gut-derived hormones, such as GLP-1, have been proposed to relay information to the brain to regulate appetite. GLP-1 receptor agonists, currently used for the treatment of type 2 diabetes (T2DM), improve glycemic control and stimulate satiety, leading to decreases in food intake and body weight. We hypothesized that food intake reduction after GLP-1 receptor activation is mediated through appetite- and reward-related brain areas. Obese T2DM patients and normoglycemic obese and lean individuals (n = 48) were studied in a randomized, crossover, placebo-controlled trial. Using functional MRI, we determined the acute effects of intravenous administration of the GLP-1 receptor agonist exenatide, with or without prior GLP-1 receptor blockade using exendin 9-39, on brain responses to food pictures during a somatostatin pancreatic-pituitary clamp. Obese T2DM patients and normoglycemic obese versus lean subjects showed increased brain responses to food pictures in appetite- and reward-related brain regions (insula and amygdala). Exenatide versus placebo decreased food intake and food-related brain responses in T2DM patients and obese subjects (in insula, amygdala, putamen, and orbitofrontal cortex). These effects were largely blocked by prior GLP-1 receptor blockade using exendin 9-39. Our findings provide novel insights into the mechanisms by which GLP-1 regulates food intake and how GLP-1 receptor agonists cause weight loss.

  7. Activation of physiological stress responses by a natural reward: Novel vs. repeated sucrose intake.

    Science.gov (United States)

    Egan, Ann E; Ulrich-Lai, Yvonne M

    2015-10-15

    Pharmacological rewards, such as drugs of abuse, evoke physiological stress responses, including increased heart rate and blood pressure, and activation of the hypothalamic-pituitary-adrenal (HPA) axis. It is not clear to what extent the natural reward of palatable foods elicits similar physiological responses. In order to address this question, HPA axis hormones, heart rate, blood pressure and brain pCREB immunolabeling were assessed following novel and repeated sucrose exposure. Briefly, adult, male rats with ad libitum food and water were given either a single (day 1) or repeated (twice-daily for 14 days) brief (up to 30 min) exposure to a second drink bottle containing 4 ml of 30% sucrose drink vs. water (as a control for bottle presentation). Sucrose-fed rats drank more than water-fed on all days of exposure, as expected. On day 1 of exposure, heart rate, blood pressure, plasma corticosterone, and locomotion were markedly increased by presentation of the second drink bottle regardless of drink type. After repeated exposure (day 14), these responses habituated to similar extents regardless of drink type and pCREB immunolabeling in the hypothalamic paraventricular nucleus (PVN) also did not vary with drink type, whereas basolateral amygdala pCREB was increased by sucrose intake. Taken together, these data suggest that while sucrose is highly palatable, physiological stress responses were evoked principally by the drink presentation itself (e.g., an unfamiliar intervention by the investigators), as opposed to the palatability of the offered drink.

  8. Reward association facilitates distractor suppression in human visual search.

    Science.gov (United States)

    Gong, Mengyuan; Yang, Feitong; Li, Sheng

    2016-04-01

    Although valuable objects are attractive in nature, people often encounter situations where they would prefer to avoid such distraction while focusing on the task goal. Contrary to the typical effect of attentional capture by a reward-associated item, we provide evidence for a facilitation effect derived from the active suppression of a high reward-associated stimulus when cuing its identity as distractor before the display of search arrays. Selection of the target is shown to be significantly faster when the distractors were in high reward-associated colour than those in low reward-associated or non-rewarded colours. This behavioural reward effect was associated with two neural signatures before the onset of the search display: the increased frontal theta oscillation and the strengthened top-down modulation from frontal to anterior temporal regions. The former suggests an enhanced working memory representation for the reward-associated stimulus and the increased need for cognitive control to override Pavlovian bias, whereas the latter indicates that the boost of inhibitory control is realized through a frontal top-down mechanism. These results suggest a mechanism in which the enhanced working memory representation of a reward-associated feature is integrated with task demands to modify attentional priority during active distractor suppression and benefit behavioural performance.

  9. Endogenous Opioid-Induced Neuroplasticity of Dopaminergic Neurons in the Ventral Tegmental Area Influences Natural and Opiate Reward

    NARCIS (Netherlands)

    Pitchers, Kyle K.; Coppens, Caroline M.; Beloate, Lauren N.; Fuller, Jonathan; Van, Sandy; Frohmader, Karla S.; Laviolette, Steven R.; Lehman, Michael N.; Coolen, Lique M.

    2014-01-01

    Natural reward and drugs of abuse converge on the mesolimbic pathway and activate common mechanism of neural plasticity in the nucleus accumbens. Chronic exposure to opiates induces plasticity in dopaminergic neurons of the ventral tegmental area (VTA), which regulates morphine reward tolerance. Her

  10. Relationship between oscillatory neuronal activity during reward processing and trait impulsivity and sensation seeking.

    Directory of Open Access Journals (Sweden)

    Gregor Leicht

    Full Text Available BACKGROUND: The processing of reward and punishment stimuli in humans appears to involve brain oscillatory activity of several frequencies, probably each with a distinct function. The exact nature of associations of these electrophysiological measures with impulsive or risk-seeking personality traits is not completely clear. Thus, the aim of the present study was to investigate event-related oscillatory activity during reward processing across a wide spectrum of frequencies, and its associations with impulsivity and sensation seeking in healthy subjects. METHODS: During recording of a 32-channel EEG 22 healthy volunteers were characterized with the Barratt Impulsiveness and the Sensation Seeking Scale and performed a computerized two-choice gambling task comprising different feedback options with positive vs. negative valence (gain or loss and high or low magnitude (5 vs. 25 points. RESULTS: We observed greater increases of amplitudes of the feedback-related negativity and of activity in the theta, alpha and low-beta frequency range following loss feedback and, in contrast, greater increase of activity in the high-beta frequency range following gain feedback. Significant magnitude effects were observed for theta and delta oscillations, indicating greater amplitudes upon feedback concerning large stakes. The theta amplitude changes during loss were negatively correlated with motor impulsivity scores, whereas alpha and low-beta increase upon loss and high-beta increase upon gain were positively correlated with various dimensions of sensation seeking. CONCLUSIONS: The findings suggest that the processing of feedback information involves several distinct processes, which are subserved by oscillations of different frequencies and are associated with different personality traits.

  11. Rewarding prayers.

    Science.gov (United States)

    Schjødt, Uffe; Stødkilde-Jørgensen, Hans; Geertz, Armin W; Roepstorff, Andreas

    2008-10-10

    We report a highly significant regional increase of the BOLD response in the caudate nucleus in a group of Danish Christians while performing silent religious prayer. The effect was found in a main-effect analysis of high-structured and low-structured religious recitals relative to comparable secular recitals and to a non-narrative baseline. This supports the hypothesis that religious prayer as a form of frequently recurring behavior is capable of stimulating the dopaminergic reward system in practicing individuals. It extends recent research which demonstrates a relation between interpersonal trust and activation in the dopaminergic system to also encompass relations to abstract entities.

  12. Motor Planning under Unpredictable Reward: Modulations of Movement Vigor and Primate Striatum Activity

    Directory of Open Access Journals (Sweden)

    Ioan eOpris

    2011-05-01

    Full Text Available Although reward probability is an important factor that shapes animal behavior, it is not well understood however, how the primate brain translates reward expectation into the vigor of movement (reaction time and speed. To address this question, we trained two monkeys in a reaction time task that required wrist movements in response to vibrotactile and visual stimuli, with a variable reward schedule. Correct performance was rewarded in 75 % of the trials. Monkeys were certain that they would be rewarded only in the trials immediately following withheld rewards. In these trials, the animals responded sooner and moved faster. Single-unit recordings from the dorsal striatum revealed that modulations in striatal neurons reflected such modulations of movement vigor. First, in the trials with certain rewards, striatal neurons modulated their firing rates earlier. Second, magnitudes of changes in neuronal firing rates depended on whether or not monkeys were certain about the reward. Third, these modulations depended on the sensory modality of the cue (visual vs. vibratory and/or movement direction (flexions vs. extensions. We conclude that dorsal striatum may be a part of the mechanism responsible for the modulation of movement vigor in response to changes of reward predictability.

  13. Operant behavior to obtain palatable food modifies ERK activity in the brain reward circuit.

    Science.gov (United States)

    Guegan, Thomas; Cutando, Laura; Gangarossa, Giuseppe; Santini, Emanuela; Fisone, Gilberto; Martinez, Albert; Valjent, Emmanuel; Maldonado, Rafael; Martin, Miquel

    2013-03-01

    Food palatability produces behavioral modifications that resemble those induced by drugs of abuse. Palatability-induced behavioral changes require both, the activation of the endogenous cannabinoid system, and changes in structural plasticity in neurons of the brain reward pathway. The ERK intracellular pathway is activated by CB1 receptors (CB1-R) and plays a crucial role in neuroplasticity. We investigated the activation of the ERK signaling cascade in the mesocorticolimbic system induced by operant training to obtain highly palatable isocaloric food and the involvement of the CB1-R in these responses. Using immunofluorescence techniques, we analyzed changes in ERK intracellular pathway activation in the mesocorticolimbic system of wild-type and CB1 knockout mice (CB1-/-) trained on an operant paradigm to obtain standard, highly caloric or highly palatable isocaloric food. Operant training for highly palatable isocaloric food, but not for standard or highly caloric food, produced a robust activation of the ERK signaling cascade in the same brain areas where this training modified structural plasticity. These changes induced by the operant training were absent in CB1-/-. We can conclude that the activation of the ERK pathway is associated to the neuroplasticity induced by operant training for highly palatable isocaloric food and might be involved in CB1-R mediated alterations in behavior and structural plasticity.

  14. Social power and approach-related neural activity

    NARCIS (Netherlands)

    M.A.S. Boksem (Maarten); R. Smolders (Ruud); D. de Cremer (David)

    2009-01-01

    textabstractIt has been argued that power activates a general tendency to approach whereas powerlessness activates a tendency to inhibit. The assumption is that elevated power involves reward-rich environments, freedom and, as a consequence, triggers an approach-related motivational orientation and

  15. Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement.

    Directory of Open Access Journals (Sweden)

    Kyung Man Kim

    Full Text Available Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a "reward prediction error" (RPE. Although RPE drives reinforcement learning (RL in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA dopamine neurons expressing Channelrhodopsin-2 (ChR2 in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function.

  16. Peripheral neural activity recording and stimulation system.

    Science.gov (United States)

    Loi, D; Carboni, C; Angius, G; Angotzi, G N; Barbaro, M; Raffo, L; Raspopovic, S; Navarro, X

    2011-08-01

    This paper presents a portable, embedded, microcontroller-based system for bidirectional communication (recording and stimulation) between an electrode, implanted in the peripheral nervous system, and a host computer. The device is able to record and digitize spontaneous and/or evoked neural activities and store them in data files on a PC. In addition, the system has the capability of providing electrical stimulation of peripheral nerves, injecting biphasic current pulses with programmable duration, intensity, and frequency. The recording system provides a highly selective band-pass filter from 800 Hz to 3 kHz, with a gain of 56 dB. The amplification range can be further extended to 96 dB with a variable gain amplifier. The proposed acquisition/stimulation circuitry has been successfully tested through in vivo measurements, implanting a tf-LIFE electrode in the sciatic nerve of a rat. Once implanted, the device showed an input referred noise of 0.83 μVrms, was capable of recording signals below 10 μ V, and generated muscle responses to injected stimuli. The results demonstrate the capability of processing and transmitting neural signals with very low distortion and with a power consumption lower than 1 W. A graphic, user-friendly interface has been developed to facilitate the configuration of the entire system, providing the possibility to activate stimulation and monitor recordings in real time.

  17. The neuroscience of investing: fMRI of the reward system.

    Science.gov (United States)

    Peterson, Richard L

    2005-11-15

    Functional magnetic resonance imaging (fMRI) has proven a useful tool for observing neural BOLD signal changes during complex cognitive and emotional tasks. Yet the meaning and applicability of the fMRI data being gathered is still largely unknown. The brain's reward system underlies the fundamental neural processes of goal evaluation, preference formation, positive motivation, and choice behavior. fMRI technology allows researchers to dynamically visualize reward system processes. Experimenters can then correlate reward system BOLD activations with experimental behavior from carefully controlled experiments. In the SPAN lab at Stanford University, directed by Brian Knutson Ph.D., researchers have been using financial tasks during fMRI scanning to correlate emotion, behavior, and cognition with the reward system's fundamental neural activations. One goal of the SPAN lab is the development of predictive models of behavior. In this paper we extrapolate our fMRI results toward understanding and predicting individual behavior in the uncertain and high-risk environment of the financial markets. The financial market price anomalies of "value versus glamour" and "momentum" may be real-world examples of reward system activation biasing collective behavior. On the individual level, the investor's bias of overconfidence may similarly be related to reward system activation. We attempt to understand selected "irrational" investor behaviors and anomalous financial market price patterns through correlations with findings from fMRI research of the reward system.

  18. Fat/carbohydrate ratio but not energy density determines snack food intake and activates brain reward areas.

    Science.gov (United States)

    Hoch, Tobias; Kreitz, Silke; Gaffling, Simone; Pischetsrieder, Monika; Hess, Andreas

    2015-05-14

    The snack food potato chips induces food intake in ad libitum fed rats, which is associated with modulation of the brain reward system and other circuits. Here, we show that food intake in satiated rats is triggered by an optimal fat/carbohydrate ratio. Like potato chips, an isocaloric fat/carbohydrate mixture influenced whole brain activity pattern of rats, affecting circuits related e.g. to reward/addiction, but the number of modulated areas and the extent of modulation was lower compared to the snack food itself.

  19. Fat/carbohydrate ratio but not energy density determines snack food intake and activates brain reward areas

    OpenAIRE

    Hoch, Tobias; Kreitz, Silke; Gaffling, Simone; Pischetsrieder, Monika; Hess, Andreas

    2015-01-01

    The snack food potato chips induces food intake in ad libitum fed rats, which is associated with modulation of the brain reward system and other circuits. Here, we show that food intake in satiated rats is triggered by an optimal fat/carbohydrate ratio. Like potato chips, an isocaloric fat/carbohydrate mixture influenced whole brain activity pattern of rats, affecting circuits related e.g. to reward/addiction, but the number of modulated areas and the extent of modulation was lower compared t...

  20. Relative Timing Between Kappa Opioid Receptor Activation and Cocaine Determines the Impact on Reward and Dopamine Release

    Science.gov (United States)

    Chartoff, Elena H; Ebner, Shayla R; Sparrow, Angela; Potter, David; Baker, Phillip M; Ragozzino, Michael E; Roitman, Mitchell F

    2016-01-01

    Negative affective states can increase the rewarding value of drugs of abuse and promote drug taking. Chronic cocaine exposure increases levels of the neuropeptide dynorphin, an endogenous ligand at kappa opioid receptors (KOR) that suppresses dopamine release in the nucleus accumbens (NAc) and elicits negative affective states upon drug withdrawal. However, there is evidence that the effects of KOR activation on affective state are biphasic: immediate aversive effects are followed by delayed increases in reward. The impact of KOR-induced affective states on reward-related effects of cocaine over time is not known. We hypothesize that the initial aversive effects of KOR activation increase, whereas the delayed rewarding effects decrease, the net effects of cocaine on reward and dopamine release. We treated rats with cocaine at various times (15 min to 48 h) after administration of the selective KOR agonist salvinorin A (salvA). Using intracranial self-stimulation and fast scan cyclic voltammetry, we found that cocaine-induced increases in brain stimulation reward and evoked dopamine release in the NAc core were potentiated when cocaine was administered within 1 h of salvA, but attenuated when administered 24 h after salvA. Quantitative real-time PCR was used to show that KOR and prodynorphin mRNA levels were decreased in the NAc, whereas tyrosine hydroxylase and dopamine transporter mRNA levels and tissue dopamine content were increased in the ventral tegmental area 24 h post-salvA. These findings raise the possibility that KOR activation—as occurs upon withdrawal from chronic cocaine—modulates vulnerability to cocaine in a time-dependent manner. PMID:26239494

  1. Withholding a Reward-driven Action: Studies of the Rise and Fall of Motor Activation and the Effect of Cognitive Depletion.

    Science.gov (United States)

    Freeman, Scott M; Aron, Adam R

    2016-02-01

    Controlling an inappropriate response tendency in the face of a reward-predicting stimulus likely depends on the strength of the reward-driven activation, the strength of a putative top-down control process, and their relative timing. We developed a rewarded go/no-go paradigm to investigate such dynamics. Participants made rapid responses (on go trials) to high versus low reward-predicting stimuli and sometimes had to withhold responding (on no-go trials) in the face of the same stimuli. Behaviorally, for high versus low reward stimuli, responses were faster on go trials, and there were more errors of commission on no-go trials. We used single-pulse TMS to map out the corticospinal excitability dynamics, especially on no-go trials where control is needed. For successful no-go trials, there was an early rise in motor activation that was then sharply reduced beneath baseline. This activation-reduction pattern was more pronounced for high- versus low-reward trials and in individuals with greater motivational drive for reward. A follow-on experiment showed that, when participants were fatigued by an effortful task, they made more errors on no-go trials for high versus low reward stimuli. Together, these studies show that, when a response is inappropriate, reward-predicting stimuli induce early motor activation, followed by a top-down effortful control process (which we interpret as response suppression) that depends on the strength of the preceding activation. Our findings provide novel information about the activation-suppression dynamics during control over reward-driven actions, and they illustrate how fatigue or depletion leads to control failures in the face of reward.

  2. Phencyclidine affects firing activity of ventral tegmental area neurons that are related to reward and social behaviors in rats.

    Science.gov (United States)

    Katayama, T; Okamoto, M; Suzuki, Y; Hoshino, K-Y; Jodo, E

    2013-06-14

    Patients with schizophrenia exhibit deficits in motivation and affect, which suggests an impairment in the reward system. The psychotomimetic drug, phencyclidine (PCP), also induces schizophrenia-like negative symptoms, such as reduced motivation, blunted affect, and social withdrawal in both humans and animals. Previous studies have indicated that the dopaminergic neurons in the ventral tegmental area (VTA) play a pivotal role in the development of reward-associated learning and motivation. However, how PCP affects the activity of VTA neurons during performance of a reward-related task and social interaction with others in unanesthetized animals remains unclear. Here, we recorded the unit activity of VTA neurons in freely moving rats before and after systemic administration of PCP in a classical conditioning paradigm, and during social interaction with an unfamiliar partner. In the classical conditioning task, two different tones were sequentially presented, one of which accompanied electrical stimulation of the medial forebrain bundle as an unconditioned stimulus. After identifying the response properties of recorded neurons in the classical conditioning task and social interaction, animals received an intraperitoneal injection of PCP. Our study demonstrated that most VTA neurons responsive to reward-associated stimuli were also activated during social interaction. Such activation of neurons was considerably suppressed by systemic administration of PCP, thus, PCP may affect the firing activity of VTA neurons that are involved in motivation, learning, and social interaction. Disruption of the response of VTA neurons to reward stimuli and socially interactive situations may be involved in PCP-induced impairments similar to the negative symptoms of schizophrenia.

  3. Midbrain volume predicts fMRI and ERP measures of reward reactivity.

    Science.gov (United States)

    Carlson, Joshua M; Foti, Dan; Harmon-Jones, Eddie; Proudfit, Greg H

    2015-01-01

    Ventral striatal activation measured with functional magnetic resonance imaging (fMRI) and feedback negativity amplitude measured with event-related potentials (ERPs) are each enhanced during reward processing. Recent research has found that these two neural measures of reward processing are also related to one another, such that increases in ventral striatal activity are accompanied by increases in the amplitude of the feedback negativity. Although there is a long history of research implicating the midbrain dopamine system in reward processing, there has been little research into the possibility that structural variability in the midbrain may be linked to functional variability in reward reactivity. Here, we used structural MRI to measure midbrain volumes in addition to fMRI and ERP measures of functional neural reactivity to rewards in a simple gambling task. The results suggest that as midbrain volumes increase, fMRI reward reactivity in the ventral striatum and medial prefrontal cortex also increases. A similar relationship exists between midbrain structure and the amplitude of the feedback negativity; further, this relationship is mediated specifically by activity in the ventral striatum. These data demonstrate convergence between neuroanatomical, hemodynamic, and electrophysiological measures. Thus, structural variability in the midbrain relates to variability in fMRI and ERP measures of functional reward reactivity, which may play a critical role in reward-related psychopathologies and the treatment of these disorders.

  4. Protein receptor for activated C kinase 1 is involved in morphine reward in mice.

    Science.gov (United States)

    Wan, L; Su, L; Xie, Y; Liu, Y; Wang, Y; Wang, Z

    2009-07-07

    Opiate addiction is associated with upregulation of cAMP signaling in the brain. cAMP-responsive element binding protein (CREB), a nuclear transcription factor, is a downstream component of the extracellular signal-regulated protein kinase (ERK) pathway, which has been shown to regulate different physiological and psychological responses of drug addiction. RACK1, the protein receptor for activated C kinase 1, is a multifunctional scaffolding protein known to be a key regulator of various signaling cascades in the CNS. RACK1 functions specifically in integrin mediated activation of ERK cascade and targets active ERK. We examined if RACK1 is involved in the mechanism of drug addiction by regulating CREB in mouse hippocampus and prefrontal cortex. Several expressions were observed. Chronic administration of morphine made the expression of RACK1 and CREB mRNA increase in hippocampus and prefrontal cortex. The expression of RACK1 and CREB protein was strongly positive in CA1, CA3 and dentate gyrus (DG) of the hippocampus of morphine-treated mice brain, especially the pyramidal neurons in the DG of the hippocampus. Using the small interfering RNA technology, we determined that the expression of CREB mRNA was decreased in hippocampus and prefrontal cortex of morphine-treated mice. The expression of RACK1 and CREB protein was negative in CA1, CA3 and DG of hippocampus. These findings suggest that morphine reward can influence the expression of RACK1 in mouse hippocampus and prefrontal cortex through regulating CREB transcription.

  5. Reward-Guided Learning with and without Causal Attribution.

    Science.gov (United States)

    Jocham, Gerhard; Brodersen, Kay H; Constantinescu, Alexandra O; Kahn, Martin C; Ianni, Angela M; Walton, Mark E; Rushworth, Matthew F S; Behrens, Timothy E J

    2016-04-01

    When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task.

  6. Models of neural networks with fuzzy activation functions

    Science.gov (United States)

    Nguyen, A. T.; Korikov, A. M.

    2017-02-01

    This paper investigates the application of a new form of neuron activation functions that are based on the fuzzy membership functions derived from the theory of fuzzy systems. On the basis of the results regarding neuron models with fuzzy activation functions, we created the models of fuzzy-neural networks. These fuzzy-neural network models differ from conventional networks that employ the fuzzy inference systems using the methods of neural networks. While conventional fuzzy-neural networks belong to the first type, fuzzy-neural networks proposed here are defined as the second-type models. The simulation results show that the proposed second-type model can successfully solve the problem of the property prediction for time – dependent signals. Neural networks with fuzzy impulse activation functions can be widely applied in many fields of science, technology and mechanical engineering to solve the problems of classification, prediction, approximation, etc.

  7. Nucleus accumbens response to rewards and testosterone levels are related to alcohol use in adolescents and young adults

    Directory of Open Access Journals (Sweden)

    Barbara R. Braams

    2016-02-01

    Full Text Available During adolescence there is a normative increase in risk-taking behavior, which is reflected in, for example, increases in alcohol consumption. Prior research has demonstrated a link between testosterone and alcohol consumption, and between testosterone and neural responses to rewards. Yet, no study to date tested how testosterone levels and neural responses to rewards relate to and predict individual differences in alcohol use. The current study aimed to investigate this by assessing alcohol use, testosterone levels and neural responses to rewards in adolescents (12–17 years old and young adults (18–26 years old. Participants were measured twice with a two-year interval between testing sessions. Cross-sectional analysis showed that at the second time point higher neural activity to rewards, but not testosterone levels, explained significant variance above age in reported alcohol use. Predictive analyses showed that, higher testosterone level at the first time point, but not neural activity to rewards at the first time point, was predictive of more alcohol use at the second time point. These results suggest that neural responses to rewards are correlated with current alcohol consumption, and that testosterone level is predictive of future alcohol consumption. These results are interpreted in the context of trajectory models of adolescent development.

  8. Nucleus accumbens response to rewards and testosterone levels are related to alcohol use in adolescents and young adults.

    Science.gov (United States)

    Braams, Barbara R; Peper, Jiska S; van der Heide, Dianne; Peters, Sabine; Crone, Eveline A

    2016-02-01

    During adolescence there is a normative increase in risk-taking behavior, which is reflected in, for example, increases in alcohol consumption. Prior research has demonstrated a link between testosterone and alcohol consumption, and between testosterone and neural responses to rewards. Yet, no study to date tested how testosterone levels and neural responses to rewards relate to and predict individual differences in alcohol use. The current study aimed to investigate this by assessing alcohol use, testosterone levels and neural responses to rewards in adolescents (12-17 years old) and young adults (18-26 years old). Participants were measured twice with a two-year interval between testing sessions. Cross-sectional analysis showed that at the second time point higher neural activity to rewards, but not testosterone levels, explained significant variance above age in reported alcohol use. Predictive analyses showed that, higher testosterone level at the first time point, but not neural activity to rewards at the first time point, was predictive of more alcohol use at the second time point. These results suggest that neural responses to rewards are correlated with current alcohol consumption, and that testosterone level is predictive of future alcohol consumption. These results are interpreted in the context of trajectory models of adolescent development.

  9. Cue-elicited reward-seeking requires extracellular signal-regulated kinase activation in the nucleus accumbens.

    Science.gov (United States)

    Shiflett, Michael W; Martini, Ross P; Mauna, Jocelyn C; Foster, Rebecca L; Peet, Eloise; Thiels, Edda

    2008-02-01

    The motivation to seek out rewards can come under the control of stimuli associated with reward delivery. The ability of cues to motivate reward-seeking behavior depends on the nucleus accumbens (NAcc). The molecular mechanisms in the NAcc that underlie the ability of a cue to motivate reward-seeking are not well understood. We examined whether extracellular signal-regulated kinase (ERK), an important intracellular signaling pathway in learning and memory, has a role in these motivational processes. We first examined p42 ERK (ERK2) activation in the NAcc after rats were trained to associate an auditory stimulus with food delivery and found that, as a consequence of training, presentation of the auditory cue itself was sufficient to increase ERK2 activation in the NAcc. To examine whether inhibition of ERK in the NAcc prevents cue-induced reward-seeking, we infused an inhibitor of ERK, U0126, into the NAcc before assessing rats' instrumental responding in the presence versus absence of the conditioned cue. We found that, whereas vehicle-infused rats showed increased instrumental responding during cue presentation, rats infused with U0126 showed a profound impairment in cue-induced instrumental responding. In contrast, intra-NAcc U0126 infusion had no effect on rats' food-reinforced instrumental responding or their ability to execute conditioned approach behavior. Our results demonstrate learning-related changes in ERK signaling in the NAcc, and that disruption of ERK activation in this structure interferes with the incentive-motivational effects of conditioned stimuli. The molecular mechanisms described here may have implications for cue-elicited drug craving after repeated exposure to drugs of abuse.

  10. Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

    Directory of Open Access Journals (Sweden)

    Alexander Niklas Häusler

    Full Text Available Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP, reward reception (RR and reward prediction errors (RPE showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.

  11. Regional brain activation supporting cognitive control in the context of reward is associated with treated adolescents’ marijuana problem severity at follow-up: A preliminary study

    Directory of Open Access Journals (Sweden)

    Tammy Chung

    2015-12-01

    Full Text Available This preliminary study examined the extent to which regional brain activation during a reward cue antisaccade (AS task was associated with 6-month treatment outcome in adolescent substance users. Antisaccade performance provides a sensitive measure of executive function and cognitive control, and generally improves with reward cues. We hypothesized that when preparing to execute an AS, greater activation in regions associated with cognitive and oculomotor control supporting AS, particularly during reward cue trials, would be associated with lower substance use severity at 6-month follow-up. Adolescents (n = 14, ages 14–18 recruited from community-based outpatient treatment completed an fMRI reward cue AS task (reward and neutral conditions, and provided follow-up data. Results indicated that AS errors decreased in reward, compared to neutral, trials. AS behavioral performance, however, was not associated with treatment outcome. As hypothesized, activation in regions of interest (ROIs associated with cognitive (e.g., ventrolateral prefrontal cortex and oculomotor control (e.g., supplementary eye field during reward trials were inversely correlated with marijuana problem severity at 6-months. ROI activation during neutral trials was not associated with outcomes. Results support the role of motivational (reward cue factors to enhance cognitive control processes, and suggest a potential brain-based correlate of youth treatment outcome.

  12. Acute stress-induced cortisol elevations mediate reward system activity during subconscious processing of sexual stimuli

    OpenAIRE

    Oei, Nicole Y. L.; Both, Stephanie; van Heemst, Diana; van der Grond, Jeroen

    2014-01-01

    Summary Stress is thought to alter motivational processes by increasing dopamine (DA) secretion in the brain’s ‘‘reward system’’, and its key region, the nucleus accumbens (NAcc). However, stress studies using functional magnetic resonance imaging (fMRI), mainly found evidence for stress-induced decreases in NAcc responsiveness toward reward cues. Results from both animal and human PETstudies indicate that the stress hormone cortisol may be crucial in the interaction between st...

  13. Identifying Emotions on the Basis of Neural Activation.

    Directory of Open Access Journals (Sweden)

    Karim S Kassam

    Full Text Available We attempt to determine the discriminability and organization of neural activation corresponding to the experience of specific emotions. Method actors were asked to self-induce nine emotional states (anger, disgust, envy, fear, happiness, lust, pride, sadness, and shame while in an fMRI scanner. Using a Gaussian Naïve Bayes pooled variance classifier, we demonstrate the ability to identify specific emotions experienced by an individual at well over chance accuracy on the basis of: 1 neural activation of the same individual in other trials, 2 neural activation of other individuals who experienced similar trials, and 3 neural activation of the same individual to a qualitatively different type of emotion induction. Factor analysis identified valence, arousal, sociality, and lust as dimensions underlying the activation patterns. These results suggest a structure for neural representations of emotion and inform theories of emotional processing.

  14. Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

    Science.gov (United States)

    Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

    2016-10-01

    Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment.

  15. Function of the centromedial amygdala in reward devaluation and open-field activity.

    Science.gov (United States)

    Kawasaki, K; Glueck, A C; Annicchiarico, I; Papini, M R

    2015-09-10

    The present research aimed at determining the role played by the amygdala in reward devaluation using transient inactivation induced by lidocaine microinfusions into the centromedial region. Two situations involving reward devaluation were tested in rats: consummatory successive negative contrast (cSNC) and anticipatory negative contrast (ANC). In cSNC, rats exposed to a downshift from 32% to 4% sucrose consume less 4% sucrose than rats always exposed to 4% sucrose. Extensive evidence suggests that reward devaluation in the cSNC situation is accompanied by negative emotion. In ANC, rats consume less 4% sucrose when each session is closely followed by access to 32% sucrose rather than by 4% sucrose. Evidence suggests that reward devaluation in the ANC situation does not involve negative emotions; rather, ANC appears to involve Pavlovian anticipation of the higher value solution. To test the effects of lidocaine microinfusions in a situation known to induce negative emotion, but unrelated to reward devaluation, animals were also exposed to a lighted open field. Centromedial amygdala inactivation reduced the cSNC effect and increased exploratory behavior in the open field, both effects consistent with a reduction in negative emotional state. However, no detectable effects of amygdala inactivation were observed in the ANC situation. These results suggest that, first, the function of the amygdala is not unique to reward devaluation and, second, it is concerned with tagging the devaluation experience with aversive valence.

  16. The brain correlates of the effects of monetary and verbal rewards on intrinsic motivation.

    Science.gov (United States)

    Albrecht, Konstanze; Abeler, Johannes; Weber, Bernd; Falk, Armin

    2014-01-01

    Apart from everyday duties, such as doing the laundry or cleaning the house, there are tasks we do for pleasure and enjoyment. We do such tasks, like solving crossword puzzles or reading novels, without any external pressure or force; instead, we are intrinsically motivated: we do the tasks because we enjoy doing them. Previous studies suggest that external rewards, i.e., rewards from the outside, affect the intrinsic motivation to engage in a task: while performance-based monetary rewards are perceived as controlling and induce a business-contract framing, verbal rewards praising one's competence can enhance the perceived self-determination. Accordingly, the former have been shown to decrease intrinsic motivation, whereas the latter have been shown to increase intrinsic motivation. The present study investigated the neural processes underlying the effects of monetary and verbal rewards on intrinsic motivation in a group of 64 subjects applying functional magnetic resonance imaging (fMRI). We found that, when participants received positive performance feedback, activation in the anterior striatum and midbrain was affected by the nature of the reward; compared to a non-rewarded control group, activation was higher while monetary rewards were administered. However, we did not find a decrease in activation after reward withdrawal. In contrast, we found an increase in activation for verbal rewards: after verbal rewards had been withdrawn, participants showed a higher activation in the aforementioned brain areas when they received success compared to failure feedback. We further found that, while participants worked on the task, activation in the lateral prefrontal cortex was enhanced after the verbal rewards were administered and withdrawn.

  17. Just watching the game ain’t enough: Striatal fMRI reward responses to successes and failures in a video game during active and vicarious playing

    Directory of Open Access Journals (Sweden)

    Jari eKätsyri

    2013-06-01

    Full Text Available Although the multimodal stimulation provided by modern audiovisual video games is pleasing by itself, the rewarding nature of video game playing depends critically also on the players’ active engagement in the gameplay. The extent to which active engagement influences dopaminergic brain reward circuit responses remains unsettled. Here we show that striatal reward circuit responses elicited by successes (wins and failures (losses in a video game are stronger during active than vicarious gameplay. Eleven healthy males both played a competitive first-person tank shooter game (active playing and watched a pre-recorded gameplay video (vicarious playing while their hemodynamic brain activation was measured with 3-tesla functional magnetic resonance imaging (fMRI. Wins and losses were paired with symmetrical monetary rewards and punishments during active and vicarious playing so that the external reward context remained identical during both conditions. Brain activation was stronger in the orbitomedial prefrontal cortex (omPFC during winning than losing, both during active and vicarious playing conditions. In contrast, both wins and losses suppressed activations in the midbrain and striatum during active playing; however, the striatal suppression, particularly in the anterior putamen, was more pronounced during loss than win events. Sensorimotor confounds related to joystick movements did not account for the results. Self-ratings indicated losing to be more unpleasant during active than vicarious playing. Our findings demonstrate striatum to be selectively sensitive to self-acquired rewards, in contrast to frontal components of the reward circuit that process both self-acquired and passively received rewards. We propose that the striatal responses to repeated acquisition of rewards that are contingent on game related successes contribute to the motivational pull of video-game playing.

  18. Insula and striatum activity in effort-related monetary reward processing in gambling disorder: The role of depressive symptomatology

    Directory of Open Access Journals (Sweden)

    Mira Fauth-Bühler

    2014-01-01

    Full Text Available The neurobiological underpinnings of effort-related monetary reward processing of gambling disorder have not been previously studied. To date neuroimaging studies lack in large sample sizes and as a consequence less attention has been given to brain reward processing that could potentially be attributed to comorbid conditions such as depressive mood state. We assessed monetary reward processing using an effort-dependent task during 3 tesla functional magnetic resonance imaging. We investigated a large sample of male, right-handed, slot-machine-playing disordered gamblers (DGs; N = 80 as well as age- and smoking-matched male healthy controls (HCs; N = 89. Depressive symptoms were assessed using the Beck Depression Inventory (BDI. DGs and HCs were divided into subgroups (“high” and “low” based on their BDI scores. Effort-related monetary reward processing did not differ between the complete groups of HCs and DGs. Brain activation during receipt of monetary reward though revealed a significant Group × BDI interaction: DGs with higher BDI scores compared to DGs with lower BDI scores showed greater brain activity in the right insula cortex and dorsal striatum while no differences were observed for HCs with higher versus lower BDI scores. Our results suggest that effort-related aspects of monetary motivation, i.e. when monetary output is tied to performance, are not altered in DG. Additionally, our findings strengthen the need for subgroup comparisons in future investigations of the disorder as part of a personalized medicine approach.

  19. An obesity-associated risk allele within the FTO gene affects human brain activity for areas important for emotion, impulse control and reward in response to food images.

    Science.gov (United States)

    Wiemerslage, Lyle; Nilsson, Emil K; Solstrand Dahlberg, Linda; Ence-Eriksson, Fia; Castillo, Sandra; Larsen, Anna L; Bylund, Simon B A; Hogenkamp, Pleunie S; Olivo, Gaia; Bandstein, Marcus; Titova, Olga E; Larsson, Elna-Marie; Benedict, Christian; Brooks, Samantha J; Schiöth, Helgi B

    2016-05-01

    Understanding how genetics influences obesity, brain activity and eating behaviour will add important insight for developing strategies for weight-loss treatment, as obesity may stem from different causes and as individual feeding behaviour may depend on genetic differences. To this end, we examined how an obesity risk allele for the FTO gene affects brain activity in response to food images of different caloric content via functional magnetic resonance imaging (fMRI). Thirty participants homozygous for the rs9939609 single nucleotide polymorphism were shown images of low- or high-calorie food while brain activity was measured via fMRI. In a whole-brain analysis, we found that people with the FTO risk allele genotype (AA) had increased activity compared with the non-risk (TT) genotype in the posterior cingulate, cuneus, precuneus and putamen. Moreover, higher body mass index in the AA genotype was associated with reduced activity to food images in areas important for emotion (cingulate cortex), but also in areas important for impulse control (frontal gyri and lentiform nucleus). Lastly, we corroborate our findings with behavioural scales for the behavioural inhibition and activation systems. Our results suggest that the two genotypes are associated with differential neural processing of food images, which may influence weight status through diminished impulse control and reward processing.

  20. Social status modulates neural activity in the mentalizing network.

    Science.gov (United States)

    Muscatell, Keely A; Morelli, Sylvia A; Falk, Emily B; Way, Baldwin M; Pfeifer, Jennifer H; Galinsky, Adam D; Lieberman, Matthew D; Dapretto, Mirella; Eisenberger, Naomi I

    2012-04-15

    The current research explored the neural mechanisms linking social status to perceptions of the social world. Two fMRI studies provide converging evidence that individuals lower in social status are more likely to engage neural circuitry often involved in 'mentalizing' or thinking about others' thoughts and feelings. Study 1 found that college students' perception of their social status in the university community was related to neural activity in the mentalizing network (e.g., DMPFC, MPFC, precuneus/PCC) while encoding social information, with lower social status predicting greater neural activity in this network. Study 2 demonstrated that socioeconomic status, an objective indicator of global standing, predicted adolescents' neural activity during the processing of threatening faces, with individuals lower in social status displaying greater activity in the DMPFC, previously associated with mentalizing, and the amygdala, previously associated with emotion/salience processing. These studies demonstrate that social status is fundamentally and neurocognitively linked to how people process and navigate their social worlds.

  1. Reduction in ventral striatal activity when anticipating a reward in depression and schizophrenia: a replicated cross-diagnostic finding

    Directory of Open Access Journals (Sweden)

    Gonzalo eArrondo

    2015-08-01

    Full Text Available In the research domain framework (RDoC, dysfunctional reward expectation has been proposed to be a cross-diagnostic domain in psychiatry, which may contribute to symptoms common to various neuropsychiatric conditions, such as anhedonia or apathy/avolition. We used a modified version of the Monetary Incentive Delay (MID paradigm to obtain functional MRI images from 22 patients with schizophrenia, 24 with depression and 21 controls. Anhedonia and other symptoms of depression, and overall positive and negative symptomatology were also measured. We hypothesized that the two clinical groups would have a reduced activity in the ventral striatum when anticipating reward (compared to anticipation of a neutral outcome and that striatal activation would correlate with clinical measures of motivational problems and anhedonia. Results were consistent with the first hypothesis: two clusters in both the left and right ventral striatum were found to differ between the groups in reward anticipation. Post-hoc analysis showed that this was due to higher activation in the controls compared to the schizophrenia and the depression groups in the right ventral striatum, with activation differences between depression and controls also seen in the left ventral striatum. No differences were found between the two patient groups, and there were no areas of abnormal cortical activation in either group that survived correction for multiple comparisons. Reduced ventral striatal activity was related to greater anhedonia and overall depressive symptoms in the schizophrenia group, but not in the participants with depression. Findings are discussed in relation to previous literature but overall are supporting evidence of reward system dysfunction across the neuropsychiatric continuum, even if the specific clinical relevance is still not fully understood. We also discuss how the RDoC approach may help to solve some of the replication problems in psychiatric fMRI research.

  2. The effect of the neural activity on topological properties of growing neural networks.

    Science.gov (United States)

    Gafarov, F M; Gafarova, V R

    2016-09-01

    The connectivity structure in cortical networks defines how information is transmitted and processed, and it is a source of the complex spatiotemporal patterns of network's development, and the process of creation and deletion of connections is continuous in the whole life of the organism. In this paper, we study how neural activity influences the growth process in neural networks. By using a two-dimensional activity-dependent growth model we demonstrated the neural network growth process from disconnected neurons to fully connected networks. For making quantitative investigation of the network's activity influence on its topological properties we compared it with the random growth network not depending on network's activity. By using the random graphs theory methods for the analysis of the network's connections structure it is shown that the growth in neural networks results in the formation of a well-known "small-world" network.

  3. Neural regions that underlie reinforcement learning are also active for social expectancy violations.

    Science.gov (United States)

    Harris, Lasana T; Fiske, Susan T

    2010-01-01

    Prediction error, the difference between an expected and an actual outcome, serves as a learning signal that interacts with reward and punishment value to direct future behavior during reinforcement learning. We hypothesized that similar learning and valuation signals may underlie social expectancy violations. Here, we explore the neural correlates of social expectancy violation signals along the universal person-perception dimensions trait warmth and competence. In this context, social learning may result from expectancy violations that occur when a target is inconsistent with an a priori schema. Expectancy violation may activate neural regions normally implicated in prediction error and valuation during appetitive and aversive conditioning. Using fMRI, we first gave perceivers high warmth or competence behavioral information that led to dispositional or situational attributions for the behavior. Participants then saw pictures of people responsible for the behavior; they represented social groups either inconsistent (rated low on either warmth or competence) or consistent (rated high on either warmth or competence) with the behavior information. Warmth and competence expectancy violations activate striatal regions that represent evaluative and prediction error signals. Social cognition regions underlie consistent expectations. These findings suggest that regions underlying reinforcement learning may work in concert with social cognition regions in warmth and competence social expectancy. This study illustrates the neural overlap between neuroeconomics and social neuroscience.

  4. Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task.

    Science.gov (United States)

    Gu, Xiaosi; Kirk, Ulrich; Lohrenz, Terry M; Montague, P Read

    2014-08-01

    Computational models of reward processing suggest that foregone or fictive outcomes serve as important information sources for learning and augment those generated by experienced rewards (e.g. reward prediction errors). An outstanding question is how these learning signals interact with top-down cognitive influences, such as cognitive reappraisal strategies. Using a sequential investment task and functional magnetic resonance imaging, we show that the reappraisal strategy selectively attenuates the influence of fictive, but not reward prediction error signals on investment behavior; such behavioral effect is accompanied by changes in neural activity and connectivity in the anterior insular cortex, a brain region thought to integrate subjective feelings with high-order cognition. Furthermore, individuals differ in the extent to which their behaviors are driven by fictive errors versus reward prediction errors, and the reappraisal strategy interacts with such individual differences; a finding also accompanied by distinct underlying neural mechanisms. These findings suggest that the variable interaction of cognitive strategies with two important classes of computational learning signals (fictive, reward prediction error) represent one contributing substrate for the variable capacity of individuals to control their behavior based on foregone rewards. These findings also expose important possibilities for understanding the lack of control in addiction based on possibly foregone rewarding outcomes.

  5. Disrupted reward circuits is associated with cognitive deficits and depression severity in major depressive disorder.

    Science.gov (United States)

    Gong, Liang; Yin, Yingying; He, Cancan; Ye, Qing; Bai, Feng; Yuan, Yonggui; Zhang, Haisan; Lv, Luxian; Zhang, Hongxing; Xie, Chunming; Zhang, Zhijun

    2017-01-01

    Neuroimaging studies have demonstrated that major depressive disorder (MDD) patients show blunted activity responses to reward-related tasks. However, whether abnormal reward circuits affect cognition and depression in MDD patients remains unclear. Seventy-five drug-naive MDD patients and 42 cognitively normal (CN) subjects underwent a resting-state functional magnetic resonance imaging scan. The bilateral nucleus accumbens (NAc) were selected as seeds to construct reward circuits across all subjects. A multivariate linear regression analysis was employed to investigate the neural substrates of cognitive function and depression severity on the reward circuits in MDD patients. The common pathway underlying cognitive deficits and depression was identified with conjunction analysis. Compared with CN subjects, MDD patients showed decreased reward network connectivity that was primarily located in the prefrontal-striatal regions. Importantly, distinct and common neural pathways underlying cognition and depression were identified, implying the independent and synergistic effects of cognitive deficits and depression severity on reward circuits. This study demonstrated that disrupted topological organization within reward circuits was significantly associated with cognitive deficits and depression severity in MDD patients. These findings suggest that in addition to antidepressant treatment, normalized reward circuits should be a focus and a target for improving depression and cognitive deficits in MDD patients.

  6. Post-learning Hippocampal Dynamics Promote Preferential Retention of Rewarding Events.

    Science.gov (United States)

    Gruber, Matthias J; Ritchey, Maureen; Wang, Shao-Fang; Doss, Manoj K; Ranganath, Charan

    2016-03-01

    Reward motivation is known to modulate memory encoding, and this effect depends on interactions between the substantia nigra/ventral tegmental area complex (SN/VTA) and the hippocampus. It is unknown, however, whether these interactions influence offline neural activity in the human brain that is thought to promote memory consolidation. Here we used fMRI to test the effect of reward motivation on post-learning neural dynamics and subsequent memory for objects that were learned in high- and low-reward motivation contexts. We found that post-learning increases in resting-state functional connectivity between the SN/VTA and hippocampus predicted preferential retention of objects that were learned in high-reward contexts. In addition, multivariate pattern classification revealed that hippocampal representations of high-reward contexts were preferentially reactivated during post-learning rest, and the number of hippocampal reactivations was predictive of preferential retention of items learned in high-reward contexts. These findings indicate that reward motivation alters offline post-learning dynamics between the SN/VTA and hippocampus, providing novel evidence for a potential mechanism by which reward could influence memory consolidation.

  7. Brain reward-system activation in response to anticipation and consumption of palatable food is altered by glucagon-like peptide-1 receptor activation in humans

    NARCIS (Netherlands)

    van Bloemendaal, L.; Veltman, D. J.; ten Kulve, J. S.; Groot, P. F. C.; Ruhe, H. G.; Barkhof, F.; Sloan, J. H.; Diamant, M.; Ijzerman, R. G.

    2015-01-01

    AimTo test the hypothesis that food intake reduction after glucagon-like peptide-1 (GLP-1) receptor activation is mediated through brain areas regulating anticipatory and consummatory food reward. MethodsAs part of a larger study, we determined the effects of GLP-1 receptor activation on brain respo

  8. Brain activity in advantageous and disadvantageous situations: implications for reward/punishment sensitivity in different situations.

    Directory of Open Access Journals (Sweden)

    Guangheng Dong

    Full Text Available OBJECTIVE: This study modeled win and lose trials in a simple gambling task to examine the effect of entire win-lose situations (WIN, LOSS, or TIE on single win/lose trials and related neural underpinnings. METHODS: The behavior responses and brain activities of 17 participants were recorded by an MRI scanner while they performed a gambling task. Different conditions were compared to determine the effect of the task on the behavior and brain activity of the participants. Correlations between brain activity and behavior were calculated to support the imaging results. RESULTS: In win trials, LOSS caused less intense posterior cingulate activity than TIE. In lose trials, LOSS caused more intense activity in the right superior temporal gyrus, bilateral superior frontal gyrus, bilateral anterior cingulate, bilateral insula cortex, and left orbitofrontal cortex than WIN and TIE. CONCLUSIONS: The experiences of the participants in win trials showed great similarity among different win-lose situations. However, the brain activity and behavior responses of the participants in lose trials indicated that they experienced stronger negative emotion in LOSS. The participants also showed an increased desire to win in LOSS than in WIN or TIE conditions.

  9. Graphene microelectrode arrays for neural activity detection.

    Science.gov (United States)

    Du, Xiaowei; Wu, Lei; Cheng, Ji; Huang, Shanluo; Cai, Qi; Jin, Qinghui; Zhao, Jianlong

    2015-09-01

    We demonstrate a method to fabricate graphene microelectrode arrays (MEAs) using a simple and inexpensive method to solve the problem of opaque electrode positions in traditional MEAs, while keeping good biocompatibility. To study the interface differences between graphene-electrolyte and gold-electrolyte, graphene and gold electrodes with a large area were fabricated. According to the simulation results of electrochemical impedances, the gold-electrolyte interface can be described as a classical double-layer structure, while the graphene-electrolyte interface can be explained by a modified double-layer theory. Furthermore, using graphene MEAs, we detected the neural activities of neurons dissociated from Wistar rats (embryonic day 18). The signal-to-noise ratio of the detected signal was 10.31 ± 1.2, which is comparable to those of MEAs made with other materials. The long-term stability of the MEAs is demonstrated by comparing differences in Bode diagrams taken before and after cell culturing.

  10. Developmental effects of reward on sustained attention networks.

    Science.gov (United States)

    Smith, Anna B; Halari, Rozmin; Giampetro, Vincent; Brammer, Michael; Rubia, Katya

    2011-06-01

    Adolescence is typified by significant maturation in higher-level attention functions coupled with less developed control over motivation, and enhanced sensitivity to novelty and reward. This study used event-related functional magnetic resonance imaging (fMRI) in seventy male and female participants aged between 10 and 43 years to identify age-related linear changes in cognitive sustained attention systems and the impact of reward on these systems, using a sustained attention task with and without a rewarded condition. For the non-rewarded sustained attention contrast, increasing age was associated with activation increases in typical regions of sustained attention including right inferior frontal, superior temporo-parietal and cerebellar cortices. Age-related activation decreases were observed within more posterior regions including posterior cingulate, insula and posterior cerebellar cortices, presumably mediating visual-spatial saliency detection. The effect of reward on sustained attention networks was associated with increased activation with age in regions associated with both executive attention control and reward processing, including dorsolateral, inferior and ventromedial prefrontal cortices (PFC), striatum, and temporo-parietal regions, suggestive of greater integration and executive control of motivation and cognition with maturity. Activation in paralimbic posterior cingulate and inferior temporal brain regions of visual-spatial saliency processing was progressively reduced in activation with increasing development. Thus, with increasing development between adolescence and adulthood, reward appears to enhance maturing cognitive sustained attention and executive reward-processing networks, whilst reducing paralimbic regions of saliency detection. These findings may be the neural underpinnings for the progressive maturation of motivational control over risk taking behaviours between adolescence and adulthood.

  11. Activation instead of blocking mesolimbic dopaminergic reward circuitry is a preferred modality in the long term treatment of reward deficiency syndrome (RDS: a commentary

    Directory of Open Access Journals (Sweden)

    Waite Roger L

    2008-11-01

    proliferation of D2 receptors. Proposal and conclusion The authors propose that D2 receptor stimulation can be accomplished via the use of Synapatmine™, a natural but therapeutic nutraceutical formulation that potentially induces DA release, causing the same induction of D2-directed mRNA and thus proliferation of D2 receptors in the human. This proliferation of D2 receptors in turn will induce the attenuation of craving behavior. In fact as mentioned earlier, this model has been proven in research showing DNA-directed compensatory overexpression (a form of gene therapy of the DRD2 receptors, resulting in a significant reduction in alcohol craving behavior in alcohol preferring rodents. Utilizing natural dopaminergic repletion therapy to promote long term dopaminergic activation will ultimately lead to a common, safe and effective modality to treat Reward Deficiency Syndrome (RDS behaviors including Substance Use Disorders (SUD, Attention Deficit Hyperactivity Disorder (ADHD, Obesity and other reward deficient aberrant behaviors. This concept is further supported by the more comprehensive understanding of the role of dopamine in the NAc as a "wanting" messenger in the meso-limbic DA system.

  12. Embedding responses in spontaneous neural activity shaped through sequential learning.

    Directory of Open Access Journals (Sweden)

    Tomoki Kurikawa

    Full Text Available Recent experimental measurements have demonstrated that spontaneous neural activity in the absence of explicit external stimuli has remarkable spatiotemporal structure. This spontaneous activity has also been shown to play a key role in the response to external stimuli. To better understand this role, we proposed a viewpoint, "memories-as-bifurcations," that differs from the traditional "memories-as-attractors" viewpoint. Memory recall from the memories-as-bifurcations viewpoint occurs when the spontaneous neural activity is changed to an appropriate output activity upon application of an input, known as a bifurcation in dynamical systems theory, wherein the input modifies the flow structure of the neural dynamics. Learning, then, is a process that helps create neural dynamical systems such that a target output pattern is generated as an attractor upon a given input. Based on this novel viewpoint, we introduce in this paper an associative memory model with a sequential learning process. Using a simple hebbian-type learning, the model is able to memorize a large number of input/output mappings. The neural dynamics shaped through the learning exhibit different bifurcations to make the requested targets stable upon an increase in the input, and the neural activity in the absence of input shows chaotic dynamics with occasional approaches to the memorized target patterns. These results suggest that these dynamics facilitate the bifurcations to each target attractor upon application of the corresponding input, which thus increases the capacity for learning. This theoretical finding about the behavior of the spontaneous neural activity is consistent with recent experimental observations in which the neural activity without stimuli wanders among patterns evoked by previously applied signals. In addition, the neural networks shaped by learning properly reflect the correlations of input and target-output patterns in a similar manner to those designed in

  13. Subjective illusion of control modulates striatal reward anticipation in adolescence.

    Science.gov (United States)

    Lorenz, Robert C; Gleich, Tobias; Kühn, Simone; Pöhland, Lydia; Pelz, Patricia; Wüstenberg, Torsten; Raufelder, Diana; Heinz, Andreas; Beck, Anne

    2015-08-15

    The perception of control over the environment constitutes a fundamental biological adaptive mechanism, especially during development. Previous studies comparing an active choice condition with a passive no-choice condition showed that the neural basis of this mechanism is associated with increased activity within the striatum and the prefrontal cortex. In the current study, we aimed to investigate whether subjective belief of control in an uncertain gambling situation induces elevated activation in a cortico-striatal network. We investigated 79 adolescents (age range: 13-16years) during reward anticipation with a slot machine task using functional magnetic resonance imaging. We assessed post-experimentally whether the participants experienced a subjective illusion of control on winning or losing in this task that was objectively not given. Nineteen adolescents experienced an illusion of control during slot machine gambling. This illusion of control group showed an increased neural activity during reward anticipation within a cortico-striatal network including ventral striatum (VS) as well as right inferior frontal gyrus (rIFG) relative to the group reporting no illusion of control. The rIFG activity was inversely associated with impulsivity in the no illusion of control group. The subjective belief about control led to an elevated ventral striatal activity, which is known to be involved in the processing of reward. This finding strengthens the notion that subjectively perceived control, not necessarily the objective presence of control, affects striatal reward-related processing.

  14. Feedback associated with expectation for larger-reward improves visuospatial working memory performances in children with ADHD

    Directory of Open Access Journals (Sweden)

    Rubi Hammer

    2015-08-01

    Full Text Available We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC boys underwent functional magnetic resonance imaging (fMRI while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small and feedback availability (no-feedback; feedback. While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory.

  15. Neural activity, memory, and dementias: serotonergic markers.

    Science.gov (United States)

    Meneses, Alfredo

    2017-04-01

    Dysfunctional memory seems to be a key component of diverse dementias and other neuropsychiatric disorders; unfortunately, no effective treatment exists for this, probably because of the absence of neural biomarkers accompanying it. Diverse neurotransmission systems have been implicated in memory, including serotonin or 5-hydroxytryptamine (5-HT). There are multiple serotonergic pharmacological tools, well-characterized downstream signaling in mammals' species and neural markers providing new insights into memory functions and dysfunctions. Serotonin in mammal species has multiple neural markers, including receptors (5-HT1-7), serotonin transporter, and volume transmission, which are present in brain areas involved in memory. Memory, amnesia, and forgetting modify serotonergic markers; this influence is bidirectional. Evidence shows insights and therapeutic targets and diverse approaches support the translatability of using neural markers and cerebral functions and dysfunctions, including memory formation and amnesia. For instance, 5-HT2A/2B/2C, 5-HT4, and 5-HT6 receptors are involved in tau protein hyperphosphorylation in Alzheimer's disease. In addition, at least, 5-HT1A, 5-HT4, 5-HT6, and 5-HT7 receptors as well as serotonin transporter seem to be useful neural markers and therapeutic targets. Hence, available evidence supports the notion that several mechanisms cooperate to achieve synaptic plasticity or memory, including changes in the number of neurotransmitter receptors and transporters. Considering that memory is a key component of dementias, hence reversing or reducing memory deficits might positively affect them?

  16. NPY mediates reward activity of morphine, via NPY Y1 receptors, in the nucleus accumbens shell.

    Science.gov (United States)

    Desai, Sagar J; Upadhya, Manoj A; Subhedar, Nishikant K; Kokare, Dadasaheb M

    2013-06-15

    Although the interaction between endogenous neuropeptide Y (NPY) and opioidergic systems in processing of reward has been speculated, experimental evidence is lacking. We investigated the role of NPY, and its Y1 receptors, in the nucleus accumbens shell (AcbSh) in morphine induced reward and reinforcement behavior. Rats were implanted with cannulae targeted at AcbSh for drug administration, and with stimulating electrode in the medial forebrain bundle (MFB). The rats were then conditioned in an operant conditioning chamber for electrical self-stimulation of the MFB. Increased rate of lever pressings was evaluated against the frequency of the stimulating current. Increase in rate of lever presses was considered as a measure of reward and reinforcement. About 30-70% increase in self-stimulation was observed following bilateral intra-AcbSh treatment with morphine, NPY or [Leu(31), Pro(34)]-NPY (NPY Y1/Y5 receptors agonist), however, BIBP3226 (selective NPY Y1 receptors antagonist) produced opposite effect. The reward effect of morphine was significantly potentiated by NPY or [Leu(31), Pro(34)]-NPY, but antagonized by BIBP3226. NPY-immunoreactivity in the AcbSh, arcuate nucleus (ARC) and lateral part of bed nucleus of stria terminalis (BNSTl) was significantly more in the operant conditioned rats than in naïve control. However, morphine administration to the conditioned rats resulted in significant decrease in the NPY-immunoreactivity in all these anatomical regions. Since the role of morphine in modulation of mesolimbic-dopaminergic pathway is well established, we suggest that NPY system in AcbSh, ARC and BNSTl, perhaps acting via Y1-receptor system, may be an important component of the mesolimbic-AcbSh reward circuitry triggered by endogenous opioids.

  17. Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events.

    Science.gov (United States)

    Murty, Vishnu P; Adcock, R Alison

    2014-08-01

    Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning.

  18. Neural progenitor cells regulate microglia functions and activity.

    Science.gov (United States)

    Mosher, Kira I; Andres, Robert H; Fukuhara, Takeshi; Bieri, Gregor; Hasegawa-Moriyama, Maiko; He, Yingbo; Guzman, Raphael; Wyss-Coray, Tony

    2012-11-01

    We found mouse neural progenitor cells (NPCs) to have a secretory protein profile distinct from other brain cells and to modulate microglial activation, proliferation and phagocytosis. NPC-derived vascular endothelial growth factor was necessary and sufficient to exert at least some of these effects in mice. Thus, neural precursor cells may not only be shaped by microglia, but also regulate microglia functions and activity.

  19. Abnormal Social Reward Responses in Anorexia Nervosa: An fMRI Study.

    Directory of Open Access Journals (Sweden)

    Esther Via

    Full Text Available Patients with anorexia nervosa (AN display impaired social interactions, implicated in the development and prognosis of the disorder. Importantly, social behavior is modulated by reward-based processes, and dysfunctional at-brain-level reward responses have been involved in AN neurobiological models. However, no prior evidence exists of whether these neural alterations would be equally present in social contexts. In this study, we conducted a cross-sectional social-judgment functional magnetic resonance imaging (fMRI study of 20 restrictive-subtype AN patients and 20 matched healthy controls. Brain activity during acceptance and rejection was investigated and correlated with severity measures (Eating Disorder Inventory -EDI-2 and with personality traits of interest known to modulate social behavior (The Sensitivity to Punishment and Sensitivity to Reward Questionnaire. Patients showed hypoactivation of the dorsomedial prefrontal cortex (DMPFC during social acceptance and hyperactivation of visual areas during social rejection. Ventral striatum activation during rejection was positively correlated in patients with clinical severity scores. During acceptance, activation of the frontal opercula-anterior insula and dorsomedial/dorsolateral prefrontal cortices was differentially associated with reward sensitivity between groups. These results suggest an abnormal motivational drive for social stimuli, and involve overlapping social cognition and reward systems leading to a disruption of adaptive responses in the processing of social reward. The specific association of reward-related regions with clinical and psychometric measures suggests the putative involvement of reward structures in the maintenance of pathological behaviors in AN.

  20. The Dopaminergic Midbrain Mediates an Effect of Average Reward on Pavlovian Vigor.

    Science.gov (United States)

    Rigoli, Francesco; Chew, Benjamin; Dayan, Peter; Dolan, Raymond J

    2016-09-01

    Dopamine plays a key role in motivation. Phasic dopamine response reflects a reinforcement prediction error (RPE), whereas tonic dopamine activity is postulated to represent an average reward that mediates motivational vigor. However, it has been hard to find evidence concerning the neural encoding of average reward that is uncorrupted by influences of RPEs. We circumvented this difficulty in a novel visual search task where we measured participants' button pressing vigor in a context where information (underlying an RPE) about future average reward was provided well before the average reward itself. Despite no instrumental consequence, participants' pressing force increased for greater current average reward, consistent with a form of Pavlovian effect on motivational vigor. We recorded participants' brain activity during task performance with fMRI. Greater average reward was associated with enhanced activity in dopaminergic midbrain to a degree that correlated with the relationship between average reward and pressing vigor. Interestingly, an opposite pattern was observed in subgenual cingulate cortex, a region implicated in negative mood and motivational inhibition. These findings highlight a crucial role for dopaminergic midbrain in representing aspects of average reward and motivational vigor.

  1. Psychosocial versus physiological stress - Meta-analyses on deactivations and activations of the neural correlates of stress reactions.

    Science.gov (United States)

    Kogler, Lydia; Müller, Veronika I; Chang, Amy; Eickhoff, Simon B; Fox, Peter T; Gur, Ruben C; Derntl, Birgit

    2015-10-01

    Stress is present in everyday life in various forms and situations. Two stressors frequently investigated are physiological and psychosocial stress. Besides similar subjective and hormonal responses, it has been suggested that they also share common neural substrates. The current study used activation-likelihood-estimation meta-analysis to test this assumption by integrating results of previous neuroimaging studies on stress processing. Reported results are cluster-level FWE corrected. The inferior frontal gyrus (IFG) and the anterior insula (AI) were the only regions that demonstrated overlapping activation for both stressors. Analysis of physiological stress showed consistent activation of cognitive and affective components of pain processing such as the insula, striatum, or the middle cingulate cortex. Contrarily, analysis across psychosocial stress revealed consistent activation of the right superior temporal gyrus and deactivation of the striatum. Notably, parts of the striatum appeared to be functionally specified: the dorsal striatum was activated in physiological stress, whereas the ventral striatum was deactivated in psychosocial stress. Additional functional connectivity and decoding analyses further characterized this functional heterogeneity and revealed higher associations of the dorsal striatum with motor regions and of the ventral striatum with reward processing. Based on our meta-analytic approach, activation of the IFG and the AI seems to indicate a global neural stress reaction. While physiological stress activates a motoric fight-or-flight reaction, during psychosocial stress attention is shifted towards emotion regulation and goal-directed behavior, and reward processing is reduced. Our results show the significance of differentiating physiological and psychosocial stress in neural engagement. Furthermore, the assessment of deactivations in addition to activations in stress research is highly recommended.

  2. Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict.

    Science.gov (United States)

    van den Berg, Berry; Krebs, Ruth M; Lorist, Monicque M; Woldorff, Marty G

    2014-06-01

    The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive task performance. In this task, the cue indicated whether or not the participant needed to prepare for an upcoming Stroop stimulus and, if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued attention and cued reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (contingent negative variation [CNV]) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted shorter versus longer response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across participants with the degree to which reward-prospect both facilitated overall task performance (shorter RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information.

  3. Nalbuphine could decrease the rewarding effect induced by tramadol in mice while enhancing its antinociceptive activity.

    Science.gov (United States)

    Abdel-Ghany, Rasha; Nabil, Mahmoud; Abdel-Aal, Mohamed; Barakat, Waleed

    2015-07-05

    Nalbuphine, a kappa-opioid agonist and mu-opioid partial agonist, has been used as an analgesic or an adjuvant with morphine to attenuate the development of morphine dependence and rewarding effect. In this study, we investigated the effect of nalbuphine on tramadol rewarding effect and antinociception. Using the conditioned place preference (CPP) paradigm in mice, we demonstrated that co-administration of nalbuphine (7mg/kg, s.c.) with tramadol (70mg/kg, s.c.) during conditioning completely blocked the CPP induced by tramadol. Co-administration of nalbuphine blocked the increase in dopamine level in the nucleus accumbens induced by tramadol. These actions were accompanied by an increase rather than attenuation of the antinociceptive effect of tramadol. These results suggest that nalbuphine could have a great potential as a pharmacotherapy for tramadol abuse.

  4. Active Engine Mounting Control Algorithm Using Neural Network

    Directory of Open Access Journals (Sweden)

    Fadly Jashi Darsivan

    2009-01-01

    Full Text Available This paper proposes the application of neural network as a controller to isolate engine vibration in an active engine mounting system. It has been shown that the NARMA-L2 neurocontroller has the ability to reject disturbances from a plant. The disturbance is assumed to be both impulse and sinusoidal disturbances that are induced by the engine. The performance of the neural network controller is compared with conventional PD and PID controllers tuned using Ziegler-Nichols. From the result simulated the neural network controller has shown better ability to isolate the engine vibration than the conventional controllers.

  5. Is avolition in schizophrenia associated with a deficit of dorsal caudate activity? A functional magnetic resonance imaging study during reward anticipation and feedback

    OpenAIRE

    Mucci, A.; D. Dima; Soricelli, A; Volpe, U.; Bucci, P.; Frangou, S.; Prinster, A.; Salvatore, M; Galderisi, S.; Maj, M.

    2015-01-01

    BACKGROUND: The neurobiological underpinnings of avolition in schizophrenia remain unclear. Most brain imaging research has focused on reward prediction deficit and on ventral striatum dysfunction, but findings are not consistent. In the light of accumulating evidence that both ventral striatum and dorsal caudate play a key role in motivation, we investigated ventral striatum and dorsal caudate activation during processing of reward or loss in patients with schizophrenia. METHOD: We used ...

  6. Death and rebirth of neural activity in sparse inhibitory networks

    OpenAIRE

    Angulo-Garcia, David; Luccioli, Stefano; Olmi, Simona; Torcini, Alessandro

    2016-01-01

    In this paper, we clarify the mechanisms underlying a general phenomenon present in pulse-coupled heterogeneous inhibitory networks: inhibition can induce not only suppression of the neural activity, as expected, but it can also promote neural reactivation. In particular, for globally coupled systems, the number of firing neurons monotonically reduces upon increasing the strength of inhibition (neurons' death). However, the random pruning of the connections is able to reverse the action of in...

  7. Understanding the brain by controlling neural activity

    OpenAIRE

    Krug, Kristine; Salzman, C. Daniel; Waddell, Scott

    2015-01-01

    Causal methods to interrogate brain function have been employed since the advent of modern neuroscience in the nineteenth century. Initially, randomly placed electrodes and stimulation of parts of the living brain were used to localize specific functions to these areas. Recent technical developments have rejuvenated this approach by providing more precise tools to dissect the neural circuits underlying behaviour, perception and cognition. Carefully controlled behavioural experiments have been...

  8. Neurometabolic coupling between neural activity, glucose, and lactate in activated visual cortex.

    Science.gov (United States)

    Li, Baowang; Freeman, Ralph D

    2015-11-01

    Neural activity is closely coupled with energy metabolism but details of the association remain to be identified. One basic area involves the relationships between neural activity and the main supportive substrates of glucose and lactate. This is of fundamental significance for the interpretation of non-invasive neural imaging. Here, we use microelectrodes with high spatial and temporal resolution to determine simultaneous co-localized changes in glucose, lactate, and neural activity during visual activation of the cerebral cortex in the cat. Tissue glucose and lactate concentration levels are measured with electrochemical microelectrodes while neural spiking activity and local field potentials are sampled by a microelectrode. These measurements are performed simultaneously while neurons are activated by visual stimuli of different contrast levels, orientations, and sizes. We find immediate decreases in tissue glucose concentration and simultaneous increases in lactate during neural activation. Both glucose and lactate signals return to their baseline levels instantly as neurons cease firing. No sustained changes or initial dips in glucose or lactate signals are elicited by visual stimulation. However, co-localized measurements of cerebral blood flow and neural activity demonstrate a clear delay in the cerebral blood flow signal such that it does not correlate temporally with the neural response. These results provide direct real-time evidence regarding the coupling between co-localized energy metabolism and neural activity during physiological stimulation. They are also relevant to a current question regarding the role of lactate in energy metabolism in the brain during neural activation. Dynamic changes in energy metabolites can be measured directly with high spatial and temporal resolution by use of enzyme-based microelectrodes. Here, to examine neuro-metabolic coupling during brain activation, we use combined microelectrodes to simultaneously measure

  9. Neural Network-Based Active Control for Offshore Platforms

    Institute of Scientific and Technical Information of China (English)

    周亚军; 赵德有

    2003-01-01

    A new active control scheme, based on neural network, for the suppression of oscillation in multiple-degree-of-freedom (MDOF) offshore platforms, is studied in this paper. With the main advantages of neural network, i.e. the inherent robustness, fault tolerance, and generalized capability of its parallel massive interconnection structure, the active structural control of offshore platforms under random waves is accomplished by use of the BP neural network model. The neural network is trained offline with the data generated from numerical analysis, and it simulates the process of Classical Linear Quadratic Regular Control for the platform under random waves. After the learning phase, the trained network has learned about the nonlinear dynamic behavior of the active control system, and is capable of predicting the active control forces of the next time steps. The results obtained show that the active control is feasible and effective, and it finally overcomes time delay owing to the robustness, fault tolerance, and generalized capability of artificial neural network.

  10. High Accuracy Human Activity Monitoring using Neural network

    CERN Document Server

    Sharma, Annapurna; Chung, Wan-Young

    2011-01-01

    This paper presents the designing of a neural network for the classification of Human activity. A Triaxial accelerometer sensor, housed in a chest worn sensor unit, has been used for capturing the acceleration of the movements associated. All the three axis acceleration data were collected at a base station PC via a CC2420 2.4GHz ISM band radio (zigbee wireless compliant), processed and classified using MATLAB. A neural network approach for classification was used with an eye on theoretical and empirical facts. The work shows a detailed description of the designing steps for the classification of human body acceleration data. A 4-layer back propagation neural network, with Levenberg-marquardt algorithm for training, showed best performance among the other neural network training algorithms.

  11. Denial of reward in the neonate shapes sociability and serotonergic activity in the adult rat.

    Directory of Open Access Journals (Sweden)

    Anastasia Diamantopoulou

    Full Text Available BACKGROUND: Manipulations of the early environment are linked to long-lasting alterations of emotionality and social capabilities. Denial of rewarding mother-pup interactions in early life of rats could serve as model for child neglect. Negative consequences for social competence in later life, accompanied by changes in the serotonergic system would be expected. In contrast, rewarding mother-pup contact should promote adequate social abilities. METHODOLOGY/PRINCIPAL FINDINGS: Male Wistar rats trained in a T-maze during postnatal days 10-13 under denial (DER or permission (RER of maternal contact were tested for play behavior in adolescence and for coping with defeat in adulthood. We estimated serotonin (5-HT levels in the brain under basal conditions and following defeat, as well as serotonin receptor 1A (5-HT1A and serotonin transporter (SERT expression. DER rats exhibited increased aggressive-like play behavior in adolescence (i.e. increased nape attacks, p<0.0001 and selected a proactive coping style during defeat in adulthood (higher sum of proactive behaviors: number of attacks, flights, rearings and defensive upright posture; p = 0.011, p<0.05 vs RER, non-handled-NH. In adulthood, they had lower 5-HT levels in both the prefrontal cortex (p<0.05 vs RER and the amygdala (p<0.05 vs NH, increased 5-HT levels following defeat (PFC p<0.0001 and decreased serotonin turnover (amygdala p = 0.008. The number of 5-HT1A immunopositive cells in the CA1 hippocampal area was increased (p<0.05 DER, vs RER, NH; SERT levels in the amygdala were elevated (p<0.05 vs RER, NH, but were lower in the prefrontal cortex (p<0.05 vs NH. CONCLUSIONS/SIGNIFICANCE: Denial of expected maternal reward early in life negatively affects sociability and the serotonergic system in a complex manner. We propose that our animal model could contribute to the identification of the neurobiological correlates of early neglect effects on social behavior and coping with challenges, but

  12. Distinct Neural Activities in Premotor Cortex during Natural Vocal Behaviors in a New World Primate, the Common Marmoset (Callithrix jacchus).

    Science.gov (United States)

    Roy, Sabyasachi; Zhao, Lingyun; Wang, Xiaoqin

    2016-11-30

    Although evidence from human studies has long indicated the crucial role of the frontal cortex in speech production, it has remained uncertain whether the frontal cortex in nonhuman primates plays a similar role in vocal communication. Previous studies of prefrontal and premotor cortices of macaque monkeys have found neural signals associated with cue- and reward-conditioned vocal production, but not with self-initiated or spontaneous vocalizations (Coudé et al., 2011; Hage and Nieder, 2013), which casts doubt on the role of the frontal cortex of the Old World monkeys in vocal communication. A recent study of marmoset frontal cortex observed modulated neural activities associated with self-initiated vocal production (Miller et al., 2015), but it did not delineate whether these neural activities were specifically attributed to vocal production or if they may result from other nonvocal motor activity such as orofacial motor movement. In the present study, we attempted to resolve these issues and examined single neuron activities in premotor cortex during natural vocal exchanges in the common marmoset (Callithrix jacchus), a highly vocal New World primate. Neural activation and suppression were observed both before and during self-initiated vocal production. Furthermore, by comparing neural activities between self-initiated vocal production and nonvocal orofacial motor movement, we identified a subpopulation of neurons in marmoset premotor cortex that was activated or suppressed by vocal production, but not by orofacial movement. These findings provide clear evidence of the premotor cortex's involvement in self-initiated vocal production in natural vocal behaviors of a New World primate.

  13. Internal models for interpreting neural population activity during sensorimotor control.

    Science.gov (United States)

    Golub, Matthew D; Yu, Byron M; Chase, Steven M

    2015-01-01

    To successfully guide limb movements, the brain takes in sensory information about the limb, internally tracks the state of the limb, and produces appropriate motor commands. It is widely believed that this process uses an internal model, which describes our prior beliefs about how the limb responds to motor commands. Here, we leveraged a brain-machine interface (BMI) paradigm in rhesus monkeys and novel statistical analyses of neural population activity to gain insight into moment-by-moment internal model computations. We discovered that a mismatch between subjects' internal models and the actual BMI explains roughly 65% of movement errors, as well as long-standing deficiencies in BMI speed control. We then used the internal models to characterize how the neural population activity changes during BMI learning. More broadly, this work provides an approach for interpreting neural population activity in the context of how prior beliefs guide the transformation of sensory input to motor output.

  14. Serotonergic modulation of reward and punishment

    DEFF Research Database (Denmark)

    Macoveanu, Julian

    2014-01-01

    Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line...... of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions......-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor...

  15. Corticotropin-releasing hormone receptor type 1 (CRHR1) genetic variation and stress interact to influence reward learning.

    Science.gov (United States)

    Bogdan, Ryan; Santesso, Diane L; Fagerness, Jesen; Perlis, Roy H; Pizzagalli, Diego A

    2011-09-14

    Stress is a general risk factor for psychopathology, but the mechanisms underlying this relationship remain largely unknown. Animal studies and limited human research suggest that stress can induce anhedonic behavior. Moreover, emerging data indicate that genetic variation within the corticotropin-releasing hormone type 1 receptor gene (CRHR1) at rs12938031 may promote psychopathology, particularly in the context of stress. Using an intermediate phenotypic neurogenetics approach, we assessed how stress and CRHR1 genetic variation (rs12938031) influence reward learning, an important component of anhedonia. Psychiatrically healthy female participants (n = 75) completed a probabilistic reward learning task during stress and no-stress conditions while 128-channel event-related potentials were recorded. Fifty-six participants were also genotyped across CRHR1. Response bias, an individual's ability to modulate behavior as a function of reward, was the primary behavioral variable of interest. The feedback-related positivity (FRP) in response to reward feedback was used as a neural index of reward learning. Relative to the no-stress condition, acute stress was associated with blunted response bias as well as a smaller and delayed FRP (indicative of disrupted reward learning) and reduced anterior cingulate and orbitofrontal cortex activation to reward. Critically, rs12938031 interacted with stress to influence reward learning: both behaviorally and neurally, A homozygotes showed stress-induced reward learning abnormalities. These findings indicate that acute, uncontrollable stressors reduce participants' ability to modulate behavior as a function of reward, and that such effects are modulated by CRHR1 genotype. Homozygosity for the A allele at rs12938031 may increase risk for psychopathology via stress-induced reward learning deficits.

  16. Design of 3D Active Multichannel Silicon Neural Microelectrode

    Institute of Scientific and Technical Information of China (English)

    WANG Di; ZHANG Guoxiong; LI Xingfei

    2006-01-01

    To find a design method for 3D active multichannel silicon microelectrode,a microstructure of active neural recording system is presented,where two 2D probes,two integrated circuits and two spacers are microassembled on a 5 mm ×7 mm silicon platform,and 32 sites neural signals can be operated simultaneously.A theoretical model for measuring the neural signal by the silicon microelectrode is proposed based on the structure and fabrication process of a single-shank probe.The method of determining the dimensional parameters of the probe shank is discussed in the following three aspects,i.e.the structures of pallium and endocranium,coupled interconnecters noise,and strength characteristic of neural probe.The design criterion is to minimize the size of the neural probe as well as that the probe has enough stiffness to pierce the endocranium.The on-chip unity-gain bandpass amplifier has an overall gain of 42 dB over a bandwidth from 60 Hz to 10 kHz;and the DC-baseline stability circuit is of high input resistance above 30 MΩ to guarantee a cutoff frequency below 100 Hz.The circuit works in stimulating or recording modes.The conversion of the modes depends on the stimulating control signal.

  17. Cultured Neural Networks: Optimization of Patterned Network Adhesiveness and Characterization of their Neural Activity

    Directory of Open Access Journals (Sweden)

    W. L. C. Rutten

    2006-01-01

    Full Text Available One type of future, improved neural interface is the “cultured probe”. It is a hybrid type of neural information transducer or prosthesis, for stimulation and/or recording of neural activity. It would consist of a microelectrode array (MEA on a planar substrate, each electrode being covered and surrounded by a local circularly confined network (“island” of cultured neurons. The main purpose of the local networks is that they act as biofriendly intermediates for collateral sprouts from the in vivo system, thus allowing for an effective and selective neuron–electrode interface. As a secondary purpose, one may envisage future information processing applications of these intermediary networks. In this paper, first, progress is shown on how substrates can be chemically modified to confine developing networks, cultured from dissociated rat cortex cells, to “islands” surrounding an electrode site. Additional coating of neurophobic, polyimide-coated substrate by triblock-copolymer coating enhances neurophilic-neurophobic adhesion contrast. Secondly, results are given on neuronal activity in patterned, unconnected and connected, circular “island” networks. For connected islands, the larger the island diameter (50, 100 or 150 μm, the more spontaneous activity is seen. Also, activity may show a very high degree of synchronization between two islands. For unconnected islands, activity may start at 22 days in vitro (DIV, which is two weeks later than in unpatterned networks.

  18. Impact of expected value on neural activity in rat substantia nigra pars reticulata.

    Science.gov (United States)

    Bryden, Daniel W; Johnson, Emily E; Diao, Xiayang; Roesch, Matthew R

    2011-06-01

    The substantia nigra pars reticulata (SNr) is thought to serve as the output of the basal ganglia, whereby associative information from striatum influences behavior via disinhibition of downstream motor areas to motivate behavior. Unfortunately, few studies have examined activity in SNr in rats making decisions based on the value of predicted reward similar to those conducted in primates. To fill this void, we recorded from single neurons in SNr while rats performed a choice task in which different odor cues indicated what reward was available on the left or on the right. The value of reward associated with a leftward or rightward movement was manipulated by varying the size of and delay to reward in separate blocks of trials. Rats were faster or slower depending on whether the expected reward value was high or low, respectively. The number of neurons that increased firing during performance of the task outnumbered those that decreased firing. Both increases and decreases were modulated by expected value and response direction. Neurons that fired more or less strongly for larger reward tended to fire, respectively, more or less strongly for immediate reward, reflecting their common motivational output. Finally, value selectivity was present prior to presentation of cues indicating the nature of the upcoming behavioral response for both increasing- and decreasing-type neurons, reflecting the internal bias or preparatory set of the rat. These results emphasize the importance of increasing-type neurons on behavioral output when animals are making decisions based on predicted reward value.

  19. Novelty increases the mesolimbic functional connectivity of the substantia nigra/ventral tegmental area (SN/VTA) during reward anticipation: Evidence from high-resolution fMRI.

    Science.gov (United States)

    Krebs, R M; Heipertz, D; Schuetze, H; Duzel, E

    2011-09-15

    Reward and novelty are potent learning signals that critically rely on dopaminergic midbrain responses. Recent findings suggest that although reward and novelty are likely to interact, both functions may be subserved by distinct neuronal clusters. We used high-resolution functional magnetic resonance imaging (fMRI) to isolate neural responses to reward and novelty within the human substantia nigra/ventral tegmental area (SN/VTA) complex to investigate the spatial delineation and integration of reward- and novelty-related activity clusters. We demonstrate that distinct clusters within the caudal portion of the medial SN/VTA and the lateral portion of the right SN are predominantly modulated by the anticipation of reward, while a more rostral part of the medial SN/VTA was exclusively modulated by novelty. In addition, the caudal medial SN/VTA cluster embodied an interaction between novelty and reward where novelty selectively increased reward-anticipation responses. This interaction, in turn, was paralleled by differences in the functional-connectivity patterns of these SN/VTA regions. Specifically, novel as compared to familiar reward-predictive stimuli increased the functional connectivity of the medial SN/VTA with mesolimbic regions, including the nucleus accumbens and the hippocampus, as well as with the primary visual cortex. This functional correlation may highlight how afferents of the medial SN/VTA provide integrative information about novelty and reward, or, alternatively, how medial SN/VTA activity may modulate memory processes for novel events associated with rewards.

  20. Controlling neural activity in Caenorhabditis elegans to evoke chemotactic behavior

    Science.gov (United States)

    Kocabas, Askin; Shen, Ching-Han; Guo, Zengcai V.; Ramanathan, Sharad

    2013-03-01

    Animals locate and track chemoattractive gradients in the environment to find food. With its simple nervous system, Caenorhabditis elegans is a good model system in which to understand how the dynamics of neural activity control this search behavior. To understand how the activity in its interneurons coordinate different motor programs to lead the animal to food, here we used optogenetics and new optical tools to manipulate neural activity directly in freely moving animals to evoke chemotactic behavior. By deducing the classes of activity patterns triggered during chemotaxis and exciting individual neurons with these patterns, we identified interneurons that control the essential locomotory programs for this behavior. Notably, we discovered that controlling the dynamics of activity in just one interneuron pair was sufficient to force the animal to locate, turn towards and track virtual light gradients.

  1. Adolescents' risky decision-making activates neural networks related to social cognition and cognitive control processes.

    Science.gov (United States)

    Rodrigo, María José; Padrón, Iván; de Vega, Manuel; Ferstl, Evelyn C

    2014-01-01

    This study examines by means of functional magnetic resonance imaging the neural mechanisms underlying adolescents' risk decision-making in social contexts. We hypothesize that the social context could engage brain regions associated with social cognition processes and developmental changes are also expected. Sixty participants (adolescents: 17-18, and young adults: 21-22 years old) read narratives describing typical situations of decision-making in the presence of peers. They were asked to make choices in risky situations (e.g., taking or refusing a drug) or ambiguous situations (e.g., eating a hamburger or a hotdog). Risky as compared to ambiguous scenarios activated bilateral temporoparietal junction (TPJ), bilateral middle temporal gyrus (MTG), right medial prefrontal cortex, and the precuneus bilaterally; i.e., brain regions related to social cognition processes, such as self-reflection and theory of mind (ToM). In addition, brain structures related to cognitive control were active [right anterior cingulate cortex (ACC), bilateral dorsolateral prefrontal cortex (DLPFC), bilateral orbitofrontal cortex], whereas no significant clusters were obtained in the reward system (ventral striatum). Choosing the dangerous option involved a further activation of control areas (ACC) and emotional and social cognition areas (temporal pole). Adolescents employed more neural resources than young adults in the right DLPFC and the right TPJ in risk situations. When choosing the dangerous option, young adults showed a further engagement in ToM related regions (bilateral MTG) and in motor control regions related to the planning of actions (pre-supplementary motor area). Finally, the right insula and the right superior temporal gyrus were more activated in women than in men, suggesting more emotional involvement and more intensive modeling of the others' perspective in the risky conditions. These findings call for more comprehensive developmental accounts of decision-making in

  2. Adolescents’ risky decision-making activates neural networks related to social cognition and cognitive control processes

    Directory of Open Access Journals (Sweden)

    María José eRodrigo

    2014-02-01

    Full Text Available This study examines by means of fMRI the neural mechanisms underlying adolescents’ risk decision-making in social contexts. We hypothesize that the social context could engage brain regions associated with social cognition processes and developmental changes are also expected. Sixty participants (adolescents: 17-18, and young adults: 21-22 years old read narratives describing typical situations of decision-making in the presence of peers. They were asked to make choices in risky situations (e.g., taking or refusing a drug or ambiguous situations (e.g., eating a hamburger or a hotdog. Risky as compared to ambiguous scenarios activated bilateral temporoparietal junction (TPJ, bilateral middle temporal gyrus (MTG, right medial prefrontal cortex (mPFC, and the precuneus bilaterally; i.e., brain regions related to social cognition processes, such as self-reflection and theory of mind. In addition, brain structures related to cognitive control were active (right ACC, bilateral DLPFC, bilateral OFC, whereas no significant clusters were obtained in the reward system (VS. Choosing the dangerous option involved a further activation of control areas (ACC and emotional and social cognition areas (temporal pole. Adolescents employed more neural resources than young adults in the right DLPFC and the right TPJ in risk situations. When choosing the dangerous option, young adults showed a further engagement in theory of mind related regions (bilateral middle temporal gyrus and in motor control regions related to the planning of actions (pre-supplementary motor area. Finally, the right insula and the right superior temporal gyrus were more activated in women than in men, suggesting more emotional involvement and more intensive modeling of the others’ perspective in the risky conditions. These findings call for more comprehensive developmental accounts of decision-making in social contexts that incorporate the role of emotional and social cognition processes.

  3. Rewards teach visual selective attention.

    Science.gov (United States)

    Chelazzi, Leonardo; Perlato, Andrea; Santandrea, Elisa; Della Libera, Chiara

    2013-06-07

    Visual selective attention is the brain function that modulates ongoing processing of retinal input in order for selected representations to gain privileged access to perceptual awareness and guide behavior. Enhanced analysis of currently relevant or otherwise salient information is often accompanied by suppressed processing of the less relevant or salient input. Recent findings indicate that rewards exert a powerful influence on the deployment of visual selective attention. Such influence takes different forms depending on the specific protocol adopted in the given study. In some cases, the prospect of earning a larger reward in relation to a specific stimulus or location biases attention accordingly in order to maximize overall gain. This is mediated by an effect of reward acting as a type of incentive motivation for the strategic control of attention. In contrast, reward delivery can directly alter the processing of specific stimuli by increasing their attentional priority, and this can be measured even when rewards are no longer involved, reflecting a form of reward-mediated attentional learning. As a further development, recent work demonstrates that rewards can affect attentional learning in dissociable ways depending on whether rewards are perceived as feedback on performance or instead are registered as random-like events occurring during task performance. Specifically, it appears that visual selective attention is shaped by two distinct reward-related learning mechanisms: one requiring active monitoring of performance and outcome, and a second one detecting the sheer association between objects in the environment (whether attended or ignored) and the more-or-less rewarding events that accompany them. Overall this emerging literature demonstrates unequivocally that rewards "teach" visual selective attention so that processing resources will be allocated to objects, features and locations which are likely to optimize the organism's interaction with the

  4. Self-affirmation activates brain systems associated with self-related processing and reward and is reinforced by future orientation.

    Science.gov (United States)

    Cascio, Christopher N; O'Donnell, Matthew Brook; Tinney, Francis J; Lieberman, Matthew D; Taylor, Shelley E; Strecher, Victor J; Falk, Emily B

    2016-04-01

    Self-affirmation theory posits that people are motivated to maintain a positive self-view and that threats to perceived self-competence are met with resistance. When threatened, self-affirmations can restore self-competence by allowing individuals to reflect on sources of self-worth, such as core values. Many questions exist, however, about the underlying mechanisms associated with self-affirmation. We examined the neural mechanisms of self-affirmation with a task developed for use in a functional magnetic resonance imaging environment. Results of a region of interest analysis demonstrated that participants who were affirmed (compared with unaffirmed participants) showed increased activity in key regions of the brain's self-processing (medial prefrontal cortex + posterior cingulate cortex) and valuation (ventral striatum + ventral medial prefrontal cortex) systems when reflecting on future-oriented core values (compared with everyday activities). Furthermore, this neural activity went on to predict changes in sedentary behavior consistent with successful affirmation in response to a separate physical activity intervention. These results highlight neural processes associated with successful self-affirmation, and further suggest that key pathways may be amplified in conjunction with prospection.

  5. How to be patient. The ability to wait for a reward depends on menstrual cycle phase and feedback-related activity.

    Directory of Open Access Journals (Sweden)

    Luise eReimers

    2014-12-01

    Full Text Available Dopamine (DA plays a major role in reinforcement learning with increases promoting reward sensitivity (Go learning while decreases facilitate the avoidance of negative outcomes (NoGo learning. This is also reflected in adaptations of response time: higher levels of DA enhance speeding up to get a reward, whereas lower levels favor slowing down. The steroid hormones estradiol and progesterone have been shown to modulate dopaminergic tone. Here, we tested fourteen women twice during their menstrual cycle, during the follicular (FP and the luteal phase (LP, applying functional magnetic resonance imaging while they performed a feedback learning task. Subsequent behavioral testing assessed response time preferences with a clock task, in which subjects had to explore the optimal response time (RT to maximize reward. In the FP subjects displayed a greater learning-related change of their RT than during the LP, when they were required to slow down. Final RTs in the slow condition were also predicted by feedback-related brain activation, but only in the FP. Increased activation of the inferior frontal junction and rostral cingulate zone was thereby predictive of slower and thus better adapted final RTs. Conversely, final RT was faster and less optimal for reward maximization if activation in the ventromedial prefrontal cortex was enhanced. These findings show that hormonal shifts across the menstrual cycle affect adaptation of response speed during reward acquisition with higher RT adjustment in the FP in the condition that requires slowing down. Since high estradiol levels during the FP increase synaptic DA levels, this conforms well to our hypothesis that estradiol supports Go learning at the expense of NoGo learning. Brain-behavior correlations further indicated that the compensatory capacity to counteract the follicular Go bias may be linked to the ability to more effectively monitor action outcomes and suppress bottom-up reward desiring during

  6. Reduced Caudate and Nucleus Accumbens Response to Rewards in Unmedicated Subjects with Major Depressive Disorder

    Science.gov (United States)

    Pizzagalli, Diego A.; Holmes, Avram J.; Dillon, Daniel G.; Goetz, Elena L.; Birk, Jeffrey L.; Bogdan, Ryan; Dougherty, Darin D.; Iosifescu, Dan V.; Rauch, Scott L.; Fava, Maurizio

    2009-01-01

    Objective Major depressive disorder (MDD) is characterized by impaired reward processing, possibly due to dysfunction in the basal ganglia. However, few neuroimaging studies of depression have distinguished between anticipatory and consummatory phases of reward processing. Using functional magnetic resonance imaging (fMRI) and a task that dissociates anticipatory and consummatory phases of reward processing, the authors tested the hypothesis that MDD participants would show reduced reward-related responses in basal ganglia structures. Method A monetary incentive delay task was presented to 30 unmedicated MDD subjects and 31 healthy comparison subjects during fMRI scanning. Whole-brain analyses focused on neural responses to reward-predicting cues and rewarding outcomes (i.e., monetary gains). Secondary analyses focused on the relationship between anhedonic symptoms and basal ganglia volumes. Results Relative to comparison subjects, MDD participants showed significantly weaker responses to gains in the left nucleus accumbens and bilateral caudate. Group differences in these regions were specific to rewarding outcomes and did not generalize to neutral or negative outcomes, although relatively reduced responses to monetary penalties in MDD emerged in other caudate regions. By contrast, evidence for group differences during reward anticipation was weaker, although MDD subjects showed reduced activation to reward cues in a small sector of the left posterior putamen. Among MDD subjects, anhedonic symptoms and depression severity were associated with reduced bilateral caudate volume. Conclusions These results indicate that basal ganglia dysfunction in MDD may affect the consummatory phase of reward processing. Additionally, morphometric results suggest that anhedonia in MDD is related to caudate volume. PMID:19411368

  7. Early interfaced neural activity from chronic amputated nerves

    Directory of Open Access Journals (Sweden)

    Kshitija Garde

    2009-05-01

    Full Text Available Direct interfacing of transected peripheral nerves with advanced robotic prosthetic devices has been proposed as a strategy for achieving natural motor control and sensory perception of such bionic substitutes, thus fully functionally replacing missing limbs in amputees. Multi-electrode arrays placed in the brain and peripheral nerves have been used successfully to convey neural control of prosthetic devices to the user. However, reactive gliosis, micro hemorrhages, axonopathy and excessive inflammation, currently limit their long-term use. Here we demonstrate that enticement of peripheral nerve regeneration through a non-obstructive multi-electrode array, after either acute or chronic nerve amputation, offers a viable alternative to obtain early neural recordings and to enhance long-term interfacing of nerve activity. Non restrictive electrode arrays placed in the path of regenerating nerve fibers allowed the recording of action potentials as early as 8 days post-implantation with high signal-to-noise ratio, as long as 3 months in some animals, and with minimal inflammation at the nerve tissue-metal electrode interface. Our findings suggest that regenerative on-dependent multi-electrode arrays of open design allow the early and stable interfacing of neural activity from amputated peripheral nerves and might contribute towards conveying full neural control and sensory feedback to users of robotic prosthetic devices. .

  8. Perception Neural Networks for Active Noise Control Systems

    Directory of Open Access Journals (Sweden)

    Wang Xiaoli

    2012-11-01

    Full Text Available In a response to a growing demand for environments of 70dB or less noise levels, many industrial sectors have focused with some form of noise control system. Active noise control (ANC has proven to be the most effective technology. This paper mainly investigates application of neural network on self-adaptation system in active noise control (ANC. An active silencing control system is made which adopts a motional feedback loudspeaker as not a noise controlling source but a detecting sensor. The working fundamentals and the characteristics of the motional feedback loudspeaker are analyzed in detail. By analyzing each acoustical path, identification based adaptive linear neural network is built. This kind of identifying method can be achieved conveniently. The estimated result of each sound channel matches well with its real sound character, respectively.

  9. Active Noise Feedback Control Using a Neural Network

    Directory of Open Access Journals (Sweden)

    Zhang Qizhi

    2001-01-01

    Full Text Available The active noise control (ANC is discussed. Many digital ANC systems often based on the filter-x algorithm for finite impulse response (FIR filter use adaptive filtering techniques. But if the primary noise path is nonlinear, the control system based on adaptive filter technology will be invalid. In this paper, an adaptive active nonlinear noise feedback control approach using a neural network is derived. The feedback control system drives a secondary signal to destructively interfere with the original noise to cut down the noise power. An on-line learning algorithm based on the error gradient descent method was proposed, and the local stability of closed loop system is proved using the discrete Lyapunov function. A nonlinear simulation example shows that the adaptive active noise feedback control method based on a neural network is very effective to the nonlinear noise control.

  10. Individual differences in the time course of reward processing: Stage-specific links with depression and impulsivity.

    Science.gov (United States)

    Novak, Brittni K; Novak, Keisha D; Lynam, Donald R; Foti, Dan

    2016-09-01

    Reward dysfunction has been implicated in a wide range of psychological disorders, including internalizing and externalizing psychopathology. Basic neuroscience research has shown that reward is a multistage process, yet it is unclear how specific stages relate to individual differences in reward sensitivity. The current study utilized event-related potentials elicited during a monetary incentive task to parse sub-stages within anticipatory and consummatory reward processing. Effects of depressive symptoms and trait impulsivity were examined at each sub-stage (N=92). Reward anticipation modulated neural activity across three sub-stages: cue detection (cue-P3), approach behavior (contingent negative variation, CNV), and outcome anticipation (stimulus preceding negativity). Reward delivery modulated activity across two sub-stages: initial evaluation (reward positivity, RewP), and allocation of attention (feedback-P3). Sensation seeking predicted faster reaction times, as well as cue-P3 and RewP amplitudes. Depression and lack of premeditation interacted to predict CNV and RewP amplitudes. Results demonstrate that individual differences in reward functioning are stage-specific.

  11. Relationships between reward sensitivity, risk-taking and family history of alcoholism during an interactive competitive fMRI task.

    Directory of Open Access Journals (Sweden)

    Haley L Yarosh

    Full Text Available BACKGROUND: Individuals with a positive family history for alcoholism (FHP have shown differences from family-history-negative (FHN individuals in the neural correlates of reward processing. FHP, compared to FHN individuals, demonstrate relatively diminished ventral striatal activation during anticipation of monetary rewards, and the degree of ventral striatal activation shows an inverse correlation with specific impulsivity measures in alcohol-dependent individuals. Rewards in socially interactive contexts relate importantly to addictive propensities, yet have not been examined with respect to how their neural underpinnings relate to impulsivity-related measures. Here we describe impulsivity measures in FHN and FHP individuals as they relate to a socially interactive functional magnetic resonance imaging (fMRI task. METHODS: Forty FHP and 29 FHN subjects without histories of Axis-I disorders completed a socially interactive Domino task during functional magnetic resonance imaging and completed self-report and behavioral impulsivity-related assessments. RESULTS: FHP compared to FHN individuals showed higher scores (p = .004 on one impulsivity-related factor relating to both compulsivity (Padua Inventory and reward/punishment sensitivity (Sensitivity to Punishment/Sensitivity to Reward Questionnaire. Multiple regression analysis within a reward-related network revealed a correlation between risk-taking (involving another impulsivity-related factor, the Balloon Analog Risk Task (BART and right ventral striatum activation under reward >punishment contrast (p<0.05 FWE corrected in the social task. CONCLUSIONS: Behavioral risk-taking scores may be more closely associated with neural correlates of reward responsiveness in socially interactive contexts than are FH status or impulsivity-related self-report measures. These findings suggest that risk-taking assessments be examined further in socially interactive settings relevant to addictive behaviors.

  12. Children with ADHD Symptoms Show Decreased Activity in Ventral Striatum during the Anticipation of Reward, Irrespective of ADHD Diagnosis

    Science.gov (United States)

    van Hulst, Branko M.; de Zeeuw, Patrick; Bos, Dienke J.; Rijks, Yvonne; Neggers, Sebastiaan F. W.; Durston, Sarah

    2017-01-01

    Background: Changes in reward processing are thought to be involved in the etiology of attention-deficit/hyperactivity disorder (ADHD), as well as other developmental disorders. In addition, different forms of therapy for ADHD rely on reinforcement principles. As such, improved understanding of reward processing in ADHD could eventually lead to…

  13. Longitudinal study of striatal activation to reward and loss anticipation from mid-adolescence into late adolescence/early adulthood.

    Science.gov (United States)

    Lamm, C; Benson, B E; Guyer, A E; Perez-Edgar, K; Fox, N A; Pine, D S; Ernst, M

    2014-08-01

    Adolescent risk-taking behavior has been associated with age-related changes in striatal activation to incentives. Previous cross-sectional studies have shown both increased and decreased striatal activation to incentives for adolescents compared to adults. The monetary incentive delay (MID) task, designed to assess functional brain activation in anticipation of reward, has been used extensively to examine striatal activation in both adult and adolescent populations. The current study used this task with a longitudinal approach across mid-adolescence and late adolescence/early adulthood. Twenty-two participants (13 male) were studied using the MID task at two time-points, once in mid-adolescence (mean age=16.11; SD=1.44) and a second time in late adolescence/early adulthood (mean age=20.14; SD=.67). Results revealed greater striatal activation with increased age in high- compared to low-incentive contexts (incentive magnitude), for gain as well as for loss trials (incentive valence). Results extend cross-sectional findings and show reduced striatal engagement in adolescence compared to adulthood during preparation for action in an incentive context.

  14. Oxytocin selectively facilitates learning with social feedback and increases activity and functional connectivity in emotional memory and reward processing regions.

    Science.gov (United States)

    Hu, Jiehui; Qi, Song; Becker, Benjamin; Luo, Lizhu; Gao, Shan; Gong, Qiyong; Hurlemann, René; Kendrick, Keith M

    2015-06-01

    In male Caucasian subjects, learning is facilitated by receipt of social compared with non-social feedback, and the neuropeptide oxytocin (OXT) facilitates this effect. In this study, we have first shown a cultural difference in that male Chinese subjects actually perform significantly worse in the same reinforcement associated learning task with social (emotional faces) compared with non-social feedback. Nevertheless, in two independent double-blind placebo (PLC) controlled between-subject design experiments we found OXT still selectively facilitated learning with social feedback. Similar to Caucasian subjects this OXT effect was strongest with feedback using female rather than male faces. One experiment performed in conjunction with functional magnetic resonance imaging showed that during the response, but not feedback phase of the task, OXT selectively increased activity in the amygdala, hippocampus, parahippocampal gyrus and putamen during the social feedback condition, and functional connectivity between the amygdala and insula and caudate. Therefore, OXT may be increasing the salience and reward value of anticipated social feedback. In the PLC group, response times and state anxiety scores during social feedback were associated with signal changes in these same regions but not in the OXT group. OXT may therefore have also facilitated learning by reducing anxiety in the social feedback condition. Overall our results provide the first evidence for cultural differences in social facilitation of learning per se, but a similar selective enhancement of learning with social feedback under OXT. This effect of OXT may be associated with enhanced responses and functional connectivity in emotional memory and reward processing regions.

  15. Early Years Education: Are Young Students Intrinsically or Extrinsically Motivated Towards School Activities? A Discussion about the Effects of Rewards on Young Children's Learning

    Science.gov (United States)

    Theodotou, Evgenia

    2014-01-01

    Rewards can reinforce and at the same time forestall young children's willingness to learn. However, they are broadly used in the field of education, especially in early years settings, to stimulate children towards learning activities. This paper reviews the theoretical and research literature related to intrinsic and extrinsic motivational…

  16. Persistent activity in neural networks with dynamic synapses.

    Directory of Open Access Journals (Sweden)

    Omri Barak

    2007-02-01

    Full Text Available Persistent activity states (attractors, observed in several neocortical areas after the removal of a sensory stimulus, are believed to be the neuronal basis of working memory. One of the possible mechanisms that can underlie persistent activity is recurrent excitation mediated by intracortical synaptic connections. A recent experimental study revealed that connections between pyramidal cells in prefrontal cortex exhibit various degrees of synaptic depression and facilitation. Here we analyze the effect of synaptic dynamics on the emergence and persistence of attractor states in interconnected neural networks. We show that different combinations of synaptic depression and facilitation result in qualitatively different network dynamics with respect to the emergence of the attractor states. This analysis raises the possibility that the framework of attractor neural networks can be extended to represent time-dependent stimuli.

  17. Activated sludge process based on artificial neural network

    Institute of Scientific and Technical Information of China (English)

    张文艺; 蔡建安

    2002-01-01

    Considering the difficulty of creating water quality model for activated sludge system, a typical BP artificial neural network model has been established to simulate the operation of a waste water treatment facilities. The comparison of prediction results with the on-spot measurements shows the model, the model is accurate and this model can also be used to realize intelligentized on-line control of the wastewater processing process.

  18. Rewards and punishments, goal-directed behavior and consciousness.

    Science.gov (United States)

    Ressler, Newton

    2004-03-01

    A parsimonious account of consciousness is given in which it emerges as a direct consequence of basic neural processes without the necessity of any higher order system. In this model, pleasant or unpleasant conscious feelings of various stimuli in the environment stem from their higher order associations to innate rewards or punishments. When a conditioned stimulus (CS) is associated with a reward, it acquires pleasant feelings due to the temporal correlation of the activations representing its sensory features with those representing innate visceral reward acquisition processes. When the CS is associated with the punishment, it acquires unpleasant feelings due to the correlation of its sensory features with the innate visceral inhibition of punishment acquisition processes. The correlations involve coherent activity between the sensory cortex, the limbic system, the orbital and medial prefrontal cortex, and more lateral prefrontal areas where stimuli can be incorporated into working memory. A conscious act involves responses (or attempts to improve the environment) made on the basis of the feelings of such stimuli. Covert memory scans, in which comparisons are made of the reward and punishment associations of the outcomes of previous responses, are related to the motivations and attention behind the conscious selection of a current response. This model appears to fit together various empirical observations. Its relations to some higher or more abstract mental processes, and some evolutionary implications are discussed.

  19. The role of reward in word learning and its implications for language acquisition.

    Science.gov (United States)

    Ripollés, Pablo; Marco-Pallarés, Josep; Hielscher, Ulrike; Mestres-Missé, Anna; Tempelmann, Claus; Heinze, Hans-Jochen; Rodríguez-Fornells, Antoni; Noesselt, Toemme

    2014-11-03

    The exact neural processes behind humans' drive to acquire a new language--first as infants and later as second-language learners--are yet to be established. Recent theoretical models have proposed that during human evolution, emerging language-learning mechanisms might have been glued to phylogenetically older subcortical reward systems, reinforcing human motivation to learn a new language. Supporting this hypothesis, our results showed that adult participants exhibited robust fMRI activation in the ventral striatum (VS)--a core region of reward processing--when successfully learning the meaning of new words. This activation was similar to the VS recruitment elicited using an independent reward task. Moreover, the VS showed enhanced functional and structural connectivity with neocortical language areas during successful word learning. Together, our results provide evidence for the neural substrate of reward and motivation during word learning. We suggest that this strong functional and anatomical coupling between neocortical language regions and the subcortical reward system provided a crucial advantage in humans that eventually enabled our lineage to successfully acquire linguistic skills.

  20. Functional changes of the reward system underlie blunted response to social gaze in cocaine users.

    Science.gov (United States)

    Preller, Katrin H; Herdener, Marcus; Schilbach, Leonhard; Stämpfli, Philipp; Hulka, Lea M; Vonmoos, Matthias; Ingold, Nina; Vogeley, Kai; Tobler, Philippe N; Seifritz, Erich; Quednow, Boris B

    2014-02-18

    Social interaction deficits in drug users likely impede treatment, increase the burden of the affected families, and consequently contribute to the high costs for society associated with addiction. Despite its significance, the neural basis of altered social interaction in drug users is currently unknown. Therefore, we investigated basal social gaze behavior in cocaine users by applying behavioral, psychophysiological, and functional brain-imaging methods. In study I, 80 regular cocaine users and 63 healthy controls completed an interactive paradigm in which the participants' gaze was recorded by an eye-tracking device that controlled the gaze of an anthropomorphic virtual character. Valence ratings of different eye-contact conditions revealed that cocaine users show diminished emotional engagement in social interaction, which was also supported by reduced pupil responses. Study II investigated the neural underpinnings of changes in social reward processing observed in study I. Sixteen cocaine users and 16 controls completed a similar interaction paradigm as used in study I while undergoing functional magnetic resonance imaging. In response to social interaction, cocaine users displayed decreased activation of the medial orbitofrontal cortex, a key region of reward processing. Moreover, blunted activation of the medial orbitofrontal cortex was significantly correlated with a decreased social network size, reflecting problems in real-life social behavior because of reduced social reward. In conclusion, basic social interaction deficits in cocaine users as observed here may arise from altered social reward processing. Consequently, these results point to the importance of reinstatement of social reward in the treatment of stimulant addiction.

  1. Imbalanced functional link between reward circuits and the cognitive control system in patients with obsessive-compulsive disorder.

    Science.gov (United States)

    Xie, Chunming; Ma, Lisha; Jiang, Nan; Huang, Ruyan; Li, Li; Gong, Liang; He, Cancan; Xiao, Chaoyong; Liu, Wen; Xu, Shu; Zhang, Zhijun

    2016-08-23

    Altered reward processing and cognitive deficits are often observed in patients with obsessive-compulsive disorder (OCD); however, whether the imbalance in activity between reward circuits and the cognitive control (CC) system is associated with compulsive behavior remains unknown. Sixty-eight OCD patients and 33 cognitively normal (CN) healthy subjects participated in this resting-state functional magnetic resonance imaging study. Alterations in the functional connectivity between reward circuits and the CC system were quantitatively assessed and compared between the groups. A Granger causality analysis was used to determine the causal informational influence between and within reward circuits and the CC system across all subjects. OCD patients showed a dichotomous pattern of enhanced functional coupling in their reward circuits and a weakened functional coupling in their CC system when compared to CN subjects. Neural correlates of compulsive behavior were primarily located in the reward circuits and CC system in OCD patients. Importantly, the CC system exerted a reduced interregional causal influence over the reward system in OCD patients relative to its effect in CN subjects. The limitations of this study are that it was a cross-sectional study and the potential effects of environmental and genetic factors were not explored. OCD patients showed an imbalance in the functional link between reward circuits and the CC system at rest. This bias toward a loss of control may define a pathological state in which subjects are more vulnerable to engaging in compulsive behaviors.

  2. Age-related changes in midbrain dopaminergic regulation of the human reward system

    Science.gov (United States)

    Dreher, Jean-Claude; Meyer-Lindenberg, Andreas; Kohn, Philip; Berman, Karen Faith

    2008-01-01

    The dopamine system, which plays a crucial role in reward processing, is particularly vulnerable to aging. Significant losses over a normal lifespan have been reported for dopamine receptors and transporters, but very little is known about the neurofunctional consequences of this age-related dopaminergic decline. In animals, a substantial body of data indicates that dopamine activity in the midbrain is tightly associated with reward processing. In humans, although indirect evidence from pharmacological and clinical studies also supports such an association, there has been no direct demonstration of a link between midbrain dopamine and reward-related neural response. Moreover, there are no in vivo data for alterations in this relationship in older humans. Here, by using 6-[18F]FluoroDOPA (FDOPA) positron emission tomography (PET) and event-related 3T functional magnetic resonance imaging (fMRI) in the same subjects, we directly demonstrate a link between midbrain dopamine synthesis and reward-related prefrontal activity in humans, show that healthy aging induces functional alterations in the reward system, and identify an age-related change in the direction of the relationship (from a positive to a negative correlation) between midbrain dopamine synthesis and prefrontal activity. These results indicate an age-dependent dopaminergic tuning mechanism for cortical reward processing and provide system-level information about alteration of a key neural circuit in healthy aging. Taken together, our findings provide an important characterization of the interactions between midbrain dopamine function and the reward system in healthy young humans and older subjects, and identify the changes in this regulatory circuit that accompany aging. PMID:18794529

  3. Brain structure and neural network of the reward/loss process in decision making%决策奖损加工的脑神经结构与环路

    Institute of Scientific and Technical Information of China (English)

    魏巍; 郭宗君

    2015-01-01

    目的 以国内外2005~2014年发表的针对与决策机制有关的关于奖赏、损失的神经结构及环路,及其与某些身心疾病关系的文献,综述决策奖损加工的脑神经结构及其意义,可以在一定程度上揭示行为决策的神经结构和网络机制,及其与某些身心疾病的关系.方法 2014年9月在PubMed、Science-Direct、中国知网和万方数据库等数据库,以“决策”、“奖赏”、“损失规避”等检索词,检索国内外有关决策奖损加工相关脑神经结构,及其与某些身心疾病的关系的研究.结果 检索文献110篇,纳入分析40篇.结果总结了大脑奖损结构及其关系在决策加工过程中的作用机制,以及两系统失衡所导致的身心疾病.结论 大部分文献认为奖赏趋近系统和损失规避系统的协调加工共同影响人们的行为决策,一旦上述系统平衡失调,则可出现行为决策障碍,产生一些身心疾病,但与决策行为模式相关的精确的神经机制尚须进一步研究.%Objective Based on the literatures published between 2005 and 2014,review the correlation between reward/loss of brain structure and neural network,and its relationship with physical and mental ailments,aim to reveal the neural structure and network of behavioral decision mechanism.Methods By retrieving literatures on PubMed,ScienceDirect,CNKI and Wanfang database in September 2014,we used "decision making","reward","loss aversion" and so on as the key words.Results Totally 40 papers were enrolled,the result reviewed the clinic meaning and the brain structure and neural network of the reward/loss process in decision making.Conclusion Most studies found the reward/loss decision making mechanism of the brain structure and the physical and mental ailments caused by the two systems imbalance,but related to the precise decision making neural mechanism has yet to be studied further.

  4. Involvement of μ- and δ-opioid receptor function in the rewarding effect of (±)-pentazocine.

    Science.gov (United States)

    Mori, Tomohisa; Itoh, Toshimasa; Yoshizawa, Kazumi; Ise, Yuya; Mizuo, Keisuke; Saeki, Tomoya; Komiya, Sachiko; Masukawa, Daiki; Shibasaki, Masahiro; Suzuki, Tsutomu

    2015-07-01

    Most opioid receptor agonists have abuse potential, and the rewarding effects of opioids can be reduced in the presence of pain. While each of the enantiomers of pentazocine has a differential pharmacologic profile, (±)-pentazocine has been used clinically for the treatment of pain. However, little information is available regarding which components of pentazocine are associated with its rewarding effects, and whether the (±)-pentazocine-induced rewarding effects can be suppressed under pain. Therefore, the present study was performed to investigate the effects of pain on the acquisition of the rewarding effects of (±)-pentazocine, and to examine the mechanism of the rewarding effects of (±)-pentazocine using the conditioned place preference paradigm. (±)-Pentazocine and (-)-pentazocine, but not (+)-pentazocine, produced significant rewarding effects. Even though the rewarding effects induced by (±)-pentazocine were significantly suppressed under pain induced by formalin, accompanied by increase of preprodynorphin mRNA levels in the nucleus accumbens, a high dose of (±)-pentazocine produced significant rewarding effects under pain. In the normal condition, (±)-pentazocine-induced rewarding effects were blocked by a low dose of naloxone, whereas the rewarding effects induced by high doses of pentazocine under pain were suppressed by naltrindole (a δ-opioid receptor antagonist). Interestingly, (±)-pentazocine did not significantly affect dopamine levels in the nucleus accumbens. These findings suggest that the rewarding effects of (-)-pentazocine may contribute to the abuse potential of (±)-pentazocine through μ- as well as δ-opioid receptors, without robust activation of the mesolimbic dopaminergic system. We also found that neural adaptations can reduce the abuse potential of (±)-pentazocine under pain.

  5. Multiview fusion for activity recognition using deep neural networks

    Science.gov (United States)

    Kavi, Rahul; Kulathumani, Vinod; Rohit, Fnu; Kecojevic, Vlad

    2016-07-01

    Convolutional neural networks (ConvNets) coupled with long short term memory (LSTM) networks have been recently shown to be effective for video classification as they combine the automatic feature extraction capabilities of a neural network with additional memory in the temporal domain. This paper shows how multiview fusion can be applied to such a ConvNet LSTM architecture. Two different fusion techniques are presented. The system is first evaluated in the context of a driver activity recognition system using data collected in a multicamera driving simulator. These results show significant improvement in accuracy with multiview fusion and also show that deep learning performs better than a traditional approach using spatiotemporal features even without requiring any background subtraction. The system is also validated on another publicly available multiview action recognition dataset that has 12 action classes and 8 camera views.

  6. Adolescent development of the reward system

    Directory of Open Access Journals (Sweden)

    Adriana Galván

    2010-02-01

    Full Text Available Adolescence is a developmental period characterized by increased reward-seeking behavior. Investigators have used functional magnetic resonance imaging (fMRI in conjunction with reward paradigms to test two opposing hypotheses about adolescent developmental changes in the striatum, a region implicated in reward processing. One hypothesis posits that the striatum is relatively hypo-responsive to rewards during adolescence, such that heightened reward-seeking behavior is necessary to achieve the same activation as adults. Another view suggests that during adolescence the striatal reward system is hyper-responsive, which subsequently results in greater reward-seeking. While evidence for both hypotheses has been reported, the field has generally converged on this latter hypothesis based on compelling evidence. In this review, I describe the evidence to support this notion, speculate on the disparate fMRI findings and conclude with future areas of inquiry to this fascinating question.

  7. A neural network model for olfactory glomerular activity prediction

    Science.gov (United States)

    Soh, Zu; Tsuji, Toshio; Takiguchi, Noboru; Ohtake, Hisao

    2012-12-01

    Recently, the importance of odors and methods for their evaluation have seen increased emphasis, especially in the fragrance and food industries. Although odors can be characterized by their odorant components, their chemical information cannot be directly related to the flavors we perceive. Biological research has revealed that neuronal activity related to glomeruli (which form part of the olfactory system) is closely connected to odor qualities. Here we report on a neural network model of the olfactory system that can predict glomerular activity from odorant molecule structures. We also report on the learning and prediction ability of the proposed model.

  8. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Science.gov (United States)

    Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

    2015-01-01

    Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.

  9. The Rewards of Learning.

    Science.gov (United States)

    Chance, Paul

    1992-01-01

    Although intrinsic rewards are important, they (along with punishment and encouragement) are insufficient for efficient learning. Teachers must supplement intrinsic rewards with extrinsic rewards, such as praising, complimenting, applauding, and providing other forms of recognition for good work. Teachers should use the weakest reward required to…

  10. Impaired cross-talk between mesolimbic food reward processing and metabolic signaling predicts body mass index

    Directory of Open Access Journals (Sweden)

    Joe J Simon

    2014-10-01

    Full Text Available The anticipation of the pleasure derived from food intake drives the motivation to eat, and hence facilitate overconsumption of food which ultimately results in obesity. Brain imaging studies provide evidence that mesolimbic brain regions underlie both general as well as food related anticipatory reward processing. In light of this knowledge, the present study examined the neural responsiveness of the ventral striatum in participants with a broad BMI spectrum. The study differentiated between general (i.e. monetary and food related anticipatory reward processing. We recruited a sample of volunteers with greatly varying body weights, ranging from a low BMI (below 20 kg/m² over a normal (20 to 25 kg/m² and overweight (25 to 30 kg/m² BMI, to class I (30 to 35 kg/m² and class II (35 to 40 kg/m² obesity. A total of 24 participants underwent functional magnetic resonance imaging whilst performing both a food and monetary incentive delay task, which allows to measure neural activation during the anticipation of rewards. After the presentation of a cue indicating the amount of food or money to be won, participants had to react correctly in order to earn snack points or money coins which could then be exchanged for real food or money, respectively, at the end of the experiment. During the anticipation of both types of rewards, participants displayed activity in the ventral striatum, a region that plays a pivotal role in the anticipation of rewards. Additionally, we observed that specifically anticipatory food reward processing predicted the individual BMI (current and maximum lifetime. This relation was found to be mediated by impaired hormonal satiety signaling, i.e. increased leptin levels and insulin resistance. These findings suggest that heightened food reward motivation contributes to obesity through impaired metabolic signaling.

  11. Motor neuron activation in peripheral nerves using infrared neural stimulation

    Science.gov (United States)

    Peterson, E. J.; Tyler, D. J.

    2014-02-01

    Objective. Localized activation of peripheral axons may improve selectivity of peripheral nerve interfaces. Infrared neural stimulation (INS) employs localized delivery to activate neural tissue. This study investigated INS to determine whether localized delivery limited functionality in larger mammalian nerves. Approach. The rabbit sciatic nerve was stimulated extraneurally with 1875 nm wavelength infrared light, electrical stimulation, or a combination of both. Infrared-sensitive regions (ISR) of the nerve surface and electromyogram (EMG) recruitment of the Medial Gastrocnemius, Lateral Gastrocnemius, Soleus, and Tibialis Anterior were the primary output measures. Stimulation applied included infrared-only, electrical-only, and combined infrared and electrical. Main results. 81% of nerves tested were sensitive to INS, with 1.7 ± 0.5 ISR detected per nerve. INS was selective to a single muscle within 81% of identified ISR. Activation energy threshold did not change significantly with stimulus power, but motor activation decreased significantly when radiant power was decreased. Maximum INS levels typically recruited up to 2-9% of any muscle. Combined infrared and electrical stimulation differed significantly from electrical recruitment in 7% of cases. Significance. The observed selectivity of INS indicates that it may be useful in augmenting rehabilitation, but significant challenges remain in increasing sensitivity and response magnitude to improve the functionality of INS.

  12. The effects of reward magnitude on reward processing: An averaged and single trial event-related potential study.

    Science.gov (United States)

    Meadows, Caroline C; Gable, Philip A; Lohse, Keith R; Miller, Matthew W

    2016-07-01

    From a neurobiological and motivational perspective, the feedback-related negativity (FRN) and reward positivity (RewP) event-related potential (ERP) components should increase with reward magnitude (reward associated with valence (success/failure) feedback). To test this hypothesis, we recorded participants' electroencephalograms while presenting them with potential monetary rewards ($0.00-$4.96) pre-trial for each trial of a reaction time task and presenting them with valence feedback post-trial. Averaged ERPs time-locked to valence feedback were extracted, and results revealed a valence by magnitude interaction for neural activity in the FRN/RewP time window. This interaction was driven by magnitude affecting RewP, but not FRN, amplitude. Moreover, single trial ERP analyses revealed a reliable correlation between magnitude and RewP, but not FRN, amplitude. Finally, P3b and late positive potential (LPP) amplitudes were affected by magnitude. Results partly support the neurobiological (dopamine) account of the FRN/RewP and suggest motivation affects feedback processing, as indicated by multiple ERP components.

  13. Supervised learning for neural manifold using spatiotemporal brain activity

    Science.gov (United States)

    Kuo, Po-Chih; Chen, Yong-Sheng; Chen, Li-Fen

    2015-12-01

    Objective. Determining the means by which perceived stimuli are compactly represented in the human brain is a difficult task. This study aimed to develop techniques for the construction of the neural manifold as a representation of visual stimuli. Approach. We propose a supervised locally linear embedding method to construct the embedded manifold from brain activity, taking into account similarities between corresponding stimuli. In our experiments, photographic portraits were used as visual stimuli and brain activity was calculated from magnetoencephalographic data using a source localization method. Main results. The results of 10 × 10-fold cross-validation revealed a strong correlation between manifolds of brain activity and the orientation of faces in the presented images, suggesting that high-level information related to image content can be revealed in the brain responses represented in the manifold. Significance. Our experiments demonstrate that the proposed method is applicable to investigation into the inherent patterns of brain activity.

  14. Understanding Crowdsourcing: Effects of motivation and rewards on participation and performance in voluntary online activities

    NARCIS (Netherlands)

    W.A.M. Borst (Irma)

    2010-01-01

    textabstractCompanies increasingly outsource activities to volunteers that they approach via an open call on the internet. The phenomenon is called ‘crowdsourcing’. For an effective use of crowdsourcing it is important to understand what motivated these online volunteers and what is the influence of

  15. A GABAergic Projection from the Centromedial Nuclei of the Amygdala to Ventromedial Prefrontal Cortex Modulates Reward Behavior.

    Science.gov (United States)

    Seo, Dong-Oh; Funderburk, Samuel C; Bhatti, Dionnet L; Motard, Laura E; Newbold, Dillan; Girven, Kasey S; McCall, Jordan G; Krashes, Michael; Sparta, Dennis R; Bruchas, Michael R

    2016-10-19

    The neural circuitry underlying mammalian reward behaviors involves several distinct nuclei throughout the brain. It is widely accepted that the midbrain dopamine (DA) neurons are critical for the reward-related behaviors. Recent studies have shown that the centromedial nucleus of the amygdala (CeMA) has a distinct role in regulating reward-related behaviors. However, the CeMA and ventromedial PFC (vmPFC) interaction in reward regulation remains poorly understood. Here, we identify and dissect a GABAergic projection that originates in the CeMA and terminates in the vmPFC (VGat-Cre(CeMA-vmPFC)) using viral-vector-mediated, cell-type-specific optogenetic techniques in mice. Pathway-specific optogenetic activation of the VGat-Cre(CeMA-vmPFC) circuit in awake, behaving animals produced a positive, reward-like phenotype in real-time place preference and increased locomotor activity in open-field testing. In sucrose operant conditioning, the photoactivation of these terminals increased nose-poking effort with no effect on licking behavior and robustly facilitated the extinction of operant behavior. However, photoactivation of these terminals did not induce self-stimulation in the absence of an external reward. The results described here suggest that the VGat-Cre(CeMA-vmPFC) projection acts to modulate existing reward-related behaviors.

  16. Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area

    Directory of Open Access Journals (Sweden)

    Julien eVitay

    2014-01-01

    Full Text Available Neural activity in dopaminergic areas such as the ventral tegmental area is influenced by timing processes, in particular by the temporal expectation of rewards during Pavlovian conditioning. Receipt of a reward at the expected time allows to compute reward-prediction errors which can drive learning in motor or cognitive structures. Reciprocally, dopamine plays an important role in the timing of external events. Several models of the dopaminergic system exist, but the substrate of temporal learning is rather unclear. In this article, we propose a neuro-computational model of the afferent network to the ventral tegmental area, including the lateral hypothalamus, the pedunculopontine nucleus, the amygdala, the ventromedial prefrontal cortex, the ventral basal ganglia (including the nucleus accumbens and the ventral pallidum, as well as the lateral habenula and the rostromedial tegmental nucleus. Based on a plausible connectivity and realistic learning rules, this neuro-computational model reproduces several experimental observations, such as the progressive cancellation of dopaminergic bursts at reward delivery, the appearance of bursts at the onset of reward-predicting cues or the influence of reward magnitude on activity in the amygdala and ventral tegmental area. While associative learning occurs primarily in the amygdala, learning of the temporal relationship between the cue and the associated reward is implemented as a dopamine-modulated coincidence detection mechanism in the nucleus accumbens.

  17. Estimation of spatiotemporal neural activity using radial basis function networks.

    Science.gov (United States)

    Anderson, R W; Das, S; Keller, E L

    1998-12-01

    We report a method using radial basis function (RBF) networks to estimate the time evolution of population activity in topologically organized neural structures from single-neuron recordings. This is an important problem in neuroscience research, as such estimates may provide insights into systems-level function of these structures. Since single-unit neural data tends to be unevenly sampled and highly variable under similar behavioral conditions, obtaining such estimates is a difficult task. In particular, a class of cells in the superior colliculus called buildup neurons can have very narrow regions of saccade vectors for which they discharge at high rates but very large surround regions over which they discharge at low, but not zero, levels. Estimating the dynamic movement fields for these cells for two spatial dimensions at closely spaced timed intervals is a difficult problem, and no general method has been described that can be applied to all buildup cells. Estimation of individual collicular cells' spatiotemporal movement fields is a prerequisite for obtaining reliable two-dimensional estimates of the population activity on the collicular motor map during saccades. Therefore, we have developed several computational-geometry-based algorithms that regularize the data before computing a surface estimation using RBF networks. The method is then expanded to the problem of estimating simultaneous spatiotemporal activity occurring across the superior colliculus during a single movement (the inverse problem). In principle, this methodology could be applied to any neural structure with a regular, two-dimensional organization, provided a sufficient spatial distribution of sampled neurons is available.

  18. Multifractal detrended fluctuation analysis of optogenetic modulation of neural activity

    Science.gov (United States)

    Kumar, S.; Gu, L.; Ghosh, N.; Mohanty, S. K.

    2013-02-01

    Here, we introduce a computational procedure to examine whether optogenetically activated neuronal firing recordings could be characterized as multifractal series. Optogenetics is emerging as a valuable experimental tool and a promising approach for studying a variety of neurological disorders in animal models. The spiking patterns from cortical region of the brain of optogenetically-stimulated transgenic mice were analyzed using a sophisticated fluctuation analysis method known as multifractal detrended fluctuation analysis (MFDFA). We observed that the optogenetically-stimulated neural firings are consistent with a multifractal process. Further, we used MFDFA to monitor the effect of chemically induced pain (formalin injection) and optogenetic treatment used to relieve the pain. In this case, dramatic changes in parameters characterizing a multifractal series were observed. Both the generalized Hurst exponent and width of singularity spectrum effectively differentiates the neural activities during control and pain induction phases. The quantitative nature of the analysis equips us with better measures to quantify pain. Further, it provided a measure for effectiveness of the optogenetic stimulation in inhibiting pain. MFDFA-analysis of spiking data from other deep regions of the brain also turned out to be multifractal in nature, with subtle differences in the parameters during pain-induction by formalin injection and inhibition by optogenetic stimulation. Characterization of neuronal firing patterns using MFDFA will lead to better understanding of neuronal response to optogenetic activation and overall circuitry involved in the process.

  19. Endocannabinoid signaling in reward and addiction

    OpenAIRE

    Parsons, Loren H.; Hurd, Yasmin L.

    2015-01-01

    Brain endocannabinoid signaling influences the motivation for natural rewards (such as palatable food, sexual activity and social interaction) and modulates the rewarding effects of addictive drugs. Pathological forms of natural and drug-induced reward are associated with dysregulated endocannabinoid signaling that may derive from pre-existing genetic factors or from prolonged drug exposure. Impaired endocannabinoid signaling contributes to dysregulated synaptic plasticity, increased stress r...

  20. Individual Differences in Music Reward Experiences

    OpenAIRE

    Mas-Herrero, E.; Marco Pallarés, Josep; Lorenzo-Seva, U.; Zatorre, R.; Rodriguez-Fornells, A.

    2013-01-01

    Music is one of the most pleasant human experiences, even though it has no direct biological advantage. However little is known about individual differences in how people experience reward in music-related activities. The goal of the present study was to describe the main facets of music experience that could explain the variance observed in how people experience reward associated with music. To this end we developed the Barcelona Music Reward Questionnaire (BMRQ), which was administrated to ...

  1. Classification of the extracellular fields produced by activated neural structures

    Directory of Open Access Journals (Sweden)

    Perry Danielle

    2005-09-01

    Full Text Available Abstract Background Classifying the types of extracellular potentials recorded when neural structures are activated is an important component in understanding nerve pathophysiology. Varying definitions and approaches to understanding the factors that influence the potentials recorded during neural activity have made this issue complex. Methods In this article, many of the factors which influence the distribution of electric potential produced by a traveling action potential are discussed from a theoretical standpoint with illustrative simulations. Results For an axon of arbitrary shape, it is shown that a quadrupolar potential is generated by action potentials traveling along a straight axon. However, a dipole moment is generated at any point where an axon bends or its diameter changes. Next, it is shown how asymmetric disturbances in the conductivity of the medium surrounding an axon produce dipolar potentials, even during propagation along a straight axon. Next, by studying the electric fields generated by a dipole source in an insulating cylinder, it is shown that in finite volume conductors, the extracellular potentials can be very different from those in infinite volume conductors. Finally, the effects of impulses propagating along axons with inhomogeneous cable properties are analyzed. Conclusion Because of the well-defined factors affecting extracellular potentials, the vague terms far-field and near-field potentials should be abandoned in favor of more accurate descriptions of the potentials.

  2. Pharmacological differentiation of opioid receptor antagonists by molecular and functional imaging of target occupancy and food reward-related brain activation in humans.

    Science.gov (United States)

    Rabiner, E A; Beaver, J; Makwana, A; Searle, G; Long, C; Nathan, P J; Newbould, R D; Howard, J; Miller, S R; Bush, M A; Hill, S; Reiley, R; Passchier, J; Gunn, R N; Matthews, P M; Bullmore, E T

    2011-08-01

    Opioid neurotransmission has a key role in mediating reward-related behaviours. Opioid receptor (OR) antagonists, such as naltrexone (NTX), can attenuate the behaviour-reinforcing effects of primary (food) and secondary rewards. GSK1521498 is a novel OR ligand, which behaves as an inverse agonist at the μ-OR sub-type. In a sample of healthy volunteers, we used [(11)C]-carfentanil positron emission tomography to measure the OR occupancy and functional magnetic resonance imaging (fMRI) to measure activation of brain reward centres by palatable food stimuli before and after single oral doses of GSK1521498 (range, 0.4-100 mg) or NTX (range, 2-50 mg). GSK1521498 had high affinity for human brain ORs (GSK1521498 effective concentration 50 = 7.10 ng ml(-1)) and there was a direct relationship between receptor occupancy (RO) and plasma concentrations of GSK1521498. However, for both NTX and its principal active metabolite in humans, 6-β-NTX, this relationship was indirect. GSK1521498, but not NTX, significantly attenuated the fMRI activation of the amygdala by a palatable food stimulus. We thus have shown how the pharmacological properties of OR antagonists can be characterised directly in humans by a novel integration of molecular and functional neuroimaging techniques. GSK1521498 was differentiated from NTX in terms of its pharmacokinetics, target affinity, plasma concentration-RO relationships and pharmacodynamic effects on food reward processing in the brain. Pharmacological differentiation of these molecules suggests that they may have different therapeutic profiles for treatment of overeating and other disorders of compulsive consumption.

  3. Dopamine Signaling in reward-related behaviors

    Directory of Open Access Journals (Sweden)

    Ja-Hyun eBaik

    2013-10-01

    Full Text Available Dopamine (DA regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DAmesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural rewards such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

  4. Dopamine signaling in reward-related behaviors.

    Science.gov (United States)

    Baik, Ja-Hyun

    2013-01-01

    Dopamine (DA) regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DA mesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural reward such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

  5. Task-dependent modulation of oscillatory neural activity during movements

    DEFF Research Database (Denmark)

    Herz, D. M.; Christensen, M. S.; Reck, C.

    2011-01-01

    Neural oscillations in different frequency bands have been observed in a range of sensorimotor tasks and have been linked to coupling of spatially distinct neurons. The goal of this study was to detect a general motor network that is activated during phasic and tonic movements and to study the task......-dependent modulation of frequency coupling within this network. To this end we recorded 122-multichannel EEG in 13 healthy subjects while they performed three simple motor tasks. EEG data source modeling using individual MR images was carried out with a multiple source beamformer approach. A bilateral motor network...... connecting frontal, cerebellar and central motor regions, was consistently activated throughout the motor tasks. Quantification of observed spectral responses using dynamic causal modeling revealed strong coupling in the c-band (30–48 Hz) between frontal and central motor regions when a slow finger movement...

  6. The neural basis of following advice.

    Directory of Open Access Journals (Sweden)

    Guido Biele

    2011-06-01

    Full Text Available Learning by following explicit advice is fundamental for human cultural evolution, yet the neurobiology of adaptive social learning is largely unknown. Here, we used simulations to analyze the adaptive value of social learning mechanisms, computational modeling of behavioral data to describe cognitive mechanisms involved in social learning, and model-based functional magnetic resonance imaging (fMRI to identify the neurobiological basis of following advice. One-time advice received before learning had a sustained influence on people's learning processes. This was best explained by social learning mechanisms implementing a more positive evaluation of the outcomes from recommended options. Computer simulations showed that this "outcome-bonus" accumulates more rewards than an alternative mechanism implementing higher initial reward expectation for recommended options. fMRI results revealed a neural outcome-bonus signal in the septal area and the left caudate. This neural signal coded rewards in the absence of advice, and crucially, it signaled greater positive rewards for positive and negative feedback after recommended rather than after non-recommended choices. Hence, our results indicate that following advice is intrinsically rewarding. A positive correlation between the model's outcome-bonus parameter and amygdala activity after positive feedback directly relates the computational model to brain activity. These results advance the understanding of social learning by providing a neurobiological account for adaptive learning from advice.

  7. Endogenous GLP-1 mediates postprandial reductions in activation in central reward and satiety areas in patients with type 2 diabetes

    DEFF Research Database (Denmark)

    Ten Kulve, Jennifer S; Veltman, Dick J; van Bloemendaal, Liselotte

    2015-01-01

    that endogenous GLP-1 has effects on CNS reward and satiety circuits. Methods This was a randomised, crossover, placebo-controlled intervention study, performed in a university medical centre in the Netherlands. We included patients with type 2 diabetes and healthy lean control subjects. Individuals were eligible...

  8. Social decisions affect neural activity to perceived dynamic gaze.

    Science.gov (United States)

    Latinus, Marianne; Love, Scott A; Rossi, Alejandra; Parada, Francisco J; Huang, Lisa; Conty, Laurence; George, Nathalie; James, Karin; Puce, Aina

    2015-11-01

    Gaze direction, a cue of both social and spatial attention, is known to modulate early neural responses to faces e.g. N170. However, findings in the literature have been inconsistent, likely reflecting differences in stimulus characteristics and task requirements. Here, we investigated the effect of task on neural responses to dynamic gaze changes: away and toward transitions (resulting or not in eye contact). Subjects performed, in random order, social (away/toward them) and non-social (left/right) judgment tasks on these stimuli. Overall, in the non-social task, results showed a larger N170 to gaze aversion than gaze motion toward the observer. In the social task, however, this difference was no longer present in the right hemisphere, likely reflecting an enhanced N170 to gaze motion toward the observer. Our behavioral and event-related potential data indicate that performing social judgments enhances saliency of gaze motion toward the observer, even those that did not result in gaze contact. These data and that of previous studies suggest two modes of processing visual information: a 'default mode' that may focus on spatial information; a 'socially aware mode' that might be activated when subjects are required to make social judgments. The exact mechanism that allows switching from one mode to the other remains to be clarified.

  9. Dyadic social interaction as an alternative reward to cocaine

    Directory of Open Access Journals (Sweden)

    Gerald eZernig

    2013-09-01

    Full Text Available Individuals suffering from substance use disorders often show severely impaired social interaction, preferring drugs of abuse to the contact with others. Their impaired social interaction is doubly harmful for them as (1 therapy itself is based and dependent on social interaction and as (2 social interaction is not available to them as an "alternative", i.e., non-drug reward, decreasing their motivation to stop drug use. We therefore developed an animal experimental model to investigate the neurobiology of dyadic social interaction- vs cocaine reward. We took care to avoid (a engaging sexual attraction-related aspects of such a social interaction and (b hierarchical difference as confounding stimuli. The cocaine- or social interaction stimulus was offered - in a mutually exclusive setting - within the confines of a conditioned place preference (CPP apparatus. In our paradigm, only four 15-min episodes of social interaction proved sufficient to (i switch the rats' preference from cocaine-associated contextual stimuli to social interaction CPP and (ii inhibit the subsequent reacquisition/reexpression of cocaine CPP. The behavioral effect was paralleled by a reversal of brain activation (i.e., EGR1 expression in the nucleus accumbens, the central and basolateral amygdala, and the ventral tegmental area. Of relevance for the psychotherapy of addictive disorders, the most rewarding sensory component of the composite stimulus 'social interaction' was touch. To test our hypothesis that motivation is encoded in neuron ensembles dedicated to specific reward scenarios, we are currently (1 mapping the neural circuits involved in cocaine- vs social interaction reward and (2 adapting our paradigm for C57BL/6 mice to make use of the plethora of transgenic models available in this species.

  10. Liking and wanting of drug and nondrug rewards in active cocaine users: the STRAP-R questionnaire

    Energy Technology Data Exchange (ETDEWEB)

    Goldstein, R.Z.; Goldstein, R.Z.; Woicik, P.A..; Moeller, S.J.; Telang, F.; Jayne, M.; Wong, C.; Wang, G-J.; Fowler, J.S.; Volkow, N.D.

    2008-10-01

    Few studies have examined the subjective value attributed to drug rewards specifically as it compares with the value attributed to primary non-drug rewards in addicted individuals. The objective of this study is to assess liking and wanting of expected drug rewards as compared to food and sex while respondents report about three different situations (current, and hypothetical in general, and under drug influence). In all, 20 cocaine-addicted individuals (mean abstinence = 2 days) and 20 healthy control subjects were administered the STRAP-R (Sensitivity To Reinforcement of Addictive and other Primary Rewards) questionnaire after receiving an oral dose of the dopamine agonist methylphenidate (20 mg) or placebo. The reinforcers relative value changed within the addicted sample when reporting about the under drug influence situation (drug > food; otherwise, drug < food). This change was highest in the addicted individuals with the youngest age of cocaine use onset. Moreover, drug wanting exceeded drug liking in the addicted subjects when reporting about this situation during methylphenidate. Thus, cocaine-addicted individuals assign the highest subjective valence to drug rewards but only when recalling cue-related situations. When recalling this situation, they also report higher drug wanting than hedonic liking, a motivational shift that was only significant during methylphenidate. Together, these valence shifts may underlie compulsive stimulant abuse upon pharmacological or behavioural cue exposure in addicted individuals. Additional studies are required to assess the reliability of the STRAP-R in larger samples and to examine its validity in measuring the subjective value attributed to experienced reinforcers or in predicting behaviour.

  11. Punished by Rewards?

    Science.gov (United States)

    Brandt, Ron

    1995-01-01

    The author of "Punished by Rewards" (1993), claims that rewards and punishments serve to manipulate behavior and destroy the potential for real learning. Praise is especially tricky, since intangible rewards can also foster compliance, not motivation. An engaging curriculum and a caring atmosphere encourage kids to exercise their natural…

  12. Motivation and reward systems

    NARCIS (Netherlands)

    van Eerde, W.; Vodosek, M.; den Hartog, D.N.; McNett, J.M.

    2014-01-01

    Reward systems are identified as one of the human resource management (HRM) practices that may impact motivation. Reward systems may consist of several components, including financial and nonfinancial rewards, in fixed and variable amounts. Reinforcement, expectancy, and equity principles are discus

  13. Global Stability Analysis for Periodic Solution in Discontinuous Neural Networks with Nonlinear Growth Activations

    Directory of Open Access Journals (Sweden)

    Wu Huaiqin

    2009-01-01

    Full Text Available This paper considers a new class of additive neural networks where the neuron activations are modelled by discontinuous functions with nonlinear growth. By Leray-Schauder alternative theorem in differential inclusion theory, matrix theory, and generalized Lyapunov approach, a general result is derived which ensures the existence and global asymptotical stability of a unique periodic solution for such neural networks. The obtained results can be applied to neural networks with a broad range of activation functions assuming neither boundedness nor monotonicity, and also show that Forti's conjecture for discontinuous neural networks with nonlinear growth activations is true.

  14. Self-reported empathy and neural activity during action imitation and observation in schizophrenia

    Directory of Open Access Journals (Sweden)

    William P. Horan

    2014-01-01

    Conclusions: Although patients with schizophrenia demonstrated largely normal patterns of neural activation across the finger movement and facial expression tasks, they reported decreased self perceived empathy and failed to show the typical relationship between neural activity and self-reported empathy seen in controls. These findings suggest that patients show a disjunction between automatic neural responses to low level social cues and higher level, integrative social cognitive processes involved in self-perceived empathy.

  15. Interpreting collective neural activity underlying spatial navigation in virtual reality

    Science.gov (United States)

    Meshulam, Leenoy; Gauthier, Jeff; Tank, David; Bialek, William

    2015-03-01

    Traditionally, cognitive- demanding processes like spatial navigation were studied by recording the activity of single neurons. However, recent technological progress allows imaging the simultaneous activity of large neuronal populations in awake behaving animals. This progress in experimental work calls for a similar adjustments of the modeling frameworks. To achieve a description of the ``real thermodynamics'' of the neural system, we construct maximum entropy models for optical imaging data taken in vivo, from the hippocampus of mice navigating in a virtual reality environment. This provides a natural extension of statistical mechanics applicable to brain activity, by focusing on the interactions between cells rather than on single cell's activity. We aim to determine how the topology of the energy landscape predicted by the model corresponds to the location of the animal in the environment. Since large subpopulations of the neurons in this area are spatially modulated, we expect the landscape to exhibit a large ``valley'' structure of local minima, corresponding to the animal's position along the environment. Such a finding is especially of interest because the location information emerges solely from the activity patterns that are accessible to the brain.

  16. Activation of endogenous neural stem cells for multiple sclerosis therapy

    Directory of Open Access Journals (Sweden)

    Iliana eMichailidou

    2015-01-01

    Full Text Available Multiple sclerosis (MS is a chronic inflammatory disorder of the central nervous system, leading to severe neurological deficits. Current MS treatment regimens, consist of immunomodulatory agents aiming to reduce the rate of relapses. However, these agents are usually insufficient to treat chronic neurological disability.A promising perspective for future therapy of MS is the regeneration of lesions with replacement of the damaged oligodendrocytes or neurons. Therapies targeting to the enhancement of endogenous remyelination, aim to promote the activation of either the parenchymal oligodendrocyte progenitor cells or the subventricular zone-derived neural stem cells (NSCs. Less studied but highly potent, is the strategy of neuronal regeneration with endogenous NSCs that although being linked to numerous limitations, is anticipated to ameliorate cognitive disability in MS. Focusing on the forebrain, this review highlights the role of NSCs in the regeneration of MS lesions.

  17. Deterministic dynamics of neural activity during absence seizures in rats

    Science.gov (United States)

    Ouyang, Gaoxiang; Li, Xiaoli; Dang, Chuangyin; Richards, Douglas A.

    2009-04-01

    The study of brain electrical activities in terms of deterministic nonlinear dynamics has recently received much attention. Forbidden ordinal patterns (FOP) is a recently proposed method to investigate the determinism of a dynamical system through the analysis of intrinsic ordinal properties of a nonstationary time series. The advantages of this method in comparison to others include simplicity and low complexity in computation without further model assumptions. In this paper, the FOP of the EEG series of genetic absence epilepsy rats from Strasbourg was examined to demonstrate evidence of deterministic dynamics during epileptic states. Experiments showed that the number of FOP of the EEG series grew significantly from an interictal to an ictal state via a preictal state. These findings indicated that the deterministic dynamics of neural networks increased significantly in the transition from the interictal to the ictal states and also suggested that the FOP measures of the EEG series could be considered as a predictor of absence seizures.

  18. Resting-state hemodynamics are spatiotemporally coupled to synchronized and symmetric neural activity in excitatory neurons.

    Science.gov (United States)

    Ma, Ying; Shaik, Mohammed A; Kozberg, Mariel G; Kim, Sharon H; Portes, Jacob P; Timerman, Dmitriy; Hillman, Elizabeth M C

    2016-12-27

    Brain hemodynamics serve as a proxy for neural activity in a range of noninvasive neuroimaging techniques including functional magnetic resonance imaging (fMRI). In resting-state fMRI, hemodynamic fluctuations have been found to exhibit patterns of bilateral synchrony, with correlated regions inferred to have functional connectivity. However, the relationship between resting-state hemodynamics and underlying neural activity has not been well established, making the neural underpinnings of functional connectivity networks unclear. In this study, neural activity and hemodynamics were recorded simultaneously over the bilateral cortex of awake and anesthetized Thy1-GCaMP mice using wide-field optical mapping. Neural activity was visualized via selective expression of the calcium-sensitive fluorophore GCaMP in layer 2/3 and 5 excitatory neurons. Characteristic patterns of resting-state hemodynamics were accompanied by more rapidly changing bilateral patterns of resting-state neural activity. Spatiotemporal hemodynamics could be modeled by convolving this neural activity with hemodynamic response functions derived through both deconvolution and gamma-variate fitting. Simultaneous imaging and electrophysiology confirmed that Thy1-GCaMP signals are well-predicted by multiunit activity. Neurovascular coupling between resting-state neural activity and hemodynamics was robust and fast in awake animals, whereas coupling in urethane-anesthetized animals was slower, and in some cases included lower-frequency (neural activity. The patterns of bilaterally-symmetric spontaneous neural activity revealed by wide-field Thy1-GCaMP imaging may depict the neural foundation of functional connectivity networks detected in resting-state fMRI.

  19. Studying modulation on simultaneously activated SSVEP neural networks by a cognitive task.

    Science.gov (United States)

    Wu, Zhenghua

    2014-01-01

    Since the discovery of steady-state visually evoked potential (SSVEP), it has been used in many fields. Numerous studies suggest that there exist three SSVEP neural networks in different frequency bands. An obvious phenomenon has been observed, that the amplitude and phase of SSVEP can be modulated by a cognitive task. Previous works have studied this modulation on separately activated SSVEP neural networks by a cognitive task. If two or more SSVEP neural networks are activated simultaneously in the process of a cognitive task, is the modulation on different SSVEP neural networks the same? In this study, two different SSVEP neural networks were activated simultaneously by two different frequency flickers, with a working memory task irrelevant to the flickers being conducted at the same time. The modulated SSVEP waves were compared with each other and to those only under one flicker in previous studies. The comparison results show that the cognitive task can modulate different SSVEP neural networks with a similar style.

  20. Cerebral oxygen delivery and consumption during evoked neural activity

    Directory of Open Access Journals (Sweden)

    Alberto L Vazquez

    2010-06-01

    Full Text Available Increases in neural activity evoke increases in the delivery and consumption of oxygen. Beyond observations of cerebral tissue and blood oxygen, the role and properties of cerebral oxygen delivery and consumption during changes in brain function are not well understood. This work overviews the current knowledge of functional oxygen delivery and consumption and introduces recent and preliminary findings to explore the mechanisms by which oxygen is delivered to tissue as well as the temporal dynamics of oxygen metabolism. Vascular oxygen tension measurements have shown that a relatively large amount of oxygen exits pial arterioles prior to capillaries. Additionally, increases in cerebral blood flow (CBF induced by evoked neural activation are accompanied by arterial vasodilation and also by increases in arteriolar oxygenation. This increase contributes not only to the down-stream delivery of oxygen to tissue, but also to delivery of additional oxygen to extra-vascular spaces surrounding the arterioles. On the other hand, the changes in tissue oxygen tension due to functional increases in oxygen consumption have been investigated using a method to suppress the evoked CBF response. The functional decreases in tissue oxygen tension induced by increases in oxygen consumption are slow to evoked changes in CBF under control conditions. Preliminary findings obtained using flavoprotein autofluorescence imaging suggest cellular oxidative metabolism changes at a faster rate than the average changes in tissue oxygen. These issues are important in the determination of the dynamic changes in tissue oxygen metabolism from hemoglobin-based imaging techniques such as blood oxygenation-level dependent functional magnetic resonance imaging (fMRI.

  1. Can simple interactions capture complex features of neural activity underlying behavior in a virtual reality environment?

    Science.gov (United States)

    Meshulam, Leenoy; Gauthier, Jeffrey; Brody, Carlos; Tank, David; Bialek, William

    The complex neural interactions which are abundant in most recordings of neural activity are relatively poorly understood. A prime example of such interactions can be found in the in vivo neural activity which underlies complex behaviors of mice, imaged in brain regions such as hippocampus and parietal cortex. Experimental techniques now allow us to accurately follow these neural interactions in the simultaneous activity of large neuronal populations of awake behaving animals. Here, we demonstrate that pairwise maximum entropy models can predict a surprising number of properties of the neural activity. The models, that are constrained with activity rates and interactions between pairs of neurons, are well fit to the activity `states' in the hippocampus and cortex of mice performing cognitive tasks while navigating in a virtual reality environment.

  2. Coping with unpredictability: Dopaminergic and neurotrophic responses to omission of expected reward in Atlantic salmon (Salmo salar L.)

    DEFF Research Database (Denmark)

    Vindas, Marco A; Sørensen, Christina; Johansen, Ida;

    2014-01-01

    Comparative studies are imperative for understanding the evolution of adaptive neurobiological processes such as neural plasticity, cognition, and emotion. Previously we have reported that prolonged omission of expected rewards (OER, or 'frustrative nonreward') causes increased aggression....... Subsequently, the expected food reward was delayed for 30 minutes during two out of three meals per day in the OER treatment, while the previously established routine was maintained in control groups. After 8 days there was no effect of OER on baseline brain stem serotonin (5-HT) or dopamine (DA) activity...

  3. Forebrain substrates of reward and motivation.

    Science.gov (United States)

    Wise, Roy A

    2005-12-01

    Electrical stimulation of the medial forebrain bundle can reward arbitrary acts or motivate biologically primitive, species-typical behaviors like feeding or copulation. The subsystems involved in these behaviors are only partially characterized, but they appear to transsynaptically activate the mesocorticolimbic dopamine system. Basal function of the dopamine system is essential for arousal and motor function; phasic activation of this system is rewarding and can potentiate the effectiveness of reward-predictors that guide learned behaviors. This system is phasically activated by most drugs of abuse and such activation contributes to the habit-forming actions of these drugs.

  4. Video Game Training and the Reward System

    Directory of Open Access Journals (Sweden)

    Robert C. Lorenz

    2015-02-01

    Full Text Available Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual towards playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training.Fifty healthy participants were randomly assigned to a video game training (TG or control group (CG. Before and after training/control period, functional magnetic resonance imaging (fMRI was conducted using a non-video game related reward task.At pretest, both groups showed strongest activation in ventral striatum (VS during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated.This longitudinal study revealed that video game training may preserve reward responsiveness in the ventral striatum in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  5. Video game training and the reward system.

    Science.gov (United States)

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  6. Amphetamine Sensitization Alters Reward Processing in the Human Striatum and Amygdala

    Science.gov (United States)

    O’Daly, Owen G.; Joyce, Daniel; Tracy, Derek K.; Azim, Adnan; Stephan, Klaas E.; Murray, Robin M.; Shergill, Sukhwinder S.

    2014-01-01

    Dysregulation of mesolimbic dopamine transmission is implicated in a number of psychiatric illnesses characterised by disruption of reward processing and goal-directed behaviour, including schizophrenia, drug addiction and impulse control disorders associated with chronic use of dopamine agonists. Amphetamine sensitization (AS) has been proposed to model the development of this aberrant dopamine signalling and the subsequent dysregulation of incentive motivational processes. However, in humans the effects of AS on the dopamine-sensitive neural circuitry associated with reward processing remains unclear. Here we describe the effects of acute amphetamine administration, following a sensitising dosage regime, on blood oxygen level dependent (BOLD) signal in dopaminoceptive brain regions during a rewarded gambling task performed by healthy volunteers. Using a randomised, double-blind, parallel-groups design, we found clear evidence for sensitization to the subjective effects of the drug, while rewarded reaction times were unchanged. Repeated amphetamine exposure was associated with reduced dorsal striatal BOLD signal during decision making, but enhanced ventromedial caudate activity during reward anticipation. The amygdala BOLD response to reward outcomes was blunted following repeated amphetamine exposure. Positive correlations between subjective sensitization and changes in anticipation- and outcome-related BOLD signal were seen for the caudate nucleus and amygdala, respectively. These data show for the first time in humans that AS changes the functional impact of acute stimulant exposure on the processing of reward-related information within dopaminoceptive regions. Our findings accord with pathophysiological models which implicate aberrant dopaminergic modulation of striatal and amygdala activity in psychosis and drug-related compulsive disorders. PMID:24717936

  7. Amphetamine sensitization alters reward processing in the human striatum and amygdala.

    Directory of Open Access Journals (Sweden)

    Owen G O'Daly

    Full Text Available Dysregulation of mesolimbic dopamine transmission is implicated in a number of psychiatric illnesses characterised by disruption of reward processing and goal-directed behaviour, including schizophrenia, drug addiction and impulse control disorders associated with chronic use of dopamine agonists. Amphetamine sensitization (AS has been proposed to model the development of this aberrant dopamine signalling and the subsequent dysregulation of incentive motivational processes. However, in humans the effects of AS on the dopamine-sensitive neural circuitry associated with reward processing remains unclear. Here we describe the effects of acute amphetamine administration, following a sensitising dosage regime, on blood oxygen level dependent (BOLD signal in dopaminoceptive brain regions during a rewarded gambling task performed by healthy volunteers. Using a randomised, double-blind, parallel-groups design, we found clear evidence for sensitization to the subjective effects of the drug, while rewarded reaction times were unchanged. Repeated amphetamine exposure was associated with reduced dorsal striatal BOLD signal during decision making, but enhanced ventromedial caudate activity during reward anticipation. The amygdala BOLD response to reward outcomes was blunted following repeated amphetamine exposure. Positive correlations between subjective sensitization and changes in anticipation- and outcome-related BOLD signal were seen for the caudate nucleus and amygdala, respectively. These data show for the first time in humans that AS changes the functional impact of acute stimulant exposure on the processing of reward-related information within dopaminoceptive regions. Our findings accord with pathophysiological models which implicate aberrant dopaminergic modulation of striatal and amygdala activity in psychosis and drug-related compulsive disorders.

  8. Determination of Activation Functions in A Feedforward Neural Network by using Genetic Algorithm

    Directory of Open Access Journals (Sweden)

    Oğuz ÜSTÜN

    2009-03-01

    Full Text Available In this study, activation functions of all layers of the multilayered feedforward neural network have been determined by using genetic algorithm. The main criteria that show the efficiency of the neural network is to approximate to the desired output with the same number nodes and connection weights. One of the important parameter to determine this performance is to choose a proper activation function. In the classical neural network designing, a network is designed by choosing one of the generally known activation function. In the presented study, a table has been generated for the activation functions. The ideal activation function for each node has been chosen from this table by using the genetic algorithm. Two dimensional regression problem clusters has been used to compare the performance of the classical static neural network and the genetic algorithm based neural network. Test results reveal that the proposed method has a high level approximation capacity.

  9. EEG-fMRI Bayesian framework for neural activity estimation: a simulation study

    Science.gov (United States)

    Croce, Pierpaolo; Basti, Alessio; Marzetti, Laura; Zappasodi, Filippo; Del Gratta, Cosimo

    2016-12-01

    Objective. Due to the complementary nature of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), and given the possibility of simultaneous acquisition, the joint data analysis can afford a better understanding of the underlying neural activity estimation. In this simulation study we want to show the benefit of the joint EEG-fMRI neural activity estimation in a Bayesian framework. Approach. We built a dynamic Bayesian framework in order to perform joint EEG-fMRI neural activity time course estimation. The neural activity is originated by a given brain area and detected by means of both measurement techniques. We have chosen a resting state neural activity situation to address the worst case in terms of the signal-to-noise ratio. To infer information by EEG and fMRI concurrently we used a tool belonging to the sequential Monte Carlo (SMC) methods: the particle filter (PF). Main results. First, despite a high computational cost, we showed the feasibility of such an approach. Second, we obtained an improvement in neural activity reconstruction when using both EEG and fMRI measurements. Significance. The proposed simulation shows the improvements in neural activity reconstruction with EEG-fMRI simultaneous data. The application of such an approach to real data allows a better comprehension of the neural dynamics.

  10. Activity-dependent modulation of neural circuit synaptic connectivity

    Directory of Open Access Journals (Sweden)

    Charles R Tessier

    2009-07-01

    Full Text Available In many nervous systems, the establishment of neural circuits is known to proceed via a two-stage process; 1 early, activity-independent wiring to produce a rough map characterized by excessive synaptic connections, and 2 subsequent, use-dependent pruning to eliminate inappropriate connections and reinforce maintained synapses. In invertebrates, however, evidence of the activity-dependent phase of synaptic refinement has been elusive, and the dogma has long been that invertebrate circuits are “hard-wired” in a purely activity-independent manner. This conclusion has been challenged recently through the use of new transgenic tools employed in the powerful Drosophila system, which have allowed unprecedented temporal control and single neuron imaging resolution. These recent studies reveal that activity-dependent mechanisms are indeed required to refine circuit maps in Drosophila during precise, restricted windows of late-phase development. Such mechanisms of circuit refinement may be key to understanding a number of human neurological diseases, including developmental disorders such as Fragile X syndrome (FXS and autism, which are hypothesized to result from defects in synaptic connectivity and activity-dependent circuit function. This review focuses on our current understanding of activity-dependent synaptic connectivity in Drosophila, primarily through analyzing the role of the fragile X mental retardation protein (FMRP in the Drosophila FXS disease model. The particular emphasis of this review is on the expanding array of new genetically-encoded tools that are allowing cellular events and molecular players to be dissected with ever greater precision and detail.

  11. Comparison of the MK-801-induced increase in non-rewarded appetitive responding with dopamine agonists and locomotor activity in rats.

    Science.gov (United States)

    Davis-MacNevin, Parnell L; Dekraker, Jordan; LaDouceur, Liane; Holahan, Matthew R

    2013-09-01

    Systemic administration of the noncompetitive N-methyl-D-aspartate (NMDA)- receptor antagonist, MK-801, has been proposed to model cognitive deficits similar to those seen in patients with schizophrenia. Evidence has shown that MK-801 increases the probability of operant responding during extinction, possibly modeling perseveration, as would be seen in patients with schizophrenia. This MK-801-induced behavioral perseveration is reversed by dopamine receptor antagonism. To further explore the role of dopamine in this behavioral change, the current study sought to determine if the MK-801-induced increase in non-rewarded operant responding could be mimicked by dopamine agonism and determine how it was related to locomotor activity. Male Long Evans rats were treated systemically with MK-801, cocaine, GBR12909 or apomorphine (APO) and given a single trial operant extinction session, followed by a separate assessment of locomotor activity. Both MK-801 (0.05 mg/kg) and cocaine (10 mg/kg) significantly increased responding during the extinction session and both increased horizontal locomotor activity. No dose of GBR-12909 (5, 10 or 20 mg/kg) was found to effect non-rewarded operant responding or locomotor activity. APO (0.05, 0.5, 2 or 5 mg/kg) treatment produced a dose-dependent decrease in both operant responding and locomotor activity. These results suggest the possibility that, rather than a primary influence of increased dopamine concentration on elevating bar-pressing responses during extinction, other neurotransmitter systems may be involved.

  12. It's in the eye of the beholder: selective attention to drink properties during tasting influences brain activation in gustatory and reward regions.

    Science.gov (United States)

    van Rijn, Inge; de Graaf, Cees; Smeets, Paul A M

    2017-03-20

    Statements regarding pleasantness, taste intensity or caloric content on a food label may influence the attention consumers pay to such characteristics during consumption. There is little research on the effects of selective attention on taste perception and associated brain activation in regular drinks. The aim of this study was to investigate the effect of selective attention on hedonics, intensity and caloric content on brain responses during tasting drinks. Using functional MRI brain responses of 27 women were measured while they paid attention to the intensity, pleasantness or caloric content of fruit juice, tomato juice and water. Brain activation during tasting largely overlapped between the three selective attention conditions and was found in the rolandic operculum, insula and overlying frontal operculum, striatum, amygdala, thalamus, anterior cingulate cortex and middle orbitofrontal cortex (OFC). Brain activation was higher during selective attention to taste intensity compared to calories in the right middle OFC and during selective attention to pleasantness compared to intensity in the right putamen, right ACC and bilateral middle insula. Intensity ratings correlated with brain activation during selective attention to taste intensity in the anterior insula and lateral OFC. Our data suggest that not only the anterior insula but also the middle and lateral OFC are involved in evaluating taste intensity. Furthermore, selective attention to pleasantness engaged regions associated with food reward. Overall, our results indicate that selective attention to food properties can alter the activation of gustatory and reward regions. This may underlie effects of food labels on the consumption experience of consumers.

  13. SPR imaging combined with cyclic voltammetry for the detection of neural activity

    Directory of Open Access Journals (Sweden)

    Hui Li

    2014-03-01

    Full Text Available Surface plasmon resonance (SPR detects changes in refractive index at a metal-dielectric interface. In this study, SPR imaging (SPRi combined with cyclic voltammetry (CV was applied to detect neural activity in isolated bullfrog sciatic nerves. The neural activities induced by chemical and electrical stimulation led to an SPR response, and the activities were recorded in real time. The activities of different parts of the sciatic nerve were recorded and compared. The results demonstrated that SPR imaging combined with CV is a powerful tool for the investigation of neural activity.

  14. Altered social reward and attention in anorexia nervosa

    Directory of Open Access Journals (Sweden)

    Karli K Watson

    2010-09-01

    Full Text Available Dysfunctional social reward and social orienting attend a variety of neuropsychiatric disorders including autism, schizophrenia, social anxiety, and psychopathy. Here we show that similar social reward and attention dysfunction attend anorexia nervosa, a disorder defined by avoidance of food and extreme weight loss. We measured the implicit reward value of social stimuli for female participants with (n=11 and without (n=11 anorexia nervosa using an econometric choice task and also tracked gaze patterns during free viewing of images of female faces and bodies. As predicted, the reward value of viewing bodies varied inversely with observed body weight for women with anorexia but not neurotypical women, in contrast with their explicit ratings of attractiveness. Surprisingly, women with anorexia nervosa, unlike neurotypical women, did not find female faces rewarding and avoided looking at both the face and eyes—independent of observed body weight. These findings demonstrate comorbid dysfunction in the neural circuits mediating gustatory and social reward in anorexia nervosa.

  15. Social and monetary reward processing in autism spectrum disorders

    Directory of Open Access Journals (Sweden)

    Delmonte Sonja

    2012-09-01

    Full Text Available Abstract Background Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD. However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Methods Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD response during the anticipation and receipt of both reward types. Results Behaviorally, the ASD group showed less of a reduction in reaction time (RT for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS. The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in

  16. Markov reward processes

    Science.gov (United States)

    Smith, R. M.

    1991-01-01

    Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

  17. Neural activity in relation to clinically derived personality syndromes in depression using a psychodynamic fMRI paradigm

    Directory of Open Access Journals (Sweden)

    Svenja eTaubner

    2013-12-01

    Full Text Available Objective: The heterogeneity between patients with depression cannot be captured adequately with existing descriptive systems of diagnosis and neurobiological models of depression. Furthermore, considering the highly individual nature of depression, the application of general stimuli in past research efforts may not capture the essence of the disorder. This study aims to identify subtypes of depression by using empirically-derived personality-syndromes, and to explore neural correlates of the derived personality syndromes.Method: In the present exploratory study an individually tailored and psychodynamically based fMRI paradigm using dysfunctional relationship patterns was presented to 20 chronically depressed patients. Results from the Shedler-Westen-Assessment-Procedure (SWAP-200 were analyzed by Q-factor analysis to identify clinically relevant subgroups of depression and related brain activation.Results: The principle component analysis of SWAP-200 items from all 20 patients lead to a 2-factor solution: Depressive Personality and Emotional-Hostile-Externalizing Personality. Both factors were used in a whole-brain correlational analysis but only the second factor yielded significant positive correlations in four regions: A large cluster in the right orbitofrontal cortex (OFC, the left ventral striatum, a small cluster in the left temporal pole and another small cluster in the right middle frontal gyrus. Discussion: The degree to which patients with depression score high on the factor Emotional-Hostile-Externalizing Personality correlated with relatively higher activity in three key areas involved in emotion processing, evaluation of reward/punishment, negative cognitions, depressive pathology and social knowledge (OFC, ventral striatum, temporal pole. Results may contribute to an alternative description of neural correlates of depression showing differential brain activation dependent on the extent of specific personality syndromes in

  18. Positive and negative reinforcement activate human auditory cortex.

    Science.gov (United States)

    Weis, Tina; Puschmann, Sebastian; Brechmann, André; Thiel, Christiane M

    2013-01-01

    Prior studies suggest that reward modulates neural activity in sensory cortices, but less is known about punishment. We used functional magnetic resonance imaging and an auditory discrimination task, where participants had to judge the duration of frequency modulated tones. In one session correct performance resulted in financial gains at the end of the trial, in a second session incorrect performance resulted in financial loss. Incorrect performance in the rewarded as well as correct performance in the punishment condition resulted in a neutral outcome. The size of gains and losses was either low or high (10 or 50 Euro cent) depending on the direction of frequency modulation. We analyzed neural activity at the end of the trial, during reinforcement, and found increased neural activity in auditory cortex when gaining a financial reward as compared to gaining no reward and when avoiding financial loss as compared to receiving a financial loss. This was independent on the size of gains and losses. A similar pattern of neural activity for both gaining a reward and avoiding a loss was also seen in right middle temporal gyrus, bilateral insula and pre-supplemental motor area, here however neural activity was lower after correct responses compared to incorrect responses. To summarize, this study shows that the activation of sensory cortices, as previously shown for gaining a reward is also seen during avoiding a loss.

  19. Positive and negative reinforcement activate human auditory cortex

    Directory of Open Access Journals (Sweden)

    Tina eWeis

    2013-12-01

    Full Text Available Prior studies suggest that reward modulates neural activity in sensory cortices, but less is known about punishment. We used functional magnetic resonance imaging and an auditory discrimination task, where participants had to judge the duration of frequency modulated tones. In one session correct performance resulted in financial gains at the end of the trial, in a second session incorrect performance resulted in financial loss. Incorrect performance in the rewarded as well as correct performance in the punishment condition resulted in a neutral outcome. The size of gains and losses was either low or high (10 or 50 Euro cent depending on the direction of frequency modulation. We analyzed neural activity at the end of the trial, during reinforcement, and found increased neural activity in auditory cortex when gaining a financial reward as compared to gaining no reward and when avoiding financial loss as compared to receiving a financial loss. This was independent on the size of gains and losses. A similar pattern of neural activity for both gaining a reward and avoiding a loss was also seen in right middle temporal gyrus, bilateral insula and pre-supplemental motor area, here however neural activity was lower after correct responses compared to incorrect responses. To summarize, this study shows that the activation of sensory cortices, as previously shown for gaining a reward is also seen during avoiding a loss.

  20. Sensory entrainment mechanisms in auditory perception: neural synchronization and cortico-striatal activation

    Directory of Open Access Journals (Sweden)

    Catia M Sameiro-Barbosa

    2016-08-01

    Full Text Available The auditory system displays modulations in sensitivity that can align with the temporal structure of the acoustic environment. This sensory entrainment can facilitate sensory perception and is particularly relevant for audition. Systems neuroscience is slowly uncovering the neural mechanisms underlying the behaviorally observed sensory entrainment effects in the human sensory system. The present article summarizes the prominent behavioral effects of sensory entrainment and reviews our current understanding of the neural basis of sensory entrainment, such as synchronized neural oscillations and, potentially, neural activation in the cortico-striatal system.

  1. Activation of D1/5 Dopamine Receptors: A Common Mechanism for Enhancing Extinction of Fear and Reward-Seeking Behaviors.

    Science.gov (United States)

    Abraham, Antony D; Neve, Kim A; Lattal, K Matthew

    2016-07-01

    Dopamine is critical for many processes that drive learning and memory, including motivation, prediction error, incentive salience, memory consolidation, and response output. Theories of dopamine's function in these processes have, for the most part, been developed from behavioral approaches that examine learning mechanisms in appetitive tasks. A parallel and growing literature indicates that dopamine signaling is involved in consolidation of memories into stable representations in aversive tasks such as fear conditioning. Relatively little is known about how dopamine may modulate memories that form during extinction, when organisms learn that the relation between previously associated events is severed. We investigated whether fear and reward extinction share common mechanisms that could be enhanced with dopamine D1/5 receptor activation. Pharmacological activation of dopamine D1/5 receptors (with SKF 81297) enhanced extinction of both cued and contextual fear. These effects also occurred in the extinction of cocaine-induced conditioned place preference, suggesting that the observed effects on extinction were not specific to a particular type of procedure (aversive or appetitive). A cAMP/PKA biased D1 agonist (SKF 83959) did not affect fear extinction, whereas a broadly efficacious D1 agonist (SKF 83822) promoted fear extinction. Together, these findings show that dopamine D1/5 receptor activation is a target for the enhancement of fear or reward extinction.

  2. Activation of oxytocin receptors, but not arginine-vasopressin V1a receptors, in the ventral tegmental area of male Syrian hamsters is essential for the reward-like properties of social interactions.

    Science.gov (United States)

    Song, Zhimin; Borland, Johnathan M; Larkin, Tony E; O'Malley, Maureen; Albers, H Elliott

    2016-12-01

    Social reward plays a fundamental role in shaping human and animal behavior. The rewarding nature of many forms of social behavior including sexual behavior, parental behavior, and social play has been revealed using well-established procedures such as the conditioned place preference test. Many motivated social behaviors are regulated by the nonapeptides oxytocin (OT) and arginine vasopressin (AVP) through their actions in multiple brain structures. Interestingly, there are few data on whether OT or AVP might contribute to the rewarding properties of social interaction by their actions within brain structures that play a key role in reward mechanisms such as the ventral tegmental area (VTA). The goal of the present study was to investigate the role of OT and AVP in the VTA in regulating the reward-like properties of social interactions. Social interactions between two male hamsters reduced a spontaneous place avoidance in hamsters injected with saline control. Interestingly, however, OT and AVP injected into the VTA induced a significant two-fold reduction in place avoidance for the social interaction chamber when compared to control injections of vehicle. Finally, because OT and AVP can act on each other's receptors to influence social behavior, we also injected highly selective OTR and V1aR agonists and antagonists to determine whether OT or AVP V1a receptors were responsible for mediating the effects of these neuropeptides on social reward. Our results not only demonstrated that OT and AVP activate OTRs and not V1aRs to mediate social reward, they also demonstrated that the activation of OT receptors in the VTA is essential for the expression of the rewarding properties of social interactions.

  3. Hemispheric Asymmetries in Striatal Reward Responses Relate to Approach-Avoidance Learning and Encoding of Positive-Negative Prediction Errors in Dopaminergic Midbrain Regions.

    Science.gov (United States)

    Aberg, Kristoffer Carl; Doell, Kimberly C; Schwartz, Sophie

    2015-10-28

    Some individuals are better at learning about rewarding situations, whereas others are inclined to avoid punishments (i.e., enhanced approach or avoidance learning, respectively). In reinforcement learning, action values are increased when outcomes are better than predicted (positive prediction errors [PEs]) and decreased for worse than predicted outcomes (negative PEs). Because actions with high and low values are approached and avoided, respectively, individual differences in the neural encoding of PEs may influence the balance between approach-avoidance learning. Recent correlational approaches also indicate that biases in approach-avoidance learning involve hemispheric asymmetries in dopamine function. However, the computational and neural mechanisms underpinning such learning biases remain unknown. Here we assessed hemispheric reward asymmetry in striatal activity in 34 human participants who performed a task involving rewards and punishments. We show that the relative difference in reward response between hemispheres relates to individual biases in approach-avoidance learning. Moreover, using a computational modeling approach, we demonstrate that better encoding of positive (vs negative) PEs in dopaminergic midbrain regions is associated with better approach (vs avoidance) learning, specifically in participants with larger reward responses in the left (vs right) ventral striatum. Thus, individual dispositions or traits may be determined by neural processes acting to constrain learning about specific aspects of the world.

  4. The neural mechanisms of learning from competitors.

    Science.gov (United States)

    Howard-Jones, Paul A; Bogacz, Rafal; Yoo, Jee H; Leonards, Ute; Demetriou, Skevi

    2010-11-01

    Learning from competitors poses a challenge for existing theories of reward-based learning, which assume that rewarded actions are more likely to be executed in the future. Such a learning mechanism would disadvantage a player in a competitive situation because, since the competitor's loss is the player's gain, reward might become associated with an action the player should themselves avoid. Using fMRI, we investigated the neural activity of humans competing with a computer in a foraging task. We observed neural activity that represented the variables required for learning from competitors: the actions of the competitor (in the player's motor and premotor cortex) and the reward prediction error arising from the competitor's feedback. In particular, regions positively correlated with the unexpected loss of the competitor (which was beneficial to the player) included the striatum and those regions previously implicated in response inhibition. Our results suggest that learning in such contexts may involve the competitor's unexpected losses activating regions of the player's brain that subserve response inhibition, as the player learns to avoid the actions that produced them.

  5. Linking online gaming and addictive behavior: Converging evidence for a general reward deficiency in frequent online gamers

    Directory of Open Access Journals (Sweden)

    Tim eHahn

    2014-11-01

    Full Text Available Millions of people regularly play so-called Massively Multiplayer Online Role Playing Games (MMORPGs. Recently, it has been argued that MMORPG overuse is becoming a significant health problem worldwide. Symptoms such as tolerance, withdrawal and craving have been described. Based on behavioral, resting state and task-related neuroimaging data, we test whether frequent players of the MMORPG World of Warcraft (WoW – similar to drug addicts and individuals with an increased risk for addictions – show a generally deficient reward system. In frequent players of the MMORPG World of Warcraft (WoW-players and in a control group of non-gamers we assessed 1 trait sensitivity to reward, 2 BOLD responses during monetary reward processing in the ventral striatum and 3 ventral-striatal resting state dynamics. We find a decreased neural activation in the ventral striatum during the anticipation of both small and large monetary rewards. Additionally, we show generally altered neurodynamics in this region independent of any specific task for WoW players (resting state. On the behavioral level, we found differences in trait sensitivity to reward, suggesting that the reward processing deficiencies found in this study are not a consequence of gaming, but predisposed to it. These findings empirically support a direct link between frequent online gaming and the broad field of behavioral and drug addiction research, thus opening new avenues for clinical interventions in addicted gamers and potentially improving the assessment of addiction-risk in the vast population of frequent gamers.

  6. Application of Artificial Neural Network in Active Vibration Control of Diesel Engine

    Institute of Scientific and Technical Information of China (English)

    SUN Cheng-shun; ZHANG Jian-wu

    2005-01-01

    Artificial Neural Network (ANN) is applied to diesel twostage vibration isolating system and an AVC (Active Vibration Control) system is developed. Both identifier and controller are constructed by three-layer BP neural network. Besides computer simulation, experiment research is carried out on both analog bench and diesel bench. The results of simulation and experiment show a diminished response of vibration.

  7. Topography, power, and current source density of θ oscillations during reward processing as markers for alcohol dependence.

    Science.gov (United States)

    Kamarajan, Chella; Rangaswamy, Madhavi; Manz, Niklas; Chorlian, David B; Pandey, Ashwini K; Roopesh, Bangalore N; Porjesz, Bernice

    2012-05-01

    Recent studies have linked alcoholism with a dysfunctional neural reward system. Although several electrophysiological studies have explored reward processing in healthy individuals, such studies in alcohol-dependent individuals are quite rare. The present study examines theta oscillations during reward processing in abstinent alcoholics. The electroencephalogram (EEG) was recorded in 38 abstinent alcoholics and 38 healthy controls as they performed a single outcome gambling task, which involved outcomes of either loss or gain of an amount (10 or 50¢) that was bet. Event-related theta band (3.0-7.0 Hz) power following each outcome stimulus was computed using the S-transform method. Theta power at the time window of the outcome-related negativity (ORN) and positivity (ORP) (200-500 ms) was compared across groups and outcome conditions. Additionally, behavioral data of impulsivity and task performance were analyzed. The alcoholic group showed significantly decreased theta power during reward processing compared to controls. Current source density (CSD) maps of alcoholics revealed weaker and diffuse source activity for all conditions and weaker bilateral prefrontal sources during the Loss 50 condition when compared with controls who manifested stronger and focused midline sources. Furthermore, alcoholics exhibited increased impulsivity and risk-taking on the behavioral measures. A strong association between reduced anterior theta power and impulsive task-performance was observed. It is suggested that decreased power and weaker and diffuse CSD in alcoholics may be due to dysfunctional neural reward circuitry. The relationship among alcoholism, theta oscillations, reward processing, and impulsivity could offer clues to understand brain circuitries that mediate reward processing and inhibitory control.

  8. Synthetic cathinone MDPV downregulates glutamate transporter subtype I (GLT-1) and produces rewarding and locomotor-activating effects that are reduced by a GLT-1 activator.

    Science.gov (United States)

    Gregg, Ryan A; Hicks, Callum; Nayak, Sunil U; Tallarida, Christopher S; Nucero, Paul; Smith, Garry R; Reitz, Allen B; Rawls, Scott M

    2016-09-01

    Synthetic cathinones produce dysregulation of monoamine systems, but their effects on the glutamate system and the influence of glutamate on behavioral effects related to cathinone abuse are unknown. A principal regulator of glutamate homeostasis is glutamate transporter subtype 1 (GLT-1), an astrocytic protein that clears glutamate from the extracellular space and influences behavioral effects of established psychostimulants. We hypothesized that repeated administration of the synthetic cathinone, MDPV (3,4-methylenedioxypyrovalerone), would affect GLT-1 expression in the corticolimbic circuit, and that a GLT-1 activator (ceftriaxone, CTX) would reduce rewarding and locomotor-stimulant effects of MDPV in rats. GLT-1 protein expression in the nucleus accumbens (NAcc), but not prefrontal cortex (PFC), was decreased following withdrawal (2, 5 and 10 days) from repeated MDPV treatment, but not immediately after the last MDPV injection. CTX (200 mg/kg) pretreatment did not affect acute locomotor activation produced by MDPV (0.5, 1, 3 mg/kg). However, CTX (200 mg/kg) administered during a 7-day MDPV treatment paradigm attenuated the development of MDPV-induced sensitization of repetitive movements in rats challenged with MDPV following 11 days of drug abstinence. Pretreatment with CTX (200 mg/kg) during a 4-day MDPV (2 mg/kg) conditioned place preference (CPP) paradigm reduced the development of place preference produced by MDPV. The present data demonstrate dysregulation of corticolimbic glutamate transport systems during withdrawal from chronic MDPV exposure, and show that a GLT-1 transporter activator disrupts behavioral effects of MDPV that are related to synthetic cathinone abuse.

  9. A putatively novel form of spontaneous coordination in neural activity.

    Science.gov (United States)

    Hermer-Vazquez, Raymond; Hermer-Vazquez, Linda; Srinivasan, Sridhar

    2009-04-06

    We simultaneously recorded local field potentials from three sites along the olfactory-entorhinal axis in rats lightly anesthetized with isoflurane, as part of another experiment. While analyzing the initial data from that experiment with spectrograms, we discovered a potentially novel form of correlated neural activity, with near-simultaneous occurrence across the three widely separated brain sites. After validating their existence further, we named these events Synchronous Frequency Bursts (SFBs). Here we report our initial investigations into their properties and their potential functional significance. In Experiment 1, we found that SFBs have highly regular properties, consisting of brief (approximately 250 ms), high amplitude bursts of LFP energy spanning frequency ranges from the delta band (1-4 Hz) to at least the low gamma band (30-50 Hz). SFBs occurred almost simultaneously across recording sites, usually with onsets sites. While the SFBs had fairly typical, exponentially decaying power spectral density plots, their coherence structure was unusual, with high peaks in several narrow frequency ranges and little coherence in other bands. In Experiment 2, we found that SFBs occurred far more often under light anesthesia than deeper anesthetic states, and were especially prevalent as the animals regained consciousness. Finally, in Experiment 3 we showed that SFBs occur simultaneously at a significant rate across brain sites from putatively different functional subsystems--olfactory versus motor pathways. We suggest that SFBs do not carry information per se, but rather, play a role in coordinating activity in different frequency bands, potentially brain-wide, as animals progress from sleep or anesthesia toward full consciousness.

  10. Accounting for Dynamic Fluctuations across Time when Examining fMRI Test-Retest Reliability: Analysis of a Reward Paradigm in the EMBARC Study.

    Directory of Open Access Journals (Sweden)

    Henry W Chase

    Full Text Available Longitudinal investigation of the neural correlates of reward processing in depression may represent an important step in defining effective biomarkers for antidepressant treatment outcome prediction, but the reliability of reward-related activation is not well understood. Thirty-seven healthy control participants were scanned using fMRI while performing a reward-related guessing task on two occasions, approximately one week apart. Two main contrasts were examined: right ventral striatum (VS activation fMRI BOLD signal related to signed prediction errors (PE and reward expectancy (RE. We also examined bilateral visual cortex activation coupled to outcome anticipation. Significant VS PE-related activity was observed at the first testing session, but at the second testing session, VS PE-related activation was significantly reduced. Conversely, significant VS RE-related activity was observed at time 2 but not time 1. Increases in VS RE-related activity from time 1 to time 2 were significantly associated with decreases in VS PE-related activity from time 1 to time 2 across participants. Intraclass correlations (ICCs in VS were very low. By contrast, visual cortex activation had much larger ICCs, particularly in individuals with high quality data. Dynamic changes in brain activation are widely predicted, and failure to account for these changes could lead to inaccurate evaluations of the reliability of functional MRI signals. Conventional measures of reliability cannot distinguish between changes specified by algorithmic models of neural function and noisy signal. Here, we provide evidence for the former possibility: reward-related VS activations follow the pattern predicted by temporal difference models of reward learning but have low ICCs.

  11. Addiction: Beyond dopamine reward circuitry

    Energy Technology Data Exchange (ETDEWEB)

    Volkow, N.D.; Wang, G.; Volkow, N.D.; Wang, G.-J.; Fowler, J.S.; Tomasi, D.; Telang, F.

    2011-09-13

    Dopamine (DA) is considered crucial for the rewarding effects of drugs of abuse, but its role in addiction is much less clear. This review focuses on studies that used PET to characterize the brain DA system in addicted subjects. These studies have corroborated in humans the relevance of drug-induced fast DA increases in striatum [including nucleus accumbens (NAc)] in their rewarding effects but have unexpectedly shown that in addicted subjects, drug-induced DA increases (as well as their subjective reinforcing effects) are markedly blunted compared with controls. In contrast, addicted subjects show significant DA increases in striatum in response to drug-conditioned cues that are associated with self-reports of drug craving and appear to be of a greater magnitude than the DA responses to the drug. We postulate that the discrepancy between the expectation for the drug effects (conditioned responses) and the blunted pharmacological effects maintains drug taking in an attempt to achieve the expected reward. Also, whether tested during early or protracted withdrawal, addicted subjects show lower levels of D2 receptors in striatum (including NAc), which are associated with decreases in baseline activity in frontal brain regions implicated in salience attribution (orbitofrontal cortex) and inhibitory control (anterior cingulate gyrus), whose disruption results in compulsivity and impulsivity. These results point to an imbalance between dopaminergic circuits that underlie reward and conditioning and those that underlie executive function (emotional control and decision making), which we postulate contributes to the compulsive drug use and loss of control in addiction.

  12. Low and high gamma oscillations in rat ventral striatum have distinct relationships to behavior, reward, and spiking activity on a learned spatial decision task

    Directory of Open Access Journals (Sweden)

    Matthijs A A Van Der Meer

    2009-06-01

    Full Text Available Local field potential (LFP oscillations in the brain reflect organization thought to be important for perception, attention, movement, and memory. In the basal ganglia, including dorsal striatum, dysfunctional LFP states are associated with Parkinson’s disease, while in healthy subjects, dorsal striatal LFPs have been linked to decision-making processes. However, LFPs in ventral striatum have been less studied. We report that in rats running a spatial decision task, prominent gamma-50 (45-55 Hz and gamma-80 (70-85 Hz oscillations in ventral striatum had distinct relationships to behavior, task events, and spiking activity. Gamma-50 power increased sharply following reward delivery and before movement initiation, while in contrast, gamma-80 power ramped up gradually to reward locations. Gamma-50 power was low and contained little structure during early learning, but rapidly developed a stable pattern, while gamma-80 power was initially high before returning to a stable level within a similar timeframe. Putative fast-spiking interneurons (FSIs showed phase, firing rate, and coherence relationships with gamma-50 and gamma-80, indicating that the observed LFP patterns are locally relevant. Furthermore, in a number of FSIs such relationships were specific to gamma-50 or gamma-80, suggesting that partially distinct FSI populations mediate the effects of gamma-50 and gamma-80.

  13. Optogenetics in Silicon: A Neural Processor for Predicting Optically Active Neural Networks.

    Science.gov (United States)

    Luo, Junwen; Nikolic, Konstantin; Evans, Benjamin D; Dong, Na; Sun, Xiaohan; Andras, Peter; Yakovlev, Alex; Degenaar, Patrick

    2016-08-17

    We present a reconfigurable neural processor for real-time simulation and prediction of opto-neural behaviour. We combined a detailed Hodgkin-Huxley CA3 neuron integrated with a four-state Channelrhodopsin-2 (ChR2) model into reconfigurable silicon hardware. Our architecture consists of a Field Programmable Gated Array (FPGA) with a custom-built computing data-path, a separate data management system and a memory approach based router. Advancements over previous work include the incorporation of short and long-term calcium and light-dependent ion channels in reconfigurable hardware. Also, the developed processor is computationally efficient, requiring only 0.03 ms processing time per sub-frame for a single neuron and 9.7 ms for a fully connected network of 500 neurons with a given FPGA frequency of 56.7 MHz. It can therefore be utilized for exploration of closed loop processing and tuning of biologically realistic optogenetic circuitry.

  14. Filtered-X Radial Basis Function Neural Networks for Active Noise Control

    Directory of Open Access Journals (Sweden)

    Bambang Riyanto

    2004-05-01

    Full Text Available This paper presents active control of acoustic noise using radial basis function (RBF networks and its digital signal processor (DSP real-time implementation. The neural control system consists of two stages: first, identification (modeling of secondary path of the active noise control using RBF networks and its learning algorithm, and secondly neural control of primary path based on neural model obtained in the first stage. A tapped delay line is introduced in front of controller neural, and another tapped delay line is inserted between controller neural networks and model neural networks. A new algorithm referred to as Filtered X-RBF is proposed to account for secondary path effects of the control system arising in active noise control. The resulting algorithm turns out to be the filtered-X version of the standard RBF learning algorithm. We address centralized and decentralized controller configurations and their DSP implementation is carried out. Effectiveness of the neural controller is demonstrated by applying the algorithm to active noise control within a 3 dimension enclosure to generate quiet zones around error microphones. Results of the real-time experiments show that 10-23 dB noise attenuation is produced with moderate transient response.

  15. Neural activity control of neural stem cells and SVZ niche response to brain injury

    OpenAIRE

    Páez González, Patricia

    2014-01-01

    Patricia Paez-Gonzalez Kuo Lab, Dept. of Cell Biology, Duke University Medical Center, NC,USA. Date: 11/16/2014 Utilizing stem cells in the adult brain hold great promise for regenerative medicine. Harnessing ability of adult neural stem cells (NSCs) to generate new neurons or other types of brain cells may provide much needed therapies for patients suffering from brain injuries or neuro-degenerative diseases such as Parkinson’s, Scizophrenia, or Alzheimer’s disease. However...

  16. Validation and extension of the reward-mountain model

    Directory of Open Access Journals (Sweden)

    Yannick-André eBreton

    2013-10-01

    Full Text Available The reward-mountain model relates the vigor of reward seeking to the strength and cost of reward. Application of this model provides information about the stage of processing at which manipulations such as drug administration, lesions, deprivation states, and optogenetic interventions act to alter reward seeking. The model has been updated by incorporation of new information about frequency following in the directly stimulated neurons responsible for brain stimulation reward and about the function that maps objective opportunity costs into subjective ones. The behavioral methods for applying the model have been updated and improved as well. To assess the impact of these changes, two related predictions of the model that were supported by earlier work have been retested: 1 altering the duration of rewarding brain stimulation should change the pulse frequency required to produce a reward of half-maximal intensity, and 2 this manipulation should not change the opportunity cost at which half-maximal performance is directed at earning a maximally intense reward. Prediction 1 was supported in all six subjects, but prediction 2 was supported in only three. The latter finding is interpreted to reflect recruitment, at some stimulation sites, of a heterogeneous reward substrate comprising dual, parallel circuits that integrate the stimulation-induced neural signals.

  17. Identification of non-linear models of neural activity in bold fmri

    DEFF Research Database (Denmark)

    Jacobsen, Daniel Jakup; Madsen, Kristoffer Hougaard; Hansen, Lars Kai

    2006-01-01

    Non-linear hemodynamic models express the BOLD signal as a nonlinear, parametric functional of the temporal sequence of local neural activity. Several models have been proposed for this neural activity. We identify one such parametric model by estimating the distribution of its parameters. These ....... These distributions are themselves stochastic, therefore we estimate their variance by epoch based leave-one-out cross validation, using a Metropolis-Hastings algorithm for sampling of the posterior parameter distribution....

  18. Endocannabinoid signalling in reward and addiction.

    Science.gov (United States)

    Parsons, Loren H; Hurd, Yasmin L

    2015-10-01

    Brain endocannabinoid (eCB) signalling influences the motivation for natural rewards (such as palatable food, sexual activity and social interaction) and modulates the rewarding effects of addictive drugs. Pathological forms of natural and drug-induced reward are associated with dysregulated eCB signalling that may derive from pre-existing genetic factors or from prolonged drug exposure. Impaired eCB signalling contributes to dysregulated synaptic plasticity, increased stress responsivity, negative emotional states and cravings that propel addiction. Understanding the contributions of eCB disruptions to behavioural and physiological traits provides insight into the eCB influence on addiction vulnerability.

  19. Distance modulation of neural activity in the visual cortex.

    Science.gov (United States)

    Dobbins, A C; Jeo, R M; Fiser, J; Allman, J M

    1998-07-24

    Humans use distance information to scale the size of objects. Earlier studies demonstrated changes in neural response as a function of gaze direction and gaze distance in the dorsal visual cortical pathway to parietal cortex. These findings have been interpreted as evidence of the parietal pathway's role in spatial representation. Here, distance-dependent changes in neural response were also found to be common in neurons in the ventral pathway leading to inferotemporal cortex of monkeys. This result implies that the information necessary for object and spatial scaling is common to all visual cortical areas.

  20. Neural activity to positive expressions predicts daily experience of schizophrenia-spectrum symptoms in adults with high social anhedonia.

    Science.gov (United States)

    Hooker, Christine I; Benson, Taylor L; Gyurak, Anett; Yin, Hong; Tully, Laura M; Lincoln, Sarah Hope

    2014-02-01

    Social anhedonia (SA), the diminished pleasure from social relationships, is a prominent characteristic of the vulnerability and manifestation of schizophrenia disorder. However, SA can develop for multiple reasons and little is known about its neural basis; these 2 issues hinder the utility and sensitivity of SA as a marker of schizophrenia pathology. This study investigated whether lateral prefrontal cortex (LPFC) deficits in social reward processing are associated with both SA and other schizophrenia-spectrum symptoms. During functional MRI (fMRI), a community sample of healthy adults (N = 30) with high and low SA viewed positive, negative, and neutral facial expressions. Afterward, participants completed an online daily diary in which they rated schizophrenia-spectrum symptoms and occurrence of interpersonal conflict each day for 21 days. Compared with low SA, high SA participants had less ventral (V)LPFC activity to positive versus neutral expressions. In addition, participants with a combination of high SA and low VLPFC activity to positive versus neutral expressions had worse daily diary ratings of schizophrenia-spectrum symptoms, including worse cognition, paranoia, motivation/productivity, and vigor/positive affect (i.e., psychomotor activation). Finally, among high SA participants, VLPFC activity predicted the daily relationship between distress from interpersonal conflict and symptom-severity; specifically, high SA participants with low VLPFC activity had worse paranoia on days of high conflict distress. These findings indicate that VLPFC deficits in positive emotion are associated with both SA and other schizophrenia-spectrum symptoms and that understanding the interaction of SA, VLPFC function, and social stress could facilitate the use of SA in the prevention and treatment of schizophrenia.

  1. Anticipation of novelty recruits reward system and hippocampus while promoting recollection

    OpenAIRE

    2007-01-01

    The dopaminergic midbrain, which comprises the substantia nigra and ventral tegmental area (SN/VTA), plays a central role in reward processing. This region is also activated by novel stimuli, raising the possibility that novelty and reward have shared functional properties. It is currently unclear whether functional aspects of reward processing in the SN/VTA, namely, activation by unexpected rewards and cues that predict reward, also characterise novelty processing. To address this question, ...

  2. Nucleus accumbens μ-opioid receptors mediate social reward

    OpenAIRE

    Trezza, Viviana; Damsteegt, Ruth; Achterberg, E J Marijke; Vanderschuren, Louk J. M. J

    2011-01-01

    Positive social interactions are essential for emotional well-being and proper behavioral development of young individuals. Here, we studied the neural underpinnings of social reward, by investigating the involvement of opioid neurotransmission in the nucleus accumbens (NAc) in social play behavior, a highly rewarding social interaction in adolescent rats. Intra-NAc infusion of morphine (0.05–0.1 μg) increased pinning and pouncing, characteristic elements of social play behavior in rats, and ...

  3. Impulsiveness and insula activation during reward anticipation are associated with genetic variants in GABRA2 in a family sample enriched for alcoholism.

    Science.gov (United States)

    Villafuerte, S; Heitzeg, M M; Foley, S; Yau, W-Y Wendy; Majczenko, K; Zubieta, J-K; Zucker, R A; Burmeister, M

    2012-05-01

    Genetic factors, externalizing personality traits such as impulsivity, and brain processing of salient stimuli all can affect individual risk for alcoholism. One of very few confirmed genetic association findings differentiating alcoholics from non-alcoholics is with variants in the inhibitory γ-amino butyric acid α2 receptor subunit (GABRA2) gene. Here we report the association of two of these GABRA2 variants with measures of alcohol symptoms, impulsivity and with insula cortex activation during anticipation of reward or loss using functional magnetic resonance imaging (fMRI). In a sample of 173 families (449 subjects), 129 of whom had at least one member diagnosed with alcohol dependence or abuse, carriers for the G allele in two single-nucleotide polymorphisms (SNPs) and haplotypes were more likely to have alcohol dependence symptoms (rs279858, P=0.01; rs279826, P=0.05; haplotype, P=0.02) and higher NEO Personality Inventory-Revised (NEO-PI-R) Impulsiveness scores (rs279858, P=0.016; rs279826, P=0.012; haplotype, P=0.032) with a stronger effect in women (rs279858, P=0.011; rs279826, P=0.002; haplotype, P=0.006), all P-values are corrected for family history and age. A subset of offspring from these families (n=44, 20 females), genotyped for GABRA2, participated in an fMRI study using a monetary incentive delay task. Increased insula activation during reward (r(2)=0.4; P=0.026) and loss (r(2)=0.38; P=0.039) anticipation was correlated with NEO-PI-R Impulsiveness and further associated with the GG genotype for both SNPs (P's<0.04). Our results suggest that GABRA2 genetic variation is associated with Impulsiveness through variation of insula activity responses, here evidenced during anticipatory responses.

  4. Associations among smoking, anhedonia, and reward learning in depression.

    Science.gov (United States)

    Liverant, Gabrielle I; Sloan, Denise M; Pizzagalli, Diego A; Harte, Christopher B; Kamholz, Barbara W; Rosebrock, Laina E; Cohen, Andrew L; Fava, Maurizio; Kaplan, Gary B

    2014-09-01

    Depression and cigarette smoking co-occur at high rates. However, the etiological mechanisms that contribute to this relationship remain unclear. Anhedonia and associated impairments in reward learning are key features of depression, which also have been linked to the onset and maintenance of cigarette smoking. However, few studies have investigated differences in anhedonia and reward learning among depressed smokers and depressed nonsmokers. The goal of this study was to examine putative differences in anhedonia and reward learning in depressed smokers (n=36) and depressed nonsmokers (n=44). To this end, participants completed self-report measures of anhedonia and behavioral activation (BAS reward responsiveness scores) and as well as a probabilistic reward task rooted in signal detection theory, which measures reward learning (Pizzagalli, Jahn, & O'Shea, 2005). When considering self-report measures, depressed smokers reported higher trait anhedonia and reduced BAS reward responsiveness scores compared to depressed nonsmokers. In contrast to self-report measures, nicotine-satiated depressed smokers demonstrated greater acquisition of reward-based learning compared to depressed nonsmokers as indexed by the probabilistic reward task. Findings may point to a potential mechanism underlying the frequent co-occurrence of smoking and depression. These results highlight the importance of continued investigation of the role of anhedonia and reward system functioning in the co-occurrence of depression and nicotine abuse. Results also may support the use of treatments targeting reward learning (e.g., behavioral activation) to enhance smoking cessation among individuals with depression.

  5. Lack of telomerase activity in rabbit bone marrow stromal cells during differentiation along neural pathway

    Institute of Scientific and Technical Information of China (English)

    CHEN Zhen-zhou; XU Ru-xiang; JIANG Xiao-dan; TENG Xiao-hua; LI Gui-tao; ZHOU Yü-xi

    2006-01-01

    Objective: To investigate telomerase activity in rabbit bone marrow stromal cells (BMSCs) during their committed differentiation in vitro along neural pathway and the effect of glial cell line-derived neurotrophic factor (GDNF) on the expression of telomerase.Methods: BMSCs were acquired from rabbit marrow and divided into control group, GDNF (10 ng/ml) group.No. ZL02134314. 4) supplemented with 10% fetal bovine serum (FBS) was used to induce BMSCs differentiation along neural pathway. Fluorescent immunocytochemistry was employed to identify the expressions of Nestin, neuronspecific endase (NSE), and gial fibrillary acidic protein (GFAP). The growth curves of the cells and the status of cell cycles were analyzed, respectively. During the differentiation, telomerase activitys were detected using the telomeric repeat amplification protocol-enzyme-linked immunosorbent assay (TRAP-ELISA).Results: BMSCs were successfully induced to differentiate along neural pathway and expressed specific markers of fetal neural epithelium, mature neuron and glial cells. Telomerase activities were undetectable in BMSCs during differentiation along neural pathway. Similar changes of cell growth curves, cell cycle status and telomerase expression were observed in the two groups.Conclusions: Rabbit BMSCs do not display telomerase activity during differentiation along neural pathway. GDNF shows little impact on proliferation and telomerase activity of BMSCs.

  6. Active Control of Sound based on Diagonal Recurrent Neural Network

    NARCIS (Netherlands)

    Jayawardhana, Bayu; Xie, Lihua; Yuan, Shuqing

    2002-01-01

    Recurrent neural network has been known for its dynamic mapping and better suited for nonlinear dynamical system. Nonlinear controller may be needed in cases where the actuators exhibit the nonlinear characteristics, or in cases when the structure to be controlled exhibits nonlinear behavior. The fe

  7. Sociocultural patterning of neural activity during self-reflection

    DEFF Research Database (Denmark)

    Ma, Yina; Bang, Dan; Wang, Chenbo

    2014-01-01

    Western cultures encourage self-construals independent of social contexts whereas East Asian cultures foster interdependent self-construals that rely on how others perceive the self. How are culturally specific self-construals mediated by the human brain? Using functional MRI, we monitored neural...

  8. Neural Activity during Encoding Predicts False Memories Created by Misinformation

    Science.gov (United States)

    Okado, Yoko; Stark, Craig E. L.

    2005-01-01

    False memories are often demonstrated using the misinformation paradigm, in which a person's recollection of a witnessed event is altered after exposure to misinformation about the event. The neural basis of this phenomenon, however, remains unknown. The authors used fMRI to investigate encoding processes during the viewing of an event and…

  9. Voltage Estimation in Active Distribution Grids Using Neural Networks

    DEFF Research Database (Denmark)

    Pertl, Michael; Heussen, Kai; Gehrke, Oliver

    2016-01-01

    the observability of distribution systems has to be improved. To increase the situational awareness of the power system operator data driven methods can be employed. These methods benefit from newly available data sources such as smart meters. This paper presents a voltage estimation method based on neural networks...

  10. The Circadian Clock, Reward, and Memory

    OpenAIRE

    Urs eAlbrecht

    2011-01-01

    During our daily activities, we experience variations in our cognitive performance, which is often accompanied by cravings for small rewards, such as consuming coffee or chocolate. This indicates that the time of day, cognitive performance, and reward may be related to one another. This review will summarize data that describe the influence of the circadian clock on addiction and mood-related behavior and put the data into perspective in relation to memory processes.

  11. The circadian clock, reward and memory

    Directory of Open Access Journals (Sweden)

    Urs eAlbrecht

    2011-11-01

    Full Text Available During our daily activities, we experience variations in our cognitive performance, which is often accompanied by cravings for small rewards, such as consuming coffee or chocolate. This indicates that the time of day, cognitive performance and reward may be related to one another. This review will summarize data that describes the influence of the circadian clock on addiction and mood-related behavior and put the data into perspective in relation to memory processes.

  12. High baseline activity in inferior temporal cortex improves neural and behavioral discriminability during visual categorization

    Directory of Open Access Journals (Sweden)

    Nazli eEmadi

    2014-11-01

    Full Text Available Spontaneous firing is a ubiquitous property of neural activity in the brain. Recent literature suggests that this baseline activity plays a key role in perception. However, it is not known how the baseline activity contributes to neural coding and behavior. Here, by recording from the single neurons in the inferior temporal cortex of monkeys performing a visual categorization task, we thoroughly explored the relationship between baseline activity, the evoked response, and behavior. Specifically we found that a low-frequency (< 8 Hz oscillation in the spike train, prior and phase-locked to the stimulus onset, was correlated with increased gamma power and neuronal baseline activity. This enhancement of the baseline activity was then followed by an increase in the neural selectivity and the response reliability and eventually a higher behavioral performance.

  13. A fast learning algorithm of neural network with tunable activation function

    Institute of Scientific and Technical Information of China (English)

    SHEN Yanjun; WANG Bingwen

    2004-01-01

    This paper presents a modified structure of a neural network with tunable activation function and provides a new learning algorithm for the neural network training. Simulation results of XOR problem, Feigenbaum function, and Henon map show that the new algorithm has better performance than BP (back propagation) algorithm in terms of shorter convergence time and higher convergence accuracy. Further modifications of the structure of the neural network with the faster learning algorithm demonstrate simpler structure with even faster convergence speed and better convergence accuracy.

  14. Active Vibration Control of the Smart Plate Using Artificial Neural Network Controller

    Directory of Open Access Journals (Sweden)

    Mohit

    2015-01-01

    Full Text Available The active vibration control (AVC of a rectangular plate with single input and single output approach is investigated using artificial neural network. The cantilever plate of finite length, breadth, and thickness having piezoelectric patches as sensors/actuators fixed at the upper and lower surface of the metal plate is considered for examination. The finite element model of the cantilever plate is utilized to formulate the whole strategy. The compact RIO and MATLAB simulation software are exercised to get the appropriate results. The cantilever plate is subjected to impulse input and uniform white noise disturbance. The neural network is trained offline and tuned with LQR controller. The various training algorithms to tune the neural network are exercised. The best efficient algorithm is finally considered to tune the neural network controller designed for active vibration control of the smart plate.

  15. In vivo blockade of neural activity alters dendritic development of neonatal CA1 pyramidal cells.

    Science.gov (United States)

    Groc, Laurent; Petanjek, Zdravko; Gustafsson, Bengt; Ben-Ari, Yehezkel; Hanse, Eric; Khazipov, Roustem

    2002-11-01

    During development, neural activity has been proposed to promote neuronal growth. During the first postnatal week, the hippocampus is characterized by an oscillating neural network activity and a rapid neuronal growth. In the present study we tested in vivo, by injecting tetanus toxin into the hippocampus of P1 rats, whether this neural activity indeed promotes growth of pyramidal cells. We have previously shown that tetanus toxin injection leads to a strong reduction in the frequency of spontaneous GABA and glutamatergic synaptic currents, and to a complete blockade of the early neural network activity during the first postnatal week. Morphology of neurobiotin-filled CA1 pyramidal cells was analyzed at the end of the first postnatal week (P6-10). In activity-reduced neurons, the total length of basal dendritic tree was three times less than control. The number, but not the length, of basal dendritic branches was affected. The growth impairment was restricted to the basal dendrites. The apical dendrite, the axons, or the soma grew normally during activity deprivation. Thus, the in vivo neural activity in the neonate hippocampus seems to promote neuronal growth by initiating novel branches.

  16. A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects.

    Science.gov (United States)

    Truccolo, Wilson; Eden, Uri T; Fellows, Matthew R; Donoghue, John P; Brown, Emery N

    2005-02-01

    Multiple factors simultaneously affect the spiking activity of individual neurons. Determining the effects and relative importance of these factors is a challenging problem in neurophysiology. We propose a statistical framework based on the point process likelihood function to relate a neuron's spiking probability to three typical covariates: the neuron's own spiking history, concurrent ensemble activity, and extrinsic covariates such as stimuli or behavior. The framework uses parametric models of the conditional intensity function to define a neuron's spiking probability in terms of the covariates. The discrete time likelihood function for point processes is used to carry out model fitting and model analysis. We show that, by modeling the logarithm of the conditional intensity function as a linear combination of functions of the covariates, the discrete time point process likelihood function is readily analyzed in the generalized linear model (GLM) framework. We illustrate our approach for both GLM and non-GLM likelihood functions using simulated data and multivariate single-unit activity data simultaneously recorded from the motor cortex of a monkey performing a visuomotor pursuit-tracking task. The point process framework provides a flexible, computationally efficient approach for maximum likelihood estimation, goodness-of-fit assessment, residual analysis, model selection, and neural decoding. The framework thus allows for the formulation and analysis of point process models of neural spiking activity that readily capture the simultaneous effects of multiple covariates and enables the assessment of their relative importance.

  17. Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis.

    Science.gov (United States)

    Chase, Henry W; Kumar, Poornima; Eickhoff, Simon B; Dombrovski, Alexandre Y

    2015-06-01

    Reinforcement learning describes motivated behavior in terms of two abstract signals. The representation of discrepancies between expected and actual rewards/punishments-prediction error-is thought to update the expected value of actions and predictive stimuli. Electrophysiological and lesion studies have suggested that mesostriatal prediction error signals control behavior through synaptic modification of cortico-striato-thalamic networks. Signals in the ventromedial prefrontal and orbitofrontal cortex are implicated in representing expected value. To obtain unbiased maps of these representations in the human brain, we performed a meta-analysis of functional magnetic resonance imaging studies that had employed algorithmic reinforcement learning models across a variety of experimental paradigms. We found that the ventral striatum (medial and lateral) and midbrain/thalamus represented reward prediction errors, consistent with animal studies. Prediction error signals were also seen in the frontal operculum/insula, particularly for social rewards. In Pavlovian studies, striatal prediction error signals extended into the amygdala, whereas instrumental tasks engaged the caudate. Prediction error maps were sensitive to the model-fitting procedure (fixed or individually estimated) and to the extent of spatial smoothing. A correlate of expected value was found in a posterior region of the ventromedial prefrontal cortex, caudal and medial to the orbitofrontal regions identified in animal studies. These findings highlight a reproducible motif of reinforcement learning in the cortico-striatal loops and identify methodological dimensions that may influence the reproducibility of activation patterns across studies.

  18. Explorative data analysis for changes in neural activity

    Science.gov (United States)

    Blythe, Duncan A. J.; Meinecke, Frank C.; von Bünau, Paul; Müller, Klaus-Robert

    2013-04-01

    Neural recordings are non-stationary time series, i.e. their properties typically change over time. Identifying specific changes, e.g., those induced by a learning task, can shed light on the underlying neural processes. However, such changes of interest are often masked by strong unrelated changes, which can be of physiological origin or due to measurement artifacts. We propose a novel algorithm for disentangling such different causes of non-stationarity and in this manner enable better neurophysiological interpretation for a wider set of experimental paradigms. A key ingredient is the repeated application of Stationary Subspace Analysis (SSA) using different temporal scales. The usefulness of our explorative approach is demonstrated in simulations, theory and EEG experiments with 80 brain-computer interfacing subjects.

  19. Serotonin activates overall feeding by activating two separate neural pathways in Caenorhabditis elegans.

    Science.gov (United States)

    Song, Bo-mi; Avery, Leon

    2012-02-08

    Food intake in the nematode Caenorhabditis elegans requires two distinct feeding motions, pharyngeal pumping and isthmus peristalsis. Bacteria, the natural food of C. elegans, activate both feeding motions (Croll, 1978; Horvitz et al., 1982; Chiang et al., 2006). The mechanisms by which bacteria activate the feeding motions are largely unknown. To understand the process, we studied how serotonin, an endogenous pharyngeal pumping activator whose action is triggered by bacteria, activates feeding motions. Here, we show that serotonin, like bacteria, activates overall feeding by activating isthmus peristalsis as well as pharyngeal pumping. During active feeding, the frequencies and the timing of onset of the two motions were distinct, but each isthmus peristalsis was coupled to the preceding pump. We found that serotonin activates the two feeding motions mainly by activating two separate neural pathways in response to bacteria. For activating pumping, the SER-7 serotonin receptor in the MC motor neurons in the feeding organ activated cholinergic transmission from MC to the pharyngeal muscles by activating the Gsα signaling pathway. For activating isthmus peristalsis, SER-7 in the M4 (and possibly M2) motor neuron in the feeding organ activated the G(12)α signaling pathway in a cell-autonomous manner, which presumably activates neurotransmission from M4 to the pharyngeal muscles. Based on our results and previous calcium imaging of pharyngeal muscles (Shimozono et al., 2004), we propose a model that explains how the two feeding motions are separately regulated yet coupled. The feeding organ may have evolved this way to support efficient feeding.

  20. Integrative activity of neural networks may code virtual spaces with internal representations.

    Science.gov (United States)

    Strelnikov, Kuzma

    2014-10-01

    It was shown recently in neuroimaging that spatial differentiation of brain activity provides novel information about brain function. This confirms the integrative organisation of brain activity, but given present technical limitations of neuroimaging approaches, the exact role of integrative activity remains unclear. We trained a neural network to integrate information using random numbers so as to imitate the "centre-periphery" pattern of brain activity in neuroimaging. Only the hierarchical organisation of the network permitted the learning of fast and reliable integration. We presented images to the trained network and, by spatial differentiation of the network activity, obtained virtual spaces with the presented images. Thus, our study established the necessity of the hierarchical organisation of neural networks for integration and demonstrated that the role of neural integration in the brain may be to create virtual spaces with internal representations of the objects.

  1. Coupling Strength and System Size Induce Firing Activity of Globally Coupled Neural Network

    Institute of Scientific and Technical Information of China (English)

    WEI Du-Qu; LUO Xiao-Shu; ZOU Yan-Li

    2008-01-01

    We investigate how firing activity of globally coupled neural network depends on the coupling strength C and system size N.Network elements are described by space-clamped FitzHugh-Nagumo (SCFHN) neurons with the values of parameters at which no firing activity occurs.It is found that for a given appropriate coupling strength,there is an intermediate range of system size where the firing activity of globally coupled SCFHN neural network is induced and enhanced.On the other hand,for a given intermediate system size level,there ex/sts an optimal value of coupling strength such that the intensity of firing activity reaches its maximum.These phenomena imply that the coupling strength and system size play a vital role in firing activity of neural network.

  2. The affective impact of financial skewness on neural activity and choice.

    Science.gov (United States)

    Wu, Charlene C; Bossaerts, Peter; Knutson, Brian

    2011-02-15

    Few finance theories consider the influence of "skewness" (or large and asymmetric but unlikely outcomes) on financial choice. We investigated the impact of skewed gambles on subjects' neural activity, self-reported affective responses, and subsequent preferences using functional magnetic resonance imaging (FMRI). Neurally, skewed gambles elicited more anterior insula activation than symmetric gambles equated for expected value and variance, and positively skewed gambles also specifically elicited more nucleus accumbens (NAcc) activation than negatively skewed gambles. Affectively, positively skewed gambles elicited more positive arousal and negatively skewed gambles elicited more negative arousal than symmetric gambles equated for expected value and variance. Subjects also preferred positively skewed gambles more, but negatively skewed gambles less than symmetric gambles of equal expected value. Individual differences in both NAcc activity and positive arousal predicted preferences for positively skewed gambles. These findings support an anticipatory affect account in which statistical properties of gambles--including skewness--can influence neural activity, affective responses, and ultimately, choice.

  3. Light-induced Notch activity controls neurogenic and gliogenic potential of neural progenitors.

    Science.gov (United States)

    Kim, Kyung-Tai; Song, Mi-Ryoung

    2016-10-28

    Oscillations in Notch signaling are essential for reserving neural progenitors for cellular diversity in developing brains. Thus, steady and prolonged overactivation of Notch signaling is not suitable for generating neurons. To acquire greater temporal control of Notch activity and mimic endogenous oscillating signals, here we adopted a light-inducible transgene system to induce active form of Notch NICD in neural progenitors. Alternating Notch activity saved more progenitors that are prone to produce neurons creating larger number of mixed clones with neurons and progenitors in vitro, compared to groups with no light or continuous light stimulus. Furthermore, more upper layer neurons and astrocytes arose upon intermittent Notch activity, indicating that dynamic Notch activity maintains neural progeny and fine-tune neuron-glia diversity.

  4. The impact of cancer on the neural activity

    CERN Document Server

    Iarosz, Kelly Cristiane; Baptista, Murilo da Silva; Protachevicz, Paulo Ricardo

    2015-01-01

    We study the impact of the decrease in the neural population on the neuronal firing rate. We propose a cellular automaton model from cancerous growth in a brain tissue and the death of neurons due absence of cells that help support to neurons. We use this model to study how the firing rate changes when the neuronal networks is under different external stimuli and the cancerous cells have different proliferation rate. Our work shows that the cancer proliferation decreases the neuronal firing rate.

  5. Active control of vibration using a neural network.

    Science.gov (United States)

    Snyder, S D; Tanaka, N

    1995-01-01

    Feedforward control of sound and vibration using a neural network-based control system is considered, with the aim being to derive an architecture/algorithm combination which is capable of supplanting the commonly used finite impulse response filter/filtered-x least mean square (LMS) linear arrangement for certain nonlinear problems. An adaptive algorithm is derived which enables stable adaptation of the neural controller for this purpose, while providing the capacity to maintain causality within the control scheme. The algorithm is shown to be simply a generalization of the linear filtered-x LMS algorithm. Experiments are undertaken which demonstrate the utility of the proposed arrangement, showing that it performs as well as a linear control system for a linear control problem and better for a nonlinear control problem. The experiments also lead to the conclusion that more work is required to improve the predictability and consistency of the performance before the neural network controller becomes a practical alternative to the current linear feedforward systems.

  6. Cannabinoid modulation of drug reward and the implications of marijuana legalization.

    Science.gov (United States)

    Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

    2015-12-02

    Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction.

  7. Assessing fear following retrieval+extinction through suppression of baseline reward seeking vs. freezing

    Directory of Open Access Journals (Sweden)

    Jason eShumake

    2015-12-01

    Full Text Available Freezing has become the predominant measure used in rodent studies of conditioned fear, but conditioned suppression of reward-seeking behavior may provide a measure that is more relevant to human anxiety disorders; that is, a measure of how fear interferes with the enjoyment of pleasurable activities. Previous work has found that an isolated presentation of a fear conditioned stimulus prior to extinction training (retrieval + extinction results in a more robust and longer-lasting reduction in fear. The objective of this study was to assess whether the retrieval + extinction effect is evident using conditioned suppression of reward seeking, operationalized as a reduction in baseline licking (without prior water deprivation for a 10% sucrose solution. We found that, compared to freezing, conditioned suppression of reward seeking was much more sensitive to fear conditioning and far less responsive to extinction training. As in previous work, we found that retrieval + extinction reduced post-extinction fear reinstatement when measured as freezing, but it did not reduce fear reinstatement when measured as conditioned suppression. This suggests that there is still residual fear following retrieval + extinction, or that this procedure only modifies memory traces in neural circuits relevant to the expression of freezing, but not to the suppression of reward seeking.

  8. Fractal patterns of neural activity exist within the suprachiasmatic nucleus and require extrinsic network interactions.

    Science.gov (United States)

    Hu, Kun; Meijer, Johanna H; Shea, Steven A; vanderLeest, Henk Tjebbe; Pittman-Polletta, Benjamin; Houben, Thijs; van Oosterhout, Floor; Deboer, Tom; Scheer, Frank A J L

    2012-01-01

    The mammalian central circadian pacemaker (the suprachiasmatic nucleus, SCN) contains thousands of neurons that are coupled through a complex network of interactions. In addition to the established role of the SCN in generating rhythms of ~24 hours in many physiological functions, the SCN was recently shown to be necessary for normal self-similar/fractal organization of motor activity and heart rate over a wide range of time scales--from minutes to 24 hours. To test whether the neural network within the SCN is sufficient to generate such fractal patterns, we studied multi-unit neural activity of in vivo and in vitro SCNs in rodents. In vivo SCN-neural activity exhibited fractal patterns that are virtually identical in mice and rats and are similar to those in motor activity at time scales from minutes up to 10 hours. In addition, these patterns remained unchanged when the main afferent signal to the SCN, namely light, was removed. However, the fractal patterns of SCN-neural activity are not autonomous within the SCN as these patterns completely broke down in the isolated in vitro SCN despite persistence of circadian rhythmicity. Thus, SCN-neural activity is fractal in the intact organism and these fractal patterns require network interactions between the SCN and extra-SCN nodes. Such a fractal control network could underlie the fractal regulation observed in many physiological functions that involve the SCN, including motor control and heart rate regulation.

  9. Temporal coupling between stimulus-evoked neural activity and hemodynamic responses from individual cortical columns

    Energy Technology Data Exchange (ETDEWEB)

    Bruyns-Haylett, Michael; Zheng Ying; Berwick, Jason; Jones, Myles [The Centre for Signal Processing in Neuroimaging and Systems Neuroscience (SPINSN), Department of Psychology, University of Sheffield, Western Bank, Sheffield S10 2TP (United Kingdom)], E-mail: m.jones@sheffield.ac.uk

    2010-04-21

    Using previously published data from the whisker barrel cortex of anesthetized rodents (Berwick et al 2008 J. Neurophysiol. 99 787-98) we investigated whether highly spatially localized stimulus-evoked cortical hemodynamics responses displayed a linear time-invariant (LTI) relationship with neural activity. Presentation of stimuli to individual whiskers of 2 s and 16 s durations produced hemodynamics and neural activity spatially localized to individual cortical columns. Two-dimensional optical imaging spectroscopy (2D-OIS) measured hemoglobin responses, while multi-laminar electrophysiology recorded neural activity. Hemoglobin responses to 2 s stimuli were deconvolved with underlying evoked neural activity to estimate impulse response functions which were then convolved with neural activity evoked by 16 s stimuli to generate predictions of hemodynamic responses. An LTI system more adequately described the temporal neuro-hemodynamics coupling relationship for these spatially localized sensory stimuli than in previous studies that activated the entire whisker cortex. An inability to predict the magnitude of an initial 'peak' in the total and oxy- hemoglobin responses was alleviated when excluding responses influenced by overlying arterial components. However, this did not improve estimation of the hemodynamic responses return to baseline post-stimulus cessation.

  10. Dynamical Behaviors of Multiple Equilibria in Competitive Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions.

    Science.gov (United States)

    Nie, Xiaobing; Zheng, Wei Xing

    2016-03-01

    This paper addresses the problem of coexistence and dynamical behaviors of multiple equilibria for competitive neural networks. First, a general class of discontinuous nonmonotonic piecewise linear activation functions is introduced for competitive neural networks. Then based on the fixed point theorem and theory of strict diagonal dominance matrix, it is shown that under some conditions, such n -neuron competitive neural networks can have 5(n) equilibria, among which 3(n) equilibria are locally stable and the others are unstable. More importantly, it is revealed that the neural networks with the discontinuous activation functions introduced in this paper can have both more total equilibria and locally stable equilibria than the ones with other activation functions, such as the continuous Mexican-hat-type activation function and discontinuous two-level activation function. Furthermore, the 3(n) locally stable equilibria given in this paper are located in not only saturated regions, but also unsaturated regions, which is different from the existing results on multistability of neural networks with multiple level activation functions. A simulation example is provided to illustrate and validate the theoretical findings.

  11. Memory Consolidation and Neural Substrate of Reward

    Directory of Open Access Journals (Sweden)

    Mañas, Mauro

    2012-08-01

    Full Text Available Prematurity is one of the most relevant health problems among children in the developed countries. Around 8 to 10% of children birth before the 37 week and/or with a very low birth weight (VLBW (1500 g. This causes 75% of the prenatal mortality and the 50% of the children disability. The aim of this study was to assess neuropsychological and emotional impairments in 7 year old children who were born VLBW. A clinical interview, the Children Neuropsychological Assessment Battery, and the Behavioral Assessment System for Children (BASC were administrated. VLBW children showed memory and executive function deficits, as well as, behavioral and attention problems. These results highlight the importance of long term follow up of the VLBW children and point out the necessity of developing adequate neuropsychological and emotional treatment program for these children.

  12. Diverse sources of reward value signals in the basal ganglia nuclei transmitted to the lateral habenula in the monkey

    Directory of Open Access Journals (Sweden)

    Simon eHong

    2013-11-01

    Full Text Available The lateral habenula (LHb plays an important role in motivational decision making. Neurons in the primate LHb signal negative ‘reward prediction errors’ and inhibit midbrain dopamine (DA neurons. These negative reward prediction error signals in the LHb are, at least partly, provided by a distinct group of neurons in the border region of the globus pallidus internal segment (GPb. However, it is still unclear whether other basal ganglia nuclei provide the LHb with reward signals, either through the GPb or through different circuits. As a first step to answer this question, we electrically stimulated various parts of the basal ganglia and monitored the neural activity in the LHb in the awake monkey. First, we found that low intensity stimulations in the GPb and the internal segment of the globus pallidus (GPi evoked a short latency (5 ms excitatory response in LHb neurons. Second, LHb neurons were inhibited by stimulations in the ventral pallidum (VP. These results suggest that reward-related signals are transmitted to the LHb mainly through excitatory connections from the GPb and inhibitory connections from the VP. Finally, excitations or inhibitions are induced in LHb neurons from diverse but patchy regions in the striatum. These effects have considerably longer latencies, suggesting that they may be mediated by the GPb or the VP. The patchy nature of the stimulation effect raises the possibility that the striosomes are the source of reward-related signals transmitted to the LHb.

  13. Linking online gaming and addictive behavior: converging evidence for a general reward deficiency in frequent online gamers.

    Science.gov (United States)

    Hahn, Tim; Notebaert, Karolien Hilde; Dresler, Thomas; Kowarsch, Linda; Reif, Andreas; Fallgatter, Andreas J

    2014-01-01

    Millions of people regularly play so-called massively multiplayer online role playing games (MMORPGs). Recently, it has been argued that MMORPG overuse is becoming a significant health problem worldwide. Symptoms such as tolerance, withdrawal, and craving have been described. Based on behavioral, resting state, and task-related neuroimaging data, we test whether frequent players of the MMORPG "World of Warcraft" (WoW) - similar to drug addicts and individuals with an increased risk for addictions - show a generally deficient reward system. In frequent players of the MMORPG "World of Warcraft" (WoW-players) and in a control group of non-gamers we assessed (1) trait sensitivity to reward (SR), (2) BOLD responses during monetary reward processing in the ventral striatum, and (3) ventral-striatal resting-state dynamics. We found a decreased neural activation in the ventral striatum during the anticipation of both small and large monetary rewards. Additionally, we show generally altered neurodynamics in this region independent of any specific task for WoW players (resting state). On the behavioral level, we found differences in trait SR, suggesting that the reward processing deficiencies found in this study are not a consequence of gaming, but predisposed to it. These findings empirically support a direct link between frequent online gaming and the broad field of behavioral and drug addiction research, thus opening new avenues for clinical interventions in addicted gamers and potentially improving the assessment of addiction-risk in the vast population of frequent gamers.

  14. Multistability and Instability of Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions.

    Science.gov (United States)

    Nie, Xiaobing; Zheng, Wei Xing

    2015-11-01

    In this paper, we discuss the coexistence and dynamical behaviors of multiple equilibrium points for recurrent neural networks with a class of discontinuous nonmonotonic piecewise linear activation functions. It is proved that under some conditions, such n -neuron neural networks can have at least 5(n) equilibrium points, 3(n) of which are locally stable and the others are unstable, based on the contraction mapping theorem and the theory of strict diagonal dominance matrix. The investigation shows that the neural networks with the discontinuous activation functions introduced in this paper can have both more total equilibrium points and more locally stable equilibrium points than the ones with continuous Mexican-hat-type activation function or discontinuous two-level activation functions. An illustrative example with computer simulations is presented to verify the theoretical analysis.

  15. Increased neural activity of a mushroom body neuron subtype in the brains of forager honeybees.

    Directory of Open Access Journals (Sweden)

    Taketoshi Kiya

    Full Text Available Honeybees organize a sophisticated society, and the workers transmit information about the location of food sources using a symbolic dance, known as 'dance communication'. Recent studies indicate that workers integrate sensory information during foraging flight for dance communication. The neural mechanisms that account for this remarkable ability are, however, unknown. In the present study, we established a novel method to visualize neural activity in the honeybee brain using a novel immediate early gene, kakusei, as a marker of neural activity. The kakusei transcript was localized in the nuclei of brain neurons and did not encode an open reading frame, suggesting that it functions as a non-coding nuclear RNA. Using this method, we show that neural activity of a mushroom body neuron subtype, the small-type Kenyon cells, is prominently increased in the brains of dancer and forager honeybees. In contrast, the neural activity of the two mushroom body neuron subtypes, the small-and large-type Kenyon cells, is increased in the brains of re-orienting workers, which memorize their hive location during re-orienting flights. These findings demonstrate that the small-type Kenyon cell-preferential activity is associated with foraging behavior, suggesting its involvement in information integration during foraging flight, which is an essential basis for dance communication.

  16. Perceptual similarity of visual patterns predicts dynamic neural activation patterns measured with MEG.

    Science.gov (United States)

    Wardle, Susan G; Kriegeskorte, Nikolaus; Grootswagers, Tijl; Khaligh-Razavi, Seyed-Mahdi; Carlson, Thomas A

    2016-05-15

    Perceptual similarity is a cognitive judgment that represents the end-stage of a complex cascade of hierarchical processing throughout visual cortex. Previous studies have shown a correspondence between the similarity of coarse-scale fMRI activation patterns and the perceived similarity of visual stimuli, suggesting that visual objects that appear similar also share similar underlying patterns of neural activation. Here we explore the temporal relationship between the human brain's time-varying representation of visual patterns and behavioral judgments of perceptual similarity. The visual stimuli were abstract patterns constructed from identical perceptual units (oriented Gabor patches) so that each pattern had a unique global form or perceptual 'Gestalt'. The visual stimuli were decodable from evoked neural activation patterns measured with magnetoencephalography (MEG), however, stimuli differed in the similarity of their neural representation as estimated by differences in decodability. Early after stimulus onset (from 50ms), a model based on retinotopic organization predicted the representational similarity of the visual stimuli. Following the peak correlation between the retinotopic model and neural data at 80ms, the neural representations quickly evolved so that retinotopy no longer provided a sufficient account of the brain's time-varying representation of the stimuli. Overall the strongest predictor of the brain's representation was a model based on human judgments of perceptual similarity, which reached the limits of the maximum correlation with the neural data defined by the 'noise ceiling'. Our results show that large-scale brain activation patterns contain a neural signature for the perceptual Gestalt of composite visual features, and demonstrate a strong correspondence between perception and complex patterns of brain activity.

  17. Neural networks with non-smooth and impact activations

    CERN Document Server

    Akhmet, M U

    2011-01-01

    In this paper, we consider a model of impulsive recurrent neural networks with piecewise constant delay. The dynamics are presented by differential equations with discontinuities such as impulses at fixed moments and piecewise constant argument of generalized type. Sufficient conditions ensuring the existence, uniqueness and global asymptotic stability of the equilibrium point are obtained. By employing Green's function we derive new result of existence of the periodic solution. The global asymptotic stability of the solution is investigated. Examples with numerical simulations are given to validate the theoretical results.

  18. A pilot study linking reduced fronto-striatal recruitment during reward processing to persistent bingeing following treatment for binge-eating disorder

    Science.gov (United States)

    Balodis, Iris M.; Grilo, Carlos M.; Kober, Hedy; Worhunsky, Patrick D.; White, Marney A.; Stevens, Michael C.; Pearlson, Godfrey D.; Potenza, Marc N.

    2013-01-01

    Objective The primary purpose of this study was to examine neurobiological underpinnings of reward processing that may relate to treatment outcome for binge-eating disorder (BED). Method Prior to starting treatment, nineteen obese persons seeking treatment for BED performed a monetary incentive delay task during functional magnetic resonance imaging (fMRI). Analyses examined how the neural correlates of reward processing related to binge-eating status after four-month of treatment. Results Ten individuals continued to report binge- eating (BEpost-tx) following treatment and nine individuals did not (NBEpost-tx). The groups did not differ in body mass index. The BEpost-tx group relative to the NBEpost-tx group showed diminished recruitment of the ventral striatum and the inferior frontal gyrus during the anticipatory phase of reward processing and reduced activity in the medial prefrontal cortex during the outcome phase of reward processing. Discussion These results link brain reward circuitry to treatment outcome in BED and suggest that specific brain regions underlying reward processing may represent important therapeutic targets in BED. PMID:24729034

  19. Strategies influence neural activity for feedback learning across child and adolescent development.

    Science.gov (United States)

    Peters, Sabine; Koolschijn, P Cédric M P; Crone, Eveline A; Van Duijvenvoorde, Anna C K; Raijmakers, Maartje E J

    2014-09-01

    Learning from feedback is an important aspect of executive functioning that shows profound improvements during childhood and adolescence. This is accompanied by neural changes in the feedback-learning network, which includes pre-supplementary motor area (pre- SMA)/anterior cingulate cortex (ACC), dorsolateral prefrontal cortex (DLPFC), superior parietal cortex (SPC), and the basal ganglia. However, there can be considerable differences within age ranges in performance that are ascribed to differences in strategy use. This is problematic for traditional approaches of analyzing developmental data, in which age groups are assumed to be homogenous in strategy use. In this study, we used latent variable models to investigate if underlying strategy groups could be detected for a feedback-learning task and whether there were differences in neural activation patterns between strategies. In a sample of 268 participants between ages 8 to 25 years, we observed four underlying strategy groups, which were cut across age groups and varied in the optimality of executive functioning. These strategy groups also differed in neural activity during learning; especially the most optimal performing group showed more activity in DLPFC, SPC and pre-SMA/ACC compared to the other groups. However, age differences remained an important contributor to neural activation, even when correcting for strategy. These findings contribute to the debate of age versus performance predictors of neural development, and highlight the importance of studying individual differences in strategy use when studying development.

  20. Evaluation of Neural Networks Performance in Active Cancellation of Acoustic Noise

    Directory of Open Access Journals (Sweden)

    Mehrshad Salmasi,

    2014-12-01

    Full Text Available Active Noise Control (ANC works on the principle of destructive interference between the primary disturbance field heard as undesired noise and the secondary field which is generated from control actuators. In the simplest system, the disturbance field can be a simple sine wave, and the secondary field is the same sine wave but 180 degrees out of phase. This research presents an investigation on the use of different types of neural networks in active noise control. Performance of the multilayer perceptron (MLP, Elman and generalized regression neural networks (GRNN in active cancellation of acoustic noise signals is investigated and compared in this paper. Acoustic noise signals are selected from a Signal Processing Information Base (SPIB database. In order to compare the networks appropriately, similar structures and similar training and test samples are deduced for neural networks. The simulation results show that MLP, GRNN, and Elman neural networks present proper performance in active cancellation of acoustic noise. It is concluded that Elman and MLP neural networks have better performance than GRNN in noise attenuation. It is demonstrated that designed ANC system achieve good noise reduction in low frequencies.

  1. A new scale for measuring reward responsiveness

    Directory of Open Access Journals (Sweden)

    Ivo Van Den Berg

    2010-12-01

    Full Text Available Several psychological theories assume that there are two basic brain mechanisms that guide behavior: an avoidance or inhibition system, which is responsive to signals of punishment, and an approach or activation system, which is sensitive to signals of reward. Several self-report scales have been developed to assess the sensitivity to punishment and reward, and these instruments have been shown to be useful in research on personality, psychopathology, and underlying biological substrates. However, it is also true that in particular scales for measuring reward responsiveness suffer from various inadequacies. Therefore, a new Reward Responsiveness (RR scale was developed and subjected to an extensive psychometric evaluation. The results show that this scale measures a single factor, reward responsiveness that is clearly independent of punishment sensitivity. Further, the data indicated that the internal consistency, convergent validity, discriminant validity, test-retest reliability, and predictive properties of the new scale were all adequate. It can be concluded that the RR scale is a psychometrically sound instrument that may be useful for researchers with interest in the personality construct of reward responsiveness.

  2. Control of a Shunt Active Power Filter with Neural Networks—Theory and Practical Results

    Science.gov (United States)

    Villalva, Marcelo G.; Filho, Ernesto Ruppert

    This paper presents theoretical studies and practical results obtained with a four-wire shunt active power filter fully controlled with neural networks. The paper is focused on a current compensation method based on adaptive linear elements (adalines), which are powerful and easy-to-use neural networks. The reader will find here an introduction about these networks, an explanatory section about the achievement of Fourier series with adalines, and the full description of an adaline-based selective current compensator. The paper also brings a quick discussion about the use of a feedforward neural network in the current controller of the active filter, as well as simulation and experimental results obtained with the prototype of an active power filter.

  3. New exponential synchronization criteria for time-varying delayed neural networks with discontinuous activations.

    Science.gov (United States)

    Cai, Zuowei; Huang, Lihong; Zhang, Lingling

    2015-05-01

    This paper investigates the problem of exponential synchronization of time-varying delayed neural networks with discontinuous neuron activations. Under the extended Filippov differential inclusion framework, by designing discontinuous state-feedback controller and using some analytic techniques, new testable algebraic criteria are obtained to realize two different kinds of global exponential synchronization of the drive-response system. Moreover, we give the estimated rate of exponential synchronization which depends on the delays and system parameters. The obtained results extend some previous works on synchronization of delayed neural networks not only with continuous activations but also with discontinuous activations. Finally, numerical examples are provided to show the correctness of our analysis via computer simulations. Our method and theoretical results have a leading significance in the design of synchronized neural network circuits involving discontinuous factors and time-varying delays.

  4. Vascular Endothelial Growth Factor Receptor 3 Controls Neural Stem Cell Activation in Mice and Humans

    Directory of Open Access Journals (Sweden)

    Jinah Han

    2015-02-01

    Full Text Available Neural stem cells (NSCs continuously produce new neurons within the adult mammalian hippocampus. NSCs are typically quiescent but activated to self-renew or differentiate into neural progenitor cells. The molecular mechanisms of NSC activation remain poorly understood. Here, we show that adult hippocampal NSCs express vascular endothelial growth factor receptor (VEGFR 3 and its ligand VEGF-C, which activates quiescent NSCs to enter the cell cycle and generate progenitor cells. Hippocampal NSC activation and neurogenesis are impaired by conditional deletion of Vegfr3 in NSCs. Functionally, this is associated with compromised NSC activation in response to VEGF-C and physical activity. In NSCs derived from human embryonic stem cells (hESCs, VEGF-C/VEGFR3 mediates intracellular activation of AKT and ERK pathways that control cell fate and proliferation. These findings identify VEGF-C/VEGFR3 signaling as a specific regulator of NSC activation and neurogenesis in mammals.

  5. Delay discounting without decision-making: Medial prefrontal cortex and amygdala activations reflect immediacy processing and correlate with impulsivity and anxious-depressive traits

    Directory of Open Access Journals (Sweden)

    Vera eLudwig

    2015-10-01

    Full Text Available Humans value rewards less when these are delivered in the future as opposed to immediately, a phenomenon referred to as delay discounting. While delay discounting has been studied during the anticipation of rewards and in the context of intertemporal decision-making, little is known about its neural correlates in the outcome phase (during reward delivery and their relation to personality. Personality traits that have been associated with increased delay discounting include impulsivity and, potentially, anxious-depressive traits. Here we performed functional magnetic resonance imaging (fMRI in 72 healthy participants while they carried out a monetary incentive delay task with a delay manipulation. In sixty percent of the experimental trials, participants won rewards that differed in magnitude (0.05€, 0.50€ or 1€ and delay until delivery (immediately, 10 days, or 100 days. A factor analysis on questionnaires yielded two factors reflecting Impulsivity and Anxiety/Depression, which we used to examine potential relationships between personality and delay discounting. When winning a reward, medial prefrontal cortex (mPFC activation was higher for immediate compared to delayed rewards. Moreover, amygdala activation correlated with reward magnitude for immediate but not for delayed rewards. Amygdala activation to winning immediate rewards was higher in more impulsive participants, while mPFC activation to winning immediate rewards was higher in more anxious-depressed participants. Our results uncover neural correlates of delay discounting during reward delivery, and suggest that impulsivity and subclinical anxious-depressive traits are related to stronger neural responses for winning immediate relative to delayed rewards.

  6. Neural activation during submaximal contractions seems more reflective of neuromuscular ageing than maximal voluntary activation

    Directory of Open Access Journals (Sweden)

    Gil eScaglioni

    2016-02-01

    Full Text Available This study aimed at testing the hypothesis that differences in neural activation strategy during submaximal but not maximal plantarflexions exist between young and older men. Eleven young men (YM, 26±4 yr and 13 OM (76±3 yr volunteered for the investigation. Maximal voluntary torque (MVT was 38.2%, lower (P<0.001 in OM than in YM, while voluntary activation was equivalent (~97%. The relationship between the interpolated twitch-torque and the voluntary torque (IT-VT relationship was composite (curvilinear+exponential for both age-groups. However, the OM showed accentuated concavity, as attested by the occurrence of the deviation from linearity at a lower contraction intensity (OM: 54.9 vs. YM: 71.9% MVT. In conclusion, ageing does not affect the capacity to fully activate the plantar flexors during maximal performances, but it alters the activation pattern for submaximal levels of effort. The greater age-related concavity of the IT-VT relationship suggests that, during submaximal contractions, OM need to reach a level of activation higher than YM to develop an equivalent relative torque.

  7. 食物奖赏和渴求行为相关的大鼠左侧眶额叶皮质Delta频段脑电活动%Delta EEG Activity in Left Orbitofrontal Cortex in Rats Related to Food Reward and Craving

    Institute of Scientific and Technical Information of China (English)

    付玉; 陈艳梅; 曾涛; 彭沿平; 田绍华; 马原野

    2008-01-01

    The orbitofrontal cortex (OFC) is particularly important for the neural representation of reward value. Previous studies indicated that electroencephalogram (EEG) activity in the OFC was involved in drug administration and withdrawal. The present study investigated EEG activity in the OFC in rats during the development of food reward and craving. Two environments were used separately for control and food-related EEG recordings. In the food-related environment rats were first trained to eat chocolate peanuts; then they either had no access to this food, but could see and smell it (craving trials), or had free access to this food (reward trials). The EEG in the left OFC was recorded during these trials. We showed that, in the food-related environment the EEG activity peaking in the delta band (2-4Hz) was significantly correlated with the stimulus, increasing during food reward and decreasing during food craving when compared with that in the control environment. Our data suggests that EEG activity in the OFC can be altered by food reward; moreover, delta rhythm in this region could be used as an index monitoring changed signal underlying this reward.%眶额叶皮质与中脑边缘多巴胺奖赏系统有着复杂的相互纤维联系.先前的研究探讨了药物成瘾过程中眶额叶皮质的脑电活动.在本实验中,将探讨食物奖赏和渴求过程中该皮质的脑电活动.实验采用了两个环境:对照环境和食物刺激相关的环境.首先,训练大鼠在食物刺激相关的环境中吃巧克力花生豆,而后在该环境中设置两种不同的刺激方式:能看到和闻到但不能吃到(渴求实验),或者仍旧可以吃到巧克力花生豆(奖赏实验):同时进行左侧眶额叶皮质的脑电记录.结果发现,在食物刺激相关的环境中大鼠Delta频段(2-4Hz)的脑电活动与食物刺激显著相关,此外,与在对照环境中相比,其相对功率在食物渴求时下降而在食物奖赏时升高.本实验表明,食

  8. Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation.

    Science.gov (United States)

    Li, Shuai; Li, Yangming

    2013-10-28

    The Sylvester equation is often encountered in mathematics and control theory. For the general time-invariant Sylvester equation problem, which is defined in the domain of complex numbers, the Bartels-Stewart algorithm and its extensions are effective and widely used with an O(n³) time complexity. When applied to solving the time-varying Sylvester equation, the computation burden increases intensively with the decrease of sampling period and cannot satisfy continuous realtime calculation requirements. For the special case of the general Sylvester equation problem defined in the domain of real numbers, gradient-based recurrent neural networks are able to solve the time-varying Sylvester equation in real time, but there always exists an estimation error while a recently proposed recurrent neural network by Zhang et al [this type of neural network is called Zhang neural network (ZNN)] converges to the solution ideally. The advancements in complex-valued neural networks cast light to extend the existing real-valued ZNN for solving the time-varying real-valued Sylvester equation to its counterpart in the domain of complex numbers. In this paper, a complex-valued ZNN for solving the complex-valued Sylvester equation problem is investigated and the global convergence of the neural network is proven with the proposed nonlinear complex-valued activation functions. Moreover, a special type of activation function with a core function, called sign-bi-power function, is proven to enable the ZNN to converge in finite time, which further enhances its advantage in online processing. In this case, the upper bound of the convergence time is also derived analytically. Simulations are performed to evaluate and compare the performance of the neural network with different parameters and activation functions. Both theoretical analysis and numerical simulations validate the effectiveness of the proposed method.

  9. Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

    Science.gov (United States)

    Morie, K P; De Sanctis, P; Foxe, J J

    2014-07-25

    Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but

  10. When opportunity meets motivation: Neural engagement during social approach is linked to high approach motivation.

    Science.gov (United States)

    Radke, Sina; Seidel, Eva-Maria; Eickhoff, Simon B; Gur, Ruben C; Schneider, Frank; Habel, Ute; Derntl, Birgit

    2016-02-15

    Social rewards are processed by the same dopaminergic-mediated brain networks as non-social rewards, suggesting a common representation of subjective value. Individual differences in personality and motivation influence the reinforcing value of social incentives, but it remains open whether the pursuit of social incentives is analogously supported by the neural reward system when positive social stimuli are connected to approach behavior. To test for a modulation of neural activation by approach motivation, individuals with high and low approach motivation (BAS) completed implicit and explicit social approach-avoidance paradigms during fMRI. High approach motivation was associated with faster implicit approach reactions as well as a trend for higher approach ratings, indicating increased approach tendencies. Implicit and explicit positive social approach was accompanied by stronger recruitment of the nucleus accumbens, middle cingulate cortex, and (pre-)cuneus for individuals with high compared to low approach motivation. These results support and extend prior research on social reward processing, self-other distinctions and affective judgments by linking approach motivation to the engagement of reward-related circuits during motivational reactions to social incentives. This interplay between motivational preferences and motivational contexts might underlie the rewarding experience during social interactions.

  11. Do Substantia Nigra Dopaminergic Neurons Differentiate Between Reward and Punishment?

    Institute of Scientific and Technical Information of China (English)

    Michael J. Frank; D. James Surmeier

    2009-01-01

    The activity of dopaminergic neurons are thought to be increased by stimuli that predict reward and decreased by stimuli that predict aversive outcomes. Recent work by Matsumoto and Hikosaka challenges this model by asserting that stimuli associated with either rewarding or aversive outcomes increase the activity of dopaminergic neurons in the substantia nigra pars compacta.

  12. A non-reward attractor theory of depression.

    Science.gov (United States)

    Rolls, Edmund T

    2016-09-01

    A non-reward attractor theory of depression is proposed based on the operation of the lateral orbitofrontal cortex and supracallosal cingulate cortex. The orbitofrontal cortex contains error neurons that respond to non-reward for many seconds in an attractor state that maintains a memory of the non-reward. The human lateral orbitofrontal cortex is activated by non-reward during reward reversal, and by a signal to stop a response that is now incorrect. Damage to the human orbitofrontal cortex impairs reward reversal learning. Not receiving reward can produce depression. The theory proposed is that in depression, this lateral orbitofrontal cortex non-reward system is more easily triggered, and maintains its attractor-related firing for longer. This triggers negative cognitive states, which in turn have positive feedback top-down effects on the orbitofrontal cortex non-reward system. Treatments for depression, including ketamine, may act in part by quashing this attractor. The mania of bipolar disorder is hypothesized to be associated with oversensitivity and overactivity in the reciprocally related reward system in the medial orbitofrontal cortex and pregenual cingulate cortex.

  13. Information content of neural networks with self-control and variable activity

    Science.gov (United States)

    Bollé, D.; Amari, S. I.; Dominguez Carreta, D. R. C.; Massolo, G.

    2001-02-01

    A self-control mechanism for the dynamics of neural networks with variable activity is discussed using a recursive scheme for the time evolution of the local field. It is based upon the introduction of a self-adapting time-dependent threshold as a function of both the neural and pattern activity in the network. This mechanism leads to an improvement of the information content of the network as well as an increase of the storage capacity and the basins of attraction. Different architectures are considered and the results are compared with numerical simulations.

  14. Computational modeling of neural activities for statistical inference

    CERN Document Server

    Kolossa, Antonio

    2016-01-01

    This authored monograph supplies empirical evidence for the Bayesian brain hypothesis by modeling event-related potentials (ERP) of the human electroencephalogram (EEG) during successive trials in cognitive tasks. The employed observer models are useful to compute probability distributions over observable events and hidden states, depending on which are present in the respective tasks. Bayesian model selection is then used to choose the model which best explains the ERP amplitude fluctuations. Thus, this book constitutes a decisive step towards a better understanding of the neural coding and computing of probabilities following Bayesian rules. The target audience primarily comprises research experts in the field of computational neurosciences, but the book may also be beneficial for graduate students who want to specialize in this field. .

  15. Visualizing the Hidden Activity of Artificial Neural Networks.

    Science.gov (United States)

    Rauber, Paulo E; Fadel, Samuel G; Falcao, Alexandre X; Telea, Alexandru C

    2017-01-01

    In machine learning, pattern classification assigns high-dimensional vectors (observations) to classes based on generalization from examples. Artificial neural networks currently achieve state-of-the-art results in this task. Although such networks are typically used as black-boxes, they are also widely believed to learn (high-dimensional) higher-level representations of the original observations. In this paper, we propose using dimensionality reduction for two tasks: visualizing the relationships between learned representations of observations, and visualizing the relationships between artificial neurons. Through experiments conducted in three traditional image classification benchmark datasets, we show how visualization can provide highly valuable feedback for network designers. For instance, our discoveries in one of these datasets (SVHN) include the presence of interpretable clusters of learned representations, and the partitioning of artificial neurons into groups with apparently related discriminative roles.

  16. Reduced respiratory neural activity elicits a long-lasting decrease in the CO2 threshold for apnea in anesthetized rats.

    Science.gov (United States)

    Baertsch, N A; Baker, T L

    2017-01-01

    Two critical parameters that influence breathing stability are the levels of arterial pCO2 at which breathing ceases and subsequently resumes - termed the apneic and recruitment thresholds (AT and RT, respectively). Reduced respiratory neural activity elicits a chemoreflex-independent, long-lasting increase in phrenic burst amplitude, a form of plasticity known as inactivity-induced phrenic motor facilitation (iPMF). The physiological significance of iPMF is unknown. To determine if iPMF and neural apnea have long-lasting physiological effects on breathing, we tested the hypothesis that patterns of neural apnea that induce iPMF also elicit changes in the AT and RT. Phrenic nerve activity and end-tidal CO2 were recorded in urethane-anesthetized, ventilated rats to quantify phrenic nerve burst amplitude and the AT and RT before and after three patterns of neural apnea that differed in their duration and ability to elicit iPMF: brief intermittent neural apneas, a single brief "massed" neural apnea, or a prolonged neural apnea. Consistent with our hypothesis, we found that patterns of neural apnea that elicited iPMF also resulted in changes in the AT and RT. Specifically, intermittent neural apneas progressively decreased the AT with each subsequent neural apnea, which persisted for at least 60min. Similarly, a prolonged neural apnea elicited a long-lasting decrease in the AT. In both cases, the magnitude of the AT decrease was proportional to iPMF. In contrast, the RT was transiently decreased following prolonged neural apnea, and was not proportional to iPMF. No changes in the AT or RT were observed following a single brief neural apnea. Our results indicate that the AT and RT are differentially altered by neural apnea and suggest that specific patterns of neural apnea that elicit plasticity may stabilize breathing via a decrease in the AT.

  17. Implications of the Dependence of Neuronal Activity on Neural Network States for the Design of Brain-Machine Interfaces

    OpenAIRE

    Panzeri, Stefano; Safaai, Houman; De Feo, Vito; Vato, Alessandro

    2016-01-01

    Brain-machine interfaces (BMIs) can improve the quality of life of patients with sensory and motor disabilities by both decoding motor intentions expressed by neural activity, and by encoding artificially sensed information into patterns of neural activity elicited by causal interventions on the neural tissue. Yet, current BMIs can exchange relatively small amounts of information with the brain. This problem has proved difficult to overcome by simply increasing the number of recording or stim...

  18. Fundamental Active Current Adaptive Linear Neural Networks for Photovoltaic Shunt Active Power Filters

    Directory of Open Access Journals (Sweden)

    Muhammad Ammirrul Atiqi Mohd Zainuri

    2016-05-01

    Full Text Available This paper presents improvement of a harmonics extraction algorithm, known as the fundamental active current (FAC adaptive linear element (ADALINE neural network with the integration of photovoltaic (PV to shunt active power filters (SAPFs as active current source. Active PV injection in SAPFs should reduce dependency on grid supply current to supply the system. In addition, with a better and faster harmonics extraction algorithm, the SAPF should perform well, especially under dynamic PV and load conditions. The role of the actual injection current from SAPF after connecting PVs will be evaluated, and the better effect of using FAC ADALINE will be confirmed. The proposed SAPF was simulated and evaluated in MATLAB/Simulink first. Then, an experimental laboratory prototype was also developed to be tested with a PV simulator (CHROMA 62100H-600S, and the algorithm was implemented using a TMS320F28335 Digital Signal Processor (DSP. From simulation and experimental results, significant improvements in terms of total harmonic distortion (THD, time response and reduction of source power from grid have successfully been verified and achieved.

  19. A Role for the Lateral Dorsal Tegmentum in Memory and Decision Neural Circuitry

    Science.gov (United States)

    Redila, Van; Kinzel, Chantelle; Jo, Yong Sang; Puryear, Corey B.; Mizumori, Sheri J.Y.

    2017-01-01

    A role for the hippocampus in memory is clear, although the mechanism for its contribution remains a matter of debate. Converging evidence suggests that hippocampus evaluates the extent to which context-defining features of events occur as expected. The consequence of mismatches, or prediction error, signals from hippocampus is discussed in terms of its impact on neural circuitry that evaluates the significance of prediction errors: Ventral tegmental area (VTA) dopamine cells burst fire to rewards or cues that predict rewards (Schultz et al., 1997). Although the lateral dorsal tegmentum (LDTg) importantly controls dopamine cell burst firing (Lodge & Grace, 2006) the behavioral significance of the LDTg control is not known. Therefore, we evaluated LDTg functional activity as rats performed a spatial memory task that generates task-dependent reward codes in VTA (Jo et al., 2013; Puryear et al., 2010) and another VTA afferent, the pedunculopontine nucleus (PPTg, Norton et al., 2011). Reversible inactivation of the LDTg significantly impaired choice accuracy. LDTg neurons coded primarily egocentric information in the form of movement velocity, turning behaviors, and behaviors leading up to expected reward locations. A subset of the velocity-tuned LDTg cells also showed high frequency bursts shortly before or after reward encounters, after which they showed tonic elevated firing during consumption of small, but not large, rewards. Cells that fired before reward encounters showed stronger correlations with velocity as rats moved toward, rather than away from, rewarded sites. LDTg neural activity was more strongly regulated by egocentric behaviors than that observed for PPTg or VTA cells that were recorded by Puryear et al. and Norton et al. While PPTg activity was uniquely sensitive to ongoing sensory input, all three regions encoded reward magnitude (although in different ways), reward expectation, and reward encounters. Only VTA encoded reward prediction errors. LDTg

  20. Case Study of Ecstatic Meditation: fMRI and EEG Evidence of Self-Stimulating a Reward System

    Directory of Open Access Journals (Sweden)

    Michael R. Hagerty

    2013-01-01

    Full Text Available We report the first neural recording during ecstatic meditations called jhanas and test whether a brain reward system plays a role in the joy reported. Jhanas are Altered States of Consciousness (ASC that imply major brain changes based on subjective reports: (1 external awareness dims, (2 internal verbalizations fade, (3 the sense of personal boundaries is altered, (4 attention is highly focused on the object of meditation, and (5 joy increases to high levels. The fMRI and EEG results from an experienced meditator show changes in brain activity in 11 regions shown to be associated with the subjective reports, and these changes occur promptly after jhana is entered. In particular, the extreme joy is associated not only with activation of cortical processes but also with activation of the nucleus accumbens (NAc in the dopamine/opioid reward system. We test three mechanisms by which the subject might stimulate his own reward system by external means and reject all three. Taken together, these results demonstrate an apparently novel method of self-stimulating a brain reward system using only internal mental processes in a highly trained subject.

  1. Circular polarization intrinsic optical signal recording of stimulus-evoked neural activity.

    Science.gov (United States)

    Lu, Rong-Wen; Zhang, Qiu-Xiang; Yao, Xin-Cheng

    2011-05-15

    Linear polarization intrinsic optical signal (LP-IOS) measurement can provide sensitive detection of neural activities in stimulus-activated neural tissues. However, the LP-IOS magnitude and signal-to-noise ratio (SNR) are highly correlated with the nerve orientation relative to the polarization plane of the incident light. Because of the complexity of orientation dependency, LP-IOS optimization and outcome interpretation are time consuming and complicated. In this study, we demonstrate the feasibility of circular polarization intrinsic optical signal (CP-IOS) measurement. Our theoretical modeling and experimental investigation indicate that CP-IOS magnitude and SNR are independent from the nerve orientation. Therefore, CP-IOS promises a practical method for polarization IOS imaging of complex neural systems.

  2. Application of neural networks with orthogonal activation functions in control of dynamical systems

    Science.gov (United States)

    Nikolić, Saša S.; Antić, Dragan S.; Milojković, Marko T.; Milovanović, Miroslav B.; Perić, Staniša Lj.; Mitić, Darko B.

    2016-04-01

    In this article, we present a new method for the synthesis of almost and quasi-orthogonal polynomials of arbitrary order. Filters designed on the bases of these functions are generators of generalised quasi-orthogonal signals for which we derived and presented necessary mathematical background. Based on theoretical results, we designed and practically implemented generalised first-order (k = 1) quasi-orthogonal filter and proved its quasi-orthogonality via performed experiments. Designed filters can be applied in many scientific areas. In this article, generated functions were successfully implemented in Nonlinear Auto Regressive eXogenous (NARX) neural network as activation functions. One practical application of the designed orthogonal neural network is demonstrated through the example of control of the complex technical non-linear system - laboratory magnetic levitation system. Obtained results were compared with neural networks with standard activation functions and orthogonal functions of trigonometric shape. The proposed network demonstrated superiority over existing solutions in the sense of system performances.

  3. Food reward without a timing component does not alter the timing of activity under positive energy balance

    NARCIS (Netherlands)

    van der Vinne, V.; Akkerman, J.; Lanting, G. D.; Riede, S. J.; Hut, R. A.

    2015-01-01

    Circadian clocks drive daily rhythms in physiology and behavior which allow organisms to anticipate predictable daily changes in the environment. In most mammals, circadian rhythms result in nocturnal activity patterns although plasticity of the circadian system allows activity patterns to shift to

  4. Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity, and Performance

    Science.gov (United States)

    2014-09-29

    value function approximation is an active area of research ( Parr et al., 2008; Mahadevan, 2009; Taylor and Parr , 2009; Boots and Gordon, 2010), but it is...Publishers Inc. Ng, A., Harada, D., Russell , S., 1999. Policy invariance under reward transfor- mations: Theory and application to reward shaping. ICML...strategy. In: Proceedings of the IEEE/ACM International Conference on Human-Robot Interaction. 43 Parr , R., Li, L., Taylor, G., Painter-Wakefield, C

  5. Performance of Deep and Shallow Neural Networks, the Universal Approximation Theorem, Activity Cliffs, and QSAR.

    Science.gov (United States)

    Winkler, David A; Le, Tu C

    2017-01-01

    Neural networks have generated valuable Quantitative Structure-Activity/Property Relationships (QSAR/QSPR) models for a wide variety of small molecules and materials properties. They have grown in sophistication and many of their initial problems have been overcome by modern mathematical techniques. QSAR studies have almost always used so-called "shallow" neural networks in which there is a single hidden layer between the input and output layers. Recently, a new and potentially paradigm-shifting type of neural network based on Deep Learning has appeared. Deep learning methods have generated impressive improvements in image and voice recognition, and are now being applied to QSAR and QSAR modelling. This paper describes the differences in approach between deep and shallow neural networks, compares their abilities to predict the properties of test sets for 15 large drug data sets (the kaggle set), discusses the results in terms of the Universal Approximation theorem for neural networks, and describes how DNN may ameliorate or remove troublesome "activity cliffs" in QSAR data sets.

  6. Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity

    Science.gov (United States)

    Moses, David A.; Mesgarani, Nima; Leonard, Matthew K.; Chang, Edward F.

    2016-10-01

    Objective. The superior temporal gyrus (STG) and neighboring brain regions play a key role in human language processing. Previous studies have attempted to reconstruct speech information from brain activity in the STG, but few of them incorporate the probabilistic framework and engineering methodology used in modern speech recognition systems. In this work, we describe the initial efforts toward the design of a neural speech recognition (NSR) system that performs continuous phoneme recognition on English stimuli with arbitrary vocabulary sizes using the high gamma band power of local field potentials in the STG and neighboring cortical areas obtained via electrocorticography. Approach. The system implements a Viterbi decoder that incorporates phoneme likelihood estimates from a linear discriminant analysis model and transition probabilities from an n-gram phonemic language model. Grid searches were used in an attempt to determine optimal parameterizations of the feature vectors and Viterbi decoder. Main results. The performance of the system was significantly improved by using spatiotemporal representations of the neural activity (as opposed to purely spatial representations) and by including language modeling and Viterbi decoding in the NSR system. Significance. These results emphasize the importance of modeling the temporal dynamics of neural responses when analyzing their variations with respect to varying stimuli and demonstrate that speech recognition techniques can be successfully leveraged when decoding speech from neural signals. Guided by the results detailed in this work, further development of the NSR system could have applications in the fields of automatic speech recognition and neural prosthetics.

  7. Reward Processing in Adolescents with Bipolar I Disorder

    Science.gov (United States)

    Singh, Manpreet K.; Chang, Kiki D.; Kelley, Ryan G.; Cui, Xu; Sherdell, Lindsey; Howe, Meghan E.; Gotlib, Ian H.; Reiss, Allan L.

    2013-01-01

    Objective: Bipolar disorder (BD) is a debilitating psychiatric condition that commonly begins in adolescence, a developmental period that has been associated with increased reward seeking. Because youth with BD are especially vulnerable to negative risk-taking behaviors, understanding the neural mechanisms by which dysregulated affect interacts…

  8. Endocrine links between food reward and caloric homeostasis.

    Science.gov (United States)

    Lattemann, Dianne Figlewicz

    2008-11-01

    Both intrinsic and extrinsic (endocrine) inputs to the central nervous system (CNS) modulate motivation for feeding. Endocrine inputs such as insulin and leptin can have very rapid effects, but also the potential for chronic actions to decrease rewarding attributes of food. Future studies should elucidate the neural and cellular mechanisms which underlie these endocrine actions in the CNS.

  9. Investigating the Impact of a Genome-Wide Supported Bipolar Risk Variant of MAD1L1 on the Human Reward System.

    Science.gov (United States)

    Trost, Sarah; Diekhof, Esther K; Mohr, Holger; Vieker, Henning; Krämer, Bernd; Wolf, Claudia; Keil, Maria; Dechent, Peter; Binder, Elisabeth B; Gruber, Oliver

    2016-10-01

    Recent genome-wide association studies have identified MAD1L1 (mitotic arrest deficient-like 1) as a susceptibility gene for bipolar disorder and schizophrenia. The minor allele of the single-nucleotide polymorphism (SNP) rs11764590 in MAD1L1 was associated with bipolar disorder. Both diseases, bipolar disorder and schizophrenia, are linked to functional alterations in the reward system. We aimed at investigating possible effects of the MAD1L1 rs11764590 risk allele on reward systems functioning in healthy adults. A large homogenous sample of 224 young (aged 18-31 years) participants was genotyped and underwent functional magnetic resonance imaging (fMRI). All participants performed the 'Desire-Reason Dilemma' paradigm investigating the neural correlates that underlie reward processing and active reward dismissal in favor of a long-term goal. We found significant hypoactivations of the ventral tegmental area (VTA), the bilateral striatum and bilateral frontal and parietal cortices in response to conditioned reward stimuli in the risk allele carriers compared with major allele carriers. In the dilemma situation, functional connectivity between prefrontal brain regions and the ventral striatum was significantly diminished in the risk allele carriers. Healthy risk allele carriers showed a significant deficit of their bottom-up response to conditioned reward stimuli in the bilateral VTA and striatum. Furthermore, functional connectivity between the ventral striatum and prefrontal areas exerting top-down control on the mesolimbic reward system was reduced in this group. Similar alterations in reward processing and disturbances of prefrontal control mechanisms on mesolimbic brain circuits have also been reported in bipolar disorder and schizophrenia. Together, these findings suggest the existence of an intermediate phenotype associated with MAD1L1.

  10. Do Economic Rewards Work?

    Science.gov (United States)

    Wallace, Brian D.

    2009-01-01

    The love of learning--that intrinsic desire to gain knowledge and insight into new subjects--was once its own reward. That was altered decades ago when parents started using the proverbial "stick and carrot" to motivate their children to do well in school, or even just show up. Today, educators across the country have taken hold of this approach…

  11. Neural Changes following Behavioral Activation for a Depressed Breast Cancer Patient: A Functional MRI Case Study

    Directory of Open Access Journals (Sweden)

    Michael J. Gawrysiak

    2012-01-01

    Full Text Available Functional neuroimaging is an innovative but at this stage underutilized method to assess the efficacy of psychotherapy for depression. Functional magnetic resonance imaging (fMRI was used in this case study to examine changes in brain activity in a depressed breast cancer patient receiving an 8-session Behavioral Activation Treatment for Depression (BATD, based on the work of Hopko and Lejuez (2007. A music listening paradigm was used during fMRI brain scans to assess reward responsiveness at pre- and posttreatment. Following treatment, the patient exhibited attenuated depression and changes in blood oxygenation level dependence (BOLD response in regions of the prefrontal cortex and the subgenual cingulate cortex. These preliminary findings outline a novel means to assess psychotherapy efficacy and suggest that BATD elicits functional brain changes in areas implicated in the pathophysiology of depression. Further research is necessary to explore neurobiological mechanisms of change in BATD, particularly the potential mediating effects of reward responsiveness and associated brain functioning.

  12. Commitment to self-rewards

    DEFF Research Database (Denmark)

    Koch, Alexander; Nafziger, Julia

    People often overcome self-control problems by promising to reward themselves for accomplishing a task. Such strategies based on self-administered rewards however require the person to believe that she would indeed deny herself the reward if she should fail to achieve the desired outcome. Drawing...

  13. Differential neural activity patterns for spatial relations in humans: a MEG study.

    Science.gov (United States)

    Scott, Nicole M; Leuthold, Arthur; Sera, Maria D; Georgopoulos, Apostolos P

    2016-02-01

    Children learn the words for above-below relations earlier than for left-right relations, despite treating these equally well in a simple visual categorization task. Even as adults--conflicts in congruency, such as when a stimulus is depicted in a spatially incongruent manner with respect to salient global cues--can be challenging. Here we investigated the neural correlates of encoding and maintaining in working memory above-below and left-right relational planes in 12 adults using magnetoencephalography in order to discover whether above-below relations are represented by the brain differently than left-right relations. Adults performed perfectly on the task behaviorally, so any differences in neural activity were attributed to the stimuli's cognitive attributes. In comparing above-below to left-right relations during stimulus encoding, we found the greatest differences in neural activity in areas associated with space and movement. In comparing congruent to incongruent trials, we found the greatest differential activity in premotor areas. For both contrasts, brain areas involved in the encoding phase were also involved in the maintenance phase, which provides evidence that those brain areas are particularly important in representing the relational planes or congruency types throughout the trial. When comparing neural activity associated with the relational planes during working memory, additional right posterior areas were implicated, whereas the congruent-incongruent contrast implicated additional bilateral frontal and temporal areas. These findings are consistent with the hypothesis left-right relations are represented differently than above-below relations.

  14. Identification of children's activity type with accelerometer-based neural networks

    NARCIS (Netherlands)

    Vries, S.I. de; Engels, M.; Garre, F.G.

    2011-01-01

    Purpose: The study's purpose was to identify children's physical activity type using artificial neural network (ANN) models based on uniaxial or triaxial accelerometer data from the hip or the ankle. Methods: Fifty-eight children (31 boys and 27 girls, age range = 9-12 yr) performed the following ac

  15. Evaluation of neural networks to identify types of activity using accelerometers

    NARCIS (Netherlands)

    Vries, S.I. de; Garre, F.G.; Engbers, L.H.; Hildebrandt, V.H.; Buuren, S. van

    2011-01-01

    Purpose: To develop and evaluate two artificial neural network (ANN) models based on single-sensor accelerometer data and an ANN model based on the data of two accelerometers for the identification of types of physical activity in adults. Methods: Forty-nine subjects (21 men and 28 women; age range

  16. Modeling electrocortical activity through improved local approximations of integral neural field equations.

    NARCIS (Netherlands)

    Coombes, S.; Venkov, N.A.; Shiau, L.; Bojak, I.; Liley, D.T.; Laing, C.R.

    2007-01-01

    Neural field models of firing rate activity typically take the form of integral equations with space-dependent axonal delays. Under natural assumptions on the synaptic connectivity we show how one can derive an equivalent partial differential equation (PDE) model that properly treats the axonal dela

  17. Parasympathetic neural activity accounts for the lowering of exercise heart rate at high altitude

    DEFF Research Database (Denmark)

    Boushel, Robert Christopher; Calbet, J A; Rådegran, G

    2001-01-01

    In chronic hypoxia, both heart rate (HR) and cardiac output (Q) are reduced during exercise. The role of parasympathetic neural activity in lowering HR is unresolved, and its influence on Q and oxygen transport at high altitude has never been studied....

  18. Using Perfusion fMRI to Measure Continuous Changes in Neural Activity with Learning

    Science.gov (United States)

    Olson, Ingrid R.; Rao, Hengyi; Moore, Katherine Sledge; Wang, Jiongjiong; Detre, John A.; Aguirre, Geoffrey K.

    2006-01-01

    In this study, we examine the suitability of a relatively new imaging technique, "arterial spin labeled perfusion imaging," for the study of continuous, gradual changes in neural activity. Unlike BOLD imaging, the perfusion signal is stable over long time-scales, allowing for accurate assessment of continuous performance. In addition, perfusion…

  19. Neural activity supporting the formation of associative memory versus source memory.

    Science.gov (United States)

    Park, Heekyeong; Shannon, Vale; Biggan, John; Spann, Catherine

    2012-08-30

    The ability to form a new association with discontiguous elements constitutes the very crux of episodic memory. However, it is not fully understood whether different types of associations rely on common neural correlates for encoding associations. In the present study, we investigated whether the formation of associative memory (associations between items) and source memory (associations between an item and its context) recruits common neural activity during encoding, or whether each type of association requires different neural activity for subsequent memory. During study, participants were visually presented a list of object pairs in the scanner while the names of objects were simultaneously presented either in a male or female voice. Participants completed a post-scan recognition test for associative and source memories for object pairs and their contexts. Associative memory was predicted in the left inferior prefrontal cortex, the fusiform gyrus and the medial temporal lobe including both perirhinal and parahippocampal cortices and the posterior hippocampus. Encoding activity for source memory was identified in the right insula and the right anterior hippocampus. Further, neural activity in the right posterior hippocampus was recruited for successful formation of both associative and source memories. Collectively, these findings highlight the pivotal role of the hippocampus in successful encoding of associative and source memories and add more weight to the role of the perirhinal cortex in associative encoding of objects. The present findings have implications for roles of the medial temporal lobe sub-regions for successful formation of associative and source memories.

  20. An application of multilayer neural network on hepatitis disease diagnosis using approximations of sigmoid activation function

    Directory of Open Access Journals (Sweden)

    Onursal Çetin

    2015-06-01

    Full Text Available Objective: Implementation of multilayer neural network (MLNN with sigmoid activation function for the diagnosis of hepatitis disease. Methods: Artificial neural networks (ANNs are efficient tools currently in common use for medical diagnosis. In hardware based architectures activation functions play an important role in ANN behavior. Sigmoid function is the most frequently used activation function because of its smooth response. Thus, sigmoid function and its close approximations were implemented as activation function. The dataset is taken from the UCI machine learning database. Results: For the diagnosis of hepatitis disease, MLNN structure was implemented and Levenberg Morquardt (LM algorithm was used for learning. Our method of classifying hepatitis disease produced an accuracy of 91.9% to 93.8% via 10 fold cross validation. Conclusion: When compared to previous work that diagnosed hepatitis disease using artificial neural networks and the identical data set, our results are promising in order to reduce the size and cost of neural network based hardware. Thus, hardware based diagnosis systems can be developed effectively by using approximations of sigmoid function.

  1. A Constraint Satisfaction Neural Network and Heuristic Combined Approach for Concurrent Activities Scheduling

    Institute of Scientific and Technical Information of China (English)

    YAN JiHong(闫纪红); WU Cheng(吴澄)

    2003-01-01

    Scheduling activities in concurrent product development process is of great sig-nificance to shorten development lead time and minimize the cost. Moreover, it can eliminate theunnecessary redesign periods and guarantee that serial activities can be executed as concurrently aspossible. This paper presents a constraint satisfaction neural network and heuristic combined ap-proach for concurrent activities scheduling. In the combined approach, the neural network is usedto obtain a feasible starting time of all the activities based on sequence constraints, the heuris-tic algorithm is used to obtain a feasible solution of the scheduling problem based on resourceconstraints. The feasible scheduling solution is obtained by a gradient optimization function. Sim-ulations have shown that the proposed combined approach is efficient and feasible with respect toconcurrent activities scheduling.

  2. Cues Produced by Reward and Nonreward and Temporal Cues Influence Responding in the Intertrial Interval and to the Conditioned Stimulus

    Science.gov (United States)

    Capaldi, E. J.; Martins, Ana; Miller, Ronald M.

    2007-01-01

    Rats in a Pavlovian situation were trained under three different reward schedules, at either a 30 s or a 90 s intertrial interval (ITI): Consistent reward (C), 50% irregular reward (I), and single alternation of reward and nonrewarded trials (SA). Activity was recorded to the conditioned stimulus (CS) and in all 10 s bins in each ITI except the…

  3. Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies

    NARCIS (Netherlands)

    Sescousse, G.T.; Caldu, X.; Segura, B.; Dreher, J.C.

    2013-01-01

    One fundamental question concerning brain reward mechanisms is to determine how reward-related activity is influenced by the nature of rewards. Here, we review the neuroimaging literature and explicitly assess to what extent the representations of primary and secondary rewards overlap in the human b

  4. Global robust dissipativity of interval recurrent neural networks with time-varying delay and discontinuous activations.

    Science.gov (United States)

    Duan, Lian; Huang, Lihong; Guo, Zhenyuan

    2016-07-01

    In this paper, the problems of robust dissipativity and robust exponential dissipativity are discussed for a class of recurrent neural networks with time-varying delay and discontinuous activations. We extend an invariance principle for the study of the dissipativity problem of delay systems to the discontinuous case. Based on the developed theory, some novel criteria for checking the global robust dissipativity and global robust exponential dissipativity of the addressed neural network model are established by constructing appropriate Lyapunov functionals and employing the theory of Filippov systems and matrix inequality techniques. The effectiveness of the theoretical results is shown by two examples with numerical simulations.

  5. Global robust dissipativity of interval recurrent neural networks with time-varying delay and discontinuous activations

    Science.gov (United States)

    Duan, Lian; Huang, Lihong; Guo, Zhenyuan

    2016-07-01

    In this paper, the problems of robust dissipativity and robust exponential dissipativity are discussed for a class of recurrent neural networks with time-varying delay and discontinuous activations. We extend an invariance principle for the study of the dissipativity problem of delay systems to the discontinuous case. Based on the developed theory, some novel criteria for checking the global robust dissipativity and global robust exponential dissipativity of the addressed neural network model are established by constructing appropriate Lyapunov functionals and employing the theory of Filippov systems and matrix inequality techniques. The effectiveness of the theoretical results is shown by two examples with numerical simulations.

  6. Cognitive-affective neural plasticity following active-controlled mindfulness intervention

    DEFF Research Database (Denmark)

    Allen, Micah Galen

    Mindfulness meditation is a set of attention-based, regulatory and self-inquiry training regimes. Although the impact of mindfulness meditation training (MT) on self-regulation is well established, the neural mechanisms supporting such plasticity are poorly understood. MT is thought to act through...... prefrontal cortex (mPFC), and right anterior insula during negative valence processing. Our findings highlight the importance of active control in MT research, indicate unique neural mechanisms for progressive stages of mindfulness training, and suggest that optimal application of MT may differ depending...

  7. The role of the striatum in effort-based decision-making in the absence of reward.

    Science.gov (United States)

    Schouppe, Nathalie; Demanet, Jelle; Boehler, Carsten N; Ridderinkhof, K Richard; Notebaert, Wim

    2014-02-05

    Decision-making involves weighing costs against benefits, for instance, in terms of the effort it takes to obtain a reward of a given magnitude. This evaluation process has been linked to the dorsal anterior cingulate cortex (dACC) and the striatum, with activation in these brain structures reflecting the discounting effect of effort on reward. Here, we investigate how cognitive effort influences neural choice processes in the absence of an extrinsic reward. Using functional magnetic resonance imaging in humans, we used an effort-based decision-making task in which participants were required to choose between two options for a subsequent flanker task that differed in the amount of cognitive effort. Cognitive effort was manipulated by varying the proportion of incongruent trials associated with each choice option. Choice-locked activation in the striatum was higher when participants chose voluntarily for the more effortful alternative but displayed the opposite trend on forced-choice trials. The dACC revealed a similar, yet only trend-level significant, activation pattern. Our results imply that activation levels in the striatum reflect a cost-benefit analysis, in which a balance is made between effort discounting and the intrinsic motivation to choose a cognitively challenging task. Moreover, our findings indicate that it matters whether this challenge is voluntarily chosen or externally imposed. As such, the present findings contrast with classical findings on effort discounting that found reductions in striatum activation for higher effort by finding enhancements of the same neural circuits when a cognitively challenging task is voluntarily selected and does not entail the danger of losing reward.

  8. The Roles of Dopamine and Related Compounds in Reward-Seeking Behavior Across Animal Phyla

    Science.gov (United States)

    Barron, Andrew B.; Søvik, Eirik; Cornish, Jennifer L.

    2010-01-01

    Motile animals actively seek out and gather resources they find rewarding, and this is an extremely powerful organizer and motivator of animal behavior. Mammalian studies have revealed interconnected neurobiological systems for reward learning, reward assessment, reinforcement and reward-seeking; all involving the biogenic amine dopamine. The neurobiology of reward-seeking behavioral systems is less well understood in invertebrates, but in many diverse invertebrate groups, reward learning and responses to food rewards also involve dopamine. The obvious exceptions are the arthropods in which the chemically related biogenic amine octopamine has a greater effect on reward learning and reinforcement than dopamine. Here we review the functions of these biogenic amines in behavioral responses to rewards in different animal groups, and discuss these findings in an evolutionary context. PMID:21048897

  9. Are extremes of consumption in eating disorders related to an altered balance between reward and inhibition?

    Directory of Open Access Journals (Sweden)

    Christina E Wierenga

    2014-12-01

    Full Text Available The primary defining characteristic of a diagnosis of an eating disorder (ED is the disturbance of eating or eating-related behavior that results in the altered consumption or absorption of food (DSM V; American Psychiatric Association, 2013. There is a spectrum, ranging from those who severely restrict eating and become emaciated on one end to those who binge and overconsume, usually accompanied by some form of compensatory behaviors, on the other. How can we understand reasons for such extremes of food consummatory behaviors? Recent work on obesity and substance use disorders has identified behaviors and neural pathways that play a powerful role in human consummatory behaviors. That is, corticostriatal limbic and dorsal cognitive neural circuitry can make drugs and food rewarding, but also engage self-control mechanisms that may inhibit their use. Importantly, there is considerable evidence that alterations of these systems also occur in ED. This paper explores the hypothesis that an altered balance of reward and inhibition contributes to altered extremes of response to salient stimuli, such as food. We will review recent studies that show altered sensitivity to reward and punishment in ED, with evidence of altered activity in corticostriatal and insula processes with respect to monetary gains or losses, and tastes of palatable foods. We will also discuss evidence for a spectrum of extremes of inhibition and dysregulation behaviors in ED supported by studies suggesting that this is related to top-down self-control mechanisms. The lack of a mechanistic understanding of ED has thwarted efforts for evidence-based approaches to develop interventions. Understanding how ED behavior is encoded in neural circuits would provide a foundation for developing more specific and effective treatment approaches.

  10. RBF neural network and active circles based algorithm for contours extraction

    Institute of Scientific and Technical Information of China (English)

    Zhou Zhiheng; Zeng Delu; Xie Shengli

    2007-01-01

    For the contours extraction from the images, active contour model and self-organizing map based approach are popular nowadays. But they are still confronted with the problems that the optimization of energy function will trap in local minimums and the contour evolutions greatly depend on the initial contour selection. Addressing to these problems, a contours extraction algorithm based on RBF neural network is proposed here. A series of circles with adaptive radius and center is firstly used to search image feature points that are scattered enough. After the feature points are clustered, a group of radial basis functions are constructed. Using the pixels' intensities and gradients as the input vector, the final object contour can be obtained by the predicting ability of the neural network. The RBF neural network based algorithm is tested on three kinds of images, such as changing topology, complicated background, and blurring or noisy boundary. Simulation results show that the proposed algorithm performs contours extraction greatly.

  11. Simultaneous imaging of neural activity in three dimensions

    Directory of Open Access Journals (Sweden)

    Sean eQuirin

    2014-04-01

    Full Text Available We introduce a scanless optical method to image neuronal activity in three dimensions simultaneously. Using a spatial light modulator and a custom-designed phase mask, we illuminate and collect light simultaneously from different focal planes and perform calcium imaging of neuronal activity in vitro and in vivo. This method, combining structured illumination with volume projection imaging, could be used as a technological platform for brain activity mapping.

  12. Age-related changes in neural activity associated with familiarity, recollection and false recognition.

    Science.gov (United States)

    Duarte, Audrey; Graham, Kim S; Henson, Richard N

    2010-10-01

    Older adults often exhibit elevated false recognition for events that never occurred, while simultaneously experiencing difficulty in recognizing events that actually occurred. It has been proposed that reduced recollection in conjunction with an over-reliance on familiarity may contribute to this pattern of results. This explanation is somewhat inconsistent, however, with recent evidence suggesting that familiarity and associated neural activity are reduced in healthy aging. Alternatively, given that illusory memory may be based, in part, on veridical memory processes (recollection/familiarity), one might predict that older adults exhibit enhanced false alarm rates because the neural signatures associated with true recognition (hits) and false recognition (false alarms) are less distinguishable in old than in young adults. Here, we used event-related fMRI to measure the effects of aging on neural activity associated with recollection, familiarity and familiarity-based false alarms for objects in young and older adults. Compared to young adults, older adults exhibited elevated false alarm rates and impaired behavioral indices of recollection and familiarity. Imaging data showed that older adults exhibited reduced recollection effects in the left parietoccipital cortex. Furthermore, while similar regions in frontal, parietal, lateral and inferior temporal cortices contributed to familiarity-based true and false recognition, reduced familiarity-related activity in frontal and inferior temporal regions in the older adults resulted in decreased differentiation between true and false recognition effects in this group. Our results suggest that reductions in neural activity associated with both recollection and familiarity for studied items may contribute to elevated false recognition in older adults, via reduced differentiation between the neural activity associated with true and false memory.

  13. Neurons in the pigeon caudolateral nidopallium differentiate Pavlovian conditioned stimuli but not their associated reward value in a sign-tracking paradigm

    Science.gov (United States)

    Kasties, Nils; Starosta, Sarah; Güntürkün, Onur; Stüttgen, Maik C.

    2016-01-01

    Animals exploit visual information to identify objects, form stimulus-reward associations, and prepare appropriate behavioral responses. The nidopallium caudolaterale (NCL), an associative region of the avian endbrain, contains neurons exhibiting prominent response modulation during presentation of reward-predicting visual stimuli, but it is unclear whether neural activity represents valuation signals, stimulus properties, or sensorimotor contingencies. To test the hypothesis that NCL neurons represent stimulus value, we subjected pigeons to a Pavlovian sign-tracking paradigm in which visual cues predicted rewards differing in magnitude (large vs. small) and delay to presentation (short vs. long). Subjects’ strength of conditioned responding to visual cues reliably differentiated between predicted reward types and thus indexed valuation. The majority of NCL neurons discriminated between visual cues, with discriminability peaking shortly after stimulus onset and being maintained at lower levels throughout the stimulus presentation period. However, while some cells’ firing rates correlated with reward value, such neurons were not more frequent than expected by chance. Instead, neurons formed discernible clusters which differed in their preferred visual cue. We propose that this activity pattern constitutes a prerequisite for using visual information in more complex situations e.g. requiring value-based choices. PMID:27762287

  14. Rewards for Reading: Their Effects on Reading Motivation

    Science.gov (United States)

    Chen, Pin-Hwa; Wu, Jen-Rung

    2010-01-01

    In recent years, many Taiwanese elementary schools have implemented extensive reading activities in their respective campuses. In order to motivate pupils to read, teachers and parents would offer pupils contingent rewards. As we know, the use of rewards in educational settings as a way to improve motivation is a controversial issue. Previous…

  15. Extrinsic Rewards Are Education's Past, Not Its Future.

    Science.gov (United States)

    Schaps, Eric; Lewis, Catherine

    1991-01-01

    Robert Slavin's position--that extrinsic rewards promote student motivation and learning--may be valid within the context of a "facts-and-skills" curriculum. However, extrinsic rewards are unnecessary when schools offer engaging learning activities; programs addressing social, ethical, and cognitive development; and a supportive…

  16. Opportunity NYC--Family Rewards: Qualitative Study of Family Communication

    Science.gov (United States)

    Fraker, Carolyn A.; Greenberg, David

    2011-01-01

    Aimed at low-income families in six of New York City's highest-poverty communities, the Family Rewards program ties cash rewards to a pre-specified set of activities. This paper presents the qualitative findings from interviews with 77 families. It examines how families incorporated the program into their households, and specifically the…

  17. Neurobiology of hyperactivity and reward : Agreeable restlessness in Anorexia Nervosa

    NARCIS (Netherlands)

    Scheurink, Anton J. W.; Boersma, Gretha J.; Nergardh, Ricard; Sodersten, Per; Nergårdh, Ricard; Södersten, Per

    2010-01-01

    Restricted food intake is associated with increased physical activity, very likely an evolutionary advantage, initially both functional and rewarding. The hyperactivity of patients with Anorexia Nervosa, however, is a main problem for recovery. This seemingly paradoxical reward of hyperactivity in A

  18. GH mediates exercise-dependent activation of SVZ neural precursor cells in aged mice.

    Directory of Open Access Journals (Sweden)

    Daniel G Blackmore

    Full Text Available Here we demonstrate, both in vivo and in vitro, that growth hormone (GH mediates precursor cell activation in the subventricular zone (SVZ of the aged (12-month-old brain following exercise, and that GH signaling stimulates precursor activation to a similar extent to exercise. Our results reveal that both addition of GH in culture and direct intracerebroventricular infusion of GH stimulate neural precursor cells in the aged brain. In contrast, no increase in neurosphere numbers was observed in GH receptor null animals following exercise. Continuous infusion of a GH antagonist into the lateral ventricle of wild-type animals completely abolished the exercise-induced increase in neural precursor cell number. Given that the aged brain does not recover well after injury, we investigated the direct effect of exercise and GH on neural precursor cell activation following irradiation. This revealed that physical exercise as well as infusion of GH promoted repopulation of neural precursor cells in irradiated aged animals. Conversely, infusion of a GH antagonist during exercise prevented recovery of precursor cells in the SVZ following irradiation.

  19. Convergence of inhibitory neural inputs regulate motor activity in the murine and monkey stomach.

    Science.gov (United States)

    Shaylor, Lara A; Hwang, Sung Jin; Sanders, Kenton M; Ward, Sean M

    2016-11-01

    Inhibitory motor neurons regulate several gastric motility patterns including receptive relaxation, gastric peristaltic motor patterns, and pyloric sphincter opening. Nitric oxide (NO) and purines have been identified as likely candidates that mediate inhibitory neural responses. However, the contribution from each neurotransmitter has received little attention in the distal stomach. The aims of this study were to identify the roles played by NO and purines in inhibitory motor responses in the antrums of mice and monkeys. By using wild-type mice and mutants with genetically deleted neural nitric oxide synthase (Nos1(-/-)) and P2Y1 receptors (P2ry1(-/-)) we examined the roles of NO and purines in postjunctional inhibitory responses in the distal stomach and compared these responses to those in primate stomach. Activation of inhibitory motor nerves using electrical field stimulation (EFS) produced frequency-dependent inhibitory junction potentials (IJPs) that produced muscle relaxations in both species. Stimulation of inhibitory nerves during slow waves terminated pacemaker events and associated contractions. In Nos1(-/-) mice IJPs and relaxations persisted whereas in P2ry1(-/-) mice IJPs were absent but relaxations persisted. In the gastric antrum of the non-human primate model Macaca fascicularis, similar NO and purine neural components contributed to inhibition of gastric motor activity. These data support a role of convergent inhibitory neural responses in the regulation of gastric motor activity across diverse species.

  20. Wide-field optical mapping of neural activity and brain haemodynamics: considerations and novel approaches

    Science.gov (United States)

    Ma, Ying; Shaik, Mohammed A.; Kozberg, Mariel G.; Thibodeaux, David N.; Zhao, Hanzhi T.; Yu, Hang

    2016-01-01

    Although modern techniques such as two-photon microscopy can now provide cellular-level three-dimensional imaging of the intact living brain, the speed and fields of view of these techniques remain limited. Conversely, two-dimensional wide-field optical mapping (WFOM), a simpler technique that uses a camera to observe large areas of the exposed cortex under visible light, can detect changes in both neural activity and haemodynamics at very high speeds. Although WFOM may not provide single-neuron or capillary-level resolution, it is an attractive and accessible approach to imaging large areas of the brain in awake, behaving mammals at speeds fast enough to observe widespread neural firing events, as well as their dynamic coupling to haemodynamics. Although such wide-field optical imaging techniques have a long history, the advent of genetically encoded fluorophores that can report neural activity with high sensitivity, as well as modern technologies such as light emitting diodes and sensitive and high-speed digital cameras have driven renewed interest in WFOM. To facilitate the wider adoption and standardization of WFOM approaches for neuroscience and neurovascular coupling research, we provide here an overview of the basic principles of WFOM, considerations for implementation of wide-field fluorescence imaging of neural activity, spectroscopic analysis and interpretation of results. This article is part of the themed issue ‘Interpreting BOLD: a dialogue between cognitive and cellular neuroscience’. PMID:27574312

  1. Local active information storage as a tool to understand distributed neural information processing.

    Science.gov (United States)

    Wibral, Michael; Lizier, Joseph T; Vögler, Sebastian; Priesemann, Viola; Galuske, Ralf

    2014-01-01

    Every act of information processing can in principle be decomposed into the component operations of information storage, transfer, and modification. Yet, while this is easily done for today's digital computers, the application of these concepts to neural information processing was hampered by the lack of proper mathematical definitions of these operations on information. Recently, definitions were given for the dynamics of these information processing operations on a local scale in space and time in a distributed system, and the specific concept of local active information storage was successfully applied to the analysis and optimization of artificial neural systems. However, no attempt to measure the space-time dynamics of local active information storage in neural data has been made to date. Here we measure local active information storage on a local scale in time and space in voltage sensitive dye imaging data from area 18 of the cat. We show that storage reflects neural properties such as stimulus preferences and surprise upon unexpected stimulus change, and in area 18 reflects the abstract concept of an ongoing stimulus despite the locally random nature of this stimulus. We suggest that LAIS will be a useful quantity to test theories of cortical function, such as predictive coding.

  2. Effect of short-term escitalopram treatment on neural activation during emotional processing.

    Science.gov (United States)

    Maron, Eduard; Wall, Matt; Norbury, Ray; Godlewska, Beata; Terbeck, Sylvia; Cowen, Philip; Matthews, Paul; Nutt, David J

    2016-01-01

    Recent functional magnetic resonance (fMRI) imaging studies have revealed that subchronic medication with escitalopram leads to significant reduction in both amygdala and medial frontal gyrus reactivity during processing of emotional faces, suggesting that escitalopram may have a distinguishable modulatory effect on neural activation as compared with other serotonin-selective antidepressants. In this fMRI study we aimed to explore whether short-term medication with escitalopram in healthy volunteers is associated with reduced neural response to emotional processing, and whether this effect is predicted by drug plasma concentration. The neural response to fearful and happy faces was measured before and on day 7 of treatment with escitalopram (10mg) in 15 healthy volunteers and compared with those in a control unmedicated group (n=14). Significantly reduced activation to fearful, but not to happy facial expressions was observed in the bilateral amygdala, cingulate and right medial frontal gyrus following escitalopram medication. This effect was not correlated with plasma drug concentration. In accordance with previous data, we showed that escitalopram exerts its rapid direct effect on emotional processing via attenuation of neural activation in pathways involving medial frontal gyrus and amygdala, an effect that seems to be distinguishable from that of other SSRIs.

  3. An investigation of the relationship between activation of a social cognitive neural network and social functioning.

    Science.gov (United States)

    Pinkham, Amy E; Hopfinger, Joseph B; Ruparel, Kosha; Penn, David L

    2008-07-01

    Previous work examining the neurobiological substrates of social cognition in healthy individuals has reported modulation of a social cognitive network such that increased activation of the amygdala, fusiform gyrus, and superior temporal sulcus are evident when individuals judge a face to be untrustworthy as compared with trustworthy. We examined whether this pattern would be present in individuals with schizophrenia who are known to show reduced activation within these same neural regions when processing faces. Additionally, we sought to determine how modulation of this social cognitive network may relate to social functioning. Neural activation was measured using functional magnetic resonance imaging with blood oxygenation level dependent contrast in 3 groups of individuals--nonparanoid individuals with schizophrenia, paranoid individuals with schizophrenia, and healthy controls--while they rated faces as either trustworthy or untrustworthy. Analyses of mean percent signal change extracted from a priori regions of interest demonstrated that both controls and nonparanoid individuals with schizophrenia showed greater activation of this social cognitive network when they rated a face as untrustworthy relative to trustworthy. In contrast, paranoid individuals did not show a significant difference in levels of activation based on how they rated faces. Further, greater activation of this social cognitive network to untrustworthy faces was significantly and positively correlated with social functioning. These findings indicate that impaired modulation of neural activity while processing social stimuli may underlie deficits in social cognition and social dysfunction in schizophrenia.

  4. Searching for learning-dependent changes in the antennal lobe: simultaneous recording of neural activity and aversive olfactory learning in honeybees

    Directory of Open Access Journals (Sweden)

    Edith Roussel

    2010-09-01

    Full Text Available Plasticity in the honeybee brain has been studied using the appetitive olfactory conditioning of the proboscis extension reflex, in which a bee learns the association between an odor and a sucrose reward. In this framework, coupling behavioral measurements of proboscis extension and invasive recordings of neural activity has been difficult because proboscis movements usually introduce brain movements that affect physiological preparations. Here we took advantage of a new conditioning protocol, the aversive olfactory conditioning of the sting extension reflex, which does not generate this problem. We achieved the first simultaneous recordings of conditioned sting extension responses and calcium imaging of antennal lobe activity, thus revealing on-line processing of olfactory information during conditioning trials. Based on behavioral output we distinguished learners and non-learners and analyzed possible learning-dependent changes in antennal lobe activity. We did not find differences between glomerular responses to the CS+ and the CS- in learners. Unexpectedly, we found that during conditioning trials non-learners exhibited a progressive decrease in physiological responses to odors, irrespective of their valence. This effect could neither be attributed to a fitness problem nor to abnormal dye bleaching. We discuss the absence of learning-induced changes in the antennal lobe of learners and the decrease in calcium responses found in non-learners. Further studies will have to extend the search for functional plasticity related to aversive learning to other brain areas and to look on a broader range of temporal scales

  5. Gain control of gamma frequency activation by a novel feed forward disinhibitory loop: implications for normal and epileptic neural activity

    Directory of Open Access Journals (Sweden)

    Zeinab eBirjandian

    2013-11-01

    Full Text Available The inhibition of excitatory (pyramidal neurons directly dampens their activity resulting in a suppression of neural network output. The inhibition of inhibitory cells is more complex. Inhibitory drive is known to gate neural network synchrony, but there is also a widely held view that it may augment excitability by reducing inhibitory cell activity, a process termed disinhibition. Surprisingly, however, disinhibition has never been demonstrated to be an important mechanism that augments or drives the activity of excitatory neurons in a functioning neural circuit. Using voltage sensitive dye imaging (VSDI we show that 20-80 Hz stimulus trains, (beta-gamma activation, of the olfactory cortex pyramidal cells in layer II leads to a subsequent reduction in inhibitory interneuron activity that augments the efficacy of the initial stimulus. This disinhibition occurs with a lag of about 150-250 ms after the initial excitation of the layer 2 pyramidal cell layer. In addition activation of the endopiriform nucleus also arises just before the disinhibitory phase with a lag of about 40-80 ms. Preventing the spread of action potentials from layer II stopped the excitation of the endopiriform nucleus, abolished the disinhibitory activity and reduced the excitation of layer II cells. After the induction of experimental epilepsy the disinhibition was more intense with a concomitant increase in excitatory cell activity. Our observations provide the first evidence of feed forward disinhibition loop that augments excitatory neurotransmission, a mechanism that could play an important role in the development of epileptic seizures.

  6. Neural correlates of attentional bias in addiction.

    Science.gov (United States)

    Hester, Robert; Luijten, Maartje

    2014-06-01

    A small but growing neuroimaging literature has begun to examine the neural mechanisms underlying the difficulty that substance-use dependent (SUD) groups have with ignoring salient, drug-related stimuli. Drug-related attentional bias appears to implicate the countermanding forces of cognitive control and reward salience. Basic cognitive neuroscience research suggests that ignoring emotionally evocative stimuli in our environment requires both up-regulation of control networks and down-regulation of processing in emotion and reward regions. Research to date suggests that attentional biases for drug-related stimuli emerge from a failure to sufficiently increase control of attention over salient, but task-irrelevant stimuli. While SUD samples have typically shown increased activity in the cognitive control regions (ie, lateral prefrontal and dorsal anterior cingulate), during attentional bias such increases appear to have been insufficient for the concomitant increases in processing by the emotion/reward regions (ie, amygdala, insula, and striatum). Given the potential contribution of attentional biases to perpetuating drug use and the development of interventions (both pharmaceutical and cognitive-behavioral) to treat biases, understanding the neural basis of successfully reducing bias remains an important, but as yet unanswered, question for our field.

  7. Lateral habenula neurons signal errors in the prediction of reward information.

    Science.gov (United States)

    Bromberg-Martin, Ethan S; Hikosaka, Okihide

    2011-08-21

    Humans and animals have the ability to predict future events, which they cultivate by continuously searching their environment for sources of predictive information. However, little is known about the neural systems that motivate this behavior. We hypothesized that information-seeking is assigned value by the same circuits that support reward-seeking, such that neural signals encoding reward prediction errors (RPEs) include analogous information prediction errors (IPEs). To test this, we recorded from neurons in the lateral habenula, a nucleus that encodes RPEs, while monkeys chose between cues that provided different chances to view information about upcoming rewards. We found that a subpopulation of lateral habenula neurons transmitted signals resembling IPEs, responding when reward information was unexpectedly cued, delivered or denied. These signals evaluated information sources reliably, even when the monkey's decisions did not. These neurons could provide a common instructive signal for reward-seeking and information-seeking behavior.

  8. Prediction of bioactive compounds activity against wood contaminant fungi using artificial neural networks

    OpenAIRE

    Vicente, Henrique; Roseiro, José C.; Arteiro, José M.; Neves, José; Caldeira, A. Teresa

    2013-01-01

    Biopesticides based on natural endophytic bacteria to control plant diseases are an ecological alternative to the chemical treatments. Bacillus species produce a wide variety of metabolites with biological activity like iturinic lipopeptides. This work addresses the production of biopesticides based on natural endophytic bacteria, isolated from Quercus suber. Artificial Neural Networks were used to maximize the percentage of inhibition triggered by antifungal activity of bioactive compounds p...

  9. Prediction Model of Antibacterial Activities for Inorganic Antibacterial Agents Based on Artificial Neural Networks

    Institute of Scientific and Technical Information of China (English)

    刘雪峰; 张利; 涂铭旌

    2004-01-01

    Quantitatively evaluation of antibacterial activities of inorganic antibacterial agents is an urgent problem to be solved. Using experimental data by an orthogonal design, a prediction model of the relation between conditions of preparing inorganic antibacterial agents and their antibacterial activities has been developed. This is accomplished by introducing BP artificial neural networks in the study of inorganic antibacterial agents..It provides a theoretical support for the development and research on inorganic antibacterial agents.

  10. Pain as a reward: changing the meaning of pain from negative to positive co-activates opioid and cannabinoid systems.

    Science.gov (United States)

    Benedetti, Fabrizio; Thoen, Wilma; Blanchard, Catherine; Vighetti, Sergio; Arduino, Claudia

    2013-03-01

    Pain is a negative emotional experience that is modulated by a variety of psychological factors through different inhibitory systems. For example, endogenous opioids and cannabinoids have been found to be involved in stress and placebo analgesia. Here we show that when the meaning of the pain experience is changed from negative to positive through verbal suggestions, the opioid and cannabinoid systems are co-activated and these, in turn, increase pain tolerance. We induced ischemic arm pain in healthy volunteers, who had to tolerate the pain as long as possible. One group was informed about the aversive nature of the task, as done in any pain study. Conversely, a second group was told that the ischemia would be beneficial to the muscles, thus emphasizing the usefulness of the pain endurance task. We found that in the second group pain tolerance was significantly higher compared to the first one, and that this effect was partially blocked by the opioid antagonist naltrexone alone and by the cannabinoid antagonist rimonabant alone. However, the combined administration of naltrexone and rimonabant antagonized the increased tolerance completely. Our results indicate that a positive approach to pain reduces the global pain experience through the co-activation of the opioid and cannabinoid systems. These findings may have a profound impact on clinical practice. For example, postoperative pain, which means healing, can be perceived as less unpleasant than cancer pain, which means death. Therefore, the behavioral and/or pharmacological manipulation of the meaning of pain can represent an effective approach to pain management.

  11. Constructive feedforward neural networks using hermite polynomial activation functions.

    Science.gov (United States)

    Ma, Liying; Khorasani, K

    2005-07-01

    In this paper, a constructive one-hidden-layer network is introduced where each hidden unit employs a polynomial function for its activation function that is different from other units. Specifically, both a structure level as well as a function level adaptation methodologies are utilized in constructing the network. The functional level adaptation scheme ensures that the "growing" or constructive network has different activation functions for each neuron such that the network may be able to capture the underlying input-output map more effectively. The activation functions considered consist of orthonormal Hermite polynomials. It is shown through extensive simulations that the proposed network yields improved performance when compared to networks having identical sigmoidal activation functions.

  12. Work Motivation and the Negative Effects of Extrinsic Rewards: A Reward With Implications for Theory and Practice

    Science.gov (United States)

    Notz, William W.

    1975-01-01

    Summarizes and discusses findings on two hypotheses predicting interaction between intrinsic and extrinsic motivation: extrinsic rewards are those which provide satisfaction independent of the actual activity itself and are controlled by someone other than the employee, whereas intrinsic rewards are those over which the employee has a high degree…

  13. Endogenous testosterone levels are associated with neural activity in men with schizophrenia during facial emotion processing.

    Science.gov (United States)

    Ji, Ellen; Weickert, Cynthia Shannon; Lenroot, Rhoshel; Catts, Stanley V; Vercammen, Ans; White, Christopher; Gur, Raquel E; Weickert, Thomas W

    2015-06-01

    Growing evidence suggests that testosterone may play a role in the pathophysiology of schizophrenia given that testosterone has been linked to cognition and negative symptoms in schizophrenia. Here, we determine the extent to which serum testosterone levels are related to neural activity in affective processing circuitry in men with schizophrenia. Functional magnetic resonance imaging was used to measure blood-oxygen-level-dependent signal changes as 32 healthy controls and 26 people with schizophrenia performed a facial emotion identification task. Whole brain analyses were performed to determine regions of differential activity between groups during processing of angry versus non-threatening faces. A follow-up ROI analysis using a regression model in a subset of 16 healthy men and 16 men with schizophrenia was used to determine the extent to which serum testosterone levels were related to neural activity. Healthy controls displayed significantly greater activation than people with schizophrenia in the left inferior frontal gyrus (IFG). There was no significant difference in circulating testosterone levels between healthy men and men with schizophrenia. Regression analyses between activation in the IFG and circulating testosterone levels revealed a significant positive correlation in men with schizophrenia (r=.63, p=.01) and no significant relationship in healthy men. This study provides the first evidence that circulating serum testosterone levels are related to IFG activation during emotion face processing in men with schizophrenia but not in healthy men, which suggests that testosterone levels modulate neural processes relevant to facial emotion processing that may interfere with social functioning in men with schizophrenia.

  14. Brain mechanisms of drug reward and euphoria.

    Science.gov (United States)

    Wise, R A; Bozarth, M A

    1985-01-01

    Drugs of abuse have in common the fact that they serve as biological rewards. They presumably do so because of their ability to activate endogenous brain circuitry. By determining the brain circuitry activated by rewarding drug injections, much can be learned about the degree to which there is a common basis for the abuse liability of seemingly different drugs. The brain circuitry activated by two classes of abused drugs, psychomotor stimulants and opiates, is now partially understood; the current evidence suggests a shared mechanism of stimulant reward and opiate reward. The identified portion of the circuitry involves dopamine-containing cells of the ventral tegmental area and their fiber projections to the cells of the nucleus accumbens. Morphine activates these cells in the region of the cell bodies; it may have direct actions on receptors imbedded in the dopaminergic cell membrane, or it may act on afferent terminals that synapse on the dopaminergic cell bodies or dendrites. Cocaine and amphetamine act at the terminals of the dopaminergic fibers to nucleus accumbens and perhaps other structures. The shared activation of the dopaminergic input to nucleus accumbens accounts for the behaviorally activating and the rewarding effects of both stimulants and opiates (the opiate stimulant action is not widely known because it is usually masked by depressant actions of opiates in other, antagonistic, brain circuits). The activation of dopaminergic systems also accounts for amphetamine euphoria; it almost certainly accounts for cocaine euphoria and it probably accounts for opiate euphoria as well. Opiates and psychomotor stimulants clearly have many other actions which are not shared; nonshared actions must account for the well-known differences in the subjective effects of opiates and stimulants. One of the major nonshared actions is physical dependence. Opiates gain access to a major component of the circuitry mediating opiate physical dependence through opiate

  15. Dampened neural activity and abolition of epileptic-like activity in cortical slices by active ingredients of spices.

    Science.gov (United States)

    Pezzoli, Maurizio; Elhamdani, Abdeladim; Camacho, Susana; Meystre, Julie; González, Stephanie Michlig; le Coutre, Johannes; Markram, Henry

    2014-10-31

    Active ingredients of spices (AIS) modulate neural response in the peripheral nervous system, mainly through interaction with TRP channel/receptors. The present study explores how different AIS modulate neural response in layer 5 pyramidal neurons of S1 neocortex. The AIS tested are agonists of TRPV1/3, TRPM8 or TRPA1. Our results demonstrate that capsaicin, eugenol, menthol, icilin and cinnamaldehyde, but not AITC dampen the generation of APs in a voltage- and time-dependent manner. This effect was further tested for the TRPM8 ligands in the presence of a TRPM8 blocker (BCTC) and on TRPM8 KO mice. The observable effect was still present. Finally, the influence of the selected AIS was tested on in vitro gabazine-induced seizures. Results coincide with the above observations: except for cinnamaldehyde, the same AIS were able to reduce the number, duration of the AP bursts and increase the concentration of gabazine needed to elicit them. In conclusion, our data suggests that some of these AIS can modulate glutamatergic neurons in the brain through a TRP-independent pathway, regardless of whether the neurons are stimulated intracellularly or by hyperactive microcircuitry.

  16. Video-based convolutional neural networks for activity recognition from robot-centric videos

    Science.gov (United States)

    Ryoo, M. S.; Matthies, Larry

    2016-05-01

    In this evaluation paper, we discuss convolutional neural network (CNN)-based approaches for human activity recognition. In particular, we investigate CNN architectures designed to capture temporal information in videos and their applications to the human activity recognition problem. There have been multiple previous works to use CNN-features for videos. These include CNNs using 3-D XYT convolutional filters, CNNs using pooling operations on top of per-frame image-based CNN descriptors, and recurrent neural networks to learn temporal changes in per-frame CNN descriptors. We experimentally compare some of these different representatives CNNs while using first-person human activity videos. We especially focus on videos from a robots viewpoint, captured during its operations and human-robot interactions.

  17. Persistent neural activity in the prefrontal cortex: a mechanism by which BDNF regulates working memory?

    Science.gov (United States)

    Galloway, Evan M; Woo, Newton H; Lu, Bai

    2008-01-01

    Working memory is the ability to maintain representations of task-relevant information for short periods of time to guide subsequent actions or make decisions. Neurons of the prefrontal cortex exhibit persistent firing during the delay period of working memory tasks. Despite extensive studies, the mechanisms underlying this persistent neural activity remain largely obscure. The neurotransmitter systems of dopamine, NMDA, and GABA have been implicated, but further investigations are necessary to establish their precise roles and relationships. Recent research has suggested a new component: brain-derived neurotrophic factor (BDNF) and its high-affinity receptor, TrkB. We review the research on persistent activity and suggest that BDNF/TrkB signaling in a distinct class of interneurons plays an important role in organizing persistent neural activity at the single-neuron and network levels.

  18. Model Integrating Fuzzy Argument with Neural Network Enhancing the Performance of Active Queue Management

    Directory of Open Access Journals (Sweden)

    Nguyen Kim Quoc

    2015-08-01

    Full Text Available The bottleneck control by active queue management mechanisms at network nodes is essential. In recent years, some researchers have used fuzzy argument to improve the active queue management mechanisms to enhance the network performance. However, the projects using the fuzzy controller depend heavily on professionals and their parameters cannot be updated according to changes in the network, so the effectiveness of this mechanism is not high. Therefore, we propose a model combining the fuzzy controller with neural network (FNN to overcome the limitations above. Results of the training of the neural networks will find the optimal parameters for the adaptive fuzzy controller well to changes of the network. This improves the operational efficiency of the active queue management mechanisms at network nodes.

  19. Neural activities during affective processing in people with Alzheimer's disease

    NARCIS (Netherlands)

    Lee, Tatia M. C.; Sun, Delin; Leung, Mei-Kei; Chu, Leung-Wing; Keysers, Christian

    2013-01-01

    This study examined brain activities in people with Alzheimer's disease when viewing happy, sad, and fearful facial expressions of others. A functional magnetic resonance imaging and a voxel-based morphometry methodology together with a passive viewing of emotional faces paradigm were employed to co

  20. Concurrent multitasking : From neural activity to human cognition

    NARCIS (Netherlands)

    Nijboer, Menno

    2016-01-01

    Multitasking has become an important part of our daily lives. This delicate juggling act between several activities occurs when people drive, when they are working, and even when they should be paying attention in the classroom. While multitasking is typically considered as something to avoid, there