WorldWideScience

Sample records for activate neural reward

  1. Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.

    Science.gov (United States)

    Kim, Sang Hee; Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

    2015-09-01

    In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment.

  2. Perceptual Salience and Reward Both Influence Feedback-Related Neural Activity Arising from Choice.

    Science.gov (United States)

    Lou, Bin; Hsu, Wha-Yin; Sajda, Paul

    2015-09-23

    expected reward. Here, we use electroencephelography to identify trial-by-trial neural activity of perceived stimulus salience, showing that this activity can be combined with the value of choice options to form a representation of expected reward. Our results provide insight into the neural processing governing the interaction between salience and value and the formation of subjective expected reward and prediction error. This work is potentially important for identifying neural markers of abnormal sensory/value processing, as is seen in some cases of psychiatric illnesses. PMID:26400937

  3. Primary and secondary rewards differentially modulate neural activity dynamics during working memory.

    Directory of Open Access Journals (Sweden)

    Stefanie M Beck

    Full Text Available BACKGROUND: Cognitive control and working memory processes have been found to be influenced by changes in motivational state. Nevertheless, the impact of different motivational variables on behavior and brain activity remains unclear. METHODOLOGY/PRINCIPAL FINDINGS: The current study examined the impact of incentive category by varying on a within-subjects basis whether performance during a working memory task was reinforced with either secondary (monetary or primary (liquid rewards. The temporal dynamics of motivation-cognition interactions were investigated by employing an experimental design that enabled isolation of sustained and transient effects. Performance was dramatically and equivalently enhanced in each incentive condition, whereas neural activity dynamics differed between incentive categories. The monetary reward condition was associated with a tonic activation increase in primarily right-lateralized cognitive control regions including anterior prefrontal cortex (PFC, dorsolateral PFC, and parietal cortex. In the liquid condition, the identical regions instead showed a shift in transient activation from a reactive control pattern (primary probe-based activation during no-incentive trials to proactive control (primary cue-based activation during rewarded trials. Additionally, liquid-specific tonic activation increases were found in subcortical regions (amygdala, dorsal striatum, nucleus accumbens, indicating an anatomical double dissociation in the locus of sustained activation. CONCLUSIONS/SIGNIFICANCE: These different activation patterns suggest that primary and secondary rewards may produce similar behavioral changes through distinct neural mechanisms of reinforcement. Further, our results provide new evidence for the flexibility of cognitive control, in terms of the temporal dynamics of activation.

  4. Motivated to win: Relationship between anticipatory and outcome reward-related neural activity.

    Science.gov (United States)

    Pornpattananangkul, Narun; Nusslock, Robin

    2015-11-01

    Reward-processing involves two temporal stages characterized by two distinct neural processes: reward-anticipation and reward-outcome. Intriguingly, very little research has examined the relationship between neural processes involved in reward-anticipation and reward-outcome. To investigate this, one needs to consider the heterogeneity of reward-processing within each stage. To identify different stages of reward processing, we adapted a reward time-estimation task. While EEG data were recorded, participants were instructed to button-press 3.5s after the onset of an Anticipation-Cue and received monetary reward for good time-estimation on the Reward trials, but not on No-Reward trials. We first separated reward-anticipation into event related potentials (ERPs) occurring at three sub-stages: reward/no-reward cue-evaluation, motor-preparation and feedback-anticipation. During reward/no-reward cue-evaluation, the Reward-Anticipation Cue led to a smaller N2 and larger P3. During motor-preparation, we report, for the first time, that the Reward-Anticipation Cue enhanced the Readiness Potential (RP), starting approximately 1s before movement. At the subsequent feedback-anticipation stage, the Reward-Anticipation Cue elevated the Stimulus-Preceding Negativity (SPN). We also separated reward-outcome ERPs into different components occurring at different time-windows: the Feedback-Related Negativity (FRN), Feedback-P3 (FB-P3) and Late-Positive Potentials (LPP). Lastly, we examined the relationship between reward-anticipation and reward-outcome ERPs. We report that individual-differences in specific reward-anticipation ERPs uniquely predicted specific reward-outcome ERPs. In particular, the reward-anticipation Early-RP (1-.8s before movement) predicted early reward-outcome ERPs (FRN and FB-P3), whereas, the reward-anticipation SPN most strongly predicted a later reward-outcome ERP (LPP). Results have important implications for understanding the nature of the relationship

  5. Memory Consolidation and Neural Substrate of Reward

    Directory of Open Access Journals (Sweden)

    Redolar-Ripoll, Diego

    2012-08-01

    Full Text Available The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of goal-directed behavior. The neural substrate underling this processing of reward information is a reliable way of improving learning and memory processes. Evidence from several studies indicates that this neural system can facilitate memory consolidation in a wide variety of learning tasks. From a molecular perspective, certain cardinal features of reward have been described as forms of memory. Studies of human addicts and studies in animal models of addiction show that chronic drug exposure produces stable changes in the brain at the cellular and molecular levels that underlie the long-lasting behavioral plasticity associated with addiction. These molecular and cellular adaptations involved in addiction are also implicated in learning and memory processes. Dopamine seems to be a critical common signal to activate different genetic mechanisms that ultimately remodel synapses and circuits. Despite memory is an active and complex process mediated by different brain areas, the neural substrate of reward is able to improve memory consolidation in a several paradigms. We believe that there are many equivalent traits between reward and learning and memory processes.

  6. Interactivity and reward-related neural activation during a serious videogame.

    Directory of Open Access Journals (Sweden)

    Steven W Cole

    Full Text Available This study sought to determine whether playing a "serious" interactive digital game (IDG--the Re-Mission videogame for cancer patients--activates mesolimbic neural circuits associated with incentive motivation, and if so, whether such effects stem from the participatory aspects of interactive gameplay, or from the complex sensory/perceptual engagement generated by its dynamic event-stream. Healthy undergraduates were randomized to groups in which they were scanned with functional magnetic resonance imaging (FMRI as they either actively played Re-Mission or as they passively observed a gameplay audio-visual stream generated by a yoked active group subject. Onset of interactive game play robustly activated mesolimbic projection regions including the caudate nucleus and nucleus accumbens, as well as a subregion of the parahippocampal gyrus. During interactive gameplay, subjects showed extended activation of the thalamus, anterior insula, putamen, and motor-related regions, accompanied by decreased activation in parietal and medial prefrontal cortex. Offset of interactive gameplay activated the anterior insula and anterior cingulate. Between-group comparisons of within-subject contrasts confirmed that mesolimbic activation was significantly more pronounced in the active playgroup than in the passive exposure control group. Individual difference analyses also found the magnitude of parahippocampal activation following gameplay onset to correlate with positive attitudes toward chemotherapy assessed both at the end of the scanning session and at an unannounced one-month follow-up. These findings suggest that IDG-induced activation of reward-related mesolimbic neural circuits stems primarily from participatory engagement in gameplay (interactivity, rather than from the effects of vivid and dynamic sensory stimulation.

  7. Interactivity and reward-related neural activation during a serious videogame.

    Science.gov (United States)

    Cole, Steven W; Yoo, Daniel J; Knutson, Brian

    2012-01-01

    This study sought to determine whether playing a "serious" interactive digital game (IDG)--the Re-Mission videogame for cancer patients--activates mesolimbic neural circuits associated with incentive motivation, and if so, whether such effects stem from the participatory aspects of interactive gameplay, or from the complex sensory/perceptual engagement generated by its dynamic event-stream. Healthy undergraduates were randomized to groups in which they were scanned with functional magnetic resonance imaging (FMRI) as they either actively played Re-Mission or as they passively observed a gameplay audio-visual stream generated by a yoked active group subject. Onset of interactive game play robustly activated mesolimbic projection regions including the caudate nucleus and nucleus accumbens, as well as a subregion of the parahippocampal gyrus. During interactive gameplay, subjects showed extended activation of the thalamus, anterior insula, putamen, and motor-related regions, accompanied by decreased activation in parietal and medial prefrontal cortex. Offset of interactive gameplay activated the anterior insula and anterior cingulate. Between-group comparisons of within-subject contrasts confirmed that mesolimbic activation was significantly more pronounced in the active playgroup than in the passive exposure control group. Individual difference analyses also found the magnitude of parahippocampal activation following gameplay onset to correlate with positive attitudes toward chemotherapy assessed both at the end of the scanning session and at an unannounced one-month follow-up. These findings suggest that IDG-induced activation of reward-related mesolimbic neural circuits stems primarily from participatory engagement in gameplay (interactivity), rather than from the effects of vivid and dynamic sensory stimulation.

  8. Neural processing of reward in adolescent rodents

    Directory of Open Access Journals (Sweden)

    Nicholas W. Simon

    2015-02-01

    Full Text Available Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.

  9. Neural sensitivity to absolute and relative anticipated reward in adolescents.

    Science.gov (United States)

    Vaidya, Jatin G; Knutson, Brian; O'Leary, Daniel S; Block, Robert I; Magnotta, Vincent

    2013-01-01

    Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID) task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards). This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude). While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing), adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards) correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity. PMID:23544046

  10. Neural sensitivity to absolute and relative anticipated reward in adolescents.

    Directory of Open Access Journals (Sweden)

    Jatin G Vaidya

    Full Text Available Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards. This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude. While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing, adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity.

  11. Preliminary Evidence for Impaired Brain Activity of Neural Reward Processing in Children and Adolescents with Reactive Attachment Disorder.

    Science.gov (United States)

    Tomoda, Akemi

    2016-01-01

    Childhood maltreatment, which markedly increases risks for psychopathology, is associated with structural and functional brain differences. Especially, exposure to parental verbal abuse (PVA) or interparental violence during childhood is associated with negative outcomes such as depression, posttraumatic stress disorder (PTSD), and reduced cognitive abilities. Other forms of childhood maltreatment have been associated with brain structure or developmental alteration. Our earlier studies elucidated potential discernible effects of PVA and witnessing domestic violence during childhood on brain morphology, including gray matter volume or cortical thickness. Brain regions that process and convey the adverse sensory input of the abuse might be modified specifically by such experiences, particularly in subjects exposed to a single type of maltreatment. Exposure to multiple types of maltreatment is more commonly associated with morphological alterations in the corticolimbic regions. These findings fit with preclinical studies showing that sensory cortices are highly plastic structures. Using tasks with high and low monetary rewards while subjects underwent functional MRI, we also examined whether neural activity during reward processing was altered, or not, in children and adolescents with reactive attachment disorder (RAD). Significantly reduced activity in the caudate and nucleus accumbens was observed during a high monetary reward condition in the RAD group compared to the typically developed group. The striatal neural reward activity in the RAD group was also markedly decreased. The present results suggest that dopaminergic dysfunction occurred in the striatum in children and adolescents with RAD, potentially leading to a future risk of psychiatric disorders such as dependence. PMID:27150924

  12. The neural correlates of temporal reward discounting

    NARCIS (Netherlands)

    Scheres, A.P.J.; Water, E. de; Mies, G.W.

    2013-01-01

    Temporal reward discounting (TD) refers to the decrease in subjective value of a reward when the delay to that reward increases. In recent years, a growing number of studies on the neural correlates of temporal reward discounting have been conducted. This article focuses on functional magnetic reson

  13. Differentiating neural reward responsiveness in autism versus ADHD.

    OpenAIRE

    2014-01-01

    Although attention deficit hyperactivity disorders (ADHD) and autism spectrum disorders (ASD) share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC). A significant group by reward type i...

  14. Differentiating neural reward responsiveness in autism versus ADHD

    Directory of Open Access Journals (Sweden)

    Gregor Kohls

    2014-10-01

    Full Text Available Although attention deficit hyperactivity disorders (ADHD and autism spectrum disorders (ASD share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC. A significant group by reward type interaction effect emerged in the ventral striatum with greater activation to monetary versus social reward only in TDC, whereas subjects with ADHD responded equally strong to both reward types, and subjects with ASD showed low striatal reactivity across both reward conditions. Moreover, disorder-specific neural abnormalities were revealed, including medial prefrontal hyperactivation in response to social reward in ADHD versus ventral striatal hypoactivation in response to monetary reward in ASD. Shared dysfunction was characterized by fronto-striato-parietal hypoactivation in both clinical groups when money was at stake. Interestingly, lower neural activation within parietal circuitry was associated with higher autistic traits across the entire study sample. In sum, the present findings concur with the assumption that both ASD and ADHD display distinct and shared neural dysfunction in response to reward.

  15. Stress and CRF gate neural activation of BDNF in the mesolimbic reward pathway.

    Science.gov (United States)

    Walsh, Jessica J; Friedman, Allyson K; Sun, Haosheng; Heller, Elizabeth A; Ku, Stacy M; Juarez, Barbara; Burnham, Veronica L; Mazei-Robison, Michelle S; Ferguson, Deveroux; Golden, Sam A; Koo, Ja Wook; Chaudhury, Dipesh; Christoffel, Daniel J; Pomeranz, Lisa; Friedman, Jeffrey M; Russo, Scott J; Nestler, Eric J; Han, Ming-Hu

    2014-01-01

    Mechanisms controlling release of brain-derived neurotrophic factor (BDNF) in the mesolimbic dopamine reward pathway remain unknown. We report that phasic optogenetic activation of this pathway increases BDNF amounts in the nucleus accumbens (NAc) of socially stressed mice but not of stress-naive mice. This stress gating of BDNF signaling is mediated by corticotrophin-releasing factor (CRF) acting in the NAc. These results unravel a stress context-detecting function of the brain's mesolimbic circuit.

  16. Neural response to reward anticipation is modulated by Gray's impulsivity.

    Science.gov (United States)

    Hahn, Tim; Dresler, Thomas; Ehlis, Ann-Christine; Plichta, Michael M; Heinzel, Sebastian; Polak, Thomas; Lesch, Klaus-Peter; Breuer, Felix; Jakob, Peter M; Fallgatter, Andreas J

    2009-07-15

    According to the Reinforcement Sensitivity Theory (RST), Gray's dimension of impulsivity, reflecting human trait reward sensitivity, determines the extent to which stimuli activate the Behavioural Approach System (BAS). The potential neural underpinnings of the BAS, however, remain poorly understood. In the present study, we examined the association between Gray's impulsivity as defined by the RST and event-related fMRI BOLD-response to anticipation of reward in twenty healthy human subjects in brain regions previously associated with reward processing. Anticipation of reward during a Monetary Incentive Delay Task elicited activation in key components of the human reward circuitry such as the ventral striatum, the amygdala and the orbitofrontal cortex. Interindividual differences in Gray's impulsivity accounted for a significant amount of variance of the reward-related BOLD-response in the ventral striatum and the orbitofrontal cortex. Specifically, higher trait reward sensitivity was associated with increased activation in response to cues indicating potential reward. Extending previous evidence, here we show that variance in functional brain activation during anticipation of reward is attributed to interindividual differences regarding Gray's dimension of impulsivity. Thus, trait reward sensitivity contributes to the modulation of responsiveness in major components of the human reward system which thereby display a core property of the BAS. Generally, fostering our understanding of the neural underpinnings of the association of reward-related interindividual differences in affective traits might aid researchers in quest for custom-tailored treatments of psychiatric disorders, further disentangling the complex relationship between personality traits, emotion, and health. PMID:19328237

  17. Reward-related neural responses are dependent on the beneficiary.

    Science.gov (United States)

    Braams, Barbara R; Güroğlu, Berna; de Water, Erik; Meuwese, Rosa; Koolschijn, P Cédric; Peper, Jiska S; Crone, Eveline A

    2014-07-01

    Prior studies have suggested that positive social interactions are experienced as rewarding. Yet, it is not well understood how social relationships influence neural responses to other persons' gains. In this study, we investigated neural responses during a gambling task in which healthy participants (N = 31; 18 females) could win or lose money for themselves, their best friend or a disliked other (antagonist). At the moment of receiving outcome, person-related activity was observed in the dorsal medial prefrontal cortex (dmPFC), precuneus and temporal parietal junction (TPJ), showing higher activity for friends and antagonists than for self, and this activity was independent of outcome. The only region showing an interaction between the person-participants played for and outcome was the ventral striatum. Specifically, the striatum was more active following gains than losses for self and friends, whereas for the antagonist this pattern was reversed. Together, these results show that, in a context with social and reward information, social aspects are processed in brain regions associated with social cognition (mPFC, TPJ), and reward aspects are processed in primary reward areas (striatum). Furthermore, there is an interaction of social and reward information in the striatum, such that reward-related activity was dependent on social relationship.

  18. Reward-related neural responses are dependent on the beneficiary.

    Science.gov (United States)

    Braams, Barbara R; Güroğlu, Berna; de Water, Erik; Meuwese, Rosa; Koolschijn, P Cédric; Peper, Jiska S; Crone, Eveline A

    2014-07-01

    Prior studies have suggested that positive social interactions are experienced as rewarding. Yet, it is not well understood how social relationships influence neural responses to other persons' gains. In this study, we investigated neural responses during a gambling task in which healthy participants (N = 31; 18 females) could win or lose money for themselves, their best friend or a disliked other (antagonist). At the moment of receiving outcome, person-related activity was observed in the dorsal medial prefrontal cortex (dmPFC), precuneus and temporal parietal junction (TPJ), showing higher activity for friends and antagonists than for self, and this activity was independent of outcome. The only region showing an interaction between the person-participants played for and outcome was the ventral striatum. Specifically, the striatum was more active following gains than losses for self and friends, whereas for the antagonist this pattern was reversed. Together, these results show that, in a context with social and reward information, social aspects are processed in brain regions associated with social cognition (mPFC, TPJ), and reward aspects are processed in primary reward areas (striatum). Furthermore, there is an interaction of social and reward information in the striatum, such that reward-related activity was dependent on social relationship. PMID:23720575

  19. RM-SORN: a reward-modulated self-organizing recurrent neural network.

    Science.gov (United States)

    Aswolinskiy, Witali; Pipa, Gordon

    2015-01-01

    Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain.

  20. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

    Science.gov (United States)

    Schultz, Wolfram

    2004-04-01

    Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making. PMID:15082317

  1. Neural dissociation of food- and money-related reward processing using an abstract incentive delay task.

    Science.gov (United States)

    Simon, Joe J; Skunde, Mandy; Wu, Mudan; Schnell, Knut; Herpertz, Sabine C; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

    2015-08-01

    Food is an innate reward stimulus related to energy homeostasis and survival, whereas money is considered a more general reward stimulus that gains a rewarding value through learning experiences. Although the underlying neural processing for both modalities of reward has been investigated independently from one another, a more detailed investigation of neural similarities and/or differences between food and monetary reward is still missing. Here, we investigated the neural processing of food compared with monetary-related rewards in 27 healthy, normal-weight women using functional magnetic resonance imaging. We developed a task distinguishing between the anticipation and the receipt of either abstract food or monetary reward. Both tasks activated the ventral striatum during the expectation of a reward. Compared with money, greater food-related activations were observed in prefrontal, parietal and central midline structures during the anticipation and lateral orbitofrontal cortex (lOFC) during the receipt of food reward. Furthermore, during the receipt of food reward, brain activation in the secondary taste cortex was positively related to the body mass index. These results indicate that food-dependent activations encompass to a greater extent brain regions involved in self-control and self-reflection during the anticipation and phylogenetically older parts of the lOFC during the receipt of reward.

  2. Neural processing of calories in brain reward areas can be modulated by reward sensitivity

    Directory of Open Access Journals (Sweden)

    Inge eVan Rijn

    2016-01-01

    Full Text Available A food’s reward value is dependent on its caloric content. Furthermore, a food’s acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity, however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015, in which participants (n=30 tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n=18 (Griffioen-Roose et al., 2013. First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS questionnaire.When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate, right amygdala and anterior cingulate cortex (bilaterally correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per

  3. Memory Consolidation and Neural Substrate of Reward

    OpenAIRE

    Redolar-Ripoll, Diego

    2012-01-01

    The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of go...

  4. Activation of the human brain by monetary reward

    NARCIS (Netherlands)

    Thut, G; Schultz, W; Roelcke, U; Nienhusmeier, M; Missimer, J; Maguire, RP; Leenders, KL

    1997-01-01

    WITH the purpose of studying neural activation associated with reward processing in humans, we measured regional cerebral blood flow in 10 right-handed healthy subjects performing a delayed go-no go task in two different reinforcement conditions. Correct responses were either rewarded by money or a

  5. Effects of selective serotonin reuptake inhibition on neural activity related to risky decisions and monetary rewards in healthy males

    DEFF Research Database (Denmark)

    Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E;

    2014-01-01

    or placebo. Participants underwent task-related fMRI prior to and after the three-week intervention while performing a card gambling task. The task required participants to choose between two decks of cards. Choices were associated with different risk levels and potential reward magnitudes. Relative...... the involvement of the normally functioning 5HT-system in decision-making under risk and processing of monetary rewards. The data suggest that prolonged SSRI treatment might reduce emotional engagement by reducing the impact of risk during decision-making or the impact of reward during outcome evaluation....

  6. The role of the neural reward system in attention selection.

    Science.gov (United States)

    Soder, Heather E; de Dios, Constanza; Potts, Geoffrey F

    2016-07-01

    The prefrontal cortex may play a role in attention selection using motivational information from the mesotelencephalic dopamine system, a neural system that responds to reward prediction violations. If so, neural indices of attention selection and reward prediction violation should have overlapping spatiotemporal distributions. Attention selection elicits a frontal event-related potential component around 200-300 ms, the frontal selection positivity. A component with similar spatiotemporal characteristics, the reward positivity is elicited in reward prediction designs to outcomes that are better than expected. The current study used dense sensor array recording in a sample of 41 participants performing visual oddball (attention) and a reward prediction 'slot machine-like' design to compare the spatiotemporal distributions of the frontal selection positivity and the reward positivity. The components did not differ in their peak latencies and had overlapping scalp topographies, supporting the hypothesis that these positivities represent attachment of incentive salience to perceptual representations in the prefrontal cortex. PMID:27232519

  7. Altered neural reward and loss processing and prediction error signalling in depression.

    Science.gov (United States)

    Ubl, Bettina; Kuehner, Christine; Kirsch, Peter; Ruttorf, Michaela; Diener, Carsten; Flor, Herta

    2015-08-01

    Dysfunctional processing of reward and punishment may play an important role in depression. However, functional magnetic resonance imaging (fMRI) studies have shown heterogeneous results for reward processing in fronto-striatal regions. We examined neural responsivity associated with the processing of reward and loss during anticipation and receipt of incentives and related prediction error (PE) signalling in depressed individuals. Thirty medication-free depressed persons and 28 healthy controls performed an fMRI reward paradigm. Regions of interest analyses focused on neural responses during anticipation and receipt of gains and losses and related PE-signals. Additionally, we assessed the relationship between neural responsivity during gain/loss processing and hedonic capacity. When compared with healthy controls, depressed individuals showed reduced fronto-striatal activity during anticipation of gains and losses. The groups did not significantly differ in response to reward and loss outcomes. In depressed individuals, activity increases in the orbitofrontal cortex and nucleus accumbens during reward anticipation were associated with hedonic capacity. Depressed individuals showed an absence of reward-related PEs but encoded loss-related PEs in the ventral striatum. Depression seems to be linked to blunted responsivity in fronto-striatal regions associated with limited motivational responses for rewards and losses. Alterations in PE encoding might mirror blunted reward- and enhanced loss-related associative learning in depression. PMID:25567763

  8. Gender-specific modulation of neural mechanisms underlying social reward processing by Autism Quotient.

    Science.gov (United States)

    Barman, Adriana; Richter, Sylvia; Soch, Joram; Deibele, Anna; Richter, Anni; Assmann, Anne; Wüstenberg, Torsten; Walter, Henrik; Seidenbecher, Constanze I; Schott, Björn H

    2015-11-01

    Autism spectrum disorder refers to a neurodevelopmental condition primarily characterized by deficits in social cognition and behavior. Subclinically, autistic features are supposed to be present in healthy humans and can be quantified using the Autism Quotient (AQ). Here, we investigated a potential relationship between AQ and neural correlates of social and monetary reward processing, using functional magnetic resonance imaging in young, healthy participants. In an incentive delay task with either monetary or social reward, reward anticipation elicited increased ventral striatal activation, which was more pronounced during monetary reward anticipation. Anticipation of social reward elicited activation in the default mode network (DMN), a network previously implicated in social processing. Social reward feedback was associated with bilateral amygdala and fusiform face area activation. The relationship between AQ and neural correlates of social reward processing varied in a gender-dependent manner. In women and, to a lesser extent in men, higher AQ was associated with increased posterior DMN activation during social reward anticipation. During feedback, we observed a negative correlation of AQ and right amygdala activation in men only. Our results suggest that social reward processing might constitute an endophenotype for autism-related traits in healthy humans that manifests in a gender-specific way. PMID:25944965

  9. Relief as a reward: hedonic and neural responses to safety from pain.

    Directory of Open Access Journals (Sweden)

    Siri Leknes

    Full Text Available Relief fits the definition of a reward. Unlike other reward types the pleasantness of relief depends on the violation of a negative expectation, yet this has not been investigated using neuroimaging approaches. We hypothesized that the degree of negative expectation depends on state (dread and trait (pessimism sensitivity. Of the brain regions that are involved in mediating pleasure, the nucleus accumbens also signals unexpected reward and positive prediction error. We hypothesized that accumbens activity reflects the level of negative expectation and subsequent pleasant relief. Using fMRI and two purpose-made tasks, we compared hedonic and BOLD responses to relief with responses during an appetitive reward task in 18 healthy volunteers. We expected some similarities in task responses, reflecting common neural substrates implicated across reward types. However, we also hypothesized that relief responses would differ from appetitive rewards in the nucleus accumbens, since only relief pleasantness depends on negative expectations. The results confirmed these hypotheses. Relief and appetitive reward task activity converged in the ventromedial prefrontal cortex, which also correlated with appetitive reward pleasantness ratings. In contrast, dread and pessimism scores correlated with relief but not with appetitive reward hedonics. Moreover, only relief pleasantness covaried with accumbens activation. Importantly, the accumbens signal appeared to specifically reflect individual differences in anticipation of the adverse event (dread, pessimism but was uncorrelated to appetitive reward hedonics. In conclusion, relief differs from appetitive rewards due to its reliance on negative expectations, the violation of which is reflected in relief-related accumbens activation.

  10. Response of neural reward regions to food cues in autism spectrum disorders

    Directory of Open Access Journals (Sweden)

    Cascio Carissa J

    2012-05-01

    Full Text Available Abstract Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our understanding of neural reward circuitry in ASD includes a characterization of the neural response to primary rewards. Method We asked 17 children with ASD and 18 children without ASD to abstain from eating for at least four hours before an MRI scan in which they viewed images of high-calorie foods. We assessed the neural reward network for increases in the blood oxygenation level dependent (BOLD signal in response to the food images Results We found very similar patterns of increased BOLD signal to these images in the two groups; both groups showed increased BOLD signal in the bilateral amygdala, as well as in the nucleus accumbens, orbitofrontal cortex, and insula. Direct group comparisons revealed that the ASD group showed a stronger response to food cues in bilateral insula along the anterior-posterior gradient and in the anterior cingulate cortex than the control group, whereas there were no neural reward regions that showed higher activation for controls than for ASD. Conclusion These results suggest that neural response to primary rewards is not diminished but in fact shows an aberrant enhancement in children with ASD.

  11. Shared neural basis of social and non-social reward deficits in chronic cocaine users.

    Science.gov (United States)

    Tobler, Philippe N; Preller, Katrin H; Campbell-Meiklejohn, Daniel K; Kirschner, Matthias; Kraehenmann, Rainer; Stämpfli, Philipp; Herdener, Marcus; Seifritz, Erich; Quednow, Boris B

    2016-06-01

    Changed reward functions have been proposed as a core feature of stimulant addiction, typically observed as reduced neural responses to non-drug-related rewards. However, it was unclear yet how specific this deficit is for different types of non-drug rewards arising from social and non-social reinforcements. We used functional neuroimaging in cocaine users to investigate explicit social reward as modeled by agreement of music preferences with music experts. In addition, we investigated non-social reward as modeled by winning desired music pieces. The study included 17 chronic cocaine users and 17 matched stimulant-naive healthy controls. Cocaine users, compared with controls, showed blunted neural responses to both social and non-social reward. Activation differences were located in the ventromedial prefrontal cortex overlapping for both reward types and, thus, suggesting a non-specific deficit in the processing of non-drug rewards. Interestingly, in the posterior lateral orbitofrontal cortex, social reward responses of cocaine users decreased with the degree to which they were influenced by social feedback from the experts, a response pattern that was opposite to that observed in healthy controls. The present results suggest that cocaine users likely suffer from a generalized impairment in value representation as well as from an aberrant processing of social feedback. PMID:26969866

  12. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function.

    Science.gov (United States)

    Subramaniam, Karuna; Hooker, Christine I; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

    2015-01-01

    Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal-striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal-striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life. PMID:26413478

  13. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function

    Directory of Open Access Journals (Sweden)

    Karuna Subramaniam

    2015-01-01

    Full Text Available Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC participants, reward anticipation is associated with activity in frontal–striatal networks. By contrast, schizophrenia (SZ participants show hypoactivation within these frontal–striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.

  14. Training recurrent neural networks with sparse, delayed rewards for flexible decision tasks

    OpenAIRE

    Miconi, Thomas

    2015-01-01

    Recurrent neural networks in the chaotic regime exhibit complex dynamics reminiscent of high-level cortical activity during behavioral tasks. However, existing training methods for such networks are either biologically implausible, or require a real-time continuous error signal to guide the learning process. This is in contrast with most behavioral tasks, which only provide time-sparse, delayed rewards. Here we show that a biologically plausible reward-modulated Hebbian learning algorithm, pr...

  15. Fairness influences early signatures of reward-related neural processing.

    Science.gov (United States)

    Massi, Bart; Luhmann, Christian C

    2015-12-01

    Many humans exhibit a strong preference for fairness during decision-making. Although there is evidence that social factors influence reward-related and affective neural processing, it is unclear if this effect is mediated by compulsory outcome evaluation processes or results from slower deliberate cognition. Here we show that the feedback-related negativity (FRN) and late positive potential (LPP), two signatures of early hedonic processing, are modulated by the fairness of rewards during a passive rating task. We find that unfair payouts elicit larger FRNs than fair payouts, whereas fair payouts elicit larger LPPs than unfair payouts. This is true both in the time-domain, where the FRN and LPP are related, and in the time-frequency domain, where the two signals are largely independent. Ultimately, this work demonstrates that fairness affects the early stages of reward and affective processing, suggesting a common biological mechanism for social and personal reward evaluation.

  16. Perceptions of moral character modulate the neural systems of reward during the trust game.

    Science.gov (United States)

    Delgado, M R; Frank, R H; Phelps, E A

    2005-11-01

    Studies of reward learning have implicated the striatum as part of a neural circuit that guides and adjusts future behavior on the basis of reward feedback. Here we investigate whether prior social and moral information about potential trading partners affects this neural circuitry. Participants made risky choices about whether to trust hypothetical trading partners after having read vivid descriptions of life events indicating praiseworthy, neutral or suspect moral character. Despite equivalent reinforcement rates for all partners, participants were persistently more likely to make risky choices with the 'good' partner. As expected from previous studies, activation of the caudate nucleus differentiated between positive and negative feedback, but only for the 'neutral' partner. Notably, it did not do so for the 'good' partner and did so only weakly for the 'bad' partner, suggesting that prior social and moral perceptions can diminish reliance on feedback mechanisms in the neural circuitry of trial-and-error reward learning.

  17. Perceptions of moral character modulate the neural systems of reward during the trust game.

    Science.gov (United States)

    Delgado, M R; Frank, R H; Phelps, E A

    2005-11-01

    Studies of reward learning have implicated the striatum as part of a neural circuit that guides and adjusts future behavior on the basis of reward feedback. Here we investigate whether prior social and moral information about potential trading partners affects this neural circuitry. Participants made risky choices about whether to trust hypothetical trading partners after having read vivid descriptions of life events indicating praiseworthy, neutral or suspect moral character. Despite equivalent reinforcement rates for all partners, participants were persistently more likely to make risky choices with the 'good' partner. As expected from previous studies, activation of the caudate nucleus differentiated between positive and negative feedback, but only for the 'neutral' partner. Notably, it did not do so for the 'good' partner and did so only weakly for the 'bad' partner, suggesting that prior social and moral perceptions can diminish reliance on feedback mechanisms in the neural circuitry of trial-and-error reward learning. PMID:16222226

  18. Neural basis of reward anticipation and its genetic determinants.

    Science.gov (United States)

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-04-01

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

  19. Neural basis of reward anticipation and its genetic determinants.

    Science.gov (United States)

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-04-01

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature.

  20. Explicit neural signals reflecting reward uncertainty

    OpenAIRE

    Schultz, W.; Preuschoff, K; Camerer, C.; Hsu, M; Fiorillo, C D; Tobler, Philippe N.; Bossaerts, P.

    2008-01-01

    The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitu...

  1. What can the monetary incentive delay task tell us about the neural processing of reward and punishment?

    Directory of Open Access Journals (Sweden)

    Lutz K

    2014-04-01

    Full Text Available Kai Lutz,1–3 Mario Widmer1,2,41Department of Neurology, University Hospital Zürich, Zürich, 2Cereneo, Center for Neurology and Rehabilitation, Vitznau, 3Division of Neuropsychology, Institute of Psychology, University of Zürich, Zürich, 4Neural Control of Movement Lab, ETH Zürich, Zürich, SwitzerlandAbstract: Since its introduction in 2000, the monetary incentive delay (MID task has been used extensively to investigate changes in neural activity in response to the processing of reward and punishment in healthy, but also in clinical populations. Typically, the MID task requires an individual to react to a target stimulus presented after an incentive cue to win or to avoid losing the indicated reward. In doing so, this paradigm allows the detailed examination of different stages of reward processing like reward prediction, anticipation, outcome processing, and consumption as well as the processing of tasks under different reward conditions. This review gives an overview of different utilizations of the MID task by outlining the neuronal processes involved in distinct aspects of human reward processing, such as anticipation versus consumption, reward versus punishment, and, with a special focus, reward-based learning processes. Furthermore, literature on specific influences on reward processing like behavioral, clinical and developmental influences, is reviewed, describing current findings and possible future directions.Keywords: reward, punishment, dopamine, reward system

  2. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain.

    Directory of Open Access Journals (Sweden)

    Hackjin Kim

    2006-07-01

    Full Text Available Avoidance learning poses a challenge for reinforcement-based theories of instrumental conditioning, because once an aversive outcome is successfully avoided an individual may no longer experience extrinsic reinforcement for their behavior. One possible account for this is to propose that avoiding an aversive outcome is in itself a reward, and thus avoidance behavior is positively reinforced on each trial when the aversive outcome is successfully avoided. In the present study we aimed to test this possibility by determining whether avoidance of an aversive outcome recruits the same neural circuitry as that elicited by a reward itself. We scanned 16 human participants with functional MRI while they performed an instrumental choice task, in which on each trial they chose from one of two actions in order to either win money or else avoid losing money. Neural activity in a region previously implicated in encoding stimulus reward value, the medial orbitofrontal cortex, was found to increase, not only following receipt of reward, but also following successful avoidance of an aversive outcome. This neural signal may itself act as an intrinsic reward, thereby serving to reinforce actions during instrumental avoidance.

  3. Adolescent behavioral and neural reward sensitivity: a test of the differential susceptibility theory.

    Science.gov (United States)

    Richards, J S; Arias Vásquez, A; von Rhein, D; van der Meer, D; Franke, B; Hoekstra, P J; Heslenfeld, D J; Oosterlaan, J; Faraone, S V; Buitelaar, J K; Hartman, C A

    2016-01-01

    Little is known about the causes of individual differences in reward sensitivity. We investigated gene-environment interactions (GxE) on behavioral and neural measures of reward sensitivity, in light of the differential susceptibility theory. This theory states that individuals carrying plasticity gene variants will be more disadvantaged in negative, but more advantaged in positive environments. Reward responses were assessed during a monetary incentive delay task in 178 participants with and 265 without attention-deficit/hyperactivity disorder (ADHD), from N=261 families. We examined interactions between variants in candidate plasticity genes (DAT1, 5-HTT and DRD4) and social environments (maternal expressed emotion and peer affiliation). HTTLPR short allele carriers showed the least reward speeding when exposed to high positive peer affiliation, but the most when faced with low positive peer affiliation or low maternal warmth. DAT1 10-repeat homozygotes displayed similar GxE patterns toward maternal warmth on general task performance. At the neural level, DRD4 7-repeat carriers showed the least striatal activation during reward anticipation when exposed to high maternal warmth, but the most when exposed to low warmth. Findings were independent of ADHD severity. Our results partially confirm the differential susceptibility theory and indicate the importance of positive social environments in reward sensitivity and general task performance for persons with specific genotypes. PMID:27045841

  4. Anticipation of monetary and social reward differently activates mesolimbic brain structures in men and women.

    Science.gov (United States)

    Spreckelmeyer, Katja N; Krach, Sören; Kohls, Gregor; Rademacher, Lena; Irmak, Arda; Konrad, Kerstin; Kircher, Tilo; Gründer, Gerhard

    2009-06-01

    Motivation for goal-directed behaviour largely depends on the expected value of the anticipated reward. The aim of the present study was to examine how different levels of reward value are coded in the brain for two common forms of human reward: money and social approval. To account for gender differences 16 male and 16 female participants performed an incentive delay task expecting to win either money or positive social feedback. fMRI recording during the anticipation phase revealed proportional activation of neural structures constituting the human reward system for increasing levels of reward, independent of incentive type. However, in men activation in the prospect of monetary rewards encompassed a wide network of mesolimbic brain regions compared to only limited activation for social rewards. In contrast, in women, anticipation of either incentive type activated identical brain regions. Our findings represent an important step towards a better understanding of motivated behaviour by taking into account individual differences in reward valuation. PMID:19174537

  5. Links between parental depression and longitudinal changes in youths' neural sensitivity to rewards.

    Science.gov (United States)

    Qu, Yang; Fuligni, Andrew J; Galván, Adriana; Lieberman, Matthew D; Telzer, Eva H

    2016-08-01

    Parental depression is a significant risk factor for adolescents' engagement in risk taking. Yet the neural processes that mediate the link between parental depression and adolescents' functioning remain unknown. Using a longitudinal functional magnetic resonance imaging design, we investigated how parental depression is associated with changes in adolescents' neural reactivity to rewards during a risk-taking task, and how such changes in neural reactivity are associated with changes in risk-taking behavior. Greater parental depressive symptoms were associated with increases in their adolescent child's risk taking and self-reported externalizing behavior over time. At the neural level, adolescents of parents with greater depressive symptoms showed longitudinal increases in the ventral striatum and dorsolateral prefrontal cortex to rewards during risk taking. Longitudinal increases in adolescents' ventral striatum activation mediates the link between greater parental depression and increases in adolescents' risk taking and externalizing behavior. These findings provide novel evidence that parental depression may contribute to changes in adolescents' neural reactivity to rewards over time, which is associated with greater increases in their risk taking and externalizing behavior. PMID:27013103

  6. Neural signature of reward-modulated unconscious inhibitory control.

    Science.gov (United States)

    Diao, Liuting; Qi, Senqing; Xu, Mengsi; Li, Zhiai; Ding, Cody; Chen, Antao; Zheng, Yan; Yang, Dong

    2016-09-01

    Consciously initiated cognitive control is generally determined by motivational incentives (e.g., monetary reward). Recent studies have revealed that human cognitive control processes can nevertheless operate without awareness. However, whether monetary reward can impinge on unconscious cognitive control remains unclear. To clarify this issue, a task consisting of several runs was designed to combine a modified version of the reward-priming paradigm with an unconscious version of the Go/No-Go task. At the beginning of each run, participants were exposed to a high- or low-value coin, followed by the modified Go/No-Go task. Participants could earn the coin only if they responded correctly to each trial of the run. Event-related potential (ERP) results indicated that high-value rewards (vs. low-value rewards) induced a greater centro-parietal P3 component associated with conscious and unconscious inhibitory control. Moreover, the P3 amplitude correlated positively with the magnitude of reaction time slowing reflecting the intensity of activation of unconscious inhibitory control in the brain. These findings suggest that high-value reward may facilitate human higher-order inhibitory processes that are independent of conscious awareness, which provides insights into the brain processes that underpin motivational modulation of cognitive control. PMID:27346057

  7. Abnormal Reward System Activation in Mania

    OpenAIRE

    Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan

    2007-01-01

    Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects...

  8. Response of neural reward regions to food cues in autism spectrum disorders

    OpenAIRE

    Cascio Carissa J; Foss-Feig Jennifer H; Heacock Jessica L; Newsom Cassandra R; Cowan Ronald L; Benningfield Margaret M; Rogers Baxter P; Cao Aize

    2012-01-01

    Abstract Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD) is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our...

  9. Age associations with neural processing of reward anticipation in adolescents with bipolar disorders

    Directory of Open Access Journals (Sweden)

    Snežana Urošević

    2016-01-01

    Full Text Available Reward/behavioral approach system hypersensitivity is implicated in bipolar disorders (BD and in normative development during adolescence. Pediatric onset of BD is associated with a more severe illness course. However, little is known about neural processing of rewards in adolescents with BD or developmental (i.e., age associations with activation of these neural systems. The present study aims to address this knowledge gap. The present sample included 21 adolescents with BD and 26 healthy adolescents, ages 13 to 19. Participants completed a functional magnetic resonance imaging (fMRI protocol using the Monetary Incentive Delay (MID task. Behavioral performance was similar between groups. Group differences in BOLD activation during target anticipation and feedback anticipation periods of the task were examined using whole-brain analyses, as were group differences in age effects. During both target anticipation and feedback anticipation, adolescents with BD, compared to adolescents without psychopathology, exhibited decreased engagement of frontal regions involved in cognitive control (i.e., dorsolateral prefrontal cortex. Healthy adolescents exhibited age-related decreases, while adolescents with BD exhibited age-related increases, in activity of other cognitive control frontal areas (i.e., right inferior frontal gyrus, suggesting altered development in the BD group. Longitudinal research is needed to examine potentially abnormal development of cognitive control during reward pursuit in adolescent BD and whether early therapeutic interventions can prevent these potential deviations from normative development.

  10. Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans

    Directory of Open Access Journals (Sweden)

    Julie eThomas

    2013-11-01

    Full Text Available Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies.

  11. Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

    OpenAIRE

    van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Paul A.M. Smeets

    2016-01-01

    A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simpl...

  12. Neural processing of calories in brain reward areas can be modulated by reward sensitivity

    OpenAIRE

    Inge eVan Rijn; Sanne eGriffioen-Roose; Cees ede Graaf; Paul A.M. Smeets

    2016-01-01

    A food’s reward value is dependent on its caloric content. Furthermore, a food’s acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n=30) tasted simple ...

  13. BAS-drive trait modulates dorsomedial striatum activity during reward response-outcome associations.

    Science.gov (United States)

    Costumero, Víctor; Barrós-Loscertales, Alfonso; Fuentes, Paola; Rosell-Negre, Patricia; Bustamante, Juan Carlos; Ávila, César

    2016-09-01

    According to the Reinforcement Sensitivity Theory, behavioral studies have found that individuals with stronger reward sensitivity easily detect cues of reward and establish faster associations between instrumental responses and reward. Neuroimaging studies have shown that processing anticipatory cues of reward is accompanied by stronger ventral striatum activity in individuals with stronger reward sensitivity. Even though establishing response-outcome contingencies has been consistently associated with dorsal striatum, individual differences in this process are poorly understood. Here, we aimed to study the relation between reward sensitivity and brain activity while processing response-reward contingencies. Forty-five participants completed the BIS/BAS questionnaire and performed a gambling task paradigm in which they received monetary rewards or punishments. Overall, our task replicated previous results that have related processing high reward outcomes with activation of striatum and medial frontal areas, whereas processing high punishment outcomes was associated with stronger activity in insula and middle cingulate. As expected, the individual differences in the activity of dorsomedial striatum correlated positively with BAS-Drive. Our results agree with previous studies that have related the dorsomedial striatum with instrumental performance, and suggest that the individual differences in this area may form part of the neural substrate responsible for modulating instrumental conditioning by reward sensitivity. PMID:26489979

  14. BAS-drive trait modulates dorsomedial striatum activity during reward response-outcome associations.

    Science.gov (United States)

    Costumero, Víctor; Barrós-Loscertales, Alfonso; Fuentes, Paola; Rosell-Negre, Patricia; Bustamante, Juan Carlos; Ávila, César

    2016-09-01

    According to the Reinforcement Sensitivity Theory, behavioral studies have found that individuals with stronger reward sensitivity easily detect cues of reward and establish faster associations between instrumental responses and reward. Neuroimaging studies have shown that processing anticipatory cues of reward is accompanied by stronger ventral striatum activity in individuals with stronger reward sensitivity. Even though establishing response-outcome contingencies has been consistently associated with dorsal striatum, individual differences in this process are poorly understood. Here, we aimed to study the relation between reward sensitivity and brain activity while processing response-reward contingencies. Forty-five participants completed the BIS/BAS questionnaire and performed a gambling task paradigm in which they received monetary rewards or punishments. Overall, our task replicated previous results that have related processing high reward outcomes with activation of striatum and medial frontal areas, whereas processing high punishment outcomes was associated with stronger activity in insula and middle cingulate. As expected, the individual differences in the activity of dorsomedial striatum correlated positively with BAS-Drive. Our results agree with previous studies that have related the dorsomedial striatum with instrumental performance, and suggest that the individual differences in this area may form part of the neural substrate responsible for modulating instrumental conditioning by reward sensitivity.

  15. Dopamine, reward learning, and active inference

    Directory of Open Access Journals (Sweden)

    Thomas eFitzgerald

    2015-11-01

    Full Text Available Temporal difference learning models propose phasic dopamine signalling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behaviour. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings.

  16. Distinct neural responses to conscious versus unconscious monetary reward cues

    NARCIS (Netherlands)

    Bijleveld, Erik; Custers, Ruud; Van der Stigchel, Stefan; Aarts, Henk; Pas, Pascal; Vink, Matthijs

    2014-01-01

    Human reward pursuit is often assumed to involve conscious processing of reward information. However, recent research revealed that reward cues enhance cognitive performance even when perceived without awareness. Building on this discovery, the present functional MRI study tested two hypotheses usin

  17. The influence of personality on neural mechanisms of observational fear and reward learning

    OpenAIRE

    Hooker, Christine I.; Verosky, Sara C.; Miyakawa, Asako; Robert T Knight; D’Esposito, Mark

    2008-01-01

    Fear and reward learning can occur through direct experience or observation. Both channels can enhance survival or create maladaptive behavior. We used fMRI to isolate neural mechanisms of observational fear and reward learning and investigate whether neural response varied according to individual differences in neuroticism and extraversion. Participants learned object-emotion associations by observing a woman respond with fearful (or neutral) and happy (or neutral) facial expressions to nove...

  18. Reward-related neural dysfunction across depression and impulsivity: A dimensional approach.

    Science.gov (United States)

    Ait Oumeziane, Belel; Foti, Dan

    2016-08-01

    Recent theoretical models underline reward sensitivity as a potential endophenotype for major depressive disorder. Neural and behavioral evidence reveals depression is associated with reduced reward sensitivity. However, reward dysfunction is not unique to depression, as it is also common across disorders of poor impulse control. We examined the interrelationships of depression (Depression, Anxiety, and Stress Scale [DASS-21]) and impulsivity (UPPS-P Impulsive Behavior Scale) with reward sensitivity among a large, representative sample (N = 260). ERPs were recorded to isolate two neural indicators of consummatory reward processing: initial evaluation of rewards in the 250-350 ms time window postonset of feedback (reward positivity [RewP]), and salience to monetary outcomes (P3). Significant interactions were observed between depression and impulsivity facets across these two stages of reward processing: depression and positive urgency predicted RewP amplitude to reward outcomes (win vs. loss); depression and one other impulsivity trait, (lack of) premeditation, predicted P3 amplitude to monetary outcomes. Conversely, high symptoms of depression were related to three biobehavioral profiles: (1) blunted RewP in conjunction with high positive urgency, (2) combination of blunted RewP and low (lack of) premeditation, and (3) blunted P3 to monetary wins/losses, in conjunction with low (lack of) premeditation. Findings illustrate that reward-related dysfunctions may be optimally conceptualized when examining the interactions between dimensions of internalizing and externalizing psychopathology. PMID:27193188

  19. Neural evidence for an association between social proficiency and sensitivity to social reward.

    Science.gov (United States)

    Gossen, Anna; Groppe, Sarah E; Winkler, Lina; Kohls, Gregor; Herrington, John; Schultz, Robert T; Gründer, Gerhard; Spreckelmeyer, Katja N

    2014-05-01

    Data from developmental psychology suggests a link between the growth of socio-emotional competences and the infant's sensitivity to the salience of social stimuli. The aim of the present study was to find evidence for this relationship in healthy adults. Thirty-five participants were recruited based on their score above the 85th or below the 15th percentile of the empathy quotient questionnaire (EQ, Baron-Cohen and Wheelwright, 2004). Functional magnetic resonance imaging (fMRI) was used to compare neural responses to cues of social and non-social (monetary) reward. When compared to the high-EQ group, the low-EQ group showed reduced activity of the brain s reward system, specifically the right nucleus accumbens, in response to cues predictive of social reward (videos showing gestures of approval)-but increased activation in this area for monetary incentives. Our data provide evidence for a link between self-reported deficits in social proficiency and reduced sensitivity to the motivational salience of positive social stimuli. PMID:23512930

  20. Monetary reward suppresses anterior insula activity during social pain.

    Science.gov (United States)

    Cristofori, Irene; Harquel, Sylvain; Isnard, Jean; Mauguière, François; Sirigu, Angela

    2015-12-01

    Social pain after exclusion by others activates brain regions also involved in physical pain. Here we evaluated whether monetary reward could compensate for the negative feeling of social pain in the brain. To address this question we used the unique technique of intracranial electroencephalography in subjects with drug resistant epilepsy. Specifically, we recorded theta activity from intracranial electrodes implanted in the insular cortex while subjects experienced conditions of social inclusion and exclusion associated with monetary gain and loss. Our study confirmed that theta rhythm in the insular cortex is the neural signature of social exclusion. We found that while monetary gain suppresses the effect of social pain in the anterior insula, there is no such effect in the posterior insula. These results imply that the anterior insula can use secondary reward signals to compensate for the negative feeling of social pain. Hence, here we propose that the anterior insula plays a pivotal role in integrating contingencies to update social pain feelings. Finally, the possibility to modulate the theta rhythm through the reward system might open new avenues of research for treating pathologies related to social exclusion.

  1. Monetary reward suppresses anterior insula activity during social pain.

    Science.gov (United States)

    Cristofori, Irene; Harquel, Sylvain; Isnard, Jean; Mauguière, François; Sirigu, Angela

    2015-12-01

    Social pain after exclusion by others activates brain regions also involved in physical pain. Here we evaluated whether monetary reward could compensate for the negative feeling of social pain in the brain. To address this question we used the unique technique of intracranial electroencephalography in subjects with drug resistant epilepsy. Specifically, we recorded theta activity from intracranial electrodes implanted in the insular cortex while subjects experienced conditions of social inclusion and exclusion associated with monetary gain and loss. Our study confirmed that theta rhythm in the insular cortex is the neural signature of social exclusion. We found that while monetary gain suppresses the effect of social pain in the anterior insula, there is no such effect in the posterior insula. These results imply that the anterior insula can use secondary reward signals to compensate for the negative feeling of social pain. Hence, here we propose that the anterior insula plays a pivotal role in integrating contingencies to update social pain feelings. Finally, the possibility to modulate the theta rhythm through the reward system might open new avenues of research for treating pathologies related to social exclusion. PMID:25964499

  2. Effects of direct social experience on trust decisions and neural reward circuitry

    Directory of Open Access Journals (Sweden)

    Dominic S. Fareri

    2012-10-01

    Full Text Available The human striatum is integral for reward-processing and supports learning by linking experienced outcomes with prior expectations. Recent endeavors implicate the striatum in processing outcomes of social interactions, such as social approval/rejection, as well as in learning reputations of others. Interestingly, social impressions often influence our behavior with others during interactions. Information about an interaction partner’s moral character acquired from biographical information hinders updating of expectations after interactions via top down modulation of reward circuitry. An outstanding question is whether initial impressions formed through experience similarly modulate the ability to update social impressions at the behavioral and neural level. We investigated the role of experienced social information on trust behavior and reward-related BOLD activity. Participants played a computerized ball tossing game with three fictional partners manipulated to be perceived as good, bad or neutral. Participants then played an iterated trust game as investors with these same partners while undergoing fMRI. Unbeknownst to participants, partner behavior in the trust game was random and unrelated to their ball-tossing behavior. Participants’ trust decisions were influenced by their prior experience in the ball tossing game, investing less often with the bad partner compared to the good and neutral. Reinforcement learning models revealed that participants were more sensitive to updating their beliefs about good and bad partners when experiencing outcomes consistent with initial experience. Increased striatal and anterior cingulate BOLD activity for positive versus negative trust game outcomes emerged, which further correlated with model-derived prediction-error (PE learning signals. These results suggest that initial impressions formed from direct social experience can be continually shaped by consistent information through reward learning

  3. Learning to Produce Syllabic Speech Sounds via Reward-Modulated Neural Plasticity.

    Directory of Open Access Journals (Sweden)

    Anne S Warlaumont

    Full Text Available At around 7 months of age, human infants begin to reliably produce well-formed syllables containing both consonants and vowels, a behavior called canonical babbling. Over subsequent months, the frequency of canonical babbling continues to increase. How the infant's nervous system supports the acquisition of this ability is unknown. Here we present a computational model that combines a spiking neural network, reinforcement-modulated spike-timing-dependent plasticity, and a human-like vocal tract to simulate the acquisition of canonical babbling. Like human infants, the model's frequency of canonical babbling gradually increases. The model is rewarded when it produces a sound that is more auditorily salient than sounds it has previously produced. This is consistent with data from human infants indicating that contingent adult responses shape infant behavior and with data from deaf and tracheostomized infants indicating that hearing, including hearing one's own vocalizations, is critical for canonical babbling development. Reward receipt increases the level of dopamine in the neural network. The neural network contains a reservoir with recurrent connections and two motor neuron groups, one agonist and one antagonist, which control the masseter and orbicularis oris muscles, promoting or inhibiting mouth closure. The model learns to increase the number of salient, syllabic sounds it produces by adjusting the base level of muscle activation and increasing their range of activity. Our results support the possibility that through dopamine-modulated spike-timing-dependent plasticity, the motor cortex learns to harness its natural oscillations in activity in order to produce syllabic sounds. It thus suggests that learning to produce rhythmic mouth movements for speech production may be supported by general cortical learning mechanisms. The model makes several testable predictions and has implications for our understanding not only of how syllabic

  4. Girls’ challenging social experiences in early adolescence predict neural response to rewards and depressive symptoms

    Directory of Open Access Journals (Sweden)

    Melynda D. Casement

    2014-04-01

    Full Text Available Developmental models of psychopathology posit that exposure to social stressors may confer risk for depression in adolescent girls by disrupting neural reward circuitry. The current study tested this hypothesis by examining the relationship between early adolescent social stressors and later neural reward processing and depressive symptoms. Participants were 120 girls from an ongoing longitudinal study of precursors to depression across adolescent development. Low parental warmth, peer victimization, and depressive symptoms were assessed when the girls were 11 and 12 years old, and participants completed a monetary reward guessing fMRI task and assessment of depressive symptoms at age 16. Results indicate that low parental warmth was associated with increased response to potential rewards in the medial prefrontal cortex (mPFC, striatum, and amygdala, whereas peer victimization was associated with decreased response to potential rewards in the mPFC. Furthermore, concurrent depressive symptoms were associated with increased reward anticipation response in mPFC and striatal regions that were also associated with early adolescent psychosocial stressors, with mPFC and striatal response mediating the association between social stressors and depressive symptoms. These findings are consistent with developmental models that emphasize the adverse impact of early psychosocial stressors on neural reward processing and risk for depression in adolescence.

  5. Blunted neural response to rewards as a vulnerability factor for depression: Results from a family study.

    Science.gov (United States)

    Weinberg, Anna; Liu, Huiting; Hajcak, Greg; Shankman, Stewart A

    2015-11-01

    Depressive disorders are associated with significant economic and public health burdens as well as increased morbidity. Yet, perhaps due to the heterogeneous nature of the disease, prevention and intervention efforts are only moderately efficacious. A better understanding of core mechanisms of depressive disorders might aid in the development of more targeted intervention, and perhaps help identify individuals at risk. One mechanism that may be particularly important to depressive phenotypes is reward insensitivity. Examination of neurobiological correlates of reward-processing, which should relate more directly to the neuropathology of depression, may be helpful in identifying liability for the disorder. To that end, we used a family study design to examine whether a neural response to rewards is a familial risk factor for depression in a sample of probands with a wide range of internalizing psychopathology, as well as their biological siblings. Event-related potentials were recorded during a simple forced-choice gambling paradigm, in which participants could either win or lose small amounts of money. Lower levels of positive affect in probands predicted a reduced neural response to rewards in siblings, even over and above the sibling's own level of positive and negative affect. Additionally, the neural response to rewards was familial (i.e., correlated among siblings). Combined, these analyses suggest that a blunted neural response to rewards may be useful in identifying individuals vulnerable to depressive illnesses. PMID:26214708

  6. At what stage of neural processing does cocaine act to boost pursuit of rewards?

    Directory of Open Access Journals (Sweden)

    Giovanni Hernandez

    Full Text Available Dopamine-containing neurons have been implicated in reward and decision making. One element of the supporting evidence is that cocaine, like other drugs that increase dopaminergic neurotransmission, powerfully potentiates reward seeking. We analyze this phenomenon from a novel perspective, introducing a new conceptual framework and new methodology for determining the stage(s of neural processing at which drugs, lesions and physiological manipulations act to influence reward-seeking behavior. Cocaine strongly boosts the proclivity of rats to work for rewarding electrical brain stimulation. We show that the conventional conceptual framework and methods do not distinguish between three conflicting accounts of how the drug produces this effect: increased sensitivity of brain reward circuitry, increased gain, or decreased subjective reward costs. Sensitivity determines the stimulation strength required to produce a reward of a given intensity (a measure analogous to the KM of an enzyme whereas gain determines the maximum intensity attainable (a measure analogous to the vmax of an enzyme-catalyzed reaction. To distinguish sensitivity changes from the other determinants, we measured and modeled reward seeking as a function of both stimulation strength and opportunity cost. The principal effect of cocaine was a two-fourfold increase in willingness to pay for the electrical reward, an effect consistent with increased gain or decreased subjective cost. This finding challenges the long-standing view that cocaine increases the sensitivity of brain reward circuitry. We discuss the implications of the results and the analytic approach for theories of how dopaminergic neurons and other diffuse modulatory brain systems contribute to reward pursuit, and we explore the implications of the conceptual framework for the study of natural rewards, drug reward, and mood.

  7. Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder

    Science.gov (United States)

    Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

    2016-01-01

    Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants’ brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing. PMID:27464551

  8. Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder.

    Science.gov (United States)

    Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

    2016-01-01

    Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants' brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing. PMID:27464551

  9. The neural dynamics of reward value and risk coding in the human orbitofrontal cortex.

    Science.gov (United States)

    Li, Yansong; Vanni-Mercier, Giovanna; Isnard, Jean; Mauguière, François; Dreher, Jean-Claude

    2016-04-01

    The orbitofrontal cortex is known to carry information regarding expected reward, risk and experienced outcome. Yet, due to inherent limitations in lesion and neuroimaging methods, the neural dynamics of these computations has remained elusive in humans. Here, taking advantage of the high temporal definition of intracranial recordings, we characterize the neurophysiological signatures of the intact orbitofrontal cortex in processing information relevant for risky decisions. Local field potentials were recorded from the intact orbitofrontal cortex of patients suffering from drug-refractory partial epilepsy with implanted depth electrodes as they performed a probabilistic reward learning task that required them to associate visual cues with distinct reward probabilities. We observed three successive signals: (i) around 400 ms after cue presentation, the amplitudes of the local field potentials increased with reward probability; (ii) a risk signal emerged during the late phase of reward anticipation and during the outcome phase; and (iii) an experienced value signal appeared at the time of reward delivery. Both the medial and lateral orbitofrontal cortex encoded risk and reward probability while the lateral orbitofrontal cortex played a dominant role in coding experienced value. The present study provides the first evidence from intracranial recordings that the human orbitofrontal cortex codes reward risk both during late reward anticipation and during the outcome phase at a time scale of milliseconds. Our findings offer insights into the rapid mechanisms underlying the ability to learn structural relationships from the environment. PMID:26811252

  10. Choice modulates the neural dynamics of prediction error processing during rewarded learning

    OpenAIRE

    David A. Peterson; Lotz, Daniel T.; Halgren, Eric; Sejnowski, Terrence J.; Poizner, Howard

    2010-01-01

    Our ability to selectively engage with our environment enables us to guide our learning and to take advantage of its benefits. When facing multiple possible actions, our choices are a critical aspect of learning. In the case of learning from rewarding feedback, there has been substantial theoretical and empirical progress in elucidating the associated behavioral and neural processes, predominantly in terms of a reward prediction error, a measure of the discrepancy between actual versus expect...

  11. Rewards.

    Science.gov (United States)

    Gunderman, Richard B; Kamer, Aaron P

    2011-05-01

    For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today. PMID:21531311

  12. Remembering with gains and losses: effects of monetary reward and punishment on successful encoding activation of source memories.

    Science.gov (United States)

    Shigemune, Yayoi; Tsukiura, Takashi; Kambara, Toshimune; Kawashima, Ryuta

    2014-05-01

    The motivation of getting rewards or avoiding punishments reinforces learning behaviors. Although the neural mechanisms underlying the effect of rewards on episodic memory have been demonstrated, there is little evidence of the effect of punishments on this memory. Our functional magnetic resonance imaging (fMRI) study investigated the effects of monetary rewards and punishments on activation during the encoding of source memories. During encoding, participants memorized words (item) and locations of presented words (source) under 3 conditions (Reward, Punishment, and Control). During retrieval, participants retrieved item and source memories of the words and were rewarded or penalized according to their performance. Source memories encoded with rewards or punishments were remembered better than those without such encoding. fMRI data demonstrated that the ventral tegmental area and substantia nigra and nucleus accumbens activations reflected both the processes of reward and punishment, whereas insular activation increased as a linear function of punishment. Activation in the hippocampus and parahippocampal cortex predicted subsequent retrieval success of source memories. Additionally, correlations between these reward/punishment-related regions and the hippocampus were significant. The successful encoding of source memories could be enhanced by punishments and rewards, and interactions between reward/punishment-related regions and memory-related regions could contribute to memory enhancement by reward and/or punishment.

  13. Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds.

    Science.gov (United States)

    Bunzeck, Nico; Doeller, Christian F; Fuentemilla, Lluis; Dolan, Raymond J; Duzel, Emrah

    2009-08-11

    The neural responses that distinguish novel from familiar items in recognition memory tasks are remarkably fast in both humans and nonhuman primates. In humans, the earliest onsets of neural novelty effects emerge at about approximately 150-200 ms after stimulus onset. However, in recognition memory studies with nonhuman primates, novelty effects can arise at as early as 70-80 ms. Here, we address the possibility that this large species difference in onset latencies is caused experimentally by the necessity of using reward reinforcement to motivate the detection of novel or familiar items in nonhuman primates but not in humans. Via magnetoencephalography in humans, we show in two experiments that the onset of neural novelty signals is accelerated from approximately 200 ms to approximately 85 ms if correct recognition memory for either novel or familiar items is rewarded. Importantly, this acceleration is independent of whether the detection of the novel or the familiar scenes is rewarded. Furthermore, this early novelty effect contributed to memory retrieval because neural reward responses, which were contingent upon novelty detection, followed approximately 100 ms later. Thus, under the contextual influence of reward motivation, behaviorally relevant novelty signals emerge much faster than previously held possible in humans.

  14. A neural model of the frontal eye fields with reward-based learning.

    Science.gov (United States)

    Ye, Weijie; Liu, Shenquan; Liu, Xuanliang; Yu, Yuguo

    2016-09-01

    Decision-making is a flexible process dependent on the accumulation of various kinds of information; however, the corresponding neural mechanisms are far from clear. We extended a layered model of the frontal eye field to a learning-based model, using computational simulations to explain the cognitive process of choice tasks. The core of this extended model has three aspects: direction-preferred populations that cluster together the neurons with the same orientation preference, rule modules that control different rule-dependent activities, and reward-based synaptic plasticity that modulates connections to flexibly change the decision according to task demands. After repeated attempts in a number of trials, the network successfully simulated three decision choice tasks: an anti-saccade task, a no-go task, and an associative task. We found that synaptic plasticity could modulate the competition of choices by suppressing erroneous choices while enhancing the correct (rewarding) choice. In addition, the trained model captured some properties exhibited in animal and human experiments, such as the latency of the reaction time distribution of anti-saccades, the stop signal mechanism for canceling a reflexive saccade, and the variation of latency to half-max selectivity. Furthermore, the trained model was capable of reproducing the re-learning procedures when switching tasks and reversing the cue-saccade association. PMID:27284696

  15. Perceiving active listening activates the reward system and improves the impression of relevant experiences.

    Science.gov (United States)

    Kawamichi, Hiroaki; Yoshihara, Kazufumi; Sasaki, Akihiro T; Sugawara, Sho K; Tanabe, Hiroki C; Shinohara, Ryoji; Sugisawa, Yuka; Tokutake, Kentaro; Mochizuki, Yukiko; Anme, Tokie; Sadato, Norihiro

    2015-01-01

    Although active listening is an influential behavior, which can affect the social responses of others, the neural correlates underlying its perception have remained unclear. Sensing active listening in social interactions is accompanied by an improvement in the recollected impressions of relevant experiences and is thought to arouse positive feelings. We therefore hypothesized that the recognition of active listening activates the reward system, and that the emotional appraisal of experiences that had been subject to active listening would be improved. To test these hypotheses, we conducted functional magnetic resonance imaging (fMRI) on participants viewing assessments of their own personal experiences made by evaluators with or without active listening attitude. Subjects rated evaluators who showed active listening more positively. Furthermore, they rated episodes more positively when they were evaluated by individuals showing active listening. Neural activation in the ventral striatum was enhanced by perceiving active listening, suggesting that this was processed as rewarding. It also activated the right anterior insula, representing positive emotional reappraisal processes. Furthermore, the mentalizing network was activated when participants were being evaluated, irrespective of active listening behavior. Therefore, perceiving active listening appeared to result in positive emotional appraisal and to invoke mental state attribution to the active listener. PMID:25188354

  16. Implicit trustworthiness ratings of self-resembling faces activate brain centers involved in reward.

    Science.gov (United States)

    Platek, Steven M; Krill, Austen L; Wilson, Benjamin

    2009-01-01

    On the basis of Hamilton's (Hamilton, W. D. (1964). The genetical evolution of social behavior I, II. Journal of Theoretical Biology, 7, 17-52) theory of inclusive fitness, self-facial resemblance is hypothesized as a mechanism for self-referent phenotypic matching by which humans can detect kin. To understand the mechanisms underlying pro-sociality toward self-resembling faces, we investigated the neural correlates of implicit trustworthiness ratings for self-resembling faces. Here we show that idiosyncratic trustworthiness ratings of self-resembling faces predict brain activation in the ventral inferior, middle and medial frontal gyri, substrates involved in reward processing. These findings demonstrate that neural reward centers are implicated in evaluating implicit pro-social behaviors toward self-resembling faces. These findings suggest that humans have evolved to use neurocomputational architecture dedicated to face processing and reward evaluation for the differentiation of kin, which drives implicit idiosyncratic affectively regulated social interactions. PMID:18761362

  17. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Science.gov (United States)

    Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F

    2012-01-01

    Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness. PMID:22479547

  18. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Directory of Open Access Journals (Sweden)

    Carsten Murawski

    Full Text Available Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  19. Neural correlates of emotion- and reward-driven attentional capture

    OpenAIRE

    Gupta, Rashmi; Dominguez Borras, Judith; Vuilleumier, Patrik

    2014-01-01

    In recent years, affective neuroscience has emerged as an important discipline to study the brain mechanisms of affect and emotion by employing various methods, ranging from neuroimaging and neurobiology through to drug and lesion studies (Davidson et al., 2003; Deak, 2011; Kringelbach, 2005, Kringelbach & Berridge 2008; LeDoux & Phelps 2000; Leknes & Tracey 2008). Ample research has demonstrated that emotionally significant and rewarding information often produces strong effects on other pro...

  20. Altered brain activity during reward anticipation in pathological gambling and obsessive-compulsive disorder.

    Directory of Open Access Journals (Sweden)

    Jung-Seok Choi

    Full Text Available BACKGROUND: Pathological gambling (PG and obsessive-compulsive disorder (OCD are conceptualized as a behavioral addiction, with a dependency on repetitive gambling behavior and rewarding effects following compulsive behavior, respectively. However, no neuroimaging studies to date have examined reward circuitry during the anticipation phase of reward in PG compared with in OCD while considering repetitive gambling and compulsion as addictive behaviors. METHODS/PRINCIPAL FINDINGS: To elucidate the neural activities specific to the anticipation phase of reward, we performed event-related functional magnetic resonance imaging (fMRI in young adults with PG and compared them with those in patients with OCD and healthy controls. Fifteen male patients with PG, 13 patients with OCD, and 15 healthy controls, group-matched for age, gender, and IQ, participated in a monetary incentive delay task during fMRI scanning. Neural activation in the ventromedial caudate nucleus during anticipation of both gain and loss decreased in patients with PG compared with that in patients with OCD and healthy controls. Additionally, reduced activation in the anterior insula during anticipation of loss was observed in patients with PG compared with that in patients with OCD which was intermediate between that in OCD and healthy controls (healthy controls < PG < OCD, and a significant positive correlation between activity in the anterior insula and South Oaks Gambling Screen score was found in patients with PG. CONCLUSIONS: Decreased neural activity in the ventromedial caudate nucleus during anticipation may be a specific neurobiological feature for the pathophysiology of PG, distinguishing it from OCD and healthy controls. Correlation of anterior insular activity during loss anticipation with PG symptoms suggests that patients with PG fit the features of OCD associated with harm avoidance as PG symptoms deteriorate. Our findings have identified functional disparities and

  1. Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults

    Science.gov (United States)

    Nusslock, Robin; Almeida, Jorge RC; Forbes, Erika E; Versace, Amelia; Frank, Ellen; LaBarbara, Edmund J; Klein, Crystal R; Phillips, Mary L

    2012-01-01

    Objective Bipolar disorder may be characterized by a hypersensitivity to reward-relevant stimuli, potentially underlying the emotional lability and dysregulation that characterizes the illness. In parallel, research highlights the predominant role of striatal and orbitofrontal cortical (OFC) regions in reward-processing and approach-related affect. We aimed to examine whether bipolar disorder, relative to healthy, participants displayed elevated activity in these regions during reward processing. Methods Twenty-one euthymic bipolar I disorder and 20 healthy control participants with no lifetime history of psychiatric disorder underwent functional magnetic resonance imaging (fMRI) scanning during a card-guessing paradigm designed to examine reward-related brain function to anticipation and receipt of monetary reward and loss. Data were collected using a 3T Siemens Trio scanner. Results Region-of-interest analyses revealed that bipolar disorder participants displayed greater ventral striatal and right-sided orbitofrontal [Brodmann area (BA) 11] activity during anticipation, but not outcome, of monetary reward, relative to healthy controls (p < 0.05, corrected). Wholebrain analyses indicated that bipolar disorder, relative to healthy, participants also displayed elevated left-lateral OFC activity (BA 47) activity during reward anticipation (p < 0.05, corrected). Conclusions Elevated ventral striatal and OFC activity during reward anticipation may represent a neural mechanism for predisposition to expansive mood and hypo/mania in response to reward-relevant cues that characterizes bipolar disorder. Our findings contrast with research reporting blunted activity in the ventral striatum during reward processing in unipolar depressed individuals, relative to healthy controls. Examination of reward-related neural activity in bipolar disorder is a promising research focus to facilitate identification of biological markers of the illness. PMID:22548898

  2. Reward sensitivity is associated with brain activity during erotic stimulus processing.

    Science.gov (United States)

    Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

    2013-01-01

    The behavioral approach system (BAS) from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food. PMID:23840558

  3. Reward sensitivity is associated with brain activity during erotic stimulus processing.

    Directory of Open Access Journals (Sweden)

    Victor Costumero

    Full Text Available The behavioral approach system (BAS from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

  4. Neural signature of food reward processing in bulimic-type eating disorders.

    Science.gov (United States)

    Simon, Joe J; Skunde, Mandy; Walther, Stephan; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

    2016-09-01

    Clinical observations and similarities to addiction suggest heightened reward sensitivity to food in patients with bulimic-type eating (BTE) disorders. Therefore, we investigated the expectation and receipt of food reward compared with monetary reward in patients with BTE. Fifty-six patients with BTE (27 patients with binge eating disorder and 29 with bulimia nervosa) and 55 matched healthy control participants underwent event-related functional magnetic resonance imaging while performing both food and monetary incentive delay tasks. BTE patients exhibited reduced brain activation in the posterior cingulate cortex during the expectation of food and increased activity in the medial orbitofrontal cortex, anterior medial prefrontal cortex and posterior cingulate cortex during the receipt of food reward. These findings were relevant to food because we found no significant group differences related to monetary reward. In the patients, higher brain activity in the medial orbitofrontal cortex during the receipt of food reward was related to higher levels of trait food craving and external eating. BTE patients exhibited increased hedonic processing during the receipt of food reward. These findings corroborate the notion that an altered responsiveness of the reward network to food stimuli is associated with BTE.

  5. Effects of emotion and reward motivation on neural correlates of episodic memory encoding: a PET study.

    Science.gov (United States)

    Shigemune, Yayoi; Abe, Nobuhito; Suzuki, Maki; Ueno, Aya; Mori, Etsuro; Tashiro, Manabu; Itoh, Masatoshi; Fujii, Toshikatsu

    2010-05-01

    It is known that emotion and reward motivation promote long-term memory formation. It remains unclear, however, how and where emotion and reward are integrated during episodic memory encoding. In the present study, subjects were engaged in intentional encoding of photographs under four different conditions that were made by combining two factors (emotional valence, negative or neutral; and monetary reward value, high or low for subsequent successful recognition) during H2 15O positron emission tomography (PET) scanning. As for recognition performance, we found significant main effects of emotional valence (negative>neutral) and reward value (high value>low value), without an interaction between the two factors. Imaging data showed that the left amygdala was activated during the encoding conditions of negative pictures relative to neutral pictures, and the left orbitofrontal cortex was activated during the encoding conditions of high reward pictures relative to low reward pictures. In addition, conjunction analysis of these two main effects detected right hippocampal activation. Although we could not find correlations between recognition performance and activity of these three regions, we speculate that the right hippocampus may integrate the effects of emotion (processed in the amygdala) and monetary reward (processed in the orbitofrontal cortex) on episodic memory encoding.

  6. Common and distinct neural features of social and non-social reward processing in autism and social anxiety disorder

    OpenAIRE

    Richey, John A.; Rittenberg, Alison; Hughes, Lauren; Damiano, Cara R.; Sabatino, Antoinette; Miller, Stephanie; Hanna, Eleanor; Bodfish, James W.; Dichter, Gabriel S.

    2013-01-01

    Autism spectrum disorders (ASDs) and social anxiety disorder (SAD) are both characterized by social dysfunction, but no study to date has compared neural responses to social rewards in ASDs and SAD. Neural responses during social and non-social reward anticipation and outcomes were examined in individuals with ASD (n = 16), SAD (n = 15) and a control group (n = 19) via functional magnetic resonance imaging. Analyses modeling all three groups revealed increased nucleus accumbens (NAc) activati...

  7. Self-Affirmation Activates the Ventral Striatum: A Possible Reward-Related Mechanism for Self-Affirmation.

    Science.gov (United States)

    Dutcher, Janine M; Creswell, J David; Pacilio, Laura E; Harris, Peter R; Klein, William M P; Levine, John M; Bower, Julienne E; Muscatell, Keely A; Eisenberger, Naomi I

    2016-04-01

    Self-affirmation (reflecting on important personal values) has been shown to have a range of positive effects; however, the neural basis of self-affirmation is not known. Building on studies showing that thinking about self-preferences activates neural reward pathways, we hypothesized that self-affirmation would activate brain reward circuitry during functional MRI (fMRI) studies. In Study 1, with college students, making judgments about important personal values during self-affirmation activated neural reward regions (i.e., ventral striatum), whereas making preference judgments that were not self-relevant did not. Study 2 replicated these results in a community sample, again showing that self-affirmation activated the ventral striatum. These are among the first fMRI studies to identify neural processes during self-affirmation. The findings extend theory by showing that self-affirmation may be rewarding and may provide a first step toward identifying a neural mechanism by which self-affirmation may produce a wide range of beneficial effects. PMID:26917214

  8. Subjective sensitivity to monetary gradients is associated with frontolimbic activation to reward in cocaine abusers

    OpenAIRE

    Goldstein, Rita Z.; Tomasi, Dardo; Alia-Klein, Nelly; Cottone, Lisa A.; Zhang, Lei; Telang, Frank; Volkow, Nora D.

    2006-01-01

    Drug addiction is characterized by marked disruptions in the ability to process reward. Here we evaluated in cocaine addicted and healthy control participants the subjective sensitivity to reward gradients and its association with neural responses to sustained reward. A self-report questionnaire was used to assess the former. A functional magnetic resonance imaging task that utilized monetary reward as feedback in a blocked design was used to assess the latter. Results revealed that whereas c...

  9. Reward Sensitivity Modulates Brain Activity in the Prefrontal Cortex, ACC and Striatum during Task Switching

    Science.gov (United States)

    Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Ventura-Campos, Noelia; Bustamante, Juan C.; Costumero, Víctor; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

    2015-01-01

    Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies. PMID:25875640

  10. Stimulus-Dependent Adjustment of Reward Prediction Error in the Midbrain

    OpenAIRE

    Takemura, Hiromasa; Samejima, Kazuyuki; Vogels, Rufin; Sakagami, Masamichi; Okuda, Jiro

    2011-01-01

    Previous reports have described that neural activities in midbrain dopamine areas are sensitive to unexpected reward delivery and omission. These activities are correlated with reward prediction error in reinforcement learning models, the difference between predicted reward values and the obtained reward outcome. These findings suggest that the reward prediction error signal in the brain updates reward prediction through stimulus–reward experiences. It remains unknown, however, how sensory pr...

  11. Natural and Drug Rewards Act on Common Neural Plasticity Mechanisms with ΔFosB as a Key Mediator

    OpenAIRE

    Pitchers, Kyle K.; Vialou, Vincent; Nestler, Eric J.; Laviolette, Steven R; Lehman, Michael N.; Coolen, Lique M.

    2013-01-01

    Drugs of abuse induce neuroplasticity in the natural reward pathway, specifically the nucleus accumbens (NAc), thereby causing development and expression of addictive behavior. Recent evidence suggests that natural rewards may cause similar changes in the NAc, suggesting that drugs may activate mechanisms of plasticity shared with natural rewards, and allowing for unique interplay between natural and drug rewards. In this study, we demonstrate that sexual experience in male rats when followed...

  12. Activation of the reward system boosts innate and adaptive immunity.

    Science.gov (United States)

    Ben-Shaanan, Tamar L; Azulay-Debby, Hilla; Dubovik, Tania; Starosvetsky, Elina; Korin, Ben; Schiller, Maya; Green, Nathaniel L; Admon, Yasmin; Hakim, Fahed; Shen-Orr, Shai S; Rolls, Asya

    2016-08-01

    Positive expectations contribute to the clinical benefits of the placebo effect. Such positive expectations are mediated by the brain's reward system; however, it remains unknown whether and how reward system activation affects the body's physiology and, specifically, immunity. Here we show that activation of the ventral tegmental area (VTA), a key component of the reward system, strengthens immunological host defense. We used 'designer receptors exclusively activated by designer drugs' (DREADDs) to directly activate dopaminergic neurons in the mouse VTA and characterized the subsequent immune response after exposure to bacteria (Escherichia coli), using time-of-flight mass cytometry (CyTOF) and functional assays. We found an increase in innate and adaptive immune responses that were manifested by enhanced antibacterial activity of monocytes and macrophages, reduced in vivo bacterial load and a heightened T cell response in the mouse model of delayed-type hypersensitivity. By chemically ablating the sympathetic nervous system (SNS), we showed that the reward system's effects on immunity are, at least partly, mediated by the SNS. Thus, our findings establish a causal relationship between the activity of the VTA and the immune response to bacterial infection. PMID:27376577

  13. Neural Reactivity to Rewards and Losses in Offspring of Mothers and Fathers with Histories of Depressive and Anxiety Disorders

    Science.gov (United States)

    Kujawa, Autumn; Proudfit, Greg Hajcak; Klein, Daniel N.

    2016-01-01

    Depression appears to be characterized by reduced neural reactivity to receipt of reward. Despite evidence of shared etiologies and high rates of comorbidity between depression and anxiety, this abnormality may be relatively specific to depression. However, it is unclear whether children at risk for depression also exhibit abnormal reward responding, and if so, whether risk for anxiety moderates this association. The feedback negativity (FN) is an event-related potential component sensitive to receipt of rewards versus losses that is reduced in depression. Using a large community sample (N=407) of 9-year old children who had never experienced a depressive episode, we examined whether histories of depression and anxiety in their parents were associated with the FN following monetary rewards and losses. Results indicated that maternal history of depression was associated with a blunted FN in offspring, but only when there was no maternal history of anxiety. In addition, greater severity of maternal depression was associated with greater blunting of the FN in children. No effects of paternal psychopathology were observed. Results suggest that blunted reactivity to rewards versus losses may be a vulnerability marker that is specific to pure depression, but is not evident when there is also familial risk for anxiety. In addition, these findings suggest that abnormal reward responding is evident as early as middle childhood, several years prior to the sharp increase in the prevalence of depression and rapid changes in neural reward circuitry in adolescence. PMID:24886003

  14. Multivariate Neural Representations of Value during Reward Anticipation and Consummation in the Human Orbitofrontal Cortex.

    Science.gov (United States)

    Yan, Chao; Su, Li; Wang, Yi; Xu, Ting; Yin, Da-Zhi; Fan, Ming-Xia; Deng, Ci-Ping; Hu, Yang; Wang, Zhao-Xin; Cheung, Eric F C; Lim, Kelvin O; Chan, Raymond C K

    2016-01-01

    The role of the orbitofrontal cortex (OFC) in value processing is a focus of research. Conventional imaging analysis, where smoothing and averaging are employed, may not be sufficiently sensitive in studying the OFC, which has heterogeneous anatomical structures and functions. In this study, we employed representational similarity analysis (RSA) to reveal the multi-voxel fMRI patterns in the OFC associated with value processing during the anticipatory and the consummatory phases. We found that multi-voxel activation patterns in the OFC encoded magnitude and partial valence information (win vs. loss) but not outcome (favourable vs. unfavourable) during reward consummation. Furthermore, the lateral OFC rather than the medial OFC encoded loss information. Also, we found that OFC encoded values in a similar way to the ventral striatum (VS) or the anterior insula (AI) during reward anticipation regardless of motivated response and to the medial prefrontal cortex (MPFC) and the VS in reward consummation. In contrast, univariate analysis did not show changes of activation in the OFC. These findings suggest an important role of the OFC in value processing during reward anticipation and consummation. PMID:27378417

  15. Behavioral and neural evidence of incentive bias for immediate rewards relative to preference-matched delayed rewards.

    Science.gov (United States)

    Luo, Shan; Ainslie, George; Giragosian, Lisa; Monterosso, John R

    2009-11-25

    Several theories of self-control [including intertemporal bargaining (Ainslie, 1992) and self-signaling (Bodner and Prelec, 2001)] imply that intertemporal decisions can be more farsighted than would be predicted by the incentive associated with rewards outside a decision context. We examined this hypothesis using behavior and functional neuroimaging. First, subjects expressed preferences between amounts of money delayed by 4 months and smaller amounts available that day. This allowed us to establish "indifference pairs" individualized to each participant: immediate and delayed amounts that were equally preferred. Participants subsequently performed a reaction time functional magnetic resonance imaging task (Knutson et al., 2001a) that provided them with distinct opportunities to win each of the rewards that comprised the indifference pairs. Anatomical region of interest analysis as well as whole-brain analysis indicated greater response recruited by the immediate rewards (relative to the preference-matched delayed rewards) in regions previously implicated as sensitive to incentive value using the same task (including bilateral putamen, bilateral anterior insula, and midbrain). Reaction time to the target was also faster during the immediate relative to delayed reward trials (p < 0.01), and individual differences in reaction time between immediate versus delayed reward trials correlated with variance in magnetic resonance signal in those clusters that responded preferentially to immediate rewards (r = 0.33, p < 0.05). These findings indicate a discrepancy in incentive associated with the immediate versus the preference-matched delayed rewards. This discrepancy may mark the contribution of self-control processes that are recruited during decision-making but that are absent when rewards are individually anticipated. PMID:19940177

  16. Longitudinal changes in adolescent risk-taking: a comprehensive study of neural responses to rewards, pubertal development, and risk-taking behavior.

    Science.gov (United States)

    Braams, Barbara R; van Duijvenvoorde, Anna C K; Peper, Jiska S; Crone, Eveline A

    2015-05-01

    Prior studies have highlighted adolescence as a period of increased risk-taking, which is postulated to result from an overactive reward system in the brain. Longitudinal studies are pivotal for testing these brain-behavior relations because individual slopes are more sensitive for detecting change. The aim of the current study was twofold: (1) to test patterns of age-related change (i.e., linear, quadratic, and cubic) in activity in the nucleus accumbens, a key reward region in the brain, in relation to change in puberty (self-report and testosterone levels), laboratory risk-taking and self-reported risk-taking tendency; and (2) to test whether individual differences in pubertal development and risk-taking behavior were contributors to longitudinal change in nucleus accumbens activity. We included 299 human participants at the first time point and 254 participants at the second time point, ranging between ages 8-27 years, time points were separated by a 2 year interval. Neural responses to rewards, pubertal development (self-report and testosterone levels), laboratory risk-taking (balloon analog risk task; BART), and self-reported risk-taking tendency (Behavior Inhibition System/Behavior Activation System questionnaire) were collected at both time points. The longitudinal analyses confirmed the quadratic age pattern for nucleus accumbens activity to rewards (peaking in adolescence), and the same quadratic pattern was found for laboratory risk-taking (BART). Nucleus accumbens activity change was further related to change in testosterone and self-reported reward-sensitivity (BAS Drive). Thus, this longitudinal analysis provides new insight in risk-taking and reward sensitivity in adolescence: (1) confirming an adolescent peak in nucleus accumbens activity, and (2) underlining a critical role for pubertal hormones and individual differences in risk-taking tendency.

  17. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task.

    NARCIS (Netherlands)

    E. van Duuren; F.A.N. Escamez; R.N.J.M.A. Joosten; R. Visser; A.B. Mulder; C.M.A. Pennartz

    2007-01-01

    The orbitofrontal cortex (OBFc) has been suggested to code the motivational value of environmental stimuli and to use this information for the flexible guidance of goal-directed behavior. To examine whether information regarding reward prediction is quantitatively represented in the rat OBFc, neural

  18. Converging effects of cocaine addiction and sex on neural responses to monetary rewards.

    Science.gov (United States)

    Konova, Anna B; Moeller, Scott J; Parvaz, Muhammad A; Froböse, Monja I; Alia-Klein, Nelly; Goldstein, Rita Z

    2016-02-28

    There is some evidence that cocaine addiction manifests as more severe in women than men. Here, we examined whether these sex-specific differences in the clinical setting parallel differential neurobehavioral sensitivity to rewards in the laboratory setting. Twenty-eight (14 females/14 males) cocaine-dependent and 25 (11 females/14 males) healthy individuals completed a monetary reward task during fMRI. Results showed that the effects of cocaine dependence and sex overlapped in regions traditionally considered part of the mesocorticolimbic brain circuits including the hippocampus and posterior cingulate cortex (PCC), as well as those outside of this circuit (e.g., the middle temporal gyrus). The nature of this 'overlap' was such that both illness and female sex were associated with lower activations in these regions in response to money. Diagnosis-by-sex interactions instead emerged in the frontal cortex, such that cocaine-dependent females exhibited lower precentral gyrus and greater inferior frontal gyrus (IFG) activations relative to cocaine-dependent males and healthy females. Within these regions modulated both by diagnosis and sex, lower activation in the hippocampus and PCC, and higher IFG activations, correlated with increased subjective craving during the task. Results suggest sex-specific differences in addiction extend to monetary rewards and may contribute to core symptoms linked to relapse. PMID:26809268

  19. Variation in TREK1 gene linked to depression-resistant phenotype is associated with potentiated neural responses to rewards in humans

    Science.gov (United States)

    Dillon, Daniel G.; Bogdan, Ryan; Fagerness, Jesen; Holmes, Avram J.; Perlis, Roy H.; Pizzagalli, Diego A.

    2010-01-01

    The TREK1 gene has been linked to a depression-resistant phenotype in rodents and antidepressant response in humans, but the neural mechanisms underlying these links are unclear. Because TREK1 is expressed in reward-related basal ganglia regions, it has been hypothesized that TREK1 genetic variation may be associated with anhedonic symptoms of depression. To investigate whether TREK1 genetic variation influences reward processing, we genotyped healthy individuals (n = 31) who completed a monetary incentive delay task during functional magnetic resonance imaging (fMRI). Three genotypes previously linked to positive antidepressant response were associated with potentiated basal ganglia activity to gains, but did not influence responses to penalties or no change feedback. TREK1 genetic variations did not affect basal ganglia volume, and fMRI group differences were confirmed when accounting for self-report measures of anhedonia. In addition, the total number of “protective” TREK1 alleles was associated with stronger responses to gains in several other reward-related regions, including the dorsal anterior cingulate cortex, orbitofrontal cortex, and mesial prefrontal cortex. In control analyses, associations between basal ganglia responses to gains and functional polymorphisms in the dopamine transporter (DAT1) and catechol-O-methyltransferase (COMT) genes were also explored. Results revealed that TREK1 and DAT/COMT genotypes were independently related to basal ganglia responses to gains. These findings indicate that TREK1 genotypes are associated with individual differences in reward-related brain activity. Future studies in depressed samples should evaluate whether variation in neural responses to rewards may contribute to the association between TREK1 and antidepressant response in humans. PMID:19621370

  20. The Neural Correlates of Expectancy Deviation and Punishment and Reward:An EPR Study%预期背离下奖励与惩罚的ERPs研究

    Institute of Scientific and Technical Information of China (English)

    刘耀中; 唐志文; 叶海英

    2012-01-01

    Reward and punishment play an important role in the study of human cooperation today.In our daily lives,it often happens that a person deserves being rewarded but the reward does not come,or he deserves being punished but the punishment does not come, either.Previous studies did not discuss much about the situation in which a person makes the right response but does not receive the reward he deserves,or the wrong response but does not receive the punishment.In this study,we try to explore how individuals' brain will respond to both of the two conditions we mentioned above using the Flanker experimental paradigm and ERP(Event - related potential) technology in order to find out what the neural processing mechanisms are for those rewards and punishments,as well as their FRN effects.We also try to analyze the relationship between the individuals neural mechanism and the Reinforcement Sensitivity Theory using the behavioral inhibition system(BIS) / behavioral approach system(BAS) analytical methods to reveal the psychological processing mechanism of punishment and reward. Here,we selected 15 candidates and conducted a 2- stimulus type(reward vs.punishment)×2 expectation deviated(Yes vs. No) experiment.All the 15 candidates were induced to accept all of the four experimental treatments.The results showed that(1) the individual's expectation that was deviated caused higher FRN;(2) when the individual was punished,a higher FRN appeared,and when he was rewarded,a higher P3 appeared;(3) there was no significant relationship between FRN and individuals sensitivity of being punished or failing to be rewarded.All those results above indicate;(1) if a person does not receive the reward he deserves,the effect caused will be the same as being punished and the correlation between BIS and FRN is confirmed.Individuals will experience a negative emotion.So we suggest that such condition may be adjusted by the punishment system;(2) when the expected punishment does not appear

  1. Pathological gambling and alcohol dependence: neural disturbances in reward and loss avoidance processing.

    Science.gov (United States)

    Romanczuk-Seiferth, Nina; Koehler, Saskia; Dreesen, Caspar; Wüstenberg, Torsten; Heinz, Andreas

    2015-05-01

    Pathological gambling (PG) shares clinical characteristics such as craving and loss of control with substance use disorders and is thus considered a behavioral addiction. While functional alterations in the mesolimbic reward system have been correlated with craving and relapse in substance use disorders, only a few studies have examined this brain circuit in PG, and no direct comparison has been conducted so far. Thus, we investigated the neuronal correlates of reward processing in PG in contrast to alcohol-dependent (AD) patients and healthy subjects. Eighteen PG patients, 15 AD patients and 17 controls were investigated with a monetary incentive delay task, in which visual cues predict the consequence (monetary gain, avoidance of loss, none) of a fast response to a subsequent target stimulus. Functional magnetic resonance imaging data were analyzed to account for possible confounding factors such as local gray matter volume. Activity in the right ventral striatum during loss anticipation was increased in PG patients compared with controls and AD patients. Moreover, PG patients showed decreased activation in the right ventral striatum and right medial prefrontal cortex during successful loss avoidance compared with controls, which was inversely associated with severity of gambling behavior. Thus, despite neurobiological similarities to substance use disorders in reward processing, as reported by previous studies, we found relevant differences with respect to the anticipation of loss as well as its avoidance (negative reinforcement), which further contributes to the understanding of PG.

  2. Matching Behavior as a Tradeoff Between Reward Maximization and Demands on Neural Computation [version 2; referees: 2 approved

    Directory of Open Access Journals (Sweden)

    Jan Kubanek

    2015-10-01

    Full Text Available When faced with a choice, humans and animals commonly distribute their behavior in proportion to the frequency of payoff of each option. Such behavior is referred to as matching and has been captured by the matching law. However, matching is not a general law of economic choice. Matching in its strict sense seems to be specifically observed in tasks whose properties make matching an optimal or a near-optimal strategy. We engaged monkeys in a foraging task in which matching was not the optimal strategy. Over-matching the proportions of the mean offered reward magnitudes would yield more reward than matching, yet, surprisingly, the animals almost exactly matched them. To gain insight into this phenomenon, we modeled the animals' decision-making using a mechanistic model. The model accounted for the animals' macroscopic and microscopic choice behavior. When the models' three parameters were not constrained to mimic the monkeys' behavior, the model over-matched the reward proportions and in doing so, harvested substantially more reward than the monkeys. This optimized model revealed a marked bottleneck in the monkeys' choice function that compares the value of the two options. The model featured a very steep value comparison function relative to that of the monkeys. The steepness of the value comparison function had a profound effect on the earned reward and on the level of matching. We implemented this value comparison function through responses of simulated biological neurons. We found that due to the presence of neural noise, steepening the value comparison requires an exponential increase in the number of value-coding neurons. Matching may be a compromise between harvesting satisfactory reward and the high demands placed by neural noise on optimal neural computation.

  3. Anger is associated with reward-related electrocortical activity: Evidence from the reward positivity

    NARCIS (Netherlands)

    Angus, D.J.; Kemkes, K.; Schutter, D.J.L.G.; Harmon-Jones, E.

    2015-01-01

    Previous research indicates that the reward positivity (RewP), an electrophysiological correlate of sensitivity and biases towards rewarding stimuli, is modulated by affective and motivational variables. Studies have provided evidence that states and traits associated with negative affect and reduce

  4. Dopamine-signalled reward predictions generated by competitive excitation and inhibition in a spiking neural network model

    Directory of Open Access Journals (Sweden)

    Paul eChorley

    2011-05-01

    Full Text Available Dopaminergic neurons in the mammalian substantia nigra displaycharacteristic phasic responses to stimuli which reliably predict thereceipt of primary rewards. These responses have been suggested toencode reward prediction-errors similar to those used in reinforcementlearning. Here, we propose a model of dopaminergic activity in whichprediction error signals are generated by the joint action ofshort-latency excitation and long-latency inhibition, in a networkundergoing dopaminergic neuromodulation of both spike-timing dependentsynaptic plasticity and neuronal excitability. In contrast toprevious models, sensitivity to recent events is maintained by theselective modification of specific striatal synapses, efferent tocortical neurons exhibiting stimulus-specific, temporally extendedactivity patterns. Our model shows, in the presence of significantbackground activity, (i a shift in dopaminergic response from rewardto reward predicting stimuli, (ii preservation of a response tounexpected rewards, and (iii a precisely-timed below-baseline dip inactivity observed when expected rewards are omitted.

  5. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards

    OpenAIRE

    Roesch, Matthew R; Calu, Donna J.; Schoenbaum, Geoffrey

    2007-01-01

    The dopamine system is thought to be involved in making decisions about reward. Here we recorded from the ventral tegmental area in rats learning to choose between differently delayed and sized rewards. As expected, the activity of many putative dopamine neurons reflected reward prediction errors, changing when the value of the reward increased or decreased unexpectedly. During learning, neural responses to reward in these neurons waned and responses to cues that predicted reward emerged. Not...

  6. Prediction-error in the context of real social relationships modulates reward system activity

    OpenAIRE

    Joshua ePoore; Jennifer ePfeifer; Elliot eBerkman; Tristen eInagaki; Benjamin Locke Welborn; Matthew eLieberman

    2012-01-01

    The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to...

  7. Application of fMRI to obesity research: differences in reward pathway activation measured with fMRI BOLD during visual presentation of high and low calorie foods

    Science.gov (United States)

    Tsao, Sinchai; Adam, Tanja C.; Goran, Michael I.; Singh, Manbir

    2012-03-01

    The factors behind the neural mechanisms that motivate food choice and obesity are not well known. Furthermore, it is not known when these neural mechanisms develop and how they are influenced by both genetic and environmental factors. This study uses fMRI together with clinical data to shed light on the aforementioned questions by investigating how appetite-related activation in the brain changes with low versus high caloric foods in pre-pubescent girls. Previous studies have shown that obese adults have less striatal D2 receptors and thus reduced Dopamine (DA) signaling leading to the reward-deficit theory of obesity. However, overeating in itself reduces D2 receptor density, D2 sensitivity and thus reward sensitivity. The results of this study will show how early these neural mechanisms develop and what effect the drastic endocrinological changes during puberty has on these mechanisms. Our preliminary results showed increased activations in the Putamen, Insula, Thalamus and Hippocampus when looking at activations where High Calorie > Low Calorie. When comparing High Calorie > Control and Low Calorie > Control, the High > Control test showed increased significant activation in the frontal lobe. The Low > Control also yielded significant activation in the Left and Right Fusiform Gyrus, which did not appear in the High > Control test. These results indicate that the reward pathway activations previously shown in post-puberty and adults are present in pre-pubescent teens. These results may suggest that some of the preferential neural mechanisms of reward are already present pre-puberty.

  8. Immediate early gene expression reveals interactions between social and nicotine rewards on brain activity in adolescent male rats.

    Science.gov (United States)

    Bastle, Ryan M; Peartree, Natalie A; Goenaga, Julianna; Hatch, Kayla N; Henricks, Angela; Scott, Samantha; Hood, Lauren E; Neisewander, Janet L

    2016-10-15

    Smoking initiation predominantly occurs during adolescence, often in the presence of peers. Therefore, understanding the neural mechanisms underlying the rewarding effects of nicotine and social stimuli is vital. Using the conditioned place preference (CPP) procedure, we measured immediate early gene (IEG) expression in animals following exposure either to a reward-conditioned environment or to the unconditioned stimuli (US). Adolescent, male rats were assigned to the following CPP US conditions: (1) Saline+Isolated, (2) Nicotine+Isolated, (3) Saline+Social, or (4) Nicotine+Social. For Experiment 1, brain tissue was collected 90min following the CPP expression test and processed for Fos immunohistochemistry. We found that rats conditioned with nicotine with or without a social partner exhibited CPP; however, we found no group differences in Fos expression in any brain region analyzed, with the exception of the nucleus accumbens core that exhibited a social-induced attenuation in Fos expression. For Experiment 2, brain tissue was collected 90min following US exposure during the last conditioning session. We found social reward-induced increases in IEG expression in striatal and amydalar subregions. In contrast, nicotine reduced IEG expression in prefrontal and striatal subregions. Reward interactions were also found in the dorsolateral striatum, basolateral amygdala, and ventral tegmental area where nicotine alone attenuated IEG expression and social reward reversed this effect. These results suggest that in general social rewards enhance, whereas nicotine attenuates, activation of mesocorticolimbic regions; however, the rewards given together interact to enhance activation in some regions. The findings contribute to knowledge of how a social environment influences nicotine effects. PMID:27435419

  9. Differential patterns of nucleus accumbens activation during anticipation of monetary and social reward in young and older adults

    OpenAIRE

    Rademacher, Lena; Salama, Aallaa; Gründer, Gerhard; Spreckelmeyer, Katja N.

    2013-01-01

    Recent studies have reported inconsistent results regarding the loss of reward sensitivity in the aging brain. Although such an age effect might be due to a decline of physiological processes, it may also be a consequence of age-related changes in motivational preference for different rewards. Here, we examined whether the age effects on neural correlates of reward anticipation are modulated by the type of expected reward. Functional magnetic resonance images were acquired in 24 older (60–78 ...

  10. Neural responses to threat and reward interact to predict stress-related problem drinking: A novel protective role of the amygdala

    Directory of Open Access Journals (Sweden)

    Nikolova Yuliya S

    2012-11-01

    Full Text Available Abstract Background Research into neural mechanisms of drug abuse risk has focused on the role of dysfunction in neural circuits for reward. In contrast, few studies have examined the role of dysfunction in neural circuits of threat in mediating drug abuse risk. Although typically regarded as a risk factor for mood and anxiety disorders, threat-related amygdala reactivity may serve as a protective factor against substance use disorders, particularly in individuals with exaggerated responsiveness to reward. Findings We used well-established neuroimaging paradigms to probe threat-related amygdala and reward-related ventral striatum reactivity in a sample of 200 young adult students from the ongoing Duke Neurogenetics Study. Recent life stress and problem drinking were assessed using self-report. We found a significant three-way interaction between threat-related amygdala reactivity, reward-related ventral striatum reactivity, and recent stress, wherein individuals with higher reward-related ventral striatum reactivity exhibit higher levels of problem drinking in the context of stress, but only if they also have lower threat-related amygdala reactivity. This three-way interaction predicted both contemporaneous problem drinking and problem drinking reported three-months later in a subset of participants. Conclusions These findings suggest complex interactions between stress and neural responsiveness to both threat and reward mediate problem drinking. Furthermore, they highlight a novel protective role for threat-related amygdala reactivity against drug use in individuals with high neural reactivity to reward.

  11. Changes in reward-induced brain activation in opiate addicts

    NARCIS (Netherlands)

    Martin-Soelch, C; Chevalley, AF; Kunig, G; Missimer, J; Magyar, S; Mino, A; Schultz, W; Leenders, KL

    2001-01-01

    Many studies indicate a role of the cerebral dopaminergic reward system in addiction. Motivated by these findings, we examined in opiate addicts whether brain regions involved in the reward circuitry also react to human prototypical rewards. We measured regional cerebral blood flow (rCBF) with (H2O)

  12. Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

    Science.gov (United States)

    Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

    2015-12-10

    Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. PMID:26499261

  13. Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

    Science.gov (United States)

    Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

    2015-12-10

    Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing.

  14. Reward prediction-related increases and decreases in tonic neuronal activity of the pedunculopontine tegmental nucleus

    Directory of Open Access Journals (Sweden)

    Ken-Ichi eOkada

    2013-05-01

    Full Text Available The neuromodulators serotonin, acetylcholine, and dopamine have been proposed to play important roles in the execution of movement, control of several forms of attentional behavior, and reinforcement learning. While the response pattern of midbrain dopaminergic neurons and its specific role in reinforcement learning have been revealed, the roles of the other neuromodulators remain elusive. Reportedly, neurons in the dorsal raphe nucleus, one major source of serotonin, continually track the state of expectation of future rewards by showing a correlated response to the start of a behavioral task, reward cue presentation, and reward delivery. Here, we show that neurons in the pedunculopontine tegmental nucleus (PPTN, one major source of acetylcholine, showed similar encoding of the expectation of future rewards by a systematic increase or decrease in tonic activity. We recorded and analyzed PPTN neuronal activity in monkeys during a reward conditioned visually guided saccade task. The firing patterns of many PPTN neurons were tonically increased or decreased throughout the task period. The tonic activity pattern of neurons was correlated with their encoding of the predicted reward value; neurons exhibiting an increase or decrease in tonic activity showed higher or lower activity in the large reward-predicted trials, respectively. Tonic activity and reward-related modulation ended around the time of reward delivery. Additionally, some tonic changes in activity started prior to the appearance of the initial stimulus, and were related to the anticipatory fixational behavior. A partially overlapping population of neurons showed both the initial anticipatory response and subsequent predicted reward value-dependent activity modulation by their systematic increase or decrease of tonic activity. These bi-directional reward- and anticipatory behavior-related modulation patterns are suitable for the presumed role of the PPTN in reward processing and

  15. Reward system dysfunction in autism spectrum disorders

    OpenAIRE

    Kohls, Gregor; Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

    2012-01-01

    Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in r...

  16. Dopamine Modulates Reward System Activity During Subconscious Processing of Sexual Stimuli

    OpenAIRE

    Oei, Nicole Y. L.; Rombouts, Serge ARB; Soeter, Roelof P.; van Gerven, Joop M; Both, Stephanie

    2012-01-01

    Dopaminergic medication influences conscious processing of rewarding stimuli, and is associated with impulsive–compulsive behaviors, such as hypersexuality. Previous studies have shown that subconscious subliminal presentation of sexual stimuli activates brain areas known to be part of the ‘reward system'. In this study, it was hypothesized that dopamine modulates activation in key areas of the reward system, such as the nucleus accumbens, during subconscious processing of sexual stimuli. You...

  17. Shared neural basis of social and non-social reward deficits in chronic cocaine users

    DEFF Research Database (Denmark)

    Tobler, Philippe N; Preller, Katrin H; Campbell-Meiklejohn, Daniel K;

    2016-01-01

    -social reinforcements. We used functional neuroimaging in cocaine users to investigate explicit social reward as modeled by agreement of music preferences with music experts. In addition, we investigated non-social reward as modeled by winning desired music pieces. The study included 17 chronic cocaine users and 17...

  18. Activity in human reward-sensitive brain areas in strongly context dependent

    NARCIS (Netherlands)

    Nieuwenhuis, S.; Heslenfeld, D.J.; Mars, R.B.; Alting von Geusau, N.J.; Holroyd, C.B.; Yeung, N.

    2005-01-01

    Functional neuroimaging research in humans has identified a number of brain areas that are activated by the delivery of primary and secondary reinforcers. The present study investigated how activity in these reward-sensitive regions is modulated by the context in which rewards and punishments are ex

  19. Activation of the central serotonergic system in response to delayed but not omitted rewards

    OpenAIRE

    Miyazaki, Kayoko W.; Miyazaki, Katsuhiko; Doya, Kenji

    2011-01-01

    The forebrain serotonergic system is a crucial component in the control of impulsive behaviours. However, there is no direct evidence for natural serotonin activity during behaviours for delayed rewards as opposed to immediate rewards. Herein we show that serotonin efflux is enhanced while rats perform a task that requires waiting for a delayed reward. We simultaneously measured the levels of serotonin and dopamine in the dorsal raphe nucleus using in vivo microdialysis. Rats performed a sequ...

  20. Reward processing in anorexia nervosa.

    Science.gov (United States)

    Keating, Charlotte; Tilbrook, Alan J; Rossell, Susan L; Enticott, Peter G; Fitzgerald, Paul B

    2012-04-01

    Individuals with anorexia nervosa (AN) demonstrate a relentless engagement in behaviors aimed to reduce their weight, which leads to severe underweight status, and occasionally death. Neurobiological abnormalities, as a consequence of starvation are controversial: evidence, however, demonstrates abnormalities in the reward system of patients, and recovered individuals. Despite this, a unifying explanation for reward abnormalities observed in AN and their relevance to symptoms of the illness, remains incompletely understood. Theories explaining reward dysfunction have conventionally focused on anhedonia, describing that patients have an impaired ability to experience reward or pleasure. We review taste reward literature and propose that patients' reduced responses to conventional taste-reward tasks may reflect a fear of weight gain associated with the caloric nature of the tasks, rather than an impaired ability to experience reward. Consistent with this, we propose that patients are capable of 'liking' hedonic taste stimuli (e.g., identifying them), however, they do not 'want' or feel motivated for the stimuli in the same way that healthy controls report. Recent brain imaging data on more complex reward processing tasks provide insights into fronto-striatal neural circuit dysfunction related to altered reward processing in AN that challenges the relevance of anhedonia in explaining reward dysfunction in AN. In this way, altered activity of the anterior cingulate cortex and striatum could explain patients' pathological engagement in behaviors they consider rewarding (e.g., self-starvation) that are otherwise aversive or punishing, to those without the eating disorder. Such evidence for altered patterns of brain activity associated with reward processing tasks in patients and recovered individuals may provide important information about mechanisms underlying symptoms of AN, their future investigation, and the development of treatment approaches. PMID:22349445

  1. Menstrual cycle phase modulates reward-related neural function in women

    OpenAIRE

    Dreher, Jean-Claude; Schmidt, Peter J.; Kohn, Philip; Furman, Daniella; Rubinow, David; Berman, Karen Faith

    2007-01-01

    There is considerable evidence from animal studies that the mesolimbic and mesocortical dopamine systems are sensitive to circulating gonadal steroid hormones. Less is known about the influence of estrogen and progesterone on the human reward system. To investigate this directly, we used functional MRI and an event-related monetary reward paradigm to study women with a repeated-measures, counterbalanced design across the menstrual cycle. Here we show that during the midfollicular phase (days ...

  2. Weak reward source memory in depression reflects blunted activation of VTA/SN and parahippocampus.

    Science.gov (United States)

    Dillon, Daniel G; Dobbins, Ian G; Pizzagalli, Diego A

    2014-10-01

    Reward responses in the medial temporal lobes and dopaminergic midbrain boost episodic memory formation in healthy adults, and weak memory for emotionally positive material in depression suggests this mechanism may be dysfunctional in major depressive disorder (MDD). To test this hypothesis, we performed a study in which unmedicated adults with MDD and healthy controls encoded drawings paired with reward or zero tokens during functional magnetic resonance imaging. In a recognition test, participants judged whether drawings were previously associated with the reward token ('reward source') or the zero token ('zero source'). Unlike controls, depressed participants failed to show better memory for drawings from the reward source vs the zero source. Consistent with predictions, controls also showed a stronger encoding response to reward tokens vs zero tokens in the right parahippocampus and dopaminergic midbrain, whereas the MDD group showed the opposite pattern-stronger responses to zero vs reward tokens-in these regions. Differential activation of the dopaminergic midbrain by reward vs zero tokens was positively correlated with the reward source memory advantage in controls, but not depressed participants. These data suggest that weaker memory for positive material in depression reflects blunted encoding responses in the dopaminergic midbrain and medial temporal lobes. PMID:24078019

  3. Reward contingency modulates neuronal activity in rat septal nuclei during elemental and configural association tasks

    Directory of Open Access Journals (Sweden)

    Nozomu eMatsuyama

    2011-05-01

    Full Text Available It has been suggested that septal nuclei are important in the control of behavior during various reward and non-reward situations. In the present study, neuronal activity was recorded from rat septal nuclei during discrimination of conditioned sensory stimuli (CSs of the medial forebrain bundle associated with or without a reward (sucrose solution or intracranial self-stimulation, ICSS. Rats were trained to lick a spout protruding close to the mouth just after a CS to obtain a reward stimulus. The CSs included both elemental and configural stimuli. In the configural condition, the reward contingency of the stimuli presented together was opposite to that of each elemental stimulus presented alone, although the same sensory stimuli were involved. Of the 72 responsive septal neurons, 18 responded selectively to the CSs predicting reward (CS+-related, four to the CSs predicting nonreward (CS0-related, nine to some CSs predicting reward or nonreward, and 15 nondifferentially to all CSs. The remaining 26 neurons responded mainly during the ingestion/ICSS phase. A multivariate analysis of the septal neuronal responses to elemental and configural stimuli indicated that septal neurons encoded the CSs based on reward contingency, regardless of the stimulus physical properties and were categorized into three groups; CSs predicting the sucrose solution, CSs predicting a nonreward, and CSs predicting ICSS. The results suggest that septal nuclei are deeply involved in discriminating the reward contingency of environmental stimuli to manifest appropriate behaviors in response to changing stimuli.

  4. Reward salience and risk aversion underlie differential ACC activity in substance dependence

    Directory of Open Access Journals (Sweden)

    William H. Alexander

    2015-01-01

    Full Text Available The medial prefrontal cortex, especially the dorsal anterior cingulate cortex (ACC, has long been implicated in cognitive control and error processing. Although the association between ACC and behavior has been established, it is less clear how ACC contributes to dysfunctional behavior such as substance dependence. Evidence from neuroimaging studies investigating ACC function in substance users is mixed, with some studies showing disengagement of ACC in substance dependent individuals (SDs, while others show increased ACC activity related to substance use. In this study, we investigate ACC function in SDs and healthy individuals performing a change signal task for monetary rewards. Using a priori predictions derived from a recent computational model of ACC, we find that ACC activity differs between SDs and controls in factors related to reward salience and risk aversion between SDs and healthy individuals. Quantitative fits of a computational model to fMRI data reveal significant differences in best fit parameters for reward salience and risk preferences. Specifically, the ACC in SDs shows greater risk aversion, defined as concavity in the utility function, and greater attention to rewards relative to reward omission. Furthermore, across participants risk aversion and reward salience are positively correlated. The results clarify the role that ACC plays in both the reduced sensitivity to omitted rewards and greater reward valuation in SDs. Clinical implications of applying computational modeling in psychiatry are also discussed.

  5. Opioid-Induced Glial Activation: Mechanisms of Activation and Implications for Opioid Analgesia, Dependence, and Reward

    Directory of Open Access Journals (Sweden)

    Mark R. Hutchinson

    2007-01-01

    Full Text Available This review will introduce the concept of toll-like receptor (TLR–mediated glial activation as central to all of the following: neuropathic pain, compromised acute opioid analgesia, and unwanted opioid side effects (tolerance, dependence, and reward. Attenuation of glial activation has previously been demonstrated both to alleviate exaggerated pain states induced by experimental pain models and to reduce the development of opioid tolerance. Here we demonstrate that selective acute antagonism of TLR4 results in reversal of neuropathic pain as well as potentiation of opioid analgesia. Attenuating central nervous system glial activation was also found to reduce the development of opioid dependence, and opioid reward at a behavioral (conditioned place preference and neurochemical (nucleus accumbens microdialysis of morphine-induced elevations in dopamine level of analysis. Moreover, a novel antagonism of TLR4 by (+- and (˗-isomer opioid antagonists has now been characterized, and both antiallodynic and morphine analgesia potentiating activity shown. Opioid agonists were found to also possess TLR4 agonistic activity, predictive of glial activation. Targeting glial activation is a novel and as yet clinically unexploited method for treatment of neuropathic pain. Moreover, these data indicate that attenuation of glial activation, by general or selective TLR antagonistic mechanisms, may also be a clinical method for separating the beneficial (analgesia and unwanted (tolerance, dependence, and reward actions of opioids, thereby improving the safety and efficacy of their use.

  6. Associations of reward sensitivity with food consumption, activity pattern, and BMI in children.

    Science.gov (United States)

    De Decker, Annelies; Sioen, Isabelle; Verbeken, Sandra; Braet, Caroline; Michels, Nathalie; De Henauw, Stefaan

    2016-05-01

    In the current study, the associations of reward sensitivity with weight related behaviors and body mass index were investigated in a general population sample of 443 Flemish children (50.3% boys) aged 5.5-12 years. Cross-sectional data on palatable food consumption frequency, screen time, physical activity, parental education level and measured length and weight were collected. The Drive subscale of the 'Behavioral Inhibition Scale/Behavioral Activation Scale' was used as a short method to measure reward sensitivity. A significant positive association of reward sensitivity with the fast food and sweet drink consumption frequency was found. Furthermore, a significant positive association of reward sensitivity with the z-score of body mass index was demonstrated, which explained additional variance to the variance explained by palatable food consumption frequency, screen time, physical activity and parental education level. Hence, the assessment of reward sensitivity may have an added value to the assessment of weight-related behavior indicators when evaluating the determinants of overweight in a child. In sum, children high in reward sensitivity might be more attracted to fast food and sweet drinks, and hence, might be more vulnerable to develop unfavorable food habits and overweight. These findings suggest that considering inter-individual differences in reward sensitivity is of importance in future childhood obesity prevention campaigns. PMID:26898320

  7. Prediction-error in the context of real social relationships modulates reward system activity

    Directory of Open Access Journals (Sweden)

    Joshua ePoore

    2012-08-01

    Full Text Available The human reward system is sensitive to both social (e.g., validation and non-social rewards (e.g., money and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward—social validation—and this activity’s relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants’ expectations for their romantic partners’ positive regard of them were confirmed (validated or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

  8. Planning activity for internally generated reward goals in monkey amygdala neurons.

    Science.gov (United States)

    Hernádi, István; Grabenhorst, Fabian; Schultz, Wolfram

    2015-03-01

    The best rewards are often distant and can only be achieved by planning and decision-making over several steps. We designed a multi-step choice task in which monkeys followed internal plans to save rewards toward self-defined goals. During this self-controlled behavior, amygdala neurons showed future-oriented activity that reflected the animal's plan to obtain specific rewards several trials ahead. This prospective activity encoded crucial components of the animal's plan, including value and length of the planned choice sequence. It began on initial trials when a plan would be formed, reappeared step by step until reward receipt, and readily updated with a new sequence. It predicted performance, including errors, and typically disappeared during instructed behavior. Such prospective activity could underlie the formation and pursuit of internal plans characteristic of goal-directed behavior. The existence of neuronal planning activity in the amygdala suggests that this structure is important in guiding behavior toward internally generated, distant goals.

  9. Brain areas activated by uncertain reward-based decision-making in healthy volunteers

    OpenAIRE

    Guo, Zongjun; Chen, Juan; Liu, Shien; Li, Yuhuan; Sun, Bo; Gao, Zhenbo

    2013-01-01

    Reward-based decision-making has been found to activate several brain areas, including the ventrolateral prefrontal lobe, orbitofrontal cortex, anterior cingulate cortex, ventral striatum, and mesolimbic dopaminergic system. In this study, we observed brain areas activated under three degrees of uncertainty in a reward-based decision-making task (certain, risky, and ambiguous). The tasks were presented using a brain function audiovisual stimulation system. We conducted brain scans of 15 healt...

  10. Active reward processing during human sleep: insights from sleep-related eating disorder

    Directory of Open Access Journals (Sweden)

    Lampros ePerogamvros

    2012-11-01

    Full Text Available In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED, a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity on reward-related questionnaires. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating disorders, our findings suggest a role of an active reward system during sleep in the manifestation of SRED.

  11. Neural Correlates of Reward-Based Spatial Learning in Persons with Cocaine Dependence

    OpenAIRE

    Tau, Gregory Z.; Marsh, Rachel; Wang, Zhishun; Torres-Sanchez, Tania; Graniello, Barbara; Hao, Xuejun; Xu, Dongrong; Packard, Mark G.; Duan, Yunsuo; Kangarlu, Alayar; Martinez, Diana; Peterson, Bradley S.

    2013-01-01

    Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary reward...

  12. Reward bias and lateralization in gambling behavior: behavioral activation system and alpha band analysis.

    Science.gov (United States)

    Balconi, Michela; Finocchiaro, Roberta; Canavesio, Ylenia; Messina, Rossella

    2014-11-30

    The present research explored the main factors that can influence subjects' choices in the case of decisions. In order to elucidate the individual differences that influence the decisional processes, making their strategies more or less advantageous, we tested the effect of a reward sensitivity in the behavioral activation system (BAS-Reward) constructed on the ability to distinguish between high- and low-risk decisions. Secondly, the lateralization effect, related to increased activation of the left (BAS-related) hemisphere, was explored. Thirty-one subjects were tested using the Iowa Gambling Task, and the BAS-Reward measure was applied to distinguish between high-BAS and low-BAS groups. Behavioral responses (gain/loss options) and alpha-band modulation were considered. It was found that high-BAS group increased their tendency to opt in favor of the immediate reward (loss strategy) rather than the long-term option (win strategy). Secondly, high-BAS subjects showed an increased left-hemisphere activation in response to losing (with immediate reward) choices in comparison with low-BAS subjects. A "reward bias" effect was supposed to explain both the bad strategy and the unbalanced hemispheric activation for high-BAS and more risk-taking subjects.

  13. Synchrony Can Destabilize Reward-Sensitive Networks

    Directory of Open Access Journals (Sweden)

    Michael eChary

    2014-04-01

    Full Text Available When exposed to rewarding stimuli, only some animals develop persistent craving. Others are resilient and do not. How the activity of neural populations relates to the development of persistent craving behavior is not fully understood. Previous computational studies suggest that synchrony helps a network embed certain patterns of activity, although the role of synchrony in reward-dependent learning has been less studied. Increased synchrony has been reported as a marker for both susceptibility and resilience to developing persistent craving. Here we use computational simulations to study the effect of reward salience on the ability of synchronous input to embed a new pattern of activity into a neural population. Our main finding is that weak stimulus-reward correlations can facilitate the short-term repetition of a pattern of neural activity, while blocking long-term embedding of that pattern. Interestingly, synchrony did not have this dual effect on all patterns, which suggests that synchrony is more effective at embedding some patterns of activity than others. Our results demonstrate that synchrony can have opposing effects in networks sensitive to the correlation structure of their inputs, in this case the correlation between stimulus and reward. This work contributes to an understanding of the interplay between synchrony and reward-dependent plasticity.

  14. Combining Correlation-Based and Reward-Based Learning in Neural Control for Policy Improvement

    DEFF Research Database (Denmark)

    Manoonpong, Poramate; Kolodziejski, Christoph; Wörgötter, Florentin;

    2013-01-01

    Classical conditioning (conventionally modeled as correlation-based learning) and operant conditioning (conventionally modeled as reinforcement learning or reward-based learning) have been found in biological systems. Evidence shows that these two mechanisms strongly involve learning about...... policy, i.e., it allows the controller to learn stabilizing the pole in the largest domain of initial conditions compared to the results obtained when using a single learning mechanism. This model can also find a successful control policy for goal-directed behavior, i.e., the robot can effectively learn...

  15. Compassionate attitude towards others' suffering activates the mesolimbic neural system.

    Science.gov (United States)

    Kim, Ji-Woong; Kim, Sung-Eun; Kim, Jae-Jin; Jeong, Bumseok; Park, Chang-Hyun; Son, Ae Ree; Song, Ji Eun; Ki, Seon Wan

    2009-08-01

    Compassion is one of the essential components which enable individuals to enter into and maintain relationships of caring. Compassion tends to motivate us to help people who are emotionally suffering. It is also known that a feeling of intrinsic reward may occur as a result of experiencing compassion for others. We conducted this study to understand the neural nature of compassion for other people's emotional state. Twenty-one healthy normal volunteers participated in this study. We used a 2 x 2 factorial design in which each subject was asked to assume a compassionate attitude or passive attitude while viewing the sad or neutral facial affective pictures during functional magnetic imaging. The main effect of a compassionate attitude was observed in the medial frontal cortex, the subgenual frontal cortex, the inferior frontal cortex and the midbrain regions. A test of the interaction between a compassionate attitude and sad facial affect revealed significant activations in the midbrain-ventral striatum/septal network region. The results of this study suggest that taking a compassionate attitude towards other people's sad expressions modulate the activities of the midbrain-ventral striatum/septal region network, which is known to play a role in the prosocial/social approach motivation and its accompanied rewarding feeling. PMID:19428038

  16. Neural networks with discontinuous/impact activations

    CERN Document Server

    Akhmet, Marat

    2014-01-01

    This book presents as its main subject new models in mathematical neuroscience. A wide range of neural networks models with discontinuities are discussed, including impulsive differential equations, differential equations with piecewise constant arguments, and models of mixed type. These models involve discontinuities, which are natural because huge velocities and short distances are usually observed in devices modeling the networks. A discussion of the models, appropriate for the proposed applications, is also provided. This book also: Explores questions related to the biological underpinning for models of neural networks\\ Considers neural networks modeling using differential equations with impulsive and piecewise constant argument discontinuities Provides all necessary mathematical basics for application to the theory of neural networks Neural Networks with Discontinuous/Impact Activations is an ideal book for researchers and professionals in the field of engineering mathematics that have an interest in app...

  17. Neostriatal Neuronal Activity Correlates Better with Movement Kinematics under Certain Rewards.

    Science.gov (United States)

    Opris, Ioan; Lebedev, Mikhail A; Nelson, Randall J

    2016-01-01

    This study investigated how the activity of neostriatal neurons is related to the kinematics of movement when monkeys performed visually and vibratory cued wrist extensions and flexions. Single-unit recordings of 142/236 neostriatal neurons showed pre-movement activity (PMA) in a reaction time task with unpredictable reward. Monkeys were pseudo-randomly (75%) rewarded for correct performance. A regression model was used to determine whether the correlation between neostriatal neuronal activity and the kinematic variables (position, velocity, and acceleration) of wrist movement changes as a function of reward contingency, sensory cues, and movement direction. The coefficients of determination (CoD) representing the proportion of the variance in neuronal activity explained by the regression model on a trial by trial basis, together with their temporal occurrences (time of best regression/correlation, ToC) were compared across sensory modality, movement direction, and reward contingency. The best relationship (correlation) between neuronal activity and movement kinematic variables, given by the average coefficient of determination (CoD), was: (a) greater during trials in which rewards were certain, called "A" trials, as compared with those in which reward was uncertain called ("R") trials, (b) greater during flexion (Flex) trials as compared with extension (Ext) trials, and (c) greater during visual (VIS) cued trials than during vibratory (VIB) cued trials, for the same type of trial and the same movement direction. These results are consistent with the hypothesis that predictability of reward for correct performance is accompanied by faster linkage between neostriatal PMA and the vigor of wrist movement kinematics. Furthermore, the results provide valuable insights for building an upper-limb neuroprosthesis. PMID:27579022

  18. Pain relief produces negative reinforcement through activation of mesolimbic reward-valuation circuitry.

    Science.gov (United States)

    Navratilova, Edita; Xie, Jennifer Y; Okun, Alec; Qu, Chaoling; Eyde, Nathan; Ci, Shuang; Ossipov, Michael H; King, Tamara; Fields, Howard L; Porreca, Frank

    2012-12-11

    Relief of pain is rewarding. Using a model of experimental postsurgical pain we show that blockade of afferent input from the injury with local anesthetic elicits conditioned place preference, activates ventral tegmental dopaminergic cells, and increases dopamine release in the nucleus accumbens. Importantly, place preference is associated with increased activity in midbrain dopaminergic neurons and blocked by dopamine antagonists injected into the nucleus accumbens. The data directly support the hypothesis that relief of pain produces negative reinforcement through activation of the mesolimbic reward-valuation circuitry.

  19. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum.

    Science.gov (United States)

    O'Doherty, John P; Buchanan, Tony W; Seymour, Ben; Dolan, Raymond J

    2006-01-01

    Food preferences are acquired through experience and can exert strong influence on choice behavior. In order to choose which food to consume, it is necessary to maintain a predictive representation of the subjective value of the associated food stimulus. Here, we explore the neural mechanisms by which such predictive representations are learned through classical conditioning. Human subjects were scanned using fMRI while learning associations between arbitrary visual stimuli and subsequent delivery of one of five different food flavors. Using a temporal difference algorithm to model learning, we found predictive responses in the ventral midbrain and a part of ventral striatum (ventral putamen) that were related directly to subjects' actual behavioral preferences. These brain structures demonstrated divergent response profiles, with the ventral midbrain showing a linear response profile with preference, and the ventral striatum a bivalent response. These results provide insight into the neural mechanisms underlying human preference behavior. PMID:16387647

  20. Trait impulsivity is related to ventral ACC and amygdala activity during primary reward anticipation.

    Science.gov (United States)

    Kerr, Kara L; Avery, Jason A; Barcalow, Joel C; Moseman, Scott E; Bodurka, Jerzy; Bellgowan, Patrick S F; Simmons, W Kyle

    2015-01-01

    Trait impulsivity is characterized by behavioral disinhibition and rash decision-making that contribute to many maladaptive behaviors. Previous research demonstrates that trait impulsivity is related to the activity of brain regions underlying reward sensitivity and emotion regulation, but little is known about this relationship in the context of immediately available primary reward. This is unfortunate, as impulsivity in these contexts can lead to unhealthy behaviors, including poor food choices, dangerous drug use and risky sexual practices. In addition, little is known about the relationship between integration of reward and affective neurocircuitry, as measured by resting-state functional connectivity, and trait impulsivity in everyday life, as measured with a commonly used personality inventory. We therefore asked healthy adults to undergo a functional magnetic resonance imaging task in which they saw cues indicating the imminent oral administration of rewarding taste, as well as a resting-state scan. Trait impulsivity was associated with increased activation during anticipation of primary reward in the anterior cingulate cortex (ACC) and amygdala. Additionally, resting-state functional connectivity between the ACC and the right amygdala was negatively correlated with trait impulsivity. These findings demonstrate that trait impulsivity is related not only to ACC-amygdala activation but also to how tightly coupled these regions are to one another. PMID:24526181

  1. Increased frequency of social interaction is associated with enjoyment enhancement and reward system activation.

    Science.gov (United States)

    Kawamichi, Hiroaki; Sugawara, Sho K; Hamano, Yuki H; Makita, Kai; Kochiyama, Takanori; Sadato, Norihiro

    2016-04-19

    Positive social interactions contribute to the sense that one's life has meaning. Enjoyment of feelings associated through social interaction motivates humans to build social connections according to their personal preferences. Therefore, we hypothesized that social interaction itself activates the reward system in a manner that depends upon individual interaction preferences. To test this hypothesis, we conducted a functional magnetic resonance imaging (fMRI) study in which 38 participants played a virtual ball-toss game in which the number of ball tosses to the participant was either similar to (normal-frequency condition) or higher than (high-frequency condition) the number of tosses to the other players. Participants reported greater-than-anticipated enjoyment during the high-frequency condition, suggesting that receiving a social reward led to unexpected positive feelings. Consistent with this, the high-frequency condition produced stronger activation in the ventral striatum, which is part of the reward system, and the precuneus, representing positive self-image, which might be translated to social reward. Furthermore, ventral striatal activation covaried with individual participants' preference for interactions with others. These findings suggest that an elevated frequency of social interaction is represented as a social reward, which might motivate individuals to promote social interaction in a manner that is modulated by personal preference.

  2. Future planning: default network activity couples with frontoparietal control network and reward-processing regions during process and outcome simulations.

    Science.gov (United States)

    Gerlach, Kathy D; Spreng, R Nathan; Madore, Kevin P; Schacter, Daniel L

    2014-12-01

    We spend much of our daily lives imagining how we can reach future goals and what will happen when we attain them. Despite the prevalence of such goal-directed simulations, neuroimaging studies on planning have mainly focused on executive processes in the frontal lobe. This experiment examined the neural basis of process simulations, during which participants imagined themselves going through steps toward attaining a goal, and outcome simulations, during which participants imagined events they associated with achieving a goal. In the scanner, participants engaged in these simulation tasks and an odd/even control task. We hypothesized that process simulations would recruit default and frontoparietal control network regions, and that outcome simulations, which allow us to anticipate the affective consequences of achieving goals, would recruit default and reward-processing regions. Our analysis of brain activity that covaried with process and outcome simulations confirmed these hypotheses. A functional connectivity analysis with posterior cingulate, dorsolateral prefrontal cortex and anterior inferior parietal lobule seeds showed that their activity was correlated during process simulations and associated with a distributed network of default and frontoparietal control network regions. During outcome simulations, medial prefrontal cortex and amygdala seeds covaried together and formed a functional network with default and reward-processing regions.

  3. Own-gender imitation activates the brain's reward circuitry

    OpenAIRE

    Losin, Elizabeth A. Reynolds; Iacoboni, Macro; Martin, Alia; DAPRETTO, MIRELLA

    2012-01-01

    Imitation is an important component of human social learning throughout life. Theoretical models and empirical data from anthropology and psychology suggest that people tend to imitate self-similar individuals, and that such imitation biases increase the adaptive value (e.g., self-relevance) of learned information. It is unclear, however, what neural mechanisms underlie people's tendency to imitate those similar to themselves. We focused on the own-gender imitation bias, a pervasive bias thou...

  4. Relative ability of fat and sugar tastes to activate reward, gustatory, and somatosensory regions123

    OpenAIRE

    Stice, Eric; Burger, Kyle S; Yokum, Sonja

    2013-01-01

    Background: Although the intake of high-fat and high-sugar food activates mesolimbic reward, gustatory, and oral somatosensory brain regions, contributing to overeating, few studies have examined the relative role of fat and sugar in the activation of these brain regions, which would inform policy, prevention, and treatment interventions designed to reduce obesity.

  5. Striatal Reward Activity and Antipsychotic-Associated Weight Change in Patients With Schizophrenia Undergoing Initial Treatment

    DEFF Research Database (Denmark)

    Nielsen, Mette Ødegaard; Rostrup, Egill; Wulff, Sanne;

    2016-01-01

    anticipation is associated with amisulpride-induced weight change in antipsychotic-naive patients with schizophrenia undergoing initial treatment and to examine the association between weight change and changes in reward anticipation activity after treatment. Design, Setting, and Participants: Sixty......-nine antipsychotic-naive inpatients and outpatients with schizophrenia were included in a multimodal longitudinal cohort study from December 16, 2008, to December 11, 2013. Fifty-eight patients underwent functional magnetic resonance imaging (fMRI) while performing a monetary reward task. After 6 weeks of treatment......Importance: Weight gain is a common and serious adverse effect of antipsychotic treatment. A variable individual predisposition to development of metabolic disturbances calls for predictive biological markers. Objectives: To investigate whether attenuated striatal activity during reward...

  6. Brain areas activated by uncertain reward-based decision-making in healthy volunteers

    Institute of Scientific and Technical Information of China (English)

    Zongjun Guo; Juan Chen; Shien Liu; Yuhuan Li; Bo Sun; Zhenbo Gao

    2013-01-01

    Reward-based decision-making has been found to activate several brain areas, including the ven-trolateral prefrontal lobe, orbitofrontal cortex, anterior cingulate cortex, ventral striatum, and meso-limbic dopaminergic system. In this study, we observed brain areas activated under three degrees of uncertainty in a reward-based decision-making task (certain, risky, and ambiguous). The tasks were presented using a brain function audiovisual stimulation system. We conducted brain scans of 15 healthy volunteers using a 3.0T magnetic resonance scanner. We used SPM8 to analyze the location and intensity of activation during the reward-based decision-making task, with respect to the three conditions. We found that the orbitofrontal cortex was activated in the certain reward con-dition, while the prefrontal cortex, precentral gyrus, occipital visual cortex, inferior parietal lobe, ce-rebel ar posterior lobe, middle temporal gyrus, inferior temporal gyrus, limbic lobe, and midbrain were activated during the ‘risk’ condition. The prefrontal cortex, temporal pole, inferior temporal gyrus, occipital visual cortex, and cerebel ar posterior lobe were activated during ambiguous deci-sion-making. The ventrolateral prefrontal lobe, frontal pole of the prefrontal lobe, orbitofrontal cortex, precentral gyrus, inferior temporal gyrus, fusiform gyrus, supramarginal gyrus, inferior parietal lo-bule, and cerebel ar posterior lobe exhibited greater activation in the‘risk’ than in the‘certain’ con-dition (P<0.05). The frontal pole and dorsolateral region of the prefrontal lobe, as wel as the ce-rebel ar posterior lobe, showed significantly greater activation in the ‘ambiguous’ condition com-pared to the ‘risk’ condition (P < 0.05). The prefrontal lobe, occipital lobe, parietal lobe, temporal lobe, limbic lobe, midbrain, and posterior lobe of the cerebel um were activated during deci-sion-making about uncertain rewards. Thus, we observed different levels and regions of

  7. Insular activation during reward anticipation reflects duration of illness in abstinent pathological gamblers

    Directory of Open Access Journals (Sweden)

    Kosuke eTsurumi

    2014-09-01

    Full Text Available Pathological gambling (PG is a chronic mental disorder characterized by a difficulty restraining gambling behavior despite negative consequences. Although brain abnormalities in patients with substance use disorders are caused by repetitive drug use and recover partly with drug abstinence, the relationship between brain activity and duration of illness or abstinence of gambling behavior in PG patients remains unclear. Here, using functional magnetic resonance imaging, we compared the brain activity of 23 PG patients recruited from a treatment facility with 27 demographically-matched healthy control subjects during reward anticipation, and examined the correlations between brain activity and duration of illness or abstinence in PG patients. During reward anticipation, PG patients showed decreased activity compared to healthy controls in a broad range of the reward system regions, including the insula cortex. In PG patients, activation in the left insula showed a significant negative correlation with illness duration. Our findings suggest that insular activation during reward anticipation may serve as a marker of progression of pathological gambling.

  8. Oscillatory activity in the medial prefrontal cortex and nucleus accumbens correlates with impulsivity and reward outcome.

    Directory of Open Access Journals (Sweden)

    Nicholas A Donnelly

    Full Text Available Actions expressed prematurely without regard for their consequences are considered impulsive. Such behaviour is governed by a network of brain regions including the prefrontal cortex (PFC and nucleus accumbens (NAcb and is prevalent in disorders including attention deficit hyperactivity disorder (ADHD and drug addiction. However, little is known of the relationship between neural activity in these regions and specific forms of impulsive behaviour. In the present study we investigated local field potential (LFP oscillations in distinct sub-regions of the PFC and NAcb on a 5-choice serial reaction time task (5-CSRTT, which measures sustained, spatially-divided visual attention and action restraint. The main findings show that power in gamma frequency (50-60 Hz LFP oscillations transiently increases in the PFC and NAcb during both the anticipation of a cue signalling the spatial location of a nose-poke response and again following correct responses. Gamma oscillations were coupled to low-frequency delta oscillations in both regions; this coupling strengthened specifically when an error response was made. Theta (7-9 Hz LFP power in the PFC and NAcb increased during the waiting period and was also related to response outcome. Additionally, both gamma and theta power were significantly affected by upcoming premature responses as rats waited for the visual cue to respond. In a subgroup of rats showing persistently high levels of impulsivity we found that impulsivity was associated with increased error signals following a nose-poke response, as well as reduced signals of previous trial outcome during the waiting period. Collectively, these in-vivo neurophysiological findings further implicate the PFC and NAcb in anticipatory impulsive responses and provide evidence that abnormalities in the encoding of rewarding outcomes may underlie trait-like impulsive behaviour.

  9. Dopamine agonist increases risk taking but blunts reward-related brain activity.

    Directory of Open Access Journals (Sweden)

    Jordi Riba

    Full Text Available The use of D2/D3 dopaminergic agonists in Parkinson's disease (PD may lead to pathological gambling. In a placebo-controlled double-blind study in healthy volunteers, we observed riskier choices in a lottery task after administration of the D3 receptor-preferring agonist pramipexole thus mimicking risk-taking behavior in PD. Moreover, we demonstrate decreased activation in the rostral basal ganglia and midbrain, key structures of the reward system, following unexpected high gains and therefore propose that pathological gambling in PD results from the need to seek higher rewards to overcome the blunted response in this system.

  10. Neural Activities Underlying the Feedback Express Salience Prediction Errors for Appetitive and Aversive Stimuli

    Science.gov (United States)

    Gu, Yan; Hu, Xueping; Pan, Weigang; Yang, Chun; Wang, Lijun; Li, Yiyuan; Chen, Antao

    2016-01-01

    Feedback information is essential for us to adapt appropriately to the environment. The feedback-related negativity (FRN), a frontocentral negative deflection after the delivery of feedback, has been found to be larger for outcomes that are worse than expected, and it reflects a reward prediction error derived from the midbrain dopaminergic projections to the anterior cingulate cortex (ACC), as stated in reinforcement learning theory. In contrast, the prediction of response-outcome (PRO) model claims that the neural activity in the mediofrontal cortex (mPFC), especially the ACC, is sensitive to the violation of expectancy, irrespective of the valence of feedback. Additionally, increasing evidence has demonstrated significant activities in the striatum, anterior insula and occipital lobe for unexpected outcomes independently of their valence. Thus, the neural mechanism of the feedback remains under dispute. Here, we investigated the feedback with monetary reward and electrical pain shock in one task via functional magnetic resonance imaging. The results revealed significant prediction-error-related activities in the bilateral fusiform gyrus, right middle frontal gyrus and left cingulate gyrus for both money and pain. This implies that some regions underlying the feedback may signal a salience prediction error rather than a reward prediction error. PMID:27694920

  11. Optogenetic Activation of a Lateral Hypothalamic-Ventral Tegmental Drive-Reward Pathway.

    Science.gov (United States)

    Gigante, Eduardo D; Benaliouad, Faiza; Zamora-Olivencia, Veronica; Wise, Roy A

    2016-01-01

    Electrical stimulation of the lateral hypothalamus can motivate feeding or can serve as a reward in its own right. It remains unclear whether the same or independent but anatomically overlapping circuitries mediate the two effects. Electrical stimulation findings implicate medial forebrain bundle (MFB) fibers of passage in both effects, and optogenetic studies confirm a contribution from fibers originating in the lateral hypothalamic area and projecting to or through the ventral tegmental area. Here we report that optogenetic activation of ventral tegmental fibers from cells of origin in more anterior or posterior portions of the MFB failed to induce either reward or feeding. The feeding and reward induced by optogenetic activation of fibers from the lateral hypothalamic cells of origin were influenced similarly by variations in stimulation pulse width and pulse frequency, consistent with the hypothesis of a common substrate for the two effects. There were, however, several cases where feeding but not self-stimulation or self-stimulation but not feeding were induced, consistent with the hypothesis that distinct but anatomically overlapping systems mediate the two effects. Thus while optogenetic stimulation provides a more selective tool for characterizing the mechanisms of stimulation-induced feeding and reward, it does not yet resolve the question of common or independent substrates.

  12. Reduced cerebellar brain activity during reward processing in adolescent binge drinkers

    Directory of Open Access Journals (Sweden)

    Anita Cservenka

    2015-12-01

    Full Text Available Due to ongoing development, adolescence may be a period of heightened vulnerability to the neurotoxic effects of alcohol. Binge drinking may alter reward-driven behavior and neurocircuitry, thereby increasing risk for escalating alcohol use. Therefore, we compared reward processing in adolescents with and without a history of recent binge drinking. At their baseline study visit, all participants (age = 14.86 ± 0.88 were free of heavy alcohol use and completed a modified version of the Wheel of Fortune (WOF functional magnetic resonance imaging task. Following this visit, 17 youth reported binge drinking on ≥3 occasions within a 90 day period and were matched to 17 youth who remained alcohol and substance-naïve. All participants repeated the WOF task during a second visit (age = 16.83 ± 1.22. No significant effects were found in a region of interest analysis of the ventral striatum, but whole-brain analyses showed significant group differences in reward response at the second study visit in the left cerebellum, controlling for baseline visit brain activity (p/α < 0.05, which was negatively correlated with mean number of drinks consumed/drinking day in the last 90 days. These findings suggest that binge drinking during adolescence may alter brain activity during reward processing in a dose-dependent manner.

  13. Differences in Neural Activation as a Function of Risk-taking Task Parameters

    Directory of Open Access Journals (Sweden)

    Eliza eCongdon

    2013-09-01

    Full Text Available Despite evidence supporting a relationship between impulsivity and naturalistic risk-taking, the relationship of impulsivity with laboratory-based measures of risky decision-making remains unclear. One factor contributing to this gap in our understanding is the degree to which different risky decision-making tasks vary in their details. We conducted an fMRI investigation of the Angling Risk Task (ART, which is an improved behavioral measure of risky decision-making. In order to examine whether the observed pattern of neural activation was specific to the ART or generalizable, we also examined correlates of the Balloon Analogue Risk Taking (BART task in the same sample of 23 healthy adults. Exploratory analyses were conducted to examine the relationship between neural activation, performance, impulsivity and self-reported risk-taking. While activation in a valuation network was associated with reward tracking during the ART but not the BART, increased fronto-cingulate activation was seen during risky choice trials in the BART as compared to the ART. Thus, neural activation during risky decision-making trials differed between the two tasks, and this observation was likely driven by differences in task parameters, namely the absence vs. presence of ambiguity and/or stationary vs. increasing probability of loss on the ART and BART, respectively. Exploratory association analyses suggest that sensitivity of neural response to the magnitude of potential reward during the ART was associated with a suboptimal performance strategy, higher scores on a scale of dysfunctional impulsivity and a greater likelihood of engaging in risky behaviors, while this pattern was not seen for the BART. Our results suggest that the ART is decomposable and associated with distinct patterns of neural activation; this represents a preliminary step towards characterizing a behavioral measure of risky decision-making that may support a better understanding of naturalistic risk-taking.

  14. Relation of obesity to neural activation in response to food commercials.

    Science.gov (United States)

    Gearhardt, Ashley N; Yokum, Sonja; Stice, Eric; Harris, Jennifer L; Brownell, Kelly D

    2014-07-01

    Adolescents view thousands of food commercials annually, but the neural response to food advertising and its association with obesity is largely unknown. This study is the first to examine how neural response to food commercials differs from other stimuli (e.g. non-food commercials and television show) and to explore how this response may differ by weight status. The blood oxygen level-dependent functional magnetic resonance imaging activation was measured in 30 adolescents ranging from lean to obese in response to food and non-food commercials imbedded in a television show. Adolescents exhibited greater activation in regions implicated in visual processing (e.g. occipital gyrus), attention (e.g. parietal lobes), cognition (e.g. temporal gyrus and posterior cerebellar lobe), movement (e.g. anterior cerebellar cortex), somatosensory response (e.g. postcentral gyrus) and reward [e.g. orbitofrontal cortex and anterior cingulate cortex (ACC)] during food commercials. Obese participants exhibited less activation during food relative to non-food commercials in neural regions implicated in visual processing (e.g. cuneus), attention (e.g. posterior cerebellar lobe), reward (e.g. ventromedial prefrontal cortex and ACC) and salience detection (e.g. precuneus). Obese participants did exhibit greater activation in a region implicated in semantic control (e.g. medial temporal gyrus). These findings may inform current policy debates regarding the impact of food advertising to minors. PMID:23576811

  15. Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex.

    Science.gov (United States)

    Klein-Flügge, Miriam Cornelia; Barron, Helen Catharine; Brodersen, Kay Henning; Dolan, Raymond J; Behrens, Timothy Edward John

    2013-02-13

    A dominant focus in studies of learning and decision-making is the neural coding of scalar reward value. This emphasis ignores the fact that choices are strongly shaped by a rich representation of potential rewards. Here, using fMRI adaptation, we demonstrate that responses in the human orbitofrontal cortex (OFC) encode a representation of the specific type of food reward predicted by a visual cue. By controlling for value across rewards and by linking each reward with two distinct stimuli, we could test for representations of reward-identity that were independent of associative information. Our results show reward-identity representations in a medial-caudal region of OFC, independent of the associated predictive stimulus. This contrasts with a more rostro-lateral OFC region encoding reward-identity representations tied to the predicate stimulus. This demonstration of adaptation in OFC to reward specific representations opens an avenue for investigation of more complex decision mechanisms that are not immediately accessible in standard analyses, which focus on correlates of average activity. PMID:23407973

  16. When a good taste turns bad: Neural mechanisms underlying the emergence of negative affect and associated natural reward devaluation by cocaine.

    Science.gov (United States)

    Carelli, Regina M; West, Elizabeth A

    2014-01-01

    An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, research in the Carelli laboratory is reviewed that examined neurobiological mechanisms that may underlie these processes using a novel animal model. Oromotor responses (taste reactivity) were examined as rats learned that intraoral infusion of a sweet (e.g., saccharin) predicts impending but delayed access to cocaine self-administration. We showed that rats exhibit aversive taste reactivity (i.e., gapes/rejection responses) during infusion of the sweet paired with impending cocaine, similar to aversive responses observed during infusion of quinine, a bitter tastant. Critically, the expression of this pronounced aversion to the sweet predicted the subsequent motivation to self-administer cocaine. Electrophysiology studies show that this shift in palatability corresponds to an alteration in nucleus accumbens (NAc) cell firing; neurons that previously responded with inhibition during infusion of the palatable sweet shifted to excitatory activity during infusion of the cocaine-devalued tastant. This excitatory response profile is typically observed during infusion of quinine, indicating that the once palatable sweet becomes aversive following its association with impending but delayed cocaine, and NAc neurons encode this aversive state. We also review electrochemical studies showing a shift (from increase to decrease) in rapid NAc dopamine release during infusion of the cocaine-paired tastant as the aversive state developed, again, resulting in responses similar to quinine

  17. Food reward in active compared to inactive men: Roles for gastric emptying and body fat.

    Science.gov (United States)

    Horner, Katy M; Finlayson, Graham; Byrne, Nuala M; King, Neil A

    2016-06-01

    Habitual exercise could contribute to weight management by altering processes of food reward via the gut-brain axis. We investigated hedonic processes of food reward in active and inactive men and characterised relationships with gastric emptying and body fat. Forty-four men (active: n=22; inactive: n=22, BMI range 21-36kg/m(2); percent fat mass range 9-42%) were studied. Participants were provided with a standardised fixed breakfast and an ad libitum lunch meal 5h later. Explicit liking, implicit wanting and preference among high-fat, low-fat, sweet and savoury food items were assessed immediately post-breakfast (fed state) and again pre-lunch (hungry state) using the Leeds Food Preference Questionnaire. Gastric emptying was assessed by (13)C-octanoic acid breath test. Active individuals exhibited a lower liking for foods overall and a greater implicit wanting for low-fat savoury foods in the fed state, compared to inactive men. Differences in the fed state remained significant after adjusting for percent fat mass. Active men also had a greater increase in liking for savoury foods in the interval between breakfast and lunch. Faster gastric emptying was associated with liking for savoury foods and with an increase in liking for savoury foods in the postprandial interval. In contrast, greater implicit wanting for high-fat foods was associated with slower gastric emptying. These associations were independent of each other, activity status and body fat. In conclusion, active and inactive men differ in processes of food reward. The rate of gastric emptying may play a role in the association between physical activity status and food reward, via the gut-brain axis. PMID:27072508

  18. Food reward in active compared to inactive men: Roles for gastric emptying and body fat.

    Science.gov (United States)

    Horner, Katy M; Finlayson, Graham; Byrne, Nuala M; King, Neil A

    2016-06-01

    Habitual exercise could contribute to weight management by altering processes of food reward via the gut-brain axis. We investigated hedonic processes of food reward in active and inactive men and characterised relationships with gastric emptying and body fat. Forty-four men (active: n=22; inactive: n=22, BMI range 21-36kg/m(2); percent fat mass range 9-42%) were studied. Participants were provided with a standardised fixed breakfast and an ad libitum lunch meal 5h later. Explicit liking, implicit wanting and preference among high-fat, low-fat, sweet and savoury food items were assessed immediately post-breakfast (fed state) and again pre-lunch (hungry state) using the Leeds Food Preference Questionnaire. Gastric emptying was assessed by (13)C-octanoic acid breath test. Active individuals exhibited a lower liking for foods overall and a greater implicit wanting for low-fat savoury foods in the fed state, compared to inactive men. Differences in the fed state remained significant after adjusting for percent fat mass. Active men also had a greater increase in liking for savoury foods in the interval between breakfast and lunch. Faster gastric emptying was associated with liking for savoury foods and with an increase in liking for savoury foods in the postprandial interval. In contrast, greater implicit wanting for high-fat foods was associated with slower gastric emptying. These associations were independent of each other, activity status and body fat. In conclusion, active and inactive men differ in processes of food reward. The rate of gastric emptying may play a role in the association between physical activity status and food reward, via the gut-brain axis.

  19. The decision to engage cognitive control is driven by expected reward-value: neural and behavioral evidence.

    Directory of Open Access Journals (Sweden)

    Matthew L Dixon

    Full Text Available Cognitive control is a fundamental skill reflecting the active use of task-rules to guide behavior and suppress inappropriate automatic responses. Prior work has traditionally used paradigms in which subjects are told when to engage cognitive control. Thus, surprisingly little is known about the factors that influence individuals' initial decision of whether or not to act in a reflective, rule-based manner. To examine this, we took three classic cognitive control tasks (Stroop, Wisconsin Card Sorting Task, Go/No-Go task and created novel 'free-choice' versions in which human subjects were free to select an automatic, pre-potent action, or an action requiring rule-based cognitive control, and earned varying amounts of money based on their choices. Our findings demonstrated that subjects' decision to engage cognitive control was driven by an explicit representation of monetary rewards expected to be obtained from rule-use. Subjects rarely engaged cognitive control when the expected outcome was of equal or lesser value as compared to the value of the automatic response, but frequently engaged cognitive control when it was expected to yield a larger monetary outcome. Additionally, we exploited fMRI-adaptation to show that the lateral prefrontal cortex (LPFC represents associations between rules and expected reward outcomes. Together, these findings suggest that individuals are more likely to act in a reflective, rule-based manner when they expect that it will result in a desired outcome. Thus, choosing to exert cognitive control is not simply a matter of reason and willpower, but rather, conforms to standard mechanisms of value-based decision making. Finally, in contrast to current models of LPFC function, our results suggest that the LPFC plays a direct role in representing motivational incentives.

  20. SOVEREIGN: An autonomous neural system for incrementally learning planned action sequences to navigate towards a rewarded goal.

    Science.gov (United States)

    Gnadt, William; Grossberg, Stephen

    2008-06-01

    How do reactive and planned behaviors interact in real time? How are sequences of such behaviors released at appropriate times during autonomous navigation to realize valued goals? Controllers for both animals and mobile robots, or animats, need reactive mechanisms for exploration, and learned plans to reach goal objects once an environment becomes familiar. The SOVEREIGN (Self-Organizing, Vision, Expectation, Recognition, Emotion, Intelligent, Goal-oriented Navigation) animat model embodies these capabilities, and is tested in a 3D virtual reality environment. SOVEREIGN includes several interacting subsystems which model complementary properties of cortical What and Where processing streams and which clarify similarities between mechanisms for navigation and arm movement control. As the animat explores an environment, visual inputs are processed by networks that are sensitive to visual form and motion in the What and Where streams, respectively. Position-invariant and size-invariant recognition categories are learned by real-time incremental learning in the What stream. Estimates of target position relative to the animat are computed in the Where stream, and can activate approach movements toward the target. Motion cues from animat locomotion can elicit head-orienting movements to bring a new target into view. Approach and orienting movements are alternately performed during animat navigation. Cumulative estimates of each movement are derived from interacting proprioceptive and visual cues. Movement sequences are stored within a motor working memory. Sequences of visual categories are stored in a sensory working memory. These working memories trigger learning of sensory and motor sequence categories, or plans, which together control planned movements. Predictively effective chunk combinations are selectively enhanced via reinforcement learning when the animat is rewarded. Selected planning chunks effect a gradual transition from variable reactive exploratory

  1. The decision to engage cognitive control is driven by expected reward-value: neural and behavioral evidence.

    Science.gov (United States)

    Dixon, Matthew L; Christoff, Kalina

    2012-01-01

    Cognitive control is a fundamental skill reflecting the active use of task-rules to guide behavior and suppress inappropriate automatic responses. Prior work has traditionally used paradigms in which subjects are told when to engage cognitive control. Thus, surprisingly little is known about the factors that influence individuals' initial decision of whether or not to act in a reflective, rule-based manner. To examine this, we took three classic cognitive control tasks (Stroop, Wisconsin Card Sorting Task, Go/No-Go task) and created novel 'free-choice' versions in which human subjects were free to select an automatic, pre-potent action, or an action requiring rule-based cognitive control, and earned varying amounts of money based on their choices. Our findings demonstrated that subjects' decision to engage cognitive control was driven by an explicit representation of monetary rewards expected to be obtained from rule-use. Subjects rarely engaged cognitive control when the expected outcome was of equal or lesser value as compared to the value of the automatic response, but frequently engaged cognitive control when it was expected to yield a larger monetary outcome. Additionally, we exploited fMRI-adaptation to show that the lateral prefrontal cortex (LPFC) represents associations between rules and expected reward outcomes. Together, these findings suggest that individuals are more likely to act in a reflective, rule-based manner when they expect that it will result in a desired outcome. Thus, choosing to exert cognitive control is not simply a matter of reason and willpower, but rather, conforms to standard mechanisms of value-based decision making. Finally, in contrast to current models of LPFC function, our results suggest that the LPFC plays a direct role in representing motivational incentives. PMID:23284730

  2. Dissecting Neural Responses to Temporal Prediction, Attention, and Memory: Effects of Reward Learning and Interoception on Time Perception.

    Science.gov (United States)

    Tomasi, Dardo; Wang, Gene-Jack; Studentsova, Yana; Volkow, Nora D

    2015-10-01

    Temporal prediction (TP) is needed to anticipate future events and is essential for survival. Our sense of time is modulated by emotional and interoceptive (corporal) states that are hypothesized to rely on a dopamine (DA)-modulated "internal clock" in the basal ganglia. However, the neurobiological substrates for TP in the human brain have not been identified. We tested the hypothesis that TP involves DA striato-cortical pathways, and that accurate responses are reinforcing in themselves and activate the nucleus accumbens (NAc). Functional magnetic resonance imaging revealed the involvement of the NAc and anterior insula in the temporal precision of the responses, and of the ventral tegmental area in error processing. Moreover, NAc showed higher activation for successful than for unsuccessful trials, indicating that accurate TP per se is rewarding. Inasmuch as activation of the NAc is associated with drug-induced addictive behaviors, its activation by accurate TP could help explain why video games that rely on TP can trigger compulsive behaviors. PMID:25389123

  3. Information transmission in oscillatory neural activity

    CERN Document Server

    Koepsell, Kilian

    2008-01-01

    Periodic neural activity not locked to the stimulus or to motor responses is usually ignored. Here, we present new tools for modeling and quantifying the information transmission based on periodic neural activity that occurs with quasi-random phase relative to the stimulus. We propose a model to reproduce characteristic features of oscillatory spike trains, such as histograms of inter-spike intervals and phase locking of spikes to an oscillatory influence. The proposed model is based on an inhomogeneous Gamma process governed by a density function that is a product of the usual stimulus-dependent rate and a quasi-periodic function. Further, we present an analysis method generalizing the direct method (Rieke et al, 1999; Brenner et al, 2000) to assess the information content in such data. We demonstrate these tools on recordings from relay cells in the lateral geniculate nucleus of the cat.

  4. Neural activity associated with self-reflection

    OpenAIRE

    Herwig Uwe; Kaffenberger Tina; Schell Caroline; Jäncke Lutz; Brühl Annette B

    2012-01-01

    Abstract Background Self-referential cognitions are important for self-monitoring and self-regulation. Previous studies have addressed the neural correlates of self-referential processes in response to or related to external stimuli. We here investigated brain activity associated with a short, exclusively mental process of self-reflection in the absence of external stimuli or behavioural requirements. Healthy subjects reflected either on themselves, a personally known or an unknown person dur...

  5. Peers increase adolescent risk taking by enhancing activity in the brain’s reward circuitry

    OpenAIRE

    Chein, Jason; Albert, Dustin; O’Brien, Lia; Uckert, Kaitlyn; Steinberg, Laurence

    2011-01-01

    The presence of peers increases risk taking among adolescents but not adults. We posited that the presence of peers may promote adolescent risk taking by sensitizing brain regions associated with the anticipation of potential rewards. Using fMRI, we measured brain activity in adolescents, young adults, and adults as they made decisions in a simulated driving task. Participants completed one task block while alone, and one block while their performance was observed by peers in an adjacent room...

  6. Dopamine Agonist Increases Risk Taking but Blunts Reward-Related Brain Activity

    OpenAIRE

    Jordi Riba; Krämer, Ulrike M.; Marcus Heldmann; Sylvia Richter; Münte, Thomas F.

    2008-01-01

    The use of D2/D3 dopaminergic agonists in Parkinson's disease (PD) may lead to pathological gambling. In a placebo-controlled double-blind study in healthy volunteers, we observed riskier choices in a lottery task after administration of the D3 receptor-preferring agonist pramipexole thus mimicking risk-taking behavior in PD. Moreover, we demonstrate decreased activation in the rostral basal ganglia and midbrain, key structures of the reward system, following unexpected high gains and therefo...

  7. Salience network-midbrain dysconnectivity and blunted reward signals in schizophrenia

    OpenAIRE

    Gradin, Victoria; Waiter, Gordon; O'Connor, Akira Robert; Romaniuk, Liana; Stickle, Catriona; Matthews, Keith; Hall, Jeremy; Steele, Douglas

    2012-01-01

    Theories of schizophrenia propose that abnormal functioning of the neural reward system is linked to negative and psychotic symptoms, by disruption of reward processing and promotion of context-independent false associations. Recently it has been argued that an insula-anterior cingulate cortex (ACC) salience network system enables switching of brain states from the default mode to a task-related activity mode. Abnormal interaction between the insula-ACC system and reward processing regions ma...

  8. ADHD Related Behaviors Are Associated with Brain Activation in the Reward System

    Science.gov (United States)

    Stark, R.; Bauer, E.; Merz, C. J.; Zimmermann, M.; Reuter, M.; Plichta, M. M.; Kirsch, P.; Lesch, K. P.; Fallgatter, A. J.; Vaitl, D.; Herrmann, M. J.

    2011-01-01

    Neuroimaging studies on attention-deficit/hyperactivity disorder (ADHD) suggest dysfunctional reward processing, with hypo-responsiveness during reward anticipation in the reward system including the nucleus accumbens (NAcc). In this study, we investigated the association between ADHD related behaviors and the reward system using functional…

  9. Neural and sympathetic activity associated with exploration in decision-making: Further evidence for involvement of insula

    Directory of Open Access Journals (Sweden)

    Hideki eOhira

    2014-11-01

    Full Text Available We previously reported that sympathetic activity was associated with exploration in decision-making indexed by entropy, which is a concept in information theory and indexes randomness of choices or the degree of deviation from sticking to recent experiences of gains and losses, and that activation of the anterior insula mediated this association. The current study aims to replicate and to expand these findings in a situation where contingency between options and outcomes is manipulated. Sixteen participants performed a stochastic decision-making task in which we manipulated a condition with low uncertainty of gain/loss (contingent-reward condition and a condition with high uncertainty of gain/loss (random-reward condition. Regional cerebral blood flow was measured by 15O-water positron emission tomography (PET, and cardiovascular parameters and catecholamine in the peripheral blood were measured, during the task. In the contingent-reward condition, norepinephrine as an index of sympathetic activity was positively correlated with entropy indicating exploration in decision-making. Norepinephrine was negatively correlated with neural activity in the right posterior insula, rostral anterior cingulate cortex, and dorsal pons, suggesting neural bases for detecting changes of bodily states. Furthermore, right anterior insular activity was negatively correlated with entropy, suggesting influences on exploration in decision-making. By contrast, in the random-reward condition, entropy correlated with activity in the dorsolateral prefrontal and parietal cortices but not with sympathetic activity. These findings suggest that influences of sympathetic activity on exploration in decision-making and its underlying neural mechanisms might be dependent on the degree of uncertainty of situations.

  10. Dopamine Receptor Blockade Modulates the Rewarding and Aversive Properties of Nicotine via Dissociable Neuronal Activity Patterns in the Nucleus Accumbens

    OpenAIRE

    Sun, Ninglei; Laviolette, Steven R

    2014-01-01

    The mesolimbic pathway comprising the ventral tegmental area (VTA) and projection terminals in the nucleus accumbens (NAc) has been identified as a critical neural system involved in processing both the rewarding and aversive behavioral effects of nicotine. Transmission through dopamine (DA) receptors functionally modulates these effects directly within the NAc. Nevertheless, the neuronal mechanisms within the NAc responsible for these bivalent behavioral effects are presently not known. Usin...

  11. Early effects of reward anticipation are modulated by dopaminergic stimulation.

    Directory of Open Access Journals (Sweden)

    Thore Apitz

    Full Text Available The abilities to predict future rewards and assess the value of reward delivery are crucial aspects of adaptive behavior. While the mesolimbic system, including dopaminergic midbrain, ventral striatum and prefrontal cortex have long been associated with reward processing, recent studies also indicate a prominent role of early visual brain regions. However, the precise underlying neural mechanisms still remain unclear. To address this issue, we presented participants with visual cues predicting rewards of high and low magnitudes and probability (2 × 2 factorial design, while neural activity was scanned using magnetoencephalography. Importantly, one group of participants received 150 mg of the dopamine precursor levodopa prior to the experiment, while another group received a placebo. For the placebo group, neural signals of reward probability (but not magnitude emerged at ∼ 100 ms after cue presentation at occipital sensors in the event-related magnetic fields. Importantly, these probability signals were absent in the levodopa group indicating a close link. Moreover, levodopa administration reduced oscillatory power in the high (20-30 Hz and low (13-20 Hz beta band during both reward anticipation and delivery. Taken together, our findings indicate that visual brain regions are involved in coding prospective reward probability but not magnitude and that these effects are modulated by dopamine.

  12. A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages.

    Science.gov (United States)

    Sambrook, Thomas D; Goslin, Jeremy

    2015-01-01

    Economic approaches to decision making assume that people attach values to prospective goods and act to maximize their obtained value. Neuroeconomics strives to observe these values directly in the brain. A widely used valuation term in formal learning and decision-making models is the reward prediction error: the value of an outcome relative to its expected value. An influential theory (Holroyd & Coles, 2002) claims that an electrophysiological component, feedback related negativity (FRN), codes a reward prediction error in the human brain. Such a component should be sensitive to both the prior likelihood of reward and its magnitude on receipt. A number of studies have found the FRN to be insensitive to reward magnitude, thus questioning the Holroyd and Coles account. However, because of marked inconsistencies in how the FRN is measured, a meaningful synthesis of this evidence is highly problematic. We conducted a meta-analysis of the FRN's response to both reward magnitude and likelihood using a novel method in which published effect sizes were disregarded in favor of direct measurement of the published waveforms themselves, with these waveforms then averaged to produce "great grand averages." Under this standardized measure, the meta-analysis revealed strong effects of magnitude and likelihood on the FRN, consistent with it encoding a reward prediction error. In addition, it revealed strong main effects of reward magnitude and likelihood across much of the waveform, indicating sensitivity to unsigned prediction errors or "salience." The great grand average technique is proposed as a general method for meta-analysis of event-related potential (ERP). PMID:25495239

  13. Resting-state EEG theta activity and risk learning: sensitivity to reward or punishment?

    Science.gov (United States)

    Massar, Stijn A A; Kenemans, J Leon; Schutter, Dennis J L G

    2014-03-01

    Increased theta (4-7 Hz)-beta (13-30 Hz) power ratio in resting state electroencephalography (EEG) has been associated with risky disadvantageous decision making and with impaired reinforcement learning. However, the specific contributions of theta and beta power in risky decision making remain unclear. The first aim of the present study was to replicate the earlier found relationship and examine the specific contributions of theta and beta power in risky decision making using the Iowa Gambling Task. The second aim of the study was to examine whether the relation were associated with differences in reward or punishment sensitivity. We replicated the earlier found relationship by showing a positive association between theta/beta ratio and risky decision making. This correlation was mainly driven by theta oscillations. Furthermore, theta power correlated with reward motivated learning, but not with punishment learning. The present results replicate and extend earlier findings by providing novel insights into the relation between thetabeta ratios and risky decision making. Specifically, findings show that resting-state theta activity is correlated with reinforcement learning, and that this association may be explained by differences in reward sensitivity. PMID:24184042

  14. Resting-state EEG theta activity and risk learning: sensitivity to reward or punishment?

    Science.gov (United States)

    Massar, Stijn A A; Kenemans, J Leon; Schutter, Dennis J L G

    2014-03-01

    Increased theta (4-7 Hz)-beta (13-30 Hz) power ratio in resting state electroencephalography (EEG) has been associated with risky disadvantageous decision making and with impaired reinforcement learning. However, the specific contributions of theta and beta power in risky decision making remain unclear. The first aim of the present study was to replicate the earlier found relationship and examine the specific contributions of theta and beta power in risky decision making using the Iowa Gambling Task. The second aim of the study was to examine whether the relation were associated with differences in reward or punishment sensitivity. We replicated the earlier found relationship by showing a positive association between theta/beta ratio and risky decision making. This correlation was mainly driven by theta oscillations. Furthermore, theta power correlated with reward motivated learning, but not with punishment learning. The present results replicate and extend earlier findings by providing novel insights into the relation between thetabeta ratios and risky decision making. Specifically, findings show that resting-state theta activity is correlated with reinforcement learning, and that this association may be explained by differences in reward sensitivity.

  15. Neural reactivity to monetary rewards and losses in childhood: longitudinal and concurrent associations with observed and self-reported positive emotionality.

    Science.gov (United States)

    Kujawa, Autumn; Proudfit, Greg Hajcak; Kessel, Ellen M; Dyson, Margaret; Olino, Thomas; Klein, Daniel N

    2015-01-01

    Reward reactivity and positive emotion are key components of a theoretical, early-emerging approach motivational system, yet few studies have examined associations between positive emotion and neural reactivity to reward across development. In this multi-method prospective study, we examined the association of laboratory observations of positive emotionality (PE) at age 3 and self-reported positive affect (PA) at age 9 with an event-related potential component sensitive to the relative response to winning vs. losing money, the feedback negativity (ΔFN), at age 9 (N=381). Males had a larger ΔFN than females, and both greater observed PE at age 3 and self-reported PA at age 9 significantly, but modestly, predicted an enhanced ΔFN at age 9. Negative emotionality and behavioral inhibition did not predict ΔFN. Results contribute to understanding the neural correlates of PE and suggest that the FN and PE may be related to the same biobehavioral approach system. PMID:25433097

  16. The neural basis of decision-making and reward processing in adults with euthymic bipolar disorder or attention-deficit/hyperactivity disorder (ADHD.

    Directory of Open Access Journals (Sweden)

    Agustin Ibanez

    Full Text Available BACKGROUND: Attention-deficit/hyperactivity disorder (ADHD and bipolar disorder (BD share DSM-IV criteria in adults and cause problems in decision-making. Nevertheless, no previous report has assessed a decision-making task that includes the examination of the neural correlates of reward and gambling in adults with ADHD and those with BD. METHODOLOGY/PRINCIPAL FINDINGS: We used the Iowa gambling task (IGT, a task of rational decision-making under risk (RDMUR and a rapid-decision gambling task (RDGT which elicits behavioral measures as well as event-related potentials (ERPs: fERN and P3 in connection to the motivational impact of events. We did not observe between-group differences for decision-making under risk or ambiguity (RDMUR and IGT; however, there were significant differences for the ERP-assessed RDGT. Compared to controls, the ADHD group showed a pattern of impaired learning by feedback (fERN and insensitivity to reward magnitude (P3. This ERP pattern (fERN and P3 was associated with impulsivity, hyperactivity, executive function and working memory. Compared to controls, the BD group showed fERN- and P3-enhanced responses to reward magnitude regardless of valence. This ERP pattern (fERN and P3 was associated with mood and inhibitory control. Consistent with the ERP findings, an analysis of source location revealed reduced responses of the cingulate cortex to the valence and magnitude of rewards in patients with ADHD and BD. CONCLUSIONS/SIGNIFICANCE: Our data suggest that neurophysiological (ERPs paradigms such as the RDGT are well suited to assess subclinical decision-making processes in patients with ADHD and BD as well as for linking the cingulate cortex with action monitoring systems.

  17. Peripheral neural activity recording and stimulation system.

    Science.gov (United States)

    Loi, D; Carboni, C; Angius, G; Angotzi, G N; Barbaro, M; Raffo, L; Raspopovic, S; Navarro, X

    2011-08-01

    This paper presents a portable, embedded, microcontroller-based system for bidirectional communication (recording and stimulation) between an electrode, implanted in the peripheral nervous system, and a host computer. The device is able to record and digitize spontaneous and/or evoked neural activities and store them in data files on a PC. In addition, the system has the capability of providing electrical stimulation of peripheral nerves, injecting biphasic current pulses with programmable duration, intensity, and frequency. The recording system provides a highly selective band-pass filter from 800 Hz to 3 kHz, with a gain of 56 dB. The amplification range can be further extended to 96 dB with a variable gain amplifier. The proposed acquisition/stimulation circuitry has been successfully tested through in vivo measurements, implanting a tf-LIFE electrode in the sciatic nerve of a rat. Once implanted, the device showed an input referred noise of 0.83 μVrms, was capable of recording signals below 10 μ V, and generated muscle responses to injected stimuli. The results demonstrate the capability of processing and transmitting neural signals with very low distortion and with a power consumption lower than 1 W. A graphic, user-friendly interface has been developed to facilitate the configuration of the entire system, providing the possibility to activate stimulation and monitor recordings in real time.

  18. Selective Activation of Cholinergic Interneurons Enhances Accumbal Phasic Dopamine Release: Setting the Tone for Reward Processing

    Directory of Open Access Journals (Sweden)

    Roger Cachope

    2012-07-01

    Full Text Available Dopamine plays a critical role in motor control, addiction, and reward-seeking behaviors, and its release dynamics have traditionally been linked to changes in midbrain dopamine neuron activity. Here, we report that selective endogenous cholinergic activation achieved via in vitro optogenetic stimulation of nucleus accumbens, a terminal field of dopaminergic neurons, elicits real-time dopamine release. This mechanism occurs via direct actions on dopamine terminals, does not require changes in neuron firing within the midbrain, and is dependent on glutamatergic receptor activity. More importantly, we demonstrate that in vivo selective activation of cholinergic interneurons is sufficient to elicit dopamine release in the nucleus accumbens. Therefore, the control of accumbal extracellular dopamine levels by endogenous cholinergic activity results from a complex convergence of neurotransmitter/neuromodulator systems that may ultimately synergize to drive motivated behavior.

  19. Dual reward prediction components yield Pavlovian sign- and goal-tracking.

    Science.gov (United States)

    Kaveri, Sivaramakrishnan; Nakahara, Hiroyuki

    2014-01-01

    Reinforcement learning (RL) has become a dominant paradigm for understanding animal behaviors and neural correlates of decision-making, in part because of its ability to explain Pavlovian conditioned behaviors and the role of midbrain dopamine activity as reward prediction error (RPE). However, recent experimental findings indicate that dopamine activity, contrary to the RL hypothesis, may not signal RPE and differs based on the type of Pavlovian response (e.g. sign- and goal-tracking responses). In this study, we address this discrepancy by introducing a new neural correlate for learning reward predictions; the correlate is called "cue-evoked reward". It refers to a recall of reward evoked by the cue that is learned through simple cue-reward associations. We introduce a temporal difference learning model, in which neural correlates of the cue itself and cue-evoked reward underlie learning of reward predictions. The animal's reward prediction supported by these two correlates is divided into sign and goal components respectively. We relate the sign and goal components to approach responses towards the cue (i.e. sign-tracking) and the food-tray (i.e. goal-tracking) respectively. We found a number of correspondences between simulated models and the experimental findings (i.e. behavior and neural responses). First, the development of modeled responses is consistent with those observed in the experimental task. Second, the model's RPEs were similar to dopamine activity in respective response groups. Finally, goal-tracking, but not sign-tracking, responses rapidly emerged when RPE was restored in the simulated models, similar to experiments with recovery from dopamine-antagonist. These results suggest two complementary neural correlates, corresponding to the cue and its evoked reward, form the basis for learning reward predictions in the sign- and goal-tracking rats.

  20. Brain's reward circuits mediate itch relief. a functional MRI study of active scratching.

    Directory of Open Access Journals (Sweden)

    Alexandru D P Papoiu

    Full Text Available Previous brain imaging studies investigating the brain processing of scratching used an exogenous intervention mimicking scratching, performed not by the subjects themselves, but delivered by an investigator. In real life, scratching is a conscious, voluntary, controlled motor response to itching, which is directed to the perceived site of distress. In this study we aimed to visualize in real-time by brain imaging the core mechanisms of the itch-scratch cycle when scratching was performed by subjects themselves. Secondly, we aimed to assess the correlations between brain patterns of activation and psychophysical ratings of itch relief or pleasurability of scratching. We also compared the patterns of brain activity evoked by self-scratching vs. passive scratching. We used a robust tridimensional Arterial Spin Labeling fMRI technique that is less sensitive to motion artifacts: 3D gradient echo and spin echo (GRASE--Propeller. Active scratching was accompanied by a higher pleasurability and induced a more pronounced deactivation of the anterior cingulate cortex and insula, in comparison with passive scratching. A significant involvement of the reward system including the ventral tegmentum of the midbrain, coupled with a mechanism deactivating the periaqueductal gray matter (PAG, suggests that itch modulation operates in reverse to the mechanism known to suppress pain. Our findings not only confirm a role for the central networks processing reward in the pleasurable aspects of scratching, but also suggest they play a role in mediating itch relief.

  1. Social power and approach-related neural activity

    NARCIS (Netherlands)

    M.A.S. Boksem (Maarten); R. Smolders (Ruud); D. de Cremer (David)

    2009-01-01

    textabstractIt has been argued that power activates a general tendency to approach whereas powerlessness activates a tendency to inhibit. The assumption is that elevated power involves reward-rich environments, freedom and, as a consequence, triggers an approach-related motivational orientation and

  2. Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

    Science.gov (United States)

    Baskin-Sommers, Arielle R; Foti, Dan

    2015-11-01

    A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. PMID:25655926

  3. Actively caring to prevent bullying in an elementary school: Prompting and rewarding prosocial behavior.

    Science.gov (United States)

    McCarty, Shane; Teie, Sophia; McCutchen, Jenna; Geller, E Scott

    2016-01-01

    This field study evaluated the impact of an intervention designed to prevent bullying among elementary-school students by prompting and rewarding prosocial behavior. More specifically, teachers of 404 second-, third-, fourth-, fifth-, and sixth-grade students from an elementary school in northeast Virginia asked their students to look out for other students' prosocial behaviors (termed "actively caring") and to submit their stories about actively caring. At the start of every class day, the teachers read three of these stories and recognized one story and the two associated students (i.e., the observer and the performer) by providing each with a wristband engraved with "Actively Caring for People." For six consecutive Fridays, students reported their observations of bullying and completed a single item estimate of self-esteem. Weekly surveys revealed reductions in "being bullied" and "bullying others," as well as an increase in self-esteem. PMID:27309025

  4. Endogenous Opioid-Induced Neuroplasticity of Dopaminergic Neurons in the Ventral Tegmental Area Influences Natural and Opiate Reward

    NARCIS (Netherlands)

    Pitchers, Kyle K.; Coppens, Caroline M.; Beloate, Lauren N.; Fuller, Jonathan; Van, Sandy; Frohmader, Karla S.; Laviolette, Steven R.; Lehman, Michael N.; Coolen, Lique M.

    2014-01-01

    Natural reward and drugs of abuse converge on the mesolimbic pathway and activate common mechanism of neural plasticity in the nucleus accumbens. Chronic exposure to opiates induces plasticity in dopaminergic neurons of the ventral tegmental area (VTA), which regulates morphine reward tolerance. Her

  5. An Activity for Demonstrating the Concept of a Neural Circuit

    Science.gov (United States)

    Kreiner, David S.

    2012-01-01

    College students in two sections of a general psychology course participated in a demonstration of a simple neural circuit. The activity was based on a neural circuit that Jeffress proposed for localizing sounds. Students in one section responded to a questionnaire prior to participating in the activity, while students in the other section…

  6. Cortisol alters reward processing in the human brain.

    Science.gov (United States)

    Kinner, Valerie L; Wolf, Oliver T; Merz, Christian J

    2016-08-01

    Dysfunctional reward processing is known to play a central role for the development of psychiatric disorders. Glucocorticoids that are secreted in response to stress have been shown to attenuate reward sensitivity and thereby might promote the onset of psychopathology. However, the underlying neurobiological mechanisms mediating stress hormone effects on reward processing as well as potential sex differences remain elusive. In this neuroimaging study, we administered 30mg cortisol or a placebo to 30 men and 30 women and subsequently tested them in the Monetary Incentive Delay Task. Cortisol attenuated anticipatory neural responses to a verbal and a monetary reward in the left pallidum and the right anterior parahippocampal gyrus. Furthermore, in men, activation in the amygdala, the precuneus, the anterior cingulate, and in hippocampal regions was reduced under cortisol, whereas in cortisol-treated women a signal increase was observed in these regions. Behavioral performance also indicated that reward learning in men is impaired under high cortisol concentrations, while it is augmented in women. These findings illustrate that the stress hormone cortisol substantially diminishes reward anticipation and provide first evidence that cortisol effects on the neural reward system are sensitive to sex differences, which might translate into different vulnerabilities for psychiatric disorders. PMID:27170428

  7. When a good taste turns bad: Neural mechanisms underlying the emergence of negative affect and associated natural reward devaluation by cocaine

    OpenAIRE

    Carelli, Regina M.; West, Elizabeth A.

    2013-01-01

    An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, ...

  8. Activation of physiological stress responses by a natural reward: Novel vs. repeated sucrose intake.

    Science.gov (United States)

    Egan, Ann E; Ulrich-Lai, Yvonne M

    2015-10-15

    Pharmacological rewards, such as drugs of abuse, evoke physiological stress responses, including increased heart rate and blood pressure, and activation of the hypothalamic-pituitary-adrenal (HPA) axis. It is not clear to what extent the natural reward of palatable foods elicits similar physiological responses. In order to address this question, HPA axis hormones, heart rate, blood pressure and brain pCREB immunolabeling were assessed following novel and repeated sucrose exposure. Briefly, adult, male rats with ad libitum food and water were given either a single (day 1) or repeated (twice-daily for 14 days) brief (up to 30 min) exposure to a second drink bottle containing 4 ml of 30% sucrose drink vs. water (as a control for bottle presentation). Sucrose-fed rats drank more than water-fed on all days of exposure, as expected. On day 1 of exposure, heart rate, blood pressure, plasma corticosterone, and locomotion were markedly increased by presentation of the second drink bottle regardless of drink type. After repeated exposure (day 14), these responses habituated to similar extents regardless of drink type and pCREB immunolabeling in the hypothalamic paraventricular nucleus (PVN) also did not vary with drink type, whereas basolateral amygdala pCREB was increased by sucrose intake. Taken together, these data suggest that while sucrose is highly palatable, physiological stress responses were evoked principally by the drink presentation itself (e.g., an unfamiliar intervention by the investigators), as opposed to the palatability of the offered drink.

  9. Reward association facilitates distractor suppression in human visual search.

    Science.gov (United States)

    Gong, Mengyuan; Yang, Feitong; Li, Sheng

    2016-04-01

    Although valuable objects are attractive in nature, people often encounter situations where they would prefer to avoid such distraction while focusing on the task goal. Contrary to the typical effect of attentional capture by a reward-associated item, we provide evidence for a facilitation effect derived from the active suppression of a high reward-associated stimulus when cuing its identity as distractor before the display of search arrays. Selection of the target is shown to be significantly faster when the distractors were in high reward-associated colour than those in low reward-associated or non-rewarded colours. This behavioural reward effect was associated with two neural signatures before the onset of the search display: the increased frontal theta oscillation and the strengthened top-down modulation from frontal to anterior temporal regions. The former suggests an enhanced working memory representation for the reward-associated stimulus and the increased need for cognitive control to override Pavlovian bias, whereas the latter indicates that the boost of inhibitory control is realized through a frontal top-down mechanism. These results suggest a mechanism in which the enhanced working memory representation of a reward-associated feature is integrated with task demands to modify attentional priority during active distractor suppression and benefit behavioural performance. PMID:26797805

  10. Relationship between oscillatory neuronal activity during reward processing and trait impulsivity and sensation seeking.

    Directory of Open Access Journals (Sweden)

    Gregor Leicht

    Full Text Available BACKGROUND: The processing of reward and punishment stimuli in humans appears to involve brain oscillatory activity of several frequencies, probably each with a distinct function. The exact nature of associations of these electrophysiological measures with impulsive or risk-seeking personality traits is not completely clear. Thus, the aim of the present study was to investigate event-related oscillatory activity during reward processing across a wide spectrum of frequencies, and its associations with impulsivity and sensation seeking in healthy subjects. METHODS: During recording of a 32-channel EEG 22 healthy volunteers were characterized with the Barratt Impulsiveness and the Sensation Seeking Scale and performed a computerized two-choice gambling task comprising different feedback options with positive vs. negative valence (gain or loss and high or low magnitude (5 vs. 25 points. RESULTS: We observed greater increases of amplitudes of the feedback-related negativity and of activity in the theta, alpha and low-beta frequency range following loss feedback and, in contrast, greater increase of activity in the high-beta frequency range following gain feedback. Significant magnitude effects were observed for theta and delta oscillations, indicating greater amplitudes upon feedback concerning large stakes. The theta amplitude changes during loss were negatively correlated with motor impulsivity scores, whereas alpha and low-beta increase upon loss and high-beta increase upon gain were positively correlated with various dimensions of sensation seeking. CONCLUSIONS: The findings suggest that the processing of feedback information involves several distinct processes, which are subserved by oscillations of different frequencies and are associated with different personality traits.

  11. A new window to understanding individual differences in reward sensitivity from attentional networks.

    Science.gov (United States)

    Costumero, V; Barrós-Loscertales, A; Bustamante, J C; Fuentes, P; Rosell-Negre, P; Ventura-Campos, N; Ávila, C

    2015-01-01

    Existing evidence suggests that the presence of reward cues modifies the activity in attentional networks, however, the nature of these influences remains poorly understood. Here, we performed independent component analysis (ICA) in two fMRI datasets corresponding to two incentive delay tasks, which compared the response to reward (money and erotic pictures) and neutral cues, and yielded activations in the ventral striatum using a general linear model approach. Across both experiments, ICA revealed that both the right frontoparietal network and default mode network time courses were positively and negatively modulated by reward cues, respectively. Moreover, this dual neural response pattern was enhanced in individuals with strong reward sensitivity. Therefore, ICA may be a complementary tool to investigate the relevant role of attentional networks on reward processing, and to investigate reward sensitivity in normal and pathological populations. PMID:24696182

  12. Reward-related dorsal striatal activity differences between former and current cocaine dependent individuals during an interactive competitive game.

    Directory of Open Access Journals (Sweden)

    Christopher J Hyatt

    Full Text Available Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI in current (CCD; n = 30 and former (FCD; n = 28 cocaine dependent subjects as well as healthy control (HC; n = 31 subjects while playing an interactive competitive Domino game involving risk-taking and reward/punishment processing. Out-of-scanner impulsivity-related measures were also collected. Although both FCD and CCD subjects scored significantly higher on impulsivity-related measures than did HC subjects, only FCD subjects had differences in striatal activation, specifically showing hypoactivation during their response to gains versus losses in right dorsal caudate, a brain region linked to habituation, cocaine craving and addiction maintenance. Right caudate activity in FCD subjects also correlated negatively with impulsivity-related measures of self-reported compulsivity and sensitivity to reward. These findings suggest that remitted cocaine dependence is associated with striatal dysfunction during social reward processing in a manner linked to compulsivity and reward sensitivity measures. Future research should investigate the extent to which such differences might reflect underlying vulnerabilities linked to cocaine-using propensities (e.g., relapses.

  13. Dopaminergic reward sensitivity can promote adolescent health: A new perspective on the mechanism of ventral striatum activation

    Directory of Open Access Journals (Sweden)

    Eva H. Telzer

    2016-02-01

    Full Text Available The prevailing view in the field of adolescent brain development is that heightened activity in the mesolimbic dopaminergic reward system serves as a liability, orienting adolescents toward risky behaviors, increasing their sensitivity to social evaluation and loss, and resulting in compromised well-being. Several findings inconsistent with this deficit view challenge the perspective that adolescent reward sensitivity largely serves as a liability and highlights the potential adaptive function that heightened striatal reactivity can serve. The goal of this review is to refine our understanding of dopaminergic reward sensitivity in adolescence. I review several studies showing that ventral striatum activation serves an adaptive function for adolescents’ health and well being relating to declines in both risk taking and depression and increases in cognitive persistence and achievement.

  14. Anticipation of monetary and social reward differently activates mesolimbic brain structures in men and women

    OpenAIRE

    Spreckelmeyer, Katja N.; Krach, Sören; Kohls, Gregor; Rademacher, Lena; Irmak, Arda; Konrad, Kerstin; Kircher, Tilo; Gründer, Gerhard

    2009-01-01

    Motivation for goal-directed behaviour largely depends on the expected value of the anticipated reward. The aim of the present study was to examine how different levels of reward value are coded in the brain for two common forms of human reward: money and social approval. To account for gender differences 16 male and 16 female participants performed an incentive delay task expecting to win either money or positive social feedback. fMRI recording during the anticipation phase revealed proporti...

  15. Motor Planning under Unpredictable Reward: Modulations of Movement Vigor and Primate Striatum Activity

    Directory of Open Access Journals (Sweden)

    Ioan eOpris

    2011-05-01

    Full Text Available Although reward probability is an important factor that shapes animal behavior, it is not well understood however, how the primate brain translates reward expectation into the vigor of movement (reaction time and speed. To address this question, we trained two monkeys in a reaction time task that required wrist movements in response to vibrotactile and visual stimuli, with a variable reward schedule. Correct performance was rewarded in 75 % of the trials. Monkeys were certain that they would be rewarded only in the trials immediately following withheld rewards. In these trials, the animals responded sooner and moved faster. Single-unit recordings from the dorsal striatum revealed that modulations in striatal neurons reflected such modulations of movement vigor. First, in the trials with certain rewards, striatal neurons modulated their firing rates earlier. Second, magnitudes of changes in neuronal firing rates depended on whether or not monkeys were certain about the reward. Third, these modulations depended on the sensory modality of the cue (visual vs. vibratory and/or movement direction (flexions vs. extensions. We conclude that dorsal striatum may be a part of the mechanism responsible for the modulation of movement vigor in response to changes of reward predictability.

  16. What are the odds? The neural correlates of active choice during gambling

    Directory of Open Access Journals (Sweden)

    Bettina eStuder

    2012-04-01

    Full Text Available Gambling is a widespread recreational activity and requires pitting the values of potential wins and losses against their probability of occurrence. Neuropsychological research showed that betting behavior on laboratory gambling tasks is highly sensitive to focal lesions to the ventromedial prefrontal cortex (vmPFC and insula. In the current study, we assessed the neural basis of betting choices in healthy participants, using functional magnetic resonance imaging of the Roulette Betting Task. In half of the trials participants actively chose their bets; in the other half the computer dictated the bet size. Our results highlight the impact of volitional choice upon the neural substrates of gambling: Neural activity in a distributed network - including key structures of the reward circuitry (midbrain, striatum - was higher during active compared to computer-dictated bet selection. In line with neuropsychological data, the anterior insula and vmPFC were more activated during self-directed bet selection, and responses in these areas were differentially modulated by the odds of winning in the two choice conditions. In addition, responses in the vmPFC and ventral striatum were modulated by the bet size. Convergent with electrophysiological research in macaques, our results further implicate the inferior parietal cortex (IPC in the processing of the likelihood of potential outcomes: Neural responses in the IPC bilaterally reflected the probability of winning during bet selection. Moreover, the IPC was particularly sensitive to the odds of winning in the active choice condition, where this information was used to guide bet selection. Our results indicate a neglected role of the IPC in human decision-making under risk and help to integrate neuropsychological data of risk-taking following vmPFC and insula damage with models of choice derived from human neuroimaging and monkey electrophysiology.

  17. Activity patterns of cultured neural networks on micro electrode arrays

    NARCIS (Netherlands)

    Rutten, W.L.C.; Pelt, van J.

    2001-01-01

    A hybrid neuro-electronic interface is a cell-cultured micro electrode array, acting as a neural information transducer for stimulation and/or recording of neural activity in the brain or the spinal cord (ventral motor region or dorsal sensory region). It consists of an array of micro electrodes on

  18. Relative Timing Between Kappa Opioid Receptor Activation and Cocaine Determines the Impact on Reward and Dopamine Release.

    Science.gov (United States)

    Chartoff, Elena H; Ebner, Shayla R; Sparrow, Angela; Potter, David; Baker, Phillip M; Ragozzino, Michael E; Roitman, Mitchell F

    2016-03-01

    Negative affective states can increase the rewarding value of drugs of abuse and promote drug taking. Chronic cocaine exposure increases levels of the neuropeptide dynorphin, an endogenous ligand at kappa opioid receptors (KOR) that suppresses dopamine release in the nucleus accumbens (NAc) and elicits negative affective states upon drug withdrawal. However, there is evidence that the effects of KOR activation on affective state are biphasic: immediate aversive effects are followed by delayed increases in reward. The impact of KOR-induced affective states on reward-related effects of cocaine over time is not known. We hypothesize that the initial aversive effects of KOR activation increase, whereas the delayed rewarding effects decrease, the net effects of cocaine on reward and dopamine release. We treated rats with cocaine at various times (15 min to 48 h) after administration of the selective KOR agonist salvinorin A (salvA). Using intracranial self-stimulation and fast scan cyclic voltammetry, we found that cocaine-induced increases in brain stimulation reward and evoked dopamine release in the NAc core were potentiated when cocaine was administered within 1 h of salvA, but attenuated when administered 24 h after salvA. Quantitative real-time PCR was used to show that KOR and prodynorphin mRNA levels were decreased in the NAc, whereas tyrosine hydroxylase and dopamine transporter mRNA levels and tissue dopamine content were increased in the ventral tegmental area 24 h post-salvA. These findings raise the possibility that KOR activation-as occurs upon withdrawal from chronic cocaine-modulates vulnerability to cocaine in a time-dependent manner. PMID:26239494

  19. Neural regions that underlie reinforcement learning are also active for social expectancy violations.

    Science.gov (United States)

    Harris, Lasana T; Fiske, Susan T

    2010-01-01

    Prediction error, the difference between an expected and an actual outcome, serves as a learning signal that interacts with reward and punishment value to direct future behavior during reinforcement learning. We hypothesized that similar learning and valuation signals may underlie social expectancy violations. Here, we explore the neural correlates of social expectancy violation signals along the universal person-perception dimensions trait warmth and competence. In this context, social learning may result from expectancy violations that occur when a target is inconsistent with an a priori schema. Expectancy violation may activate neural regions normally implicated in prediction error and valuation during appetitive and aversive conditioning. Using fMRI, we first gave perceivers high warmth or competence behavioral information that led to dispositional or situational attributions for the behavior. Participants then saw pictures of people responsible for the behavior; they represented social groups either inconsistent (rated low on either warmth or competence) or consistent (rated high on either warmth or competence) with the behavior information. Warmth and competence expectancy violations activate striatal regions that represent evaluative and prediction error signals. Social cognition regions underlie consistent expectations. These findings suggest that regions underlying reinforcement learning may work in concert with social cognition regions in warmth and competence social expectancy. This study illustrates the neural overlap between neuroeconomics and social neuroscience.

  20. Fat/carbohydrate ratio but not energy density determines snack food intake and activates brain reward areas.

    Science.gov (United States)

    Hoch, Tobias; Kreitz, Silke; Gaffling, Simone; Pischetsrieder, Monika; Hess, Andreas

    2015-05-14

    The snack food potato chips induces food intake in ad libitum fed rats, which is associated with modulation of the brain reward system and other circuits. Here, we show that food intake in satiated rats is triggered by an optimal fat/carbohydrate ratio. Like potato chips, an isocaloric fat/carbohydrate mixture influenced whole brain activity pattern of rats, affecting circuits related e.g. to reward/addiction, but the number of modulated areas and the extent of modulation was lower compared to the snack food itself.

  1. Fat/carbohydrate ratio but not energy density determines snack food intake and activates brain reward areas

    OpenAIRE

    Hoch, Tobias; Kreitz, Silke; Gaffling, Simone; Pischetsrieder, Monika; Hess, Andreas

    2015-01-01

    The snack food potato chips induces food intake in ad libitum fed rats, which is associated with modulation of the brain reward system and other circuits. Here, we show that food intake in satiated rats is triggered by an optimal fat/carbohydrate ratio. Like potato chips, an isocaloric fat/carbohydrate mixture influenced whole brain activity pattern of rats, affecting circuits related e.g. to reward/addiction, but the number of modulated areas and the extent of modulation was lower compared t...

  2. Embedding responses in spontaneous neural activity shaped through sequential learning.

    Directory of Open Access Journals (Sweden)

    Tomoki Kurikawa

    Full Text Available Recent experimental measurements have demonstrated that spontaneous neural activity in the absence of explicit external stimuli has remarkable spatiotemporal structure. This spontaneous activity has also been shown to play a key role in the response to external stimuli. To better understand this role, we proposed a viewpoint, "memories-as-bifurcations," that differs from the traditional "memories-as-attractors" viewpoint. Memory recall from the memories-as-bifurcations viewpoint occurs when the spontaneous neural activity is changed to an appropriate output activity upon application of an input, known as a bifurcation in dynamical systems theory, wherein the input modifies the flow structure of the neural dynamics. Learning, then, is a process that helps create neural dynamical systems such that a target output pattern is generated as an attractor upon a given input. Based on this novel viewpoint, we introduce in this paper an associative memory model with a sequential learning process. Using a simple hebbian-type learning, the model is able to memorize a large number of input/output mappings. The neural dynamics shaped through the learning exhibit different bifurcations to make the requested targets stable upon an increase in the input, and the neural activity in the absence of input shows chaotic dynamics with occasional approaches to the memorized target patterns. These results suggest that these dynamics facilitate the bifurcations to each target attractor upon application of the corresponding input, which thus increases the capacity for learning. This theoretical finding about the behavior of the spontaneous neural activity is consistent with recent experimental observations in which the neural activity without stimuli wanders among patterns evoked by previously applied signals. In addition, the neural networks shaped by learning properly reflect the correlations of input and target-output patterns in a similar manner to those designed in

  3. Nucleus accumbens response to rewards and testosterone levels are related to alcohol use in adolescents and young adults

    Directory of Open Access Journals (Sweden)

    Barbara R. Braams

    2016-02-01

    Full Text Available During adolescence there is a normative increase in risk-taking behavior, which is reflected in, for example, increases in alcohol consumption. Prior research has demonstrated a link between testosterone and alcohol consumption, and between testosterone and neural responses to rewards. Yet, no study to date tested how testosterone levels and neural responses to rewards relate to and predict individual differences in alcohol use. The current study aimed to investigate this by assessing alcohol use, testosterone levels and neural responses to rewards in adolescents (12–17 years old and young adults (18–26 years old. Participants were measured twice with a two-year interval between testing sessions. Cross-sectional analysis showed that at the second time point higher neural activity to rewards, but not testosterone levels, explained significant variance above age in reported alcohol use. Predictive analyses showed that, higher testosterone level at the first time point, but not neural activity to rewards at the first time point, was predictive of more alcohol use at the second time point. These results suggest that neural responses to rewards are correlated with current alcohol consumption, and that testosterone level is predictive of future alcohol consumption. These results are interpreted in the context of trajectory models of adolescent development.

  4. Nucleus accumbens response to rewards and testosterone levels are related to alcohol use in adolescents and young adults.

    Science.gov (United States)

    Braams, Barbara R; Peper, Jiska S; van der Heide, Dianne; Peters, Sabine; Crone, Eveline A

    2016-02-01

    During adolescence there is a normative increase in risk-taking behavior, which is reflected in, for example, increases in alcohol consumption. Prior research has demonstrated a link between testosterone and alcohol consumption, and between testosterone and neural responses to rewards. Yet, no study to date tested how testosterone levels and neural responses to rewards relate to and predict individual differences in alcohol use. The current study aimed to investigate this by assessing alcohol use, testosterone levels and neural responses to rewards in adolescents (12-17 years old) and young adults (18-26 years old). Participants were measured twice with a two-year interval between testing sessions. Cross-sectional analysis showed that at the second time point higher neural activity to rewards, but not testosterone levels, explained significant variance above age in reported alcohol use. Predictive analyses showed that, higher testosterone level at the first time point, but not neural activity to rewards at the first time point, was predictive of more alcohol use at the second time point. These results suggest that neural responses to rewards are correlated with current alcohol consumption, and that testosterone level is predictive of future alcohol consumption. These results are interpreted in the context of trajectory models of adolescent development.

  5. Midbrain volume predicts fMRI and ERP measures of reward reactivity.

    Science.gov (United States)

    Carlson, Joshua M; Foti, Dan; Harmon-Jones, Eddie; Proudfit, Greg H

    2015-01-01

    Ventral striatal activation measured with functional magnetic resonance imaging (fMRI) and feedback negativity amplitude measured with event-related potentials (ERPs) are each enhanced during reward processing. Recent research has found that these two neural measures of reward processing are also related to one another, such that increases in ventral striatal activity are accompanied by increases in the amplitude of the feedback negativity. Although there is a long history of research implicating the midbrain dopamine system in reward processing, there has been little research into the possibility that structural variability in the midbrain may be linked to functional variability in reward reactivity. Here, we used structural MRI to measure midbrain volumes in addition to fMRI and ERP measures of functional neural reactivity to rewards in a simple gambling task. The results suggest that as midbrain volumes increase, fMRI reward reactivity in the ventral striatum and medial prefrontal cortex also increases. A similar relationship exists between midbrain structure and the amplitude of the feedback negativity; further, this relationship is mediated specifically by activity in the ventral striatum. These data demonstrate convergence between neuroanatomical, hemodynamic, and electrophysiological measures. Thus, structural variability in the midbrain relates to variability in fMRI and ERP measures of functional reward reactivity, which may play a critical role in reward-related psychopathologies and the treatment of these disorders.

  6. Withholding a Reward-driven Action: Studies of the Rise and Fall of Motor Activation and the Effect of Cognitive Depletion.

    Science.gov (United States)

    Freeman, Scott M; Aron, Adam R

    2016-02-01

    Controlling an inappropriate response tendency in the face of a reward-predicting stimulus likely depends on the strength of the reward-driven activation, the strength of a putative top-down control process, and their relative timing. We developed a rewarded go/no-go paradigm to investigate such dynamics. Participants made rapid responses (on go trials) to high versus low reward-predicting stimuli and sometimes had to withhold responding (on no-go trials) in the face of the same stimuli. Behaviorally, for high versus low reward stimuli, responses were faster on go trials, and there were more errors of commission on no-go trials. We used single-pulse TMS to map out the corticospinal excitability dynamics, especially on no-go trials where control is needed. For successful no-go trials, there was an early rise in motor activation that was then sharply reduced beneath baseline. This activation-reduction pattern was more pronounced for high- versus low-reward trials and in individuals with greater motivational drive for reward. A follow-on experiment showed that, when participants were fatigued by an effortful task, they made more errors on no-go trials for high versus low reward stimuli. Together, these studies show that, when a response is inappropriate, reward-predicting stimuli induce early motor activation, followed by a top-down effortful control process (which we interpret as response suppression) that depends on the strength of the preceding activation. Our findings provide novel information about the activation-suppression dynamics during control over reward-driven actions, and they illustrate how fatigue or depletion leads to control failures in the face of reward.

  7. Phencyclidine affects firing activity of ventral tegmental area neurons that are related to reward and social behaviors in rats.

    Science.gov (United States)

    Katayama, T; Okamoto, M; Suzuki, Y; Hoshino, K-Y; Jodo, E

    2013-06-14

    Patients with schizophrenia exhibit deficits in motivation and affect, which suggests an impairment in the reward system. The psychotomimetic drug, phencyclidine (PCP), also induces schizophrenia-like negative symptoms, such as reduced motivation, blunted affect, and social withdrawal in both humans and animals. Previous studies have indicated that the dopaminergic neurons in the ventral tegmental area (VTA) play a pivotal role in the development of reward-associated learning and motivation. However, how PCP affects the activity of VTA neurons during performance of a reward-related task and social interaction with others in unanesthetized animals remains unclear. Here, we recorded the unit activity of VTA neurons in freely moving rats before and after systemic administration of PCP in a classical conditioning paradigm, and during social interaction with an unfamiliar partner. In the classical conditioning task, two different tones were sequentially presented, one of which accompanied electrical stimulation of the medial forebrain bundle as an unconditioned stimulus. After identifying the response properties of recorded neurons in the classical conditioning task and social interaction, animals received an intraperitoneal injection of PCP. Our study demonstrated that most VTA neurons responsive to reward-associated stimuli were also activated during social interaction. Such activation of neurons was considerably suppressed by systemic administration of PCP, thus, PCP may affect the firing activity of VTA neurons that are involved in motivation, learning, and social interaction. Disruption of the response of VTA neurons to reward stimuli and socially interactive situations may be involved in PCP-induced impairments similar to the negative symptoms of schizophrenia.

  8. Disturbed anterior prefrontal control of the mesolimbic reward system and increased impulsivity in bipolar disorder.

    Science.gov (United States)

    Trost, Sarah; Diekhof, Esther Kristina; Zvonik, Kerstin; Lewandowski, Mirjana; Usher, Juliana; Keil, Maria; Zilles, David; Falkai, Peter; Dechent, Peter; Gruber, Oliver

    2014-07-01

    Bipolar disorder (BD) is characterized by recurrent mood episodes ranging from severe depression to acute full-blown mania. Both states of this severe psychiatric disorder have been associated with alterations of reward processing in the brain. Here, we present results of a functional magnetic resonance imaging (fMRI) study on the neural correlates and functional interactions underlying reward gain processing and reward dismissal in favor of a long-term goal in bipolar patients. Sixteen medicated patients diagnosed with bipolar I disorder, euthymic to mildly depressed, and sixteen matched healthy controls performed the 'desire-reason dilemma' (DRD) paradigm demanding rejection of priorly conditioned reward stimuli to successfully pursue a superordinate goal. Both groups exhibited significant activations in reward-related brain regions, particularly in the mesolimbic reward system. However, bipolar patients showed reduced neural responses of the ventral striatum (vStr) when exploiting a reward stimulus, and exhibited a decreased suppression of the reward-related activation of the mesolimbic reward system while having to reject immediate reward in favor of the long-term goal. Further, functional interaction between the anteroventral prefrontal cortex and the vStr in the 'DRD' was significantly impaired in the bipolar group. These findings provide evidence for a reduced responsivity of the vStr to reward stimuli in BD, possibly related to clinical features like anhedonia. The disturbed top-down control of mesolimbic reward signals by prefrontal brain regions in BD can be interpreted in terms of a disease-related enhanced impulsivity, a trait marker of BD. PMID:24535101

  9. Neural progenitor cells regulate microglia functions and activity.

    Science.gov (United States)

    Mosher, Kira I; Andres, Robert H; Fukuhara, Takeshi; Bieri, Gregor; Hasegawa-Moriyama, Maiko; He, Yingbo; Guzman, Raphael; Wyss-Coray, Tony

    2012-11-01

    We found mouse neural progenitor cells (NPCs) to have a secretory protein profile distinct from other brain cells and to modulate microglial activation, proliferation and phagocytosis. NPC-derived vascular endothelial growth factor was necessary and sufficient to exert at least some of these effects in mice. Thus, neural precursor cells may not only be shaped by microglia, but also regulate microglia functions and activity.

  10. Technologies for imaging neural activity in large volumes.

    Science.gov (United States)

    Ji, Na; Freeman, Jeremy; Smith, Spencer L

    2016-08-26

    Neural circuitry has evolved to form distributed networks that act dynamically across large volumes. Conventional microscopy collects data from individual planes and cannot sample circuitry across large volumes at the temporal resolution relevant to neural circuit function and behaviors. Here we review emerging technologies for rapid volume imaging of neural circuitry. We focus on two critical challenges: the inertia of optical systems, which limits image speed, and aberrations, which restrict the image volume. Optical sampling time must be long enough to ensure high-fidelity measurements, but optimized sampling strategies and point-spread function engineering can facilitate rapid volume imaging of neural activity within this constraint. We also discuss new computational strategies for processing and analyzing volume imaging data of increasing size and complexity. Together, optical and computational advances are providing a broader view of neural circuit dynamics and helping elucidate how brain regions work in concert to support behavior. PMID:27571194

  11. Neural Activity Reveals Preferences Without Choices

    Science.gov (United States)

    Smith, Alec; Bernheim, B. Douglas; Camerer, Colin

    2014-01-01

    We investigate the feasibility of inferring the choices people would make (if given the opportunity) based on their neural responses to the pertinent prospects when they are not engaged in actual decision making. The ability to make such inferences is of potential value when choice data are unavailable, or limited in ways that render standard methods of estimating choice mappings problematic. We formulate prediction models relating choices to “non-choice” neural responses and use them to predict out-of-sample choices for new items and for new groups of individuals. The predictions are sufficiently accurate to establish the feasibility of our approach. PMID:25729468

  12. Reward-Guided Learning with and without Causal Attribution.

    Science.gov (United States)

    Jocham, Gerhard; Brodersen, Kay H; Constantinescu, Alexandra O; Kahn, Martin C; Ianni, Angela M; Walton, Mark E; Rushworth, Matthew F S; Behrens, Timothy E J

    2016-04-01

    When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. PMID:26971947

  13. Reward-Guided Learning with and without Causal Attribution.

    Science.gov (United States)

    Jocham, Gerhard; Brodersen, Kay H; Constantinescu, Alexandra O; Kahn, Martin C; Ianni, Angela M; Walton, Mark E; Rushworth, Matthew F S; Behrens, Timothy E J

    2016-04-01

    When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task.

  14. Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

    Directory of Open Access Journals (Sweden)

    Alexander Niklas Häusler

    Full Text Available Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP, reward reception (RR and reward prediction errors (RPE showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.

  15. Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

    Science.gov (United States)

    Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

    2015-01-01

    Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes. PMID:25875594

  16. Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

    Science.gov (United States)

    Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

    2016-10-01

    Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. PMID:26854903

  17. Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

    Science.gov (United States)

    Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

    2016-10-01

    Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment.

  18. Cue-elicited reward-seeking requires extracellular signal-regulated kinase activation in the nucleus accumbens.

    Science.gov (United States)

    Shiflett, Michael W; Martini, Ross P; Mauna, Jocelyn C; Foster, Rebecca L; Peet, Eloise; Thiels, Edda

    2008-02-01

    The motivation to seek out rewards can come under the control of stimuli associated with reward delivery. The ability of cues to motivate reward-seeking behavior depends on the nucleus accumbens (NAcc). The molecular mechanisms in the NAcc that underlie the ability of a cue to motivate reward-seeking are not well understood. We examined whether extracellular signal-regulated kinase (ERK), an important intracellular signaling pathway in learning and memory, has a role in these motivational processes. We first examined p42 ERK (ERK2) activation in the NAcc after rats were trained to associate an auditory stimulus with food delivery and found that, as a consequence of training, presentation of the auditory cue itself was sufficient to increase ERK2 activation in the NAcc. To examine whether inhibition of ERK in the NAcc prevents cue-induced reward-seeking, we infused an inhibitor of ERK, U0126, into the NAcc before assessing rats' instrumental responding in the presence versus absence of the conditioned cue. We found that, whereas vehicle-infused rats showed increased instrumental responding during cue presentation, rats infused with U0126 showed a profound impairment in cue-induced instrumental responding. In contrast, intra-NAcc U0126 infusion had no effect on rats' food-reinforced instrumental responding or their ability to execute conditioned approach behavior. Our results demonstrate learning-related changes in ERK signaling in the NAcc, and that disruption of ERK activation in this structure interferes with the incentive-motivational effects of conditioned stimuli. The molecular mechanisms described here may have implications for cue-elicited drug craving after repeated exposure to drugs of abuse.

  19. Regional brain activation supporting cognitive control in the context of reward is associated with treated adolescents’ marijuana problem severity at follow-up: A preliminary study

    Directory of Open Access Journals (Sweden)

    Tammy Chung

    2015-12-01

    Full Text Available This preliminary study examined the extent to which regional brain activation during a reward cue antisaccade (AS task was associated with 6-month treatment outcome in adolescent substance users. Antisaccade performance provides a sensitive measure of executive function and cognitive control, and generally improves with reward cues. We hypothesized that when preparing to execute an AS, greater activation in regions associated with cognitive and oculomotor control supporting AS, particularly during reward cue trials, would be associated with lower substance use severity at 6-month follow-up. Adolescents (n = 14, ages 14–18 recruited from community-based outpatient treatment completed an fMRI reward cue AS task (reward and neutral conditions, and provided follow-up data. Results indicated that AS errors decreased in reward, compared to neutral, trials. AS behavioral performance, however, was not associated with treatment outcome. As hypothesized, activation in regions of interest (ROIs associated with cognitive (e.g., ventrolateral prefrontal cortex and oculomotor control (e.g., supplementary eye field during reward trials were inversely correlated with marijuana problem severity at 6-months. ROI activation during neutral trials was not associated with outcomes. Results support the role of motivational (reward cue factors to enhance cognitive control processes, and suggest a potential brain-based correlate of youth treatment outcome.

  20. Reward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing

    OpenAIRE

    Victor Costumero; Alfonso Barrós-Loscertales; Juan Carlos Bustamante; Noelia Ventura-Campos; Paola Fuentes; Patricia Rosell-Negre; César Ávila

    2013-01-01

    The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men compl...

  1. Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus

    OpenAIRE

    NAKAMURA, KAE; Matsumoto, Masayuki; Hikosaka, Okihide

    2008-01-01

    The dopamine system has been thought to play a central role in guiding behavior based on rewards. Recent pharmacological studies suggest that another monoamine neurotransmitter, serotonin, is also involved in reward processing. To elucidate the functional relationship between serotonin neurons and dopamine neurons, we performed single unit recording in the dorsal raphe nucleus (DRN), a major source of serotonin, and the substantia nigra pars compacta, a major source of dopamine, while monkeys...

  2. Active reward processing during human sleep: insights from sleep-related eating disorder

    OpenAIRE

    Lampros ePerogamvros; Roland eHasler; Patrick eBaud; Claude Robert Cloninger; Sophie eSchwartz; Stephen ePerrig

    2012-01-01

    In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED), a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity on reward-related questionnaires. In light of new evidence on the mesolimbic dopaminergic implication in co...

  3. Active Engine Mounting Control Algorithm Using Neural Network

    Directory of Open Access Journals (Sweden)

    Fadly Jashi Darsivan

    2009-01-01

    Full Text Available This paper proposes the application of neural network as a controller to isolate engine vibration in an active engine mounting system. It has been shown that the NARMA-L2 neurocontroller has the ability to reject disturbances from a plant. The disturbance is assumed to be both impulse and sinusoidal disturbances that are induced by the engine. The performance of the neural network controller is compared with conventional PD and PID controllers tuned using Ziegler-Nichols. From the result simulated the neural network controller has shown better ability to isolate the engine vibration than the conventional controllers.

  4. Function of the centromedial amygdala in reward devaluation and open-field activity.

    Science.gov (United States)

    Kawasaki, K; Glueck, A C; Annicchiarico, I; Papini, M R

    2015-09-10

    The present research aimed at determining the role played by the amygdala in reward devaluation using transient inactivation induced by lidocaine microinfusions into the centromedial region. Two situations involving reward devaluation were tested in rats: consummatory successive negative contrast (cSNC) and anticipatory negative contrast (ANC). In cSNC, rats exposed to a downshift from 32% to 4% sucrose consume less 4% sucrose than rats always exposed to 4% sucrose. Extensive evidence suggests that reward devaluation in the cSNC situation is accompanied by negative emotion. In ANC, rats consume less 4% sucrose when each session is closely followed by access to 32% sucrose rather than by 4% sucrose. Evidence suggests that reward devaluation in the ANC situation does not involve negative emotions; rather, ANC appears to involve Pavlovian anticipation of the higher value solution. To test the effects of lidocaine microinfusions in a situation known to induce negative emotion, but unrelated to reward devaluation, animals were also exposed to a lighted open field. Centromedial amygdala inactivation reduced the cSNC effect and increased exploratory behavior in the open field, both effects consistent with a reduction in negative emotional state. However, no detectable effects of amygdala inactivation were observed in the ANC situation. These results suggest that, first, the function of the amygdala is not unique to reward devaluation and, second, it is concerned with tagging the devaluation experience with aversive valence. PMID:26141844

  5. Just watching the game ain’t enough: Striatal fMRI reward responses to successes and failures in a video game during active and vicarious playing

    Directory of Open Access Journals (Sweden)

    Jari eKätsyri

    2013-06-01

    Full Text Available Although the multimodal stimulation provided by modern audiovisual video games is pleasing by itself, the rewarding nature of video game playing depends critically also on the players’ active engagement in the gameplay. The extent to which active engagement influences dopaminergic brain reward circuit responses remains unsettled. Here we show that striatal reward circuit responses elicited by successes (wins and failures (losses in a video game are stronger during active than vicarious gameplay. Eleven healthy males both played a competitive first-person tank shooter game (active playing and watched a pre-recorded gameplay video (vicarious playing while their hemodynamic brain activation was measured with 3-tesla functional magnetic resonance imaging (fMRI. Wins and losses were paired with symmetrical monetary rewards and punishments during active and vicarious playing so that the external reward context remained identical during both conditions. Brain activation was stronger in the orbitomedial prefrontal cortex (omPFC during winning than losing, both during active and vicarious playing conditions. In contrast, both wins and losses suppressed activations in the midbrain and striatum during active playing; however, the striatal suppression, particularly in the anterior putamen, was more pronounced during loss than win events. Sensorimotor confounds related to joystick movements did not account for the results. Self-ratings indicated losing to be more unpleasant during active than vicarious playing. Our findings demonstrate striatum to be selectively sensitive to self-acquired rewards, in contrast to frontal components of the reward circuit that process both self-acquired and passively received rewards. We propose that the striatal responses to repeated acquisition of rewards that are contingent on game related successes contribute to the motivational pull of video-game playing.

  6. Insula and striatum activity in effort-related monetary reward processing in gambling disorder: The role of depressive symptomatology

    Directory of Open Access Journals (Sweden)

    Mira Fauth-Bühler

    2014-01-01

    Full Text Available The neurobiological underpinnings of effort-related monetary reward processing of gambling disorder have not been previously studied. To date neuroimaging studies lack in large sample sizes and as a consequence less attention has been given to brain reward processing that could potentially be attributed to comorbid conditions such as depressive mood state. We assessed monetary reward processing using an effort-dependent task during 3 tesla functional magnetic resonance imaging. We investigated a large sample of male, right-handed, slot-machine-playing disordered gamblers (DGs; N = 80 as well as age- and smoking-matched male healthy controls (HCs; N = 89. Depressive symptoms were assessed using the Beck Depression Inventory (BDI. DGs and HCs were divided into subgroups (“high” and “low” based on their BDI scores. Effort-related monetary reward processing did not differ between the complete groups of HCs and DGs. Brain activation during receipt of monetary reward though revealed a significant Group × BDI interaction: DGs with higher BDI scores compared to DGs with lower BDI scores showed greater brain activity in the right insula cortex and dorsal striatum while no differences were observed for HCs with higher versus lower BDI scores. Our results suggest that effort-related aspects of monetary motivation, i.e. when monetary output is tied to performance, are not altered in DG. Additionally, our findings strengthen the need for subgroup comparisons in future investigations of the disorder as part of a personalized medicine approach.

  7. Neural activity during encoding predicts false memories created by misinformation

    OpenAIRE

    Okado, Yoko; Stark, Craig E.L.

    2005-01-01

    False memories are often demonstrated using the misinformation paradigm, in which a person's recollection of a witnessed event is altered after exposure to misinformation about the event. The neural basis of this phenomenon, however, remains unknown. We used fMRI to investigate encoding processes during the viewing of an event and misinformation to see whether neural activity during either encoding phase could predict what would be remembered. fMRI data were collected as participants studied ...

  8. Learning to Discern Images Modifies Neural Activity

    OpenAIRE

    Gregor Rainer; Han Lee; Logothetis, Nikos K.

    2004-01-01

    One of the most remarkable capabilities of the adult brain is its ability to learn and continuously adapt to an ever-changing environment. While many studies have documented how learning improves the perception and identification of visual stimuli, relatively little is known about how it modifies the underlying neural mechanisms. We trained monkeys to identify natural images that were degraded by interpolation with visual noise. We found that learning led to an improvement in monkeys' ability...

  9. Psychosocial versus physiological stress - Meta-analyses on deactivations and activations of the neural correlates of stress reactions.

    Science.gov (United States)

    Kogler, Lydia; Müller, Veronika I; Chang, Amy; Eickhoff, Simon B; Fox, Peter T; Gur, Ruben C; Derntl, Birgit

    2015-10-01

    Stress is present in everyday life in various forms and situations. Two stressors frequently investigated are physiological and psychosocial stress. Besides similar subjective and hormonal responses, it has been suggested that they also share common neural substrates. The current study used activation-likelihood-estimation meta-analysis to test this assumption by integrating results of previous neuroimaging studies on stress processing. Reported results are cluster-level FWE corrected. The inferior frontal gyrus (IFG) and the anterior insula (AI) were the only regions that demonstrated overlapping activation for both stressors. Analysis of physiological stress showed consistent activation of cognitive and affective components of pain processing such as the insula, striatum, or the middle cingulate cortex. Contrarily, analysis across psychosocial stress revealed consistent activation of the right superior temporal gyrus and deactivation of the striatum. Notably, parts of the striatum appeared to be functionally specified: the dorsal striatum was activated in physiological stress, whereas the ventral striatum was deactivated in psychosocial stress. Additional functional connectivity and decoding analyses further characterized this functional heterogeneity and revealed higher associations of the dorsal striatum with motor regions and of the ventral striatum with reward processing. Based on our meta-analytic approach, activation of the IFG and the AI seems to indicate a global neural stress reaction. While physiological stress activates a motoric fight-or-flight reaction, during psychosocial stress attention is shifted towards emotion regulation and goal-directed behavior, and reward processing is reduced. Our results show the significance of differentiating physiological and psychosocial stress in neural engagement. Furthermore, the assessment of deactivations in addition to activations in stress research is highly recommended. PMID:26123376

  10. Psychosocial versus physiological stress - Meta-analyses on deactivations and activations of the neural correlates of stress reactions.

    Science.gov (United States)

    Kogler, Lydia; Müller, Veronika I; Chang, Amy; Eickhoff, Simon B; Fox, Peter T; Gur, Ruben C; Derntl, Birgit

    2015-10-01

    Stress is present in everyday life in various forms and situations. Two stressors frequently investigated are physiological and psychosocial stress. Besides similar subjective and hormonal responses, it has been suggested that they also share common neural substrates. The current study used activation-likelihood-estimation meta-analysis to test this assumption by integrating results of previous neuroimaging studies on stress processing. Reported results are cluster-level FWE corrected. The inferior frontal gyrus (IFG) and the anterior insula (AI) were the only regions that demonstrated overlapping activation for both stressors. Analysis of physiological stress showed consistent activation of cognitive and affective components of pain processing such as the insula, striatum, or the middle cingulate cortex. Contrarily, analysis across psychosocial stress revealed consistent activation of the right superior temporal gyrus and deactivation of the striatum. Notably, parts of the striatum appeared to be functionally specified: the dorsal striatum was activated in physiological stress, whereas the ventral striatum was deactivated in psychosocial stress. Additional functional connectivity and decoding analyses further characterized this functional heterogeneity and revealed higher associations of the dorsal striatum with motor regions and of the ventral striatum with reward processing. Based on our meta-analytic approach, activation of the IFG and the AI seems to indicate a global neural stress reaction. While physiological stress activates a motoric fight-or-flight reaction, during psychosocial stress attention is shifted towards emotion regulation and goal-directed behavior, and reward processing is reduced. Our results show the significance of differentiating physiological and psychosocial stress in neural engagement. Furthermore, the assessment of deactivations in addition to activations in stress research is highly recommended.

  11. Neurometabolic coupling between neural activity, glucose, and lactate in activated visual cortex.

    Science.gov (United States)

    Li, Baowang; Freeman, Ralph D

    2015-11-01

    Neural activity is closely coupled with energy metabolism but details of the association remain to be identified. One basic area involves the relationships between neural activity and the main supportive substrates of glucose and lactate. This is of fundamental significance for the interpretation of non-invasive neural imaging. Here, we use microelectrodes with high spatial and temporal resolution to determine simultaneous co-localized changes in glucose, lactate, and neural activity during visual activation of the cerebral cortex in the cat. Tissue glucose and lactate concentration levels are measured with electrochemical microelectrodes while neural spiking activity and local field potentials are sampled by a microelectrode. These measurements are performed simultaneously while neurons are activated by visual stimuli of different contrast levels, orientations, and sizes. We find immediate decreases in tissue glucose concentration and simultaneous increases in lactate during neural activation. Both glucose and lactate signals return to their baseline levels instantly as neurons cease firing. No sustained changes or initial dips in glucose or lactate signals are elicited by visual stimulation. However, co-localized measurements of cerebral blood flow and neural activity demonstrate a clear delay in the cerebral blood flow signal such that it does not correlate temporally with the neural response. These results provide direct real-time evidence regarding the coupling between co-localized energy metabolism and neural activity during physiological stimulation. They are also relevant to a current question regarding the role of lactate in energy metabolism in the brain during neural activation. Dynamic changes in energy metabolites can be measured directly with high spatial and temporal resolution by use of enzyme-based microelectrodes. Here, to examine neuro-metabolic coupling during brain activation, we use combined microelectrodes to simultaneously measure

  12. Post-learning Hippocampal Dynamics Promote Preferential Retention of Rewarding Events.

    Science.gov (United States)

    Gruber, Matthias J; Ritchey, Maureen; Wang, Shao-Fang; Doss, Manoj K; Ranganath, Charan

    2016-03-01

    Reward motivation is known to modulate memory encoding, and this effect depends on interactions between the substantia nigra/ventral tegmental area complex (SN/VTA) and the hippocampus. It is unknown, however, whether these interactions influence offline neural activity in the human brain that is thought to promote memory consolidation. Here we used fMRI to test the effect of reward motivation on post-learning neural dynamics and subsequent memory for objects that were learned in high- and low-reward motivation contexts. We found that post-learning increases in resting-state functional connectivity between the SN/VTA and hippocampus predicted preferential retention of objects that were learned in high-reward contexts. In addition, multivariate pattern classification revealed that hippocampal representations of high-reward contexts were preferentially reactivated during post-learning rest, and the number of hippocampal reactivations was predictive of preferential retention of items learned in high-reward contexts. These findings indicate that reward motivation alters offline post-learning dynamics between the SN/VTA and hippocampus, providing novel evidence for a potential mechanism by which reward could influence memory consolidation.

  13. Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task.

    Science.gov (United States)

    Gu, Xiaosi; Kirk, Ulrich; Lohrenz, Terry M; Montague, P Read

    2014-08-01

    Computational models of reward processing suggest that foregone or fictive outcomes serve as important information sources for learning and augment those generated by experienced rewards (e.g. reward prediction errors). An outstanding question is how these learning signals interact with top-down cognitive influences, such as cognitive reappraisal strategies. Using a sequential investment task and functional magnetic resonance imaging, we show that the reappraisal strategy selectively attenuates the influence of fictive, but not reward prediction error signals on investment behavior; such behavioral effect is accompanied by changes in neural activity and connectivity in the anterior insular cortex, a brain region thought to integrate subjective feelings with high-order cognition. Furthermore, individuals differ in the extent to which their behaviors are driven by fictive errors versus reward prediction errors, and the reappraisal strategy interacts with such individual differences; a finding also accompanied by distinct underlying neural mechanisms. These findings suggest that the variable interaction of cognitive strategies with two important classes of computational learning signals (fictive, reward prediction error) represent one contributing substrate for the variable capacity of individuals to control their behavior based on foregone rewards. These findings also expose important possibilities for understanding the lack of control in addiction based on possibly foregone rewarding outcomes.

  14. Brain reward-system activation in response to anticipation and consumption of palatable food is altered by glucagon-like peptide-1 receptor activation in humans

    NARCIS (Netherlands)

    van Bloemendaal, L.; Veltman, D. J.; ten Kulve, J. S.; Groot, P. F. C.; Ruhe, H. G.; Barkhof, F.; Sloan, J. H.; Diamant, M.; Ijzerman, R. G.

    2015-01-01

    AimTo test the hypothesis that food intake reduction after glucagon-like peptide-1 (GLP-1) receptor activation is mediated through brain areas regulating anticipatory and consummatory food reward. MethodsAs part of a larger study, we determined the effects of GLP-1 receptor activation on brain respo

  15. Brain activity in advantageous and disadvantageous situations: implications for reward/punishment sensitivity in different situations.

    Directory of Open Access Journals (Sweden)

    Guangheng Dong

    Full Text Available OBJECTIVE: This study modeled win and lose trials in a simple gambling task to examine the effect of entire win-lose situations (WIN, LOSS, or TIE on single win/lose trials and related neural underpinnings. METHODS: The behavior responses and brain activities of 17 participants were recorded by an MRI scanner while they performed a gambling task. Different conditions were compared to determine the effect of the task on the behavior and brain activity of the participants. Correlations between brain activity and behavior were calculated to support the imaging results. RESULTS: In win trials, LOSS caused less intense posterior cingulate activity than TIE. In lose trials, LOSS caused more intense activity in the right superior temporal gyrus, bilateral superior frontal gyrus, bilateral anterior cingulate, bilateral insula cortex, and left orbitofrontal cortex than WIN and TIE. CONCLUSIONS: The experiences of the participants in win trials showed great similarity among different win-lose situations. However, the brain activity and behavior responses of the participants in lose trials indicated that they experienced stronger negative emotion in LOSS. The participants also showed an increased desire to win in LOSS than in WIN or TIE conditions.

  16. Optical imaging of neural and hemodynamic brain activity

    Science.gov (United States)

    Schei, Jennifer Lynn

    Optical imaging technologies can be used to record neural and hemodynamic activity. Neural activity elicits physiological changes that alter the optical tissue properties. Specifically, changes in polarized light are concomitant with neural depolarization. We measured polarization changes from an isolated lobster nerve during action potential propagation using both reflected and transmitted light. In transmission mode, polarization changes were largest throughout the center of the nerve, suggesting that most of the optical signal arose from the inner nerve bundle. In reflection mode, polarization changes were largest near the edges, suggesting that most of the optical signal arose from the outer sheath. To overcome irregular cell orientation found in the brain, we measured polarization changes from a nerve tied in a knot. Our results show that neural activation produces polarization changes that can be imaged even without regular cell orientations. Neural activation expends energy resources and elicits metabolic delivery through blood vessel dilation, increasing blood flow and volume. We used spectroscopic imaging techniques combined with electrophysiological measurements to record evoked neural and hemodynamic responses from the auditory cortex of the rat. By using implantable optics, we measured responses across natural wake and sleep states, as well as responses following different amounts of sleep deprivation. During quiet sleep, evoked metabolic responses were larger compared to wake, perhaps because blood vessels were more compliant. When animals were sleep deprived, evoked hemodynamic responses were smaller following longer periods of deprivation. These results suggest that prolonged neural activity through sleep deprivation may diminish vascular compliance as indicated by the blunted vascular response. Subsequent sleep may allow vessels to relax, restoring their ability to deliver blood. These results also suggest that severe sleep deprivation or chronic

  17. Neural Network-Based Active Control for Offshore Platforms

    Institute of Scientific and Technical Information of China (English)

    周亚军; 赵德有

    2003-01-01

    A new active control scheme, based on neural network, for the suppression of oscillation in multiple-degree-of-freedom (MDOF) offshore platforms, is studied in this paper. With the main advantages of neural network, i.e. the inherent robustness, fault tolerance, and generalized capability of its parallel massive interconnection structure, the active structural control of offshore platforms under random waves is accomplished by use of the BP neural network model. The neural network is trained offline with the data generated from numerical analysis, and it simulates the process of Classical Linear Quadratic Regular Control for the platform under random waves. After the learning phase, the trained network has learned about the nonlinear dynamic behavior of the active control system, and is capable of predicting the active control forces of the next time steps. The results obtained show that the active control is feasible and effective, and it finally overcomes time delay owing to the robustness, fault tolerance, and generalized capability of artificial neural network.

  18. High Accuracy Human Activity Monitoring using Neural network

    CERN Document Server

    Sharma, Annapurna; Chung, Wan-Young

    2011-01-01

    This paper presents the designing of a neural network for the classification of Human activity. A Triaxial accelerometer sensor, housed in a chest worn sensor unit, has been used for capturing the acceleration of the movements associated. All the three axis acceleration data were collected at a base station PC via a CC2420 2.4GHz ISM band radio (zigbee wireless compliant), processed and classified using MATLAB. A neural network approach for classification was used with an eye on theoretical and empirical facts. The work shows a detailed description of the designing steps for the classification of human body acceleration data. A 4-layer back propagation neural network, with Levenberg-marquardt algorithm for training, showed best performance among the other neural network training algorithms.

  19. Market rewards to patterns of increasing earnings: effects of cash flow patterns, accruals manipulation, real activities manipulation and conservative accounting

    OpenAIRE

    Liu, Su-Ping

    2013-01-01

    In this dissertation I investigate whether market rewards to a pattern of increasing earnings vary with certain signals of whether the pattern is genuine or fabricated. Among these signals, I examine growth in cash flows, accrual-based earnings management, earnings management through the manipulation of real operating activities, and conservative accounting. The findings show that market participants assign higher price-earnings multiples to firms when their pattern of increasi...

  20. Feedback associated with expectation for larger-reward improves visuospatial working memory performances in children with ADHD

    Directory of Open Access Journals (Sweden)

    Rubi Hammer

    2015-08-01

    Full Text Available We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC boys underwent functional magnetic resonance imaging (fMRI while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small and feedback availability (no-feedback; feedback. While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory.

  1. Internal models for interpreting neural population activity during sensorimotor control.

    Science.gov (United States)

    Golub, Matthew D; Yu, Byron M; Chase, Steven M

    2015-01-01

    To successfully guide limb movements, the brain takes in sensory information about the limb, internally tracks the state of the limb, and produces appropriate motor commands. It is widely believed that this process uses an internal model, which describes our prior beliefs about how the limb responds to motor commands. Here, we leveraged a brain-machine interface (BMI) paradigm in rhesus monkeys and novel statistical analyses of neural population activity to gain insight into moment-by-moment internal model computations. We discovered that a mismatch between subjects' internal models and the actual BMI explains roughly 65% of movement errors, as well as long-standing deficiencies in BMI speed control. We then used the internal models to characterize how the neural population activity changes during BMI learning. More broadly, this work provides an approach for interpreting neural population activity in the context of how prior beliefs guide the transformation of sensory input to motor output.

  2. Serotonergic modulation of reward and punishment

    DEFF Research Database (Denmark)

    Macoveanu, Julian

    2014-01-01

    of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions....... Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward...

  3. Activation instead of blocking mesolimbic dopaminergic reward circuitry is a preferred modality in the long term treatment of reward deficiency syndrome (RDS: a commentary

    Directory of Open Access Journals (Sweden)

    Waite Roger L

    2008-11-01

    proliferation of D2 receptors. Proposal and conclusion The authors propose that D2 receptor stimulation can be accomplished via the use of Synapatmine™, a natural but therapeutic nutraceutical formulation that potentially induces DA release, causing the same induction of D2-directed mRNA and thus proliferation of D2 receptors in the human. This proliferation of D2 receptors in turn will induce the attenuation of craving behavior. In fact as mentioned earlier, this model has been proven in research showing DNA-directed compensatory overexpression (a form of gene therapy of the DRD2 receptors, resulting in a significant reduction in alcohol craving behavior in alcohol preferring rodents. Utilizing natural dopaminergic repletion therapy to promote long term dopaminergic activation will ultimately lead to a common, safe and effective modality to treat Reward Deficiency Syndrome (RDS behaviors including Substance Use Disorders (SUD, Attention Deficit Hyperactivity Disorder (ADHD, Obesity and other reward deficient aberrant behaviors. This concept is further supported by the more comprehensive understanding of the role of dopamine in the NAc as a "wanting" messenger in the meso-limbic DA system.

  4. Reward functions of the basal ganglia.

    Science.gov (United States)

    Schultz, Wolfram

    2016-07-01

    Besides their fundamental movement function evidenced by Parkinsonian deficits, the basal ganglia are involved in processing closely linked non-motor, cognitive and reward information. This review describes the reward functions of three brain structures that are major components of the basal ganglia or are closely associated with the basal ganglia, namely midbrain dopamine neurons, pedunculopontine nucleus, and striatum (caudate nucleus, putamen, nucleus accumbens). Rewards are involved in learning (positive reinforcement), approach behavior, economic choices and positive emotions. The response of dopamine neurons to rewards consists of an early detection component and a subsequent reward component that reflects a prediction error in economic utility, but is unrelated to movement. Dopamine activations to non-rewarded or aversive stimuli reflect physical impact, but not punishment. Neurons in pedunculopontine nucleus project their axons to dopamine neurons and process sensory stimuli, movements and rewards and reward-predicting stimuli without coding outright reward prediction errors. Neurons in striatum, besides their pronounced movement relationships, process rewards irrespective of sensory and motor aspects, integrate reward information into movement activity, code the reward value of individual actions, change their reward-related activity during learning, and code own reward in social situations depending on whose action produces the reward. These data demonstrate a variety of well-characterized reward processes in specific basal ganglia nuclei consistent with an important function in non-motor aspects of motivated behavior. PMID:26838982

  5. Nucleus accumbens mediates relative motivation for rewards in the absence of choice

    Directory of Open Access Journals (Sweden)

    John A Clithero

    2011-08-01

    Full Text Available To dissociate a choice from its antecedent neural states, motivation associated with the expected outcome must be captured in the absence of choice. Yet, the neural mechanisms that mediate behavioral idiosyncrasies in motivation, particularly with regard to complex economic preferences, are rarely examined in situations without overt decisions. We employed functional magnetic resonance imaging (fMRI in a large sample of participants while they anticipated earning rewards from two different modalities: monetary and candy rewards. An index for relative motivation toward different reward types was constructed using reaction times to the target for earning rewards. Activation in the nucleus accumbens (NAcc and anterior insula (aINS predicted individual variation in relative motivation between our reward modalities. NAcc activation, however, mediated the effects of aINS, indicating the NAcc is the likely source of this relative weighting. These results demonstrate that neural idiosyncrasies in reward efficacy exist even in the absence of explicit choices, and extend the role of NAcc as a critical brain region for such choice-free motivation.

  6. HIV infection results in ventral-striatal reward system hypo-activation during cue processing

    NARCIS (Netherlands)

    Plessis, Stéfan du; Vink, Matthijs; Joska, John A; Koutsilieri, Eleni; Bagadia, Asif; Stein, Dan J; Emsley, Robin

    2015-01-01

    OBJECTIVE: Functional MRI has thus far demonstrated that HIV has an impact on frontal-striatal systems involved in executive functioning. The potential impact of HIV on frontal-striatal systems involved in reward processing has yet to be examined by functional MRI. This study therefore aims to inves

  7. Changes in brain activation associated with reward processing in smokers and nonsmokers

    NARCIS (Netherlands)

    Martin-Solch, C; Magyar, S; Kunig, G; Missimer, J; Schultz, W; Leenders, KL

    2001-01-01

    Tobacco smoking is the most frequent form of substance abuse. Several studies have shown that the addictive action of nicotine is mediated by the mesolimbic. dopamine system. This system is implicated in reward processing. In order to better understand the relationship between nicotine addiction and

  8. Updating dopamine reward signals

    OpenAIRE

    Schultz, Wolfram

    2013-01-01

    Recent work has advanced our knowledge of phasic dopamine reward prediction error signals. The error signal is bidirectional, reflects well the higher order prediction error described by temporal difference learning models, is compatible with model-free and model-based reinforcement learning, reports the subjective rather than physical reward value during temporal discounting and reflects subjective stimulus perception rather than physical stimulus aspects. Dopamine activations are primarily ...

  9. Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events.

    Science.gov (United States)

    Murty, Vishnu P; Adcock, R Alison

    2014-08-01

    Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning.

  10. NPY mediates reward activity of morphine, via NPY Y1 receptors, in the nucleus accumbens shell.

    Science.gov (United States)

    Desai, Sagar J; Upadhya, Manoj A; Subhedar, Nishikant K; Kokare, Dadasaheb M

    2013-06-15

    Although the interaction between endogenous neuropeptide Y (NPY) and opioidergic systems in processing of reward has been speculated, experimental evidence is lacking. We investigated the role of NPY, and its Y1 receptors, in the nucleus accumbens shell (AcbSh) in morphine induced reward and reinforcement behavior. Rats were implanted with cannulae targeted at AcbSh for drug administration, and with stimulating electrode in the medial forebrain bundle (MFB). The rats were then conditioned in an operant conditioning chamber for electrical self-stimulation of the MFB. Increased rate of lever pressings was evaluated against the frequency of the stimulating current. Increase in rate of lever presses was considered as a measure of reward and reinforcement. About 30-70% increase in self-stimulation was observed following bilateral intra-AcbSh treatment with morphine, NPY or [Leu(31), Pro(34)]-NPY (NPY Y1/Y5 receptors agonist), however, BIBP3226 (selective NPY Y1 receptors antagonist) produced opposite effect. The reward effect of morphine was significantly potentiated by NPY or [Leu(31), Pro(34)]-NPY, but antagonized by BIBP3226. NPY-immunoreactivity in the AcbSh, arcuate nucleus (ARC) and lateral part of bed nucleus of stria terminalis (BNSTl) was significantly more in the operant conditioned rats than in naïve control. However, morphine administration to the conditioned rats resulted in significant decrease in the NPY-immunoreactivity in all these anatomical regions. Since the role of morphine in modulation of mesolimbic-dopaminergic pathway is well established, we suggest that NPY system in AcbSh, ARC and BNSTl, perhaps acting via Y1-receptor system, may be an important component of the mesolimbic-AcbSh reward circuitry triggered by endogenous opioids.

  11. Design of 3D Active Multichannel Silicon Neural Microelectrode

    Institute of Scientific and Technical Information of China (English)

    WANG Di; ZHANG Guoxiong; LI Xingfei

    2006-01-01

    To find a design method for 3D active multichannel silicon microelectrode,a microstructure of active neural recording system is presented,where two 2D probes,two integrated circuits and two spacers are microassembled on a 5 mm ×7 mm silicon platform,and 32 sites neural signals can be operated simultaneously.A theoretical model for measuring the neural signal by the silicon microelectrode is proposed based on the structure and fabrication process of a single-shank probe.The method of determining the dimensional parameters of the probe shank is discussed in the following three aspects,i.e.the structures of pallium and endocranium,coupled interconnecters noise,and strength characteristic of neural probe.The design criterion is to minimize the size of the neural probe as well as that the probe has enough stiffness to pierce the endocranium.The on-chip unity-gain bandpass amplifier has an overall gain of 42 dB over a bandwidth from 60 Hz to 10 kHz;and the DC-baseline stability circuit is of high input resistance above 30 MΩ to guarantee a cutoff frequency below 100 Hz.The circuit works in stimulating or recording modes.The conversion of the modes depends on the stimulating control signal.

  12. Cultured Neural Networks: Optimization of Patterned Network Adhesiveness and Characterization of their Neural Activity

    Directory of Open Access Journals (Sweden)

    W. L. C. Rutten

    2006-01-01

    Full Text Available One type of future, improved neural interface is the “cultured probe”. It is a hybrid type of neural information transducer or prosthesis, for stimulation and/or recording of neural activity. It would consist of a microelectrode array (MEA on a planar substrate, each electrode being covered and surrounded by a local circularly confined network (“island” of cultured neurons. The main purpose of the local networks is that they act as biofriendly intermediates for collateral sprouts from the in vivo system, thus allowing for an effective and selective neuron–electrode interface. As a secondary purpose, one may envisage future information processing applications of these intermediary networks. In this paper, first, progress is shown on how substrates can be chemically modified to confine developing networks, cultured from dissociated rat cortex cells, to “islands” surrounding an electrode site. Additional coating of neurophobic, polyimide-coated substrate by triblock-copolymer coating enhances neurophilic-neurophobic adhesion contrast. Secondly, results are given on neuronal activity in patterned, unconnected and connected, circular “island” networks. For connected islands, the larger the island diameter (50, 100 or 150 μm, the more spontaneous activity is seen. Also, activity may show a very high degree of synchronization between two islands. For unconnected islands, activity may start at 22 days in vitro (DIV, which is two weeks later than in unpatterned networks.

  13. The Dopaminergic Midbrain Mediates an Effect of Average Reward on Pavlovian Vigor.

    Science.gov (United States)

    Rigoli, Francesco; Chew, Benjamin; Dayan, Peter; Dolan, Raymond J

    2016-09-01

    Dopamine plays a key role in motivation. Phasic dopamine response reflects a reinforcement prediction error (RPE), whereas tonic dopamine activity is postulated to represent an average reward that mediates motivational vigor. However, it has been hard to find evidence concerning the neural encoding of average reward that is uncorrupted by influences of RPEs. We circumvented this difficulty in a novel visual search task where we measured participants' button pressing vigor in a context where information (underlying an RPE) about future average reward was provided well before the average reward itself. Despite no instrumental consequence, participants' pressing force increased for greater current average reward, consistent with a form of Pavlovian effect on motivational vigor. We recorded participants' brain activity during task performance with fMRI. Greater average reward was associated with enhanced activity in dopaminergic midbrain to a degree that correlated with the relationship between average reward and pressing vigor. Interestingly, an opposite pattern was observed in subgenual cingulate cortex, a region implicated in negative mood and motivational inhibition. These findings highlight a crucial role for dopaminergic midbrain in representing aspects of average reward and motivational vigor. PMID:27082045

  14. The Dopaminergic Midbrain Mediates an Effect of Average Reward on Pavlovian Vigor.

    Science.gov (United States)

    Rigoli, Francesco; Chew, Benjamin; Dayan, Peter; Dolan, Raymond J

    2016-09-01

    Dopamine plays a key role in motivation. Phasic dopamine response reflects a reinforcement prediction error (RPE), whereas tonic dopamine activity is postulated to represent an average reward that mediates motivational vigor. However, it has been hard to find evidence concerning the neural encoding of average reward that is uncorrupted by influences of RPEs. We circumvented this difficulty in a novel visual search task where we measured participants' button pressing vigor in a context where information (underlying an RPE) about future average reward was provided well before the average reward itself. Despite no instrumental consequence, participants' pressing force increased for greater current average reward, consistent with a form of Pavlovian effect on motivational vigor. We recorded participants' brain activity during task performance with fMRI. Greater average reward was associated with enhanced activity in dopaminergic midbrain to a degree that correlated with the relationship between average reward and pressing vigor. Interestingly, an opposite pattern was observed in subgenual cingulate cortex, a region implicated in negative mood and motivational inhibition. These findings highlight a crucial role for dopaminergic midbrain in representing aspects of average reward and motivational vigor.

  15. Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict.

    Science.gov (United States)

    van den Berg, Berry; Krebs, Ruth M; Lorist, Monicque M; Woldorff, Marty G

    2014-06-01

    The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive task performance. In this task, the cue indicated whether or not the participant needed to prepare for an upcoming Stroop stimulus and, if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued attention and cued reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (contingent negative variation [CNV]) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted shorter versus longer response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across participants with the degree to which reward-prospect both facilitated overall task performance (shorter RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information.

  16. Controlling neural activity in Caenorhabditis elegans to evoke chemotactic behavior

    Science.gov (United States)

    Kocabas, Askin; Shen, Ching-Han; Guo, Zengcai V.; Ramanathan, Sharad

    2013-03-01

    Animals locate and track chemoattractive gradients in the environment to find food. With its simple nervous system, Caenorhabditis elegans is a good model system in which to understand how the dynamics of neural activity control this search behavior. To understand how the activity in its interneurons coordinate different motor programs to lead the animal to food, here we used optogenetics and new optical tools to manipulate neural activity directly in freely moving animals to evoke chemotactic behavior. By deducing the classes of activity patterns triggered during chemotaxis and exciting individual neurons with these patterns, we identified interneurons that control the essential locomotory programs for this behavior. Notably, we discovered that controlling the dynamics of activity in just one interneuron pair was sufficient to force the animal to locate, turn towards and track virtual light gradients.

  17. Adolescent Depression: Stress and Reward Dysfunction

    OpenAIRE

    Auerbach, Randy P.; Admon, Roee; Pizzagalli, Diego A.

    2014-01-01

    Adolescence is a peak period for the onset of depression, and it is also a time marked by substantial stress as well as neural development within the brain reward circuitry. In the current review, we provide a selective overview of current animal and human research investigating the relationship among reward processes, stress, and depression. Three separate, but related, etiological models examine the differential roles that stress may play with regard to reward dysfunction and adolescent dep...

  18. The rewarding nature of social interactions

    OpenAIRE

    Sören Krach; Paulus, Frieder M.; Maren Bodden; TIlo Kircher

    2010-01-01

    The objective of this short review is to highlight rewarding aspects of social interactions for humans and discuss their neural basis. Thereby we report recent research findings to illustrate how social stimuli in general are processed in the reward system and highlight the role of Theory of Mind (ToM) as one mediating process for experiencing social reward during social interactions. In conclusion we discuss clinical implications for psychiatry and psychotherapy.

  19. Biological substrates of reward and aversion: a nucleus accumbens activity hypothesis

    OpenAIRE

    Carlezon, William A; Thomas, Mark J.

    2008-01-01

    The nucleus accumbens (NAc) is a critical element of the mesocorticolimbic system, a brain circuit implicated in reward and motivation. This basal forebrain structure receives dopamine (DA) input from the ventral tegmental area (VTA) and glutamate (GLU) input from regions including the prefrontal cortex (PFC), amygdala (AMG), and hippocampus (HIP). As such, it integrates inputs from limbic and cortical regions, linking motivation with action. The NAc has a well-established role in mediating t...

  20. Active Reward Processing during Human Sleep: Insights from Sleep-Related Eating Disorder

    OpenAIRE

    Perogamvros, Lampros; Baud, Patrick; Hasler, Roland; Cloninger, Claude Robert; Schwartz, Sophie; Perrig, Stephen

    2012-01-01

    In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED), a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography, a dream diary and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating di...

  1. Tools for Resolving Functional Activity and Connectivity within Intact Neural Circuits

    OpenAIRE

    Jennings, Joshua H.; Stuber, Garret D.

    2014-01-01

    Mammalian neural circuits are sophisticated biological systems that choreograph behavioral processes vital for survival. While the inherent complexity of discrete neural circuits has proven difficult to decipher, many parallel methodological developments promise to help delineate the function and connectivity of molecularly defined neural circuits. Here, we review recent technological advances designed to precisely monitor and manipulate neural circuit activity. We propose a holistic, multifa...

  2. Adolescents' risky decision-making activates neural networks related to social cognition and cognitive control processes.

    Science.gov (United States)

    Rodrigo, María José; Padrón, Iván; de Vega, Manuel; Ferstl, Evelyn C

    2014-01-01

    This study examines by means of functional magnetic resonance imaging the neural mechanisms underlying adolescents' risk decision-making in social contexts. We hypothesize that the social context could engage brain regions associated with social cognition processes and developmental changes are also expected. Sixty participants (adolescents: 17-18, and young adults: 21-22 years old) read narratives describing typical situations of decision-making in the presence of peers. They were asked to make choices in risky situations (e.g., taking or refusing a drug) or ambiguous situations (e.g., eating a hamburger or a hotdog). Risky as compared to ambiguous scenarios activated bilateral temporoparietal junction (TPJ), bilateral middle temporal gyrus (MTG), right medial prefrontal cortex, and the precuneus bilaterally; i.e., brain regions related to social cognition processes, such as self-reflection and theory of mind (ToM). In addition, brain structures related to cognitive control were active [right anterior cingulate cortex (ACC), bilateral dorsolateral prefrontal cortex (DLPFC), bilateral orbitofrontal cortex], whereas no significant clusters were obtained in the reward system (ventral striatum). Choosing the dangerous option involved a further activation of control areas (ACC) and emotional and social cognition areas (temporal pole). Adolescents employed more neural resources than young adults in the right DLPFC and the right TPJ in risk situations. When choosing the dangerous option, young adults showed a further engagement in ToM related regions (bilateral MTG) and in motor control regions related to the planning of actions (pre-supplementary motor area). Finally, the right insula and the right superior temporal gyrus were more activated in women than in men, suggesting more emotional involvement and more intensive modeling of the others' perspective in the risky conditions. These findings call for more comprehensive developmental accounts of decision-making in

  3. Adolescents’ risky decision-making activates neural networks related to social cognition and cognitive control processes

    Directory of Open Access Journals (Sweden)

    María José eRodrigo

    2014-02-01

    Full Text Available This study examines by means of fMRI the neural mechanisms underlying adolescents’ risk decision-making in social contexts. We hypothesize that the social context could engage brain regions associated with social cognition processes and developmental changes are also expected. Sixty participants (adolescents: 17-18, and young adults: 21-22 years old read narratives describing typical situations of decision-making in the presence of peers. They were asked to make choices in risky situations (e.g., taking or refusing a drug or ambiguous situations (e.g., eating a hamburger or a hotdog. Risky as compared to ambiguous scenarios activated bilateral temporoparietal junction (TPJ, bilateral middle temporal gyrus (MTG, right medial prefrontal cortex (mPFC, and the precuneus bilaterally; i.e., brain regions related to social cognition processes, such as self-reflection and theory of mind. In addition, brain structures related to cognitive control were active (right ACC, bilateral DLPFC, bilateral OFC, whereas no significant clusters were obtained in the reward system (VS. Choosing the dangerous option involved a further activation of control areas (ACC and emotional and social cognition areas (temporal pole. Adolescents employed more neural resources than young adults in the right DLPFC and the right TPJ in risk situations. When choosing the dangerous option, young adults showed a further engagement in theory of mind related regions (bilateral middle temporal gyrus and in motor control regions related to the planning of actions (pre-supplementary motor area. Finally, the right insula and the right superior temporal gyrus were more activated in women than in men, suggesting more emotional involvement and more intensive modeling of the others’ perspective in the risky conditions. These findings call for more comprehensive developmental accounts of decision-making in social contexts that incorporate the role of emotional and social cognition processes.

  4. Fast ventral stream neural activity enables rapid visual categorization.

    Science.gov (United States)

    Cauchoix, Maxime; Crouzet, Sébastien M; Fize, Denis; Serre, Thomas

    2016-01-15

    Primates can recognize objects embedded in complex natural scenes in a glimpse. Rapid categorization paradigms have been extensively used to study our core perceptual abilities when the visual system is forced to operate under strong time constraints. However, the neural underpinning of rapid categorization remains to be understood, and the incredible speed of sight has yet to be reconciled with modern ventral stream cortical theories of object recognition. Here we recorded multichannel subdural electrocorticogram (ECoG) signals from intermediate areas (V4/PIT) of the ventral stream of the visual cortex while monkeys were actively engaged in a rapid animal/non-animal categorization task. A traditional event-related potential (ERP) analysis revealed short visual latencies (<50-70ms) followed by a rapidly developing visual selectivity (within ~20-30ms) for most electrodes. A multi-variate pattern analysis (MVPA) technique further confirmed that reliable animal/non-animal category information was possible from this initial ventral stream neural activity (within ~90-100ms). Furthermore, this early category-selective neural activity was (a) unaffected by the presentation of a backward (pattern) mask, (b) generalized to novel (unfamiliar) stimuli and (c) co-varied with behavioral responses (both accuracy and reaction times). Despite the strong prevalence of task-related information on the neural signal, task-irrelevant visual information could still be decoded independently of monkey behavior. Monkey behavioral responses were also found to correlate significantly with human behavioral responses for the same set of stimuli. Together, the present study establishes that rapid ventral stream neural activity induces a visually selective signal subsequently used to drive rapid visual categorization and that this visual strategy may be shared between human and non-human primates. PMID:26477655

  5. Activity-dependent modulation of neural circuit synaptic connectivity

    OpenAIRE

    Tessier, Charles R.; Kendal Broadie

    2009-01-01

    In many nervous systems, the establishment of neural circuits is known to proceed via a two-stage process; 1) early, activity-independent wiring to produce a rough map characterized by excessive synaptic connections, and 2) subsequent, use-dependent pruning to eliminate inappropriate connections and reinforce maintained synapses. In invertebrates, however, evidence of the activity-dependent phase of synaptic refinement has been elusive, and the dogma has long been that invertebrate circ...

  6. Impact of expected value on neural activity in rat substantia nigra pars reticulata.

    Science.gov (United States)

    Bryden, Daniel W; Johnson, Emily E; Diao, Xiayang; Roesch, Matthew R

    2011-06-01

    The substantia nigra pars reticulata (SNr) is thought to serve as the output of the basal ganglia, whereby associative information from striatum influences behavior via disinhibition of downstream motor areas to motivate behavior. Unfortunately, few studies have examined activity in SNr in rats making decisions based on the value of predicted reward similar to those conducted in primates. To fill this void, we recorded from single neurons in SNr while rats performed a choice task in which different odor cues indicated what reward was available on the left or on the right. The value of reward associated with a leftward or rightward movement was manipulated by varying the size of and delay to reward in separate blocks of trials. Rats were faster or slower depending on whether the expected reward value was high or low, respectively. The number of neurons that increased firing during performance of the task outnumbered those that decreased firing. Both increases and decreases were modulated by expected value and response direction. Neurons that fired more or less strongly for larger reward tended to fire, respectively, more or less strongly for immediate reward, reflecting their common motivational output. Finally, value selectivity was present prior to presentation of cues indicating the nature of the upcoming behavioral response for both increasing- and decreasing-type neurons, reflecting the internal bias or preparatory set of the rat. These results emphasize the importance of increasing-type neurons on behavioral output when animals are making decisions based on predicted reward value.

  7. Phosphoproteomics of the Dopamine Pathway Enables Discovery of Rap1 Activation as a Reward Signal In Vivo.

    Science.gov (United States)

    Nagai, Taku; Nakamuta, Shinichi; Kuroda, Keisuke; Nakauchi, Sakura; Nishioka, Tomoki; Takano, Tetsuya; Zhang, Xinjian; Tsuboi, Daisuke; Funahashi, Yasuhiro; Nakano, Takashi; Yoshimoto, Junichiro; Kobayashi, Kenta; Uchigashima, Motokazu; Watanabe, Masahiko; Miura, Masami; Nishi, Akinori; Kobayashi, Kazuto; Yamada, Kiyofumi; Amano, Mutsuki; Kaibuchi, Kozo

    2016-02-01

    Dopamine (DA) type 1 receptor (D1R) signaling in the striatum presumably regulates neuronal excitability and reward-related behaviors through PKA. However, whether and how D1Rs and PKA regulate neuronal excitability and behavior remain largely unknown. Here, we developed a phosphoproteomic analysis method to identify known and novel PKA substrates downstream of the D1R and obtained more than 100 candidate substrates, including Rap1 GEF (Rasgrp2). We found that PKA phosphorylation of Rasgrp2 activated its guanine nucleotide-exchange activity on Rap1. Cocaine exposure activated Rap1 in the nucleus accumbens in mice. The expression of constitutively active PKA or Rap1 in accumbal D1R-expressing medium spiny neurons (D1R-MSNs) enhanced neuronal firing rates and behavioral responses to cocaine exposure through MAPK. Knockout of Rap1 in the accumbal D1R-MSNs was sufficient to decrease these phenotypes. These findings demonstrate a novel DA-PKA-Rap1-MAPK intracellular signaling mechanism in D1R-MSNs that increases neuronal excitability to enhance reward-related behaviors. PMID:26804993

  8. Early interfaced neural activity from chronic amputated nerves

    Directory of Open Access Journals (Sweden)

    Kshitija Garde

    2009-05-01

    Full Text Available Direct interfacing of transected peripheral nerves with advanced robotic prosthetic devices has been proposed as a strategy for achieving natural motor control and sensory perception of such bionic substitutes, thus fully functionally replacing missing limbs in amputees. Multi-electrode arrays placed in the brain and peripheral nerves have been used successfully to convey neural control of prosthetic devices to the user. However, reactive gliosis, micro hemorrhages, axonopathy and excessive inflammation, currently limit their long-term use. Here we demonstrate that enticement of peripheral nerve regeneration through a non-obstructive multi-electrode array, after either acute or chronic nerve amputation, offers a viable alternative to obtain early neural recordings and to enhance long-term interfacing of nerve activity. Non restrictive electrode arrays placed in the path of regenerating nerve fibers allowed the recording of action potentials as early as 8 days post-implantation with high signal-to-noise ratio, as long as 3 months in some animals, and with minimal inflammation at the nerve tissue-metal electrode interface. Our findings suggest that regenerative on-dependent multi-electrode arrays of open design allow the early and stable interfacing of neural activity from amputated peripheral nerves and might contribute towards conveying full neural control and sensory feedback to users of robotic prosthetic devices. .

  9. Active Noise Feedback Control Using a Neural Network

    Directory of Open Access Journals (Sweden)

    Zhang Qizhi

    2001-01-01

    Full Text Available The active noise control (ANC is discussed. Many digital ANC systems often based on the filter-x algorithm for finite impulse response (FIR filter use adaptive filtering techniques. But if the primary noise path is nonlinear, the control system based on adaptive filter technology will be invalid. In this paper, an adaptive active nonlinear noise feedback control approach using a neural network is derived. The feedback control system drives a secondary signal to destructively interfere with the original noise to cut down the noise power. An on-line learning algorithm based on the error gradient descent method was proposed, and the local stability of closed loop system is proved using the discrete Lyapunov function. A nonlinear simulation example shows that the adaptive active noise feedback control method based on a neural network is very effective to the nonlinear noise control.

  10. Perception Neural Networks for Active Noise Control Systems

    Directory of Open Access Journals (Sweden)

    Wang Xiaoli

    2012-11-01

    Full Text Available In a response to a growing demand for environments of 70dB or less noise levels, many industrial sectors have focused with some form of noise control system. Active noise control (ANC has proven to be the most effective technology. This paper mainly investigates application of neural network on self-adaptation system in active noise control (ANC. An active silencing control system is made which adopts a motional feedback loudspeaker as not a noise controlling source but a detecting sensor. The working fundamentals and the characteristics of the motional feedback loudspeaker are analyzed in detail. By analyzing each acoustical path, identification based adaptive linear neural network is built. This kind of identifying method can be achieved conveniently. The estimated result of each sound channel matches well with its real sound character, respectively.

  11. Top-down-directed synchrony from medial frontal cortex to nucleus accumbens during reward anticipation

    NARCIS (Netherlands)

    Cohen, Michael X.; Bour, Lo; Mantione, Mariska; Figee, Martijn; Vink, Matthijs; Tijssen, Marina A. J.; van Rootselaar, Anne-Fleur; van den Munckhof, Pepijn; Schuurman, P. Richard; Denys, Damiaan

    2012-01-01

    The nucleus accumbens and medial frontal cortex (MFC) are part of a loop involved in modulating behavior according to anticipated rewards. However, the precise temporal landscape of their electrophysiological interactions in humans remains unknown because it is not possible to record neural activity

  12. Persistent activity in neural networks with dynamic synapses.

    Directory of Open Access Journals (Sweden)

    Omri Barak

    2007-02-01

    Full Text Available Persistent activity states (attractors, observed in several neocortical areas after the removal of a sensory stimulus, are believed to be the neuronal basis of working memory. One of the possible mechanisms that can underlie persistent activity is recurrent excitation mediated by intracortical synaptic connections. A recent experimental study revealed that connections between pyramidal cells in prefrontal cortex exhibit various degrees of synaptic depression and facilitation. Here we analyze the effect of synaptic dynamics on the emergence and persistence of attractor states in interconnected neural networks. We show that different combinations of synaptic depression and facilitation result in qualitatively different network dynamics with respect to the emergence of the attractor states. This analysis raises the possibility that the framework of attractor neural networks can be extended to represent time-dependent stimuli.

  13. Optimal Coding Predicts Attentional Modulation of Activity in Neural Systems

    OpenAIRE

    Jaramillo, Santiago; Pearlmutter, Barak A.

    2007-01-01

    Neuronal activity in response to a fixed stimulus has been shown to change as a function of attentional state, implying that the neural code also changes with attention. We propose an information-theoretic account of such modulation: that the nervous system adapts to optimally encode sensory stimuli while taking into account the changing relevance of different features. We show using computer simulation that such modulation emerges in a coding system informed about the uneven relevance of ...

  14. Activated sludge process based on artificial neural network

    Institute of Scientific and Technical Information of China (English)

    张文艺; 蔡建安

    2002-01-01

    Considering the difficulty of creating water quality model for activated sludge system, a typical BP artificial neural network model has been established to simulate the operation of a waste water treatment facilities. The comparison of prediction results with the on-spot measurements shows the model, the model is accurate and this model can also be used to realize intelligentized on-line control of the wastewater processing process.

  15. Updating dopamine reward signals.

    Science.gov (United States)

    Schultz, Wolfram

    2013-04-01

    Recent work has advanced our knowledge of phasic dopamine reward prediction error signals. The error signal is bidirectional, reflects well the higher order prediction error described by temporal difference learning models, is compatible with model-free and model-based reinforcement learning, reports the subjective rather than physical reward value during temporal discounting and reflects subjective stimulus perception rather than physical stimulus aspects. Dopamine activations are primarily driven by reward, and to some extent risk, whereas punishment and salience have only limited activating effects when appropriate controls are respected. The signal is homogeneous in terms of time course but heterogeneous in many other aspects. It is essential for synaptic plasticity and a range of behavioural learning situations.

  16. Forward shift of feeding buzz components of dolphins and belugas during associative learning reveals a likely connection to reward expectation, pleasure and brain dopamine activation.

    Science.gov (United States)

    Ridgway, S H; Moore, P W; Carder, D A; Romano, T A

    2014-08-15

    For many years, we heard sounds associated with reward from dolphins and belugas. We named these pulsed sounds victory squeals (VS), as they remind us of a child's squeal of delight. Here we put these sounds in context with natural and learned behavior. Like bats, echolocating cetaceans produce feeding buzzes as they approach and catch prey. Unlike bats, cetaceans continue their feeding buzzes after prey capture and the after portion is what we call the VS. Prior to training (or conditioning), the VS comes after the fish reward; with repeated trials it moves to before the reward. During training, we use a whistle or other sound to signal a correct response by the animal. This sound signal, named a secondary reinforcer (SR), leads to the primary reinforcer, fish. Trainers usually name their whistle or other SR a bridge, as it bridges the time gap between the correct response and reward delivery. During learning, the SR becomes associated with reward and the VS comes after the SR rather than after the fish. By following the SR, the VS confirms that the animal expects a reward. Results of early brain stimulation work suggest to us that SR stimulates brain dopamine release, which leads to the VS. Although there are no direct studies of dopamine release in cetaceans, we found that the timing of our VS is consistent with a response after dopamine release. We compared trained vocal responses to auditory stimuli with VS responses to SR sounds. Auditory stimuli that did not signal reward resulted in faster responses by a mean of 151 ms for dolphins and 250 ms for belugas. In laboratory animals, there is a 100 to 200 ms delay for dopamine release. VS delay in our animals is similar and consistent with vocalization after dopamine release. Our novel observation suggests that the dopamine reward system is active in cetacean brains. PMID:25122919

  17. Efficient universal computing architectures for decoding neural activity.

    Directory of Open Access Journals (Sweden)

    Benjamin I Rapoport

    Full Text Available The ability to decode neural activity into meaningful control signals for prosthetic devices is critical to the development of clinically useful brain- machine interfaces (BMIs. Such systems require input from tens to hundreds of brain-implanted recording electrodes in order to deliver robust and accurate performance; in serving that primary function they should also minimize power dissipation in order to avoid damaging neural tissue; and they should transmit data wirelessly in order to minimize the risk of infection associated with chronic, transcutaneous implants. Electronic architectures for brain- machine interfaces must therefore minimize size and power consumption, while maximizing the ability to compress data to be transmitted over limited-bandwidth wireless channels. Here we present a system of extremely low computational complexity, designed for real-time decoding of neural signals, and suited for highly scalable implantable systems. Our programmable architecture is an explicit implementation of a universal computing machine emulating the dynamics of a network of integrate-and-fire neurons; it requires no arithmetic operations except for counting, and decodes neural signals using only computationally inexpensive logic operations. The simplicity of this architecture does not compromise its ability to compress raw neural data by factors greater than [Formula: see text]. We describe a set of decoding algorithms based on this computational architecture, one designed to operate within an implanted system, minimizing its power consumption and data transmission bandwidth; and a complementary set of algorithms for learning, programming the decoder, and postprocessing the decoded output, designed to operate in an external, nonimplanted unit. The implementation of the implantable portion is estimated to require fewer than 5000 operations per second. A proof-of-concept, 32-channel field-programmable gate array (FPGA implementation of this portion

  18. Deficits in context-dependent adaptive coding of reward in schizophrenia

    OpenAIRE

    Kirschner, Matthias; Hager, Oliver M.; Bischof, Martin; Hartmann-Riemer, Matthias N; Kluge, Agne; Seifritz, Erich; Tobler, Philippe N.; Kaiser, Stefan

    2016-01-01

    Theoretical principles of information processing and empirical findings suggest that to efficiently represent all possible rewards in the natural environment, reward-sensitive neurons have to adapt their coding range dynamically to the current reward context. Adaptation ensures that the reward system is most sensitive for the most likely rewards, enabling the system to efficiently represent a potentially infinite range of reward information. A deficit in neural adaptation would prevent precis...

  19. Memory and reward systems coproduce 'nostalgic' experiences in the brain.

    Science.gov (United States)

    Oba, Kentaro; Noriuchi, Madoka; Atomi, Tomoaki; Moriguchi, Yoshiya; Kikuchi, Yoshiaki

    2016-07-01

    People sometimes experience an emotional state known as 'nostalgia', which involves experiencing predominantly positive emotions while remembering autobiographical events. Nostalgia is thought to play an important role in psychological resilience. Previous neuroimaging studies have shown involvement of memory and reward systems in such experiences. However, it remains unclear how these two systems are collaboratively involved with nostalgia experiences. Here, we conducted a functional magnetic resonance imaging study of healthy females to investigate the relationship between memory-reward co-activation and nostalgia, using childhood-related visual stimuli. Moreover, we examined the factors constituting nostalgia and their neural correlates. We confirmed the presence of nostalgia-related activity in both memory and reward systems, including the hippocampus (HPC), substantia nigra/ventral tegmental area (SN/VTA), and ventral striatum (VS). We also found significant HPC-VS co-activation, with its strength correlating with individual 'nostalgia tendencies'. Factor analyses showed that two dimensions underlie nostalgia: emotional and personal significance and chronological remoteness, with the former correlating with caudal SN/VTA and left anterior HPC activity, and the latter correlating with rostral SN/VTA activity. These findings demonstrate the cooperative activity of memory and reward systems, where each system has a specific role in the construction of the factors that underlie the experience of nostalgia. PMID:26060325

  20. Effects of reinforcement-blocking doses of pimozide on neural systems driven by rewarding stimulation of the MFB: a /sup 14/C-2-deoxyglucose analysis

    Energy Technology Data Exchange (ETDEWEB)

    Gomita, Y.; Gallistel, C.R.

    1982-10-01

    An analysis by means of /sup 14/C-2-deoxyglucose autoradiography of the neural systems unilaterally activated by the reinforcing stimulation used in the two accompanying papers revealed strong and reliable effects in the nucleus of the diagonal band of Broca, in the medial forebrain bundle (MFB) and/or the fornix throughout the diencephalon, and in the part of the anterior ventral tegmentum where the dopaminergic projection to the lateral habenula originates. The terminal fields of the dopaminergic forebrain projections were not affected, but there was bilateral suppression of lateral habenular activity. A second experiment found that the same systems are still activated by (automatically administered) reinforcing stimulation in rats treated with reinforcement blocking doses of pimozide. The only clear effect of pimozide was to reverse the bilateral suppressive effect of the stimulation on lateral habenular activity. Animals treated with pimozide show greatly elevated activity in the lateral habenula, whether or not they receive reinforcing stimulation. The results suggest that pimozide's effect on reinforcement is mediated by the circuitry interconnecting the lateral habenula with the nucleus of the diagonal band of Broca and/or the anterior ventral tegmentum.

  1. Neural sensing of electrical activity with stretchable microelectrode arrays.

    Science.gov (United States)

    Yu, Zhe; Graudejus, Oliver; Lacour, Stéphanie P; Wagner, Sigurd; Morrison, Barclay

    2009-01-01

    Sensing neural activity within mechanically active tissues poses particular hurdles because most electrodes are much stiffer than biological tissues. As the tissue deforms, the rigid electrodes may damage the surrounding tissue. The problem is exacerbated when sensing neural activity in experimental models of traumatic brain injury (TBI) which is caused by the rapid and large deformation of brain tissue. We have developed a stretchable microelectrode array (SMEA) that can withstand large elastic deformations (>5% biaxial strain) while continuing to function. The SMEA were fabricated from thin metal conductors patterned on polydimethylsiloxane (PDMS) and encapsulated with a photo-patternable silicone. SMEA were used to record spontaneous activity from brain slice cultures, as well as evoked activity after stimulating through SMEA electrodes. Slices of brain tissue were grown on SMEA in long-term culture and then mechanically injured with our well-characterized in vitro injury model by stretching the SMEA and the adherent culture, which was confirmed by image analysis. Because brain tissue was grown on the substrate-integrated SMEA, post-injury changes in electrophysiological function were normalized to pre-injury function since the SMEA deformed with the tissue and remained in place during mechanical stimulation. The combination of our injury model and SMEA could help elucidate mechanisms responsible for post-traumatic neuronal dysfunction in the quest for TBI therapies. The SMEA may have additional sensing applications in other mechanically active tissues such as peripheral nerve and heart. PMID:19964344

  2. A neural network model for olfactory glomerular activity prediction

    Science.gov (United States)

    Soh, Zu; Tsuji, Toshio; Takiguchi, Noboru; Ohtake, Hisao

    2012-12-01

    Recently, the importance of odors and methods for their evaluation have seen increased emphasis, especially in the fragrance and food industries. Although odors can be characterized by their odorant components, their chemical information cannot be directly related to the flavors we perceive. Biological research has revealed that neuronal activity related to glomeruli (which form part of the olfactory system) is closely connected to odor qualities. Here we report on a neural network model of the olfactory system that can predict glomerular activity from odorant molecule structures. We also report on the learning and prediction ability of the proposed model.

  3. A genetic polymorphism of the endogenous opioid dynorphin modulates monetary reward anticipation in the corticostriatal loop.

    Directory of Open Access Journals (Sweden)

    Mikhail Votinov

    Full Text Available The dynorphin/κ-opioid receptor (KOP-R system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype of the variable nucleotide tandem repeat (68-bp VNTR functional polymorphism of the prodynorphin (PDYN gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype. We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse.

  4. Self-affirmation activates brain systems associated with self-related processing and reward and is reinforced by future orientation.

    Science.gov (United States)

    Cascio, Christopher N; O'Donnell, Matthew Brook; Tinney, Francis J; Lieberman, Matthew D; Taylor, Shelley E; Strecher, Victor J; Falk, Emily B

    2016-04-01

    Self-affirmation theory posits that people are motivated to maintain a positive self-view and that threats to perceived self-competence are met with resistance. When threatened, self-affirmations can restore self-competence by allowing individuals to reflect on sources of self-worth, such as core values. Many questions exist, however, about the underlying mechanisms associated with self-affirmation. We examined the neural mechanisms of self-affirmation with a task developed for use in a functional magnetic resonance imaging environment. Results of a region of interest analysis demonstrated that participants who were affirmed (compared with unaffirmed participants) showed increased activity in key regions of the brain's self-processing (medial prefrontal cortex + posterior cingulate cortex) and valuation (ventral striatum + ventral medial prefrontal cortex) systems when reflecting on future-oriented core values (compared with everyday activities). Furthermore, this neural activity went on to predict changes in sedentary behavior consistent with successful affirmation in response to a separate physical activity intervention. These results highlight neural processes associated with successful self-affirmation, and further suggest that key pathways may be amplified in conjunction with prospection.

  5. Altered resting-state neural activity and changes following a craving behavioral intervention for Internet gaming disorder.

    Science.gov (United States)

    Zhang, Jin-Tao; Yao, Yuan-Wei; Potenza, Marc N; Xia, Cui-Cui; Lan, Jing; Liu, Lu; Wang, Ling-Jiao; Liu, Ben; Ma, Shan-Shan; Fang, Xiao-Yi

    2016-01-01

    Internet gaming disorder (IGD) has become a serious mental health issue worldwide. Evaluating the benefits of interventions for IGD is of great significance. Thirty-six young adults with IGD and 19 healthy comparison (HC) subjects were recruited and underwent resting-state fMRI scanning. Twenty IGD subjects participated in a group craving behavioral intervention (CBI) and were scanned before and after the intervention. The remaining 16 IGD subjects did not receive an intervention. The results showed that IGD subjects showed decreased amplitude of low fluctuation in the orbital frontal cortex and posterior cingulate cortex, and exhibited increased resting-state functional connectivity between the posterior cingulate cortex and dorsolateral prefrontal cortex, compared with HC subjects. Compared with IGD subjects who did not receive the intervention, those receiving CBI demonstrated significantly reduced resting-state functional connectivity between the: (1) orbital frontal cortex with hippocampus/parahippocampal gyrus; and, (2) posterior cingulate cortex with supplementary motor area, precentral gyrus, and postcentral gyrus. These findings suggest that IGD is associated with abnormal resting-state neural activity in reward-related, default mode and executive control networks. Thus, the CBI may exert effects by reducing interactions between regions within a reward-related network, and across the default mode and executive control networks. PMID:27381822

  6. MONITORING EXTRACELLULAR PH, OXYGEN, AND DOPAMINE DURING REWARD DELIVERY IN THE STRIATUM OF PRIMATES

    Directory of Open Access Journals (Sweden)

    Jennifer L Ariansen

    2012-07-01

    Full Text Available Dopamine projections that extend from the ventral tegmental area to the striatum have been implicated in the biological basis for behaviors associated with reward and addiction. Until recently, it has been difficult to evaluate the complex balance of energy utilization and neural activity in the striatum. Many techniques such as electrophysiology, functional magnetic resonance imaging (fMRI, and fast-scan cyclic voltammetry have been employed to monitor these neurochemical and neurophysiological changes. In this brain region, physiological responses to cues and rewards cause local, transient pH changes. Oxygen and pH are coupled in the brain through a complex system of blood flow and metabolism as a result of transient neural activity. Indeed, this balance is at the heart of imaging studies such as fMRI. To this end, we measured pH and O2 changes with fast-scan cyclic voltammetry in the striatum as indices of changes in metabolism and blood flow in vivo in three Macaca mulatta monkeys. The animals were presented with Pavlovian conditioned cues that predicted different probabilities of liquid reward. They also received free reward without predictive cues. The primary change consisted of pH shifts in the striatal extracellular environment following the reward predicting cues or the free reward. We observed three types of cue responses which consisted of purely basic pH shifts, basic pH shifts followed by acidic pH shifts, and purely acidic pH shifts. These responses increased with reward probability. The pH changes were accompanied by increases in extracellular O2. The changes in pH and extracellular O2 are consistent with current theories of metabolism and blood flow. The findings suggest a role of these chemical responses in neuronal reward processing

  7. Estimation of spatiotemporal neural activity using radial basis function networks.

    Science.gov (United States)

    Anderson, R W; Das, S; Keller, E L

    1998-12-01

    We report a method using radial basis function (RBF) networks to estimate the time evolution of population activity in topologically organized neural structures from single-neuron recordings. This is an important problem in neuroscience research, as such estimates may provide insights into systems-level function of these structures. Since single-unit neural data tends to be unevenly sampled and highly variable under similar behavioral conditions, obtaining such estimates is a difficult task. In particular, a class of cells in the superior colliculus called buildup neurons can have very narrow regions of saccade vectors for which they discharge at high rates but very large surround regions over which they discharge at low, but not zero, levels. Estimating the dynamic movement fields for these cells for two spatial dimensions at closely spaced timed intervals is a difficult problem, and no general method has been described that can be applied to all buildup cells. Estimation of individual collicular cells' spatiotemporal movement fields is a prerequisite for obtaining reliable two-dimensional estimates of the population activity on the collicular motor map during saccades. Therefore, we have developed several computational-geometry-based algorithms that regularize the data before computing a surface estimation using RBF networks. The method is then expanded to the problem of estimating simultaneous spatiotemporal activity occurring across the superior colliculus during a single movement (the inverse problem). In principle, this methodology could be applied to any neural structure with a regular, two-dimensional organization, provided a sufficient spatial distribution of sampled neurons is available.

  8. Relative reward preference in primate orbitofrontal cortex.

    Science.gov (United States)

    Tremblay, L; Schultz, W

    1999-04-22

    The orbital part of prefrontal cortex appears to be crucially involved in the motivational control of goal-directed behaviour. Patients with lesions of orbitofrontal cortex show impairments in making decisions about the expected outcome of actions. Monkeys with orbitofrontal lesions respond abnormally to changes in reward expectations and show altered reward preferences. As rewards constitute basic goals of behaviour, we investigated here how neurons in the orbitofrontal cortex of monkeys process information about liquid and food rewards in a typical frontal task, spatial delayed responding. The activity of orbitofrontal neurons increases in response to reward-predicting signals, during the expectation of rewards, and after the receipt of rewards. Neurons discriminate between different rewards, mainly irrespective of the spatial and visual features of reward-predicting stimuli and behavioural reactions. Most reward discriminations reflect the animals' relative preference among the available rewards, as expressed by their choice behaviour, rather than physical reward properties. Thus, neurons in the orbitofrontal cortex appear to process the motivational value of rewarding outcomes of voluntary action. PMID:10227292

  9. Multifractal detrended fluctuation analysis of optogenetic modulation of neural activity

    Science.gov (United States)

    Kumar, S.; Gu, L.; Ghosh, N.; Mohanty, S. K.

    2013-02-01

    Here, we introduce a computational procedure to examine whether optogenetically activated neuronal firing recordings could be characterized as multifractal series. Optogenetics is emerging as a valuable experimental tool and a promising approach for studying a variety of neurological disorders in animal models. The spiking patterns from cortical region of the brain of optogenetically-stimulated transgenic mice were analyzed using a sophisticated fluctuation analysis method known as multifractal detrended fluctuation analysis (MFDFA). We observed that the optogenetically-stimulated neural firings are consistent with a multifractal process. Further, we used MFDFA to monitor the effect of chemically induced pain (formalin injection) and optogenetic treatment used to relieve the pain. In this case, dramatic changes in parameters characterizing a multifractal series were observed. Both the generalized Hurst exponent and width of singularity spectrum effectively differentiates the neural activities during control and pain induction phases. The quantitative nature of the analysis equips us with better measures to quantify pain. Further, it provided a measure for effectiveness of the optogenetic stimulation in inhibiting pain. MFDFA-analysis of spiking data from other deep regions of the brain also turned out to be multifractal in nature, with subtle differences in the parameters during pain-induction by formalin injection and inhibition by optogenetic stimulation. Characterization of neuronal firing patterns using MFDFA will lead to better understanding of neuronal response to optogenetic activation and overall circuitry involved in the process.

  10. How to be patient. The ability to wait for a reward depends on menstrual cycle phase and feedback-related activity.

    Directory of Open Access Journals (Sweden)

    Luise eReimers

    2014-12-01

    Full Text Available Dopamine (DA plays a major role in reinforcement learning with increases promoting reward sensitivity (Go learning while decreases facilitate the avoidance of negative outcomes (NoGo learning. This is also reflected in adaptations of response time: higher levels of DA enhance speeding up to get a reward, whereas lower levels favor slowing down. The steroid hormones estradiol and progesterone have been shown to modulate dopaminergic tone. Here, we tested fourteen women twice during their menstrual cycle, during the follicular (FP and the luteal phase (LP, applying functional magnetic resonance imaging while they performed a feedback learning task. Subsequent behavioral testing assessed response time preferences with a clock task, in which subjects had to explore the optimal response time (RT to maximize reward. In the FP subjects displayed a greater learning-related change of their RT than during the LP, when they were required to slow down. Final RTs in the slow condition were also predicted by feedback-related brain activation, but only in the FP. Increased activation of the inferior frontal junction and rostral cingulate zone was thereby predictive of slower and thus better adapted final RTs. Conversely, final RT was faster and less optimal for reward maximization if activation in the ventromedial prefrontal cortex was enhanced. These findings show that hormonal shifts across the menstrual cycle affect adaptation of response speed during reward acquisition with higher RT adjustment in the FP in the condition that requires slowing down. Since high estradiol levels during the FP increase synaptic DA levels, this conforms well to our hypothesis that estradiol supports Go learning at the expense of NoGo learning. Brain-behavior correlations further indicated that the compensatory capacity to counteract the follicular Go bias may be linked to the ability to more effectively monitor action outcomes and suppress bottom-up reward desiring during

  11. Reduced Caudate and Nucleus Accumbens Response to Rewards in Unmedicated Subjects with Major Depressive Disorder

    Science.gov (United States)

    Pizzagalli, Diego A.; Holmes, Avram J.; Dillon, Daniel G.; Goetz, Elena L.; Birk, Jeffrey L.; Bogdan, Ryan; Dougherty, Darin D.; Iosifescu, Dan V.; Rauch, Scott L.; Fava, Maurizio

    2009-01-01

    Objective Major depressive disorder (MDD) is characterized by impaired reward processing, possibly due to dysfunction in the basal ganglia. However, few neuroimaging studies of depression have distinguished between anticipatory and consummatory phases of reward processing. Using functional magnetic resonance imaging (fMRI) and a task that dissociates anticipatory and consummatory phases of reward processing, the authors tested the hypothesis that MDD participants would show reduced reward-related responses in basal ganglia structures. Method A monetary incentive delay task was presented to 30 unmedicated MDD subjects and 31 healthy comparison subjects during fMRI scanning. Whole-brain analyses focused on neural responses to reward-predicting cues and rewarding outcomes (i.e., monetary gains). Secondary analyses focused on the relationship between anhedonic symptoms and basal ganglia volumes. Results Relative to comparison subjects, MDD participants showed significantly weaker responses to gains in the left nucleus accumbens and bilateral caudate. Group differences in these regions were specific to rewarding outcomes and did not generalize to neutral or negative outcomes, although relatively reduced responses to monetary penalties in MDD emerged in other caudate regions. By contrast, evidence for group differences during reward anticipation was weaker, although MDD subjects showed reduced activation to reward cues in a small sector of the left posterior putamen. Among MDD subjects, anhedonic symptoms and depression severity were associated with reduced bilateral caudate volume. Conclusions These results indicate that basal ganglia dysfunction in MDD may affect the consummatory phase of reward processing. Additionally, morphometric results suggest that anhedonia in MDD is related to caudate volume. PMID:19411368

  12. Individual differences in the time course of reward processing: Stage-specific links with depression and impulsivity.

    Science.gov (United States)

    Novak, Brittni K; Novak, Keisha D; Lynam, Donald R; Foti, Dan

    2016-09-01

    Reward dysfunction has been implicated in a wide range of psychological disorders, including internalizing and externalizing psychopathology. Basic neuroscience research has shown that reward is a multistage process, yet it is unclear how specific stages relate to individual differences in reward sensitivity. The current study utilized event-related potentials elicited during a monetary incentive task to parse sub-stages within anticipatory and consummatory reward processing. Effects of depressive symptoms and trait impulsivity were examined at each sub-stage (N=92). Reward anticipation modulated neural activity across three sub-stages: cue detection (cue-P3), approach behavior (contingent negative variation, CNV), and outcome anticipation (stimulus preceding negativity). Reward delivery modulated activity across two sub-stages: initial evaluation (reward positivity, RewP), and allocation of attention (feedback-P3). Sensation seeking predicted faster reaction times, as well as cue-P3 and RewP amplitudes. Depression and lack of premeditation interacted to predict CNV and RewP amplitudes. Results demonstrate that individual differences in reward functioning are stage-specific. PMID:27396750

  13. Individual differences in the time course of reward processing: Stage-specific links with depression and impulsivity.

    Science.gov (United States)

    Novak, Brittni K; Novak, Keisha D; Lynam, Donald R; Foti, Dan

    2016-09-01

    Reward dysfunction has been implicated in a wide range of psychological disorders, including internalizing and externalizing psychopathology. Basic neuroscience research has shown that reward is a multistage process, yet it is unclear how specific stages relate to individual differences in reward sensitivity. The current study utilized event-related potentials elicited during a monetary incentive task to parse sub-stages within anticipatory and consummatory reward processing. Effects of depressive symptoms and trait impulsivity were examined at each sub-stage (N=92). Reward anticipation modulated neural activity across three sub-stages: cue detection (cue-P3), approach behavior (contingent negative variation, CNV), and outcome anticipation (stimulus preceding negativity). Reward delivery modulated activity across two sub-stages: initial evaluation (reward positivity, RewP), and allocation of attention (feedback-P3). Sensation seeking predicted faster reaction times, as well as cue-P3 and RewP amplitudes. Depression and lack of premeditation interacted to predict CNV and RewP amplitudes. Results demonstrate that individual differences in reward functioning are stage-specific.

  14. Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum.

    Directory of Open Access Journals (Sweden)

    Saori C Tanaka

    Full Text Available BACKGROUND: The ability to select an action by considering both delays and amount of reward outcome is critical for maximizing long-term benefits. Although previous animal experiments on impulsivity have suggested a role of serotonin in behaviors requiring prediction of delayed rewards, the underlying neural mechanism is unclear. METHODOLOGY/PRINCIPAL FINDINGS: To elucidate the role of serotonin in the evaluation of delayed rewards, we performed a functional brain imaging experiment in which subjects chose small-immediate or large-delayed liquid rewards under dietary regulation of tryptophan, a precursor of serotonin. A model-based analysis revealed that the activity of the ventral part of the striatum was correlated with reward prediction at shorter time scales, and this correlated activity was stronger at low serotonin levels. By contrast, the activity of the dorsal part of the striatum was correlated with reward prediction at longer time scales, and this correlated activity was stronger at high serotonin levels. CONCLUSIONS/SIGNIFICANCE: Our results suggest that serotonin controls the time scale of reward prediction by differentially regulating activities within the striatum.

  15. Early Years Education: Are Young Students Intrinsically or Extrinsically Motivated Towards School Activities? A Discussion about the Effects of Rewards on Young Children's Learning

    Science.gov (United States)

    Theodotou, Evgenia

    2014-01-01

    Rewards can reinforce and at the same time forestall young children's willingness to learn. However, they are broadly used in the field of education, especially in early years settings, to stimulate children towards learning activities. This paper reviews the theoretical and research literature related to intrinsic and extrinsic motivational…

  16. Classification of the extracellular fields produced by activated neural structures

    Directory of Open Access Journals (Sweden)

    Perry Danielle

    2005-09-01

    Full Text Available Abstract Background Classifying the types of extracellular potentials recorded when neural structures are activated is an important component in understanding nerve pathophysiology. Varying definitions and approaches to understanding the factors that influence the potentials recorded during neural activity have made this issue complex. Methods In this article, many of the factors which influence the distribution of electric potential produced by a traveling action potential are discussed from a theoretical standpoint with illustrative simulations. Results For an axon of arbitrary shape, it is shown that a quadrupolar potential is generated by action potentials traveling along a straight axon. However, a dipole moment is generated at any point where an axon bends or its diameter changes. Next, it is shown how asymmetric disturbances in the conductivity of the medium surrounding an axon produce dipolar potentials, even during propagation along a straight axon. Next, by studying the electric fields generated by a dipole source in an insulating cylinder, it is shown that in finite volume conductors, the extracellular potentials can be very different from those in infinite volume conductors. Finally, the effects of impulses propagating along axons with inhomogeneous cable properties are analyzed. Conclusion Because of the well-defined factors affecting extracellular potentials, the vague terms far-field and near-field potentials should be abandoned in favor of more accurate descriptions of the potentials.

  17. Brain structure and neural network of the reward/loss process in decision making%决策奖损加工的脑神经结构与环路

    Institute of Scientific and Technical Information of China (English)

    魏巍; 郭宗君

    2015-01-01

    目的 以国内外2005~2014年发表的针对与决策机制有关的关于奖赏、损失的神经结构及环路,及其与某些身心疾病关系的文献,综述决策奖损加工的脑神经结构及其意义,可以在一定程度上揭示行为决策的神经结构和网络机制,及其与某些身心疾病的关系.方法 2014年9月在PubMed、Science-Direct、中国知网和万方数据库等数据库,以“决策”、“奖赏”、“损失规避”等检索词,检索国内外有关决策奖损加工相关脑神经结构,及其与某些身心疾病的关系的研究.结果 检索文献110篇,纳入分析40篇.结果总结了大脑奖损结构及其关系在决策加工过程中的作用机制,以及两系统失衡所导致的身心疾病.结论 大部分文献认为奖赏趋近系统和损失规避系统的协调加工共同影响人们的行为决策,一旦上述系统平衡失调,则可出现行为决策障碍,产生一些身心疾病,但与决策行为模式相关的精确的神经机制尚须进一步研究.%Objective Based on the literatures published between 2005 and 2014,review the correlation between reward/loss of brain structure and neural network,and its relationship with physical and mental ailments,aim to reveal the neural structure and network of behavioral decision mechanism.Methods By retrieving literatures on PubMed,ScienceDirect,CNKI and Wanfang database in September 2014,we used "decision making","reward","loss aversion" and so on as the key words.Results Totally 40 papers were enrolled,the result reviewed the clinic meaning and the brain structure and neural network of the reward/loss process in decision making.Conclusion Most studies found the reward/loss decision making mechanism of the brain structure and the physical and mental ailments caused by the two systems imbalance,but related to the precise decision making neural mechanism has yet to be studied further.

  18. Visualization and manipulation of neural activity in the developing vertebrate nervous system

    Directory of Open Access Journals (Sweden)

    Jiayi eZhang

    2011-11-01

    Full Text Available Neural activity during vertebrate development has been unambiguously shown to play a critical role in sculpting circuit formation and function. Patterned neural activity in various parts of the developing nervous system is thought to modulate neurite outgrowth, axon targeting and synapse refinement. The nature and role of patterned neural activity during development has been classically studied with in vitro preparations using pharmacological manipulations. In this review we discuss newly available and developing molecular genetic tools for the visualization and manipulation of neural activity patterns specifically during development.

  19. The role of reward in word learning and its implications for language acquisition.

    Science.gov (United States)

    Ripollés, Pablo; Marco-Pallarés, Josep; Hielscher, Ulrike; Mestres-Missé, Anna; Tempelmann, Claus; Heinze, Hans-Jochen; Rodríguez-Fornells, Antoni; Noesselt, Toemme

    2014-11-01

    The exact neural processes behind humans' drive to acquire a new language--first as infants and later as second-language learners--are yet to be established. Recent theoretical models have proposed that during human evolution, emerging language-learning mechanisms might have been glued to phylogenetically older subcortical reward systems, reinforcing human motivation to learn a new language. Supporting this hypothesis, our results showed that adult participants exhibited robust fMRI activation in the ventral striatum (VS)--a core region of reward processing--when successfully learning the meaning of new words. This activation was similar to the VS recruitment elicited using an independent reward task. Moreover, the VS showed enhanced functional and structural connectivity with neocortical language areas during successful word learning. Together, our results provide evidence for the neural substrate of reward and motivation during word learning. We suggest that this strong functional and anatomical coupling between neocortical language regions and the subcortical reward system provided a crucial advantage in humans that eventually enabled our lineage to successfully acquire linguistic skills.

  20. Neural oscillations: beta band activity across motor networks.

    Science.gov (United States)

    Khanna, Preeya; Carmena, Jose M

    2015-06-01

    Local field potential (LFP) activity in motor cortical and basal ganglia regions exhibits prominent beta (15-40Hz) oscillations during reaching and grasping, muscular contraction, and attention tasks. While in vitro and computational work has revealed specific mechanisms that may give rise to the frequency and duration of this oscillation, there is still controversy about what behavioral processes ultimately drive it. Here, simultaneous behavioral and large-scale neural recording experiments from non-human primate and human subjects are reviewed in the context of specific hypotheses about how beta band activity is generated. Finally, a new experimental paradigm utilizing operant conditioning combined with motor tasks is proposed as a way to further investigate this oscillation. PMID:25528615

  1. Rewards and punishments, goal-directed behavior and consciousness.

    Science.gov (United States)

    Ressler, Newton

    2004-03-01

    A parsimonious account of consciousness is given in which it emerges as a direct consequence of basic neural processes without the necessity of any higher order system. In this model, pleasant or unpleasant conscious feelings of various stimuli in the environment stem from their higher order associations to innate rewards or punishments. When a conditioned stimulus (CS) is associated with a reward, it acquires pleasant feelings due to the temporal correlation of the activations representing its sensory features with those representing innate visceral reward acquisition processes. When the CS is associated with the punishment, it acquires unpleasant feelings due to the correlation of its sensory features with the innate visceral inhibition of punishment acquisition processes. The correlations involve coherent activity between the sensory cortex, the limbic system, the orbital and medial prefrontal cortex, and more lateral prefrontal areas where stimuli can be incorporated into working memory. A conscious act involves responses (or attempts to improve the environment) made on the basis of the feelings of such stimuli. Covert memory scans, in which comparisons are made of the reward and punishment associations of the outcomes of previous responses, are related to the motivations and attention behind the conscious selection of a current response. This model appears to fit together various empirical observations. Its relations to some higher or more abstract mental processes, and some evolutionary implications are discussed. PMID:15036931

  2. Age-related changes in midbrain dopaminergic regulation of the human reward system

    Science.gov (United States)

    Dreher, Jean-Claude; Meyer-Lindenberg, Andreas; Kohn, Philip; Berman, Karen Faith

    2008-01-01

    The dopamine system, which plays a crucial role in reward processing, is particularly vulnerable to aging. Significant losses over a normal lifespan have been reported for dopamine receptors and transporters, but very little is known about the neurofunctional consequences of this age-related dopaminergic decline. In animals, a substantial body of data indicates that dopamine activity in the midbrain is tightly associated with reward processing. In humans, although indirect evidence from pharmacological and clinical studies also supports such an association, there has been no direct demonstration of a link between midbrain dopamine and reward-related neural response. Moreover, there are no in vivo data for alterations in this relationship in older humans. Here, by using 6-[18F]FluoroDOPA (FDOPA) positron emission tomography (PET) and event-related 3T functional magnetic resonance imaging (fMRI) in the same subjects, we directly demonstrate a link between midbrain dopamine synthesis and reward-related prefrontal activity in humans, show that healthy aging induces functional alterations in the reward system, and identify an age-related change in the direction of the relationship (from a positive to a negative correlation) between midbrain dopamine synthesis and prefrontal activity. These results indicate an age-dependent dopaminergic tuning mechanism for cortical reward processing and provide system-level information about alteration of a key neural circuit in healthy aging. Taken together, our findings provide an important characterization of the interactions between midbrain dopamine function and the reward system in healthy young humans and older subjects, and identify the changes in this regulatory circuit that accompany aging. PMID:18794529

  3. Basal ganglia orient eyes to reward.

    Science.gov (United States)

    Hikosaka, Okihide; Nakamura, Kae; Nakahara, Hiroyuki

    2006-02-01

    Expectation of reward motivates our behaviors and influences our decisions. Indeed, neuronal activity in many brain areas is modulated by expected reward. However, it is still unclear where and how the reward-dependent modulation of neuronal activity occurs and how the reward-modulated signal is transformed into motor outputs. Recent studies suggest an important role of the basal ganglia. Sensorimotor/cognitive activities of neurons in the basal ganglia are strongly modulated by expected reward. Through their abundant outputs to the brain stem motor areas and the thalamocortical circuits, the basal ganglia appear capable of producing body movements based on expected reward. A good behavioral measure to test this hypothesis is saccadic eye movement because its brain stem mechanism has been extensively studied. Studies from our laboratory suggest that the basal ganglia play a key role in guiding the gaze to the location where reward is available. Neurons in the caudate nucleus and the substantia nigra pars reticulata are extremely sensitive to the positional difference in expected reward, which leads to a bias in excitability between the superior colliculi such that the saccade to the to-be-rewarded position occurs more quickly. It is suggested that the reward modulation occurs in the caudate where cortical inputs carrying spatial signals and dopaminergic inputs carrying reward-related signals are integrated. These data support a specific form of reinforcement learning theories, but also suggest further refinement of the theory.

  4. Reward deficiency and anti-reward in pain chronification.

    Science.gov (United States)

    Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

    2016-09-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). PMID:27246519

  5. Deletion of dopamine D1 and D3 receptors differentially affects spontaneous behaviour and cocaine-induced locomotor activity, reward and CREB phosphorylation.

    Science.gov (United States)

    Karasinska, Joanna M; George, Susan R; Cheng, Regina; O'Dowd, Brian F

    2005-10-01

    Co-localization of dopamine D1 and D3 receptors in striatal neurons suggests that these two receptors interact at a cellular level in mediating dopaminergic function including psychostimulant-induced behaviour. To study D1 and D3 receptor interactions in cocaine-mediated effects, cocaine-induced locomotion and reward in mice lacking either D1, D3 or both receptors were analysed. Spontaneous locomotor activity was increased in D1-/- and D1-/-D3-/- mice and D1-/-D3-/- mice did not exhibit habituation of spontaneous rearing activity. Cocaine (20 mg/kg) increased locomotor activity in wild-type and D3-/- mice, failed to stimulate activity in D1-/- mice and reduced activity in D1-/-D3-/- mice. In the conditioned place preference, all groups exhibited reward at 5, 10 and 20 mg/kg of cocaine. D1-/-D3-/- mice did not demonstrate preference at 2.5 mg/kg of cocaine although preference was observed in wild-type, D1-/- and D3-/- mice. The transcription factor cAMP-responsive element binding protein (CREB) is activated by phosphorylation in striatal regions following dopamine receptor activation. Striatal pCREB levels following acute cocaine were increased in wild-type and D3-/- mice and decreased in D1-/- and D1-/-D3-/- mice. After repeated administration of 2.5 mg/kg of cocaine, D1-/- mice had lower pCREB levels in caudate-putamen and nucleus accumbens. Our findings suggest that, although spontaneous and cocaine-induced horizontal activity depended mainly on the presence of the D1 receptor, there may be crosstalk between D1 and D3 receptors in rearing habituation and the perception of cocaine reward at low doses of the drug. Furthermore, alterations in pCREB levels were associated with changes in cocaine-induced locomotor activity but not reward. PMID:16197514

  6. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Science.gov (United States)

    Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

    2015-01-01

    Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects. PMID:25799565

  7. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Directory of Open Access Journals (Sweden)

    Björn Enzi

    Full Text Available Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15 and in healthy control subjects (n = 15 with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.

  8. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Science.gov (United States)

    Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

    2015-01-01

    Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.

  9. Effects of Near-Infrared Laser on Neural Cell Activity

    International Nuclear Information System (INIS)

    Near-infrared laser has been used to relieve patients from various kinds of pain caused by postherpetic neuralgesia, myofascial dysfunction, surgical and traumatic wound, cancer, and rheumatoid arthritis. Clinically, He-Ne (λ=632.8 nm, 780 nm) and Ga-Al-As (805 ± 25 nm) lasers are used to irradiate trigger points or nerve ganglion. However the precise mechanisms of such biological actions of the laser have not yet been resolved. Since laser therapy is often effective to suppress the pain caused by hyperactive excitation of sensory neurons, interactions with laser light and neural cells are suggested. As neural excitation requires large amount of energy liberated from adenosine triphosphate (ATP), we examined the effect of 830-nm laser irradiation on the energy metabolism of the rat central nervous system and isolated mitochondria from brain. The diode laser was applied for 15 min with irradiance of 4.8 W/cm2 on a 2 mm-diameter spot at the brain surface. Tissue ATP content of the irradiated area in the cerebral cortex was 19% higher than that of the non-treated area (opposite side of the cortex), whereas the ADP content showed no significant difference. Irradiation at another wavelength (652 nm) had no effect on either ATP or ADP contents. The temperature of the brain tissue was increased 4.5-5.0 deg. C during the irradiation of both 830-nm and 652-nm laser light. Direct irradiation of the mitochondrial suspension did not show any wavelength-dependent acceleration of respiration rate nor ATP synthesis. These results suggest that the increase in tissue ATP content did not result from the thermal effect, but from specific effect of the laser operated at 830 nm. Electrophysiological studies showed the hyperpolarization of membrane potential of isolated neurons and decrease in membrane resistance with irradiation of the laser, suggesting an activation of potassium channels. Intracellular ATP is reported to regulate some kinds of potassium channels. Possible mechanisms

  10. Studying modulation on simultaneously activated SSVEP neural networks by a cognitive task.

    Science.gov (United States)

    Wu, Zhenghua

    2014-01-01

    Since the discovery of steady-state visually evoked potential (SSVEP), it has been used in many fields. Numerous studies suggest that there exist three SSVEP neural networks in different frequency bands. An obvious phenomenon has been observed, that the amplitude and phase of SSVEP can be modulated by a cognitive task. Previous works have studied this modulation on separately activated SSVEP neural networks by a cognitive task. If two or more SSVEP neural networks are activated simultaneously in the process of a cognitive task, is the modulation on different SSVEP neural networks the same? In this study, two different SSVEP neural networks were activated simultaneously by two different frequency flickers, with a working memory task irrelevant to the flickers being conducted at the same time. The modulated SSVEP waves were compared with each other and to those only under one flicker in previous studies. The comparison results show that the cognitive task can modulate different SSVEP neural networks with a similar style.

  11. Impaired cross-talk between mesolimbic food reward processing and metabolic signaling predicts body mass index

    Directory of Open Access Journals (Sweden)

    Joe J Simon

    2014-10-01

    Full Text Available The anticipation of the pleasure derived from food intake drives the motivation to eat, and hence facilitate overconsumption of food which ultimately results in obesity. Brain imaging studies provide evidence that mesolimbic brain regions underlie both general as well as food related anticipatory reward processing. In light of this knowledge, the present study examined the neural responsiveness of the ventral striatum in participants with a broad BMI spectrum. The study differentiated between general (i.e. monetary and food related anticipatory reward processing. We recruited a sample of volunteers with greatly varying body weights, ranging from a low BMI (below 20 kg/m² over a normal (20 to 25 kg/m² and overweight (25 to 30 kg/m² BMI, to class I (30 to 35 kg/m² and class II (35 to 40 kg/m² obesity. A total of 24 participants underwent functional magnetic resonance imaging whilst performing both a food and monetary incentive delay task, which allows to measure neural activation during the anticipation of rewards. After the presentation of a cue indicating the amount of food or money to be won, participants had to react correctly in order to earn snack points or money coins which could then be exchanged for real food or money, respectively, at the end of the experiment. During the anticipation of both types of rewards, participants displayed activity in the ventral striatum, a region that plays a pivotal role in the anticipation of rewards. Additionally, we observed that specifically anticipatory food reward processing predicted the individual BMI (current and maximum lifetime. This relation was found to be mediated by impaired hormonal satiety signaling, i.e. increased leptin levels and insulin resistance. These findings suggest that heightened food reward motivation contributes to obesity through impaired metabolic signaling.

  12. Can simple interactions capture complex features of neural activity underlying behavior in a virtual reality environment?

    Science.gov (United States)

    Meshulam, Leenoy; Gauthier, Jeffrey; Brody, Carlos; Tank, David; Bialek, William

    The complex neural interactions which are abundant in most recordings of neural activity are relatively poorly understood. A prime example of such interactions can be found in the in vivo neural activity which underlies complex behaviors of mice, imaged in brain regions such as hippocampus and parietal cortex. Experimental techniques now allow us to accurately follow these neural interactions in the simultaneous activity of large neuronal populations of awake behaving animals. Here, we demonstrate that pairwise maximum entropy models can predict a surprising number of properties of the neural activity. The models, that are constrained with activity rates and interactions between pairs of neurons, are well fit to the activity `states' in the hippocampus and cortex of mice performing cognitive tasks while navigating in a virtual reality environment.

  13. Adolescent development of the reward system

    Directory of Open Access Journals (Sweden)

    Adriana Galván

    2010-02-01

    Full Text Available Adolescence is a developmental period characterized by increased reward-seeking behavior. Investigators have used functional magnetic resonance imaging (fMRI in conjunction with reward paradigms to test two opposing hypotheses about adolescent developmental changes in the striatum, a region implicated in reward processing. One hypothesis posits that the striatum is relatively hypo-responsive to rewards during adolescence, such that heightened reward-seeking behavior is necessary to achieve the same activation as adults. Another view suggests that during adolescence the striatal reward system is hyper-responsive, which subsequently results in greater reward-seeking. While evidence for both hypotheses has been reported, the field has generally converged on this latter hypothesis based on compelling evidence. In this review, I describe the evidence to support this notion, speculate on the disparate fMRI findings and conclude with future areas of inquiry to this fascinating question.

  14. Identification of non-linear models of neural activity in bold fmri

    DEFF Research Database (Denmark)

    Jacobsen, Daniel Jakup; Madsen, Kristoffer Hougaard; Hansen, Lars Kai

    2006-01-01

    Non-linear hemodynamic models express the BOLD signal as a nonlinear, parametric functional of the temporal sequence of local neural activity. Several models have been proposed for this neural activity. We identify one such parametric model by estimating the distribution of its parameters...

  15. Evidence-Based Systematic Review: Effects of Neuromuscular Electrical Stimulation on Swallowing and Neural Activation

    Science.gov (United States)

    Clark, Heather; Lazarus, Cathy; Arvedson, Joan; Schooling, Tracy; Frymark, Tobi

    2009-01-01

    Purpose: To systematically review the literature examining the effects of neuromuscular electrical stimulation (NMES) on swallowing and neural activation. The review was conducted as part of a series examining the effects of oral motor exercises (OMEs) on speech, swallowing, and neural activation. Method: A systematic search was conducted to…

  16. Endogenous GLP-1 mediates postprandial reductions in activation in central reward and satiety areas in patients with type 2 diabetes

    DEFF Research Database (Denmark)

    Ten Kulve, Jennifer S; Veltman, Dick J; van Bloemendaal, Liselotte;

    2015-01-01

    that endogenous GLP-1 has effects on CNS reward and satiety circuits. Methods This was a randomised, crossover, placebo-controlled intervention study, performed in a university medical centre in the Netherlands. We included patients with type 2 diabetes and healthy lean control subjects. Individuals were eligible...... if they were 40–65 years. Inclusion criteria for the healthy lean individuals included a BMI patients with type 2 diabetes included BMI >26 kg/m2, HbA1c levels between 42 and 69 mmol/mol (6.0–8.5%) and treatment for diabetes with only oral glucose......-lowering agents. We assessed CNS activation, defined as blood oxygen level dependent (BOLD) signal, in response to food pictures in obese patients with type 2 diabetes (n = 20) and healthy lean individuals (n = 20) using functional magnetic resonance imaging (fMRI). fMRI was performed in the fasted state...

  17. Determination of Activation Functions in A Feedforward Neural Network by using Genetic Algorithm

    Directory of Open Access Journals (Sweden)

    Oğuz ÜSTÜN

    2009-03-01

    Full Text Available In this study, activation functions of all layers of the multilayered feedforward neural network have been determined by using genetic algorithm. The main criteria that show the efficiency of the neural network is to approximate to the desired output with the same number nodes and connection weights. One of the important parameter to determine this performance is to choose a proper activation function. In the classical neural network designing, a network is designed by choosing one of the generally known activation function. In the presented study, a table has been generated for the activation functions. The ideal activation function for each node has been chosen from this table by using the genetic algorithm. Two dimensional regression problem clusters has been used to compare the performance of the classical static neural network and the genetic algorithm based neural network. Test results reveal that the proposed method has a high level approximation capacity.

  18. Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area

    Directory of Open Access Journals (Sweden)

    Julien eVitay

    2014-01-01

    Full Text Available Neural activity in dopaminergic areas such as the ventral tegmental area is influenced by timing processes, in particular by the temporal expectation of rewards during Pavlovian conditioning. Receipt of a reward at the expected time allows to compute reward-prediction errors which can drive learning in motor or cognitive structures. Reciprocally, dopamine plays an important role in the timing of external events. Several models of the dopaminergic system exist, but the substrate of temporal learning is rather unclear. In this article, we propose a neuro-computational model of the afferent network to the ventral tegmental area, including the lateral hypothalamus, the pedunculopontine nucleus, the amygdala, the ventromedial prefrontal cortex, the ventral basal ganglia (including the nucleus accumbens and the ventral pallidum, as well as the lateral habenula and the rostromedial tegmental nucleus. Based on a plausible connectivity and realistic learning rules, this neuro-computational model reproduces several experimental observations, such as the progressive cancellation of dopaminergic bursts at reward delivery, the appearance of bursts at the onset of reward-predicting cues or the influence of reward magnitude on activity in the amygdala and ventral tegmental area. While associative learning occurs primarily in the amygdala, learning of the temporal relationship between the cue and the associated reward is implemented as a dopamine-modulated coincidence detection mechanism in the nucleus accumbens.

  19. The effects of reward magnitude on reward processing: An averaged and single trial event-related potential study.

    Science.gov (United States)

    Meadows, Caroline C; Gable, Philip A; Lohse, Keith R; Miller, Matthew W

    2016-07-01

    From a neurobiological and motivational perspective, the feedback-related negativity (FRN) and reward positivity (RewP) event-related potential (ERP) components should increase with reward magnitude (reward associated with valence (success/failure) feedback). To test this hypothesis, we recorded participants' electroencephalograms while presenting them with potential monetary rewards ($0.00-$4.96) pre-trial for each trial of a reaction time task and presenting them with valence feedback post-trial. Averaged ERPs time-locked to valence feedback were extracted, and results revealed a valence by magnitude interaction for neural activity in the FRN/RewP time window. This interaction was driven by magnitude affecting RewP, but not FRN, amplitude. Moreover, single trial ERP analyses revealed a reliable correlation between magnitude and RewP, but not FRN, amplitude. Finally, P3b and late positive potential (LPP) amplitudes were affected by magnitude. Results partly support the neurobiological (dopamine) account of the FRN/RewP and suggest motivation affects feedback processing, as indicated by multiple ERP components.

  20. The effects of reward magnitude on reward processing: An averaged and single trial event-related potential study.

    Science.gov (United States)

    Meadows, Caroline C; Gable, Philip A; Lohse, Keith R; Miller, Matthew W

    2016-07-01

    From a neurobiological and motivational perspective, the feedback-related negativity (FRN) and reward positivity (RewP) event-related potential (ERP) components should increase with reward magnitude (reward associated with valence (success/failure) feedback). To test this hypothesis, we recorded participants' electroencephalograms while presenting them with potential monetary rewards ($0.00-$4.96) pre-trial for each trial of a reaction time task and presenting them with valence feedback post-trial. Averaged ERPs time-locked to valence feedback were extracted, and results revealed a valence by magnitude interaction for neural activity in the FRN/RewP time window. This interaction was driven by magnitude affecting RewP, but not FRN, amplitude. Moreover, single trial ERP analyses revealed a reliable correlation between magnitude and RewP, but not FRN, amplitude. Finally, P3b and late positive potential (LPP) amplitudes were affected by magnitude. Results partly support the neurobiological (dopamine) account of the FRN/RewP and suggest motivation affects feedback processing, as indicated by multiple ERP components. PMID:27288743

  1. Can Neural Activity Propagate by Endogenous Electrical Field?

    Science.gov (United States)

    Qiu, Chen; Shivacharan, Rajat S; Zhang, Mingming; Durand, Dominique M

    2015-12-01

    It is widely accepted that synaptic transmissions and gap junctions are the major governing mechanisms for signal traveling in the neural system. Yet, a group of neural waves, either physiological or pathological, share the same speed of ∼0.1 m/s without synaptic transmission or gap junctions, and this speed is not consistent with axonal conduction or ionic diffusion. The only explanation left is an electrical field effect. We tested the hypothesis that endogenous electric fields are sufficient to explain the propagation with in silico and in vitro experiments. Simulation results show that field effects alone can indeed mediate propagation across layers of neurons with speeds of 0.12 ± 0.09 m/s with pathological kinetics, and 0.11 ± 0.03 m/s with physiologic kinetics, both generating weak field amplitudes of ∼2-6 mV/mm. Further, the model predicted that propagation speed values are inversely proportional to the cell-to-cell distances, but do not significantly change with extracellular resistivity, membrane capacitance, or membrane resistance. In vitro recordings in mice hippocampi produced similar speeds (0.10 ± 0.03 m/s) and field amplitudes (2.5-5 mV/mm), and by applying a blocking field, the propagation speed was greatly reduced. Finally, osmolarity experiments confirmed the model's prediction that cell-to-cell distance inversely affects propagation speed. Together, these results show that despite their weak amplitude, electric fields can be solely responsible for spike propagation at ∼0.1 m/s. This phenomenon could be important to explain the slow propagation of epileptic activity and other normal propagations at similar speeds. PMID:26631463

  2. Activity-dependent modulation of neural circuit synaptic connectivity

    Directory of Open Access Journals (Sweden)

    Charles R Tessier

    2009-07-01

    Full Text Available In many nervous systems, the establishment of neural circuits is known to proceed via a two-stage process; 1 early, activity-independent wiring to produce a rough map characterized by excessive synaptic connections, and 2 subsequent, use-dependent pruning to eliminate inappropriate connections and reinforce maintained synapses. In invertebrates, however, evidence of the activity-dependent phase of synaptic refinement has been elusive, and the dogma has long been that invertebrate circuits are “hard-wired” in a purely activity-independent manner. This conclusion has been challenged recently through the use of new transgenic tools employed in the powerful Drosophila system, which have allowed unprecedented temporal control and single neuron imaging resolution. These recent studies reveal that activity-dependent mechanisms are indeed required to refine circuit maps in Drosophila during precise, restricted windows of late-phase development. Such mechanisms of circuit refinement may be key to understanding a number of human neurological diseases, including developmental disorders such as Fragile X syndrome (FXS and autism, which are hypothesized to result from defects in synaptic connectivity and activity-dependent circuit function. This review focuses on our current understanding of activity-dependent synaptic connectivity in Drosophila, primarily through analyzing the role of the fragile X mental retardation protein (FMRP in the Drosophila FXS disease model. The particular emphasis of this review is on the expanding array of new genetically-encoded tools that are allowing cellular events and molecular players to be dissected with ever greater precision and detail.

  3. Understanding Crowdsourcing: Effects of motivation and rewards on participation and performance in voluntary online activities

    NARCIS (Netherlands)

    W.A.M. Borst (Irma)

    2010-01-01

    textabstractCompanies increasingly outsource activities to volunteers that they approach via an open call on the internet. The phenomenon is called ‘crowdsourcing’. For an effective use of crowdsourcing it is important to understand what motivated these online volunteers and what is the influence of

  4. Spatially selective reward site responses in tonically active neurons of the nucleus accumbens in behaving rats

    NARCIS (Netherlands)

    A.B. Mulder; R. Shibata; O Trullier; S.I. Wiener

    2005-01-01

    To study how hippocampal output signals conveying spatial and other contextual information might be integrated in the nucleus accumbens, tonically active accumbens neurons were recorded in three unrestrained rats as they performed spatial orientation tasks on an elevated round rotatable platform wit

  5. SPR imaging combined with cyclic voltammetry for the detection of neural activity

    Directory of Open Access Journals (Sweden)

    Hui Li

    2014-03-01

    Full Text Available Surface plasmon resonance (SPR detects changes in refractive index at a metal-dielectric interface. In this study, SPR imaging (SPRi combined with cyclic voltammetry (CV was applied to detect neural activity in isolated bullfrog sciatic nerves. The neural activities induced by chemical and electrical stimulation led to an SPR response, and the activities were recorded in real time. The activities of different parts of the sciatic nerve were recorded and compared. The results demonstrated that SPR imaging combined with CV is a powerful tool for the investigation of neural activity.

  6. Hippocampal Cannabinoid Transmission Modulates Dopamine Neuron Activity: Impact on Rewarding Memory Formation and Social Interaction

    OpenAIRE

    Loureiro, Michael; Renard, Justine; Zunder, Jordan; Laviolette, Steven R

    2015-01-01

    Disturbances in cannabinoid type 1 receptor (CB1R) signaling have been linked to emotional and cognitive deficits characterizing neuropsychiatric disorders, including schizophrenia. Thus, there is growing interest in characterizing the relationship between cannabinoid transmission, emotional processing, and dopamine (DA)-dependent behavioral deficits. The CB1R is highly expressed in the mammalian nervous system, particularly in the hippocampus. Activation of the ventral hippocampal subregion ...

  7. Layered reward signalling through octopamine and dopamine in Drosophila

    OpenAIRE

    Burke, Christopher J.; Huetteroth, Wolf; Owald, David; Perisse, Emmanuel; Krashes, Michael J.; Das, Gaurav; Gohl, Daryl; Silies, Marion; Certel, Sarah; Waddell, Scott

    2012-01-01

    Dopamine is synonymous with reward and motivation in mammals. However, only recently has dopamine been linked to motivated behaviour and rewarding reinforcement in fruitflies. Instead, octopamine has historically been considered to be the signal for reward in insects. Here we show, using temporal control of neural function in Drosophila, that only short-term appetitive memory is reinforced by octopamine. Moreover, octopamine-dependent memory formation requires signalling through dopamine neur...

  8. Early Effects of Reward Anticipation Are Modulated by Dopaminergic Stimulation

    OpenAIRE

    Thore Apitz; Nico Bunzeck

    2014-01-01

    The abilities to predict future rewards and assess the value of reward delivery are crucial aspects of adaptive behavior. While the mesolimbic system, including dopaminergic midbrain, ventral striatum and prefrontal cortex have long been associated with reward processing, recent studies also indicate a prominent role of early visual brain regions. However, the precise underlying neural mechanisms still remain unclear. To address this issue, we presented participants with visual cues predictin...

  9. Acute Stress Reduces Reward Responsiveness: Implications for Depression

    OpenAIRE

    Bogdan, Ryan; Pizzagalli, Diego

    2006-01-01

    Background: Stress, one of the strongest risk factors for depression, has been linked to "anbedonic" behavior and dysfunctional reward-related neural circuitry in preclinical models. Methods: To test if acute stress reduces reward responsiveness (i.e., the ability to modulate behavior as a function of past reward), a signal-detection task coupled with a differential reinforcement schedule was utilized. Eighty female participants completed the task under both a stress condition, either threat-...

  10. PER1 rs3027172 genotype interacts with early life stress to predict problematic alcohol use, but not reward-related ventral striatum activity

    Directory of Open Access Journals (Sweden)

    David eBaranger

    2016-03-01

    Full Text Available Increasing evidence suggests that the circadian and stress regulatory systems contribute to alcohol use disorder (AUD risk, which may partially arise through effects on reward-related neural function. The C allele of the PER1 rs3027172 single nucleotide polymorphism reduces PER1 expression in cells incubated with cortisol and has been associated with increased risk for adult AUD and problematic drinking among adolescents exposed to high levels of familial psychosocial adversity. Using data from undergraduate students who completed the ongoing Duke Neurogenetics Study (n=665, we tested whether exposure to early life stress (ELS; Childhood Trauma Questionnaire moderates the association between rs3027172 genotype and later problematic alcohol use (Alcohol Use Disorders Identification Test as well as ventral striatum (VS reactivity to reward (card-guessing task while functional magnetic resonance imaging data were acquired. Initial analyses found that PER1 rs3027172 genotype interacted with ELS to predict both problematic drinking and VS reactivity; minor C allele carriers, who were also exposed to elevated ELS reported greater problematic drinking and exhibited greater ventral striatum reactivity to reward-related stimuli. When gene x covariate and environment x covariate interactions were controlled for, the interaction predicting problematic alcohol use remained significant (p<0.05, corrected while the interaction predicting VS reactivity was no longer significant. These results extend our understanding of relationships between PER1 genotype, early life stress, and problematic alcohol use, and serve as a cautionary tale on the importance of controlling for potential confounders in studies of moderation including gene x environment interactions.

  11. PER1 rs3027172 Genotype Interacts with Early Life Stress to Predict Problematic Alcohol Use, but Not Reward-Related Ventral Striatum Activity.

    Science.gov (United States)

    Baranger, David A A; Ifrah, Chloé; Prather, Aric A; Carey, Caitlin E; Corral-Frías, Nadia S; Drabant Conley, Emily; Hariri, Ahmad R; Bogdan, Ryan

    2016-01-01

    Increasing evidence suggests that the circadian and stress regulatory systems contribute to alcohol use disorder (AUD) risk, which may partially arise through effects on reward-related neural function. The C allele of the PER1 rs3027172 single nucleotide polymorphism (SNP) reduces PER1 expression in cells incubated with cortisol and has been associated with increased risk for adult AUD and problematic drinking among adolescents exposed to high levels of familial psychosocial adversity. Using data from undergraduate students who completed the ongoing Duke Neurogenetics Study (DNS) (n = 665), we tested whether exposure to early life stress (ELS; Childhood Trauma Questionnaire) moderates the association between rs3027172 genotype and later problematic alcohol use (Alcohol Use Disorders Identification Test) as well as ventral striatum (VS) reactivity to reward (card-guessing task while functional magnetic resonance imaging data were acquired). Initial analyses found that PER1 rs3027172 genotype interacted with ELS to predict both problematic drinking and VS reactivity; minor C allele carriers, who were also exposed to elevated ELS reported greater problematic drinking and exhibited greater ventral striatum reactivity to reward-related stimuli. When gene × covariate and environment × covariate interactions were controlled for, the interaction predicting problematic alcohol use remained significant (p < 0.05, corrected) while the interaction predicting VS reactivity was no longer significant. These results extend our understanding of relationships between PER1 genotype, ELS, and problematic alcohol use, and serve as a cautionary tale on the importance of controlling for potential confounders in studies of moderation including gene × environment interactions. PMID:27065929

  12. Validation and Psychometric Properties of the French Versions of the Environmental Reward Observation Scale and of the Reward Probability Index

    OpenAIRE

    Aurélie Wagener; Sylvie Blairy

    2015-01-01

    Background: Low levels of environmental rewards have been related to depression on a number of occasions in the scientific literature. Two scales have been created to assess environmental rewards: the Environmental Reward Observation Scale (EROS) and the Reward Probability Index (RPI). This study aims to validate the French versions of these two scales. Method: 466 non-clinical adults completed an online survey assessing environmental rewards, depression, anxiety, activation, avoidance and be...

  13. Generalized activity equations for spiking neural network dynamics

    Directory of Open Access Journals (Sweden)

    Michael A Buice

    2013-11-01

    Full Text Available Much progress has been made in uncovering the computational capabilities of spiking neural networks. However, spiking neurons will always be more expensive to simulate compared to rate neurons because of the inherent disparity in time scales - the spike duration time is much shorter than the inter-spike time, which is much shorter than any learning time scale. In numerical analysis, this is a classic stiff problem. Spiking neurons are also much more difficult to study analytically. One possible approach to making spiking networks more tractable is to augment mean field activity models with some information about spiking correlations. For example, such a generalized activity model could carry information about spiking rates and correlations between spikes self-consistently. Here, we will show how this can be accomplished by constructing a complete formal probabilistic description of the network and then expanding around a small parameter such as the inverse of the number of neurons in the network. The mean field theory of the system gives a rate-like description. The first order terms in the perturbation expansion keep track of covariances.

  14. Neuritin: A gene induced by neural activity and neurotrophins that promotes neuritogenesis

    OpenAIRE

    Naeve, Gregory S.; Ramakrishnan, Meena; Kramer, Rainer; Hevroni, Dana; Citri, Yoav; Theill, Lars E.

    1997-01-01

    Neural activity and neurotrophins induce synaptic remodeling in part by altering gene expression. A cDNA encoding a glycosylphoshatidylinositol-anchored protein was identified by screening for hippocampal genes that are induced by neural activity. This molecule, named neuritin, is expressed in postmitotic-differentiating neurons of the developing nervous system and neuronal structures associated with plasticity in the adult. Neuritin message is induced by neuronal activity and by the activity...

  15. Neural activity in relation to clinically derived personality syndromes in depression using a psychodynamic fMRI paradigm

    Directory of Open Access Journals (Sweden)

    Svenja eTaubner

    2013-12-01

    Full Text Available Objective: The heterogeneity between patients with depression cannot be captured adequately with existing descriptive systems of diagnosis and neurobiological models of depression. Furthermore, considering the highly individual nature of depression, the application of general stimuli in past research efforts may not capture the essence of the disorder. This study aims to identify subtypes of depression by using empirically-derived personality-syndromes, and to explore neural correlates of the derived personality syndromes.Method: In the present exploratory study an individually tailored and psychodynamically based fMRI paradigm using dysfunctional relationship patterns was presented to 20 chronically depressed patients. Results from the Shedler-Westen-Assessment-Procedure (SWAP-200 were analyzed by Q-factor analysis to identify clinically relevant subgroups of depression and related brain activation.Results: The principle component analysis of SWAP-200 items from all 20 patients lead to a 2-factor solution: Depressive Personality and Emotional-Hostile-Externalizing Personality. Both factors were used in a whole-brain correlational analysis but only the second factor yielded significant positive correlations in four regions: A large cluster in the right orbitofrontal cortex (OFC, the left ventral striatum, a small cluster in the left temporal pole and another small cluster in the right middle frontal gyrus. Discussion: The degree to which patients with depression score high on the factor Emotional-Hostile-Externalizing Personality correlated with relatively higher activity in three key areas involved in emotion processing, evaluation of reward/punishment, negative cognitions, depressive pathology and social knowledge (OFC, ventral striatum, temporal pole. Results may contribute to an alternative description of neural correlates of depression showing differential brain activation dependent on the extent of specific personality syndromes in

  16. Application of Artificial Neural Network in Active Vibration Control of Diesel Engine

    Institute of Scientific and Technical Information of China (English)

    SUN Cheng-shun; ZHANG Jian-wu

    2005-01-01

    Artificial Neural Network (ANN) is applied to diesel twostage vibration isolating system and an AVC (Active Vibration Control) system is developed. Both identifier and controller are constructed by three-layer BP neural network. Besides computer simulation, experiment research is carried out on both analog bench and diesel bench. The results of simulation and experiment show a diminished response of vibration.

  17. Ketamine Suppresses the Ventral Striatal Response to Reward Anticipation: A Cross-Species Translational Neuroimaging Study.

    Science.gov (United States)

    Francois, Jennifer; Grimm, Oliver; Schwarz, Adam J; Schweiger, Janina; Haller, Leila; Risterucci, Celine; Böhringer, Andreas; Zang, Zhenxiang; Tost, Heike; Gilmour, Gary; Meyer-Lindenberg, Andreas

    2016-04-01

    Convergent evidence implicates regional neural responses to reward anticipation in the pathogenesis of several psychiatric disorders, such as schizophrenia, where blunted ventral striatal responses to positive reward are observed in patients and at-risk populations. In vivo oxygen amperometry measurements in the ventral striatum in awake, behaving rats reveal reward-related tissue oxygen changes that closely parallel blood oxygen level dependent (BOLD) signal changes observed in human functional magnetic resonance imaging (fMRI), suggesting that a cross-species approach targeting this mechanism might be feasible in psychopharmacology. The present study explored modulatory effects of acute, subanaesthetic doses of ketamine-a pharmacological model widely used in psychopharmacological research, both preclinically and clinically-on ventral striatum activity during performance of a reward anticipation task in both species, using fMRI in humans and in vivo oxygen amperometry in rats. In a region-of-interest analysis conducted following a cross-over placebo and ketamine study in human subjects, an attenuated ventral striatal response during reward anticipation was observed following ketamine relative to placebo during performance of a monetary incentive delay task. In rats, a comparable attenuation of ventral striatal signal was found after ketamine challenge, relative to vehicle, in response to a conditioned stimulus that predicted delivery of reward. This study provides the first data in both species demonstrating an attenuating effect of acute ketamine on reward-related ventral striatal (O2) and fMRI signals. These findings may help elucidate a deeper mechanistic understanding of the potential role of ketamine as a model for psychosis, show that cross-species pharmacological experiments targeting reward signaling are feasible, and suggest this phenotype as a promising translational biomarker for the development of novel compounds, assessment of disease status, and

  18. Dopamine Signaling in reward-related behaviors

    Directory of Open Access Journals (Sweden)

    Ja-Hyun eBaik

    2013-10-01

    Full Text Available Dopamine (DA regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DAmesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural rewards such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

  19. Dopamine signaling in reward-related behaviors.

    Science.gov (United States)

    Baik, Ja-Hyun

    2013-01-01

    Dopamine (DA) regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DA mesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural reward such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

  20. Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function.

    Science.gov (United States)

    Scaplen, Kristin M; Kaun, Karla R

    2016-06-01

    In a complex environment, animals learn from their responses to stimuli and events. Appropriate response to reward and punishment can promote survival, reproduction and increase evolutionary fitness. Interestingly, the neural processes underlying these responses are remarkably similar across phyla. In all species, dopamine is central to encoding reward and directing motivated behaviors, however, a comprehensive understanding of how circuits encode reward and direct motivated behaviors is still lacking. In part, this is a result of the sheer diversity of neurons, the heterogeneity of their responses and the complexity of neural circuits within which they are found. We argue that general features of reward circuitry are common across model organisms, and thus principles learned from invertebrate model organisms can inform research across species. In particular, we discuss circuit motifs that appear to be functionally equivalent from flies to primates. We argue that a comparative approach to studying and understanding reward circuit function provides a more comprehensive understanding of reward circuitry, and informs disorders that affect the brain's reward circuitry. PMID:27328845

  1. Altered cingulo-striatal function underlies reward drive deficits in schizophrenia.

    Science.gov (United States)

    Park, Il Ho; Chun, Ji Won; Park, Hae-Jeong; Koo, Min-Seong; Park, Sunyoung; Kim, Seok-Hyeong; Kim, Jae-Jin

    2015-02-01

    Amotivation in schizophrenia is assumed to involve dysfunctional dopaminergic signaling of reward prediction or anticipation. It is unclear, however, whether the translation of neural representation of reward value to behavioral drive is affected in schizophrenia. In order to examine how abnormal neural processing of response valuation and initiation affects incentive motivation in schizophrenia, we conducted functional MRI using a deterministic reinforcement learning task with variable intervals of contingency reversals in 20 clinically stable patients with schizophrenia and 20 healthy controls. Behaviorally, the advantage of positive over negative reinforcer in reinforcement-related responsiveness was not observed in patients. Patients showed altered response valuation and initiation-related striatal activity and deficient rostro-ventral anterior cingulate cortex activation during reward approach initiation. Among these neural abnormalities, rostro-ventral anterior cingulate cortex activation was correlated with positive reinforcement-related responsiveness in controls and social anhedonia and social amotivation subdomain scores in patients. Our findings indicate that the central role of the anterior cingulate cortex is in translating action value into driving force of action, and underscore the role of the cingulo-striatal network in amotivation in schizophrenia.

  2. Altered cingulo-striatal function underlies reward drive deficits in schizophrenia.

    Science.gov (United States)

    Park, Il Ho; Chun, Ji Won; Park, Hae-Jeong; Koo, Min-Seong; Park, Sunyoung; Kim, Seok-Hyeong; Kim, Jae-Jin

    2015-02-01

    Amotivation in schizophrenia is assumed to involve dysfunctional dopaminergic signaling of reward prediction or anticipation. It is unclear, however, whether the translation of neural representation of reward value to behavioral drive is affected in schizophrenia. In order to examine how abnormal neural processing of response valuation and initiation affects incentive motivation in schizophrenia, we conducted functional MRI using a deterministic reinforcement learning task with variable intervals of contingency reversals in 20 clinically stable patients with schizophrenia and 20 healthy controls. Behaviorally, the advantage of positive over negative reinforcer in reinforcement-related responsiveness was not observed in patients. Patients showed altered response valuation and initiation-related striatal activity and deficient rostro-ventral anterior cingulate cortex activation during reward approach initiation. Among these neural abnormalities, rostro-ventral anterior cingulate cortex activation was correlated with positive reinforcement-related responsiveness in controls and social anhedonia and social amotivation subdomain scores in patients. Our findings indicate that the central role of the anterior cingulate cortex is in translating action value into driving force of action, and underscore the role of the cingulo-striatal network in amotivation in schizophrenia. PMID:25468177

  3. SNW1 is a critical regulator of spatial BMP activity, neural plate border formation, and neural crest specification in vertebrate embryos.

    Directory of Open Access Journals (Sweden)

    Mary Y Wu

    Full Text Available Bone morphogenetic protein (BMP gradients provide positional information to direct cell fate specification, such as patterning of the vertebrate ectoderm into neural, neural crest, and epidermal tissues, with precise borders segregating these domains. However, little is known about how BMP activity is regulated spatially and temporally during vertebrate development to contribute to embryonic patterning, and more specifically to neural crest formation. Through a large-scale in vivo functional screen in Xenopus for neural crest fate, we identified an essential regulator of BMP activity, SNW1. SNW1 is a nuclear protein known to regulate gene expression. Using antisense morpholinos to deplete SNW1 protein in both Xenopus and zebrafish embryos, we demonstrate that dorsally expressed SNW1 is required for neural crest specification, and this is independent of mesoderm formation and gastrulation morphogenetic movements. By exploiting a combination of immunostaining for phosphorylated Smad1 in Xenopus embryos and a BMP-dependent reporter transgenic zebrafish line, we show that SNW1 regulates a specific domain of BMP activity in the dorsal ectoderm at the neural plate border at post-gastrula stages. We use double in situ hybridizations and immunofluorescence to show how this domain of BMP activity is spatially positioned relative to the neural crest domain and that of SNW1 expression. Further in vivo and in vitro assays using cell culture and tissue explants allow us to conclude that SNW1 acts upstream of the BMP receptors. Finally, we show that the requirement of SNW1 for neural crest specification is through its ability to regulate BMP activity, as we demonstrate that targeted overexpression of BMP to the neural plate border is sufficient to restore neural crest formation in Xenopus SNW1 morphants. We conclude that through its ability to regulate a specific domain of BMP activity in the vertebrate embryo, SNW1 is a critical regulator of neural plate

  4. Neural Changes following Behavioral Activation for a Depressed Breast Cancer Patient: A Functional MRI Case Study

    OpenAIRE

    Gawrysiak, Michael J.; John P. Carvalho; Rogers, Baxter P.; Nicholas, Christopher R. N.; Dougherty, John H.; Hopko, Derek R.

    2012-01-01

    Functional neuroimaging is an innovative but at this stage underutilized method to assess the efficacy of psychotherapy for depression. Functional magnetic resonance imaging (fMRI) was used in this case study to examine changes in brain activity in a depressed breast cancer patient receiving an 8-session Behavioral Activation Treatment for Depression (BATD), based on the work of Hopko and Lejuez (2007). A music listening paradigm was used during fMRI brain scans to assess reward responsivenes...

  5. Dyadic social interaction as an alternative reward to cocaine

    Directory of Open Access Journals (Sweden)

    Gerald eZernig

    2013-09-01

    Full Text Available Individuals suffering from substance use disorders often show severely impaired social interaction, preferring drugs of abuse to the contact with others. Their impaired social interaction is doubly harmful for them as (1 therapy itself is based and dependent on social interaction and as (2 social interaction is not available to them as an "alternative", i.e., non-drug reward, decreasing their motivation to stop drug use. We therefore developed an animal experimental model to investigate the neurobiology of dyadic social interaction- vs cocaine reward. We took care to avoid (a engaging sexual attraction-related aspects of such a social interaction and (b hierarchical difference as confounding stimuli. The cocaine- or social interaction stimulus was offered - in a mutually exclusive setting - within the confines of a conditioned place preference (CPP apparatus. In our paradigm, only four 15-min episodes of social interaction proved sufficient to (i switch the rats' preference from cocaine-associated contextual stimuli to social interaction CPP and (ii inhibit the subsequent reacquisition/reexpression of cocaine CPP. The behavioral effect was paralleled by a reversal of brain activation (i.e., EGR1 expression in the nucleus accumbens, the central and basolateral amygdala, and the ventral tegmental area. Of relevance for the psychotherapy of addictive disorders, the most rewarding sensory component of the composite stimulus 'social interaction' was touch. To test our hypothesis that motivation is encoded in neuron ensembles dedicated to specific reward scenarios, we are currently (1 mapping the neural circuits involved in cocaine- vs social interaction reward and (2 adapting our paradigm for C57BL/6 mice to make use of the plethora of transgenic models available in this species.

  6. Liking and wanting of drug and nondrug rewards in active cocaine users: the STRAP-R questionnaire

    Energy Technology Data Exchange (ETDEWEB)

    Goldstein, R.Z.; Goldstein, R.Z.; Woicik, P.A..; Moeller, S.J.; Telang, F.; Jayne, M.; Wong, C.; Wang, G-J.; Fowler, J.S.; Volkow, N.D.

    2008-10-01

    Few studies have examined the subjective value attributed to drug rewards specifically as it compares with the value attributed to primary non-drug rewards in addicted individuals. The objective of this study is to assess liking and wanting of expected drug rewards as compared to food and sex while respondents report about three different situations (current, and hypothetical in general, and under drug influence). In all, 20 cocaine-addicted individuals (mean abstinence = 2 days) and 20 healthy control subjects were administered the STRAP-R (Sensitivity To Reinforcement of Addictive and other Primary Rewards) questionnaire after receiving an oral dose of the dopamine agonist methylphenidate (20 mg) or placebo. The reinforcers relative value changed within the addicted sample when reporting about the under drug influence situation (drug > food; otherwise, drug < food). This change was highest in the addicted individuals with the youngest age of cocaine use onset. Moreover, drug wanting exceeded drug liking in the addicted subjects when reporting about this situation during methylphenidate. Thus, cocaine-addicted individuals assign the highest subjective valence to drug rewards but only when recalling cue-related situations. When recalling this situation, they also report higher drug wanting than hedonic liking, a motivational shift that was only significant during methylphenidate. Together, these valence shifts may underlie compulsive stimulant abuse upon pharmacological or behavioural cue exposure in addicted individuals. Additional studies are required to assess the reliability of the STRAP-R in larger samples and to examine its validity in measuring the subjective value attributed to experienced reinforcers or in predicting behaviour.

  7. Disentangling the autism-anxiety overlap: fMRI of reward processing in a community-based longitudinal study.

    Science.gov (United States)

    Mikita, N; Simonoff, E; Pine, D S; Goodman, R; Artiges, E; Banaschewski, T; Bokde, A L; Bromberg, U; Büchel, C; Cattrell, A; Conrod, P J; Desrivières, S; Flor, H; Frouin, V; Gallinat, J; Garavan, H; Heinz, A; Ittermann, B; Jurk, S; Martinot, J L; Paillère Martinot, M L; Nees, F; Papadopoulos Orfanos, D; Paus, T; Poustka, L; Smolka, M N; Walter, H; Whelan, R; Schumann, G; Stringaris, A

    2016-01-01

    Up to 40% of youth with autism spectrum disorder (ASD) also suffer from anxiety, and this comorbidity is linked with significant functional impairment. However, the mechanisms of this overlap are poorly understood. We investigated the interplay between ASD traits and anxiety during reward processing, known to be affected in ASD, in a community sample of 1472 adolescents (mean age=14.4 years) who performed a modified monetary incentive delay task as part of the Imagen project. Blood-oxygen-level dependent (BOLD) responses to reward anticipation and feedback were compared using a 2x2 analysis of variance test (ASD traits: low/high; anxiety symptoms: low/high), controlling for plausible covariates. In addition, we used a longitudinal design to assess whether neural responses during reward processing predicted anxiety at 2-year follow-up. High ASD traits were associated with reduced BOLD responses in dorsal prefrontal regions during reward anticipation and negative feedback. Participants with high anxiety symptoms showed increased lateral prefrontal responses during anticipation, but decreased responses following feedback. Interaction effects revealed that youth with combined ASD traits and anxiety, relative to other youth, showed high right insula activation when anticipating reward, and low right-sided caudate, putamen, medial and lateral prefrontal activations during negative feedback (all clusters PFWE<0.05). BOLD activation patterns in the right dorsal cingulate and right medial frontal gyrus predicted new-onset anxiety in participants with high but not low ASD traits. Our results reveal both quantitatively enhanced and qualitatively distinct neural correlates underlying the comorbidity between ASD traits and anxiety. Specific neural responses during reward processing may represent a risk factor for developing anxiety in ASD youth. PMID:27351599

  8. Disentangling the autism−anxiety overlap: fMRI of reward processing in a community-based longitudinal study

    Science.gov (United States)

    Mikita, N; Simonoff, E; Pine, D S; Goodman, R; Artiges, E; Banaschewski, T; Bokde, A L; Bromberg, U; Büchel, C; Cattrell, A; Conrod, P J; Desrivières, S; Flor, H; Frouin, V; Gallinat, J; Garavan, H; Heinz, A; Ittermann, B; Jurk, S; Martinot, J L; Paillère Martinot, M L; Nees, F; Papadopoulos Orfanos, D; Paus, T; Poustka, L; Smolka, M N; Walter, H; Whelan, R; Schumann, G; Stringaris, A

    2016-01-01

    Up to 40% of youth with autism spectrum disorder (ASD) also suffer from anxiety, and this comorbidity is linked with significant functional impairment. However, the mechanisms of this overlap are poorly understood. We investigated the interplay between ASD traits and anxiety during reward processing, known to be affected in ASD, in a community sample of 1472 adolescents (mean age=14.4 years) who performed a modified monetary incentive delay task as part of the Imagen project. Blood-oxygen-level dependent (BOLD) responses to reward anticipation and feedback were compared using a 2x2 analysis of variance test (ASD traits: low/high; anxiety symptoms: low/high), controlling for plausible covariates. In addition, we used a longitudinal design to assess whether neural responses during reward processing predicted anxiety at 2-year follow-up. High ASD traits were associated with reduced BOLD responses in dorsal prefrontal regions during reward anticipation and negative feedback. Participants with high anxiety symptoms showed increased lateral prefrontal responses during anticipation, but decreased responses following feedback. Interaction effects revealed that youth with combined ASD traits and anxiety, relative to other youth, showed high right insula activation when anticipating reward, and low right-sided caudate, putamen, medial and lateral prefrontal activations during negative feedback (all clusters PFWE<0.05). BOLD activation patterns in the right dorsal cingulate and right medial frontal gyrus predicted new-onset anxiety in participants with high but not low ASD traits. Our results reveal both quantitatively enhanced and qualitatively distinct neural correlates underlying the comorbidity between ASD traits and anxiety. Specific neural responses during reward processing may represent a risk factor for developing anxiety in ASD youth. PMID:27351599

  9. Physical methods for generating and decoding neural activity in Hirudo verbana

    Science.gov (United States)

    Migliori, Benjamin John

    The interface between living nervous systems and hardware is an excellent proving ground for precision experimental methods and information classification systems. Nervous systems are complex (104 -- 10 15(!) connections), fragile, and highly active in intricate, constantly evolving patterns. However, despite the conveniently electrical nature of neural transmission, the interface between nervous systems and hardware poses significant experimental difficulties. As the desire for direct interfaces with neural signals continues to expand, the need for methods of generating and measuring neural activity with high spatiotemporal precision has become increasingly critical. In this thesis, I describe advances I have made in the ability to modify, generate, measure, and understand neural signals both in- and ex-vivo. I focus on methods developed for transmitting and extracting signals in the intact nervous system of Hirudo verbana (the medicinal leech), an animal with a minimally complex nervous system (10000 neurons distributed in packets along a nerve cord) that exhibits a diverse array of behaviors. To introduce artificial activity patterns, I developed a photothermal activation system in which a highly focused laser is used to irradiate carbon microparticles in contact with target neurons. The resulting local temperature increase generates an electrical current that forces the target neuron to fire neural signals, thereby providing a unique neural input mechanism. These neural signals can potentially be used to alter behavioral choice or generate specific behavioral output, and can be used endogenously in many animal models. I also describe new tools developed to expand the application of this method. In complement to this input system, I describe a new method of analyzing neural output signals involved in long-range coordination of behaviors. Leech behavioral signals are propagated between neural packets as electrical pulses in the nerve connective, a bundle of

  10. The neural mechanisms of learning from competitors.

    Science.gov (United States)

    Howard-Jones, Paul A; Bogacz, Rafal; Yoo, Jee H; Leonards, Ute; Demetriou, Skevi

    2010-11-01

    Learning from competitors poses a challenge for existing theories of reward-based learning, which assume that rewarded actions are more likely to be executed in the future. Such a learning mechanism would disadvantage a player in a competitive situation because, since the competitor's loss is the player's gain, reward might become associated with an action the player should themselves avoid. Using fMRI, we investigated the neural activity of humans competing with a computer in a foraging task. We observed neural activity that represented the variables required for learning from competitors: the actions of the competitor (in the player's motor and premotor cortex) and the reward prediction error arising from the competitor's feedback. In particular, regions positively correlated with the unexpected loss of the competitor (which was beneficial to the player) included the striatum and those regions previously implicated in response inhibition. Our results suggest that learning in such contexts may involve the competitor's unexpected losses activating regions of the player's brain that subserve response inhibition, as the player learns to avoid the actions that produced them.

  11. Filtered-X Radial Basis Function Neural Networks for Active Noise Control

    Directory of Open Access Journals (Sweden)

    Bambang Riyanto

    2004-05-01

    Full Text Available This paper presents active control of acoustic noise using radial basis function (RBF networks and its digital signal processor (DSP real-time implementation. The neural control system consists of two stages: first, identification (modeling of secondary path of the active noise control using RBF networks and its learning algorithm, and secondly neural control of primary path based on neural model obtained in the first stage. A tapped delay line is introduced in front of controller neural, and another tapped delay line is inserted between controller neural networks and model neural networks. A new algorithm referred to as Filtered X-RBF is proposed to account for secondary path effects of the control system arising in active noise control. The resulting algorithm turns out to be the filtered-X version of the standard RBF learning algorithm. We address centralized and decentralized controller configurations and their DSP implementation is carried out. Effectiveness of the neural controller is demonstrated by applying the algorithm to active noise control within a 3 dimension enclosure to generate quiet zones around error microphones. Results of the real-time experiments show that 10-23 dB noise attenuation is produced with moderate transient response.

  12. Positive and negative reinforcement activate human auditory cortex.

    Science.gov (United States)

    Weis, Tina; Puschmann, Sebastian; Brechmann, André; Thiel, Christiane M

    2013-01-01

    Prior studies suggest that reward modulates neural activity in sensory cortices, but less is known about punishment. We used functional magnetic resonance imaging and an auditory discrimination task, where participants had to judge the duration of frequency modulated tones. In one session correct performance resulted in financial gains at the end of the trial, in a second session incorrect performance resulted in financial loss. Incorrect performance in the rewarded as well as correct performance in the punishment condition resulted in a neutral outcome. The size of gains and losses was either low or high (10 or 50 Euro cent) depending on the direction of frequency modulation. We analyzed neural activity at the end of the trial, during reinforcement, and found increased neural activity in auditory cortex when gaining a financial reward as compared to gaining no reward and when avoiding financial loss as compared to receiving a financial loss. This was independent on the size of gains and losses. A similar pattern of neural activity for both gaining a reward and avoiding a loss was also seen in right middle temporal gyrus, bilateral insula and pre-supplemental motor area, here however neural activity was lower after correct responses compared to incorrect responses. To summarize, this study shows that the activation of sensory cortices, as previously shown for gaining a reward is also seen during avoiding a loss. PMID:24367318

  13. Positive and negative reinforcement activate human auditory cortex

    Directory of Open Access Journals (Sweden)

    Tina eWeis

    2013-12-01

    Full Text Available Prior studies suggest that reward modulates neural activity in sensory cortices, but less is known about punishment. We used functional magnetic resonance imaging and an auditory discrimination task, where participants had to judge the duration of frequency modulated tones. In one session correct performance resulted in financial gains at the end of the trial, in a second session incorrect performance resulted in financial loss. Incorrect performance in the rewarded as well as correct performance in the punishment condition resulted in a neutral outcome. The size of gains and losses was either low or high (10 or 50 Euro cent depending on the direction of frequency modulation. We analyzed neural activity at the end of the trial, during reinforcement, and found increased neural activity in auditory cortex when gaining a financial reward as compared to gaining no reward and when avoiding financial loss as compared to receiving a financial loss. This was independent on the size of gains and losses. A similar pattern of neural activity for both gaining a reward and avoiding a loss was also seen in right middle temporal gyrus, bilateral insula and pre-supplemental motor area, here however neural activity was lower after correct responses compared to incorrect responses. To summarize, this study shows that the activation of sensory cortices, as previously shown for gaining a reward is also seen during avoiding a loss.

  14. Modeling electrocortical activity through improved local approximations of integral neural field equations

    OpenAIRE

    Coombes, Stephen; Venkov, Nikola; Shiau, LieJune; Bojak, Ingo; Liley, David; Laing, Carlo

    2007-01-01

    Neural field models of firing rate activity typically take the form of integral equations with space-dependent axonal delays. Under natural assumptions on the synaptic connectivity we show how one can derive an equivalent partial differential equation (PDE) model that properly treats the axonal delay terms of the integral formulation. Our analysis avoids the so-called long-wavelength approximation that has previously been used to formulate PDE models for neural activity in two spatial dime...

  15. Parasympathetic neural activity accounts for the lowering of exercise heart rate at high altitude

    DEFF Research Database (Denmark)

    Boushel, Robert Christopher; Calbet, J A; Rådegran, G;

    2001-01-01

    In chronic hypoxia, both heart rate (HR) and cardiac output (Q) are reduced during exercise. The role of parasympathetic neural activity in lowering HR is unresolved, and its influence on Q and oxygen transport at high altitude has never been studied.......In chronic hypoxia, both heart rate (HR) and cardiac output (Q) are reduced during exercise. The role of parasympathetic neural activity in lowering HR is unresolved, and its influence on Q and oxygen transport at high altitude has never been studied....

  16. Punished by Rewards?

    Science.gov (United States)

    Brandt, Ron

    1995-01-01

    The author of "Punished by Rewards" (1993), claims that rewards and punishments serve to manipulate behavior and destroy the potential for real learning. Praise is especially tricky, since intangible rewards can also foster compliance, not motivation. An engaging curriculum and a caring atmosphere encourage kids to exercise their natural…

  17. Motivation and reward systems

    NARCIS (Netherlands)

    W. van Eerde

    2014-01-01

    Reward systems are identified as one of the human resource management (HRM) practices that may impact motivation. Reward systems may consist of several components, including financial and nonfinancial rewards, in fixed and variable amounts. Reinforcement, expectancy, and equity principles are discus

  18. Altered Patterns of Reward Activation in a Large Cohort of Antipsychotic Naïve First Episode Schizophrenia Patients

    DEFF Research Database (Denmark)

    Nielsen, Mette Ødegaard; Rostrup, Egill; Wulff, Sanne;

    2014-01-01

    not have been caught by the focused analyses. By using a multivariate approach we want to confirm previous findings in a smaller group of patients, and further we expect this method to reveal other important alterations in reward processing. METHODS 53 antipsychotic-naïve first-episode patients...... with schizophrenia and 48 age and gender matched healthy controls were included in a large first episode study. Among several other examinations, the participants went through a functional Magnetic Resonance Imaging (fMRI) while playing a monetary reward task. The functional images were analyzed using...... parts of striatum and medial and dorso-lateral prefrontal cortex LV 4 described a widespread network with group difference related the period right after the action applied to target when the outcome was uncertain. LV 5 defined among others small areas in medial prefrontal and anterior cingulated cortex...

  19. Amphetamine sensitization alters reward processing in the human striatum and amygdala.

    Directory of Open Access Journals (Sweden)

    Owen G O'Daly

    Full Text Available Dysregulation of mesolimbic dopamine transmission is implicated in a number of psychiatric illnesses characterised by disruption of reward processing and goal-directed behaviour, including schizophrenia, drug addiction and impulse control disorders associated with chronic use of dopamine agonists. Amphetamine sensitization (AS has been proposed to model the development of this aberrant dopamine signalling and the subsequent dysregulation of incentive motivational processes. However, in humans the effects of AS on the dopamine-sensitive neural circuitry associated with reward processing remains unclear. Here we describe the effects of acute amphetamine administration, following a sensitising dosage regime, on blood oxygen level dependent (BOLD signal in dopaminoceptive brain regions during a rewarded gambling task performed by healthy volunteers. Using a randomised, double-blind, parallel-groups design, we found clear evidence for sensitization to the subjective effects of the drug, while rewarded reaction times were unchanged. Repeated amphetamine exposure was associated with reduced dorsal striatal BOLD signal during decision making, but enhanced ventromedial caudate activity during reward anticipation. The amygdala BOLD response to reward outcomes was blunted following repeated amphetamine exposure. Positive correlations between subjective sensitization and changes in anticipation- and outcome-related BOLD signal were seen for the caudate nucleus and amygdala, respectively. These data show for the first time in humans that AS changes the functional impact of acute stimulant exposure on the processing of reward-related information within dopaminoceptive regions. Our findings accord with pathophysiological models which implicate aberrant dopaminergic modulation of striatal and amygdala activity in psychosis and drug-related compulsive disorders.

  20. Reward-Related Dorsal Striatal Activity Differences between Former and Current Cocaine Dependent Individuals during an Interactive Competitive Game

    OpenAIRE

    Hyatt, Christopher J.; Assaf, Michal; Christine E Muska; Rivkah I Rosen; Thomas, Andre D.; Johnson, Matthew R.; Jennifer L Hylton; Andrews, Melissa M.; Reynolds, Brady A.; Krystal, John H.; Potenza, Marc N.; Pearlson, Godfrey D.

    2012-01-01

    Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD) signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI) in current (CCD; n = 30) and former (FCD; n = 28) cocaine dependent subjects as well as healthy control (HC; n = 31) subjects while playing ...

  1. Neural Activity during Encoding Predicts False Memories Created by Misinformation

    Science.gov (United States)

    Okado, Yoko; Stark, Craig E. L.

    2005-01-01

    False memories are often demonstrated using the misinformation paradigm, in which a person's recollection of a witnessed event is altered after exposure to misinformation about the event. The neural basis of this phenomenon, however, remains unknown. The authors used fMRI to investigate encoding processes during the viewing of an event and…

  2. Sociocultural patterning of neural activity during self-reflection

    DEFF Research Database (Denmark)

    Ma, Yina; Bang, Dan; Wang, Chenbo;

    2014-01-01

    Western cultures encourage self-construals independent of social contexts whereas East Asian cultures foster interdependent self-construals that rely on how others perceive the self. How are culturally specific self-construals mediated by the human brain? Using functional MRI, we monitored neural...

  3. Active Control of Sound based on Diagonal Recurrent Neural Network

    NARCIS (Netherlands)

    Jayawardhana, Bayu; Xie, Lihua; Yuan, Shuqing

    2002-01-01

    Recurrent neural network has been known for its dynamic mapping and better suited for nonlinear dynamical system. Nonlinear controller may be needed in cases where the actuators exhibit the nonlinear characteristics, or in cases when the structure to be controlled exhibits nonlinear behavior. The fe

  4. Lack of telomerase activity in rabbit bone marrow stromal cells during differentiation along neural pathway

    Institute of Scientific and Technical Information of China (English)

    CHEN Zhen-zhou; XU Ru-xiang; JIANG Xiao-dan; TENG Xiao-hua; LI Gui-tao; ZHOU Yü-xi

    2006-01-01

    Objective: To investigate telomerase activity in rabbit bone marrow stromal cells (BMSCs) during their committed differentiation in vitro along neural pathway and the effect of glial cell line-derived neurotrophic factor (GDNF) on the expression of telomerase.Methods: BMSCs were acquired from rabbit marrow and divided into control group, GDNF (10 ng/ml) group.No. ZL02134314. 4) supplemented with 10% fetal bovine serum (FBS) was used to induce BMSCs differentiation along neural pathway. Fluorescent immunocytochemistry was employed to identify the expressions of Nestin, neuronspecific endase (NSE), and gial fibrillary acidic protein (GFAP). The growth curves of the cells and the status of cell cycles were analyzed, respectively. During the differentiation, telomerase activitys were detected using the telomeric repeat amplification protocol-enzyme-linked immunosorbent assay (TRAP-ELISA).Results: BMSCs were successfully induced to differentiate along neural pathway and expressed specific markers of fetal neural epithelium, mature neuron and glial cells. Telomerase activities were undetectable in BMSCs during differentiation along neural pathway. Similar changes of cell growth curves, cell cycle status and telomerase expression were observed in the two groups.Conclusions: Rabbit BMSCs do not display telomerase activity during differentiation along neural pathway. GDNF shows little impact on proliferation and telomerase activity of BMSCs.

  5. The fiber-optic imaging and manipulation of neural activity during animal behavior.

    Science.gov (United States)

    Miyamoto, Daisuke; Murayama, Masanori

    2016-02-01

    Recent progress with optogenetic probes for imaging and manipulating neural activity has further increased the relevance of fiber-optic systems for neural circuitry research. Optical fibers, which bi-directionally transmit light between separate sites (even at a distance of several meters), can be used for either optical imaging or manipulating neural activity relevant to behavioral circuitry mechanisms. The method's flexibility and the specifications of the light structure are well suited for following the behavior of freely moving animals. Furthermore, thin optical fibers allow researchers to monitor neural activity from not only the cortical surface but also deep brain regions, including the hippocampus and amygdala. Such regions are difficult to target with two-photon microscopes. Optogenetic manipulation of neural activity with an optical fiber has the advantage of being selective for both cell-types and projections as compared to conventional electrophysiological brain tissue stimulation. It is difficult to extract any data regarding changes in neural activity solely from a fiber-optic manipulation device; however, the readout of data is made possible by combining manipulation with electrophysiological recording, or the simultaneous application of optical imaging and manipulation using a bundle-fiber. The present review introduces recent progress in fiber-optic imaging and manipulation methods, while also discussing fiber-optic system designs that are suitable for a given experimental protocol. PMID:26427958

  6. Neuritin: a gene induced by neural activity and neurotrophins that promotes neuritogenesis.

    Science.gov (United States)

    Naeve, G S; Ramakrishnan, M; Kramer, R; Hevroni, D; Citri, Y; Theill, L E

    1997-03-18

    Neural activity and neurotrophins induce synaptic remodeling in part by altering gene expression. A cDNA encoding a glycosylphoshatidylinositol-anchored protein was identified by screening for hippocampal genes that are induced by neural activity. This molecule, named neuritin, is expressed in postmitotic-differentiating neurons of the developing nervous system and neuronal structures associated with plasticity in the adult. Neuritin message is induced by neuronal activity and by the activity-regulated neurotrophins BDNF and NT-3. Purified recombinant neuritin promotes neurite outgrowth and arborization in primary embryonic hippocampal and cortical cultures. These data implicate neuritin as a downstream effector of activity-induced neurite outgrowth. PMID:9122250

  7. Forebrain substrates of reward and motivation.

    Science.gov (United States)

    Wise, Roy A

    2005-12-01

    Electrical stimulation of the medial forebrain bundle can reward arbitrary acts or motivate biologically primitive, species-typical behaviors like feeding or copulation. The subsystems involved in these behaviors are only partially characterized, but they appear to transsynaptically activate the mesocorticolimbic dopamine system. Basal function of the dopamine system is essential for arousal and motor function; phasic activation of this system is rewarding and can potentiate the effectiveness of reward-predictors that guide learned behaviors. This system is phasically activated by most drugs of abuse and such activation contributes to the habit-forming actions of these drugs.

  8. Neural activity to positive expressions predicts daily experience of schizophrenia-spectrum symptoms in adults with high social anhedonia.

    Science.gov (United States)

    Hooker, Christine I; Benson, Taylor L; Gyurak, Anett; Yin, Hong; Tully, Laura M; Lincoln, Sarah Hope

    2014-02-01

    Social anhedonia (SA), the diminished pleasure from social relationships, is a prominent characteristic of the vulnerability and manifestation of schizophrenia disorder. However, SA can develop for multiple reasons and little is known about its neural basis; these 2 issues hinder the utility and sensitivity of SA as a marker of schizophrenia pathology. This study investigated whether lateral prefrontal cortex (LPFC) deficits in social reward processing are associated with both SA and other schizophrenia-spectrum symptoms. During functional MRI (fMRI), a community sample of healthy adults (N = 30) with high and low SA viewed positive, negative, and neutral facial expressions. Afterward, participants completed an online daily diary in which they rated schizophrenia-spectrum symptoms and occurrence of interpersonal conflict each day for 21 days. Compared with low SA, high SA participants had less ventral (V)LPFC activity to positive versus neutral expressions. In addition, participants with a combination of high SA and low VLPFC activity to positive versus neutral expressions had worse daily diary ratings of schizophrenia-spectrum symptoms, including worse cognition, paranoia, motivation/productivity, and vigor/positive affect (i.e., psychomotor activation). Finally, among high SA participants, VLPFC activity predicted the daily relationship between distress from interpersonal conflict and symptom-severity; specifically, high SA participants with low VLPFC activity had worse paranoia on days of high conflict distress. These findings indicate that VLPFC deficits in positive emotion are associated with both SA and other schizophrenia-spectrum symptoms and that understanding the interaction of SA, VLPFC function, and social stress could facilitate the use of SA in the prevention and treatment of schizophrenia.

  9. Video game training and the reward system.

    Science.gov (United States)

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training. PMID:25698962

  10. Video Game Training and the Reward System

    Directory of Open Access Journals (Sweden)

    Robert C. Lorenz

    2015-02-01

    Full Text Available Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual towards playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training.Fifty healthy participants were randomly assigned to a video game training (TG or control group (CG. Before and after training/control period, functional magnetic resonance imaging (fMRI was conducted using a non-video game related reward task.At pretest, both groups showed strongest activation in ventral striatum (VS during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated.This longitudinal study revealed that video game training may preserve reward responsiveness in the ventral striatum in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  11. Video game training and the reward system.

    Science.gov (United States)

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  12. Altered social reward and attention in anorexia nervosa

    Directory of Open Access Journals (Sweden)

    Karli K Watson

    2010-09-01

    Full Text Available Dysfunctional social reward and social orienting attend a variety of neuropsychiatric disorders including autism, schizophrenia, social anxiety, and psychopathy. Here we show that similar social reward and attention dysfunction attend anorexia nervosa, a disorder defined by avoidance of food and extreme weight loss. We measured the implicit reward value of social stimuli for female participants with (n=11 and without (n=11 anorexia nervosa using an econometric choice task and also tracked gaze patterns during free viewing of images of female faces and bodies. As predicted, the reward value of viewing bodies varied inversely with observed body weight for women with anorexia but not neurotypical women, in contrast with their explicit ratings of attractiveness. Surprisingly, women with anorexia nervosa, unlike neurotypical women, did not find female faces rewarding and avoided looking at both the face and eyes—independent of observed body weight. These findings demonstrate comorbid dysfunction in the neural circuits mediating gustatory and social reward in anorexia nervosa.

  13. High baseline activity in inferior temporal cortex improves neural and behavioral discriminability during visual categorization

    Directory of Open Access Journals (Sweden)

    Nazli eEmadi

    2014-11-01

    Full Text Available Spontaneous firing is a ubiquitous property of neural activity in the brain. Recent literature suggests that this baseline activity plays a key role in perception. However, it is not known how the baseline activity contributes to neural coding and behavior. Here, by recording from the single neurons in the inferior temporal cortex of monkeys performing a visual categorization task, we thoroughly explored the relationship between baseline activity, the evoked response, and behavior. Specifically we found that a low-frequency (< 8 Hz oscillation in the spike train, prior and phase-locked to the stimulus onset, was correlated with increased gamma power and neuronal baseline activity. This enhancement of the baseline activity was then followed by an increase in the neural selectivity and the response reliability and eventually a higher behavioral performance.

  14. Hemispheric Asymmetries in Striatal Reward Responses Relate to Approach-Avoidance Learning and Encoding of Positive-Negative Prediction Errors in Dopaminergic Midbrain Regions.

    Science.gov (United States)

    Aberg, Kristoffer Carl; Doell, Kimberly C; Schwartz, Sophie

    2015-10-28

    Some individuals are better at learning about rewarding situations, whereas others are inclined to avoid punishments (i.e., enhanced approach or avoidance learning, respectively). In reinforcement learning, action values are increased when outcomes are better than predicted (positive prediction errors [PEs]) and decreased for worse than predicted outcomes (negative PEs). Because actions with high and low values are approached and avoided, respectively, individual differences in the neural encoding of PEs may influence the balance between approach-avoidance learning. Recent correlational approaches also indicate that biases in approach-avoidance learning involve hemispheric asymmetries in dopamine function. However, the computational and neural mechanisms underpinning such learning biases remain unknown. Here we assessed hemispheric reward asymmetry in striatal activity in 34 human participants who performed a task involving rewards and punishments. We show that the relative difference in reward response between hemispheres relates to individual biases in approach-avoidance learning. Moreover, using a computational modeling approach, we demonstrate that better encoding of positive (vs negative) PEs in dopaminergic midbrain regions is associated with better approach (vs avoidance) learning, specifically in participants with larger reward responses in the left (vs right) ventral striatum. Thus, individual dispositions or traits may be determined by neural processes acting to constrain learning about specific aspects of the world. PMID:26511241

  15. Hemispheric Asymmetries in Striatal Reward Responses Relate to Approach-Avoidance Learning and Encoding of Positive-Negative Prediction Errors in Dopaminergic Midbrain Regions.

    Science.gov (United States)

    Aberg, Kristoffer Carl; Doell, Kimberly C; Schwartz, Sophie

    2015-10-28

    Some individuals are better at learning about rewarding situations, whereas others are inclined to avoid punishments (i.e., enhanced approach or avoidance learning, respectively). In reinforcement learning, action values are increased when outcomes are better than predicted (positive prediction errors [PEs]) and decreased for worse than predicted outcomes (negative PEs). Because actions with high and low values are approached and avoided, respectively, individual differences in the neural encoding of PEs may influence the balance between approach-avoidance learning. Recent correlational approaches also indicate that biases in approach-avoidance learning involve hemispheric asymmetries in dopamine function. However, the computational and neural mechanisms underpinning such learning biases remain unknown. Here we assessed hemispheric reward asymmetry in striatal activity in 34 human participants who performed a task involving rewards and punishments. We show that the relative difference in reward response between hemispheres relates to individual biases in approach-avoidance learning. Moreover, using a computational modeling approach, we demonstrate that better encoding of positive (vs negative) PEs in dopaminergic midbrain regions is associated with better approach (vs avoidance) learning, specifically in participants with larger reward responses in the left (vs right) ventral striatum. Thus, individual dispositions or traits may be determined by neural processes acting to constrain learning about specific aspects of the world.

  16. A fast learning algorithm of neural network with tunable activation function

    Institute of Scientific and Technical Information of China (English)

    SHEN Yanjun; WANG Bingwen

    2004-01-01

    This paper presents a modified structure of a neural network with tunable activation function and provides a new learning algorithm for the neural network training. Simulation results of XOR problem, Feigenbaum function, and Henon map show that the new algorithm has better performance than BP (back propagation) algorithm in terms of shorter convergence time and higher convergence accuracy. Further modifications of the structure of the neural network with the faster learning algorithm demonstrate simpler structure with even faster convergence speed and better convergence accuracy.

  17. Active Vibration Control of the Smart Plate Using Artificial Neural Network Controller

    Directory of Open Access Journals (Sweden)

    Mohit

    2015-01-01

    Full Text Available The active vibration control (AVC of a rectangular plate with single input and single output approach is investigated using artificial neural network. The cantilever plate of finite length, breadth, and thickness having piezoelectric patches as sensors/actuators fixed at the upper and lower surface of the metal plate is considered for examination. The finite element model of the cantilever plate is utilized to formulate the whole strategy. The compact RIO and MATLAB simulation software are exercised to get the appropriate results. The cantilever plate is subjected to impulse input and uniform white noise disturbance. The neural network is trained offline and tuned with LQR controller. The various training algorithms to tune the neural network are exercised. The best efficient algorithm is finally considered to tune the neural network controller designed for active vibration control of the smart plate.

  18. The Roles of Dopamine and Related Compounds in Reward-Seeking Behavior Across Animal Phyla

    OpenAIRE

    Barron, Andrew B.; Eirik Søvik; Cornish, Jennifer L.

    2010-01-01

    Motile animals actively seek out and gather resources they find rewarding, and this is an extremely powerful organiser and motivator of animal behaviour. Mammalian studies have revealed interconnected neurobiological systems for reward learning, reward assessment, reinforcement and reward seeking; all involving the biogenic amine dopamine. The neurobiology of reward-seeking behavioural systems is less well understood in invertebrates, but in many diverse invertebrate groups, reward learning ...

  19. Social and monetary reward processing in autism spectrum disorders

    Directory of Open Access Journals (Sweden)

    Delmonte Sonja

    2012-09-01

    Full Text Available Abstract Background Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD. However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Methods Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD response during the anticipation and receipt of both reward types. Results Behaviorally, the ASD group showed less of a reduction in reaction time (RT for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS. The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in

  20. A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects.

    Science.gov (United States)

    Truccolo, Wilson; Eden, Uri T; Fellows, Matthew R; Donoghue, John P; Brown, Emery N

    2005-02-01

    Multiple factors simultaneously affect the spiking activity of individual neurons. Determining the effects and relative importance of these factors is a challenging problem in neurophysiology. We propose a statistical framework based on the point process likelihood function to relate a neuron's spiking probability to three typical covariates: the neuron's own spiking history, concurrent ensemble activity, and extrinsic covariates such as stimuli or behavior. The framework uses parametric models of the conditional intensity function to define a neuron's spiking probability in terms of the covariates. The discrete time likelihood function for point processes is used to carry out model fitting and model analysis. We show that, by modeling the logarithm of the conditional intensity function as a linear combination of functions of the covariates, the discrete time point process likelihood function is readily analyzed in the generalized linear model (GLM) framework. We illustrate our approach for both GLM and non-GLM likelihood functions using simulated data and multivariate single-unit activity data simultaneously recorded from the motor cortex of a monkey performing a visuomotor pursuit-tracking task. The point process framework provides a flexible, computationally efficient approach for maximum likelihood estimation, goodness-of-fit assessment, residual analysis, model selection, and neural decoding. The framework thus allows for the formulation and analysis of point process models of neural spiking activity that readily capture the simultaneous effects of multiple covariates and enables the assessment of their relative importance. PMID:15356183

  1. Characterization of the feeding inhibition and neural activation produced by dorsomedial hypothalamic cholecystokinin administration

    OpenAIRE

    Chen, Jie; Scott, Karen A.; Zhao, Zhengyan; Moran, Timothy H.; BI, Sheng

    2008-01-01

    Within the dorsomedial hypothalamus (DMH), cholecystokinin (CCK) has been proposed to modulate neuropeptide Y (NPY) signaling to affect food intake. However, the neural circuitry underlying the actions of this CCK-NPY signaling system in the controls of food intake has yet to be determined. We sought to characterize the feeding inhibition and brain neural activation produced by CCK administration into the DMH of rats. We determined the time course of feeding inhibitory effects of exogenous DM...

  2. Variability of neural activation during walking in humans: short heels and big calves

    OpenAIRE

    Ahn, A. N.; Kang, J. K.; Quitt, M. A.; Davidson, B. C.; Nguyen, C. T.

    2011-01-01

    People come in different shapes and sizes. In particular, calf muscle size in humans varies considerably. One possible cause for the different shapes of calf muscles is the inherent difference in neural signals sent to these muscles during walking. In sedentary adults, the variability in neural control of the calf muscles was examined with muscle size, walking kinematics and limb morphometrics. Half the subjects walked while activating their medial gastrocnemius (MG) muscles more strongly tha...

  3. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

    Science.gov (United States)

    Berridge, K C; Robinson, T E

    1998-12-01

    What roles do mesolimbic and neostriatal dopamine systems play in reward? Do they mediate the hedonic impact of rewarding stimuli? Do they mediate hedonic reward learning and associative prediction? Our review of the literature, together with results of a new study of residual reward capacity after dopamine depletion, indicates the answer to both questions is 'no'. Rather, dopamine systems may mediate the incentive salience of rewards, modulating their motivational value in a manner separable from hedonia and reward learning. In a study of the consequences of dopamine loss, rats were depleted of dopamine in the nucleus accumbens and neostriatum by up to 99% using 6-hydroxydopamine. In a series of experiments, we applied the 'taste reactivity' measure of affective reactions (gapes, etc.) to assess the capacity of dopamine-depleted rats for: 1) normal affect (hedonic and aversive reactions), 2) modulation of hedonic affect by associative learning (taste aversion conditioning), and 3) hedonic enhancement of affect by non-dopaminergic pharmacological manipulation of palatability (benzodiazepine administration). We found normal hedonic reaction patterns to sucrose vs. quinine, normal learning of new hedonic stimulus values (a change in palatability based on predictive relations), and normal pharmacological hedonic enhancement of palatability. We discuss these results in the context of hypotheses and data concerning the role of dopamine in reward. We review neurochemical, electrophysiological, and other behavioral evidence. We conclude that dopamine systems are not needed either to mediate the hedonic pleasure of reinforcers or to mediate predictive associations involved in hedonic reward learning. We conclude instead that dopamine may be more important to incentive salience attributions to the neural representations of reward-related stimuli. Incentive salience, we suggest, is a distinct component of motivation and reward. In other words, dopamine systems are necessary

  4. Topography, power, and current source density of θ oscillations during reward processing as markers for alcohol dependence.

    Science.gov (United States)

    Kamarajan, Chella; Rangaswamy, Madhavi; Manz, Niklas; Chorlian, David B; Pandey, Ashwini K; Roopesh, Bangalore N; Porjesz, Bernice

    2012-05-01

    Recent studies have linked alcoholism with a dysfunctional neural reward system. Although several electrophysiological studies have explored reward processing in healthy individuals, such studies in alcohol-dependent individuals are quite rare. The present study examines theta oscillations during reward processing in abstinent alcoholics. The electroencephalogram (EEG) was recorded in 38 abstinent alcoholics and 38 healthy controls as they performed a single outcome gambling task, which involved outcomes of either loss or gain of an amount (10 or 50¢) that was bet. Event-related theta band (3.0-7.0 Hz) power following each outcome stimulus was computed using the S-transform method. Theta power at the time window of the outcome-related negativity (ORN) and positivity (ORP) (200-500 ms) was compared across groups and outcome conditions. Additionally, behavioral data of impulsivity and task performance were analyzed. The alcoholic group showed significantly decreased theta power during reward processing compared to controls. Current source density (CSD) maps of alcoholics revealed weaker and diffuse source activity for all conditions and weaker bilateral prefrontal sources during the Loss 50 condition when compared with controls who manifested stronger and focused midline sources. Furthermore, alcoholics exhibited increased impulsivity and risk-taking on the behavioral measures. A strong association between reduced anterior theta power and impulsive task-performance was observed. It is suggested that decreased power and weaker and diffuse CSD in alcoholics may be due to dysfunctional neural reward circuitry. The relationship among alcoholism, theta oscillations, reward processing, and impulsivity could offer clues to understand brain circuitries that mediate reward processing and inhibitory control.

  5. A network-dependent rewarding system: proof-of-mining

    OpenAIRE

    Lao, Joe

    2014-01-01

    A soft control of the network activity through varying reward in a proof-of-work (PoW) cryptocurrency is reported. Rewards are the necessity to incent the contributors activities (i.e., mining) in order to maintain the PoW network. Contrary to constant rewarding in a certain period implemented in most of cryptocurrency, such as bitcoin, we propose a network-dependent rewarding model system, primarily including two phases: 1) activities encouraging phase in which higher rewards are issued at h...

  6. Activation of D1/5 Dopamine Receptors: A Common Mechanism for Enhancing Extinction of Fear and Reward-Seeking Behaviors.

    Science.gov (United States)

    Abraham, Antony D; Neve, Kim A; Lattal, K Matthew

    2016-07-01

    Dopamine is critical for many processes that drive learning and memory, including motivation, prediction error, incentive salience, memory consolidation, and response output. Theories of dopamine's function in these processes have, for the most part, been developed from behavioral approaches that examine learning mechanisms in appetitive tasks. A parallel and growing literature indicates that dopamine signaling is involved in consolidation of memories into stable representations in aversive tasks such as fear conditioning. Relatively little is known about how dopamine may modulate memories that form during extinction, when organisms learn that the relation between previously associated events is severed. We investigated whether fear and reward extinction share common mechanisms that could be enhanced with dopamine D1/5 receptor activation. Pharmacological activation of dopamine D1/5 receptors (with SKF 81297) enhanced extinction of both cued and contextual fear. These effects also occurred in the extinction of cocaine-induced conditioned place preference, suggesting that the observed effects on extinction were not specific to a particular type of procedure (aversive or appetitive). A cAMP/PKA biased D1 agonist (SKF 83959) did not affect fear extinction, whereas a broadly efficacious D1 agonist (SKF 83822) promoted fear extinction. Together, these findings show that dopamine D1/5 receptor activation is a target for the enhancement of fear or reward extinction. PMID:26763483

  7. Activation of D1/5 Dopamine Receptors: A Common Mechanism for Enhancing Extinction of Fear and Reward-Seeking Behaviors.

    Science.gov (United States)

    Abraham, Antony D; Neve, Kim A; Lattal, K Matthew

    2016-07-01

    Dopamine is critical for many processes that drive learning and memory, including motivation, prediction error, incentive salience, memory consolidation, and response output. Theories of dopamine's function in these processes have, for the most part, been developed from behavioral approaches that examine learning mechanisms in appetitive tasks. A parallel and growing literature indicates that dopamine signaling is involved in consolidation of memories into stable representations in aversive tasks such as fear conditioning. Relatively little is known about how dopamine may modulate memories that form during extinction, when organisms learn that the relation between previously associated events is severed. We investigated whether fear and reward extinction share common mechanisms that could be enhanced with dopamine D1/5 receptor activation. Pharmacological activation of dopamine D1/5 receptors (with SKF 81297) enhanced extinction of both cued and contextual fear. These effects also occurred in the extinction of cocaine-induced conditioned place preference, suggesting that the observed effects on extinction were not specific to a particular type of procedure (aversive or appetitive). A cAMP/PKA biased D1 agonist (SKF 83959) did not affect fear extinction, whereas a broadly efficacious D1 agonist (SKF 83822) promoted fear extinction. Together, these findings show that dopamine D1/5 receptor activation is a target for the enhancement of fear or reward extinction.

  8. The impact of cancer on the neural activity

    CERN Document Server

    Iarosz, Kelly Cristiane; Baptista, Murilo da Silva; Protachevicz, Paulo Ricardo

    2015-01-01

    We study the impact of the decrease in the neural population on the neuronal firing rate. We propose a cellular automaton model from cancerous growth in a brain tissue and the death of neurons due absence of cells that help support to neurons. We use this model to study how the firing rate changes when the neuronal networks is under different external stimuli and the cancerous cells have different proliferation rate. Our work shows that the cancer proliferation decreases the neuronal firing rate.

  9. Integrative activity of neural networks may code virtual spaces with internal representations.

    Science.gov (United States)

    Strelnikov, Kuzma

    2014-10-01

    It was shown recently in neuroimaging that spatial differentiation of brain activity provides novel information about brain function. This confirms the integrative organisation of brain activity, but given present technical limitations of neuroimaging approaches, the exact role of integrative activity remains unclear. We trained a neural network to integrate information using random numbers so as to imitate the "centre-periphery" pattern of brain activity in neuroimaging. Only the hierarchical organisation of the network permitted the learning of fast and reliable integration. We presented images to the trained network and, by spatial differentiation of the network activity, obtained virtual spaces with the presented images. Thus, our study established the necessity of the hierarchical organisation of neural networks for integration and demonstrated that the role of neural integration in the brain may be to create virtual spaces with internal representations of the objects.

  10. Coupling Strength and System Size Induce Firing Activity of Globally Coupled Neural Network

    Institute of Scientific and Technical Information of China (English)

    WEI Du-Qu; LUO Xiao-Shu; ZOU Yan-Li

    2008-01-01

    We investigate how firing activity of globally coupled neural network depends on the coupling strength C and system size N.Network elements are described by space-clamped FitzHugh-Nagumo (SCFHN) neurons with the values of parameters at which no firing activity occurs.It is found that for a given appropriate coupling strength,there is an intermediate range of system size where the firing activity of globally coupled SCFHN neural network is induced and enhanced.On the other hand,for a given intermediate system size level,there ex/sts an optimal value of coupling strength such that the intensity of firing activity reaches its maximum.These phenomena imply that the coupling strength and system size play a vital role in firing activity of neural network.

  11. Active control of vibration using a neural network.

    Science.gov (United States)

    Snyder, S D; Tanaka, N

    1995-01-01

    Feedforward control of sound and vibration using a neural network-based control system is considered, with the aim being to derive an architecture/algorithm combination which is capable of supplanting the commonly used finite impulse response filter/filtered-x least mean square (LMS) linear arrangement for certain nonlinear problems. An adaptive algorithm is derived which enables stable adaptation of the neural controller for this purpose, while providing the capacity to maintain causality within the control scheme. The algorithm is shown to be simply a generalization of the linear filtered-x LMS algorithm. Experiments are undertaken which demonstrate the utility of the proposed arrangement, showing that it performs as well as a linear control system for a linear control problem and better for a nonlinear control problem. The experiments also lead to the conclusion that more work is required to improve the predictability and consistency of the performance before the neural network controller becomes a practical alternative to the current linear feedforward systems.

  12. Robot Reinforcement Learning using EEG-based reward signals

    OpenAIRE

    Iturrate, Inaki; Montesano, Luis; Minguez, Javier

    2010-01-01

    Reinforcement learning algorithms have been successfully applied in robotics to learn how to solve tasks based on reward signals obtained during task execution. These reward signals are usually modeled by the programmer or provided by supervision. However, there are situations in which this reward is hard to encode, and so would require a supervised approach of reinforcement learning, where a user directly types the reward on each trial. This paper proposes to use brain activity recorded by a...

  13. Testosterone and reward prediction-errors in healthy men and men with schizophrenia.

    Science.gov (United States)

    Morris, R W; Purves-Tyson, T D; Weickert, C Shannon; Rothmond, D; Lenroot, R; Weickert, T W

    2015-11-01

    Sex hormones impact reward processing, which is dysfunctional in schizophrenia; however, the degree to which testosterone levels relate to reward-related brain activity in healthy men and the extent to which this relationship may be altered in men with schizophrenia has not been determined. We used functional magnetic resonance imaging (fMRI) to measure neural responses in the striatum during reward prediction-errors and hormone assays to measure testosterone and prolactin in serum. To determine if testosterone can have a direct effect on dopamine neurons, we also localized and measured androgen receptors in human midbrain with immunohistochemistry and quantitative PCR. We found correlations between testosterone and prediction-error related activity in the ventral striatum of healthy men, but not in men with schizophrenia, such that testosterone increased the size of positive and negative prediction-error related activity in a valence-specific manner. We also identified midbrain dopamine neurons that were androgen receptor immunoreactive, and found that androgen receptor (AR) mRNA was positively correlated with tyrosine hydroxylase (TH) mRNA in human male substantia nigra. The results suggest that sex steroid receptors can potentially influence midbrain dopamine biosynthesis, and higher levels of serum testosterone are linked to better discrimination of motivationally-relevant signals in the ventral striatum, putatively by modulation of the dopamine biosynthesis pathway via AR ligand binding. However, the normal relationship between serum testosterone and ventral striatum activity during reward learning appears to be disrupted in schizophrenia. PMID:26232868

  14. Dynamical Behaviors of Multiple Equilibria in Competitive Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions.

    Science.gov (United States)

    Nie, Xiaobing; Zheng, Wei Xing

    2016-03-01

    This paper addresses the problem of coexistence and dynamical behaviors of multiple equilibria for competitive neural networks. First, a general class of discontinuous nonmonotonic piecewise linear activation functions is introduced for competitive neural networks. Then based on the fixed point theorem and theory of strict diagonal dominance matrix, it is shown that under some conditions, such n -neuron competitive neural networks can have 5(n) equilibria, among which 3(n) equilibria are locally stable and the others are unstable. More importantly, it is revealed that the neural networks with the discontinuous activation functions introduced in this paper can have both more total equilibria and locally stable equilibria than the ones with other activation functions, such as the continuous Mexican-hat-type activation function and discontinuous two-level activation function. Furthermore, the 3(n) locally stable equilibria given in this paper are located in not only saturated regions, but also unsaturated regions, which is different from the existing results on multistability of neural networks with multiple level activation functions. A simulation example is provided to illustrate and validate the theoretical findings.

  15. Extending overjustification: the effect of perceived reward-giver intention on response to rewards.

    Science.gov (United States)

    Forehand, M R

    2000-12-01

    The perceived intention model incorporates a new moderator, beliefs about reward-giver intention, into the overjustification paradigm. In 2 simulated shopping studies featuring products paired with promotional rewards, consumers who believed the marketer was promotion focused (reward used to encourage purchase) reported lower purchase intentions and brand attitudes for promoted products after promotion, whereas consumers who believed the marketer was reward focused (promotion used to distribute the reward) showed no attitude change. Promotion-focus beliefs lowered attitudes by heightening the contingency between the promotion and purchase and thereby increasing the perceived causal role of the reward. This effect was contingent on initial behavior--postpromotion attitude change occurred for consumers who actively engaged in product decisions but not for consumers who passively observed the choice sets. PMID:11125656

  16. Accounting for Dynamic Fluctuations across Time when Examining fMRI Test-Retest Reliability: Analysis of a Reward Paradigm in the EMBARC Study.

    Directory of Open Access Journals (Sweden)

    Henry W Chase

    Full Text Available Longitudinal investigation of the neural correlates of reward processing in depression may represent an important step in defining effective biomarkers for antidepressant treatment outcome prediction, but the reliability of reward-related activation is not well understood. Thirty-seven healthy control participants were scanned using fMRI while performing a reward-related guessing task on two occasions, approximately one week apart. Two main contrasts were examined: right ventral striatum (VS activation fMRI BOLD signal related to signed prediction errors (PE and reward expectancy (RE. We also examined bilateral visual cortex activation coupled to outcome anticipation. Significant VS PE-related activity was observed at the first testing session, but at the second testing session, VS PE-related activation was significantly reduced. Conversely, significant VS RE-related activity was observed at time 2 but not time 1. Increases in VS RE-related activity from time 1 to time 2 were significantly associated with decreases in VS PE-related activity from time 1 to time 2 across participants. Intraclass correlations (ICCs in VS were very low. By contrast, visual cortex activation had much larger ICCs, particularly in individuals with high quality data. Dynamic changes in brain activation are widely predicted, and failure to account for these changes could lead to inaccurate evaluations of the reliability of functional MRI signals. Conventional measures of reliability cannot distinguish between changes specified by algorithmic models of neural function and noisy signal. Here, we provide evidence for the former possibility: reward-related VS activations follow the pattern predicted by temporal difference models of reward learning but have low ICCs.

  17. Theta-band oscillatory activity differs between gamblers and nongamblers comorbid with attention-deficit hyperactivity disorder in a probabilistic reward-learning task.

    Science.gov (United States)

    Abouzari, Mehdi; Oberg, Scott; Tata, Matthew

    2016-10-01

    Problemgambling is thought to be comorbid with attention-deficit hyperactivity disorder (ADHD). We tested whether gamblers and ADHD patients exhibit similar reward-related brain activity in response to feedback in a gambling task. A series of brain electrical responses can be observed in the electroencephalogram (EEG) and the stimulus-locked event-related potentials (ERP), when participants in a gambling task are given feedback regardless of winning or losing the previous bet. Here, we used a simplified computerized version of the Iowa Gambling Task (IGT) to assess differences in reinforcement-driven choice adaptation between unmedicated ADHD patients with or without problem gambling traits and contrasted with a sex- and age-matched control group. EEG was recorded from the participants while they were engaged in the task which contained two choice options with different net payouts and win/loss probabilities. Learning trend which shows the ability to acquire and use knowledge of the reward outcomes to obtain a positive financial outcome was not observed in ADHD gamblers versus nongamblers. Induced theta-band (4-8Hz) power over frontal cortex was significantly higher in gamblers versus nongamblers in all different high-risk/low-risk win/lose conditions. Whereas induced low alpha (9-11Hz) power at frontal electrodes could only differentiate high-risk lose between gamblers and nongamblers but not the other three conditions between the two groups. The results indicate that ADHD nongamblers do not share with problem gamblers underlying deficits in reward learning. These pilot data highlight the need for studies of ADHD in gambling to elucidate how motivational states are represented during feedback processing.

  18. Multistability and Instability of Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions.

    Science.gov (United States)

    Nie, Xiaobing; Zheng, Wei Xing

    2015-11-01

    In this paper, we discuss the coexistence and dynamical behaviors of multiple equilibrium points for recurrent neural networks with a class of discontinuous nonmonotonic piecewise linear activation functions. It is proved that under some conditions, such n -neuron neural networks can have at least 5(n) equilibrium points, 3(n) of which are locally stable and the others are unstable, based on the contraction mapping theorem and the theory of strict diagonal dominance matrix. The investigation shows that the neural networks with the discontinuous activation functions introduced in this paper can have both more total equilibrium points and more locally stable equilibrium points than the ones with continuous Mexican-hat-type activation function or discontinuous two-level activation functions. An illustrative example with computer simulations is presented to verify the theoretical analysis.

  19. Reward Processing in Autism

    OpenAIRE

    Scott-Van Zeeland, Ashley A.; DAPRETTO, MIRELLA; Ghahremani, Dara G.; Poldrack, Russell A.; Bookheimer, Susan Y.

    2010-01-01

    The social motivation hypothesis of autism posits that infants with autism do not experience social stimuli as rewarding, thereby leading to a cascade of potentially negative consequences for later development. While possible downstream effects of this hypothesis such as altered face and voice processing have been examined, there has not been a direct investigation of social reward processing in autism. Here we use functional magnetic resonance imaging to examine social and monetary rewarded ...

  20. Neural networks with non-smooth and impact activations

    CERN Document Server

    Akhmet, M U

    2011-01-01

    In this paper, we consider a model of impulsive recurrent neural networks with piecewise constant delay. The dynamics are presented by differential equations with discontinuities such as impulses at fixed moments and piecewise constant argument of generalized type. Sufficient conditions ensuring the existence, uniqueness and global asymptotic stability of the equilibrium point are obtained. By employing Green's function we derive new result of existence of the periodic solution. The global asymptotic stability of the solution is investigated. Examples with numerical simulations are given to validate the theoretical results.

  1. [Neural mechanisms of decision making].

    Science.gov (United States)

    Funahashi, Shintaro

    2008-09-01

    Decision-making plays an important role in the transformation of incoming sensory information to purposeful actions. Many decisions have important biological and social consequences, while others may have a more limited impact on our everyday life. The neural mechanisms of decision-making currently constitute an important subject under intense investigation in the field of cognitive and behavioral neuroscience. Among the investigations, on this topic, those involving sensory discrimination tasks using visual motion have provided a wealth of information about the nature of the neural circuitry required to perform perceptual decision-making. For example, by using a motion discrimination task, Shadlen and Newsome have shown an essential role of area LIP in perceptual decision-making. On the other hand, the importance of reward and reward expectations as determinants of decision-making is increasingly appreciated. In particular, reinforcement learning and economic theories, such as game theory, have provided valuable insights into the brain functions related to decision-making. By using a competitive game analogous to matching pennies against a computer, Lee's group showed that in monkeys, previous selections modulated prefrontal neural activity and that this modulation affected the current choice behavior. The prefrontal cortex has been shown to participate in decision-making in free-choice conditions. By using a task involving the free choice of 1 target from multiple saccade targets, Funahashi's group examined the prefrontal participation in decision-making in a free-choice condition. They compared the activities of prefrontal neurons during an oculomotor delay task with forced-choice conditions and free-choice conditions and identified the neural components reflecting the underlying decision-making processes. Although several attempts have been made to understand the neural mechanisms of decision-making, further investigations are required to fully understand these

  2. Strategies influence neural activity for feedback learning across child and adolescent development.

    Science.gov (United States)

    Peters, Sabine; Koolschijn, P Cédric M P; Crone, Eveline A; Van Duijvenvoorde, Anna C K; Raijmakers, Maartje E J

    2014-09-01

    Learning from feedback is an important aspect of executive functioning that shows profound improvements during childhood and adolescence. This is accompanied by neural changes in the feedback-learning network, which includes pre-supplementary motor area (pre- SMA)/anterior cingulate cortex (ACC), dorsolateral prefrontal cortex (DLPFC), superior parietal cortex (SPC), and the basal ganglia. However, there can be considerable differences within age ranges in performance that are ascribed to differences in strategy use. This is problematic for traditional approaches of analyzing developmental data, in which age groups are assumed to be homogenous in strategy use. In this study, we used latent variable models to investigate if underlying strategy groups could be detected for a feedback-learning task and whether there were differences in neural activation patterns between strategies. In a sample of 268 participants between ages 8 to 25 years, we observed four underlying strategy groups, which were cut across age groups and varied in the optimality of executive functioning. These strategy groups also differed in neural activity during learning; especially the most optimal performing group showed more activity in DLPFC, SPC and pre-SMA/ACC compared to the other groups. However, age differences remained an important contributor to neural activation, even when correcting for strategy. These findings contribute to the debate of age versus performance predictors of neural development, and highlight the importance of studying individual differences in strategy use when studying development.

  3. Epigenetic activation of Sox2 gene in the developing vertebrate neural plate

    Science.gov (United States)

    Bouzas, Santiago O.; Marini, Melisa S.; Torres Zelada, Eliana; Buzzi, Ailín L.; Morales Vicente, David A.; Strobl-Mazzulla, Pablo H.

    2016-01-01

    One of the earliest manifestations of neural induction is onset of expression of the neural marker Sox2, mediated by the activation of the enhancers N1 and N2. By using loss and gain of function, we find that Sox2 expression requires the activity of JmjD2A and the Msk1 kinase, which can respectively demethylate the repressive H3K9me3 mark and phosphorylate the activating H3S10 (H3S10ph) mark. Bimolecular fluorescence complementation reveals that the adaptor protein 14-3-3, known to bind to H3S10ph, interacts with JMJD2A and may be involved in its recruitment to regulatory regions of the Sox2 gene. Chromatin immunoprecipitation reveals dynamic binding of JMJD2A to the Sox2 promoter and N-1 enhancer at the time of neural plate induction. Finally, we show a clear temporal antagonism on the occupancy of H3K9me3 and H3S10ph modifications at the promoter of the Sox2 locus before and after the neural plate induction. Taken together, our results propose a series of epigenetic events necessary for the early activation of the Sox2 gene in neural progenitor cells. PMID:27099369

  4. Decoding-Accuracy-Based Sequential Dimensionality Reduction of Spatio-Temporal Neural Activities

    Science.gov (United States)

    Funamizu, Akihiro; Kanzaki, Ryohei; Takahashi, Hirokazu

    Performance of a brain machine interface (BMI) critically depends on selection of input data because information embedded in the neural activities is highly redundant. In addition, properly selected input data with a reduced dimension leads to improvement of decoding generalization ability and decrease of computational efforts, both of which are significant advantages for the clinical applications. In the present paper, we propose an algorithm of sequential dimensionality reduction (SDR) that effectively extracts motor/sensory related spatio-temporal neural activities. The algorithm gradually reduces input data dimension by dropping neural data spatio-temporally so as not to undermine the decoding accuracy as far as possible. Support vector machine (SVM) was used as the decoder, and tone-induced neural activities in rat auditory cortices were decoded into the test tone frequencies. SDR reduced the input data dimension to a quarter and significantly improved the accuracy of decoding of novel data. Moreover, spatio-temporal neural activity patterns selected by SDR resulted in significantly higher accuracy than high spike rate patterns or conventionally used spatial patterns. These results suggest that the proposed algorithm can improve the generalization ability and decrease the computational effort of decoding.

  5. Neural Activation Underlying Cognitive Control in the Context of Neutral and Affectively Charged Pictures in Children

    Science.gov (United States)

    Lamm, Connie; White, Lauren K.; McDermott, Jennifer Martin; Fox, Nathan A.

    2012-01-01

    The neural correlates of cognitive control for typically developing 9-year-old children were examined using dense-array ERPs and estimates of cortical activation (LORETA) during a go/no-go task with two conditions: a neutral picture condition and an affectively charged picture condition. Activation was estimated for the entire cortex after which…

  6. Dopamine signals mimic reward prediction errors

    OpenAIRE

    Schoenbaum, Geoffrey; Esber, Guillem R; Iordanova, Mihaela D.

    2013-01-01

    Modern theories of associative learning center on a prediction error. A study finds that artificial activation of dopamine neurons can substitute for missing reward prediction errors to rescue blocked learning.

  7. New exponential synchronization criteria for time-varying delayed neural networks with discontinuous activations.

    Science.gov (United States)

    Cai, Zuowei; Huang, Lihong; Zhang, Lingling

    2015-05-01

    This paper investigates the problem of exponential synchronization of time-varying delayed neural networks with discontinuous neuron activations. Under the extended Filippov differential inclusion framework, by designing discontinuous state-feedback controller and using some analytic techniques, new testable algebraic criteria are obtained to realize two different kinds of global exponential synchronization of the drive-response system. Moreover, we give the estimated rate of exponential synchronization which depends on the delays and system parameters. The obtained results extend some previous works on synchronization of delayed neural networks not only with continuous activations but also with discontinuous activations. Finally, numerical examples are provided to show the correctness of our analysis via computer simulations. Our method and theoretical results have a leading significance in the design of synchronized neural network circuits involving discontinuous factors and time-varying delays.

  8. Vascular Endothelial Growth Factor Receptor 3 Controls Neural Stem Cell Activation in Mice and Humans

    Directory of Open Access Journals (Sweden)

    Jinah Han

    2015-02-01

    Full Text Available Neural stem cells (NSCs continuously produce new neurons within the adult mammalian hippocampus. NSCs are typically quiescent but activated to self-renew or differentiate into neural progenitor cells. The molecular mechanisms of NSC activation remain poorly understood. Here, we show that adult hippocampal NSCs express vascular endothelial growth factor receptor (VEGFR 3 and its ligand VEGF-C, which activates quiescent NSCs to enter the cell cycle and generate progenitor cells. Hippocampal NSC activation and neurogenesis are impaired by conditional deletion of Vegfr3 in NSCs. Functionally, this is associated with compromised NSC activation in response to VEGF-C and physical activity. In NSCs derived from human embryonic stem cells (hESCs, VEGF-C/VEGFR3 mediates intracellular activation of AKT and ERK pathways that control cell fate and proliferation. These findings identify VEGF-C/VEGFR3 signaling as a specific regulator of NSC activation and neurogenesis in mammals.

  9. Low and high gamma oscillations in rat ventral striatum have distinct relationships to behavior, reward, and spiking activity on a learned spatial decision task

    Directory of Open Access Journals (Sweden)

    Matthijs A A Van Der Meer

    2009-06-01

    Full Text Available Local field potential (LFP oscillations in the brain reflect organization thought to be important for perception, attention, movement, and memory. In the basal ganglia, including dorsal striatum, dysfunctional LFP states are associated with Parkinson’s disease, while in healthy subjects, dorsal striatal LFPs have been linked to decision-making processes. However, LFPs in ventral striatum have been less studied. We report that in rats running a spatial decision task, prominent gamma-50 (45-55 Hz and gamma-80 (70-85 Hz oscillations in ventral striatum had distinct relationships to behavior, task events, and spiking activity. Gamma-50 power increased sharply following reward delivery and before movement initiation, while in contrast, gamma-80 power ramped up gradually to reward locations. Gamma-50 power was low and contained little structure during early learning, but rapidly developed a stable pattern, while gamma-80 power was initially high before returning to a stable level within a similar timeframe. Putative fast-spiking interneurons (FSIs showed phase, firing rate, and coherence relationships with gamma-50 and gamma-80, indicating that the observed LFP patterns are locally relevant. Furthermore, in a number of FSIs such relationships were specific to gamma-50 or gamma-80, suggesting that partially distinct FSI populations mediate the effects of gamma-50 and gamma-80.

  10. Functional Relevance of Different Basal Ganglia Pathways Investigated in a Spiking Model with Reward Dependent Plasticity.

    Science.gov (United States)

    Berthet, Pierre; Lindahl, Mikael; Tully, Philip J; Hellgren-Kotaleski, Jeanette; Lansner, Anders

    2016-01-01

    The brain enables animals to behaviorally adapt in order to survive in a complex and dynamic environment, but how reward-oriented behaviors are achieved and computed by its underlying neural circuitry is an open question. To address this concern, we have developed a spiking model of the basal ganglia (BG) that learns to dis-inhibit the action leading to a reward despite ongoing changes in the reward schedule. The architecture of the network features the two pathways commonly described in BG, the direct (denoted D1) and the indirect (denoted D2) pathway, as well as a loop involving striatum and the dopaminergic system. The activity of these dopaminergic neurons conveys the reward prediction error (RPE), which determines the magnitude of synaptic plasticity within the different pathways. All plastic connections implement a versatile four-factor learning rule derived from Bayesian inference that depends upon pre- and post-synaptic activity, receptor type, and dopamine level. Synaptic weight updates occur in the D1 or D2 pathways depending on the sign of the RPE, and an efference copy informs upstream nuclei about the action selected. We demonstrate successful performance of the system in a multiple-choice learning task with a transiently changing reward schedule. We simulate lesioning of the various pathways and show that a condition without the D2 pathway fares worse than one without D1. Additionally, we simulate the degeneration observed in Parkinson's disease (PD) by decreasing the number of dopaminergic neurons during learning. The results suggest that the D1 pathway impairment in PD might have been overlooked. Furthermore, an analysis of the alterations in the synaptic weights shows that using the absolute reward value instead of the RPE leads to a larger change in D1. PMID:27493625

  11. Addiction: Beyond dopamine reward circuitry

    Energy Technology Data Exchange (ETDEWEB)

    Volkow, N.D.; Wang, G.; Volkow, N.D.; Wang, G.-J.; Fowler, J.S.; Tomasi, D.; Telang, F.

    2011-09-13

    Dopamine (DA) is considered crucial for the rewarding effects of drugs of abuse, but its role in addiction is much less clear. This review focuses on studies that used PET to characterize the brain DA system in addicted subjects. These studies have corroborated in humans the relevance of drug-induced fast DA increases in striatum [including nucleus accumbens (NAc)] in their rewarding effects but have unexpectedly shown that in addicted subjects, drug-induced DA increases (as well as their subjective reinforcing effects) are markedly blunted compared with controls. In contrast, addicted subjects show significant DA increases in striatum in response to drug-conditioned cues that are associated with self-reports of drug craving and appear to be of a greater magnitude than the DA responses to the drug. We postulate that the discrepancy between the expectation for the drug effects (conditioned responses) and the blunted pharmacological effects maintains drug taking in an attempt to achieve the expected reward. Also, whether tested during early or protracted withdrawal, addicted subjects show lower levels of D2 receptors in striatum (including NAc), which are associated with decreases in baseline activity in frontal brain regions implicated in salience attribution (orbitofrontal cortex) and inhibitory control (anterior cingulate gyrus), whose disruption results in compulsivity and impulsivity. These results point to an imbalance between dopaminergic circuits that underlie reward and conditioning and those that underlie executive function (emotional control and decision making), which we postulate contributes to the compulsive drug use and loss of control in addiction.

  12. Addiction: Beyond dopamine reward circuitry

    International Nuclear Information System (INIS)

    Dopamine (DA) is considered crucial for the rewarding effects of drugs of abuse, but its role in addiction is much less clear. This review focuses on studies that used PET to characterize the brain DA system in addicted subjects. These studies have corroborated in humans the relevance of drug-induced fast DA increases in striatum [including nucleus accumbens (NAc)] in their rewarding effects but have unexpectedly shown that in addicted subjects, drug-induced DA increases (as well as their subjective reinforcing effects) are markedly blunted compared with controls. In contrast, addicted subjects show significant DA increases in striatum in response to drug-conditioned cues that are associated with self-reports of drug craving and appear to be of a greater magnitude than the DA responses to the drug. We postulate that the discrepancy between the expectation for the drug effects (conditioned responses) and the blunted pharmacological effects maintains drug taking in an attempt to achieve the expected reward. Also, whether tested during early or protracted withdrawal, addicted subjects show lower levels of D2 receptors in striatum (including NAc), which are associated with decreases in baseline activity in frontal brain regions implicated in salience attribution (orbitofrontal cortex) and inhibitory control (anterior cingulate gyrus), whose disruption results in compulsivity and impulsivity. These results point to an imbalance between dopaminergic circuits that underlie reward and conditioning and those that underlie executive function (emotional control and decision making), which we postulate contributes to the compulsive drug use and loss of control in addiction.

  13. Information content of neural networks with self-control and variable activity

    Science.gov (United States)

    Bollé, D.; Amari, S. I.; Dominguez Carreta, D. R. C.; Massolo, G.

    2001-02-01

    A self-control mechanism for the dynamics of neural networks with variable activity is discussed using a recursive scheme for the time evolution of the local field. It is based upon the introduction of a self-adapting time-dependent threshold as a function of both the neural and pattern activity in the network. This mechanism leads to an improvement of the information content of the network as well as an increase of the storage capacity and the basins of attraction. Different architectures are considered and the results are compared with numerical simulations.

  14. Computational modeling of neural activities for statistical inference

    CERN Document Server

    Kolossa, Antonio

    2016-01-01

    This authored monograph supplies empirical evidence for the Bayesian brain hypothesis by modeling event-related potentials (ERP) of the human electroencephalogram (EEG) during successive trials in cognitive tasks. The employed observer models are useful to compute probability distributions over observable events and hidden states, depending on which are present in the respective tasks. Bayesian model selection is then used to choose the model which best explains the ERP amplitude fluctuations. Thus, this book constitutes a decisive step towards a better understanding of the neural coding and computing of probabilities following Bayesian rules. The target audience primarily comprises research experts in the field of computational neurosciences, but the book may also be beneficial for graduate students who want to specialize in this field. .

  15. Validation and extension of the reward-mountain model

    Directory of Open Access Journals (Sweden)

    Yannick-André eBreton

    2013-10-01

    Full Text Available The reward-mountain model relates the vigor of reward seeking to the strength and cost of reward. Application of this model provides information about the stage of processing at which manipulations such as drug administration, lesions, deprivation states, and optogenetic interventions act to alter reward seeking. The model has been updated by incorporation of new information about frequency following in the directly stimulated neurons responsible for brain stimulation reward and about the function that maps objective opportunity costs into subjective ones. The behavioral methods for applying the model have been updated and improved as well. To assess the impact of these changes, two related predictions of the model that were supported by earlier work have been retested: 1 altering the duration of rewarding brain stimulation should change the pulse frequency required to produce a reward of half-maximal intensity, and 2 this manipulation should not change the opportunity cost at which half-maximal performance is directed at earning a maximally intense reward. Prediction 1 was supported in all six subjects, but prediction 2 was supported in only three. The latter finding is interpreted to reflect recruitment, at some stimulation sites, of a heterogeneous reward substrate comprising dual, parallel circuits that integrate the stimulation-induced neural signals.

  16. Implications of the Dependence of Neuronal Activity on Neural Network States for the Design of Brain-Machine Interfaces

    OpenAIRE

    Panzeri, Stefano; Safaai, Houman; De Feo, Vito; Vato, Alessandro

    2016-01-01

    Brain-machine interfaces (BMIs) can improve the quality of life of patients with sensory and motor disabilities by both decoding motor intentions expressed by neural activity, and by encoding artificially sensed information into patterns of neural activity elicited by causal interventions on the neural tissue. Yet, current BMIs can exchange relatively small amounts of information with the brain. This problem has proved difficult to overcome by simply increasing the number of recording or stim...

  17. Application of neural networks with orthogonal activation functions in control of dynamical systems

    Science.gov (United States)

    Nikolić, Saša S.; Antić, Dragan S.; Milojković, Marko T.; Milovanović, Miroslav B.; Perić, Staniša Lj.; Mitić, Darko B.

    2016-04-01

    In this article, we present a new method for the synthesis of almost and quasi-orthogonal polynomials of arbitrary order. Filters designed on the bases of these functions are generators of generalised quasi-orthogonal signals for which we derived and presented necessary mathematical background. Based on theoretical results, we designed and practically implemented generalised first-order (k = 1) quasi-orthogonal filter and proved its quasi-orthogonality via performed experiments. Designed filters can be applied in many scientific areas. In this article, generated functions were successfully implemented in Nonlinear Auto Regressive eXogenous (NARX) neural network as activation functions. One practical application of the designed orthogonal neural network is demonstrated through the example of control of the complex technical non-linear system - laboratory magnetic levitation system. Obtained results were compared with neural networks with standard activation functions and orthogonal functions of trigonometric shape. The proposed network demonstrated superiority over existing solutions in the sense of system performances.

  18. Selective activation of the trace amine-associated receptor 1 decreases cocaine's reinforcing efficacy and prevents cocaine-induced changes in brain reward thresholds.

    Science.gov (United States)

    Pei, Yue; Mortas, Patrick; Hoener, Marius C; Canales, Juan J

    2015-12-01

    The newly discovered trace amine-associated receptor 1 (TAAR1) has emerged as a promising target for medication development in stimulant addiction due to its ability to regulate dopamine (DA) function and modulate stimulants' effects. Recent findings indicate that TAAR1 activation blocks some of the abuse-related physiological and behavioral effects of cocaine. However, findings from existing self-administration studies are inconclusive due to the very limited range of cocaine unit doses tested. Here, in order to shed light on the influence of TAAR1 on cocaine's reward and reinforcement, we studied the effects of partial and full activation of TAAR1on (1) the dose-response curve for cocaine self-administration and (2) cocaine-induced changes in intracranial self-stimulation (ICSS). In the first experiment, we examined the effects of the selective full and partial TAAR1 agonists, RO5256390 and RO5203648, on self-administration of five unit-injection doses of cocaine (0.03, 0.1, 0.2, 0.45, and 1mg/kg/infusion). Both agonists induced dose-dependent downward shifts in the cocaine dose-response curve, indicating that both partial and full TAAR1 activation decrease cocaine, reinforcing efficacy. In the second experiment, RO5256390 and the partial agonist, RO5263397, dose-dependently prevented cocaine-induced lowering of ICSS thresholds. Taken together, these data demonstrated that TAAR1 stimulation effectively suppresses the rewarding and reinforcing effects of cocaine in self-administration and ICSS models, supporting the candidacy of TAAR1 as a drug discovery target for cocaine addiction. PMID:26048337

  19. Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity

    Science.gov (United States)

    Moses, David A.; Mesgarani, Nima; Leonard, Matthew K.; Chang, Edward F.

    2016-10-01

    Objective. The superior temporal gyrus (STG) and neighboring brain regions play a key role in human language processing. Previous studies have attempted to reconstruct speech information from brain activity in the STG, but few of them incorporate the probabilistic framework and engineering methodology used in modern speech recognition systems. In this work, we describe the initial efforts toward the design of a neural speech recognition (NSR) system that performs continuous phoneme recognition on English stimuli with arbitrary vocabulary sizes using the high gamma band power of local field potentials in the STG and neighboring cortical areas obtained via electrocorticography. Approach. The system implements a Viterbi decoder that incorporates phoneme likelihood estimates from a linear discriminant analysis model and transition probabilities from an n-gram phonemic language model. Grid searches were used in an attempt to determine optimal parameterizations of the feature vectors and Viterbi decoder. Main results. The performance of the system was significantly improved by using spatiotemporal representations of the neural activity (as opposed to purely spatial representations) and by including language modeling and Viterbi decoding in the NSR system. Significance. These results emphasize the importance of modeling the temporal dynamics of neural responses when analyzing their variations with respect to varying stimuli and demonstrate that speech recognition techniques can be successfully leveraged when decoding speech from neural signals. Guided by the results detailed in this work, further development of the NSR system could have applications in the fields of automatic speech recognition and neural prosthetics.

  20. Impaired activity-dependent neural circuit assembly and refinement in autism spectrum disorder genetic models

    OpenAIRE

    Caleb Andrew Doll; Kendal eBroadie

    2014-01-01

    Early-use activity during circuit-specific critical periods refines brain circuitry by the coupled processes of eliminating inappropriate synapses and strengthening maintained synapses. We theorize these activity-dependent developmental processes are specifically impaired in autism spectrum disorders (ASDs). ASD genetic models in both mouse and Drosophila have pioneered our insights into normal activity-dependent neural circuit assembly and consolidation, and how these developmental mechanism...

  1. Animal models of cannabinoid reward

    OpenAIRE

    Panlilio, Leigh V; Justinova, Zuzana; Goldberg, Steven R.

    2010-01-01

    The endogenous cannabinoid system is involved in numerous physiological and neuropsychological functions. Medications that target this system hold promise for the treatment of a wide variety of disorders. However, as reward is one of the most prominent of these functions, medications that activate this system must be evaluated for abuse potential. Meanwhile, cannabis is already being used chronically by millions of people, many of whom eventually seek treatment for cannabis dependence. Theref...

  2. Using Perfusion fMRI to Measure Continuous Changes in Neural Activity with Learning

    Science.gov (United States)

    Olson, Ingrid R.; Rao, Hengyi; Moore, Katherine Sledge; Wang, Jiongjiong; Detre, John A.; Aguirre, Geoffrey K.

    2006-01-01

    In this study, we examine the suitability of a relatively new imaging technique, "arterial spin labeled perfusion imaging," for the study of continuous, gradual changes in neural activity. Unlike BOLD imaging, the perfusion signal is stable over long time-scales, allowing for accurate assessment of continuous performance. In addition, perfusion…

  3. Distributed dynamical computation in neural circuits with propagating coherent activity patterns.

    Directory of Open Access Journals (Sweden)

    Pulin Gong

    2009-12-01

    Full Text Available Activity in neural circuits is spatiotemporally organized. Its spatial organization consists of multiple, localized coherent patterns, or patchy clusters. These patterns propagate across the circuits over time. This type of collective behavior has ubiquitously been observed, both in spontaneous activity and evoked responses; its function, however, has remained unclear. We construct a spatially extended, spiking neural circuit that generates emergent spatiotemporal activity patterns, thereby capturing some of the complexities of the patterns observed empirically. We elucidate what kind of fundamental function these patterns can serve by showing how they process information. As self-sustained objects, localized coherent patterns can signal information by propagating across the neural circuit. Computational operations occur when these emergent patterns interact, or collide with each other. The ongoing behaviors of these patterns naturally embody both distributed, parallel computation and cascaded logical operations. Such distributed computations enable the system to work in an inherently flexible and efficient way. Our work leads us to propose that propagating coherent activity patterns are the underlying primitives with which neural circuits carry out distributed dynamical computation.

  4. Specific and Nonspecific Neural Activity during Selective Processing of Visual Representations in Working Memory

    Science.gov (United States)

    Oh, Hwamee; Leung, Hoi-Chung

    2010-01-01

    In this fMRI study, we investigated prefrontal cortex (PFC) and visual association regions during selective information processing. We recorded behavioral responses and neural activity during a delayed recognition task with a cue presented during the delay period. A specific cue ("Face" or "Scene") was used to indicate which one of the two…

  5. Differential neural activity patterns for spatial relations in humans: a MEG study.

    Science.gov (United States)

    Scott, Nicole M; Leuthold, Arthur; Sera, Maria D; Georgopoulos, Apostolos P

    2016-02-01

    Children learn the words for above-below relations earlier than for left-right relations, despite treating these equally well in a simple visual categorization task. Even as adults--conflicts in congruency, such as when a stimulus is depicted in a spatially incongruent manner with respect to salient global cues--can be challenging. Here we investigated the neural correlates of encoding and maintaining in working memory above-below and left-right relational planes in 12 adults using magnetoencephalography in order to discover whether above-below relations are represented by the brain differently than left-right relations. Adults performed perfectly on the task behaviorally, so any differences in neural activity were attributed to the stimuli's cognitive attributes. In comparing above-below to left-right relations during stimulus encoding, we found the greatest differences in neural activity in areas associated with space and movement. In comparing congruent to incongruent trials, we found the greatest differential activity in premotor areas. For both contrasts, brain areas involved in the encoding phase were also involved in the maintenance phase, which provides evidence that those brain areas are particularly important in representing the relational planes or congruency types throughout the trial. When comparing neural activity associated with the relational planes during working memory, additional right posterior areas were implicated, whereas the congruent-incongruent contrast implicated additional bilateral frontal and temporal areas. These findings are consistent with the hypothesis left-right relations are represented differently than above-below relations. PMID:26514809

  6. Identification of children's activity type with accelerometer-based neural networks

    NARCIS (Netherlands)

    Vries, S.I. de; Engels, M.; Garre, F.G.

    2011-01-01

    Purpose: The study's purpose was to identify children's physical activity type using artificial neural network (ANN) models based on uniaxial or triaxial accelerometer data from the hip or the ankle. Methods: Fifty-eight children (31 boys and 27 girls, age range = 9-12 yr) performed the following ac

  7. Modeling electrocortical activity through improved local approximations of integral neural field equations.

    NARCIS (Netherlands)

    Coombes, S.; Venkov, N.A.; Shiau, L.; Bojak, I.; Liley, D.T.; Laing, C.R.

    2007-01-01

    Neural field models of firing rate activity typically take the form of integral equations with space-dependent axonal delays. Under natural assumptions on the synaptic connectivity we show how one can derive an equivalent partial differential equation (PDE) model that properly treats the axonal dela

  8. A Constraint Satisfaction Neural Network and Heuristic Combined Approach for Concurrent Activities Scheduling

    Institute of Scientific and Technical Information of China (English)

    YAN JiHong(闫纪红); WU Cheng(吴澄)

    2003-01-01

    Scheduling activities in concurrent product development process is of great sig-nificance to shorten development lead time and minimize the cost. Moreover, it can eliminate theunnecessary redesign periods and guarantee that serial activities can be executed as concurrently aspossible. This paper presents a constraint satisfaction neural network and heuristic combined ap-proach for concurrent activities scheduling. In the combined approach, the neural network is usedto obtain a feasible starting time of all the activities based on sequence constraints, the heuris-tic algorithm is used to obtain a feasible solution of the scheduling problem based on resourceconstraints. The feasible scheduling solution is obtained by a gradient optimization function. Sim-ulations have shown that the proposed combined approach is efficient and feasible with respect toconcurrent activities scheduling.

  9. Active Diverse Learning Neural Network Ensemble Approach for Power Transformer Fault Diagnosis

    Directory of Open Access Journals (Sweden)

    Yu Xu

    2010-10-01

    Full Text Available An ensemble learning algorithm was proposed in this paper by analyzing the error function of neural network ensembles, by which, individual neural networks were actively guided to learn diversity. By decomposing the ensemble error function, error correlation terms were included in the learning criterion function of individual networks. And all the individual networks in the ensemble were leaded to learn diversity through cooperative training. The method was applied in Dissolved Gas Analysis based fault diagnosis of power transformer. Experiment results show that, the algorithm has higher accuracy than IEC method and BP network. In addition, the performance is more stable than conventional ensemble method, i.e., Bagging and Boosting.

  10. Global robust dissipativity of interval recurrent neural networks with time-varying delay and discontinuous activations

    Science.gov (United States)

    Duan, Lian; Huang, Lihong; Guo, Zhenyuan

    2016-07-01

    In this paper, the problems of robust dissipativity and robust exponential dissipativity are discussed for a class of recurrent neural networks with time-varying delay and discontinuous activations. We extend an invariance principle for the study of the dissipativity problem of delay systems to the discontinuous case. Based on the developed theory, some novel criteria for checking the global robust dissipativity and global robust exponential dissipativity of the addressed neural network model are established by constructing appropriate Lyapunov functionals and employing the theory of Filippov systems and matrix inequality techniques. The effectiveness of the theoretical results is shown by two examples with numerical simulations.

  11. Enhanced Food Anticipatory Activity Associated with Enhanced Activation of Extrahypothalamic Neural Pathways in Serotonin2C Receptor Null Mutant Mice

    OpenAIRE

    Mistlberger, Ralph; Hsu, Jennifer; Yu, Lisa; Bowman, Melody; Tecott, Laurence; Sullivan, Elinor

    2010-01-01

    The ability to entrain circadian rhythms to food availability is important for survival. Food-entrained circadian rhythms are characterized by increased locomotor activity in anticipation of food availability (food anticipatory activity). However, the molecular components and neural circuitry underlying the regulation of food anticipatory activity remain unclear. Here we show that serotonin2C receptor (5-HT2CR) null mutant mice subjected to a daytime restricted feeding schedule exhibit enhanc...

  12. Enhanced Food Anticipatory Activity Associated with Enhanced Activation of Extrahypothalamic Neural Pathways in Serotonin2C Receptor Null Mutant Mice

    OpenAIRE

    Hsu, Jennifer L.; Lisa Yu; Elinor Sullivan; Melodi Bowman; Mistlberger, Ralph E.; Tecott, Laurence H.

    2010-01-01

    The ability to entrain circadian rhythms to food availability is important for survival. Food-entrained circadian rhythms are characterized by increased locomotor activity in anticipation of food availability (food anticipatory activity). However, the molecular components and neural circuitry underlying the regulation of food anticipatory activity remain unclear. Here we show that serotonin(2C) receptor (5-HT2CR) null mutant mice subjected to a daytime restricted feeding schedule exhibit enha...

  13. The circadian clock, reward and memory

    OpenAIRE

    Urs eAlbrecht

    2011-01-01

    During our daily activities, we experience variations in our cognitive performance, which is often accompanied by cravings for small rewards, such as consuming coffee or chocolate. This indicates that the time of day, cognitive performance, and reward may be related to one another. This review will summarize data that describe the influence of the circadian clock on addiction and mood-related behavior and put the data into perspective in relation to memory processes.

  14. Neural correlates of response reversal: considering acquisition.

    Science.gov (United States)

    Budhani, S; Marsh, A A; Pine, D S; Blair, R J R

    2007-02-15

    Previous work on response reversal has typically used a single pair of stimuli that serially reverse. This conflation of acquisition and reversal processes has prevented an examination of the functional role of neural systems implicated in response reversal during acquisition despite the relevance of such data in evaluating accounts of response reversal. In the current study, participants encountered 16 independent reversing stimulus pairs in the context of a probabilistic response reversal paradigm. Functional regions of interest identified as involved in response reversal through a contrast used in the previous literature (punished errors made in the reversal phase versus rewarded correct responses), were interrogated across conditions. Consistent with suggestions that middle frontal cortex codes reward, this region showed significantly greater responses to rewarded rather than punished trials irrespective of accuracy or learning phase (acquisition or reversal). Consistent with the suggestion that this coding of the expectation of reinforcement is acquired via input from the amygdala, we observed significant positive connectivity between activity within the amygdala and a region of rostral anterior cingulate cortex highly proximal to this region of middle frontal/mesial prefrontal cortex. In contrast, inferior frontal cortex, anterior cingulate cortex and caudate showed greater responses to punished errors than to the rewarded correct responses. These three regions also showed significant activation to rewarded errors during acquisition, in contrast to positions suggesting that inferior frontal cortex represents punishment or suppresses previously rewarded responses. Moreover, a connectivity analysis with an anterior cingulate cortex seed revealed highly significant positive connectivity among them. The implications of these data for recent accounts of response reversal and of response reversal impairments in specific neuropsychiatric populations are discussed.

  15. RBF neural network and active circles based algorithm for contours extraction

    Institute of Scientific and Technical Information of China (English)

    Zhou Zhiheng; Zeng Delu; Xie Shengli

    2007-01-01

    For the contours extraction from the images, active contour model and self-organizing map based approach are popular nowadays. But they are still confronted with the problems that the optimization of energy function will trap in local minimums and the contour evolutions greatly depend on the initial contour selection. Addressing to these problems, a contours extraction algorithm based on RBF neural network is proposed here. A series of circles with adaptive radius and center is firstly used to search image feature points that are scattered enough. After the feature points are clustered, a group of radial basis functions are constructed. Using the pixels' intensities and gradients as the input vector, the final object contour can be obtained by the predicting ability of the neural network. The RBF neural network based algorithm is tested on three kinds of images, such as changing topology, complicated background, and blurring or noisy boundary. Simulation results show that the proposed algorithm performs contours extraction greatly.

  16. Neural networkbased semi-active control strategy for structural vibration mitigation with magnetorheological damper

    DEFF Research Database (Denmark)

    Bhowmik, Subrata

    2011-01-01

    This paper presents a neural network based semi-active control method for a rotary type magnetorheological (MR) damper. The characteristics of the MR damper are described by the classic Bouc-Wen model, and the performance of the proposed control method is evaluated in terms of a base exited shear......-displacement trajectories. The proposed neural network controller is therefore trained based on data derived from these desired forcedisplacement curves, where the optimal relation between friction force level and response amplitude is determined explicitly by simply maximizing the damping ratio of the targeted vibration...... to determine the damper current based on the derived optimal damper force. For that reason an inverse MR damper model is also designed based on the neural network identification of the particular rotary MR damper. The performance of the proposed controller is compared to that of an optimal pure viscous damper...

  17. Neural network based semi-active control strategy for structural vibration mitigation with magnetorheological damper

    DEFF Research Database (Denmark)

    Bhowmik, Subrata

    2011-01-01

    This paper presents a neural network based semi-active control method for a rotary type magnetorheological (MR) damper. The characteristics of the MR damper are described by the classic Bouc-Wen model, and the performance of the proposed control method is evaluated in terms of a base exited shear......-displacement trajectories. The proposed neural network controller is therefore trained based on data derived from these desired forcedisplacement curves, where the optimal relation between friction force level and response amplitude is determined explicitly by simply maximizing the damping ratio of the targeted vibration...... to determine the damper current based on the derived optimal damper force. For that reason an inverse MR damper model is also designed based on the neural network identification of the particular rotary MR damper. The performance of the proposed controller is compared to that of an optimal pure viscous damper...

  18. Cannabinoid modulation of drug reward and the implications of marijuana legalization.

    Science.gov (United States)

    Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

    2015-12-01

    Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction. PMID:25463025

  19. Cannabinoid modulation of drug reward and the implications of marijuana legalization.

    Science.gov (United States)

    Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

    2015-12-01

    Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction.

  20. Assessing fear following retrieval+extinction through suppression of baseline reward seeking vs. freezing

    Directory of Open Access Journals (Sweden)

    Jason eShumake

    2015-12-01

    Full Text Available Freezing has become the predominant measure used in rodent studies of conditioned fear, but conditioned suppression of reward-seeking behavior may provide a measure that is more relevant to human anxiety disorders; that is, a measure of how fear interferes with the enjoyment of pleasurable activities. Previous work has found that an isolated presentation of a fear conditioned stimulus prior to extinction training (retrieval + extinction results in a more robust and longer-lasting reduction in fear. The objective of this study was to assess whether the retrieval + extinction effect is evident using conditioned suppression of reward seeking, operationalized as a reduction in baseline licking (without prior water deprivation for a 10% sucrose solution. We found that, compared to freezing, conditioned suppression of reward seeking was much more sensitive to fear conditioning and far less responsive to extinction training. As in previous work, we found that retrieval + extinction reduced post-extinction fear reinstatement when measured as freezing, but it did not reduce fear reinstatement when measured as conditioned suppression. This suggests that there is still residual fear following retrieval + extinction, or that this procedure only modifies memory traces in neural circuits relevant to the expression of freezing, but not to the suppression of reward seeking.

  1. Neural Changes following Behavioral Activation for a Depressed Breast Cancer Patient: A Functional MRI Case Study

    Directory of Open Access Journals (Sweden)

    Michael J. Gawrysiak

    2012-01-01

    Full Text Available Functional neuroimaging is an innovative but at this stage underutilized method to assess the efficacy of psychotherapy for depression. Functional magnetic resonance imaging (fMRI was used in this case study to examine changes in brain activity in a depressed breast cancer patient receiving an 8-session Behavioral Activation Treatment for Depression (BATD, based on the work of Hopko and Lejuez (2007. A music listening paradigm was used during fMRI brain scans to assess reward responsiveness at pre- and posttreatment. Following treatment, the patient exhibited attenuated depression and changes in blood oxygenation level dependence (BOLD response in regions of the prefrontal cortex and the subgenual cingulate cortex. These preliminary findings outline a novel means to assess psychotherapy efficacy and suggest that BATD elicits functional brain changes in areas implicated in the pathophysiology of depression. Further research is necessary to explore neurobiological mechanisms of change in BATD, particularly the potential mediating effects of reward responsiveness and associated brain functioning.

  2. Wide-field optical mapping of neural activity and brain haemodynamics: considerations and novel approaches

    Science.gov (United States)

    Ma, Ying; Shaik, Mohammed A.; Kozberg, Mariel G.; Thibodeaux, David N.; Zhao, Hanzhi T.; Yu, Hang

    2016-01-01

    Although modern techniques such as two-photon microscopy can now provide cellular-level three-dimensional imaging of the intact living brain, the speed and fields of view of these techniques remain limited. Conversely, two-dimensional wide-field optical mapping (WFOM), a simpler technique that uses a camera to observe large areas of the exposed cortex under visible light, can detect changes in both neural activity and haemodynamics at very high speeds. Although WFOM may not provide single-neuron or capillary-level resolution, it is an attractive and accessible approach to imaging large areas of the brain in awake, behaving mammals at speeds fast enough to observe widespread neural firing events, as well as their dynamic coupling to haemodynamics. Although such wide-field optical imaging techniques have a long history, the advent of genetically encoded fluorophores that can report neural activity with high sensitivity, as well as modern technologies such as light emitting diodes and sensitive and high-speed digital cameras have driven renewed interest in WFOM. To facilitate the wider adoption and standardization of WFOM approaches for neuroscience and neurovascular coupling research, we provide here an overview of the basic principles of WFOM, considerations for implementation of wide-field fluorescence imaging of neural activity, spectroscopic analysis and interpretation of results. This article is part of the themed issue ‘Interpreting BOLD: a dialogue between cognitive and cellular neuroscience’. PMID:27574312

  3. A New Training Method for Feedforward Neural Networks Based on Geometric Contraction Property of Activation Functions

    OpenAIRE

    Birtea, Petre; Cernazanu-Glavan, Cosmin; Sisu, Alexandru

    2016-01-01

    We propose a new training method for a feedforward neural network having the activation functions with the geometric contraction property. The method consists of constructing a new functional that is less nonlinear in comparison with the classical functional by removing the nonlinearity of the activation functions from the output layer. We validate this new method by a series of experiments that show an improved learning speed and also a better classification error.

  4. Ventral pallidum firing codes hedonic reward: when a bad taste turns good.

    Science.gov (United States)

    Tindell, Amy J; Smith, Kyle S; Peciña, Susana; Berridge, Kent C; Aldridge, J Wayne

    2006-11-01

    The ventral pallidum (VP) is a key structure in brain mesocorticolimbic reward circuits that mediate "liking" reactions to sensory pleasures. Do firing patterns in VP actually code sensory pleasure? Strong evidence for hedonic coding requires showing that neural signals track positive increases in sensory pleasure or even reversals from bad to good. A useful test is the salt alliesthesia of physiological sodium depletion that makes even aversively intense NaCl taste become palatable and "liked." We compared VP neural firing activity in rats during aversive "disliking" reactions elicited by a noxiously intense NaCl taste (triple-seawater 1.5 M concentration) in normal homeostatic state versus in a physiological salt appetite state that made the same NaCl taste palatable and elicit positive "liking" reactions. We also compared firing elicited by palatable sucrose taste, which always elicited "liking" reactions in both states. A dramatic doubling in the amplitude of VP neural firing peaks to NaCl was caused by salt appetite that matched the affective switch from aversive ("disliking") to positive hedonic ("liking") reactions. By contrast, VP neural activity to "liked" sucrose taste was always high and never altered. In summary, VP firing activity selectively tracks the hedonic values of tastes, even across hedonic reversals caused by physiological changes. Our data provide the strongest evidence yet for neural hedonic coding of natural sensory pleasures and suggest, by extension, how abnormalities in VP firing patterns might contribute to clinical hedonic dysfunctions. PMID:16885520

  5. Constructive feedforward neural networks using hermite polynomial activation functions.

    Science.gov (United States)

    Ma, Liying; Khorasani, K

    2005-07-01

    In this paper, a constructive one-hidden-layer network is introduced where each hidden unit employs a polynomial function for its activation function that is different from other units. Specifically, both a structure level as well as a function level adaptation methodologies are utilized in constructing the network. The functional level adaptation scheme ensures that the "growing" or constructive network has different activation functions for each neuron such that the network may be able to capture the underlying input-output map more effectively. The activation functions considered consist of orthonormal Hermite polynomials. It is shown through extensive simulations that the proposed network yields improved performance when compared to networks having identical sigmoidal activation functions.

  6. Stress and reward

    DEFF Research Database (Denmark)

    Chumbley, J R; Hulme, O; Köchli, H;

    2014-01-01

    Healthy individuals tend to consume available rewards like food and sex. This tendency is attenuated or amplified in most stress-related psychiatric conditions, so we asked if it depends on endogenous levels of the 'canonical stress hormone' cortisol. We unobtrusively quantified how hard healthy...... preference declines with self-reported anhedonia but increases with long term exposure to endogenous cortisol. These results suggest that cortisol may affect reward-related behavior in healthy adults....

  7. Endogenous testosterone levels are associated with neural activity in men with schizophrenia during facial emotion processing.

    Science.gov (United States)

    Ji, Ellen; Weickert, Cynthia Shannon; Lenroot, Rhoshel; Catts, Stanley V; Vercammen, Ans; White, Christopher; Gur, Raquel E; Weickert, Thomas W

    2015-06-01

    Growing evidence suggests that testosterone may play a role in the pathophysiology of schizophrenia given that testosterone has been linked to cognition and negative symptoms in schizophrenia. Here, we determine the extent to which serum testosterone levels are related to neural activity in affective processing circuitry in men with schizophrenia. Functional magnetic resonance imaging was used to measure blood-oxygen-level-dependent signal changes as 32 healthy controls and 26 people with schizophrenia performed a facial emotion identification task. Whole brain analyses were performed to determine regions of differential activity between groups during processing of angry versus non-threatening faces. A follow-up ROI analysis using a regression model in a subset of 16 healthy men and 16 men with schizophrenia was used to determine the extent to which serum testosterone levels were related to neural activity. Healthy controls displayed significantly greater activation than people with schizophrenia in the left inferior frontal gyrus (IFG). There was no significant difference in circulating testosterone levels between healthy men and men with schizophrenia. Regression analyses between activation in the IFG and circulating testosterone levels revealed a significant positive correlation in men with schizophrenia (r=.63, p=.01) and no significant relationship in healthy men. This study provides the first evidence that circulating serum testosterone levels are related to IFG activation during emotion face processing in men with schizophrenia but not in healthy men, which suggests that testosterone levels modulate neural processes relevant to facial emotion processing that may interfere with social functioning in men with schizophrenia.

  8. Exposure to an Inflammatory Challenge Enhances Neural Sensitivity to Negative and Positive Social Feedback

    Science.gov (United States)

    Muscatell, Keely A.; Moieni, Mona; Inagaki, Tristen K.; Dutcher, Janine M.; Jevtic, Ivana; Breen, Elizabeth C.; Irwin, Michael R.; Eisenberger, Naomi I.

    2016-01-01

    Inflammation, part of the body’s innate immune response, can lead to “sickness behaviors,” as well as alterations in social and affective experiences. Elevated levels of pro-inflammatory cytokines have been associated with increased neural sensitivity to social rejection and social threat, but also decreased neural sensitivity to rewards. However, recent evidence suggests that inflammation may actually enhance sensitivity to certain social rewards, such as those that signal support and care. Despite a growing interest in how inflammation influences neural reactivity to positive and negative social experiences, no known studies have investigated these processes in the same participants, using a similar task. To examine this issue, 107 participants were randomly assigned to receive either placebo or low-dose endotoxin, which safely triggers an inflammatory response. When levels of pro-inflammatory cytokines were at their peak, participants were scanned using fMRI while they received positive, negative, and neutral feedback from an “evaluator” (actually a confederate) about how they came across in an audio-recorded interview. In response to negative feedback (vs. neutral), participants in the endotoxin condition showed heightened neural activity in a number of threat-related neural regions (i.e., bilateral amygdala, dorsal anterior cingulate cortex) and a key mentalizing-related region (i.e., dorsomedial PFC), compared to placebo participants. Interestingly, when receiving positive feedback (vs. neutral), endotoxin led to greater neural activity in the ventral striatum and ventromedial PFC, regions often implicated in processing reward, compared to placebo. Together, these results reveal that individuals exposed to an inflammatory challenge are more “neurally sensitive” to both negative and positive social feedback, suggesting that inflammation may lead to a greater vigilance for both social threats and social rewards. PMID:27032568

  9. Comparing the effects of food restriction and overeating on brain reward systems

    OpenAIRE

    Avena, Nicole M.; Murray, Susan; Gold, Mark S.

    2013-01-01

    Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such e...

  10. Basal forebrain projections to the lateral habenula modulate aggression reward.

    Science.gov (United States)

    Golden, Sam A; Heshmati, Mitra; Flanigan, Meghan; Christoffel, Daniel J; Guise, Kevin; Pfau, Madeline L; Aleyasin, Hossein; Menard, Caroline; Zhang, Hongxing; Hodes, Georgia E; Bregman, Dana; Khibnik, Lena; Tai, Jonathan; Rebusi, Nicole; Krawitz, Brian; Chaudhury, Dipesh; Walsh, Jessica J; Han, Ming-Hu; Shapiro, Matt L; Russo, Scott J

    2016-06-30

    Maladaptive aggressive behaviour is associated with a number of neuropsychiatric disorders and is thought to result partly from the inappropriate activation of brain reward systems in response to aggressive or violent social stimuli. Nuclei within the ventromedial hypothalamus, extended amygdala and limbic circuits are known to encode initiation of aggression; however, little is known about the neural mechanisms that directly modulate the motivational component of aggressive behaviour. Here we established a mouse model to measure the valence of aggressive inter-male social interaction with a smaller subordinate intruder as reinforcement for the development of conditioned place preference (CPP). Aggressors develop a CPP, whereas non-aggressors develop a conditioned place aversion to the intruder-paired context. Furthermore, we identify a functional GABAergic projection from the basal forebrain (BF) to the lateral habenula (lHb) that bi-directionally controls the valence of aggressive interactions. Circuit-specific silencing of GABAergic BF-lHb terminals of aggressors with halorhodopsin (NpHR3.0) increases lHb neuronal firing and abolishes CPP to the intruder-paired context. Activation of GABAergic BF-lHb terminals of non-aggressors with channelrhodopsin (ChR2) decreases lHb neuronal firing and promotes CPP to the intruder-paired context. Finally, we show that altering inhibitory transmission at BF-lHb terminals does not control the initiation of aggressive behaviour. These results demonstrate that the BF-lHb circuit has a critical role in regulating the valence of inter-male aggressive behaviour and provide novel mechanistic insight into the neural circuits modulating aggression reward processing. PMID:27357796

  11. Video-based convolutional neural networks for activity recognition from robot-centric videos

    Science.gov (United States)

    Ryoo, M. S.; Matthies, Larry

    2016-05-01

    In this evaluation paper, we discuss convolutional neural network (CNN)-based approaches for human activity recognition. In particular, we investigate CNN architectures designed to capture temporal information in videos and their applications to the human activity recognition problem. There have been multiple previous works to use CNN-features for videos. These include CNNs using 3-D XYT convolutional filters, CNNs using pooling operations on top of per-frame image-based CNN descriptors, and recurrent neural networks to learn temporal changes in per-frame CNN descriptors. We experimentally compare some of these different representatives CNNs while using first-person human activity videos. We especially focus on videos from a robots viewpoint, captured during its operations and human-robot interactions.

  12. Model Integrating Fuzzy Argument with Neural Network Enhancing the Performance of Active Queue Management

    Directory of Open Access Journals (Sweden)

    Nguyen Kim Quoc

    2015-08-01

    Full Text Available The bottleneck control by active queue management mechanisms at network nodes is essential. In recent years, some researchers have used fuzzy argument to improve the active queue management mechanisms to enhance the network performance. However, the projects using the fuzzy controller depend heavily on professionals and their parameters cannot be updated according to changes in the network, so the effectiveness of this mechanism is not high. Therefore, we propose a model combining the fuzzy controller with neural network (FNN to overcome the limitations above. Results of the training of the neural networks will find the optimal parameters for the adaptive fuzzy controller well to changes of the network. This improves the operational efficiency of the active queue management mechanisms at network nodes.

  13. Dampened neural activity and abolition of epileptic-like activity in cortical slices by active ingredients of spices.

    Science.gov (United States)

    Pezzoli, Maurizio; Elhamdani, Abdeladim; Camacho, Susana; Meystre, Julie; González, Stephanie Michlig; le Coutre, Johannes; Markram, Henry

    2014-10-31

    Active ingredients of spices (AIS) modulate neural response in the peripheral nervous system, mainly through interaction with TRP channel/receptors. The present study explores how different AIS modulate neural response in layer 5 pyramidal neurons of S1 neocortex. The AIS tested are agonists of TRPV1/3, TRPM8 or TRPA1. Our results demonstrate that capsaicin, eugenol, menthol, icilin and cinnamaldehyde, but not AITC dampen the generation of APs in a voltage- and time-dependent manner. This effect was further tested for the TRPM8 ligands in the presence of a TRPM8 blocker (BCTC) and on TRPM8 KO mice. The observable effect was still present. Finally, the influence of the selected AIS was tested on in vitro gabazine-induced seizures. Results coincide with the above observations: except for cinnamaldehyde, the same AIS were able to reduce the number, duration of the AP bursts and increase the concentration of gabazine needed to elicit them. In conclusion, our data suggests that some of these AIS can modulate glutamatergic neurons in the brain through a TRP-independent pathway, regardless of whether the neurons are stimulated intracellularly or by hyperactive microcircuitry.

  14. Neural control of glutamine synthetase activity in rat skeletal muscles.

    Science.gov (United States)

    Feng, B; Konagaya, M; Konagaya, Y; Thomas, J W; Banner, C; Mill, J; Max, S R

    1990-05-01

    The mechanism of glutamine synthetase induction in rat skeletal muscle after denervation or limb immobilization was investigated. Adult male rats were subjected to midthigh section of the sciatic nerve. At 1, 2, and 5 h and 1, 2, and 7 days after denervation, rats were killed and denervated, and contralateral control soleus and plantaris muscles were excised, weighted, homogenized, and assayed for glutamine synthetase. Glutamine synthetase activity increased approximately twofold 1 h after denervation in both muscles. By 7 days postdenervation enzyme activity had increased to three times the control level in plantaris muscle and to four times the control level in soleus muscle. Increased enzyme activity after nerve section was associated with increased maximum velocity with no change in apparent Michaelis constant. Immunotitration with an antiglutamine synthetase antibody suggested that denervation caused an increase in the number of glutamine synthetase molecules in muscle. However, Northern-blot analysis revealed no increase in the steady-state level of glutamine synthetase mRNA after denervation. A mixing experiment failed to yield evidence for the presence of a soluble factor involved in regulating the activity of glutamine synthetase in denervated muscle. A combination of denervation and dexamethasone injections resulted in additive increases in glutamine synthetase. Thus the mechanism underlying increased glutamine synthetase after denervation appears to be posttranscriptional and is distinct from that of the glucocorticoid-mediated glutamine synthetase induction previously described by us. PMID:1970709

  15. Concurrent multitasking : From neural activity to human cognition

    NARCIS (Netherlands)

    Nijboer, Menno

    2016-01-01

    Multitasking has become an important part of our daily lives. This delicate juggling act between several activities occurs when people drive, when they are working, and even when they should be paying attention in the classroom. While multitasking is typically considered as something to avoid, there

  16. Neural activities during affective processing in people with Alzheimer's disease

    NARCIS (Netherlands)

    Lee, Tatia M. C.; Sun, Delin; Leung, Mei-Kei; Chu, Leung-Wing; Keysers, Christian

    2013-01-01

    This study examined brain activities in people with Alzheimer's disease when viewing happy, sad, and fearful facial expressions of others. A functional magnetic resonance imaging and a voxel-based morphometry methodology together with a passive viewing of emotional faces paradigm were employed to co

  17. Quantitative meta-analysis of neural activity in posttraumatic stress disorder

    Directory of Open Access Journals (Sweden)

    Hayes Jasmeet P

    2012-05-01

    Full Text Available Abstract Background In recent years, neuroimaging techniques such as functional magnetic resonance imaging (fMRI and positron emission tomography (PET have played a significant role in elucidating the neural underpinnings of posttraumatic stress disorder (PTSD. However, a detailed understanding of the neural regions implicated in the disorder remains incomplete because of considerable variability in findings across studies. The aim of this meta-analysis was to identify consistent patterns of neural activity across neuroimaging study designs in PTSD to improve understanding of the neurocircuitry of PTSD. Methods We conducted a literature search for PET and fMRI studies of PTSD that were published before February 2011. The article search resulted in 79 functional neuroimaging PTSD studies. Data from 26 PTSD peer-reviewed neuroimaging articles reporting results from 342 adult patients and 342 adult controls were included. Peak activation coordinates from selected articles were used to generate activation likelihood estimate maps separately for symptom provocation and cognitive-emotional studies of PTSD. A separate meta-analysis examined the coupling between ventromedial prefrontal cortex and amygdala activity in patients. Results Results demonstrated that the regions most consistently hyperactivated in PTSD patients included mid- and dorsal anterior cingulate cortex, and when ROI studies were included, bilateral amygdala. By contrast, widespread hypoactivity was observed in PTSD including the ventromedial prefrontal cortex and the inferior frontal gyrus. Furthermore, decreased ventromedial prefrontal cortex activity was associated with increased amygdala activity. Conclusions These results provide evidence for a neurocircuitry model of PTSD that emphasizes alteration in neural networks important for salience detection and emotion regulation.

  18. 食物奖赏和渴求行为相关的大鼠左侧眶额叶皮质Delta频段脑电活动%Delta EEG Activity in Left Orbitofrontal Cortex in Rats Related to Food Reward and Craving

    Institute of Scientific and Technical Information of China (English)

    付玉; 陈艳梅; 曾涛; 彭沿平; 田绍华; 马原野

    2008-01-01

    The orbitofrontal cortex (OFC) is particularly important for the neural representation of reward value. Previous studies indicated that electroencephalogram (EEG) activity in the OFC was involved in drug administration and withdrawal. The present study investigated EEG activity in the OFC in rats during the development of food reward and craving. Two environments were used separately for control and food-related EEG recordings. In the food-related environment rats were first trained to eat chocolate peanuts; then they either had no access to this food, but could see and smell it (craving trials), or had free access to this food (reward trials). The EEG in the left OFC was recorded during these trials. We showed that, in the food-related environment the EEG activity peaking in the delta band (2-4Hz) was significantly correlated with the stimulus, increasing during food reward and decreasing during food craving when compared with that in the control environment. Our data suggests that EEG activity in the OFC can be altered by food reward; moreover, delta rhythm in this region could be used as an index monitoring changed signal underlying this reward.%眶额叶皮质与中脑边缘多巴胺奖赏系统有着复杂的相互纤维联系.先前的研究探讨了药物成瘾过程中眶额叶皮质的脑电活动.在本实验中,将探讨食物奖赏和渴求过程中该皮质的脑电活动.实验采用了两个环境:对照环境和食物刺激相关的环境.首先,训练大鼠在食物刺激相关的环境中吃巧克力花生豆,而后在该环境中设置两种不同的刺激方式:能看到和闻到但不能吃到(渴求实验),或者仍旧可以吃到巧克力花生豆(奖赏实验):同时进行左侧眶额叶皮质的脑电记录.结果发现,在食物刺激相关的环境中大鼠Delta频段(2-4Hz)的脑电活动与食物刺激显著相关,此外,与在对照环境中相比,其相对功率在食物渴求时下降而在食物奖赏时升高.本实验表明,食

  19. Implications of the Dependence of Neuronal Activity on Neural Network States for the Design of Brain-Machine Interfaces.

    Science.gov (United States)

    Panzeri, Stefano; Safaai, Houman; De Feo, Vito; Vato, Alessandro

    2016-01-01

    Brain-machine interfaces (BMIs) can improve the quality of life of patients with sensory and motor disabilities by both decoding motor intentions expressed by neural activity, and by encoding artificially sensed information into patterns of neural activity elicited by causal interventions on the neural tissue. Yet, current BMIs can exchange relatively small amounts of information with the brain. This problem has proved difficult to overcome by simply increasing the number of recording or stimulating electrodes, because trial-to-trial variability of neural activity partly arises from intrinsic factors (collectively known as the network state) that include ongoing spontaneous activity and neuromodulation, and so is shared among neurons. Here we review recent progress in characterizing the state dependence of neural responses, and in particular of how neural responses depend on endogenous slow fluctuations of network excitability. We then elaborate on how this knowledge may be used to increase the amount of information that BMIs exchange with brain. Knowledge of network state can be used to fine-tune the stimulation pattern that should reliably elicit a target neural response used to encode information in the brain, and to discount part of the trial-by-trial variability of neural responses, so that they can be decoded more accurately. PMID:27147955

  20. Implications of the dependence of neuronal activity on neural network states for the design of brain-machine interfaces

    Directory of Open Access Journals (Sweden)

    Stefano ePanzeri

    2016-04-01

    Full Text Available Brain-machine interfaces (BMIs can improve the quality of life of patients with sensory and motor disabilities by both decoding motor intentions expressed by neural activity, and by encoding artificially sensed information into patterns of neural activity elicited by causal interventions on the neural tissue. Yet, current BMIs can exchange relatively small amounts of information with the brain. This problem has proved difficult to overcome by simply increasing the number of recording or stimulating electrodes, because trial-to-trial variability of neural activity partly arises from intrinsic factors (collectively known as the network state that include ongoing spontaneous activity and neuromodulation, and so is shared among neurons. Here we review recent progress in characterizing the state dependence of neural responses, and in particular of how neural responses depend on endogenous slow fluctuations of network excitability. We then elaborate on how this knowledge may be used to increase the amount of information that BMIs exchange with brains. Knowledge of network state can be used to fine-tune the stimulation pattern that should reliably elicit a target neural response used to encode information in the brain, and to discount part of the trial-by-trial variability of neural responses, so that they can be decoded more accurately.

  1. Implications of the Dependence of Neuronal Activity on Neural Network States for the Design of Brain-Machine Interfaces.

    Science.gov (United States)

    Panzeri, Stefano; Safaai, Houman; De Feo, Vito; Vato, Alessandro

    2016-01-01

    Brain-machine interfaces (BMIs) can improve the quality of life of patients with sensory and motor disabilities by both decoding motor intentions expressed by neural activity, and by encoding artificially sensed information into patterns of neural activity elicited by causal interventions on the neural tissue. Yet, current BMIs can exchange relatively small amounts of information with the brain. This problem has proved difficult to overcome by simply increasing the number of recording or stimulating electrodes, because trial-to-trial variability of neural activity partly arises from intrinsic factors (collectively known as the network state) that include ongoing spontaneous activity and neuromodulation, and so is shared among neurons. Here we review recent progress in characterizing the state dependence of neural responses, and in particular of how neural responses depend on endogenous slow fluctuations of network excitability. We then elaborate on how this knowledge may be used to increase the amount of information that BMIs exchange with brain. Knowledge of network state can be used to fine-tune the stimulation pattern that should reliably elicit a target neural response used to encode information in the brain, and to discount part of the trial-by-trial variability of neural responses, so that they can be decoded more accurately.

  2. Alternative Sensor System and MLP Neural Network for Vehicle Pedal Activity Estimation

    Directory of Open Access Journals (Sweden)

    Ahmed M. Wefky

    2010-04-01

    Full Text Available It is accepted that the activity of the vehicle pedals (i.e., throttle, brake, clutch reflects the driver’s behavior, which is at least partially related to the fuel consumption and vehicle pollutant emissions. This paper presents a solution to estimate the driver activity regardless of the type, model, and year of fabrication of the vehicle. The solution is based on an alternative sensor system (regime engine, vehicle speed, frontal inclination and linear acceleration that reflects the activity of the pedals in an indirect way, to estimate that activity by means of a multilayer perceptron neural network with a single hidden layer.

  3. Optimal Recognition Method of Human Activities Using Artificial Neural Networks

    Science.gov (United States)

    Oniga, Stefan; József, Sütő

    2015-12-01

    The aim of this research is an exhaustive analysis of the various factors that may influence the recognition rate of the human activity using wearable sensors data. We made a total of 1674 simulations on a publically released human activity database by a group of researcher from the University of California at Berkeley. In a previous research, we analyzed the influence of the number of sensors and their placement. In the present research we have examined the influence of the number of sensor nodes, the type of sensor node, preprocessing algorithms, type of classifier and its parameters. The final purpose is to find the optimal setup for best recognition rates with lowest hardware and software costs.

  4. Average activity of excitatory and inhibitory neural populations

    Science.gov (United States)

    Roulet, Javier; Mindlin, Gabriel B.

    2016-09-01

    We develop an extension of the Ott-Antonsen method [E. Ott and T. M. Antonsen, Chaos 18(3), 037113 (2008)] that allows obtaining the mean activity (spiking rate) of a population of excitable units. By means of the Ott-Antonsen method, equations for the dynamics of the order parameters of coupled excitatory and inhibitory populations of excitable units are obtained, and their mean activities are computed. Two different excitable systems are studied: Adler units and theta neurons. The resulting bifurcation diagrams are compared with those obtained from studying the phenomenological Wilson-Cowan model in some regions of the parameter space. Compatible behaviors, as well as higher dimensional chaotic solutions, are observed. We study numerical simulations to further validate the equations.

  5. Optimal Recognition Method of Human Activities Using Artificial Neural Networks

    Directory of Open Access Journals (Sweden)

    Oniga Stefan

    2015-12-01

    Full Text Available The aim of this research is an exhaustive analysis of the various factors that may influence the recognition rate of the human activity using wearable sensors data. We made a total of 1674 simulations on a publically released human activity database by a group of researcher from the University of California at Berkeley. In a previous research, we analyzed the influence of the number of sensors and their placement. In the present research we have examined the influence of the number of sensor nodes, the type of sensor node, preprocessing algorithms, type of classifier and its parameters. The final purpose is to find the optimal setup for best recognition rates with lowest hardware and software costs.

  6. Environmental layout complexity affects neural activity during navigation in humans.

    Science.gov (United States)

    Slone, Edward; Burles, Ford; Iaria, Giuseppe

    2016-05-01

    Navigating large-scale surroundings is a fundamental ability. In humans, it is commonly assumed that navigational performance is affected by individual differences, such as age, sex, and cognitive strategies adopted for orientation. We recently showed that the layout of the environment itself also influences how well people are able to find their way within it, yet it remains unclear whether differences in environmental complexity are associated with changes in brain activity during navigation. We used functional magnetic resonance imaging to investigate how the brain responds to a change in environmental complexity by asking participants to perform a navigation task in two large-scale virtual environments that differed solely in interconnection density, a measure of complexity defined as the average number of directional choices at decision points. The results showed that navigation in the simpler, less interconnected environment was faster and more accurate relative to the complex environment, and such performance was associated with increased activity in a number of brain areas (i.e. precuneus, retrosplenial cortex, and hippocampus) known to be involved in mental imagery, navigation, and memory. These findings provide novel evidence that environmental complexity not only affects navigational behaviour, but also modulates activity in brain regions that are important for successful orientation and navigation.

  7. A Granger causality measure for point process models of ensemble neural spiking activity.

    Directory of Open Access Journals (Sweden)

    Sanggyun Kim

    2011-03-01

    Full Text Available The ability to identify directional interactions that occur among multiple neurons in the brain is crucial to an understanding of how groups of neurons cooperate in order to generate specific brain functions. However, an optimal method of assessing these interactions has not been established. Granger causality has proven to be an effective method for the analysis of the directional interactions between multiple sets of continuous-valued data, but cannot be applied to neural spike train recordings due to their discrete nature. This paper proposes a point process framework that enables Granger causality to be applied to point process data such as neural spike trains. The proposed framework uses the point process likelihood function to relate a neuron's spiking probability to possible covariates, such as its own spiking history and the concurrent activity of simultaneously recorded neurons. Granger causality is assessed based on the relative reduction of the point process likelihood of one neuron obtained excluding one of its covariates compared to the likelihood obtained using all of its covariates. The method was tested on simulated data, and then applied to neural activity recorded from the primary motor cortex (MI of a Felis catus subject. The interactions present in the simulated data were predicted with a high degree of accuracy, and when applied to the real neural data, the proposed method identified causal relationships between many of the recorded neurons. This paper proposes a novel method that successfully applies Granger causality to point process data, and has the potential to provide unique physiological insights when applied to neural spike trains.

  8. Differences in neural activity when processing emotional arousal and valence in autism spectrum disorders.

    Science.gov (United States)

    Tseng, Angela; Wang, Zhishun; Huo, Yuankai; Goh, Suzanne; Russell, James A; Peterson, Bradley S

    2016-02-01

    Individuals with autism spectrum disorders (ASD) often have difficulty recognizing and interpreting facial expressions of emotion, which may impair their ability to navigate and communicate successfully in their social, interpersonal environments. Characterizing specific differences between individuals with ASD and their typically developing (TD) counterparts in the neural activity subserving their experience of emotional faces may provide distinct targets for ASD interventions. Thus we used functional magnetic resonance imaging (fMRI) and a parametric experimental design to identify brain regions in which neural activity correlated with ratings of arousal and valence for a broad range of emotional faces. Participants (51 ASD, 84 TD) were group-matched by age, sex, IQ, race, and socioeconomic status. Using task-related change in blood-oxygen-level-dependent (BOLD) fMRI signal as a measure, and covarying for age, sex, FSIQ, and ADOS scores, we detected significant differences across diagnostic groups in the neural activity subserving the dimension of arousal but not valence. BOLD-signal in TD participants correlated inversely with ratings of arousal in regions associated primarily with attentional functions, whereas BOLD-signal in ASD participants correlated positively with arousal ratings in regions commonly associated with impulse control and default-mode activity. Only minor differences were detected between groups in the BOLD signal correlates of valence ratings. Our findings provide unique insight into the emotional experiences of individuals with ASD. Although behavioral responses to face-stimuli were comparable across diagnostic groups, the corresponding neural activity for our ASD and TD groups differed dramatically. The near absence of group differences for valence correlates and the presence of strong group differences for arousal correlates suggest that individuals with ASD are not atypical in all aspects of emotion-processing. Studying these similarities

  9. Model for a flexible motor memory based on a self-active recurrent neural network.

    Science.gov (United States)

    Boström, Kim Joris; Wagner, Heiko; Prieske, Markus; de Lussanet, Marc

    2013-10-01

    Using recent recurrent network architecture based on the reservoir computing approach, we propose and numerically simulate a model that is focused on the aspects of a flexible motor memory for the storage of elementary movement patterns into the synaptic weights of a neural network, so that the patterns can be retrieved at any time by simple static commands. The resulting motor memory is flexible in that it is capable to continuously modulate the stored patterns. The modulation consists in an approximately linear inter- and extrapolation, generating a large space of possible movements that have not been learned before. A recurrent network of thousand neurons is trained in a manner that corresponds to a realistic exercising scenario, with experimentally measured muscular activations and with kinetic data representing proprioceptive feedback. The network is "self-active" in that it maintains recurrent flow of activation even in the absence of input, a feature that resembles the "resting-state activity" found in the human and animal brain. The model involves the concept of "neural outsourcing" which amounts to the permanent shifting of computational load from higher to lower-level neural structures, which might help to explain why humans are able to execute learned skills in a fluent and flexible manner without the need for attention to the details of the movement.

  10. A nonlinear neural fir filter with an adaptive activation function

    Directory of Open Access Journals (Sweden)

    Lee Su Goh

    2003-01-01

    Full Text Available An adaptive amplitude normalized nonlinear gradient descent (AANNGD algorithm for the class of nonlinear finite impulse response (FIR adaptive filters (dynamical perception is introduced. This is achieved by making the amplitude of the nonlinear activation function gradient adaptive. The proposed learning algorithm is suitable for processing of nonlinear and nonstationary signals with a large dynamical range, and removes the unwanted effect of saturation nonlinearities. For rigor, sensitivity analysis is performed and the improved performance of the AANNGD algorithm over the standard LMS, NGD, NNGD, the fully adaptive NNGD (FANNGD and the sign algorithm is verified by simulations on nonlinear and nonstationary inputs with large dynamics.

  11. Spontaneous neural activity during human slow wave sleep

    OpenAIRE

    Dang-Vu, Thien Thanh; Schabus, Manuel; Desseilles, Martin; Albouy, Geneviève; Boly, Mélanie; Darsaud, Annabelle; Gais, Steffen; Rauchs, Géraldine; Sterpenich, Virginie; Vandewalle, Gilles; Carrier, Julie; Moonen, Gustave; Balteau, Evelyne; Degueldre, Christian; Luxen, André

    2008-01-01

    Slow wave sleep (SWS) is associated with spontaneous brain oscillations that are thought to participate in sleep homeostasis and to support the processing of information related to the experiences of the previous awake period. At the cellular level, during SWS, a slow oscillation (140 μV) and delta waves (75–140 μV) during SWS in 14 non-sleep-deprived normal human volunteers. Significant increases in activity were associated with these waves in several cortical areas, including the inferior f...

  12. Amphetamine alters neural response to sucrose in healthy women.

    Science.gov (United States)

    Melrose, A James; Bailer, Ursula; Wierenga, Christina E; Bischoff-Grethe, Amanda; Paulus, Martin P; Kaye, Walter H

    2016-06-30

    Amphetamine, likely via action on the brain's dopaminergic systems, induces anorectic eating behavior and blunts dopaminergic midbrain activation to rewards. Past work has hypothesized that this blunted reward responsivity is a result of increasing tonic over phasic DA activity. We sought to extend past findings to sweet taste during fMRI following single-blind administration of dextroamphetamine and placebo in 11 healthy women. We hypothesized that neural response in both limbic and cognitive sweet taste circuits would mirror past work with monetary rewards by effectively blunting sweet taste reward, and 'equalizing' it's rewarding taste with receipt of water. Behavioral results showed that amphetamine reduced self-reported hunger (supporting the existence of amphetamine anorexia) and increased self-report euphoria. In addition, region of Interest analysis revealed significant treatment by taste interactions in the middle insula and dorsal anterior cingulate confirming the 'equalizing' hypothesis in the cingulate, but unlike monetary reinforcers, the insula actually evinced enhanced separation between tastes on the amphetamine day. These results suggest a divergence from prior research using monetary reinforcers when extended to primary reinforcers, and may hint that altering dopaminergic signaling in the insula and anterior cingulate may be a target for pharmacological manipulation of appetite, and the treatment of obesity. PMID:27179312

  13. Life stress in adolescence predicts early adult reward-related brain function and alcohol dependence

    OpenAIRE

    Casement, Melynda D.; Shaw, Daniel S.; Sitnick, Stephanie L.; Musselman, Samuel C.; Forbes, Erika E.

    2014-01-01

    Stressful life events increase vulnerability to problematic alcohol use, and they may do this by disrupting reward-related neural circuitry. This is particularly relevant for adolescents because alcohol use rises sharply after mid-adolescence and alcohol abuse peaks at age 20. Adolescents also report more stressors compared with children, and neural reward circuitry may be especially vulnerable to stressors during adolescence because of prefrontal cortex remodeling. Using a large sample of ma...

  14. Category-based induction from similarity of neural activation.

    Science.gov (United States)

    Weber, Matthew J; Osherson, Daniel

    2014-03-01

    The idea that similarity might be an engine of inductive inference dates back at least as far as David Hume. However, Hume's thesis is difficult to test without begging the question, since judgments of similarity may be infected by inferential processes. We present a one-parameter model of category-based induction that generates predictions about arbitrary statements of conditional probability over a predicate and a set of items. The prediction is based on the unconditional probabilities and similarities that characterize that predicate and those items. To test Hume's thesis, we collected brain activation from various regions of the ventral visual stream during a categorization task that did not invite comparison of categories. We then calculated the similarity of those activation patterns using a simple measure of vectorwise similarity and supplied those similarities to the model. The model's outputs correlated well with subjects' judgments of conditional probability. Our results represent a promising first step toward confirming Hume's thesis; similarity, assessed without reference to induction, may well drive inductive inference.

  15. Category-based induction from similarity of neural activation.

    Science.gov (United States)

    Weber, Matthew J; Osherson, Daniel

    2014-03-01

    The idea that similarity might be an engine of inductive inference dates back at least as far as David Hume. However, Hume's thesis is difficult to test without begging the question, since judgments of similarity may be infected by inferential processes. We present a one-parameter model of category-based induction that generates predictions about arbitrary statements of conditional probability over a predicate and a set of items. The prediction is based on the unconditional probabilities and similarities that characterize that predicate and those items. To test Hume's thesis, we collected brain activation from various regions of the ventral visual stream during a categorization task that did not invite comparison of categories. We then calculated the similarity of those activation patterns using a simple measure of vectorwise similarity and supplied those similarities to the model. The model's outputs correlated well with subjects' judgments of conditional probability. Our results represent a promising first step toward confirming Hume's thesis; similarity, assessed without reference to induction, may well drive inductive inference. PMID:24254747

  16. Dopamine-induced dissociation of BOLD and neural activity in macaque visual cortex.

    Science.gov (United States)

    Zaldivar, Daniel; Rauch, Alexander; Whittingstall, Kevin; Logothetis, Nikos K; Goense, Jozien

    2014-12-01

    Neuromodulators determine how neural circuits process information during cognitive states such as wakefulness, attention, learning, and memory. fMRI can provide insight into their function and dynamics, but their exact effect on BOLD responses remains unclear, limiting our ability to interpret the effects of changes in behavioral state using fMRI. Here, we investigated the effects of dopamine (DA) injections on neural responses and haemodynamic signals in macaque primary visual cortex (V1) using fMRI (7T) and intracortical electrophysiology. Aside from DA's involvement in diseases such as Parkinson's and schizophrenia, it also plays a role in visual perception. We mimicked DAergic neuromodulation by systemic injection of L-DOPA and Carbidopa (LDC) or by local application of DA in V1 and found that systemic application of LDC increased the signal-to-noise ratio (SNR) and amplitude of the visually evoked neural responses in V1. However, visually induced BOLD responses decreased, whereas cerebral blood flow (CBF) responses increased. This dissociation of BOLD and CBF suggests that dopamine increases energy metabolism by a disproportionate amount relative to the CBF response, causing the reduced BOLD response. Local application of DA in V1 had no effect on neural activity, suggesting that the dopaminergic effects are mediated by long-range interactions. The combination of BOLD-based and CBF-based fMRI can provide a signature of dopaminergic neuromodulation, indicating that the application of multimodal methods can improve our ability to distinguish sensory processing from neuromodulatory effects. PMID:25456449

  17. Deep neural nets as a method for quantitative structure-activity relationships.

    Science.gov (United States)

    Ma, Junshui; Sheridan, Robert P; Liaw, Andy; Dahl, George E; Svetnik, Vladimir

    2015-02-23

    Neural networks were widely used for quantitative structure-activity relationships (QSAR) in the 1990s. Because of various practical issues (e.g., slow on large problems, difficult to train, prone to overfitting, etc.), they were superseded by more robust methods like support vector machine (SVM) and random forest (RF), which arose in the early 2000s. The last 10 years has witnessed a revival of neural networks in the machine learning community thanks to new methods for preventing overfitting, more efficient training algorithms, and advancements in computer hardware. In particular, deep neural nets (DNNs), i.e. neural nets with more than one hidden layer, have found great successes in many applications, such as computer vision and natural language processing. Here we show that DNNs can routinely make better prospective predictions than RF on a set of large diverse QSAR data sets that are taken from Merck's drug discovery effort. The number of adjustable parameters needed for DNNs is fairly large, but our results show that it is not necessary to optimize them for individual data sets, and a single set of recommended parameters can achieve better performance than RF for most of the data sets we studied. The usefulness of the parameters is demonstrated on additional data sets not used in the calibration. Although training DNNs is still computationally intensive, using graphical processing units (GPUs) can make this issue manageable. PMID:25635324

  18. Data Fusion Using Different Activation Functions in Artificial Neural Networks for Vehicular Navigation

    Directory of Open Access Journals (Sweden)

    MALLESWARAN M,

    2010-12-01

    Full Text Available Global positioning System (GPS and Inertial Navigation System (INS data can be integrated together to provide a reliable navigation. GPS/INS data integration provides reliable navigation solutions by overcoming each of their shortcomings, including signal blockage for GPS and increase in position errors with time for INS. This paper aims to provide GPS/INS data integration utilizing Artificial Neural Network (ANN architecture. This architecture is based on Feed Forward Neural Networks, which generally includes Radial Basis Function (RBF neural network and Back Propagation neural network (BPN. These are systematic methods for training multi-layer artificial networks. The BPN-ANN and RBF-ANN modules are trained to predict the INS position error and provide accurate positioning of the moving vehicle. This paper also compares performance of theGPS/INS data integration system by using different activation function like Bipolar Sigmoidal Function (BPSF, Binary Sigmoidal Function (BISF, Hyperbolic Tangential Function (HTF and Gaussian Function (GF in BPN-ANN and using Gaussian function in RBF-ANN.

  19. Musical pleasure and reward: mechanisms and dysfunction.

    Science.gov (United States)

    Zatorre, Robert J

    2015-03-01

    Most people derive pleasure from music. Neuroimaging studies show that the reward system of the human brain is central to this experience. Specifically, the dorsal and ventral striatum release dopamine when listening to pleasurable music, and activity in these structures also codes the reward value of musical excerpts. Moreover, the striatum interacts with cortical mechanisms involved in perception and valuation of musical stimuli. Recent studies have begun to explore individual differences in the way that this complex system functions. Development of a questionnaire for music reward experiences has allowed the identification of separable factors associated with musical pleasure, described as music-seeking, emotion-evocation, mood regulation, sensorimotor, and social factors. Applying this questionnaire to a large sample uncovered approximately 5% of the population with low sensitivity to musical reward in the absence of generalized anhedonia or depression. Further study of this group revealed that there are individuals who respond normally both behaviorally and psychophysiologically to rewards other than music (e.g., monetary value) but do not experience pleasure from music despite normal music perception ability and preserved ability to identify intended emotions in musical passages. This specific music anhedonia bears further study, as it may shed light on the function and dysfunction of the reward system. PMID:25773636

  20. A new scale for measuring reward responsiveness

    Directory of Open Access Journals (Sweden)

    Ivo Van Den Berg

    2010-12-01

    Full Text Available Several psychological theories assume that there are two basic brain mechanisms that guide behavior: an avoidance or inhibition system, which is responsive to signals of punishment, and an approach or activation system, which is sensitive to signals of reward. Several self-report scales have been developed to assess the sensitivity to punishment and reward, and these instruments have been shown to be useful in research on personality, psychopathology, and underlying biological substrates. However, it is also true that in particular scales for measuring reward responsiveness suffer from various inadequacies. Therefore, a new Reward Responsiveness (RR scale was developed and subjected to an extensive psychometric evaluation. The results show that this scale measures a single factor, reward responsiveness that is clearly independent of punishment sensitivity. Further, the data indicated that the internal consistency, convergent validity, discriminant validity, test-retest reliability, and predictive properties of the new scale were all adequate. It can be concluded that the RR scale is a psychometrically sound instrument that may be useful for researchers with interest in the personality construct of reward responsiveness.

  1. Mutual information and self-control of a fully-connected low-activity neural network

    Science.gov (United States)

    Bollé, D.; Carreta, D. Dominguez

    2000-11-01

    A self-control mechanism for the dynamics of a three-state fully connected neural network is studied through the introduction of a time-dependent threshold. The self-adapting threshold is a function of both the neural and the pattern activity in the network. The time evolution of the order parameters is obtained on the basis of a recently developed dynamical recursive scheme. In the limit of low activity the mutual information is shown to be the relevant parameter in order to determine the retrieval quality. Due to self-control an improvement of this mutual information content as well as an increase of the storage capacity and an enlargement of the basins of attraction are found. These results are compared with numerical simulations.

  2. Cognitive-affective neural plasticity following active-controlled mindfulness intervention

    DEFF Research Database (Denmark)

    Allen, Micah Galen

    Mindfulness meditation is a set of attention-based, regulatory and self-inquiry training regimes. Although the impact of mindfulness meditation training (MT) on self-regulation is well established, the neural mechanisms supporting such plasticity are poorly understood. MT is thought to act through...... for cognitive and treatment effects with an active control group. We measured behavioral metacognition and whole-brain Blood Oxygenation Level Dependent (BOLD) signals using functional MRI during an affective Stroop task before and after intervention in healthy human subjects. Although both groups improved...... prefrontal cortex (mPFC), and right anterior insula during negative valence processing. Our findings highlight the importance of active control in MT research, indicate unique neural mechanisms for progressive stages of mindfulness training, and suggest that optimal application of MT may differ depending...

  3. QSAR study on estrogenic activity of structurally diverse compounds using generalized regression neural network

    Institute of Scientific and Technical Information of China (English)

    JI Li; WANG XiaoDong; LUO Si; QIN Liang; YANG XvShu; LIU ShuShen; WANG LianSheng

    2008-01-01

    Computer-based quantitative structure-activity relationship (QSAR) model has been becoming a powerful tool in understanding the structural requirements for chemicals to bind the estrogen receptor (ER), designing drugs for human estrogen replacement therapy, and identifying potential estrogenic endocrine disruptors, in this study, a simple yet powerful neural network technique, generalized regression neural network (GRNN) was used to develop a QSAR model based on 131 structurally diverse estrogens (training set). Only nine descriptors calculated solely from the molecular structures of compounds selected by objective and subjective feature selections were used as inputs of the GRNN model. The predictive power of the built model was found to be comparable to that of the more traditional techniques but requiring significantly easy implementation and a shorter computation-time. The obtained result indicates that the proposed GRNN model is robust and satisfactory, and can provide a feasible and practical tool for the rapid screening of the estrogenic activity of organic compounds.

  4. Single-cell transcriptome analyses reveal signals to activate dormant neural stem cells.

    Science.gov (United States)

    Luo, Yuping; Coskun, Volkan; Liang, Aibing; Yu, Juehua; Cheng, Liming; Ge, Weihong; Shi, Zhanping; Zhang, Kunshan; Li, Chun; Cui, Yaru; Lin, Haijun; Luo, Dandan; Wang, Junbang; Lin, Connie; Dai, Zachary; Zhu, Hongwen; Zhang, Jun; Liu, Jie; Liu, Hailiang; deVellis, Jean; Horvath, Steve; Sun, Yi Eve; Li, Siguang

    2015-05-21

    The scarcity of tissue-specific stem cells and the complexity of their surrounding environment have made molecular characterization of these cells particularly challenging. Through single-cell transcriptome and weighted gene co-expression network analysis (WGCNA), we uncovered molecular properties of CD133(+)/GFAP(-) ependymal (E) cells in the adult mouse forebrain neurogenic zone. Surprisingly, prominent hub genes of the gene network unique to ependymal CD133(+)/GFAP(-) quiescent cells were enriched for immune-responsive genes, as well as genes encoding receptors for angiogenic factors. Administration of vascular endothelial growth factor (VEGF) activated CD133(+) ependymal neural stem cells (NSCs), lining not only the lateral but also the fourth ventricles and, together with basic fibroblast growth factor (bFGF), elicited subsequent neural lineage differentiation and migration. This study revealed the existence of dormant ependymal NSCs throughout the ventricular surface of the CNS, as well as signals abundant after injury for their activation. PMID:26000486

  5. Case Study of Ecstatic Meditation: fMRI and EEG Evidence of Self-Stimulating a Reward System

    Directory of Open Access Journals (Sweden)

    Michael R. Hagerty

    2013-01-01

    Full Text Available We report the first neural recording during ecstatic meditations called jhanas and test whether a brain reward system plays a role in the joy reported. Jhanas are Altered States of Consciousness (ASC that imply major brain changes based on subjective reports: (1 external awareness dims, (2 internal verbalizations fade, (3 the sense of personal boundaries is altered, (4 attention is highly focused on the object of meditation, and (5 joy increases to high levels. The fMRI and EEG results from an experienced meditator show changes in brain activity in 11 regions shown to be associated with the subjective reports, and these changes occur promptly after jhana is entered. In particular, the extreme joy is associated not only with activation of cortical processes but also with activation of the nucleus accumbens (NAc in the dopamine/opioid reward system. We test three mechanisms by which the subject might stimulate his own reward system by external means and reject all three. Taken together, these results demonstrate an apparently novel method of self-stimulating a brain reward system using only internal mental processes in a highly trained subject.

  6. Abnormal Task Modulation of Oscillatory Neural Activity in Schizophrenia

    Directory of Open Access Journals (Sweden)

    Elisa C Dias

    2013-08-01

    Full Text Available Schizophrenia patients have deficits in cognitive function that are a core feature of the disorder. AX-CPT is commonly used to study cognition in schizophrenia, and patients have characteristic pattern of behavioral and ERP response. In AX-CPT subjects respond when a flashed cue A is followed by a target X, ignoring other letter combinations. Patients show reduced hit rate to go trials, and increased false alarms to sequences that require inhibition of a prepotent response. EEG recordings show reduced sensory (P1/N1, as well as later cognitive components (N2, P3, CNV. Behavioral deficits correlate most strongly with sensory dysfunction. Oscillatory analyses provide critical information regarding sensory/cognitive processing over and above standard ERP analyses. Recent analyses of induced oscillatory activity in single trials during AX-CPT in healthy volunteers showed characteristic response patterns in theta, alpha and beta frequencies tied to specific sensory and cognitive processes. Alpha and beta modulated during the trials and beta modulation over the frontal cortex correlated with reaction time. In this study, EEG data was obtained from 18 schizophrenia patients and 13 controls during AX-CPT performance, and single trial decomposition of the signal yielded power in the target wavelengths.Significant task-related event-related desynchronization (ERD was observed in both alpha and beta frequency bands over parieto-occipital cortex related to sensory encoding of the cue. This modulation was reduced in patients for beta, but not for alpha. In addition, significant beta ERD was observed over motor cortex, related to motor preparation for the response, and was also reduced in patients. These findings demonstrate impaired dynamic modulation of beta frequency rhythms in schizophrenia, and suggest that failures of oscillatory activity may underlie impaired sensory information processing in schizophrenia that in turn contributes to cognitive deficits.

  7. Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

    Science.gov (United States)

    Morie, K P; De Sanctis, P; Foxe, J J

    2014-07-25

    Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but

  8. Do Substantia Nigra Dopaminergic Neurons Differentiate Between Reward and Punishment?

    Institute of Scientific and Technical Information of China (English)

    Michael J. Frank; D. James Surmeier

    2009-01-01

    The activity of dopaminergic neurons are thought to be increased by stimuli that predict reward and decreased by stimuli that predict aversive outcomes. Recent work by Matsumoto and Hikosaka challenges this model by asserting that stimuli associated with either rewarding or aversive outcomes increase the activity of dopaminergic neurons in the substantia nigra pars compacta.

  9. Distinct neural activity associated with focused-attention meditation and loving-kindness meditation.

    Directory of Open Access Journals (Sweden)

    Tatia M C Lee

    Full Text Available This study examined the dissociable neural effects of ānāpānasati (focused-attention meditation, FAM and mettā (loving-kindness meditation, LKM on BOLD signals during cognitive (continuous performance test, CPT and affective (emotion-processing task, EPT, in which participants viewed affective pictures processing. Twenty-two male Chinese expert meditators (11 FAM experts, 11 LKM experts and 22 male Chinese novice meditators (11 FAM novices, 11 LKM novices had their brain activity monitored by a 3T MRI scanner while performing the cognitive and affective tasks in both meditation and baseline states. We examined the interaction between state (meditation vs. baseline and expertise (expert vs. novice separately during LKM and FAM, using a conjunction approach to reveal common regions sensitive to the expert meditative state. Additionally, exclusive masking techniques revealed distinct interactions between state and group during LKM and FAM. Specifically, we demonstrated that the practice of FAM was associated with expertise-related behavioral improvements and neural activation differences in attention task performance. However, the effect of state LKM meditation did not carry over to attention task performance. On the other hand, both FAM and LKM practice appeared to affect the neural responses to affective pictures. For viewing sad faces, the regions activated for FAM practitioners were consistent with attention-related processing; whereas responses of LKM experts to sad pictures were more in line with differentiating emotional contagion from compassion/emotional regulation processes. Our findings provide the first report of distinct neural activity associated with forms of meditation during sustained attention and emotion processing.

  10. Distinct neural activity associated with focused-attention meditation and loving-kindness meditation.

    Science.gov (United States)

    Lee, Tatia M C; Leung, Mei-Kei; Hou, Wai-Kai; Tang, Joey C Y; Yin, Jing; So, Kwok-Fai; Lee, Chack-Fan; Chan, Chetwyn C H

    2012-01-01

    This study examined the dissociable neural effects of ānāpānasati (focused-attention meditation, FAM) and mettā (loving-kindness meditation, LKM) on BOLD signals during cognitive (continuous performance test, CPT) and affective (emotion-processing task, EPT, in which participants viewed affective pictures) processing. Twenty-two male Chinese expert meditators (11 FAM experts, 11 LKM experts) and 22 male Chinese novice meditators (11 FAM novices, 11 LKM novices) had their brain activity monitored by a 3T MRI scanner while performing the cognitive and affective tasks in both meditation and baseline states. We examined the interaction between state (meditation vs. baseline) and expertise (expert vs. novice) separately during LKM and FAM, using a conjunction approach to reveal common regions sensitive to the expert meditative state. Additionally, exclusive masking techniques revealed distinct interactions between state and group during LKM and FAM. Specifically, we demonstrated that the practice of FAM was associated with expertise-related behavioral improvements and neural activation differences in attention task performance. However, the effect of state LKM meditation did not carry over to attention task performance. On the other hand, both FAM and LKM practice appeared to affect the neural responses to affective pictures. For viewing sad faces, the regions activated for FAM practitioners were consistent with attention-related processing; whereas responses of LKM experts to sad pictures were more in line with differentiating emotional contagion from compassion/emotional regulation processes. Our findings provide the first report of distinct neural activity associated with forms of meditation during sustained attention and emotion processing.

  11. Social Exclusion in Middle Childhood: Rejection Events, Slow-wave Neural Activity and Ostracism Distress

    OpenAIRE

    Crowley, Michael J.; Wu, Jia; MOLFESE, PETER J.; Mayes, Linda C.

    2010-01-01

    This study examined neural activity with event-related potentials (ERPs) in middle childhood during a computer-simulated ball-toss game, Cyberball. Experiencing fair play initially, children were ultimately excluded by the other players. We focused specifically on “not my turn” events within fair play and rejection events within social exclusion. Dense-array ERPs revealed that rejection events are perceived rapidly. Condition differences (“not my turn” vs. rejection) were evident in a posteri...

  12. Human facial neural activities and gesture recognition for machine-interfacing applications

    Directory of Open Access Journals (Sweden)

    Hamedi M

    2011-12-01

    Full Text Available M Hamedi1, Sh-Hussain Salleh2, TS Tan2, K Ismail2, J Ali3, C Dee-Uam4, C Pavaganun4, PP Yupapin51Faculty of Biomedical and Health Science Engineering, Department of Biomedical Instrumentation and Signal Processing, University of Technology Malaysia, Skudai, 2Centre for Biomedical Engineering Transportation Research Alliance, 3Institute of Advanced Photonics Science, Nanotechnology Research Alliance, University of Technology Malaysia (UTM, Johor Bahru, Malaysia; 4College of Innovative Management, Valaya Alongkorn Rajabhat University, Pathum Thani, 5Nanoscale Science and Engineering Research Alliance (N'SERA, Advanced Research Center for Photonics, Faculty of Science, King Mongkut's Institute of Technology Ladkrabang, Bangkok, ThailandAbstract: The authors present a new method of recognizing different human facial gestures through their neural activities and muscle movements, which can be used in machine-interfacing applications. Human–machine interface (HMI technology utilizes human neural activities as input controllers for the machine. Recently, much work has been done on the specific application of facial electromyography (EMG-based HMI, which have used limited and fixed numbers of facial gestures. In this work, a multipurpose interface is suggested that can support 2–11 control commands that can be applied to various HMI systems. The significance of this work is finding the most accurate facial gestures for any application with a maximum of eleven control commands. Eleven facial gesture EMGs are recorded from ten volunteers. Detected EMGs are passed through a band-pass filter and root mean square features are extracted. Various combinations of gestures with a different number of gestures in each group are made from the existing facial gestures. Finally, all combinations are trained and classified by a Fuzzy c-means classifier. In conclusion, combinations with the highest recognition accuracy in each group are chosen. An average accuracy

  13. Impact of Size and Delay on Neural Activity in the Rat Limbic Corticostriatal System

    OpenAIRE

    Roesch, Matthew R; Bryden, Daniel W.

    2011-01-01

    A number of factors influence an animal’s economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short-delay and big-reward conditions than under long-delay a...

  14. A non-reward attractor theory of depression.

    Science.gov (United States)

    Rolls, Edmund T

    2016-09-01

    A non-reward attractor theory of depression is proposed based on the operation of the lateral orbitofrontal cortex and supracallosal cingulate cortex. The orbitofrontal cortex contains error neurons that respond to non-reward for many seconds in an attractor state that maintains a memory of the non-reward. The human lateral orbitofrontal cortex is activated by non-reward during reward reversal, and by a signal to stop a response that is now incorrect. Damage to the human orbitofrontal cortex impairs reward reversal learning. Not receiving reward can produce depression. The theory proposed is that in depression, this lateral orbitofrontal cortex non-reward system is more easily triggered, and maintains its attractor-related firing for longer. This triggers negative cognitive states, which in turn have positive feedback top-down effects on the orbitofrontal cortex non-reward system. Treatments for depression, including ketamine, may act in part by quashing this attractor. The mania of bipolar disorder is hypothesized to be associated with oversensitivity and overactivity in the reciprocally related reward system in the medial orbitofrontal cortex and pregenual cingulate cortex. PMID:27181908

  15. Global exponential stability of the periodic solution of a delayed neural network with discontinuous activations

    Energy Technology Data Exchange (ETDEWEB)

    Papini, Duccio [Dipartimento di Ingegneria dell' Informazione, Universita degli Studi di Siena, via Roma 56, 53100 Siena (Italy)]. E-mail: papini@dii.unisi.it; Taddei, Valentina [Dipartimento di Ingegneria dell' Informazione, Universita degli Studi di Siena, via Roma 56, 53100 Siena (Italy)]. E-mail: taddei@dii.unisi.it

    2005-08-01

    We study the stability of a delayed Hopfield neural network with periodic coefficients and inputs and an arbitrary and constant delay. We consider non-decreasing activation functions which may also have jump discontinuities in order to model the ideal situation where the gain of the neur