WorldWideScience

Sample records for activate neural reward

  1. Perceptual Salience and Reward Both Influence Feedback-Related Neural Activity Arising from Choice.

    Lou, Bin; Hsu, Wha-Yin; Sajda, Paul

    2015-09-23

    expected reward. Here, we use electroencephelography to identify trial-by-trial neural activity of perceived stimulus salience, showing that this activity can be combined with the value of choice options to form a representation of expected reward. Our results provide insight into the neural processing governing the interaction between salience and value and the formation of subjective expected reward and prediction error. This work is potentially important for identifying neural markers of abnormal sensory/value processing, as is seen in some cases of psychiatric illnesses. PMID:26400937

  2. Optimal waist-to-hip ratios in women activate neural reward centers in men.

    Platek, Steven M; Singh, Devendra

    2010-01-01

    Secondary sexual characteristics convey information about reproductive potential. In the same way that facial symmetry and masculinity, and shoulder-to-hip ratio convey information about reproductive/genetic quality in males, waist-to-hip-ratio (WHR) is a phenotypic cue to fertility, fecundity, neurodevelopmental resources in offspring, and overall health, and is indicative of "good genes" in women. Here, using fMRI, we found that males show activation in brain reward centers in response to naked female bodies when surgically altered to express an optimal (approximately 0.7) WHR with redistributed body fat, but relatively unaffected body mass index (BMI). Relative to presurgical bodies, brain activation to postsurgical bodies was observed in bilateral orbital frontal cortex. While changes in BMI only revealed activation in visual brain substrates, changes in WHR revealed activation in the anterior cingulate cortex, an area associated with reward processing and decision-making. When regressing ratings of attractiveness on brain activation, we observed activation in forebrain substrates, notably the nucleus accumbens, a forebrain nucleus highly involved in reward processes. These findings suggest that an hourglass figure (i.e., an optimal WHR) activates brain centers that drive appetitive sociality/attention toward females that represent the highest-quality reproductive partners. This is the first description of a neural correlate implicating WHR as a putative honest biological signal of female reproductive viability and its effects on men's neurological processing. PMID:20140088

  3. Memory Consolidation and Neural Substrate of Reward

    Redolar-Ripoll, Diego

    2012-08-01

    Full Text Available The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of goal-directed behavior. The neural substrate underling this processing of reward information is a reliable way of improving learning and memory processes. Evidence from several studies indicates that this neural system can facilitate memory consolidation in a wide variety of learning tasks. From a molecular perspective, certain cardinal features of reward have been described as forms of memory. Studies of human addicts and studies in animal models of addiction show that chronic drug exposure produces stable changes in the brain at the cellular and molecular levels that underlie the long-lasting behavioral plasticity associated with addiction. These molecular and cellular adaptations involved in addiction are also implicated in learning and memory processes. Dopamine seems to be a critical common signal to activate different genetic mechanisms that ultimately remodel synapses and circuits. Despite memory is an active and complex process mediated by different brain areas, the neural substrate of reward is able to improve memory consolidation in a several paradigms. We believe that there are many equivalent traits between reward and learning and memory processes.

  4. Effects of selective serotonin reuptake inhibition on neural activity related to risky decisions and monetary rewards in healthy males

    Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E;

    2014-01-01

    functional MRI (fMRI) to investigate how a three-week fluoxetine intervention influences neural activity related to risk taking and reward processing. Employing a double-blinded parallel-group design, 29 healthy young males were randomly assigned to receive 3 weeks of a daily dose of 40 mg fluoxetine or...... placebo, the SSRI intervention did not alter individual risk-choice preferences, but modified neural activity during decision-making and reward processing: During the choice phase, SSRI reduced the neural response to increasing risk in lateral orbitofrontal cortex, a key structure for value-based decision-making...... involvement of the normally functioning 5HT-system in decision-making under risk and processing of monetary rewards. The data suggest that prolonged SSRI treatment might reduce emotional engagement by reducing the impact of risk during decision-making or the impact of reward during outcome evaluation....

  5. Neural processing of reward in adolescent rodents

    Nicholas W. Simon

    2015-02-01

    Full Text Available Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.

  6. Preliminary Evidence for Impaired Brain Activity of Neural Reward Processing in Children and Adolescents with Reactive Attachment Disorder.

    Tomoda, Akemi

    2016-01-01

    Childhood maltreatment, which markedly increases risks for psychopathology, is associated with structural and functional brain differences. Especially, exposure to parental verbal abuse (PVA) or interparental violence during childhood is associated with negative outcomes such as depression, posttraumatic stress disorder (PTSD), and reduced cognitive abilities. Other forms of childhood maltreatment have been associated with brain structure or developmental alteration. Our earlier studies elucidated potential discernible effects of PVA and witnessing domestic violence during childhood on brain morphology, including gray matter volume or cortical thickness. Brain regions that process and convey the adverse sensory input of the abuse might be modified specifically by such experiences, particularly in subjects exposed to a single type of maltreatment. Exposure to multiple types of maltreatment is more commonly associated with morphological alterations in the corticolimbic regions. These findings fit with preclinical studies showing that sensory cortices are highly plastic structures. Using tasks with high and low monetary rewards while subjects underwent functional MRI, we also examined whether neural activity during reward processing was altered, or not, in children and adolescents with reactive attachment disorder (RAD). Significantly reduced activity in the caudate and nucleus accumbens was observed during a high monetary reward condition in the RAD group compared to the typically developed group. The striatal neural reward activity in the RAD group was also markedly decreased. The present results suggest that dopaminergic dysfunction occurred in the striatum in children and adolescents with RAD, potentially leading to a future risk of psychiatric disorders such as dependence. PMID:27150924

  7. The neural correlates of temporal reward discounting

    Scheres, A.P.J.; Water, E. de; Mies, G.W.

    2013-01-01

    Temporal reward discounting (TD) refers to the decrease in subjective value of a reward when the delay to that reward increases. In recent years, a growing number of studies on the neural correlates of temporal reward discounting have been conducted. This article focuses on functional magnetic reson

  8. Differentiating neural reward responsiveness in autism versus ADHD.

    2014-01-01

    Although attention deficit hyperactivity disorders (ADHD) and autism spectrum disorders (ASD) share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC). A significant group by reward type i...

  9. Differentiating neural reward responsiveness in autism versus ADHD

    Gregor Kohls

    2014-10-01

    Full Text Available Although attention deficit hyperactivity disorders (ADHD and autism spectrum disorders (ASD share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC. A significant group by reward type interaction effect emerged in the ventral striatum with greater activation to monetary versus social reward only in TDC, whereas subjects with ADHD responded equally strong to both reward types, and subjects with ASD showed low striatal reactivity across both reward conditions. Moreover, disorder-specific neural abnormalities were revealed, including medial prefrontal hyperactivation in response to social reward in ADHD versus ventral striatal hypoactivation in response to monetary reward in ASD. Shared dysfunction was characterized by fronto-striato-parietal hypoactivation in both clinical groups when money was at stake. Interestingly, lower neural activation within parietal circuitry was associated with higher autistic traits across the entire study sample. In sum, the present findings concur with the assumption that both ASD and ADHD display distinct and shared neural dysfunction in response to reward.

  10. Optimal Waist-to-Hip Ratios in Women Activate Neural Reward Centers in Men

    Platek, Steven M.; Singh, Devendra

    2010-01-01

    Secondary sexual characteristics convey information about reproductive potential. In the same way that facial symmetry and masculinity, and shoulder-to-hip ratio convey information about reproductive/genetic quality in males, waist-to-hip-ratio (WHR) is a phenotypic cue to fertility, fecundity, neurodevelopmental resources in offspring, and overall health, and is indicative of “good genes” in women. Here, using fMRI, we found that males show activation in brain reward centers in response to n...

  11. RM-SORN: a reward-modulated self-organizing recurrent neural network.

    Aswolinskiy, Witali; Pipa, Gordon

    2015-01-01

    Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain. PMID:25852533

  12. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

    Schultz, Wolfram

    2004-04-01

    Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making. PMID:15082317

  13. Neural processing of calories in brain reward areas can be modulated by reward sensitivity

    Inge eVan Rijn

    2016-01-01

    Full Text Available A food’s reward value is dependent on its caloric content. Furthermore, a food’s acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity, however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015, in which participants (n=30 tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n=18 (Griffioen-Roose et al., 2013. First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS questionnaire.When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate, right amygdala and anterior cingulate cortex (bilaterally correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per

  14. Memory Consolidation and Neural Substrate of Reward

    Redolar-Ripoll, Diego

    2012-01-01

    The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of go...

  15. The role of the neural reward system in attention selection.

    Soder, Heather E; de Dios, Constanza; Potts, Geoffrey F

    2016-07-01

    The prefrontal cortex may play a role in attention selection using motivational information from the mesotelencephalic dopamine system, a neural system that responds to reward prediction violations. If so, neural indices of attention selection and reward prediction violation should have overlapping spatiotemporal distributions. Attention selection elicits a frontal event-related potential component around 200-300 ms, the frontal selection positivity. A component with similar spatiotemporal characteristics, the reward positivity is elicited in reward prediction designs to outcomes that are better than expected. The current study used dense sensor array recording in a sample of 41 participants performing visual oddball (attention) and a reward prediction 'slot machine-like' design to compare the spatiotemporal distributions of the frontal selection positivity and the reward positivity. The components did not differ in their peak latencies and had overlapping scalp topographies, supporting the hypothesis that these positivities represent attachment of incentive salience to perceptual representations in the prefrontal cortex. PMID:27232519

  16. Relief as a reward: hedonic and neural responses to safety from pain.

    Siri Leknes

    Full Text Available Relief fits the definition of a reward. Unlike other reward types the pleasantness of relief depends on the violation of a negative expectation, yet this has not been investigated using neuroimaging approaches. We hypothesized that the degree of negative expectation depends on state (dread and trait (pessimism sensitivity. Of the brain regions that are involved in mediating pleasure, the nucleus accumbens also signals unexpected reward and positive prediction error. We hypothesized that accumbens activity reflects the level of negative expectation and subsequent pleasant relief. Using fMRI and two purpose-made tasks, we compared hedonic and BOLD responses to relief with responses during an appetitive reward task in 18 healthy volunteers. We expected some similarities in task responses, reflecting common neural substrates implicated across reward types. However, we also hypothesized that relief responses would differ from appetitive rewards in the nucleus accumbens, since only relief pleasantness depends on negative expectations. The results confirmed these hypotheses. Relief and appetitive reward task activity converged in the ventromedial prefrontal cortex, which also correlated with appetitive reward pleasantness ratings. In contrast, dread and pessimism scores correlated with relief but not with appetitive reward hedonics. Moreover, only relief pleasantness covaried with accumbens activation. Importantly, the accumbens signal appeared to specifically reflect individual differences in anticipation of the adverse event (dread, pessimism but was uncorrelated to appetitive reward hedonics. In conclusion, relief differs from appetitive rewards due to its reliance on negative expectations, the violation of which is reflected in relief-related accumbens activation.

  17. Gender-specific modulation of neural mechanisms underlying social reward processing by Autism Quotient.

    Barman, Adriana; Richter, Sylvia; Soch, Joram; Deibele, Anna; Richter, Anni; Assmann, Anne; Wüstenberg, Torsten; Walter, Henrik; Seidenbecher, Constanze I; Schott, Björn H

    2015-11-01

    Autism spectrum disorder refers to a neurodevelopmental condition primarily characterized by deficits in social cognition and behavior. Subclinically, autistic features are supposed to be present in healthy humans and can be quantified using the Autism Quotient (AQ). Here, we investigated a potential relationship between AQ and neural correlates of social and monetary reward processing, using functional magnetic resonance imaging in young, healthy participants. In an incentive delay task with either monetary or social reward, reward anticipation elicited increased ventral striatal activation, which was more pronounced during monetary reward anticipation. Anticipation of social reward elicited activation in the default mode network (DMN), a network previously implicated in social processing. Social reward feedback was associated with bilateral amygdala and fusiform face area activation. The relationship between AQ and neural correlates of social reward processing varied in a gender-dependent manner. In women and, to a lesser extent in men, higher AQ was associated with increased posterior DMN activation during social reward anticipation. During feedback, we observed a negative correlation of AQ and right amygdala activation in men only. Our results suggest that social reward processing might constitute an endophenotype for autism-related traits in healthy humans that manifests in a gender-specific way. PMID:25944965

  18. Response of neural reward regions to food cues in autism spectrum disorders

    Cascio Carissa J

    2012-05-01

    Full Text Available Abstract Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our understanding of neural reward circuitry in ASD includes a characterization of the neural response to primary rewards. Method We asked 17 children with ASD and 18 children without ASD to abstain from eating for at least four hours before an MRI scan in which they viewed images of high-calorie foods. We assessed the neural reward network for increases in the blood oxygenation level dependent (BOLD signal in response to the food images Results We found very similar patterns of increased BOLD signal to these images in the two groups; both groups showed increased BOLD signal in the bilateral amygdala, as well as in the nucleus accumbens, orbitofrontal cortex, and insula. Direct group comparisons revealed that the ASD group showed a stronger response to food cues in bilateral insula along the anterior-posterior gradient and in the anterior cingulate cortex than the control group, whereas there were no neural reward regions that showed higher activation for controls than for ASD. Conclusion These results suggest that neural response to primary rewards is not diminished but in fact shows an aberrant enhancement in children with ASD.

  19. Related Neural Mechanism in Reward Learning and Memory

    C. Liu

    2012-01-01

    Learning and memory are two corresponding neural processes. Learning is a neural actitivity depending on experience and changing organ’s behaviour to adapt the enviorement.Memory is a neural processing which storages and retrieves learned information. Reward and punishment learning and memory protect animals to approach the benefits and avoid risks for better life. Although researches are exploring the mechanism of the brain work, a large amount of studies are required to reveal the truth in ...

  20. Shared neural basis of social and non-social reward deficits in chronic cocaine users.

    Tobler, Philippe N; Preller, Katrin H; Campbell-Meiklejohn, Daniel K; Kirschner, Matthias; Kraehenmann, Rainer; Stämpfli, Philipp; Herdener, Marcus; Seifritz, Erich; Quednow, Boris B

    2016-06-01

    Changed reward functions have been proposed as a core feature of stimulant addiction, typically observed as reduced neural responses to non-drug-related rewards. However, it was unclear yet how specific this deficit is for different types of non-drug rewards arising from social and non-social reinforcements. We used functional neuroimaging in cocaine users to investigate explicit social reward as modeled by agreement of music preferences with music experts. In addition, we investigated non-social reward as modeled by winning desired music pieces. The study included 17 chronic cocaine users and 17 matched stimulant-naive healthy controls. Cocaine users, compared with controls, showed blunted neural responses to both social and non-social reward. Activation differences were located in the ventromedial prefrontal cortex overlapping for both reward types and, thus, suggesting a non-specific deficit in the processing of non-drug rewards. Interestingly, in the posterior lateral orbitofrontal cortex, social reward responses of cocaine users decreased with the degree to which they were influenced by social feedback from the experts, a response pattern that was opposite to that observed in healthy controls. The present results suggest that cocaine users likely suffer from a generalized impairment in value representation as well as from an aberrant processing of social feedback. PMID:26969866

  1. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function

    Karuna Subramaniam

    2015-01-01

    Full Text Available Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC participants, reward anticipation is associated with activity in frontal–striatal networks. By contrast, schizophrenia (SZ participants show hypoactivation within these frontal–striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.

  2. Training recurrent neural networks with sparse, delayed rewards for flexible decision tasks

    Miconi, Thomas

    2015-01-01

    Recurrent neural networks in the chaotic regime exhibit complex dynamics reminiscent of high-level cortical activity during behavioral tasks. However, existing training methods for such networks are either biologically implausible, or require a real-time continuous error signal to guide the learning process. This is in contrast with most behavioral tasks, which only provide time-sparse, delayed rewards. Here we show that a biologically plausible reward-modulated Hebbian learning algorithm, pr...

  3. Fairness influences early signatures of reward-related neural processing.

    Massi, Bart; Luhmann, Christian C

    2015-12-01

    Many humans exhibit a strong preference for fairness during decision-making. Although there is evidence that social factors influence reward-related and affective neural processing, it is unclear if this effect is mediated by compulsory outcome evaluation processes or results from slower deliberate cognition. Here we show that the feedback-related negativity (FRN) and late positive potential (LPP), two signatures of early hedonic processing, are modulated by the fairness of rewards during a passive rating task. We find that unfair payouts elicit larger FRNs than fair payouts, whereas fair payouts elicit larger LPPs than unfair payouts. This is true both in the time-domain, where the FRN and LPP are related, and in the time-frequency domain, where the two signals are largely independent. Ultimately, this work demonstrates that fairness affects the early stages of reward and affective processing, suggesting a common biological mechanism for social and personal reward evaluation. PMID:25962511

  4. Neural basis of reward anticipation and its genetic determinants.

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-04-01

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

  5. Explicit neural signals reflecting reward uncertainty

    Schultz, W.; Preuschoff, K; Camerer, C.; Hsu, M; Fiorillo, C D; Tobler, Philippe N.; Bossaerts, P.

    2008-01-01

    The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitu...

  6. Neural signature of reward-modulated unconscious inhibitory control.

    Diao, Liuting; Qi, Senqing; Xu, Mengsi; Li, Zhiai; Ding, Cody; Chen, Antao; Zheng, Yan; Yang, Dong

    2016-09-01

    Consciously initiated cognitive control is generally determined by motivational incentives (e.g., monetary reward). Recent studies have revealed that human cognitive control processes can nevertheless operate without awareness. However, whether monetary reward can impinge on unconscious cognitive control remains unclear. To clarify this issue, a task consisting of several runs was designed to combine a modified version of the reward-priming paradigm with an unconscious version of the Go/No-Go task. At the beginning of each run, participants were exposed to a high- or low-value coin, followed by the modified Go/No-Go task. Participants could earn the coin only if they responded correctly to each trial of the run. Event-related potential (ERP) results indicated that high-value rewards (vs. low-value rewards) induced a greater centro-parietal P3 component associated with conscious and unconscious inhibitory control. Moreover, the P3 amplitude correlated positively with the magnitude of reaction time slowing reflecting the intensity of activation of unconscious inhibitory control in the brain. These findings suggest that high-value reward may facilitate human higher-order inhibitory processes that are independent of conscious awareness, which provides insights into the brain processes that underpin motivational modulation of cognitive control. PMID:27346057

  7. Neural sensitivity to eudaimonic and hedonic rewards differentially predict adolescent depressive symptoms over time.

    Telzer, Eva H; Fuligni, Andrew J; Lieberman, Matthew D; Galván, Adriana

    2014-05-01

    The pursuit of happiness and reward is an impetus for everyday human behavior and the basis of well-being. Although optimal well-being may be achieved through eudaimonic activities (e.g., meaning and purpose), individuals tend to orient toward hedonic activities (e.g., pleasure seeking), potentially placing them at risk for ill-being. We implemented a longitudinal study and followed adolescents over 1 y to examine whether neural sensitivity to eudaimonic (e.g., prosocial decisions) and hedonic (e.g., selfish rewards and risky decisions) rewards differentially predicts longitudinal changes in depressive symptoms. Ventral striatum activation during eudaimonic decisions predicted longitudinal declines in depressive symptoms, whereas ventral striatum activation to hedonic decisions related to longitudinal increases in depressive symptoms. These findings underscore how the motivational context underlying neural sensitivity to rewards can differentially predict changes in well-being over time. Importantly, to our knowledge, this is the first study to show that striatal activation within an individual can be both a source of risk and protection. PMID:24753574

  8. Abnormal Reward System Activation in Mania

    Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan

    2007-01-01

    Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects...

  9. The Influence of Personality on Neural Mechanisms of Observational Fear and Reward Learning

    Hooker, Christine I.; Verosky, Sara C.; Miyakawa, Asako; Knight, Robert T.; D'Esposito, Mark

    2008-01-01

    Fear and reward learning can occur through direct experience or observation. Both channels can enhance survival or create maladaptive behavior. We used fMRI to isolate neural mechanisms of observational fear and reward learning and investigate whether neural response varied according to individual differences in neuroticism and extraversion.…

  10. Response of neural reward regions to food cues in autism spectrum disorders

    Cascio Carissa J; Foss-Feig Jennifer H; Heacock Jessica L; Newsom Cassandra R; Cowan Ronald L; Benningfield Margaret M; Rogers Baxter P; Cao Aize

    2012-01-01

    Abstract Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD) is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our...

  11. Neural mechanisms of the nucleus accumbens circuit in reward and aversive learning.

    Hikida, Takatoshi; Morita, Makiko; Macpherson, Tom

    2016-07-01

    The basal ganglia are key neural substrates not only for motor function, but also cognitive functions including reward and aversive learning. Critical for these processes are the functional role played by two projection neurons within nucleus accumbens (NAc); the D1- and D2-expressing neurons. Recently, we have developed a novel reversible neurotransmission blocking technique that specifically blocks neurotransmission from NAc D1- and D2-expressing neurons, allowing for in vivo analysis. In this review, we outline the functional dissociation of NAc D1- and D2-expressing neurons of the basal ganglia in reward and aversive learning, as well as drug addiction. These studies have revealed the importance of activation of NAc D1 receptors for reward learning and drug addiction, and inactivation of NAc D2 receptors for aversive learning and flexibility. Based on these findings, we propose a neural mechanism, in which dopamine neurons in the ventral tegmental area that send inputs to the NAc work as a switch between D1- and D2-expressing neurons. These basal ganglia neural mechanisms will give us new insights into the pathophysiology of neuropsychiatric diseases. PMID:26827817

  12. Age associations with neural processing of reward anticipation in adolescents with bipolar disorders

    Snežana Urošević

    2016-01-01

    Full Text Available Reward/behavioral approach system hypersensitivity is implicated in bipolar disorders (BD and in normative development during adolescence. Pediatric onset of BD is associated with a more severe illness course. However, little is known about neural processing of rewards in adolescents with BD or developmental (i.e., age associations with activation of these neural systems. The present study aims to address this knowledge gap. The present sample included 21 adolescents with BD and 26 healthy adolescents, ages 13 to 19. Participants completed a functional magnetic resonance imaging (fMRI protocol using the Monetary Incentive Delay (MID task. Behavioral performance was similar between groups. Group differences in BOLD activation during target anticipation and feedback anticipation periods of the task were examined using whole-brain analyses, as were group differences in age effects. During both target anticipation and feedback anticipation, adolescents with BD, compared to adolescents without psychopathology, exhibited decreased engagement of frontal regions involved in cognitive control (i.e., dorsolateral prefrontal cortex. Healthy adolescents exhibited age-related decreases, while adolescents with BD exhibited age-related increases, in activity of other cognitive control frontal areas (i.e., right inferior frontal gyrus, suggesting altered development in the BD group. Longitudinal research is needed to examine potentially abnormal development of cognitive control during reward pursuit in adolescent BD and whether early therapeutic interventions can prevent these potential deviations from normative development.

  13. Age associations with neural processing of reward anticipation in adolescents with bipolar disorders

    Urošević, Snežana; Luciana, Monica; Jensen, Jonathan B.; Youngstrom, Eric A.; Thomas, Kathleen M.

    2016-01-01

    Reward/behavioral approach system hypersensitivity is implicated in bipolar disorders (BD) and in normative development during adolescence. Pediatric onset of BD is associated with a more severe illness course. However, little is known about neural processing of rewards in adolescents with BD or developmental (i.e., age) associations with activation of these neural systems. The present study aims to address this knowledge gap. The present sample included 21 adolescents with BD and 26 healthy adolescents, ages 13 to 19. Participants completed a functional magnetic resonance imaging (fMRI) protocol using the Monetary Incentive Delay (MID) task. Behavioral performance was similar between groups. Group differences in BOLD activation during target anticipation and feedback anticipation periods of the task were examined using whole-brain analyses, as were group differences in age effects. During both target anticipation and feedback anticipation, adolescents with BD, compared to adolescents without psychopathology, exhibited decreased engagement of frontal regions involved in cognitive control (i.e., dorsolateral prefrontal cortex). Healthy adolescents exhibited age-related decreases, while adolescents with BD exhibited age-related increases, in activity of other cognitive control frontal areas (i.e., right inferior frontal gyrus), suggesting altered development in the BD group. Longitudinal research is needed to examine potentially abnormal development of cognitive control during reward pursuit in adolescent BD and whether early therapeutic interventions can prevent these potential deviations from normative development. PMID:27114896

  14. Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans

    Julie eThomas

    2013-11-01

    Full Text Available Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies.

  15. Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

    van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Paul A.M. Smeets

    2016-01-01

    A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simpl...

  16. Neural processing of calories in brain reward areas can be modulated by reward sensitivity

    Inge eVan Rijn; Sanne eGriffioen-Roose; Cees ede Graaf; Paul A.M. Smeets

    2016-01-01

    A food’s reward value is dependent on its caloric content. Furthermore, a food’s acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n=30) tasted simple ...

  17. Dopamine, reward learning, and active inference

    Thomas eFitzgerald

    2015-11-01

    Full Text Available Temporal difference learning models propose phasic dopamine signalling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behaviour. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings.

  18. An altered neural response to reward may contribute to alcohol problems among late adolescents with an evening chronotype

    Hasler, Brant P.; Sitnick, Stephanie L.; Shaw, Daniel S.; Erika E. Forbes

    2013-01-01

    Evening chronotypes not only differ from morning-types in their sleep and circadian timing, but they are prone to problematic outcomes involving reward function, including affective disturbance, sensation seeking, and substance involvement. We explored the neural mechanisms underlying these chronotype differences by comparing the neural response to reward in morning- and evening-types. Using a monetary reward fMRI paradigm, we compared the neural response to reward in 13 morning-types and 21 ...

  19. The influence of personality on neural mechanisms of observational fear and reward learning

    Hooker, Christine I.; Verosky, Sara C.; Miyakawa, Asako; Robert T Knight; D’Esposito, Mark

    2008-01-01

    Fear and reward learning can occur through direct experience or observation. Both channels can enhance survival or create maladaptive behavior. We used fMRI to isolate neural mechanisms of observational fear and reward learning and investigate whether neural response varied according to individual differences in neuroticism and extraversion. Participants learned object-emotion associations by observing a woman respond with fearful (or neutral) and happy (or neutral) facial expressions to nove...

  20. Reward-related neural dysfunction across depression and impulsivity: A dimensional approach.

    Ait Oumeziane, Belel; Foti, Dan

    2016-08-01

    Recent theoretical models underline reward sensitivity as a potential endophenotype for major depressive disorder. Neural and behavioral evidence reveals depression is associated with reduced reward sensitivity. However, reward dysfunction is not unique to depression, as it is also common across disorders of poor impulse control. We examined the interrelationships of depression (Depression, Anxiety, and Stress Scale [DASS-21]) and impulsivity (UPPS-P Impulsive Behavior Scale) with reward sensitivity among a large, representative sample (N = 260). ERPs were recorded to isolate two neural indicators of consummatory reward processing: initial evaluation of rewards in the 250-350 ms time window postonset of feedback (reward positivity [RewP]), and salience to monetary outcomes (P3). Significant interactions were observed between depression and impulsivity facets across these two stages of reward processing: depression and positive urgency predicted RewP amplitude to reward outcomes (win vs. loss); depression and one other impulsivity trait, (lack of) premeditation, predicted P3 amplitude to monetary outcomes. Conversely, high symptoms of depression were related to three biobehavioral profiles: (1) blunted RewP in conjunction with high positive urgency, (2) combination of blunted RewP and low (lack of) premeditation, and (3) blunted P3 to monetary wins/losses, in conjunction with low (lack of) premeditation. Findings illustrate that reward-related dysfunctions may be optimally conceptualized when examining the interactions between dimensions of internalizing and externalizing psychopathology. PMID:27193188

  1. Reward value enhances post-decision error-related activity in the cingulate cortex.

    Taylor, Jessica E; Ogawa, Akitoshi; Sakagami, Masamichi

    2016-06-01

    By saying "Anyone who has never made a mistake has never tried anything new", Albert Einstein himself allegedly implied that the making and processing of errors are essential for behavioral adaption to a new or changing environment. These essential error-related cognitive and neural processes are likely influenced by reward value. However, previous studies have not dissociated accuracy and value and so the distinct effect of reward on error processing in the brain remained unknown. Therefore, we set out to investigate this at various points in decision-making. We used functional magnetic resonance imaging to scan participants while they completed a random dot motion discrimination task where reward and non-reward were associated with stimuli via classical conditioning. Pre-error activity was found in the medial frontal cortex prior to response but this was not related to reward value. At response time, error-related activity was found to be significantly greater in reward than non-reward trials in the midcingulate cortex. Finally at outcome time, error-related activity was found in the anterior cingulate cortex in non-reward trials. These results show that reward value enhances post-decision but not pre-decision error-related activities and these results therefore have implications for theories of error correction and confidence. PMID:26739226

  2. Neural evidence for an association between social proficiency and sensitivity to social reward.

    Gossen, Anna; Groppe, Sarah E; Winkler, Lina; Kohls, Gregor; Herrington, John; Schultz, Robert T; Gründer, Gerhard; Spreckelmeyer, Katja N

    2014-05-01

    Data from developmental psychology suggests a link between the growth of socio-emotional competences and the infant's sensitivity to the salience of social stimuli. The aim of the present study was to find evidence for this relationship in healthy adults. Thirty-five participants were recruited based on their score above the 85th or below the 15th percentile of the empathy quotient questionnaire (EQ, Baron-Cohen and Wheelwright, 2004). Functional magnetic resonance imaging (fMRI) was used to compare neural responses to cues of social and non-social (monetary) reward. When compared to the high-EQ group, the low-EQ group showed reduced activity of the brain s reward system, specifically the right nucleus accumbens, in response to cues predictive of social reward (videos showing gestures of approval)-but increased activation in this area for monetary incentives. Our data provide evidence for a link between self-reported deficits in social proficiency and reduced sensitivity to the motivational salience of positive social stimuli. PMID:23512930

  3. Effects of direct social experience on trust decisions and neural reward circuitry

    Dominic S. Fareri

    2012-10-01

    Full Text Available The human striatum is integral for reward-processing and supports learning by linking experienced outcomes with prior expectations. Recent endeavors implicate the striatum in processing outcomes of social interactions, such as social approval/rejection, as well as in learning reputations of others. Interestingly, social impressions often influence our behavior with others during interactions. Information about an interaction partner’s moral character acquired from biographical information hinders updating of expectations after interactions via top down modulation of reward circuitry. An outstanding question is whether initial impressions formed through experience similarly modulate the ability to update social impressions at the behavioral and neural level. We investigated the role of experienced social information on trust behavior and reward-related BOLD activity. Participants played a computerized ball tossing game with three fictional partners manipulated to be perceived as good, bad or neutral. Participants then played an iterated trust game as investors with these same partners while undergoing fMRI. Unbeknownst to participants, partner behavior in the trust game was random and unrelated to their ball-tossing behavior. Participants’ trust decisions were influenced by their prior experience in the ball tossing game, investing less often with the bad partner compared to the good and neutral. Reinforcement learning models revealed that participants were more sensitive to updating their beliefs about good and bad partners when experiencing outcomes consistent with initial experience. Increased striatal and anterior cingulate BOLD activity for positive versus negative trust game outcomes emerged, which further correlated with model-derived prediction-error (PE learning signals. These results suggest that initial impressions formed from direct social experience can be continually shaped by consistent information through reward learning

  4. Girls’ challenging social experiences in early adolescence predict neural response to rewards and depressive symptoms

    Melynda D. Casement

    2014-04-01

    Full Text Available Developmental models of psychopathology posit that exposure to social stressors may confer risk for depression in adolescent girls by disrupting neural reward circuitry. The current study tested this hypothesis by examining the relationship between early adolescent social stressors and later neural reward processing and depressive symptoms. Participants were 120 girls from an ongoing longitudinal study of precursors to depression across adolescent development. Low parental warmth, peer victimization, and depressive symptoms were assessed when the girls were 11 and 12 years old, and participants completed a monetary reward guessing fMRI task and assessment of depressive symptoms at age 16. Results indicate that low parental warmth was associated with increased response to potential rewards in the medial prefrontal cortex (mPFC, striatum, and amygdala, whereas peer victimization was associated with decreased response to potential rewards in the mPFC. Furthermore, concurrent depressive symptoms were associated with increased reward anticipation response in mPFC and striatal regions that were also associated with early adolescent psychosocial stressors, with mPFC and striatal response mediating the association between social stressors and depressive symptoms. These findings are consistent with developmental models that emphasize the adverse impact of early psychosocial stressors on neural reward processing and risk for depression in adolescence.

  5. Learning to Produce Syllabic Speech Sounds via Reward-Modulated Neural Plasticity.

    Anne S Warlaumont

    Full Text Available At around 7 months of age, human infants begin to reliably produce well-formed syllables containing both consonants and vowels, a behavior called canonical babbling. Over subsequent months, the frequency of canonical babbling continues to increase. How the infant's nervous system supports the acquisition of this ability is unknown. Here we present a computational model that combines a spiking neural network, reinforcement-modulated spike-timing-dependent plasticity, and a human-like vocal tract to simulate the acquisition of canonical babbling. Like human infants, the model's frequency of canonical babbling gradually increases. The model is rewarded when it produces a sound that is more auditorily salient than sounds it has previously produced. This is consistent with data from human infants indicating that contingent adult responses shape infant behavior and with data from deaf and tracheostomized infants indicating that hearing, including hearing one's own vocalizations, is critical for canonical babbling development. Reward receipt increases the level of dopamine in the neural network. The neural network contains a reservoir with recurrent connections and two motor neuron groups, one agonist and one antagonist, which control the masseter and orbicularis oris muscles, promoting or inhibiting mouth closure. The model learns to increase the number of salient, syllabic sounds it produces by adjusting the base level of muscle activation and increasing their range of activity. Our results support the possibility that through dopamine-modulated spike-timing-dependent plasticity, the motor cortex learns to harness its natural oscillations in activity in order to produce syllabic sounds. It thus suggests that learning to produce rhythmic mouth movements for speech production may be supported by general cortical learning mechanisms. The model makes several testable predictions and has implications for our understanding not only of how syllabic

  6. At what stage of neural processing does cocaine act to boost pursuit of rewards?

    Giovanni Hernandez

    Full Text Available Dopamine-containing neurons have been implicated in reward and decision making. One element of the supporting evidence is that cocaine, like other drugs that increase dopaminergic neurotransmission, powerfully potentiates reward seeking. We analyze this phenomenon from a novel perspective, introducing a new conceptual framework and new methodology for determining the stage(s of neural processing at which drugs, lesions and physiological manipulations act to influence reward-seeking behavior. Cocaine strongly boosts the proclivity of rats to work for rewarding electrical brain stimulation. We show that the conventional conceptual framework and methods do not distinguish between three conflicting accounts of how the drug produces this effect: increased sensitivity of brain reward circuitry, increased gain, or decreased subjective reward costs. Sensitivity determines the stimulation strength required to produce a reward of a given intensity (a measure analogous to the KM of an enzyme whereas gain determines the maximum intensity attainable (a measure analogous to the vmax of an enzyme-catalyzed reaction. To distinguish sensitivity changes from the other determinants, we measured and modeled reward seeking as a function of both stimulation strength and opportunity cost. The principal effect of cocaine was a two-fourfold increase in willingness to pay for the electrical reward, an effect consistent with increased gain or decreased subjective cost. This finding challenges the long-standing view that cocaine increases the sensitivity of brain reward circuitry. We discuss the implications of the results and the analytic approach for theories of how dopaminergic neurons and other diffuse modulatory brain systems contribute to reward pursuit, and we explore the implications of the conceptual framework for the study of natural rewards, drug reward, and mood.

  7. Rewards.

    Gunderman, Richard B; Kamer, Aaron P

    2011-05-01

    For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today. PMID:21531311

  8. Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder.

    Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

    2016-01-01

    Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants' brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing. PMID:27464551

  9. Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder

    Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

    2016-01-01

    Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants’ brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing. PMID:27464551

  10. The neural dynamics of reward value and risk coding in the human orbitofrontal cortex.

    Li, Yansong; Vanni-Mercier, Giovanna; Isnard, Jean; Mauguière, François; Dreher, Jean-Claude

    2016-04-01

    SEE KRINGELBACH AND RAPUANO DOI101093/BRAIN/AWW049 FOR A SCIENTIFIC COMMENTARY ON THIS ARTICLE: The orbitofrontal cortex is known to carry information regarding expected reward, risk and experienced outcome. Yet, due to inherent limitations in lesion and neuroimaging methods, the neural dynamics of these computations has remained elusive in humans. Here, taking advantage of the high temporal definition of intracranial recordings, we characterize the neurophysiological signatures of the intact orbitofrontal cortex in processing information relevant for risky decisions. Local field potentials were recorded from the intact orbitofrontal cortex of patients suffering from drug-refractory partial epilepsy with implanted depth electrodes as they performed a probabilistic reward learning task that required them to associate visual cues with distinct reward probabilities. We observed three successive signals: (i) around 400 ms after cue presentation, the amplitudes of the local field potentials increased with reward probability; (ii) a risk signal emerged during the late phase of reward anticipation and during the outcome phase; and (iii) an experienced value signal appeared at the time of reward delivery. Both the medial and lateral orbitofrontal cortex encoded risk and reward probability while the lateral orbitofrontal cortex played a dominant role in coding experienced value. The present study provides the first evidence from intracranial recordings that the human orbitofrontal cortex codes reward risk both during late reward anticipation and during the outcome phase at a time scale of milliseconds. Our findings offer insights into the rapid mechanisms underlying the ability to learn structural relationships from the environment. PMID:26811252

  11. Choice modulates the neural dynamics of prediction error processing during rewarded learning

    David A. Peterson; Lotz, Daniel T.; Halgren, Eric; Sejnowski, Terrence J.; Poizner, Howard

    2010-01-01

    Our ability to selectively engage with our environment enables us to guide our learning and to take advantage of its benefits. When facing multiple possible actions, our choices are a critical aspect of learning. In the case of learning from rewarding feedback, there has been substantial theoretical and empirical progress in elucidating the associated behavioral and neural processes, predominantly in terms of a reward prediction error, a measure of the discrepancy between actual versus expect...

  12. Cannabinoid conditioned reward and aversion: behavioral and neural processes.

    Murray, Jennifer E; Bevins, Rick A

    2010-03-10

    The discovery that delta-9-tetrahydrocannabinol (Δ(9)-THC) is the primary psychoactive ingredient in marijuana prompted research that helped elucidate the endogenous cannabinoid system of the brain. Δ(9)-THC and other cannabinoid ligands with agonist action (CP 55,940, HU210, and WIN 55,212-2) increase firing of dopamine neurons and increase synaptic dopamine in brain regions associated with reward and drug addiction. Such changes in cellular processes have prompted investigators to examine the conditioned rewarding effects of the cannabinoid ligands using the place conditioning task with rats and mice. As reviewed here, these cannabinoid ligands can condition place preferences (evidence for rewarding effects) and place aversions (evidence for aversive qualities). Notably, the procedural details used in these place conditioning studies have varied across laboratories. Such variation includes differences in apparatus type, existence of procedural biases, dose, number of conditioning trials, injection-to-placement intervals, and pre-training drug exposure. Some differences in outcome across studies can be explained by these procedural variables. For example, low doses of Δ(9)-THC appear to have conditioned rewarding effects, whereas higher doses have aversive effects that either mask these rewarding effects or condition a place aversion. Throughout this review we highlight key areas that need further research. PMID:20495676

  13. Reward expectation differentially modulates attentional behavior and activity in visual area V4.

    Baruni, Jalal K; Lau, Brian; Salzman, C Daniel

    2015-11-01

    Neural activity in visual area V4 is enhanced when attention is directed into neuronal receptive fields. However, the source of this enhancement is unclear, as most physiological studies have manipulated attention by changing the absolute reward associated with a particular location as well as its value relative to other locations. We trained monkeys to discriminate the orientation of two stimuli presented simultaneously in different hemifields while we independently varied the reward magnitude associated with correct discrimination at each location. Behavioral measures of attention were controlled by the relative value of each location. By contrast, neurons in V4 were consistently modulated by absolute reward value, exhibiting increased activity, increased gamma-band power and decreased trial-to-trial variability whenever receptive field locations were associated with large rewards. These data challenge the notion that the perceptual benefits of spatial attention rely on increased signal-to-noise in V4. Instead, these benefits likely derive from downstream selection mechanisms. PMID:26479590

  14. A neural model of the frontal eye fields with reward-based learning.

    Ye, Weijie; Liu, Shenquan; Liu, Xuanliang; Yu, Yuguo

    2016-09-01

    Decision-making is a flexible process dependent on the accumulation of various kinds of information; however, the corresponding neural mechanisms are far from clear. We extended a layered model of the frontal eye field to a learning-based model, using computational simulations to explain the cognitive process of choice tasks. The core of this extended model has three aspects: direction-preferred populations that cluster together the neurons with the same orientation preference, rule modules that control different rule-dependent activities, and reward-based synaptic plasticity that modulates connections to flexibly change the decision according to task demands. After repeated attempts in a number of trials, the network successfully simulated three decision choice tasks: an anti-saccade task, a no-go task, and an associative task. We found that synaptic plasticity could modulate the competition of choices by suppressing erroneous choices while enhancing the correct (rewarding) choice. In addition, the trained model captured some properties exhibited in animal and human experiments, such as the latency of the reaction time distribution of anti-saccades, the stop signal mechanism for canceling a reflexive saccade, and the variation of latency to half-max selectivity. Furthermore, the trained model was capable of reproducing the re-learning procedures when switching tasks and reversing the cue-saccade association. PMID:27284696

  15. Implicit trustworthiness ratings of self-resembling faces activate brain centers involved in reward.

    Platek, Steven M; Krill, Austen L; Wilson, Benjamin

    2009-01-01

    On the basis of Hamilton's (Hamilton, W. D. (1964). The genetical evolution of social behavior I, II. Journal of Theoretical Biology, 7, 17-52) theory of inclusive fitness, self-facial resemblance is hypothesized as a mechanism for self-referent phenotypic matching by which humans can detect kin. To understand the mechanisms underlying pro-sociality toward self-resembling faces, we investigated the neural correlates of implicit trustworthiness ratings for self-resembling faces. Here we show that idiosyncratic trustworthiness ratings of self-resembling faces predict brain activation in the ventral inferior, middle and medial frontal gyri, substrates involved in reward processing. These findings demonstrate that neural reward centers are implicated in evaluating implicit pro-social behaviors toward self-resembling faces. These findings suggest that humans have evolved to use neurocomputational architecture dedicated to face processing and reward evaluation for the differentiation of kin, which drives implicit idiosyncratic affectively regulated social interactions. PMID:18761362

  16. Perceiving active listening activates the reward system and improves the impression of relevant experiences.

    Kawamichi, Hiroaki; Yoshihara, Kazufumi; Sasaki, Akihiro T; Sugawara, Sho K; Tanabe, Hiroki C; Shinohara, Ryoji; Sugisawa, Yuka; Tokutake, Kentaro; Mochizuki, Yukiko; Anme, Tokie; Sadato, Norihiro

    2015-01-01

    Although active listening is an influential behavior, which can affect the social responses of others, the neural correlates underlying its perception have remained unclear. Sensing active listening in social interactions is accompanied by an improvement in the recollected impressions of relevant experiences and is thought to arouse positive feelings. We therefore hypothesized that the recognition of active listening activates the reward system, and that the emotional appraisal of experiences that had been subject to active listening would be improved. To test these hypotheses, we conducted functional magnetic resonance imaging (fMRI) on participants viewing assessments of their own personal experiences made by evaluators with or without active listening attitude. Subjects rated evaluators who showed active listening more positively. Furthermore, they rated episodes more positively when they were evaluated by individuals showing active listening. Neural activation in the ventral striatum was enhanced by perceiving active listening, suggesting that this was processed as rewarding. It also activated the right anterior insula, representing positive emotional reappraisal processes. Furthermore, the mentalizing network was activated when participants were being evaluated, irrespective of active listening behavior. Therefore, perceiving active listening appeared to result in positive emotional appraisal and to invoke mental state attribution to the active listener. PMID:25188354

  17. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Carsten Murawski

    Full Text Available Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  18. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F

    2012-01-01

    Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness. PMID:22479547

  19. Neural correlates of emotion- and reward-driven attentional capture

    Gupta, Rashmi; Dominguez Borras, Judith; Vuilleumier, Patrik

    2014-01-01

    In recent years, affective neuroscience has emerged as an important discipline to study the brain mechanisms of affect and emotion by employing various methods, ranging from neuroimaging and neurobiology through to drug and lesion studies (Davidson et al., 2003; Deak, 2011; Kringelbach, 2005, Kringelbach & Berridge 2008; LeDoux & Phelps 2000; Leknes & Tracey 2008). Ample research has demonstrated that emotionally significant and rewarding information often produces strong effects on other pro...

  20. Altered brain activity during reward anticipation in pathological gambling and obsessive-compulsive disorder.

    Jung-Seok Choi

    Full Text Available BACKGROUND: Pathological gambling (PG and obsessive-compulsive disorder (OCD are conceptualized as a behavioral addiction, with a dependency on repetitive gambling behavior and rewarding effects following compulsive behavior, respectively. However, no neuroimaging studies to date have examined reward circuitry during the anticipation phase of reward in PG compared with in OCD while considering repetitive gambling and compulsion as addictive behaviors. METHODS/PRINCIPAL FINDINGS: To elucidate the neural activities specific to the anticipation phase of reward, we performed event-related functional magnetic resonance imaging (fMRI in young adults with PG and compared them with those in patients with OCD and healthy controls. Fifteen male patients with PG, 13 patients with OCD, and 15 healthy controls, group-matched for age, gender, and IQ, participated in a monetary incentive delay task during fMRI scanning. Neural activation in the ventromedial caudate nucleus during anticipation of both gain and loss decreased in patients with PG compared with that in patients with OCD and healthy controls. Additionally, reduced activation in the anterior insula during anticipation of loss was observed in patients with PG compared with that in patients with OCD which was intermediate between that in OCD and healthy controls (healthy controls < PG < OCD, and a significant positive correlation between activity in the anterior insula and South Oaks Gambling Screen score was found in patients with PG. CONCLUSIONS: Decreased neural activity in the ventromedial caudate nucleus during anticipation may be a specific neurobiological feature for the pathophysiology of PG, distinguishing it from OCD and healthy controls. Correlation of anterior insular activity during loss anticipation with PG symptoms suggests that patients with PG fit the features of OCD associated with harm avoidance as PG symptoms deteriorate. Our findings have identified functional disparities and

  1. Reward System Dysfunction as a Neural Substrate of Symptom Expression Across the General Population and Patients With Schizophrenia.

    Simon, Joe J; Cordeiro, Sheila A; Weber, Marc-André; Friederich, Hans-Christoph; Wolf, Robert C; Weisbrod, Matthias; Kaiser, Stefan

    2015-11-01

    Dysfunctional patterns of activation in brain reward networks have been suggested as a core element in the pathophysiology of schizophrenia. However, it remains unclear whether this dysfunction is specific to schizophrenia or can be continuously observed across persons with different levels of nonclinical and clinical symptom expression. Therefore, we sought to investigate whether the pattern of reward system dysfunction is consistent with a dimensional or categorical model of psychosis-like symptom expression. 23 patients with schizophrenia and 37 healthy control participants with varying levels of psychosis-like symptoms, separated into 3 groups of low, medium, and high symptom expression underwent event-related functional magnetic resonance imaging while performing a Cued Reinforcement Reaction Time task. We observed lower activation in the ventral striatum during the expectation of high vs no reward to be associated with higher symptom expression across all participants. No significant difference between patients with schizophrenia and healthy participants with high symptom expression was found. However, connectivity between the ventral striatum and the medial orbitofrontal cortex was specifically reduced in patients with schizophrenia. Dysfunctional local activation of the ventral striatum depends less on diagnostic category than on the degree of symptom expression, therefore showing a pattern consistent with a psychosis continuum. In contrast, aberrant connectivity in the reward system is specific to patients with schizophrenia, thereby supporting a categorical view. Thus, the results of the present study provide evidence for both continuous and discontinuous neural substrates of symptom expression across patients with schizophrenia and the general population. PMID:26006262

  2. Dopamine, reward learning, and active inference

    Thomas Fitzgerald; Ray Dolan

    2015-01-01

    Temporal difference learning models propose phasic dopamine signalling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of b...

  3. BRAIN REWARD ACTIVITY TO MASKED IN-GROUP SMILING FACES PREDICTS FRIENDSHIP DEVELOPMENT

    Chen, Pin-Hao A.; Whalen, Paul J.; Freeman, Jonathan B.; Taylor, James M.; Heatherton, Todd F.

    2015-01-01

    This study examined whether neural responses in the ventral striatum (VS) to in-group facial expressions—presented without explicit awareness—could predict friendship patterns in newly arrived individuals from China six months later. Individuals who initially showed greater VS activity in response to in-group happy expressions during functional neuroimaging later made considerably more in-group friends, suggesting that VS activity might reflect reward processes that drive in-group approach behaviors. PMID:26185595

  4. Common and distinct neural features of social and non-social reward processing in autism and social anxiety disorder

    Richey, John A.; Rittenberg, Alison; Hughes, Lauren; Damiano, Cara R.; Sabatino, Antoinette; Miller, Stephanie; Hanna, Eleanor; Bodfish, James W.; Dichter, Gabriel S.

    2013-01-01

    Autism spectrum disorders (ASDs) and social anxiety disorder (SAD) are both characterized by social dysfunction, but no study to date has compared neural responses to social rewards in ASDs and SAD. Neural responses during social and non-social reward anticipation and outcomes were examined in individuals with ASD (n = 16), SAD (n = 15) and a control group (n = 19) via functional magnetic resonance imaging. Analyses modeling all three groups revealed increased nucleus accumbens (NAc) activati...

  5. Self-Affirmation Activates the Ventral Striatum: A Possible Reward-Related Mechanism for Self-Affirmation.

    Dutcher, Janine M; Creswell, J David; Pacilio, Laura E; Harris, Peter R; Klein, William M P; Levine, John M; Bower, Julienne E; Muscatell, Keely A; Eisenberger, Naomi I

    2016-04-01

    Self-affirmation (reflecting on important personal values) has been shown to have a range of positive effects; however, the neural basis of self-affirmation is not known. Building on studies showing that thinking about self-preferences activates neural reward pathways, we hypothesized that self-affirmation would activate brain reward circuitry during functional MRI (fMRI) studies. In Study 1, with college students, making judgments about important personal values during self-affirmation activated neural reward regions (i.e., ventral striatum), whereas making preference judgments that were not self-relevant did not. Study 2 replicated these results in a community sample, again showing that self-affirmation activated the ventral striatum. These are among the first fMRI studies to identify neural processes during self-affirmation. The findings extend theory by showing that self-affirmation may be rewarding and may provide a first step toward identifying a neural mechanism by which self-affirmation may produce a wide range of beneficial effects. PMID:26917214

  6. Subjective sensitivity to monetary gradients is associated with frontolimbic activation to reward in cocaine abusers

    Goldstein, Rita Z.; Tomasi, Dardo; Alia-Klein, Nelly; Cottone, Lisa A.; Zhang, Lei; Telang, Frank; Volkow, Nora D.

    2006-01-01

    Drug addiction is characterized by marked disruptions in the ability to process reward. Here we evaluated in cocaine addicted and healthy control participants the subjective sensitivity to reward gradients and its association with neural responses to sustained reward. A self-report questionnaire was used to assess the former. A functional magnetic resonance imaging task that utilized monetary reward as feedback in a blocked design was used to assess the latter. Results revealed that whereas c...

  7. Stimulus-Dependent Adjustment of Reward Prediction Error in the Midbrain

    Takemura, Hiromasa; Samejima, Kazuyuki; Vogels, Rufin; Sakagami, Masamichi; Okuda, Jiro

    2011-01-01

    Previous reports have described that neural activities in midbrain dopamine areas are sensitive to unexpected reward delivery and omission. These activities are correlated with reward prediction error in reinforcement learning models, the difference between predicted reward values and the obtained reward outcome. These findings suggest that the reward prediction error signal in the brain updates reward prediction through stimulus–reward experiences. It remains unknown, however, how sensory pr...

  8. Natural and Drug Rewards Act on Common Neural Plasticity Mechanisms with ΔFosB as a Key Mediator

    Pitchers, Kyle K.; Vialou, Vincent; Nestler, Eric J.; Laviolette, Steven R; Lehman, Michael N.; Coolen, Lique M.

    2013-01-01

    Drugs of abuse induce neuroplasticity in the natural reward pathway, specifically the nucleus accumbens (NAc), thereby causing development and expression of addictive behavior. Recent evidence suggests that natural rewards may cause similar changes in the NAc, suggesting that drugs may activate mechanisms of plasticity shared with natural rewards, and allowing for unique interplay between natural and drug rewards. In this study, we demonstrate that sexual experience in male rats when followed...

  9. Increased Neural Responses to Reward in Adolescents and Young Adults With Attention-Deficit/Hyperactivity Disorder and Their Unaffected Siblings

    von Rhein, Daniel; Cools, Roshan; Zwiers, Marcel P.; van der Schaaf, Marieke; Franke, Barbara; Luman, Marjolein; Oosterlaan, Jaap; Heslenfeld, Dirk J.; Hoekstra, Pieter J.; Hartman, Catharina A.; Faraone, Stephen V.; van Rooij, Daan; van Dongen, Eelco V.; Lojowska, Maria; Mennes, Maarten; Buitelaar, Jan

    2015-01-01

    Objective Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is unknown whether reward processing is abnormal in unaffected siblings of participants with ADHD. Method We used event-related functional magnetic resonance imaging (fMRI) to investigate brain responses during reward anticipation and receipt with an adapted monetary incentive delay task in a large sample of adolescents and young adults with ADHD (n=150), their unaffected siblings (n=92), and control participants (n=108), all of the same age. Results Participants with ADHD showed, relative to control participants, increased responses in the anterior cingulate, anterior frontal cortex, and cerebellum during reward anticipation, and in the orbitofrontal, occipital cortex, and ventral striatum during reward receipt. Responses of unaffected siblings were increased in these regions as well, except for the cerebellum during anticipation and the orbitofrontal cortex during receipt. Conclusion ADHD in adolescents and young adults is associated with enhanced neural responses in frontostriatal circuitry to anticipation and receipt of reward. The findings support models emphasizing aberrant reward processing in ADHD and suggest that processing of reward is subject to familial influences. Future studies using standard monetary incentive delay task parameters have to replicate our findings. PMID:25901776

  10. Activation of the reward system boosts innate and adaptive immunity.

    Ben-Shaanan, Tamar L; Azulay-Debby, Hilla; Dubovik, Tania; Starosvetsky, Elina; Korin, Ben; Schiller, Maya; Green, Nathaniel L; Admon, Yasmin; Hakim, Fahed; Shen-Orr, Shai S; Rolls, Asya

    2016-08-01

    Positive expectations contribute to the clinical benefits of the placebo effect. Such positive expectations are mediated by the brain's reward system; however, it remains unknown whether and how reward system activation affects the body's physiology and, specifically, immunity. Here we show that activation of the ventral tegmental area (VTA), a key component of the reward system, strengthens immunological host defense. We used 'designer receptors exclusively activated by designer drugs' (DREADDs) to directly activate dopaminergic neurons in the mouse VTA and characterized the subsequent immune response after exposure to bacteria (Escherichia coli), using time-of-flight mass cytometry (CyTOF) and functional assays. We found an increase in innate and adaptive immune responses that were manifested by enhanced antibacterial activity of monocytes and macrophages, reduced in vivo bacterial load and a heightened T cell response in the mouse model of delayed-type hypersensitivity. By chemically ablating the sympathetic nervous system (SNS), we showed that the reward system's effects on immunity are, at least partly, mediated by the SNS. Thus, our findings establish a causal relationship between the activity of the VTA and the immune response to bacterial infection. PMID:27376577

  11. Egalitarian reward contingency in competitive games and primate prefrontal neuronal activity.

    Hosokawa, Takayuki; Watanabe, Masataka

    2015-01-01

    How people work to obtain a reward depends on the context of the reward delivery, such as the presence/absence of competition and the contingency of reward delivery. Since resources are limited, winning a competition is critically important for organisms' obtaining a reward. People usually expect ordinary performance-reward contingency, with better performers obtaining better rewards. Unordinary reward contingency, such as egalitarianism (equal rewards/no-rewards to both good and poor performers), dampens people's motivation. We previously reported that monkeys were more motivated, and neurons in the lateral prefrontal cortex (LPFC) showed higher outcome-related activity in a competitive than in a noncompetitive game (Hosokawa and Watanabe, 2012). However, monkey's behavior and LPFC neuronal activity have not been examined in a competitive situation with an unordinary performance-reward contingency. Also, the fixed performance-reward contingency in the previous study did not allow us to examine effects of win/loss separately from those of reward/no-reward on prefrontal neuronal activity. Here, we employed the egalitarian competitive situation in which both the winner and loser, or neither of them, got a reward as well as the normal competitive situation in which only the winner got a reward. Monkey's behavioral performance greatly deteriorated in trials with the egalitarian outcome conditions. LPFC neurons showed activities that reflected the normal or egalitarian outcome condition while very few neurons coded win/loss independent of reward/no-reward. Importantly, we found neurons that showed reward-related activity in the normal, but not in the egalitarian outcome conditions, even though the same reward was given to the animal. These results indicate that LPFC may play an important role in monitoring the current reward contingency and integrating it with the performance outcome (win-loss) for better performing the competitive game, and thus for better survival

  12. Multivariate Neural Representations of Value during Reward Anticipation and Consummation in the Human Orbitofrontal Cortex.

    Yan, Chao; Su, Li; Wang, Yi; Xu, Ting; Yin, Da-Zhi; Fan, Ming-Xia; Deng, Ci-Ping; Hu, Yang; Wang, Zhao-Xin; Cheung, Eric F C; Lim, Kelvin O; Chan, Raymond C K

    2016-01-01

    The role of the orbitofrontal cortex (OFC) in value processing is a focus of research. Conventional imaging analysis, where smoothing and averaging are employed, may not be sufficiently sensitive in studying the OFC, which has heterogeneous anatomical structures and functions. In this study, we employed representational similarity analysis (RSA) to reveal the multi-voxel fMRI patterns in the OFC associated with value processing during the anticipatory and the consummatory phases. We found that multi-voxel activation patterns in the OFC encoded magnitude and partial valence information (win vs. loss) but not outcome (favourable vs. unfavourable) during reward consummation. Furthermore, the lateral OFC rather than the medial OFC encoded loss information. Also, we found that OFC encoded values in a similar way to the ventral striatum (VS) or the anterior insula (AI) during reward anticipation regardless of motivated response and to the medial prefrontal cortex (MPFC) and the VS in reward consummation. In contrast, univariate analysis did not show changes of activation in the OFC. These findings suggest an important role of the OFC in value processing during reward anticipation and consummation. PMID:27378417

  13. Converging effects of cocaine addiction and sex on neural responses to monetary rewards.

    Konova, Anna B; Moeller, Scott J; Parvaz, Muhammad A; Froböse, Monja I; Alia-Klein, Nelly; Goldstein, Rita Z

    2016-02-28

    There is some evidence that cocaine addiction manifests as more severe in women than men. Here, we examined whether these sex-specific differences in the clinical setting parallel differential neurobehavioral sensitivity to rewards in the laboratory setting. Twenty-eight (14 females/14 males) cocaine-dependent and 25 (11 females/14 males) healthy individuals completed a monetary reward task during fMRI. Results showed that the effects of cocaine dependence and sex overlapped in regions traditionally considered part of the mesocorticolimbic brain circuits including the hippocampus and posterior cingulate cortex (PCC), as well as those outside of this circuit (e.g., the middle temporal gyrus). The nature of this 'overlap' was such that both illness and female sex were associated with lower activations in these regions in response to money. Diagnosis-by-sex interactions instead emerged in the frontal cortex, such that cocaine-dependent females exhibited lower precentral gyrus and greater inferior frontal gyrus (IFG) activations relative to cocaine-dependent males and healthy females. Within these regions modulated both by diagnosis and sex, lower activation in the hippocampus and PCC, and higher IFG activations, correlated with increased subjective craving during the task. Results suggest sex-specific differences in addiction extend to monetary rewards and may contribute to core symptoms linked to relapse. PMID:26809268

  14. The Neural Correlates of Expectancy Deviation and Punishment and Reward:An EPR Study%预期背离下奖励与惩罚的ERPs研究

    刘耀中; 唐志文; 叶海英

    2012-01-01

    Reward and punishment play an important role in the study of human cooperation today.In our daily lives,it often happens that a person deserves being rewarded but the reward does not come,or he deserves being punished but the punishment does not come, either.Previous studies did not discuss much about the situation in which a person makes the right response but does not receive the reward he deserves,or the wrong response but does not receive the punishment.In this study,we try to explore how individuals' brain will respond to both of the two conditions we mentioned above using the Flanker experimental paradigm and ERP(Event - related potential) technology in order to find out what the neural processing mechanisms are for those rewards and punishments,as well as their FRN effects.We also try to analyze the relationship between the individuals neural mechanism and the Reinforcement Sensitivity Theory using the behavioral inhibition system(BIS) / behavioral approach system(BAS) analytical methods to reveal the psychological processing mechanism of punishment and reward. Here,we selected 15 candidates and conducted a 2- stimulus type(reward vs.punishment)×2 expectation deviated(Yes vs. No) experiment.All the 15 candidates were induced to accept all of the four experimental treatments.The results showed that(1) the individual's expectation that was deviated caused higher FRN;(2) when the individual was punished,a higher FRN appeared,and when he was rewarded,a higher P3 appeared;(3) there was no significant relationship between FRN and individuals sensitivity of being punished or failing to be rewarded.All those results above indicate;(1) if a person does not receive the reward he deserves,the effect caused will be the same as being punished and the correlation between BIS and FRN is confirmed.Individuals will experience a negative emotion.So we suggest that such condition may be adjusted by the punishment system;(2) when the expected punishment does not appear

  15. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards

    Roesch, Matthew R; Calu, Donna J.; Schoenbaum, Geoffrey

    2007-01-01

    The dopamine system is thought to be involved in making decisions about reward. Here we recorded from the ventral tegmental area in rats learning to choose between differently delayed and sized rewards. As expected, the activity of many putative dopamine neurons reflected reward prediction errors, changing when the value of the reward increased or decreased unexpectedly. During learning, neural responses to reward in these neurons waned and responses to cues that predicted reward emerged. Not...

  16. Dopamine-signalled reward predictions generated by competitive excitation and inhibition in a spiking neural network model

    Paul eChorley

    2011-05-01

    Full Text Available Dopaminergic neurons in the mammalian substantia nigra displaycharacteristic phasic responses to stimuli which reliably predict thereceipt of primary rewards. These responses have been suggested toencode reward prediction-errors similar to those used in reinforcementlearning. Here, we propose a model of dopaminergic activity in whichprediction error signals are generated by the joint action ofshort-latency excitation and long-latency inhibition, in a networkundergoing dopaminergic neuromodulation of both spike-timing dependentsynaptic plasticity and neuronal excitability. In contrast toprevious models, sensitivity to recent events is maintained by theselective modification of specific striatal synapses, efferent tocortical neurons exhibiting stimulus-specific, temporally extendedactivity patterns. Our model shows, in the presence of significantbackground activity, (i a shift in dopaminergic response from rewardto reward predicting stimuli, (ii preservation of a response tounexpected rewards, and (iii a precisely-timed below-baseline dip inactivity observed when expected rewards are omitted.

  17. Prediction-error in the context of real social relationships modulates reward system activity

    Joshua ePoore; Jennifer ePfeifer; Elliot eBerkman; Tristen eInagaki; Benjamin Locke Welborn; Matthew eLieberman

    2012-01-01

    The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to...

  18. Social reward improves the voluntary control over localized brain activity in fMRI-based neurofeedback training

    Krystyna Anna Mathiak

    2015-06-01

    Full Text Available Neurofeedback (NF based on real-time functional magnetic resonance imaging (rt-fMRI allows voluntary regulation of the activity in a selected brain region. For the training of this regulation, a well-designed feedback system is required. Social reward may serve as an effective incentive in NF paradigms, but its efficiency has not yet been tested. Therefore, we developed a social reward NF paradigm and assessed it in comparison with a typical visual NF paradigm (moving bar. We trained 24 healthy participants, on three consecutive days, to control activation in dorsal anterior cingulate cortex (ACC with fMRI-based NF. In the social feedback group, an avatar gradually smiled when ACC activity increased, whereas in the standard feedback group, a moving bar indicated the activation level. To assess a transfer of the NF training both groups were asked to up-regulate their brain activity without receiving feedback immediately before and after the NF training (pre- and post-test. Finally, the effect of the acquired NF training on ACC function was evaluated in a cognitive interference task (Simon task during the pre- and post-test. Social reward led to stronger activity in the ACC and reward-related areas during the NF training when compared to standard feedback. After the training, both groups were able to regulate ACC without receiving feedback, with a trend for stronger responses in the social feedback group. Moreover, despite a lack of behavioral differences, significant higher ACC activations emerged in the cognitive interference task, reflecting a stronger generalization of the NF training on cognitive interference processing after social feedback. Social reward can increase self-regulation in fMRI-based NF and strengthen its effects on neural processing in related tasks, such as cognitive interference. An advantage of social feedback is that a direct external reward is provided as in natural social interactions, opening perspectives for implicit

  19. Application of fMRI to obesity research: differences in reward pathway activation measured with fMRI BOLD during visual presentation of high and low calorie foods

    Tsao, Sinchai; Adam, Tanja C.; Goran, Michael I.; Singh, Manbir

    2012-03-01

    The factors behind the neural mechanisms that motivate food choice and obesity are not well known. Furthermore, it is not known when these neural mechanisms develop and how they are influenced by both genetic and environmental factors. This study uses fMRI together with clinical data to shed light on the aforementioned questions by investigating how appetite-related activation in the brain changes with low versus high caloric foods in pre-pubescent girls. Previous studies have shown that obese adults have less striatal D2 receptors and thus reduced Dopamine (DA) signaling leading to the reward-deficit theory of obesity. However, overeating in itself reduces D2 receptor density, D2 sensitivity and thus reward sensitivity. The results of this study will show how early these neural mechanisms develop and what effect the drastic endocrinological changes during puberty has on these mechanisms. Our preliminary results showed increased activations in the Putamen, Insula, Thalamus and Hippocampus when looking at activations where High Calorie > Low Calorie. When comparing High Calorie > Control and Low Calorie > Control, the High > Control test showed increased significant activation in the frontal lobe. The Low > Control also yielded significant activation in the Left and Right Fusiform Gyrus, which did not appear in the High > Control test. These results indicate that the reward pathway activations previously shown in post-puberty and adults are present in pre-pubescent teens. These results may suggest that some of the preferential neural mechanisms of reward are already present pre-puberty.

  20. Immediate early gene expression reveals interactions between social and nicotine rewards on brain activity in adolescent male rats.

    Bastle, Ryan M; Peartree, Natalie A; Goenaga, Julianna; Hatch, Kayla N; Henricks, Angela; Scott, Samantha; Hood, Lauren E; Neisewander, Janet L

    2016-10-15

    Smoking initiation predominantly occurs during adolescence, often in the presence of peers. Therefore, understanding the neural mechanisms underlying the rewarding effects of nicotine and social stimuli is vital. Using the conditioned place preference (CPP) procedure, we measured immediate early gene (IEG) expression in animals following exposure either to a reward-conditioned environment or to the unconditioned stimuli (US). Adolescent, male rats were assigned to the following CPP US conditions: (1) Saline+Isolated, (2) Nicotine+Isolated, (3) Saline+Social, or (4) Nicotine+Social. For Experiment 1, brain tissue was collected 90min following the CPP expression test and processed for Fos immunohistochemistry. We found that rats conditioned with nicotine with or without a social partner exhibited CPP; however, we found no group differences in Fos expression in any brain region analyzed, with the exception of the nucleus accumbens core that exhibited a social-induced attenuation in Fos expression. For Experiment 2, brain tissue was collected 90min following US exposure during the last conditioning session. We found social reward-induced increases in IEG expression in striatal and amydalar subregions. In contrast, nicotine reduced IEG expression in prefrontal and striatal subregions. Reward interactions were also found in the dorsolateral striatum, basolateral amygdala, and ventral tegmental area where nicotine alone attenuated IEG expression and social reward reversed this effect. These results suggest that in general social rewards enhance, whereas nicotine attenuates, activation of mesocorticolimbic regions; however, the rewards given together interact to enhance activation in some regions. The findings contribute to knowledge of how a social environment influences nicotine effects. PMID:27435419

  1. Differential patterns of nucleus accumbens activation during anticipation of monetary and social reward in young and older adults

    Rademacher, Lena; Salama, Aallaa; Gründer, Gerhard; Spreckelmeyer, Katja N.

    2013-01-01

    Recent studies have reported inconsistent results regarding the loss of reward sensitivity in the aging brain. Although such an age effect might be due to a decline of physiological processes, it may also be a consequence of age-related changes in motivational preference for different rewards. Here, we examined whether the age effects on neural correlates of reward anticipation are modulated by the type of expected reward. Functional magnetic resonance images were acquired in 24 older (60–78 ...

  2. Changes in reward-induced brain activation in opiate addicts

    Martin-Soelch, C; Chevalley, AF; Kunig, G; Missimer, J; Magyar, S; Mino, A; Schultz, W; Leenders, KL

    2001-01-01

    Many studies indicate a role of the cerebral dopaminergic reward system in addiction. Motivated by these findings, we examined in opiate addicts whether brain regions involved in the reward circuitry also react to human prototypical rewards. We measured regional cerebral blood flow (rCBF) with (H2O)

  3. Neural responses to threat and reward interact to predict stress-related problem drinking: A novel protective role of the amygdala

    Nikolova Yuliya S

    2012-11-01

    Full Text Available Abstract Background Research into neural mechanisms of drug abuse risk has focused on the role of dysfunction in neural circuits for reward. In contrast, few studies have examined the role of dysfunction in neural circuits of threat in mediating drug abuse risk. Although typically regarded as a risk factor for mood and anxiety disorders, threat-related amygdala reactivity may serve as a protective factor against substance use disorders, particularly in individuals with exaggerated responsiveness to reward. Findings We used well-established neuroimaging paradigms to probe threat-related amygdala and reward-related ventral striatum reactivity in a sample of 200 young adult students from the ongoing Duke Neurogenetics Study. Recent life stress and problem drinking were assessed using self-report. We found a significant three-way interaction between threat-related amygdala reactivity, reward-related ventral striatum reactivity, and recent stress, wherein individuals with higher reward-related ventral striatum reactivity exhibit higher levels of problem drinking in the context of stress, but only if they also have lower threat-related amygdala reactivity. This three-way interaction predicted both contemporaneous problem drinking and problem drinking reported three-months later in a subset of participants. Conclusions These findings suggest complex interactions between stress and neural responsiveness to both threat and reward mediate problem drinking. Furthermore, they highlight a novel protective role for threat-related amygdala reactivity against drug use in individuals with high neural reactivity to reward.

  4. Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

    Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

    2015-12-10

    Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. PMID:26499261

  5. Reward system dysfunction in autism spectrum disorders

    Kohls, Gregor; Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

    2012-01-01

    Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in r...

  6. Reward prediction-related increases and decreases in tonic neuronal activity of the pedunculopontine tegmental nucleus

    Ken-Ichi Okada

    2013-05-01

    Full Text Available The neuromodulators serotonin, acetylcholine, and dopamine have been proposed to play important roles in the execution of movement, control of several forms of attentional behavior, and reinforcement learning. While the response pattern of midbrain dopaminergic neurons and its specific role in reinforcement learning have been revealed, the roles of the other neuromodulators remain elusive. Reportedly, neurons in the dorsal raphe nucleus, one major source of serotonin, continually track the state of expectation of future rewards by showing a correlated response to the start of a behavioral task, reward cue presentation, and reward delivery. Here, we show that neurons in the pedunculopontine tegmental nucleus (PPTN, one major source of acetylcholine, showed similar encoding of the expectation of future rewards by a systematic increase or decrease in tonic activity. We recorded and analyzed PPTN neuronal activity in monkeys during a reward conditioned visually guided saccade task. The firing patterns of many PPTN neurons were tonically increased or decreased throughout the task period. The tonic activity pattern of neurons was correlated with their encoding of the predicted reward value; neurons exhibiting an increase or decrease in tonic activity showed higher or lower activity in the large reward-predicted trials, respectively. Tonic activity and reward-related modulation ended around the time of reward delivery. Additionally, some tonic changes in activity started prior to the appearance of the initial stimulus, and were related to the anticipatory fixational behavior. A partially overlapping population of neurons showed both the initial anticipatory response and subsequent predicted reward value-dependent activity modulation by their systematic increase or decrease of tonic activity. These bi-directional reward- and anticipatory behavior-related modulation patterns are suitable for the presumed role of the PPTN in reward processing and

  7. Dopamine Modulates Reward System Activity During Subconscious Processing of Sexual Stimuli

    Oei, Nicole Y. L.; Rombouts, Serge ARB; Soeter, Roelof P.; van Gerven, Joop M; Both, Stephanie

    2012-01-01

    Dopaminergic medication influences conscious processing of rewarding stimuli, and is associated with impulsive–compulsive behaviors, such as hypersexuality. Previous studies have shown that subconscious subliminal presentation of sexual stimuli activates brain areas known to be part of the ‘reward system'. In this study, it was hypothesized that dopamine modulates activation in key areas of the reward system, such as the nucleus accumbens, during subconscious processing of sexual stimuli. You...

  8. Shared neural basis of social and non-social reward deficits in chronic cocaine users

    Tobler, Philippe N; Preller, Katrin H; Campbell-Meiklejohn, Daniel K;

    2016-01-01

    -social reinforcements. We used functional neuroimaging in cocaine users to investigate explicit social reward as modeled by agreement of music preferences with music experts. In addition, we investigated non-social reward as modeled by winning desired music pieces. The study included 17 chronic cocaine users and 17...... the processing of non-drug rewards. Interestingly, in the posterior lateral orbitofrontal cortex, social reward responses of cocaine users decreased with the degree to which they were influenced by social feedback from the experts, a response pattern that was opposite to that observed in healthy...

  9. Activation of the central serotonergic system in response to delayed but not omitted rewards

    Miyazaki, Kayoko W.; Miyazaki, Katsuhiko; Doya, Kenji

    2011-01-01

    The forebrain serotonergic system is a crucial component in the control of impulsive behaviours. However, there is no direct evidence for natural serotonin activity during behaviours for delayed rewards as opposed to immediate rewards. Herein we show that serotonin efflux is enhanced while rats perform a task that requires waiting for a delayed reward. We simultaneously measured the levels of serotonin and dopamine in the dorsal raphe nucleus using in vivo microdialysis. Rats performed a sequ...

  10. Reward processing in anorexia nervosa.

    Keating, Charlotte; Tilbrook, Alan J; Rossell, Susan L; Enticott, Peter G; Fitzgerald, Paul B

    2012-04-01

    Individuals with anorexia nervosa (AN) demonstrate a relentless engagement in behaviors aimed to reduce their weight, which leads to severe underweight status, and occasionally death. Neurobiological abnormalities, as a consequence of starvation are controversial: evidence, however, demonstrates abnormalities in the reward system of patients, and recovered individuals. Despite this, a unifying explanation for reward abnormalities observed in AN and their relevance to symptoms of the illness, remains incompletely understood. Theories explaining reward dysfunction have conventionally focused on anhedonia, describing that patients have an impaired ability to experience reward or pleasure. We review taste reward literature and propose that patients' reduced responses to conventional taste-reward tasks may reflect a fear of weight gain associated with the caloric nature of the tasks, rather than an impaired ability to experience reward. Consistent with this, we propose that patients are capable of 'liking' hedonic taste stimuli (e.g., identifying them), however, they do not 'want' or feel motivated for the stimuli in the same way that healthy controls report. Recent brain imaging data on more complex reward processing tasks provide insights into fronto-striatal neural circuit dysfunction related to altered reward processing in AN that challenges the relevance of anhedonia in explaining reward dysfunction in AN. In this way, altered activity of the anterior cingulate cortex and striatum could explain patients' pathological engagement in behaviors they consider rewarding (e.g., self-starvation) that are otherwise aversive or punishing, to those without the eating disorder. Such evidence for altered patterns of brain activity associated with reward processing tasks in patients and recovered individuals may provide important information about mechanisms underlying symptoms of AN, their future investigation, and the development of treatment approaches. PMID:22349445

  11. Abnormal Brain Activity in Social Reward Learning in Children with Autism Spectrum Disorder: An fMRI Study

    Choi, Uk-Su; Kim, Sun-Young; Sim, Hyeon Jeong; Lee, Seo-Young; Park, Sung-Yeon; Jeong, Joon-Sup; Seol, Kyeong In; Yoon, Hyo-Woon; Jhung, Kyungun; Park, Jee-In; Cheon, Keun-Ah

    2015-01-01

    Purpose We aimed to determine whether Autism Spectrum Disorder (ASD) would show neural abnormality of the social reward system using functional MRI (fMRI). Materials and Methods 27 ASDs and 12 typically developing controls (TDCs) participated in this study. The social reward task was developed, and all participants performed the task during fMRI scanning. Results ASDs and TDCs with a social reward learning effect were selected on the basis of behavior data. We found significant differences in...

  12. Menstrual cycle phase modulates reward-related neural function in women

    Dreher, Jean-Claude; Schmidt, Peter J.; Kohn, Philip; Furman, Daniella; Rubinow, David; Berman, Karen Faith

    2007-01-01

    There is considerable evidence from animal studies that the mesolimbic and mesocortical dopamine systems are sensitive to circulating gonadal steroid hormones. Less is known about the influence of estrogen and progesterone on the human reward system. To investigate this directly, we used functional MRI and an event-related monetary reward paradigm to study women with a repeated-measures, counterbalanced design across the menstrual cycle. Here we show that during the midfollicular phase (days ...

  13. Cognitive flexibility in adolescence: neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development.

    Hauser, Tobias U; Iannaccone, Reto; Walitza, Susanne; Brandeis, Daniel; Brem, Silvia

    2015-01-01

    Adolescence is associated with quickly changing environmental demands which require excellent adaptive skills and high cognitive flexibility. Feedback-guided adaptive learning and cognitive flexibility are driven by reward prediction error (RPE) signals, which indicate the accuracy of expectations and can be estimated using computational models. Despite the importance of cognitive flexibility during adolescence, only little is known about how RPE processing in cognitive flexibility deviates between adolescence and adulthood. In this study, we investigated the developmental aspects of cognitive flexibility by means of computational models and functional magnetic resonance imaging (fMRI). We compared the neural and behavioral correlates of cognitive flexibility in healthy adolescents (12-16years) to adults performing a probabilistic reversal learning task. Using a modified risk-sensitive reinforcement learning model, we found that adolescents learned faster from negative RPEs than adults. The fMRI analysis revealed that within the RPE network, the adolescents had a significantly altered RPE-response in the anterior insula. This effect seemed to be mainly driven by increased responses to negative prediction errors. In summary, our findings indicate that decision making in adolescence goes beyond merely increased reward-seeking behavior and provides a developmental perspective to the behavioral and neural mechanisms underlying cognitive flexibility in the context of reinforcement learning. PMID:25234119

  14. Reward salience and risk aversion underlie differential ACC activity in substance dependence

    William H. Alexander

    2015-01-01

    Full Text Available The medial prefrontal cortex, especially the dorsal anterior cingulate cortex (ACC, has long been implicated in cognitive control and error processing. Although the association between ACC and behavior has been established, it is less clear how ACC contributes to dysfunctional behavior such as substance dependence. Evidence from neuroimaging studies investigating ACC function in substance users is mixed, with some studies showing disengagement of ACC in substance dependent individuals (SDs, while others show increased ACC activity related to substance use. In this study, we investigate ACC function in SDs and healthy individuals performing a change signal task for monetary rewards. Using a priori predictions derived from a recent computational model of ACC, we find that ACC activity differs between SDs and controls in factors related to reward salience and risk aversion between SDs and healthy individuals. Quantitative fits of a computational model to fMRI data reveal significant differences in best fit parameters for reward salience and risk preferences. Specifically, the ACC in SDs shows greater risk aversion, defined as concavity in the utility function, and greater attention to rewards relative to reward omission. Furthermore, across participants risk aversion and reward salience are positively correlated. The results clarify the role that ACC plays in both the reduced sensitivity to omitted rewards and greater reward valuation in SDs. Clinical implications of applying computational modeling in psychiatry are also discussed.

  15. Prediction-error in the context of real social relationships modulates reward system activity

    Joshua ePoore

    2012-08-01

    Full Text Available The human reward system is sensitive to both social (e.g., validation and non-social rewards (e.g., money and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward—social validation—and this activity’s relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants’ expectations for their romantic partners’ positive regard of them were confirmed (validated or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

  16. Associations of reward sensitivity with food consumption, activity pattern, and BMI in children.

    De Decker, Annelies; Sioen, Isabelle; Verbeken, Sandra; Braet, Caroline; Michels, Nathalie; De Henauw, Stefaan

    2016-05-01

    In the current study, the associations of reward sensitivity with weight related behaviors and body mass index were investigated in a general population sample of 443 Flemish children (50.3% boys) aged 5.5-12 years. Cross-sectional data on palatable food consumption frequency, screen time, physical activity, parental education level and measured length and weight were collected. The Drive subscale of the 'Behavioral Inhibition Scale/Behavioral Activation Scale' was used as a short method to measure reward sensitivity. A significant positive association of reward sensitivity with the fast food and sweet drink consumption frequency was found. Furthermore, a significant positive association of reward sensitivity with the z-score of body mass index was demonstrated, which explained additional variance to the variance explained by palatable food consumption frequency, screen time, physical activity and parental education level. Hence, the assessment of reward sensitivity may have an added value to the assessment of weight-related behavior indicators when evaluating the determinants of overweight in a child. In sum, children high in reward sensitivity might be more attracted to fast food and sweet drinks, and hence, might be more vulnerable to develop unfavorable food habits and overweight. These findings suggest that considering inter-individual differences in reward sensitivity is of importance in future childhood obesity prevention campaigns. PMID:26898320

  17. Combining Correlation-Based and Reward-Based Learning in Neural Control for Policy Improvement

    Manoonpong, Poramate; Kolodziejski, Christoph; Wörgötter, Florentin;

    2013-01-01

    associations. Based on these biological findings, we propose a new learning model to achieve successful control policies for artificial systems. This model combines correlation-based learning using input correlation learning (ICO learning) and reward-based learning using continuous actor–critic reinforcement...

  18. Brain areas activated by uncertain reward-based decision-making in healthy volunteers

    Guo, Zongjun; Chen, Juan; Liu, Shien; Li, Yuhuan; Sun, Bo; Gao, Zhenbo

    2013-01-01

    Reward-based decision-making has been found to activate several brain areas, including the ventrolateral prefrontal lobe, orbitofrontal cortex, anterior cingulate cortex, ventral striatum, and mesolimbic dopaminergic system. In this study, we observed brain areas activated under three degrees of uncertainty in a reward-based decision-making task (certain, risky, and ambiguous). The tasks were presented using a brain function audiovisual stimulation system. We conducted brain scans of 15 healt...

  19. Striatal Reward Activity and Antipsychotic-Associated Weight Change in Patients With Schizophrenia Undergoing Initial Treatment

    Nielsen, Mette Ødegaard; Rostrup, Egill; Wulff, Sanne;

    2016-01-01

    associated with an increase in mean (SD) reward activity in the same region during treatment (0.28 [0.74]; F37,1 = 4.48; P = .04). Conclusions and Relevance: Activity in striatal regions of the reward system appears to be associated with the individual variability in the predisposition for antipsychotic......-associated weight gain. Moreover, pharmacologic modulation of the reward system may play a role in antipsychotic-associated weight gain.......Importance: Weight gain is a common and serious adverse effect of antipsychotic treatment. A variable individual predisposition to development of metabolic disturbances calls for predictive biological markers. Objectives: To investigate whether attenuated striatal activity during reward...

  20. Active reward processing during human sleep: insights from sleep-related eating disorder

    Lampros ePerogamvros

    2012-11-01

    Full Text Available In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED, a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity on reward-related questionnaires. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating disorders, our findings suggest a role of an active reward system during sleep in the manifestation of SRED.

  1. Dopamine Depletion Reduces Food-Related Reward Activity Independent of BMI.

    Frank, Sabine; Veit, Ralf; Sauer, Helene; Enck, Paul; Friederich, Hans-Christoph; Unholzer, Theresa; Bauer, Ute-Maria; Linder, Katarzyna; Heni, Martin; Fritsche, Andreas; Preissl, Hubert

    2016-05-01

    Reward sensitivity and possible alterations in the dopaminergic-reward system are associated with obesity. We therefore aimed to investigate the influence of dopamine depletion on food-reward processing. We investigated 34 female subjects in a randomized placebo-controlled, within-subject design (body mass index (BMI)=27.0 kg/m(2) ±4.79 SD; age=28 years ±4.97 SD) using an acute phenylalanine/tyrosine depletion drink representing dopamine depletion and a balanced amino acid drink as the control condition. Brain activity was measured with functional magnetic resonance imaging during a 'wanting' and 'liking' rating of food items. Eating behavior-related traits and states were assessed on the basis of questionnaires. Dopamine depletion resulted in reduced activation in the striatum and higher activation in the superior frontal gyrus independent of BMI. Brain activity during the wanting task activated a more distributed network than during the liking task. This network included gustatory, memory, visual, reward, and frontal regions. An interaction effect of dopamine depletion and the wanting/liking task was observed in the hippocampus. The interaction with the covariate BMI was significant in motor and control regions but not in the striatum. Our results support the notion of altered brain activity in the reward and prefrontal network with blunted dopaminergic action during food-reward processing. This effect is, however, independent of BMI, which contradicts the reward-deficiency hypothesis. This hints to the hypothesis suggesting a different or more complex mechanism underlying the dopaminergic reward function in obesity. PMID:26450814

  2. Neural Correlates of Reward-Based Spatial Learning in Persons with Cocaine Dependence

    Tau, Gregory Z.; Marsh, Rachel; Wang, Zhishun; Torres-Sanchez, Tania; Graniello, Barbara; Hao, Xuejun; Xu, Dongrong; Packard, Mark G.; Duan, Yunsuo; Kangarlu, Alayar; Martinez, Diana; Peterson, Bradley S.

    2013-01-01

    Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary reward...

  3. Neuronal and oscillatory activity during reward processing in the human ventral striatum.

    Lega, Bradley C; Kahana, Michael J; Jaggi, Jurg; Baltuch, Gordon H; Zaghloul, Kareem

    2011-11-16

    Accumulated evidence from animal studies implicates the ventral striatum in the processing of reward information. Recently, deep brain stimulation (DBS) surgery has enabled researchers to analyze neurophysiological recordings from humans engaged in reward tasks. We present data recorded from the human ventral striatum during deep brain stimulation surgery as a participant played a video game coupled to the receipt of visual reward images. To our knowledge, we identify the first instances of reward-sensitive single unit activity in the human ventral striatum. Local field potential data suggest that alpha oscillations are sensitive to positive feedback, whereas beta oscillations exhibit significantly higher power during unrewarded trials. We report evidence of alpha-gamma cross-frequency coupling that differentiates between positive and negative feedback. PMID:21975313

  4. The Influence of Palatable Diets in Reward System Activation: A Mini Review

    de Macedo, Isabel Cristina; de Freitas, Joice Soares; da Silva Torres, Iraci Lucena

    2016-01-01

    The changes in eating patterns that have occurred in recent decades are an important cause of obesity. Food intake and energy expenditure are controlled by a complex neural system involving the hypothalamic centers and peripheral satiety system (gastrointestinal and pancreatic hormones). Highly palatable and caloric food disrupts appetite regulation; however, palatable foods induce pleasure and reward. The cafeteria diet is such a palatable diet and has been shown consistently to increase body weight and induce hyperplasia in animal obesity models. Moreover, palatable high-fat foods (such as those of the cafeteria diet) can induce addiction-like deficits in brain reward function and are considered to be an important source of motivation that might drive overeating and contribute to the development of obesity. The mechanism of neural adaptation triggered by palatable foods is similar to those that have been reported for nondrug addictions and long-term drug use. Thus, this review attempts to describe the potential mechanisms that might lead to highly palatable diets, such as the cafeteria diet, triggering addiction, or compulsion through the reward system. PMID:27087806

  5. Abnormal Frontostriatal Activity During Unexpected Reward Receipt in Depression and Schizophrenia: Relationship to Anhedonia.

    Segarra, Nuria; Metastasio, Antonio; Ziauddeen, Hisham; Spencer, Jennifer; Reinders, Niels R; Dudas, Robert B; Arrondo, Gonzalo; Robbins, Trevor W; Clark, Luke; Fletcher, Paul C; Murray, Graham K

    2016-07-01

    Alterations in reward processes may underlie motivational and anhedonic symptoms in depression and schizophrenia. However it remains unclear whether these alterations are disorder-specific or shared, and whether they clearly relate to symptom generation or not. We studied brain responses to unexpected rewards during a simulated slot-machine game in 24 patients with depression, 21 patients with schizophrenia, and 21 healthy controls using functional magnetic resonance imaging. We investigated relationships between brain activation, task-related motivation, and questionnaire rated anhedonia. There was reduced activation in the orbitofrontal cortex, ventral striatum, inferior temporal gyrus, and occipital cortex in both depression and schizophrenia in comparison with healthy participants during receipt of unexpected reward. In the medial prefrontal cortex both patient groups showed reduced activation, with activation significantly more abnormal in schizophrenia than depression. Anterior cingulate and medial frontal cortical activation predicted task-related motivation, which in turn predicted anhedonia severity in schizophrenia. Our findings provide evidence for overlapping hypofunction in ventral striatal and orbitofrontal regions in depression and schizophrenia during unexpected reward receipt, and for a relationship between unexpected reward processing in the medial prefrontal cortex and the generation of motivational states. PMID:26708106

  6. Compassionate attitude towards others' suffering activates the mesolimbic neural system.

    Kim, Ji-Woong; Kim, Sung-Eun; Kim, Jae-Jin; Jeong, Bumseok; Park, Chang-Hyun; Son, Ae Ree; Song, Ji Eun; Ki, Seon Wan

    2009-08-01

    Compassion is one of the essential components which enable individuals to enter into and maintain relationships of caring. Compassion tends to motivate us to help people who are emotionally suffering. It is also known that a feeling of intrinsic reward may occur as a result of experiencing compassion for others. We conducted this study to understand the neural nature of compassion for other people's emotional state. Twenty-one healthy normal volunteers participated in this study. We used a 2 x 2 factorial design in which each subject was asked to assume a compassionate attitude or passive attitude while viewing the sad or neutral facial affective pictures during functional magnetic imaging. The main effect of a compassionate attitude was observed in the medial frontal cortex, the subgenual frontal cortex, the inferior frontal cortex and the midbrain regions. A test of the interaction between a compassionate attitude and sad facial affect revealed significant activations in the midbrain-ventral striatum/septal network region. The results of this study suggest that taking a compassionate attitude towards other people's sad expressions modulate the activities of the midbrain-ventral striatum/septal region network, which is known to play a role in the prosocial/social approach motivation and its accompanied rewarding feeling. PMID:19428038

  7. Trait impulsivity is related to ventral ACC and amygdala activity during primary reward anticipation.

    Kerr, Kara L; Avery, Jason A; Barcalow, Joel C; Moseman, Scott E; Bodurka, Jerzy; Bellgowan, Patrick S F; Simmons, W Kyle

    2015-01-01

    Trait impulsivity is characterized by behavioral disinhibition and rash decision-making that contribute to many maladaptive behaviors. Previous research demonstrates that trait impulsivity is related to the activity of brain regions underlying reward sensitivity and emotion regulation, but little is known about this relationship in the context of immediately available primary reward. This is unfortunate, as impulsivity in these contexts can lead to unhealthy behaviors, including poor food choices, dangerous drug use and risky sexual practices. In addition, little is known about the relationship between integration of reward and affective neurocircuitry, as measured by resting-state functional connectivity, and trait impulsivity in everyday life, as measured with a commonly used personality inventory. We therefore asked healthy adults to undergo a functional magnetic resonance imaging task in which they saw cues indicating the imminent oral administration of rewarding taste, as well as a resting-state scan. Trait impulsivity was associated with increased activation during anticipation of primary reward in the anterior cingulate cortex (ACC) and amygdala. Additionally, resting-state functional connectivity between the ACC and the right amygdala was negatively correlated with trait impulsivity. These findings demonstrate that trait impulsivity is related not only to ACC-amygdala activation but also to how tightly coupled these regions are to one another. PMID:24526181

  8. Own-gender imitation activates the brain's reward circuitry

    Losin, Elizabeth A. Reynolds; Iacoboni, Macro; Martin, Alia; DAPRETTO, MIRELLA

    2012-01-01

    Imitation is an important component of human social learning throughout life. Theoretical models and empirical data from anthropology and psychology suggest that people tend to imitate self-similar individuals, and that such imitation biases increase the adaptive value (e.g., self-relevance) of learned information. It is unclear, however, what neural mechanisms underlie people's tendency to imitate those similar to themselves. We focused on the own-gender imitation bias, a pervasive bias thou...

  9. Brain areas activated by uncertain reward-based decision-making in healthy volunteers

    Zongjun Guo; Juan Chen; Shien Liu; Yuhuan Li; Bo Sun; Zhenbo Gao

    2013-01-01

    Reward-based decision-making has been found to activate several brain areas, including the ven-trolateral prefrontal lobe, orbitofrontal cortex, anterior cingulate cortex, ventral striatum, and meso-limbic dopaminergic system. In this study, we observed brain areas activated under three degrees of uncertainty in a reward-based decision-making task (certain, risky, and ambiguous). The tasks were presented using a brain function audiovisual stimulation system. We conducted brain scans of 15 healthy volunteers using a 3.0T magnetic resonance scanner. We used SPM8 to analyze the location and intensity of activation during the reward-based decision-making task, with respect to the three conditions. We found that the orbitofrontal cortex was activated in the certain reward con-dition, while the prefrontal cortex, precentral gyrus, occipital visual cortex, inferior parietal lobe, ce-rebel ar posterior lobe, middle temporal gyrus, inferior temporal gyrus, limbic lobe, and midbrain were activated during the ‘risk’ condition. The prefrontal cortex, temporal pole, inferior temporal gyrus, occipital visual cortex, and cerebel ar posterior lobe were activated during ambiguous deci-sion-making. The ventrolateral prefrontal lobe, frontal pole of the prefrontal lobe, orbitofrontal cortex, precentral gyrus, inferior temporal gyrus, fusiform gyrus, supramarginal gyrus, inferior parietal lo-bule, and cerebel ar posterior lobe exhibited greater activation in the‘risk’ than in the‘certain’ con-dition (P<0.05). The frontal pole and dorsolateral region of the prefrontal lobe, as wel as the ce-rebel ar posterior lobe, showed significantly greater activation in the ‘ambiguous’ condition com-pared to the ‘risk’ condition (P < 0.05). The prefrontal lobe, occipital lobe, parietal lobe, temporal lobe, limbic lobe, midbrain, and posterior lobe of the cerebel um were activated during deci-sion-making about uncertain rewards. Thus, we observed different levels and regions of

  10. Insular activation during reward anticipation reflects duration of illness in abstinent pathological gamblers

    Kosuke Tsurumi

    2014-09-01

    Full Text Available Pathological gambling (PG is a chronic mental disorder characterized by a difficulty restraining gambling behavior despite negative consequences. Although brain abnormalities in patients with substance use disorders are caused by repetitive drug use and recover partly with drug abstinence, the relationship between brain activity and duration of illness or abstinence of gambling behavior in PG patients remains unclear. Here, using functional magnetic resonance imaging, we compared the brain activity of 23 PG patients recruited from a treatment facility with 27 demographically-matched healthy control subjects during reward anticipation, and examined the correlations between brain activity and duration of illness or abstinence in PG patients. During reward anticipation, PG patients showed decreased activity compared to healthy controls in a broad range of the reward system regions, including the insula cortex. In PG patients, activation in the left insula showed a significant negative correlation with illness duration. Our findings suggest that insular activation during reward anticipation may serve as a marker of progression of pathological gambling.

  11. Oscillatory activity in the medial prefrontal cortex and nucleus accumbens correlates with impulsivity and reward outcome.

    Nicholas A Donnelly

    Full Text Available Actions expressed prematurely without regard for their consequences are considered impulsive. Such behaviour is governed by a network of brain regions including the prefrontal cortex (PFC and nucleus accumbens (NAcb and is prevalent in disorders including attention deficit hyperactivity disorder (ADHD and drug addiction. However, little is known of the relationship between neural activity in these regions and specific forms of impulsive behaviour. In the present study we investigated local field potential (LFP oscillations in distinct sub-regions of the PFC and NAcb on a 5-choice serial reaction time task (5-CSRTT, which measures sustained, spatially-divided visual attention and action restraint. The main findings show that power in gamma frequency (50-60 Hz LFP oscillations transiently increases in the PFC and NAcb during both the anticipation of a cue signalling the spatial location of a nose-poke response and again following correct responses. Gamma oscillations were coupled to low-frequency delta oscillations in both regions; this coupling strengthened specifically when an error response was made. Theta (7-9 Hz LFP power in the PFC and NAcb increased during the waiting period and was also related to response outcome. Additionally, both gamma and theta power were significantly affected by upcoming premature responses as rats waited for the visual cue to respond. In a subgroup of rats showing persistently high levels of impulsivity we found that impulsivity was associated with increased error signals following a nose-poke response, as well as reduced signals of previous trial outcome during the waiting period. Collectively, these in-vivo neurophysiological findings further implicate the PFC and NAcb in anticipatory impulsive responses and provide evidence that abnormalities in the encoding of rewarding outcomes may underlie trait-like impulsive behaviour.

  12. Dopamine agonist increases risk taking but blunts reward-related brain activity.

    Jordi Riba

    Full Text Available The use of D2/D3 dopaminergic agonists in Parkinson's disease (PD may lead to pathological gambling. In a placebo-controlled double-blind study in healthy volunteers, we observed riskier choices in a lottery task after administration of the D3 receptor-preferring agonist pramipexole thus mimicking risk-taking behavior in PD. Moreover, we demonstrate decreased activation in the rostral basal ganglia and midbrain, key structures of the reward system, following unexpected high gains and therefore propose that pathological gambling in PD results from the need to seek higher rewards to overcome the blunted response in this system.

  13. Activation of MAPK Is Necessary for Long-Term Memory Consolidation Following Food-Reward Conditioning

    Ribeiro, Maria J.; Schofield, Michael G.; Kemenes, Ildiko; O'Shea, Michael; Kemenes, Gyorgy; Benjamin, Paul R.

    2005-01-01

    Although an important role for the mitogen-activated protein kinase (MAPK) has been established for memory consolidation in a variety of learning paradigms, it is not known if this pathway is also involved in appetitive classical conditioning. We address this question by using a single-trial food-reward conditioning paradigm in the freshwater…

  14. Learning from Reward as an emergent property of Physics-like interactions between neurons in an artificial neural network.

    Davesne, Frédéric

    2004-01-01

    We study a class of artificial neural networks in which a physics-like conservation law upon the activity of connected neurons is imposed at each time. We postulate that the modification of the network activities may be interpreted as a learning capability if a judicious conservation law is chosen. We illustrate our claim by modeling a rat behavior in a labyrinth: the exploration of the labyrinth permits to create connections between neurons (latent learning), whereas the discovery of food in...

  15. Prior fear conditioning and reward learning interact in fear and reward networks

    Dominik R Bach

    2014-03-01

    Full Text Available The ability to flexibly adapt responses to changes in the environment is important for survival. Previous research in humans separately examined the mechanisms underlying acquisition and extinction of aversive and appetitive conditioned responses. It is yet unclear how aversive and appetitive learning interact on a neural level during counterconditioning in humans. This functional magnetic resonance imaging (fMRI study investigated the interaction of fear conditioning and subsequent reward learning. In the first phase (fear acquisition, images predicted aversive electric shocks or no aversive outcome. In the second phase (counterconditioning, half of the CS+ and CS- were associated with monetary reward in the absence of electric stimulation. The third phase initiated reinstatement of fear through presentation of electric shocks, followed by CS presentation in the absence of shock or reward. Results indicate that participants were impaired at learning the reward contingencies for stimuli previously associated with shock. In the counterconditioning phase, prior fear association interacted with reward representation in the amygdala, where activation was decreased for rewarded compared to unrewarded CS- trials, while there was no reward-related difference in CS+ trials. In the reinstatement phase, an interaction of previous fear association and previous reward status was observed in a reward network consisting of substantia nigra / ventral tegmental area (SN/VTA, striatum and orbitofrontal cortex (OFC, where activation was increased by previous reward association only for CS- but not for CS+ trials. These findings suggest that during counterconditioning, prior fear conditioning interferes with reward learning, subsequently leading to lower activation of the reward network.

  16. Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex.

    Klein-Flügge, Miriam Cornelia; Barron, Helen Catharine; Brodersen, Kay Henning; Dolan, Raymond J; Behrens, Timothy Edward John

    2013-02-13

    A dominant focus in studies of learning and decision-making is the neural coding of scalar reward value. This emphasis ignores the fact that choices are strongly shaped by a rich representation of potential rewards. Here, using fMRI adaptation, we demonstrate that responses in the human orbitofrontal cortex (OFC) encode a representation of the specific type of food reward predicted by a visual cue. By controlling for value across rewards and by linking each reward with two distinct stimuli, we could test for representations of reward-identity that were independent of associative information. Our results show reward-identity representations in a medial-caudal region of OFC, independent of the associated predictive stimulus. This contrasts with a more rostro-lateral OFC region encoding reward-identity representations tied to the predicate stimulus. This demonstration of adaptation in OFC to reward specific representations opens an avenue for investigation of more complex decision mechanisms that are not immediately accessible in standard analyses, which focus on correlates of average activity. PMID:23407973

  17. Reduced cerebellar brain activity during reward processing in adolescent binge drinkers

    Anita Cservenka

    2015-12-01

    Full Text Available Due to ongoing development, adolescence may be a period of heightened vulnerability to the neurotoxic effects of alcohol. Binge drinking may alter reward-driven behavior and neurocircuitry, thereby increasing risk for escalating alcohol use. Therefore, we compared reward processing in adolescents with and without a history of recent binge drinking. At their baseline study visit, all participants (age = 14.86 ± 0.88 were free of heavy alcohol use and completed a modified version of the Wheel of Fortune (WOF functional magnetic resonance imaging task. Following this visit, 17 youth reported binge drinking on ≥3 occasions within a 90 day period and were matched to 17 youth who remained alcohol and substance-naïve. All participants repeated the WOF task during a second visit (age = 16.83 ± 1.22. No significant effects were found in a region of interest analysis of the ventral striatum, but whole-brain analyses showed significant group differences in reward response at the second study visit in the left cerebellum, controlling for baseline visit brain activity (p/α < 0.05, which was negatively correlated with mean number of drinks consumed/drinking day in the last 90 days. These findings suggest that binge drinking during adolescence may alter brain activity during reward processing in a dose-dependent manner.

  18. Food reward in active compared to inactive men: Roles for gastric emptying and body fat.

    Horner, Katy M; Finlayson, Graham; Byrne, Nuala M; King, Neil A

    2016-06-01

    Habitual exercise could contribute to weight management by altering processes of food reward via the gut-brain axis. We investigated hedonic processes of food reward in active and inactive men and characterised relationships with gastric emptying and body fat. Forty-four men (active: n=22; inactive: n=22, BMI range 21-36kg/m(2); percent fat mass range 9-42%) were studied. Participants were provided with a standardised fixed breakfast and an ad libitum lunch meal 5h later. Explicit liking, implicit wanting and preference among high-fat, low-fat, sweet and savoury food items were assessed immediately post-breakfast (fed state) and again pre-lunch (hungry state) using the Leeds Food Preference Questionnaire. Gastric emptying was assessed by (13)C-octanoic acid breath test. Active individuals exhibited a lower liking for foods overall and a greater implicit wanting for low-fat savoury foods in the fed state, compared to inactive men. Differences in the fed state remained significant after adjusting for percent fat mass. Active men also had a greater increase in liking for savoury foods in the interval between breakfast and lunch. Faster gastric emptying was associated with liking for savoury foods and with an increase in liking for savoury foods in the postprandial interval. In contrast, greater implicit wanting for high-fat foods was associated with slower gastric emptying. These associations were independent of each other, activity status and body fat. In conclusion, active and inactive men differ in processes of food reward. The rate of gastric emptying may play a role in the association between physical activity status and food reward, via the gut-brain axis. PMID:27072508

  19. When a good taste turns bad: Neural mechanisms underlying the emergence of negative affect and associated natural reward devaluation by cocaine.

    Carelli, Regina M; West, Elizabeth A

    2014-01-01

    An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, research in the Carelli laboratory is reviewed that examined neurobiological mechanisms that may underlie these processes using a novel animal model. Oromotor responses (taste reactivity) were examined as rats learned that intraoral infusion of a sweet (e.g., saccharin) predicts impending but delayed access to cocaine self-administration. We showed that rats exhibit aversive taste reactivity (i.e., gapes/rejection responses) during infusion of the sweet paired with impending cocaine, similar to aversive responses observed during infusion of quinine, a bitter tastant. Critically, the expression of this pronounced aversion to the sweet predicted the subsequent motivation to self-administer cocaine. Electrophysiology studies show that this shift in palatability corresponds to an alteration in nucleus accumbens (NAc) cell firing; neurons that previously responded with inhibition during infusion of the palatable sweet shifted to excitatory activity during infusion of the cocaine-devalued tastant. This excitatory response profile is typically observed during infusion of quinine, indicating that the once palatable sweet becomes aversive following its association with impending but delayed cocaine, and NAc neurons encode this aversive state. We also review electrochemical studies showing a shift (from increase to decrease) in rapid NAc dopamine release during infusion of the cocaine-paired tastant as the aversive state developed, again, resulting in responses similar to quinine

  20. SOVEREIGN: An autonomous neural system for incrementally learning planned action sequences to navigate towards a rewarded goal.

    Gnadt, William; Grossberg, Stephen

    2008-06-01

    How do reactive and planned behaviors interact in real time? How are sequences of such behaviors released at appropriate times during autonomous navigation to realize valued goals? Controllers for both animals and mobile robots, or animats, need reactive mechanisms for exploration, and learned plans to reach goal objects once an environment becomes familiar. The SOVEREIGN (Self-Organizing, Vision, Expectation, Recognition, Emotion, Intelligent, Goal-oriented Navigation) animat model embodies these capabilities, and is tested in a 3D virtual reality environment. SOVEREIGN includes several interacting subsystems which model complementary properties of cortical What and Where processing streams and which clarify similarities between mechanisms for navigation and arm movement control. As the animat explores an environment, visual inputs are processed by networks that are sensitive to visual form and motion in the What and Where streams, respectively. Position-invariant and size-invariant recognition categories are learned by real-time incremental learning in the What stream. Estimates of target position relative to the animat are computed in the Where stream, and can activate approach movements toward the target. Motion cues from animat locomotion can elicit head-orienting movements to bring a new target into view. Approach and orienting movements are alternately performed during animat navigation. Cumulative estimates of each movement are derived from interacting proprioceptive and visual cues. Movement sequences are stored within a motor working memory. Sequences of visual categories are stored in a sensory working memory. These working memories trigger learning of sensory and motor sequence categories, or plans, which together control planned movements. Predictively effective chunk combinations are selectively enhanced via reinforcement learning when the animat is rewarded. Selected planning chunks effect a gradual transition from variable reactive exploratory

  1. Dissecting Neural Responses to Temporal Prediction, Attention, and Memory: Effects of Reward Learning and Interoception on Time Perception.

    Tomasi, Dardo; Wang, Gene-Jack; Studentsova, Yana; Volkow, Nora D

    2015-10-01

    Temporal prediction (TP) is needed to anticipate future events and is essential for survival. Our sense of time is modulated by emotional and interoceptive (corporal) states that are hypothesized to rely on a dopamine (DA)-modulated "internal clock" in the basal ganglia. However, the neurobiological substrates for TP in the human brain have not been identified. We tested the hypothesis that TP involves DA striato-cortical pathways, and that accurate responses are reinforcing in themselves and activate the nucleus accumbens (NAc). Functional magnetic resonance imaging revealed the involvement of the NAc and anterior insula in the temporal precision of the responses, and of the ventral tegmental area in error processing. Moreover, NAc showed higher activation for successful than for unsuccessful trials, indicating that accurate TP per se is rewarding. Inasmuch as activation of the NAc is associated with drug-induced addictive behaviors, its activation by accurate TP could help explain why video games that rely on TP can trigger compulsive behaviors. PMID:25389123

  2. Genetic control of active neural circuits

    Leon Reijmers

    2009-12-01

    Full Text Available The use of molecular tools to study the neurobiology of complex behaviors has been hampered by an inability to target the desired changes to relevant groups of neurons. Specific memories and specific sensory representations are sparsely encoded by a small fraction of neurons embedded in a sea of morphologically and functionally similar cells. In this review we discuss genetics techniques that are being developed to address this difficulty. In several studies the use of promoter elements that are responsive to neural activity have been used to drive long lasting genetic alterations into neural ensembles that are activated by natural environmental stimuli. This approach has been used to examine neural activity patterns during learning and retrieval of a memory, to examine the regulation of receptor trafficking following learning and to functionally manipulate a specific memory trace. We suggest that these techniques will provide a general approach to experimentally investigate the link between patterns of environmentally activated neural firing and cognitive processes such as perception and memory.

  3. Reward-related activity in the medial prefrontal cortex is driven by consumption

    MarkLaubach

    2013-04-01

    Full Text Available An emerging literature suggests that the mPFC is crucial for the ability to track behavioral outcomes over time and has a critical role in successful foraging. Here, we examine this issue by analyzing changes in neuronal spike activity and local field potentials in the rat mPFC in relation to the consumption of rewarding stimuli. Using multi-electrode recording methods, we simultaneously recorded from ensembles of neurons and field potentials in the mPFC during the performance of an operant delayed alternation task and a variable-interval licking procedure. In both tasks, we found that consummatory behavior (licking activates many mPFC neurons and is associated with theta-band phase locking by mPFC field potentials. Many neurons that were modulated by the delivery of reward were also modulated when rats emitted bouts of licks during the period of consumption. The majority of these licking-modulated neurons were found in the rostral part of the prelimbic cortex, a region that is heavily interconnected with the gustatory insular cortex and projects to subcortical feeding-related centers. Based on the tight coupling between spike activity, theta-band phase locking, and licking behavior, we suggest that reward-related activity in the mPFC is driven by consummatory behavior.

  4. Relation of obesity to neural activation in response to food commercials.

    Gearhardt, Ashley N; Yokum, Sonja; Stice, Eric; Harris, Jennifer L; Brownell, Kelly D

    2014-07-01

    Adolescents view thousands of food commercials annually, but the neural response to food advertising and its association with obesity is largely unknown. This study is the first to examine how neural response to food commercials differs from other stimuli (e.g. non-food commercials and television show) and to explore how this response may differ by weight status. The blood oxygen level-dependent functional magnetic resonance imaging activation was measured in 30 adolescents ranging from lean to obese in response to food and non-food commercials imbedded in a television show. Adolescents exhibited greater activation in regions implicated in visual processing (e.g. occipital gyrus), attention (e.g. parietal lobes), cognition (e.g. temporal gyrus and posterior cerebellar lobe), movement (e.g. anterior cerebellar cortex), somatosensory response (e.g. postcentral gyrus) and reward [e.g. orbitofrontal cortex and anterior cingulate cortex (ACC)] during food commercials. Obese participants exhibited less activation during food relative to non-food commercials in neural regions implicated in visual processing (e.g. cuneus), attention (e.g. posterior cerebellar lobe), reward (e.g. ventromedial prefrontal cortex and ACC) and salience detection (e.g. precuneus). Obese participants did exhibit greater activation in a region implicated in semantic control (e.g. medial temporal gyrus). These findings may inform current policy debates regarding the impact of food advertising to minors. PMID:23576811

  5. Differences in Neural Activation as a Function of Risk-taking Task Parameters

    Eliza eCongdon

    2013-09-01

    Full Text Available Despite evidence supporting a relationship between impulsivity and naturalistic risk-taking, the relationship of impulsivity with laboratory-based measures of risky decision-making remains unclear. One factor contributing to this gap in our understanding is the degree to which different risky decision-making tasks vary in their details. We conducted an fMRI investigation of the Angling Risk Task (ART, which is an improved behavioral measure of risky decision-making. In order to examine whether the observed pattern of neural activation was specific to the ART or generalizable, we also examined correlates of the Balloon Analogue Risk Taking (BART task in the same sample of 23 healthy adults. Exploratory analyses were conducted to examine the relationship between neural activation, performance, impulsivity and self-reported risk-taking. While activation in a valuation network was associated with reward tracking during the ART but not the BART, increased fronto-cingulate activation was seen during risky choice trials in the BART as compared to the ART. Thus, neural activation during risky decision-making trials differed between the two tasks, and this observation was likely driven by differences in task parameters, namely the absence vs. presence of ambiguity and/or stationary vs. increasing probability of loss on the ART and BART, respectively. Exploratory association analyses suggest that sensitivity of neural response to the magnitude of potential reward during the ART was associated with a suboptimal performance strategy, higher scores on a scale of dysfunctional impulsivity and a greater likelihood of engaging in risky behaviors, while this pattern was not seen for the BART. Our results suggest that the ART is decomposable and associated with distinct patterns of neural activation; this represents a preliminary step towards characterizing a behavioral measure of risky decision-making that may support a better understanding of naturalistic risk-taking.

  6. Peers increase adolescent risk taking by enhancing activity in the brain’s reward circuitry

    Chein, Jason; Albert, Dustin; O’Brien, Lia; Uckert, Kaitlyn; Steinberg, Laurence

    2011-01-01

    The presence of peers increases risk taking among adolescents but not adults. We posited that the presence of peers may promote adolescent risk taking by sensitizing brain regions associated with the anticipation of potential rewards. Using fMRI, we measured brain activity in adolescents, young adults, and adults as they made decisions in a simulated driving task. Participants completed one task block while alone, and one block while their performance was observed by peers in an adjacent room...

  7. Dopamine Agonist Increases Risk Taking but Blunts Reward-Related Brain Activity

    Jordi Riba; Krämer, Ulrike M.; Marcus Heldmann; Sylvia Richter; Münte, Thomas F.

    2008-01-01

    The use of D2/D3 dopaminergic agonists in Parkinson's disease (PD) may lead to pathological gambling. In a placebo-controlled double-blind study in healthy volunteers, we observed riskier choices in a lottery task after administration of the D3 receptor-preferring agonist pramipexole thus mimicking risk-taking behavior in PD. Moreover, we demonstrate decreased activation in the rostral basal ganglia and midbrain, key structures of the reward system, following unexpected high gains and therefo...

  8. Salience network-midbrain dysconnectivity and blunted reward signals in schizophrenia

    Gradin, Victoria; Waiter, Gordon; O'Connor, Akira Robert; Romaniuk, Liana; Stickle, Catriona; Matthews, Keith; Hall, Jeremy; Steele, Douglas

    2012-01-01

    Theories of schizophrenia propose that abnormal functioning of the neural reward system is linked to negative and psychotic symptoms, by disruption of reward processing and promotion of context-independent false associations. Recently it has been argued that an insula-anterior cingulate cortex (ACC) salience network system enables switching of brain states from the default mode to a task-related activity mode. Abnormal interaction between the insula-ACC system and reward processing regions ma...

  9. ADHD Related Behaviors Are Associated with Brain Activation in the Reward System

    Stark, R.; Bauer, E.; Merz, C. J.; Zimmermann, M.; Reuter, M.; Plichta, M. M.; Kirsch, P.; Lesch, K. P.; Fallgatter, A. J.; Vaitl, D.; Herrmann, M. J.

    2011-01-01

    Neuroimaging studies on attention-deficit/hyperactivity disorder (ADHD) suggest dysfunctional reward processing, with hypo-responsiveness during reward anticipation in the reward system including the nucleus accumbens (NAcc). In this study, we investigated the association between ADHD related behaviors and the reward system using functional…

  10. Early effects of reward anticipation are modulated by dopaminergic stimulation.

    Thore Apitz

    Full Text Available The abilities to predict future rewards and assess the value of reward delivery are crucial aspects of adaptive behavior. While the mesolimbic system, including dopaminergic midbrain, ventral striatum and prefrontal cortex have long been associated with reward processing, recent studies also indicate a prominent role of early visual brain regions. However, the precise underlying neural mechanisms still remain unclear. To address this issue, we presented participants with visual cues predicting rewards of high and low magnitudes and probability (2 × 2 factorial design, while neural activity was scanned using magnetoencephalography. Importantly, one group of participants received 150 mg of the dopamine precursor levodopa prior to the experiment, while another group received a placebo. For the placebo group, neural signals of reward probability (but not magnitude emerged at ∼ 100 ms after cue presentation at occipital sensors in the event-related magnetic fields. Importantly, these probability signals were absent in the levodopa group indicating a close link. Moreover, levodopa administration reduced oscillatory power in the high (20-30 Hz and low (13-20 Hz beta band during both reward anticipation and delivery. Taken together, our findings indicate that visual brain regions are involved in coding prospective reward probability but not magnitude and that these effects are modulated by dopamine.

  11. Diffusion models and neural activity

    Ricciardi, L. M.; Lánský, Petr

    London : Nature publishing group, 2003 - (Nadel, L.), s. 968-972 ISBN 0-333-79261-0 R&D Projects: GA ČR GA309/02/0168 Institutional research plan: CEZ:AV0Z5011922 Keywords : Neuronal activity, Diffusion model Subject RIV: ED - Physiology

  12. rsfMRI effects of KB220Z™ on neural pathways in reward circuitry of abstinent genotyped heroin addicts.

    Blum, Kenneth; Liu, Yijun; Wang, Wei; Wang, Yarong; Zhang, Yi; Oscar-Berman, Marlene; Smolen, Andrew; Febo, Marcelo; Han, David; Simpatico, Thomas; Cronjé, Frans J; Demetrovics, Zsolt; Gold, Mark S

    2015-03-01

    Recently, Willuhn et al. reported that cocaine use and even non-substance-related addictive behavior increases as dopaminergic function is reduced. Chronic cocaine exposure has been associated with decreases in D2/D3 receptors and was also associated with lower activation of cues in occipital cortex and cerebellum, in a recent PET study by Volkow's et al. Therefore, treatment strategies, like dopamine agonist therapy, that might conserve dopamine function may be an interesting approach to relapse prevention in psychoactive drug and behavioral addictions. To this aim, we evaluated the effect of KB220Z™ on reward circuitry of 10 heroin addicts undergoing protracted abstinence (average 16.9 months). In a randomized placebo-controlled crossover study of KB220Z, five subjects completed a triple-blinded experiment in which the subject, the person administering the treatment, and the person evaluating the response to treatment were blinded to the treatment that any particular subject was receiving. In addition, nine subjects were genotyped utilizing the GARSDX™ test. We preliminarily report that KB220Z induced an increase in BOLD activation in caudate-accumbens-dopaminergic pathways compared to placebo following 1-hour acute administration. Furthermore, KB220Z also reduced resting-state activity in the putamen of abstinent heroin addicts. In the second phase of this pilot study of all 10 abstinent heroin-dependent subjects, we observed that three brain regions of interest were significantly activated from resting state by KB220Z compared to placebo (p addiction by direct or indirect dopaminergic interaction. Due to small sample size, we caution definitive interpretation of these preliminary results, and confirmation with additional research and ongoing rodent and human studies of KB220Z is required. PMID:25526228

  13. Dopamine Receptor Blockade Modulates the Rewarding and Aversive Properties of Nicotine via Dissociable Neuronal Activity Patterns in the Nucleus Accumbens

    Sun, Ninglei; Laviolette, Steven R

    2014-01-01

    The mesolimbic pathway comprising the ventral tegmental area (VTA) and projection terminals in the nucleus accumbens (NAc) has been identified as a critical neural system involved in processing both the rewarding and aversive behavioral effects of nicotine. Transmission through dopamine (DA) receptors functionally modulates these effects directly within the NAc. Nevertheless, the neuronal mechanisms within the NAc responsible for these bivalent behavioral effects are presently not known. Usin...

  14. Information transmission in oscillatory neural activity

    Koepsell, Kilian

    2008-01-01

    Periodic neural activity not locked to the stimulus or to motor responses is usually ignored. Here, we present new tools for modeling and quantifying the information transmission based on periodic neural activity that occurs with quasi-random phase relative to the stimulus. We propose a model to reproduce characteristic features of oscillatory spike trains, such as histograms of inter-spike intervals and phase locking of spikes to an oscillatory influence. The proposed model is based on an inhomogeneous Gamma process governed by a density function that is a product of the usual stimulus-dependent rate and a quasi-periodic function. Further, we present an analysis method generalizing the direct method (Rieke et al, 1999; Brenner et al, 2000) to assess the information content in such data. We demonstrate these tools on recordings from relay cells in the lateral geniculate nucleus of the cat.

  15. Functional magnetic resonance imaging in awake transgenic fragile X rats: evidence of dysregulation in reward processing in the mesolimbic/habenular neural circuit.

    Kenkel, W M; Yee, J R; Moore, K; Madularu, D; Kulkarni, P; Gamber, K; Nedelman, M; Ferris, C F

    2016-01-01

    Anxiety and social deficits, often involving communication impairment, are fundamental clinical features of fragile X syndrome. There is growing evidence that dysregulation in reward processing is a contributing factor to the social deficits observed in many psychiatric disorders. Hence, we hypothesized that transgenic fragile X mental retardation 1 gene (fmr1) KO (FX) rats would display alterations in reward processing. To this end, awake control and FX rats were imaged for changes in blood oxygen level dependent (BOLD) signal intensity in response to the odor of almond, a stimulus to elicit the innate reward response. Subjects were 'odor naive' to this evolutionarily conserved stimulus. The resulting changes in brain activity were registered to a three-dimensional segmented, annotated rat atlas delineating 171 brain regions. Both wild-type (WT) and FX rats showed robust brain activation to a rewarding almond odor, though FX rats showed an altered temporal pattern and tended to have a higher number of voxels with negative BOLD signal change from baseline. This pattern of greater negative BOLD was especially apparent in the Papez circuit, critical to emotional processing and the mesolimbic/habenular reward circuit. WT rats showed greater positive BOLD response in the supramammillary area, whereas FX rats showed greater positive BOLD response in the dorsal lateral striatum, and greater negative BOLD response in the retrosplenial cortices, the core of the accumbens and the lateral preoptic area. When tested in a freely behaving odor-investigation paradigm, FX rats failed to show the preference for almond odor which typifies WT rats. However, FX rats showed investigation profiles similar to WT when presented with social odors. These data speak to an altered processing of this highly salient novel odor in the FX phenotype and lend further support to the notion that altered reward systems in the brain may contribute to fragile X syndrome symptomology. PMID:27003189

  16. Neural activity associated with self-reflection

    Herwig Uwe; Kaffenberger Tina; Schell Caroline; Jäncke Lutz; Brühl Annette B

    2012-01-01

    Abstract Background Self-referential cognitions are important for self-monitoring and self-regulation. Previous studies have addressed the neural correlates of self-referential processes in response to or related to external stimuli. We here investigated brain activity associated with a short, exclusively mental process of self-reflection in the absence of external stimuli or behavioural requirements. Healthy subjects reflected either on themselves, a personally known or an unknown person dur...

  17. Neural reactivity to monetary rewards and losses in childhood: longitudinal and concurrent associations with observed and self-reported positive emotionality.

    Kujawa, Autumn; Proudfit, Greg Hajcak; Kessel, Ellen M; Dyson, Margaret; Olino, Thomas; Klein, Daniel N

    2015-01-01

    Reward reactivity and positive emotion are key components of a theoretical, early-emerging approach motivational system, yet few studies have examined associations between positive emotion and neural reactivity to reward across development. In this multi-method prospective study, we examined the association of laboratory observations of positive emotionality (PE) at age 3 and self-reported positive affect (PA) at age 9 with an event-related potential component sensitive to the relative response to winning vs. losing money, the feedback negativity (ΔFN), at age 9 (N=381). Males had a larger ΔFN than females, and both greater observed PE at age 3 and self-reported PA at age 9 significantly, but modestly, predicted an enhanced ΔFN at age 9. Negative emotionality and behavioral inhibition did not predict ΔFN. Results contribute to understanding the neural correlates of PE and suggest that the FN and PE may be related to the same biobehavioral approach system. PMID:25433097

  18. Running is rewarding and antidepressive

    Brené, Stefan; Bjørnebekk, Astrid; Åberg, Elin; Mathé, Aleksander A.; Olson, Lars; Werme, Martin

    2007-01-01

    Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent to activate the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genet...

  19. Task preparation processes related to reward prediction precede those related to task-difficulty expectation

    Schevernels, Hanne; Krebs, Ruth M.; Santens, Patrick; Woldorff, Marty G.; Boehler, C. Nico

    2013-01-01

    Recently, attempts have been made to disentangle the neural underpinnings of preparatory processes related to reward and attention. Functional magnetic resonance imaging (fMRI) research showed that neural activity related to the anticipation of reward and to attentional demands invokes neural activity patterns featuring large-scale overlap, along with some differences and interactions. Due to the limited temporal resolution of fMRI, however, the temporal dynamics of these processes remain unclear. Here, we report an event-related potentials (ERP) study in which cued attentional demands and reward prospect were combined in a factorial design. Results showed that reward prediction dominated early cue processing, as well as the early and later parts of the contingent negative variation (CNV) slow-wave ERP component that has been associated with task-preparation processes. Moreover these reward-related electrophysiological effects correlated across participants with response-time speeding on reward-prospect trials. In contrast, cued attentional demands affected only the later part of the CNV, with the highest amplitudes following cues predicting high-difficulty potential-reward targets, thus suggesting maximal task preparation when the task requires it and entails reward prospect. Consequently, we suggest that task-preparation processes triggered by reward can arise earlier, and potentially more directly, than strategic top-down aspects of preparation based on attentional demands. PMID:24064071

  20. Neural and sympathetic activity associated with exploration in decision-making: Further evidence for involvement of insula

    Hideki eOhira

    2014-11-01

    Full Text Available We previously reported that sympathetic activity was associated with exploration in decision-making indexed by entropy, which is a concept in information theory and indexes randomness of choices or the degree of deviation from sticking to recent experiences of gains and losses, and that activation of the anterior insula mediated this association. The current study aims to replicate and to expand these findings in a situation where contingency between options and outcomes is manipulated. Sixteen participants performed a stochastic decision-making task in which we manipulated a condition with low uncertainty of gain/loss (contingent-reward condition and a condition with high uncertainty of gain/loss (random-reward condition. Regional cerebral blood flow was measured by 15O-water positron emission tomography (PET, and cardiovascular parameters and catecholamine in the peripheral blood were measured, during the task. In the contingent-reward condition, norepinephrine as an index of sympathetic activity was positively correlated with entropy indicating exploration in decision-making. Norepinephrine was negatively correlated with neural activity in the right posterior insula, rostral anterior cingulate cortex, and dorsal pons, suggesting neural bases for detecting changes of bodily states. Furthermore, right anterior insular activity was negatively correlated with entropy, suggesting influences on exploration in decision-making. By contrast, in the random-reward condition, entropy correlated with activity in the dorsolateral prefrontal and parietal cortices but not with sympathetic activity. These findings suggest that influences of sympathetic activity on exploration in decision-making and its underlying neural mechanisms might be dependent on the degree of uncertainty of situations.

  1. Selective Activation of Cholinergic Interneurons Enhances Accumbal Phasic Dopamine Release: Setting the Tone for Reward Processing

    Roger Cachope

    2012-07-01

    Full Text Available Dopamine plays a critical role in motor control, addiction, and reward-seeking behaviors, and its release dynamics have traditionally been linked to changes in midbrain dopamine neuron activity. Here, we report that selective endogenous cholinergic activation achieved via in vitro optogenetic stimulation of nucleus accumbens, a terminal field of dopaminergic neurons, elicits real-time dopamine release. This mechanism occurs via direct actions on dopamine terminals, does not require changes in neuron firing within the midbrain, and is dependent on glutamatergic receptor activity. More importantly, we demonstrate that in vivo selective activation of cholinergic interneurons is sufficient to elicit dopamine release in the nucleus accumbens. Therefore, the control of accumbal extracellular dopamine levels by endogenous cholinergic activity results from a complex convergence of neurotransmitter/neuromodulator systems that may ultimately synergize to drive motivated behavior.

  2. Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

    Baskin-Sommers, Arielle R; Foti, Dan

    2015-11-01

    A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. PMID:25655926

  3. Brain's reward circuits mediate itch relief. a functional MRI study of active scratching.

    Alexandru D P Papoiu

    Full Text Available Previous brain imaging studies investigating the brain processing of scratching used an exogenous intervention mimicking scratching, performed not by the subjects themselves, but delivered by an investigator. In real life, scratching is a conscious, voluntary, controlled motor response to itching, which is directed to the perceived site of distress. In this study we aimed to visualize in real-time by brain imaging the core mechanisms of the itch-scratch cycle when scratching was performed by subjects themselves. Secondly, we aimed to assess the correlations between brain patterns of activation and psychophysical ratings of itch relief or pleasurability of scratching. We also compared the patterns of brain activity evoked by self-scratching vs. passive scratching. We used a robust tridimensional Arterial Spin Labeling fMRI technique that is less sensitive to motion artifacts: 3D gradient echo and spin echo (GRASE--Propeller. Active scratching was accompanied by a higher pleasurability and induced a more pronounced deactivation of the anterior cingulate cortex and insula, in comparison with passive scratching. A significant involvement of the reward system including the ventral tegmentum of the midbrain, coupled with a mechanism deactivating the periaqueductal gray matter (PAG, suggests that itch modulation operates in reverse to the mechanism known to suppress pain. Our findings not only confirm a role for the central networks processing reward in the pleasurable aspects of scratching, but also suggest they play a role in mediating itch relief.

  4. Witnessing hateful people in pain modulates brain activity in regions associated with physical pain and reward.

    GlennRyanFox

    2013-10-01

    Full Text Available How does witnessing a hateful person in pain compare to witnessing a likable person in pain? The current study compared the brain bases for how we perceive likable people in pain with those of viewing hateful people in pain. While social bonds are built through sharing the plight and pain of others in the name of empathy, viewing a hateful person in pain also has many potential ramifications. In this functional Magnetic Resonance Imaging (fMRI study, Caucasian Jewish male participants viewed videos of (1 disliked, hateful, anti-Semitic individuals, and (2 liked, non-hateful, tolerant individuals in pain. The results showed that, compared with viewing liked people, viewing hateful people in pain elicited increased responses in regions associated with observation of physical pain (the insular cortex, the anterior cingulate cortex, and the somatosensory cortex, reward processing (the striatum, and frontal regions associated with emotion regulation. Functional connectivity analyses revealed connections between seed regions in the left anterior cingulate cortex and right insular cortex with reward regions, the amygdala, and frontal regions associated with emotion regulation. These data indicate that regions of the brain active while viewing someone in pain may be more active in response to the danger or threat posed by witnessing the pain of a hateful individual more so than the desire to empathize with a likable person’s pain.

  5. Endogenous Opioid-Induced Neuroplasticity of Dopaminergic Neurons in the Ventral Tegmental Area Influences Natural and Opiate Reward

    Pitchers, Kyle K.; Coppens, Caroline M.; Beloate, Lauren N.; Fuller, Jonathan; Van, Sandy; Frohmader, Karla S.; Laviolette, Steven R.; Lehman, Michael N.; Coolen, Lique M.

    2014-01-01

    Natural reward and drugs of abuse converge on the mesolimbic pathway and activate common mechanism of neural plasticity in the nucleus accumbens. Chronic exposure to opiates induces plasticity in dopaminergic neurons of the ventral tegmental area (VTA), which regulates morphine reward tolerance. Her

  6. Cortisol alters reward processing in the human brain.

    Kinner, Valerie L; Wolf, Oliver T; Merz, Christian J

    2016-08-01

    Dysfunctional reward processing is known to play a central role for the development of psychiatric disorders. Glucocorticoids that are secreted in response to stress have been shown to attenuate reward sensitivity and thereby might promote the onset of psychopathology. However, the underlying neurobiological mechanisms mediating stress hormone effects on reward processing as well as potential sex differences remain elusive. In this neuroimaging study, we administered 30mg cortisol or a placebo to 30 men and 30 women and subsequently tested them in the Monetary Incentive Delay Task. Cortisol attenuated anticipatory neural responses to a verbal and a monetary reward in the left pallidum and the right anterior parahippocampal gyrus. Furthermore, in men, activation in the amygdala, the precuneus, the anterior cingulate, and in hippocampal regions was reduced under cortisol, whereas in cortisol-treated women a signal increase was observed in these regions. Behavioral performance also indicated that reward learning in men is impaired under high cortisol concentrations, while it is augmented in women. These findings illustrate that the stress hormone cortisol substantially diminishes reward anticipation and provide first evidence that cortisol effects on the neural reward system are sensitive to sex differences, which might translate into different vulnerabilities for psychiatric disorders. PMID:27170428

  7. Actively caring to prevent bullying in an elementary school: Prompting and rewarding prosocial behavior.

    McCarty, Shane; Teie, Sophia; McCutchen, Jenna; Geller, E Scott

    2016-01-01

    This field study evaluated the impact of an intervention designed to prevent bullying among elementary-school students by prompting and rewarding prosocial behavior. More specifically, teachers of 404 second-, third-, fourth-, fifth-, and sixth-grade students from an elementary school in northeast Virginia asked their students to look out for other students' prosocial behaviors (termed "actively caring") and to submit their stories about actively caring. At the start of every class day, the teachers read three of these stories and recognized one story and the two associated students (i.e., the observer and the performer) by providing each with a wristband engraved with "Actively Caring for People." For six consecutive Fridays, students reported their observations of bullying and completed a single item estimate of self-esteem. Weekly surveys revealed reductions in "being bullied" and "bullying others," as well as an increase in self-esteem. PMID:27309025

  8. Reward association facilitates distractor suppression in human visual search.

    Gong, Mengyuan; Yang, Feitong; Li, Sheng

    2016-04-01

    Although valuable objects are attractive in nature, people often encounter situations where they would prefer to avoid such distraction while focusing on the task goal. Contrary to the typical effect of attentional capture by a reward-associated item, we provide evidence for a facilitation effect derived from the active suppression of a high reward-associated stimulus when cuing its identity as distractor before the display of search arrays. Selection of the target is shown to be significantly faster when the distractors were in high reward-associated colour than those in low reward-associated or non-rewarded colours. This behavioural reward effect was associated with two neural signatures before the onset of the search display: the increased frontal theta oscillation and the strengthened top-down modulation from frontal to anterior temporal regions. The former suggests an enhanced working memory representation for the reward-associated stimulus and the increased need for cognitive control to override Pavlovian bias, whereas the latter indicates that the boost of inhibitory control is realized through a frontal top-down mechanism. These results suggest a mechanism in which the enhanced working memory representation of a reward-associated feature is integrated with task demands to modify attentional priority during active distractor suppression and benefit behavioural performance. PMID:26797805

  9. When a good taste turns bad: Neural mechanisms underlying the emergence of negative affect and associated natural reward devaluation by cocaine

    Carelli, Regina M.; West, Elizabeth A.

    2013-01-01

    An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, ...

  10. Activation of physiological stress responses by a natural reward: Novel vs. repeated sucrose intake.

    Egan, Ann E; Ulrich-Lai, Yvonne M

    2015-10-15

    Pharmacological rewards, such as drugs of abuse, evoke physiological stress responses, including increased heart rate and blood pressure, and activation of the hypothalamic-pituitary-adrenal (HPA) axis. It is not clear to what extent the natural reward of palatable foods elicits similar physiological responses. In order to address this question, HPA axis hormones, heart rate, blood pressure and brain pCREB immunolabeling were assessed following novel and repeated sucrose exposure. Briefly, adult, male rats with ad libitum food and water were given either a single (day 1) or repeated (twice-daily for 14 days) brief (up to 30 min) exposure to a second drink bottle containing 4 ml of 30% sucrose drink vs. water (as a control for bottle presentation). Sucrose-fed rats drank more than water-fed on all days of exposure, as expected. On day 1 of exposure, heart rate, blood pressure, plasma corticosterone, and locomotion were markedly increased by presentation of the second drink bottle regardless of drink type. After repeated exposure (day 14), these responses habituated to similar extents regardless of drink type and pCREB immunolabeling in the hypothalamic paraventricular nucleus (PVN) also did not vary with drink type, whereas basolateral amygdala pCREB was increased by sucrose intake. Taken together, these data suggest that while sucrose is highly palatable, physiological stress responses were evoked principally by the drink presentation itself (e.g., an unfamiliar intervention by the investigators), as opposed to the palatability of the offered drink. PMID:25747321

  11. TOUCHING MOMENTS: DESIRE MODULATES THE NEURAL ANTICIPATION OF ACTIVE ROMANTIC CARESS

    Sjoerd J.H. Ebisch

    2014-02-01

    Full Text Available A romantic caress is a basic expression of affiliative behavior and a primary reinforcer. Given its inherent affective valence, its performance also would imply the prediction of reward values. For example, touching a person for whom one has strong passionate feelings likely is motivated by a strong desire for physical contact and associated with the anticipation of hedonic experiences. The present study aims at investigating how the anticipatory neural processes of active romantic caress are modulated by the intensity of the desire for affective contact as reflected by passionate feelings for the other. Functional magnetic resonance imaging scanning was performed in romantically involved partners using a paradigm that allowed to isolate the specific anticipatory representations of active romantic caress, compared with control caress, while testing for the relationship between neural activity and measures of feelings of passionate love for the other. The results demonstrated that right posterior insula activity in anticipation of romantic caress significantly co-varied with the intensity of desire for union with the other. This effect was independent of the sensory-affective properties of the performed touch, like its pleasantness. Furthermore, functional connectivity analysis showed that the same posterior insula cluster interacted with brain regions related to sensory-motor functions as well as to the processing and anticipation of reward. The findings provide insight on the neural substrate mediating between the desire for and the performance of romantic caress. In particular, we propose that anticipatory activity patterns in posterior insula may modulate subsequent sensory-affective processing of skin-to-skin contact.

  12. A new window to understanding individual differences in reward sensitivity from attentional networks.

    Costumero, V; Barrós-Loscertales, A; Bustamante, J C; Fuentes, P; Rosell-Negre, P; Ventura-Campos, N; Ávila, C

    2015-01-01

    Existing evidence suggests that the presence of reward cues modifies the activity in attentional networks, however, the nature of these influences remains poorly understood. Here, we performed independent component analysis (ICA) in two fMRI datasets corresponding to two incentive delay tasks, which compared the response to reward (money and erotic pictures) and neutral cues, and yielded activations in the ventral striatum using a general linear model approach. Across both experiments, ICA revealed that both the right frontoparietal network and default mode network time courses were positively and negatively modulated by reward cues, respectively. Moreover, this dual neural response pattern was enhanced in individuals with strong reward sensitivity. Therefore, ICA may be a complementary tool to investigate the relevant role of attentional networks on reward processing, and to investigate reward sensitivity in normal and pathological populations. PMID:24696182

  13. Relationship between oscillatory neuronal activity during reward processing and trait impulsivity and sensation seeking.

    Gregor Leicht

    Full Text Available BACKGROUND: The processing of reward and punishment stimuli in humans appears to involve brain oscillatory activity of several frequencies, probably each with a distinct function. The exact nature of associations of these electrophysiological measures with impulsive or risk-seeking personality traits is not completely clear. Thus, the aim of the present study was to investigate event-related oscillatory activity during reward processing across a wide spectrum of frequencies, and its associations with impulsivity and sensation seeking in healthy subjects. METHODS: During recording of a 32-channel EEG 22 healthy volunteers were characterized with the Barratt Impulsiveness and the Sensation Seeking Scale and performed a computerized two-choice gambling task comprising different feedback options with positive vs. negative valence (gain or loss and high or low magnitude (5 vs. 25 points. RESULTS: We observed greater increases of amplitudes of the feedback-related negativity and of activity in the theta, alpha and low-beta frequency range following loss feedback and, in contrast, greater increase of activity in the high-beta frequency range following gain feedback. Significant magnitude effects were observed for theta and delta oscillations, indicating greater amplitudes upon feedback concerning large stakes. The theta amplitude changes during loss were negatively correlated with motor impulsivity scores, whereas alpha and low-beta increase upon loss and high-beta increase upon gain were positively correlated with various dimensions of sensation seeking. CONCLUSIONS: The findings suggest that the processing of feedback information involves several distinct processes, which are subserved by oscillations of different frequencies and are associated with different personality traits.

  14. Reward-related dorsal striatal activity differences between former and current cocaine dependent individuals during an interactive competitive game.

    Hyatt, Christopher J; Assaf, Michal; Muska, Christine E; Rosen, Rivkah I; Thomas, Andre D; Johnson, Matthew R; Hylton, Jennifer L; Andrews, Melissa M; Reynolds, Brady A; Krystal, John H; Potenza, Marc N; Pearlson, Godfrey D

    2012-01-01

    Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD) signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI) in current (CCD; n = 30) and former (FCD; n = 28) cocaine dependent subjects as well as healthy control (HC; n = 31) subjects while playing an interactive competitive Domino game involving risk-taking and reward/punishment processing. Out-of-scanner impulsivity-related measures were also collected. Although both FCD and CCD subjects scored significantly higher on impulsivity-related measures than did HC subjects, only FCD subjects had differences in striatal activation, specifically showing hypoactivation during their response to gains versus losses in right dorsal caudate, a brain region linked to habituation, cocaine craving and addiction maintenance. Right caudate activity in FCD subjects also correlated negatively with impulsivity-related measures of self-reported compulsivity and sensitivity to reward. These findings suggest that remitted cocaine dependence is associated with striatal dysfunction during social reward processing in a manner linked to compulsivity and reward sensitivity measures. Future research should investigate the extent to which such differences might reflect underlying vulnerabilities linked to cocaine-using propensities (e.g., relapses). PMID:22606228

  15. Reward-related dorsal striatal activity differences between former and current cocaine dependent individuals during an interactive competitive game.

    Christopher J Hyatt

    Full Text Available Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI in current (CCD; n = 30 and former (FCD; n = 28 cocaine dependent subjects as well as healthy control (HC; n = 31 subjects while playing an interactive competitive Domino game involving risk-taking and reward/punishment processing. Out-of-scanner impulsivity-related measures were also collected. Although both FCD and CCD subjects scored significantly higher on impulsivity-related measures than did HC subjects, only FCD subjects had differences in striatal activation, specifically showing hypoactivation during their response to gains versus losses in right dorsal caudate, a brain region linked to habituation, cocaine craving and addiction maintenance. Right caudate activity in FCD subjects also correlated negatively with impulsivity-related measures of self-reported compulsivity and sensitivity to reward. These findings suggest that remitted cocaine dependence is associated with striatal dysfunction during social reward processing in a manner linked to compulsivity and reward sensitivity measures. Future research should investigate the extent to which such differences might reflect underlying vulnerabilities linked to cocaine-using propensities (e.g., relapses.

  16. Dopaminergic reward sensitivity can promote adolescent health: A new perspective on the mechanism of ventral striatum activation

    Eva H. Telzer

    2016-02-01

    Full Text Available The prevailing view in the field of adolescent brain development is that heightened activity in the mesolimbic dopaminergic reward system serves as a liability, orienting adolescents toward risky behaviors, increasing their sensitivity to social evaluation and loss, and resulting in compromised well-being. Several findings inconsistent with this deficit view challenge the perspective that adolescent reward sensitivity largely serves as a liability and highlights the potential adaptive function that heightened striatal reactivity can serve. The goal of this review is to refine our understanding of dopaminergic reward sensitivity in adolescence. I review several studies showing that ventral striatum activation serves an adaptive function for adolescents’ health and well being relating to declines in both risk taking and depression and increases in cognitive persistence and achievement.

  17. Anticipation of monetary and social reward differently activates mesolimbic brain structures in men and women

    Spreckelmeyer, Katja N.; Krach, Sören; Kohls, Gregor; Rademacher, Lena; Irmak, Arda; Konrad, Kerstin; Kircher, Tilo; Gründer, Gerhard

    2009-01-01

    Motivation for goal-directed behaviour largely depends on the expected value of the anticipated reward. The aim of the present study was to examine how different levels of reward value are coded in the brain for two common forms of human reward: money and social approval. To account for gender differences 16 male and 16 female participants performed an incentive delay task expecting to win either money or positive social feedback. fMRI recording during the anticipation phase revealed proporti...

  18. Motor Planning under Unpredictable Reward: Modulations of Movement Vigor and Primate Striatum Activity

    Ioan eOpris

    2011-05-01

    Full Text Available Although reward probability is an important factor that shapes animal behavior, it is not well understood however, how the primate brain translates reward expectation into the vigor of movement (reaction time and speed. To address this question, we trained two monkeys in a reaction time task that required wrist movements in response to vibrotactile and visual stimuli, with a variable reward schedule. Correct performance was rewarded in 75 % of the trials. Monkeys were certain that they would be rewarded only in the trials immediately following withheld rewards. In these trials, the animals responded sooner and moved faster. Single-unit recordings from the dorsal striatum revealed that modulations in striatal neurons reflected such modulations of movement vigor. First, in the trials with certain rewards, striatal neurons modulated their firing rates earlier. Second, magnitudes of changes in neuronal firing rates depended on whether or not monkeys were certain about the reward. Third, these modulations depended on the sensory modality of the cue (visual vs. vibratory and/or movement direction (flexions vs. extensions. We conclude that dorsal striatum may be a part of the mechanism responsible for the modulation of movement vigor in response to changes of reward predictability.

  19. Relative Timing Between Kappa Opioid Receptor Activation and Cocaine Determines the Impact on Reward and Dopamine Release.

    Chartoff, Elena H; Ebner, Shayla R; Sparrow, Angela; Potter, David; Baker, Phillip M; Ragozzino, Michael E; Roitman, Mitchell F

    2016-03-01

    Negative affective states can increase the rewarding value of drugs of abuse and promote drug taking. Chronic cocaine exposure increases levels of the neuropeptide dynorphin, an endogenous ligand at kappa opioid receptors (KOR) that suppresses dopamine release in the nucleus accumbens (NAc) and elicits negative affective states upon drug withdrawal. However, there is evidence that the effects of KOR activation on affective state are biphasic: immediate aversive effects are followed by delayed increases in reward. The impact of KOR-induced affective states on reward-related effects of cocaine over time is not known. We hypothesize that the initial aversive effects of KOR activation increase, whereas the delayed rewarding effects decrease, the net effects of cocaine on reward and dopamine release. We treated rats with cocaine at various times (15 min to 48 h) after administration of the selective KOR agonist salvinorin A (salvA). Using intracranial self-stimulation and fast scan cyclic voltammetry, we found that cocaine-induced increases in brain stimulation reward and evoked dopamine release in the NAc core were potentiated when cocaine was administered within 1 h of salvA, but attenuated when administered 24 h after salvA. Quantitative real-time PCR was used to show that KOR and prodynorphin mRNA levels were decreased in the NAc, whereas tyrosine hydroxylase and dopamine transporter mRNA levels and tissue dopamine content were increased in the ventral tegmental area 24 h post-salvA. These findings raise the possibility that KOR activation-as occurs upon withdrawal from chronic cocaine-modulates vulnerability to cocaine in a time-dependent manner. PMID:26239494

  20. Operant behavior to obtain palatable food modifies ERK activity in the brain reward circuit.

    Guegan, Thomas; Cutando, Laura; Gangarossa, Giuseppe; Santini, Emanuela; Fisone, Gilberto; Martinez, Albert; Valjent, Emmanuel; Maldonado, Rafael; Martin, Miquel

    2013-03-01

    Food palatability produces behavioral modifications that resemble those induced by drugs of abuse. Palatability-induced behavioral changes require both, the activation of the endogenous cannabinoid system, and changes in structural plasticity in neurons of the brain reward pathway. The ERK intracellular pathway is activated by CB1 receptors (CB1-R) and plays a crucial role in neuroplasticity. We investigated the activation of the ERK signaling cascade in the mesocorticolimbic system induced by operant training to obtain highly palatable isocaloric food and the involvement of the CB1-R in these responses. Using immunofluorescence techniques, we analyzed changes in ERK intracellular pathway activation in the mesocorticolimbic system of wild-type and CB1 knockout mice (CB1-/-) trained on an operant paradigm to obtain standard, highly caloric or highly palatable isocaloric food. Operant training for highly palatable isocaloric food, but not for standard or highly caloric food, produced a robust activation of the ERK signaling cascade in the same brain areas where this training modified structural plasticity. These changes induced by the operant training were absent in CB1-/-. We can conclude that the activation of the ERK pathway is associated to the neuroplasticity induced by operant training for highly palatable isocaloric food and might be involved in CB1-R mediated alterations in behavior and structural plasticity. PMID:22580057

  1. An Activity for Demonstrating the Concept of a Neural Circuit

    Kreiner, David S.

    2012-01-01

    College students in two sections of a general psychology course participated in a demonstration of a simple neural circuit. The activity was based on a neural circuit that Jeffress proposed for localizing sounds. Students in one section responded to a questionnaire prior to participating in the activity, while students in the other section…

  2. Fat/carbohydrate ratio but not energy density determines snack food intake and activates brain reward areas

    Hoch, Tobias; Kreitz, Silke; Gaffling, Simone; Pischetsrieder, Monika; Hess, Andreas

    2015-01-01

    The snack food potato chips induces food intake in ad libitum fed rats, which is associated with modulation of the brain reward system and other circuits. Here, we show that food intake in satiated rats is triggered by an optimal fat/carbohydrate ratio. Like potato chips, an isocaloric fat/carbohydrate mixture influenced whole brain activity pattern of rats, affecting circuits related e.g. to reward/addiction, but the number of modulated areas and the extent of modulation was lower compared t...

  3. Identifying Emotions on the Basis of Neural Activation.

    Kassam, Karim S; Markey, Amanda R; Cherkassky, Vladimir L; Loewenstein, George; Just, Marcel Adam

    2013-01-01

    We attempt to determine the discriminability and organization of neural activation corresponding to the experience of specific emotions. Method actors were asked to self-induce nine emotional states (anger, disgust, envy, fear, happiness, lust, pride, sadness, and shame) while in an fMRI scanner. Using a Gaussian Naïve Bayes pooled variance classifier, we demonstrate the ability to identify specific emotions experienced by an individual at well over chance accuracy on the basis of: 1) neural activation of the same individual in other trials, 2) neural activation of other individuals who experienced similar trials, and 3) neural activation of the same individual to a qualitatively different type of emotion induction. Factor analysis identified valence, arousal, sociality, and lust as dimensions underlying the activation patterns. These results suggest a structure for neural representations of emotion and inform theories of emotional processing. PMID:23840392

  4. Disturbed anterior prefrontal control of the mesolimbic reward system and increased impulsivity in bipolar disorder.

    Trost, Sarah; Diekhof, Esther Kristina; Zvonik, Kerstin; Lewandowski, Mirjana; Usher, Juliana; Keil, Maria; Zilles, David; Falkai, Peter; Dechent, Peter; Gruber, Oliver

    2014-07-01

    Bipolar disorder (BD) is characterized by recurrent mood episodes ranging from severe depression to acute full-blown mania. Both states of this severe psychiatric disorder have been associated with alterations of reward processing in the brain. Here, we present results of a functional magnetic resonance imaging (fMRI) study on the neural correlates and functional interactions underlying reward gain processing and reward dismissal in favor of a long-term goal in bipolar patients. Sixteen medicated patients diagnosed with bipolar I disorder, euthymic to mildly depressed, and sixteen matched healthy controls performed the 'desire-reason dilemma' (DRD) paradigm demanding rejection of priorly conditioned reward stimuli to successfully pursue a superordinate goal. Both groups exhibited significant activations in reward-related brain regions, particularly in the mesolimbic reward system. However, bipolar patients showed reduced neural responses of the ventral striatum (vStr) when exploiting a reward stimulus, and exhibited a decreased suppression of the reward-related activation of the mesolimbic reward system while having to reject immediate reward in favor of the long-term goal. Further, functional interaction between the anteroventral prefrontal cortex and the vStr in the 'DRD' was significantly impaired in the bipolar group. These findings provide evidence for a reduced responsivity of the vStr to reward stimuli in BD, possibly related to clinical features like anhedonia. The disturbed top-down control of mesolimbic reward signals by prefrontal brain regions in BD can be interpreted in terms of a disease-related enhanced impulsivity, a trait marker of BD. PMID:24535101

  5. The influence of contextual reward statistics on risk preference.

    Rigoli, Francesco; Rutledge, Robb B; Dayan, Peter; Dolan, Raymond J

    2016-03-01

    Decision theories mandate that organisms should adjust their behaviour in the light of the contextual reward statistics. We tested this notion using a gambling choice task involving distinct contexts with different reward distributions. The best fitting model of subjects' behaviour indicated that the subjective values of options depended on several factors, including a baseline gambling propensity, a gambling preference dependent on reward amount, and a contextual reward adaptation factor. Combining this behavioural model with simultaneous functional magnetic resonance imaging we probed neural responses in three key regions linked to reward and value, namely ventral tegmental area/substantia nigra (VTA/SN), ventromedial prefrontal cortex (vmPFC) and ventral striatum (VST). We show that activity in the VTA/SN reflected contextual reward statistics to the extent that context affected behaviour, activity in the vmPFC represented a value difference between chosen and unchosen options while VST responses reflected a non-linear mapping between the actual objective rewards and their subjective value. The findings highlight a multifaceted basis for choice behaviour with distinct mappings between components of this behaviour and value sensitive brain regions. PMID:26707890

  6. Reward-Guided Learning with and without Causal Attribution.

    Jocham, Gerhard; Brodersen, Kay H; Constantinescu, Alexandra O; Kahn, Martin C; Ianni, Angela M; Walton, Mark E; Rushworth, Matthew F S; Behrens, Timothy E J

    2016-04-01

    When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. PMID:26971947

  7. Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

    Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

    2015-01-01

    Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes. PMID:25875594

  8. Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

    Alexander Niklas Häusler

    Full Text Available Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP, reward reception (RR and reward prediction errors (RPE showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.

  9. Activity patterns of cultured neural networks on micro electrode arrays

    Rutten, W.L.C.; Pelt, van J.

    2001-01-01

    A hybrid neuro-electronic interface is a cell-cultured micro electrode array, acting as a neural information transducer for stimulation and/or recording of neural activity in the brain or the spinal cord (ventral motor region or dorsal sensory region). It consists of an array of micro electrodes on

  10. Rewarding effort

    Alexander W. Cappelen; Tungodden, Bertil

    2004-01-01

    According to liberal egalitarian ethics, individuals should be rewarded for factors under their control, but not for factors outside their control. A fundamental challenge to liberal egalitarian theories of justice is how to do this without violating minimal egalitarian and liberal requirements. The paper analyses the effects of two such requirements: the principle of equal reward and the principle of reward independence. The exact formulations of these principles depend on how we interpret t...

  11. Rewarding effort

    Alexander W. Cappelen; Tungodden, Bertil

    2004-01-01

    According to liberal egalitarian ethics, individuals should be rewarded for factors under their control, but not for factors outside their control. A fundamental challenge to liberal egalitarian theories of justice is how to do this without violating minimal egalitarian and liberal requirements. The paper analyses the effects of two such requirements: the principle of equal reward and the principle of reward independence. The exact formulations of these principles depend on ...

  12. THE BRAIN CORRELATES OF THE EFFECTS OF MONETARY AND VERBAL REWARDS ON INTRINSIC MOTIVATION

    KonstanzeAlbrecht

    2014-09-01

    Full Text Available Apart from everyday duties, such as doing the laundry or cleaning the house, there are tasks we do for pleasure and enjoyment. We do such tasks, like solving crossword puzzles or reading novels, without any external pressure or force; instead, we are intrinsically motivated: We do the tasks because we enjoy doing them. Previous studies suggest that external rewards, i.e., rewards from the outside, affect the intrinsic motivation to engage in a task: While performance-based monetary rewards are perceived as controlling and induce a business-contract framing, verbal rewards praising one’s competence can enhance the perceived self-determination. Accordingly, the former have been shown to decrease intrinsic motivation, whereas the latter have been shown to increase intrinsic motivation. The present study investigated the neural processes underlying the effects of monetary and verbal rewards on intrinsic motivation in a group of 64 subjects applying functional magnetic resonance imaging (fMRI. We found that, when participants received positive performance feedback, activation in the anterior striatum and midbrain was affected by the nature of the reward; compared to a non-rewarded control group, activation was higher while monetary rewards were administered. However, we did not find a decrease in activation after reward withdrawal. In contrast, we found an increase in activation for verbal rewards: After verbal rewards had been withdrawn, participants showed a higher activation in the aforementioned brain areas when they received success compared to failure feedback. We further found that, while participants worked on the task, activation in the lateral prefrontal cortex was enhanced after the verbal rewards were administered and withdrawn.

  13. Regional brain activation supporting cognitive control in the context of reward is associated with treated adolescents’ marijuana problem severity at follow-up: A preliminary study

    Tammy Chung

    2015-12-01

    Full Text Available This preliminary study examined the extent to which regional brain activation during a reward cue antisaccade (AS task was associated with 6-month treatment outcome in adolescent substance users. Antisaccade performance provides a sensitive measure of executive function and cognitive control, and generally improves with reward cues. We hypothesized that when preparing to execute an AS, greater activation in regions associated with cognitive and oculomotor control supporting AS, particularly during reward cue trials, would be associated with lower substance use severity at 6-month follow-up. Adolescents (n = 14, ages 14–18 recruited from community-based outpatient treatment completed an fMRI reward cue AS task (reward and neutral conditions, and provided follow-up data. Results indicated that AS errors decreased in reward, compared to neutral, trials. AS behavioral performance, however, was not associated with treatment outcome. As hypothesized, activation in regions of interest (ROIs associated with cognitive (e.g., ventrolateral prefrontal cortex and oculomotor control (e.g., supplementary eye field during reward trials were inversely correlated with marijuana problem severity at 6-months. ROI activation during neutral trials was not associated with outcomes. Results support the role of motivational (reward cue factors to enhance cognitive control processes, and suggest a potential brain-based correlate of youth treatment outcome.

  14. Large-scale multielectrode recording and stimulation of neural activity

    Large circuits of neurons are employed by the brain to encode and process information. How this encoding and processing is carried out is one of the central questions in neuroscience. Since individual neurons communicate with each other through electrical signals (action potentials), the recording of neural activity with arrays of extracellular electrodes is uniquely suited for the investigation of this question. Such recordings provide the combination of the best spatial (individual neurons) and temporal (individual action-potentials) resolutions compared to other large-scale imaging methods. Electrical stimulation of neural activity in turn has two very important applications: it enhances our understanding of neural circuits by allowing active interactions with them, and it is a basis for a large variety of neural prosthetic devices. Until recently, the state-of-the-art in neural activity recording systems consisted of several dozen electrodes with inter-electrode spacing ranging from tens to hundreds of microns. Using silicon microstrip detector expertise acquired in the field of high-energy physics, we created a unique neural activity readout and stimulation framework that consists of high-density electrode arrays, multi-channel custom-designed integrated circuits, a data acquisition system, and data-processing software. Using this framework we developed a number of neural readout and stimulation systems: (1) a 512-electrode system for recording the simultaneous activity of as many as hundreds of neurons, (2) a 61-electrode system for electrical stimulation and readout of neural activity in retinas and brain-tissue slices, and (3) a system with telemetry capabilities for recording neural activity in the intact brain of awake, naturally behaving animals. We will report on these systems, their various applications to the field of neurobiology, and novel scientific results obtained with some of them. We will also outline future directions

  15. Large-scale multielectrode recording and stimulation of neural activity

    Sher, A. [Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA (United States)], E-mail: sasha@scipp.ucsc.edu; Chichilnisky, E.J. [Systems Neurobiology, Salk Institute, La Jolla, CA (United States); Dabrowski, W. [AGH University of Science and Technology, Cracow (Poland); Grillo, A.A.; Grivich, M. [Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA (United States); Gunning, D. [University of Glasgow, Glasgow (United Kingdom); Hottowy, P. [AGH University of Science and Technology, Cracow (Poland); Kachiguine, S.; Litke, A.M. [Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA (United States); Mathieson, K. [University of Glasgow, Glasgow (United Kingdom); Petrusca, D. [Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA (United States)

    2007-09-01

    Large circuits of neurons are employed by the brain to encode and process information. How this encoding and processing is carried out is one of the central questions in neuroscience. Since individual neurons communicate with each other through electrical signals (action potentials), the recording of neural activity with arrays of extracellular electrodes is uniquely suited for the investigation of this question. Such recordings provide the combination of the best spatial (individual neurons) and temporal (individual action-potentials) resolutions compared to other large-scale imaging methods. Electrical stimulation of neural activity in turn has two very important applications: it enhances our understanding of neural circuits by allowing active interactions with them, and it is a basis for a large variety of neural prosthetic devices. Until recently, the state-of-the-art in neural activity recording systems consisted of several dozen electrodes with inter-electrode spacing ranging from tens to hundreds of microns. Using silicon microstrip detector expertise acquired in the field of high-energy physics, we created a unique neural activity readout and stimulation framework that consists of high-density electrode arrays, multi-channel custom-designed integrated circuits, a data acquisition system, and data-processing software. Using this framework we developed a number of neural readout and stimulation systems: (1) a 512-electrode system for recording the simultaneous activity of as many as hundreds of neurons, (2) a 61-electrode system for electrical stimulation and readout of neural activity in retinas and brain-tissue slices, and (3) a system with telemetry capabilities for recording neural activity in the intact brain of awake, naturally behaving animals. We will report on these systems, their various applications to the field of neurobiology, and novel scientific results obtained with some of them. We will also outline future directions.

  16. Active reward processing during human sleep: insights from sleep-related eating disorder

    Lampros ePerogamvros; Roland eHasler; Patrick eBaud; Claude Robert Cloninger; Sophie eSchwartz; Stephen ePerrig

    2012-01-01

    In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED), a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity on reward-related questionnaires. In light of new evidence on the mesolimbic dopaminergic implication in co...

  17. Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus

    NAKAMURA, KAE; Matsumoto, Masayuki; Hikosaka, Okihide

    2008-01-01

    The dopamine system has been thought to play a central role in guiding behavior based on rewards. Recent pharmacological studies suggest that another monoamine neurotransmitter, serotonin, is also involved in reward processing. To elucidate the functional relationship between serotonin neurons and dopamine neurons, we performed single unit recording in the dorsal raphe nucleus (DRN), a major source of serotonin, and the substantia nigra pars compacta, a major source of dopamine, while monkeys...

  18. Increased ventral striatal BOLD activity during non-drug reward anticipation in cannabis users

    Nestor, Liam; Hester, Robert; Garavan, Hugh

    2009-01-01

    Despite an increased understanding of the pharmacology and long-term cognitive effects of cannabis in humans, there has been no research to date examining its chronic effects upon reward processing in the brain. Motivational theories regarding long-term drug use posit contrasting predictions with respect to how drug users are likely to process non-drug incentives. The reward deficiency syndrome (RDS) of addiction posits that there are deficits in dopamine (DA) motivational circuitry for non-d...

  19. Reward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing

    Victor Costumero; Alfonso Barrós-Loscertales; Juan Carlos Bustamante; Noelia Ventura-Campos; Paola Fuentes; Patricia Rosell-Negre; César Ávila

    2013-01-01

    The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men compl...

  20. Activity-dependent neural plasticity from bench to bedside.

    Ganguly, Karunesh; Poo, Mu-Ming

    2013-10-30

    Much progress has been made in understanding how behavioral experience and neural activity can modify the structure and function of neural circuits during development and in the adult brain. Studies of physiological and molecular mechanisms underlying activity-dependent plasticity in animal models have suggested potential therapeutic approaches for a wide range of brain disorders in humans. Physiological and electrical stimulations as well as plasticity-modifying molecular agents may facilitate functional recovery by selectively enhancing existing neural circuits or promoting the formation of new functional circuits. Here, we review the advances in basic studies of neural plasticity mechanisms in developing and adult nervous systems and current clinical treatments that harness neural plasticity, and we offer perspectives on future development of plasticity-based therapy. PMID:24183023

  1. An obesity-associated risk allele within the FTO gene affects human brain activity for areas important for emotion, impulse control and reward in response to food images.

    Wiemerslage, Lyle; Nilsson, Emil K; Solstrand Dahlberg, Linda; Ence-Eriksson, Fia; Castillo, Sandra; Larsen, Anna L; Bylund, Simon B A; Hogenkamp, Pleunie S; Olivo, Gaia; Bandstein, Marcus; Titova, Olga E; Larsson, Elna-Marie; Benedict, Christian; Brooks, Samantha J; Schiöth, Helgi B

    2016-05-01

    Understanding how genetics influences obesity, brain activity and eating behaviour will add important insight for developing strategies for weight-loss treatment, as obesity may stem from different causes and as individual feeding behaviour may depend on genetic differences. To this end, we examined how an obesity risk allele for the FTO gene affects brain activity in response to food images of different caloric content via functional magnetic resonance imaging (fMRI). Thirty participants homozygous for the rs9939609 single nucleotide polymorphism were shown images of low- or high-calorie food while brain activity was measured via fMRI. In a whole-brain analysis, we found that people with the FTO risk allele genotype (AA) had increased activity compared with the non-risk (TT) genotype in the posterior cingulate, cuneus, precuneus and putamen. Moreover, higher body mass index in the AA genotype was associated with reduced activity to food images in areas important for emotion (cingulate cortex), but also in areas important for impulse control (frontal gyri and lentiform nucleus). Lastly, we corroborate our findings with behavioural scales for the behavioural inhibition and activation systems. Our results suggest that the two genotypes are associated with differential neural processing of food images, which may influence weight status through diminished impulse control and reward processing. PMID:26797854

  2. Just watching the game ain’t enough: Striatal fMRI reward responses to successes and failures in a video game during active and vicarious playing

    Jari eKätsyri

    2013-06-01

    Full Text Available Although the multimodal stimulation provided by modern audiovisual video games is pleasing by itself, the rewarding nature of video game playing depends critically also on the players’ active engagement in the gameplay. The extent to which active engagement influences dopaminergic brain reward circuit responses remains unsettled. Here we show that striatal reward circuit responses elicited by successes (wins and failures (losses in a video game are stronger during active than vicarious gameplay. Eleven healthy males both played a competitive first-person tank shooter game (active playing and watched a pre-recorded gameplay video (vicarious playing while their hemodynamic brain activation was measured with 3-tesla functional magnetic resonance imaging (fMRI. Wins and losses were paired with symmetrical monetary rewards and punishments during active and vicarious playing so that the external reward context remained identical during both conditions. Brain activation was stronger in the orbitomedial prefrontal cortex (omPFC during winning than losing, both during active and vicarious playing conditions. In contrast, both wins and losses suppressed activations in the midbrain and striatum during active playing; however, the striatal suppression, particularly in the anterior putamen, was more pronounced during loss than win events. Sensorimotor confounds related to joystick movements did not account for the results. Self-ratings indicated losing to be more unpleasant during active than vicarious playing. Our findings demonstrate striatum to be selectively sensitive to self-acquired rewards, in contrast to frontal components of the reward circuit that process both self-acquired and passively received rewards. We propose that the striatal responses to repeated acquisition of rewards that are contingent on game related successes contribute to the motivational pull of video-game playing.

  3. Insula and striatum activity in effort-related monetary reward processing in gambling disorder: The role of depressive symptomatology

    Mira Fauth-Bühler

    2014-01-01

    Full Text Available The neurobiological underpinnings of effort-related monetary reward processing of gambling disorder have not been previously studied. To date neuroimaging studies lack in large sample sizes and as a consequence less attention has been given to brain reward processing that could potentially be attributed to comorbid conditions such as depressive mood state. We assessed monetary reward processing using an effort-dependent task during 3 tesla functional magnetic resonance imaging. We investigated a large sample of male, right-handed, slot-machine-playing disordered gamblers (DGs; N = 80 as well as age- and smoking-matched male healthy controls (HCs; N = 89. Depressive symptoms were assessed using the Beck Depression Inventory (BDI. DGs and HCs were divided into subgroups (“high” and “low” based on their BDI scores. Effort-related monetary reward processing did not differ between the complete groups of HCs and DGs. Brain activation during receipt of monetary reward though revealed a significant Group × BDI interaction: DGs with higher BDI scores compared to DGs with lower BDI scores showed greater brain activity in the right insula cortex and dorsal striatum while no differences were observed for HCs with higher versus lower BDI scores. Our results suggest that effort-related aspects of monetary motivation, i.e. when monetary output is tied to performance, are not altered in DG. Additionally, our findings strengthen the need for subgroup comparisons in future investigations of the disorder as part of a personalized medicine approach.

  4. A Neural Mechanism for Nonconscious Activation of Conditioned Placebo and Nocebo Responses.

    Jensen, Karin B; Kaptchuk, Ted J; Chen, Xiaoyan; Kirsch, Irving; Ingvar, Martin; Gollub, Randy L; Kong, Jian

    2015-10-01

    Fundamental aspects of human behavior operate outside of conscious awareness. Yet, theories of conditioned responses in humans, such as placebo and nocebo effects on pain, have a strong emphasis on conscious recognition of contextual cues that trigger the response. Here, we investigated the neural pathways involved in nonconscious activation of conditioned pain responses, using functional magnetic resonance imaging in healthy participants. Nonconscious compared with conscious activation of conditioned placebo analgesia was associated with increased activation of the orbitofrontal cortex, a structure with direct connections to affective brain regions and basic reward processing. During nonconscious nocebo, there was increased activation of the thalamus, amygdala, and hippocampus. In contrast to previous assumptions about conditioning in humans, our results show that conditioned pain responses can be elicited independently of conscious awareness and our results suggest a hierarchical activation of neural pathways for nonconscious and conscious conditioned responses. Demonstrating that the human brain has a nonconscious mechanism for responding to conditioned cues has major implications for the role of associative learning in behavioral medicine and psychiatry. Our results may also open up for novel approaches to translational animal-to-human research since human consciousness and animal cognition is an inherent paradox in all behavioral science. PMID:25452576

  5. Food reward, hyperphagia, and obesity

    Berthoud, Hans-Rudolf; Lenard, Natalie R.; Shin, Andrew C.

    2011-01-01

    Given the unabated obesity problem, there is increasing appreciation of expressions like “my eyes are bigger than my stomach,” and recent studies in rodents and humans suggest that dysregulated brain reward pathways may be contributing not only to drug addiction but also to increased intake of palatable foods and ultimately obesity. After describing recent progress in revealing the neural pathways and mechanisms underlying food reward and the attribution of incentive salience by internal stat...

  6. Technologies for imaging neural activity in large volumes.

    Ji, Na; Freeman, Jeremy; Smith, Spencer L

    2016-08-26

    Neural circuitry has evolved to form distributed networks that act dynamically across large volumes. Conventional microscopy collects data from individual planes and cannot sample circuitry across large volumes at the temporal resolution relevant to neural circuit function and behaviors. Here we review emerging technologies for rapid volume imaging of neural circuitry. We focus on two critical challenges: the inertia of optical systems, which limits image speed, and aberrations, which restrict the image volume. Optical sampling time must be long enough to ensure high-fidelity measurements, but optimized sampling strategies and point-spread function engineering can facilitate rapid volume imaging of neural activity within this constraint. We also discuss new computational strategies for processing and analyzing volume imaging data of increasing size and complexity. Together, optical and computational advances are providing a broader view of neural circuit dynamics and helping elucidate how brain regions work in concert to support behavior. PMID:27571194

  7. Neural Activity Reveals Preferences Without Choices

    Smith, Alec; Bernheim, B. Douglas; Camerer, Colin

    2014-01-01

    We investigate the feasibility of inferring the choices people would make (if given the opportunity) based on their neural responses to the pertinent prospects when they are not engaged in actual decision making. The ability to make such inferences is of potential value when choice data are unavailable, or limited in ways that render standard methods of estimating choice mappings problematic. We formulate prediction models relating choices to “non-choice” neural responses and use them to predict out-of-sample choices for new items and for new groups of individuals. The predictions are sufficiently accurate to establish the feasibility of our approach. PMID:25729468

  8. Brain activity in advantageous and disadvantageous situations: implications for reward/punishment sensitivity in different situations.

    Guangheng Dong

    Full Text Available OBJECTIVE: This study modeled win and lose trials in a simple gambling task to examine the effect of entire win-lose situations (WIN, LOSS, or TIE on single win/lose trials and related neural underpinnings. METHODS: The behavior responses and brain activities of 17 participants were recorded by an MRI scanner while they performed a gambling task. Different conditions were compared to determine the effect of the task on the behavior and brain activity of the participants. Correlations between brain activity and behavior were calculated to support the imaging results. RESULTS: In win trials, LOSS caused less intense posterior cingulate activity than TIE. In lose trials, LOSS caused more intense activity in the right superior temporal gyrus, bilateral superior frontal gyrus, bilateral anterior cingulate, bilateral insula cortex, and left orbitofrontal cortex than WIN and TIE. CONCLUSIONS: The experiences of the participants in win trials showed great similarity among different win-lose situations. However, the brain activity and behavior responses of the participants in lose trials indicated that they experienced stronger negative emotion in LOSS. The participants also showed an increased desire to win in LOSS than in WIN or TIE conditions.

  9. Market rewards to patterns of increasing earnings: effects of cash flow patterns, accruals manipulation, real activities manipulation and conservative accounting

    Liu, Su-Ping

    2013-01-01

    In this dissertation I investigate whether market rewards to a pattern of increasing earnings vary with certain signals of whether the pattern is genuine or fabricated. Among these signals, I examine growth in cash flows, accrual-based earnings management, earnings management through the manipulation of real operating activities, and conservative accounting. The findings show that market participants assign higher price-earnings multiples to firms when their pattern of increasi...

  10. Feedback associated with expectation for larger-reward improves visuospatial working memory performances in children with ADHD

    Rubi Hammer

    2015-08-01

    Full Text Available We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC boys underwent functional magnetic resonance imaging (fMRI while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small and feedback availability (no-feedback; feedback. While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory.

  11. Feedback associated with expectation for larger-reward improves visuospatial working memory performances in children with ADHD.

    Hammer, Rubi; Tennekoon, Michael; Cooke, Gillian E; Gayda, Jessica; Stein, Mark A; Booth, James R

    2015-08-01

    We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC) boys underwent functional magnetic resonance imaging (fMRI) while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small) and feedback availability (no-feedback; feedback). While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys) only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory. PMID:26142072

  12. Reward functions of the basal ganglia.

    Schultz, Wolfram

    2016-07-01

    Besides their fundamental movement function evidenced by Parkinsonian deficits, the basal ganglia are involved in processing closely linked non-motor, cognitive and reward information. This review describes the reward functions of three brain structures that are major components of the basal ganglia or are closely associated with the basal ganglia, namely midbrain dopamine neurons, pedunculopontine nucleus, and striatum (caudate nucleus, putamen, nucleus accumbens). Rewards are involved in learning (positive reinforcement), approach behavior, economic choices and positive emotions. The response of dopamine neurons to rewards consists of an early detection component and a subsequent reward component that reflects a prediction error in economic utility, but is unrelated to movement. Dopamine activations to non-rewarded or aversive stimuli reflect physical impact, but not punishment. Neurons in pedunculopontine nucleus project their axons to dopamine neurons and process sensory stimuli, movements and rewards and reward-predicting stimuli without coding outright reward prediction errors. Neurons in striatum, besides their pronounced movement relationships, process rewards irrespective of sensory and motor aspects, integrate reward information into movement activity, code the reward value of individual actions, change their reward-related activity during learning, and code own reward in social situations depending on whose action produces the reward. These data demonstrate a variety of well-characterized reward processes in specific basal ganglia nuclei consistent with an important function in non-motor aspects of motivated behavior. PMID:26838982

  13. Psychosocial versus physiological stress - Meta-analyses on deactivations and activations of the neural correlates of stress reactions.

    Kogler, Lydia; Müller, Veronika I; Chang, Amy; Eickhoff, Simon B; Fox, Peter T; Gur, Ruben C; Derntl, Birgit

    2015-10-01

    Stress is present in everyday life in various forms and situations. Two stressors frequently investigated are physiological and psychosocial stress. Besides similar subjective and hormonal responses, it has been suggested that they also share common neural substrates. The current study used activation-likelihood-estimation meta-analysis to test this assumption by integrating results of previous neuroimaging studies on stress processing. Reported results are cluster-level FWE corrected. The inferior frontal gyrus (IFG) and the anterior insula (AI) were the only regions that demonstrated overlapping activation for both stressors. Analysis of physiological stress showed consistent activation of cognitive and affective components of pain processing such as the insula, striatum, or the middle cingulate cortex. Contrarily, analysis across psychosocial stress revealed consistent activation of the right superior temporal gyrus and deactivation of the striatum. Notably, parts of the striatum appeared to be functionally specified: the dorsal striatum was activated in physiological stress, whereas the ventral striatum was deactivated in psychosocial stress. Additional functional connectivity and decoding analyses further characterized this functional heterogeneity and revealed higher associations of the dorsal striatum with motor regions and of the ventral striatum with reward processing. Based on our meta-analytic approach, activation of the IFG and the AI seems to indicate a global neural stress reaction. While physiological stress activates a motoric fight-or-flight reaction, during psychosocial stress attention is shifted towards emotion regulation and goal-directed behavior, and reward processing is reduced. Our results show the significance of differentiating physiological and psychosocial stress in neural engagement. Furthermore, the assessment of deactivations in addition to activations in stress research is highly recommended. PMID:26123376

  14. Active Engine Mounting Control Algorithm Using Neural Network

    Fadly Jashi Darsivan

    2009-01-01

    Full Text Available This paper proposes the application of neural network as a controller to isolate engine vibration in an active engine mounting system. It has been shown that the NARMA-L2 neurocontroller has the ability to reject disturbances from a plant. The disturbance is assumed to be both impulse and sinusoidal disturbances that are induced by the engine. The performance of the neural network controller is compared with conventional PD and PID controllers tuned using Ziegler-Nichols. From the result simulated the neural network controller has shown better ability to isolate the engine vibration than the conventional controllers.

  15. Activation instead of blocking mesolimbic dopaminergic reward circuitry is a preferred modality in the long term treatment of reward deficiency syndrome (RDS: a commentary

    Waite Roger L

    2008-11-01

    proliferation of D2 receptors. Proposal and conclusion The authors propose that D2 receptor stimulation can be accomplished via the use of Synapatmine™, a natural but therapeutic nutraceutical formulation that potentially induces DA release, causing the same induction of D2-directed mRNA and thus proliferation of D2 receptors in the human. This proliferation of D2 receptors in turn will induce the attenuation of craving behavior. In fact as mentioned earlier, this model has been proven in research showing DNA-directed compensatory overexpression (a form of gene therapy of the DRD2 receptors, resulting in a significant reduction in alcohol craving behavior in alcohol preferring rodents. Utilizing natural dopaminergic repletion therapy to promote long term dopaminergic activation will ultimately lead to a common, safe and effective modality to treat Reward Deficiency Syndrome (RDS behaviors including Substance Use Disorders (SUD, Attention Deficit Hyperactivity Disorder (ADHD, Obesity and other reward deficient aberrant behaviors. This concept is further supported by the more comprehensive understanding of the role of dopamine in the NAc as a "wanting" messenger in the meso-limbic DA system.

  16. Nucleus accumbens mediates relative motivation for rewards in the absence of choice

    John A Clithero

    2011-08-01

    Full Text Available To dissociate a choice from its antecedent neural states, motivation associated with the expected outcome must be captured in the absence of choice. Yet, the neural mechanisms that mediate behavioral idiosyncrasies in motivation, particularly with regard to complex economic preferences, are rarely examined in situations without overt decisions. We employed functional magnetic resonance imaging (fMRI in a large sample of participants while they anticipated earning rewards from two different modalities: monetary and candy rewards. An index for relative motivation toward different reward types was constructed using reaction times to the target for earning rewards. Activation in the nucleus accumbens (NAcc and anterior insula (aINS predicted individual variation in relative motivation between our reward modalities. NAcc activation, however, mediated the effects of aINS, indicating the NAcc is the likely source of this relative weighting. These results demonstrate that neural idiosyncrasies in reward efficacy exist even in the absence of explicit choices, and extend the role of NAcc as a critical brain region for such choice-free motivation.

  17. Lag Synchronization of Switched Neural Networks via Neural Activation Function and Applications in Image Encryption.

    Wen, Shiping; Zeng, Zhigang; Huang, Tingwen; Meng, Qinggang; Yao, Wei

    2015-07-01

    This paper investigates the problem of global exponential lag synchronization of a class of switched neural networks with time-varying delays via neural activation function and applications in image encryption. The controller is dependent on the output of the system in the case of packed circuits, since it is hard to measure the inner state of the circuits. Thus, it is critical to design the controller based on the neuron activation function. Comparing the results, in this paper, with the existing ones shows that we improve and generalize the results derived in the previous literature. Several examples are also given to illustrate the effectiveness and potential applications in image encryption. PMID:25594985

  18. Neural activity during encoding predicts false memories created by misinformation

    Okado, Yoko; Stark, Craig E.L.

    2005-01-01

    False memories are often demonstrated using the misinformation paradigm, in which a person's recollection of a witnessed event is altered after exposure to misinformation about the event. The neural basis of this phenomenon, however, remains unknown. We used fMRI to investigate encoding processes during the viewing of an event and misinformation to see whether neural activity during either encoding phase could predict what would be remembered. fMRI data were collected as participants studied ...

  19. Changes in brain activation associated with reward processing in smokers and nonsmokers

    Martin-Solch, C; Magyar, S; Kunig, G; Missimer, J; Schultz, W; Leenders, KL

    2001-01-01

    Tobacco smoking is the most frequent form of substance abuse. Several studies have shown that the addictive action of nicotine is mediated by the mesolimbic. dopamine system. This system is implicated in reward processing. In order to better understand the relationship between nicotine addiction and

  20. Learning to Discern Images Modifies Neural Activity

    Gregor Rainer; Han Lee; Logothetis, Nikos K.

    2004-01-01

    One of the most remarkable capabilities of the adult brain is its ability to learn and continuously adapt to an ever-changing environment. While many studies have documented how learning improves the perception and identification of visual stimuli, relatively little is known about how it modifies the underlying neural mechanisms. We trained monkeys to identify natural images that were degraded by interpolation with visual noise. We found that learning led to an improvement in monkeys' ability...

  1. Positive emotions and brain reward circuits in chronic pain.

    Navratilova, Edita; Morimura, Kozo; Xie, Jennifer Y; Atcherley, Christopher W; Ossipov, Michael H; Porreca, Frank

    2016-06-01

    Chronic pain is an important public health problem that negatively impacts the quality of life of affected individuals and exacts enormous socioeconomic costs. Chronic pain is often accompanied by comorbid emotional disorders including anxiety, depression, and possibly anhedonia. The neural circuits underlying the intersection of pain and pleasure are not well understood. We summarize recent human and animal investigations and demonstrate that aversive aspects of pain are encoded in brain regions overlapping with areas processing reward and motivation. We highlight findings revealing anatomical and functional alterations of reward/motivation circuits in chronic pain. Finally, we review supporting evidence for the concept that pain relief is rewarding and activates brain reward/motivation circuits. Adaptations in brain reward circuits may be fundamental to the pathology of chronic pain. Knowledge of brain reward processing in the context of pain could lead to the development of new therapeutics for the treatment of emotional aspects of pain and comorbid conditions. J. Comp. Neurol. 524:1646-1652, 2016. © 2016 Wiley Periodicals, Inc. PMID:26788716

  2. Optical imaging of neural and hemodynamic brain activity

    Schei, Jennifer Lynn

    Optical imaging technologies can be used to record neural and hemodynamic activity. Neural activity elicits physiological changes that alter the optical tissue properties. Specifically, changes in polarized light are concomitant with neural depolarization. We measured polarization changes from an isolated lobster nerve during action potential propagation using both reflected and transmitted light. In transmission mode, polarization changes were largest throughout the center of the nerve, suggesting that most of the optical signal arose from the inner nerve bundle. In reflection mode, polarization changes were largest near the edges, suggesting that most of the optical signal arose from the outer sheath. To overcome irregular cell orientation found in the brain, we measured polarization changes from a nerve tied in a knot. Our results show that neural activation produces polarization changes that can be imaged even without regular cell orientations. Neural activation expends energy resources and elicits metabolic delivery through blood vessel dilation, increasing blood flow and volume. We used spectroscopic imaging techniques combined with electrophysiological measurements to record evoked neural and hemodynamic responses from the auditory cortex of the rat. By using implantable optics, we measured responses across natural wake and sleep states, as well as responses following different amounts of sleep deprivation. During quiet sleep, evoked metabolic responses were larger compared to wake, perhaps because blood vessels were more compliant. When animals were sleep deprived, evoked hemodynamic responses were smaller following longer periods of deprivation. These results suggest that prolonged neural activity through sleep deprivation may diminish vascular compliance as indicated by the blunted vascular response. Subsequent sleep may allow vessels to relax, restoring their ability to deliver blood. These results also suggest that severe sleep deprivation or chronic

  3. Adolescent Depression: Stress and Reward Dysfunction

    Auerbach, Randy P.; Admon, Roee; Pizzagalli, Diego A.

    2014-01-01

    Adolescence is a peak period for the onset of depression, and it is also a time marked by substantial stress as well as neural development within the brain reward circuitry. In the current review, we provide a selective overview of current animal and human research investigating the relationship among reward processes, stress, and depression. Three separate, but related, etiological models examine the differential roles that stress may play with regard to reward dysfunction and adolescent dep...

  4. The rewarding nature of social interactions

    Sören Krach; Paulus, Frieder M.; Maren Bodden; TIlo Kircher

    2010-01-01

    The objective of this short review is to highlight rewarding aspects of social interactions for humans and discuss their neural basis. Thereby we report recent research findings to illustrate how social stimuli in general are processed in the reward system and highlight the role of Theory of Mind (ToM) as one mediating process for experiencing social reward during social interactions. In conclusion we discuss clinical implications for psychiatry and psychotherapy.

  5. Neural Network-Based Active Control for Offshore Platforms

    周亚军; 赵德有

    2003-01-01

    A new active control scheme, based on neural network, for the suppression of oscillation in multiple-degree-of-freedom (MDOF) offshore platforms, is studied in this paper. With the main advantages of neural network, i.e. the inherent robustness, fault tolerance, and generalized capability of its parallel massive interconnection structure, the active structural control of offshore platforms under random waves is accomplished by use of the BP neural network model. The neural network is trained offline with the data generated from numerical analysis, and it simulates the process of Classical Linear Quadratic Regular Control for the platform under random waves. After the learning phase, the trained network has learned about the nonlinear dynamic behavior of the active control system, and is capable of predicting the active control forces of the next time steps. The results obtained show that the active control is feasible and effective, and it finally overcomes time delay owing to the robustness, fault tolerance, and generalized capability of artificial neural network.

  6. High Accuracy Human Activity Monitoring using Neural network

    Sharma, Annapurna; Chung, Wan-Young

    2011-01-01

    This paper presents the designing of a neural network for the classification of Human activity. A Triaxial accelerometer sensor, housed in a chest worn sensor unit, has been used for capturing the acceleration of the movements associated. All the three axis acceleration data were collected at a base station PC via a CC2420 2.4GHz ISM band radio (zigbee wireless compliant), processed and classified using MATLAB. A neural network approach for classification was used with an eye on theoretical and empirical facts. The work shows a detailed description of the designing steps for the classification of human body acceleration data. A 4-layer back propagation neural network, with Levenberg-marquardt algorithm for training, showed best performance among the other neural network training algorithms.

  7. Serotonergic modulation of reward and punishment

    Macoveanu, Julian

    2014-01-01

    Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line of...... evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions....... Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward...

  8. Active Reward Processing during Human Sleep: Insights from Sleep-Related Eating Disorder

    Perogamvros, Lampros; Baud, Patrick; Hasler, Roland; Cloninger, Claude Robert; Schwartz, Sophie; Perrig, Stephen

    2012-01-01

    In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED), a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography, a dream diary and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating di...

  9. Biological substrates of reward and aversion: a nucleus accumbens activity hypothesis

    Carlezon, William A; Thomas, Mark J.

    2008-01-01

    The nucleus accumbens (NAc) is a critical element of the mesocorticolimbic system, a brain circuit implicated in reward and motivation. This basal forebrain structure receives dopamine (DA) input from the ventral tegmental area (VTA) and glutamate (GLU) input from regions including the prefrontal cortex (PFC), amygdala (AMG), and hippocampus (HIP). As such, it integrates inputs from limbic and cortical regions, linking motivation with action. The NAc has a well-established role in mediating t...

  10. A neural link between affective understanding and interpersonal attraction.

    Anders, Silke; de Jong, Roos; Beck, Christian; Haynes, John-Dylan; Ethofer, Thomas

    2016-04-19

    Being able to comprehend another person's intentions and emotions is essential for successful social interaction. However, it is currently unknown whether the human brain possesses a neural mechanism that attracts people to others whose mental states they can easily understand. Here we show that the degree to which a person feels attracted to another person can change while they observe the other's affective behavior, and that these changes depend on the observer's confidence in having correctly understood the other's affective state. At the neural level, changes in interpersonal attraction were predicted by activity in the reward system of the observer's brain. Importantly, these effects were specific to individual observer-target pairs and could not be explained by a target's general attractiveness or expressivity. Furthermore, using multivoxel pattern analysis (MVPA), we found that neural activity in the reward system of the observer's brain varied as a function of how well the target's affective behavior matched the observer's neural representation of the underlying affective state: The greater the match, the larger the brain's intrinsic reward signal. Taken together, these findings provide evidence that reward-related neural activity during social encounters signals how well an individual's "neural vocabulary" is suited to infer another person's affective state, and that this intrinsic reward might be a source of changes in interpersonal attraction. PMID:27044071

  11. Phosphoproteomics of the Dopamine Pathway Enables Discovery of Rap1 Activation as a Reward Signal In Vivo.

    Nagai, Taku; Nakamuta, Shinichi; Kuroda, Keisuke; Nakauchi, Sakura; Nishioka, Tomoki; Takano, Tetsuya; Zhang, Xinjian; Tsuboi, Daisuke; Funahashi, Yasuhiro; Nakano, Takashi; Yoshimoto, Junichiro; Kobayashi, Kenta; Uchigashima, Motokazu; Watanabe, Masahiko; Miura, Masami; Nishi, Akinori; Kobayashi, Kazuto; Yamada, Kiyofumi; Amano, Mutsuki; Kaibuchi, Kozo

    2016-02-01

    Dopamine (DA) type 1 receptor (D1R) signaling in the striatum presumably regulates neuronal excitability and reward-related behaviors through PKA. However, whether and how D1Rs and PKA regulate neuronal excitability and behavior remain largely unknown. Here, we developed a phosphoproteomic analysis method to identify known and novel PKA substrates downstream of the D1R and obtained more than 100 candidate substrates, including Rap1 GEF (Rasgrp2). We found that PKA phosphorylation of Rasgrp2 activated its guanine nucleotide-exchange activity on Rap1. Cocaine exposure activated Rap1 in the nucleus accumbens in mice. The expression of constitutively active PKA or Rap1 in accumbal D1R-expressing medium spiny neurons (D1R-MSNs) enhanced neuronal firing rates and behavioral responses to cocaine exposure through MAPK. Knockout of Rap1 in the accumbal D1R-MSNs was sufficient to decrease these phenotypes. These findings demonstrate a novel DA-PKA-Rap1-MAPK intracellular signaling mechanism in D1R-MSNs that increases neuronal excitability to enhance reward-related behaviors. PMID:26804993

  12. Reward Processing in Unipolar and Bipolar Depression: A Functional MRI Study.

    Redlich, Ronny; Dohm, Katharina; Grotegerd, Dominik; Opel, Nils; Zwitserlood, Pienie; Heindel, Walter; Arolt, Volker; Kugel, Harald; Dannlowski, Udo

    2015-10-01

    Differentiating bipolar disorders (BD) from unipolar depression (UD) remains a major clinical challenge. The identification of neurobiological markers may help to differentiate these disorders, particularly during depressive episodes. This cross-sectional study, including 33 patients with UD, 33 patients with BD, and 34 healthy controls, is one of the first to directly compare UD and BD with respect to reward processing. A card-guessing paradigm was employed and brain activity associated with reward processing was investigated by means of fMRI. A 3 (group) × 2 (condition: reward>control, loss>control) ANOVA was conducted using the nucleus accumbens (NAcc) as ROI. Furthermore, a whole-brain approach was applied. A functional connectivity analysis was performed to characterize diagnosis-related alterations in the functional coupling between the NAcc and other brain areas. The ANOVA revealed higher activity for healthy controls (HCs) than for BD and UD in the NAcc during reward processing. Moreover, UD showed a higher functional connectivity between the NAcc and the VTA than HC. The patients groups could be differentiated in that BD showed a decreased activation, in the reward condition, of the NAcc, caudate nucleus, thalamus, putamen, insula, and prefrontal areas compared with UD. These results may help to refine the understanding of neural correlates of reward processing in both disorders, and to understand the neural underpinnings of anhedonia, a core symptom of depressive episodes. PMID:25881114

  13. Design of 3D Active Multichannel Silicon Neural Microelectrode

    WANG Di; ZHANG Guoxiong; LI Xingfei

    2006-01-01

    To find a design method for 3D active multichannel silicon microelectrode,a microstructure of active neural recording system is presented,where two 2D probes,two integrated circuits and two spacers are microassembled on a 5 mm ×7 mm silicon platform,and 32 sites neural signals can be operated simultaneously.A theoretical model for measuring the neural signal by the silicon microelectrode is proposed based on the structure and fabrication process of a single-shank probe.The method of determining the dimensional parameters of the probe shank is discussed in the following three aspects,i.e.the structures of pallium and endocranium,coupled interconnecters noise,and strength characteristic of neural probe.The design criterion is to minimize the size of the neural probe as well as that the probe has enough stiffness to pierce the endocranium.The on-chip unity-gain bandpass amplifier has an overall gain of 42 dB over a bandwidth from 60 Hz to 10 kHz;and the DC-baseline stability circuit is of high input resistance above 30 MΩ to guarantee a cutoff frequency below 100 Hz.The circuit works in stimulating or recording modes.The conversion of the modes depends on the stimulating control signal.

  14. Cultured Neural Networks: Optimization of Patterned Network Adhesiveness and Characterization of their Neural Activity

    W. L. C. Rutten

    2006-01-01

    Full Text Available One type of future, improved neural interface is the “cultured probe”. It is a hybrid type of neural information transducer or prosthesis, for stimulation and/or recording of neural activity. It would consist of a microelectrode array (MEA on a planar substrate, each electrode being covered and surrounded by a local circularly confined network (“island” of cultured neurons. The main purpose of the local networks is that they act as biofriendly intermediates for collateral sprouts from the in vivo system, thus allowing for an effective and selective neuron–electrode interface. As a secondary purpose, one may envisage future information processing applications of these intermediary networks. In this paper, first, progress is shown on how substrates can be chemically modified to confine developing networks, cultured from dissociated rat cortex cells, to “islands” surrounding an electrode site. Additional coating of neurophobic, polyimide-coated substrate by triblock-copolymer coating enhances neurophilic-neurophobic adhesion contrast. Secondly, results are given on neuronal activity in patterned, unconnected and connected, circular “island” networks. For connected islands, the larger the island diameter (50, 100 or 150 μm, the more spontaneous activity is seen. Also, activity may show a very high degree of synchronization between two islands. For unconnected islands, activity may start at 22 days in vitro (DIV, which is two weeks later than in unpatterned networks.

  15. Denial of reward in the neonate shapes sociability and serotonergic activity in the adult rat.

    Anastasia Diamantopoulou

    Full Text Available BACKGROUND: Manipulations of the early environment are linked to long-lasting alterations of emotionality and social capabilities. Denial of rewarding mother-pup interactions in early life of rats could serve as model for child neglect. Negative consequences for social competence in later life, accompanied by changes in the serotonergic system would be expected. In contrast, rewarding mother-pup contact should promote adequate social abilities. METHODOLOGY/PRINCIPAL FINDINGS: Male Wistar rats trained in a T-maze during postnatal days 10-13 under denial (DER or permission (RER of maternal contact were tested for play behavior in adolescence and for coping with defeat in adulthood. We estimated serotonin (5-HT levels in the brain under basal conditions and following defeat, as well as serotonin receptor 1A (5-HT1A and serotonin transporter (SERT expression. DER rats exhibited increased aggressive-like play behavior in adolescence (i.e. increased nape attacks, p<0.0001 and selected a proactive coping style during defeat in adulthood (higher sum of proactive behaviors: number of attacks, flights, rearings and defensive upright posture; p = 0.011, p<0.05 vs RER, non-handled-NH. In adulthood, they had lower 5-HT levels in both the prefrontal cortex (p<0.05 vs RER and the amygdala (p<0.05 vs NH, increased 5-HT levels following defeat (PFC p<0.0001 and decreased serotonin turnover (amygdala p = 0.008. The number of 5-HT1A immunopositive cells in the CA1 hippocampal area was increased (p<0.05 DER, vs RER, NH; SERT levels in the amygdala were elevated (p<0.05 vs RER, NH, but were lower in the prefrontal cortex (p<0.05 vs NH. CONCLUSIONS/SIGNIFICANCE: Denial of expected maternal reward early in life negatively affects sociability and the serotonergic system in a complex manner. We propose that our animal model could contribute to the identification of the neurobiological correlates of early neglect effects on social behavior and coping with challenges, but

  16. Tools for Resolving Functional Activity and Connectivity within Intact Neural Circuits

    Jennings, Joshua H.; Stuber, Garret D.

    2014-01-01

    Mammalian neural circuits are sophisticated biological systems that choreograph behavioral processes vital for survival. While the inherent complexity of discrete neural circuits has proven difficult to decipher, many parallel methodological developments promise to help delineate the function and connectivity of molecularly defined neural circuits. Here, we review recent technological advances designed to precisely monitor and manipulate neural circuit activity. We propose a holistic, multifa...

  17. Deficits in context-dependent adaptive coding of reward in schizophrenia

    Kirschner, Matthias; Hager, Oliver M.; Bischof, Martin; Hartmann-Riemer, Matthias N; Kluge, Agne; Seifritz, Erich; Tobler, Philippe N.; Kaiser, Stefan

    2016-01-01

    Theoretical principles of information processing and empirical findings suggest that to efficiently represent all possible rewards in the natural environment, reward-sensitive neurons have to adapt their coding range dynamically to the current reward context. Adaptation ensures that the reward system is most sensitive for the most likely rewards, enabling the system to efficiently represent a potentially infinite range of reward information. A deficit in neural adaptation would prevent precis...

  18. Forward shift of feeding buzz components of dolphins and belugas during associative learning reveals a likely connection to reward expectation, pleasure and brain dopamine activation.

    Ridgway, S H; Moore, P W; Carder, D A; Romano, T A

    2014-08-15

    For many years, we heard sounds associated with reward from dolphins and belugas. We named these pulsed sounds victory squeals (VS), as they remind us of a child's squeal of delight. Here we put these sounds in context with natural and learned behavior. Like bats, echolocating cetaceans produce feeding buzzes as they approach and catch prey. Unlike bats, cetaceans continue their feeding buzzes after prey capture and the after portion is what we call the VS. Prior to training (or conditioning), the VS comes after the fish reward; with repeated trials it moves to before the reward. During training, we use a whistle or other sound to signal a correct response by the animal. This sound signal, named a secondary reinforcer (SR), leads to the primary reinforcer, fish. Trainers usually name their whistle or other SR a bridge, as it bridges the time gap between the correct response and reward delivery. During learning, the SR becomes associated with reward and the VS comes after the SR rather than after the fish. By following the SR, the VS confirms that the animal expects a reward. Results of early brain stimulation work suggest to us that SR stimulates brain dopamine release, which leads to the VS. Although there are no direct studies of dopamine release in cetaceans, we found that the timing of our VS is consistent with a response after dopamine release. We compared trained vocal responses to auditory stimuli with VS responses to SR sounds. Auditory stimuli that did not signal reward resulted in faster responses by a mean of 151 ms for dolphins and 250 ms for belugas. In laboratory animals, there is a 100 to 200 ms delay for dopamine release. VS delay in our animals is similar and consistent with vocalization after dopamine release. Our novel observation suggests that the dopamine reward system is active in cetacean brains. PMID:25122919

  19. Neural Activity When People Solve Verbal Problems with Insight

    Jung-Beeman Mark

    2004-01-01

    Full Text Available People sometimes solve problems with a unique process called insight, accompanied by an "Aha!" experience. It has long been unclear whether different cognitive and neural processes lead to insight versus noninsight solutions, or if solutions differ only in subsequent subjective feeling. Recent behavioral studies indicate distinct patterns of performance and suggest differential hemispheric involvement for insight and noninsight solutions. Subjects solved verbal problems, and after each correct solution indicated whether they solved with or without insight. We observed two objective neural correlates of insight. Functional magnetic resonance imaging (Experiment 1 revealed increased activity in the right hemisphere anterior superior temporal gyrus for insight relative to noninsight solutions. The same region was active during initial solving efforts. Scalp electroencephalogram recordings (Experiment 2 revealed a sudden burst of high-frequency (gamma-band neural activity in the same area beginning 0.3 s prior to insight solutions. This right anterior temporal area is associated with making connections across distantly related information during comprehension. Although all problem solving relies on a largely shared cortical network, the sudden flash of insight occurs when solvers engage distinct neural and cognitive processes that allow them to see connections that previously eluded them.

  20. Memory and reward systems coproduce 'nostalgic' experiences in the brain.

    Oba, Kentaro; Noriuchi, Madoka; Atomi, Tomoaki; Moriguchi, Yoshiya; Kikuchi, Yoshiaki

    2016-07-01

    People sometimes experience an emotional state known as 'nostalgia', which involves experiencing predominantly positive emotions while remembering autobiographical events. Nostalgia is thought to play an important role in psychological resilience. Previous neuroimaging studies have shown involvement of memory and reward systems in such experiences. However, it remains unclear how these two systems are collaboratively involved with nostalgia experiences. Here, we conducted a functional magnetic resonance imaging study of healthy females to investigate the relationship between memory-reward co-activation and nostalgia, using childhood-related visual stimuli. Moreover, we examined the factors constituting nostalgia and their neural correlates. We confirmed the presence of nostalgia-related activity in both memory and reward systems, including the hippocampus (HPC), substantia nigra/ventral tegmental area (SN/VTA), and ventral striatum (VS). We also found significant HPC-VS co-activation, with its strength correlating with individual 'nostalgia tendencies'. Factor analyses showed that two dimensions underlie nostalgia: emotional and personal significance and chronological remoteness, with the former correlating with caudal SN/VTA and left anterior HPC activity, and the latter correlating with rostral SN/VTA activity. These findings demonstrate the cooperative activity of memory and reward systems, where each system has a specific role in the construction of the factors that underlie the experience of nostalgia. PMID:26060325

  1. Activity-dependent modulation of neural circuit synaptic connectivity

    Tessier, Charles R.; Kendal Broadie

    2009-01-01

    In many nervous systems, the establishment of neural circuits is known to proceed via a two-stage process; 1) early, activity-independent wiring to produce a rough map characterized by excessive synaptic connections, and 2) subsequent, use-dependent pruning to eliminate inappropriate connections and reinforce maintained synapses. In invertebrates, however, evidence of the activity-dependent phase of synaptic refinement has been elusive, and the dogma has long been that invertebrate circ...

  2. Early interfaced neural activity from chronic amputated nerves

    Kshitija Garde

    2009-05-01

    Full Text Available Direct interfacing of transected peripheral nerves with advanced robotic prosthetic devices has been proposed as a strategy for achieving natural motor control and sensory perception of such bionic substitutes, thus fully functionally replacing missing limbs in amputees. Multi-electrode arrays placed in the brain and peripheral nerves have been used successfully to convey neural control of prosthetic devices to the user. However, reactive gliosis, micro hemorrhages, axonopathy and excessive inflammation, currently limit their long-term use. Here we demonstrate that enticement of peripheral nerve regeneration through a non-obstructive multi-electrode array, after either acute or chronic nerve amputation, offers a viable alternative to obtain early neural recordings and to enhance long-term interfacing of nerve activity. Non restrictive electrode arrays placed in the path of regenerating nerve fibers allowed the recording of action potentials as early as 8 days post-implantation with high signal-to-noise ratio, as long as 3 months in some animals, and with minimal inflammation at the nerve tissue-metal electrode interface. Our findings suggest that regenerative on-dependent multi-electrode arrays of open design allow the early and stable interfacing of neural activity from amputated peripheral nerves and might contribute towards conveying full neural control and sensory feedback to users of robotic prosthetic devices. .

  3. Application of neural networks to seismic active control

    An exploratory study on seismic active control using an artificial neural network (ANN) is presented in which a singledegree-of-freedom (SDF) structural system is controlled by a trained neural network. A feed-forward neural network and the backpropagation training method are used in the study. In backpropagation training, the learning rate is determined by ensuring the decrease of the error function at each training cycle. The training patterns for the neural net are generated randomly. Then, the trained ANN is used to compute the control force according to the control algorithm. The control strategy proposed herein is to apply the control force at every time step to destroy the build-up of the system response. The ground motions considered in the simulations are the N21E and N69W components of the Lake Hughes No. 12 record that occurred in the San Fernando Valley in California on February 9, 1971. Significant reduction of the structural response by one order of magnitude is observed. Also, it is shown that the proposed control strategy has the ability to reduce the peak that occurs during the first few cycles of the time history. These promising results assert the potential of applying ANNs to active structural control under seismic loads

  4. Dynamical criticality in the collective activity of a neural population

    Mora, Thierry

    The past decade has seen a wealth of physiological data suggesting that neural networks may behave like critical branching processes. Concurrently, the collective activity of neurons has been studied using explicit mappings to classic statistical mechanics models such as disordered Ising models, allowing for the study of their thermodynamics, but these efforts have ignored the dynamical nature of neural activity. I will show how to reconcile these two approaches by learning effective statistical mechanics models of the full history of the collective activity of a neuron population directly from physiological data, treating time as an additional dimension. Applying this technique to multi-electrode recordings from retinal ganglion cells, and studying the thermodynamics of the inferred model, reveals a peak in specific heat reminiscent of a second-order phase transition.

  5. Perception Neural Networks for Active Noise Control Systems

    Wang Xiaoli

    2012-11-01

    Full Text Available In a response to a growing demand for environments of 70dB or less noise levels, many industrial sectors have focused with some form of noise control system. Active noise control (ANC has proven to be the most effective technology. This paper mainly investigates application of neural network on self-adaptation system in active noise control (ANC. An active silencing control system is made which adopts a motional feedback loudspeaker as not a noise controlling source but a detecting sensor. The working fundamentals and the characteristics of the motional feedback loudspeaker are analyzed in detail. By analyzing each acoustical path, identification based adaptive linear neural network is built. This kind of identifying method can be achieved conveniently. The estimated result of each sound channel matches well with its real sound character, respectively.

  6. Functional connectivity of reward processing in the brain

    2009-01-01

    Full Text Available Controversial results have been reported concerning the neural mechanisms involved in the processing of rewards and punishments. On the one hand, there is evidence suggesting that monetary gains and losses activate a similar fronto-subcortical network. On the other hand, results of recent studies imply that reward and punishment may engage distinct neural mechanisms. Using functional magnetic resonance imaging we investigated both regional and interregional functional connectivity patterns while participants performed a gambling task featuring unexpectedly high monetary gains and losses. Classical univariate statistical analysis showed that monetary gains and losses activated a similar fronto-striatal-limbic network, in which main activation peaks were observed bilaterally in the ventral striatum. Functional connectivity analysis showed similar responses for gain and loss conditions in the insular cortex, the amygdala, and the hippocampus that correlated with the activity observed in the seed region ventral striatum, with the connectivity to the amygdale appearing more pronounced after losses. Larger functional connectivity was found to the medial OFC for negative outcomes. The fact that different functional patterns were obtained with both analyses suggests that the brain activations observed in the classical univariate approach identifies the involvement of different functional networks in a current task. These results stress the importance of studying functional connectivity in addition to standard fMRI analysis in reward-related studies.

  7. Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion

    Blood, Anne J.; Zatorre, Robert J.

    2001-01-01

    We used positron emission tomography to study neural mechanisms underlying intensely pleasant emotional responses to music. Cerebral blood flow changes were measured in response to subject-selected music that elicited the highly pleasurable experience of “shivers-down-the-spine” or “chills.” Subjective reports of chills were accompanied by changes in heart rate, electromyogram, and respiration. As intensity of these chills increased, cerebral blood flow increases a...

  8. The effects of gratitude expression on neural activity.

    Kini, Prathik; Wong, Joel; McInnis, Sydney; Gabana, Nicole; Brown, Joshua W

    2016-03-01

    Gratitude is a common aspect of social interaction, yet relatively little is known about the neural bases of gratitude expression, nor how gratitude expression may lead to longer-term effects on brain activity. To address these twin issues, we recruited subjects who coincidentally were entering psychotherapy for depression and/or anxiety. One group participated in a gratitude writing intervention, which required them to write letters expressing gratitude. The therapy-as-usual control group did not perform a writing intervention. After three months, subjects performed a "Pay It Forward" task in the fMRI scanner. In the task, subjects were repeatedly endowed with a monetary gift and then asked to pass it on to a charitable cause to the extent they felt grateful for the gift. Operationalizing gratitude as monetary gifts allowed us to engage the subjects and quantify the gratitude expression for subsequent analyses. We measured brain activity and found regions where activity correlated with self-reported gratitude experience during the task, even including related constructs such as guilt motivation and desire to help as statistical controls. These were mostly distinct from brain regions activated by empathy or theory of mind. Also, our between groups cross-sectional study found that a simple gratitude writing intervention was associated with significantly greater and lasting neural sensitivity to gratitude - subjects who participated in gratitude letter writing showed both behavioral increases in gratitude and significantly greater neural modulation by gratitude in the medial prefrontal cortex three months later. PMID:26746580

  9. MONITORING EXTRACELLULAR PH, OXYGEN, AND DOPAMINE DURING REWARD DELIVERY IN THE STRIATUM OF PRIMATES

    Jennifer L Ariansen

    2012-07-01

    Full Text Available Dopamine projections that extend from the ventral tegmental area to the striatum have been implicated in the biological basis for behaviors associated with reward and addiction. Until recently, it has been difficult to evaluate the complex balance of energy utilization and neural activity in the striatum. Many techniques such as electrophysiology, functional magnetic resonance imaging (fMRI, and fast-scan cyclic voltammetry have been employed to monitor these neurochemical and neurophysiological changes. In this brain region, physiological responses to cues and rewards cause local, transient pH changes. Oxygen and pH are coupled in the brain through a complex system of blood flow and metabolism as a result of transient neural activity. Indeed, this balance is at the heart of imaging studies such as fMRI. To this end, we measured pH and O2 changes with fast-scan cyclic voltammetry in the striatum as indices of changes in metabolism and blood flow in vivo in three Macaca mulatta monkeys. The animals were presented with Pavlovian conditioned cues that predicted different probabilities of liquid reward. They also received free reward without predictive cues. The primary change consisted of pH shifts in the striatal extracellular environment following the reward predicting cues or the free reward. We observed three types of cue responses which consisted of purely basic pH shifts, basic pH shifts followed by acidic pH shifts, and purely acidic pH shifts. These responses increased with reward probability. The pH changes were accompanied by increases in extracellular O2. The changes in pH and extracellular O2 are consistent with current theories of metabolism and blood flow. The findings suggest a role of these chemical responses in neuronal reward processing

  10. Activated sludge process based on artificial neural network

    张文艺; 蔡建安

    2002-01-01

    Considering the difficulty of creating water quality model for activated sludge system, a typical BP artificial neural network model has been established to simulate the operation of a waste water treatment facilities. The comparison of prediction results with the on-spot measurements shows the model, the model is accurate and this model can also be used to realize intelligentized on-line control of the wastewater processing process.

  11. Optimal Coding Predicts Attentional Modulation of Activity in Neural Systems

    Jaramillo, Santiago; Pearlmutter, Barak A.

    2007-01-01

    Neuronal activity in response to a fixed stimulus has been shown to change as a function of attentional state, implying that the neural code also changes with attention. We propose an information-theoretic account of such modulation: that the nervous system adapts to optimally encode sensory stimuli while taking into account the changing relevance of different features. We show using computer simulation that such modulation emerges in a coding system informed about the uneven relevance of ...

  12. Efficient universal computing architectures for decoding neural activity.

    Benjamin I Rapoport

    Full Text Available The ability to decode neural activity into meaningful control signals for prosthetic devices is critical to the development of clinically useful brain- machine interfaces (BMIs. Such systems require input from tens to hundreds of brain-implanted recording electrodes in order to deliver robust and accurate performance; in serving that primary function they should also minimize power dissipation in order to avoid damaging neural tissue; and they should transmit data wirelessly in order to minimize the risk of infection associated with chronic, transcutaneous implants. Electronic architectures for brain- machine interfaces must therefore minimize size and power consumption, while maximizing the ability to compress data to be transmitted over limited-bandwidth wireless channels. Here we present a system of extremely low computational complexity, designed for real-time decoding of neural signals, and suited for highly scalable implantable systems. Our programmable architecture is an explicit implementation of a universal computing machine emulating the dynamics of a network of integrate-and-fire neurons; it requires no arithmetic operations except for counting, and decodes neural signals using only computationally inexpensive logic operations. The simplicity of this architecture does not compromise its ability to compress raw neural data by factors greater than [Formula: see text]. We describe a set of decoding algorithms based on this computational architecture, one designed to operate within an implanted system, minimizing its power consumption and data transmission bandwidth; and a complementary set of algorithms for learning, programming the decoder, and postprocessing the decoded output, designed to operate in an external, nonimplanted unit. The implementation of the implantable portion is estimated to require fewer than 5000 operations per second. A proof-of-concept, 32-channel field-programmable gate array (FPGA implementation of this portion

  13. Individual differences in the time course of reward processing: Stage-specific links with depression and impulsivity.

    Novak, Brittni K; Novak, Keisha D; Lynam, Donald R; Foti, Dan

    2016-09-01

    Reward dysfunction has been implicated in a wide range of psychological disorders, including internalizing and externalizing psychopathology. Basic neuroscience research has shown that reward is a multistage process, yet it is unclear how specific stages relate to individual differences in reward sensitivity. The current study utilized event-related potentials elicited during a monetary incentive task to parse sub-stages within anticipatory and consummatory reward processing. Effects of depressive symptoms and trait impulsivity were examined at each sub-stage (N=92). Reward anticipation modulated neural activity across three sub-stages: cue detection (cue-P3), approach behavior (contingent negative variation, CNV), and outcome anticipation (stimulus preceding negativity). Reward delivery modulated activity across two sub-stages: initial evaluation (reward positivity, RewP), and allocation of attention (feedback-P3). Sensation seeking predicted faster reaction times, as well as cue-P3 and RewP amplitudes. Depression and lack of premeditation interacted to predict CNV and RewP amplitudes. Results demonstrate that individual differences in reward functioning are stage-specific. PMID:27396750

  14. Fearfulness moderates the link between childhood social withdrawal and adolescent reward response.

    Morgan, Judith K; Shaw, Daniel S; Forbes, Erika E

    2015-06-01

    Withdrawal from peers during childhood may reflect disruptions in reward functioning that heighten vulnerability to affective disorders during adolescence. The association between socially withdrawn behavior and reward functioning may depend on traits that influence this withdrawal, such as fearfulness or unsociability. In a study of 129 boys, we evaluated how boys' fearfulness and sociability at age 5 and social withdrawal at school at ages 6 to 10 and during a summer camp at age 9/10 were associated with their neural response to reward at age 20. Greater social withdrawal during childhood was associated with heightened striatal and mPFC activation when anticipating rewards at age 20. Fearfulness moderated this effect to indicate that social withdrawal was associated with heightened reward-related response in the striatum for boys high on fearfulness. Altered striatal response associated with social withdrawal and fearfulness predicted greater likelihood to have a lifetime history of depression and social phobia at age 20. These findings add greater specificity to previous findings that children high in traits related to fear of novelty show altered reward responses, by identifying fearfulness (but not low levels of sociability) as a potential underlying mechanism that contributes to reward alterations in withdrawn children. PMID:25193948

  15. Covert expectation-of-reward in rat ventral striatum at decision points

    A. David Redish

    2009-02-01

    Full Text Available Flexible decision-making strategies (such as planning are a key component of adaptive behavior, yet their neural mechanisms have remained resistant to experimental analysis. Theories of planning require prediction and evaluation of potential future rewards, suggesting that reward signals may covertly appear at decision points. To test this idea, we recorded ensembles of ventral striatal neurons on a spatial decision task, in which hippocampal ensembles are known to represent future possibilities at decision points. We found representations of reward which were not only activated at actual reward delivery sites, but also at a high-cost choice point and before error correction. This expectation-of-reward signal at decision points was apparent at both the single cell and the ensemble level, and vanished with behavioral automation. We conclude that ventral striatal representations of reward are more dynamic than suggested by previous reports of reward- and cue-responsive cells, and may provide the necessary signal for evaluation of internally generated possibilities considered during flexible decision-making.

  16. Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum.

    Saori C Tanaka

    Full Text Available BACKGROUND: The ability to select an action by considering both delays and amount of reward outcome is critical for maximizing long-term benefits. Although previous animal experiments on impulsivity have suggested a role of serotonin in behaviors requiring prediction of delayed rewards, the underlying neural mechanism is unclear. METHODOLOGY/PRINCIPAL FINDINGS: To elucidate the role of serotonin in the evaluation of delayed rewards, we performed a functional brain imaging experiment in which subjects chose small-immediate or large-delayed liquid rewards under dietary regulation of tryptophan, a precursor of serotonin. A model-based analysis revealed that the activity of the ventral part of the striatum was correlated with reward prediction at shorter time scales, and this correlated activity was stronger at low serotonin levels. By contrast, the activity of the dorsal part of the striatum was correlated with reward prediction at longer time scales, and this correlated activity was stronger at high serotonin levels. CONCLUSIONS/SIGNIFICANCE: Our results suggest that serotonin controls the time scale of reward prediction by differentially regulating activities within the striatum.

  17. Early Years Education: Are Young Students Intrinsically or Extrinsically Motivated Towards School Activities? A Discussion about the Effects of Rewards on Young Children's Learning

    Theodotou, Evgenia

    2014-01-01

    Rewards can reinforce and at the same time forestall young children's willingness to learn. However, they are broadly used in the field of education, especially in early years settings, to stimulate children towards learning activities. This paper reviews the theoretical and research literature related to intrinsic and extrinsic motivational…

  18. Altered resting-state neural activity and changes following a craving behavioral intervention for Internet gaming disorder.

    Zhang, Jin-Tao; Yao, Yuan-Wei; Potenza, Marc N; Xia, Cui-Cui; Lan, Jing; Liu, Lu; Wang, Ling-Jiao; Liu, Ben; Ma, Shan-Shan; Fang, Xiao-Yi

    2016-01-01

    Internet gaming disorder (IGD) has become a serious mental health issue worldwide. Evaluating the benefits of interventions for IGD is of great significance. Thirty-six young adults with IGD and 19 healthy comparison (HC) subjects were recruited and underwent resting-state fMRI scanning. Twenty IGD subjects participated in a group craving behavioral intervention (CBI) and were scanned before and after the intervention. The remaining 16 IGD subjects did not receive an intervention. The results showed that IGD subjects showed decreased amplitude of low fluctuation in the orbital frontal cortex and posterior cingulate cortex, and exhibited increased resting-state functional connectivity between the posterior cingulate cortex and dorsolateral prefrontal cortex, compared with HC subjects. Compared with IGD subjects who did not receive the intervention, those receiving CBI demonstrated significantly reduced resting-state functional connectivity between the: (1) orbital frontal cortex with hippocampus/parahippocampal gyrus; and, (2) posterior cingulate cortex with supplementary motor area, precentral gyrus, and postcentral gyrus. These findings suggest that IGD is associated with abnormal resting-state neural activity in reward-related, default mode and executive control networks. Thus, the CBI may exert effects by reducing interactions between regions within a reward-related network, and across the default mode and executive control networks. PMID:27381822

  19. The role of reward in word learning and its implications for language acquisition.

    Ripollés, Pablo; Marco-Pallarés, Josep; Hielscher, Ulrike; Mestres-Missé, Anna; Tempelmann, Claus; Heinze, Hans-Jochen; Rodríguez-Fornells, Antoni; Noesselt, Toemme

    2014-11-01

    The exact neural processes behind humans' drive to acquire a new language--first as infants and later as second-language learners--are yet to be established. Recent theoretical models have proposed that during human evolution, emerging language-learning mechanisms might have been glued to phylogenetically older subcortical reward systems, reinforcing human motivation to learn a new language. Supporting this hypothesis, our results showed that adult participants exhibited robust fMRI activation in the ventral striatum (VS)--a core region of reward processing--when successfully learning the meaning of new words. This activation was similar to the VS recruitment elicited using an independent reward task. Moreover, the VS showed enhanced functional and structural connectivity with neocortical language areas during successful word learning. Together, our results provide evidence for the neural substrate of reward and motivation during word learning. We suggest that this strong functional and anatomical coupling between neocortical language regions and the subcortical reward system provided a crucial advantage in humans that eventually enabled our lineage to successfully acquire linguistic skills. PMID:25447993

  20. Brain structure and neural network of the reward/loss process in decision making%决策奖损加工的脑神经结构与环路

    魏巍; 郭宗君

    2015-01-01

    目的 以国内外2005~2014年发表的针对与决策机制有关的关于奖赏、损失的神经结构及环路,及其与某些身心疾病关系的文献,综述决策奖损加工的脑神经结构及其意义,可以在一定程度上揭示行为决策的神经结构和网络机制,及其与某些身心疾病的关系.方法 2014年9月在PubMed、Science-Direct、中国知网和万方数据库等数据库,以“决策”、“奖赏”、“损失规避”等检索词,检索国内外有关决策奖损加工相关脑神经结构,及其与某些身心疾病的关系的研究.结果 检索文献110篇,纳入分析40篇.结果总结了大脑奖损结构及其关系在决策加工过程中的作用机制,以及两系统失衡所导致的身心疾病.结论 大部分文献认为奖赏趋近系统和损失规避系统的协调加工共同影响人们的行为决策,一旦上述系统平衡失调,则可出现行为决策障碍,产生一些身心疾病,但与决策行为模式相关的精确的神经机制尚须进一步研究.%Objective Based on the literatures published between 2005 and 2014,review the correlation between reward/loss of brain structure and neural network,and its relationship with physical and mental ailments,aim to reveal the neural structure and network of behavioral decision mechanism.Methods By retrieving literatures on PubMed,ScienceDirect,CNKI and Wanfang database in September 2014,we used "decision making","reward","loss aversion" and so on as the key words.Results Totally 40 papers were enrolled,the result reviewed the clinic meaning and the brain structure and neural network of the reward/loss process in decision making.Conclusion Most studies found the reward/loss decision making mechanism of the brain structure and the physical and mental ailments caused by the two systems imbalance,but related to the precise decision making neural mechanism has yet to be studied further.

  1. Reward deficiency and anti-reward in pain chronification.

    Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

    2016-09-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). PMID:27246519

  2. Motor neuron activation in peripheral nerves using infrared neural stimulation

    Peterson, E. J.; Tyler, D. J.

    2014-02-01

    Objective. Localized activation of peripheral axons may improve selectivity of peripheral nerve interfaces. Infrared neural stimulation (INS) employs localized delivery to activate neural tissue. This study investigated INS to determine whether localized delivery limited functionality in larger mammalian nerves. Approach. The rabbit sciatic nerve was stimulated extraneurally with 1875 nm wavelength infrared light, electrical stimulation, or a combination of both. Infrared-sensitive regions (ISR) of the nerve surface and electromyogram (EMG) recruitment of the Medial Gastrocnemius, Lateral Gastrocnemius, Soleus, and Tibialis Anterior were the primary output measures. Stimulation applied included infrared-only, electrical-only, and combined infrared and electrical. Main results. 81% of nerves tested were sensitive to INS, with 1.7 ± 0.5 ISR detected per nerve. INS was selective to a single muscle within 81% of identified ISR. Activation energy threshold did not change significantly with stimulus power, but motor activation decreased significantly when radiant power was decreased. Maximum INS levels typically recruited up to 2-9% of any muscle. Combined infrared and electrical stimulation differed significantly from electrical recruitment in 7% of cases. Significance. The observed selectivity of INS indicates that it may be useful in augmenting rehabilitation, but significant challenges remain in increasing sensitivity and response magnitude to improve the functionality of INS.

  3. Manipulating neural activity in physiologically classified neurons: triumphs and challenges.

    Gore, Felicity; Schwartz, Edmund C; Salzman, C Daniel

    2015-09-19

    Understanding brain function requires knowing both how neural activity encodes information and how this activity generates appropriate responses. Electrophysiological, imaging and immediate early gene immunostaining studies have been instrumental in identifying and characterizing neurons that respond to different sensory stimuli, events and motor actions. Here we highlight approaches that have manipulated the activity of physiologically classified neurons to determine their role in the generation of behavioural responses. Previous experiments have often exploited the functional architecture observed in many cortical areas, where clusters of neurons share response properties. However, many brain structures do not exhibit such functional architecture. Instead, neurons with different response properties are anatomically intermingled. Emerging genetic approaches have enabled the identification and manipulation of neurons that respond to specific stimuli despite the lack of discernable anatomical organization. These approaches have advanced understanding of the circuits mediating sensory perception, learning and memory, and the generation of behavioural responses by providing causal evidence linking neural response properties to appropriate behavioural output. However, significant challenges remain for understanding cognitive processes that are probably mediated by neurons with more complex physiological response properties. Currently available strategies may prove inadequate for determining how activity in these neurons is causally related to cognitive behaviour. PMID:26240431

  4. Infrared neural stimulation fails to evoke neural activity in the deaf guinea pig cochlea.

    Thompson, Alexander C; Fallon, James B; Wise, Andrew K; Wade, Scott A; Shepherd, Robert K; Stoddart, Paul R

    2015-06-01

    At present there is some debate as to the processes by which infrared neural stimulation (INS) activates neurons in the cochlea, as the lasers used for INS can potentially generate a range of secondary stimuli e.g. an acoustic stimulus is produced when the light is absorbed by water. To clarify whether INS in the cochlea requires functioning hair cells and to explore the potential relevance to cochlear implants, experiments using INS were performed in the cochleae of both normal hearing and profoundly deaf guinea pigs. A response to laser stimulation was readily evoked in normal hearing cochlea. However, no response was evoked in any profoundly deaf cochleae, for either acute or chronic deafening, contrary to previous work where a response was observed after acute deafening with ototoxic drugs. A neural response to electrical stimulation was readily evoked in all cochleae after deafening. The absence of a response from optical stimuli in profoundly deaf cochleae suggests that the response from INS in the cochlea is hair cell mediated. PMID:25796297

  5. Sociocultural patterning of neural activity during self-reflection

    Ma, Yina; Bang, Dan; Wang, Chenbo;

    2014-01-01

    Chinese than in Danish participants. Moreover, the group difference in TPJ activity was mediated by a measure of a cultural value (i.e., interdependence of self-construal). Our findings suggest that individuals in different sociocultural contexts may learn and/or adopt distinct strategies for self......Western cultures encourage self-construals independent of social contexts whereas East Asian cultures foster interdependent self-construals that rely on how others perceive the self. How are culturally specific self-construals mediated by the human brain? Using functional MRI, we monitored neural......-reflection by changing the weight of the mPFC and TPJ in the social brain network....

  6. Kohonen Neural Network Stress Detection Using Only Electrodermal Activity Features

    BORNOIU, I.-V.

    2014-08-01

    Full Text Available This paper presents a method for identifying human stress levels by using a Kohonen neural network. The study focuses on differentiating between a relaxed and a stressed state and it presents a series of parameters (skin conductance response signal power, skin conductance response signal frequency, skin conductance level gradient, response rise time and response amplitude extracted only from the electrodermal activity signal. A very strict recording protocol was used to minimize the artifacts caused by the bad connection between electrodes and skin. A stress inducing method is presented that can be used to replicate results in laboratory conditions.

  7. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

    2015-01-01

    Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects. PMID:25799565

  8. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Björn Enzi

    Full Text Available Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15 and in healthy control subjects (n = 15 with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.

  9. Adolescent development of the reward system

    Adriana Galván

    2010-02-01

    Full Text Available Adolescence is a developmental period characterized by increased reward-seeking behavior. Investigators have used functional magnetic resonance imaging (fMRI in conjunction with reward paradigms to test two opposing hypotheses about adolescent developmental changes in the striatum, a region implicated in reward processing. One hypothesis posits that the striatum is relatively hypo-responsive to rewards during adolescence, such that heightened reward-seeking behavior is necessary to achieve the same activation as adults. Another view suggests that during adolescence the striatal reward system is hyper-responsive, which subsequently results in greater reward-seeking. While evidence for both hypotheses has been reported, the field has generally converged on this latter hypothesis based on compelling evidence. In this review, I describe the evidence to support this notion, speculate on the disparate fMRI findings and conclude with future areas of inquiry to this fascinating question.

  10. Deletion of dopamine D1 and D3 receptors differentially affects spontaneous behaviour and cocaine-induced locomotor activity, reward and CREB phosphorylation.

    Karasinska, Joanna M; George, Susan R; Cheng, Regina; O'Dowd, Brian F

    2005-10-01

    Co-localization of dopamine D1 and D3 receptors in striatal neurons suggests that these two receptors interact at a cellular level in mediating dopaminergic function including psychostimulant-induced behaviour. To study D1 and D3 receptor interactions in cocaine-mediated effects, cocaine-induced locomotion and reward in mice lacking either D1, D3 or both receptors were analysed. Spontaneous locomotor activity was increased in D1-/- and D1-/-D3-/- mice and D1-/-D3-/- mice did not exhibit habituation of spontaneous rearing activity. Cocaine (20 mg/kg) increased locomotor activity in wild-type and D3-/- mice, failed to stimulate activity in D1-/- mice and reduced activity in D1-/-D3-/- mice. In the conditioned place preference, all groups exhibited reward at 5, 10 and 20 mg/kg of cocaine. D1-/-D3-/- mice did not demonstrate preference at 2.5 mg/kg of cocaine although preference was observed in wild-type, D1-/- and D3-/- mice. The transcription factor cAMP-responsive element binding protein (CREB) is activated by phosphorylation in striatal regions following dopamine receptor activation. Striatal pCREB levels following acute cocaine were increased in wild-type and D3-/- mice and decreased in D1-/- and D1-/-D3-/- mice. After repeated administration of 2.5 mg/kg of cocaine, D1-/- mice had lower pCREB levels in caudate-putamen and nucleus accumbens. Our findings suggest that, although spontaneous and cocaine-induced horizontal activity depended mainly on the presence of the D1 receptor, there may be crosstalk between D1 and D3 receptors in rearing habituation and the perception of cocaine reward at low doses of the drug. Furthermore, alterations in pCREB levels were associated with changes in cocaine-induced locomotor activity but not reward. PMID:16197514

  11. The neural basis of academic achievement motivation.

    Mizuno, Kei; Tanaka, Masaaki; Ishii, Akira; Tanabe, Hiroki C; Onoe, Hirotaka; Sadato, Norihiro; Watanabe, Yasuyoshi

    2008-08-01

    We have used functional magnetic resonance imaging to study the neural correlates of motivation, concentrating on the motivation to learn and gain monetary rewards. We compared the activation in the brain obtained during reported high states of motivation for learning, with the ones observed when the motivation was based on monetary reward. Our results show that motivation to learn correlates with bilateral activity in the putamen, and that the higher the reported motivation, as derived from a questionnaire that each subject filled prior to scanning, the greater the change in the BOLD signals within the putamen. Monetary motivation also activated the putamen bilaterally, though the intensity of activity was not related to the monetary reward. We conclude that the putamen is critical for motivation in different domains and the extent of activity of the putamen may be pivotal to the motivation that drives academic achievement and thus academic successes. PMID:18550387

  12. The Rewards of Learning.

    Chance, Paul

    1992-01-01

    Although intrinsic rewards are important, they (along with punishment and encouragement) are insufficient for efficient learning. Teachers must supplement intrinsic rewards with extrinsic rewards, such as praising, complimenting, applauding, and providing other forms of recognition for good work. Teachers should use the weakest reward required to…

  13. Classification of the extracellular fields produced by activated neural structures

    Perry Danielle

    2005-09-01

    Full Text Available Abstract Background Classifying the types of extracellular potentials recorded when neural structures are activated is an important component in understanding nerve pathophysiology. Varying definitions and approaches to understanding the factors that influence the potentials recorded during neural activity have made this issue complex. Methods In this article, many of the factors which influence the distribution of electric potential produced by a traveling action potential are discussed from a theoretical standpoint with illustrative simulations. Results For an axon of arbitrary shape, it is shown that a quadrupolar potential is generated by action potentials traveling along a straight axon. However, a dipole moment is generated at any point where an axon bends or its diameter changes. Next, it is shown how asymmetric disturbances in the conductivity of the medium surrounding an axon produce dipolar potentials, even during propagation along a straight axon. Next, by studying the electric fields generated by a dipole source in an insulating cylinder, it is shown that in finite volume conductors, the extracellular potentials can be very different from those in infinite volume conductors. Finally, the effects of impulses propagating along axons with inhomogeneous cable properties are analyzed. Conclusion Because of the well-defined factors affecting extracellular potentials, the vague terms far-field and near-field potentials should be abandoned in favor of more accurate descriptions of the potentials.

  14. Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area

    Julien eVitay

    2014-01-01

    Full Text Available Neural activity in dopaminergic areas such as the ventral tegmental area is influenced by timing processes, in particular by the temporal expectation of rewards during Pavlovian conditioning. Receipt of a reward at the expected time allows to compute reward-prediction errors which can drive learning in motor or cognitive structures. Reciprocally, dopamine plays an important role in the timing of external events. Several models of the dopaminergic system exist, but the substrate of temporal learning is rather unclear. In this article, we propose a neuro-computational model of the afferent network to the ventral tegmental area, including the lateral hypothalamus, the pedunculopontine nucleus, the amygdala, the ventromedial prefrontal cortex, the ventral basal ganglia (including the nucleus accumbens and the ventral pallidum, as well as the lateral habenula and the rostromedial tegmental nucleus. Based on a plausible connectivity and realistic learning rules, this neuro-computational model reproduces several experimental observations, such as the progressive cancellation of dopaminergic bursts at reward delivery, the appearance of bursts at the onset of reward-predicting cues or the influence of reward magnitude on activity in the amygdala and ventral tegmental area. While associative learning occurs primarily in the amygdala, learning of the temporal relationship between the cue and the associated reward is implemented as a dopamine-modulated coincidence detection mechanism in the nucleus accumbens.

  15. Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area

    Vitay, Julien; Hamker, Fred H.

    2014-01-01

    Neural activity in dopaminergic areas such as the ventral tegmental area is influenced by timing processes, in particular by the temporal expectation of rewards during Pavlovian conditioning. Receipt of a reward at the expected time allows to compute reward-prediction errors which can drive learning in motor or cognitive structures. Reciprocally, dopamine plays an important role in the timing of external events. Several models of the dopaminergic system exist, but the substrate of temporal learning is rather unclear. In this article, we propose a neuro-computational model of the afferent network to the ventral tegmental area, including the lateral hypothalamus, the pedunculopontine nucleus, the amygdala, the ventromedial prefrontal cortex, the ventral basal ganglia (including the nucleus accumbens and the ventral pallidum), as well as the lateral habenula and the rostromedial tegmental nucleus. Based on a plausible connectivity and realistic learning rules, this neuro-computational model reproduces several experimental observations, such as the progressive cancelation of dopaminergic bursts at reward delivery, the appearance of bursts at the onset of reward-predicting cues or the influence of reward magnitude on activity in the amygdala and ventral tegmental area. While associative learning occurs primarily in the amygdala, learning of the temporal relationship between the cue and the associated reward is implemented as a dopamine-modulated coincidence detection mechanism in the nucleus accumbens. PMID:24550821

  16. Visualization and manipulation of neural activity in the developing vertebrate nervous system

    Jiayi eZhang

    2011-11-01

    Full Text Available Neural activity during vertebrate development has been unambiguously shown to play a critical role in sculpting circuit formation and function. Patterned neural activity in various parts of the developing nervous system is thought to modulate neurite outgrowth, axon targeting and synapse refinement. The nature and role of patterned neural activity during development has been classically studied with in vitro preparations using pharmacological manipulations. In this review we discuss newly available and developing molecular genetic tools for the visualization and manipulation of neural activity patterns specifically during development.

  17. Sex, drugs, and rock 'n' roll: hypothesizing common mesolimbic activation as a function of reward gene polymorphisms.

    Blum, Kenneth; Werner, Tonia; Carnes, Stefanie; Carnes, Patrick; Bowirrat, Abdalla; Giordano, John; Oscar-Berman, Marlene; Gold, Mark

    2012-01-01

    The nucleus accumbens, a site within the ventral striatum, plays a prominent role in mediating the reinforcing effects of drugs of abuse, food, sex, and other addictions. Indeed, it is generally believed that this structure mandates motivated behaviors such as eating, drinking, and sexual activity, which are elicited by natural rewards and other strong incentive stimuli. This article focuses on sex addiction, but we hypothesize that there is a common underlying mechanism of action for the powerful effects that all addictions have on human motivation. That is, biological drives may have common molecular genetic antecedents, which if impaired, lead to aberrant behaviors. Based on abundant scientific support, we further hypothesize that dopaminergic genes, and possibly other candidate neurotransmitter-related gene polymorphisms, affect both hedonic and anhedonic behavioral outcomes. Genotyping studies already have linked gene polymorphic associations with alcohol and drug addictions and obesity, and we anticipate that future genotyping studies of sex addicts will provide evidence for polymorphic associations with specific clustering of sexual typologies based on clinical instrument assessments. We recommend that scientists and clinicians embark on research coupling the use of neuroimaging tools with dopaminergic agonistic agents to target specific gene polymorphisms systematically for normalizing hyper- or hypo-sexual behaviors. PMID:22641964

  18. Validation and Psychometric Properties of the French Versions of the Environmental Reward Observation Scale and of the Reward Probability Index

    Aurélie Wagener; Sylvie Blairy

    2015-01-01

    Background: Low levels of environmental rewards have been related to depression on a number of occasions in the scientific literature. Two scales have been created to assess environmental rewards: the Environmental Reward Observation Scale (EROS) and the Reward Probability Index (RPI). This study aims to validate the French versions of these two scales. Method: 466 non-clinical adults completed an online survey assessing environmental rewards, depression, anxiety, activation, avoidance and be...

  19. Layered reward signalling through octopamine and dopamine in Drosophila

    Burke, Christopher J.; Huetteroth, Wolf; Owald, David; Perisse, Emmanuel; Krashes, Michael J.; Das, Gaurav; Gohl, Daryl; Silies, Marion; Certel, Sarah; Waddell, Scott

    2012-01-01

    Dopamine is synonymous with reward and motivation in mammals. However, only recently has dopamine been linked to motivated behaviour and rewarding reinforcement in fruitflies. Instead, octopamine has historically been considered to be the signal for reward in insects. Here we show, using temporal control of neural function in Drosophila, that only short-term appetitive memory is reinforced by octopamine. Moreover, octopamine-dependent memory formation requires signalling through dopamine neur...

  20. Early Effects of Reward Anticipation Are Modulated by Dopaminergic Stimulation

    Thore Apitz; Nico Bunzeck

    2014-01-01

    The abilities to predict future rewards and assess the value of reward delivery are crucial aspects of adaptive behavior. While the mesolimbic system, including dopaminergic midbrain, ventral striatum and prefrontal cortex have long been associated with reward processing, recent studies also indicate a prominent role of early visual brain regions. However, the precise underlying neural mechanisms still remain unclear. To address this issue, we presented participants with visual cues predictin...

  1. Acute Stress Reduces Reward Responsiveness: Implications for Depression

    Bogdan, Ryan; Pizzagalli, Diego

    2006-01-01

    Background: Stress, one of the strongest risk factors for depression, has been linked to "anbedonic" behavior and dysfunctional reward-related neural circuitry in preclinical models. Methods: To test if acute stress reduces reward responsiveness (i.e., the ability to modulate behavior as a function of past reward), a signal-detection task coupled with a differential reinforcement schedule was utilized. Eighty female participants completed the task under both a stress condition, either threat-...

  2. Understanding Crowdsourcing: Effects of motivation and rewards on participation and performance in voluntary online activities

    W.A.M. Borst (Irma)

    2010-01-01

    textabstractCompanies increasingly outsource activities to volunteers that they approach via an open call on the internet. The phenomenon is called ‘crowdsourcing’. For an effective use of crowdsourcing it is important to understand what motivated these online volunteers and what is the influence of

  3. Hippocampal Cannabinoid Transmission Modulates Dopamine Neuron Activity: Impact on Rewarding Memory Formation and Social Interaction

    Loureiro, Michael; Renard, Justine; Zunder, Jordan; Laviolette, Steven R

    2015-01-01

    Disturbances in cannabinoid type 1 receptor (CB1R) signaling have been linked to emotional and cognitive deficits characterizing neuropsychiatric disorders, including schizophrenia. Thus, there is growing interest in characterizing the relationship between cannabinoid transmission, emotional processing, and dopamine (DA)-dependent behavioral deficits. The CB1R is highly expressed in the mammalian nervous system, particularly in the hippocampus. Activation of the ventral hippocampal subregion ...

  4. PER1 rs3027172 Genotype Interacts with Early Life Stress to Predict Problematic Alcohol Use, but Not Reward-Related Ventral Striatum Activity.

    Baranger, David A A; Ifrah, Chloé; Prather, Aric A; Carey, Caitlin E; Corral-Frías, Nadia S; Drabant Conley, Emily; Hariri, Ahmad R; Bogdan, Ryan

    2016-01-01

    Increasing evidence suggests that the circadian and stress regulatory systems contribute to alcohol use disorder (AUD) risk, which may partially arise through effects on reward-related neural function. The C allele of the PER1 rs3027172 single nucleotide polymorphism (SNP) reduces PER1 expression in cells incubated with cortisol and has been associated with increased risk for adult AUD and problematic drinking among adolescents exposed to high levels of familial psychosocial adversity. Using data from undergraduate students who completed the ongoing Duke Neurogenetics Study (DNS) (n = 665), we tested whether exposure to early life stress (ELS; Childhood Trauma Questionnaire) moderates the association between rs3027172 genotype and later problematic alcohol use (Alcohol Use Disorders Identification Test) as well as ventral striatum (VS) reactivity to reward (card-guessing task while functional magnetic resonance imaging data were acquired). Initial analyses found that PER1 rs3027172 genotype interacted with ELS to predict both problematic drinking and VS reactivity; minor C allele carriers, who were also exposed to elevated ELS reported greater problematic drinking and exhibited greater ventral striatum reactivity to reward-related stimuli. When gene × covariate and environment × covariate interactions were controlled for, the interaction predicting problematic alcohol use remained significant (p < 0.05, corrected) while the interaction predicting VS reactivity was no longer significant. These results extend our understanding of relationships between PER1 genotype, ELS, and problematic alcohol use, and serve as a cautionary tale on the importance of controlling for potential confounders in studies of moderation including gene × environment interactions. PMID:27065929

  5. PER1 rs3027172 genotype interacts with early life stress to predict problematic alcohol use, but not reward-related ventral striatum activity

    David eBaranger

    2016-03-01

    Full Text Available Increasing evidence suggests that the circadian and stress regulatory systems contribute to alcohol use disorder (AUD risk, which may partially arise through effects on reward-related neural function. The C allele of the PER1 rs3027172 single nucleotide polymorphism reduces PER1 expression in cells incubated with cortisol and has been associated with increased risk for adult AUD and problematic drinking among adolescents exposed to high levels of familial psychosocial adversity. Using data from undergraduate students who completed the ongoing Duke Neurogenetics Study (n=665, we tested whether exposure to early life stress (ELS; Childhood Trauma Questionnaire moderates the association between rs3027172 genotype and later problematic alcohol use (Alcohol Use Disorders Identification Test as well as ventral striatum (VS reactivity to reward (card-guessing task while functional magnetic resonance imaging data were acquired. Initial analyses found that PER1 rs3027172 genotype interacted with ELS to predict both problematic drinking and VS reactivity; minor C allele carriers, who were also exposed to elevated ELS reported greater problematic drinking and exhibited greater ventral striatum reactivity to reward-related stimuli. When gene x covariate and environment x covariate interactions were controlled for, the interaction predicting problematic alcohol use remained significant (p<0.05, corrected while the interaction predicting VS reactivity was no longer significant. These results extend our understanding of relationships between PER1 genotype, early life stress, and problematic alcohol use, and serve as a cautionary tale on the importance of controlling for potential confounders in studies of moderation including gene x environment interactions.

  6. Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum.

    Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N; Iijima, Toshio; Tsutsui, Ken-Ichiro

    2015-11-01

    To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. PMID:26378201

  7. Artificial Neural Network Characteristic For Neutron Activation Analysis

    Neutron activation analysis (NAA) is one of analysis methods for identification of elements from material. Irradiated unknown material could be identified by gamma spectrum pattern analysis. The recognition process will be done easily if we have a smart system. One of the smart system choices was artificial neural network (ANN). The gamma spectrum emitted from radioactive nuclide has specific pattern, therefore smart system will try to classify the input data. Firstly, Hp-Ge detector detects gamma radiation from material, then the gamma radiations is counted by multi channel analysis instrument (MCA). The smart system based ANN system was tested to identify 50 material, in which the system has been trained by using one data only for each classifications. The result showed that the ANN appreciates 100% identification capability or has a good performance

  8. Effects of Near-Infrared Laser on Neural Cell Activity

    Near-infrared laser has been used to relieve patients from various kinds of pain caused by postherpetic neuralgesia, myofascial dysfunction, surgical and traumatic wound, cancer, and rheumatoid arthritis. Clinically, He-Ne (λ=632.8 nm, 780 nm) and Ga-Al-As (805 ± 25 nm) lasers are used to irradiate trigger points or nerve ganglion. However the precise mechanisms of such biological actions of the laser have not yet been resolved. Since laser therapy is often effective to suppress the pain caused by hyperactive excitation of sensory neurons, interactions with laser light and neural cells are suggested. As neural excitation requires large amount of energy liberated from adenosine triphosphate (ATP), we examined the effect of 830-nm laser irradiation on the energy metabolism of the rat central nervous system and isolated mitochondria from brain. The diode laser was applied for 15 min with irradiance of 4.8 W/cm2 on a 2 mm-diameter spot at the brain surface. Tissue ATP content of the irradiated area in the cerebral cortex was 19% higher than that of the non-treated area (opposite side of the cortex), whereas the ADP content showed no significant difference. Irradiation at another wavelength (652 nm) had no effect on either ATP or ADP contents. The temperature of the brain tissue was increased 4.5-5.0 deg. C during the irradiation of both 830-nm and 652-nm laser light. Direct irradiation of the mitochondrial suspension did not show any wavelength-dependent acceleration of respiration rate nor ATP synthesis. These results suggest that the increase in tissue ATP content did not result from the thermal effect, but from specific effect of the laser operated at 830 nm. Electrophysiological studies showed the hyperpolarization of membrane potential of isolated neurons and decrease in membrane resistance with irradiation of the laser, suggesting an activation of potassium channels. Intracellular ATP is reported to regulate some kinds of potassium channels. Possible mechanisms

  9. Perceived stress predicts altered reward and loss feedback processing in medial prefrontal cortex

    Michael T Treadway

    2013-05-01

    Full Text Available Stress is significant risk factor for the development of psychopathology, particularly symptoms related to reward processing. Importantly, individuals display marked variation in how they perceive and cope with stressful events, and such differences are strongly linked to risk for developing psychiatric symptoms following stress exposure. However, many questions remain regarding the neural architecture that underlies inter-subject variability in perceptions of stressors. Using functional magnetic resonance imaging (fMRI during a monetary incentive delay paradigm, we examined the effects of self-reported perceived stress levels on neural activity during reward anticipation and feedback in a sample of healthy individuals. We found that subjects reporting more uncontrollable and overwhelming stressors displayed blunted neural responses in medial prefrontal cortex (mPFC following feedback related to monetary gains as well monetary losses. This is consistent with preclinical models that implicate the mPFC as a key site of vulnerability to the noxious effects of uncontrollable stressors. Our data help translate these findings to humans, and elucidate some of the neural mechanisms that may underlie stress-linked risk for developing reward-related psychiatric symptoms.

  10. Can simple interactions capture complex features of neural activity underlying behavior in a virtual reality environment?

    Meshulam, Leenoy; Gauthier, Jeffrey; Brody, Carlos; Tank, David; Bialek, William

    The complex neural interactions which are abundant in most recordings of neural activity are relatively poorly understood. A prime example of such interactions can be found in the in vivo neural activity which underlies complex behaviors of mice, imaged in brain regions such as hippocampus and parietal cortex. Experimental techniques now allow us to accurately follow these neural interactions in the simultaneous activity of large neuronal populations of awake behaving animals. Here, we demonstrate that pairwise maximum entropy models can predict a surprising number of properties of the neural activity. The models, that are constrained with activity rates and interactions between pairs of neurons, are well fit to the activity `states' in the hippocampus and cortex of mice performing cognitive tasks while navigating in a virtual reality environment.

  11. Dopamine Signaling in reward-related behaviors

    Ja-Hyun eBaik

    2013-10-01

    Full Text Available Dopamine (DA regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DAmesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural rewards such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

  12. Evidence-Based Systematic Review: Effects of Neuromuscular Electrical Stimulation on Swallowing and Neural Activation

    Clark, Heather; Lazarus, Cathy; Arvedson, Joan; Schooling, Tracy; Frymark, Tobi

    2009-01-01

    Purpose: To systematically review the literature examining the effects of neuromuscular electrical stimulation (NMES) on swallowing and neural activation. The review was conducted as part of a series examining the effects of oral motor exercises (OMEs) on speech, swallowing, and neural activation. Method: A systematic search was conducted to…

  13. Identification of non-linear models of neural activity in bold fmri

    Jacobsen, Daniel Jakup; Madsen, Kristoffer Hougaard; Hansen, Lars Kai

    2006-01-01

    Non-linear hemodynamic models express the BOLD signal as a nonlinear, parametric functional of the temporal sequence of local neural activity. Several models have been proposed for this neural activity. We identify one such parametric model by estimating the distribution of its parameters. These...

  14. Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function.

    Scaplen, Kristin M; Kaun, Karla R

    2016-06-01

    In a complex environment, animals learn from their responses to stimuli and events. Appropriate response to reward and punishment can promote survival, reproduction and increase evolutionary fitness. Interestingly, the neural processes underlying these responses are remarkably similar across phyla. In all species, dopamine is central to encoding reward and directing motivated behaviors, however, a comprehensive understanding of how circuits encode reward and direct motivated behaviors is still lacking. In part, this is a result of the sheer diversity of neurons, the heterogeneity of their responses and the complexity of neural circuits within which they are found. We argue that general features of reward circuitry are common across model organisms, and thus principles learned from invertebrate model organisms can inform research across species. In particular, we discuss circuit motifs that appear to be functionally equivalent from flies to primates. We argue that a comparative approach to studying and understanding reward circuit function provides a more comprehensive understanding of reward circuitry, and informs disorders that affect the brain's reward circuitry. PMID:27328845

  15. Ketamine Suppresses the Ventral Striatal Response to Reward Anticipation: A Cross-Species Translational Neuroimaging Study.

    Francois, Jennifer; Grimm, Oliver; Schwarz, Adam J; Schweiger, Janina; Haller, Leila; Risterucci, Celine; Böhringer, Andreas; Zang, Zhenxiang; Tost, Heike; Gilmour, Gary; Meyer-Lindenberg, Andreas

    2016-04-01

    Convergent evidence implicates regional neural responses to reward anticipation in the pathogenesis of several psychiatric disorders, such as schizophrenia, where blunted ventral striatal responses to positive reward are observed in patients and at-risk populations. In vivo oxygen amperometry measurements in the ventral striatum in awake, behaving rats reveal reward-related tissue oxygen changes that closely parallel blood oxygen level dependent (BOLD) signal changes observed in human functional magnetic resonance imaging (fMRI), suggesting that a cross-species approach targeting this mechanism might be feasible in psychopharmacology. The present study explored modulatory effects of acute, subanaesthetic doses of ketamine-a pharmacological model widely used in psychopharmacological research, both preclinically and clinically-on ventral striatum activity during performance of a reward anticipation task in both species, using fMRI in humans and in vivo oxygen amperometry in rats. In a region-of-interest analysis conducted following a cross-over placebo and ketamine study in human subjects, an attenuated ventral striatal response during reward anticipation was observed following ketamine relative to placebo during performance of a monetary incentive delay task. In rats, a comparable attenuation of ventral striatal signal was found after ketamine challenge, relative to vehicle, in response to a conditioned stimulus that predicted delivery of reward. This study provides the first data in both species demonstrating an attenuating effect of acute ketamine on reward-related ventral striatal (O2) and fMRI signals. These findings may help elucidate a deeper mechanistic understanding of the potential role of ketamine as a model for psychosis, show that cross-species pharmacological experiments targeting reward signaling are feasible, and suggest this phenotype as a promising translational biomarker for the development of novel compounds, assessment of disease status, and

  16. Determination of Activation Functions in A Feedforward Neural Network by using Genetic Algorithm

    Oğuz ÜSTÜN

    2009-03-01

    Full Text Available In this study, activation functions of all layers of the multilayered feedforward neural network have been determined by using genetic algorithm. The main criteria that show the efficiency of the neural network is to approximate to the desired output with the same number nodes and connection weights. One of the important parameter to determine this performance is to choose a proper activation function. In the classical neural network designing, a network is designed by choosing one of the generally known activation function. In the presented study, a table has been generated for the activation functions. The ideal activation function for each node has been chosen from this table by using the genetic algorithm. Two dimensional regression problem clusters has been used to compare the performance of the classical static neural network and the genetic algorithm based neural network. Test results reveal that the proposed method has a high level approximation capacity.

  17. Expectation modulates neural representations of valence throughout the human brain.

    Ramayya, Ashwin G; Pedisich, Isaac; Kahana, Michael J

    2015-07-15

    The brain's sensitivity to unexpected gains or losses plays an important role in our ability to learn new behaviors (Rescorla and Wagner, 1972; Sutton and Barto, 1990). Recent work suggests that gains and losses are ubiquitously encoded throughout the human brain (Vickery et al., 2011), however, the extent to which reward expectation modulates these valence representations is not known. To address this question, we analyzed recordings from 4306 intracranially implanted electrodes in 39 neurosurgical patients as they performed a two-alternative probability learning task. Using high-frequency activity (HFA, 70-200 Hz) as an indicator of local firing rates, we found that expectation modulated reward-related neural activity in widespread brain regions, including regions that receive sparse inputs from midbrain dopaminergic neurons. The strength of unexpected gain signals predicted subjects' abilities to encode stimulus-reward associations. Thus, neural signals that are functionally related to learning are widely distributed throughout the human brain. PMID:25937489

  18. Dyadic social interaction as an alternative reward to cocaine

    Gerald eZernig

    2013-09-01

    Full Text Available Individuals suffering from substance use disorders often show severely impaired social interaction, preferring drugs of abuse to the contact with others. Their impaired social interaction is doubly harmful for them as (1 therapy itself is based and dependent on social interaction and as (2 social interaction is not available to them as an "alternative", i.e., non-drug reward, decreasing their motivation to stop drug use. We therefore developed an animal experimental model to investigate the neurobiology of dyadic social interaction- vs cocaine reward. We took care to avoid (a engaging sexual attraction-related aspects of such a social interaction and (b hierarchical difference as confounding stimuli. The cocaine- or social interaction stimulus was offered - in a mutually exclusive setting - within the confines of a conditioned place preference (CPP apparatus. In our paradigm, only four 15-min episodes of social interaction proved sufficient to (i switch the rats' preference from cocaine-associated contextual stimuli to social interaction CPP and (ii inhibit the subsequent reacquisition/reexpression of cocaine CPP. The behavioral effect was paralleled by a reversal of brain activation (i.e., EGR1 expression in the nucleus accumbens, the central and basolateral amygdala, and the ventral tegmental area. Of relevance for the psychotherapy of addictive disorders, the most rewarding sensory component of the composite stimulus 'social interaction' was touch. To test our hypothesis that motivation is encoded in neuron ensembles dedicated to specific reward scenarios, we are currently (1 mapping the neural circuits involved in cocaine- vs social interaction reward and (2 adapting our paradigm for C57BL/6 mice to make use of the plethora of transgenic models available in this species.

  19. Altered cingulo-striatal function underlies reward drive deficits in schizophrenia.

    Park, Il Ho; Chun, Ji Won; Park, Hae-Jeong; Koo, Min-Seong; Park, Sunyoung; Kim, Seok-Hyeong; Kim, Jae-Jin

    2015-02-01

    Amotivation in schizophrenia is assumed to involve dysfunctional dopaminergic signaling of reward prediction or anticipation. It is unclear, however, whether the translation of neural representation of reward value to behavioral drive is affected in schizophrenia. In order to examine how abnormal neural processing of response valuation and initiation affects incentive motivation in schizophrenia, we conducted functional MRI using a deterministic reinforcement learning task with variable intervals of contingency reversals in 20 clinically stable patients with schizophrenia and 20 healthy controls. Behaviorally, the advantage of positive over negative reinforcer in reinforcement-related responsiveness was not observed in patients. Patients showed altered response valuation and initiation-related striatal activity and deficient rostro-ventral anterior cingulate cortex activation during reward approach initiation. Among these neural abnormalities, rostro-ventral anterior cingulate cortex activation was correlated with positive reinforcement-related responsiveness in controls and social anhedonia and social amotivation subdomain scores in patients. Our findings indicate that the central role of the anterior cingulate cortex is in translating action value into driving force of action, and underscore the role of the cingulo-striatal network in amotivation in schizophrenia. PMID:25468177

  20. Activation of dopamine D4 receptors within the anterior cingulate cortex enhances the erroneous expectation of reward on a rat slot machine task.

    Cocker, P J; Hosking, J G; Murch, W S; Clark, L; Winstanley, C A

    2016-06-01

    Using a rodent slot machine task (rSMT), we have previously shown that rats, like humans, are susceptible to the reinforcing effects of winning signals presented within a compound stimulus array, even when the pattern generated predicts a negative rather than a positive outcome such as during a "near-miss". The dopamine D4 receptor critically mediates the erroneous reward expectancy generated on such trials. D4 receptors are particularly enriched within frontal and limbic areas activated during slot machine play, such as the anterior cingulate cortex (ACC). We therefore selectively inactivated the ACC to confirm involvement of this region in rSMT performance, and subsequently examined the specific contribution of local D4 receptors. ACC inactivations generally impaired animals' ability to optimally differentiate winning from losing outcomes. Local administration of the D4 agonist PD168077 had a qualitatively similar effect, but increased reward expectancy was only evident on archetypal "near-miss" trials i.e. when the first two of three stimuli in the array were concordant with a rewarding outcome, and only the last stimulus critically signalled a non-win. These data indicate that the ACC is critically involved in parsing the appropriate response when competing stimulus-outcome associations are activated, and that signalling via D4 receptors may play a particularly important role in gating the temporal and spatial summation of salient events. Such findings provide novel insights into the mechanism underlying the erroneous expectations of reward generated when playing slot machines, and suggest a mechanism by which D4 receptor antagonists may be effective in treating gambling disorder. PMID:26775821

  1. Can Neural Activity Propagate by Endogenous Electrical Field?

    Qiu, Chen; Shivacharan, Rajat S; Zhang, Mingming; Durand, Dominique M

    2015-12-01

    It is widely accepted that synaptic transmissions and gap junctions are the major governing mechanisms for signal traveling in the neural system. Yet, a group of neural waves, either physiological or pathological, share the same speed of ∼0.1 m/s without synaptic transmission or gap junctions, and this speed is not consistent with axonal conduction or ionic diffusion. The only explanation left is an electrical field effect. We tested the hypothesis that endogenous electric fields are sufficient to explain the propagation with in silico and in vitro experiments. Simulation results show that field effects alone can indeed mediate propagation across layers of neurons with speeds of 0.12 ± 0.09 m/s with pathological kinetics, and 0.11 ± 0.03 m/s with physiologic kinetics, both generating weak field amplitudes of ∼2-6 mV/mm. Further, the model predicted that propagation speed values are inversely proportional to the cell-to-cell distances, but do not significantly change with extracellular resistivity, membrane capacitance, or membrane resistance. In vitro recordings in mice hippocampi produced similar speeds (0.10 ± 0.03 m/s) and field amplitudes (2.5-5 mV/mm), and by applying a blocking field, the propagation speed was greatly reduced. Finally, osmolarity experiments confirmed the model's prediction that cell-to-cell distance inversely affects propagation speed. Together, these results show that despite their weak amplitude, electric fields can be solely responsible for spike propagation at ∼0.1 m/s. This phenomenon could be important to explain the slow propagation of epileptic activity and other normal propagations at similar speeds. PMID:26631463

  2. Activity-dependent modulation of neural circuit synaptic connectivity

    Charles R Tessier

    2009-07-01

    Full Text Available In many nervous systems, the establishment of neural circuits is known to proceed via a two-stage process; 1 early, activity-independent wiring to produce a rough map characterized by excessive synaptic connections, and 2 subsequent, use-dependent pruning to eliminate inappropriate connections and reinforce maintained synapses. In invertebrates, however, evidence of the activity-dependent phase of synaptic refinement has been elusive, and the dogma has long been that invertebrate circuits are “hard-wired” in a purely activity-independent manner. This conclusion has been challenged recently through the use of new transgenic tools employed in the powerful Drosophila system, which have allowed unprecedented temporal control and single neuron imaging resolution. These recent studies reveal that activity-dependent mechanisms are indeed required to refine circuit maps in Drosophila during precise, restricted windows of late-phase development. Such mechanisms of circuit refinement may be key to understanding a number of human neurological diseases, including developmental disorders such as Fragile X syndrome (FXS and autism, which are hypothesized to result from defects in synaptic connectivity and activity-dependent circuit function. This review focuses on our current understanding of activity-dependent synaptic connectivity in Drosophila, primarily through analyzing the role of the fragile X mental retardation protein (FMRP in the Drosophila FXS disease model. The particular emphasis of this review is on the expanding array of new genetically-encoded tools that are allowing cellular events and molecular players to be dissected with ever greater precision and detail.

  3. SPR imaging combined with cyclic voltammetry for the detection of neural activity

    Hui Li

    2014-03-01

    Full Text Available Surface plasmon resonance (SPR detects changes in refractive index at a metal-dielectric interface. In this study, SPR imaging (SPRi combined with cyclic voltammetry (CV was applied to detect neural activity in isolated bullfrog sciatic nerves. The neural activities induced by chemical and electrical stimulation led to an SPR response, and the activities were recorded in real time. The activities of different parts of the sciatic nerve were recorded and compared. The results demonstrated that SPR imaging combined with CV is a powerful tool for the investigation of neural activity.

  4. Adaptive RBF Neural Network Control for Three-Phase Active Power Filter

    Juntao Fei; Zhe Wang

    2013-01-01

    An adaptive radial basis function (RBF) neural network control system for three‐phase active power filter (APF) is proposed to eliminate harmonics. Compensation current is generated to track command current so as to eliminate the harmonic current of non‐linear load and improve the quality of the power system. The asymptotical stability of the APF system can be guaranteed with the proposed adaptive neural network strategy. The parameters of the neural network can be adaptively updated to achie...

  5. Liking and wanting of drug and nondrug rewards in active cocaine users: the STRAP-R questionnaire

    Goldstein, R.Z.; Goldstein, R.Z.; Woicik, P.A..; Moeller, S.J.; Telang, F.; Jayne, M.; Wong, C.; Wang, G-J.; Fowler, J.S.; Volkow, N.D.

    2008-10-01

    Few studies have examined the subjective value attributed to drug rewards specifically as it compares with the value attributed to primary non-drug rewards in addicted individuals. The objective of this study is to assess liking and wanting of expected drug rewards as compared to food and sex while respondents report about three different situations (current, and hypothetical in general, and under drug influence). In all, 20 cocaine-addicted individuals (mean abstinence = 2 days) and 20 healthy control subjects were administered the STRAP-R (Sensitivity To Reinforcement of Addictive and other Primary Rewards) questionnaire after receiving an oral dose of the dopamine agonist methylphenidate (20 mg) or placebo. The reinforcers relative value changed within the addicted sample when reporting about the under drug influence situation (drug > food; otherwise, drug < food). This change was highest in the addicted individuals with the youngest age of cocaine use onset. Moreover, drug wanting exceeded drug liking in the addicted subjects when reporting about this situation during methylphenidate. Thus, cocaine-addicted individuals assign the highest subjective valence to drug rewards but only when recalling cue-related situations. When recalling this situation, they also report higher drug wanting than hedonic liking, a motivational shift that was only significant during methylphenidate. Together, these valence shifts may underlie compulsive stimulant abuse upon pharmacological or behavioural cue exposure in addicted individuals. Additional studies are required to assess the reliability of the STRAP-R in larger samples and to examine its validity in measuring the subjective value attributed to experienced reinforcers or in predicting behaviour.

  6. Motivation and reward systems

    W. van Eerde

    2014-01-01

    Reward systems are identified as one of the human resource management (HRM) practices that may impact motivation. Reward systems may consist of several components, including financial and nonfinancial rewards, in fixed and variable amounts. Reinforcement, expectancy, and equity principles are discus

  7. Orbitofrontal cortex mediates the differential impact of signaled-reward probability on discrimination accuracy

    Ward, Ryan D.; Winiger, Vanessa; Kandel, Eric R.; Balsam, Peter D; Simpson, Eleanor H.

    2015-01-01

    Orbitofrontal cortex (OFC) function is critical to decision making and behavior based on the value of expected outcomes. While some of the roles the OFC plays in value computations and behavior have been identified, the role of the OFC in modulating cognitive resources based on reward expectancy has not been explored. Here we assessed the involvement of OFC in the interaction between motivation and attention. We tested mice in a sustained-attention task in which explicitly signaling the probability of reward differentially modulates discrimination accuracy. Using pharmacogenetic methods, we generated mice in which neuronal activity in the OFC could be transiently and reversibly inhibited during performance of our signaled-probability task. We found that inhibiting OFC neuronal activity abolished the ability of reward-associated cues to differentially impact accuracy of sustained-attention performance. This failure to modulate attention occurred despite evidence that mice still processed the differential value of the reward-associated cues. These data indicate that OFC function is critical for the ability of a reward-related signal to impact other cognitive and decision-making processes and begin to delineate the neural circuitry involved in the interaction between motivation and attention. PMID:26157358

  8. The use of a running wheel to measure activity in rodents: Relationship to energy balance, general activity, and reward

    Novak, Colleen M.; Burghardt, Paul R.; Levine, James A.

    2012-01-01

    Running wheels are commonly employed to measure rodent physical activity in a variety of contexts, including studies of energy balance and obesity. There is no consensus on the nature of wheel-running activity or its underlying causes, however. Here, we will begin by systematically reviewing how running wheel availability affects physical activity and other aspects of energy balance in laboratory rodents. While wheel running and physical activity in the absence of a wheel commonly correlate i...

  9. Sensitive red protein calcium indicators for imaging neural activity.

    Dana, Hod; Mohar, Boaz; Sun, Yi; Narayan, Sujatha; Gordus, Andrew; Hasseman, Jeremy P; Tsegaye, Getahun; Holt, Graham T; Hu, Amy; Walpita, Deepika; Patel, Ronak; Macklin, John J; Bargmann, Cornelia I; Ahrens, Misha B; Schreiter, Eric R; Jayaraman, Vivek; Looger, Loren L; Svoboda, Karel; Kim, Douglas S

    2016-01-01

    Genetically encoded calcium indicators (GECIs) allow measurement of activity in large populations of neurons and in small neuronal compartments, over times of milliseconds to months. Although GFP-based GECIs are widely used for in vivo neurophysiology, GECIs with red-shifted excitation and emission spectra have advantages for in vivo imaging because of reduced scattering and absorption in tissue, and a consequent reduction in phototoxicity. However, current red GECIs are inferior to the state-of-the-art GFP-based GCaMP6 indicators for detecting and quantifying neural activity. Here we present improved red GECIs based on mRuby (jRCaMP1a, b) and mApple (jRGECO1a), with sensitivity comparable to GCaMP6. We characterized the performance of the new red GECIs in cultured neurons and in mouse, Drosophila, zebrafish and C. elegans in vivo. Red GECIs facilitate deep-tissue imaging, dual-color imaging together with GFP-based reporters, and the use of optogenetics in combination with calcium imaging. PMID:27011354

  10. Generalized activity equations for spiking neural network dynamics

    Michael A Buice

    2013-11-01

    Full Text Available Much progress has been made in uncovering the computational capabilities of spiking neural networks. However, spiking neurons will always be more expensive to simulate compared to rate neurons because of the inherent disparity in time scales - the spike duration time is much shorter than the inter-spike time, which is much shorter than any learning time scale. In numerical analysis, this is a classic stiff problem. Spiking neurons are also much more difficult to study analytically. One possible approach to making spiking networks more tractable is to augment mean field activity models with some information about spiking correlations. For example, such a generalized activity model could carry information about spiking rates and correlations between spikes self-consistently. Here, we will show how this can be accomplished by constructing a complete formal probabilistic description of the network and then expanding around a small parameter such as the inverse of the number of neurons in the network. The mean field theory of the system gives a rate-like description. The first order terms in the perturbation expansion keep track of covariances.

  11. Neural activity in relation to clinically derived personality syndromes in depression using a psychodynamic fMRI paradigm

    Svenja eTaubner

    2013-12-01

    Full Text Available Objective: The heterogeneity between patients with depression cannot be captured adequately with existing descriptive systems of diagnosis and neurobiological models of depression. Furthermore, considering the highly individual nature of depression, the application of general stimuli in past research efforts may not capture the essence of the disorder. This study aims to identify subtypes of depression by using empirically-derived personality-syndromes, and to explore neural correlates of the derived personality syndromes.Method: In the present exploratory study an individually tailored and psychodynamically based fMRI paradigm using dysfunctional relationship patterns was presented to 20 chronically depressed patients. Results from the Shedler-Westen-Assessment-Procedure (SWAP-200 were analyzed by Q-factor analysis to identify clinically relevant subgroups of depression and related brain activation.Results: The principle component analysis of SWAP-200 items from all 20 patients lead to a 2-factor solution: Depressive Personality and Emotional-Hostile-Externalizing Personality. Both factors were used in a whole-brain correlational analysis but only the second factor yielded significant positive correlations in four regions: A large cluster in the right orbitofrontal cortex (OFC, the left ventral striatum, a small cluster in the left temporal pole and another small cluster in the right middle frontal gyrus. Discussion: The degree to which patients with depression score high on the factor Emotional-Hostile-Externalizing Personality correlated with relatively higher activity in three key areas involved in emotion processing, evaluation of reward/punishment, negative cognitions, depressive pathology and social knowledge (OFC, ventral striatum, temporal pole. Results may contribute to an alternative description of neural correlates of depression showing differential brain activation dependent on the extent of specific personality syndromes in

  12. Accurate Wavelet Neural Network for Efficient Controlling of an Active Magnetic Bearing System

    Youssef Harkouss

    2010-01-01

    Full Text Available Problem statement: The synthesis of a command by the neural network has an excellent advantage over the classical one such as PID. This study presented a fast and accurate Wavelet Neural Network (WNN approach for efficient controlling of an Active Magnetic Bearing (AMB system. Approach: The proposed approach combined neural network with the wavelet theory. Wavelet theory may be exploited in deriving a good initialization for the neural network and thus improved convergence of the learning algorithm. Results: We tested two control systems based on three types of neural controllers: Multiplayer Perceptron (MLP controller, RBF Neural Network (RBFNN controller and WNN controller. The simulation results show that the proposed WNN controller provides better performance comparing with standard PID controller, MLP and RBFNN controllers. Conclusion: The proposed WNN approach was shown to be useful in controlling nonlinear dynamic mechanical system, such as the AMB system used in this study.

  13. Amphetamine sensitization alters reward processing in the human striatum and amygdala.

    Owen G O'Daly

    Full Text Available Dysregulation of mesolimbic dopamine transmission is implicated in a number of psychiatric illnesses characterised by disruption of reward processing and goal-directed behaviour, including schizophrenia, drug addiction and impulse control disorders associated with chronic use of dopamine agonists. Amphetamine sensitization (AS has been proposed to model the development of this aberrant dopamine signalling and the subsequent dysregulation of incentive motivational processes. However, in humans the effects of AS on the dopamine-sensitive neural circuitry associated with reward processing remains unclear. Here we describe the effects of acute amphetamine administration, following a sensitising dosage regime, on blood oxygen level dependent (BOLD signal in dopaminoceptive brain regions during a rewarded gambling task performed by healthy volunteers. Using a randomised, double-blind, parallel-groups design, we found clear evidence for sensitization to the subjective effects of the drug, while rewarded reaction times were unchanged. Repeated amphetamine exposure was associated with reduced dorsal striatal BOLD signal during decision making, but enhanced ventromedial caudate activity during reward anticipation. The amygdala BOLD response to reward outcomes was blunted following repeated amphetamine exposure. Positive correlations between subjective sensitization and changes in anticipation- and outcome-related BOLD signal were seen for the caudate nucleus and amygdala, respectively. These data show for the first time in humans that AS changes the functional impact of acute stimulant exposure on the processing of reward-related information within dopaminoceptive regions. Our findings accord with pathophysiological models which implicate aberrant dopaminergic modulation of striatal and amygdala activity in psychosis and drug-related compulsive disorders.

  14. Brain responses to emotional salience and reward in alcohol use disorder.

    Alba-Ferrara, L; Müller-Oehring, E M; Sullivan, E V; Pfefferbaum, A; Schulte, T

    2016-03-01

    Heightened neural responsiveness of alcoholics to alcohol cues and social emotion may impede sobriety. To test mesocorticolimbic network responsivity, 10 (8 men) alcohol use disorder (AUD) patients sober for 3 weeks to 10 months and 11 (8 men) controls underwent fMRI whilst viewing pictures of alcohol and non-alcohol beverages and of emotional faces (happy, sad, angry). AUD and controls showed similarities in mesocorticolimbic activity: both groups activated fusiform for emotional faces and hippocampal and pallidum regions during alcohol picture processing. In AUD, less fusiform activity to emotional faces and more pallidum activity to alcohol pictures were associated with longer sobriety. Using graph theory-based network efficiency measures to specify the role of the mesocorticolimbic network nodes for emotion and reward in sober AUD revealed that the left hippocampus was less efficiently connected with the other task-activated network regions in AUD than controls when viewing emotional faces, while the pallidum was more efficiently connected when viewing alcohol beverages. Together our findings identified lower occipito-temporal sensitivity to emotional faces and enhanced striatal sensitivity to alcohol stimuli in AUD than controls. Considering the role of the striatum in encoding reward, its activation enhancement with longer sobriety may reflect adaptive neural changes in the first year of drinking cessation and mesocorticolimbic system vulnerability for encoding emotional salience and reward potentially affecting executive control ability and relapse propensity during abstinence. PMID:25875013

  15. Reward-Related Dorsal Striatal Activity Differences between Former and Current Cocaine Dependent Individuals during an Interactive Competitive Game

    Hyatt, Christopher J.; Assaf, Michal; Christine E Muska; Rivkah I Rosen; Thomas, Andre D.; Johnson, Matthew R.; Jennifer L Hylton; Andrews, Melissa M.; Reynolds, Brady A.; Krystal, John H.; Potenza, Marc N.; Pearlson, Godfrey D.

    2012-01-01

    Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD) signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI) in current (CCD; n = 30) and former (FCD; n = 28) cocaine dependent subjects as well as healthy control (HC; n = 31) subjects while playing ...

  16. Positive and negative reinforcement activate human auditory cortex

    Tina Weis

    2013-12-01

    Full Text Available Prior studies suggest that reward modulates neural activity in sensory cortices, but less is known about punishment. We used functional magnetic resonance imaging and an auditory discrimination task, where participants had to judge the duration of frequency modulated tones. In one session correct performance resulted in financial gains at the end of the trial, in a second session incorrect performance resulted in financial loss. Incorrect performance in the rewarded as well as correct performance in the punishment condition resulted in a neutral outcome. The size of gains and losses was either low or high (10 or 50 Euro cent depending on the direction of frequency modulation. We analyzed neural activity at the end of the trial, during reinforcement, and found increased neural activity in auditory cortex when gaining a financial reward as compared to gaining no reward and when avoiding financial loss as compared to receiving a financial loss. This was independent on the size of gains and losses. A similar pattern of neural activity for both gaining a reward and avoiding a loss was also seen in right middle temporal gyrus, bilateral insula and pre-supplemental motor area, here however neural activity was lower after correct responses compared to incorrect responses. To summarize, this study shows that the activation of sensory cortices, as previously shown for gaining a reward is also seen during avoiding a loss.

  17. Video Game Training and the Reward System

    Robert C. Lorenz

    2015-02-01

    Full Text Available Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual towards playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training.Fifty healthy participants were randomly assigned to a video game training (TG or control group (CG. Before and after training/control period, functional magnetic resonance imaging (fMRI was conducted using a non-video game related reward task.At pretest, both groups showed strongest activation in ventral striatum (VS during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated.This longitudinal study revealed that video game training may preserve reward responsiveness in the ventral striatum in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  18. Video game training and the reward system.

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training. PMID:25698962

  19. Neural Changes following Behavioral Activation for a Depressed Breast Cancer Patient: A Functional MRI Case Study

    Gawrysiak, Michael J.; John P. Carvalho; Rogers, Baxter P.; Nicholas, Christopher R. N.; Dougherty, John H.; Hopko, Derek R.

    2012-01-01

    Functional neuroimaging is an innovative but at this stage underutilized method to assess the efficacy of psychotherapy for depression. Functional magnetic resonance imaging (fMRI) was used in this case study to examine changes in brain activity in a depressed breast cancer patient receiving an 8-session Behavioral Activation Treatment for Depression (BATD), based on the work of Hopko and Lejuez (2007). A music listening paradigm was used during fMRI brain scans to assess reward responsivenes...

  20. Altered social reward and attention in anorexia nervosa

    Karli K Watson

    2010-09-01

    Full Text Available Dysfunctional social reward and social orienting attend a variety of neuropsychiatric disorders including autism, schizophrenia, social anxiety, and psychopathy. Here we show that similar social reward and attention dysfunction attend anorexia nervosa, a disorder defined by avoidance of food and extreme weight loss. We measured the implicit reward value of social stimuli for female participants with (n=11 and without (n=11 anorexia nervosa using an econometric choice task and also tracked gaze patterns during free viewing of images of female faces and bodies. As predicted, the reward value of viewing bodies varied inversely with observed body weight for women with anorexia but not neurotypical women, in contrast with their explicit ratings of attractiveness. Surprisingly, women with anorexia nervosa, unlike neurotypical women, did not find female faces rewarding and avoided looking at both the face and eyes—independent of observed body weight. These findings demonstrate comorbid dysfunction in the neural circuits mediating gustatory and social reward in anorexia nervosa.

  1. An application of multilayer neural network on hepatitis disease diagnosis using approximations of sigmoid activation function

    Onursal Çetin; Feyzullah Temurtaş; Şenol Gülgönül

    2015-01-01

    Objective: Implementation of multilayer neural network (MLNN) with sigmoid activation function for the diagnosis of hepatitis disease.Methods: Artificial neural networks (ANNs) are efficient tools currently in common use for medical diagnosis. In hardware based architectures activation functions play an important role in ANN behavior. Sigmoid function is the most frequently used activation function because of its smooth response. Thus, sigmoid function and its close approximations were implem...

  2. The Roles of Dopamine and Related Compounds in Reward-Seeking Behavior Across Animal Phyla

    Barron, Andrew B.; Eirik Søvik; Cornish, Jennifer L.

    2010-01-01

    Motile animals actively seek out and gather resources they find rewarding, and this is an extremely powerful organiser and motivator of animal behaviour. Mammalian studies have revealed interconnected neurobiological systems for reward learning, reward assessment, reinforcement and reward seeking; all involving the biogenic amine dopamine. The neurobiology of reward-seeking behavioural systems is less well understood in invertebrates, but in many diverse invertebrate groups, reward learning ...

  3. Physical methods for generating and decoding neural activity in Hirudo verbana

    Migliori, Benjamin John

    The interface between living nervous systems and hardware is an excellent proving ground for precision experimental methods and information classification systems. Nervous systems are complex (104 -- 10 15(!) connections), fragile, and highly active in intricate, constantly evolving patterns. However, despite the conveniently electrical nature of neural transmission, the interface between nervous systems and hardware poses significant experimental difficulties. As the desire for direct interfaces with neural signals continues to expand, the need for methods of generating and measuring neural activity with high spatiotemporal precision has become increasingly critical. In this thesis, I describe advances I have made in the ability to modify, generate, measure, and understand neural signals both in- and ex-vivo. I focus on methods developed for transmitting and extracting signals in the intact nervous system of Hirudo verbana (the medicinal leech), an animal with a minimally complex nervous system (10000 neurons distributed in packets along a nerve cord) that exhibits a diverse array of behaviors. To introduce artificial activity patterns, I developed a photothermal activation system in which a highly focused laser is used to irradiate carbon microparticles in contact with target neurons. The resulting local temperature increase generates an electrical current that forces the target neuron to fire neural signals, thereby providing a unique neural input mechanism. These neural signals can potentially be used to alter behavioral choice or generate specific behavioral output, and can be used endogenously in many animal models. I also describe new tools developed to expand the application of this method. In complement to this input system, I describe a new method of analyzing neural output signals involved in long-range coordination of behaviors. Leech behavioral signals are propagated between neural packets as electrical pulses in the nerve connective, a bundle of

  4. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

    Berridge, K C; Robinson, T E

    1998-12-01

    What roles do mesolimbic and neostriatal dopamine systems play in reward? Do they mediate the hedonic impact of rewarding stimuli? Do they mediate hedonic reward learning and associative prediction? Our review of the literature, together with results of a new study of residual reward capacity after dopamine depletion, indicates the answer to both questions is 'no'. Rather, dopamine systems may mediate the incentive salience of rewards, modulating their motivational value in a manner separable from hedonia and reward learning. In a study of the consequences of dopamine loss, rats were depleted of dopamine in the nucleus accumbens and neostriatum by up to 99% using 6-hydroxydopamine. In a series of experiments, we applied the 'taste reactivity' measure of affective reactions (gapes, etc.) to assess the capacity of dopamine-depleted rats for: 1) normal affect (hedonic and aversive reactions), 2) modulation of hedonic affect by associative learning (taste aversion conditioning), and 3) hedonic enhancement of affect by non-dopaminergic pharmacological manipulation of palatability (benzodiazepine administration). We found normal hedonic reaction patterns to sucrose vs. quinine, normal learning of new hedonic stimulus values (a change in palatability based on predictive relations), and normal pharmacological hedonic enhancement of palatability. We discuss these results in the context of hypotheses and data concerning the role of dopamine in reward. We review neurochemical, electrophysiological, and other behavioral evidence. We conclude that dopamine systems are not needed either to mediate the hedonic pleasure of reinforcers or to mediate predictive associations involved in hedonic reward learning. We conclude instead that dopamine may be more important to incentive salience attributions to the neural representations of reward-related stimuli. Incentive salience, we suggest, is a distinct component of motivation and reward. In other words, dopamine systems are necessary

  5. A network-dependent rewarding system: proof-of-mining

    Lao, Joe

    2014-01-01

    A soft control of the network activity through varying reward in a proof-of-work (PoW) cryptocurrency is reported. Rewards are the necessity to incent the contributors activities (i.e., mining) in order to maintain the PoW network. Contrary to constant rewarding in a certain period implemented in most of cryptocurrency, such as bitcoin, we propose a network-dependent rewarding model system, primarily including two phases: 1) activities encouraging phase in which higher rewards are issued at h...

  6. Markov reward processes

    Smith, R. M.

    1991-01-01

    Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

  7. Robot Reinforcement Learning using EEG-based reward signals

    Iturrate, Inaki; Montesano, Luis; Minguez, Javier

    2010-01-01

    Reinforcement learning algorithms have been successfully applied in robotics to learn how to solve tasks based on reward signals obtained during task execution. These reward signals are usually modeled by the programmer or provided by supervision. However, there are situations in which this reward is hard to encode, and so would require a supervised approach of reinforcement learning, where a user directly types the reward on each trial. This paper proposes to use brain activity recorded by a...

  8. Testosterone and reward prediction-errors in healthy men and men with schizophrenia.

    Morris, R W; Purves-Tyson, T D; Weickert, C Shannon; Rothmond, D; Lenroot, R; Weickert, T W

    2015-11-01

    Sex hormones impact reward processing, which is dysfunctional in schizophrenia; however, the degree to which testosterone levels relate to reward-related brain activity in healthy men and the extent to which this relationship may be altered in men with schizophrenia has not been determined. We used functional magnetic resonance imaging (fMRI) to measure neural responses in the striatum during reward prediction-errors and hormone assays to measure testosterone and prolactin in serum. To determine if testosterone can have a direct effect on dopamine neurons, we also localized and measured androgen receptors in human midbrain with immunohistochemistry and quantitative PCR. We found correlations between testosterone and prediction-error related activity in the ventral striatum of healthy men, but not in men with schizophrenia, such that testosterone increased the size of positive and negative prediction-error related activity in a valence-specific manner. We also identified midbrain dopamine neurons that were androgen receptor immunoreactive, and found that androgen receptor (AR) mRNA was positively correlated with tyrosine hydroxylase (TH) mRNA in human male substantia nigra. The results suggest that sex steroid receptors can potentially influence midbrain dopamine biosynthesis, and higher levels of serum testosterone are linked to better discrimination of motivationally-relevant signals in the ventral striatum, putatively by modulation of the dopamine biosynthesis pathway via AR ligand binding. However, the normal relationship between serum testosterone and ventral striatum activity during reward learning appears to be disrupted in schizophrenia. PMID:26232868

  9. Anisotropy of ongoing neural activity in the primate visual cortex

    Maier A

    2014-09-01

    Full Text Available Alexander Maier,1 Michele A Cox,1 Kacie Dougherty,1 Brandon Moore,1 David A Leopold2 1Department of Psychology, College of Arts and Science, Vanderbilt University, Nashville, TN, USA; 2Section on Cognitive Neurophysiology and Imaging, National Institute of Mental Health, National Institute of Health, Bethesda, MD, USA Abstract: The mammalian neocortex features distinct anatomical variation in its tangential and radial extents. This review consolidates previously published findings from our group in order to compare and contrast the spatial profile of neural activity coherence across these distinct cortical dimensions. We focus on studies of ongoing local field potential (LFP data obtained simultaneously from multiple sites in the primary visual cortex in two types of experiments in which electrode contacts were spaced either along the cortical surface or at different laminar positions. These studies demonstrate that across both dimensions the coherence of ongoing LFP fluctuations diminishes as a function of interelectrode distance, although the nature and spatial scale of this falloff is very different. Along the cortical surface, the overall LFP coherence declines gradually and continuously away from a given position. In contrast, across the cortical layers, LFP coherence is discontinuous and compartmentalized as a function of depth. Specifically, regions of high LFP coherence fall into discrete superficial and deep laminar zones, with an abrupt discontinuity between the granular and infragranular layers. This spatial pattern of ongoing LFP coherence is similar when animals are at rest and when they are engaged in a behavioral task. These results point to the existence of partially segregated laminar zones of cortical processing that extend tangentially within the laminar compartments and are thus oriented orthogonal to the cortical columns. We interpret these electrophysiological observations in light of the known anatomical organization of

  10. Activation of D1/5 Dopamine Receptors: A Common Mechanism for Enhancing Extinction of Fear and Reward-Seeking Behaviors.

    Abraham, Antony D; Neve, Kim A; Lattal, K Matthew

    2016-07-01

    Dopamine is critical for many processes that drive learning and memory, including motivation, prediction error, incentive salience, memory consolidation, and response output. Theories of dopamine's function in these processes have, for the most part, been developed from behavioral approaches that examine learning mechanisms in appetitive tasks. A parallel and growing literature indicates that dopamine signaling is involved in consolidation of memories into stable representations in aversive tasks such as fear conditioning. Relatively little is known about how dopamine may modulate memories that form during extinction, when organisms learn that the relation between previously associated events is severed. We investigated whether fear and reward extinction share common mechanisms that could be enhanced with dopamine D1/5 receptor activation. Pharmacological activation of dopamine D1/5 receptors (with SKF 81297) enhanced extinction of both cued and contextual fear. These effects also occurred in the extinction of cocaine-induced conditioned place preference, suggesting that the observed effects on extinction were not specific to a particular type of procedure (aversive or appetitive). A cAMP/PKA biased D1 agonist (SKF 83959) did not affect fear extinction, whereas a broadly efficacious D1 agonist (SKF 83822) promoted fear extinction. Together, these findings show that dopamine D1/5 receptor activation is a target for the enhancement of fear or reward extinction. PMID:26763483

  11. Extending overjustification: the effect of perceived reward-giver intention on response to rewards.

    Forehand, M R

    2000-12-01

    The perceived intention model incorporates a new moderator, beliefs about reward-giver intention, into the overjustification paradigm. In 2 simulated shopping studies featuring products paired with promotional rewards, consumers who believed the marketer was promotion focused (reward used to encourage purchase) reported lower purchase intentions and brand attitudes for promoted products after promotion, whereas consumers who believed the marketer was reward focused (promotion used to distribute the reward) showed no attitude change. Promotion-focus beliefs lowered attitudes by heightening the contingency between the promotion and purchase and thereby increasing the perceived causal role of the reward. This effect was contingent on initial behavior--postpromotion attitude change occurred for consumers who actively engaged in product decisions but not for consumers who passively observed the choice sets. PMID:11125656

  12. Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition

    Francisco Javier Ordóñez; Daniel Roggen

    2016-01-01

    Human activity recognition (HAR) tasks have traditionally been solved using engineered features obtained by heuristic processes. Current research suggests that deep convolutional neural networks are suited to automate feature extraction from raw sensor inputs. However, human activities are made of complex sequences of motor movements, and capturing this temporal dynamics is fundamental for successful HAR. Based on the recent success of recurrent neural networks for time series domains, we pro...

  13. Tracking cortical entrainment in neural activity: Auditory processes in human temporal cortex

    Thwaites, Andrew; Nimmo-Smith, Ian; Fonteneau, Elisabeth; Patterson, Roy D.; Buttery, Paula; Marslen-Wilson, William D.

    2015-01-01

    A primary objective for cognitive neuroscience is to identify how features of the sensory environment are encoded in neural activity. Current auditory models of loudness perception can be used to make detailed predictions about the neural activity of the cortex as an individual listens to speech. We used two such models (loudness-sones and loudness-phons), varying in their psychophysiological realism, to predict the instantaneous loudness contours produced by 480 isolated words. These two set...

  14. Parasympathetic neural activity accounts for the lowering of exercise heart rate at high altitude

    Boushel, Robert Christopher; Calbet, J A; Rådegran, G; Sondergaard, H; Wagner, Poul Erik; Saltin, B

    2001-01-01

    In chronic hypoxia, both heart rate (HR) and cardiac output (Q) are reduced during exercise. The role of parasympathetic neural activity in lowering HR is unresolved, and its influence on Q and oxygen transport at high altitude has never been studied.......In chronic hypoxia, both heart rate (HR) and cardiac output (Q) are reduced during exercise. The role of parasympathetic neural activity in lowering HR is unresolved, and its influence on Q and oxygen transport at high altitude has never been studied....

  15. Modeling electrocortical activity through improved local approximations of integral neural field equations

    Coombes, Stephen; Venkov, Nikola; Shiau, LieJune; Bojak, Ingo; Liley, David; Laing, Carlo

    2007-01-01

    Neural field models of firing rate activity typically take the form of integral equations with space-dependent axonal delays. Under natural assumptions on the synaptic connectivity we show how one can derive an equivalent partial differential equation (PDE) model that properly treats the axonal delay terms of the integral formulation. Our analysis avoids the so-called long-wavelength approximation that has previously been used to formulate PDE models for neural activity in two spatial dime...

  16. Endogenous GLP-1 mediates postprandial reductions in activation in central reward and satiety areas in patients with type 2 diabetes

    Ten Kulve, Jennifer S; Veltman, Dick J; van Bloemendaal, Liselotte;

    2015-01-01

    Aims/hypothesis The central nervous system (CNS) is a major player in the regulation of food intake. The gut hormone glucagon-like peptide-1 (GLP-1) has been proposed to have an important role in this regulation by relaying information about nutritional status to the CNS. We hypothesised that...... endogenous GLP-1 has effects on CNS reward and satiety circuits. Methods This was a randomised, crossover, placebo-controlled intervention study, performed in a university medical centre in the Netherlands. We included patients with type 2 diabetes and healthy lean control subjects. Individuals were eligible...

  17. Reward Processing in Autism

    Scott-Van Zeeland, Ashley A.; DAPRETTO, MIRELLA; Ghahremani, Dara G.; Poldrack, Russell A.; Bookheimer, Susan Y.

    2010-01-01

    The social motivation hypothesis of autism posits that infants with autism do not experience social stimuli as rewarding, thereby leading to a cascade of potentially negative consequences for later development. While possible downstream effects of this hypothesis such as altered face and voice processing have been examined, there has not been a direct investigation of social reward processing in autism. Here we use functional magnetic resonance imaging to examine social and monetary rewarded ...

  18. Fast and Automatic Activation of an Abstract Representation of Money in the Human Ventral Visual Pathway

    Bourgeois-Gironde, Sacha; Tallon-Baudry, Catherine; Florent, Meyniel

    2011-01-01

    Money, when used as an incentive, activates the same neural circuits as rewards associated with physiological needs. However, unlike physiological rewards, monetary stimuli are cultural artifacts: how are monetary stimuli identified in the first place? How and when does the brain identify a valid coin, i.e. a disc of metal that is, by social agreement, endowed with monetary properties? We took advantage of the changes in the Euro area in 2002 to compare neural responses to valid coins (Euros,...

  19. Accounting for Dynamic Fluctuations across Time when Examining fMRI Test-Retest Reliability: Analysis of a Reward Paradigm in the EMBARC Study.

    Henry W Chase

    Full Text Available Longitudinal investigation of the neural correlates of reward processing in depression may represent an important step in defining effective biomarkers for antidepressant treatment outcome prediction, but the reliability of reward-related activation is not well understood. Thirty-seven healthy control participants were scanned using fMRI while performing a reward-related guessing task on two occasions, approximately one week apart. Two main contrasts were examined: right ventral striatum (VS activation fMRI BOLD signal related to signed prediction errors (PE and reward expectancy (RE. We also examined bilateral visual cortex activation coupled to outcome anticipation. Significant VS PE-related activity was observed at the first testing session, but at the second testing session, VS PE-related activation was significantly reduced. Conversely, significant VS RE-related activity was observed at time 2 but not time 1. Increases in VS RE-related activity from time 1 to time 2 were significantly associated with decreases in VS PE-related activity from time 1 to time 2 across participants. Intraclass correlations (ICCs in VS were very low. By contrast, visual cortex activation had much larger ICCs, particularly in individuals with high quality data. Dynamic changes in brain activation are widely predicted, and failure to account for these changes could lead to inaccurate evaluations of the reliability of functional MRI signals. Conventional measures of reliability cannot distinguish between changes specified by algorithmic models of neural function and noisy signal. Here, we provide evidence for the former possibility: reward-related VS activations follow the pattern predicted by temporal difference models of reward learning but have low ICCs.

  20. Theta-band oscillatory activity differs between gamblers and nongamblers comorbid with attention-deficit hyperactivity disorder in a probabilistic reward-learning task.

    Abouzari, Mehdi; Oberg, Scott; Tata, Matthew

    2016-10-01

    Problemgambling is thought to be comorbid with attention-deficit hyperactivity disorder (ADHD). We tested whether gamblers and ADHD patients exhibit similar reward-related brain activity in response to feedback in a gambling task. A series of brain electrical responses can be observed in the electroencephalogram (EEG) and the stimulus-locked event-related potentials (ERP), when participants in a gambling task are given feedback regardless of winning or losing the previous bet. Here, we used a simplified computerized version of the Iowa Gambling Task (IGT) to assess differences in reinforcement-driven choice adaptation between unmedicated ADHD patients with or without problem gambling traits and contrasted with a sex- and age-matched control group. EEG was recorded from the participants while they were engaged in the task which contained two choice options with different net payouts and win/loss probabilities. Learning trend which shows the ability to acquire and use knowledge of the reward outcomes to obtain a positive financial outcome was not observed in ADHD gamblers versus nongamblers. Induced theta-band (4-8Hz) power over frontal cortex was significantly higher in gamblers versus nongamblers in all different high-risk/low-risk win/lose conditions. Whereas induced low alpha (9-11Hz) power at frontal electrodes could only differentiate high-risk lose between gamblers and nongamblers but not the other three conditions between the two groups. The results indicate that ADHD nongamblers do not share with problem gamblers underlying deficits in reward learning. These pilot data highlight the need for studies of ADHD in gambling to elucidate how motivational states are represented during feedback processing. PMID:27318102

  1. Lack of telomerase activity in rabbit bone marrow stromal cells during differentiation along neural pathway

    CHEN Zhen-zhou; XU Ru-xiang; JIANG Xiao-dan; TENG Xiao-hua; LI Gui-tao; ZHOU Yü-xi

    2006-01-01

    Objective: To investigate telomerase activity in rabbit bone marrow stromal cells (BMSCs) during their committed differentiation in vitro along neural pathway and the effect of glial cell line-derived neurotrophic factor (GDNF) on the expression of telomerase.Methods: BMSCs were acquired from rabbit marrow and divided into control group, GDNF (10 ng/ml) group.No. ZL02134314. 4) supplemented with 10% fetal bovine serum (FBS) was used to induce BMSCs differentiation along neural pathway. Fluorescent immunocytochemistry was employed to identify the expressions of Nestin, neuronspecific endase (NSE), and gial fibrillary acidic protein (GFAP). The growth curves of the cells and the status of cell cycles were analyzed, respectively. During the differentiation, telomerase activitys were detected using the telomeric repeat amplification protocol-enzyme-linked immunosorbent assay (TRAP-ELISA).Results: BMSCs were successfully induced to differentiate along neural pathway and expressed specific markers of fetal neural epithelium, mature neuron and glial cells. Telomerase activities were undetectable in BMSCs during differentiation along neural pathway. Similar changes of cell growth curves, cell cycle status and telomerase expression were observed in the two groups.Conclusions: Rabbit BMSCs do not display telomerase activity during differentiation along neural pathway. GDNF shows little impact on proliferation and telomerase activity of BMSCs.

  2. The fiber-optic imaging and manipulation of neural activity during animal behavior.

    Miyamoto, Daisuke; Murayama, Masanori

    2016-02-01

    Recent progress with optogenetic probes for imaging and manipulating neural activity has further increased the relevance of fiber-optic systems for neural circuitry research. Optical fibers, which bi-directionally transmit light between separate sites (even at a distance of several meters), can be used for either optical imaging or manipulating neural activity relevant to behavioral circuitry mechanisms. The method's flexibility and the specifications of the light structure are well suited for following the behavior of freely moving animals. Furthermore, thin optical fibers allow researchers to monitor neural activity from not only the cortical surface but also deep brain regions, including the hippocampus and amygdala. Such regions are difficult to target with two-photon microscopes. Optogenetic manipulation of neural activity with an optical fiber has the advantage of being selective for both cell-types and projections as compared to conventional electrophysiological brain tissue stimulation. It is difficult to extract any data regarding changes in neural activity solely from a fiber-optic manipulation device; however, the readout of data is made possible by combining manipulation with electrophysiological recording, or the simultaneous application of optical imaging and manipulation using a bundle-fiber. The present review introduces recent progress in fiber-optic imaging and manipulation methods, while also discussing fiber-optic system designs that are suitable for a given experimental protocol. PMID:26427958

  3. Neural Activity during Encoding Predicts False Memories Created by Misinformation

    Okado, Yoko; Stark, Craig E. L.

    2005-01-01

    False memories are often demonstrated using the misinformation paradigm, in which a person's recollection of a witnessed event is altered after exposure to misinformation about the event. The neural basis of this phenomenon, however, remains unknown. The authors used fMRI to investigate encoding processes during the viewing of an event and…

  4. Dopamine signals mimic reward prediction errors

    Schoenbaum, Geoffrey; Esber, Guillem R; Iordanova, Mihaela D.

    2013-01-01

    Modern theories of associative learning center on a prediction error. A study finds that artificial activation of dopamine neurons can substitute for missing reward prediction errors to rescue blocked learning.

  5. Addiction: Beyond dopamine reward circuitry

    Volkow, N.D.; Wang, G.; Volkow, N.D.; Wang, G.-J.; Fowler, J.S.; Tomasi, D.; Telang, F.

    2011-09-13

    Dopamine (DA) is considered crucial for the rewarding effects of drugs of abuse, but its role in addiction is much less clear. This review focuses on studies that used PET to characterize the brain DA system in addicted subjects. These studies have corroborated in humans the relevance of drug-induced fast DA increases in striatum [including nucleus accumbens (NAc)] in their rewarding effects but have unexpectedly shown that in addicted subjects, drug-induced DA increases (as well as their subjective reinforcing effects) are markedly blunted compared with controls. In contrast, addicted subjects show significant DA increases in striatum in response to drug-conditioned cues that are associated with self-reports of drug craving and appear to be of a greater magnitude than the DA responses to the drug. We postulate that the discrepancy between the expectation for the drug effects (conditioned responses) and the blunted pharmacological effects maintains drug taking in an attempt to achieve the expected reward. Also, whether tested during early or protracted withdrawal, addicted subjects show lower levels of D2 receptors in striatum (including NAc), which are associated with decreases in baseline activity in frontal brain regions implicated in salience attribution (orbitofrontal cortex) and inhibitory control (anterior cingulate gyrus), whose disruption results in compulsivity and impulsivity. These results point to an imbalance between dopaminergic circuits that underlie reward and conditioning and those that underlie executive function (emotional control and decision making), which we postulate contributes to the compulsive drug use and loss of control in addiction.

  6. Addiction: Beyond dopamine reward circuitry

    Dopamine (DA) is considered crucial for the rewarding effects of drugs of abuse, but its role in addiction is much less clear. This review focuses on studies that used PET to characterize the brain DA system in addicted subjects. These studies have corroborated in humans the relevance of drug-induced fast DA increases in striatum [including nucleus accumbens (NAc)] in their rewarding effects but have unexpectedly shown that in addicted subjects, drug-induced DA increases (as well as their subjective reinforcing effects) are markedly blunted compared with controls. In contrast, addicted subjects show significant DA increases in striatum in response to drug-conditioned cues that are associated with self-reports of drug craving and appear to be of a greater magnitude than the DA responses to the drug. We postulate that the discrepancy between the expectation for the drug effects (conditioned responses) and the blunted pharmacological effects maintains drug taking in an attempt to achieve the expected reward. Also, whether tested during early or protracted withdrawal, addicted subjects show lower levels of D2 receptors in striatum (including NAc), which are associated with decreases in baseline activity in frontal brain regions implicated in salience attribution (orbitofrontal cortex) and inhibitory control (anterior cingulate gyrus), whose disruption results in compulsivity and impulsivity. These results point to an imbalance between dopaminergic circuits that underlie reward and conditioning and those that underlie executive function (emotional control and decision making), which we postulate contributes to the compulsive drug use and loss of control in addiction.

  7. High baseline activity in inferior temporal cortex improves neural and behavioral discriminability during visual categorization

    Nazli eEmadi

    2014-11-01

    Full Text Available Spontaneous firing is a ubiquitous property of neural activity in the brain. Recent literature suggests that this baseline activity plays a key role in perception. However, it is not known how the baseline activity contributes to neural coding and behavior. Here, by recording from the single neurons in the inferior temporal cortex of monkeys performing a visual categorization task, we thoroughly explored the relationship between baseline activity, the evoked response, and behavior. Specifically we found that a low-frequency (< 8 Hz oscillation in the spike train, prior and phase-locked to the stimulus onset, was correlated with increased gamma power and neuronal baseline activity. This enhancement of the baseline activity was then followed by an increase in the neural selectivity and the response reliability and eventually a higher behavioral performance.

  8. Leptin regulates the reward value of nutrient

    Domingos, Ana I.; Vaynshteyn, Jake; Voss, Henning U.; Ren, Xueying; Gradinaru, Viviana; Zang, Feng; Deisseroth, Karl; de Araujo, Ivan E.; Friedman, Jeffrey

    2011-01-01

    We developed an assay for quantifying the reward value of nutrient and used it to analyze the effects of metabolic state and leptin. In this assay, mice chose between two sippers, one of which dispensed water and was coupled to optogenetic activation of dopaminergic (DA) neurons and the other of which dispensed natural or artificial sweeteners. This assay measured the reward value of sweeteners relative to lick-induced optogenetic activation of DA neurons. Mice preferred optogenetic stimulati...

  9. A fast learning algorithm of neural network with tunable activation function

    SHEN Yanjun; WANG Bingwen

    2004-01-01

    This paper presents a modified structure of a neural network with tunable activation function and provides a new learning algorithm for the neural network training. Simulation results of XOR problem, Feigenbaum function, and Henon map show that the new algorithm has better performance than BP (back propagation) algorithm in terms of shorter convergence time and higher convergence accuracy. Further modifications of the structure of the neural network with the faster learning algorithm demonstrate simpler structure with even faster convergence speed and better convergence accuracy.

  10. Functional Relevance of Different Basal Ganglia Pathways Investigated in a Spiking Model with Reward Dependent Plasticity.

    Berthet, Pierre; Lindahl, Mikael; Tully, Philip J; Hellgren-Kotaleski, Jeanette; Lansner, Anders

    2016-01-01

    The brain enables animals to behaviorally adapt in order to survive in a complex and dynamic environment, but how reward-oriented behaviors are achieved and computed by its underlying neural circuitry is an open question. To address this concern, we have developed a spiking model of the basal ganglia (BG) that learns to dis-inhibit the action leading to a reward despite ongoing changes in the reward schedule. The architecture of the network features the two pathways commonly described in BG, the direct (denoted D1) and the indirect (denoted D2) pathway, as well as a loop involving striatum and the dopaminergic system. The activity of these dopaminergic neurons conveys the reward prediction error (RPE), which determines the magnitude of synaptic plasticity within the different pathways. All plastic connections implement a versatile four-factor learning rule derived from Bayesian inference that depends upon pre- and post-synaptic activity, receptor type, and dopamine level. Synaptic weight updates occur in the D1 or D2 pathways depending on the sign of the RPE, and an efference copy informs upstream nuclei about the action selected. We demonstrate successful performance of the system in a multiple-choice learning task with a transiently changing reward schedule. We simulate lesioning of the various pathways and show that a condition without the D2 pathway fares worse than one without D1. Additionally, we simulate the degeneration observed in Parkinson's disease (PD) by decreasing the number of dopaminergic neurons during learning. The results suggest that the D1 pathway impairment in PD might have been overlooked. Furthermore, an analysis of the alterations in the synaptic weights shows that using the absolute reward value instead of the RPE leads to a larger change in D1. PMID:27493625

  11. Active Vibration Control of the Smart Plate Using Artificial Neural Network Controller

    Mohit

    2015-01-01

    Full Text Available The active vibration control (AVC of a rectangular plate with single input and single output approach is investigated using artificial neural network. The cantilever plate of finite length, breadth, and thickness having piezoelectric patches as sensors/actuators fixed at the upper and lower surface of the metal plate is considered for examination. The finite element model of the cantilever plate is utilized to formulate the whole strategy. The compact RIO and MATLAB simulation software are exercised to get the appropriate results. The cantilever plate is subjected to impulse input and uniform white noise disturbance. The neural network is trained offline and tuned with LQR controller. The various training algorithms to tune the neural network are exercised. The best efficient algorithm is finally considered to tune the neural network controller designed for active vibration control of the smart plate.

  12. Validation and extension of the reward-mountain model

    Yannick-André eBreton

    2013-10-01

    Full Text Available The reward-mountain model relates the vigor of reward seeking to the strength and cost of reward. Application of this model provides information about the stage of processing at which manipulations such as drug administration, lesions, deprivation states, and optogenetic interventions act to alter reward seeking. The model has been updated by incorporation of new information about frequency following in the directly stimulated neurons responsible for brain stimulation reward and about the function that maps objective opportunity costs into subjective ones. The behavioral methods for applying the model have been updated and improved as well. To assess the impact of these changes, two related predictions of the model that were supported by earlier work have been retested: 1 altering the duration of rewarding brain stimulation should change the pulse frequency required to produce a reward of half-maximal intensity, and 2 this manipulation should not change the opportunity cost at which half-maximal performance is directed at earning a maximally intense reward. Prediction 1 was supported in all six subjects, but prediction 2 was supported in only three. The latter finding is interpreted to reflect recruitment, at some stimulation sites, of a heterogeneous reward substrate comprising dual, parallel circuits that integrate the stimulation-induced neural signals.

  13. Low and high gamma oscillations in rat ventral striatum have distinct relationships to behavior, reward, and spiking activity on a learned spatial decision task

    Matthijs A A Van Der Meer

    2009-06-01

    Full Text Available Local field potential (LFP oscillations in the brain reflect organization thought to be important for perception, attention, movement, and memory. In the basal ganglia, including dorsal striatum, dysfunctional LFP states are associated with Parkinson’s disease, while in healthy subjects, dorsal striatal LFPs have been linked to decision-making processes. However, LFPs in ventral striatum have been less studied. We report that in rats running a spatial decision task, prominent gamma-50 (45-55 Hz and gamma-80 (70-85 Hz oscillations in ventral striatum had distinct relationships to behavior, task events, and spiking activity. Gamma-50 power increased sharply following reward delivery and before movement initiation, while in contrast, gamma-80 power ramped up gradually to reward locations. Gamma-50 power was low and contained little structure during early learning, but rapidly developed a stable pattern, while gamma-80 power was initially high before returning to a stable level within a similar timeframe. Putative fast-spiking interneurons (FSIs showed phase, firing rate, and coherence relationships with gamma-50 and gamma-80, indicating that the observed LFP patterns are locally relevant. Furthermore, in a number of FSIs such relationships were specific to gamma-50 or gamma-80, suggesting that partially distinct FSI populations mediate the effects of gamma-50 and gamma-80.

  14. A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects.

    Truccolo, Wilson; Eden, Uri T; Fellows, Matthew R; Donoghue, John P; Brown, Emery N

    2005-02-01

    Multiple factors simultaneously affect the spiking activity of individual neurons. Determining the effects and relative importance of these factors is a challenging problem in neurophysiology. We propose a statistical framework based on the point process likelihood function to relate a neuron's spiking probability to three typical covariates: the neuron's own spiking history, concurrent ensemble activity, and extrinsic covariates such as stimuli or behavior. The framework uses parametric models of the conditional intensity function to define a neuron's spiking probability in terms of the covariates. The discrete time likelihood function for point processes is used to carry out model fitting and model analysis. We show that, by modeling the logarithm of the conditional intensity function as a linear combination of functions of the covariates, the discrete time point process likelihood function is readily analyzed in the generalized linear model (GLM) framework. We illustrate our approach for both GLM and non-GLM likelihood functions using simulated data and multivariate single-unit activity data simultaneously recorded from the motor cortex of a monkey performing a visuomotor pursuit-tracking task. The point process framework provides a flexible, computationally efficient approach for maximum likelihood estimation, goodness-of-fit assessment, residual analysis, model selection, and neural decoding. The framework thus allows for the formulation and analysis of point process models of neural spiking activity that readily capture the simultaneous effects of multiple covariates and enables the assessment of their relative importance. PMID:15356183

  15. Characterization of the feeding inhibition and neural activation produced by dorsomedial hypothalamic cholecystokinin administration

    Chen, Jie; Scott, Karen A.; Zhao, Zhengyan; Moran, Timothy H.; BI, Sheng

    2008-01-01

    Within the dorsomedial hypothalamus (DMH), cholecystokinin (CCK) has been proposed to modulate neuropeptide Y (NPY) signaling to affect food intake. However, the neural circuitry underlying the actions of this CCK-NPY signaling system in the controls of food intake has yet to be determined. We sought to characterize the feeding inhibition and brain neural activation produced by CCK administration into the DMH of rats. We determined the time course of feeding inhibitory effects of exogenous DM...

  16. Variability of neural activation during walking in humans: short heels and big calves

    Ahn, A. N.; Kang, J. K.; Quitt, M. A.; Davidson, B. C.; Nguyen, C. T.

    2011-01-01

    People come in different shapes and sizes. In particular, calf muscle size in humans varies considerably. One possible cause for the different shapes of calf muscles is the inherent difference in neural signals sent to these muscles during walking. In sedentary adults, the variability in neural control of the calf muscles was examined with muscle size, walking kinematics and limb morphometrics. Half the subjects walked while activating their medial gastrocnemius (MG) muscles more strongly tha...

  17. Relation of obesity to neural activation in response to food commercials

    Gearhardt, Ashley N; Yokum, Sonja; Stice, Eric; Harris, Jennifer L.; Brownell, Kelly D.

    2013-01-01

    Adolescents view thousands of food commercials annually, but the neural response to food advertising and its association with obesity is largely unknown. This study is the first to examine how neural response to food commercials differs from other stimuli (e.g. non-food commercials and television show) and to explore how this response may differ by weight status. The blood oxygen level-dependent functional magnetic resonance imaging activation was measured in 30 adolescents ranging from lean ...

  18. Coupling Strength and System Size Induce Firing Activity of Globally Coupled Neural Network

    WEI Du-Qu; LUO Xiao-Shu; ZOU Yan-Li

    2008-01-01

    We investigate how firing activity of globally coupled neural network depends on the coupling strength C and system size N.Network elements are described by space-clamped FitzHugh-Nagumo (SCFHN) neurons with the values of parameters at which no firing activity occurs.It is found that for a given appropriate coupling strength,there is an intermediate range of system size where the firing activity of globally coupled SCFHN neural network is induced and enhanced.On the other hand,for a given intermediate system size level,there ex/sts an optimal value of coupling strength such that the intensity of firing activity reaches its maximum.These phenomena imply that the coupling strength and system size play a vital role in firing activity of neural network.

  19. The impact of cancer on the neural activity

    Iarosz, Kelly Cristiane; Baptista, Murilo da Silva; Protachevicz, Paulo Ricardo

    2015-01-01

    We study the impact of the decrease in the neural population on the neuronal firing rate. We propose a cellular automaton model from cancerous growth in a brain tissue and the death of neurons due absence of cells that help support to neurons. We use this model to study how the firing rate changes when the neuronal networks is under different external stimuli and the cancerous cells have different proliferation rate. Our work shows that the cancer proliferation decreases the neuronal firing rate.

  20. Early Interfaced Neural Activity from Chronic Amputated Nerves

    Garde, Kshitija; Keefer, Edward; Botterman, Barry; Galvan, Pedro; Romero, Mario I.

    2009-01-01

    Direct interfacing of transected peripheral nerves with advanced robotic prosthetic devices has been proposed as a strategy for achieving natural motor control and sensory perception of such bionic substitutes, thus fully functionally replacing missing limbs in amputees. Multi-electrode arrays placed in the brain and peripheral nerves have been used successfully to convey neural control of prosthetic devices to the user. However, reactive gliosis, micro hemorrhages, axonopathy and excessive i...

  1. Early interfaced neural activity from chronic amputated nerves

    Kshitija Garde; Barry Botterman; Pedro Galvan

    2009-01-01

    Direct interfacing of transected peripheral nerves with advanced robotic prosthetic devices has been proposed as a strategy for achieving natural motor control and sensory perception of such bionic substitutes, thus fully functionally replacing missing limbs in amputees. Multi-electrode arrays placed in the brain and peripheral nerves have been used successfully to convey neural control of prosthetic devices to the user. However, reactive gliosis, micro hemorrhages, axonopathy and excessive i...

  2. Risk-taking in disorders of natural and drug rewards

    Voon, Valerie; Morris, Laurel S; Irvine, Michael A;

    2015-01-01

    Pathological behaviors toward drugs and food rewards have underlying commonalities. Risk-taking has a fourfold pattern varying as a function of probability and valence leading to the nonlinearity of probability weighting with overweighting of small probabilities and underweighting of large...... probabilities. Here we assess these influences on risk-taking in patients with pathological behaviors toward drug and food rewards and examine structural neural correlates of nonlinearity of probability weighting in healthy volunteers. In the anticipation of rewards, subjects with binge eating disorder show...... greater risk-taking, similar to substance-use disorders. Methamphetamine-dependent subjects had greater nonlinearity of probability weighting along with impaired subjective discrimination of probability and reward magnitude. Ex-smokers also had lower risk-taking to rewards compared with non...

  3. Temporal coupling between stimulus-evoked neural activity and hemodynamic responses from individual cortical columns

    Using previously published data from the whisker barrel cortex of anesthetized rodents (Berwick et al 2008 J. Neurophysiol. 99 787-98) we investigated whether highly spatially localized stimulus-evoked cortical hemodynamics responses displayed a linear time-invariant (LTI) relationship with neural activity. Presentation of stimuli to individual whiskers of 2 s and 16 s durations produced hemodynamics and neural activity spatially localized to individual cortical columns. Two-dimensional optical imaging spectroscopy (2D-OIS) measured hemoglobin responses, while multi-laminar electrophysiology recorded neural activity. Hemoglobin responses to 2 s stimuli were deconvolved with underlying evoked neural activity to estimate impulse response functions which were then convolved with neural activity evoked by 16 s stimuli to generate predictions of hemodynamic responses. An LTI system more adequately described the temporal neuro-hemodynamics coupling relationship for these spatially localized sensory stimuli than in previous studies that activated the entire whisker cortex. An inability to predict the magnitude of an initial 'peak' in the total and oxy- hemoglobin responses was alleviated when excluding responses influenced by overlying arterial components. However, this did not improve estimation of the hemodynamic responses return to baseline post-stimulus cessation.

  4. Dynamical Behaviors of Multiple Equilibria in Competitive Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions.

    Nie, Xiaobing; Zheng, Wei Xing

    2016-03-01

    This paper addresses the problem of coexistence and dynamical behaviors of multiple equilibria for competitive neural networks. First, a general class of discontinuous nonmonotonic piecewise linear activation functions is introduced for competitive neural networks. Then based on the fixed point theorem and theory of strict diagonal dominance matrix, it is shown that under some conditions, such n -neuron competitive neural networks can have 5(n) equilibria, among which 3(n) equilibria are locally stable and the others are unstable. More importantly, it is revealed that the neural networks with the discontinuous activation functions introduced in this paper can have both more total equilibria and locally stable equilibria than the ones with other activation functions, such as the continuous Mexican-hat-type activation function and discontinuous two-level activation function. Furthermore, the 3(n) locally stable equilibria given in this paper are located in not only saturated regions, but also unsaturated regions, which is different from the existing results on multistability of neural networks with multiple level activation functions. A simulation example is provided to illustrate and validate the theoretical findings. PMID:25826814

  5. Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis.

    Chase, Henry W; Kumar, Poornima; Eickhoff, Simon B; Dombrovski, Alexandre Y

    2015-06-01

    Reinforcement learning describes motivated behavior in terms of two abstract signals. The representation of discrepancies between expected and actual rewards/punishments-prediction error-is thought to update the expected value of actions and predictive stimuli. Electrophysiological and lesion studies have suggested that mesostriatal prediction error signals control behavior through synaptic modification of cortico-striato-thalamic networks. Signals in the ventromedial prefrontal and orbitofrontal cortex are implicated in representing expected value. To obtain unbiased maps of these representations in the human brain, we performed a meta-analysis of functional magnetic resonance imaging studies that had employed algorithmic reinforcement learning models across a variety of experimental paradigms. We found that the ventral striatum (medial and lateral) and midbrain/thalamus represented reward prediction errors, consistent with animal studies. Prediction error signals were also seen in the frontal operculum/insula, particularly for social rewards. In Pavlovian studies, striatal prediction error signals extended into the amygdala, whereas instrumental tasks engaged the caudate. Prediction error maps were sensitive to the model-fitting procedure (fixed or individually estimated) and to the extent of spatial smoothing. A correlate of expected value was found in a posterior region of the ventromedial prefrontal cortex, caudal and medial to the orbitofrontal regions identified in animal studies. These findings highlight a reproducible motif of reinforcement learning in the cortico-striatal loops and identify methodological dimensions that may influence the reproducibility of activation patterns across studies. PMID:25665667

  6. Perceptual similarity of visual patterns predicts dynamic neural activation patterns measured with MEG.

    Wardle, Susan G; Kriegeskorte, Nikolaus; Grootswagers, Tijl; Khaligh-Razavi, Seyed-Mahdi; Carlson, Thomas A

    2016-05-15

    Perceptual similarity is a cognitive judgment that represents the end-stage of a complex cascade of hierarchical processing throughout visual cortex. Previous studies have shown a correspondence between the similarity of coarse-scale fMRI activation patterns and the perceived similarity of visual stimuli, suggesting that visual objects that appear similar also share similar underlying patterns of neural activation. Here we explore the temporal relationship between the human brain's time-varying representation of visual patterns and behavioral judgments of perceptual similarity. The visual stimuli were abstract patterns constructed from identical perceptual units (oriented Gabor patches) so that each pattern had a unique global form or perceptual 'Gestalt'. The visual stimuli were decodable from evoked neural activation patterns measured with magnetoencephalography (MEG), however, stimuli differed in the similarity of their neural representation as estimated by differences in decodability. Early after stimulus onset (from 50ms), a model based on retinotopic organization predicted the representational similarity of the visual stimuli. Following the peak correlation between the retinotopic model and neural data at 80ms, the neural representations quickly evolved so that retinotopy no longer provided a sufficient account of the brain's time-varying representation of the stimuli. Overall the strongest predictor of the brain's representation was a model based on human judgments of perceptual similarity, which reached the limits of the maximum correlation with the neural data defined by the 'noise ceiling'. Our results show that large-scale brain activation patterns contain a neural signature for the perceptual Gestalt of composite visual features, and demonstrate a strong correspondence between perception and complex patterns of brain activity. PMID:26899210

  7. Selective activation of the trace amine-associated receptor 1 decreases cocaine's reinforcing efficacy and prevents cocaine-induced changes in brain reward thresholds.

    Pei, Yue; Mortas, Patrick; Hoener, Marius C; Canales, Juan J

    2015-12-01

    The newly discovered trace amine-associated receptor 1 (TAAR1) has emerged as a promising target for medication development in stimulant addiction due to its ability to regulate dopamine (DA) function and modulate stimulants' effects. Recent findings indicate that TAAR1 activation blocks some of the abuse-related physiological and behavioral effects of cocaine. However, findings from existing self-administration studies are inconclusive due to the very limited range of cocaine unit doses tested. Here, in order to shed light on the influence of TAAR1 on cocaine's reward and reinforcement, we studied the effects of partial and full activation of TAAR1on (1) the dose-response curve for cocaine self-administration and (2) cocaine-induced changes in intracranial self-stimulation (ICSS). In the first experiment, we examined the effects of the selective full and partial TAAR1 agonists, RO5256390 and RO5203648, on self-administration of five unit-injection doses of cocaine (0.03, 0.1, 0.2, 0.45, and 1mg/kg/infusion). Both agonists induced dose-dependent downward shifts in the cocaine dose-response curve, indicating that both partial and full TAAR1 activation decrease cocaine, reinforcing efficacy. In the second experiment, RO5256390 and the partial agonist, RO5263397, dose-dependently prevented cocaine-induced lowering of ICSS thresholds. Taken together, these data demonstrated that TAAR1 stimulation effectively suppresses the rewarding and reinforcing effects of cocaine in self-administration and ICSS models, supporting the candidacy of TAAR1 as a drug discovery target for cocaine addiction. PMID:26048337

  8. The circadian clock, reward and memory

    Urs eAlbrecht

    2011-01-01

    During our daily activities, we experience variations in our cognitive performance, which is often accompanied by cravings for small rewards, such as consuming coffee or chocolate. This indicates that the time of day, cognitive performance, and reward may be related to one another. This review will summarize data that describe the influence of the circadian clock on addiction and mood-related behavior and put the data into perspective in relation to memory processes.

  9. Voltage Estimation in Active Distribution Grids Using Neural Networks

    Pertl, Michael; Heussen, Kai; Gehrke, Oliver;

    2016-01-01

    observability of distribution systems has to be improved. To increase the situational awareness of the power system operator data driven methods can be employed. These methods benefit from newly available data sources such as smart meters. This paper presents a voltage estimation method based on neural networks......The power flow in distribution grids is becoming more complicated as reverse power flows and undesired voltage rises might occur under particular circumstances due to integration of renewable energy sources, increasing the occurrence of critical bus voltages. To identify these critical feeders the...

  10. Epigenetic activation of Sox2 gene in the developing vertebrate neural plate

    Bouzas, Santiago O.; Marini, Melisa S.; Torres Zelada, Eliana; Buzzi, Ailín L.; Morales Vicente, David A.; Strobl-Mazzulla, Pablo H.

    2016-01-01

    One of the earliest manifestations of neural induction is onset of expression of the neural marker Sox2, mediated by the activation of the enhancers N1 and N2. By using loss and gain of function, we find that Sox2 expression requires the activity of JmjD2A and the Msk1 kinase, which can respectively demethylate the repressive H3K9me3 mark and phosphorylate the activating H3S10 (H3S10ph) mark. Bimolecular fluorescence complementation reveals that the adaptor protein 14-3-3, known to bind to H3S10ph, interacts with JMJD2A and may be involved in its recruitment to regulatory regions of the Sox2 gene. Chromatin immunoprecipitation reveals dynamic binding of JMJD2A to the Sox2 promoter and N-1 enhancer at the time of neural plate induction. Finally, we show a clear temporal antagonism on the occupancy of H3K9me3 and H3S10ph modifications at the promoter of the Sox2 locus before and after the neural plate induction. Taken together, our results propose a series of epigenetic events necessary for the early activation of the Sox2 gene in neural progenitor cells. PMID:27099369

  11. Decoding-Accuracy-Based Sequential Dimensionality Reduction of Spatio-Temporal Neural Activities

    Funamizu, Akihiro; Kanzaki, Ryohei; Takahashi, Hirokazu

    Performance of a brain machine interface (BMI) critically depends on selection of input data because information embedded in the neural activities is highly redundant. In addition, properly selected input data with a reduced dimension leads to improvement of decoding generalization ability and decrease of computational efforts, both of which are significant advantages for the clinical applications. In the present paper, we propose an algorithm of sequential dimensionality reduction (SDR) that effectively extracts motor/sensory related spatio-temporal neural activities. The algorithm gradually reduces input data dimension by dropping neural data spatio-temporally so as not to undermine the decoding accuracy as far as possible. Support vector machine (SVM) was used as the decoder, and tone-induced neural activities in rat auditory cortices were decoded into the test tone frequencies. SDR reduced the input data dimension to a quarter and significantly improved the accuracy of decoding of novel data. Moreover, spatio-temporal neural activity patterns selected by SDR resulted in significantly higher accuracy than high spike rate patterns or conventionally used spatial patterns. These results suggest that the proposed algorithm can improve the generalization ability and decrease the computational effort of decoding.

  12. Cannabinoid modulation of drug reward and the implications of marijuana legalization.

    Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

    2015-12-01

    Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction. PMID:25463025

  13. An artificial neural network to estimate physical activity energy expenditure and identify physical activity type from an accelerometer

    Staudenmayer, John; Pober, David; Crouter, Scott; Bassett, David; Freedson, Patty

    2009-01-01

    The aim of this investigation was to develop and test two artificial neural networks (ANN) to apply to physical activity data collected with a commonly used uniaxial accelerometer. The first ANN model estimated physical activity metabolic equivalents (METs), and the second ANN identified activity type. Subjects (n = 24 men and 24 women, mean age = 35 yr) completed a menu of activities that included sedentary, light, moderate, and vigorous intensities, and each activity was performed for 10 mi...

  14. Vascular Endothelial Growth Factor Receptor 3 Controls Neural Stem Cell Activation in Mice and Humans

    Jinah Han

    2015-02-01

    Full Text Available Neural stem cells (NSCs continuously produce new neurons within the adult mammalian hippocampus. NSCs are typically quiescent but activated to self-renew or differentiate into neural progenitor cells. The molecular mechanisms of NSC activation remain poorly understood. Here, we show that adult hippocampal NSCs express vascular endothelial growth factor receptor (VEGFR 3 and its ligand VEGF-C, which activates quiescent NSCs to enter the cell cycle and generate progenitor cells. Hippocampal NSC activation and neurogenesis are impaired by conditional deletion of Vegfr3 in NSCs. Functionally, this is associated with compromised NSC activation in response to VEGF-C and physical activity. In NSCs derived from human embryonic stem cells (hESCs, VEGF-C/VEGFR3 mediates intracellular activation of AKT and ERK pathways that control cell fate and proliferation. These findings identify VEGF-C/VEGFR3 signaling as a specific regulator of NSC activation and neurogenesis in mammals.

  15. Linking online gaming and addictive behavior: converging evidence for a general reward deficiency in frequent online gamers.

    Hahn, Tim; Notebaert, Karolien Hilde; Dresler, Thomas; Kowarsch, Linda; Reif, Andreas; Fallgatter, Andreas J

    2014-01-01

    Millions of people regularly play so-called massively multiplayer online role playing games (MMORPGs). Recently, it has been argued that MMORPG overuse is becoming a significant health problem worldwide. Symptoms such as tolerance, withdrawal, and craving have been described. Based on behavioral, resting state, and task-related neuroimaging data, we test whether frequent players of the MMORPG "World of Warcraft" (WoW) - similar to drug addicts and individuals with an increased risk for addictions - show a generally deficient reward system. In frequent players of the MMORPG "World of Warcraft" (WoW-players) and in a control group of non-gamers we assessed (1) trait sensitivity to reward (SR), (2) BOLD responses during monetary reward processing in the ventral striatum, and (3) ventral-striatal resting-state dynamics. We found a decreased neural activation in the ventral striatum during the anticipation of both small and large monetary rewards. Additionally, we show generally altered neurodynamics in this region independent of any specific task for WoW players (resting state). On the behavioral level, we found differences in trait SR, suggesting that the reward processing deficiencies found in this study are not a consequence of gaming, but predisposed to it. These findings empirically support a direct link between frequent online gaming and the broad field of behavioral and drug addiction research, thus opening new avenues for clinical interventions in addicted gamers and potentially improving the assessment of addiction-risk in the vast population of frequent gamers. PMID:25426039

  16. Contracting with Private Rewards

    Rene Kirkegaard

    2015-01-01

    I extend the canonical moral hazard model to allow the agent to face endogenous and non-contractible uncertainty. The agent works for the principal and simultaneously pursues private rewards. I establish conditions under which the first-order approach remains valid. The model adds to the literature on intrinsic versus extrinsic motivation. Specifically, to induce higher effort at work the contract may offer higher rewards but flatter incentives. The contract change makes the agent reevaluate ...

  17. Information content of neural networks with self-control and variable activity

    Bollé, D.; Amari, S. I.; Dominguez Carreta, D. R. C.; Massolo, G.

    2001-02-01

    A self-control mechanism for the dynamics of neural networks with variable activity is discussed using a recursive scheme for the time evolution of the local field. It is based upon the introduction of a self-adapting time-dependent threshold as a function of both the neural and pattern activity in the network. This mechanism leads to an improvement of the information content of the network as well as an increase of the storage capacity and the basins of attraction. Different architectures are considered and the results are compared with numerical simulations.

  18. Neuralized1 Activates CPEB3: A Novel Function of Ubiquitination in Synaptic Plasticity and Memory Storage

    Pavlopoulos, Elias; Trifilieff, Pierre; Chevaleyre, Vivien; Fioriti, Luana; Zairis, Sakellarios; Pagano, Andrew; Malleret, Gaël; Kandel, Eric R.

    2011-01-01

    The cytoplasmic polyadenylation element-binding protein 3 (CPEB3), a regulator of local protein synthesis, is the mouse homologue of ApCPEB, a functional prion protein in Aplysia. Here, we provide evidence that CPEB3 is activated by Neuralized1, an E3 ubiquitin ligase. In hippocampal cultures, CPEB3 activated by Neuralized1-mediated ubiquitination leads both to the growth of new dendritic spines and to an increase of the GluA1 and GluA2 subunits of AMPA receptors, two CPEB3 targets essential ...

  19. Computational modeling of neural activities for statistical inference

    Kolossa, Antonio

    2016-01-01

    This authored monograph supplies empirical evidence for the Bayesian brain hypothesis by modeling event-related potentials (ERP) of the human electroencephalogram (EEG) during successive trials in cognitive tasks. The employed observer models are useful to compute probability distributions over observable events and hidden states, depending on which are present in the respective tasks. Bayesian model selection is then used to choose the model which best explains the ERP amplitude fluctuations. Thus, this book constitutes a decisive step towards a better understanding of the neural coding and computing of probabilities following Bayesian rules. The target audience primarily comprises research experts in the field of computational neurosciences, but the book may also be beneficial for graduate students who want to specialize in this field. .

  20. Improved training of neural networks for the nonlinear active control of sound and vibration.

    Bouchard, M; Paillard, B; Le Dinh, C T

    1999-01-01

    Active control of sound and vibration has been the subject of a lot of research in recent years, and examples of applications are now numerous. However, few practical implementations of nonlinear active controllers have been realized. Nonlinear active controllers may be required in cases where the actuators used in active control systems exhibit nonlinear characteristics, or in cases when the structure to be controlled exhibits a nonlinear behavior. A multilayer perceptron neural-network based control structure was previously introduced as a nonlinear active controller, with a training algorithm based on an extended backpropagation scheme. This paper introduces new heuristical training algorithms for the same neural-network control structure. The objective is to develop new algorithms with faster convergence speed (by using nonlinear recursive-least-squares algorithms) and/or lower computational loads (by using an alternative approach to compute the instantaneous gradient of the cost function). Experimental results of active sound control using a nonlinear actuator with linear and nonlinear controllers are presented. The results show that some of the new algorithms can greatly improve the learning rate of the neural-network control structure, and that for the considered experimental setup a neural-network controller can outperform linear controllers. PMID:18252535

  1. Ventral pallidum firing codes hedonic reward: when a bad taste turns good.

    Tindell, Amy J; Smith, Kyle S; Peciña, Susana; Berridge, Kent C; Aldridge, J Wayne

    2006-11-01

    The ventral pallidum (VP) is a key structure in brain mesocorticolimbic reward circuits that mediate "liking" reactions to sensory pleasures. Do firing patterns in VP actually code sensory pleasure? Strong evidence for hedonic coding requires showing that neural signals track positive increases in sensory pleasure or even reversals from bad to good. A useful test is the salt alliesthesia of physiological sodium depletion that makes even aversively intense NaCl taste become palatable and "liked." We compared VP neural firing activity in rats during aversive "disliking" reactions elicited by a noxiously intense NaCl taste (triple-seawater 1.5 M concentration) in normal homeostatic state versus in a physiological salt appetite state that made the same NaCl taste palatable and elicit positive "liking" reactions. We also compared firing elicited by palatable sucrose taste, which always elicited "liking" reactions in both states. A dramatic doubling in the amplitude of VP neural firing peaks to NaCl was caused by salt appetite that matched the affective switch from aversive ("disliking") to positive hedonic ("liking") reactions. By contrast, VP neural activity to "liked" sucrose taste was always high and never altered. In summary, VP firing activity selectively tracks the hedonic values of tastes, even across hedonic reversals caused by physiological changes. Our data provide the strongest evidence yet for neural hedonic coding of natural sensory pleasures and suggest, by extension, how abnormalities in VP firing patterns might contribute to clinical hedonic dysfunctions. PMID:16885520

  2. Comparing the effects of food restriction and overeating on brain reward systems

    Avena, Nicole M.; Murray, Susan; Gold, Mark S.

    2013-01-01

    Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such e...

  3. Dissecting components of reward: ‘liking’, ‘wanting’, and learning

    Berridge, Kent C.; Robinson, Terry E.; Aldridge, J. Wayne

    2009-01-01

    In recent years significant progress has been made delineating the psychological components of reward and their underlying neural mechanisms. Here we briefly highlight findings on three dissociable psychological components of reward: ‘liking’ (hedonic impact), ‘wanting’ (incentive salience), and learning (predictive associations and cognitions). A better understanding of the components of reward, and their neurobiological substrates, may help in devising improved treatments for disorders of m...

  4. Impaired activity-dependent neural circuit assembly and refinement in autism spectrum disorder genetic models

    Caleb Andrew Doll; Kendal eBroadie

    2014-01-01

    Early-use activity during circuit-specific critical periods refines brain circuitry by the coupled processes of eliminating inappropriate synapses and strengthening maintained synapses. We theorize these activity-dependent developmental processes are specifically impaired in autism spectrum disorders (ASDs). ASD genetic models in both mouse and Drosophila have pioneered our insights into normal activity-dependent neural circuit assembly and consolidation, and how these developmental mechanism...

  5. Rapid neural regulation of muscle urokinase-like plasminogen activator as defined by nerve crush.

    Hantaï, D; Rao, J. S.; Festoff, B W

    1990-01-01

    Muscle plasminogen activators (PAs), such as urokinase-like PA and, to a lesser extent, tissue PA, increase dramatically after denervation induced by axotomy. The PA/plasmin system has also been implicated in degradation of specific components of the muscle fiber basement membrane after local activation of plasminogen. These results suggest that neural regulation of muscle extracellular matrix metabolism accompanies or precedes regeneration after injury and is mediated by activation of PAs. I...

  6. Musical pleasure and reward: mechanisms and dysfunction.

    Zatorre, Robert J

    2015-03-01

    Most people derive pleasure from music. Neuroimaging studies show that the reward system of the human brain is central to this experience. Specifically, the dorsal and ventral striatum release dopamine when listening to pleasurable music, and activity in these structures also codes the reward value of musical excerpts. Moreover, the striatum interacts with cortical mechanisms involved in perception and valuation of musical stimuli. Recent studies have begun to explore individual differences in the way that this complex system functions. Development of a questionnaire for music reward experiences has allowed the identification of separable factors associated with musical pleasure, described as music-seeking, emotion-evocation, mood regulation, sensorimotor, and social factors. Applying this questionnaire to a large sample uncovered approximately 5% of the population with low sensitivity to musical reward in the absence of generalized anhedonia or depression. Further study of this group revealed that there are individuals who respond normally both behaviorally and psychophysiologically to rewards other than music (e.g., monetary value) but do not experience pleasure from music despite normal music perception ability and preserved ability to identify intended emotions in musical passages. This specific music anhedonia bears further study, as it may shed light on the function and dysfunction of the reward system. PMID:25773636

  7. A new scale for measuring reward responsiveness

    PeterMuris

    2010-12-01

    Full Text Available Several psychological theories assume that there are two basic brain mechanisms that guide behavior: an avoidance or inhibition system, which is responsive to signals of punishment, and an approach or activation system, which is sensitive to signals of reward. Several self-report scales have been developed to assess the sensitivity to punishment and reward, and these instruments have been shown to be useful in research on personality, psychopathology, and underlying biological substrates. However, it is also true that in particular scales for measuring reward responsiveness suffer from various inadequacies. Therefore, a new Reward Responsiveness (RR scale was developed and subjected to an extensive psychometric evaluation. The results show that this scale measures a single factor, reward responsiveness that is clearly independent of punishment sensitivity. Further, the data indicated that the internal consistency, convergent validity, discriminant validity, test-retest reliability, and predictive properties of the new scale were all adequate. It can be concluded that the RR scale is a psychometrically sound instrument that may be useful for researchers with interest in the personality construct of reward responsiveness.

  8. 食物奖赏和渴求行为相关的大鼠左侧眶额叶皮质Delta频段脑电活动%Delta EEG Activity in Left Orbitofrontal Cortex in Rats Related to Food Reward and Craving

    付玉; 陈艳梅; 曾涛; 彭沿平; 田绍华; 马原野

    2008-01-01

    The orbitofrontal cortex (OFC) is particularly important for the neural representation of reward value. Previous studies indicated that electroencephalogram (EEG) activity in the OFC was involved in drug administration and withdrawal. The present study investigated EEG activity in the OFC in rats during the development of food reward and craving. Two environments were used separately for control and food-related EEG recordings. In the food-related environment rats were first trained to eat chocolate peanuts; then they either had no access to this food, but could see and smell it (craving trials), or had free access to this food (reward trials). The EEG in the left OFC was recorded during these trials. We showed that, in the food-related environment the EEG activity peaking in the delta band (2-4Hz) was significantly correlated with the stimulus, increasing during food reward and decreasing during food craving when compared with that in the control environment. Our data suggests that EEG activity in the OFC can be altered by food reward; moreover, delta rhythm in this region could be used as an index monitoring changed signal underlying this reward.%眶额叶皮质与中脑边缘多巴胺奖赏系统有着复杂的相互纤维联系.先前的研究探讨了药物成瘾过程中眶额叶皮质的脑电活动.在本实验中,将探讨食物奖赏和渴求过程中该皮质的脑电活动.实验采用了两个环境:对照环境和食物刺激相关的环境.首先,训练大鼠在食物刺激相关的环境中吃巧克力花生豆,而后在该环境中设置两种不同的刺激方式:能看到和闻到但不能吃到(渴求实验),或者仍旧可以吃到巧克力花生豆(奖赏实验):同时进行左侧眶额叶皮质的脑电记录.结果发现,在食物刺激相关的环境中大鼠Delta频段(2-4Hz)的脑电活动与食物刺激显著相关,此外,与在对照环境中相比,其相对功率在食物渴求时下降而在食物奖赏时升高.本实验表明,食

  9. Using Perfusion fMRI to Measure Continuous Changes in Neural Activity with Learning

    Olson, Ingrid R.; Rao, Hengyi; Moore, Katherine Sledge; Wang, Jiongjiong; Detre, John A.; Aguirre, Geoffrey K.

    2006-01-01

    In this study, we examine the suitability of a relatively new imaging technique, "arterial spin labeled perfusion imaging," for the study of continuous, gradual changes in neural activity. Unlike BOLD imaging, the perfusion signal is stable over long time-scales, allowing for accurate assessment of continuous performance. In addition, perfusion…

  10. Differential neural activity patterns for spatial relations in humans: a MEG study.

    Scott, Nicole M; Leuthold, Arthur; Sera, Maria D; Georgopoulos, Apostolos P

    2016-02-01

    Children learn the words for above-below relations earlier than for left-right relations, despite treating these equally well in a simple visual categorization task. Even as adults--conflicts in congruency, such as when a stimulus is depicted in a spatially incongruent manner with respect to salient global cues--can be challenging. Here we investigated the neural correlates of encoding and maintaining in working memory above-below and left-right relational planes in 12 adults using magnetoencephalography in order to discover whether above-below relations are represented by the brain differently than left-right relations. Adults performed perfectly on the task behaviorally, so any differences in neural activity were attributed to the stimuli's cognitive attributes. In comparing above-below to left-right relations during stimulus encoding, we found the greatest differences in neural activity in areas associated with space and movement. In comparing congruent to incongruent trials, we found the greatest differential activity in premotor areas. For both contrasts, brain areas involved in the encoding phase were also involved in the maintenance phase, which provides evidence that those brain areas are particularly important in representing the relational planes or congruency types throughout the trial. When comparing neural activity associated with the relational planes during working memory, additional right posterior areas were implicated, whereas the congruent-incongruent contrast implicated additional bilateral frontal and temporal areas. These findings are consistent with the hypothesis left-right relations are represented differently than above-below relations. PMID:26514809

  11. Identification of children's activity type with accelerometer-based neural networks

    Vries, S.I. de; Engels, M.; Garre, F.G.

    2011-01-01

    Purpose: The study's purpose was to identify children's physical activity type using artificial neural network (ANN) models based on uniaxial or triaxial accelerometer data from the hip or the ankle. Methods: Fifty-eight children (31 boys and 27 girls, age range = 9-12 yr) performed the following ac

  12. Distributed dynamical computation in neural circuits with propagating coherent activity patterns.

    Pulin Gong

    2009-12-01

    Full Text Available Activity in neural circuits is spatiotemporally organized. Its spatial organization consists of multiple, localized coherent patterns, or patchy clusters. These patterns propagate across the circuits over time. This type of collective behavior has ubiquitously been observed, both in spontaneous activity and evoked responses; its function, however, has remained unclear. We construct a spatially extended, spiking neural circuit that generates emergent spatiotemporal activity patterns, thereby capturing some of the complexities of the patterns observed empirically. We elucidate what kind of fundamental function these patterns can serve by showing how they process information. As self-sustained objects, localized coherent patterns can signal information by propagating across the neural circuit. Computational operations occur when these emergent patterns interact, or collide with each other. The ongoing behaviors of these patterns naturally embody both distributed, parallel computation and cascaded logical operations. Such distributed computations enable the system to work in an inherently flexible and efficient way. Our work leads us to propose that propagating coherent activity patterns are the underlying primitives with which neural circuits carry out distributed dynamical computation.

  13. Modeling electrocortical activity through improved local approximations of integral neural field equations.

    Coombes, S.; Venkov, N.A.; Shiau, L.; Bojak, I.; Liley, D.T.; Laing, C.R.

    2007-01-01

    Neural field models of firing rate activity typically take the form of integral equations with space-dependent axonal delays. Under natural assumptions on the synaptic connectivity we show how one can derive an equivalent partial differential equation (PDE) model that properly treats the axonal dela

  14. A Constraint Satisfaction Neural Network and Heuristic Combined Approach for Concurrent Activities Scheduling

    YAN JiHong(闫纪红); WU Cheng(吴澄)

    2003-01-01

    Scheduling activities in concurrent product development process is of great sig-nificance to shorten development lead time and minimize the cost. Moreover, it can eliminate theunnecessary redesign periods and guarantee that serial activities can be executed as concurrently aspossible. This paper presents a constraint satisfaction neural network and heuristic combined ap-proach for concurrent activities scheduling. In the combined approach, the neural network is usedto obtain a feasible starting time of all the activities based on sequence constraints, the heuris-tic algorithm is used to obtain a feasible solution of the scheduling problem based on resourceconstraints. The feasible scheduling solution is obtained by a gradient optimization function. Sim-ulations have shown that the proposed combined approach is efficient and feasible with respect toconcurrent activities scheduling.

  15. Global robust dissipativity of interval recurrent neural networks with time-varying delay and discontinuous activations

    Duan, Lian; Huang, Lihong; Guo, Zhenyuan

    2016-07-01

    In this paper, the problems of robust dissipativity and robust exponential dissipativity are discussed for a class of recurrent neural networks with time-varying delay and discontinuous activations. We extend an invariance principle for the study of the dissipativity problem of delay systems to the discontinuous case. Based on the developed theory, some novel criteria for checking the global robust dissipativity and global robust exponential dissipativity of the addressed neural network model are established by constructing appropriate Lyapunov functionals and employing the theory of Filippov systems and matrix inequality techniques. The effectiveness of the theoretical results is shown by two examples with numerical simulations.

  16. Neural Changes following Behavioral Activation for a Depressed Breast Cancer Patient: A Functional MRI Case Study

    Michael J. Gawrysiak

    2012-01-01

    Full Text Available Functional neuroimaging is an innovative but at this stage underutilized method to assess the efficacy of psychotherapy for depression. Functional magnetic resonance imaging (fMRI was used in this case study to examine changes in brain activity in a depressed breast cancer patient receiving an 8-session Behavioral Activation Treatment for Depression (BATD, based on the work of Hopko and Lejuez (2007. A music listening paradigm was used during fMRI brain scans to assess reward responsiveness at pre- and posttreatment. Following treatment, the patient exhibited attenuated depression and changes in blood oxygenation level dependence (BOLD response in regions of the prefrontal cortex and the subgenual cingulate cortex. These preliminary findings outline a novel means to assess psychotherapy efficacy and suggest that BATD elicits functional brain changes in areas implicated in the pathophysiology of depression. Further research is necessary to explore neurobiological mechanisms of change in BATD, particularly the potential mediating effects of reward responsiveness and associated brain functioning.

  17. Convergent dysregulation of frontal cortical cognitive and reward systems in eating disorders

    Stefano, George B.; Ptáček, Radek; Kuželová, Hana; Mantione, Kirk J.; Raboch, Jiří; Papezova, Hana; Kream, Richard M.

    2013-01-01

    A substantive literature has drawn a compelling case for the functional involvement of mesolimbic/prefrontal cortical neural reward systems in normative control of eating and in the etiology and persistence of severe eating disorders that affect diverse human populations. Presently, we provide a short review that develops an equally compelling case for the importance of dysregulated frontal cortical cognitive neural networks acting in concert with regional reward systems in the regulation of ...

  18. Life stress in adolescence predicts early adult reward-related brain function and alcohol dependence

    Casement, Melynda D.; Shaw, Daniel S.; Sitnick, Stephanie L.; Musselman, Samuel C.; Forbes, Erika E.

    2014-01-01

    Stressful life events increase vulnerability to problematic alcohol use, and they may do this by disrupting reward-related neural circuitry. This is particularly relevant for adolescents because alcohol use rises sharply after mid-adolescence and alcohol abuse peaks at age 20. Adolescents also report more stressors compared with children, and neural reward circuitry may be especially vulnerable to stressors during adolescence because of prefrontal cortex remodeling. Using a large sample of ma...

  19. Enhanced Food Anticipatory Activity Associated with Enhanced Activation of Extrahypothalamic Neural Pathways in Serotonin2C Receptor Null Mutant Mice

    Mistlberger, Ralph; Hsu, Jennifer; Yu, Lisa; Bowman, Melody; Tecott, Laurence; Sullivan, Elinor

    2010-01-01

    The ability to entrain circadian rhythms to food availability is important for survival. Food-entrained circadian rhythms are characterized by increased locomotor activity in anticipation of food availability (food anticipatory activity). However, the molecular components and neural circuitry underlying the regulation of food anticipatory activity remain unclear. Here we show that serotonin2C receptor (5-HT2CR) null mutant mice subjected to a daytime restricted feeding schedule exhibit enhanc...

  20. Enhanced Food Anticipatory Activity Associated with Enhanced Activation of Extrahypothalamic Neural Pathways in Serotonin2C Receptor Null Mutant Mice

    Hsu, Jennifer L.; Lisa Yu; Elinor Sullivan; Melodi Bowman; Mistlberger, Ralph E.; Tecott, Laurence H.

    2010-01-01

    The ability to entrain circadian rhythms to food availability is important for survival. Food-entrained circadian rhythms are characterized by increased locomotor activity in anticipation of food availability (food anticipatory activity). However, the molecular components and neural circuitry underlying the regulation of food anticipatory activity remain unclear. Here we show that serotonin(2C) receptor (5-HT2CR) null mutant mice subjected to a daytime restricted feeding schedule exhibit enha...

  1. Neural networkbased semi-active control strategy for structural vibration mitigation with magnetorheological damper

    Bhowmik, Subrata

    2011-01-01

    This paper presents a neural network based semi-active control method for a rotary type magnetorheological (MR) damper. The characteristics of the MR damper are described by the classic Bouc-Wen model, and the performance of the proposed control method is evaluated in terms of a base exited shear......-displacement trajectories. The proposed neural network controller is therefore trained based on data derived from these desired forcedisplacement curves, where the optimal relation between friction force level and response amplitude is determined explicitly by simply maximizing the damping ratio of the targeted vibration...... mode of the structure. The neural network control is then developed to reproduce the desired force based on damper displacement and velocity as network input, and it is therefore referred to as an amplitude dependent model reference control method. An inverse model of the MR damper is needed to...

  2. Neural network based semi-active control strategy for structural vibration mitigation with magnetorheological damper

    Bhowmik, Subrata

    2011-01-01

    This paper presents a neural network based semi-active control method for a rotary type magnetorheological (MR) damper. The characteristics of the MR damper are described by the classic Bouc-Wen model, and the performance of the proposed control method is evaluated in terms of a base exited shear......-displacement trajectories. The proposed neural network controller is therefore trained based on data derived from these desired forcedisplacement curves, where the optimal relation between friction force level and response amplitude is determined explicitly by simply maximizing the damping ratio of the targeted vibration...... mode of the structure. The neural network control is then developed to reproduce the desired force based on damper displacement and velocity as network input, and it is therefore referred to as an amplitude dependent model reference control method. An inverse model of the MR damper is needed to...

  3. Do Substantia Nigra Dopaminergic Neurons Differentiate Between Reward and Punishment?

    Michael J. Frank; D. James Surmeier

    2009-01-01

    The activity of dopaminergic neurons are thought to be increased by stimuli that predict reward and decreased by stimuli that predict aversive outcomes. Recent work by Matsumoto and Hikosaka challenges this model by asserting that stimuli associated with either rewarding or aversive outcomes increase the activity of dopaminergic neurons in the substantia nigra pars compacta.

  4. A non-reward attractor theory of depression.

    Rolls, Edmund T

    2016-09-01

    A non-reward attractor theory of depression is proposed based on the operation of the lateral orbitofrontal cortex and supracallosal cingulate cortex. The orbitofrontal cortex contains error neurons that respond to non-reward for many seconds in an attractor state that maintains a memory of the non-reward. The human lateral orbitofrontal cortex is activated by non-reward during reward reversal, and by a signal to stop a response that is now incorrect. Damage to the human orbitofrontal cortex impairs reward reversal learning. Not receiving reward can produce depression. The theory proposed is that in depression, this lateral orbitofrontal cortex non-reward system is more easily triggered, and maintains its attractor-related firing for longer. This triggers negative cognitive states, which in turn have positive feedback top-down effects on the orbitofrontal cortex non-reward system. Treatments for depression, including ketamine, may act in part by quashing this attractor. The mania of bipolar disorder is hypothesized to be associated with oversensitivity and overactivity in the reciprocally related reward system in the medial orbitofrontal cortex and pregenual cingulate cortex. PMID:27181908

  5. Case study of ecstatic meditation: fMRI and EEG evidence of self-stimulating a reward system.

    Hagerty, Michael R; Isaacs, Julian; Brasington, Leigh; Shupe, Larry; Fetz, Eberhard E; Cramer, Steven C

    2013-01-01

    We report the first neural recording during ecstatic meditations called jhanas and test whether a brain reward system plays a role in the joy reported. Jhanas are Altered States of Consciousness (ASC) that imply major brain changes based on subjective reports: (1) external awareness dims, (2) internal verbalizations fade, (3) the sense of personal boundaries is altered, (4) attention is highly focused on the object of meditation, and (5) joy increases to high levels. The fMRI and EEG results from an experienced meditator show changes in brain activity in 11 regions shown to be associated with the subjective reports, and these changes occur promptly after jhana is entered. In particular, the extreme joy is associated not only with activation of cortical processes but also with activation of the nucleus accumbens (NAc) in the dopamine/opioid reward system. We test three mechanisms by which the subject might stimulate his own reward system by external means and reject all three. Taken together, these results demonstrate an apparently novel method of self-stimulating a brain reward system using only internal mental processes in a highly trained subject. PMID:23738149

  6. Reward Processing in Adolescents with Bipolar I Disorder

    Singh, Manpreet K.; Chang, Kiki D.; Kelley, Ryan G.; Cui, Xu; Sherdell, Lindsey; Howe, Meghan E.; Gotlib, Ian H.; Reiss, Allan L.

    2013-01-01

    Objective: Bipolar disorder (BD) is a debilitating psychiatric condition that commonly begins in adolescence, a developmental period that has been associated with increased reward seeking. Because youth with BD are especially vulnerable to negative risk-taking behaviors, understanding the neural mechanisms by which dysregulated affect interacts…

  7. Altered temporal variance and neural synchronization of spontaneous brain activity in anesthesia.

    Huang, Zirui; Wang, Zhiyao; Zhang, Jianfeng; Dai, Rui; Wu, Jinsong; Li, Yuan; Liang, Weimin; Mao, Ying; Yang, Zhong; Holland, Giles; Zhang, Jun; Northoff, Georg

    2014-11-01

    Recent studies at the cellular and regional levels have pointed out the multifaceted importance of neural synchronization and temporal variance of neural activity. For example, neural synchronization and temporal variance has been shown by us to be altered in patients in the vegetative state (VS). This finding nonetheless leaves open the question of whether these abnormalities are specific to VS or rather more generally related to the absence of consciousness. The aim of our study was to investigate the changes of inter- and intra-regional neural synchronization and temporal variance of resting state activity in anesthetic-induced unconsciousness state. Applying an intra-subject design, we compared resting state activity in functional magnetic resonance imaging (fMRI) between awake versus anesthetized states in the same subjects. Replicating previous studies, we observed reduced functional connectivity within the default mode network (DMN) and thalamocortical network in the anesthetized state. Importantly, intra-regional synchronization as measured by regional homogeneity (ReHo) and temporal variance as measured by standard deviation (SD) of the BOLD signal were significantly reduced in especially the cortical midline regions, while increased in the lateral cortical areas in the anesthetized state. We further found significant frequency-dependent effects of SD in the thalamus, which showed abnormally high SD in Slow-5 (0.01-0.027 Hz) in the anesthetized state. Our results show for the first time of altered temporal variance of resting state activity in anesthesia. Combined with our findings in the vegetative state, these findings suggest a close relationship between temporal variance, neural synchronization and consciousness. PMID:24867379

  8. A New Training Method for Feedforward Neural Networks Based on Geometric Contraction Property of Activation Functions

    Birtea, Petre; Cernazanu-Glavan, Cosmin; Sisu, Alexandru

    2016-01-01

    We propose a new training method for a feedforward neural network having the activation functions with the geometric contraction property. The method consists of constructing a new functional that is less nonlinear in comparison with the classical functional by removing the nonlinearity of the activation functions from the output layer. We validate this new method by a series of experiments that show an improved learning speed and also a better classification error.

  9. Population-wide distributions of neural activity during perceptual decision-making.

    Wohrer, Adrien; Humphries, Mark D.; Machens, Christian K

    2013-01-01

    Cortical activity involves large populations of neurons, even when it is limited to functionally coherent areas. Electrophysiological recordings, on the other hand, involve comparatively small neural ensembles, even when modern-day techniques are used. Here we review results which have started to fill the gap between these two scales of inquiry, by shedding light on the statistical distributions of activity in large populations of cells. We put our main focus on data recorded in awake animals...

  10. Hyperinsulinemia produces both sympathetic neural activation and vasodilation in normal humans.

    Anderson, E A; Hoffman, R P; Balon, T W; Sinkey, C A; Mark, A L

    1991-01-01

    Hyperinsulinemia may contribute to hypertension by increasing sympathetic activity and vascular resistance. We sought to determine if insulin increases central sympathetic neural outflow and vascular resistance in humans. We recorded muscle sympathetic nerve activity (MSNA; microneurography, peroneal nerve), forearm blood flow (plethysmography), heart rate, and blood pressure in 14 normotensive males during 1-h infusions of low (38 mU/m2/min) and high (76 mU/m2/min) doses of insulin while hol...

  11. Neural networks with periodic and monotonic activation functions: a comparative study in classification problems

    Romero Merino, Enrique; Sopena, Josep Maria; Alquézar Mancho, René; Moliner, Joan L.

    2000-01-01

    This article discusses a number of reasons why the use of non-monotonic functions as activation functions can lead to a marked improvement in the performance of a neural network. Using a wide range of benchmarks we show that a multilayer feed-forward network using sine activation functions (and an appropriate choice of initial parameters) learns much faster than one incorporating sigmoid functions - as much as 150-500 times faster - when both types are trained with backpr...

  12. Searching for learning-dependent changes in the antennal lobe: simultaneous recording of neural activity and aversive olfactory learning in honeybees

    Edith Roussel

    2010-09-01

    Full Text Available Plasticity in the honeybee brain has been studied using the appetitive olfactory conditioning of the proboscis extension reflex, in which a bee learns the association between an odor and a sucrose reward. In this framework, coupling behavioral measurements of proboscis extension and invasive recordings of neural activity has been difficult because proboscis movements usually introduce brain movements that affect physiological preparations. Here we took advantage of a new conditioning protocol, the aversive olfactory conditioning of the sting extension reflex, which does not generate this problem. We achieved the first simultaneous recordings of conditioned sting extension responses and calcium imaging of antennal lobe activity, thus revealing on-line processing of olfactory information during conditioning trials. Based on behavioral output we distinguished learners and non-learners and analyzed possible learning-dependent changes in antennal lobe activity. We did not find differences between glomerular responses to the CS+ and the CS- in learners. Unexpectedly, we found that during conditioning trials non-learners exhibited a progressive decrease in physiological responses to odors, irrespective of their valence. This effect could neither be attributed to a fitness problem nor to abnormal dye bleaching. We discuss the absence of learning-induced changes in the antennal lobe of learners and the decrease in calcium responses found in non-learners. Further studies will have to extend the search for functional plasticity related to aversive learning to other brain areas and to look on a broader range of temporal scales

  13. Amphetamine alters neural response to sucrose in healthy women.

    Melrose, A James; Bailer, Ursula; Wierenga, Christina E; Bischoff-Grethe, Amanda; Paulus, Martin P; Kaye, Walter H

    2016-06-30

    Amphetamine, likely via action on the brain's dopaminergic systems, induces anorectic eating behavior and blunts dopaminergic midbrain activation to rewards. Past work has hypothesized that this blunted reward responsivity is a result of increasing tonic over phasic DA activity. We sought to extend past findings to sweet taste during fMRI following single-blind administration of dextroamphetamine and placebo in 11 healthy women. We hypothesized that neural response in both limbic and cognitive sweet taste circuits would mirror past work with monetary rewards by effectively blunting sweet taste reward, and 'equalizing' it's rewarding taste with receipt of water. Behavioral results showed that amphetamine reduced self-reported hunger (supporting the existence of amphetamine anorexia) and increased self-report euphoria. In addition, region of Interest analysis revealed significant treatment by taste interactions in the middle insula and dorsal anterior cingulate confirming the 'equalizing' hypothesis in the cingulate, but unlike monetary reinforcers, the insula actually evinced enhanced separation between tastes on the amphetamine day. These results suggest a divergence from prior research using monetary reinforcers when extended to primary reinforcers, and may hint that altering dopaminergic signaling in the insula and anterior cingulate may be a target for pharmacological manipulation of appetite, and the treatment of obesity. PMID:27179312

  14. Rationale and study protocol for the supporting children’s outcomes using rewards, exercise and skills (SCORES) group randomized controlled trial: A physical activity and fundamental movement skills intervention for primary schools in low-income communities

    Lubans David R; Morgan Philip J; Weaver Kristen; Callister Robin; Dewar Deborah L; Costigan Sarah A; Finn Tara L; Smith Jordan; Upton Lee; Plotnikoff Ronald C

    2012-01-01

    Abstract Background Many Australian children are insufficiently active to accrue health benefits and physical activity (PA) levels are consistently lower among youth of low socio-economic position. PA levels decline dramatically during adolescence and evidence suggests that competency in a range of fundamental movement skills (FMS) may serve as a protective factor against this trend. Methods/design The Supporting Children’s Outcomes Using Rewards Exercise and Skills (SCORES) intervention is a...

  15. Evaluating a genetically encoded optical sensor of neural activity using electrophysiology in intact adult fruit flies

    Gilles Laurent

    2007-11-01

    Full Text Available Genetically encoded optical indicators hold the promise of enabling non-invasive monitoring of activity in identified neurons in behaving organisms. However, the interpretation of images of brain activity produced using such sensors is not straightforward. Several recent studies of sensory coding used G-CaMP 1.3-a calcium sensor-as an indicator of neural activity; some of these studies characterized the imaged neurons as having narrow tuning curves, a conclusion not always supported by parallel electrophysiological studies. To better understand the possible cause of these conflicting results, we performed simultaneous in vivo 2-photon imaging and electrophysiological recording of G-CaMP 1.3 expressing neurons in the antennal lobe (AL of intact fruitflies. We find that G-CaMP has a relatively high threshold, that its signal often fails to capture spiking response kinetics, and that it can miss even high instantaneous rates of activity if those are not sustained. While G-CaMP can be misleading, it is clearly useful for the identification of promising neural targets: when electrical activity is well above the sensor's detection threshold, its signal is fairly well correlated with mean firing rate and G-CaMP does not appear to alter significantly the responses of neurons that express it. The methods we present should enable any genetically encoded sensor, activator, or silencer to be evaluated in an intact neural circuit in vivo in Drosophila.

  16. Concurrent multitasking: From neural activity to human cognition

    Nijboer, Menno

    2016-01-01

    Multitasking has become an important part of our daily lives. This delicate juggling act between several activities occurs when people drive, when they are working, and even when they should be paying attention in the classroom. While multitasking is typically considered as something to avoid, there are instances where we are perfectly capable at performing multiple activities concurrently. It is therefore important that we understand how multitasking works, so that we can predict when engagi...

  17. Neural portraits of perception: reconstructing face images from evoked brain activity.

    Cowen, Alan S; Chun, Marvin M; Kuhl, Brice A

    2014-07-01

    Recent neuroimaging advances have allowed visual experience to be reconstructed from patterns of brain activity. While neural reconstructions have ranged in complexity, they have relied almost exclusively on retinotopic mappings between visual input and activity in early visual cortex. However, subjective perceptual information is tied more closely to higher-level cortical regions that have not yet been used as the primary basis for neural reconstructions. Furthermore, no reconstruction studies to date have reported reconstructions of face images, which activate a highly distributed cortical network. Thus, we investigated (a) whether individual face images could be accurately reconstructed from distributed patterns of neural activity, and (b) whether this could be achieved even when excluding activity within occipital cortex. Our approach involved four steps. (1) Principal component analysis (PCA) was used to identify components that efficiently represented a set of training faces. (2) The identified components were then mapped, using a machine learning algorithm, to fMRI activity collected during viewing of the training faces. (3) Based on activity elicited by a new set of test faces, the algorithm predicted associated component scores. (4) Finally, these scores were transformed into reconstructed images. Using both objective and subjective validation measures, we show that our methods yield strikingly accurate neural reconstructions of faces even when excluding occipital cortex. This methodology not only represents a novel and promising approach for investigating face perception, but also suggests avenues for reconstructing 'offline' visual experiences-including dreams, memories, and imagination-which are chiefly represented in higher-level cortical areas. PMID:24650597

  18. Are extremes of consumption in eating disorders related to an altered balance between reward and inhibition?

    Christina E Wierenga

    2014-12-01

    Full Text Available The primary defining characteristic of a diagnosis of an eating disorder (ED is the disturbance of eating or eating-related behavior that results in the altered consumption or absorption of food (DSM V; American Psychiatric Association, 2013. There is a spectrum, ranging from those who severely restrict eating and become emaciated on one end to those who binge and overconsume, usually accompanied by some form of compensatory behaviors, on the other. How can we understand reasons for such extremes of food consummatory behaviors? Recent work on obesity and substance use disorders has identified behaviors and neural pathways that play a powerful role in human consummatory behaviors. That is, corticostriatal limbic and dorsal cognitive neural circuitry can make drugs and food rewarding, but also engage self-control mechanisms that may inhibit their use. Importantly, there is considerable evidence that alterations of these systems also occur in ED. This paper explores the hypothesis that an altered balance of reward and inhibition contributes to altered extremes of response to salient stimuli, such as food. We will review recent studies that show altered sensitivity to reward and punishment in ED, with evidence of altered activity in corticostriatal and insula processes with respect to monetary gains or losses, and tastes of palatable foods. We will also discuss evidence for a spectrum of extremes of inhibition and dysregulation behaviors in ED supported by studies suggesting that this is related to top-down self-control mechanisms. The lack of a mechanistic understanding of ED has thwarted efforts for evidence-based approaches to develop interventions. Understanding how ED behavior is encoded in neural circuits would provide a foundation for developing more specific and effective treatment approaches.

  19. Are Extremes of Consumption in Eating Disorders Related to an Altered Balance between Reward and Inhibition?

    Wierenga, Christina E.; Ely, Alice; Bischoff-Grethe, Amanda; Bailer, Ursula F.; Simmons, Alan N.; Kaye, Walter H.

    2014-01-01

    The primary defining characteristic of a diagnosis of an eating disorder (ED) is the “disturbance of eating or eating-related behavior that results in the altered consumption or absorption of food” (DSM V; American Psychiatric Association, 2013). There is a spectrum, ranging from those who severely restrict eating and become emaciated on one end to those who binge and overconsume, usually accompanied by some form of compensatory behaviors, on the other. How can we understand reasons for such extremes of food consummatory behaviors? Recent work on obesity and substance use disorders has identified behaviors and neural pathways that play a powerful role in human consummatory behaviors. That is, corticostriatal limbic and dorsal cognitive neural circuitry can make drugs and food rewarding, but also engage self-control mechanisms that may inhibit their use. Importantly, there is considerable evidence that alterations of these systems also occur in ED. This paper explores the hypothesis that an altered balance of reward and inhibition contributes to altered extremes of response to salient stimuli, such as food. We will review recent studies that show altered sensitivity to reward and punishment in ED, with evidence of altered activity in corticostriatal and insula processes with respect to monetary gains or losses, and tastes of palatable foods. We will also discuss evidence for a spectrum of extremes of inhibition and dysregulation behaviors in ED supported by studies suggesting that this is related to top-down self-control mechanisms. The lack of a mechanistic understanding of ED has thwarted efforts for evidence-based approaches to develop interventions. Understanding how ED behavior is encoded in neural circuits would provide a foundation for developing more specific and effective treatment approaches. PMID:25538579

  20. Model Integrating Fuzzy Argument with Neural Network Enhancing the Performance of Active Queue Management

    Nguyen Kim Quoc

    2015-08-01

    Full Text Available The bottleneck control by active queue management mechanisms at network nodes is essential. In recent years, some researchers have used fuzzy argument to improve the active queue management mechanisms to enhance the network performance. However, the projects using the fuzzy controller depend heavily on professionals and their parameters cannot be updated according to changes in the network, so the effectiveness of this mechanism is not high. Therefore, we propose a model combining the fuzzy controller with neural network (FNN to overcome the limitations above. Results of the training of the neural networks will find the optimal parameters for the adaptive fuzzy controller well to changes of the network. This improves the operational efficiency of the active queue management mechanisms at network nodes.

  1. Stress and reward

    Chumbley, J R; Hulme, O; Köchli, H;

    2014-01-01

    Healthy individuals tend to consume available rewards like food and sex. This tendency is attenuated or amplified in most stress-related psychiatric conditions, so we asked if it depends on endogenous levels of the 'canonical stress hormone' cortisol. We unobtrusively quantified how hard healthy...

  2. Rewards versus Intellectual Property Rights.

    Shavell, S.; van Ypersele de Strihou, T.P.M.C.

    2001-01-01

    This paper compares reward systems to intellectual property rights (patents and copyrights). Under a reward system, innovators are paid for innovations directly by the government (possibly on the basis of sales), and innovations pass immediately into the public domain. Thus, reward systems engender incentives to innovate without creating the monopoly power of intellectual property rights. But a principal difficulty with rewards is the information required for their determination. We conclude ...

  3. Rewarding Useful Suggestions in an Organizational Unit

    Rajko Vidic

    2014-02-01

    Full Text Available Research Question (RQ: Do organizational unit leaders reward useful suggestions? How does the rewarding of useful employee suggestions encourage creativity and effectiveness? Purpose: On the basis of group conversations through focus groups, to determine whether rewarding effects the creativity and performance of employees. Method: Quantitative method using focus groups. Results: The results of the research study showed that the organizational unit appropriately rewards useful suggestions and that this has an impact on employee creativity and efficiency. In addition, the massive inventive activity is a system that effectively influences the success of business. Organization: Massive inventive activity has become a system in which increasingly more employees from different organizational units are becoming a part of. An important role is by managers, who are responsible for creating a positive atmosphere and encourage employees into innovative thinking, performance, and rewarding of useful suggestions. Society: The research shows that this is part of the organizational culture and that it is necessary to transfer to new employees. Originality: This is the first such research in our organizational unit. Limitations/Future Research: The research study was conducted in only one organizational unit of the company.

  4. Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies

    Sescousse, G.T.; Caldu, X.; Segura, B.; Dreher, J.C.

    2013-01-01

    One fundamental question concerning brain reward mechanisms is to determine how reward-related activity is influenced by the nature of rewards. Here, we review the neuroimaging literature and explicitly assess to what extent the representations of primary and secondary rewards overlap in the human brain. To achieve this goal, we performed an activation likelihood estimation (ALE) meta-analysis of 87 studies (1452 subjects) comparing the brain responses to monetary, erotic and food reward outc...

  5. Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies

    Sescousse, G.T.; Caldu, X.; Segura, B.; Dreher, J.C.

    2013-01-01

    One fundamental question concerning brain reward mechanisms is to determine how reward-related activity is influenced by the nature of rewards. Here, we review the neuroimaging literature and explicitly assess to what extent the representations of primary and secondary rewards overlap in the human b

  6. Cues Produced by Reward and Nonreward and Temporal Cues Influence Responding in the Intertrial Interval and to the Conditioned Stimulus

    Capaldi, E. J.; Martins, Ana; Miller, Ronald M.

    2007-01-01

    Rats in a Pavlovian situation were trained under three different reward schedules, at either a 30 s or a 90 s intertrial interval (ITI): Consistent reward (C), 50% irregular reward (I), and single alternation of reward and nonrewarded trials (SA). Activity was recorded to the conditioned stimulus (CS) and in all 10 s bins in each ITI except the…

  7. Quantitative meta-analysis of neural activity in posttraumatic stress disorder

    Hayes Jasmeet P

    2012-05-01

    Full Text Available Abstract Background In recent years, neuroimaging techniques such as functional magnetic resonance imaging (fMRI and positron emission tomography (PET have played a significant role in elucidating the neural underpinnings of posttraumatic stress disorder (PTSD. However, a detailed understanding of the neural regions implicated in the disorder remains incomplete because of considerable variability in findings across studies. The aim of this meta-analysis was to identify consistent patterns of neural activity across neuroimaging study designs in PTSD to improve understanding of the neurocircuitry of PTSD. Methods We conducted a literature search for PET and fMRI studies of PTSD that were published before February 2011. The article search resulted in 79 functional neuroimaging PTSD studies. Data from 26 PTSD peer-reviewed neuroimaging articles reporting results from 342 adult patients and 342 adult controls were included. Peak activation coordinates from selected articles were used to generate activation likelihood estimate maps separately for symptom provocation and cognitive-emotional studies of PTSD. A separate meta-analysis examined the coupling between ventromedial prefrontal cortex and amygdala activity in patients. Results Results demonstrated that the regions most consistently hyperactivated in PTSD patients included mid- and dorsal anterior cingulate cortex, and when ROI studies were included, bilateral amygdala. By contrast, widespread hypoactivity was observed in PTSD including the ventromedial prefrontal cortex and the inferior frontal gyrus. Furthermore, decreased ventromedial prefrontal cortex activity was associated with increased amygdala activity. Conclusions These results provide evidence for a neurocircuitry model of PTSD that emphasizes alteration in neural networks important for salience detection and emotion regulation.

  8. Concurrent multitasking : From neural activity to human cognition

    Nijboer, Menno

    2016-01-01

    Multitasking has become an important part of our daily lives. This delicate juggling act between several activities occurs when people drive, when they are working, and even when they should be paying attention in the classroom. While multitasking is typically considered as something to avoid, there

  9. Neural control of glutamine synthetase activity in rat skeletal muscles.

    Feng, B; Konagaya, M; Konagaya, Y; Thomas, J W; Banner, C; Mill, J; Max, S R

    1990-05-01

    The mechanism of glutamine synthetase induction in rat skeletal muscle after denervation or limb immobilization was investigated. Adult male rats were subjected to midthigh section of the sciatic nerve. At 1, 2, and 5 h and 1, 2, and 7 days after denervation, rats were killed and denervated, and contralateral control soleus and plantaris muscles were excised, weighted, homogenized, and assayed for glutamine synthetase. Glutamine synthetase activity increased approximately twofold 1 h after denervation in both muscles. By 7 days postdenervation enzyme activity had increased to three times the control level in plantaris muscle and to four times the control level in soleus muscle. Increased enzyme activity after nerve section was associated with increased maximum velocity with no change in apparent Michaelis constant. Immunotitration with an antiglutamine synthetase antibody suggested that denervation caused an increase in the number of glutamine synthetase molecules in muscle. However, Northern-blot analysis revealed no increase in the steady-state level of glutamine synthetase mRNA after denervation. A mixing experiment failed to yield evidence for the presence of a soluble factor involved in regulating the activity of glutamine synthetase in denervated muscle. A combination of denervation and dexamethasone injections resulted in additive increases in glutamine synthetase. Thus the mechanism underlying increased glutamine synthetase after denervation appears to be posttranscriptional and is distinct from that of the glucocorticoid-mediated glutamine synthetase induction previously described by us. PMID:1970709

  10. Achievement-Based Rewards and Intrinsic Motivation: A Test of Cognitive Mediators

    Cameron, Judy; Pierce, W. David; Banko, Katherine M.; Gear, Amber

    2005-01-01

    This study assessed how rewards impacted intrinsic motivation when students were rewarded for achievement while learning an activity, for performing at a specific level on a test, or for both. Undergraduate university students engaged in a problem-solving activity. The design was a 2 * 2 factorial with 2 levels of reward in a learning phase…

  11. Commitment to self-rewards

    Koch, Alexander; Nafziger, Julia

    People often overcome self-control problems by promising to reward themselves for accomplishing a task. Such strategies based on self-administered rewards however require the person to believe that she would indeed deny herself the reward if she should fail to achieve the desired outcome. Drawing...

  12. Alternative Sensor System and MLP Neural Network for Vehicle Pedal Activity Estimation

    Ahmed M. Wefky

    2010-04-01

    Full Text Available It is accepted that the activity of the vehicle pedals (i.e., throttle, brake, clutch reflects the driver’s behavior, which is at least partially related to the fuel consumption and vehicle pollutant emissions. This paper presents a solution to estimate the driver activity regardless of the type, model, and year of fabrication of the vehicle. The solution is based on an alternative sensor system (regime engine, vehicle speed, frontal inclination and linear acceleration that reflects the activity of the pedals in an indirect way, to estimate that activity by means of a multilayer perceptron neural network with a single hidden layer.

  13. Response perseveration and ventral prefrontal sensitivity to reward and punishment in male problem gamblers and smokers.

    de Ruiter, Michiel B; Veltman, Dick J; Goudriaan, Anna E; Oosterlaan, Jaap; Sjoerds, Zsuzsika; van den Brink, Wim

    2009-03-01

    Pathological gambling (PG) is associated with maladaptive perseverative behavior, but the underlying mechanism and neural circuitry is not completely clear. Here, the hypothesis was tested that PG is characterized by response perseveration and abnormalities in reward and/or punishment sensitivity in the ventral frontostriatal circuit. Executive functioning was assessed to verify if these effects are independent of the dorsal frontostriatal circuit. A group of smokers was also included to examine whether impairments in PG generalize to substance use disorders. Response perseveration and reward/punishment sensitivity were measured with a probabilistic reversal-learning task, in which subjects could win and lose money. Executive functioning was measured with a planning task, the Tower of London. Performance and fMRI data were acquired in 19 problem gamblers, 19 smokers, and 19 healthy controls. Problem gamblers showed severe response perseveration, associated with reduced activation of right ventrolateral prefrontal cortex in response to both monetary gain and loss. Results did not fully generalize to smokers. Planning performance and related activation of the dorsal frontostriatal circuit were intact in both problem gamblers and smokers. PG is related to response perseveration and diminished reward and punishment sensitivity as indicated by hypoactivation of the ventrolateral prefrontal cortex when money is gained and lost. Moreover, intact planning abilities and normal dorsal frontostriatal responsiveness indicate that this deficit is not due to impaired executive functioning. Response perseveration and ventral prefrontal hyporesponsiveness to monetary loss may be markers for maladaptive behavior seen in chemical and nonchemical addictions. PMID:18830241

  14. Optimal Recognition Method of Human Activities Using Artificial Neural Networks

    Oniga Stefan

    2015-12-01

    Full Text Available The aim of this research is an exhaustive analysis of the various factors that may influence the recognition rate of the human activity using wearable sensors data. We made a total of 1674 simulations on a publically released human activity database by a group of researcher from the University of California at Berkeley. In a previous research, we analyzed the influence of the number of sensors and their placement. In the present research we have examined the influence of the number of sensor nodes, the type of sensor node, preprocessing algorithms, type of classifier and its parameters. The final purpose is to find the optimal setup for best recognition rates with lowest hardware and software costs.

  15. Optimal Recognition Method of Human Activities Using Artificial Neural Networks

    Oniga, Stefan; József, Sütő

    2015-12-01

    The aim of this research is an exhaustive analysis of the various factors that may influence the recognition rate of the human activity using wearable sensors data. We made a total of 1674 simulations on a publically released human activity database by a group of researcher from the University of California at Berkeley. In a previous research, we analyzed the influence of the number of sensors and their placement. In the present research we have examined the influence of the number of sensor nodes, the type of sensor node, preprocessing algorithms, type of classifier and its parameters. The final purpose is to find the optimal setup for best recognition rates with lowest hardware and software costs.

  16. Environmental layout complexity affects neural activity during navigation in humans.

    Slone, Edward; Burles, Ford; Iaria, Giuseppe

    2016-05-01

    Navigating large-scale surroundings is a fundamental ability. In humans, it is commonly assumed that navigational performance is affected by individual differences, such as age, sex, and cognitive strategies adopted for orientation. We recently showed that the layout of the environment itself also influences how well people are able to find their way within it, yet it remains unclear whether differences in environmental complexity are associated with changes in brain activity during navigation. We used functional magnetic resonance imaging to investigate how the brain responds to a change in environmental complexity by asking participants to perform a navigation task in two large-scale virtual environments that differed solely in interconnection density, a measure of complexity defined as the average number of directional choices at decision points. The results showed that navigation in the simpler, less interconnected environment was faster and more accurate relative to the complex environment, and such performance was associated with increased activity in a number of brain areas (i.e. precuneus, retrosplenial cortex, and hippocampus) known to be involved in mental imagery, navigation, and memory. These findings provide novel evidence that environmental complexity not only affects navigational behaviour, but also modulates activity in brain regions that are important for successful orientation and navigation. PMID:26990572

  17. Simultaneous Detection of c-Fos Activation from Mesolimbic and Mesocortical Dopamine Reward Sites Following Naive Sugar and Fat Ingestion in Rats.

    Dela Cruz, Julie A D; Coke, Tricia; Bodnar, Richard J

    2016-01-01

    This study uses cellular c-fos activation to assess effects of novel ingestion of fat and sugar on brain dopamine (DA) pathways in rats. Intakes of sugars and fats are mediated by their innate attractions as well as learned preferences. Brain dopamine, especially meso-limbic and meso-cortical projections from the ventral tegmental area (VTA), has been implicated in both of these unlearned and learned responses. The concept of distributed brain networks, wherein several sites and transmitter/peptide systems interact, has been proposed to mediate palatable food intake, but there is limited evidence empirically demonstrating such actions. Thus, sugar intake elicits DA release and increases c-fos-like immunoreactivity (FLI) from individual VTA DA projection zones including the nucleus accumbens (NAC), amygdala (AMY) and medial prefrontal cortex (mPFC) as well as the dorsal striatum. Further, central administration of selective DA receptor antagonists into these sites differentially reduce acquisition and expression of conditioned flavor preferences elicited by sugars or fats. One approach by which to determine whether these sites interacted as a distributed brain network in response to sugar or fat intake would be to simultaneous evaluate whether the VTA and its major mesotelencephalic DA projection zones (prelimbic and infralimbic mPFC, core and shell of the NAc, basolateral and central-cortico-medial AMY) as well as the dorsal striatum would display coordinated and simultaneous FLI activation after oral, unconditioned intake of corn oil (3.5%), glucose (8%), fructose (8%) and saccharin (0.2%) solutions. This approach is a successful first step in identifying the feasibility of using cellular c-fos activation simultaneously across relevant brain sites to study reward-related learning in ingestion of palatable food in rodents. PMID:27583636

  18. A Granger causality measure for point process models of ensemble neural spiking activity.

    Sanggyun Kim

    2011-03-01

    Full Text Available The ability to identify directional interactions that occur among multiple neurons in the brain is crucial to an understanding of how groups of neurons cooperate in order to generate specific brain functions. However, an optimal method of assessing these interactions has not been established. Granger causality has proven to be an effective method for the analysis of the directional interactions between multiple sets of continuous-valued data, but cannot be applied to neural spike train recordings due to their discrete nature. This paper proposes a point process framework that enables Granger causality to be applied to point process data such as neural spike trains. The proposed framework uses the point process likelihood function to relate a neuron's spiking probability to possible covariates, such as its own spiking history and the concurrent activity of simultaneously recorded neurons. Granger causality is assessed based on the relative reduction of the point process likelihood of one neuron obtained excluding one of its covariates compared to the likelihood obtained using all of its covariates. The method was tested on simulated data, and then applied to neural activity recorded from the primary motor cortex (MI of a Felis catus subject. The interactions present in the simulated data were predicted with a high degree of accuracy, and when applied to the real neural data, the proposed method identified causal relationships between many of the recorded neurons. This paper proposes a novel method that successfully applies Granger causality to point process data, and has the potential to provide unique physiological insights when applied to neural spike trains.

  19. Differences in neural activity when processing emotional arousal and valence in autism spectrum disorders.

    Tseng, Angela; Wang, Zhishun; Huo, Yuankai; Goh, Suzanne; Russell, James A; Peterson, Bradley S

    2016-02-01

    Individuals with autism spectrum disorders (ASD) often have difficulty recognizing and interpreting facial expressions of emotion, which may impair their ability to navigate and communicate successfully in their social, interpersonal environments. Characterizing specific differences between individuals with ASD and their typically developing (TD) counterparts in the neural activity subserving their experience of emotional faces may provide distinct targets for ASD interventions. Thus we used functional magnetic resonance imaging (fMRI) and a parametric experimental design to identify brain regions in which neural activity correlated with ratings of arousal and valence for a broad range of emotional faces. Participants (51 ASD, 84 TD) were group-matched by age, sex, IQ, race, and socioeconomic status. Using task-related change in blood-oxygen-level-dependent (BOLD) fMRI signal as a measure, and covarying for age, sex, FSIQ, and ADOS scores, we detected significant differences across diagnostic groups in the neural activity subserving the dimension of arousal but not valence. BOLD-signal in TD participants correlated inversely with ratings of arousal in regions associated primarily with attentional functions, whereas BOLD-signal in ASD participants correlated positively with arousal ratings in regions commonly associated with impulse control and default-mode activity. Only minor differences were detected between groups in the BOLD signal correlates of valence ratings. Our findings provide unique insight into the emotional experiences of individuals with ASD. Although behavioral responses to face-stimuli were comparable across diagnostic groups, the corresponding neural activity for our ASD and TD groups differed dramatically. The near absence of group differences for valence correlates and the presence of strong group differences for arousal correlates suggest that individuals with ASD are not atypical in all aspects of emotion-processing. Studying these similarities

  20. Linking online gaming and addictive behavior: Converging evidence for a general reward deficiency in frequent online gamers

    Tim Hahn

    2014-11-01

    Full Text Available Millions of people regularly play so-called Massively Multiplayer Online Role Playing Games (MMORPGs. Recently, it has been argued that MMORPG overuse is becoming a significant health problem worldwide. Symptoms such as tolerance, withdrawal and craving have been described. Based on behavioral, resting state and task-related neuroimaging data, we test whether frequent players of the MMORPG “World of Warcraft” (WoW – similar to drug addicts and individuals with an increased risk for addictions – show a generally deficient reward system. In frequent players of the MMORPG “World of Warcraft” (WoW-players and in a control group of non-gamers we assessed 1 trait sensitivity to reward, 2 BOLD responses during monetary reward processing in the ventral striatum and 3 ventral-striatal resting state dynamics. We find a decreased neural activation in the ventral striatum during the anticipation of both small and large monetary rewards. Additionally, we show generally altered neurodynamics in this region independent of any specific task for WoW players (resting state. On the behavioral level, we found differences in trait sensitivity to reward, suggesting that the reward processing deficiencies found in this study are not a consequence of gaming, but predisposed to it. These findings empirically support a direct link between frequent online gaming and the broad field of behavioral and drug addiction research, thus opening new avenues for clinical interventions in addicted gamers and potentially improving the assessment of addiction-risk in the vast population of frequent gamers.

  1. Teasing apart the anticipatory and consummatory processing of monetary incentives: An event-related potential study of reward dynamics.

    Novak, Keisha D; Foti, Dan

    2015-11-01

    The monetary incentive delay (MID) task has been widely used in fMRI studies to investigate the neural networks involved in anticipatory and consummatory reward processing. Previous efforts to adapt the MID task for use with ERPs, however, have had limited success. Here, we sought to further decompose reward dynamics using a comprehensive set of anticipatory (cue-N2, cue-P3, contingent negative variation [CNV]) and consummatory ERPs (feedback negativity [FN], feedback P3 [fb-P3]). ERP data was recorded during adapted versions of the MID task across two experiments. Unlike previous studies, monetary incentive cues modulated the cue-N2, cue-P3, and CNV; however, cue-related ERPs and the CNV were uncorrelated with one another, indicating distinct anticipatory subprocesses. With regard to consummatory processing, FN amplitude primarily tracked outcome valence (reward vs. nonreward), whereas fb-P3 amplitude primarily tracked outcome salience (uncertain vs. certain). Independent modulation of the cue-P3 and fb-P3 was observed, indicating that these two P3 responses may uniquely capture the allocation of attention during anticipatory and consummatory reward processing, respectively. Overall, across two samples, consistent evidence of both anticipatory and consummatory ERP activity was observed on an adapted version of the MID paradigm, demonstrating for the first time how these ERP components may be integrated with one another to more fully characterize the time course of reward processing. This ERP-MID paradigm is well suited to parsing reward dynamics, and can be applied to both healthy and clinical populations. PMID:26223291

  2. Neurobiology of hyperactivity and reward : Agreeable restlessness in Anorexia Nervosa

    Scheurink, Anton J. W.; Boersma, Gretha J.; Nergardh, Ricard; Sodersten, Per; Nergårdh, Ricard; Södersten, Per

    2010-01-01

    Restricted food intake is associated with increased physical activity, very likely an evolutionary advantage, initially both functional and rewarding. The hyperactivity of patients with Anorexia Nervosa, however, is a main problem for recovery. This seemingly paradoxical reward of hyperactivity in A

  3. Data Fusion Using Different Activation Functions in Artificial Neural Networks for Vehicular Navigation

    MALLESWARAN M,

    2010-12-01

    Full Text Available Global positioning System (GPS and Inertial Navigation System (INS data can be integrated together to provide a reliable navigation. GPS/INS data integration provides reliable navigation solutions by overcoming each of their shortcomings, including signal blockage for GPS and increase in position errors with time for INS. This paper aims to provide GPS/INS data integration utilizing Artificial Neural Network (ANN architecture. This architecture is based on Feed Forward Neural Networks, which generally includes Radial Basis Function (RBF neural network and Back Propagation neural network (BPN. These are systematic methods for training multi-layer artificial networks. The BPN-ANN and RBF-ANN modules are trained to predict the INS position error and provide accurate positioning of the moving vehicle. This paper also compares performance of theGPS/INS data integration system by using different activation function like Bipolar Sigmoidal Function (BPSF, Binary Sigmoidal Function (BISF, Hyperbolic Tangential Function (HTF and Gaussian Function (GF in BPN-ANN and using Gaussian function in RBF-ANN.

  4. Dopamine-induced dissociation of BOLD and neural activity in macaque visual cortex.

    Zaldivar, Daniel; Rauch, Alexander; Whittingstall, Kevin; Logothetis, Nikos K; Goense, Jozien

    2014-12-01

    Neuromodulators determine how neural circuits process information during cognitive states such as wakefulness, attention, learning, and memory. fMRI can provide insight into their function and dynamics, but their exact effect on BOLD responses remains unclear, limiting our ability to interpret the effects of changes in behavioral state using fMRI. Here, we investigated the effects of dopamine (DA) injections on neural responses and haemodynamic signals in macaque primary visual cortex (V1) using fMRI (7T) and intracortical electrophysiology. Aside from DA's involvement in diseases such as Parkinson's and schizophrenia, it also plays a role in visual perception. We mimicked DAergic neuromodulation by systemic injection of L-DOPA and Carbidopa (LDC) or by local application of DA in V1 and found that systemic application of LDC increased the signal-to-noise ratio (SNR) and amplitude of the visually evoked neural responses in V1. However, visually induced BOLD responses decreased, whereas cerebral blood flow (CBF) responses increased. This dissociation of BOLD and CBF suggests that dopamine increases energy metabolism by a disproportionate amount relative to the CBF response, causing the reduced BOLD response. Local application of DA in V1 had no effect on neural activity, suggesting that the dopaminergic effects are mediated by long-range interactions. The combination of BOLD-based and CBF-based fMRI can provide a signature of dopaminergic neuromodulation, indicating that the application of multimodal methods can improve our ability to distinguish sensory processing from neuromodulatory effects. PMID:25456449

  5. Deep neural nets as a method for quantitative structure-activity relationships.

    Ma, Junshui; Sheridan, Robert P; Liaw, Andy; Dahl, George E; Svetnik, Vladimir

    2015-02-23

    Neural networks were widely used for quantitative structure-activity relationships (QSAR) in the 1990s. Because of various practical issues (e.g., slow on large problems, difficult to train, prone to overfitting, etc.), they were superseded by more robust methods like support vector machine (SVM) and random forest (RF), which arose in the early 2000s. The last 10 years has witnessed a revival of neural networks in the machine learning community thanks to new methods for preventing overfitting, more efficient training algorithms, and advancements in computer hardware. In particular, deep neural nets (DNNs), i.e. neural nets with more than one hidden layer, have found great successes in many applications, such as computer vision and natural language processing. Here we show that DNNs can routinely make better prospective predictions than RF on a set of large diverse QSAR data sets that are taken from Merck's drug discovery effort. The number of adjustable parameters needed for DNNs is fairly large, but our results show that it is not necessary to optimize them for individual data sets, and a single set of recommended parameters can achieve better performance than RF for most of the data sets we studied. The usefulness of the parameters is demonstrated on additional data sets not used in the calibration. Although training DNNs is still computationally intensive, using graphical processing units (GPUs) can make this issue manageable. PMID:25635324

  6. Impact of Size and Delay on Neural Activity in the Rat Limbic Corticostriatal System

    Roesch, Matthew R; Bryden, Daniel W.

    2011-01-01

    A number of factors influence an animal’s economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short-delay and big-reward conditions than under long-delay a...

  7. A nonlinear neural fir filter with an adaptive activation function

    Lee Su Goh

    2003-01-01

    Full Text Available An adaptive amplitude normalized nonlinear gradient descent (AANNGD algorithm for the class of nonlinear finite impulse response (FIR adaptive filters (dynamical perception is introduced. This is achieved by making the amplitude of the nonlinear activation function gradient adaptive. The proposed learning algorithm is suitable for processing of nonlinear and nonstationary signals with a large dynamical range, and removes the unwanted effect of saturation nonlinearities. For rigor, sensitivity analysis is performed and the improved performance of the AANNGD algorithm over the standard LMS, NGD, NNGD, the fully adaptive NNGD (FANNGD and the sign algorithm is verified by simulations on nonlinear and nonstationary inputs with large dynamics.

  8. Spontaneous neural activity during human slow wave sleep

    Dang-Vu, Thien Thanh; Schabus, Manuel; Desseilles, Martin; Albouy, Geneviève; Boly, Mélanie; Darsaud, Annabelle; Gais, Steffen; Rauchs, Géraldine; Sterpenich, Virginie; Vandewalle, Gilles; Carrier, Julie; Moonen, Gustave; Balteau, Evelyne; Degueldre, Christian; Luxen, André

    2008-01-01

    Slow wave sleep (SWS) is associated with spontaneous brain oscillations that are thought to participate in sleep homeostasis and to support the processing of information related to the experiences of the previous awake period. At the cellular level, during SWS, a slow oscillation (140 μV) and delta waves (75–140 μV) during SWS in 14 non-sleep-deprived normal human volunteers. Significant increases in activity were associated with these waves in several cortical areas, including the inferior f...

  9. Hungry for reward: How can neuroscience inform the development of treatment for Anorexia Nervosa?

    Park, Rebecca J; Godier, Lauren R; Cowdrey, Felicity A

    2014-11-01

    Dysfunctional reward from the pursuit of thinness presents a major challenge to recovery from Anorexia Nervosa (AN). We explore the neuroscientific basis of aberrant reward in AN, with the aim of generating novel hypotheses for translational investigation, and elucidate disease mechanisms to inform the development of targeted interventions. Relevant neuroimaging and behavioural studies are reviewed. These suggest that altered eating in AN may be a consequence of aberrant reward processing combined with exaggerated cognitive control. We consider evidence that such aberrant reward processing is reflected in the compulsive behaviours characterising AN, with substantial overlap in the neural circuits implicated in reward processing and compulsivity. Drawing on contemporary neuroscientific theories of substance dependence, processes underpinning the shift from the initially rewarding pursuit of thinness to extreme and compulsive weight control behaviours are discussed. It is suggested that in AN, weight loss behaviour begins as overtly rewarding, goal-directed and positively reinforced, but over time becomes habitual and increasingly negatively reinforced. Excessive habit formation is suggested as one underlying mechanism perpetuating compulsive behaviour. Ongoing research into the behavioural and neural basis of aberrant reward in AN is required to further elucidate mechanisms. We discuss clinical and transdiagnostic implications, and propose that future treatment innovation may benefit from the development of novel interventions targeting aberrant reward processing in AN. PMID:25151600

  10. Mutual information and self-control of a fully-connected low-activity neural network

    Bollé, D.; Carreta, D. Dominguez

    2000-11-01

    A self-control mechanism for the dynamics of a three-state fully connected neural network is studied through the introduction of a time-dependent threshold. The self-adapting threshold is a function of both the neural and the pattern activity in the network. The time evolution of the order parameters is obtained on the basis of a recently developed dynamical recursive scheme. In the limit of low activity the mutual information is shown to be the relevant parameter in order to determine the retrieval quality. Due to self-control an improvement of this mutual information content as well as an increase of the storage capacity and an enlargement of the basins of attraction are found. These results are compared with numerical simulations.

  11. Single-cell transcriptome analyses reveal signals to activate dormant neural stem cells.

    Luo, Yuping; Coskun, Volkan; Liang, Aibing; Yu, Juehua; Cheng, Liming; Ge, Weihong; Shi, Zhanping; Zhang, Kunshan; Li, Chun; Cui, Yaru; Lin, Haijun; Luo, Dandan; Wang, Junbang; Lin, Connie; Dai, Zachary; Zhu, Hongwen; Zhang, Jun; Liu, Jie; Liu, Hailiang; deVellis, Jean; Horvath, Steve; Sun, Yi Eve; Li, Siguang

    2015-05-21

    The scarcity of tissue-specific stem cells and the complexity of their surrounding environment have made molecular characterization of these cells particularly challenging. Through single-cell transcriptome and weighted gene co-expression network analysis (WGCNA), we uncovered molecular properties of CD133(+)/GFAP(-) ependymal (E) cells in the adult mouse forebrain neurogenic zone. Surprisingly, prominent hub genes of the gene network unique to ependymal CD133(+)/GFAP(-) quiescent cells were enriched for immune-responsive genes, as well as genes encoding receptors for angiogenic factors. Administration of vascular endothelial growth factor (VEGF) activated CD133(+) ependymal neural stem cells (NSCs), lining not only the lateral but also the fourth ventricles and, together with basic fibroblast growth factor (bFGF), elicited subsequent neural lineage differentiation and migration. This study revealed the existence of dormant ependymal NSCs throughout the ventricular surface of the CNS, as well as signals abundant after injury for their activation. PMID:26000486

  12. QSAR study on estrogenic activity of structurally diverse compounds using generalized regression neural network

    JI Li; WANG XiaoDong; LUO Si; QIN Liang; YANG XvShu; LIU ShuShen; WANG LianSheng

    2008-01-01

    Computer-based quantitative structure-activity relationship (QSAR) model has been becoming a powerful tool in understanding the structural requirements for chemicals to bind the estrogen receptor (ER), designing drugs for human estrogen replacement therapy, and identifying potential estrogenic endocrine disruptors, in this study, a simple yet powerful neural network technique, generalized regression neural network (GRNN) was used to develop a QSAR model based on 131 structurally diverse estrogens (training set). Only nine descriptors calculated solely from the molecular structures of compounds selected by objective and subjective feature selections were used as inputs of the GRNN model. The predictive power of the built model was found to be comparable to that of the more traditional techniques but requiring significantly easy implementation and a shorter computation-time. The obtained result indicates that the proposed GRNN model is robust and satisfactory, and can provide a feasible and practical tool for the rapid screening of the estrogenic activity of organic compounds.

  13. Category-based induction from similarity of neural activation.

    Weber, Matthew J; Osherson, Daniel

    2014-03-01

    The idea that similarity might be an engine of inductive inference dates back at least as far as David Hume. However, Hume's thesis is difficult to test without begging the question, since judgments of similarity may be infected by inferential processes. We present a one-parameter model of category-based induction that generates predictions about arbitrary statements of conditional probability over a predicate and a set of items. The prediction is based on the unconditional probabilities and similarities that characterize that predicate and those items. To test Hume's thesis, we collected brain activation from various regions of the ventral visual stream during a categorization task that did not invite comparison of categories. We then calculated the similarity of those activation patterns using a simple measure of vectorwise similarity and supplied those similarities to the model. The model's outputs correlated well with subjects' judgments of conditional probability. Our results represent a promising first step toward confirming Hume's thesis; similarity, assessed without reference to induction, may well drive inductive inference. PMID:24254747

  14. On the solar energetic events, neural networks and forecasts of geomagnetic activity

    Hejda, Pavel; Bochníček, Josef; Valach, F.; Revallo, M.

    Sofia : International Scientific Conference SGEM, 2009, s. 685-692. ISBN 978-954-91818-1-4. [International multidisciplinary scientific geo-conference and expo /9./. Albena (BG), 14.06.2009-19.06.2009] R&D Projects: GA AV ČR(CZ) IAA300120608; GA MŠk OC09070 Institutional research plan: CEZ:AV0Z30120515 Keywords : solar energetic events * geomagnetic activity * artificial neural network Subject RIV: DE - Earth Magnetism, Geodesy, Geography

  15. A dynamic neural field architecture for a pro-active assistant robot

    Pinheiro, Manuel; Bicho, E.; Erlhagen, Wolfram

    2010-01-01

    We present a control architecture for non-verbal HRI that allows an assistant robot to have a pro-active and anticipatory behavior. The architecture implements the coordination of actions and goals among the human, that needs help, and the robot as a dynamic process that integrates contextual cues, shared task knowledge and predicted outcome of the human motor behavior. The robot control architecture is formalized by a coupled system of dynamic neural fields representing a distributed network...

  16. Neural network analysis of electrodynamic activity of yeast cells around 1 kHz

    This paper deals with data analysis of electrodynamic activity of two mutants of yeast cells, cell cycle of which is synchronized and non-synchronized, respectively. We used data already published by Jelinek et al. and treat them with data mining method based on the multilayer neural network. Intersection of data mining and statistical distribution of the noise shows significant difference between synchronized and non-synchronized yeasts not only in total power, but also discrete frequencies.

  17. Social status alters defeat-induced neural activation in Syrian hamsters

    Morrison, Kathleen E.; Curry, Daniel W.; Cooper, Matthew A.

    2012-01-01

    While exposure to social stress leads to increased depression-like and anxiety-like behavior, some individuals are more vulnerable than others to these stress-induced changes in behavior. Prior social experience is one factor that can modulate how individuals respond to stressful events. In this study we investigated whether experience-dependent resistance to the behavioral consequences of social defeat was associated with a specific pattern of neural activation. We paired weight-matched male...

  18. Social Exclusion in Middle Childhood: Rejection Events, Slow-wave Neural Activity and Ostracism Distress

    Crowley, Michael J.; Wu, Jia; MOLFESE, PETER J.; Mayes, Linda C.

    2010-01-01

    This study examined neural activity with event-related potentials (ERPs) in middle childhood during a computer-simulated ball-toss game, Cyberball. Experiencing fair play initially, children were ultimately excluded by the other players. We focused specifically on “not my turn” events within fair play and rejection events within social exclusion. Dense-array ERPs revealed that rejection events are perceived rapidly. Condition differences (“not my turn” vs. rejection) were evident in a posteri...

  19. Strong geomagnetic activity forecast by neural networks under dominant southern orientation of the interplanetary magnetic field

    Valach, F.; Bochníček, Josef; Hejda, Pavel; Revallo, M.

    2014-01-01

    Roč. 53, č. 4 (2014), s. 589-598. ISSN 0273-1177 R&D Projects: GA AV ČR(CZ) IAA300120608; GA MŠk OC09070 Institutional support: RVO:67985530 Keywords : geomagnetic activity * interplanetary magnetic field * artificial neural network * ejection of coronal mass * X-ray flares Subject RIV: DE - Earth Magnetism, Geodesy, Geography Impact factor: 1.358, year: 2014

  20. Human facial neural activities and gesture recognition for machine-interfacing applications

    Hamedi M

    2011-12-01

    Full Text Available M Hamedi1, Sh-Hussain Salleh2, TS Tan2, K Ismail2, J Ali3, C Dee-Uam4, C Pavaganun4, PP Yupapin51Faculty of Biomedical and Health Science Engineering, Department of Biomedical Instrumentation and Signal Processing, University of Technology Malaysia, Skudai, 2Centre for Biomedical Engineering Transportation Research Alliance, 3Institute of Advanced Photonics Science, Nanotechnology Research Alliance, University of Technology Malaysia (UTM, Johor Bahru, Malaysia; 4College of Innovative Management, Valaya Alongkorn Rajabhat University, Pathum Thani, 5Nanoscale Science and Engineering Research Alliance (N'SERA, Advanced Research Center for Photonics, Faculty of Science, King Mongkut's Institute of Technology Ladkrabang, Bangkok, ThailandAbstract: The authors present a new method of recognizing different human facial gestures through their neural activities and muscle movements, which can be used in machine-interfacing applications. Human–machine interface (HMI technology utilizes human neural activities as input controllers for the machine. Recently, much work has been done on the specific application of facial electromyography (EMG-based HMI, which have used limited and fixed numbers of facial gestures. In this work, a multipurpose interface is suggested that can support 2–11 control commands that can be applied to various HMI systems. The significance of this work is finding the most accurate facial gestures for any application with a maximum of eleven control commands. Eleven facial gesture EMGs are recorded from ten volunteers. Detected EMGs are passed through a band-pass filter and root mean square features are extracted. Various combinations of gestures with a different number of gestures in each group are made from the existing facial gestures. Finally, all combinations are trained and classified by a Fuzzy c-means classifier. In conclusion, combinations with the highest recognition accuracy in each group are chosen. An average accuracy

  1. Distinct neural activity associated with focused-attention meditation and loving-kindness meditation

    Lee, Tatia M. C.; Leung, Mei-Kei; Hou, Wai-Kai; Tang, Joey C. Y.; Yin, Jing; So, Kwok-Fai; Lee, Chack-Fan; Chan, Chetwyn C. H.

    2012-01-01

    This study examined the dissociable neural effects of ānāpānasati (focused-attention meditation, FAM) and mettā (loving-kindness meditation, LKM) on BOLD signals during cognitive (continuous performance test, CPT) and affective (emotion-processing task, EPT, in which participants viewed affective pictures) processing. Twenty-two male Chinese expert meditators (11 FAM experts, 11 LKM experts) and 22 male Chinese novice meditators (11 FAM novices, 11 LKM novices) had their brain activity monito...

  2. Abnormal Task Modulation of Oscillatory Neural Activity in Schizophrenia

    Elisa C Dias

    2013-08-01

    Full Text Available Schizophrenia patients have deficits in cognitive function that are a core feature of the disorder. AX-CPT is commonly used to study cognition in schizophrenia, and patients have characteristic pattern of behavioral and ERP response. In AX-CPT subjects respond when a flashed cue A is followed by a target X, ignoring other letter combinations. Patients show reduced hit rate to go trials, and increased false alarms to sequences that require inhibition of a prepotent response. EEG recordings show reduced sensory (P1/N1, as well as later cognitive components (N2, P3, CNV. Behavioral deficits correlate most strongly with sensory dysfunction. Oscillatory analyses provide critical information regarding sensory/cognitive processing over and above standard ERP analyses. Recent analyses of induced oscillatory activity in single trials during AX-CPT in healthy volunteers showed characteristic response patterns in theta, alpha and beta frequencies tied to specific sensory and cognitive processes. Alpha and beta modulated during the trials and beta modulation over the frontal cortex correlated with reaction time. In this study, EEG data was obtained from 18 schizophrenia patients and 13 controls during AX-CPT performance, and single trial decomposition of the signal yielded power in the target wavelengths.Significant task-related event-related desynchronization (ERD was observed in both alpha and beta frequency bands over parieto-occipital cortex related to sensory encoding of the cue. This modulation was reduced in patients for beta, but not for alpha. In addition, significant beta ERD was observed over motor cortex, related to motor preparation for the response, and was also reduced in patients. These findings demonstrate impaired dynamic modulation of beta frequency rhythms in schizophrenia, and suggest that failures of oscillatory activity may underlie impaired sensory information processing in schizophrenia that in turn contributes to cognitive deficits.

  3. Individual Differences in Reward and Somatosensory-Motor Brain Regions Correlate with Adiposity in Adolescents.

    Rapuano, Kristina M; Huckins, Jeremy F; Sargent, James D; Heatherton, Todd F; Kelley, William M

    2016-06-01

    The prevalence of adolescent obesity has increased dramatically over the past three decades, and research has documented that the number of television shows viewed during childhood is associated with greater risk for obesity. In particular, considerable evidence suggests that exposure to food marketing promotes eating habits that contribute to obesity. The present study examines neural responses to dynamic food commercials in overweight and healthy-weight adolescents using functional magnetic resonance imaging (fMRI). Compared with non-food commercials, food commercials more strongly engaged regions involved in attention and saliency detection (occipital lobe, precuneus, superior temporal gyri, and right insula) and in processing rewards [left and right nucleus accumbens (NAcc) and left orbitofrontal cortex (OFC)]. Activity in the left OFC and right insula further correlated with subjects' percent body fat at the time of the scan. Interestingly, this reward-related activity to food commercials was accompanied by the additional recruitment of mouth-specific somatosensory-motor cortices-a finding that suggests the intriguing possibility that higher-adiposity adolescents mentally simulate eating behaviors and offers a potential neural mechanism for the formation and reinforcement of unhealthy eating habits that may hamper an individual's ability lose weight later in life. PMID:25994961

  4. Spontaneous neural activity in the primary visual cortex of retinal degenerated rats.

    Wang, Yi; Chen, Ke; Xu, Ping; Ng, Tsz Kin; Chan, Leanne Lai Hang

    2016-06-01

    Retinal degeneration (RD) models have been widely used to study retinal degenerative diseases for a long time. The biological and electrophysiological presentations of changes in the retina during degeneration progress have been well investigated; thus, the present study is aimed at investigating the electrophysiological effects of RD in the primary visual cortex. We extracellularly recorded the spontaneous neural activities in the primary visual cortex of RD rats. The firing rate, interspike interval (ISI) and Lempel-Ziv (LZ) complexity of spontaneous neural activities were subsequently analyzed. When compared to the control group, it was found that the neurons in primary visual cortex of the RD model fired more frequently. In addition, there was a decrease in LZ complexity of spontaneous neural firing in the RD model. These results suggest that the progress of RD may not only affect the retina itself but also the primary visual cortex, which may result in an unbalanced inhibition-excitation system as well as the decreased arising rate of new patterns of spontaneous activities. PMID:27132087

  5. Dynamics of modularity of neural activity in the brain during development

    Deem, Michael; Chen, Man

    2014-03-01

    Theory suggests that more modular systems can have better response functions at short times. This theory suggests that greater cognitive performance may be achieved for more modular neural activity, and that modularity of neural activity may, therefore, likely increase with development in children. We study the relationship between age and modularity of brain neural activity in developing children. The value of modularity calculated from fMRI data is observed to increase during childhood development and peak in young adulthood. We interpret these results as evidence of selection for plasticity in the cognitive function of the human brain. We present a model to illustrate how modularity can provide greater cognitive performance at short times and enhance fast, low-level, automatic cognitive processes. Conversely, high-level, effortful, conscious cognitive processes may not benefit from modularity. We use quasispecies theory to predict how the average modularity evolves with age, given a fitness function extracted from the model. We suggest further experiments exploring the effect of modularity on cognitive performance and suggest that modularity may be a potential biomarker for injury, rehabilitation, or disease.

  6. Noise influence on spike activation in a Hindmarsh–Rose small-world neural network

    Zhe, Sun; Micheletto, Ruggero

    2016-07-01

    We studied the role of noise in neural networks, especially focusing on its relation to the propagation of spike activity in a small sized system. We set up a source of information using a single neuron that is constantly spiking. This element called initiator x o feeds spikes to the rest of the network that is initially quiescent and subsequently reacts with vigorous spiking after a transitional period of time. We found that noise quickly suppresses the initiator’s influence and favors spontaneous spike activity and, using a decibel representation of noise intensity, we established a linear relationship between noise amplitude and the interval from the initiator’s first spike and the rest of the network activation. We studied the same process with networks of different sizes (number of neurons) and found that the initiator x o has a measurable influence on small networks, but as the network grows in size, spontaneous spiking emerges disrupting its effects on networks of more than about N = 100 neurons. This suggests that the mechanism of internal noise generation allows information transmission within a small neural neighborhood, but decays for bigger network domains. We also analyzed the Fourier spectrum of the whole network membrane potential and verified that noise provokes the reduction of main θ and α peaks before transitioning into chaotic spiking. However, network size does not reproduce a similar phenomena; instead we recorded a reduction in peaks’ amplitude, a better sharpness and definition of Fourier peaks, but not the evident degeneration to chaos observed with increasing external noise. This work aims to contribute to the understanding of the fundamental mechanisms of propagation of spontaneous spiking in neural networks and gives a quantitative assessment of how noise can be used to control and modulate this phenomenon in Hindmarsh‑Rose (H‑R) neural networks.

  7. Rejuvenation of MPTP-induced human neural precursor cell senescence by activating autophagy

    Zhu, Liang [East Hospital, Tongji University School of Medicine, Shanghai (China); Dong, Chuanming [East Hospital, Tongji University School of Medicine, Shanghai (China); Department of Anatomy and Neurobiology, The Jiangsu Key Laboratory of Neuroregeneration, Nantong University, Nantong (China); Sun, Chenxi; Ma, Rongjie; Yang, Danjing [East Hospital, Tongji University School of Medicine, Shanghai (China); Zhu, Hongwen, E-mail: hongwen_zhu@hotmail.com [Tianjin Hospital, Tianjin Academy of Integrative Medicine, Tianjin (China); Xu, Jun, E-mail: xunymc2000@yahoo.com [East Hospital, Tongji University School of Medicine, Shanghai (China)

    2015-08-21

    Aging of neural stem cell, which can affect brain homeostasis, may be caused by many cellular mechanisms. Autophagy dysfunction was found in aged and neurodegenerative brains. However, little is known about the relationship between autophagy and human neural stem cell (hNSC) aging. The present study used 1-methyl-4-phenyl-1, 2, 3, 6-tetrahydropyridine (MPTP) to treat neural precursor cells (NPCs) derived from human embryonic stem cell (hESC) line H9 and investigate related molecular mechanisms involved in this process. MPTP-treated NPCs were found to undergo premature senescence [determined by increased senescence-associated-β-galactosidase (SA-β-gal) activity, elevated intracellular reactive oxygen species level, and decreased proliferation] and were associated with impaired autophagy. Additionally, the cellular senescence phenotypes were manifested at the molecular level by a significant increase in p21 and p53 expression, a decrease in SOD2 expression, and a decrease in expression of some key autophagy-related genes such as Atg5, Atg7, Atg12, and Beclin 1. Furthermore, we found that the senescence-like phenotype of MPTP-treated hNPCs was rejuvenated through treatment with a well-known autophagy enhancer rapamycin, which was blocked by suppression of essential autophagy gene Beclin 1. Taken together, these findings reveal the critical role of autophagy in the process of hNSC aging, and this process can be reversed by activating autophagy. - Highlights: • We successfully establish hESC-derived neural precursor cells. • MPTP treatment induced senescence-like state in hESC-derived NPCs. • MPTP treatment induced impaired autophagy of hESC-derived NPCs. • MPTP-induced hESC-derived NPC senescence was rejuvenated by activating autophagy.

  8. Rejuvenation of MPTP-induced human neural precursor cell senescence by activating autophagy

    Aging of neural stem cell, which can affect brain homeostasis, may be caused by many cellular mechanisms. Autophagy dysfunction was found in aged and neurodegenerative brains. However, little is known about the relationship between autophagy and human neural stem cell (hNSC) aging. The present study used 1-methyl-4-phenyl-1, 2, 3, 6-tetrahydropyridine (MPTP) to treat neural precursor cells (NPCs) derived from human embryonic stem cell (hESC) line H9 and investigate related molecular mechanisms involved in this process. MPTP-treated NPCs were found to undergo premature senescence [determined by increased senescence-associated-β-galactosidase (SA-β-gal) activity, elevated intracellular reactive oxygen species level, and decreased proliferation] and were associated with impaired autophagy. Additionally, the cellular senescence phenotypes were manifested at the molecular level by a significant increase in p21 and p53 expression, a decrease in SOD2 expression, and a decrease in expression of some key autophagy-related genes such as Atg5, Atg7, Atg12, and Beclin 1. Furthermore, we found that the senescence-like phenotype of MPTP-treated hNPCs was rejuvenated through treatment with a well-known autophagy enhancer rapamycin, which was blocked by suppression of essential autophagy gene Beclin 1. Taken together, these findings reveal the critical role of autophagy in the process of hNSC aging, and this process can be reversed by activating autophagy. - Highlights: • We successfully establish hESC-derived neural precursor cells. • MPTP treatment induced senescence-like state in hESC-derived NPCs. • MPTP treatment induced impaired autophagy of hESC-derived NPCs. • MPTP-induced hESC-derived NPC senescence was rejuvenated by activating autophagy

  9. Orphan nuclear receptor TLX activates Wnt/β-catenin signalling to stimulate neural stem cell proliferation and self-renewal

    Qu, Qiuhao; Sun, Guoqiang; Li, Wenwu; Yang, Su; Ye, Peng; Zhao, Chunnian; Yu, Ruth T.; Gage, Fred H; Evans, Ronald M; Shi, Yanhong

    2009-01-01

    The nuclear receptor TLX (also known as NR2E1) is essential for adult neural stem cell self-renewal; however, the molecular mechanisms involved remain elusive. Here we show that TLX activates the canonical Wnt/β-catenin pathway in adult mouse neural stem cells. Furthermore, we demonstrate that Wnt/β-catenin signalling is important in the proliferation and self-renewal of adult neural stem cells in the presence of epidermal growth factor and fibroblast growth factor. Wnt7a and active β-catenin...

  10. Long-range neural activity evoked by premotor cortex stimulation: a TMS/EEG co-registration study

    Marco eZanon

    2013-11-01

    Full Text Available The premotor cortex is one of the fundamental structures composing the neural networks of the human brain. It is implicated in many behaviors and cognitive tasks, ranging from movement to attention and eye-related activity. Therefore, neural circuits that are related to premotor cortex have been studied to clarify their connectivity and/or role in different tasks. In the present work, we aimed to investigate the propagation of the neural activity evoked in the dorsal premotor cortex using transcranial magnetic stimulation/electroencephalography (TMS/EEG. Towards this end, interest was focused on the neural dynamics elicited in long-ranging temporal and spatial networks. Twelve healthy volunteers underwent a single-pulse TMS protocol in a resting condition with eyes closed, and the evoked activity, measured by EEG, was compared to a sham condition in a time window ranging from 45 msec to about 200 msec after TMS. Spatial and temporal investigations were carried out with sLORETA. TMS was found to induce propagation of neural activity mainly in the contralateral sensorimotor and frontal cortices, at about 130 msec after delivery of the stimulus. Different types of analyses showed propagated activity also in posterior, mainly visual, regions, in a time window between 70 and 130 msec. Finally, a likely rebounding activation of the sensorimotor and frontal regions, was observed in various time ranges. Taken together, the present findings further characterize the neural circuits that are driven by dorsal premotor cortex activation in healthy humans.

  11. Subliminal versus supraliminal stimuli activate neural responses in anterior cingulate cortex, fusiform gyrus and insula: a meta-analysis of fMRI studies

    Meneguzzo, Paolo; Tsakiris, Manos; Schioth, Helgi B.; Dan J Stein; Brooks, Samantha J.

    2014-01-01

    Background Non-conscious neural activation may underlie various psychological functions in health and disorder. However, the neural substrates of non-conscious processing have not been entirely elucidated. Examining the differential effects of arousing stimuli that are consciously, versus unconsciously perceived will improve our knowledge of neural circuitry involved in non-conscious perception. Here we conduct preliminary analyses of neural activation in studies that have used both sublimina...

  12. Active vibration control of flexible cantilever plates using piezoelectric materials and artificial neural networks

    Abdeljaber, Osama; Avci, Onur; Inman, Daniel J.

    2016-02-01

    The study presented in this paper introduces a new intelligent methodology to mitigate the vibration response of flexible cantilever plates. The use of the piezoelectric sensor/actuator pairs for active control of plates is discussed. An intelligent neural network based controller is designed to control the optimal voltage applied on the piezoelectric patches. The control technique utilizes a neurocontroller along with a Kalman Filter to compute the appropriate actuator command. The neurocontroller is trained based on an algorithm that incorporates a set of emulator neural networks which are also trained to predict the future response of the cantilever plate. Then, the neurocontroller is evaluated by comparing the uncontrolled and controlled responses under several types of dynamic excitations. It is observed that the neurocontroller reduced the vibration response of the flexible cantilever plate significantly; the results demonstrated the success and robustness of the neurocontroller independent of the type and distribution of the excitation force.

  13. The BDNF Val66Met Polymorphism Influences Reading Ability and Patterns of Neural Activation in Children.

    Jasińska, Kaja K; Molfese, Peter J; Kornilov, Sergey A; Mencl, W Einar; Frost, Stephen J; Lee, Maria; Pugh, Kenneth R; Grigorenko, Elena L; Landi, Nicole

    2016-01-01

    Understanding how genes impact the brain's functional activation for learning and cognition during development remains limited. We asked whether a common genetic variant in the BDNF gene (the Val66Met polymorphism) modulates neural activation in the young brain during a critical period for the emergence and maturation of the neural circuitry for reading. In animal models, the bdnf variation has been shown to be associated with the structure and function of the developing brain and in humans it has been associated with multiple aspects of cognition, particularly memory, which are relevant for the development of skilled reading. Yet, little is known about the impact of the Val66Met polymorphism on functional brain activation in development, either in animal models or in humans. Here, we examined whether the BDNF Val66Met polymorphism (dbSNP rs6265) is associated with children's (age 6-10) neural activation patterns during a reading task (n = 81) using functional magnetic resonance imaging (fMRI), genotyping, and standardized behavioral assessments of cognitive and reading development. Children homozygous for the Val allele at the SNP rs6265 of the BDNF gene outperformed Met allele carriers on reading comprehension and phonological memory, tasks that have a strong memory component. Consistent with these behavioral findings, Met allele carriers showed greater activation in reading-related brain regions including the fusiform gyrus, the left inferior frontal gyrus and left superior temporal gyrus as well as greater activation in the hippocampus during a word and pseudoword reading task. Increased engagement of memory and spoken language regions for Met allele carriers relative to Val/Val homozygotes during reading suggests that Met carriers have to exert greater effort required to retrieve phonological codes. PMID:27551971

  14. Reward-Related Decision-Making in Pediatric Major Depressive Disorder: An fMRI Study

    Forbes, Erika E.; Christopher May, J.; Siegle, Greg J.; Ladouceur, Cecile D.; Ryan, Neal D.; Carter, Cameron S.; Birmaher, Boris; Axelson, David A.; Dahl, Ronald E.

    2006-01-01

    Background: Although reward processing is considered an important part of affective functioning, few studies have investigated reward-related decisions or responses in young people with affective disorders. Depression is postulated to involve decreased activity in reward-related affective systems. Methods: Using functional magnetic resonance…

  15. Effects of genetic background and environmental novelty on wheel running as a rewarding behaviour in mice

    de Visser, Leonie; van den Bos, Ruud; Stoker, Astrid K; Kas, Martien J H; Spruijt, Berry M

    2007-01-01

    Recent studies suggest running wheel activity to be naturally rewarding and reinforcing; considering the shared neuro-behavioural characteristics with drug-induced reward situations, wheel running behaviour gains interest as a tool to study mechanisms underlying reward-sensitivity. Previously, we sh

  16. Artificial neural networks in the evaluation of the radioactive waste drums activity

    The mathematical techniques are becoming more important to solve geometry and standard identification problems. The gamma spectrometry of radioactive waste drums would be a complex solution problem. The main difficulty is the detectors calibration for this geometry; the waste is not homogeneously distributed inside the drums, therefore there are many possible combinations between the activity and the position of these radionuclides inside the drums, making the preparation of calibration standards impracticable. This work describes the development of a methodology to estimate the activity of a 200 L radioactive waste drum, as well as a mapping of the waste distribution, using Artificial Neural Network. The neural network data set entry obtaining was based on the possible detection efficiency combination with 10 sources activities varying from 0 to 74 x 103 Bq. The set up consists of a 200 L drum divided in 5 layers. Ten detectors were positioned all the way through a parallel line to the drum axis, from 15 cm of its surface. The Cesium -137 radionuclide source was used. The 50 efficiency obtained values (10 detectors and 5 layers), combined with the 10 source intensities resulted in a 100,000 lines for 15 columns matrix, with all the possible combinations of source intensity and the Cs-137 position in the 5 layers of the drum. This archive was divided in 2 parts to compose the set of training: input and target files. The MatLab 7.0 module of neural networks was used for training. The net architecture has 10 neurons in the input layer, 18 in the hidden layer and 5 in the output layer. The training algorithm was the 'traincgb' and after 300 'epoch s' the medium square error was 0.00108172. This methodology allows knowing the detection positions answers in a heterogeneous distribution of radionuclides inside a 200 L waste drum; in consequence it is possible to estimate the total activity of the drum in the training neural network limits. The results accuracy depends on

  17. The interaction of dopamine and glutamate neurotransmission in reward-related brain areas in healthy subjects

    Klein, Nicola

    2011-01-01

    Reward-related learning recruits cortical and subcortical brain areas through dopaminergic and glutamate transmission. Animal research demonstrated that rewarding and reward-anticipatory tasks involve fast-firing dopaminergic neurons in the ventral tegmentum of the mesencephalon. These neurons project into the ventral striatum where increased activity during reward-associated experimental tasks has been shown in humans. processes are influenced by retrieval of stored information about the rew...

  18. The role of the central ghrelin system in reward from food and chemical drugs

    Dickson, Suzanne L; Egecioglu, Emil; Landgren, Sara; Skibicka, Karolina P; Engel, Jörgen A; Jerlhag, Elisabet

    2011-01-01

    Abstract Here we review recent advances that identify a role for the central ghrelin signalling system in reward from both natural rewards (such as food) and artificial rewards (that include alcohol and drugs of abuse). Whereas ghrelin emerged as a stomach-derived hormone involved in energy balance, hunger and meal initiation via hypothalamic circuits, it now seems clear that it also has a role in motivated reward-driven behaviours via activation of the so-called ?cholinergic-dopam...

  19. Mindfulness meditation modulates reward prediction errors in a passive conditioning task

    Kirk, Ulrich; Montague, P. Read

    2015-01-01

    Reinforcement learning models have demonstrated that phasic activity of dopamine neurons during reward expectation encodes information about the predictability of reward and cues that predict reward. Self-control strategies such as those practiced in mindfulness-based approaches is claimed to reduce negative and positive reactions to stimuli suggesting the hypothesis that such training may influence basic reward processing. Using a passive conditioning task and fMRI in a group of experienced ...

  20. Anticipatory reward signals in ventral striatal neurons of behaving rats.

    Khamassi, Mehdi; Mulder, Antonius B; Tabuchi, Eiichi; Douchamps, Vincent; Wiener, Sidney I

    2008-11-01

    It has been proposed that the striatum plays a crucial role in learning to select appropriate actions, optimizing rewards according to the principles of 'Actor-Critic' models of trial-and-error learning. The ventral striatum (VS), as Critic, would employ a temporal difference (TD) learning algorithm to predict rewards and drive dopaminergic neurons. This study examined this model's adequacy for VS responses to multiple rewards in rats. The respective arms of a plus-maze provided rewards of varying magnitudes; multiple rewards were provided at 1-s intervals while the rat stood still. Neurons discharged phasically prior to each reward, during both initial approach and immobile waiting, demonstrating that this signal is predictive and not simply motor-related. In different neurons, responses could be greater for early, middle or late droplets in the sequence. Strikingly, this activity often reappeared after the final reward, as if in anticipation of yet another. In contrast, previous TD learning models show decremental reward-prediction profiles during reward consumption due to a temporal-order signal introduced to reproduce accurate timing in dopaminergic reward-prediction error signals. To resolve this inconsistency in a biologically plausible manner, we adapted the TD learning model such that input information is nonhomogeneously distributed among different neurons. By suppressing reward temporal-order signals and varying richness of spatial and visual input information, the model reproduced the experimental data. This validates the feasibility of a TD-learning architecture where different groups of neurons participate in solving the task based on varied input information. PMID:18973599

  1. Serotonin Differentially Regulates Short- and Long-Term Prediction of Rewards in the Ventral and Dorsal Striatum

    Tanaka, Saori C.; Nicolas Schweighofer; Shuji Asahi; Kazuhiro Shishida; Yasumasa Okamoto; Shigeto Yamawaki; Kenji Doya

    2007-01-01

    BACKGROUND: The ability to select an action by considering both delays and amount of reward outcome is critical for maximizing long-term benefits. Although previous animal experiments on impulsivity have suggested a role of serotonin in behaviors requiring prediction of delayed rewards, the underlying neural mechanism is unclear. METHODOLOGY/PRINCIPAL FINDINGS: To elucidate the role of serotonin in the evaluation of delayed rewards, we performed a functional brain imaging experiment in which ...

  2. Topography, Power and Current Source Density of Theta Oscillations during Reward Processing as Markers for Alcohol Dependence

    Kamarajan, Chella; Rangaswamy, Madhavi; Manz, Niklas; Chorlian, David B.; Pandey, Ashwini K.; Roopesh, Bangalore N; Porjesz, Bernice

    2011-01-01

    Recent studies have linked alcoholism with a dysfunctional neural reward system. Although several electrophysiological studies have explored reward processing in healthy individuals, such studies in alcohol dependent individuals are quite rare. The present study examines theta oscillations during reward processing in abstinent alcoholics. The electroencephalogram (EEG) was recorded in 38 abstinent alcoholics and 38 healthy controls as they performed a single outcome gambling task which involv...

  3. Thinking about the thoughts of others; temporal and spatial neural activation during false belief reasoning.

    Mossad, Sarah I; AuCoin-Power, Michelle; Urbain, Charline; Smith, Mary Lou; Pang, Elizabeth W; Taylor, Margot J

    2016-07-01

    Theory of Mind (ToM) is the ability to understand the perspectives, mental states and beliefs of others in order to anticipate their behaviour and is therefore crucial to social interactions. Although fMRI has been widely used to establish the neural networks implicated in ToM, little is known about the timing of ToM-related brain activity. We used magnetoencephalography (MEG) to measure the neural processes underlying ToM, as MEG provides very accurate timing and excellent spatial localization of brain processes. We recorded MEG activity during a false belief task, a reliable measure of ToM, in twenty young adults (10 females). MEG data were recorded in a 151 sensor CTF system (MISL, Coquitlam, BC) and data were co-registered to each participant's MRI (Siemens 3T) for source reconstruction. We found stronger right temporoparietal junction (rTPJ) activations in the false belief condition from 150ms to 225ms, in the right precuneus from 275ms to 375ms, in the right inferior frontal gyrus from 200ms to 300ms and the superior frontal gyrus from 300ms to 400ms. Our findings extend the literature by demonstrating the timing and duration of neural activity in the main regions involved in the "mentalizing" network, showing that activations related to false belief in adults are predominantly right lateralized and onset around 100ms. The sensitivity of MEG will allow us to determine spatial and temporal differences in the brain processes in ToM in younger populations or those who demonstrate deficits in this ability. PMID:27039146

  4. Neural Operant Conditioning as a Core Mechanism of Brain-Machine Interface Control

    Yoshio Sakurai

    2016-08-01

    Full Text Available The process of changing the neuronal activity of the brain to acquire rewards in a broad sense is essential for utilizing brain-machine interfaces (BMIs, which is essentially operant conditioning of neuronal activity. Currently, this is also known as neural biofeedback, and it is often referred to as neurofeedback when human brain activity is targeted. In this review, we first illustrate biofeedback and operant conditioning, which are methodological background elements in neural operant conditioning. Then, we introduce research models of neural operant conditioning in animal experiments and demonstrate that it is possible to change the firing frequency and synchronous firing of local neuronal populations in a short time period. We also debate the possibility of the application of neural operant conditioning and its contribution to BMIs.

  5. A biased activation theory of the cognitive and attentional modulation of emotion

    Edmund eRolls

    2013-01-01

    Cognition can influence emotion by biasing neural activity in the first cortical region in which the reward value and subjective pleasantness of stimuli is made explicit in the representation, the orbitofrontal cortex. The same effect occurs in a second cortical tier for emotion, the anterior cingulate cortex. Similar effects are found for selective attention, to for example the pleasantness vs the intensity of stimuli, which modulates representations of reward value and affect in the orbitof...

  6. A biased activation theory of the cognitive and attentional modulation of emotion

    Rolls, Edmund T.

    2013-01-01

    Cognition can influence emotion by biasing neural activity in the first cortical region in which the reward value and subjective pleasantness of stimuli is made explicit in the representation, the orbitofrontal cortex (OFC). The same effect occurs in a second cortical tier for emotion, the anterior cingulate cortex (ACC). Similar effects are found for selective attention, to for example the pleasantness vs. the intensity of stimuli, which modulates representations of reward value and affect i...

  7. Micro-opioid receptor activation in the basolateral amygdala mediates the learning of increases but not decreases in the incentive value of a food reward.

    Wassum, Kate M; Cely, Ingrid C; Balleine, Bernard W; Maidment, Nigel T

    2011-02-01

    The decision to perform, or not perform, actions known to lead to a rewarding outcome is strongly influenced by the current incentive value of the reward. Incentive value is largely determined by the affective experience derived during previous consumption of the reward-the process of incentive learning. We trained rats on a two-lever, seeking-taking chain paradigm for sucrose reward, in which responding on the initial seeking lever of the chain was demonstrably controlled by the incentive value of the reward. We found that infusion of the μ-opioid receptor antagonist, CTOP (d-Phe-Cys-Tyr-d-Trp-Orn-Thr-Pen-Thr-NH(2)), into the basolateral amygdala (BLA) during posttraining, noncontingent consumption of sucrose in a novel elevated-hunger state (a positive incentive learning opportunity) blocked the encoding of incentive value information normally used to increase subsequent sucrose-seeking responses. Similar treatment with δ [N, N-diallyl-Tyr-Aib-Aib-Phe-Leu-OH (ICI 174,864)] or κ [5'-guanidinonaltrindole (GNTI)] antagonists was without effect. Interestingly, none of these drugs affected the ability of the rats to encode a decrease in incentive value resulting from experiencing the sucrose in a novel reduced-hunger state. However, the μ agonist, DAMGO ([d-Ala2, NMe-Phe4, Gly5-ol]-enkephalin), appeared to attenuate this negative incentive learning. These data suggest that upshifts and downshifts in endogenous opioid transmission in the BLA mediate the encoding of positive and negative shifts in incentive value, respectively, through actions at μ-opioid receptors, and provide insight into a mechanism through which opiates may elicit inappropriate desire resulting in their continued intake in the face of diminishing affective experience. PMID:21289167

  8. Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition

    Francisco Javier Ordóñez

    2016-01-01

    Full Text Available Human activity recognition (HAR tasks have traditionally been solved using engineered features obtained by heuristic processes. Current research suggests that deep convolutional neural networks are suited to automate feature extraction from raw sensor inputs. However, human activities are made of complex sequences of motor movements, and capturing this temporal dynamics is fundamental for successful HAR. Based on the recent success of recurrent neural networks for time series domains, we propose a generic deep framework for activity recognition based on convolutional and LSTM recurrent units, which: (i is suitable for multimodal wearable sensors; (ii can perform sensor fusion naturally; (iii does not require expert knowledge in designing features; and (iv explicitly models the temporal dynamics of feature activations. We evaluate our framework on two datasets, one of which has been used in a public activity recognition challenge. Our results show that our framework outperforms competing deep non-recurrent networks on the challenge dataset by 4% on average; outperforming some of the previous reported results by up to 9%. Our results show that the framework can be applied to homogeneous sensor modalities, but can also fuse multimodal sensors to improve performance. We characterise key architectural hyperparameters’ influence on performance to provide insights about their optimisation.

  9. Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition

    Ordóñez, Francisco Javier; Roggen, Daniel

    2016-01-01

    Human activity recognition (HAR) tasks have traditionally been solved using engineered features obtained by heuristic processes. Current research suggests that deep convolutional neural networks are suited to automate feature extraction from raw sensor inputs. However, human activities are made of complex sequences of motor movements, and capturing this temporal dynamics is fundamental for successful HAR. Based on the recent success of recurrent neural networks for time series domains, we propose a generic deep framework for activity recognition based on convolutional and LSTM recurrent units, which: (i) is suitable for multimodal wearable sensors; (ii) can perform sensor fusion naturally; (iii) does not require expert knowledge in designing features; and (iv) explicitly models the temporal dynamics of feature activations. We evaluate our framework on two datasets, one of which has been used in a public activity recognition challenge. Our results show that our framework outperforms competing deep non-recurrent networks on the challenge dataset by 4% on average; outperforming some of the previous reported results by up to 9%. Our results show that the framework can be applied to homogeneous sensor modalities, but can also fuse multimodal sensors to improve performance. We characterise key architectural hyperparameters’ influence on performance to provide insights about their optimisation. PMID:26797612

  10. Social reward shapes attentional biases.

    Anderson, Brian A

    2016-01-01

    Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us. PMID:25941868

  11. Human activities recognition by head movement using partial recurrent neural network

    Tan, Henry C. C.; Jia, Kui; De Silva, Liyanage C.

    2003-06-01

    Traditionally, human activities recognition has been achieved mainly by the statistical pattern recognition methods or the Hidden Markov Model (HMM). In this paper, we propose a novel use of the connectionist approach for the recognition of ten simple human activities: walking, sitting down, getting up, squatting down and standing up, in both lateral and frontal views, in an office environment. By means of tracking the head movement of the subjects over consecutive frames from a database of different color image sequences, and incorporating the Elman model of the partial recurrent neural network (RNN) that learns the sequential patterns of relative change of the head location in the images, the proposed system is able to robustly classify all the ten activities performed by unseen subjects from both sexes, of different race and physique, with a recognition rate as high as 92.5%. This demonstrates the potential of employing partial RNN to recognize complex activities in the increasingly popular human-activities-based applications.

  12. Neural substrates of child irritability in typically developing and psychiatric populations

    Susan B. Perlman

    2015-08-01

    Full Text Available Irritability is an aspect of the negative affectivity domain of temperament, but in severe and dysregulated forms is a symptom of a range of psychopathologies. Better understanding of the neural underpinnings of irritability, outside the context of specific disorders, can help to understand normative variation but also characterize its clinical salience in psychopathology diagnosis. This study assessed brain activation during reward and frustration, domains of behavioral deficits in childhood irritability. Children (age 6–9 presenting in mental health clinics for extreme and impairing irritability (n = 26 were compared to healthy children (n = 28. Using developmentally sensitive methods, neural activation was measured via a negative mood induction paradigm during fMRI scanning. The clinical group displayed more activation of the anterior cingulate and middle frontal gyrus during reward, but less activation during frustration, than healthy comparison children. The opposite pattern was found in the posterior cingulate. Further, in clinical subjects, parent report of irritability was dimensionally related to decreased activation of the anterior cingulate and striatum during frustration. The results of this study indicate neural dysfunction within brain regions related to reward processing, error monitoring, and emotion regulation underlying clinically impairing irritability. Results are discussed in the context of a growing field of neuroimaging research investigating irritable children.

  13. Greater striatal responses to medication in Parkinsons disease are associated with better task-switching but worse reward performance

    Aarts, E.; Nusselein, A.A.; Smittenaar, P.; Helmich, R.C.G.; Bloem, B.R.; Cools, R.

    2014-01-01

    Dopaminergic medication in Parkinsons disease has been proposed to improve cognitive processing by modulating the severely depleted dorsal striatum, while impairing reward processing by modulating the relatively intact ventral striatum. However, there is no direct (neural) evidence for this hypothes

  14. Reward Programs and Tacit Collusion

    Byung-Do Kim; Mengze Shi; Kannan Srinivasan

    2001-01-01

    Reward programs, a promotional tool to develop customer loyalty, offer incentives to consumers on the basis of cumulative purchases of a given product or service from a firm. Reward programs have become increasingly common in many industries. The best-known examples include frequent-flier programs offered by airlines, frequent-guest programs offered by hotels, and frequent-shopper programs offered by supermarkets. Despite the widespread business practice of reward programs, research efforts o...

  15. Mild blast events alter anxiety, memory, and neural activity patterns in the anterior cingulate cortex.

    Xie, Kun; Kuang, Hui; Tsien, Joe Z

    2013-01-01

    There is a general interest in understanding of whether and how exposure to emotionally traumatizing events can alter memory function and anxiety behaviors. Here we have developed a novel laboratory-version of mild blast exposure comprised of high decibel bomb explosion sound coupled with strong air blast to mice. This model allows us to isolate the effects of emotionally fearful components from those of traumatic brain injury or bodily injury typical associated with bomb blasts. We demonstrate that this mild blast exposure is capable of impairing object recognition memory, increasing anxiety in elevated O-maze test, and resulting contextual generalization. Our in vivo neural ensemble recording reveal that such mild blast exposures produced diverse firing changes in the anterior cingulate cortex, a region processing emotional memory and inhibitory control. Moreover, we show that these real-time neural ensemble patterns underwent post-event reverberations, indicating rapid consolidation of those fearful experiences. Identification of blast-induced neural activity changes in the frontal brain may allow us to better understand how mild blast experiences result in abnormal changes in memory functions and excessive fear generalization related to post-traumatic stress disorder. PMID:23741416

  16. Neural activation during processing of aversive faces predicts treatment outcome in alcoholism.

    Charlet, Katrin; Schlagenhauf, Florian; Richter, Anne; Naundorf, Karina; Dornhof, Lina; Weinfurtner, Christopher E J; König, Friederike; Walaszek, Bernadeta; Schubert, Florian; Müller, Christian A; Gutwinski, Stefan; Seissinger, Annette; Schmitz, Lioba; Walter, Henrik; Beck, Anne; Gallinat, Jürgen; Kiefer, Falk; Heinz, Andreas

    2014-05-01

    Neuropsychological studies reported decoding deficits of emotional facial expressions in alcohol-dependent patients, and imaging studies revealed reduced prefrontal and limbic activation during emotional face processing. However, it remains unclear whether this reduced neural activation is mediated by alcohol-associated volume reductions and whether it interacts with treatment outcome. We combined analyses of neural activation during an aversive face-cue-comparison task and local gray matter volumes (GM) using Biological Parametric Mapping in 33 detoxified alcohol-dependent patients and 33 matched healthy controls. Alcoholics displayed reduced activation toward aversive faces-neutral shapes in bilateral fusiform gyrus [FG; Brodmann areas (BA) 18/19], right middle frontal gyrus (BA46/47), right inferior parietal gyrus (BA7) and left cerebellum compared with controls, which were explained by GM differences (except for cerebellum). Enhanced functional activation in patients versus controls was found in left rostral anterior cingulate cortex (ACC) and medial frontal gyrus (BA10/11), even after GM reduction control. Increased ACC activation correlated significantly with less (previous) lifetime alcohol intake [Lifetime Drinking History (LDH)], longer abstinence and less subsequent binge drinking in patients. High LDH appear to impair treatment outcome via its neurotoxicity on ACC integrity. Thus, high activation of the rostral ACC elicited by affective faces appears to be a resilience factor predicting better treatment outcome. Although no group differences were found, increased FG activation correlated with patients' higher LDH. Because high LDH correlated with worse task performance for facial stimuli in patients, elevated activation in the fusiform 'face' area may reflect inefficient compensatory activation. Therapeutic interventions (e.g. emotion evaluation training) may enable patients to cope with social stress and to decrease relapses after detoxification. PMID

  17. Impact of size and delay on neural activity in the rat limbic corticostriatal system

    Matthew R Roesch

    2011-12-01

    Full Text Available A number of factors influence an animal’s economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short-delay and big-reward conditions than under long-delay and small-reward conditions as measured by percent choice, accuracy and reaction time. Since the creation of this task, we have recorded from several different brain areas including, orbitofrontal cortex, striatum, amygdala, substantia nigra pars reticulata, and midbrain dopamine neurons. Here, we review and compare those data with a substantial focus on those areas that have been shown to be critical for performance on classic time discounting procedures and provide a potential mechanism by which they might interact when animals are deciding between differently delayed rewards. We found that most brain areas in the cortico-limbic circuit encode both the magnitude and delay to reward delivery in one form or another, but only a few encode them together at the single neuron level.

  18. Dissociation of primary and secondary reward-relevant limbic nuclei in an animal model of relapse.

    Grimm, J W; See, R E

    2000-05-01

    The neural substrates underlying relapse to drug-seeking behavior after chronic drug abuse may differ from those underlying immediate drug-taking behavior. In a model of relapse to drug-seeking behavior following chronic cocaine self-administration and prolonged extinction, we have previously shown that rats will significantly reinstate lever responding for either primary reward (cocaine) or secondary reward (tone + light stimulus previously paired with cocaine). In the present study, we utilized reversible inactivation of discrete brain nuclei with tetrodotoxin (TTX) in order to examine the neural substrates mediating primary and secondary cocaine reward in rats allowed two weeks of cocaine self-administration. After one week of daily extinction sessions, bilateral inactivation of the basolateral amygdala resulted in significant attenuation of lever pressing for a cocaine-conditioned reward (tone + light). Following three more days of extinction, bilateral TTX inactivation of the basolateral amygdala had no effect on the reinstatement of cocaine self-administration. In contrast, TTX inactivation of the nucleus accumbens produced the exact opposite effects, with significant blockade of primary reward (cocaine alone), but not secondary reward (tone + light). Thus, cocaine-conditioned reward is neuroanatomically dissociated from primary cocaine reward. PMID:10731622

  19. Reward and the serotonergic system.

    Kranz, G S; Kasper, S; Lanzenberger, R

    2010-04-14

    Anhedonia, as a failure to experience rewarding stimuli, is a key characteristic of many psychiatric disorders including depression and schizophrenia. Investigations on the neurobiological correlates of reward and hedonia/anhedonia have been a growing subject of research demonstrating several neuromodulators to mediate different aspects of reward processing. Whereas the majority of research on reward mainly focused on the dopamine and opioid systems, a serotonergic mechanism has been neglected. However, recent promising results strengthen the pivotal role of serotonin in reward processing. Evidence includes electrophysical and pharmacological as well as genetic and imaging studies. Primate research using single-unit recording of neurons within the dorsal raphe nucleus argues for a serotonergic mediation of reward value, whereas studies using intracranial self-stimulation point to an important contribution of serotonin in modulating motivational aspects of rewarding brain stimulation. Pharmacological studies using agonists and antagonists of serotonergic receptor subtypes and approaches investigating an increase or decrease of the extracellular level of serotonin offer strong evidence for a serotonergic mediation, ranging from aversion to pleasure. This review provides an argument for serotonin as a fundamental mediator of emotional, motivational and cognitive aspects of reward representation, which makes it possibly as important as dopamine for reward processing. PMID:20109531

  20. Emergence of spatially heterogeneous burst suppression in a neural field model of electrocortical activity

    Ingo eBojak

    2015-02-01

    Full Text Available Burst suppression in the electroencephalogram (EEG is a well described phenomenon that occurs during deep anaesthesia, as well as in a variety of congenital and acquired brain insults. Classically it is thought of as spatially synchronous, quasi-periodic bursts of high amplitude EEG separated by low amplitude activity. However, its characterisation as a ``global brain state'' has been challenged by recent results obtained with intracranial electrocortigraphy. Not only does it appear that burst suppression activity is highly asynchronous across cortex, but also that it may occur in isolated regions of circumscribed spatial extent. Here we outline a realistic neural field model for burst suppression by adding a slow process of synaptic resource depletion and recovery, which is able to reproduce qualitatively the empirically observed features during general anaesthesia at the whole cortex level. Simulations reveal heterogeneous bursting over the model cortex and complex spatiotemporal dynamics during simulated anaesthetic action, and provide forward predictions of neuroimaging signals for subsequent empirical comparisons and more detailed characterisation.Because burst suppression corresponds to a dynamical end-point of brain activity, theoretically accounting for its spatiotemporal emergence will vitally contribute to efforts aimed at clarifying whether a common physiological trajectory is induced by the actions of general anaesthetic agents. We have taken a first step in this direction by showing that a neural field model can qualitatively match recent experimental data that indicate spatial differentiation of burst suppression activity across cortex.

  1. Right hemisphere neural activations in the recall of waking fantasies and of dreams.

    Benedetti, Francesco; Poletti, Sara; Radaelli, Daniele; Ranieri, Rebecca; Genduso, Valeria; Cavallotti, Simone; Castelnovo, Anna; Smeraldi, Enrico; Scarone, Silvio; D'Agostino, Armando

    2015-10-01

    The story-like organization of dreams is characterized by a pervasive bizarreness of events and actions that resembles psychotic thought, and largely exceeds that observed in normal waking fantasies. Little is known about the neural correlates of the confabulatory narrative construction of dreams. In this study, dreams, fantasies elicited by ambiguous pictorial stimuli, and non-imaginative first- and third-person narratives from healthy participants were recorded, and were then studied for brain blood oxygen level-dependent functional magnetic resonance imaging on a 3.0-Tesla scanner while listening to their own narrative reports and attempting a retrieval of the corresponding experience. In respect to non-bizarre reports of daytime activities, the script-driven recall of dreams and fantasies differentially activated a right hemisphere network including areas in the inferior frontal gyrus, and superior and middle temporal gyrus. Neural responses were significantly greater for fantasies than for dreams in all regions, and inversely proportional to the degree of bizarreness observed in narrative reports. The inferior frontal gyrus, superior and middle temporal gyrus have been implicated in the semantic activation, integration and selection needed to build a coherent story representation and to resolve semantic ambiguities; in deductive and inferential reasoning; in self- and other-perspective taking, theory of mind, moral and autobiographical reasoning. Their degree of activation could parallel the level of logical robustness or inconsistency experienced when integrating information and mental representations in the process of building fantasy and dream narratives. PMID:25871325

  2. Bioimpedance Harmonic Analysis as a Diagnostic Tool to Assess Regional Circulation and Neural Activity

    Mudraya, I. S.; Revenko, S. V.; Khodyreva, L. A.; Markosyan, T. G.; Dudareva, A. A.; Ibragimov, A. R.; Romich, V. V.; Kirpatovsky, V. I.

    2013-04-01

    The novel technique based on harmonic analysis of bioimpedance microvariations with original hard- and software complex incorporating a high-resolution impedance converter was used to assess the neural activity and circulation in human urinary bladder and penis in patients with pelvic pain, erectile dysfunction, and overactive bladder. The therapeutic effects of shock wave therapy and Botulinum toxin detrusor injections were evaluated quantitatively according to the spectral peaks at low 0.1 Hz frequency (M for Mayer wave), respiratory (R) and cardiac (C) rhythms with their harmonics. Enhanced baseline regional neural activity identified according to M and R peaks was found to be presumably sympathetic in pelvic pain patients, and parasympathetic - in patients with overactive bladder. Total pulsatile activity and pulsatile resonances found in the bladder as well as in the penile spectrum characterised regional circulation and vascular tone. The abnormal spectral parameters characteristic of the patients with genitourinary diseases shifted to the norm in the cases of efficient therapy. Bioimpedance harmonic analysis seems to be a potent tool to assess regional peculiarities of circulatory and autonomic nervous activity in the course of patient treatment.

  3. Bioimpedance Harmonic Analysis as a Diagnostic Tool to Assess Regional Circulation and Neural Activity

    The novel technique based on harmonic analysis of bioimpedance microvariations with original hard- and software complex incorporating a high-resolution impedance converter was used to assess the neural activity and circulation in human urinary bladder and penis in patients with pelvic pain, erectile dysfunction, and overactive bladder. The therapeutic effects of shock wave therapy and Botulinum toxin detrusor injections were evaluated quantitatively according to the spectral peaks at low 0.1 Hz frequency (M for Mayer wave), respiratory (R) and cardiac (C) rhythms with their harmonics. Enhanced baseline regional neural activity identified according to M and R peaks was found to be presumably sympathetic in pelvic pain patients, and parasympathetic – in patients with overactive bladder. Total pulsatile activity and pulsatile resonances found in the bladder as well as in the penile spectrum characterised regional circulation and vascular tone. The abnormal spectral parameters characteristic of the patients with genitourinary diseases shifted to the norm in the cases of efficient therapy. Bioimpedance harmonic analysis seems to be a potent tool to assess regional peculiarities of circulatory and autonomic nervous activity in the course of patient treatment.

  4. Analytically tractable studies of traveling waves of activity in integrate-and-fire neural networks

    Zhang, Jie; Osan, Remus

    2016-05-01

    In contrast to other large-scale network models for propagation of electrical activity in neural tissue that have no analytical solutions for their dynamics, we show that for a specific class of integrate and fire neural networks the acceleration depends quadratically on the instantaneous speed of the activity propagation. We use this property to analytically compute the network spike dynamics and to highlight the emergence of a natural time scale for the evolution of the traveling waves. These results allow us to examine other applications of this model such as the effect that a nonconductive gap of tissue has on further activity propagation. Furthermore we show that activity propagation also depends on local conditions for other more general connectivity functions, by converting the evolution equations for network dynamics into a low-dimensional system of ordinary differential equations. This approach greatly enhances our intuition into the mechanisms of the traveling waves evolution and significantly reduces the simulation time for this class of models.

  5. Impaired activity-dependent neural circuit assembly and refinement in autism spectrum disorder genetic models

    Caleb Andrew Doll

    2014-02-01

    Full Text Available Early-use activity during circuit-specific critical periods refines brain circuitry by the coupled processes of eliminating inappropriate synapses and strengthening maintained synapses. We theorize these activity-dependent developmental processes are specifically impaired in autism spectrum disorders (ASDs. ASD genetic models in both mouse and Drosophila have pioneered our insights into normal activity-dependent neural circuit assembly and consolidation, and how these developmental mechanisms go awry in specific genetic conditions. The monogenic Fragile X syndrome (FXS, a common cause of heritable ASD and intellectual disability, has been particularly well linked to defects in activity-dependent critical period processes. The Fragile X Mental Retardation Protein (FMRP is positively activity-regulated in expression and function, in turn regulates excitability and activity in a negative feedback loop, and appears to be required for the activity-dependent remodeling of synaptic connectivity during early-use critical periods. The Drosophila FXS model has been shown to functionally conserve the roles of human FMRP in synaptogenesis, and has been centrally important in generating our current mechanistic understanding of the FXS disease state. Recent advances in Drosophila optogenetics, transgenic calcium reporters, highly-targeted transgenic drivers for individually-identified neurons, and a vastly improved connectome of the brain are now being combined to provide unparalleled opportunities to both manipulate and monitor activity-dependent processes during critical period brain development in defined neural circuits. The field is now poised to exploit this new Drosophila transgenic toolbox for the systematic dissection of activity-dependent mechanisms in normal versus ASD brain development, particularly utilizing the well-established Drosophila FXS disease model.

  6. Nucleus accumbens response to rewards and testosterone levels are related to alcohol use in adolescents and young adults

    Barbara R. Braams; Peper, Jiska S.; Dianne van der Heide; Sabine Peters; Crone, Eveline A.

    2016-01-01

    During adolescence there is a normative increase in risk-taking behavior, which is reflected in, for example, increases in alcohol consumption. Prior research has demonstrated a link between testosterone and alcohol consumption, and between testosterone and neural responses to rewards. Yet, no study to date tested how testosterone levels and neural responses to rewards relate to and predict individual differences in alcohol use. The current study aimed to investigate this by assessing alcohol...

  7. Forecast and restoration of geomagnetic activity indices by using the software-computational neural network complex

    Barkhatov, Nikolay; Revunov, Sergey

    2010-05-01

    It is known that currently used indices of geomagnetic activity to some extent reflect the physical processes occurring in the interaction of the perturbed solar wind with Earth's magnetosphere. Therefore, they are connected to each other and with the parameters of near-Earth space. The establishment of such nonlinear connections is interest. For such purposes when the physical problem is complex or has many parameters the technology of artificial neural networks is applied. Such approach for development of the automated forecast and restoration method of geomagnetic activity indices with the establishment of creative software-computational neural network complex is used. Each neural network experiments were carried out at this complex aims to search for a specific nonlinear relation between the analyzed indices and parameters. At the core of the algorithm work program a complex scheme of the functioning of artificial neural networks (ANN) of different types is contained: back propagation Elman network, feed forward network, fuzzy logic network and Kohonen layer classification network. Tools of the main window of the complex (the application) the settings used by neural networks allow you to change: the number of hidden layers, the number of neurons in the layer, the input and target data, the number of cycles of training. Process and the quality of training the ANN is a dynamic plot of changing training error. Plot of comparison of network response with the test sequence is result of the network training. The last-trained neural network with established nonlinear connection for repeated numerical experiments can be run. At the same time additional training is not executed and the previously trained network as a filter input parameters get through and output parameters with the test event are compared. At statement of the large number of different experiments provided the ability to run the program in a "batch" mode is stipulated. For this purpose the user a

  8. Dopamine signals for reward value and risk: basic and recent data

    Schultz Wolfram

    2010-04-01

    Full Text Available Abstract Background Previous lesion, electrical self-stimulation and drug addiction studies suggest that the midbrain dopamine systems are parts of the reward system of the brain. This review provides an updated overview about the basic signals of dopamine neurons to environmental stimuli. Methods The described experiments used standard behavioral and neurophysiological methods to record the activity of single dopamine neurons in awake monkeys during specific behavioral tasks. Results Dopamine neurons show phasic activations to external stimuli. The signal reflects reward, physical salience, risk and punishment, in descending order of fractions of responding neurons. Expected reward value is a key decision variable for economic choices. The reward response codes reward value, probability and their summed product, expected value. The neurons code reward value as it differs from prediction, thus fulfilling the basic requirement for a bidirectional prediction error teaching signal postulated by learning theory. This response is scaled in units of standard deviation. By contrast, relatively few dopamine neurons show the phasic activation following punishers and conditioned aversive stimuli, suggesting a lack of relationship of the reward response to general attention and arousal. Large proportions of dopamine neurons are also activated by intense, physically salient stimuli. This response is enhanced when the stimuli are novel; it appears to be distinct from the reward value signal. Dopamine neurons show also unspecific activations to non-rewarding stimuli that are possibly due to generalization by similar stimuli and pseudoconditioning by primary rewards. These activations are shorter than reward responses and are often followed by depression of activity. A separate, slower dopamine signal informs about risk, another important decision variable. The prediction error response occurs only with reward; it is scaled by the risk of predicted reward

  9. A Genetic Polymorphism of the Human Dopamine Transporter Determines the Impact of Sleep Deprivation on Brain Responses to Rewards and Punishments.

    Greer, Stephanie M; Goldstein, Andrea N; Knutson, Brian; Walker, Matthew P

    2016-06-01

    Despite an emerging link between alterations in motivated behavior and a lack of sleep, the impact of sleep deprivation on human brain mechanisms of reward and punishment remain largely unknown, as does the role of trait dopamine activity in modulating such effects in the mesolimbic system. Combining fMRI with an established incentive paradigm and individual genotyping, here, we test the hypothesis that trait differences in the human dopamine transporter (DAT) gene-associated with altered synaptic dopamine signalling-govern the impact of sleep deprivation on neural sensitivity to impending monetary gains and losses. Consistent with this framework, markedly different striatal reward responses were observed following sleep loss depending on the DAT functional polymorphisms. Only participants carrying a copy of the nine-repeat DAT allele-linked to higher phasic dopamine activity-expressed amplified striatal response during anticipation of monetary gain following sleep deprivation. Moreover, participants homozygous for the ten-repeat DAT allele-linked to lower phasic dopamine activity-selectively demonstrated an increase in sensitivity to monetary loss within anterior insula following sleep loss. Together, these data reveal a mechanistic dependency on human of trait dopaminergic function in determining the interaction between sleep deprivation and neural processing of rewards and punishments. Such findings have clinical implications in disorders where the DAT genetic polymorphism presents a known risk factor with comorbid sleep disruption, including attention hyperactive deficit disorder and substance abuse. PMID:26918589

  10. Neural correlate of human reciprocity in social interactions

    ShiroSakaiya

    2013-12-01

    Full Text Available Reciprocity plays a key role maintaining cooperation in society. However, little is known about the neural process that underpins human reciprocity during social interactions. Our neuroimaging study manipulated partner identity (computer, human and strategy (random, tit-for-tat in repeated prisoner’s dilemma games and investigated the neural correlate of reciprocal interaction with humans. Reciprocal cooperation with humans but exploitation of computers by defection was associated with activation in the left amygdala. Amygdala activation was also positively and negatively correlated with a preference change for human partners following tit-for-tat and random strategies, respectively. The correlated activation represented the intensity of positive feeling toward reciprocal and negative feeling toward non-reciprocal partners, and so reflected reciprocity in social interaction. Reciprocity in social interaction, however, might plausibly be misinterpreted and so we also examined the neural coding of insight into the reciprocity of partners. Those with and without insight revealed differential brain activation across the reward-related circuitry (i.e., the right middle dorsolateral prefrontal cortex and dorsal caudate and theory of mind (ToM regions (i.e., ventromedial prefrontal cortex [VMPFC] and precuneus. Among differential activations, activation in the precuneus, which accompanied deactivation of the VMPFC, was specific to those without insight into human partners who were engaged in a tit-for-tat strategy. This asymmetric (deactivation might involve specific contributions of ToM regions to the human search for reciprocity. Consequently, the intensity of emotion attached to human reciprocity was represented in the amygdala, whereas insight into the reciprocity of others was reflected in activation across the reward-related and ToM regions. This suggests the critical role of mentalizing, which was not equated with reward expectation during

  11. Cognitive emotion regulation in children: Reappraisal of emotional faces modulates neural source activity in a frontoparietal network

    Ida Wessing

    2015-06-01

    Full Text Available Emotion regulation has an important role in child development and psychopathology. Reappraisal as cognitive regulation technique can be used effectively by children. Moreover, an ERP component known to reflect emotional processing called late positive potential (LPP can be modulated by children using reappraisal and this modulation is also related to children's emotional adjustment. The present study seeks to elucidate the neural generators of such LPP effects. To this end, children aged 8–14 years reappraised emotional faces, while neural activity in an LPP time window was estimated using magnetoencephalography-based source localization. Additionally, neural activity was correlated with two indexes of emotional adjustment and age. Reappraisal reduced activity in the left dorsolateral prefrontal cortex during down-regulation and enhanced activity in the right parietal cortex during up-regulation. Activity in the visual cortex decreased with increasing age, more adaptive emotion regulation and less anxiety. Results demonstrate that reappraisal changed activity within a frontoparietal network in children. Decreasing activity in the visual cortex with increasing age is suggested to reflect neural maturation. A similar decrease with adaptive emotion regulation and less anxiety implies that better emotional adjustment may be associated with an advance in neural maturation.

  12. Sex differences in neural activation to facial expressions denoting contempt and disgust.

    André Aleman

    Full Text Available The facial expression of contempt has been regarded to communicate feelings of moral superiority. Contempt is an emotion that is closely related to disgust, but in contrast to disgust, contempt is inherently interpersonal and hierarchical. The aim of this study was twofold. First, to investigate the hypothesis of preferential amygdala responses to contempt expressions versus disgust. Second, to investigate whether, at a neural level, men would respond stronger to biological signals of interpersonal superiority (e.g., contempt than women. We performed an experiment using functional magnetic resonance imaging (fMRI, in which participants watched facial expressions of contempt and disgust in addition to neutral expressions. The faces were presented as distractors in an oddball task in which participants had to react to one target face. Facial expressions of contempt and disgust activated a network of brain regions, including prefrontal areas (superior, middle and medial prefrontal gyrus, anterior cingulate, insula, amygdala, parietal cortex, fusiform gyrus, occipital cortex, putamen and thalamus. Contemptuous faces did not elicit stronger amygdala activation than did disgusted expressions. To limit the number of statistical comparisons, we confined our analyses of sex differences to the frontal and temporal lobes. Men displayed stronger brain activation than women to facial expressions of contempt in the medial frontal gyrus, inferior frontal gyrus, and superior temporal gyrus. Conversely, women showed stronger neural responses than men to facial expressions of disgust. In addition, the effect of stimulus sex differed for men versus women. Specifically, women showed stronger responses to male contemptuous faces (as compared to female expressions, in the insula and middle frontal gyrus. Contempt has been conceptualized as signaling perceived moral violations of social hierarchy, whereas disgust would signal violations of physical purity. Thus, our

  13. From uncertainty to reward: BOLD characteristics differentiate signaling pathways

    Grön Georg

    2009-12-01

    Full Text Available Abstract Background Reward value and uncertainty are represented by dopamine neurons in monkeys by distinct phasic and tonic firing rates. Knowledge about the underlying differential dopaminergic pathways is crucial for a better understanding of dopamine-related processes. Using functional magnetic resonance blood-oxygen level dependent (BOLD imaging we analyzed brain activation in 15 healthy, male subjects performing a gambling task, upon expectation of potential monetary rewards at different reward values and levels of uncertainty. Results Consistent with previous studies, ventral striatal activation was related to both reward magnitudes and values. Activation in medial and lateral orbitofrontal brain areas was best predicted by reward uncertainty. Moreover, late BOLD responses relative to trial onset were due to expectation of different reward values and likely to represent phasic dopaminergic signaling. Early BOLD responses were due to different levels of reward uncertainty and likely to represent tonic dopaminergic signals. Conclusions We conclude that differential dopaminergic signaling as revealed in animal studies is not only represented locally by involvement of distinct brain regions but also by distinct BOLD signal characteristics.

  14. Stability in Switched Cohen-Grossberg Neural Networks with Mixed Time Delays and Non-Lipschitz Activation Functions

    Qiangqiang Guo; Ning Li; Kewang Wang; Chongyang Wu; Guohua Xu; Huaiqin Wu

    2012-01-01

    The stability for the switched Cohen-Grossberg neural networks with mixed time delays and α-inverse Hölder activation functions is investigated under the switching rule with the average dwell time property. By applying multiple Lyapunov-Krasovskii functional approach and linear matrix inequality (LMI) technique, a delay-dependent sufficient criterion is achieved to ensure such switched neural networks to be globally exponentially stable in terms of LMIs, and the exponential decay estimation i...

  15. Neuroticism and extraversion moderate neural responses and effective connectivity during appetitive conditioning.

    Schweckendiek, Jan; Stark, Rudolf; Klucken, Tim

    2016-08-01

    Classical appetitive conditioning constitutes a basic learning process through which environmental stimuli can be associated with reward. Previous studies showed that individual differences in neuroticism and extraversion influence emotional processing and have been shown to modulate neural activity in subcortical and prefrontal areas in response to emotional stimuli. However, the role of individual differences in appetitive conditioning has so far not been investigated in detail. The aim of this study was to assess the association between neuroticism and extraversion with neural activity and connectivity during appetitive conditioning. The conditioned stimulus (CS) was either a picture of a dish or a cup. One stimulus (CS+) was paired with a monetary reward and the other stimulus (CS-) was associated with its absence while hemodynamic activity was measured by means of functional magnetic resonance imaging. A significant negative correlation of neuroticism scores with amygdala activity was observed during appetitive conditioning. Further, extraversion was positively associated with responses in the hippocampus and the thalamus. In addition, effective connectivity between the amygdala as a seed region and the anterior cingulate cortex, the insula, and the thalamus was negatively correlated with neuroticism scores and positively correlated with extraversion scores. The results may indicate a neural correlate for the deficits in appetitive learning in subjects with high neuroticism scores and point to a facilitating effect of extraversion on reward-related learning. Hum Brain Mapp 37:2992-3002, 2016. © 2016 Wiley Periodicals, Inc. PMID:27132706

  16. Neural activity in the suprachiasmatic circadian clock of nocturnal mice anticipating a daytime meal.

    Dattolo, T; Coomans, C P; van Diepen, H C; Patton, D F; Power, S; Antle, M C; Meijer, J H; Mistlberger, R E

    2016-02-19

    Circadian rhythms in mammals are regulated by a system of circadian oscillators that includes a light-entrainable pacemaker in the suprachiasmatic nucleus (SCN) and food-entrainable oscillators (FEOs) elsewhere in the brain and body. In nocturnal rodents, the SCN promotes sleep in the day and wake at night, while FEOs promote an active state in anticipation of a predictable daily meal. For nocturnal animals to anticipate a daytime meal, wake-promoting signals from FEOs must compete with sleep-promoting signals from the SCN pacemaker. One hypothesis is that FEOs impose a daily rhythm of inhibition on SCN output that is timed to permit the expression of activity prior to a daytime meal. This hypothesis predicts that SCN activity should decrease prior to the onset of anticipatory activity and remain suppressed through the scheduled mealtime. To assess the hypothesis, neural activity in the SCN of mice anticipating a 4-5-h daily meal in the light period was measured using FOS immunohistochemistry and in vivo multiple unit electrophysiology. SCN FOS, quantified by optical density, was significantly reduced at the expected mealtime in food-anticipating mice with access to a running disk, compared to ad libitum-fed and acutely fasted controls. Group differences were not significant when FOS was quantified by other methods, or in mice without running disks. SCN electrical activity was markedly decreased during locomotion in some mice but increased in others. Changes in either direction were concurrent with locomotion, were not specific to food anticipation, and were not sustained during longer pauses. Reduced FOS indicates a net suppression of SCN activity that may depend on the intensity or duration of locomotion. The timing of changes in SCN activity relative to locomotion suggests that any effect of FEOs on SCN output is mediated indirectly, by feedback from neural or systemic correlates of locomotion. PMID:26701294

  17. Intravascular food reward.

    Albino J Oliveira-Maia

    Full Text Available Consumption of calorie-containing sugars elicits appetitive behavioral responses and dopamine release in the ventral striatum, even in the absence of sweet-taste transduction machinery. However, it is unclear if such reward-related postingestive effects reflect preabsorptive or postabsorptive events. In support of the importance of postabsorptive glucose detection, we found that, in rat behavioral tests, high concentration glucose solutions administered in the jugular vein were sufficient to condition a side-bias. Additionally, a lower concentration glucose solution conditioned robust behavioral responses when administered in the hepatic-portal, but not the jugular vein. Furthermore, enteric administration of glucose at a concentration that is sufficient to elicit behavioral conditioning resulted in a glycemic profile similar to that observed after administration of the low concentration glucose solution in the hepatic-portal, but not jugular vein. Finally using fast-scan cyclic voltammetry we found that, in accordance with behavioral findings, a low concentration glucose solution caused an increase in spontaneous dopamine release events in the nucleus accumbens shell when administered in the hepatic-portal, but not the jugular vein. These findings demonstrate that the postabsorptive effects of glucose are sufficient for the postingestive behavioral and dopaminergic reward-related responses that result from sugar consumption. Furthermore, glycemia levels in the hepatic-portal venous system contribute more significantly for this effect than systemic glycemia, arguing for the participation of an intra-abdominal visceral sensor for glucose.

  18. Integration of Optical Manipulation and Electrophysiological Tools to Modulate and Record Activity in Neural Networks

    Difato, F.; Schibalsky, L.; Benfenati, F.; Blau, A.

    2011-07-01

    We present an optical system that combines IR (1064 nm) holographic optical tweezers with a sub-nanosecond-pulsed UV (355 nm) laser microdissector for the optical manipulation of single neurons and entire networks both on transparent and non-transparent substrates in vitro. The phase-modulated laser beam can illuminate the sample concurrently or independently from above or below assuring compatibility with different types of microelectrode array and patch-clamp electrophysiology. By combining electrophysiological and optical tools, neural activity in response to localized stimuli or injury can be studied and quantified at sub-cellular, cellular, and network level.

  19. Shaping prestimulus neural activity with auditory rhythmic stimulation improves the temporal allocation of attention

    Pincham, Hannah L.; Cristoforetti, Giulia; Facoetti, Andrea; Szűcs, Dénes

    2016-01-01

    Human attention fluctuates across time, and even when stimuli have identical physical characteristics and the task demands are the same, relevant information is sometimes consciously perceived and at other times not. A typical example of this phenomenon is the attentional blink, where participants show a robust deficit in reporting the second of two targets (T2) in a rapid serial visual presentation (RSVP) stream. Previous electroencephalographical (EEG) studies showed that neural correlates of correct T2 report are not limited to the RSVP period, but extend before visual stimulation begins. In particular, reduced oscillatory neural activity in the alpha band (8-12 Hz) before the onset of the RSVP has been linked to lower T2 accuracy. We therefore examined whether auditory rhythmic stimuli presented at a rate of 10 Hz (within the alpha band) could increase oscillatory alpha-band activity and improve T2 performance in the attentional blink time window. Behaviourally, the auditory rhythmic stimulation worked to enhance T2 accuracy. This enhanced perception was associated with increases in the posterior T2-evoked N2 component of the event-related potentials and this effect was observed selectively at lag 3. Frontal and posterior oscillatory alpha-band activity was also enhanced during auditory stimulation in the pre-RSVP period and positively correlated with T2 accuracy. These findings suggest that ongoing fluctuations can be shaped by sensorial events to improve the allocation of attention in time. PMID:26986506

  20. Shaping prestimulus neural activity with auditory rhythmic stimulation improves the temporal allocation of attention.

    Ronconi, Luca; Pincham, Hannah L; Cristoforetti, Giulia; Facoetti, Andrea; Szűcs, Dénes

    2016-05-01

    Human attention fluctuates across time, and even when stimuli have identical physical characteristics and the task demands are the same, relevant information is sometimes consciously perceived and at other times not. A typical example of this phenomenon is the attentional blink, where participants show a robust deficit in reporting the second of two targets (T2) in a rapid serial visual presentation (RSVP) stream. Previous electroencephalographical (EEG) studies showed that neural correlates of correct T2 report are not limited to the RSVP period, but extend before visual stimulation begins. In particular, reduced oscillatory neural activity in the alpha band (8-12 Hz) before the onset of the RSVP has been linked to lower T2 accuracy. We therefore examined whether auditory rhythmic stimuli presented at a rate of 10 Hz (within the alpha band) could increase oscillatory alpha-band activity and improve T2 performance in the attentional blink time window. Behaviourally, the auditory rhythmic stimulation worked to enhance T2 accuracy. This enhanced perception was associated with increases in the posterior T2-evoked N2 component of the event-related potentials and this effect was observed selectively at lag 3. Frontal and posterior oscillatory alpha-band activity was also enhanced during auditory stimulation in the pre-RSVP period and positively correlated with T2 accuracy. These findings suggest that ongoing fluctuations can be shaped by sensorial events to improve the allocation of attention in time. PMID:26986506