Relationship between oscillatory neuronal activity during reward processing and trait impulsivity and sensation seeking.

Directory of Open Access Journals (Sweden)

Gregor Leicht

Full Text Available BACKGROUND: The processing of reward and punishment stimuli in humans appears to involve brain oscillatory activity of several frequencies, probably each with a distinct function. The exact nature of associations of these electrophysiological measures with impulsive or risk-seeking personality traits is not completely clear. Thus, the aim of the present study was to investigate event-related oscillatory activity during reward processing across a wide spectrum of frequencies, and its associations with impulsivity and sensation seeking in healthy subjects. METHODS: During recording of a 32-channel EEG 22 healthy volunteers were characterized with the Barratt Impulsiveness and the Sensation Seeking Scale and performed a computerized two-choice gambling task comprising different feedback options with positive vs. negative valence (gain or loss and high or low magnitude (5 vs. 25 points. RESULTS: We observed greater increases of amplitudes of the feedback-related negativity and of activity in the theta, alpha and low-beta frequency range following loss feedback and, in contrast, greater increase of activity in the high-beta frequency range following gain feedback. Significant magnitude effects were observed for theta and delta oscillations, indicating greater amplitudes upon feedback concerning large stakes. The theta amplitude changes during loss were negatively correlated with motor impulsivity scores, whereas alpha and low-beta increase upon loss and high-beta increase upon gain were positively correlated with various dimensions of sensation seeking. CONCLUSIONS: The findings suggest that the processing of feedback information involves several distinct processes, which are subserved by oscillations of different frequencies and are associated with different personality traits.

In vivo imaging identifies temporal signature of D1 and D2 medium spiny neurons in cocaine reward.

Science.gov (United States)

Calipari, Erin S; Bagot, Rosemary C; Purushothaman, Immanuel; Davidson, Thomas J; Yorgason, Jordan T; Peña, Catherine J; Walker, Deena M; Pirpinias, Stephen T; Guise, Kevin G; Ramakrishnan, Charu; Deisseroth, Karl; Nestler, Eric J

2016-03-08

The reinforcing and rewarding properties of cocaine are attributed to its ability to increase dopaminergic transmission in nucleus accumbens (NAc). This action reinforces drug taking and seeking and leads to potent and long-lasting associations between the rewarding effects of the drug and the cues associated with its availability. The inability to extinguish these associations is a key factor contributing to relapse. Dopamine produces these effects by controlling the activity of two subpopulations of NAc medium spiny neurons (MSNs) that are defined by their predominant expression of either dopamine D1 or D2 receptors. Previous work has demonstrated that optogenetically stimulating D1 MSNs promotes reward, whereas stimulating D2 MSNs produces aversion. However, we still lack a clear understanding of how the endogenous activity of these cell types is affected by cocaine and encodes information that drives drug-associated behaviors. Using fiber photometry calcium imaging we define D1 MSNs as the specific population of cells in NAc that encodes information about drug associations and elucidate the temporal profile with which D1 activity is increased to drive drug seeking in response to contextual cues. Chronic cocaine exposure dysregulates these D1 signals to both prevent extinction and facilitate reinstatement of drug seeking to drive relapse. Directly manipulating these D1 signals using designer receptors exclusively activated by designer drugs prevents contextual associations. Together, these data elucidate the responses of D1- and D2-type MSNs in NAc to acute cocaine and during the formation of context-reward associations and define how prior cocaine exposure selectively dysregulates D1 signaling to drive relapse.

A cocaine context renews drug seeking preferentially in a subset of individuals.

Science.gov (United States)

Saunders, Benjamin T; O'Donnell, Elizabeth G; Aurbach, Elyse L; Robinson, Terry E

2014-11-01

Addiction is characterized by a high propensity for relapse, in part because cues associated with drugs can acquire Pavlovian incentive motivational properties, and acting as incentive stimuli, such cues can instigate and invigorate drug-seeking behavior. There is, however, considerable individual variation in the propensity to attribute incentive salience to reward cues. Discrete and localizable reward cues act as much more effective incentive stimuli in some rats ('sign-trackers', STs), than others ('goal-trackers', GTs). We asked whether similar individual variation exists for contextual cues associated with cocaine. Cocaine context conditioned motivation was quantified in two ways: (1) the ability of a cocaine context to evoke conditioned hyperactivity and (2) the ability of a context in which cocaine was previously self-administered to renew cocaine-seeking behavior. Finally, we assessed the effects of intra-accumbens core flupenthixol, a nonselective dopamine receptor antagonist, on context renewal. In contrast to studies using discrete cues, a cocaine context spurred greater conditioned hyperactivity, and more robustly renewed extinguished cocaine seeking in GTs than STs. In addition, cocaine context renewal was blocked by antagonism of dopamine receptors in the accumbens core. Thus, contextual cues associated with cocaine preferentially acquire motivational control over behavior in different individuals than do discrete cues, and in these individuals the ability of a cocaine context to create conditioned motivation for cocaine requires dopamine in the core of the nucleus accumbens. We speculate that different individuals may be preferentially sensitive to different 'triggers' of relapse.

The influence of sensitivity to reward and punishment, propensity for sensation seeking, depression, and anxiety on the risky behaviour of novice drivers: a path model.

Science.gov (United States)

Scott-Parker, Bridie; Watson, Barry; King, Mark J; Hyde, Melissa K

2012-05-01

Young novice drivers are significantly more likely to be killed or injured in car crashes than older, experienced drivers. Graduated driver licensing (GDL), which allows the novice to gain driving experience under less-risky circumstances, has resulted in reduced crash incidence; however, the driver's psychological traits are ignored. This paper explores the relationships between gender, age, anxiety, depression, sensitivity to reward and punishment, sensation-seeking propensity, and risky driving. Participants were 761 young drivers aged 17-24 (M=19.00, SD=1.56) with a Provisional (intermediate) driver's licence who completed an online survey comprising socio-demographic questions, the Impulsive Sensation Seeking Scale, Kessler's Psychological Distress Scale, the Sensitivity to Punishment and Sensitivity to Reward Questionnaire, and the Behaviour of Young Novice Drivers Scale. Path analysis revealed depression, reward sensitivity, and sensation-seeking propensity predicted the self-reported risky behaviour of the young novice drivers. Gender was a moderator; and the anxiety level of female drivers also influenced their risky driving. Interventions do not directly consider the role of rewards and sensation seeking, or the young person's mental health. An approach that does take these variables into account may contribute to improved road safety outcomes for both young and older road users. ©2011 The British Psychological Society.

'In situ' expanded graphite extinguishant

International Nuclear Information System (INIS)

Cao Qixin; Shou Yuemei; He Bangrong

1987-01-01

This report is concerning the development of the extinguishant for sodium fire and the investigation of its extinguishing property. The experiment result shows that 'in situ' expanded graphite developed by the authors is a kind of extinguishant which extinguishes sodium fire quickly and effectively and has no environment pollution during use and the amount of usage is little

Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

Science.gov (United States)

Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

2015-05-01

Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Extinguisher powder for liquid metal fires

Energy Technology Data Exchange (ETDEWEB)

Menzenhauer, P; Ochs, G [Kernforschungszentrum Karlsruhe G.m.b.H. (Germany, F.R.). Inst. fuer Reaktorentwicklung

1978-11-01

The extinguisher introduced here based on graphite exhibited considerably improved extinguishing properties compared to other extinguishing powders. It has no aggressive properties, is, as for as could be tested in the short time available, non-hygroscopic and thus very easy to remove after extinguishing and cooling of the fire. The amount of extinguisher necessary is only a fraction of the amounts needed of other common powders. Storage is no problem and nerely a small storage amount is required. This extinguisher is excellently suitable for fighting sodium surface fires.

Extinguisher powder for liquid metal fires

International Nuclear Information System (INIS)

Menzenhauer, P.; Ochs, G.

1978-01-01

The extinguisher introduced here based on graphite exhibited considerably improved extinguishing properties compared to other extinguishing powders. It has no aggressive properties, is, as for as could be tested in the short time available, non-hygroscopic and thus very easy to remove after extinguishing and cooling of the fire. The amount of extinguisher necessary is only a fraction of the amounts needed of other common powders. Storage is no problem and nerely a small storage amount is required. This extinguisher is excellently suitable for fighting sodium surface fires. (orig./HP) [de

Fun Seeking and Reward Responsiveness Moderate the Effect of the Behavioural Inhibition System on Coping-Motivated Problem Gambling.

Science.gov (United States)

Keough, Matthew T; Wardell, Jeffrey D; Hendershot, Christian S; Bagby, R Michael; Quilty, Lena C

2017-09-01

Gray's Reinforcement Sensitivity Theory (RST) predicts that the Behavioral Inhibition System (BIS) may relate to coping-motivated problem gambling, given its central role in anxiety. Studies examining the BIS-problem gambling association, however, are mixed. The revised RST posits that the Behavioral Approach System (BAS) may moderate the effect of the BIS on coping-motivated problem gambling. A concurrently strong BAS may highlight the negatively reinforcing effects of gambling, which may strengthen coping motives and increase gambling-related harms. We examined these interactive effects to clarify the moderators and mediators of the negative reinforcement pathway to problem gambling. Data came from a larger investigation of problem gambling among individuals with mood disorders. All participants (N = 275) met criteria for a lifetime depressive or bipolar disorder. During a two-day assessment, participants completed a diagnostic assessment and self-reports. Mediated moderation path analysis showed positive indirect effects from the BIS to problem gambling via coping motives at high, but not at low, levels of BAS-Reward Responsiveness and BAS-Fun Seeking. Enhancement motives were also found to mediate the associations of BAS-Fun Seeking and BAS-Drive with problem gambling. Reward Responsiveness and Fun Seeking facets of the BAS may strengthen coping gambling motives within the mood disorders.

Fire extinguishing device for nuclear power plant

International Nuclear Information System (INIS)

Arakawa, Ken

1990-01-01

Fire extinguishing pipelines disposed in turbine buildings of low earthquake proof grade and fire extinguishing pipelines disposed in reactor buildings of high earthquakes proof grade have been used in common with each other. Accordingly, if the fire extinguishing device in the turbine buildings designed for low earthquake proof grade are partially destroyed upon occurrence of medium-scale earthquakes, there is a worry that fire extinguishing water can not be supplied to the inside of the reactor buildings. In view of the above, an emergency fire extinguishing water system using a fire extinguishing reservoir at the outdoor of low earthquake proof grade as a feedwater source and suitable to the low earthquake proof grade is disposed in the turbine buildings. Another emergency fire extinguishing water system using an emergency fire extinguishing water reservoir disposed in the reactor buildings as a feedwater source and suitable to the high earthquake proof grade is disposed in the reactor buildings. Then, ordinary fire extinguishing water system and the emergency fire extinguishing water system are connected to each other. Thus, upon occurrence of earthquakes if the function of the ordinary fire extinguishing water system of low earthquake proof grade is lost, fires breaking out in the reactor buildings can rapidly be extinguished. (N.H.)

Shared Neural Mechanisms for the Evaluation of Intense Sensory Stimulation and Economic Reward, Dependent on Stimulation-Seeking Behavior.

Science.gov (United States)

Norbury, Agnes; Valton, Vincent; Rees, Geraint; Roiser, Jonathan P; Husain, Masud

2016-09-28

Why are some people strongly motivated by intense sensory experiences? Here we investigated how people encode the value of an intense sensory experience compared with economic reward, and how this varies according to stimulation-seeking preference. Specifically, we used a novel behavioral task in combination with computational modeling to derive the value individuals assigned to the opportunity to experience an intense tactile stimulus (mild electric shock). We then examined functional imaging data recorded during task performance to see how the opportunity to experience the sensory stimulus was encoded in stimulation-seekers versus stimulation-avoiders. We found that for individuals who positively sought out this kind of sensory stimulation, there was common encoding of anticipated economic and sensory rewards in the ventromedial prefrontal cortex. Conversely, there was robust encoding of the modeled probability of receiving such stimulation in the insula only in stimulation-avoidant individuals. Finally, we found preliminary evidence that sensory prediction error signals may be positively signed for stimulation-seekers, but negatively signed for stimulation-avoiders, in the posterior cingulate cortex. These findings may help explain why high intensity sensory experiences are appetitive for some individuals, but not for others, and may have relevance for the increased vulnerability for some psychopathologies, but perhaps increased resilience for others, in high sensation-seeking individuals. People vary in their preference for intense sensory experiences. Here, we investigated how different individuals evaluate the prospect of an unusual sensory experience (electric shock), compared with the opportunity to gain a more traditional reward (money). We found that in a subset of individuals who sought out such unusual sensory stimulation, anticipation of the sensory outcome was encoded in the same way as that of monetary gain, in the ventromedial prefrontal cortex

Imbalanced functional link between executive control network and reward network explain the online-game seeking behaviors in Internet gaming disorder.

Science.gov (United States)

Dong, Guangheng; Lin, Xiao; Hu, Yanbo; Xie, Chunming; Du, Xiaoxia

2015-03-17

Literatures have shown that Internet gaming disorder (IGD) subjects show impaired executive control and enhanced reward sensitivities than healthy controls. However, how these two networks jointly affect the valuation process and drive IGD subjects' online-game-seeking behaviors remains unknown. Thirty-five IGD and 36 healthy controls underwent a resting-states scan in the MRI scanner. Functional connectivity (FC) was examined within control and reward network seeds regions, respectively. Nucleus accumbens (NAcc) was selected as the node to find the interactions between these two networks. IGD subjects show decreased FC in the executive control network and increased FC in the reward network when comparing with the healthy controls. When examining the correlations between the NAcc and the executive control/reward networks, the link between the NAcc - executive control network is negatively related with the link between NAcc - reward network. The changes (decrease/increase) in IGD subjects' brain synchrony in control/reward networks suggest the inefficient/overly processing within neural circuitry underlying these processes. The inverse proportion between control network and reward network in IGD suggest that impairments in executive control lead to inefficient inhibition of enhanced cravings to excessive online game playing. This might shed light on the mechanistic understanding of IGD.

46 CFR 169.567 - Portable extinguishers.

Science.gov (United States)

2010-10-01

... COAST GUARD, DEPARTMENT OF HOMELAND SECURITY (CONTINUED) NAUTICAL SCHOOLS SAILING SCHOOL VESSELS... permit the use of any approved fire extinguishers, including semiportable extinguishers, which provide equivalent fire protection. (c) All portable fire extinguishers installed on vessels must be of an approved...

From Affective Experience to Motivated Action: Tracking Reward-Seeking and Punishment-Avoidant Behaviour in Real-Life.

Directory of Open Access Journals (Sweden)

Marieke Wichers

Full Text Available Many of the decisions and actions in everyday life result from implicit learning processes. Important to psychopathology are, for example, implicit reward-seeking and punishment-avoidant learning processes. It is known that when specific actions get associated with a rewarding experience, such as positive emotions, that this will increase the likelihood that an organism will engage in similar actions in the future. Similarly, when actions get associated with punishing experiences, such as negative emotions, this may reduce the likelihood that the organism will engage in similar actions in the future. This study examines whether we can observe these implicit processes prospectively in the flow of daily life. If such processes take place then we expect that current behaviour can be predicted by how similar behaviour was experienced (in terms of positive and negative affect at previous measurement moments. This was examined in a sample of 621 female individuals that had participated in an Experience Sampling data collection. Measures of affect and behaviour were collected at 10 semi-random moments of the day for 5 consecutive days. It was examined whether affective experience that was paired with certain behaviours (physical activity and social context at previous measurements modified the likelihood to show similar behaviours at next measurement moments. Analyses were performed both at the level of observations (a time scale with units of ± 90 min and at day level (a time scale with units of 24 h. As expected, we found that affect indeed moderated the extent to which previous behaviour predicted similar behaviour later in time, at both beep- and day-level. This study showed that it is feasible to track reward-seeking and punishment-avoidant behaviour prospectively in humans in the flow of daily life. This opens up a new toolbox to examine processes determining goal-oriented behaviour in relation to psychopathology in humans.

Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking.

Science.gov (United States)

Stuber, Garret D; Sparta, Dennis R; Stamatakis, Alice M; van Leeuwen, Wieke A; Hardjoprajitno, Juanita E; Cho, Saemi; Tye, Kay M; Kempadoo, Kimberly A; Zhang, Feng; Deisseroth, Karl; Bonci, Antonello

2011-06-29

The basolateral amygdala (BLA) has a crucial role in emotional learning irrespective of valence. The BLA projection to the nucleus accumbens (NAc) is thought to modulate cue-triggered motivated behaviours, but our understanding of the interaction between these two brain regions has been limited by the inability to manipulate neural-circuit elements of this pathway selectively during behaviour. To circumvent this limitation, we used in vivo optogenetic stimulation or inhibition of glutamatergic fibres from the BLA to the NAc, coupled with intracranial pharmacology and ex vivo electrophysiology. Here we show that optical stimulation of the pathway from the BLA to the NAc in mice reinforces behavioural responding to earn additional optical stimulation of these synaptic inputs. Optical stimulation of these glutamatergic fibres required intra-NAc dopamine D1-type receptor signalling, but not D2-type receptor signalling. Brief optical inhibition of fibres from the BLA to the NAc reduced cue-evoked intake of sucrose, demonstrating an important role of this specific pathway in controlling naturally occurring reward-related behaviour. Moreover, although optical stimulation of glutamatergic fibres from the medial prefrontal cortex to the NAc also elicited reliable excitatory synaptic responses, optical self-stimulation behaviour was not observed by activation of this pathway. These data indicate that whereas the BLA is important for processing both positive and negative affect, the glutamatergic pathway from the BLA to the NAc, in conjunction with dopamine signalling in the NAc, promotes motivated behavioural responding. Thus, optogenetic manipulation of anatomically distinct synaptic inputs to the NAc reveals functionally distinct properties of these inputs in controlling reward-seeking behaviours.

Aversive counterconditioning attenuates reward signalling in the ventral striatum

Directory of Open Access Journals (Sweden)

Anne Marije Kaag

2016-08-01

Full Text Available Appetitive conditioning refers to the process of learning cue-reward associations and is mediated by the mesocorticolimbic system. Appetitive conditioned responses are difficult to extinguish, especially for highly salient rewards such as food and drugs. We investigate whether aversive counterconditioning can alter reward reinstatement in the ventral striatum in healthy volunteers using functional Magnetic Resonance Imaging (fMRI. In the initial conditioning phase, two different stimuli were reinforced with a monetary reward. In the subsequent counterconditioning phase, one of these stimuli was paired with an aversive shock to the wrist. In the following extinction phase, none of the stimuli were reinforced. In the final reinstatement phase, reward was reinstated by informing the participants that the monetary gain could be doubled. Our fMRI data revealed that reward signalling in the ventral striatum and ventral tegmental area following reinstatement was smaller for the stimulus that was counterconditioned with an electrical shock, compared to the non-counterconditioned stimulus. A functional connectivity analysis showed that aversive counterconditioning strengthened striatal connectivity with the hippocampus and insula. These results suggest that reward signalling in the ventral striatum can be attenuated through aversive counterconditioning, possibly by concurrent retrieval of the aversive association through enhanced connectivity with hippocampus and insula.

Interaction of reward seeking and self-regulation in the prediction of risk taking: A cross-national test of the dual systems model.

Science.gov (United States)

Duell, Natasha; Steinberg, Laurence; Chein, Jason; Al-Hassan, Suha M; Bacchini, Dario; Lei, Chang; Chaudhary, Nandita; Di Giunta, Laura; Dodge, Kenneth A; Fanti, Kostas A; Lansford, Jennifer E; Malone, Patrick S; Oburu, Paul; Pastorelli, Concetta; Skinner, Ann T; Sorbring, Emma; Tapanya, Sombat; Uribe Tirado, Liliana Maria; Alampay, Liane Peña

2016-10-01

In the present analysis, we test the dual systems model of adolescent risk taking in a cross-national sample of over 5,200 individuals aged 10 through 30 (M = 17.05 years, SD = 5.91) from 11 countries. We examine whether reward seeking and self-regulation make independent, additive, or interactive contributions to risk taking, and ask whether these relations differ as a function of age and culture. To compare across cultures, we conduct 2 sets of analyses: 1 comparing individuals from Asian and Western countries, and 1 comparing individuals from low- and high-GDP countries. Results indicate that reward seeking and self-regulation have largely independent associations with risk taking and that the influences of each variable on risk taking are not unique to adolescence, but that their link to risk taking varies across cultures. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

14 CFR 29.1199 - Extinguishing agent containers.

Science.gov (United States)

2010-01-01

... 14 Aeronautics and Space 1 2010-01-01 2010-01-01 false Extinguishing agent containers. 29.1199....1199 Extinguishing agent containers. (a) Each extinguishing agent container must have a pressure relief to prevent bursting of the container by excessive internal pressures. (b) The discharge end of each...

14 CFR 25.1199 - Extinguishing agent containers.

Science.gov (United States)

2010-01-01

... 14 Aeronautics and Space 1 2010-01-01 2010-01-01 false Extinguishing agent containers. 25.1199....1199 Extinguishing agent containers. (a) Each extinguishing agent container must have a pressure relief to prevent bursting of the container by excessive internal pressures. (b) The discharge end of each...

14 CFR 23.1199 - Extinguishing agent containers.

Science.gov (United States)

2010-01-01

... 14 Aeronautics and Space 1 2010-01-01 2010-01-01 false Extinguishing agent containers. 23.1199... Powerplant Fire Protection § 23.1199 Extinguishing agent containers. For commuter category airplanes, the following applies: (a) Each extinguishing agent container must have a pressure relief to prevent bursting of...

Influences of social reward experience on behavioral responses to drugs of abuse: Review of shared and divergent neural plasticity mechanisms for sexual reward and drugs of abuse.

Science.gov (United States)

Beloate, Lauren N; Coolen, Lique M

2017-12-01

Different factors influence the development of drug addiction in humans, including social reward experiences. In animals, experience with social rewards, such as sexual behavior, pair bonding, social and environmental enrichment, can be protective. However, loss or lack of social rewards can lead to a vulnerability to drug-seeking behavior. The effects of social reward experience on drug-seeking behavior are associated with changes in the neural pathways that control drug-related behavior. This review will provide an introduction and overview of the mesolimbic pathway and the influence of social reward experience on drug-seeking behavior in rodents. Moreover, the research from our laboratory on effects of sexual experience and loss of sex reward on psychostimulant and opiate reward will be reviewed. Finally, we will review current knowledge of the neural mechanisms that underlie these interactions. Investigations of the neural underpinnings by which social and drug rewards interact contribute to improved understanding of the neural basis of vulnerability for drug addiction and reward-related behaviors in general. Copyright © 2017 Elsevier Ltd. All rights reserved.

Neurological Correlates of Reward Responding in Adolescents With and Without Externalizing Behavior Disorders

Science.gov (United States)

Gatzke-Kopp, Lisa M.; Beauchaine, Theodore P.; Shannon, Katherine E.; Chipman, Jane; Fleming, Andrew P.; Crowell, Sheila E.; Liang, Olivia; Aylward, Elizabeth; Johnson, L. Clark

2009-01-01

Opposing theories of striatal hyper- and hypodopaminergic functioning have been suggested in the pathophysiology of externalizing behavior disorders. To test these competing theories, the authors used functional MRI to evaluate neural activity during a simple reward task in 12- to 16-year-old boys with attention-deficit/hyperactivity disorder and/or conduct disorder (n = 19) and in controls with no psychiatric condition (n = 11). The task proceeded in blocks during which participants received either (a) monetary incentives for correct responses or (b) no rewards for correct responses. Controls exhibited striatal activation only during reward, shifting to anterior cingulate activation during nonreward. In contrast, externalizing adolescents exhibited striatal activation during both reward and nonreward. Externalizing psychopathology appears to be characterized by deficits in processing the omission of predicted reward, which may render behaviors that are acquired through environmental contingencies difficult to extinguish when those contingencies change. PMID:19222326

INCREASING EXTINGUISHING EFFECT OF WATER MIST BY ELEKTRIFICATION

Directory of Open Access Journals (Sweden)

Otto Dvořák

2017-04-01

Full Text Available This paper describes extinguishing experiments to verify the possibility of increasing the fire-extinguishing efficiency of low-, medium- and high-pressure water mist by its charging by the electric field of high DC voltage. The experimental results confirmed the effects of the electrical voltage, the configuration of electrodes (anode, cathode, the volumetric water flow rate, water pressure and the type of mist nozzle. Higher fire-extinguishing effect of electrically-charged water mist was shown by a shorter extinguishing time, a smaller volume of water to extinguish the fire and a higher percentage of successful extinguishing attempts. Benefit: faster and more efficient fire-fighting with a smaller risk of injury of persons and smaller subsequent damage in the protected space.

30 CFR 36.31 - Fire extinguisher.

Science.gov (United States)

2010-07-01

... Construction and Design Requirements § 36.31 Fire extinguisher. Each unit of mobile diesel-powered... an active charge of not less than 4 pounds. Pressurized dry chemical extinguishers shall contain an...

Graphite-based extinguishants for liquid metal fires

International Nuclear Information System (INIS)

Simpson, J.M.; Gardener, N.J.L.

1987-01-01

Effective extinguishants for liquid alkali metal fires must be provided for all LMFBRs. Traditional sodium salt based extinguishants have disadvantages. An intercalation compound of graphite was identified as a possible alternative. Following successful tests on fires of up to 25 m 2 area the graphite based extinguishant has been introduced by the UKAEA at Dounreay. (author)

29 CFR 1910.161 - Fixed extinguishing systems, dry chemical.

Science.gov (United States)

2010-07-01

... 29 Labor 5 2010-07-01 2010-07-01 false Fixed extinguishing systems, dry chemical. 1910.161 Section... § 1910.161 Fixed extinguishing systems, dry chemical. (a) Scope and application. This section applies to all fixed extinguishing systems, using dry chemical as the extinguishing agent, installed to meet a...

Rapamycin prevents drug seeking via disrupting reconsolidation of reward memory in rats.

Science.gov (United States)

Lin, Jue; Liu, Lingqi; Wen, Quan; Zheng, Chunming; Gao, Yang; Peng, Shuxian; Tan, Yalun; Li, Yanqin

2014-01-01

The maladaptive drug memory developed between the drug-rewarding effect and environmental cues contributes to difficulty in preventing drug relapse. Established reward memories can be disrupted by pharmacologic interventions following their reactivation. Rapamycin, an inhibitor of mammalian target of rapamycin (mTOR) kinase, has been proved to be involved in various memory consolidation. However, it is less well characterized in drug memory reconsolidation. Using a conditioned place preference (CPP) procedure, we examined the effects of systemically administered rapamycin on reconsolidation of drug memory in rats. We found that systemically administered rapamycin (0.1 or 10 mg/kg, i.p.) after re-exposure to drug-paired environment, dose dependently decreased the expression of CPP 1 d later, and the effect lasted for up to 14 d and could not be reversed by a priming injection of morphine. The effect of rapamycin on morphine-associated memory was specific to drug-paired context, and rapamycin had no effect on subsequent CPP expression when rats were exposed to saline-paired context or homecage. These results indicated that systemic administration of rapamycin after memory reactivation can persistently inhibit the drug seeking behaviour via disruption of morphine memory reconsolidation in rats. Additionally, the effect of rapamycin on memory reconsolidation was reproduced in cocaine CPP and alcohol CPP. Furthermore, rapamycin did not induce conditioned place aversion and had no effect on locomotor activity and anxiety behaviour. These findings suggest that rapamycin could erase the acquired drug CPP in rats, and that mTOR activity plays an important role in drug reconsolidation and is required for drug relapse.

New Agents for the Extinguishment of Magnesium Fires.

Science.gov (United States)

1978-04-01

34 23 July 1942. German Patent 724,795. 8. Beythien, R., Wienhaus, H., and von Zehman, H., "Extinguish- ing Magnesium and Other Light Metal Fires ," 12...34Trimethoxyboroxine--An Extinguishing Agent for Metal Fires ," ACS Advances in Chemistry, No. 23, American Chemical Society, Washington, D.C. pp 158...13. Miyashima, Z., "Fire Extinguishing Agent," 7 October 1958. Japanese Patent 8,946. 14. Jenkner, H., "Extinguishing Metal Fires ," 12 September

Introduction: Addiction and Brain Reward and Anti-Reward Pathways

Science.gov (United States)

Gardner, Eliot L.

2013-01-01

Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly) and that they enhance the functioning of the reward circuitry of the brain (producing the “high” that the drug-user seeks). The core reward circuitry consists of an “in series” circuit linking the ventral tegmental area, nucleus accumbens, and ventral pallidum - via the medial forebrain bundle. Although originally believed to encode simply the set-point of hedonic tone, these circuits are now believed to be functionally far more complex - also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. “Hedonic dysregulation” within these circuits may lead to addiction. The “second-stage” dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dopaminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g., opiates), tolerance to the euphoric effects develops with chronic use. Post-use dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get “high,” but simply to get back to normal (“get straight”). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically, and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the �

The effects of the novel DA D3 receptor antagonist SR 21502 on cocaine reward, cocaine seeking and cocaine-induced locomotor activity in rats.

Science.gov (United States)

Galaj, E; Ananthan, S; Saliba, M; Ranaldi, Robert

2014-02-01

There is a focus on developing D3 receptor antagonists as cocaine addiction treatments. We investigated the effects of a novel selective D3 receptor antagonist, SR 21502, on cocaine reward, cocaine-seeking, food reward, spontaneous locomotor activity and cocaine-induced locomotor activity in rats. In Experiment 1, rats were trained to self-administer cocaine under a progressive ratio (PR) schedule of reinforcement and tested with vehicle or one of three doses of SR 21502. In Experiment 2, animals were trained to self-administer cocaine under a fixed ratio schedule of reinforcement followed by extinction of the response. Then, animals were tested with vehicle or one of the SR 21502 doses on cue-induced reinstatement of responding. In Experiment 3, animals were trained to lever press for food under a PR schedule and tested with vehicle or one dose of the compound. In Experiments 4 and 5, in separate groups of animals, the vehicle and three doses of SR 21502 were tested on spontaneous or cocaine (10 mg/kg, IP)-induced locomotor activity, respectively. SR 21502 produced significant, dose-related (3.75, 7.5 and 15 mg/kg) reductions in breakpoint for cocaine self-administration, cue-induced reinstatement (3.75, 7.5 and 15 mg/kg) and cocaine-induced locomotor activity (3.75, 7.5 and 15 mg/kg) but failed to reduce food self-administration and spontaneous locomotor activity. SR 21502 decreases cocaine reward, cocaine-seeking and locomotor activity at doses that have no effect on food reward or spontaneous locomotor activity. These data suggest SR 21502 may selectively inhibit cocaine's rewarding, incentive motivational and stimulant effects.

Hypocretin-1 receptors regulate the reinforcing and reward-enhancing effects of cocaine: Pharmacological and behavioral genetics evidence

Directory of Open Access Journals (Sweden)

Jonathan eHollander

2012-07-01

Full Text Available Considerable evidence suggests that transmission at hypocretin-1 (orexin-1 receptors (Hcrt-R1 plays an important role in the reinstatement of extinguished cocaine-seeking behaviors in rodents. However, far less is known about the role for hypocretin transmission in regulating ongoing cocaine-taking behavior. Here, we investigated the effects of the selective Hcrt-R1 antagonist SB-334867 on cocaine intake, as measured by intravenous (IV cocaine self-administration in rats. The stimulatory effects of cocaine on brain reward systems contribute to the establishment and maintenance of cocaine-taking behaviors. Therefore, we also assessed the effects of SB-334867 on the reward-enhancing properties of cocaine, as measured by cocaine-induced lowering of intracranial self-stimulation (ICSS thresholds. Finally, to definitively establish a role for Hcrt-R1 in regulating cocaine intake, we assessed IV cocaine self-administration in Hcrt-R1 knockout mice. We found that SB-334867 (1-4 mg/kg dose-dependently decreased cocaine (0.5 mg/kg/infusion self-administration in rats but did not alter responding for food rewards under the same schedule of reinforcement. This suggests that SB-334867 decreased cocaine reinforcement without negatively impacting operant performance. SB-334867 (1-4 mg/kg also dose-dependently attenuated the stimulatory effects of cocaine (10 mg/kg on brain reward systems, as measured by reversal of cocaine-induced lowering of ICSS thresholds in rats. Finally, we found that Hcrt-R1 knockout mice self-administered far less cocaine than wildtype mice across the entire dose-response function. These data demonstrate that Hcrt-R1 play an important role in regulating the reinforcing and reward-enhancing properties of cocaine, and suggest that hypocretin transmission is likely essential for establishing and maintaining the cocaine habit in human addicts.

Validation and extension of the reward-mountain model.

Science.gov (United States)

Breton, Yannick-André; Mullett, Ada; Conover, Kent; Shizgal, Peter

2013-01-01

The reward-mountain model relates the vigor of reward seeking to the strength and cost of reward. Application of this model provides information about the stage of processing at which manipulations such as drug administration, lesions, deprivation states, and optogenetic interventions act to alter reward seeking. The model has been updated by incorporation of new information about frequency following in the directly stimulated neurons responsible for brain stimulation reward and about the function that maps objective opportunity costs into subjective ones. The behavioral methods for applying the model have been updated and improved as well. To assess the impact of these changes, two related predictions of the model that were supported by earlier work have been retested: (1) altering the duration of rewarding brain stimulation should change the pulse frequency required to produce a reward of half-maximal intensity, and (2) this manipulation should not change the opportunity cost at which half-maximal performance is directed at earning a maximally intense reward. Prediction 1 was supported in all six subjects, but prediction 2 was supported in only three. The latter finding is interpreted to reflect recruitment, at some stimulation sites, of a heterogeneous reward substrate comprising dual, parallel circuits that integrate the stimulation-induced neural signals.

Interaction of Reward Seeking and Self-Regulation in the Prediction of Risk Taking: A Cross-National Test of the Dual Systems Model

Science.gov (United States)

Duell, Natasha; Steinberg, Laurence; Chein, Jason; Al-Hassan, Suha M.; Bacchini, Dario; Lei, Chang; Chaudhary, Nandita; Di Giunta, Laura; Dodge, Kenneth A.; Fanti, Kostas A.; Lansford, Jennifer E.; Malone, Patrick S.; Oburu, Paul; Pastorelli, Concetta; Skinner, Ann T.; Sorbring, Emma; Tapanya, Sombat; Uribe Tirado, Liliana Maria; Alampay, Liane Peña

2016-01-01

In the present analysis, we test the dual systems model of adolescent risk taking in a cross-national sample of over 5,200 individuals aged 10 through 30 (M = 17.05 years, SD = 5.91) from 11 countries. We examine whether reward seeking and self-regulation make independent, additive, or interactive contributions to risk taking, and ask whether…

Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

Science.gov (United States)

Morie, K P; De Sanctis, P; Foxe, J J

2014-07-25

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but

Process and device for extinguishing fires inside gloveboxes

Energy Technology Data Exchange (ETDEWEB)

Lopez, P

1975-01-09

The present invention relates to a process of extinguishing all types of fire inside gloveboxes. Said process prevents the inner part of the box to communicate with the room atmosphere: the glove that is the nearest to the hearth of fire is perforated with an edged tip mounted on the outlet of the extinguisher and the product contained inside said extinguisher is released until the fire extinction is achieved. A device for operating said process consists in an edged tubular tip, the end of which is bevelled and in means of dispersion and of connection to an extinguisher at the other end.

Antagonism of GABA-B but not GABA-A receptors in the VTA prevents stress- and intra-VTA CRF-induced reinstatement of extinguished cocaine seeking in rats.

Science.gov (United States)

Blacktop, Jordan M; Vranjkovic, Oliver; Mayer, Matthieu; Van Hoof, Matthew; Baker, David A; Mantsch, John R

2016-03-01

Stress-induced reinstatement of cocaine seeking requires corticotropin releasing factor (CRF) actions in the ventral tegmental area (VTA). However the mechanisms through which CRF regulates VTA function to promote cocaine use are not fully understood. Here we examined the role of GABAergic neurotransmission in the VTA mediated by GABA-A or GABA-B receptors in the reinstatement of extinguished cocaine seeking by a stressor, uncontrollable intermittent footshock, or bilateral intra-VTA administration of CRF. Rats underwent repeated daily cocaine self-administration (1.0 mg/kg/ing; 14 × 6 h/day) and extinction and were tested for reinstatement in response to footshock (0.5 mA, 0.5" duration, average every 40 s; range 10-70 s) or intra-VTA CRF delivery (500 ng/side) following intra-VTA pretreatment with the GABA-A antagonist, bicuculline, the GABA-B antagonist, 2-hydroxysaclofen or vehicle. Intra-VTA bicuculline (1, 10 or 20 ng/side) failed to block footshock- or CRF-induced cocaine seeking at either dose tested. By contrast, 2-hydroxysaclofen (0.2 or 2 μg/side) prevented reinstatement by both footshock and intra-VTA CRF at a concentration that failed to attenuate food-reinforced lever pressing (45 mg sucrose-sweetened pellets; FR4 schedule) in a separate group of rats. These data suggest that GABA-B receptor-dependent CRF actions in the VTA mediate stress-induced cocaine seeking and that GABA-B receptor antagonists may have utility for the management of stress-induced relapse in cocaine addicts. Copyright © 2015 Elsevier Ltd. All rights reserved.

Context-driven Salt Seeking Test (Rats)

Science.gov (United States)

Chang, Stephen E.; Smith, Kyle S.

2018-01-01

Changes in reward seeking behavior often occur through incremental learning based on the difference between what is expected and what actually happens. Behavioral flexibility of this sort requires experience with rewards as better or worse than expected. However, there are some instances in which behavior can change through non-incremental learning, which requires no further experience with an outcome. Such an example of non-incremental learning is the salt appetite phenomenon. In this case, animals such as rats will immediately seek out a highly-concentrated salt solution that was previously undesired when they are put in a novel state of sodium deprivation. Importantly, this adaptive salt-seeking behavior occurs despite the fact that the rats never tasted salt in the depleted state, and therefore never tasted it as a highly desirable reward. The following protocol is a method to investigate the neural circuitry mediating adaptive salt seeking using a conditioned place preference (CPP) procedure. The procedure is designed to provide an opportunity to discover possible dissociations between the neural circuitry mediating salt seeking and salt consumption to replenish the bodily deficit after sodium depletion. Additionally, this procedure is amenable to incorporating a number of neurobiological techniques for studying the brain basis of this behavior.

Fire extinguishing system in large underground garages

Directory of Open Access Journals (Sweden)

Ivan Antonov

2017-04-01

Full Text Available In the work is considered an acceptable constructive scheme from a practical point of view at fire extinguishing in underground garages. The garage space is divided into quadrants which covering, for example, 2 cars. In case of ignition on one of them, a sprinkler nozzle system is triggered by the effect of the vertical convective jet. A protective curtain preventing the spread of fire to adjacent vehicles is realized. The solution is based on an integrated method which allows the calculation from hydrodynamic point of view on extinguishing time of the fire extinguishing system.

Introduction of Sodium Fire Extinguishing System for STELLA-1

Energy Technology Data Exchange (ETDEWEB)

Gam, Dayoung; Kim, Jong-Man; Jung, Min-Hwan; Eoh, Jae-Hyuk; Jeong, Eoh Jiyoung [Korea Atomic Energy Research Institute, Daejeon (Korea, Republic of)

2015-05-15

This characteristic is a big advantage as a thermal transfer fluid. However, the high reactivity of sodium, especially with water and oxygen, and white aerosol in the event of fire can cause serious accidents. Thus, large sodium facility needs a specific-developed fire extinguishing system for a safe experiment. Korea Atomic Energy Research Institute (KAERI) has conducted sodium heat transfer experiments using the facility named the Sodium Integral Effect Test Loop for Safety Simulation and Assessment (STELLA-1). STELLA-1 fully equipped a sodium fire extinguishing system for the safe experiment and fire spread prevention. In this paper, a preparation of the fire extinguishing system of STELLA-1 facility is introduced. This paper can provide an example of how to design a sodium fire extinguishing system for a large sodium experiment facility. In this paper, a preparation of the fire extinguishment system for STELLA-1 as a large sodium experiment facility was introduced and explained. For safe operation of the liquid sodium utility, it is important to equip specific-developed fire extinguishing system because of the chemical characteristics of sodium. Operators should know the process and operating manual before conducting an experiment to prevent hazardous situation. Though the dry chemical extinguishing agent put out the fire target, removing agent at high temperature state can cause re-combustion. Thus, extinguishment confirmation work should be conducted after sufficient cooling time to stabilize the surface. And in case of fire at a sealed room, a method making the percentage of oxygen low(injecting nitrogen gas or argon gas) is effective.

Introduction of Sodium Fire Extinguishing System for STELLA-1

International Nuclear Information System (INIS)

Gam, Dayoung; Kim, Jong-Man; Jung, Min-Hwan; Eoh, Jae-Hyuk; Jeong, Eoh Jiyoung

2015-01-01

This characteristic is a big advantage as a thermal transfer fluid. However, the high reactivity of sodium, especially with water and oxygen, and white aerosol in the event of fire can cause serious accidents. Thus, large sodium facility needs a specific-developed fire extinguishing system for a safe experiment. Korea Atomic Energy Research Institute (KAERI) has conducted sodium heat transfer experiments using the facility named the Sodium Integral Effect Test Loop for Safety Simulation and Assessment (STELLA-1). STELLA-1 fully equipped a sodium fire extinguishing system for the safe experiment and fire spread prevention. In this paper, a preparation of the fire extinguishing system of STELLA-1 facility is introduced. This paper can provide an example of how to design a sodium fire extinguishing system for a large sodium experiment facility. In this paper, a preparation of the fire extinguishment system for STELLA-1 as a large sodium experiment facility was introduced and explained. For safe operation of the liquid sodium utility, it is important to equip specific-developed fire extinguishing system because of the chemical characteristics of sodium. Operators should know the process and operating manual before conducting an experiment to prevent hazardous situation. Though the dry chemical extinguishing agent put out the fire target, removing agent at high temperature state can cause re-combustion. Thus, extinguishment confirmation work should be conducted after sufficient cooling time to stabilize the surface. And in case of fire at a sealed room, a method making the percentage of oxygen low(injecting nitrogen gas or argon gas) is effective

MDMA reinstates cocaine-seeking behaviour in mice.

Science.gov (United States)

Trigo, José Manuel; Orejarena, Maria Juliana; Maldonado, Rafael; Robledo, Patricia

2009-06-01

MDMA effects are mediated by monoaminergic systems, which seem to play a central role in cocaine craving and relapse. CD1 mice trained to self-administer cocaine (1 mg/kg/infusion) underwent an extinction procedure in which the cues contingent with drug self-administration remained present. Mice achieving extinction were injected with MDMA (10 mg/kg), d-amphetamine (1 and 2 mg/kg) or saline and tested for reinstatement. Acute MDMA, but not d-amphetamine or saline reinstated cocaine-seeking behaviour in mice in which cocaine self-administration and contingent cues were previously extinguished. Acute MDMA can reinstate cocaine-seeking behaviour in mice.

Optimization of extinguishing agents for nuclear power plants

International Nuclear Information System (INIS)

Boleman, M.; Lipar, M.; Balog, K.

1998-01-01

Focus is placed on use of extinguishing agents in nuclear power plants. The advantages and disadvantages of these agents are compared. Further perspectives for using particular extinguishing agents in nuclear power plants are outlined. (author)

Effects of vivo morpholino knockdown of lateral hypothalamus orexin/hypocretin on renewal of alcohol seeking.

Science.gov (United States)

Prasad, Asheeta A; McNally, Gavan P

2014-01-01

Two experiments used vivo morpholinos to assess the role of orexin/hypocretin in ABA renewal of extinguished alcohol seeking. Rats were trained to respond for alcoholic beer in a distinctive context, A, and then extinguished in a second distinctive context, B. When rats were tested in the extinction context, ABB, responding was low but when they were tested in the training context, ABA, responding was significantly higher. Microinjection of an orexin/hypocretin antisense vivo morpholino into LH significantly reduced orexin/hypocretin protein expression but had no effect on the ABA renewal of alcohol seeking (Experiment 1). Microinjection of a higher dose of the antisense vivo morpholino into LH also significantly reduced orexin/hypocretin protein expression but this was not selective and yielded significant reduction in melanin-concentrating hormone (MCH) protein expression. This non-selective knockdown did significantly reduce ABA renewal as well as reduce the reacquisition of alcohol seeking. Taken together, these findings show an important role for LH in the ABA renewal of alcohol seeking but that orexin/hypocretin is not necessary for this renewal.

Effects of vivo morpholino knockdown of lateral hypothalamus orexin/hypocretin on renewal of alcohol seeking.

Directory of Open Access Journals (Sweden)

Asheeta A Prasad

Full Text Available Two experiments used vivo morpholinos to assess the role of orexin/hypocretin in ABA renewal of extinguished alcohol seeking. Rats were trained to respond for alcoholic beer in a distinctive context, A, and then extinguished in a second distinctive context, B. When rats were tested in the extinction context, ABB, responding was low but when they were tested in the training context, ABA, responding was significantly higher. Microinjection of an orexin/hypocretin antisense vivo morpholino into LH significantly reduced orexin/hypocretin protein expression but had no effect on the ABA renewal of alcohol seeking (Experiment 1. Microinjection of a higher dose of the antisense vivo morpholino into LH also significantly reduced orexin/hypocretin protein expression but this was not selective and yielded significant reduction in melanin-concentrating hormone (MCH protein expression. This non-selective knockdown did significantly reduce ABA renewal as well as reduce the reacquisition of alcohol seeking. Taken together, these findings show an important role for LH in the ABA renewal of alcohol seeking but that orexin/hypocretin is not necessary for this renewal.

Acute alcohol impairs conditioning of a behavioural reward-seeking response and inhibitory control processes--implications for addictive disorders.

Science.gov (United States)

Loeber, Sabine; Duka, Theodora

2009-12-01

To investigate whether acute alcohol would affect performance of a conditioned behavioural response to obtain a reward outcome and impair performance in a task measuring inhibitory control to provide new knowledge of how the acute effects of alcohol might contribute to the transition from alcohol use to dependence. A randomized controlled between-subjects design was employed. The laboratory of experimental psychology at the University of Sussex. Thirty-two light to moderate social drinkers recruited from the undergraduate and postgraduate population. After the administration of alcohol (0.8 g/kg) or placebo participants underwent an instrumental reward-seeking procedure, with abstract stimuli serving as S+ (always predicting a win of 10 pence) and S- (always predicting a loss of 10 pence). In addition, a Stop Signal task was administered before and after the administration of alcohol. Participants of the alcohol group performed the behavioural response to obtain the reward outcome more often than placebo subjects in trials associated with loss of money. This finding was observed, although alcohol was not affecting explicit knowledge of stimulus-response outcome contingencies and acquisition of conditioned attentional and emotional responses. In addition, alcohol increased Stop Signal reaction time indicating disinhibiting effects of alcohol, and this was associated positively with response probability to the S-. These results demonstrate that alcohol is affecting inhibitory control of behavioural responses to external signals even when associated with punishment, contributing in this way to the transition from alcohol use to dependence.

Lab Fire Extinguishers: Here Today, Gone Tomorrow?

Science.gov (United States)

Roy, Ken

2010-01-01

When renovations or new construction occur, fire extinguishers sometimes get lost in the mix. Unfortunately, whether to save money or because the fire code is misinterpreted, some schools do not install fire extinguishers in laboratories and other areas of the building. Let's set the record straight! If flammables are present, the fire code…

Fire extinguishing of electrical equipment under voltage at nuclear power plants

International Nuclear Information System (INIS)

Capek, Josef

2009-01-01

Fire extinguishing on equipment that is under voltage is always hazardous. Conventional fire fighting equipment applicable to this task includes powder and gas extinguishers, which, however, have some drawbacks. Therefore, attention has been increasingly devoted to high-pressure fire extinguishing, whose assets include better heat removal as compared to a full water flow where the majority of the water runs off without any cooling effect. This article describes the testing of some types and combinations of extinguishing techniques and their interpretation based on earth-leakage current measurement and determination of a safe distance for fire extinguishing. Methodology described in CSN IEC 60-1:1994 and CSN EN 3-7:2004 was applied. To meet the criterion, none of the tests was to exhibit an earth-leakage current higher than 0.5 mA. In the accredited laboratory test room setup, 3 extinguishing equipment arrangements proved to extinguish fire on electrical equipment under voltage at a safe distance of 1 m (or 3 m). (orig.)

Halon Flightline Extinguisher Evaluation: Data Supporting Standard Development

National Research Council Canada - National Science Library

Dierdorf, Dougls S; Kiel, Jennifer C

2005-01-01

.... An F-100 engine nacelle mockup was used to evaluate the full extinguishment times and amount of extinguishing agent used on a series of twenty aft engine and pool fires of 100-ft2 and ten access panel fires...

HOT AEROSOL FIRE EXTINGUISHING AGENTS AND THE ASSOCIATED TECHNOLOGIES: A REVIEW

Directory of Open Access Journals (Sweden)

Xiaotian Zhang

2015-09-01

Full Text Available AbstractSince the phase out of Halon extinguishers in the 1980s, hot aerosol fire suppression technology has gained much attention. Unlike traditional inert gas, foam, water mist and Halon fire suppression agents, hot aerosol fire extinguishing agents do not need to be driven out by pressurized gases and can extinguish class A, B, C, D and K fires at 30 to 200 g/m3. Generally, hot aerosol fire extinguishing technology has developed from a generation I oil tank suppression system to a generation III strontium salt based S-type system. S-type hot aerosol fire extinguishing technology greatly solves the corrosion problem of electrical devices and electronics compared to potassium salt based generation I & II hot aerosol fire extinguishing technology. As substitutes for Halon agents, the ODP and GWP values of hot fire extinguishing aerosols are nearly zero, but those fine aerosol particles can cause adverse health effects once inhaled by human. As for configurations of hot aerosol fire extinguishing devices, fixed or portable cylindrical canisters are the most common among generation II & III hot aerosol fire extinguishers across the world, while generation I hot aerosol fire suppression systems are integrated with the oil tank as a whole. Some countries like the U.S., Australia, Russia and China, etc. have already developed standards for manufacturing and quality control of hot aerosol fire extinguishing agents and norms for hot aerosol fire extinguishing system design under different fire protection scenarios. Coolants in hot aerosol fire suppression systems, which are responsible for reducing hot aerosol temperature to avoid secondary fire risk are reviewed for the first time. Cooling effects are generally achieved through vaporization and endothermic chemical decomposition of coolants. Finally, this review discussed areas applying generation I, II or III hot aerosol fire suppression technologies. The generation III hot aerosol fire extinguishing

Extinguishing agent for combustible metal fires

Science.gov (United States)

Riley, John F.; Stauffer, Edgar Eugene

1976-10-12

A low chloride extinguishing agent for combustible metal fires comprising from substantially 75 to substantially 94 weight percent of sodium carbonate as the basic fire extinguishing material, from substantially 1 to substantially 5 weight percent of a water-repellent agent such as a metal stearate, from substantially 2 to substantially 10 weight percent of a flow promoting agent such as attapulgus clay, and from substantially 3 to substantially 15 weight percent of a polyamide resin as a crusting agent.

The dopamine β-hydroxylase inhibitor, nepicastat, suppresses chocolate self-administration and reinstatement of chocolate seeking in rats.

Science.gov (United States)

Zaru, Alessandro; Maccioni, Paola; Colombo, Giancarlo; Gessa, Gian Luigi

2013-10-01

Craving for chocolate is a common phenomenon, which may evolve to an addictive-like behaviour and contribute to obesity. Nepicastat is a selective dopamine β-hydroxylase (DBH) inhibitor that suppresses cocaine-primed reinstatement of cocaine seeking in rats. We verified whether nepicastat was able to modify the reinforcing and motivational properties of a chocolate solution and to prevent the reinstatement of chocolate seeking in rats. Nepicastat (25, 50 and 100 mg/kg, intraperitoneal) produced a dose-related inhibition of operant self-administration of the chocolate solution in rats under fixed-ratio 10 (FR10) and progressive-ratio schedules of reinforcement, measures of the reinforcing and motivational properties of the chocolate solution, respectively. The effect of nepicastat on the reinstatement of chocolate seeking was studied in rats in which lever-responding had been extinguished by removing the chocolate solution for approximately 8 d. Nepicastat dose-dependently suppressed the reinstatement of lever-responding triggered by a 'priming' of the chocolate solution together with cues previously associated with the availability of the reward. In a separate group of food-restricted rats trained to lever-respond for regular food pellets, nepicastat reduced FR10 lever-responding with the same potency as for the chocolate solution. Spontaneous locomotor activity was not modified by nepicastat doses that reduced self-administration of the chocolate solution and regular food pellets and suppressed the reinstatement of chocolate seeking. The results indicate that nepicastat reduces motivation to food consumption sustained by appetite or palatability. Moreover, the results suggest that DBH inhibitors may be a new class of pharmacological agents potentially useful in the prevention of relapse to food seeking in human dieters.

30 CFR 57.4203 - Extinguisher recharging or replacement.

Science.gov (United States)

2010-07-01

... 30 Mineral Resources 1 2010-07-01 2010-07-01 false Extinguisher recharging or replacement. 57.4203 Section 57.4203 Mineral Resources MINE SAFETY AND HEALTH ADMINISTRATION, DEPARTMENT OF LABOR METAL AND... Prevention and Control Firefighting Equipment § 57.4203 Extinguisher recharging or replacement. Fire...

30 CFR 56.4203 - Extinguisher recharging or replacement.

Science.gov (United States)

2010-07-01

... 30 Mineral Resources 1 2010-07-01 2010-07-01 false Extinguisher recharging or replacement. 56.4203 Section 56.4203 Mineral Resources MINE SAFETY AND HEALTH ADMINISTRATION, DEPARTMENT OF LABOR METAL AND... Prevention and Control Firefighting Equipment § 56.4203 Extinguisher recharging or replacement. Fire...

Cocaine- and amphetamine-regulated transcript (CART signaling within the paraventricular thalamus modulates cocaine-seeking behaviour.

Directory of Open Access Journals (Sweden)

Morgan H James

Full Text Available BACKGROUND: Cocaine- and amphetamine-regulated transcript (CART has been demonstrated to play a role in regulating the rewarding and reinforcing effects of various drugs of abuse. A recent study demonstrated that i.c.v. administration of CART negatively modulates reinstatement of alcohol seeking, however, the site(s of action remains unclear. We investigated the paraventricular thalamus (PVT as a potential site of relapse-relevant CART signaling, as this region is known to receive dense innervation from CART-containing hypothalamic cells and to project to a number of regions known to be involved in mediating reinstatement, including the nucleus accumbens (NAC, medial prefrontal cortex (mPFC and basolateral amygdala (BLA. METHODOLOGY/PRINCIPAL FINDINGS: Male rats were trained to self-administer cocaine before being extinguished to a set criterion. One day following extinction, animals received intra-PVT infusions of saline, tetrodotoxin (TTX; 2.5 ng, CART (0.625 µg or 2.5 µg or no injection, followed by a cocaine prime (10 mg/kg, i.p.. Animals were then tested under extinction conditions for one hour. Treatment with either TTX or CART resulted in a significant attenuation of drug-seeking behaviour following cocaine-prime, with the 2.5 µg dose of CART having the greatest effect. This effect was specific to the PVT region, as misplaced injections of both TTX and CART resulted in responding that was identical to controls. CONCLUSIONS/SIGNIFICANCE: We show for the first time that CART signaling within the PVT acts to inhibit drug-primed reinstatement of cocaine seeking behaviour, presumably by negatively modulating PVT efferents that are important for drug seeking, including the NAC, mPFC and BLA. In this way, we identify a possible target for future pharmacological interventions designed to suppress drug seeking.

Payment card rewards programs and consumer payment choice

OpenAIRE

Andrew Ching; Fumiko Hayashi

2006-01-01

Card payments have been growing very rapidly. To continue the growth, payment card networks keep adding new merchants and card issuers try to stimulate their existing customers’ card usage by providing rewards. This paper seeks to analyze the effects of payment card rewards programs on consumer payment choice, by using consumer survey data. Specifically, we examine whether credit/debit reward receivers use credit/debit cards relatively more often than other consumers, if so how much more ofte...

Behavioral measures of risk tasking, sensation seeking and sensitivity to reward may reflect different motivations for spicy food liking and consumption.

Science.gov (United States)

Byrnes, Nadia K; Hayes, John E

2016-08-01

Based on work a quarter century ago, it is widely accepted personality traits like sensation seeking are related to the enjoyment and intake of spicy foods; however, data supporting this belief is actually quite limited. Recently, we reported strong to moderate correlations between remembered spicy food liking and two personality traits measured with validated questionnaires. Here, participants consumed capsaicin-containing strawberry jelly to generate acute estimates of spicy food liking. Additionally, we used a laboratory-based behavioral measure of risk taking (the mobile Balloon Analogue Risk Task; mBART) to complement a range of validated self-report measures of risk-related personality traits. Present data confirm Sensation Seeking correlates with overall spicy meal liking and liking of the burn of a spicy meal, and extends prior findings by showing novel correlations with the liking of sampled stimuli. Other personality measures, including Sensitivity to Punishment (SP), Sensitivity to Reward (SR), and the Impulsivity and Risk Taking subscales of the DSM5 Personality Inventory (PID-5) did not show significant relationships with liking of spicy foods, either sampled or remembered. Our behavioral risk taking measure, the mBART, also failed to show a relationship with remembered or sampled liking. However, significant relationships were observed between reported intake of spicy foods and Sensitivity to Reward, and the Risk Taking subscale of the PID-5 (PID5-RT). Based on the observed patterns among various personality measures, and spicy food liking and intake, we propose that personality measures may exert their influence on intake of spicy food via different mechanisms. We also speculate that Sensation Seeking may reflect motivations for consuming spicy foods that are more intrinsic, while the motivations for eating spicy foods measured by SR and PID5-RT may be more extrinsic. Copyright © 2016 Elsevier Ltd. All rights reserved.

At what stage of neural processing does cocaine act to boost pursuit of rewards?

Directory of Open Access Journals (Sweden)

Giovanni Hernandez

2010-11-01

Full Text Available Dopamine-containing neurons have been implicated in reward and decision making. One element of the supporting evidence is that cocaine, like other drugs that increase dopaminergic neurotransmission, powerfully potentiates reward seeking. We analyze this phenomenon from a novel perspective, introducing a new conceptual framework and new methodology for determining the stage(s of neural processing at which drugs, lesions and physiological manipulations act to influence reward-seeking behavior. Cocaine strongly boosts the proclivity of rats to work for rewarding electrical brain stimulation. We show that the conventional conceptual framework and methods do not distinguish between three conflicting accounts of how the drug produces this effect: increased sensitivity of brain reward circuitry, increased gain, or decreased subjective reward costs. Sensitivity determines the stimulation strength required to produce a reward of a given intensity (a measure analogous to the KM of an enzyme whereas gain determines the maximum intensity attainable (a measure analogous to the vmax of an enzyme-catalyzed reaction. To distinguish sensitivity changes from the other determinants, we measured and modeled reward seeking as a function of both stimulation strength and opportunity cost. The principal effect of cocaine was a two-fourfold increase in willingness to pay for the electrical reward, an effect consistent with increased gain or decreased subjective cost. This finding challenges the long-standing view that cocaine increases the sensitivity of brain reward circuitry. We discuss the implications of the results and the analytic approach for theories of how dopaminergic neurons and other diffuse modulatory brain systems contribute to reward pursuit, and we explore the implications of the conceptual framework for the study of natural rewards, drug reward, and mood.

Neural correlates of water reward in thirsty Drosophila

OpenAIRE

Lin, Suewei; Owald, David; Chandra, Vikram; Talbot, Clifford; Huetteroth, Wolf; Waddell, Scott

2014-01-01

Drinking water is innately rewarding to thirsty animals. In addition, the consumed value can be assigned to behavioral actions and predictive sensory cues by associative learning. Here we show that thirst converts water avoidance into water-seeking in naive Drosophila melanogaster. Thirst also permitted flies to learn olfactory cues paired with water reward. Water learning required water taste and

Learning Reward Uncertainty in the Basal Ganglia.

Directory of Open Access Journals (Sweden)

John G Mikhael

2016-09-01

Full Text Available Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid options with variable reward can be controlled by increasing (or decreasing the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions.

29 CFR 1910.163 - Fixed extinguishing systems, water spray and foam.

Science.gov (United States)

2010-07-01

... 29 Labor 5 2010-07-01 2010-07-01 false Fixed extinguishing systems, water spray and foam. 1910.163... Suppression Equipment § 1910.163 Fixed extinguishing systems, water spray and foam. (a) Scope and application. This section applies to all fixed extinguishing systems, using water or foam solution as the...

Analysis of the Earthquake Impact towards water-based fire extinguishing system

Science.gov (United States)

Lee, J.; Hur, M.; Lee, K.

2015-09-01

Recently, extinguishing system installed in the building when the earthquake occurred at a separate performance requirements. Before the building collapsed during the earthquake, as a function to maintain a fire extinguishing. In particular, the automatic sprinkler fire extinguishing equipment, such as after a massive earthquake without damage to piping also must maintain confidentiality. In this study, an experiment installed in the building during the earthquake, the water-based fire extinguishing saw grasp the impact of the pipe. Experimental structures for water-based fire extinguishing seismic construction step by step, and then applied to the seismic experiment, the building appears in the extinguishing of the earthquake response of the pipe was measured. Construction of acceleration caused by vibration being added to the size and the size of the displacement is measured and compared with the data response of the pipe from the table, thereby extinguishing water piping need to enhance the seismic analysis. Define the seismic design category (SDC) for the four groups in the building structure with seismic criteria (KBC2009) designed according to the importance of the group and earthquake seismic intensity. The event of a real earthquake seismic analysis of Category A and Category B for the seismic design of buildings, the current fire-fighting facilities could have also determined that the seismic performance. In the case of seismic design categories C and D are installed in buildings to preserve the function of extinguishing the required level of seismic retrofit design is determined.

Oil well fire extinguisher having upper and lower external flame retardant-dispersing rings

International Nuclear Information System (INIS)

Kim, H.S.

1992-01-01

This patent describes an extinguisher system for extinguishing flames from combustible fluid exiting from a pipe. It comprises an elongated tubular extinguisher body disposable over the combustible fluid emitting pipe; valve means mounted in the extinguisher body adjacent the upper outlet end for eliminating the flow of the combustion

Orexin/hypocretin role in reward: implications for opioid and other addictions.

Science.gov (United States)

Baimel, Corey; Bartlett, Selena E; Chiou, Lih-Chu; Lawrence, Andrew J; Muschamp, John W; Patkar, Omkar; Tung, Li-Wei; Borgland, Stephanie L

2015-01-01

Addiction is a devastating disorder that affects 15.3 million people worldwide. While prevalent, few effective treatments exist. Orexin receptors have been proposed as a potential target for anti-craving medications. Orexins, also known as hypocretins, are neuropeptides produced in neurons of the lateral and dorsomedial hypothalamus and perifornical area, which project widely throughout the brain. The absence of orexins in rodents and humans leads to narcolepsy. However, orexins also have an established role in reward seeking. This review will discuss some of the original studies describing the roles of the orexins in reward seeking as well as specific works that were presented at the 2013 International Narcotics Research Conference. Orexin signalling can promote drug-induced plasticity of glutamatergic synapses onto dopamine neurons of the ventral tegmental area (VTA), a brain region implicated in motivated behaviour. Additional evidence suggests that orexin signalling can also promote drug seeking by initiating an endocannabinoid-mediated synaptic depression of GABAergic inputs to the VTA, and thereby disinhibiting dopaminergic neurons. Orexin neurons co-express the inhibitory opioid peptide dynorphin. It has been proposed that orexin in the VTA may not mediate reward per se, but rather occludes the 'anti-reward' effects of dynorphin. Finally, orexin signalling in the prefrontal cortex and the central amygdala is implicated in reinstatement of reward seeking. This review will highlight recent work describing the role of orexin signalling in cellular processes underlying addiction-related behaviours and propose novel hypotheses for the mechanisms by which orexin signalling may impart drug seeking. This article is part of a themed section on Opioids: New Pathways to Functional Selectivity. To view the other articles in this section visit http://dx.doi.org/10.1111/bph.2015.172.issue-2. © 2014 The British Pharmacological Society.

Habitual alcohol seeking: modeling the transition from casual drinking to addiction

Science.gov (United States)

Barker, Jacqueline M; Taylor, Jane R

2014-01-01

The transition from goal-directed actions to habitual ethanol seeking models the development of addictive behavior that characterizes alcohol use disorders. The progression to habitual ethanol-seeking behavior occurs more rapidly than for natural rewards, suggesting that ethanol may act on habit circuit to drive the loss of behavioral flexibility. This review will highlight recent research that has focused on the formation and expression of habitual ethanol seeking, and the commonalities and distinctions between ethanol and natural reward-seeking habits, with the goal of highlighting important, understudied research areas that we believe will lead toward the development of novel treatment and prevention strategies for uncontrolled drinking. PMID:25193245

Conditioned Contribution of Peripheral Cocaine Actions to Cocaine Reward and Cocaine-Seeking

OpenAIRE

Wang, Bin; You, Zhi-Bing; Oleson, Erik B; Cheer, Joseph F; Myal, Stephanie; Wise, Roy A

2013-01-01

Cocaine has actions in the peripheral nervous system that reliably precede—and thus predict—its soon-to-follow central rewarding effects. In cocaine-experienced animals, the peripheral cocaine signal is relayed to the central nervous system, triggering excitatory input to the ventral tegmental origin of the mesocorticolimbic dopamine system, the system that mediates the rewarding effects of the drug. We used cocaine methiodide, a cocaine analog that does not cross the blood–brain barrier, to ...

"Liking" and "wanting" linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry.

Science.gov (United States)

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2012-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: "liking,"learning," and "wanting" [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or "wanting" hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily selfadministered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens (NAC), and they stimulate the functioning of brain reward circuitry (producing the "high" that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions.

Counting addressing method: Command addressable element and extinguishing module

Directory of Open Access Journals (Sweden)

Ristić Jovan D.

2009-01-01

Full Text Available The specific requirements that appear in addressable fire detection and alarm systems and the shortcomings of the existing addressing methods were discussed. A new method of addressing of detectors was proposed. The basic principles of addressing and responding of a called element are stated. Extinguishing module is specific subsystem in classic fire detection and alarm systems. Appearing of addressable fire detection and alarm systems didn't caused essential change in the concept of extinguishing module because of long calling period of such systems. Addressable fire security system based on counting addressing method reaches high calling rates and enables integrating of the extinguishing module in addressable system. Solutions for command addressable element and integrated extinguishing module are given in this paper. The counting addressing method was developed for specific requirements in fire detection and alarm systems, yet its speed and reliability justifies its use in the acquisition of data on slowly variable parameters under industrial conditions. .

Optogenetic Inhibition of Ventral Pallidum Neurons Impairs Context-Driven Salt Seeking.

Science.gov (United States)

Chang, Stephen E; Smedley, Elizabeth B; Stansfield, Katherine J; Stott, Jeffrey J; Smith, Kyle S

2017-06-07

Salt appetite, in which animals can immediately seek out salt when under a novel state of sodium deprivation, is a classic example of how homeostatic systems interface with learned associations to produce an on-the-fly updating of motivated behavior. Neural activity in the ventral pallidum (VP) has been shown to encode changes in the value of salt under such conditions, both the value of salt itself (Tindell et al., 2006) and the motivational value of its predictive cues (Tindell et al., 2009; Robinson and Berridge, 2013). However, it is not known whether the VP is necessary for salt appetite in terms of seeking out salt or consuming salt following sodium depletion. Here, we used a conditioned place-preference procedure to investigate the effects of optogenetically inhibiting the VP on context-driven salt seeking and the consumption of salt following deprivation. Male rats learned to associate one context with sucrose and another context with less-desirable salt. Following sodium depletion, and in the absence of either sucrose or salt, we found that inhibiting the VP selectively reduced the elevation in time spent in the salt-paired context. VP inhibition had minimal effects on the consumption of salt once it was made available. To our knowledge, this is the first evidence that the VP or any brain region is necessary for the ability to use contextual cues to guide salt seeking. These results highlight a dissociation between deficit-driven reward seeking and reward consumption to replenish those deficits, with the former process being particularly sensitive to on-line VP activity. SIGNIFICANCE STATEMENT Salt appetite, in which rats will immediately seek out a once-undesirable concentrated salt solution after being depleted of bodily sodium despite never having tasted salt as a positive reward, is a phenomenon showing how animals can update their motivational goals without any new learning or conditioning. This salt-seeking behavior is also observed when the animal

U.S. Geological Survey Rewarding Environment Culture Study, 2002

Science.gov (United States)

Nash, Janis C.; Paradise-Tornow, Carol A.; Gray, Vicki K.; Griffin-Bemis, Sarah P.; Agnew, Pamela R.; Bouchet, Nicole M.

2010-01-01

In its 2001 review of the U.S. Geological Survey (USGS), the National Research Council (NRC, p. 126) cautioned that ?high-quality personnel are essential for developing high-quality science information? and urged the USGS to ?devote substantial efforts to recruiting and retaining excellent staff.? Recognizing the importance of the NRC recommendation, the USGS has committed time and resources to create a rewarding work environment with the goal of achieving the following valued outcomes: ? USGS science vitality ? Customer satisfaction with USGS products and services ? Employee perceptions of the USGS as a rewarding place to work ? Heightened employee morale and commitment ? The ability to recruit and retain employees with critical skills To determine whether this investment of time and resources was proving to be successful, the USGS Human Resources Office conducted a Rewarding Environment Culture Study to answer the following four questions. ? Question 1: Does a rewarding work environment lead to the valued outcomes (identified above) that the USGS is seeking? ? Question 2: Which management, supervisory, and leadership behaviors contribute most to creating a rewarding work environment and to achieving the valued outcomes that the USGS is seeking? ? Question 3: Do USGS employees perceive that the USGS is a rewarding place to work? ? Question 4: What actions can and should be taken to enhance the USGS work environment? To begin the study, a conceptual model of a rewarding USGS environment was developed to test assumptions about a rewarding work environment. The Rewarding Environment model identifies the key components that are thought to contribute to a rewarding work environment and the valued outcomes that are thought to result from having a rewarding work environment. The 2002 Organizational Assessment Survey (OAS) was used as the primary data source for the study because it provided the most readily available data. Additional survey data were included as they

Ghrelin influences novelty seeking behavior in rodents and men.

Science.gov (United States)

Hansson, Caroline; Shirazi, Rozita H; Näslund, Jakob; Vogel, Heike; Neuber, Corinna; Holm, Göran; Anckarsäter, Henrik; Dickson, Suzanne L; Eriksson, Elias; Skibicka, Karolina P

2012-01-01

Recent discoveries indicate an important role for ghrelin in drug and alcohol reward and an ability of ghrelin to regulate mesolimbic dopamine activity. The role of dopamine in novelty seeking, and the association between this trait and drug and alcohol abuse, led us to hypothesize that ghrelin may influence novelty seeking behavior. To test this possibility we applied several complementary rodent models of novelty seeking behavior, i.e. inescapable novelty-induced locomotor activity (NILA), novelty-induced place preference and novel object exploration, in rats subjected to acute ghrelin receptor (growth hormone secretagogue receptor; GHSR) stimulation or blockade. Furthermore we assessed the possible association between polymorphisms in the genes encoding ghrelin and GHSR and novelty seeking behavior in humans. The rodent studies indicate an important role for ghrelin in a wide range of novelty seeking behaviors. Ghrelin-injected rats exhibited a higher preference for a novel environment and increased novel object exploration. Conversely, those with GHSR blockade drastically reduced their preference for a novel environment and displayed decreased NILA. Importantly, the mesolimbic ventral tegmental area selective GHSR blockade was sufficient to reduce the NILA response indicating that the mesolimbic GHSRs might play an important role in the observed novelty responses. Moreover, in untreated animals, a striking positive correlation between NILA and sucrose reward behavior was detected. Two GHSR single nucleotide polymorphisms (SNPs), rs2948694 and rs495225, were significantly associated with the personality trait novelty seeking, as assessed using the Temperament and Character Inventory (TCI), in human subjects. This study provides the first evidence for a role of ghrelin in novelty seeking behavior in animals and humans, and also points to an association between food reward and novelty seeking in rodents.

Risk of punishment influences discrete and coordinated encoding of reward-guided actions by prefrontal cortex and VTA neurons

Science.gov (United States)

Park, Junchol

2017-01-01

Actions motivated by rewards are often associated with risk of punishment. Little is known about the neural representation of punishment risk during reward-seeking behavior. We modeled this circumstance in rats by designing a task where actions were consistently rewarded but probabilistically punished. Spike activity and local field potentials were recorded during task performance simultaneously from VTA and mPFC, two reciprocally connected regions implicated in reward-seeking and aversive behaviors. At the single unit level, we found that ensembles of putative dopamine and non-dopamine VTA neurons and mPFC neurons encode the relationship between action and punishment. At the network level, we found that coherent theta oscillations synchronize VTA and mPFC in a bottom-up direction, effectively phase-modulating the neuronal spike activity in the two regions during punishment-free actions. This synchrony declined as a function of punishment probability, suggesting that during reward-seeking actions, risk of punishment diminishes VTA-driven neural synchrony between the two regions. PMID:29058673

46 CFR 167.45-1 - Steam, carbon dioxide, and halon fire extinguishing systems.

Science.gov (United States)

2010-10-01

... 46 Shipping 7 2010-10-01 2010-10-01 false Steam, carbon dioxide, and halon fire extinguishing....45-1 Steam, carbon dioxide, and halon fire extinguishing systems. (a) General requirements. (1...-extinguishing system. On such vessels contracted for prior to January 1, 1962, a steam smothering system may be...

33 CFR 149.409 - How many fire extinguishers are needed?

Science.gov (United States)

2010-07-01

... 33 Navigation and Navigable Waters 2 2010-07-01 2010-07-01 false How many fire extinguishers are needed? 149.409 Section 149.409 Navigation and Navigable Waters COAST GUARD, DEPARTMENT OF HOMELAND... Fire Protection Equipment Firefighting Requirements § 149.409 How many fire extinguishers are needed...

Fire Extinguisher Training for Fire Watch and Designated Workers, Course 9893

Energy Technology Data Exchange (ETDEWEB)

Harris, Jimmy D. [Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

2016-04-19

At Los Alamos National Laboratory (LANL), all workers must be aware of LANL fire protection policies and be trained on what to do in the event of a fire. This course, Fire Extinguisher Training for Fire Watch and Designated Workers (#9893), provides awareness-level and hands-on training for fire watch personnel and designated workers. Fire watch personnel and designated workers are appointed by line management and must receive both awareness-level training and hands-on training in the use of portable fire extinguishers to extinguish an incipient-stage fire. This training meets the requirements of the Occupational Safety and Health Administration (OSHA) Code of Federal Regulations (CFR) 29 CFR 1910.157, Portable Fire Extinguishers, and Procedure (P) 101-26, Welding, Cutting, and Other Spark-/Flame-Producing Operations.

Fire Extinguisher Designated Worker and Fire Watch: Self-Study Course 15672

Energy Technology Data Exchange (ETDEWEB)

Harris, Jimmy D. [Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

2016-07-08

At Los Alamos National Laboratory (LANL), all workers must be aware of LANL fire protection policies and be trained on what to do in the event of a fire. This course, Fire Extinguisher Training for Fire Watch and Designated Workers (#9893), provides awareness-level and hands-on training for fire watch personnel and designated workers. Fire watch personnel and designated workers are appointed by line management and must receive both awareness-level training and hands-on training in the use of portable fire extinguishers to extinguish an incipient-stage fire. This training meets the requirements of the Occupational Safety and Health Administration (OSHA) Code of Federal Regulations (CFR) 29 CFR 1910.157, Portable Fire Extinguishers, and Procedure (P) 101-26, Welding, Cutting, and Other Spark-/Flame-Producing Operations.

Methods to Compose Sodium Fire Extinguishing Equipment on Sodium Test Facility

Energy Technology Data Exchange (ETDEWEB)

Kim, B H; Kim, J M; Jeong, J Y; Choi, B H

2008-06-15

Sodium fire is graded 'D' and it is difficult to extinguish sodium fire. In this report, the characteristics of sodium fire and the methods composing the suitable fire extinguishing systems to suppress fire effectively were described.

Methods to Compose Sodium Fire Extinguishing Equipment on Sodium Test Facility

International Nuclear Information System (INIS)

Kim, B. H.; Kim, J. M.; Jeong, J. Y.; Choi, B. H.

2008-06-01

Sodium fire is graded 'D' and it is difficult to extinguish sodium fire. In this report, the characteristics of sodium fire and the methods composing the suitable fire extinguishing systems to suppress fire effectively were described

Synthesis of Fire-Extinguishing Dawsonites

Science.gov (United States)

Altman, R. L.

1982-01-01

Simple nonaqueous process synthesizes sodium or potassium, dawsonites effective against hydrocarbon fuel fires. Fire-extinguishing alkali metal dawsonites are prepared using a finely-pulverized equimolar mixture of hydrogen carbonate, or carbonates and aluminum hydroxide heated for 1 to 6 hours under carbon dioxide pressure.

Extinguishing agent for magnesium fire, phases 5 and 6

Science.gov (United States)

Beeson, H. D.; Tapscott, R. E.; Mason, B. E.

1987-07-01

This report documents the validation testing of the extinguishing system for metal fires developed as part of Phases 1 to 4. The results of this validation testing form the basis of information from which draft military specifications necessary to procure the agent and the agent delivery system may be developed. The developed system was tested against a variety of large-scale metal fire scenarios and the capabilities of the system were assessed. In addition the response of the system to storage and to changes in ambient conditions was tested. Results of this testing revealed that the developed system represented a reliable metal fire extinguishing system that could control and extinguish very large metal fires. The specifications developed for the agent and for the delivery system are discussed in detail.

Addiction and brain reward and antireward pathways.

Science.gov (United States)

Gardner, Eliot L

2011-01-01

Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly), and that they enhance the functioning of the reward circuitry of the brain (producing the 'high' that the drug user seeks). The core reward circuitry consists of an 'in-series' circuit linking the ventral tegmental area, nucleus accumbens and ventral pallidum via the medial forebrain bundle. Although originally believed to simply encode the set point of hedonic tone, these circuits are now believed to be functionally far more complex, also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. 'Hedonic dysregulation' within these circuits may lead to addiction. The 'second-stage' dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dop-aminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g. opiates), tolerance to the euphoric effects develops with chronic use. Postuse dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get high, but simply to get back to normal ('get straight'). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the 'bio-psycho-social' model of

Reinstatement of an Extinguished Fear Conditioned Response in Infant Rats

Science.gov (United States)

Revillo, Damian A.; Trebucq, Gastón; Paglini, Maria G.; Arias, Carlos

2016-01-01

Although it is currently accepted that the extinction effect reflects new context-dependent learning, this is not so clear during infancy, because some studies did not find recovery of the extinguished conditioned response (CR) in rodents during this ontogenetic stage. However, recent studies have shown the return of an extinguished CR in infant…

Neural systems underlying reward and approach behaviors in childhood and adolescence.

Science.gov (United States)

Galván, Adriana

2014-01-01

Transitions into and out of adolescence are critical developmental periods of reward-seeking and approach behaviors. Converging evidence suggests that intriguing reward-related behavioral shifts are mediated by developmental changes in frontostriatal circuitry. This chapter explores how the conceptual frameworks and empirical studies in the field of developmental cognitive neuroscience have contributed to understanding reward-related behavior across development.The chapter concludes with some implications for adaptive and maladaptive behaviors that arise from these behaviors as children transition from childhood to adolescence.

Distinct alterations in motor & reward seeking behavior are dependent on the gestational age of exposure to LPS-induced maternal immune activation.

Science.gov (United States)

Straley, Megan E; Van Oeffelen, Wesley; Theze, Sarah; Sullivan, Aideen M; O'Mahony, Siobhain M; Cryan, John F; O'Keeffe, Gerard W

2017-07-01

The dopaminergic system is involved in motivation, reward and the associated motor activities. Mesodiencephalic dopaminergic neurons in the ventral tegmental area (VTA) regulate motivation and reward, whereas those in the substantia nigra (SN) are essential for motor control. Defective VTA dopaminergic transmission has been implicated in schizophrenia, drug addiction and depression whereas dopaminergic neurons in the SN are lost in Parkinson's disease. Maternal immune activation (MIA) leading to in utero inflammation has been proposed to be a risk factor for these disorders, yet it is unclear how this stimulus can lead to the diverse disturbances in dopaminergic-driven behaviors that emerge at different stages of life in affected offspring. Here we report that gestational age is a critical determinant of the subsequent alterations in dopaminergic-driven behavior in rat offspring exposed to lipopolysaccharide (LPS)-induced MIA. Behavioral analysis revealed that MIA on gestational day 16 but not gestational day 12 resulted in biphasic impairments in motor behavior. Specifically, motor impairments were evident in early life, which were resolved by adolescence, but subsequently re-emerged in adulthood. In contrast, reward seeking behaviors were altered in offspring exposed MIA on gestational day 12. These changes were not due to a loss of dopaminergic neurons per se in the postnatal period, suggesting that they reflect functional changes in dopaminergic systems. This highlights that gestational age may be a key determinant of how MIA leads to distinct alterations in dopaminergic-driven behavior across the lifespan of affected offspring. Copyright © 2016 Elsevier Inc. All rights reserved.

Reward Circuitry in Addiction.

Science.gov (United States)

Cooper, Sarah; Robison, A J; Mazei-Robison, Michelle S

2017-07-01

Understanding the brain circuitry that underlies reward is critical to improve treatment for many common health issues, including obesity, depression, and addiction. Here we focus on insights into the organization and function of reward circuitry and its synaptic and structural adaptations in response to cocaine exposure. While the importance of certain circuits, such as the mesocorticolimbic dopamine pathway, are well established in drug reward, recent studies using genetics-based tools have revealed functional changes throughout the reward circuitry that contribute to different facets of addiction, such as relapse and craving. The ability to observe and manipulate neuronal activity within specific cell types and circuits has led to new insight into not only the basic connections between brain regions, but also the molecular changes within these specific microcircuits, such as neurotrophic factor and GTPase signaling or α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) receptor function, that underlie synaptic and structural plasticity evoked by drugs of abuse. Excitingly, these insights from preclinical rodent work are now being translated into the clinic, where transcranial magnetic simulation and deep brain stimulation therapies are being piloted in human cocaine dependence. Thus, this review seeks to summarize current understanding of the major brain regions implicated in drug-related behaviors and the molecular mechanisms that contribute to altered connectivity between these regions, with the postulation that increased knowledge of the plasticity within the drug reward circuit will lead to new and improved treatments for addiction.

Techniques for extinguishing sodium fires

International Nuclear Information System (INIS)

Raju, Chander; Kale, R.D.

1979-02-01

The experimental work done to evaluate the performance of commercially available fire extinguishants and powders for sodium fires is described. Dry chemical powder with sodium bicarbonate base was found very effective. Another effective method of extinghishing fire by using perforated covered tray is also discussed. (auth.)

Reward and Punishment Sensitivity in Children with ADHD: Validating the Sensitivity to Punishment and Sensitivity to Reward Questionnaire for Children (SPSRQ-C)

OpenAIRE

Luman, Marjolein; van Meel, Catharina S.; Oosterlaan, Jaap; Geurts, Hilde M.

2011-01-01

This study validates the Sensitivity to Punishment and Sensitivity to Reward Questionnaire for children (SPSRQ-C), using a Dutch sample of 1234 children between 6-13 years old. Factor analysis determined that a 4-factor and a 5-factor solution were best fitting, explaining 41% and 50% of the variance respectively. The 4-factor model was highly similar to the original SPSRQ factors found in adults (Punishment Sensitivity, Reward Responsivity, Impulsivity/ Fun-Seeking, and Drive). The 5-factor ...

Rationalization design on large equipment dismantling facility. The cell fire-extinguishing examination (3)

International Nuclear Information System (INIS)

Donomae, Yasushi; Matsumoto, Yoshihiro; Takita, Koji; Kikuchi, Yutaka; Katoh, Noriyoshi; Miyazaki, Hitoshi; Tanimoto, Ken-ichi

2002-07-01

In order to rationalize for Large Equipment Dismantling Facility (LEDF), the plan of removing vaporizer belong to Cell-fire-extinguishing-system was investigated. When a vaporizer is cut down, it is necessary to grasp a fire-extinguishing performance. The fire-extinguishing performance check examination by liquefaction carbon dioxide in the cell fire-extinguishing examination (I) was carried out in 1999 fiscal year. As the result, the good performance was obtained to polyethylene. But there was the deep-seated fire about a piece of wood. Then, the check items were carbon dioxide (CO2) concentration and CO2 concentration holding time for the deep-seated fire in the cell fire-extinguishing examination (III). The results were as follows; (1) By use of the combustion model in which a piece of wood and cotton were put is lit, temperature inside model, mass reduction, and combustion situation were examined. The model burned remarkably in 30∼60 min. The peak temperature rise to 680 degC (MAX), and attained smoldering after (ignition) 70 min. Moreover, in order to determine the generating conditions of a deep-seated fire, the situation of CO2 extinguishing after ignition by the time lag of 50∼90 min were examined. The model around ignition 50 minutes was the most difficult to extinguish, and it turned out that they are the conditions which were most suitable for the deep-seated fire examination model of an exam. (2) In order to decide on CO2 concentration and concentration holding time required for fire extinguishing of the deep-seated fire in LEDF, the fire-extinguishing performance was investigated by 40 ∼ 65% of CO2 concentration. Consequently, CO2 concentration required for deep-seated fire extinguishing was understood that 60% or more was required when safety was taken into consideration at 50% or more. Moreover, when it was 50% or more of CO2 concentration and the holding time of CO2 concentration was 180 minutes or more and 60% or more of CO2 concentration, it

Adult neurogenesis affects motivation to obtain weak, but not strong, reward in operant tasks.

Science.gov (United States)

Karlsson, Rose-Marie; Wang, Alice S; Sonti, Anup N; Cameron, Heather A

2018-04-16

Decreased motivation to seek rewards is a key feature of mood disorders that correlates with severity and treatment outcome. This anhedonia, or apathy, likely reflects impairment in reward circuitry, but the specific neuronal populations controlling motivation are unclear. Granule neurons generated in the adult hippocampus have been implicated in mood disorders, but are not generally considered as part of reward circuits. We investigated a possible role of these new neurons in motivation to work for food and sucrose rewards in operant conditioning tasks using GFAP-TK pharmacogenetic ablation of adult neurogenesis in both rats and mice. Rats and mice lacking adult neurogenesis showed normal lever press responding during fixed ratio training, reward devaluation, and Pavlovian Instrumental Transfer, suggesting no impairment in learning. However, on an exponentially progressive ratio schedule, or when regular chow was freely available in the testing chamber, TK rats and mice showed less effort to gain sucrose tablets. When working for balanced food tablets, which rats and mice of both genotypes strongly preferred over sucrose, the genotype effects on behavior were lost. This decrease in effort under conditions of low reward suggests that loss of adult neurogenesis decreases motivation to seek reward in a manner that may model behavioral apathy. © 2018 Wiley Periodicals, Inc.

30 CFR 77.1111 - Welding, cutting, soldering; use of fire extinguisher.

Science.gov (United States)

2010-07-01

... 30 Mineral Resources 1 2010-07-01 2010-07-01 false Welding, cutting, soldering; use of fire... OF UNDERGROUND COAL MINES Fire Protection § 77.1111 Welding, cutting, soldering; use of fire extinguisher. One portable fire extinguisher shall be provided at each location where welding, cutting, or...

Effects of serotonin (5-HT)1B receptor ligands on amphetamine-seeking behavior in rats.

Science.gov (United States)

Miszkiel, Joanna; Przegaliński, Edmund

2013-01-01

Numerous studies have indicated that serotonin (5-HT)1B receptor ligands affect the behavioral effects of psychostimulants (cocaine, amphetamine), including the reinforcing activities of these drugs. To substantiate a role for those receptors in incentive motivation for amphetamine, we used the extinction/reinstatement model to examine the effects of the 5-HT1B receptor ligands on the reinstatement of extinguished amphetamine-seeking behavior. Rats trained to self-administer amphetamine (0.06 mg/kg/infusion) subsequently underwent the extinction procedure. These rats were then tested for the amphetamine-primed or amphetamine-associated cue-induced reinstatement of extinguished amphetamine-seeking behavior. The 5-HT1B receptor antagonist SB 216641 (5-7.5 mg/kg) attenuated the amphetamine (1.5 mg/kg)- and the amphetamine-associated cue combined with the threshold dose of amphetamine (0.5 mg/kg)-induced reinstatement of amphetamine-seeking behavior. The 5-HT1B receptor agonist CP 94253 (1.25-5 mg/kg) also inhibited the amphetamine-seeking behavior induced by amphetamine (1.5 mg/kg) but not by the cue combined with the threshold dose of amphetamine. The inhibitory effect of CP94253 on amphetamine-seeking behavior remained unaffected by the 5-HT1B receptor antagonist. Our results indicate that tonic activation of 5-HT1B receptors is involved in amphetamine- and cue-induced reinstatement of amphetamine-seeking behavior and that the inhibitory effects of 5-HT1B receptor antagonists on these phenomena are directly related to the motivational aspects of amphetamine abuse. The inhibitory effect of CP 94253 on amphetamine-seeking behavior seems to be unrelated to 5-HT1B receptor activation and may result from a general reduction of motivation.

Bio-robots automatic navigation with electrical reward stimulation.

Science.gov (United States)

Sun, Chao; Zhang, Xinlu; Zheng, Nenggan; Chen, Weidong; Zheng, Xiaoxiang

2012-01-01

Bio-robots that controlled by outer stimulation through brain computer interface (BCI) suffer from the dependence on realtime guidance of human operators. Current automatic navigation methods for bio-robots focus on the controlling rules to force animals to obey man-made commands, with animals' intelligence ignored. This paper proposes a new method to realize the automatic navigation for bio-robots with electrical micro-stimulation as real-time rewards. Due to the reward-seeking instinct and trial-and-error capability, bio-robot can be steered to keep walking along the right route with rewards and correct its direction spontaneously when rewards are deprived. In navigation experiments, rat-robots learn the controlling methods in short time. The results show that our method simplifies the controlling logic and realizes the automatic navigation for rat-robots successfully. Our work might have significant implication for the further development of bio-robots with hybrid intelligence.

dcc Haploinsufficiency results in blunted sensitivity to cocaine enhancement of reward seeking.

Science.gov (United States)

Reynolds, Lauren M; Gifuni, Anthony J; McCrea, E Tess; Shizgal, Peter; Flores, Cecilia

2016-02-01

Mesocortical dopamine connectivity continues to mature during adolescence. This protracted development confers increased vulnerability for environmental and genetic factors to disrupt mesocortical wiring and subsequently influence responses to drugs of abuse in adulthood. The netrin-1 receptor, DCC, orchestrates medial prefrontal cortex dopamine input during adolescence and dictates the functional organization of local circuitry. Haploinsufficiency of dcc results in increased dopamine innervation to the medial prefrontal cortex, which in turn leads to resilience against the behavioral activating effects of stimulant drugs. However, whether sensitivity to the rewarding effects of drugs of abuse is also altered in dcc haploinsufficiency remains to be resolved. Here, we used the curve-shift method to measure cocaine-induced facilitation of intracranial self-stimulation (ICSS) in adult dcc haploinsufficient mice and wild-type littermates. We found that dcc haploinsufficient mice acquire ICSS behavior at comparable stimulation parameters to wild-type controls. However, cocaine-induced potentiation of ICSS is significantly blunted in dcc haploinsufficient mice. These results are consistent with decreased sensitivity to the rewarding effects of cocaine and/or decreased proclivity to invest effort in the pursuit of reward in dcc haploinsufficient mice. Moreover, these findings suggest that DCC signaling determines adult susceptibility to drug abuse most likely by controlling prefrontal cortex development in adolescence. Copyright © 2015 Elsevier B.V. All rights reserved.

Analysis of Flame Extinguishment and Height in Low Frequency Acoustically Excited Methane Jet Diffusion Flame

Science.gov (United States)

Zong, Ruowen; Kang, Ruxue; Liu, Chen; Zhang, Zhiyang; Zhi, Youran

2018-01-01

The exploration of microgravity conditions in space is increasing and existing fire extinguishing technology is often inadequate for fire safety in this special environment. As a result, improving the efficiency of portable extinguishers is of growing importance. In this work, a visual study of the effects on methane jet diffusion flames by low frequency sound waves is conducted to assess the extinguishing ability of sound waves. With a small-scale sound wave extinguishing bench, the extinguishing ability of certain frequencies of sound waves are identified, and the response of the flame height is observed and analyzed. Results show that the flame structure changes with disturbance due to low frequency sound waves of 60-100 Hz, and quenches at effective frequencies in the range of 60-90 Hz. In this range, 60 Hz is considered to be the quick extinguishing frequency, while 70-90 Hz is the stable extinguishing frequency range. For a fixed frequency, the flame height decreases with sound pressure level (SPL). The flame height exhibits the greatest sensitivity to the 60 Hz acoustic waves, and the least to the 100 Hz acoustic waves. The flame height decreases almost identically with disturbance by 70-90 Hz acoustic waves.

Handheld Delivery System for Modified Boron-Type Fire Extinguishment Agent

Science.gov (United States)

1993-11-01

was to develop and test a handheld portable delivery system for use with the modified boron-type fire extinguishing agent for metal fires . B...BACKGROUND A need exists for an extinguishing agent and accompanying delivery system that are effective against complex geometry metal fires . A modified...agent and its delivery system have proven effective against complex geometry metal fires containing up to 200 pounds of magnesium metal. Further

Reward-related behavioral paradigms for addiction research in the mouse: performance of common inbred strains.

Directory of Open Access Journals (Sweden)

Lauren Lederle

2011-01-01

Full Text Available The mouse has emerged as a uniquely valuable species for studying the molecular and genetic basis of complex behaviors and modeling neuropsychiatric disease states. While valid and reliable preclinical assays for reward-related behaviors are critical to understanding addiction-related processes, and various behavioral procedures have been developed and characterized in rats and primates, there have been relatively few studies using operant-based addiction-relevant behavioral paradigms in the mouse. Here we describe the performance of the C57BL/6J inbred mouse strain on three major reward-related paradigms, and replicate the same procedures in two other commonly used inbred strains (DBA/2J, BALB/cJ. We examined Pavlovian-instrumental transfer (PIT by measuring the ability of an auditory cue associated with food reward to promote an instrumental (lever press response. In a separate experiment, we assessed the acquisition and extinction of a simple stimulus-reward instrumental behavior on a touch screen based task. Reinstatement of this behavior was then examined following either continuous exposure to cues (conditioned reinforcers, CRs associated with reward, brief reward and CR exposure, or brief reward exposure followed by continuous CR exposure. The third paradigm examined sensitivity of an instrumental (lever press response to devaluation of food reward (a probe for outcome insensitive, habitual behavior by repeated pairing with malaise. Results showed that C57BL/6J mice displayed robust PIT, as well as clear extinction and reinstatement, but were insensitive to reinforcer devaluation. DBA/2J mice showed good PIT and (rewarded reinstatement, but were slow to extinguish and did not show reinforcer devaluation or significant CR-reinstatement. BALB/cJ mice also displayed good PIT, extinction and reinstatement, and retained instrumental responding following devaluation, but, unlike the other strains, demonstrated reduced Pavlovian approach

Reward-related behavioral paradigms for addiction research in the mouse: performance of common inbred strains.

Science.gov (United States)

Lederle, Lauren; Weber, Susanna; Wright, Tara; Feyder, Michael; Brigman, Jonathan L; Crombag, Hans S; Saksida, Lisa M; Bussey, Timothy J; Holmes, Andrew

2011-01-10

The mouse has emerged as a uniquely valuable species for studying the molecular and genetic basis of complex behaviors and modeling neuropsychiatric disease states. While valid and reliable preclinical assays for reward-related behaviors are critical to understanding addiction-related processes, and various behavioral procedures have been developed and characterized in rats and primates, there have been relatively few studies using operant-based addiction-relevant behavioral paradigms in the mouse. Here we describe the performance of the C57BL/6J inbred mouse strain on three major reward-related paradigms, and replicate the same procedures in two other commonly used inbred strains (DBA/2J, BALB/cJ). We examined Pavlovian-instrumental transfer (PIT) by measuring the ability of an auditory cue associated with food reward to promote an instrumental (lever press) response. In a separate experiment, we assessed the acquisition and extinction of a simple stimulus-reward instrumental behavior on a touch screen based task. Reinstatement of this behavior was then examined following either continuous exposure to cues (conditioned reinforcers, CRs) associated with reward, brief reward and CR exposure, or brief reward exposure followed by continuous CR exposure. The third paradigm examined sensitivity of an instrumental (lever press) response to devaluation of food reward (a probe for outcome insensitive, habitual behavior) by repeated pairing with malaise. Results showed that C57BL/6J mice displayed robust PIT, as well as clear extinction and reinstatement, but were insensitive to reinforcer devaluation. DBA/2J mice showed good PIT and (rewarded) reinstatement, but were slow to extinguish and did not show reinforcer devaluation or significant CR-reinstatement. BALB/cJ mice also displayed good PIT, extinction and reinstatement, and retained instrumental responding following devaluation, but, unlike the other strains, demonstrated reduced Pavlovian approach behavior (food

Extinguishing experiments of sodium fires carried out by TNO

International Nuclear Information System (INIS)

Meijer, G.J.A.M.; Rulkens, W.H.

1979-01-01

For the collection of burning sodium from the components and pipes of the secondary circuit of SNR 300, spill-trays are foreseen which are connected to dump tanks. These spill-trays are covered with a sieve in order to reduce the flow of air to the sodium in the spill-tray and hence to reduce the burning rate. In order to further minimize the consequences of a large sodium fire for the components, the licensing authority required as a back-up the installation of a remotely operated distribution system by means of which an extinguishing powder can be sprayed upon the spill-trays. Experiments were carried out in which the effectiveness of different extinguishing powders in combination with the sieve covered spill-trays were tested in a comparative manner. Attention was paid to the question whether such a spray system would have also additional benefits in the case of smaller sodium leaks. To this purpose three commercially available extinguishing powders were tested, one on a sodium chloride, two on a carbonate base. Also the effectiveness of the sieves proper with respect to reducing the burning rate was tested without applying any extinguishing powders. Finally for a reference some tests were done on open spill-trays, i.e. spill-trays not covered with a sieve.The investigations which were carried out in 1976-1977 were limited to fire experiments, aspects of transport of the powder in the distribution system were not investigated

Neural circuits involved in the renewal of extinguished fear.

Science.gov (United States)

Chen, Weihai; Wang, Yan; Wang, Xiaqing; Li, Hong

2017-07-01

The last 10 years have witnessed a substantial progress in understanding the neural mechanisms for the renewal of the extinguished fear memory. Based on the theory of fear extinction, exposure therapy has been developed as a typical cognitive behavioral therapy for posttraumatic stress disorder. Although the fear memory can be extinguished by repeated presentation of conditioned stimulus without unconditioned stimulus, the fear memory is not erased and tends to relapse outside of extinction context, which is referred to as renewal. Therefore, the renewal is regarded as a great obstruction interfering with the effect of exposure therapy. In recent years, there has been a great deal of studies in understanding the neurobiological underpinnings of fear renewal. These offer a foundation upon which novel therapeutic interventions for the renewal may be built. This review focuses on behavioral, anatomical and electrophysiological studies that interpret roles of the hippocampus, prelimbic cortex and amygdala as well as the connections between them for the renewal of the extinguished fear. Additionally, this review suggests the possible pathways for the renewal: (1) the prelimbic cortex may integrate contextual information from hippocampal inputs and project to the basolateral amygdala to mediate the renewal of extinguished fear memory; the ventral hippocampus may innervate the activities of the basolateral amygdala or the central amygdala directly for the renewal. © 2017 IUBMB Life, 69(7):470-478, 2017. © 2017 International Union of Biochemistry and Molecular Biology.

Reward Processing in Adolescents with Bipolar I Disorder

Science.gov (United States)

Singh, Manpreet K.; Chang, Kiki D.; Kelley, Ryan G.; Cui, Xu; Sherdell, Lindsey; Howe, Meghan E.; Gotlib, Ian H.; Reiss, Allan L.

2013-01-01

Objective: Bipolar disorder (BD) is a debilitating psychiatric condition that commonly begins in adolescence, a developmental period that has been associated with increased reward seeking. Because youth with BD are especially vulnerable to negative risk-taking behaviors, understanding the neural mechanisms by which dysregulated affect interacts…

Research on environmental impact of water-based fire extinguishing agents

Science.gov (United States)

Wang, Shuai

2018-02-01

This paper offers current status of application of water-based fire extinguishing agents, the environmental and research considerations of the need for the study of toxicity research. This paper also offers systematic review of test methods of toxicity and environmental impact of water-based fire extinguishing agents currently available, illustrate the main requirements and relevant test methods, and offer some research findings for future research considerations. The paper also offers limitations of current study.

Active reward processing during human sleep: insights from sleep-related eating disorder

Directory of Open Access Journals (Sweden)

Lampros ePerogamvros

2012-11-01

Full Text Available In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED, a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity on reward-related questionnaires. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating disorders, our findings suggest a role of an active reward system during sleep in the manifestation of SRED.

Liquid nitrogen fire extinguishing system test report

International Nuclear Information System (INIS)

Beidelman, J.A.

1972-01-01

The objective of this test series was to demonstrate the feasibility of using liquid nitrogen as a fire-extinguishing agent for certain types of metal fires. It was intended to provide data and experience appropriate to the design of a second series which will test the applicability of this technique to plutonium fires and which will develop more detailed operating information and permit more precise measurement of test parameters-oxygen depletion rates and equilibrium concentrations, temperature effects, and nitrogen pressures, flow rates, spray methods and patterns, etc. The test series was directed specifically toward extinguishment of metal fires occurring in well-confined areas and was not intended to be representative of any larger classification. Fires of several types were tested, e.g., magnesium, mixed magnesium and zirconium, sodium and cerium

The promises and pitfalls of retrieval-extinction procedures in preventing relapse to drug seeking

Directory of Open Access Journals (Sweden)

Gavan P McNally

2013-03-01

Full Text Available Relapse to drug seeking after treatment or a period of abstinence remains a fundamental challenge for drug users. The retrieval – extinction procedure offers promise in augmenting the efficacy of exposure based treatment for drug use and for protecting against relapse to drug seeking. Preceding extinction training with a brief retrieval or reminder trial, retrieval – extinction training, has been shown to reduce reinstatement of extinguished drug seeking in animal models and also to produce profound and long lasting decrements in cue-induced craving in human heroin users. However, the mechanisms that mediate these effects of retrieval - extinction training are unclear. Moreover, under some circumstances, the retrieval – extinction procedure can significantly increase vulnerability to reinstatement in animal models.

The Colombian Policy of Rewards from the perspective of International Humanitarian Law

Directory of Open Access Journals (Sweden)

Manuel Galvis - Martínez

2010-12-01

Full Text Available The scandal caused by the assassination of a guerrilla leader by one of his subordinates and the payment of a substantial economic reward made to him by the State, led to the first questionings regarding the legality of the reward system in Colombia. This article seeks to establish if the state spon sored reward policy respects the rules of International Humanitarian Law applicable to the Colombian armed conflict. For this purpose the article will analyze both the legislative development and three of the most controversial situations raised in practice which prove the range and effects of the use of rewards as a strategic tactic within the armed conflict.

Planning an Automatic Fire Detection, Alarm, and Extinguishing System for Research Laboratories

Directory of Open Access Journals (Sweden)

Rostam Golmohamadi

2014-04-01

Full Text Available Background & Objectives: Educational and research laboratories in universities have a high risk of fire, because they have a variety of materials and equipment. The aim of this study was to provide a technical plan for safety improvement in educational and research laboratories of a university based on the design of automatic detection, alarm, and extinguishing systems . Methods : In this study, fire risk assessment was performed based on the standard of Military Risk Assessment method (MIL-STD-882. For all laboratories, detection and fire alarm systems and optimal fixed fire extinguishing systems were designed. Results : Maximum and minimum risks of fire were in chemical water and wastewater (81.2% and physical agents (62.5% laboratories, respectively. For studied laboratories, we designed fire detection systems based on heat and smoke detectors. Also in these places, fire-extinguishing systems based on CO2 were designed . Conclusion : Due to high risk of fire in studied laboratories, the best control method for fire prevention and protection based on special features of these laboratories is using automatic detection, warning and fire extinguishing systems using CO2 .

Liquefied extinguishing agent discharge to an overpressure-sensitive enclosed volume

Directory of Open Access Journals (Sweden)

Hurda Lukáš

2018-01-01

Full Text Available The throttling of liquefied substances from high pressure vessels to an enclosed volume starting at atmospheric pressure is described in order to determine thermodynamic state of the extinguished room gaseous contents. Time dependent, 0D mathematical model is implemented describing the state inside the agent container, the isenthalpic throttling in the distribution system, agent vaporization and mixing with air. The agent is modelled as real gas. Other influences on the process including the heat transfer from selected solid parts inside the room and the gas mixture leakage out of the room are taken into account. Main outcome is an MS Excel tool for integrated fire extinguishers design optimization. The optimization balances the two contradictory requirements: Agent volumetric concentration to sustain the fire extinguishing capabilities and tolerable room overpressure. Agent fill weight and discharge time are being adjusted. The discharge time is controlled by the distribution piping and spray nozzles design. System operation is checked concerning various initial and boundary conditions.

On the motivational properties of reward cues: Individual differences.

Science.gov (United States)

Robinson, Terry E; Yager, Lindsay M; Cogan, Elizabeth S; Saunders, Benjamin T

2014-01-01

Cues associated with rewards, such as food or drugs of abuse, can themselves acquire motivational properties. Acting as incentive stimuli, such cues can exert powerful control over motivated behavior, and in the case of cues associated with drugs, they can goad continued drug-seeking behavior and relapse. However, recent studies reviewed here suggest that there are large individual differences in the extent to which food and drug cues are attributed with incentive salience. Rats prone to approach reward cues (sign-trackers) attribute greater motivational value to discrete localizable cues and interoceptive cues than do rats less prone to approach reward cues (goal-trackers). In contrast, contextual cues appear to exert greater control over motivated behavior in goal-trackers than sign-trackers. It is possible to predict, therefore, before any experience with drugs, in which animals specific classes of drug cues will most likely reinstate drug-seeking behavior. The finding that different individuals may be sensitive to different triggers capable of motivating behavior and producing relapse suggests there may be different pathways to addiction, and has implications for thinking about individualized treatment. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'. Copyright © 2013 Elsevier Ltd. All rights reserved.

Evaluating psychological markers for human nicotine dependence: tobacco choice, extinction, and Pavlovian-to-instrumental transfer.

Science.gov (United States)

Hogarth, Lee; Chase, Henry W

2012-06-01

Individual differences in drug dependence may be mediated by several abnormalities in associative learning, including perseveration of drug-seeking following contingency change, greater control over drug-seeking by Pavlovian stimuli, or greater sensitivity to drug reinforcement establishing higher rates of drug-seeking. To evaluate these three candidate markers for nicotine dependence, Experiment 1 contrasted daily (N = 22) and nondaily smoker groups (N = 22) on a novel instrumental learning task, where one S+ was first trained as a predictor of tobacco reward before being extinguished. Experiment 2 compared daily (N = 18) and nondaily smoker groups (N = 18) on a concurrent-choice task for tobacco and chocolate reward before an extinction test in which the tobacco response was extinguished, followed by a Pavlovian-to-instrumental transfer test, wherein the impact of tobacco and chocolate cues on concurrent choice was measured (gender was balanced within each smoker group). The results showed no group difference in sensitivity to extinction of either the stimulus-drug or response-drug contingency in Experiments 1 and 2, respectively, nor did groups show a difference in Pavlovian-to-instrumental transfer of control over tobacco choice. By contrast, nicotine-dependence status was marked by a higher frequency of tobacco choice in the concurrent-choice procedure, and this choice preference was associated with subjective craving (gender did not affect any behavioral measure). These results favor the view that nicotine dependence in this sample is not determined by individual predilection for perseveration or stimulus-control over drug-seeking, but by greater sensitivity to reinforcement of instrumental drug choice. Value-based decision theories of dependence are discussed.

Dopamine reward prediction error responses reflect marginal utility.

Science.gov (United States)

Stauffer, William R; Lak, Armin; Schultz, Wolfram

2014-11-03

Optimal choices require an accurate neuronal representation of economic value. In economics, utility functions are mathematical representations of subjective value that can be constructed from choices under risk. Utility usually exhibits a nonlinear relationship to physical reward value that corresponds to risk attitudes and reflects the increasing or decreasing marginal utility obtained with each additional unit of reward. Accordingly, neuronal reward responses coding utility should robustly reflect this nonlinearity. In two monkeys, we measured utility as a function of physical reward value from meaningful choices under risk (that adhered to first- and second-order stochastic dominance). The resulting nonlinear utility functions predicted the certainty equivalents for new gambles, indicating that the functions' shapes were meaningful. The monkeys were risk seeking (convex utility function) for low reward and risk avoiding (concave utility function) with higher amounts. Critically, the dopamine prediction error responses at the time of reward itself reflected the nonlinear utility functions measured at the time of choices. In particular, the reward response magnitude depended on the first derivative of the utility function and thus reflected the marginal utility. Furthermore, dopamine responses recorded outside of the task reflected the marginal utility of unpredicted reward. Accordingly, these responses were sufficient to train reinforcement learning models to predict the behaviorally defined expected utility of gambles. These data suggest a neuronal manifestation of marginal utility in dopamine neurons and indicate a common neuronal basis for fundamental explanatory constructs in animal learning theory (prediction error) and economic decision theory (marginal utility). Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

Science.gov (United States)

Schultz, Wolfram

2004-04-01

Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.

Sodium fires and its extinguishment

International Nuclear Information System (INIS)

Mikhedov, V.G.

1979-01-01

The fire safety problems of NPP with sodium coolants in USSR are presented. The design of sodium reactors is made with premises with sodium coolants being hermetic and filled with nitrogen. Some engineering solutions of fire safety including design, elaboration and choice of construction and protection materials are presented. Some theoretical aspects of sodium burning are presented as well as methods of sodium fire extinguishing methods including the use of powder

Dopamine modulates reward system activity during subconscious processing of sexual stimuli.

Science.gov (United States)

Oei, Nicole Y L; Rombouts, Serge Arb; Soeter, Roelof P; van Gerven, Joop M; Both, Stephanie

2012-06-01

Dopaminergic medication influences conscious processing of rewarding stimuli, and is associated with impulsive-compulsive behaviors, such as hypersexuality. Previous studies have shown that subconscious subliminal presentation of sexual stimuli activates brain areas known to be part of the 'reward system'. In this study, it was hypothesized that dopamine modulates activation in key areas of the reward system, such as the nucleus accumbens, during subconscious processing of sexual stimuli. Young healthy males (n=53) were randomly assigned to two experimental groups or a control group, and were administered a dopamine antagonist (haloperidol), a dopamine agonist (levodopa), or placebo. Brain activation was assessed during a backward-masking task with subliminally presented sexual stimuli. Results showed that levodopa significantly enhanced the activation in the nucleus accumbens and dorsal anterior cingulate when subliminal sexual stimuli were shown, whereas haloperidol decreased activations in those areas. Dopamine thus enhances activations in regions thought to regulate 'wanting' in response to potentially rewarding sexual stimuli that are not consciously perceived. This running start of the reward system might explain the pull of rewards in individuals with compulsive reward-seeking behaviors such as hypersexuality and patients who receive dopaminergic medication.

Pleasure seeking and birdsong.

Science.gov (United States)

Riters, Lauren V

2011-10-01

Songbirds sing at high rates within multiple contexts, suggesting that they are highly motivated to communicate and that the act of singing itself may be rewarding. Little is known about the neural regulation of the motivation to communicate. Dopamine and opioid neuropeptides play a primary role in reward seeking and sensory pleasure. In songbirds, these neurochemicals are found within brain regions implicated in both motivation and reward, including the medial preoptic nucleus (mPOA) and ventral tegmental area (VTA). Several lines of research indicate that dopamine and opioids in these regions play a role in birdsong that differs depending upon whether song is used to attract females (female-directed song) or is not directed towards other individuals (undirected song). Evidence is reviewed supporting the hypotheses: (1) that distinct patterns of dopamine activity influence the motivation to produce undirected and female-directed song, (2) that undirected communication is intrinsically reinforced by immediate release of opioids induced by the act of singing, and (3) that directed communication is socially reinforced by opioids released as part of social interactions. Copyright © 2011 Elsevier Ltd. All rights reserved.

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals.

Science.gov (United States)

Doremus-Fitzwater, Tamara L; Spear, Linda P

2016-11-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a "reward-centric" phenotype-an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a "reward deficiency" syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater "pleasure" from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. Copyright © 2016 Elsevier Ltd. All rights reserved.

Circuits regulating pleasure and happiness:the evolution of reward-seeking and misery-fleeing behavioral mechanisms in vertebrates

Directory of Open Access Journals (Sweden)

Anton J.M. Loonen

2015-10-01

Full Text Available The very first free-moving animals in the oceans over 540 million years ago must have been able to obtain food, territory and shelter, as well as reproduce. Therefore, they would have needed regulatory mechanisms to induce movements enabling achievement of these prerequisites for survival. It can be useful to consider these mechanisms in primitive chordates, which represent our earliest ancestors, to develop hypotheses addressing how these essential parts of human behavior are regulated and relate to more sophisticated behavioral manifestations such as mood. An animal comparable to lampreys was the earliest known vertebrate with a modern forebrain consisting of old and new cortical parts. Lampreys have a separate dorsal pallium, the forerunner of the most recently developed part of the cerebral cortex. In addition, the lamprey extrapyramidal system, which regulates movement, is modern. However, in lampreys and their putative forerunners, the hagfishes, the striatum, which is the input part of this extrapyramidal system, probably corresponds to the human centromedial amygdala, which in higher vertebrates is part of a system mediating fear and anxiety. Both animals have well-developed nuclear habenulae, which are involved in several critical behaviors; in lampreys this system regulates the reward system that reinforces appetitive-seeking behavior or the avoidance system that reinforces flight behavior resulting from negative inputs. Lampreys also have a distinct glutamatergic nucleus, the so-called habenula-projection globus pallidus, which receives input from glutamatergic and GABAergic signals and gives output to the lateral habenula. Via this route, this nucleus influences midbrain monoaminergic nuclei and regulates the food acquisition system. These various structures involved in motor regulation in the lampreys may be conserved in humans and include two complementary mechanisms for reward reinforcement and avoidance behaviors. The first

Circuits regulating pleasure and happiness: the evolution of reward-seeking and misery-fleeing behavioral mechanisms in vertebrates.

Science.gov (United States)

Loonen, Anton J M; Ivanova, Svetlana A

2015-01-01

The very first free-moving animals in the oceans over 540 million years ago must have been able to obtain food, territory, and shelter, as well as reproduce. Therefore, they would have needed regulatory mechanisms to induce movements enabling achievement of these prerequisites for survival. It can be useful to consider these mechanisms in primitive chordates, which represent our earliest ancestors, to develop hypotheses addressing how these essential parts of human behavior are regulated and relate to more sophisticated behavioral manifestations such as mood. An animal comparable to lampreys was the earliest known vertebrate with a modern forebrain consisting of old and new cortical parts. Lampreys have a separate dorsal pallium, the forerunner of the most recently developed part of the cerebral cortex. In addition, the lamprey extrapyramidal system (EPS), which regulates movement, is modern. However, in lampreys and their putative forerunners, the hagfishes, the striatum, which is the input part of this EPS, probably corresponds to the human centromedial amygdala, which in higher vertebrates is part of a system mediating fear and anxiety. Both animals have well-developed nuclear habenulae, which are involved in several critical behaviors; in lampreys this system regulates the reward system that reinforces appetitive-seeking behavior or the avoidance system that reinforces flight behavior resulting from negative inputs. Lampreys also have a distinct glutamatergic nucleus, the so-called habenula-projection globus pallidus, which receives input from glutamatergic and GABAergic signals and gives output to the lateral habenula. Via this route, this nucleus influences midbrain monoaminergic nuclei and regulates the food acquisition system. These various structures involved in motor regulation in the lampreys may be conserved in humans and include two complementary mechanisms for reward reinforcement and avoidance behaviors. The first system is associated with

The Effect of Extinguishing Agents on Burning Sonobuoys Containing Lithium-Sulfur Dioxide Batteries

Science.gov (United States)

1989-09-01

components and the JP-5. In addition, the types of extinguish- ment materials, such as carbor spheres, that have some degree of success on metal fires , would...NWC TP 6571, publication UNCLASSIFIED.) 8. John F. Riley. "Na-X, a New Fire Extinguishing Agent for Metal Fires ," Fire Technology, Vol. 10, No. 4

Tsallis’ non-extensive free energy as a subjective value of an uncertain reward

Science.gov (United States)

Takahashi, Taiki

2009-03-01

Recent studies in neuroeconomics and econophysics revealed the importance of reward expectation in decision under uncertainty. Behavioral neuroeconomic studies have proposed that the unpredictability and the probability of an uncertain reward are distinctly encoded as entropy and a distorted probability weight, respectively, in the separate neural systems. However, previous behavioral economic and decision-theoretic models could not quantify reward-seeking and uncertainty aversion in a theoretically consistent manner. In this paper, we have: (i) proposed that generalized Helmholtz free energy in Tsallis’ non-extensive thermostatistics can be utilized to quantify a perceived value of an uncertain reward, and (ii) empirically examined the explanatory powers of the models. Future study directions in neuroeconomics and econophysics by utilizing the Tsallis’ free energy model are discussed.

Alcohol-seeking and relapse: A focus on incentive salience and contextual conditioning.

Science.gov (United States)

Valyear, Milan D; Villaruel, Franz R; Chaudhri, Nadia

2017-08-01

Environmental stimuli that reliably accompany alcohol intake can become associated with the pharmacological effects of alcohol through classical (Pavlovian) conditioning. Of growing interest to addiction researchers is whether or not this process results in the attribution of incentive salience to alcohol-predictive cues, which could motivate alcohol-seeking behavior and relapse. To evaluate this question, we present a review of rodent behavioral studies that examined the capacity of alcohol-predictive cues to (i) support sign-tracking behavior, (ii) serve as conditioned reinforcers, and (iii) produce Pavlovian-to-instrumental transfer. A second, emerging area of research is focused on delineating the role of context in alcohol-seeking behavior and relapse. Here, we review studies showing that alcohol-associated contexts (i) support conditioned place preference, (ii) renew extinguished alcohol-seeking behavior, and (iii) modulate alcohol-seeking responses elicited by discrete alcohol-predictive cues. These behavioral effects may be mediated by unique psychological processes, and have important implications for cue-reactivity studies and neurobiological research. Copyright © 2017 Elsevier B.V. All rights reserved.

Process and fire extinguishing system for inflammable liquids

International Nuclear Information System (INIS)

Levillain, C.

1988-01-01

A fire on the surface of a flammable liquid is extinguished by spreading a compact layer of sphere of uniform diameter, floating on the liquid surface. Spheres are stored in a tank and run out by gravity [fr

Literature study regarding fire protection in nuclear power plants. Part 2: Fire detection and -extinguishing systems

International Nuclear Information System (INIS)

Isaksson, S.

1996-01-01

This literature study has been made on behalf of the Swedish Nuclear Power Inspectorate. The aim is to describe different aspects of fire protection in nuclear power plants. Detection and extinguishing systems in Swedish nuclear power plants have only to a limited extent been designed after functional demands, such as a maximum acceptable damage or a maximum time to detect a fire. The availability of detection systems is difficult to assess, partly because of lack of statistics. The user interface is very important in complex systems as nuclear plants. An extinguishing system designed according to the insurance companies' regulations will only fulfill the basic demands. It should be noted that normal sprinkler design does not aim for extinguishing fires, the objective is to control fire until manual extinguishment is possible. There is a great amount of statistics on wet and dry pipe sprinkler systems, while statistics are more scarce for deluge systems. The statistics on the reliability of gaseous extinguishing systems have been found very scarce. A drawback of these systems is that they are normally designed for one shot only. There are both traditional and more recent extinguishing systems that can replace halons. From now on there will be a greater need for a thorough examination of the properties needed for the individual application and a quantification of the acceptable damage. There are several indications on the importance of a high quality maintenance program as well as carefully developed routines for testing and surveillance to ensure the reliability of detection and extinguishing systems. 78 refs, 8 figs, 10 tabs

Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection.

Science.gov (United States)

Ostlund, Sean B; Maidment, Nigel T

2012-01-01

Environmental cues affect our behavior in a variety of ways. Despite playing an invaluable role in guiding our daily activities, such cues also appear to trigger the harmful, compulsive behaviors that characterize addiction and other disorders of behavioral control. In instrumental conditioning, rewards and reward-paired cues bias action selection and invigorate reward-seeking behaviors, and appear to do so through distinct neurobehavioral processes. Although reward-paired cues are known to invigorate performance through a dopamine-dependent incentive motivational process, it is not known if dopamine also mediates the influence of rewards and reward-paired cues over action selection. The current study contrasted the effects of systemic administration of the nonspecific dopamine receptor antagonist flupentixol on response invigoration and action bias in Pavlovian-instrumental transfer, a test of cue-elicited responding, and in instrumental reinstatement, a test of noncontingent reward-elicited responding. Hungry rats were trained on two different stimulus-outcome relationships (eg, tone-grain pellets and noise-sucrose solution) and two different action-outcome relationships (eg, left press-grain and right press-sucrose). At test, we found that flupentixol pretreatment blocked the response invigoration generated by the cues but spared their ability to bias action selection to favor the action whose outcome was signaled by the cue being presented. The response-biasing influence of noncontingent reward deliveries was also unaffected by flupentixol. Interestingly, although flupentixol had a modest effect on the immediate response invigoration produced by those rewards, it was particularly potent in countering the lingering enhancement of responding produced by multiple reward deliveries. These findings indicate that dopamine mediates the general incentive motivational effects of noncontingent rewards and reward-paired cues but does not support their ability to bias

The metabotropic glutamate 5 receptor modulates extinction and reinstatement of methamphetamine-seeking in mice.

Directory of Open Access Journals (Sweden)

Rose Chesworth

Full Text Available Methamphetamine (METH is a highly addictive psychostimulant with no therapeutics registered to assist addicts in discontinuing use. Glutamatergic dysfunction has been implicated in the development and maintenance of addiction. We sought to assess the involvement of the metabotropic glutamate 5 receptor (mGlu5 in behaviours relevant to METH addiction because this receptor has been implicated in the actions of other drugs of abuse, including alcohol, cocaine and opiates. mGlu5 knockout (KO mice were tested in intravenous self-administration, conditioned place preference and locomotor sensitization. Self-administration of sucrose was used to assess the response of KO mice to a natural reward. Acquisition and maintenance of self-administration, as well as the motivation to self-administer METH was intact in mGlu5 KO mice. Importantly, mGlu5 KO mice required more extinction sessions to extinguish the operant response for METH, and exhibited an enhanced propensity to reinstate operant responding following exposure to drug-associated cues. This phenotype was not present when KO mice were tested in an equivalent paradigm assessing operant responding for sucrose. Development of conditioned place preference and locomotor sensitization were intact in KO mice; however, conditioned hyperactivity to the context previously paired with drug was elevated in KO mice. These data demonstrate a role for mGlu5 in the extinction and reinstatement of METH-seeking, and suggests a role for mGlu5 in regulating contextual salience.

Dorsal-CA1 Hippocampal Neuronal Ensembles Encode Nicotine-Reward Contextual Associations.

Science.gov (United States)

Xia, Li; Nygard, Stephanie K; Sobczak, Gabe G; Hourguettes, Nicholas J; Bruchas, Michael R

2017-06-06

Natural and drug rewards increase the motivational valence of stimuli in the environment that, through Pavlovian learning mechanisms, become conditioned stimuli that directly motivate behavior in the absence of the original unconditioned stimulus. While the hippocampus has received extensive attention for its role in learning and memory processes, less is known regarding its role in drug-reward associations. We used in vivo Ca 2+ imaging in freely moving mice during the formation of nicotine preference behavior to examine the role of the dorsal-CA1 region of the hippocampus in encoding contextual reward-seeking behavior. We show the development of specific neuronal ensembles whose activity encodes nicotine-reward contextual memories and that are necessary for the expression of place preference. Our findings increase our understanding of CA1 hippocampal function in general and as it relates to reward processing by identifying a critical role for CA1 neuronal ensembles in nicotine place preference. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Effects of Cannabinoid Exposure during Adolescence on the Conditioned Rewarding Effects of WIN 55212-2 and Cocaine in Mice: Influence of the Novelty-Seeking Trait

Directory of Open Access Journals (Sweden)

M. Rodríguez-Arias

2016-01-01

Full Text Available Adolescent exposure to cannabinoids enhances the behavioural effects of cocaine, and high novelty-seeking trait predicts greater sensitivity to the conditioned place preference (CPP induced by this drug. Our aim was to evaluate the influence of novelty-seeking on the effects of adolescent cannabinoid exposure. Adolescent male mice were classified as high or low novelty seekers (HNS and LNS in the hole-board test. First, we evaluated the CPP induced by the cannabinoid agonist WIN 55212-2 (0.05 and 0.075 mg/kg, i.p. in HNS and LNS mice. Then, HNS and LNS mice were pretreated i.p. with vehicle, WIN 55212-2 (0.1 mg/kg, or cannabinoid antagonist rimonabant (1 mg/kg and were subsequently conditioned with WIN 55212-2 (0.05 mg/kg, i.p. or cocaine (1 or 6 mg/kg, i.p.. Only HNS mice conditioned with the 0.075 mg/kg dose acquired CPP with WIN 55212-2. Adolescent exposure to this cannabinoid agonist increased the rewarding effects of 1 mg/kg of cocaine in both HNS and LNS mice, and in HNS mice it also increased the reinstating effect of a low dose of cocaine. Our results endorse a role for individual differences such as a higher propensity for sensation-seeking in the development of addiction.

Bio-robots automatic navigation with graded electric reward stimulation based on Reinforcement Learning.

Science.gov (United States)

Zhang, Chen; Sun, Chao; Gao, Liqiang; Zheng, Nenggan; Chen, Weidong; Zheng, Xiaoxiang

2013-01-01

Bio-robots based on brain computer interface (BCI) suffer from the lack of considering the characteristic of the animals in navigation. This paper proposed a new method for bio-robots' automatic navigation combining the reward generating algorithm base on Reinforcement Learning (RL) with the learning intelligence of animals together. Given the graded electrical reward, the animal e.g. the rat, intends to seek the maximum reward while exploring an unknown environment. Since the rat has excellent spatial recognition, the rat-robot and the RL algorithm can convergent to an optimal route by co-learning. This work has significant inspiration for the practical development of bio-robots' navigation with hybrid intelligence.

The effects of compound stimulus extinction and inhibition of noradrenaline reuptake on the renewal of alcohol seeking

Science.gov (United States)

Furlong, T M; Pan, M J; Corbit, L H

2015-01-01

Alcohol-related stimuli can trigger relapse of alcohol-seeking behaviors even after extended periods of abstinence. Extinction of such stimuli can reduce their impact on relapse; however, the expression of extinction can be disrupted when testing occurs outside the context where extinction learning took place, an effect termed renewal. Behavioral and pharmacological methods have recently been shown to augment extinction learning; yet, it is not known whether the improved expression of extinction following these treatments remains context-dependent. Here we examined whether two methods, compound–stimulus extinction and treatment with the noradrenaline reuptake inhibitor atomoxetine, would reduce the vulnerability of extinction to a change in context. Following alcohol self-administration, responding was extinguished in a distinct context. After initial extinction, further extinction was given to a target stimulus presented in compound with another alcohol-predictive stimulus intended to augment prediction error (Experiment 1) or after a systemic injection of atomoxetine (1.0 mg kg−1; Experiment 2). A stimulus extinguished as part of a compound elicited less responding than a stimulus receiving equal extinction alone regardless of whether animals were tested in the training or extinction context; however, reliable renewal was not observed in this paradigm. Importantly, atomoxetine enhanced extinction relative to controls even in the presence of a reliable renewal effect. Thus, extinction of alcohol-seeking behavior can be improved by extinguishing multiple alcohol-predictive stimuli or enhancing noradrenaline neurotransmission during extinction training. Importantly, both methods improve extinction even when the context is changed between extinction training and test, and thus could be utilized to enhance the outcome of extinction-based treatments for alcohol-use disorders. PMID:26327688

Relapse to cocaine seeking in an invertebrate.

Science.gov (United States)

Amaning-Kwarteng, Akua O; Asif-Malik, Aman; Pei, Yue; Canales, Juan J

2017-06-01

Addiction is characterised by cycles of compulsive drug taking, periods of abstinence and episodes of relapse. The extinction/reinstatement paradigm has been extensively used in rodents to model human relapse and explore underlying mechanisms and therapeutics. However, relapse to drug seeking behaviour has not been previously demonstrated in invertebrates. Here, we used a cocaine conditioned place preference (CPP) paradigm in the flatworm, planarian, followed by extinction and reinstatement of drug seeking. Once baseline preference was established for one of two distinctly textured environments (i.e. compartments with a coarse or smooth surface), planarian received pairings of cocaine (5μM) in the non-preferred, and vehicle in the most preferred, environment, and were tested for conditioning thereafter. Cocaine produced robust CPP, measured as a significant increase in the time spent in the cocaine-paired compartment. Subsequently, planarian underwent extinction training, reverting back to their original preference within three sessions. Brief exposure to cocaine (5μM) or methamphetamine (5μM) reinstated cocaine-seeking behaviour. By contrast, the high affinity dopamine transporter inhibitor, (N-(n-butyl)-3α-[bis (4-fluorophenyl) methoxy]-tropane) (JHW007), which in rodents exhibits a neurochemical and behavioural profile distinct from cocaine, was ineffective. The present findings demonstrate for the first time reinstatement of extinguished cocaine seeking in an invertebrate model and suggest that the long-term adaptations underlying drug conditioning and relapse are highly conserved through evolution. Copyright © 2017 Elsevier Inc. All rights reserved.

Ignition and combustion of sodium, fire consequences, extinguishment and prevention

International Nuclear Information System (INIS)

Malet, J.C.

1996-01-01

This document presents the results of work carried out at the IPSN on: sodium inflammation, sodium combustion (pool fires and sprayed jet fires), extinguishment (passive means and extinguishing powder), the physico-chemical behaviour of aerosols and their filtration, the protection means of concretes, intervention during and after a fire, treatment of residues, intervention equipment. The calculation codes developed during these studies are described. The experimental basis which allowed the qualification of these codes and the technological means aimed at prevention and sodium fire fighting, was obtained using programmes carried out in the experimental facilities existing in Cadarache or in collaboration with the German teams of Karlsruhe

Ignition and combustion of sodium, fire consequences, extinguishment and prevention

Energy Technology Data Exchange (ETDEWEB)

Malet, J C [Institut de Protection et de Surete Nucleaire, Laboratoire d' Experimentation de Modelisation des Feux, C.E. Cadarache, Saint-Paul-lez-Durance (France). E-mail: malet at ipsncad.cea.fr

1996-07-01

This document presents the results of work carried out at the IPSN on: sodium inflammation, sodium combustion (pool fires and sprayed jet fires), extinguishment (passive means and extinguishing powder), the physico-chemical behaviour of aerosols and their filtration, the protection means of concretes, intervention during and after a fire, treatment of residues, intervention equipment. The calculation codes developed during these studies are described. The experimental basis which allowed the qualification of these codes and the technological means aimed at prevention and sodium fire fighting, was obtained using programmes carried out in the experimental facilities existing in Cadarache or in collaboration with the German teams of Karlsruhe.

Cocaine enhances resistance to extinction of responding for brain-stimulation reward in adult prenatally stressed rats.

Science.gov (United States)

Gao, Shuibo; Suenaga, Toshiko; Oki, Yutaka; Yukie, Masao; Nakahara, Daiichiro

2011-10-01

The present experiment assessed whether prenatal stress (PS) can alter the ability of acute and chronic cocaine administration to increase and decrease the rewarding effectiveness of the medial forebrain bundle (MFB) using intracranial self-stimulation (ICSS), and also whether PS can affect the extinction of the MFB stimulation response. Adult male offspring of female rats that received PS or no PS (nPS) were implanted with MFB stimulating electrodes, and were then tested in ICSS paradigms. In both nPS and PS offspring, acute cocaine injection decreased ICSS thresholds dose-dependently. However, the threshold-lowering effects at any dose were not significantly different between groups. There was also no group-difference in the threshold-elevating effects of chronic cocaine administration. Nevertheless, chronically drug-administered PS rats exhibited a resistance to the extinguishing of the response for brain-stimulation reward when acutely treated with cocaine, as compared to extinction without cocaine treatment. The results suggest that PS may weaken the ability for response inhibition under cocaine loading in male adult offspring. Copyright © 2011 Elsevier B.V. All rights reserved.

Effects of cannabinoid CB₁ receptor antagonist rimonabant on acquisition and reinstatement of psychostimulant reward memory in mice.

Science.gov (United States)

Yu, Lu-Lu; Zhou, Shuang-Jiang; Wang, Xue-Yi; Liu, Jian-Feng; Xue, Yan-Xue; Jiang, Wengao; Lu, Lin

2011-02-02

Drug addiction processes are considered to be mainly controlled by the mesocorticolimbic dopamine system. Cannabinoids, a class of psychoactive drugs of abuse, elicit their rewarding and pharmacological effects through the endocannabinoid system. Previous research has indicated that dopaminergic neurons in the mesocorticolimbic system are also under the control of the endocannabinoid system. Recently, evidence has suggested that the endocannabinoid system may also participate in the modulation of the common reward system. The present study examined whether rimonabant, a cannabinoid CB₁ receptor antagonist, disrupts the acquisition and reinstatement of psychostimulant reward memory measured by conditioned place preference (CPP). Mice were trained to acquire methamphetamine or cocaine-induced CPP. A priming injection of methamphetamine (0.5 mg/kg, i.p.) or cocaine (5 mg/kg, i.p.) was respectively given to reinstate methamphetamine or cocaine-induced CPP after extinction. Vehicle or rimonabant (1 or 3 mg/kg, i.p.) was administered at different time-points: 30 min before each CPP training session (acquisition) or 30 min before the priming injection (reinstatement). Rimonabant at doses of 1 and 3 mg/kg significantly inhibited the acquisition of methamphetamine- and cocaine-induced CPP. At the high dose (3 mg/kg), rimonabant disrupted the reinstatement of extinguished methamphetamine- or cocaine-induced CPP. These findings indicate that cannabinoid CB₁ receptors play a major role in psychostimulant reward memory, and rimonabant may be a potential pharmacotherapy for psychostimulant addiction. Copyright © 2010. Published by Elsevier B.V.

Differential Contributions of Nucleus Accumbens Subregions to Cue-Guided Risk/Reward Decision Making and Implementation of Conditional Rules.

Science.gov (United States)

Floresco, Stan B; Montes, David R; Tse, Maric M T; van Holstein, Mieke

2018-02-21

The nucleus accumbens (NAc) is a key node within corticolimbic circuitry for guiding action selection and cost/benefit decision making in situations involving reward uncertainty. Preclinical studies have typically assessed risk/reward decision making using assays where decisions are guided by internally generated representations of choice-outcome contingencies. Yet, real-life decisions are often influenced by external stimuli that inform about likelihoods of obtaining rewards. How different subregions of the NAc mediate decision making in such situations is unclear. Here, we used a novel assay colloquially termed the "Blackjack" task that models these types of situations. Male Long-Evans rats were trained to choose between one lever that always delivered a one-pellet reward and another that delivered four pellets with different probabilities [either 50% (good-odds) or 12.5% (poor-odds)], which were signaled by one of two auditory cues. Under control conditions, rats selected the large/risky option more often on good-odds versus poor-odds trials. Inactivation of the NAc core caused indiscriminate choice patterns. In contrast, NAc shell inactivation increased risky choice, more prominently on poor-odds trials. Additional experiments revealed that both subregions contribute to auditory conditional discrimination. NAc core or shell inactivation reduced Pavlovian approach elicited by an auditory CS+, yet shell inactivation also increased responding during presentation of a CS-. These data highlight distinct contributions for NAc subregions in decision making and reward seeking guided by discriminative stimuli. The core is crucial for implementation of conditional rules, whereas the shell refines reward seeking by mitigating the allure of larger, unlikely rewards and reducing expression of inappropriate or non-rewarded actions. SIGNIFICANCE STATEMENT Using external cues to guide decision making is crucial for adaptive behavior. Deficits in cue-guided behavior have been

Seeking to recognize order in nature

International Nuclear Information System (INIS)

1968-01-01

Do scientists seek material rewards? What are the changes in modern scientific work? Has the scientist a sense of responsibility to society? These questions were dealt with in a talk given at the Trieste Symposium on Contemporary Physics in June by E.P. Wigner, 1963 Nobel Laureate, one of the 'Grand Old Men' who took part in an evening series under the Title 'From a Life of Physics'. (author)

Cocaine Dysregulates Opioid Gating of GABA Neurotransmission in the Ventral Pallidum

Science.gov (United States)

Scofield, Michael D.; Rice, Kenner C.; Cheng, Kejun; Roques, Bernard P.

2014-01-01

The ventral pallidum (VP) is a target of dense nucleus accumbens projections. Many of these projections coexpress GABA and the neuropeptide enkephalin, a δ and μ opioid receptor (MOR) ligand. Of these two, the MOR in the VP is known to be involved in reward-related behaviors, such as hedonic responses to palatable food, alcohol intake, and reinstatement of cocaine seeking. Stimulating MORs in the VP decreases extracellular GABA, indicating that the effects of MORs in the VP on cocaine seeking are via modulating GABA neurotransmission. Here, we use whole-cell patch-clamp on a rat model of withdrawal from cocaine self-administration to test the hypothesis that MORs presynaptically regulate GABA transmission in the VP and that cocaine withdrawal changes the interaction between MORs and GABA. We found that in cocaine-extinguished rats pharmacological activation of MORs no longer presynaptically inhibited GABA release, whereas blocking the MORs disinhibited GABA release. Moreover, MOR-dependent long-term depression of GABA neurotransmission in the VP was lost in cocaine-extinguished rats. Last, GABA neurotransmission was found to be tonically suppressed in cocaine-extinguished rats. These substantial synaptic changes indicated that cocaine was increasing tone on MOR receptors. Accordingly, increasing endogenous tone by blocking the enzymatic degradation of enkephalin inhibited GABA neurotransmission in yoked saline rats but not in cocaine-extinguished rats. In conclusion, our results indicate that following withdrawal from cocaine self-administration enkephalin levels in the VP are elevated and the opioid modulation of GABA neurotransmission is impaired. This may contribute to the difficulties withdrawn addicts experience when trying to resist relapse. PMID:24431463

Ventral striatum activation to prosocial rewards predicts longitudinal declines in adolescent risk taking.

Science.gov (United States)

Telzer, Eva H; Fuligni, Andrew J; Lieberman, Matthew D; Galván, Adriana

2013-01-01

Adolescence is a period of intensified emotions and an increase in motivated behaviors and passions. Evidence from developmental neuroscience suggests that this heightened emotionality occurs, in part, due to a peak in functional reactivity to rewarding stimuli, which renders adolescents more oriented toward reward-seeking behaviors. Most prior work has focused on how reward sensitivity may create vulnerabilities, leading to increases in risk taking. Here, we test whether heightened reward sensitivity may potentially be an asset for adolescents when engaged in prosocial activities. Thirty-two adolescents were followed over a one-year period to examine whether ventral striatum activation to prosocial rewards predicts decreases in risk taking over a year. Results show that heightened ventral striatum activation to prosocial stimuli relates to longitudinal declines in risk taking. Therefore, the very same neural region that has conferred vulnerability for adolescent risk taking may also be protective against risk taking. Copyright © 2012 Elsevier Ltd. All rights reserved.

Reward-related brain response and craving correlates of marijuana cue exposure: a preliminary study in treatment-seeking marijuana-dependent subjects.

Science.gov (United States)

Goldman, Marina; Szucs-Reed, Regina P; Jagannathan, Kanchana; Ehrman, Ronald N; Wang, Ze; Li, Yin; Suh, Jesse J; Kampman, Kyle; O'Brien, Charles P; Childress, Anna Rose; Franklin, Teresa R

2013-01-01

: Determining the brain substrates underlying the motivation to abuse addictive drugs is critical for understanding and treating addictive disorders. Laboratory neuroimaging studies have demonstrated differential activation of limbic and motivational circuitry (eg, amygdala, hippocampus, ventral striatum, insula, and orbitofrontal cortex) triggered by cocaine, heroin, nicotine, and alcohol cues. The literature on neural responses to marijuana cues is sparse. Thus, the goals of this study were to characterize the brain's response to marijuana cues, a major motivator underlying drug use and relapse, and determine whether these responses are linked to self-reported craving in a clinically relevant population of treatment-seeking marijuana-dependent subjects. : Marijuana craving was assessed in 12 marijuana-dependent subjects using the Marijuana Craving Questionnaire-Short Form. Subsequently, blood oxygen level dependent functional magnetic resonance imaging data were acquired during exposure to alternating 20-second blocks of marijuana-related versus matched nondrug visual cues. : Brain activation during marijuana cue exposure was significantly greater in the bilateral amygdala and the hippocampus. Significant positive correlations between craving scores and brain activation were found in the ventral striatum and the medial and lateral orbitofrontal cortex (P cues and craving and extends the current literature on marijuana cue reactivity. Furthermore, the correlative relationship between craving and brain activity in reward-related regions was observed in a clinically relevant sample (treatment-seeking marijuana-dependent subjects). Results are consistent with prior findings in cocaine, heroin, nicotine, and alcohol cue studies, indicating that the brain substrates of cue-triggered drug motivation are shared across abused substances.

Dopamine agonist increases risk taking but blunts reward-related brain activity.

Directory of Open Access Journals (Sweden)

Jordi Riba

Full Text Available The use of D2/D3 dopaminergic agonists in Parkinson's disease (PD may lead to pathological gambling. In a placebo-controlled double-blind study in healthy volunteers, we observed riskier choices in a lottery task after administration of the D3 receptor-preferring agonist pramipexole thus mimicking risk-taking behavior in PD. Moreover, we demonstrate decreased activation in the rostral basal ganglia and midbrain, key structures of the reward system, following unexpected high gains and therefore propose that pathological gambling in PD results from the need to seek higher rewards to overcome the blunted response in this system.

The impact of a total reward system of work engagement

Directory of Open Access Journals (Sweden)

Crystal Hoole

2016-11-01

Research purpose: The overall purpose of this study was to explore the relationship between total rewards and work engagement in a South African context and to determine which reward categories predict work engagement. The study further endeavoured to determine whether gender and age had a moderating effect on the relationship between total rewards and engagement. Motivation for the study: Statistics report that less than 30% of all working people are optimally engaged in their work. Considering that individuals spend more than a third of their lives at work committing themselves emotionally, physically and psychologically – research indicates that employees are no longer satisfied with traditional reward systems and want to feel valued and appreciated. Research approach, design and method: In this quantitative, cross-sectional research design using a non-probability convenience and purposive sampling strategy, 318 questionnaires were collected and analysed from financial institutions in Gauteng in which opinions were sought on the importance of different types of rewards structures and preferences, and how engaged they are in their workplace. The 17-item UWES and Nienaber total reward preference model were the chosen measuring instruments. Main findings: A small statistically significant correlation (r = 0.25; p < 0.05; small effect was found between total rewards and work engagement, and 12% of the variance of work engagement was explained. Only performance and career management significantly predicted work engagement. Practical/Managerial implications: Although small, the significant correlation between total rewards and work engagement implies that total rewards are important motivators for employees in the workplace. Of the total rewards scales tested, only performance and career management significantly predicted work engagement, suggesting that more research is needed. Organisations seeking to implement total reward strategies should pay specific

Radio frequency security system, method for a building facility or the like, and apparatus and methods for remotely monitoring the status of fire extinguishers

Science.gov (United States)

Runyon, Larry [Richland, WA; Gunter, Wayne M [Richland, WA; Gilbert, Ronald W [Gilroy, CA

2006-07-25

A system for remotely monitoring the status of one or more fire extinguishers includes means for sensing at least one parameter of each of the fire extinguishers; means for selectively transmitting the sensed parameters along with information identifying the fire extinguishers from which the parameters were sensed; and means for receiving the sensed parameters and identifying information for the fire extinguisher or extinguishers at a common location. Other systems and methods for remotely monitoring the status of multiple fire extinguishers are also provided.

Personality correlates of individual differences in the recruitment of cognitive mechanisms when rewards are at stake.

Science.gov (United States)

Heritage, Allan J; Long, Laura J; Woodman, Geoffrey F; Zald, David H

2018-02-01

Individuals differ greatly in their sensitivity to rewards and punishments. In the extreme, these differences are implicated in a range of psychiatric disorders from addiction to depression. However, it is unclear how these differences influence the recruitment of attention, working memory, and long-term memory when responding to potential rewards. Here, we used a rewarded memory-guided visual search task and ERPs to examine the influence of individual differences in self-reported reward/punishment sensitivity, as measured by the Behavioral Inhibition System (BIS)/Behavioral Activation System (BAS) scales, on the recruitment of cognitive mechanisms in conditions of potential reward. Select subscales of the BAS, including the fun seeking and reward responsiveness scales, showed unique relationships with context updating to reward cues and working memory maintenance of potentially rewarded stimuli. In contrast, BIS scores showed unique relationships with deployment of attention at different points in the task. These results suggest that sensitivity to rewards (i.e., BAS) and to punishment (i.e., BIS) may play an important role in the recruitment of specific and distinct cognitive mechanisms in conditions of potential rewards. © 2017 Society for Psychophysiological Research.

16 CFR 1500.15 - Labeling of fire extinguishers.

Science.gov (United States)

2010-01-01

... 16 Commercial Practices 2 2010-01-01 2010-01-01 false Labeling of fire extinguishers. 1500.15 Section 1500.15 Commercial Practices CONSUMER PRODUCT SAFETY COMMISSION FEDERAL HAZARDOUS SUBSTANCES ACT...)(1), the signal word “Danger” and the statement of hazard “Poisonous gases formed when used to...

Individual differences in decision making: Drive and reward responsiveness affect strategic bargaining in economic games

Directory of Open Access Journals (Sweden)

Sanfey Alan G

2006-10-01

Full Text Available Abstract Background In the growing body of literature on economic decision making, the main focus has typically been on explaining aggregate behavior, with little interest in individual differences despite considerable between-subject variability in decision responses. In this study, we were interested in asking to what degree individual differences in fundamental psychological processes can mediate economic decision-making behavior. Methods Specifically, we studied a personality dimension that may influence economic decision-making, the Behavioral Activation System, (BAS which is composed of three components: Reward Responsiveness, Drive, and Fun Seeking. In order to assess economic decision making, we utilized two commonly-used tasks, the Ultimatum Game and Dictator Game. Individual differences in BAS were measured by completion of the BIS/BAS Scales, and correlations between the BAS scales and monetary offers made in the two tasks were computed. Results We found that higher scores on BAS Drive and on BAS Reward Responsiveness were associated with a pattern of higher offers on the Ultimatum Game, lower offers on the Dictator Game, and a correspondingly larger discrepancy between Ultimatum Game and Dictator Game offers. Conclusion These findings are consistent with an interpretation that high scores on Drive and Reward Responsiveness are associated with a strategy that first seeks to maximize the likelihood of reward, and then to maximize the amount of reward. More generally, these results suggest that there are additional factors other than empathy, fairness and selfishness that contribute to strategic decision-making.

Individual differences in decision making: Drive and Reward Responsiveness affect strategic bargaining in economic games.

Science.gov (United States)

Scheres, Anouk; Sanfey, Alan G

2006-10-18

In the growing body of literature on economic decision making, the main focus has typically been on explaining aggregate behavior, with little interest in individual differences despite considerable between-subject variability in decision responses. In this study, we were interested in asking to what degree individual differences in fundamental psychological processes can mediate economic decision-making behavior. Specifically, we studied a personality dimension that may influence economic decision-making, the Behavioral Activation System, (BAS) which is composed of three components: Reward Responsiveness, Drive, and Fun Seeking. In order to assess economic decision making, we utilized two commonly-used tasks, the Ultimatum Game and Dictator Game. Individual differences in BAS were measured by completion of the BIS/BAS Scales, and correlations between the BAS scales and monetary offers made in the two tasks were computed. We found that higher scores on BAS Drive and on BAS Reward Responsiveness were associated with a pattern of higher offers on the Ultimatum Game, lower offers on the Dictator Game, and a correspondingly larger discrepancy between Ultimatum Game and Dictator Game offers. These findings are consistent with an interpretation that high scores on Drive and Reward Responsiveness are associated with a strategy that first seeks to maximize the likelihood of reward, and then to maximize the amount of reward. More generally, these results suggest that there are additional factors other than empathy, fairness and selfishness that contribute to strategic decision-making.

78 FR 70324 - Thy Hydrostatic Testing Provision of the Portable Fire Extinguishers Standard; Extension of the...

Science.gov (United States)

2013-11-25

... Hydrostatic Testing Provision of the Portable Fire Extinguishers Standard; Extension of the Office of...) approval of the information collection requirements contained in the Hydrostatic Testing provision of the... Hydrostatic Testing Provision of the Portable Fire Extinguishers Standard are necessary to reduce workers...

The paraventricular nucleus of the thalamus is recruited by both natural rewards and drugs of abuse: recent evidence of a pivotal role for orexin/hypocretin signaling in this thalamic nucleus in drug-seeking behavior

Directory of Open Access Journals (Sweden)

Alessandra eMatzeu

2014-04-01

Full Text Available A major challenge for the successful treatment of drug addiction is the long-lasting susceptibility to relapse and multiple processes that have been implicated in the compulsion to resume drug intake during abstinence. Recently, the orexin/hypocretin (Orx/Hcrt system has been shown to play a role in drug-seeking behavior. The Orx/Hcrt system regulates a wide range of physiological processes, including feeding, energy metabolism, and arousal. It has also been shown to be recruited by drugs of abuse. Orx/Hcrt neurons are predominantly located in the lateral hypothalamus that projects to the paraventricular nucleus of the thalamus (PVT, a region that has been identified as a way-station that processes information and then modulates the mesolimbic reward and extrahypothalamic stress systems. Although not thought to be part of the drug addiction circuitry, recent evidence indicates that the PVT is involved in the modulation of reward function in general and drug-directed behavior in particular. Evidence indicates a role for Orx/Hcrt transmission in the PVT in the modulation of reward function in general and drug-directed behavior in particular. One hypothesis is that following repeated drug exposure, the Orx/Hcrt system acquires a preferential role in mediating the effects of drugs vs. natural rewards. The present review discusses recent findings that suggest maladaptive recruitment of the PVT by drugs of abuse, specifically Orx/Hcrt-PVT neurotransmission.

Model Checking Markov Reward Models with Impulse Rewards

NARCIS (Netherlands)

Cloth, Lucia; Katoen, Joost-Pieter; Khattri, Maneesh; Pulungan, Reza; Bondavalli, Andrea; Haverkort, Boudewijn; Tang, Dong

This paper considers model checking of Markov reward models (MRMs), continuous-time Markov chains with state rewards as well as impulse rewards. The reward extension of the logic CSL (Continuous Stochastic Logic) is interpreted over such MRMs, and two numerical algorithms are provided to check the

Spontaneous Recovery But Not Reinstatement of the Extinguished Conditioned Eyeblink Response in the Rat

Science.gov (United States)

Thanellou, Alexandra; Green, John T.

2011-01-01

Reinstatement, the return of an extinguished conditioned response (CR) after reexposure to the unconditioned stimulus (US), and spontaneous recovery, the return of an extinguished CR with the passage of time, are two of four well-established phenomena which demonstrate that extinction does not erase the conditioned stimulus (CS)-US association. However, reinstatement of extinguished eyeblink CRs has never been demonstrated and spontaneous recovery of extinguished eyeblink CRs has not been systematically demonstrated in rodent eyeblink conditioning. In Experiment 1, US reexposure was administered 24 hours prior to a reinstatement test. In Experiment 2, US reexposure was administered 5 min prior to a reinstatement test. In Experiment 3, a long, discrete cue (a houselight), present in all phases of training and testing, served as a context within which each trial occurred to maximize context processing, which in other preparations has been shown to be required for reinstatement. In Experiment 4, an additional group was included that received footshock exposure, rather than US reexposure, between extinction and test, and contextual freezing was measured prior to test. Spontaneous recovery was robust in Experiments 3 and 4. In Experiment 4, context freezing was strong in a group given footshock exposure but not in a group given eyeshock US reexposure. There was no reinstatement observed in any experiment. With stimulus conditions that produce eyeblink conditioning and research designs that produce reinstatement in other forms of classical conditioning, we observed spontaneous recovery but not reinstatement of extinguished eyeblink CRs. This suggests that reinstatement, but not spontaneous recovery, is a preparation- or substrate-dependent phenomenon. PMID:21517145

Refractometry and Extinguishment/Burnback Testing of Pacific Air Forces AFFF

National Research Council Canada - National Science Library

Kalberer, Jennifer L; Barrett, Kimberly D

2006-01-01

At the request of Pacific Air Forces (PACAF), the Air Force Research Laboratory (AFRL) performed refractometry and extinguishment/burnback tests on samples of Ansulite and 3M aqueous film forming foam...

Inhibition of monoacylglycerol lipase (MAGL) enhances cue-induced reinstatement of nicotine-seeking behavior in mice.

Science.gov (United States)

Trigo, Jose M; Le Foll, Bernard

2016-05-01

Tobacco smoking is still a major population health issue. The endocannabinoid system has been shown to control drug-seeking behaviors. There are two main endocannabinoids: anandamide degraded by fatty acid amide hydrolase (FAAH) and 2-arachidonoylglycerol (2-AG) degraded by monoacylglycerol lipase (MAGL). The role of MAGL has only been explored recently, and so far, no study have been performed to evaluate the effects of MAGL inhibitor on nicotine reinforcing properties and cue-induced reinstatement of nicotine seeking. Here, we investigated the effects of the MAGL inhibitor JZL184 on nicotine self-administration under fixed and progressive-ratio schedules of reinforcement and on cue-induced reinstatement of nicotine seeking in mice. We also evaluated the effects of JZL184 on food self-administration for possible non-specific effects. JZL184 (0, 8, and 16 mg/kg) did not affect food taking, nicotine taking, or motivation for nicotine. MAGL inhibition by JZL184 (16 mg/kg) increased reinstatement of previously extinguished nicotine seeking induced by presentation of nicotine-associated cues, but did not produce reinstatement on its own. This study implicates involvement of 2-AG in nicotine-seeking behaviors.

Monetary reward processing in obese individuals with and without binge eating disorder.

Science.gov (United States)

Balodis, Iris M; Kober, Hedy; Worhunsky, Patrick D; White, Marney A; Stevens, Michael C; Pearlson, Godfrey D; Sinha, Rajita; Grilo, Carlos M; Potenza, Marc N

2013-05-01

An important step in obesity research involves identifying neurobiological underpinnings of nonfood reward processing unique to specific subgroups of obese individuals. Nineteen obese individuals seeking treatment for binge eating disorder (BED) were compared with 19 non-BED obese individuals (OB) and 19 lean control subjects (LC) while performing a monetary reward/loss task that parses anticipatory and outcome components during functional magnetic resonance imaging. Differences in regional activation were investigated in BED, OB, and LC groups during reward/loss prospect, anticipation, and notification. Relative to the LC group, the OB group demonstrated increased ventral striatal and ventromedial prefrontal cortex activity during anticipatory phases. In contrast, the BED group relative to the OB group demonstrated diminished bilateral ventral striatal activity during anticipatory reward/loss processing. No differences were observed between the BED and LC groups in the ventral striatum. Heterogeneity exists among obese individuals with respect to the neural correlates of reward/loss processing. Neural differences in separable groups with obesity suggest that multiple, varying interventions might be important in optimizing prevention and treatment strategies for obesity. Copyright © 2013 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Fire extinguishment in hypobaric and hyperbaric environments

Science.gov (United States)

Kimzey, J. H.

1971-01-01

Work that has been performed to provide information on the effects of various fire extinguishing agents in special atmospheres is discussed. Data used in the development of both equipment and techniques for manned spacecraft and related equipment are discussed. The equipment includes a hypobaric chamber suitable for low pressure use and a hyperbaric chamber for high pressure operation. The effectiveness of agents in weightless environment is also discussed.

BOLD responses in reward regions to hypothetical and imaginary monetary rewards.

Science.gov (United States)

Miyapuram, Krishna P; Tobler, Philippe N; Gregorios-Pippas, Lucy; Schultz, Wolfram

2012-01-16

Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewards can overcome the limitations of smaller monetary rewards but it is less well known whether predictors of hypothetical rewards activate reward regions. In two experiments, visual stimuli were associated with hypothetical monetary rewards. In Experiment 1, we used stimuli predicting either visually presented or imagined hypothetical monetary rewards, together with non-rewarding control pictures. Activations to reward predictive stimuli occurred in reward regions, namely the medial orbitofrontal cortex and midbrain. In Experiment 2, we parametrically varied the amount of visually presented hypothetical monetary reward keeping constant the amount of actually received reward. Graded activation in midbrain was observed to stimuli predicting increasing hypothetical rewards. The results demonstrate the efficacy of using hypothetical monetary rewards in fMRI studies. Copyright © 2011 Elsevier Inc. All rights reserved.

Reward deficiency and anti-reward in pain chronification

OpenAIRE

Borsook, D.; Linnman, C.; Faria, Vanda; Strassman, A. M.; Becerra, L.; Elman, I.

2016-01-01

Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between...

Objects of Desire: A Reading of the Reward System in World of Warcraft

DEFF Research Database (Denmark)

Larsen, Lasse Juel

2012-01-01

This article is written in an attempt to navigate the reward structure in World of Warcraft (WoW). Alongside its analysis of the reward structure in WoW, this article draws upon the paradoxical design of desire itself. In doing so, it takes a binocular perspective that addresses both the interplay...... between WoW's reward structure and a player-centric approach that seeks to explain the transcendent design of desire itself. The interplay between game structure and the design of desire is approached by means of a narrated scene from a personal experience of WoW dating back from the time of classical Wo......W, where the level cap was 60 and the guild raids in the high-end instances demanded the participation of 40 players. The scene is intended to provide the reader with insights both of the reward structure of WoW and of player's experience of the game world....

Reward positivity: Reward prediction error or salience prediction error?

Science.gov (United States)

Heydari, Sepideh; Holroyd, Clay B

2016-08-01

The reward positivity is a component of the human ERP elicited by feedback stimuli in trial-and-error learning and guessing tasks. A prominent theory holds that the reward positivity reflects a reward prediction error signal that is sensitive to outcome valence, being larger for unexpected positive events relative to unexpected negative events (Holroyd & Coles, 2002). Although the theory has found substantial empirical support, most of these studies have utilized either monetary or performance feedback to test the hypothesis. However, in apparent contradiction to the theory, a recent study found that unexpected physical punishments also elicit the reward positivity (Talmi, Atkinson, & El-Deredy, 2013). The authors of this report argued that the reward positivity reflects a salience prediction error rather than a reward prediction error. To investigate this finding further, in the present study participants navigated a virtual T maze and received feedback on each trial under two conditions. In a reward condition, the feedback indicated that they would either receive a monetary reward or not and in a punishment condition the feedback indicated that they would receive a small shock or not. We found that the feedback stimuli elicited a typical reward positivity in the reward condition and an apparently delayed reward positivity in the punishment condition. Importantly, this signal was more positive to the stimuli that predicted the omission of a possible punishment relative to stimuli that predicted a forthcoming punishment, which is inconsistent with the salience hypothesis. © 2016 Society for Psychophysiological Research.

Rewards.

Science.gov (United States)

Gunderman, Richard B; Kamer, Aaron P

2011-05-01

For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today. Copyright © 2011. Published by Elsevier Inc.

The role of reward and reward uncertainty in episodic memory

OpenAIRE

Mason, Alice; Farrell, Simon; Howard-Jones, Paul; Ludwig, Casimir

2017-01-01

Declarative memory has been found to be sensitive to reward-related changes in the environment. The reward signal can be broken down into information regarding the expected value of the reward, reward uncertainty and the prediction error. Research has established that high as opposed to low reward values enhance declarative memory. Research in neuroscience suggests that high uncertainty activates the reward system, which could lead to enhanced learning and memory. Here we present the results ...

Testing of a graphite based extinguishing powder for use on liquid metal fires

International Nuclear Information System (INIS)

Menzenhauer, P.; Ochs, G.; Peppler, W.

1977-11-01

A graphite based extinguishing powder, newly developed by a French firm for use on liquid metal fires has been tested on a sodium fire in a pan of 0.96 m 2 using 60 kg of sodium. The behaviour and extinguishing power are reported and compared with those of other materials tested in earlier experiments. The new powder has excellent efficiency in dealing with sodium pool fires. Application is simple. The amount required is more than an order magnitude less than that of currently available alternatives. The powder is not corrosive. (orig.) [de

Social defeat-induced anhedonia: effects on operant sucrose-seeking behavior

Directory of Open Access Journals (Sweden)

Danai eRiga

2015-08-01

Full Text Available Reduced capacity to experience pleasure, also known as anhedonia, is a key feature of the depressive state and is associated with poor disease prognosis and treatment outcome. Various behavioral readouts (e.g. reduced sucrose intake have been employed in animal models of depression as a measure of anhedonia. However, several aspects of anhedonia are poorly represented within the repertoire of current preclinical assessments. We recently adopted the social defeat-induced persistent stress (SDPS paradigm that models a maintained depressive-like state in the rat, including social withdrawal and deficits in short-term spatial memory. Here we investigated whether SDPS elicited persistent deficits in natural reward evaluation, as part of anhedonia. We examined cue-paired operant sucrose self-administration, enabling us to study acquisition, motivation, extinction and relapse to sucrose seeking following SDPS. Furthermore, we addressed whether guanfacine, an α2-adrenergic agonist that reduces stress-triggered maladaptive behavioral responses to drugs of abuse, could relief from SDPS-induced anhedonia. SDPS, consisting of 5 social defeat episodes followed by prolonged (≥8 weeks social isolation, did not affect sucrose consumption during acquisition of self-administration. However, it strongly enhanced the motivational drive to acquire a sucrose reward in progressive ratio training. Moreover, SDPS induced initial resilience to extinction and rendered animals more sensitive to cue-induced reinstatement of sucrose-seeking. Guanfacine treatment attenuated SDPS-induced motivational overdrive and limited reinstatement of sucrose seeking, normalizing behavior to control levels. Together, our data indicate that long after the termination of stress exposure, SDPS induces guanfacine-reversible deficits in evaluation of a natural reward. Importantly, the SDPS-triggered anhedonia reflects many aspects of the human phenotype, including impaired motivation and

Effects of sleep deprivation on retrieval and reconsolidation of morphine reward memory in rats.

Science.gov (United States)

Shi, Hai-Shui; Luo, Yi-Xiao; Xue, Yan-Xue; Wu, Ping; Zhu, Wei-Li; Ding, Zeng-Bo; Lu, Lin

2011-04-01

Relapse induced by exposure to cues associated with drugs of abuse is a major challenge to the treatment of drug addiction. Drug seeking can be inhibited by manipulation of the reconsolidation of drug-related memory. Sleep has been proposed to be involved in various memory processes. However, the role of sleep in drug reward memory is not clear. The present study used conditioned place preference to examine the effects of total sleep deprivation on retrieval and reconsolidation of morphine reward memory in rats. Six-hour total sleep deprivation had no effect on the retrieval of morphine reward memory. However, sleep deprivation from 0-6 h, but not 6-12 h, after re-exposure disrupted the reconsolidation of morphine reward memory. This impairment was not attributable to the formation of an aversive associative memory between the drug-paired context and sleep deprivation. Our findings suggest that sleep plays a critical role in morphine reward memory reconsolidation, and sleep deprivation may be a potential non-pharmacotherapy for the management of relapse associated with drug-related memory. Copyright © 2011 Elsevier Inc. All rights reserved.

Modulation of Food Reward by Endocrine and Environmental Factors: Update and Perspective.

Science.gov (United States)

Figlewicz, Dianne P

2015-01-01

Palatable foods are frequently high in energy density. Chronic consumption of high-energy density foods can contribute to the development of cardiometabolic pathology including obesity, diabetes, and cardiovascular disease. This article reviews the contributions of extrinsic and intrinsic factors that influence the reward components of food intake. A narrative review was conducted to determine the behavioral and central nervous system (CNS) related processes involved in the reward components of high-energy density food intake. The rewarding aspects of food, particularly palatable and preferred foods, are regulated by CNS circuitry. Overlaying this regulation is modulation by intrinsic endocrine systems and metabolic hormones relating to energy homeostasis, developmental stage, or gender. It is now recognized that extrinsic or environmental factors, including ambient diet composition and the provocation of stress or anxiety, also contribute substantially to the expression of food reward behaviors such as motivation for, and seeking of, preferred foods. High-energy density food intake is influenced by both physiological and pathophysiological processes. Contextual, behavioral, and psychological factors and CNS-related processes represent potential targets for multiple types of therapeutic intervention.

Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

Science.gov (United States)

Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

2015-12-10

Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

Research on fire extinguishing and disaster measures techniques for nuclear facilities

International Nuclear Information System (INIS)

Tsuruda, Takashi; Amano, Hisanori; Liao, Chihong

2004-01-01

As for a fire of alkali metals in nuclear facilities, measures to cope with the situation should be prepared. It has been experimentally investigated with a success to stabilize and treat safe in the air the leavings of burned sodium, which were extinguished by the nitrogen and poured with fire extinguishing powder for metal fire. Furthermore research and development has been conducted on a series of robots such as installing protection wall between radiation sources and victims and carrying victims out of the disaster room. Basic functional experiments on key components of robot system have been carried out using a trial product. Total control system of a series of robots will be updated based on control mechanism and software of a trial robot system. (T. Tanaka)

Use of Video Modeling to Teach Extinguishing of Cooking Related Fires to Individuals with Moderate Intellectual Disabilities

Science.gov (United States)

Mechling, Linda C.; Gast, David L.; Gustafson, Melissa R.

2009-01-01

This study evaluated the effectiveness of video modeling to teach fire extinguishing behaviors to three young adults with moderate intellectual disabilities. A multiple probe design across three fire extinguishing behaviors and replicated across three students was used to evaluate the effectiveness of the video-based program. Results indicate that…

Oxytocin Acts in Nucleus Accumbens to Attenuate Methamphetamine Seeking and Demand.

Science.gov (United States)

Cox, Brittney M; Bentzley, Brandon S; Regen-Tuero, Helaina; See, Ronald E; Reichel, Carmela M; Aston-Jones, Gary

2017-06-01

Evidence indicates that oxytocin, an endogenous peptide well known for its role in social behaviors, childbirth, and lactation, is a promising addiction pharmacotherapy. We employed a within-session behavioral-economic (BE) procedure in rats to examine oxytocin as a pharmacotherapy for methamphetamine (meth) addiction. The BE paradigm was modeled after BE procedures used to assess motivation for drugs in humans with addiction. The same BE variables assessed across species have been shown to predict later relapse behavior. Thus, the translational potential of preclinical BE studies is particularly strong. We tested the effects of systemic and microinfused oxytocin on demand for self-administered intravenous meth and reinstatement of extinguished meth seeking in male and female rats using a BE paradigm. Correlations between meth demand and meth seeking were assessed. Female rats showed greater demand (i.e., motivation) for meth compared with male rats. In both male and female rats, meth demand predicted reinstatement of meth seeking, and systemic oxytocin decreased demand for meth and attenuated reinstatement to meth seeking. Oxytocin was most effective at decreasing meth demand and seeking in rats with the strongest motivation for drug. Finally, these effects of systemic oxytocin were mediated by actions in the nucleus accumbens. Oxytocin decreases meth demand and seeking in both sexes, and these effects depend on oxytocin signaling in the nucleus accumbens. Overall, these data indicate that development of oxytocin-based therapies may be a promising treatment approach for meth addiction in humans. Copyright © 2017 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Development and Evaluation of a Prototype Wheeled Ultra-High Pressure Extinguisher System with Novec 1230

Science.gov (United States)

2016-01-01

extinguisher containing the Novec 1230 firefighting agent manufactured by 3M. This effort expanded upon a previous evaluation of the Amerex Corporation model...Air Force Civil Engineer Center (AFCEC) performed a series of tests to evaluate the performance of the Amerex Corporation model 775 wheeled...Extinguishing Effectiveness Tests, McDonald , Michael J. et al. Defense Technical Information Center. AFRL-ML-TY-TR-2004-4554, October 2005. 9. F100

Analysis of patents on extinguishing agent for sodium fires

International Nuclear Information System (INIS)

Jeong, Ji Young; Jeong, K. C.; Kim, B. H.; Kim, T. J.; Choi, J. H.

2002-02-01

This report relates to the extinction of sodium fires, particularly where the burning sodium is in liquid form. The total of 14 patents on extinguishing agents for sodium fires patented from 1969 to 1997 are analyzed and summarized. All of the patents analyzed were issued from USA, France and Japan

Analysis of patents on extinguishing agent for sodium fires

Energy Technology Data Exchange (ETDEWEB)

Jeong, Ji Young; Jeong, K C; Kim, B H; Kim, T J; Choi, J H

2002-02-01

This report relates to the extinction of sodium fires, particularly where the burning sodium is in liquid form. The total of 14 patents on extinguishing agents for sodium fires patented from 1969 to 1997 are analyzed and summarized. All of the patents analyzed were issued from USA, France and Japan.

French validation of the Barcelona Music Reward Questionnaire

Directory of Open Access Journals (Sweden)

Joe Saliba

2016-03-01

Full Text Available Background. The Barcelona Music Reward Questionnaire (BMRQ questionnaire investigates the main facets of music experience that could explain the variance observed in how people experience reward associated with music. Currently, only English and Spanish versions of this questionnaire are available. The objective of this study is to validate a French version of the BMRQ. Methods. The original BMRQ was translated and adapted into an international French version. The questionnaire was then administered through an online survey aimed at adults aged over 18 years who were fluent in French. Statistical analyses were performed and compared to the original English and Spanish version for validation purposes. Results. A total of 1,027 participants completed the questionnaire. Most responses were obtained from France (89.4%. Analyses revealed that congruence values between the rotated loading matrix and the ideal loading matrix ranged between 0.88 and 0.96. Factor reliabilities of subscales (i.e., Musical Seeking, Emotion Evocation, Mood Regulation, Social Reward and Sensory-Motor also ranged between 0.88 and 0.96. In addition, reliability of the overall factor score (i.e., Music reward was 0.91. Finally, the internal consistency of the overall scale was 0.85. The factorial structure obtained in the French translation was similar to that of the original Spanish and English samples. Conclusion. The French version of the BMRQ appears valid and reliable. Potential applications of the BMRQ include its use as a valuable tool in music reward and emotion research, whether in healthy individuals or in patients suffering from a wide variety of cognitive, neurologic and auditory disorders.

Reward deficiency and anti-reward in pain chronification.

Science.gov (United States)

Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

2016-09-01

Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

New on-board extinguisher system on diesel-driven vehicles in the German underground coal mining industry; Neuartige bordfeste Loeschanlage auf dieselgetriebenen Fahrzeugen im untertaegigen deutschen Steinkohlenbergbau

Energy Technology Data Exchange (ETDEWEB)

Fetting, Dieter; Alze, Matthias [Bergwerk Ost, Hamm (Germany); Cerny, Udo [RAG Deutsche Steinkohle AG, Herne (Germany). Hauptstelle fuer das Grubenrettungswesen

2010-01-15

A new extinguisher system has been developed by protectfire Brandschutztechnik GmbH and has now been approved for use in underground mines. This extinguisher system is interesting by virtue of its reliability (no faulty tripping e.g. by defective electrical components is possible) and it's extinguishing efficiency (significantly longer extinguishing time compared to a powder extinguisher). No outside energy source is required for operation of the extinguisher. The motor is stopped more quickly by connection of the motor shutdown valve in the exciter line. Economic considerations - easier maintenance and lower costs compared to similar systems - also make this system interesting. (orig.)

Glucocorticoid receptors in the basolateral amygdala mediated the restraint stress-induced reinstatement of methamphetamine-seeking behaviors in rats.

Science.gov (United States)

Taslimi, Zahra; Sarihi, Abdolrahman; Haghparast, Abbas

2018-04-21

Methamphetamine (METH) addiction is a growing epidemic worldwide. It is a common psychiatric disease and stress has an important role in the drug seeking and relapse behaviors. The involvement of the basolateral amygdala (BLA) in effects of stress on the reward pathway has been discussed in several studies. In this study, we tried to find out the involvement of glucocorticoid receptors (GRs) in the BLA in stress-induced reinstatement of the extinguished METH-induced conditioned place preference (CPP) in rats. The CPP paradigm was done in eighty-one adult male Wistar rats weighing 220-250 g. The animals received a daily injection of methamphetamine (0.5 mg/kg), during the conditioning phase. In extinction phase, the rats were put in the CPP box for 30 min per day for 8 days. After the extinction, the animals were exposed to acute restraint stress (ARS), 3 h before subcutaneous administration of sub-threshold dose of methamphetamine (0.125 mg/kg), based on our previous study, in reinstatement phase. In separated groups, the rats were exposed to chronic restraint stress (CRS) for 1 h each day during the extinction phase. To block the GRs in BLA, the animals unilaterally received RU38486 as GRs antagonist (10, 30 and 90 ng/0.3 μl DMSO) in all ARS groups on reinstatement day. In separated experiments, RU38486 (3, 10 and 30 ng/0.3 μl DMSO) was microinjected into the BLA in CRS groups prior to exposure to stress every day in extinction phase. The results revealed that intra-BLA RU38486 in ARS (90 ng) and CRS (10 and 30 ng) groups significantly prevented the stress-induced reinstatement. It can be proposed that stress partially exerts its effect on the reward pathway via GRs in the BLA. This effect was not quite similar in acute and chronic stress conditions. Copyright © 2018 Elsevier B.V. All rights reserved.

Solid State MEMS Thrusters Using Electrically Controlled Extinguishable Solid Propellant, Phase I

Data.gov (United States)

National Aeronautics and Space Administration — ET Materials, LLC developed the first ever electrically controlled extinguishable solid propellant (ECESP). The original propellant developed under Air Force SBIR...

Probability of seeing increases saccadic readiness.

Directory of Open Access Journals (Sweden)

Thérèse Collins

Full Text Available Associating movement directions or endpoints with monetary rewards or costs influences movement parameters in humans, and associating movement directions or endpoints with food reward influences movement parameters in non-human primates. Rewarded movements are facilitated relative to non-rewarded movements. The present study examined to what extent successful foveation facilitated saccadic eye movement behavior, with the hypothesis that foveation may constitute an informational reward. Human adults performed saccades to peripheral targets that either remained visible after saccade completion or were extinguished, preventing visual feedback. Saccades to targets that were systematically extinguished were slower and easier to inhibit than saccades to targets that afforded successful foveation, and this effect was modulated by the probability of successful foveation. These results suggest that successful foveation facilitates behavior, and that obtaining the expected sensory consequences of a saccadic eye movement may serve as a reward for the oculomotor system.

A multimodal investigation of contextual effects on alcohol's emotional rewards.

Science.gov (United States)

Fairbairn, Catharine E; Bresin, Konrad; Kang, Dahyeon; Rosen, I Gary; Ariss, Talia; Luczak, Susan E; Barnett, Nancy P; Eckland, Nathaniel S

2018-05-01

Regular alcohol consumption in unfamiliar social settings has been linked to problematic drinking. A large body of indirect evidence has accumulated to suggest that alcohol's rewarding emotional effects-both negative-mood relieving and positive-mood enhancing-will be magnified when alcohol is consumed within unfamiliar versus familiar social contexts. But empirical research has never directly examined links between contextual familiarity and alcohol reward. In the current study, we mobilized novel ambulatory technology to examine the effect of social familiarity on alcohol reward in everyday drinking contexts while also examining how alcohol reward observed in these field contexts corresponds to reward observed in the laboratory. Heavy social drinking participants (N = 48, 50% male) engaged in an intensive week of ambulatory assessment. Participants wore transdermal alcohol sensors while they reported on their mood and took photographs of their social contexts in response to random prompts. Participants also attended 2 laboratory beverage-administration sessions, during which their emotional responses were assessed and transdermal sensors were calibrated to estimate breathalyzer readings (eBrACs). Results indicated a significant interaction between social familiarity and alcohol episode in everyday drinking settings, with alcohol enhancing mood to a greater extent in relatively unfamiliar versus familiar social contexts. Findings also indicated that drinking in relatively unfamiliar social settings was associated with higher eBrACs. Finally, results indicated a correspondence between some mood effects of alcohol experienced inside and outside the laboratory. This study presents a novel methodology for examining alcohol reward and indicates social familiarity as a promising direction for research seeking to explain problematic drinking. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Rewards and Performance Incentives.

Science.gov (United States)

Zigon, Jack

1994-01-01

Discusses rewards and performance incentives for employees, including types of rewards; how rewards help in managing; dysfunctional awards; selecting the right reward; how to find rewards that fit; and delivering rewards effectively. Examples are included. (three references) (LRW)

Reward loss and the basolateral amygdala: A function in reward comparisons.

Science.gov (United States)

Kawasaki, Katsuyoshi; Annicchiarico, Iván; Glueck, Amanda C; Morón, Ignacio; Papini, Mauricio R

2017-07-28

The neural circuitry underlying behavior in reward loss situations is poorly understood. We considered two such situations: reward devaluation (from large to small rewards) and reward omission (from large rewards to no rewards). There is evidence that the central nucleus of the amygdala (CeA) plays a role in the negative emotion accompanying reward loss. However, little is known about the function of the basolateral nucleus (BLA) in reward loss. Two hypotheses of BLA function in reward loss, negative emotion and reward comparisons, were tested in an experiment involving pretraining excitotoxic BLA lesions followed by training in four tasks: consummatory successive negative contrast (cSNC), autoshaping (AS) acquisition and extinction, anticipatory negative contrast (ANC), and open field testing (OF). Cell counts in the BLA (but not in the CeA) were significantly lower in animals with lesions vs. shams. BLA lesions eliminated cSNC and ANC, and accelerated extinction of lever pressing in AS. BLA lesions had no effect on OF testing: higher activity in the periphery than in the central area. This pattern of results provides support for the hypothesis that BLA neurons are important for reward comparison. The three affected tasks (cSNC, ANC, and AS extinction) involve reward comparisons. However, ANC does not seem to involve negative emotions and it was affected, whereas OF activity is known to involve negative emotion, but it was not affected. It is hypothesized that a circuit involving the thalamus, insular cortex, and BLA is critically involved in the mechanism comparing current and expected rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

Dynamics of rapid dopamine release in the nucleus accumbens during goal-directed behaviors for cocaine versus natural rewards.

Science.gov (United States)

Cameron, Courtney M; Wightman, R Mark; Carelli, Regina M

2014-11-01

Electrophysiological studies show that distinct subsets of nucleus accumbens (NAc) neurons differentially encode information about goal-directed behaviors for intravenous cocaine versus natural (food/water) rewards. Further, NAc rapid dopamine signaling occurs on a timescale similar to phasic cell firing during cocaine and natural reward-seeking behaviors. However, it is not known whether dopamine signaling is reinforcer specific (i.e., is released during responding for only one type of reinforcer) within discrete NAc locations, similar to neural firing dynamics. Here, fast-scan cyclic voltammetry (FSCV) was used to measure rapid dopamine release during multiple schedules involving sucrose reward and cocaine self-administration (n = 8 rats) and, in a separate group of rats (n = 6), during a sucrose/food multiple schedule. During the sucrose/cocaine multiple schedule, dopamine increased within seconds of operant responding for both reinforcers. Although dopamine release was not reinforcer specific, more subtle differences were observed in peak dopamine concentration [DA] across reinforcer conditions. Specifically, peak [DA] was higher during the first phase of the multiple schedule, regardless of reinforcer type. Further, the time to reach peak [DA] was delayed during cocaine-responding compared to sucrose. During the sucrose/food multiple schedule, increases in dopamine release were also observed relative to operant responding for both natural rewards. However, peak [DA] was higher relative to responding for sucrose than food, regardless of reinforcer order. Overall, the results reveal the dynamics of rapid dopamine signaling in discrete locations in the NAc across reward conditions, and provide novel insight into the functional role of this system in reward-seeking behaviors. Copyright © 2014 Elsevier Ltd. All rights reserved.

Relapse of Extinguished Fear after Exposure to a Dangerous Context Is Mitigated by Testing in a Safe Context

Science.gov (United States)

Goode, Travis D.; Kim, Janice J.; Maren, Stephen

2015-01-01

Aversive events can trigger relapse of extinguished fear memories, presenting a major challenge to the long-term efficacy of therapeutic interventions. Here, we examined factors regulating the relapse of extinguished fear after exposure of rats to a dangerous context. Rats received unsignaled shock in a distinct context ("dangerous"…

Emerging Role for Corticotropin Releasing Factor Signaling in the Bed Nucleus of the Stria Terminalis at the Intersection of Stress and Reward

OpenAIRE

Silberman, Yuval; Winder, Danny G.

2013-01-01

Stress and anxiety play an important role in the development and maintenance of drug and alcohol addiction. The bed nucleus of the stria terminalis (BNST), a brain region involved in the production of long-term stress-related behaviors, plays an important role in animal models of relapse, such as reinstatement to previously extinguished drug-seeking behaviors. While a number of neurotransmitter systems have been suggested to play a role in these behaviors, recent evidence points to the neurop...

46 CFR 181.410 - Fixed gas fire extinguishing systems.

Science.gov (United States)

2010-10-01

... less than 170 cubic meters (6000 cubic feet), release of an extinguishing agent into a space must... unoccupied space of less than 170 cubic meters (6,000 cubic feet) may have the storage cylinders located... between 16,550 and 19,300 kPa (2,400 and 2,800 psi) must be installed in the distribution manifold to...

Neural activation to monetary reward is associated with amphetamine reward sensitivity.

Science.gov (United States)

Crane, Natania A; Gorka, Stephanie M; Weafer, Jessica; Langenecker, Scott A; de Wit, Harriet; Phan, K Luan

2018-03-14

One known risk factor for drug use and abuse is sensitivity to rewarding effects of drugs. It is not known whether this risk factor extends to sensitivity to non-drug rewards. In this study with healthy young adults, we examined the association between sensitivity to the subjective rewarding effects of amphetamine and a neural indicator of anticipation of monetary reward. We hypothesized that greater euphorigenic response to amphetamine would be associated with greater neural activation to anticipation of monetary reward (Win > Loss). Healthy participants (N = 61) completed four laboratory sessions in which they received d-amphetamine (20 mg) and placebo in alternating order, providing self-report measures of euphoria and stimulation at regular intervals. At a separate visit 1-3 weeks later, participants completed the guessing reward task (GRT) during fMRI in a drug-free state. Participants reporting greater euphoria after amphetamine also exhibited greater neural activation during monetary reward anticipation in mesolimbic reward regions, including the bilateral caudate and putamen. This is the first study to show a relationship between neural correlates of monetary reward and sensitivity to the subjective rewarding effects of amphetamine in humans. These findings support growing evidence that sensitivity to reward in general is a risk factor for drug use and abuse, and suggest that sensitivity of drug-induced euphoria may reflect a general sensitivity to rewards. This may be an index of vulnerability for drug use or abuse.

Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt.

Science.gov (United States)

Sweitzer, Maggie M; Geier, Charles F; Denlinger, Rachel; Forbes, Erika E; Raiff, Bethany R; Dallery, Jesse; McClernon, F J; Donny, Eric C

2016-03-01

Tobacco smoking is associated with dysregulated reward processing within the striatum, characterized by hypersensitivity to smoking rewards and hyposensitivity to non-smoking rewards. This bias toward smoking reward at the expense of alternative rewards is further exacerbated by deprivation from smoking, which may contribute to difficulty maintaining abstinence during a quit attempt. We examined whether abstinence-induced changes in striatal processing of rewards predicted lapse likelihood during a quit attempt supported by contingency management (CM), in which abstinence from smoking was reinforced with money. Thirty-six non-treatment-seeking smokers participated in two functional MRI (fMRI) sessions, one following 24-h abstinence and one following smoking as usual. During each scan, participants completed a rewarded guessing task designed to elicit striatal activation in which they could earn smoking and monetary rewards delivered after the scan. Participants then engaged in a 3-week CM-supported quit attempt. As previously reported, 24-h abstinence was associated with increased striatal activation in anticipation of smoking reward and decreased activation in anticipation of monetary reward. Individuals exhibiting greater decrements in right striatal activation to monetary reward during abstinence (controlling for activation during non-abstinence) were more likely to lapse during CM (p reward. These results are consistent with a growing number of studies indicating the specific importance of disrupted striatal processing of non-drug reward in nicotine dependence and highlight the importance of individual differences in abstinence-induced deficits in striatal function for smoking cessation.

Serotonergic versus Nonserotonergic Dorsal Raphe Projection Neurons: Differential Participation in Reward Circuitry

Directory of Open Access Journals (Sweden)

Ross A. McDevitt

2014-09-01

Full Text Available The dorsal raphe nucleus (DRN contains the largest group of serotonin-producing neurons in the brain and projects to regions controlling reward. Although pharmacological studies suggest that serotonin inhibits reward seeking, electrical stimulation of the DRN strongly reinforces instrumental behavior. Here, we provide a targeted assessment of the behavioral, anatomical, and electrophysiological contributions of serotonergic and nonserotonergic DRN neurons to reward processes. To explore DRN heterogeneity, we used a simultaneous two-vector knockout/optogenetic stimulation strategy, as well as cre-induced and cre-silenced vectors in several cre-expressing transgenic mouse lines. We found that the DRN is capable of reinforcing behavior primarily via nonserotonergic neurons, for which the main projection target is the ventral tegmental area (VTA. Furthermore, these nonserotonergic projections provide glutamatergic excitation of VTA dopamine neurons and account for a large majority of the DRN-VTA pathway. These findings help to resolve apparent discrepancies between the roles of serotonin versus the DRN in behavioral reinforcement.

Dopamine D2 receptors in addiction-like reward dysfunction and compulsive eating in obese rats.

Science.gov (United States)

Johnson, Paul M; Kenny, Paul J

2010-05-01

We found that development of obesity was coupled with emergence of a progressively worsening deficit in neural reward responses. Similar changes in reward homeostasis induced by cocaine or heroin are considered to be crucial in triggering the transition from casual to compulsive drug-taking. Accordingly, we detected compulsive-like feeding behavior in obese but not lean rats, measured as palatable food consumption that was resistant to disruption by an aversive conditioned stimulus. Striatal dopamine D2 receptors (D2Rs) were downregulated in obese rats, as has been reported in humans addicted to drugs. Moreover, lentivirus-mediated knockdown of striatal D2Rs rapidly accelerated the development of addiction-like reward deficits and the onset of compulsive-like food seeking in rats with extended access to palatable high-fat food. These data demonstrate that overconsumption of palatable food triggers addiction-like neuroadaptive responses in brain reward circuits and drives the development of compulsive eating. Common hedonic mechanisms may therefore underlie obesity and drug addiction.

Beyond Rewards

Science.gov (United States)

Hall, Philip S.

2009-01-01

Using rewards to impact students' behavior has long been common practice. However, using reward systems to enhance student learning conveniently masks the larger and admittedly more difficult task of finding and implementing the structure and techniques that children with special needs require to learn. More important, rewarding the child for good…

Numerical prediction of fire extinguishment characteristics of sodium leak collection tray in a fast breeder reactor

International Nuclear Information System (INIS)

Diwakar, S.V.; Mangarjuna Rao, P.; Kasinathan, N.; Das, Sarit K.; Sundararajan, T.

2011-01-01

Highlights: ► Sodium fire extinguishment in a leak collection tray is modeled by lumped approach. ► Hydrodynamics of liquid sodium on tray is emulated through a draining/sloshing model. ► Pool burning rates in the tray and holdup vessel are numerically estimated. ► The model directly yields the mass of sodium recovered after extinction of fire. ► Model predictions are in reasonable agreement with the available experimental data. - Abstract: Sodium leak collection tray (LCT) is an efficient passive device used for the extinguishment of liquid sodium fire in case of an accidental leakage from the secondary circuit of a fast breeder reactor. The LCT essentially isolates the leaking sodium into closed containers where the resulting fire is extinguished due to limited availability of oxygen. The current work aims to highlight the combustion extinguishment characteristics of LCT through a lumped formulation by conserving the mass and energy of liquid sodium and constituent gases in various parts of the LCT. Here, the complex hydrodynamics of liquid sodium is emulated through a semi-analytical draining/sloshing model and its burning rates are predicted through a three-dimensional open pool combustion model for the tray region and a closed pool combustion model for the holdup vessel. These simulations evaluate the burning rates at discrete levels of liquid sodium which are subsequently interpolated to establish correlations involving instantaneous liquid levels and oxygen concentration. Using the correlations obtained from the draining and combustion models, the overall lumped formulation directly predicts the un-burnt sodium recoverable after the extinguishment of fire in the LCT. The predicted results of this model compare well with the available experimental data.

Novel approach for extinguishing large-scale coal fires using gas-liquid foams in open pit mines.

Science.gov (United States)

Lu, Xinxiao; Wang, Deming; Qin, Botao; Tian, Fuchao; Shi, Guangyi; Dong, Shuaijun

2015-12-01

Coal fires are a serious threat to the workers' security and safe production in open pit mines. The coal fire source is hidden and innumerable, and the large-area cavity is prevalent in the coal seam after the coal burned, causing the conventional extinguishment technology difficult to work. Foams are considered as an efficient means of fire extinguishment in these large-scale workplaces. A noble foam preparation method is introduced, and an original design of cavitation jet device is proposed to add foaming agent stably. The jet cavitation occurs when the water flow rate and pressure ratio reach specified values. Through self-building foaming system, the high performance foams are produced and then infused into the blast drilling holes at a large flow. Without complicated operation, this system is found to be very suitable for extinguishing large-scale coal fires. Field application shows that foam generation adopting the proposed key technology makes a good fire extinguishment effect. The temperature reduction using foams is 6-7 times higher than water, and CO concentration is reduced from 9.43 to 0.092‰ in the drilling hole. The coal fires are controlled successfully in open pit mines, ensuring the normal production as well as the security of personnel and equipment.

Fire extinguishing strength of the combustion product of wood saw ...

African Journals Online (AJOL)

Forty saw dust samples from four mature hard wood plants grown in southwestern part of Nigeria were analyzed for their ash contents, moisture contents, metallic contents and hence the fire extinguishing strength of the saw dust ash by classical and instrumental methods of analyses. Mahogany (Khaya ivorensis) wood saw ...

Using food as a reward: An examination of parental reward practices.

Science.gov (United States)

Roberts, Lindsey; Marx, Jenna M; Musher-Eizenman, Dara R

2018-01-01

Eating patterns and taste preferences are often established early in life. Many studies have examined how parental feeding practices may affect children's outcomes, including food intake and preference. The current study focused on a common food parenting practice, using food as a reward, and used Latent Profile Analysis (LPA) to examine whether mothers (n = 376) and fathers (n = 117) of children ages 2.8 to 7.5 (M = 4.7; SD = 1.1) grouped into profiles (i.e., subgroups) based on how they use of food as a reward. The 4-class model was the best-fitting LPA model, with resulting classes based on both the frequency and type of reward used. Classes were: infrequent reward (33%), tangible reward (21%), food reward (27%), and frequent reward (19%). The current study also explored whether children's eating styles (emotional overeating, rood fussiness, food responsiveness, and satiety responsiveness) and parenting style (Authoritative, Authoritarian, and Permissive) varied by reward profile. Analyses of Variance (ANOVA) revealed that the four profiles differed significantly for all outcome variables except satiety responsiveness. It appears that the use of tangible and food-based rewards have important implications in food parenting. More research is needed to better understand how the different rewarding practices affect additional child outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

46 CFR 27.305 - What are the requirements for fire-extinguishing equipment on towing vessels in ocean or coastal...

Science.gov (United States)

2010-10-01

... 46 Shipping 1 2010-10-01 2010-10-01 false What are the requirements for fire-extinguishing equipment on towing vessels in ocean or coastal service whose construction was contracted for on or after... for fire-extinguishing equipment on towing vessels in ocean or coastal service whose construction was...

Extinguishing smouldering fires in silos. BRANDFORSK project 745-961

Energy Technology Data Exchange (ETDEWEB)

Tuomisaari, M.; Baroudi, D.; Latva, R. [VTT Building Technology, Espoo (Finland). Building Physics, Building Services and Fire Technology

1998-11-01

Combustible, porous materials may self-ignite during their storage time in silos as a result of internal heating. The self-ignition process may be slow, and it results in smouldering fires that are extremely difficult to extinguish. Suitable means to fight the smouldering fire were studied both theoretically and experimentally. General heat and mass transfer equations for porous media subject to fires and suppression were written. The equations together with dimensional analysis revealed critical parameters, like the grain size and moisture content, affecting the combustion and suppression process, but they also revealed the complexity of the problem. Experimental results of over 50 tests with varying combustibles and suppression agents were used as the basis for proposed qualitative guidelines on how to fight a smouldering silo fire. Among the potential gaseous agents, CO{sub 2} was found to be the most efficient one. Low expansion foam was also found to be a potential candidate, but its applicability requires further confirmation. Quantifying the guidelines requires a whole new study on the detection of a smouldering fire. The same detection system should be capable of monitoring the suppression process and - most importantly - verifying the extinguishment. (orig.) 46 refs.

Counterconditioned Fear Responses Exhibit Greater Renewal than Extinguished Fear Responses

Science.gov (United States)

Holmes, Nathan M.; Leung, Hiu T.; Westbrook, R. Frederick

2016-01-01

This series of experiments used rats to compare counterconditioning and extinction of conditioned fear responses (freezing) with respect to the effects of a context shift. In each experiment, a stimulus was paired with shock in context A, extinguished or counterconditioned through pairings with sucrose in context B, and then tested for renewal…

Pharmacological inactivation of the prelimbic cortex emulates compulsive reward seeking in rats

NARCIS (Netherlands)

Limpens, Jules H W; Damsteegt, Ruth; Broekhoven, Mark H; Voorn, Pieter; Vanderschuren, L.J.M.J.

2015-01-01

Drug addiction is a chronic, relapsing brain disorder characterized by compulsive drug use. Contemporary addiction theories state that loss of control over drug use is mediated by a combination of several processes, including a transition from goal-directed to habitual forms of drug seeking and

Vagus Nerve Stimulation Reduces Cocaine Seeking and Alters Plasticity in the Extinction Network

Science.gov (United States)

Childs, Jessica E.; DeLeon, Jaime; Nickel, Emily; Kroener, Sven

2017-01-01

Drugs of abuse cause changes in the prefrontal cortex (PFC) and associated regions that impair inhibitory control over drug-seeking. Breaking the contingencies between drug-associated cues and the delivery of the reward during extinction learning reduces rates of relapse. Here we used vagus nerve stimulation (VNS) to induce targeted synaptic…

Activation of dopamine D3 receptors inhibits reward-related learning induced by cocaine.

Science.gov (United States)

Kong, H; Kuang, W; Li, S; Xu, M

2011-03-10

Memories of learned associations between the rewarding properties of drugs and environmental cues contribute to craving and relapse in humans. The mesocorticolimbic dopamine (DA) system is involved in reward-related learning induced by drugs of abuse. DA D3 receptors are preferentially expressed in mesocorticolimbic DA projection areas. Genetic and pharmacological studies have shown that DA D3 receptors suppress locomotor-stimulant effects of cocaine and reinstatement of cocaine-seeking behaviors. Activation of the extracellular signal-regulated kinase (ERK) induced by acute cocaine administration is also inhibited by D3 receptors. How D3 receptors modulate cocaine-induced reward-related learning and associated changes in cell signaling in reward circuits in the brain, however, have not been fully investigated. In the present study, we show that D3 receptor mutant mice exhibit potentiated acquisition of conditioned place preference (CPP) at low doses of cocaine compared to wild-type mice. Activation of ERK and CaMKIIα, but not the c-Jun N-terminal kinase and p38, in the nucleus accumbens, amygdala and prefrontal cortex is also potentiated in D3 receptor mutant mice compared to that in wild-type mice following CPP expression. These results support a model in which D3 receptors modulate reward-related learning induced by low doses of cocaine by inhibiting activation of ERK and CaMKIIα in reward circuits in the brain. Copyright © 2011 IBRO. Published by Elsevier Ltd. All rights reserved.

Repeated nicotine exposure enhances reward-related learning in the rat.

Science.gov (United States)

Olausson, Peter; Jentsch, J David; Taylor, Jane R

2003-07-01

Repeated exposure to addictive drugs causes neuroadaptive changes in cortico-limbic-striatal circuits that may underlie alterations in incentive-motivational processes and reward-related learning. Such drug-induced alterations may be relevant to drug addiction because enhanced incentive motivation and increased control over behavior by drug-associated stimuli may contribute to aspects of compulsive drug-seeking and drug-taking behaviors. This study investigated the consequences of repeated nicotine treatment on the acquisition and performance of Pavlovian discriminative approach behavior, a measure of reward-related learning, in male rats. Water-restricted rats were trained to associate a compound conditioned stimulus (tone+light) with the availability of water (the unconditioned stimulus) in 15 consecutive daily sessions. In separate experiments, rats were repeatedly treated with nicotine (0.35 mg/kg, s.c.) either (1) prior to the onset of training, (2) after each daily training session was completed (ie postsession injections), or (3) received nicotine both before the onset of training as well as after each daily training session. In this study, all nicotine treatment schedules increased Pavlovian discriminative approach behavior and, thus, prior repeated exposure to nicotine, repeated postsession nicotine injections, or both, facilitated reward-related learning.

The role of the central ghrelin system in reward from food and chemical drugs.

Science.gov (United States)

Dickson, Suzanne L; Egecioglu, Emil; Landgren, Sara; Skibicka, Karolina P; Engel, Jörgen A; Jerlhag, Elisabet

2011-06-20

Here we review recent advances that identify a role for the central ghrelin signalling system in reward from both natural rewards (such as food) and artificial rewards (that include alcohol and drugs of abuse). Whereas ghrelin emerged as a stomach-derived hormone involved in energy balance, hunger and meal initiation via hypothalamic circuits, it now seems clear that it also has a role in motivated reward-driven behaviours via activation of the so-called "cholinergic-dopaminergic reward link". This reward link comprises a dopamine projection from the ventral tegmental area (VTA) to the nucleus accumbens together with a cholinergic input, arising primarily from the laterodorsal tegmental area. Ghrelin administration into the VTA or LDTg activates the "cholinergic-dopaminergic" reward link, suggesting that ghrelin may increase the incentive value of motivated behaviours such as reward-seeking behaviour ("wanting" or "incentive motivation"). Further, direct injection of ghrelin into the brain ventricles or into the VTA increases the consumption of rewarding foods as well as alcohol in mice and rats. Studies in rodents show beneficial effects of ghrelin receptor (GHS-R1A) antagonists to suppress the intake of palatable food, to reduce preference for caloric foods, to suppress food reward and motivated behaviour for food. They have also been shown to reduce alcohol consumption, suppress reward induced by alcohol, cocaine and amphetamine. Furthermore, variations in the GHS-R1A and pro-ghrelin genes have been associated with high alcohol consumption, smoking and increased weight gain in alcohol dependent individuals as well as with bulimia nervosa and obesity. Thus, the central ghrelin signalling system interfaces neurobiological circuits involved in reward from food as well as chemical drugs; agents that directly or indirectly suppress this system emerge as potential candidate drugs for suppressing problematic over-eating that leads to obesity as well as for the

Deletion of Type 2 Metabotropic Glutamate Receptor Decreases Sensitivity to Cocaine Reward in Rats.

Science.gov (United States)

Yang, Hong-Ju; Zhang, Hai-Ying; Bi, Guo-Hua; He, Yi; Gao, Jun-Tao; Xi, Zheng-Xiong

2017-07-11

Cocaine users show reduced expression of the metabotropic glutamate receptor (mGluR2), but it is not clear whether this is a predisposing trait for addiction or a consequence of drug exposure. In this study, we found that a nonsense mutation at the mGluR2 gene decreased mGluR2 expression and altered the seeking and taking of cocaine. mGluR2 mutant rats show reduced sensitivity to cocaine reward, requiring more cocaine to reach satiation when it was freely available and ceasing their drug-seeking behavior sooner than controls when the response requirement was increased. mGluR2 mutant rats also show a lower propensity to relapse after a period of cocaine abstinence, an effect associated with reduced cocaine-induced dopamine and glutamate overflow in the nucleus accumbens. These findings suggest that mGluR2 polymorphisms or reduced availability of mGluR2 might be risk factors for the initial development of cocaine use but could actually protect against addiction by reducing sensitivity to cocaine reward. Published by Elsevier Inc.

Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively.

Science.gov (United States)

Leon, M I; Gallistel, C R

1998-07-01

For rats that bar pressed for intracranial electrical stimulation in a 2-lever matching paradigm with concurrent variable interval schedules of reward, the authors found that the time allocation ratio is based on a multiplicative combination of the ratio of subjective reward magnitudes and the ratio of the rates of reward. Multiplicative combining was observed in a range covering approximately 2 orders of magnitude in the ratio of the rates of reward from about 1:10 to 10:1) and an order of magnitude change in the size of rewards. After determining the relation between the pulse frequency of stimulation and subjective reward magnitude, the authors were able to predict from knowledge of the subjective magnitudes of the rewards and the obtained relative rates of reward the subject's time allocation ratio over a range in which it varied by more than 3 orders of magnitude.

AT89S52 microcontroller Based A Fire Extinguisher Robot Using Ultrasonic and Ultraviolet Sensor

Directory of Open Access Journals (Sweden)

Wahyu Sapto Aji

2009-12-01

Full Text Available The fire often takes many victims. Fire detection system sometime can not prevent this from happening. Therefore, it is essential to develop a robot that can detect the present of fire as well as extinguish it. This research aimed to design a fire extinguisher robot using AT89S52 microcontroller as its controller. A DC fan controlled by a relay is utilized to put out the fire and a fire sensor (UV-Tron is used to detect the presence of fire. The movement of the robot is driven by motor DC. The robot can detect the surrounding obstacles and possess an ultrasound-based navigation system. If the ultrasound system detects an obstacle, the robot will automatically turn without colliding the obstacle or other things around it. The result has shown that this fire extinguisher robot can be built using hardware and software controlled by an AT89S52 microcontroller. It can be concluded from the tests that the robot can detect fire as far as 5 meter distance and able to successfully put out the fire.

Reward dependence moderates smoking-cue- and stress-induced cigarette cravings.

Science.gov (United States)

Michalowski, Alexandra; Erblich, Joel

2014-12-01

Cigarette cravings following exposure to smoking cues in a smoker's environment are thought to play an important role in cessation failure. The possibility that dispositional factors may impact cue-induced cravings, though intriguing, has received little attention. According to Cloninger's Tridimensional Personality Theory, factors such as reward dependence (RD), harm avoidance (HA), and novelty seeking (NS) may figure prominently in risk for addiction, as well as relapse, in individuals attempting to abstain from drug and alcohol use. Particularly interesting in this regard is the possibility that smokers with higher levels of RD, who are especially sensitive to reward signals, will have heightened craving reactions to smoking cues. To that end, non-treatment-seeking nicotine dependent smokers (n=96, mean age=41.1, 47% African American, 17% Caucasian, 22% Hispanic, 19.3cigs/day, FTND=7.5) underwent a classic experimental cue-induction, during which they were exposed to imagery of: (1) smoking, (2) neutral, and (3) stress cues, and reported their cigarette cravings (0-100) before and after each exposure. Participants also completed the Tridimensional Personality Questionnaire. Not surprisingly, smoking and stress cues (but not neutral cues) elicited significant elevations in craving (p'scues (pcues (pcues. Furthermore, the similar effects of RD on stress-induced craving suggest that both cue-and stress-induced cravings may be influenced by a common underlying disposition. Copyright © 2014 Elsevier Ltd. All rights reserved.

Abnormal Striatal BOLD Responses to Reward Anticipation and Reward Delivery in ADHD

Science.gov (United States)

Furukawa, Emi; Bado, Patricia; Tripp, Gail; Mattos, Paulo; Wickens, Jeff R.; Bramati, Ivanei E.; Alsop, Brent; Ferreira, Fernanda Meireles; Lima, Debora; Tovar-Moll, Fernanda; Sergeant, Joseph A.; Moll, Jorge

2014-01-01

Altered reward processing has been proposed to contribute to the symptoms of attention deficit hyperactivity disorder (ADHD). The neurobiological mechanism underlying this alteration remains unclear. We hypothesize that the transfer of dopamine release from reward to reward-predicting cues, as normally observed in animal studies, may be deficient in ADHD. Functional magnetic resonance imaging (fMRI) was used to investigate striatal responses to reward-predicting cues and reward delivery in a classical conditioning paradigm. Data from 14 high-functioning and stimulant-naïve young adults with elevated lifetime symptoms of ADHD (8 males, 6 females) and 15 well-matched controls (8 males, 7 females) were included in the analyses. During reward anticipation, increased blood-oxygen-level-dependent (BOLD) responses in the right ventral and left dorsal striatum were observed in controls, but not in the ADHD group. The opposite pattern was observed in response to reward delivery; the ADHD group demonstrated significantly greater BOLD responses in the ventral striatum bilaterally and the left dorsal striatum relative to controls. In the ADHD group, the number of current hyperactivity/impulsivity symptoms was inversely related to ventral striatal responses during reward anticipation and positively associated with responses to reward. The BOLD response patterns observed in the striatum are consistent with impaired predictive dopamine signaling in ADHD, which may explain altered reward-contingent behaviors and symptoms of ADHD. PMID:24586543

Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex.

Science.gov (United States)

Klein-Flügge, Miriam Cornelia; Barron, Helen Catharine; Brodersen, Kay Henning; Dolan, Raymond J; Behrens, Timothy Edward John

2013-02-13

A dominant focus in studies of learning and decision-making is the neural coding of scalar reward value. This emphasis ignores the fact that choices are strongly shaped by a rich representation of potential rewards. Here, using fMRI adaptation, we demonstrate that responses in the human orbitofrontal cortex (OFC) encode a representation of the specific type of food reward predicted by a visual cue. By controlling for value across rewards and by linking each reward with two distinct stimuli, we could test for representations of reward-identity that were independent of associative information. Our results show reward-identity representations in a medial-caudal region of OFC, independent of the associated predictive stimulus. This contrasts with a more rostro-lateral OFC region encoding reward-identity representations tied to the predicate stimulus. This demonstration of adaptation in OFC to reward specific representations opens an avenue for investigation of more complex decision mechanisms that are not immediately accessible in standard analyses, which focus on correlates of average activity.

Dopamine reward prediction error coding.

Science.gov (United States)

Schultz, Wolfram

2016-03-01

Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards-an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less reward than predicted (negative prediction error). The dopamine signal increases nonlinearly with reward value and codes formal economic utility. Drugs of addiction generate, hijack, and amplify the dopamine reward signal and induce exaggerated, uncontrolled dopamine effects on neuronal plasticity. The striatum, amygdala, and frontal cortex also show reward prediction error coding, but only in subpopulations of neurons. Thus, the important concept of reward prediction errors is implemented in neuronal hardware.

Using egg albumin foam to extinguish fires

Directory of Open Access Journals (Sweden)

Hytham A. Alsaati

2003-12-01

Full Text Available Oil, coal and chemical fires are often difficult to put out using water. In certain hydrocarbon fires, protein foam can extinguish fires better than water by keeping air (oxygen away from the flames and by ''blowing'' the flame away from its fuel source. Egg albumin is a relatively inexpensive protein and is representative of foaming proteins, which are candidates for use as fire suppression agents. This paper begins to deal with the effect of the foam bulk pH, foam protein concentration and generating air flow rate into the foam on the fire extinguishing time in laboratory experiments. A Bunsen burner was used to generate a small, controlled laboratory fire within a plastic container, which represented a point source in a partially open room in the experiments. The Bunsen burner represents a gaseous hydrocarbon fire, which can be difficult to extinguish. Both a low pH foam and one made with a high air flow rate favor a reduction in time required to put out the Bunsen burner flame.Chamas produzidas por óleo, carvão e produtos químicos (incêndios provocados são difíceis de ser extinguidos com água. Algumas chamas de hidrocarbonetos podem ser extinguidas por espumas protéicas melhor do que a manutenção de ar (oxigênio fora do alcance das chamas ou pelo sopramento da chama para longe da sua fonte. Albumina de ovo é uma proteína relativamente barata e é representativa dentre as proteínas usadas como espuma para a (supressão extinção de agentes causadores de incêndio. Este artigo trata do estudo do efeito do pH e concentração da espuma protéica, além da geração de ar no interior da espuma, sobre o tempo de extinção de incêndio em experimentos laboratoriais. Nos experimentos um bico de Bunsen foi usado para gerar uma pequena chama, controlada em um container de plástico, representando uma fonte pontual em um ambiente parcialmente aberto. A chama do bico de Bunsen representa uma chama gasosa de hidrocarbonetos, que são dif

Cue-induced reinstatement of ethanol seeking in Sardinian alcohol-preferring rats.

Science.gov (United States)

Maccioni, Paola; Orrú, Alessandro; Korkosz, Agnieszka; Gessa, Gian Luigi; Carai, Mauro A M; Colombo, Giancarlo; Bienkowski, Przemyslaw

2007-02-01

The purpose of the present study was to characterize cue-induced reinstatement of ethanol seeking in selectively bred Sardinian alcohol-preferring (sP) rats trained to lever press for ethanol in 30-min self-administration sessions. Four responses on an "active" lever led to presentation of 0.1 ml of 15% (vol/vol) ethanol by a liquid dipper and concurrent activation of a set of discrete light and auditory cues. In a 70-min extinction/reinstatement session, responding was first extinguished for 60 min. Subsequently, different stimuli were delivered in a noncontingent manner and reinstatement of nonreinforced responding was assessed. Fifteen presentations of the ethanol-predictive stimulus complex, including the dipper cup containing 5 or 15% ethanol, potently reinstated responding on the previously active lever. The magnitude of reinstatement increased with the number of stimulus presentations and concentration of ethanol presented by the dipper cup. Fifteen presentations of the ethanol-predictive stimulus complex, including the dipper cup filled with water (0% ethanol), did not produce any reinstatement. These results indicate that (1) noncontingent presentations of the ethanol-predictive stimulus complex may reinstate ethanol seeking in sP rats and (2) the orosensory properties of ethanol may play an important role in reinstatement of ethanol seeking in sP rats. The latter finding concurs with clinical observations that odor and taste of alcoholic beverages elicit immediate craving responses in abstinent alcoholics.

Within-subject neural reactivity to reward and threat is inverted in young adolescents.

Science.gov (United States)

Thomason, M E; Marusak, H A

2017-07-01

As children mature, they become increasingly independent and less reliant on caregiver support. Changes in brain systems are likely to stimulate and guide this process. One mechanistic hypothesis suggests that changes in neural systems that process reward and threat support the increase in exploratory behavior observed in the transition to adolescence. This study examines the basic tenets of this hypothesis by performing functional magnetic resonance imaging (fMRI) during well-established reward and threat processing tasks in 40 children and adolescents, aged 9-15 years. fMRI responses in the striatum and amygdala are fit to a model predicting that striatal reward and amygdala threat-responses will be unrelated in younger participants (aged 9-12 years), while older participants (aged 13-15 years) will differentially engage these structures. Our data are consistent with this model. Activity in the striatum and amygdala are comparable in younger children, but in older children, they are inversely related; those more responsive to reward show a reduced threat-response. Analyses testing age as a continuous variable yield consistent results. In addition, the proportion of threat to reward-response relates to self-reported approach behavior in older but not younger youth, exposing behavioral relevance in the relative level of activity in these structures. Results are consistent with the notion that both individual and developmental differences drive reward-seeking behavior in adolescence. While these response patterns may serve adaptive functions in the shift to independence, skew in these systems may relate to increased rates of emotional psychopathology and risk-taking observed in adolescence.

Adolescent neural response to reward is related to participant sex and task motivation.

Science.gov (United States)

Alarcón, Gabriela; Cservenka, Anita; Nagel, Bonnie J

2017-02-01

Risky decision making is prominent during adolescence, perhaps contributed to by heightened sensation seeking and ongoing maturation of reward and dopamine systems in the brain, which are, in part, modulated by sex hormones. In this study, we examined sex differences in the neural substrates of reward sensitivity during a risky decision-making task and hypothesized that compared with girls, boys would show heightened brain activation in reward-relevant regions, particularly the nucleus accumbens, during reward receipt. Further, we hypothesized that testosterone and estradiol levels would mediate this sex difference. Moreover, we predicted boys would make more risky choices on the task. While boys showed increased nucleus accumbens blood oxygen level-dependent (BOLD) response relative to girls, sex hormones did not mediate this effect. As predicted, boys made a higher percentage of risky decisions during the task. Interestingly, boys also self-reported more motivation to perform well and earn money on the task, while girls self-reported higher state anxiety prior to the scan session. Motivation to earn money partially mediated the effect of sex on nucleus accumbens activity during reward. Previous research shows that increased motivation and salience of reinforcers is linked with more robust striatal BOLD response, therefore psychosocial factors, in addition to sex, may play an important role in reward sensitivity. Elucidating neurobiological mechanisms that support adolescent sex differences in risky decision making has important implications for understanding individual differences that lead to advantageous and adverse behaviors that affect health outcomes. Copyright © 2016 Elsevier Inc. All rights reserved.

Reward, Context, and Human Behaviour

Directory of Open Access Journals (Sweden)

Clare L. Blaukopf

2007-01-01

Full Text Available Animal models of reward processing have revealed an extensive network of brain areas that process different aspects of reward, from expectation and prediction to calculation of relative value. These results have been confirmed and extended in human neuroimaging to encompass secondary rewards more unique to humans, such as money. The majority of the extant literature covers the brain areas associated with rewards whilst neglecting analysis of the actual behaviours that these rewards generate. This review strives to redress this imbalance by illustrating the importance of looking at the behavioural outcome of rewards and the context in which they are produced. Following a brief review of the literature of reward-related activity in the brain, we examine the effect of reward context on actions. These studies reveal how the presence of reward vs. reward and punishment, or being conscious vs. unconscious of reward-related actions, differentially influence behaviour. The latter finding is of particular importance given the extent to which animal models are used in understanding the reward systems of the human mind. It is clear that further studies are needed to learn about the human reaction to reward in its entirety, including any distinctions between conscious and unconscious behaviours. We propose that studies of reward entail a measure of the animal's (human or nonhuman knowledge of the reward and knowledge of its own behavioural outcome to achieve that reward.

Heterogeneity of reward mechanisms.

Science.gov (United States)

Lajtha, A; Sershen, H

2010-06-01

The finding that many drugs that have abuse potential and other natural stimuli such as food or sexual activity cause similar chemical changes in the brain, an increase in extracellular dopamine (DA) in the shell of the nucleus accumbens (NAccS), indicated some time ago that the reward mechanism is at least very similar for all stimuli and that the mechanism is relatively simple. The presently available information shows that the mechanisms involved are more complex and have multiple elements. Multiple brain regions, multiple receptors, multiple distinct neurons, multiple transmitters, multiple transporters, circuits, peptides, proteins, metabolism of transmitters, and phosphorylation, all participate in reward mechanisms. The system is variable, is changed during development, is sex-dependent, and is influenced by genetic differences. Not all of the elements participate in the reward of all stimuli. Different set of mechanisms are involved in the reward of different drugs of abuse, yet different mechanisms in the reward of natural stimuli such as food or sexual activity; thus there are different systems that distinguish different stimuli. Separate functions of the reward system such as anticipation, evaluation, consummation and identification; all contain function-specific elements. The level of the stimulus also influences the participation of the elements of the reward system, there are possible reactions to even below threshold stimuli, and excessive stimuli can change reward to aversion involving parts of the system. Learning and memory of past reward is an important integral element of reward and addictive behavior. Many of the reward elements are altered by repeated or chronic stimuli, and chronic exposure to one drug is likely to alter the response to another stimulus. To evaluate and identify the reward stimulus thus requires heterogeneity of the reward components in the brain.

Dopamine in the Brain: Hypothesizing Surfeit or Deficit Links to Reward and Addiction.

Science.gov (United States)

Blum, Kenneth; Thanos, Peter K; Oscar-Berman, Marlene; Febo, Marcelo; Baron, David; Badgaiyan, Rajendra D; Gardner, Eliot; Demetrovics, Zsolt; Fahlke, Claudia; Haberstick, Brett C; Dushaj, Kristina; Gold, Mark S

Recently there has been debate concerning the role of brain dopamine in reward and addiction. David Nutt and associates eloquently proposed that dopamine (DA) may be central to psycho stimulant dependence and some what important for alcohol, but not important for opiates, nicotine or even cannabis. Others have also argued that surfeit theories can explain for example cocaine seeking behavior as well as non-substance-related addictive behaviors. It seems prudent to distinguish between what constitutes "surfeit" compared to" deficit" in terms of short-term (acute) and long-term (chronic) brain reward circuitry responsivity. In an attempt to resolve controversy regarding the contributions of mesolimbic DA systems to reward, we review the three main competing explanatory categories: "liking", "learning", and "wanting". They are (a) the hedonic impact -liking reward, (b) the ability to predict rewarding effects-learning and (c) the incentive salience of reward-related stimuli -wanting. In terms of acute effects, most of the evidence seems to favor the "surfeit theory". Due to preferential dopamine release at mesolimbic-VTA-caudate-accumbens loci most drugs of abuse and Reward Deficiency Syndrome (RDS) behaviors have been linked to heightened feelings of well-being and hyperdopaminergic states.The "dopamine hypotheses" originally thought to be simple, is now believed to be quite complex and involves encoding the set point of hedonic tone, encoding attention, reward expectancy, and incentive motivation. Importantly, Willuhn et al. shows that in a self-administration paradigm, (chronic) excessive use of cocaine is caused by decreased phasic dopamine signaling in the striatum. In terms of chronic addictions, others have shown a blunted responsivity at brain reward sites with food, nicotine, and even gambling behavior. Finally, we are cognizant of the differences in dopaminergic function as addiction progresses and argue that relapse may be tied to dopamine deficiency

Nicotine self-administration and reinstatement of nicotine-seeking in male and female rats.

Science.gov (United States)

Feltenstein, Matthew W; Ghee, Shannon M; See, Ronald E

2012-03-01

Tobacco addiction is a relapsing disorder that constitutes a substantial worldwide health problem, with evidence suggesting that nicotine and nicotine-associated stimuli play divergent roles in maintaining smoking behavior in men and women. While animal models of tobacco addiction that utilize nicotine self-administration have become more widely established, systematic examination of the multiple factors that instigate relapse to nicotine-seeking have been limited. Here, we examined nicotine self-administration and subsequent nicotine-seeking in male and female Sprague-Dawley rats using an animal model of self-administration and relapse. Rats lever pressed for nicotine (0.03 and 0.05 mg/kg/infusion, IV) during 15 daily 2-h sessions, followed by extinction of lever responding. Once responding was extinguished, we examined the ability of previously nicotine-paired cues (tone+light), the anxiogenic drug yohimbine (2.5mg/kg, IP), a priming injection of nicotine (0.3mg/kg, SC), or combinations of drug+cues to reinstate nicotine-seeking. Both males and females readily acquired nicotine self-administration and displayed comparable levels of responding and intake at both nicotine doses. Following extinction, exposure to the previously nicotine-paired cues or yohimbine, but not the nicotine-prime alone, reinstated nicotine-seeking in males and females. Moreover, when combined with nicotine-paired cues, both yohimbine and nicotine enhanced reinstatement. No significant sex differences or estrous cycle dependent changes were noted across reinstatement tests. These results demonstrate the ability to reinstate nicotine-seeking with multiple modalities and that exposure to nicotine-associated cues during periods of a stressful state or nicotine can increase nicotine-seeking. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Reward and loss anticipation in panic disorder: An fMRI study.

Science.gov (United States)

Held-Poschardt, Dada; Sterzer, Philipp; Schlagenhauf, Florian; Pehrs, Corinna; Wittmann, Andre; Stoy, Meline; Hägele, Claudia; Knutson, Brian; Heinz, Andreas; Ströhle, Andreas

2018-01-30

Anticipatory anxiety and harm avoidance are essential features of panic disorder (PD) and may involve deficits in the reward system of the brain, in particular in the ventral striatum. While neuroimaging studies on PD have focused on fearful and negative affective stimulus processing, no investigations have directly addressed deficits in reward and loss anticipation. To determine whether the ventral striatum shows abnormal neural activity in PD patients during anticipation of loss or gain, an event-related functional magnetic resonance imaging experiment using a monetary incentive delay task was employed in 10 patients with PD and 10 healthy controls. A repeated-measures ANOVA to identify effects of group (PD vs. Control) and condition (anticipation of loss vs. gain vs. neutral outcome) revealed that patients with PD showed significantly reduced bilateral ventral striatal activation during reward anticipation but increased activity during loss anticipation. Within the patient group, the degree of activation in the ventral striatum during loss-anticipation was positively correlated with harm avoidance and negatively correlated with novelty seeking. These findings suggest that behavioural impairments in panic disorder may be related to abnormal neural processing of motivational cues. Copyright © 2017 Elsevier B.V. All rights reserved.

Decision making in the reward and punishment variants of the iowa gambling task: evidence of "foresight" or "framing"?

Science.gov (United States)

Singh, Varsha; Khan, Azizuddin

2012-01-01

Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT) observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160). It was contended that risk aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision making in the two IGT variants. Apart from the frame of the variant as a within-subjects factor (variant type: reward and punishment), the order in which the frame was triggered (order type: reward-punishment or punishment-reward), and the four types of instructions that delineated motivation toward reward from that of punishment (reward, punishment, reward and punishment, and no-hint) were hypothesized to have an effect on foresighted decision making in the IGT. As expected, long-term decision making differed across the two IGT variants suggesting that the frame of the variant has an effect on long-term decision making in the IGT (p decision making in the two IGT variants (p decision making is sensitive to reward and punishment frame in an asymmetric manner, an observation that is aligned with the behavioral decision making framework. Benefits of integrating findings from behavioral studies in decision neuroscience are discussed, and a need to investigate cultural differences in the IGT studies is pointed out.

Dopamine reward prediction error coding

OpenAIRE

Schultz, Wolfram

2016-01-01

Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards?an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less...

Class B Fire-Extinguishing Performance Evaluation of a Compressed Air Foam System at Different Air-to-Aqueous Foam Solution Mixing Ratios

Directory of Open Access Journals (Sweden)

Dong-Ho Rie

2016-06-01

Full Text Available The purpose of this research is to evaluate the fire-extinguishing performance of a compressed air foam system at different mixing ratios of pressurized air. In this system, compressed air is injected into an aqueous solution of foam and then discharged. The experimental device uses an exclusive fire-extinguishing technology with compressed air foam that is produced based on the Canada National Laboratory and UL (Underwriters Laboratories 162 standards, with a 20-unit oil fire model (Class B applied as the fire extinguisher. Compressed air is injected through the air mixture, and results with different air-to-aqueous solution foam ratios of 1:4, 1:7, and 1:10 are studied. In addition, comparison experiments between synthetic surfactant foam and a foam type which forms an aqueous film are carried out at an air-to-aqueous solution foam ratio of 1:4. From the experimental results, at identical discharging flows, it was found that the fire-extinguishing effect of the aqueous film-forming foam is greatest at an air-to-aqueous solution foam ratio of 1:7 and weakest at 1:10. Moreover, the fire-extinguishing effect of the aqueous film-forming foam in the comparison experiments between the aqueous film-forming foam and the synthetic surfactant foam is greatest.

Experimental study of hydrogen jet ignition and jet extinguishment

International Nuclear Information System (INIS)

Wierman, R.W.

1979-04-01

Two phases are described of an experimental study that investigated: (1) the ignition characteristics of hydrogen--sodium jets, (2) the formation of hydrogen in sodium--humid air atmospheres, and (3) the extinguishment characteristics of burning hydrogen--sodium jets. Test conditions were similar to those postulated for highly-improbable breeder reactor core melt-through accidents and included: jet temperature, jet velocity, jet hydrogen concentration, jet sodium concentration, atmospheric oxygen concentration, and atmospheric water vapor concentration

Decision Making in the Reward and Punishment Variants of the Iowa Gambling Task: Evidence of “Foresight” or “Framing”?

OpenAIRE

Singh, Varsha; Khan, Azizuddin

2012-01-01

Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT) observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160). It was contended that risk aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision m...

The anabolic steroid nandrolone alters cannabinoid self-administration and brain CB1 receptor density and function.

Science.gov (United States)

Struik, Dicky; Fadda, Paola; Zara, Tamara; Zamberletti, Erica; Rubino, Tiziana; Parolaro, Daniela; Fratta, Walter; Fattore, Liana

2017-01-01

Clinical and pre-clinical observations indicate that anabolic-androgenic steroids can induce neurobiological changes that alter the rewarding effects of drugs of abuse. In this study, we investigated the effect of the anabolic steroid nandrolone on the rewarding properties of the cannabinoid CB 1 receptor agonist WIN55,212-2 (WIN) in rats. Lister Hooded male rats were treated intramuscularly with nandrolone (15mg/kg) or vehicle for 14 consecutive days, and then allowed to self-administer WIN (12.5μg/kg/infusion) intravenously. After reaching stable drug intake, self-administration behavior was extinguished to examine drug- and cue-induced reinstatement of cannabinoid-seeking behavior. Other behavioral parameters presumed to influence drug-taking and drug-seeking behaviors were examined to gain more insight into the behavioral specificity of nandrolone treatment. Finally, animals were sacrificed for analysis of CB 1 receptor density and function in selected brain areas. We found that nandrolone-treated rats self-administered up to 2 times more cannabinoid than vehicle-treated rats, but behaved similarly to control rats when tested for drug- and cue-induced reinstatement of cannabinoid-seeking behavior. Enhanced cannabinoid intake by nandrolone-treated rats was not accompanied by changes in locomotor activity, sensorimotor gating, or memory function. However, our molecular data show that after chronic WIN self-administration nandrolone-treated rats display altered CB 1 receptor density and function in selected brain areas. We hypothesize that increased cannabinoid self-administration in nandrolone-treated rats results from a nandrolone-induced decrease in reward function, which rats seem to compensate by voluntarily increasing their cannabinoid intake. Altogether, our findings corroborate the hypothesis that chronic exposure to anabolic-androgenic steroids induces dysfunction of the reward pathway in rats and might represent a potential risk factor for abuse of

Individual differences in anticipatory activity to food rewards predict cue-induced appetitive 50-kHz calls in rats.

Science.gov (United States)

Brenes, Juan C; Schwarting, Rainer K W

2015-10-01

Reward-related stimuli come to acquire incentive salience through Pavlovian learning and become capable of controlling reward-oriented behaviors. Here, we examined individual differences in anticipatory activity elicited by reward-related cues as indicative of how animals attribute incentive salience to otherwise neutral stimuli. Since adult rats can signal incentive motivation states through ultrasonic vocalizations (USVs) at around 50-kHz, such calls were recorded in food-deprived rats trained to associate cues with food rewards, which were subsequently devalued by satiation.We found that the extent to which animals developed conditioned anticipatory activity to food cues while food deprived determined the level of cue-induced appetitive USVs while sated. Re-exposure to reward cues after a free-testing period reinstated USVs, invigorated reward seeking and consumption, and again, increases in calling occurred only in animals with high levels of cue-induced anticipatory activity. Reward-experienced rats systemically challenged with the catecholamine agonist amphetamine or with the dopamine receptor antagonist flupenthixol showed attenuated responses to these drugs, especially for USVs and in subjects with high levels of cue-induced anticipatory activity. Our results suggest that individuals prone to attribute incentive salience to reward cues showed heightened reward-induced USVs which were reliably expressed over time and persisted despite physiological needs being fulfilled. Also, prone subjects seemed to undergo particular adaptations in their dopaminergic system related with incentive learning. Our findings may have translational relevance in preclinical research modeling compulsive disorders, which may be due to excessive attribution of incentive salience to reward cues, such as overeating, pathological gambling, and drug addiction.

Commitment to Self-Rewards

OpenAIRE

Koch, Alexander K.; Nafziger, Julia

2009-01-01

Self-administered rewards are ubiquitous. They serve as incentives for personal accomplish¬ments and are widely recommended as tools for overcoming self-control problems. However, it seems puzzling why self-rewards can work: the prospect of a reward has a motivating force only if the threat of self-denial of the reward after low performance is credible. We explain how a rational forward-looking individual may achieve commitment to self-rewards, by applying Köszegi and Rabin's (2006) model of ...

nor-BNI Antagonism of Kappa Opioid Agonist-Induced Reinstatement of Ethanol-Seeking Behavior

Directory of Open Access Journals (Sweden)

Erin Harshberger

2016-01-01

Full Text Available Recent work suggests that the dynorphin (DYN/kappa opioid receptor (KOR system may be a key mediator in the behavioral effects of alcohol. The objective of the present study was to examine the ability of the KOR antagonist norbinaltorphimine (nor-BNI to attenuate relapse to ethanol seeking due to priming injections of the KOR agonist U50,488 at time points consistent with KOR selectivity. Male Wistar rats were trained to self-administer a 10% ethanol solution, and then responding was extinguished. Following extinction, rats were injected with U50,488 (0.1–10 mg/kg, i.p. or saline and were tested for the reinstatement of ethanol seeking. Next, the ability of the nonselective opioid receptor antagonist naltrexone (0 or 3.0 mg/kg, s.c. and nor-BNI (0 or 20.0 mg/kg, i.p. to block U50,488-induced reinstatement was examined. Priming injections U50,488 reinstated responding on the previously ethanol-associated lever. Pretreatment with naltrexone reduced the reinstatement of ethanol-seeking behavior. nor-BNI also attenuated KOR agonist-induced reinstatement, but to a lesser extent than naltrexone, when injected 24 hours prior to injections of U50,488, a time point that is consistent with KOR selectivity. While these results suggest that activation of KORs is a key mechanism in the regulation of ethanol-seeking behavior, U50,488-induced reinstatement may not be fully selective for KORs.

Random reward priming is task-contingent: The robustness of the 1-trial reward priming effect

Directory of Open Access Journals (Sweden)

Árni Gunnar Ásgeirsson

2014-04-01

Full Text Available Consistent financial reward of particular features influences the allocation of visual attention in many ways. More surprising are 1-trial reward priming effects on attention where reward schedules are random and reward on one trial influences attentional allocation on the next. Those findings are thought to reflect that rewarded features become more salient than unrewarded ones on the subsequent trial. Here we attempt to conceptually replicate this effect, testing its generalizability. In three versions of an analogous paradigm to the additional singleton paradigm involving singleton search for a Gabor patch of odd spatial frequency we found no evidence of reward priming, while we only partially replicate the reward priming in the exact original paradigm tested by Hickey and colleagues. The results cast doubt on the proposal that random reward enhances salience, suggested in the original papers, and highlight the need for a more nuanced account. In many other paradigms reward effects have been found to progress gradually, becoming stronger as they build up, and we argue that for robust reward priming, reward schedules need to be more consistent than in the original 1-trial reward priming paradigm.

A correction term for the covariance of renewal-reward processes with multivariate rewards

NARCIS (Netherlands)

Patch, B.; Nazarathy, Y.; Taimre, T.

We consider a renewal-reward process with multivariate rewards. Such a process is constructed from an i.i.d. sequence of time periods, to each of which there is associated a multivariate reward vector. The rewards in each time period may depend on each other and on the period length, but not on the

The role of medial prefrontal cortex in extinction and reinstatement of alcohol-seeking in rats.

Science.gov (United States)

Willcocks, Andrea L; McNally, Gavan P

2013-01-01

The prelimbic (PL) and infralimbic (IL) medial prefrontal cortex (mPFC) are thought to play opposing roles in drug-seeking behaviour. Specifically, the PL promotes drug-seeking whereas the IL is necessary for the inhibition of drug-seeking during extinction. We studied the roles of the PL, IL and dorsal peduncular PFC (DP) in the expression of context-induced reinstatement, reacquisition and extinction of alcoholic beer-seeking. In context-induced reinstatement (renewal), animals were trained to nosepoke for alcoholic beer (context A), extinguished (context B) and then tested in context A and B. In reacquisition, animals received the same instrumental training and extinction without any contextual manipulation. On test, alcoholic beer was again available and responding was compared with naive controls. Just prior to the test, rats received bilateral infusion of baclofen/muscimol into the PL, IL or DP. Reversible inactivation of the PL attenuated ABA renewal but augmented reacquisition. Reversible inactivation of IL had no effect on the reinstatement or reacquisition of alcoholic beer-seeking and had no effect on extinction expression (ABB and AAA). IL inactivation did, however, increase the latencies with which animals responded on test but only when animals were tested in the extinction context. DP inactivation had no effect on reinstatement or reacquisition. These studies are inconsistent with the view that PL and IL exert opposing effects on drug-seeking. Rather, they support the view that PL is important for retrieval of drug-seeking contingency information and that the use of contextual information is enhanced with IL manipulation. © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Extending overjustification: the effect of perceived reward-giver intention on response to rewards.

Science.gov (United States)

Forehand, M R

2000-12-01

The perceived intention model incorporates a new moderator, beliefs about reward-giver intention, into the overjustification paradigm. In 2 simulated shopping studies featuring products paired with promotional rewards, consumers who believed the marketer was promotion focused (reward used to encourage purchase) reported lower purchase intentions and brand attitudes for promoted products after promotion, whereas consumers who believed the marketer was reward focused (promotion used to distribute the reward) showed no attitude change. Promotion-focus beliefs lowered attitudes by heightening the contingency between the promotion and purchase and thereby increasing the perceived causal role of the reward. This effect was contingent on initial behavior--postpromotion attitude change occurred for consumers who actively engaged in product decisions but not for consumers who passively observed the choice sets.

Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

NARCIS (Netherlands)

van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A M

A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth

Activation of pyramidal neurons in mouse medial prefrontal cortex enhances food seeking behavior while reducing impulsivity in the absence of an effect on food intake

Directory of Open Access Journals (Sweden)

Daniel McAllister Warthen

2016-03-01

Full Text Available The medial prefrontal cortex (mPFC is involved in a wide range of executive cognitive functions, including reward evaluation, decision-making, memory extinction, mood, and task switching. Manipulation of the mPFC has been shown to alter food intake and food reward valuation, but whether exclusive stimulation of mPFC pyramidal neurons, which form the principle output of the mPFC, is sufficient to mediate food rewarded instrumental behavior is unknown. We sought to determine the behavioral consequences of manipulating mPFC output by exciting pyramidal neurons in mouse mPFC during performance of a panel of behavioral assays, focusing on food reward. We found that increasing mPFC pyramidal cell output using Designer Receptors Exclusively Activated by Designer Drugs (DREADD enhanced performance in instrumental food reward assays that assess food seeking behavior, while sparing effects in affect and food intake. Specifically, activation of mPFC pyramidal neurons enhanced operant responding for food reward, reinstatement of palatable food seeking, and suppression of impulsive responding for food reward. Conversely, activation of mPFC pyramidal neurons had no effect on unconditioned food intake, social interaction, or behavior in an open field. Furthermore, we found that behavioral outcome is influenced by the degree of mPFC activation, with a low drive sufficient to enhance operant responding and a higher drive required to alter impulsivity. Additionally, we provide data demonstrating that DREADD stimulation involves a nitric oxide synthase dependent pathway, similar to endogenous muscarinic M3 receptor stimulation, a finding that provides novel mechanistic insight into an increasingly widespread method of remote neuronal control.

Fifty Years in the Development of a Glutaminergic-Dopaminergic Optimization Complex (KB220) to Balance Brain Reward Circuitry in Reward Deficiency Syndrome: A Pictorial

Science.gov (United States)

Blum, K; Febo, M; Badgaiyan, RD

2016-01-01

Dopamine along with other chemical messengers like serotonin, cannabinoids, endorphins and glutamine, play significant roles in brain reward processing. There is a devastating opiate/opioid epidemicin the United States. According to the Centers for Disease Control and Prevention (CDC), at least 127 people, young and old, are dying every day due to narcotic overdose and alarmingly heroin overdose is on the rise. The Food and Drug Administration (FDA) has approved some Medication-Assisted Treatments (MATs) for alcoholism, opiate and nicotine dependence, but nothing for psychostimulant and cannabis abuse. While these pharmaceuticals are essential for the short-term induction of “psychological extinction,” in the long-term caution is necessary because their use favors blocking dopaminergic function indispensable for achieving normal satisfaction in life. The two institutions devoted to alcoholism and drug dependence (NIAAA & NIDA) realize that MATs are not optimal and continue to seek better treatment options. We review, herein, the history of the development of a glutaminergic-dopaminergic optimization complex called KB220 to provide for the possible eventual balancing of the brain reward system and the induction of “dopamine homeostasis.” This complex may provide substantial clinical benefit to the victims of Reward Deficiency Syndrome (RDS) and assist in recovery from iatrogenically induced addiction to unwanted opiates/opioids and other addictive behaviors. PMID:27840857

Motivation and reward systems

NARCIS (Netherlands)

van Eerde, W.; Vodosek, M.; den Hartog, D.N.; McNett, J.M.

2014-01-01

Reward systems are identified as one of the human resource management (HRM) practices that may impact motivation. Reward systems may consist of several components, including financial and nonfinancial rewards, in fixed and variable amounts. Reinforcement, expectancy, and equity principles are

Chronic mitragynine (kratom) enhances punishment resistance in natural reward seeking and impairs place learning in mice.

Science.gov (United States)

Ismail, Nurul Iman W; Jayabalan, Nanthini; Mansor, Sharif Mahsufi; Müller, Christian P; Muzaimi, Mustapha

2017-07-01

Kratom (Mitragyna speciosa) is a widely abused herbal drug preparation in Southeast Asia. It is often consumed as a substitute for heroin, but imposing itself unknown harms and addictive burdens. Mitragynine is the major psychostimulant constituent of kratom that has recently been reported to induce morphine-like behavioural and cognitive effects in rodents. The effects of chronic consumption on non-drug related behaviours are still unclear. In the present study, we investigated the effects of chronic mitragynine treatment on spontaneous activity, reward-related behaviour and cognition in mice in an IntelliCage® system, and compared them with those of morphine and Δ-9-tetrahydrocannabinol (THC). We found that chronic mitragynine treatment significantly potentiated horizontal exploratory activity. It enhanced spontaneous sucrose preference and also its persistence when the preference had aversive consequences. Furthermore, mitragynine impaired place learning and its reversal. Thereby, mitragynine effects closely resembled that of morphine and THC sensitisation. These findings suggest that chronic mitragynine exposure enhances spontaneous locomotor activity and the preference for natural rewards, but impairs learning and memory. These findings confirm pleiotropic effects of mitragynine (kratom) on human lifestyle, but may also support the recognition of the drug's harm potential. © 2016 Society for the Study of Addiction.

Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards.

Science.gov (United States)

Smoski, Moria J; Rittenberg, Alison; Dichter, Gabriel S

2011-12-30

Anhedonia, the loss of interest or pleasure in normally rewarding activities, is a hallmark feature of unipolar Major Depressive Disorder (MDD). A growing body of literature has identified frontostriatal dysfunction during reward anticipation and outcomes in MDD. However, no study to date has directly compared responses to different types of rewards such as pleasant images and monetary rewards in MDD. To investigate the neural responses to monetary and pleasant image rewards in MDD, a modified Monetary Incentive Delay task was used during functional magnetic resonance imaging to assess neural responses during anticipation and receipt of monetary and pleasant image rewards. Participants included nine adults with MDD and 13 affectively healthy controls. The MDD group showed lower activation than controls when anticipating monetary rewards in right orbitofrontal cortex and subcallosal cortex, and when anticipating pleasant image rewards in paracingulate and supplementary motor cortex. The MDD group had relatively greater activation in right putamen when anticipating monetary versus pleasant image rewards, relative to the control group. Results suggest reduced reward network activation in MDD when anticipating rewards, as well as relatively greater hypoactivation to pleasant image than monetary rewards. 2011 Elsevier Ireland Ltd. All rights reserved.

Multiple reward-cue contingencies favor expectancy over uncertainty in shaping the reward-cue attentional salience.

Science.gov (United States)

De Tommaso, Matteo; Mastropasqua, Tommaso; Turatto, Massimo

2018-01-25

Reward-predicting cues attract attention because of their motivational value. A debated question regards the conditions under which the cue's attentional salience is governed more by reward expectancy rather than by reward uncertainty. To help shedding light on this relevant issue, here, we manipulated expectancy and uncertainty using three levels of reward-cue contingency, so that, for example, a high level of reward expectancy (p = .8) was compared with the highest level of reward uncertainty (p = .5). In Experiment 1, the best reward-cue during conditioning was preferentially attended in a subsequent visual search task. This result was replicated in Experiment 2, in which the cues were matched in terms of response history. In Experiment 3, we implemented a hybrid procedure consisting of two phases: an omission contingency procedure during conditioning, followed by a visual search task as in the previous experiments. Crucially, during both phases, the reward-cues were never task relevant. Results confirmed that, when multiple reward-cue contingencies are explored by a human observer, expectancy is the major factor controlling both the attentional and the oculomotor salience of the reward-cue.

The amygdala, reward and emotion.

Science.gov (United States)

Murray, Elisabeth A

2007-11-01

Recent research provides new insights into amygdala contributions to positive emotion and reward. Studies of neuronal activity in the monkey amygdala and of autonomic responses mediated by the monkey amygdala show that, contrary to a widely held view, the amygdala is just as important for processing positive reward and reinforcement as it is for negative. In addition, neuropsychological studies reveal that the amygdala is essential for only a fraction of what might be considered 'stimulus-reward processing', and that the neural substrates for emotion and reward are partially nonoverlapping. Finally, evidence suggests that two systems within the amygdala, operating in parallel, enable reward-predicting cues to influence behavior; one mediates a general, arousing effect of reward and the other links the sensory properties of reward to emotion.

High temporal discounters overvalue immediate rewards rather than undervalue future rewards: an event-related brain potential study.

Science.gov (United States)

Cherniawsky, Avital S; Holroyd, Clay B

2013-03-01

Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that "high discounters" in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.

Addictive drugs and brain stimulation reward.

Science.gov (United States)

Wise, R A

1996-01-01

Direct electrical or chemical stimulation of specific brain regions can establish response habits similar to those established by natural rewards such as food or sexual contact. Cocaine, mu and delta opiates, nicotine, phencyclidine, and cannabis each have actions that summate with rewarding electrical stimulation of the medial forebrain bundle (MFB). The reward-potentiating effects of amphetamine and opiates are associated with central sites of action where these drugs also have their direct rewarding effects, suggesting common mechanisms for drug reward per se and for drug potentiation of brain stimulation reward. The central sites at which these and perhaps other drugs of abuse potentiate brain stimulation reward and are rewarding in their own right are consistent with the hypothesis that the laboratory reward of brain stimulation and the pharmacological rewards of addictive drugs are habit forming because they act in the brain circuits that subserve more natural and biologically significant rewards.

Dopaminergic modulation of reward-guided decision making in alcohol-preferring AA rats.

Science.gov (United States)

Oinio, Ville; Bäckström, Pia; Uhari-Väänänen, Johanna; Raasmaja, Atso; Piepponen, Petteri; Kiianmaa, Kalervo

2017-05-30

R**esults from animal gambling models have highlighted the importance of dopaminergic neurotransmission in modulating decision making when large sucrose rewards are combined with uncertainty. The majority of these models use food restriction as a tool to motivate animals to accomplish operant behavioral tasks, in which sucrose is used as a reward. As enhanced motivation to obtain sucrose due to hunger may impact its reward-seeking effect, we wanted to examine the decision-making behavior of rats in a situation where rats were fed ad libitum. For this purpose, we chose alcohol-preferring AA (alko alcohol) rats, as these rats have been shown to have high preference for sweet agents. In the present study, AA rats were trained to self-administer sucrose pellet rewards in a two-lever choice task (one pellet vs. three pellets). Once rational choice behavior had been established, the probability of gaining three pellets was decreased over time (50%, 33%, 25% then 20%). The effect of d-amphetamine on decision making was studied at every probability level, as well as the effect of the dopamine D 1 receptor agonist SKF-81297 and D 2 agonist quinpirole at probability levels of 100% and 25%. d-Amphetamine increased unprofitable choices in a dose-dependent manner at the two lowest probability levels. Quinpirole increased the frequency of unprofitable decisions at the 25% probability level, and SKF-82197 did not affect choice behavior. These results mirror the findings of probabilistic discounting studies using food-restricted rats. Based on this, the use of AA rats provides a new approach for studies on reward-guided decision making. Copyright © 2017 Elsevier B.V. All rights reserved.

Frontal glutamate and reward processing in adolescence and adulthood.

Science.gov (United States)

Gleich, Tobias; Lorenz, Robert C; Pöhland, Lydia; Raufelder, Diana; Deserno, Lorenz; Beck, Anne; Heinz, Andreas; Kühn, Simone; Gallinat, Jürgen

2015-11-01

The fronto-limbic network interaction, driven by glutamatergic and dopaminergic neurotransmission, represents a core mechanism of motivated behavior and personality traits. Reward seeking behavior undergoes tremendous changes in adolescence paralleled by neurobiological changes of this network including the prefrontal cortex, striatum and amygdala. Since fronto-limbic dysfunctions also underlie major psychiatric diseases beginning in adolescence, this investigation focuses on network characteristics separating adolescents from adults. To investigate differences in network interactions, the brain reward system activity (slot machine task) together with frontal glutamate concentration (anterior cingulate cortex, ACC) was measured in 28 adolescents and 26 adults employing functional magnetic resonance imaging and magnetic resonance spectroscopy, respectively. An inverse coupling of glutamate concentrations in the ACC and activation of the ventral striatum was observed in adolescents. Further, amygdala response in adolescents was negatively correlated with the personality trait impulsivity. For adults, no significant associations of network components or correlations with impulsivity were found. The inverse association between frontal glutamate concentration and striatal activation in adolescents is in line with the triadic model of motivated behavior stressing the important role of frontal top-down inhibition on limbic structures. Our data identified glutamate as the mediating neurotransmitter of this inhibitory process and demonstrates the relevance of glutamate on the reward system and related behavioral traits like impulsivity. This fronto-limbic coupling may represent a vulnerability factor for psychiatric disorders starting in adolescence but not in adulthood.

A Markov reward model checker

NARCIS (Netherlands)

Katoen, Joost P.; Maneesh Khattri, M.; Zapreev, I.S.; Zapreev, I.S.

2005-01-01

This short tool paper introduces MRMC, a model checker for discrete-time and continuous-time Markov reward models. It supports reward extensions of PCTL and CSL, and allows for the automated verification of properties concerning long-run and instantaneous rewards as well as cumulative rewards. In

Premotor and Motor Cortices Encode Reward.

Directory of Open Access Journals (Sweden)

Pavan Ramkumar

Full Text Available Rewards associated with actions are critical for motivation and learning about the consequences of one's actions on the world. The motor cortices are involved in planning and executing movements, but it is unclear whether they encode reward over and above limb kinematics and dynamics. Here, we report a categorical reward signal in dorsal premotor (PMd and primary motor (M1 neurons that corresponds to an increase in firing rates when a trial was not rewarded regardless of whether or not a reward was expected. We show that this signal is unrelated to error magnitude, reward prediction error, or other task confounds such as reward consumption, return reach plan, or kinematic differences across rewarded and unrewarded trials. The availability of reward information in motor cortex is crucial for theories of reward-based learning and motivational influences on actions.

Impaired reward responsiveness in schizophrenia.

Science.gov (United States)

Taylor, Nicholas; Hollis, Jeffrey P; Corcoran, Sarah; Gross, Robin; Cuthbert, Bruce; Swails, Lisette W; Duncan, Erica

2018-03-08

Anhedonia is a core negative symptom of schizophrenia. Schizophrenia patients report largely intact pleasure in consuming rewards, but have impairments in generating motivated behavior to pursue rewards, and show reduced fMRI activation of the reward pathway during presentation of rewarded stimuli. A computer based task measuring the development of a response bias in favor of rewarded stimuli permits assessment of reward-induced motivation. We hypothesized that subjects with schizophrenia would be impaired on this task. 58 schizophrenia subjects (SCZ) and 52 healthy controls (CON) were studied with a signal detection task to assess reward responsiveness. In multiple trials over three blocks subjects were asked to correctly identify two stimuli that were paired with unequal chance of monetary reward. The critical outcome variable was response bias, the development of a greater percent correct identification of the stimulus that was rewarded more often. An ANOVA on response bias with Block as a repeated-measures factor and Diagnosis as a between-group factor indicated that SCZ subjects achieved a lower bias to rewarded stimuli than CON subjects (F(1,105)=8.82, p=0.004, η 2 =0.078). Post hoc tests indicated that SCZ subjects had significantly impaired bias in Block 1 (p=0.002) and Block 2 (p=0.05), indicating that SCZ were slower to achieve normal levels of bias during the session. SCZ subjects were slower to develop response bias to rewarded stimuli than CON subjects. This finding is consonant with the hypothesis that people with schizophrenia have a blunted capacity to modify behavior in response to reward. Copyright © 2018. Published by Elsevier B.V.

Monetary rewards modulate inhibitory control

Directory of Open Access Journals (Sweden)

Paula Marcela Herrera

2014-05-01

Full Text Available The ability to override a dominant response, often referred to as behavioural inhibiton, is considered a key element of executive cognition. Poor behavioural inhibition is a defining characteristic of several neurological and psychiatric populations. Recently, there has been increasing interest in the motivational dimension of behavioural inhibition, with some experiments incorporating emotional contingencies in classical inhibitory paradigms such as the Go/Nogo and Stop Signal Tasks. Several studies have reported a positive modulatory effect of reward on the performance of such tasks in pathological conditions such as substance abuse, pathological gambling, and ADHD. However, experiments that directly investigate the modulatory effects of reward magnitudes on the performance of inhibitory paradigms are rare and consequently, little is known about the finer grained relationship between motivation and self-control. Here, we probed the effect of reward and reward magnitude on behavioural inhibition using two modified version of the widely used Stop Signal Task. The first task compared no reward with reward, whilst the other compared two different reward magnitudes. The reward magnitude effect was confirmed by the second study, whereas it was less compelling in the first study, possibly due to the effect of having no reward in some conditions. In addition, our results showed a kick start effect over global performance measures. More specifically, there was a long lasting improvement in performance throughout the task, when participants received the highest reward magnitudes at the beginning of the protocol. These results demonstrate that individuals’ behavioural inhibition capacities are dynamic not static because they are modulated by the reward magnitude and initial reward history of the task at hand.

Commitment to self-rewards

DEFF Research Database (Denmark)

Koch, Alexander; Nafziger, Julia

People often overcome self-control problems by promising to reward themselves for accomplishing a task. Such strategies based on self-administered rewards however require the person to believe that she would indeed deny herself the reward if she should fail to achieve the desired outcome. Drawing...... on Koszegi and Rabin's (2006) model of endogenous reference point formation, we show how a rational forward-looking individual can achieve such internal commitment. But our results also demonstrate the limitations of self regulation based on self-rewards....

Monetary rewards influence retrieval orientations.

Science.gov (United States)

Halsband, Teresa M; Ferdinand, Nicola K; Bridger, Emma K; Mecklinger, Axel

2012-09-01

Reward anticipation during learning is known to support memory formation, but its role in retrieval processes is so far unclear. Retrieval orientations, as a reflection of controlled retrieval processing, are one aspect of retrieval that might be modulated by reward. These processes can be measured using the event-related potentials (ERPs) elicited by retrieval cues from tasks with different retrieval requirements, such as via changes in the class of targeted memory information. To determine whether retrieval orientations of this kind are modulated by reward during learning, we investigated the effects of high and low reward expectancy on the ERP correlates of retrieval orientation in two separate experiments. The reward manipulation at study in Experiment 1 was associated with later memory performance, whereas in Experiment 2, reward was directly linked to accuracy in the study task. In both studies, the participants encoded mixed lists of pictures and words preceded by high- or low-reward cues. After 24 h, they performed a recognition memory exclusion task, with words as the test items. In addition to a previously reported material-specific effect of retrieval orientation, a frontally distributed, reward-associated retrieval orientation effect was found in both experiments. These findings suggest that reward motivation during learning leads to the adoption of a reward-associated retrieval orientation to support the retrieval of highly motivational information. Thus, ERP retrieval orientation effects not only reflect retrieval processes related to the sought-for materials, but also relate to the reward conditions with which items were combined during encoding.

Reward and punishment.

Science.gov (United States)

Sigmund, K; Hauert, C; Nowak, M A

2001-09-11

Minigames capturing the essence of Public Goods experiments show that even in the absence of rationality assumptions, both punishment and reward will fail to bring about prosocial behavior. This result holds in particular for the well-known Ultimatum Game, which emerges as a special case. But reputation can induce fairness and cooperation in populations adapting through learning or imitation. Indeed, the inclusion of reputation effects in the corresponding dynamical models leads to the evolution of economically productive behavior, with agents contributing to the public good and either punishing those who do not or rewarding those who do. Reward and punishment correspond to two types of bifurcation with intriguing complementarity. The analysis suggests that reputation is essential for fostering social behavior among selfish agents, and that it is considerably more effective with punishment than with reward.

Oxytocin Differentially Affects Sucrose Taking and Seeking in Male and Female Rats

OpenAIRE

Zhou, Luyi; Ghee, Shannon M.; See, Ronald E.; Reichel, Carmela M.

2015-01-01

Oxytocin has a modulatory role in natural and drug reward processes. While the role of oxytocin in pair bonding and reproduction has been extensively studied, sex differences in conditioned and unconditioned behavioral responses to oxytocin treatment have not been fully characterized. Here, we determined whether male and female rats would show similar dose response curves in response to acute oxytocin on measures of locomotor activity, sucrose seeking, and sucrose intake. Male and freely cycl...

A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task

Directory of Open Access Journals (Sweden)

Varsha eSingh

2013-12-01

Full Text Available The Iowa Gambling Task (IGT is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit. It was assumed in the present study that the emotion- and cognition-based processing dichotomy manifests in the IGT as reward and punishment frequency and the intertemporal attribute. It was further proposed that the delineation of emotion- and cognition-based processing is contingent upon reward and punishment as manifested in the frame of the task (variant type and task motivation (instruction type. The effects of IGT variant type (reward vs. punishment and instruction type (task motivation induced by instruction types: reward, punishment, reward and punishment, or no hint on the intertemporal and frequency attributes of IGT decision-making were analyzed. Decision making in the reward variant was equally governed by both attributes, and significantly affected by instruction type, while decision making in the punishment variant was differentially affected by the two attributes and not significantly impacted by instruction type. These results suggest that reward and punishment manifested via task frame as well as the task motivation may facilitate the differentiation of emotion- and cognition-based processing in the IGT.

A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task.

Science.gov (United States)

Singh, Varsha

2013-01-01

The Iowa Gambling Task (IGT) is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit). It was assumed in the present study that the emotion- and cognition-based processing dichotomy manifests in the IGT as reward and punishment frequency and the intertemporal attribute. It was further proposed that the delineation of emotion- and cognition-based processing is contingent upon reward and punishment as manifested in the frame of the task (variant type) and task motivation (instruction type). The effects of IGT variant type (reward vs. punishment) and instruction type (task motivation induced by instruction types: reward, punishment, reward and punishment, or no hint) on the intertemporal and frequency attributes of IGT decision-making were analyzed. Decision making in the reward variant was equally governed by both attributes, and significantly affected by instruction type, while decision making in the punishment variant was differentially affected by the two attributes and not significantly impacted by instruction type. These results suggest that reward and punishment manifested via task frame as well as the task motivation may facilitate the differentiation of emotion- and cognition-based processing in the IGT.

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward

Science.gov (United States)

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios

2014-01-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. PMID:25008408

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward.

Science.gov (United States)

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios; Musallam, Sam

2014-10-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. Copyright © 2014 the American Physiological Society.

DEVELOPMENT OF A WATER SPOUT FOR THE ACTIVE EXTINGUISHING OF THE FOCUS OF AN INTENSE FLAME

Directory of Open Access Journals (Sweden)

Stanislav LICHOROBIEC

2017-12-01

Full Text Available The topic of the article is devoted to the experimental development of directional charges, which have a front part filled with water and are thus capable of forming a high velocity water jet, which has intense cooling effects and is accompanied by a shock wave created by the explosion of the charge. The water jet can then be used to extinguish the flame from an intense fire epicenter caused, for example, by a gas pipe failure, a tank with flammable liquid or an oil well. The text is accompanied with the visual design of the water spout prototype, including the experimental test of extinguishing the focus of an intense flame caused by various sources.

Development of a Standard Test Scenario to Evaluate the Effectiveness of Portable Fire Extinguishers on Lithium-ion Battery Fires

Science.gov (United States)

Juarez, Alfredo; Harper, Susan A.; Hirsch, David B.; Carriere, Thierry

2013-01-01

Many sources of fuel are present aboard current spacecraft, with one especially hazardous source of stored energy: lithium ion batteries. Lithium ion batteries are a very hazardous form of fuel due to their self-sustaining combustion once ignited, for example, by an external heat source. Batteries can become extremely energetic fire sources due to their high density electrochemical energy content that may, under duress, be violently converted to thermal energy and fire in the form of a thermal runaway. Currently, lithium ion batteries are the preferred types of batteries aboard international spacecraft and therefore are routinely installed, collectively forming a potentially devastating fire threat to a spacecraft and its crew. Currently NASA is developing a fine water mist portable fire extinguisher for future use on international spacecraft. As its development ensues, a need for the standard evaluation of various types of fire extinguishers against this potential threat is required to provide an unbiased means of comparing between fire extinguisher technologies and ranking them based on performance.

Dorsomedial striatum lesions affect adjustment to reward uncertainty, but not to reward devaluation or omission.

Science.gov (United States)

Torres, Carmen; Glueck, Amanda C; Conrad, Shannon E; Morón, Ignacio; Papini, Mauricio R

2016-09-22

The dorsomedial striatum (DMS) has been implicated in the acquisition of reward representations, a proposal leading to the hypothesis that it should play a role in situations involving reward loss. We report the results of an experiment in which the effects of DMS excitotoxic lesions were tested in consummatory successive negative contrast (reward devaluation), autoshaping training with partial vs. continuous reinforcement (reward uncertainty), and appetitive extinction (reward omission). Animals with DMS lesions exhibited reduced lever pressing responding, but enhanced goal entries, during partial reinforcement training in autoshaping. However, they showed normal negative contrast, acquisition under continuous reinforcement (CR), appetitive extinction, and response facilitation in early extinction trials. Open-field testing also indicated normal motor behavior. Thus, DMS lesions selectively affected the behavioral adjustment to a situation involving reward uncertainty, producing a behavioral reorganization according to which goal tracking (goal entries) became predominant at the expense of sign tracking (lever pressing). This pattern of results shows that the function of the DMS in situations involving reward loss is not general, but restricted to reward uncertainty. We suggest that a nonassociative, drive-related process induced by reward uncertainty requires normal output from DMS neurons. Copyright © 2016 IBRO. Published by Elsevier Ltd. All rights reserved.

BOLD responses in reward regions to hypothetical and imaginary monetary rewards.

OpenAIRE

Miyapuram Krishna P; Tobler Philippe N; Gregorios-Pippas Lucy; Schultz Wolfram

2012-01-01

Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewa...

75 FR 48728 - The Hydrostatic Testing Provision of the Portable Fire Extinguishers Standard; Extension of the...

Science.gov (United States)

2010-08-11

... Hydrostatic Testing Provision of the Portable Fire Extinguishers Standard; Extension of the Office of... the information collection requirements contained in the Hydrostatic Testing provision of the Portable... 48729

Reward eliminates retrieval-induced forgetting.

Science.gov (United States)

Imai, Hisato; Kim, Dongho; Sasaki, Yuka; Watanabe, Takeo

2014-12-02

Although it is well known that reward enhances learning and memory, how extensively such enhancement occurs remains unclear. To address this question, we examined how reward influences retrieval-induced forgetting (RIF) in which the retrieval of a nonpracticed item under the same category as a practiced item is worse than the retrieval of a nonpracticed item outside the category. Subjects were asked to try to encode category-exemplar pairs (e.g., FISH-salmon). Then, they were presented with a category name and a two-letter word stem (e.g., FISH-sa) and were asked to complete an encoded word (retrieval practice). For a correct response, apple juice was given as a reward in the reward condition and a beeping sound was presented in the no-reward condition. Finally, subjects were asked to report whether each exemplar had been presented in the first phase. RIF was replicated in the no-reward condition. However, in the reward condition, RIF was eliminated. These results suggest that reward enhances processing of retrieval of unpracticed members by mechanisms such as spreading activation within the same category, irrespective of whether items were practiced or not.

Sodium fires and its extinguishment; Gorenie, sredstva i sposoby tusheniya natriya

Energy Technology Data Exchange (ETDEWEB)

Mikhedov, V G

1979-03-01

The fire safety problems of NPP with sodium coolants in USSR are presented. The design of sodium reactors is made with premises with sodium coolants being hermetic and filled with nitrogen. Some engineering solutions of fire safety including design, elaboration and choice of construction and protection materials are presented. Some theoretical aspects of sodium burning are presented as well as methods of sodium fire extinguishing methods including the use of powder.

Slave to habit? Obesity is associated with decreased behavioural sensitivity to reward devaluation.

Science.gov (United States)

Horstmann, Annette; Dietrich, Anja; Mathar, David; Pössel, Maria; Villringer, Arno; Neumann, Jane

2015-04-01

The motivational value of food is lower during satiety compared to fasting. Dynamic changes in motivational value promote food seeking or meal cessation. In obesity this mechanism might be compromised since obese subjects ingest energy beyond homeostatic needs. Thus, lower adaptation of eating behaviour with respect to changes in motivational value might cause food overconsumption in obesity. To test this hypothesis, we implemented a selective satiation procedure to investigate the relationship between obesity and the size of the behavioural devaluation effect in humans. Lean to obese men (mean age 25.9, range 19-30 years; mean BMI 29.1, range 19.2-45.1 kg/m(2)) were trained on a free operant paradigm and learned to associate cues with the possibility to win different food rewards by pressing a button. After the initial training phase, one of the rewards was devalued by consumption. Response rates for and wanting of the different rewards were measured pre and post devaluation. Behavioural sensitivity to reward devaluation, measured as the magnitude of difference between pre and post responses, was regressed against BMI. Results indicate that (1) higher BMI compared to lower BMI in men led to an attenuated behavioural adjustment to reward devaluation, and (2) the decrease in motivational value was associated with the decrease in response rate between pre and post. Change in explicitly reported motivational value, however, was not affected by BMI. Thus, we conclude that high BMI in men is associated with lower behavioural adaptation with respect to changes in motivational value of food, possibly resulting in automatic overeating patterns that are hard to control in daily life. Copyright © 2014 Elsevier Ltd. All rights reserved.

Orexin/hypocretin neuron activation is correlated with alcohol seeking and preference in a topographically specific manner.

Science.gov (United States)

Moorman, David E; James, Morgan H; Kilroy, Elisabeth A; Aston-Jones, Gary

2016-03-01

Orexin (ORX) (also known as hypocretin) neurons are located exclusively in the posterior hypothalamus, and are involved in a wide range of behaviours, including motivation for drugs of abuse such as alcohol. Hypothalamic subregions contain functionally distinct populations of ORX neurons that may play different roles in regulating drug-motivated and alcohol-motivated behaviours. To investigate the role of ORX neurons in ethanol (EtOH) seeking, we measured Fos activation of ORX neurons in rats following three different measures of EtOH seeking and preference: (i) context-induced reinstatement, or ABA renewal; (ii) cue-induced reinstatement of extinguished responding for EtOH; and (iii) a home cage task in which preference for EtOH (vs. water) was measured in the absence of either reinforcer. We found significant activation of ORX neurons in multiple subregions across all three behavioural tests. Notably, ORX neuron activation in the lateral hypothalamus correlated with the degree of seeking in context reinstatement and the degree of preference in home cage preference testing. In addition, Fos activation in ORX neurons in the dorsomedial hypothalamic and perifornical areas was correlated with context and home cage seeking/preference, respectively. Surprisingly, we found no relationship between the degree of cue-induced reinstatement and ORX neuron activation in any region, despite robust activation overall during reinstatement. These results demonstrate a strong relationship between ORX neuron activation and EtOH seeking/preference, but one that is differentially expressed across ORX field subregions, depending on reinstatement modality. © 2016 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Galanin-Expressing GABA Neurons in the Lateral Hypothalamus Modulate Food Reward and Noncompulsive Locomotion.

Science.gov (United States)

Qualls-Creekmore, Emily; Yu, Sangho; Francois, Marie; Hoang, John; Huesing, Clara; Bruce-Keller, Annadora; Burk, David; Berthoud, Hans-Rudolf; Morrison, Christopher D; Münzberg, Heike

2017-06-21

The lateral hypothalamus (LHA) integrates reward and appetitive behavior and is composed of many overlapping neuronal populations. Recent studies associated LHA GABAergic neurons (LHA GABA ), which densely innervate the ventral tegmental area (VTA), with modulation of food reward and consumption; yet, LHA GABA projections to the VTA exclusively modulated food consumption, not reward. We identified a subpopulation of LHA GABA neurons that coexpress the neuropeptide galanin (LHA Gal ). These LHA Gal neurons also modulate food reward, but lack direct VTA innervation. We hypothesized that LHA Gal neurons may represent a subpopulation of LHA GABA neurons that mediates food reward independent of direct VTA innervation. We used chemogenetic activation of LHA Gal or LHA GABA neurons in mice to compare their role in feeding behavior. We further analyzed locomotor behavior to understand how differential VTA connectivity and transmitter release in these LHA neurons influences this behavior. LHA Gal or LHA GABA neuronal activation both increased operant food-seeking behavior, but only activation of LHA GABA neurons increased overall chow consumption. Additionally, LHA Gal or LHA GABA neuronal activation similarly induced locomotor activity, but with striking differences in modality. Activation of LHA GABA neurons induced compulsive-like locomotor behavior; while LHA Gal neurons induced locomotor activity without compulsivity. Thus, LHA Gal neurons define a subpopulation of LHA GABA neurons without direct VTA innervation that mediate noncompulsive food-seeking behavior. We speculate that the striking difference in compulsive-like locomotor behavior is also based on differential VTA innervation. The downstream neural network responsible for this behavior and a potential role for galanin as neuromodulator remains to be identified. SIGNIFICANCE STATEMENT The lateral hypothalamus (LHA) regulates motivated feeding behavior via GABAergic LHA neurons. The molecular identity of LHA

Cholinergic modulation of mesolimbic dopamine function and reward.

Science.gov (United States)

Mark, Gregory P; Shabani, Shkelzen; Dobbs, Lauren K; Hansen, Stephen T

2011-07-25

The substantial health risk posed by obesity and compulsive drug use has compelled a serious research effort to identify the neurobiological substrates that underlie the development these pathological conditions. Despite substantial progress, an understanding of the neurochemical systems that mediate the motivational aspects of drug-seeking and craving remains incomplete. Important work from the laboratory of Bart Hoebel has provided key information on neurochemical systems that interact with dopamine (DA) as potentially important components in both the development of addiction and the expression of compulsive behaviors such as binge eating. One such modulatory system appears to be cholinergic pathways that interact with DA systems at all levels of the reward circuit. Cholinergic cells in the pons project to DA-rich cell body regions in the ventral tegmental area (VTA) and substantial nigra (SN) where they modulate the activity of dopaminergic neurons and reward processing. The DA terminal region of the nucleus accumbens (NAc) contains a small but particularly important group of cholinergic interneurons, which have extensive dendritic arbors that make synapses with a vast majority of NAc neurons and afferents. Together with acetylcholine (ACh) input onto DA cell bodies, cholinergic systems could serve a vital role in gating information flow concerning the motivational value of stimuli through the mesolimbic system. In this report we highlight evidence that CNS cholinergic systems play a pivotal role in behaviors that are motivated by both natural and drug rewards. We argue that the search for underlying neurochemical substrates of compulsive behaviors, as well as attempts to identify potential pharmacotherapeutic targets to combat them, must include a consideration of central cholinergic systems. Copyright © 2011 Elsevier Inc. All rights reserved.

Reward-based behaviors and emotional processing in human with narcolepsy-cataplexy

Directory of Open Access Journals (Sweden)

Sophie eBayard

2013-05-01

Full Text Available ajor advances in the past decade have led a better understanding of the pathophysiology of narcolepsy with cataplexy caused by the early loss of hypothalamic hypocretin neurons. Although a role for hypocretin in the regulation of sleep/wakefulness state is widely recognized, other functions, not necessarily related to arousal, have been identified. Hence, the hypocretin system enhances signaling in the mesolimbic pathways regulating reward processing, emotion and mood regulation, and addiction. Although studies on hypocretin-deficient mice have shown that hypocretin plays an essential role in reward-seeking, depression-like behavior and addiction, results in human narcolepsy remained subject to debate. Most of studies revealed that hypocretin-deficient narcolepsy patients either drug-free or medicated with psychostimulant had preferences towards risky choices in a decision-making task under ambiguity together with higher frequency of depressive symptoms and binge eating disorder compared to controls. However, human studies mostly reported the lack of association with pathological impulsivity and gambling, and substance and alcohol abuse in the context of narcolepsy-cataplexy. Prospective larger studies are required to confirm these findings in drug-free and medicated patients with narcolepsy. Inclusion of patients with other central hypersomnias without hypocretin deficiency will provide answer to the major question of the role of the hypocretin system in reward-based behaviors and emotional processing in humans.

Decision making in the reward and punishment variants of the Iowa gambling task: Evidence of foresight or framing?

Directory of Open Access Journals (Sweden)

Varsha eSingh

2012-07-01

Full Text Available Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160. It was contended that risk-aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision making in the two IGT variants. Apart from the frame of the variant as a within-subjects factor (variant type: reward and punishment, the order in which the frame was triggered (order type: reward–punishment or punishment–reward, and the four types of instructions that delineated motivation towards reward from that of punishment (reward, punishment, reward and punishment, and no-hint were hypothesized to have an effect on foresighted decision making in the IGT. As expected, long-term decision making differed across the two IGT variants suggesting that the frame of the variant has an effect on long-term decision making in the IGT (p < 0.001. The order in which a variant was presented, and the type of the instructions that were used both had an effect on long-term decision making in the two IGT variants (p < 0.05. A post hoc test suggested that the instructions that differentiated between reward and punishment resulted in greater foresight than the commonly used IGT instructions that fail to distinguish between reward and punishment. As observed in previous studies, there were more number of participants (60% who showed greater foresight in the punishment variant than in the reward variant (p< 0.001. The results suggest that foresight in IGT decision making is sensitive to reward and punishment frame in an asymmetric manner, an observation that is aligned with the behavioral decision-making framework. Benefits of integrating findings from behavioral studies

Dynamics of plasma catecholamine and corticosterone concentrations during reinforced and extinguished operant behavior in rats

NARCIS (Netherlands)

de Boer, S.F.; de Beun, R; Slangen, J L; van der Gugten, J

Plasma noradrenaline (NA), adrenaline (A) and corticosterone (CS) concentrations were determined simultaneously in permanently heart-cannulated rats before and during the performance of reinforced and nonreinforced (extinguished) operant behavior. Shortly before the experimental food-reinforced (VI

High on food: the interaction between the neural circuits for feeding and for reward.

Science.gov (United States)

Liu, Jing-Jing; Mukherjee, Diptendu; Haritan, Doron; Ignatowska-Jankowska, Bogna; Liu, Ji; Citri, Ami; Pang, Zhiping P

2015-04-01

Hunger, mostly initiated by a deficiency in energy, induces food seeking and intake. However, the drive toward food is not only regulated by physiological needs, but is motivated by the pleasure derived from ingestion of food, in particular palatable foods. Therefore, feeding is viewed as an adaptive motivated behavior that involves integrated communication between homeostatic feeding circuits and reward circuits. The initiation and termination of a feeding episode are instructed by a variety of neuronal signals, and maladaptive plasticity in almost any component of the network may lead to the development of pathological eating disorders. In this review we will summarize the latest understanding of how the feeding circuits and reward circuits in the brain interact. We will emphasize communication between the hypothalamus and the mesolimbic dopamine system and highlight complexities, discrepancies, open questions and future directions for the field.

Monetary reward speeds up voluntary saccades.

Science.gov (United States)

Chen, Lewis L; Chen, Y Mark; Zhou, Wu; Mustain, William D

2014-01-01

Past studies have shown that reward contingency is critical for sensorimotor learning, and reward expectation speeds up saccades in animals. Whether monetary reward speeds up saccades in human remains unknown. Here we addressed this issue by employing a conditional saccade task, in which human subjects performed a series of non-reflexive, visually-guided horizontal saccades. The subjects were (or were not) financially compensated for making a saccade in response to a centrally-displayed visual congruent (or incongruent) stimulus. Reward modulation of saccadic velocities was quantified independently of the amplitude-velocity coupling. We found that reward expectation significantly sped up voluntary saccades up to 30°/s, and the reward modulation was consistent across tests. These findings suggest that monetary reward speeds up saccades in human in a fashion analogous to how juice reward sped up saccades in monkeys. We further noticed that the idiosyncratic nasal-temporal velocity asymmetry was highly consistent regardless of test order, and its magnitude was not correlated with the magnitude of reward modulation. This suggests that reward modulation and the intrinsic velocity asymmetry may be governed by separate mechanisms that regulate saccade generation.

Effects of L-cysteine on reinstatement of ethanol-seeking behavior and on reinstatement-elicited extracellular signal-regulated kinase phosphorylation in the rat nucleus accumbens shell.

Science.gov (United States)

Peana, Alessandra T; Giugliano, Valentina; Rosas, Michela; Sabariego, Marta; Acquas, Elio

2013-01-01

Alcoholism is a neuroadaptive disorder, and the understanding of the mechanisms of the high rates of relapse, which characterize it, represents one of the most demanding challenges in alcoholism and addiction research. The extracellular signal-regulated kinase (ERK) is an intracellular kinase, critical for neuroplasticity in the adult brain that is suggested to play a fundamental role in the molecular mechanisms underlying drug addiction and relapse. We previously observed that a nonessential amino acid, L-cysteine, significantly decreases oral ethanol (EtOH) self-administration, reinstatement of EtOH-drinking behavior, and EtOH self-administration break point. Here, we tested whether L-cysteine can affect the ability of EtOH priming to induce reinstatement of EtOH-seeking behavior. In addition, we determined the ability of EtOH priming to induce ERK phosphorylation as well as the ability of L-cysteine to affect reinstatement-elicited ERK activation. To these purposes, Wistar rats were trained to nose-poke for a 10% v/v EtOH solution. After stable drug-taking behavior was obtained, nose-poking for EtOH was extinguished, and reinstatement of drug seeking, as well as reinstatement-elicited pERK, was determined after an oral, noncontingent, priming of EtOH (0.08 g/kg). Rats were pretreated with either saline or L-cysteine (80 to 120 mg/kg) 30 minutes before testing for reinstatement. The findings of this study confirm that the noncontingent delivery of a nonpharmacologically active dose of EtOH to rats, whose previous self-administration behavior had been extinguished, results in significant reinstatement into EtOH-seeking behavior. In addition, the results indicate that reinstatement selectively activates ERK phosphorylation in the shell of the nucleus accumbens (Acb) and that pretreatment with L-cysteine reduces either reinstatement of EtOH seeking and reinstatement-elicited pERK in the AcbSh. Altogether, these results indicate that L-cysteine could be an effective

Abstinence duration modulates striatal functioning during monetary reward processing in cocaine patients.

Science.gov (United States)

Bustamante, Juan-Carlos; Barrós-Loscertales, Alfonso; Costumero, Víctor; Fuentes-Claramonte, Paola; Rosell-Negre, Patricia; Ventura-Campos, Noelia; Llopis, Juan-José; Ávila, César

2014-09-01

Pre-clinical and clinical studies in cocaine addiction highlight alterations in the striatal dopaminergic reward system that subserve maintenance of cocaine use. Using an instrumental conditioning paradigm with monetary reinforcement, we studied striatal functional alterations in long-term abstinent cocaine-dependent patients and striatal functioning as a function of abstinence and treatment duration. Eighteen patients and 20 controls underwent functional magnetic resonance imaging during a Monetary Incentive Delay task. Region of interest analyses based on masks of the dorsal and ventral striatum were conducted to test between-group differences and the functional effects in the cocaine group of time (in months) with no more than two lapses from the first time patients visited the clinical service to seek treatment at the scanning time (duration of treatment), and the functional effects of the number of months with no lapses or relapses at the scanning session time (length of abstinence). We applied a voxel-wise and a cluster-wise FWE-corrected level (pFWE) at a threshold of P reward anticipation than the control group. The regression analyses in the patients group revealed a positive correlation between duration of treatment and brain activity in the left caudate during reward anticipation. Likewise, length of abstinence negatively correlated with brain activity in the bilateral nucleus accumbens during monetary outcome processing. In conclusion, caudate and nucleus accumbens show a different brain response pattern to non-drug rewards during cocaine addiction, which can be modulated by treatment success. © 2013 The Authors, Addiction Biology © 2013 Society for the Study of Addiction.

Developmental changes in the reward positivity: An electrophysiological trajectory of reward processing

Directory of Open Access Journals (Sweden)

Carmen N. Lukie

2014-07-01

Full Text Available Children and adolescents learn to regulate their behavior by utilizing feedback from the environment but exactly how this ability develops remains unclear. To investigate this question, we recorded the event-related brain potential (ERP from children (8–13 years, adolescents (14–17 years and young adults (18–23 years while they navigated a “virtual maze” in pursuit of monetary rewards. The amplitude of the reward positivity, an ERP component elicited by feedback stimuli, was evaluated for each age group. A current theory suggests the reward positivity is produced by the impact of reinforcement learning signals carried by the midbrain dopamine system on anterior cingulate cortex, which utilizes the signals to learn and execute extended behaviors. We found that the three groups produced a reward positivity of comparable size despite relatively longer ERP component latencies for the children, suggesting that the reward processing system reaches maturity early in development. We propose that early development of the midbrain dopamine system facilitates the development of extended goal-directed behaviors in anterior cingulate cortex.

Longer treatment with alternative non-drug reinforcement fails to reduce resurgence of cocaine or alcohol seeking in rats.

Science.gov (United States)

Nall, Rusty W; Craig, Andrew R; Browning, Kaitlyn O; Shahan, Timothy A

2018-04-02

Provision of alternative non-drug reinforcement is among the most effective methods for treating substance use disorders. However, when alternative reinforcers become unavailable during treatment interruptions or upon cessation of treatment, relapse often occurs. Relapse following the loss of alternative reinforcement is known as resurgence. One factor that could reduce resurgence is longer duration of treatment with alternative reinforcement, but the available data are mixed. Further, the effects of length of treatment have previously only been examined with food seeking. The present experiments directly examined if duration of treatment impacted the magnitude of resurgence of cocaine or alcohol seeking in rats. First, rats were trained to self-administer cocaine (Experiment 1) or alcohol (Experiment 2) by performing a target behavior. Second, target behavior was extinguished and performing an alternative behavior produced an alternative non-drug (i.e., food) reinforcer. Finally, resurgence was assessed following removal of alternative reinforcement after either 5 or 20 sessions of treatment. Treatment duration did not differentially affect resurgence of cocaine seeking in Experiment 1 or Alcohol seeking in Experiment 2. These results suggest that extended treatment with alternative non-drug reinforcement may not decrease propensity to relapse. Further, these results may have implications for treatment of substance use disorders and for theories of resurgence. Copyright © 2017 Elsevier B.V. All rights reserved.

Random reward priming is task-contingent

DEFF Research Database (Denmark)

Ásgeirsson, Árni Gunnar; Kristjánsson, Árni

2014-01-01

Consistent financial reward of particular features influences the allocation of visual attention in many ways. More surprising are 1-trial reward priming effects on attention where reward schedules are random and reward on one trial influences attentional allocation on the next. Those findings...

Incremental effects of reward on creativity.

Science.gov (United States)

Eisenberger, R; Rhoades, L

2001-10-01

The authors examined 2 ways reward might increase creativity. First, reward contingent on creativity might increase extrinsic motivation. Studies 1 and 2 found that repeatedly giving preadolescent students reward for creative performance in 1 task increased their creativity in subsequent tasks. Study 3 reported that reward promised for creativity increased college students' creative task performance. Second, expected reward for high performance might increase creativity by enhancing perceived self-determination and, therefore, intrinsic task interest. Study 4 found that employees' intrinsic job interest mediated a positive relationship between expected reward for high performance and creative suggestions offered at work. Study 5 found that employees' perceived self-determination mediated a positive relationship between expected reward for high performance and the creativity of anonymous suggestions for helping the organization.

Expected reward value and reward uncertainty have temporally dissociable effects on memory formation

OpenAIRE

Adcock, R; Clement, Nathaniel; Chiew, Kimberly; Dickerson, Kathryn; Stanek, Jessica

2018-01-01

Anticipating rewards has been shown to enhance memory formation. While substantial evidence implicates dopamine in this behavioral effect, the precise mechanisms remain ambiguous. Because dopamine nuclei show two distinct physiological signatures of reward prediction, we hypothesized two dissociable effects on memory formation. These two signatures are a phasic dopamine response immediately following a reward cue that encodes its expected value, and a sustained, ramping dopamine response that...

Neural correlates of reward processing in healthy siblings of patients with schizophrenia : Reward processing in schizophrenia siblings

NARCIS (Netherlands)

Hanssen, E.M.E.

2015-01-01

Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be

Social reward shapes attentional biases.

Science.gov (United States)

Anderson, Brian A

2016-01-01

Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us.

Investigation of the Extinguishing Features for Liquid Fuels and Organic Flammable Liquids Atomized by a Water Flow

Directory of Open Access Journals (Sweden)

Voytkov Ivan V.

2016-01-01

Full Text Available The processes of heat and mass transfer were investigated experimentally while moving and evaporating the atomized water flow in high-temperature combustion products of typical liquid fuels and organic flammable liquids: gasoline, kerosene, acetone, crude oil, industrial alcohol. We determined typical periods of liquid extinguishing by an atomized water flow of various dispersability. Data of the discharge of extinguishing medium corresponding to various parameters of atomization and duration of using the atomization devices was presented. It is shown that Um≈3.5 m/s is a minimal outflow velocity of droplets during moving while passing the distance of 1m in the high-temperature gas medium to stop the combustion of organic liquids.

Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events.

Science.gov (United States)

Murayama, Kou; Kitagami, Shinji

2014-02-01

Recent research suggests that extrinsic rewards promote memory consolidation through dopaminergic modulation processes. However, no conclusive behavioral evidence exists given that the influence of extrinsic reward on attention and motivation during encoding and consolidation processes are inherently confounded. The present study provides behavioral evidence that extrinsic rewards (i.e., monetary incentives) enhance human memory consolidation independently of attention and motivation. Participants saw neutral pictures, followed by a reward or control cue in an unrelated context. Our results (and a direct replication study) demonstrated that the reward cue predicted a retrograde enhancement of memory for the preceding neutral pictures. This retrograde effect was observed only after a delay, not immediately upon testing. An additional experiment showed that emotional arousal or unconscious resource mobilization cannot explain the retrograde enhancement effect. These results provide support for the notion that the dopaminergic memory consolidation effect can result from extrinsic reward.

Discrete-time rewards model-checked

NARCIS (Netherlands)

Larsen, K.G.; Andova, S.; Niebert, Peter; Hermanns, H.; Katoen, Joost P.

2003-01-01

This paper presents a model-checking approach for analyzing discrete-time Markov reward models. For this purpose, the temporal logic probabilistic CTL is extended with reward constraints. This allows to formulate complex measures – involving expected as well as accumulated rewards – in a precise and

Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats

Directory of Open Access Journals (Sweden)

Howes Nathan J

2005-05-01

Full Text Available Abstract Background Animals must frequently make choices between alternative courses of action, seeking to maximize the benefit obtained. They must therefore evaluate the magnitude and the likelihood of the available outcomes. Little is known of the neural basis of this process, or what might predispose individuals to be overly conservative or to take risks excessively (avoiding or preferring uncertainty, respectively. The nucleus accumbens core (AcbC is known to contribute to rats' ability to choose large, delayed rewards over small, immediate rewards; AcbC lesions cause impulsive choice and an impairment in learning with delayed reinforcement. However, it is not known how the AcbC contributes to choice involving probabilistic reinforcement, such as between a large, uncertain reward and a small, certain reward. We examined the effects of excitotoxic lesions of the AcbC on probabilistic choice in rats. Results Rats chose between a single food pellet delivered with certainty (p = 1 and four food pellets delivered with varying degrees of uncertainty (p = 1, 0.5, 0.25, 0.125, and 0.0625 in a discrete-trial task, with the large-reinforcer probability decreasing or increasing across the session. Subjects were trained on this task and then received excitotoxic or sham lesions of the AcbC before being retested. After a transient period during which AcbC-lesioned rats exhibited relative indifference between the two alternatives compared to controls, AcbC-lesioned rats came to exhibit risk-averse choice, choosing the large reinforcer less often than controls when it was uncertain, to the extent that they obtained less food as a result. Rats behaved as if indifferent between a single certain pellet and four pellets at p = 0.32 (sham-operated or at p = 0.70 (AcbC-lesioned by the end of testing. When the probabilities did not vary across the session, AcbC-lesioned rats and controls strongly preferred the large reinforcer when it was certain, and strongly

Reward processing in the value-driven attention network: reward signals tracking cue identity and location.

Science.gov (United States)

Anderson, Brian A

2017-03-01

Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Putting Desire on a Budget: Dopamine and Energy Expenditure, Reconciling Reward and Resources

Directory of Open Access Journals (Sweden)

Jeff A Beeler

2012-07-01

Full Text Available Accumulating evidence indicates integration of dopamine function with metabolic signals, highlighting a potential role for dopamine in energy balance, frequently construed as modulating reward in response to homeostatic state. Though its precise role remains controversial, the reward perspective of dopamine has dominated investigation of motivational disorders, including obesity. In the hypothesis outlined here, we suggest instead that the primary role of dopamine in behavior is to modulate activity to adapt behavioral energy expenditure to the prevailing environmental energy conditions, with the role of dopamine in reward and motivated behaviors derived from its primary role in energy balance. Dopamine has long been known to modulate activity, exemplified by psychostimulants that act via dopamine. More recently, there has been nascent investigation into the role of dopamine in modulating voluntary activity, with some investigators suggesting that dopamine may serve as a final common pathway that couples energy sensing to regulated voluntary energy expenditure. We suggest that interposed between input from both the internal and external world, dopamine modulates behavioral energy expenditure along two axes: a conserve-expend axis that regulates generalized activity and an explore-exploit axes that regulates the degree to which reward value biases the distribution of activity. In this view, increased dopamine does not promote consumption of tasty food. Instead increased dopamine promotes energy expenditure and exploration while decreased dopamine favors energy conservation and exploitation. This hypothesis provides a mechanistic interpretation to an apparent paradox: the well-established role of dopamine in food seeking and the findings that low dopaminergic functions are associated with obesity. Our hypothesis provides an alternative perspective on the role of dopamine in obesity and reinterprets the ‘reward deficiency hypothesis’ as a

Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.

Science.gov (United States)

Kim, Sang Hee; Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

2015-09-01

In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Ratbot automatic navigation by electrical reward stimulation based on distance measurement in unknown environments.

Science.gov (United States)

Gao, Liqiang; Sun, Chao; Zhang, Chen; Zheng, Nenggan; Chen, Weidong; Zheng, Xiaoxiang

2013-01-01

Traditional automatic navigation methods for bio-robots are constrained to configured environments and thus can't be applied to tasks in unknown environments. With no consideration of bio-robot's own innate living ability and treating bio-robots in the same way as mechanical robots, those methods neglect the intelligence behavior of animals. This paper proposes a novel ratbot automatic navigation method in unknown environments using only reward stimulation and distance measurement. By utilizing rat's habit of thigmotaxis and its reward-seeking behavior, this method is able to incorporate rat's intrinsic intelligence of obstacle avoidance and path searching into navigation. Experiment results show that this method works robustly and can successfully navigate the ratbot to a target in the unknown environment. This work might put a solid base for application of ratbots and also has significant implication of automatic navigation for other bio-robots as well.

Learned reward association improves visual working memory.

Science.gov (United States)

Gong, Mengyuan; Li, Sheng

2014-04-01

Statistical regularities in the natural environment play a central role in adaptive behavior. Among other regularities, reward association is potentially the most prominent factor that influences our daily life. Recent studies have suggested that pre-established reward association yields strong influence on the spatial allocation of attention. Here we show that reward association can also improve visual working memory (VWM) performance when the reward-associated feature is task-irrelevant. We established the reward association during a visual search training session, and investigated the representation of reward-associated features in VWM by the application of a change detection task before and after the training. The results showed that the improvement in VWM was significantly greater for items in the color associated with high reward than for those in low reward-associated or nonrewarded colors. In particular, the results from control experiments demonstrate that the observed reward effect in VWM could not be sufficiently accounted for by attentional capture toward the high reward-associated item. This was further confirmed when the effect of attentional capture was minimized by presenting the items in the sample and test displays of the change detection task with the same color. The results showed significantly larger improvement in VWM performance when the items in a display were in the high reward-associated color than those in the low reward-associated or nonrewarded colors. Our findings suggest that, apart from inducing space-based attentional capture, the learned reward association could also facilitate the perceptual representation of high reward-associated items through feature-based attentional modulation.

BOLD responses in reward regions to hypothetical and imaginary monetary rewards

NARCIS (Netherlands)

Miyapuram, K.P.; Tobler, P.N.; Gregorios-Pippas, L.; Schultz, W.

2012-01-01

Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary

Neural processing of calories in brain reward areas can be modulated by reward sensitivity

Directory of Open Access Journals (Sweden)

Inge eVan Rijn

2016-01-01

Full Text Available A food’s reward value is dependent on its caloric content. Furthermore, a food’s acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity, however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015, in which participants (n=30 tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n=18 (Griffioen-Roose et al., 2013. First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS questionnaire.When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate, right amygdala and anterior cingulate cortex (bilaterally correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per

Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity.

Science.gov (United States)

van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A M

2015-01-01

A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin) during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n = 18) (Griffioen-Roose et al., 2013). First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS) questionnaire. When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate), right amygdala and anterior cingulate cortex (bilaterally) correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per se may be

Continuous, but not intermittent, antipsychotic drug delivery intensifies the pursuit of reward cues.

Science.gov (United States)

Bédard, Anne-Marie; Maheux, Jérôme; Lévesque, Daniel; Samaha, Anne-Noël

2011-05-01

Chronic exposure to antipsychotic medications can persistently change brain dopamine systems. Most studies on the functional significance of these neural changes have focused on motor behavior and few have addressed how long-term antipsychotic treatment might influence dopamine-mediated reward function. We asked, therefore, whether a clinically relevant antipsychotic treatment regimen would alter the incentive motivational properties of a reward cue. We assessed the ability of a Pavlovian-conditioned stimulus to function as a conditioned reward, as well as to elicit approach behavior in rats treated with haloperidol, either continuously (achieved via subcutaneous osmotic minipump) or intermittently (achieved via daily subcutaneous injections). Continuous, but not intermittent, treatment enhanced the ability of amphetamine to potentiate the conditioned reinforcing effects of a cue associated with water. This effect was not related to differences in the ability to attribute predictive value to a conditioned stimulus (as measured by conditioned approach behavior), but was potentially linked to the development of behavioral supersensitivity to amphetamine and to augmented amphetamine-induced immediate early-gene expression (c-fos and Nur77) in dorsal striatopallidal and striatonigral cells. By enhancing the ability of reward cues to control behavior and by intensifying dopamine-mediated striatopallidal and striatonigral cell activity, standard (ie, continuous) antipsychotic treatment regimens might exacerbate drug-seeking and drug-taking behavior in schizophrenia. Achieving regular but transiently high antipsychotic levels in the brain (as modeled in the intermittent condition) might be a viable option to prevent these changes. This possibility should be explored in the clinic.

Novelty Seeking and Drug Addiction in Humans and Animals: From Behavior to Molecules.

Science.gov (United States)

Wingo, Taylor; Nesil, Tanseli; Choi, Jung-Seok; Li, Ming D

2016-09-01

Global treatment of drug addiction costs society billions of dollars annually, but current psychopharmacological therapies have not been successful at desired rates. The increasing number of individuals suffering from substance abuse has turned attention to what makes some people more vulnerable to drug addiction than others. One personality trait that stands out as a contributing factor is novelty seeking. Novelty seeking, affected by both genetic and environmental factors, is defined as the tendency to desire novel stimuli and environments. It can be measured in humans through questionnaires and in rodents using behavioral tasks. On the behavioral level, both human and rodent studies demonstrate that high novelty seeking can predict the initiation of drug use and a transition to compulsive drug use and create a propensity to relapse. These predictions are valid for several drugs of abuse, such as alcohol, nicotine, cocaine, amphetamine, and opiates. On the molecular level, both novelty seeking and addiction are modulated by the central reward system in the brain. Dopamine is the primary neurotransmitter involved in the overlapping neural substrates of both parameters. In sum, the novelty-seeking trait can be valuable for predicting individual vulnerability to drug addiction and for generating successful treatment for patients with substance abuse disorders.

Influence of menarche on the relation between diurnal cortisol production and ventral striatum activity during reward anticipation.

Science.gov (United States)

LeMoult, Joelle; Colich, Natalie L; Sherdell, Lindsey; Hamilton, J Paul; Gotlib, Ian H

2015-09-01

Adolescence is characterized by an increase in risk-taking and reward-seeking behaviors. In other populations, increased risk taking has been associated with tighter coupling between cortisol production and ventral striatum (VS) activation during reward anticipation; this relation has not yet been examined, however, as a function of adolescent development. This study examined the influence of pubertal development on the association between diurnal cortisol production and VS activity during reward anticipation. Pre- and post-menarcheal girls collected diurnal cortisol and completed an functional magnetic resonance imaging-based monetary incentive delay task, from which we extracted estimates of VS activity during the anticipation of reward, anticipation of loss and anticipation of non-incentive neutral trials. Post-menarcheal girls showed greater coupling between the cortisol awakening response and VS activation during anticipation of reward and loss than did their pre-menarcheal counterparts. Post-menarcheal girls did not differ from pre-menarcheal girls in their cortisol-VS coupling during anticipation of neutral trials, suggesting that puberty-related changes in cortisol-VS coupling are specific to affective stimuli. Interestingly, behavioral responses during the task indicate that post-menarcheal girls are faster to engage with affective stimuli than are pre-menarcheal girls. Thus, post-menarcheal girls exhibit neurobiological and behavioral patterns that have been associated with risk taking and that may underlie the dramatic increase in risk-taking behavior documented during adolescence. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Distinct Reward Properties are Encoded via Corticostriatal Interactions.

Science.gov (United States)

Smith, David V; Rigney, Anastasia E; Delgado, Mauricio R

2016-02-02

The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior.

The Effects of Water Spray Cooling in Conjunction with Halogenated Extinguishants on Hydrogen Fluoride Generation and Decay

National Research Council Canada - National Science Library

Burch, Ian

2007-01-01

The halogenated extinguishants Halon 1301, HFC-227ea (FM200) and NAF-S-III used within Royal Australian Navy vessels for total flooding fire suppression applications have hydrogen fluoride (HF) toxicity concerns...

Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys.

Science.gov (United States)

Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J

2009-01-01

Motivation is usually inferred from the likelihood or the intensity with which behavior is carried out. It is sensitive to external factors (e.g., the identity, amount, and timing of a rewarding outcome) and internal factors (e.g., hunger or thirst). We trained macaque monkeys to perform a nonchoice instrumental task (a sequential red-green color discrimination) while manipulating two external factors: reward size and delay-to-reward. We also inferred the state of one internal factor, level of satiation, by monitoring the accumulated reward. A visual cue indicated the forthcoming reward size and delay-to-reward in each trial. The fraction of trials completed correctly by the monkeys increased linearly with reward size and was hyperbolically discounted by delay-to-reward duration, relations that are similar to those found in free operant and choice tasks. The fraction of correct trials also decreased progressively as a function of the satiation level. Similar (albeit noiser) relations were obtained for reaction times. The combined effect of reward size, delay-to-reward, and satiation level on the proportion of correct trials is well described as a multiplication of the effects of the single factors when each factor is examined alone. These results provide a quantitative account of the interaction of external and internal factors on instrumental behavior, and allow us to extend the concept of subjective value of a rewarding outcome, usually confined to external factors, to account also for slow changes in the internal drive of the subject.

Experimental study on combustion and suppression characteristics of sodium fire in a columnar flow using extinguishing powder

International Nuclear Information System (INIS)

Huo Yan; Zhang Zhigang; Li Jinke; Liu Zhongkun; Ma Yaolong

2017-01-01

In the operation of the sodium-cooled fast reactor, the leakage and fire accident of liquid sodium is common and it is frequent in sodium-related facilities. This study focuses on the combustion and suppression characteristics of sodium fire in a columnar flow. Liquid sodium (250°C) is injected into a 7.9 m"3 cylindrical chamber at a flow rate of about 1.0 m"3/h to create a columnar sodium fire, and 18.4 kg class D extinguishing powder is sprayed after the liquid sodium injection. The temperature in the chamber space and sodium collection plate and the heat release rate from sodium fire are measured and analyzed. Based on the temperature data the sodium fire under suppression could be divided into four phases of dropping sharply, continuously remaining lower, rising and declining mildly, and depressing. The sodium fire in the space could be suppressed and cooled down if the extinguishing agent could spray in the early period of the liquid sodium injection. The extinguishing agent could suppress the combustion and spreading of liquid sodium dropping on the collection plate, limit the pool combustion area and postpone the commencement of sodium pool burning in spite of its later re-ignition happening. This study promises to evaluate the combustion and suppression characteristics of sodium fire in the sodium-related facilities. (author)

A neurocomputational account of reward and novelty processing and effects of psychostimulants in attention deficit hyperactivity disorder.

Science.gov (United States)

Sethi, Arjun; Voon, Valerie; Critchley, Hugo D; Cercignani, Mara; Harrison, Neil A

2018-05-01

Computational models of reinforcement learning have helped dissect discrete components of reward-related function and characterize neurocognitive deficits in psychiatric illnesses. Stimulus novelty biases decision-making, even when unrelated to choice outcome, acting as if possessing intrinsic reward value to guide decisions toward uncertain options. Heightened novelty seeking is characteristic of attention deficit hyperactivity disorder, yet how this influences reward-related decision-making is computationally encoded, or is altered by stimulant medication, is currently uncertain. Here we used an established reinforcement-learning task to model effects of novelty on reward-related behaviour during functional MRI in 30 adults with attention deficit hyperactivity disorder and 30 age-, sex- and IQ-matched control subjects. Each participant was tested on two separate occasions, once ON and once OFF stimulant medication. OFF medication, patients with attention deficit hyperactivity disorder showed significantly impaired task performance (P = 0.027), and greater selection of novel options (P = 0.004). Moreover, persistence in selecting novel options predicted impaired task performance (P = 0.025). These behavioural deficits were accompanied by a significantly lower learning rate (P = 0.011) and heightened novelty signalling within the substantia nigra/ventral tegmental area (family-wise error corrected P attention deficit hyperactivity disorder participants' overall task performance (P = 0.011), increased reward-learning rates (P = 0.046) and enhanced their ability to differentiate optimal from non-optimal novel choices (P = 0.032). It also reduced substantia nigra/ventral tegmental area responses to novelty. Preliminary cross-sectional evidence additionally suggested an association between long-term stimulant treatment and a reduction in the rewarding value of novelty. These data suggest that aberrant substantia nigra/ventral tegmental area novelty processing plays an

“Liking” and “Wanting” Linked to Reward Deficiency Syndrome (RDS): Hypothesizing Differential Responsivity in Brain Reward Circuitry

OpenAIRE

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2012-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: “liking,” “learning,” and “wanting” [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they...

A critical role for protein degradation in the nucleus accumbens core in cocaine reward memory.

Science.gov (United States)

Ren, Zhen-Yu; Liu, Meng-Meng; Xue, Yan-Xue; Ding, Zeng-Bo; Xue, Li-Fen; Zhai, Suo-Di; Lu, Lin

2013-04-01

The intense associative memories that develop between cocaine-paired contexts and rewarding stimuli contribute to cocaine seeking and relapse. Previous studies have shown impairment in cocaine reward memories by manipulating a labile state induced by memory retrieval, but the mechanisms that underlie the destabilization of cocaine reward memory are unknown. In this study, using a Pavlovian cocaine-induced conditioned place preference (CPP) procedure in rats, we tested the contribution of ubiquitin-proteasome system-dependent protein degradation in destabilization of cocaine reward memory. First, we found that polyubiquitinated protein expression levels and polyubiquitinated N-ethylmaleimide-sensitive fusion (NSF) markedly increased 15 min after retrieval while NSF protein levels decreased 1 h after retrieval in the synaptosomal membrane fraction in the nucleus accumbens (NAc) core. We then found that infusion of the proteasome inhibitor lactacystin into the NAc core prevented the impairment of memory reconsolidation induced by the protein synthesis inhibitor anisomycin and reversed the effects of anisomycin on NSF and glutamate receptor 2 (GluR2) protein levels in the synaptosomal membrane fraction in the NAc core. We also found that lactacystin infusion into the NAc core but not into the shell immediately after extinction training sessions inhibited CPP extinction and reversed the extinction training-induced decrease in NSF and GluR2 in the synaptosomal membrane fraction in the NAc core. Finally, infusions of lactacystin by itself into the NAc core immediately after each training session or before the CPP retrieval test had no effect on the consolidation and retrieval of cocaine reward memory. These findings suggest that ubiquitin-proteasome system-dependent protein degradation is critical for retrieval-induced memory destabilization.

Registered nurses' perceptions of rewarding and its significance.

Science.gov (United States)

Seitovirta, Jaana; Lehtimäki, Aku-Ville; Vehviläinen-Julkunen, Katri; Mitronen, Lasse; Kvist, Tarja

2017-11-07

To examine reward type preferences and their relationships with the significance of rewarding perceived by registered nurses in Finland. Previous studies have found relationships between nurses' rewarding and their motivation at work, job satisfaction and organisational commitment. Data were collected in a cross-sectional, descriptive, questionnaire survey from 402 registered nurses using the Registered Nurses' Perceptions of Rewarding Scale in 2015, and analysed with descriptive and multivariate statistical methods. Registered nurses assigned slightly higher values to several non-financial than to financial rewards. The non-financial reward types appreciation and feedback from work community, worktime arrangements, work content, and opportunity to develop, influence and participate were highly related to the significance of rewarding. We identified various rewards that registered nurses value, and indications that providing an appropriate array of rewards, particularly non-financial rewards, is a highly beneficial element of nursing management. It is important to understand the value of rewards for nursing management. Nurse managers should offer diverse rewards to their registered nurses to promote excellent performance and to help efforts to secure and maintain high-quality, safe patient care. The use of appropriate rewards is especially crucial to improving registered nurses' reward satisfaction and job satisfaction globally in the nursing profession. © 2017 John Wiley & Sons Ltd.

The relationship between personality types and reward preferences

Directory of Open Access Journals (Sweden)

R. Nienaber

2011-12-01

Full Text Available Orientation: Research has shown that total rewards models structured according to individual preferences, positively influence efforts to attract, retain and motivate key employees. Yet, this is seldom done. Structuring total rewards models according to the preferences of employee segments is a viable alternative to accommodate individual preferences. Research purpose: The primary aim of the study was to determine the relationship between personality types and reward preferences. The secondary aim was to determine the reward preferences for different demographic groups. Motivation for the study: An enhanced understanding of reward preferences for different employee segments will enable employers to offer more competitive reward options to their employees. This may, in turn, have a positive impact on retention. Research design, approach and method: Two measuring instruments, the MBTI® Form GRV and the Rewards Preferences Questionnaire, were distributed electronically to 5 000 potential respondents. The results from 589 sets of questionnaires were used in the data analyses. Primary and secondary factor analyses were done on the items in the Rewards Preferences Questionnaire. Main findings/results: The study confirmed that individuals with certain personality types and personality preferences, have different preferences for certain reward categories. There was a stronger relationship between reward preferences and personality preferences than for reward preferences and personality types. Preferences for reward categories by different demographic groups were confirmed. The significant difference in reward preferences between Black and White respondents in particular was noteworthy, with Black respondents indicating significantly higher mean scores for all reward categories than White respondents. Finally, a total rewards framework influenced by the most prominent preferences for reward categories, was designed. Practical/Managerial implications

R-Modafinil Attenuates Nicotine-Taking and Nicotine-Seeking Behavior in Alcohol-Preferring Rats

Science.gov (United States)

Wang, Xiao-Fei; Bi, Guo-Hua; He, Yi; Yang, Hong-Ju; Gao, Jun-Tao; Okunola-Bakare, Oluyomi M; Slack, Rachel D; Gardner, Eliot L; Xi, Zheng-Xiong; Newman, Amy Hauck

2015-01-01

(±)-Modafinil (MOD) is used clinically for the treatment of sleep disorders and has been investigated as a potential medication for the treatment of psychostimulant addiction. However, the therapeutic efficacy of (±)-MOD for addiction is inconclusive. Herein we used animal models of self-administration and in vivo microdialysis to study the pharmacological actions of R-modafinil (R-MOD) and S-modafinil (S-MOD) on nicotine-taking and nicotine-seeking behavior, and mechanisms underlying such actions. We found that R-MOD is more potent and effective than S-MOD in attenuating nicotine self-administration in Long–Evans rats. As Long–Evans rats did not show a robust reinstatement response to nicotine, we used alcohol-preferring rats (P-rats) that display much higher reinstatement responses to nicotine than Long–Evans rats. We found that R-MOD significantly inhibited intravenous nicotine self-administration, nicotine-induced reinstatement, and nicotine-associated cue-induced drug-seeking behavior in P-rats. R-MOD alone neither sustained self-administration in P-rats previously self-administering nicotine nor reinstated extinguished nicotine-seeking behavior. The in vivo brain microdialysis assays demonstrated that R-MOD alone produced a slow-onset moderate increase in extracellular DA. Pretreatment with R-MOD dose-dependently blocked nicotine-induced dopamine (DA) release in the nucleus accumbens (NAc) in both naive and nicotine self-administrating rats, suggesting a DA-dependent mechanism underlying mitigation of nicotine's effects. In conclusion, the present findings support further investigation of R-MOD for treatment of nicotine dependence in humans. PMID:25613829

Brain Circuits Encoding Reward from Pain Relief.

Science.gov (United States)

Navratilova, Edita; Atcherley, Christopher W; Porreca, Frank

2015-11-01

Relief from pain in humans is rewarding and pleasurable. Primary rewards, or reward-predictive cues, are encoded in brain reward/motivational circuits. While considerable advances have been made in our understanding of reward circuits underlying positive reinforcement, less is known about the circuits underlying the hedonic and reinforcing actions of pain relief. We review findings from electrophysiological, neuroimaging, and behavioral studies supporting the concept that the rewarding effect of pain relief requires opioid signaling in the anterior cingulate cortex (ACC), activation of midbrain dopamine neurons, and the release of dopamine in the nucleus accumbens (NAc). Understanding of circuits that govern the reward of pain relief may allow the discovery of more effective and satisfying therapies for patients with acute or chronic pain.

The endocannabinoid system in brain reward processes.

Science.gov (United States)

Solinas, M; Goldberg, S R; Piomelli, D

2008-05-01

Food, drugs and brain stimulation can serve as strong rewarding stimuli and are all believed to activate common brain circuits that evolved in mammals to favour fitness and survival. For decades, endogenous dopaminergic and opioid systems have been considered the most important systems in mediating brain reward processes. Recent evidence suggests that the endogenous cannabinoid (endocannabinoid) system also has an important role in signalling of rewarding events. First, CB(1) receptors are found in brain areas involved in reward processes, such as the dopaminergic mesolimbic system. Second, activation of CB(1) receptors by plant-derived, synthetic or endogenous CB(1) receptor agonists stimulates dopaminergic neurotransmission, produces rewarding effects and increases rewarding effects of abused drugs and food. Third, pharmacological or genetic blockade of CB(1) receptors prevents activation of dopaminergic neurotransmission by several addictive drugs and reduces rewarding effects of food and these drugs. Fourth, brain levels of the endocannabinoids anandamide and 2-arachidonoylglycerol are altered by activation of reward processes. However, the intrinsic activity of the endocannabinoid system does not appear to play a facilitatory role in brain stimulation reward and some evidence suggests it may even oppose it. The influence of the endocannabinoid system on brain reward processes may depend on the degree of activation of the different brain areas involved and might represent a mechanism for fine-tuning dopaminergic activity. Although involvement of the various components of the endocannabinoid system may differ depending on the type of rewarding event investigated, this system appears to play a major role in modulating reward processes.

Reward system dysfunction in autism spectrum disorders

Science.gov (United States)

Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

2013-01-01

Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in response to both reward types. In particular, diminished activation in the nucleus accumbens was observed when money, but not when social reward, was at stake, whereas the amygdala and anterior cingulate cortex were hypoactivated within the ASD group in response to both rewards. These data indicate that the reward circuitry is compromised in ASD in social as well as in non-social, i.e. monetary conditions, which likely contributes to atypical motivated behaviour. Taken together, with incentives used in this study sample, there is evidence for a general reward dysfunction in ASD. However, more ecologically valid social reward paradigms are needed to fully understand, whether there is any domain specificity to the reward deficit that appears evident in ASD, which would be most consistent with the ASD social phenotype. PMID:22419119

30 CFR 75.1107-11 - Extinguishing agents; requirements on mining equipment employed in low coal.

Science.gov (United States)

2010-07-01

... equipment employed in low coal. 75.1107-11 Section 75.1107-11 Mineral Resources MINE SAFETY AND HEALTH ADMINISTRATION, DEPARTMENT OF LABOR COAL MINE SAFETY AND HEALTH MANDATORY SAFETY STANDARDS-UNDERGROUND COAL MINES... § 75.1107-11 Extinguishing agents; requirements on mining equipment employed in low coal. On mining...

Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

Science.gov (United States)

Baskin-Sommers, Arielle R; Foti, Dan

2015-11-01

A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

Reward Merit with Praise.

Science.gov (United States)

Andrews, Hans A.

1987-01-01

Describes the efforts of two educational institutions to reward teaching excellence using positive feedback rather than merit pay incentives. An Arizona district, drawing on Herzberg's motivation theories, offers highly individualized rewards ranging from computers to conference money, while an Illinois community college bestows engraved plaques…

Brain Stimulation Reward Supports More Consistent and Accurate Rodent Decision-Making than Food Reward.

Science.gov (United States)

McMurray, Matthew S; Conway, Sineadh M; Roitman, Jamie D

2017-01-01

Animal models of decision-making rely on an animal's motivation to decide and its ability to detect differences among various alternatives. Food reinforcement, although commonly used, is associated with problematic confounds, especially satiety. Here, we examined the use of brain stimulation reward (BSR) as an alternative reinforcer in rodent models of decision-making and compared it with the effectiveness of sugar pellets. The discriminability of various BSR frequencies was compared to differing numbers of sugar pellets in separate free-choice tasks. We found that BSR was more discriminable and motivated greater task engagement and more consistent preference for the larger reward. We then investigated whether rats prefer BSR of varying frequencies over sugar pellets. We found that animals showed either a clear preference for sugar reward or no preference between reward modalities, depending on the frequency of the BSR alternative and the size of the sugar reward. Overall, these results suggest that BSR is an effective reinforcer in rodent decision-making tasks, removing food-related confounds and resulting in more accurate, consistent, and reliable metrics of choice.

Reward-dependent modulation of movement variability.

Science.gov (United States)

Pekny, Sarah E; Izawa, Jun; Shadmehr, Reza

2015-03-04

Movement variability is often considered an unwanted byproduct of a noisy nervous system. However, variability can signal a form of implicit exploration, indicating that the nervous system is intentionally varying the motor commands in search of actions that yield the greatest success. Here, we investigated the role of the human basal ganglia in controlling reward-dependent motor variability as measured by trial-to-trial changes in performance during a reaching task. We designed an experiment in which the only performance feedback was success or failure and quantified how reach variability was modulated as a function of the probability of reward. In healthy controls, reach variability increased as the probability of reward decreased. Control of variability depended on the history of past rewards, with the largest trial-to-trial changes occurring immediately after an unrewarded trial. In contrast, in participants with Parkinson's disease, a known example of basal ganglia dysfunction, reward was a poor modulator of variability; that is, the patients showed an impaired ability to increase variability in response to decreases in the probability of reward. This was despite the fact that, after rewarded trials, reach variability in the patients was comparable to healthy controls. In summary, we found that movement variability is partially a form of exploration driven by the recent history of rewards. When the function of the human basal ganglia is compromised, the reward-dependent control of movement variability is impaired, particularly affecting the ability to increase variability after unsuccessful outcomes. Copyright © 2015 the authors 0270-6474/15/354015-10$15.00/0.

A test of the reward-value hypothesis.

Science.gov (United States)

Smith, Alexandra E; Dalecki, Stefan J; Crystal, Jonathon D

2017-03-01

Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

Reward inference by primate prefrontal and striatal neurons.

Science.gov (United States)

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-22

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Distinct Reward Properties are Encoded via Corticostriatal Interactions

OpenAIRE

David V. Smith; Anastasia E. Rigney; Mauricio R. Delgado

2016-01-01

The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nu...

Reward Anticipation in Ventral Striatum and Individual Sensitivity to Reward: A Pilot Study of a Child-Friendly fMRI Task.

Science.gov (United States)

van Hulst, Branko M; de Zeeuw, Patrick; Lupas, Kellina; Bos, Dienke J; Neggers, Sebastiaan F W; Durston, Sarah

2015-01-01

Reward processing has been implicated in developmental disorders. However, the classic task to probe reward anticipation, the monetary incentive delay task, has an abstract coding of reward and no storyline and may therefore be less appropriate for use with developmental populations. We modified the task to create a version appropriate for use with children. We investigated whether this child-friendly version could elicit ventral striatal activation during reward anticipation in typically developing children and young adolescents (aged 9.5-14.5). In addition, we tested whether our performance-based measure of reward sensitivity was associated with anticipatory activity in ventral striatum. Reward anticipation was related to activity in bilateral ventral striatum. Moreover, we found an association between individual reward sensitivity and activity in ventral striatum. We conclude that this task assesses ventral striatal activity in a child-friendly paradigm. The combination with a performance-based measure of reward sensitivity potentially makes the task a powerful tool for developmental imaging studies of reward processing.

Reward modulates oculomotor competition between differently valued stimuli.

Science.gov (United States)

Bucker, Berno; Silvis, Jeroen D; Donk, Mieke; Theeuwes, Jan

2015-03-01

The present work explored the effects of reward in the well-known global effect paradigm in which two objects appear simultaneously in close spatial proximity. The experiment consisted of three phases (i) a pre-training phase that served as a baseline, (ii) a reward-training phase to associate differently colored stimuli with high, low and no reward value, and (iii) a post-training phase in which rewards were no longer delivered, to examine whether objects previously associated with higher reward value attracted the eyes more strongly than those associated with low or no reward value. Unlike previous reward studies, the differently valued objects directly competed with each other on the same trial. The results showed that initially eye movements were not biased towards any particular stimulus, while in the reward-training phase, eye movements started to land progressively closer towards stimuli that were associated with a high reward value. Even though rewards were no longer delivered, this bias remained robustly present in the post-training phase. A time course analysis showed that the effect of reward was present for the fastest saccades (around 170 ms) and increased with increasing latency. Although strategic effects for slower saccades cannot be ruled out, we suggest that fast oculomotor responses became habituated and were no longer under strategic attentional control. Together the results imply that reward affects oculomotor competition in favor of stimuli previously associated high reward, when multiple reward associated objects compete for selection. Copyright © 2015 Elsevier Ltd. All rights reserved.

Reward, Distraction, and the Overjustification Effect

Science.gov (United States)

Smith, Timothy W.; Pittman, Thane S.

1978-01-01

This study tests two differing hypotheses: the competing response hypothesis, which states that both reward and non-reward distractions produce decreases in interest which weaken over repeated trials, and the attribution/overjustification hypothesis, which maintains that rewards produce a decrease in interest that does not weaken over trials.…

Renewal processes with costs and rewards

NARCIS (Netherlands)

Vlasiou, M.; Cochran, J.J.; Cox, L.A.; Keskinocak, P.; Kharoufeh, J.P.; Smith, J.C.

2011-01-01

We review the theory of renewal reward processes, which describes renewal processes that have some cost or reward associated with each cycle. We present a new simplified proof of the renewal reward theorem that mimics the proof of the Elementary Renewal Theorem and avoids the technicalities in the

Neuroimaging of the Dopamine/Reward System in Adolescent Drug Use

Science.gov (United States)

Ernst, Monique; Luciana, Monica

2015-01-01

Adolescence is characterized by heightened risk-taking, including substance misuse. These behavioral patterns are influenced by ontogenic changes in neurotransmitter systems, particularly the dopamine system, which is fundamentally involved in the neural coding of reward and motivated approach behavior. During adolescence, this system evidences a peak in activity. At the same time, the dopamine system is neuroplastically altered by substance abuse, impacting subsequent function. Here, we describe properties of the dopamine system that change with typical adolescent development and that are altered with substance abuse. Much of this work has been gleaned from animal models due to limitations in measuring dopamine in pediatric samples. Structural and functional neuroimaging techniques have been used to examine structures that are heavily DA-innervated; they measure morphological and functional changes with age and with drug exposure. Presenting marijuana abuse as an exemplar, we consider recent findings that support an adolescent peak in DA-driven reward-seeking behavior and related deviations in motivational systems that are associated with marijuana abuse/dependence. Clinicians are advised that (1) chronic adolescent marijuana use may lead to deficiencies in incentive motivation, (2) that this state is due to marijuana’s interactions with the developing DA system, and (3) that treatment strategies should be directed to remediating resultant deficiencies in goal-directed activity. PMID:26095977

The use of boron trifluoride and alkoxiboroxines as extinguishants for magnesium alloy fires

International Nuclear Information System (INIS)

Newman, R.N.

1987-11-01

The extinguishants currently available for putting out magnesium alloy fires work by covering the burning fuel and excluding both the oxygen and nitrogen from the reaction zone. It has been reported that boron trifluoride and trimethoxi-and tributoxi-boroxine may act in a more specific chemical way on the combustion reactions. In this report an investigation into the effectiveness of these compounds on magnesium alloy fires is described. (author)

Deep brain stimulation of the nucleus accumbens shell attenuates cue-induced reinstatement of both cocaine and sucrose seeking in rats.

Science.gov (United States)

Guercio, Leonardo A; Schmidt, Heath D; Pierce, R Christopher

2015-03-15

Stimuli previously associated with drug taking can become triggers that can elicit craving and lead to relapse of drug-seeking behavior. Here, we examined the influence of deep brain stimulation (DBS) in the nucleus accumbens shell on cue-induced reinstatement of cocaine seeking, an animal model of relapse. Rats were allowed to self-administer cocaine (0.254 mg, i.v.) for 2 h daily for 21 days, with each infusion of cocaine being paired with a cue light. After 21 days of self-administration, cocaine-taking behavior was extinguished by replacing cocaine with saline in the absence of the cue light. Next, during the reinstatement phase, DBS was administered bilaterally into the nucleus accumbens shell through bipolar stainless steel electrodes immediately prior to re-exposure to cues previously associated with cocaine reinforcement. DBS continued throughout the 2 h reinstatement session. Parallel studies examined the influence of accumbens shell DBS on reinstatement induced by cues previously associated with sucrose reinforcement. Results indicated that DBS of the nucleus accumbens shell significantly attenuated cue-induced reinstatement of cocaine and sucrose seeking. Together, these results indicate that DBS of the accumbens shell disrupts cue-induced reinstatement associated with both a drug and a natural reinforcer. Copyright © 2014 Elsevier B.V. All rights reserved.

Reward-related genes and personality traits in alcohol-dependent individuals: a pilot case control study.

Science.gov (United States)

Landgren, Sara; Berglund, Kristina; Jerlhag, Elisabet; Fahlke, Claudia; Balldin, Jan; Berggren, Ulf; Zetterberg, Henrik; Blennow, Kaj; Engel, Jörgen A

2011-01-01

Components of the brain reward system, i.e. the mesolimbic dopamine, laterodorsal cholinergic and ghrelin signaling systems, have been implicated in alcohol reward in preclinical studies. Genetic variants of these systems have previously been linked to alcohol dependence. Here, we genotyped 31 single nucleotide polymorphisms (SNPs): 1 SNP in the dopamine D₂ receptor (DRD2) gene, 20 SNPs in 5 different nicotinic acetylcholine receptor subunit (CHRN*) genes, and 10 SNPs in the genes encoding pro-ghrelin (GHRL) and its receptor (GHSR), in a pilot study of type 1 alcoholics (n = 84) and healthy controls (n = 32). These individuals were characterized using the Temperament and Character Inventory. None of the SNPs were associated with risk of alcohol dependence in this population. The GG genotype of SNP rs13261190 in the CHRNB3 was associated with increased novelty seeking, while SNPs of the ghrelin signaling system were associated with decreased self-directedness (AA of rs495225, GHSR) and alterations in self-transcendence (AA of both rs42451 and rs35680, GHRL). In conclusion, this pilot study suggests that reward-related genes are associated with altered personality scores in type 1 alcohol dependence, which warrants future studies of these associations in larger study samples. Copyright © 2011 S. Karger AG, Basel.

Neural processing of reward in adolescent rodents

Directory of Open Access Journals (Sweden)

Nicholas W. Simon

2015-02-01

Full Text Available Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.

Reward Inference by Primate Prefrontal and Striatal Neurons

OpenAIRE

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-01

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Im...

Ventral pallidum roles in reward and motivation.

Science.gov (United States)

Smith, Kyle S; Tindell, Amy J; Aldridge, J Wayne; Berridge, Kent C

2009-01-23

In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that (1) an intact ventral pallidum is necessary for normal reward and motivation, (2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and (3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important 'limbic final common pathway' for mesocorticolimbic processing of many rewards.

Reward modulates perception in binocular rivalry.

Science.gov (United States)

Marx, Svenja; Einhäuser, Wolfgang

2015-01-14

Our perception does not provide us with an exact imprint of the outside world, but is continuously adapted to our internal expectations, task sets, and behavioral goals. Although effects of reward-or value in general-on perception therefore seem likely, how valuation modulates perception and how such modulation relates to attention is largely unknown. We probed effects of reward on perception by using a binocular-rivalry paradigm. Distinct gratings drifting in opposite directions were presented to each observer's eyes. To objectify their subjective perceptual experience, the optokinetic nystagmus was used as measure of current perceptual dominance. In a first experiment, one of the percepts was either rewarded or attended. We found that reward and attention similarly biased perception. In a second experiment, observers performed an attentionally demanding task either on the rewarded stimulus, the other stimulus, or both. We found that-on top of an attentional effect on perception-at each level of attentional load, reward still modulated perception by increasing the dominance of the rewarded percept. Similarly, penalizing one percept increased dominance of the other at each level of attentional load. In turn, rewarding-and similarly nonpunishing-a percept yielded performance benefits that are typically associated with selective attention. In conclusion, our data show that value modulates perception in a similar way as the volitional deployment of attention, even though the relative effect of value is largely unaffected by an attention task. © 2015 ARVO.

It's about time: Earlier rewards increase intrinsic motivation.

Science.gov (United States)

Woolley, Kaitlin; Fishbach, Ayelet

2018-06-01

Can immediate (vs. delayed) rewards increase intrinsic motivation? Prior research compared the presence versus absence of rewards. By contrast, this research compared immediate versus delayed rewards, predicting that more immediate rewards increase intrinsic motivation by creating a perceptual fusion between the activity and its goal (i.e., the reward). In support of the hypothesis, framing a reward from watching a news program as more immediate (vs. delayed) increased intrinsic motivation to watch the program (Study 1), and receiving more immediate bonus (vs. delayed, Study 2; and vs. delayed and no bonus, Study 3) increased intrinsic motivation in an experimental task. The effect of reward timing was mediated by the strength of the association between an activity and a reward, and was specific to intrinsic (vs. extrinsic) motivation-immediacy influenced the positive experience of an activity, but not perceived outcome importance (Study 4). In addition, the effect of the timing of rewards was independent of the effect of the magnitude of the rewards (Study 5). (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Evolutionary advantages of adaptive rewarding

International Nuclear Information System (INIS)

Szolnoki, Attila; Perc, Matjaž

2012-01-01

Our well-being depends on both our personal success and the success of our society. The realization of this fact makes cooperation an essential trait. Experiments have shown that rewards can elevate our readiness to cooperate, but since giving a reward inevitably entails paying a cost for it, the emergence and stability of such behavior remains elusive. Here we show that allowing for the act of rewarding to self-organize in dependence on the success of cooperation creates several evolutionary advantages that instill new ways through which collaborative efforts are promoted. Ranging from indirect territorial battle to the spontaneous emergence and destruction of coexistence, phase diagrams and the underlying spatial patterns reveal fascinatingly rich social dynamics that explain why this costly behavior has evolved and persevered. Comparisons with adaptive punishment, however, uncover an Achilles heel of adaptive rewarding, coming from over-aggression, which in turn hinders optimal utilization of network reciprocity. This may explain why, despite its success, rewarding is not as firmly embedded into our societal organization as punishment. (paper)

Overt and covert attention to location-based reward.

Science.gov (United States)

McCoy, Brónagh; Theeuwes, Jan

2018-01-01

Recent research on the impact of location-based reward on attentional orienting has indicated that reward factors play an influential role in spatial priority maps. The current study investigated whether and how reward associations based on spatial location translate from overt eye movements to covert attention. If reward associations can be tied to locations in space, and if overt and covert attention rely on similar overlapping neuronal populations, then both overt and covert attentional measures should display similar spatial-based reward learning. Our results suggest that location- and reward-based changes in one attentional domain do not lead to similar changes in the other. Specifically, although we found similar improvements at differentially rewarded locations during overt attentional learning, this translated to the least improvement at a highly rewarded location during covert attention. We interpret this as the result of an increased motivational link between the high reward location and the trained eye movement response acquired during learning, leading to a relative slowing during covert attention when the eyes remained fixated and the saccade response was suppressed. In a second experiment participants were not required to keep fixated during the covert attention task and we no longer observed relative slowing at the high reward location. Furthermore, the second experiment revealed no covert spatial priority of rewarded locations. We conclude that the transfer of location-based reward associations is intimately linked with the reward-modulated motor response employed during learning, and alternative attentional and task contexts may interfere with learned spatial priorities. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Hunger and Satiety Gauge Reward Sensitivity

Directory of Open Access Journals (Sweden)

Ryan Michael Cassidy

2017-05-01

Full Text Available Many of the neurocircuits and hormones known to underlie the sensations of hunger and satiety also substantially alter the activity of the dopaminergic reward system. Much interest lies in the ways that hunger, satiety, and reward tie together, as the epidemic of obesity seems tied to the recent development and mass availability of highly palatable foods. In this review, we will first discuss the basic neurocircuitry of the midbrain and basal forebrain reward system. We will elaborate how several important mediators of hunger—the agouti-related protein neurons of the arcuate nucleus, the lateral hypothalamic nucleus, and ghrelin—enhance the sensitivity of the dopaminergic reward system. Then, we will elaborate how mediators of satiety—the nucleus tractus solitarius, pro-opiomelanocortin neurons of the arcuate nucleus, and its peripheral hormonal influences such as leptin—reduce the reward system sensitivity. We hope to provide a template by which future research may identify the ways in which highly rewarding foods bypass this balanced system to produce excessive food consumption.

Identifying nurses' rewards: a qualitative categorization study in Belgium

Directory of Open Access Journals (Sweden)

Du Bois Cindy

2006-07-01

Full Text Available Abstract Background Rewards are important in attracting, motivating and retaining the most qualified employees, and nurses are no exception to this rule. This makes the establishment of an efficient reward system for nurses a true challenge for every hospital manager. A reward does not necessarily have a financial connotation: non-financial rewards may matter too, or may even be more important. Therefore, the present study examines nurses' reward perceptions, in order to identify potential reward options. Methods To answer the research question "What do nurses consider a reward and how can these rewards be categorized?", 20 in-depth semi-structured interviews with nurses were conducted and analysed using discourse and content analyses. In addition, the respondents received a list of 34 rewards (derived from the literature and were asked to indicate the extent to which they perceived each of them to be rewarding. Results Discourse analysis revealed three major reward categories: financial, non-financial and psychological, each containing different subcategories. In general, nurses more often mentioned financial rewards spontaneously in the interview, compared to non-financial and psychological rewards. The questionnaire results did not, however, indicate a significant difference in the rewarding potential of these three categories. Both the qualitative and quantitative data revealed that a number of psychological and non-financial rewards were important for nurses in addition to their monthly pay and other remunerations. In particular, appreciation for their work by others, compliments from others, presents from others and contact with patients were highly valued. Moreover, some demographical variables influenced the reward perceptions. Younger and less experienced nurses considered promotion possibilities as more rewarding than the older and more senior ones. The latter valued job security and working for a hospital with a good reputation higher

Social and monetary reward processing in autism spectrum disorders.

Science.gov (United States)

Delmonte, Sonja; Balsters, Joshua H; McGrath, Jane; Fitzgerald, Jacqueline; Brennan, Sean; Fagan, Andrew J; Gallagher, Louise

2012-09-26

Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. In line with social motivation theory, the ASD

Pleasure seeking and the aspect of longing for an object in perversion. A neuropsychoanalytical perspective.

Science.gov (United States)

Berner, Wolfgang; Briken, Peer

2012-01-01

In modern psychiatric classifications the term paraphilia has replaced the term perversion by changing the scope of the definitions from avoided procreation to failures of relationship-aspects of sexuality. Contemporary psychoanalysts also seem less interested in pleasure seeking aspects, which were so important within original Freudian thought, and instead concentrate interpretation on hostility and the history of the representation of objects. This paper discusses the connection between distinct object representations in perversions and attachment theory and neurobiological representations. It will discuss the observation that the neglect of pleasure seeking in perversion often results in a failure to recognise the addiction-like aspects of perversion, which seem to be particularly relevant to modern psychiatric and psychological thinking. The SEEKING-system (Panksepp, 1998) is used to conceptualise a neurobiological basis for pleasure seeking. This SEEKING-system may be "hijacked" by rewards in different forms of addiction as well as in sexual obsessions. The polarity between "drive representation" and "object representation," as created by Freud (1933, 1940a), may correspond to the polarity identified in contemporary thinking between the addictive or compulsive characteristics of sexual gratification (drive representation) and the influence of early object representation on the later ability to integrate instinctual wishes into relationships (object representation).

Memory Consolidation and Neural Substrate of Reward

Directory of Open Access Journals (Sweden)

Redolar-Ripoll, Diego

2012-08-01

Full Text Available The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of goal-directed behavior. The neural substrate underling this processing of reward information is a reliable way of improving learning and memory processes. Evidence from several studies indicates that this neural system can facilitate memory consolidation in a wide variety of learning tasks. From a molecular perspective, certain cardinal features of reward have been described as forms of memory. Studies of human addicts and studies in animal models of addiction show that chronic drug exposure produces stable changes in the brain at the cellular and molecular levels that underlie the long-lasting behavioral plasticity associated with addiction. These molecular and cellular adaptations involved in addiction are also implicated in learning and memory processes. Dopamine seems to be a critical common signal to activate different genetic mechanisms that ultimately remodel synapses and circuits. Despite memory is an active and complex process mediated by different brain areas, the neural substrate of reward is able to improve memory consolidation in a several paradigms. We believe that there are many equivalent traits between reward and learning and memory processes.

Dopaminergic control of motivation and reinforcement learning: a closed-circuit account for reward-oriented behavior.

Science.gov (United States)

Morita, Kenji; Morishima, Mieko; Sakai, Katsuyuki; Kawaguchi, Yasuo

2013-05-15

Humans and animals take actions quickly when they expect that the actions lead to reward, reflecting their motivation. Injection of dopamine receptor antagonists into the striatum has been shown to slow such reward-seeking behavior, suggesting that dopamine is involved in the control of motivational processes. Meanwhile, neurophysiological studies have revealed that phasic response of dopamine neurons appears to represent reward prediction error, indicating that dopamine plays central roles in reinforcement learning. However, previous attempts to elucidate the mechanisms of these dopaminergic controls have not fully explained how the motivational and learning aspects are related and whether they can be understood by the way the activity of dopamine neurons itself is controlled by their upstream circuitries. To address this issue, we constructed a closed-circuit model of the corticobasal ganglia system based on recent findings regarding intracortical and corticostriatal circuit architectures. Simulations show that the model could reproduce the observed distinct motivational effects of D1- and D2-type dopamine receptor antagonists. Simultaneously, our model successfully explains the dopaminergic representation of reward prediction error as observed in behaving animals during learning tasks and could also explain distinct choice biases induced by optogenetic stimulation of the D1 and D2 receptor-expressing striatal neurons. These results indicate that the suggested roles of dopamine in motivational control and reinforcement learning can be understood in a unified manner through a notion that the indirect pathway of the basal ganglia represents the value of states/actions at a previous time point, an empirically driven key assumption of our model.

Incentive theory: IV. Magnitude of reward

OpenAIRE

Killeen, Peter R.

1985-01-01

Incentive theory is successfully applied to data from experiments in which the amount of food reward is varied. This is accomplished by assuming that incentive value is a negatively accelerated function of reward duration. The interaction of the magnitude of a reward with its delay is confirmed, and the causes and implications of this interaction are discussed.

Reward deficiency syndrome: a biogenetic model for the diagnosis and treatment of impulsive, addictive, and compulsive behaviors.

Science.gov (United States)

Blum, K; Braverman, E R; Holder, J M; Lubar, J F; Monastra, V J; Miller, D; Lubar, J O; Chen, T J; Comings, D E

2000-11-01

The dopaminergic system, and in particular the dopamine D2 receptor, has been implicated in reward mechanisms. The net effect of neurotransmitter interaction at the mesolimbic brain region induces "reward" when dopamine (DA) is released from the neuron at the nucleus accumbens and interacts with a dopamine D2 receptor. "The reward cascade" involves the release of serotonin, which in turn at the hypothalmus stimulates enkephalin, which in turn inhibits GABA at the substania nigra, which in turn fine tunes the amount of DA released at the nucleus accumbens or "reward site." It is well known that under normal conditions in the reward site DA works to maintain our normal drives. In fact, DA has become to be known as the "pleasure molecule" and/or the "antistress molecule." When DA is released into the synapse, it stimulates a number a DA receptors (D1-D5) which results in increased feelings of well-being and stress reduction. A consensus of the literature suggests that when there is a dysfunction in the brain reward cascade, which could be caused by certain genetic variants (polygenic), especially in the DA system causing a hypodopaminergic trait, the brain of that person requires a DA fix to feel good. This trait leads to multiple drug-seeking behavior. This is so because alcohol, cocaine, heroin, marijuana, nicotine, and glucose all cause activation and neuronal release of brain DA, which could heal the abnormal cravings. Certainly after ten years of study we could say with confidence that carriers of the DAD2 receptor A1 allele have compromised D2 receptors. Therefore lack of D2 receptors causes individuals to have a high risk for multiple addictive, impulsive and compulsive behavioral propensities, such as severe alcoholism, cocaine, heroin, marijuana and nicotine use, glucose bingeing, pathological gambling, sex addiction, ADHD, Tourette's Syndrome, autism, chronic violence, posttraumatic stress disorder, schizoid/avoidant cluster, conduct disorder and antisocial

The Timing Effects of Reward, Business Longevity, and Involvement on Consumers’ Responses to a Reward Program

Directory of Open Access Journals (Sweden)

Badri Munir Sukoco

2015-06-01

Full Text Available Managers could elicit customers’ repeat purchase behavior through a well-designed reward program. This study examines two extrinsic cues - business longevity and timing effects of reward – to determine the consumers’ perceived risk and intention to participate in this kind of program. Moreover, this study discusses how different levels of involvement might interact with these two cues. An experiment with a 2 (business longevity: long vs. short x 2 (timing of reward: delayed vs. immediate x 2 (involvement: high vs. low between-subject factorial design is conducted to validate the proposed research hypotheses. The results show that an immediate reward offered by an older, more established, firm for a highly-involved product, make loyalty programs less risky and consequently attract consumers to participate. Interestingly, immediate rewards that are offered by older firms for a product that customers are less involved in has the opposite effects. Managerial and academic implications are further presented in this study.

Music-related reward responses predict episodic memory performance.

Science.gov (United States)

Ferreri, Laura; Rodriguez-Fornells, Antoni

2017-12-01

Music represents a special type of reward involving the recruitment of the mesolimbic dopaminergic system. According to recent theories on episodic memory formation, as dopamine strengthens the synaptic potentiation produced by learning, stimuli triggering dopamine release could result in long-term memory improvements. Here, we behaviourally test whether music-related reward responses could modulate episodic memory performance. Thirty participants rated (in terms of arousal, familiarity, emotional valence, and reward) and encoded unfamiliar classical music excerpts. Twenty-four hours later, their episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed an influence of music-related reward responses on memory: excerpts rated as more rewarding were significantly better recognized and remembered. Furthermore, inter-individual differences in the ability to experience musical reward, measured through the Barcelona Music Reward Questionnaire, positively predicted memory performance. Taken together, these findings shed new light on the relationship between music, reward and memory, showing for the first time that music-driven reward responses are directly implicated in higher cognitive functions and can account for individual differences in memory performance.

Sensitivity to Temporal Reward Structure in Amygdala Neurons

OpenAIRE

Bermudez, Maria A.; Göbel, Carl; Schultz, Wolfram

2012-01-01

Summary The time of reward and the temporal structure of reward occurrence fundamentally influence behavioral reinforcement and decision processes [1–11]. However, despite knowledge about timing in sensory and motor systems [12–17], we know little about temporal mechanisms of neuronal reward processing. In this experiment, visual stimuli predicted different instantaneous probabilities of reward occurrence that resulted in specific temporal reward structures. Licking behavior demonstrated that...

Reward, interrupted: Inhibitory control and its relevance to addictions.

Science.gov (United States)

Jentsch, James David; Pennington, Zachary T

2014-01-01

There are broad individual differences in the ability to voluntarily and effortfully suppress motivated, reward-seeking behaviors, and this review presents the hypothesis that these individual differences are relevant to addictive disorders. On one hand, cumulative experience with drug abuse appears to alter the molecular, cellular and circuit mechanisms that mediate inhibitory abilities, leading to increasingly uncontrolled patterns of drug-seeking and -taking. On the other, native inter-individual differences in inhibitory control are apparently a risk factor for aspects of drug-reinforced responding and substance use disorders. In both cases, the behavioral manifestation of poor inhibitory abilities is linked to relatively low striatal dopamine D2-like receptor availability, and evidence is accumulating for a more direct contribution of striatopallidal neurons to cognitive control processes. Mechanistic research is now identifying genes upstream of dopamine transmission that mediate these relationships, as well as the involvement of other neurotransmitter systems, acting alone and in concert with dopamine. The reviewed research stands poised to identify new mechanisms that can be targeted by pharmacotherapies and/or by behavioral interventions that are designed to prevent or treat addictive behaviors and associated behavioral pathology. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'. Copyright © 2013 Elsevier Ltd. All rights reserved.

Reward sensitivity and food addiction in women.

Science.gov (United States)

Loxton, Natalie J; Tipman, Renée J

2017-08-01

Sensitivity to the rewarding properties of appetitive substances has long been implicated in excessive consumption of palatable foods and drugs of abuse. Previous research focusing on individual differences in reward responsiveness has found heightened trait reward sensitivity to be associated with binge-eating, hazardous drinking, and illicit substance use. Food addiction has been proposed as an extreme form of compulsive-overeating and has been associated with genetic markers of heightened reward responsiveness. However, little research has explicitly examined the association between reward sensitivity and food addiction. Further, the processes by which individual differences in this trait are associated with excessive over-consumption has not been determined. A total of 374 women from the community completed an online questionnaire assessing reward sensitivity, food addiction, emotional, externally-driven, and hedonic eating. High reward sensitivity was significantly associated with greater food addiction symptoms (r = 0.31). Bootstrapped tests of indirect effects found the relationship between reward sensitivity and food addiction symptom count to be uniquely mediated by binge-eating, emotional eating, and hedonic eating (notably, food availability). These indirect effects held even when controlling for BMI, anxiety, depression, and trait impulsivity. This study further supports the argument that high levels of reward sensitivity may offer a trait marker of vulnerability to excessive over-eating, beyond negative affect and impulse-control deficits. That the hedonic properties of food (especially food availability), emotional, and binge-eating behavior act as unique mediators suggest that interventions for reward-sensitive women presenting with food addiction may benefit from targeting food availability in addition to management of negative affect. Copyright © 2016 Elsevier Ltd. All rights reserved.

Oleic Acid in the Ventral Tegmental Area Inhibits Feeding, Food Reward, and Dopamine Tone.

Science.gov (United States)

Hryhorczuk, Cecile; Sheng, Zhenyu; Décarie-Spain, Léa; Giguère, Nicolas; Ducrot, Charles; Trudeau, Louis-Éric; Routh, Vanessa H; Alquier, Thierry; Fulton, Stephanie

2018-02-01

Long-chain fatty acids (FAs) act centrally to decrease food intake and hepatic glucose production and alter hypothalamic neuronal activity in a manner that depends on FA type and cellular transport proteins. However, it is not known whether FAs are sensed by ventral tegmental area (VTA) dopamine (DA) neurons to control food-motivated behavior and DA neurotransmission. We investigated the impact of the monounsaturated FA oleate in the VTA on feeding, locomotion, food reward, and DA neuronal activity and DA neuron expression of FA-handling proteins and FA uptake. A single intra-VTA injection of oleate, but not of the saturated FA palmitate, decreased food intake and increased locomotor activity. Furthermore, intra-VTA oleate blunted the rewarding effects of high-fat/sugar food in an operant task and inhibited DA neuronal firing. Using sorted DA neuron preparations from TH-eGFP mice we found that DA neurons express FA transporter and binding proteins, and are capable of intracellular transport of long-chain FA. Finally, we demonstrate that a transporter blocker attenuates FA uptake into DA neurons and blocks the effects of intra-VTA oleate to decrease food-seeking and DA neuronal activity. Together, these results suggest that DA neurons detect FA and that oleate has actions in the VTA to suppress DA neuronal activity and food seeking following cellular incorporation. These findings highlight the capacity of DA neurons to act as metabolic sensors by responding not only to hormones but also to FA nutrient signals to modulate food-directed behavior.

Video game training and the reward system.

Science.gov (United States)

Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

2015-01-01

Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

Reward Systems in the Brain and Nutrition.

Science.gov (United States)

Rolls, Edmund T

2016-07-17

The taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in the orbitofrontal cortex, these sensory inputs are combined by associative learning with olfactory and visual inputs for some neurons, and these neurons encode food reward value in that they respond to food only when hunger is present and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions and selective attention to affective value, modulate the representation of the reward value of taste, olfactory, and flavor stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex. These food reward representations are important in the control of appetite and food intake. Individual differences in reward representations may contribute to obesity, and there are age-related differences in these reward representations. Implications of how reward systems in the brain operate for understanding, preventing, and treating obesity are described.

Differentiating neural reward responsiveness in autism versus ADHD

Directory of Open Access Journals (Sweden)

Gregor Kohls

2014-10-01

Full Text Available Although attention deficit hyperactivity disorders (ADHD and autism spectrum disorders (ASD share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC. A significant group by reward type interaction effect emerged in the ventral striatum with greater activation to monetary versus social reward only in TDC, whereas subjects with ADHD responded equally strong to both reward types, and subjects with ASD showed low striatal reactivity across both reward conditions. Moreover, disorder-specific neural abnormalities were revealed, including medial prefrontal hyperactivation in response to social reward in ADHD versus ventral striatal hypoactivation in response to monetary reward in ASD. Shared dysfunction was characterized by fronto-striato-parietal hypoactivation in both clinical groups when money was at stake. Interestingly, lower neural activation within parietal circuitry was associated with higher autistic traits across the entire study sample. In sum, the present findings concur with the assumption that both ASD and ADHD display distinct and shared neural dysfunction in response to reward.

Video game training and the reward system

OpenAIRE

Lorenz, R.; Gleich, T.; Gallinat, J.; Kühn, S.

2015-01-01

Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors ...

The SEEKING mind: primal neuro-affective substrates for appetitive incentive states and their pathological dynamics in addictions and depression.

Science.gov (United States)

Alcaro, Antonio; Panksepp, Jaak

2011-10-01

Appetitive motivation and incentive states are essential functions sustained by a common emotional brain process, the SEEKING disposition, which drives explorative and approach behaviors, sustains goal-directed activity, promotes anticipatory cognitions, and evokes feelings of positive excitement which control reward-learning. All such functions are orchestrated by the same "archetypical" neural processes, activated in ancient subcortical areas and transported to the forebrain by the mesolimbic dopamine (ML-DA) system. In mammals, the neurophysiology of the SEEKING urge is expressed by DA-promoted high-frequency oscillations, in the form of transient and synchronized gamma waves (>30Hz) emerging in limbic forebrain and diffusing throughout basal ganglia-thalamocortical (BG-T-C) circuits. These patterns may be considered basic "SEEKING neurodynamic impulses" which represent the primary-process exploratory disposition getting integrated with information relative to the external and the internal environment. Abnormal manifestation of SEEKING and its neural substrates are evident in clinical depression and addiction. Specifically, depression is characterized by reduced recruitment of SEEKING, while addictions reflect re-organizations of the SEEKING disposition around ultra-specific appetitive memories and compulsive activities. Copyright © 2011 Elsevier Ltd. All rights reserved.

Trait Anticipatory Pleasure Predicts Effort Expenditure for Reward.

Directory of Open Access Journals (Sweden)

Joachim T Geaney

Full Text Available Research in motivation and emotion has been increasingly influenced by the perspective that processes underpinning the motivated approach of rewarding goals are distinct from those underpinning enjoyment during reward consummation. This distinction recently inspired the construction of the Temporal Experience of Pleasure Scale (TEPS, a self-report measure that distinguishes trait anticipatory pleasure (pre-reward feelings of desire from consummatory pleasure (feelings of enjoyment and gratification upon reward attainment. In a university community sample (N = 97, we examined the TEPS subscales as predictors of (1 the willingness to expend effort for monetary rewards, and (2 affective responses to a pleasant mood induction procedure. Results showed that both anticipatory pleasure and a well-known trait measure of reward motivation predicted effort-expenditure for rewards when the probability of being rewarded was relatively low. Against expectations, consummatory pleasure was unrelated to induced pleasant affect. Taken together, our findings provide support for the validity of the TEPS anticipatory pleasure scale, but not the consummatory pleasure scale.

Effects of Trace Amine-associated Receptor 1 Agonists on the Expression, Reconsolidation, and Extinction of Cocaine Reward Memory.

Science.gov (United States)

Liu, Jian-Feng; Thorn, David A; Zhang, Yanan; Li, Jun-Xu

2016-07-01

As a modulator of dopaminergic system, trace amine-associated receptor 1 has been shown to play a critical role in regulating the rewarding properties of additive drugs. It has been demonstrated that activation of trace amine-associated receptor 1 decreased the abuse-related behaviors of cocaine in rats. However, the role of trace amine-associated receptor 1 in specific stages of cocaine reward memory is still unclear. Here, using a cocaine-induced conditioned place preference model, we tested the effects of a selective trace amine-associated receptor 1 agonist RO5166017 on the expression, reconsolidation, and extinction of cocaine reward memory. We found that RO5166017 inhibited the expression but not retention of cocaine-induced conditioned place preference. RO5166017 had no effect on the reconsolidation of cocaine reward memory. Pretreatment with RO5166017 before extinction hindered the formation of extinction long-term memory. RO5166017 did not affect the movement during the conditioned place preference test, indicating the inhibitory effect of RO5166017 on the expression of cocaine-induced conditioned place preference was not caused by locomotion inhibition. Using a cocaine i.v. self-administration model, we found that the combined trace amine-associated receptor 1 partial agonist RO5263397 with extinction had no effect on the following cue- and drug-induced reinstatement of cocaine-seeking behavior. Repeated administration of the trace amine-associated receptor 1 agonist during extinction showed a continually inhibitory effect on the expression of cocaine reward memory both in cocaine-induced conditioned place preference and cocaine self-administration models. Taken together, these results indicate that activation of trace amine-associated receptor 1 specifically inhibited the expression of cocaine reward memory. The inhibitory effect of trace amine-associated receptor 1 agonists on cocaine reward memory suggests that trace amine-associated receptor 1

Beyond reward prediction errors: the role of dopamine in movement kinematics

Directory of Open Access Journals (Sweden)

Joseph eBarter

2015-05-01

Full Text Available We recorded activity of dopamine (DA neurons in the substantia nigra pars compacta in unrestrained mice while monitoring their movements with video tracking. Our approach allows an unbiased examination of the continuous relationship between single unit activity and behavior. Although DA neurons show characteristic burst firing following cue or reward presentation, as previously reported, their activity can be explained by the representation of actual movement kinematics. Unlike neighboring pars reticulata GABAergic output neurons, which can represent vector components of position, DA neurons represent vector components of velocity or acceleration. We found neurons related to movements in four directions—up, down, left right. For horizontal movements, there is significant lateralization of neurons: the left nigra contains more rightward neurons, whereas the right nigra contains more leftward neurons. The relationship between DA activity and movement kinematics was found on both appetitive trials using sucrose and aversive trials using air puff, showing that these neurons belong to a velocity control circuit that can be used for any number of purposes, whether to seek reward or to avoid harm. In support of this conclusion, mimicry of the phasic activation of DA neurons with selective optogenetic stimulation could also generate movements. Contrary to the popular hypothesis that DA neurons encode reward prediction errors, our results suggest that nigrostriatal DA plays an essential role in controlling the kinematics of voluntary movements. We hypothesize that DA signaling implements gain adjustment for adaptive transition control, and describe a new model of BG in which DA functions to adjust the gain of a transition controller. This model has significant implications for our understanding of movement disorders implicating DA and the BG.

Facilitation of voluntary goal-directed action by reward cues.

Science.gov (United States)

Lovibond, Peter F; Colagiuri, Ben

2013-10-01

Reward-associated cues are known to influence motivation to approach both natural and man-made rewards, such as food and drugs. However, the mechanisms underlying these effects are not well understood. To model these processes in the laboratory with humans, we developed an appetitive Pavlovian-instrumental transfer procedure with a chocolate reward. We used a single unconstrained response that led to an actual rather than symbolic reward to assess the strength of reward motivation. Presentation of a chocolate-paired cue, but not an unpaired cue, markedly enhanced instrumental responding over a 30-s period. The same pattern was observed with 10-s and 30-s cues, showing that close cue-reward contiguity is not necessary for facilitation of reward-directed action. The results confirm that reward-related cues can instigate voluntary action to obtain that reward. The effectiveness of long-duration cues suggests that in clinical settings, attention should be directed to both proximal and distal cues for reward.

Rewards and advancements for clinical pharmacists.

Science.gov (United States)

Goodwin, S Diane; Kane-Gill, Sandra L; Ng, Tien M H; Melroy, Joel T; Hess, Mary M; Tallian, Kimberly; Trujillo, Toby C; Vermeulen, Lee C

2010-01-01

The American College of Clinical Pharmacy charged the Clinical Practice Affairs Committee to review and update the College's 1995 White Paper, "Rewards and Advancements for Clinical Pharmacy Practitioners." Because of the limited data on the present state of rewards and advancements for clinical pharmacists, an online survey of "front-line" clinical pharmacists and pharmacy managers was conducted (1126 total respondents, 14% response rate). The resulting White Paper discusses motivators and existing systems of rewards and advancements for clinical pharmacists, as well as perceived barriers to implementation of these systems. Clinical pharmacists reported work-life balance, a challenging position, and opportunities for professional advancement as the most important factors for career success. At the time of the survey, financial rewards appeared not to be a major motivator for clinical pharmacists. Managers underestimated the importance that clinical pharmacists place on work-life balance and favorable work schedules. Although almost two thirds of the clinical pharmacists surveyed had not developed a professional development plan, 84% indicated an interest in career planning. Both clinical pharmacists and managers rated the lack of a clear reward and advancement structure as the most important barrier to effective systems of rewards and advancements. Pharmacy managers and administrators are encouraged to develop effective systems of rewards and advancements for clinical pharmacists that positively impact patient care and the institution's mission; these systems will benefit the clinical pharmacist, the health care institution, and the patient.

Can Pornography be Addictive? An fMRI Study of Men Seeking Treatment for Problematic Pornography Use.

Science.gov (United States)

Gola, Mateusz; Wordecha, Małgorzata; Sescousse, Guillaume; Lew-Starowicz, Michał; Kossowski, Bartosz; Wypych, Marek; Makeig, Scott; Potenza, Marc N; Marchewka, Artur

2017-09-01

Pornography consumption is highly prevalent, particularly among young adult males. For some individuals, problematic pornography use (PPU) is a reason for seeking treatment. Despite the pervasiveness of pornography, PPU appears under-investigated, including with respect to the underlying neural mechanisms. Using functional magnetic resonance imaging (fMRI), we examined ventral striatal responses to erotic and monetary stimuli, disentangling cue-related 'wanting' from reward-related 'liking' among 28 heterosexual males seeking treatment for PPU and 24 heterosexual males without PPU. Subjects engaged in an incentive delay task in the scanner, in which they received erotic or monetary rewards preceded by predictive cues. Blood-oxygen-level-dependent responses to erotic and monetary cues were analyzed and examined with respect to self-reported data on sexual activity collected over the 2 preceding months. Men with and without PPU differed in their striatal responses to cues predicting erotic pictures but not in their responses to erotic pictures. PPU subjects when compared with control subjects showed increased activation of ventral striatum specifically for cues predicting erotic pictures but not for cues predicting monetary gains. Relative sensitivity to cues predicting erotic pictures vs monetary gains was significantly related to the increased behavioral motivation to view erotic images (suggestive of higher 'wanting'), severity of PPU, amount of pornography use per week, and number of weekly masturbations. Our findings suggest that, similar to what is observed in substance and gambling addictions, the neural and behavioral mechanisms associated with the anticipatory processing of cues specifically predicting erotic rewards relate importantly to clinically relevant features of PPU. These findings suggest that PPU may represent a behavioral addiction and that interventions helpful in targeting behavioral and substance addictions warrant consideration for adaptation

Cannabinoid Regulation of Brain Reward Processing with an Emphasis on the Role of CB1 Receptors: A Step Back into the Future.

Science.gov (United States)

Panagis, George; Mackey, Brian; Vlachou, Styliani

2014-01-01

Over the last decades, the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain-reward circuits and the regulation of motivational processes. Importantly, behavioral studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine, and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioral experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure, and the reinstatement of drug-seeking behavior procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain-reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1) receptor agonists, antagonists, and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction-related disorders.

Cannabinoid regulation of brain reward processing with an emphasis on the role of CB1 receptors: a step back into the future

Directory of Open Access Journals (Sweden)

George ePanagis

2014-07-01

Full Text Available Over the last decades the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain reward circuits and the regulation of motivational processes. Importantly, behavioural studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioural experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure and the reinstatement of drug-seeking behaviour procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1 receptor agonists, antagonists and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggests that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction related disorders.

Model Checking Multivariate State Rewards

DEFF Research Database (Denmark)

Nielsen, Bo Friis; Nielson, Flemming; Nielson, Hanne Riis

2010-01-01

We consider continuous stochastic logics with state rewards that are interpreted over continuous time Markov chains. We show how results from multivariate phase type distributions can be used to obtain higher-order moments for multivariate state rewards (including covariance). We also generalise...

Self-rewards and personal motivation

DEFF Research Database (Denmark)

Koch, Alexander Karl; Nafziger, Julia; Suvorov, Anton

2014-01-01

Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool...

Self-Rewards and Personal Motivation

DEFF Research Database (Denmark)

Koch, Alexander Karl; Nafziger, Julia; Suvorov, Anton

Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool...

Self-rewards and personal motivation

NARCIS (Netherlands)

Koch, A.K.; Nafziger, J.; Suvorov, A.; van de Ven, J.

2014-01-01

Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool to

Video Game Training and the Reward System

Directory of Open Access Journals (Sweden)

Robert C. Lorenz

2015-02-01

Full Text Available Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual towards playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training.Fifty healthy participants were randomly assigned to a video game training (TG or control group (CG. Before and after training/control period, functional magnetic resonance imaging (fMRI was conducted using a non-video game related reward task.At pretest, both groups showed strongest activation in ventral striatum (VS during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated.This longitudinal study revealed that video game training may preserve reward responsiveness in the ventral striatum in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

Video game training and the reward system

Science.gov (United States)

Lorenz, Robert C.; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

2015-01-01

Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training. PMID:25698962

75 FR 20516 - Special Conditions: Cirrus Design Corporation, Model SF50; Fire Extinguishing for Upper Aft...

Science.gov (United States)

2010-04-20

... defined in Sec. 11.19, under Sec. 11.38 and they become part of the type certification basis under Sec. 21... requiring and defining engine compartment fire extinguishing systems already exist for part 23 commuter... structure or the fuselage. In essence the engine could burn off of the pylon and not adversely compromise...

Which Cue to ‘Want?’ Central Amygdala Opioid Activation Enhances and Focuses Incentive Salience on a Prepotent Reward Cue

Science.gov (United States)

Mahler, Stephen V.; Berridge, Kent C.

2009-01-01

The central nucleus of the amygdala (CeA) helps translate learning into motivation, and here we show that opioid stimulation of CeA magnifies and focuses learned incentive salience onto a specific reward cue (Pavlovian conditioned stimulus, or CS). This motivation enhancement makes that cue more attractive, noticeable, and liable to elicit appetitive and consummatory behaviors. To reveal the focusing of incentive salience, we exploited individual differences in an autoshaping paradigm in which a rat prefers to approach, nibble and sniff one of two reward-associated stimuli (its prepotent stimulus). The individually-prepotent cue is either a predictive CS+ that signals reward (8sec metal lever insertion), or instead the metal cup that delivers sucrose pellets (the reward source). Results indicated that CeA opioid activation by microinjection of the μ agonist DAMGO (0.1μg) selectively and reversibly enhanced the attractiveness of whichever reward CS was that rat's prepotent cue. CeA DAMGO microinjections made rats more vigorously approach their particular prepotent CS, and to energetically sniff and nibble it in a nearly frenzied consummatory fashion. Only the prepotent cue was enhanced as an incentive target, and alternative cues were not enhanced. Conversely, inactivation of CeA by muscimol microinjection (0.25μg) suppressed approach, nibbles and sniffs of the prepotent CS. Confirming modulation of incentive salience, unconditioned food intake was similarly increased by DAMGO microinjection and decreased by muscimol in CeA. We conclude that opioid neurotransmission in central amygdala helps determine which environmental stimuli become most ‘wanted,’ and how ‘wanted’ they become. This may powerfully guide reward-seeking behavior. PMID:19458221

Suicide by Fire Extinguisher Powder Ingestion: A Case Report

Directory of Open Access Journals (Sweden)

Hamid Mohammadi Kojidi

2017-07-01

Full Text Available A 51-year-old man committed suicide by swallowing the contents of a fire extinguisher. A few hours after his suicide attempt, he was referred to the medical center for poisoning. At the time of admission, the patient was conscious with stable vital signs. The patient complained of burning lips and mouth, mentioning diarrhea. Initial treatments included gastric lavage with activated charcoal, while paraclinical measures were requested. The patient had undergone hypernatremia (Na: 152 mEq/l and metabolic alkalosis. Treatment focused on the adjustment of sodium level and alkalosis. On the first day of hospitalization, the patient experienced recurrent episodes of tonic-clonic seizure along with the loss of consciousness. On the third day of hospitalization, the patient developed respiratory arrest followed by cardiac arrest and death.

Reward disrupts reactivated human skill memory.

Science.gov (United States)

Dayan, Eran; Laor-Maayany, Rony; Censor, Nitzan

2016-06-16

Accumulating evidence across species and memory domains shows that when an existing memory is reactivated, it becomes susceptible to modifications. However, the potential role of reward signals in these mechanisms underlying human memory dynamics is unknown. Leaning on a wealth of findings on the role of reward in reinforcing memory, we tested the impact of reinforcing a skill memory trace with monetary reward following memory reactivation, on strengthening of the memory trace. Reinforcing reactivated memories did not strengthen the memory, but rather led to disruption of the memory trace, breaking down the link between memory reactivation and subsequent memory strength. Statistical modeling further revealed a strong mediating role for memory reactivation in linking between memory encoding and subsequent memory strength only when the memory was replayed without reinforcement. We suggest that, rather than reinforcing the existing memory trace, reward creates a competing memory trace, impairing expression of the original reward-free memory. This mechanism sheds light on the processes underlying skill acquisition, having wide translational implications.

Community-based faculty: motivation and rewards.

Science.gov (United States)

Fulkerson, P K; Wang-Cheng, R

1997-02-01

The reasons why practicing physicians precept students in their offices, and the rewards they wish to receive for this work, have not been clearly elucidated. This study determined the reasons for precepting and the rewards expected among a network of preceptors in Milwaukee. A questionnaire was mailed to 120 community-based physician preceptors in a required, third-year ambulatory care clerkship. Respondents were asked to identify why they volunteered and what they considered appropriate recognition or reward. The personal satisfaction derived from the student-teacher interaction was, by far, the most important motivator for preceptors (84%). The most preferred rewards for teaching included clinical faculty appointment, CME and bookstore discounts, computer networking, and workshops for improving skills in clinical teaching. Community-based private physicians who participate in medical student education programs are primarily motivated by the personal satisfaction that they derive from the teaching encounter. An effective preceptor recognition/reward program can be developed using input from the preceptors themselves.

Fire-extinguishing organic electrolytes for safe batteries

Science.gov (United States)

Wang, Jianhui; Yamada, Yuki; Sodeyama, Keitaro; Watanabe, Eriko; Takada, Koji; Tateyama, Yoshitaka; Yamada, Atsuo

2018-01-01

Severe safety concerns are impeding the large-scale employment of lithium/sodium batteries. Conventional electrolytes are highly flammable and volatile, which may cause catastrophic fires or explosions. Efforts to introduce flame-retardant solvents into the electrolytes have generally resulted in compromised battery performance because those solvents do not suitably passivate carbonaceous anodes. Here we report a salt-concentrated electrolyte design to resolve this dilemma via the spontaneous formation of a robust inorganic passivation film on the anode. We demonstrate that a concentrated electrolyte using a salt and a popular flame-retardant solvent (trimethyl phosphate), without any additives or soft binders, allows stable charge-discharge cycling of both hard-carbon and graphite anodes for more than 1,000 cycles (over one year) with negligible degradation; this performance is comparable or superior to that of conventional flammable carbonate electrolytes. The unusual passivation character of the concentrated electrolyte coupled with its fire-extinguishing property contributes to developing safe and long-lasting batteries, unlocking the limit toward development of much higher energy-density batteries.

Intersection of reward and memory in monkey rhinal cortex.

Science.gov (United States)

Clark, Andrew M; Bouret, Sebastien; Young, Adrienne M; Richmond, Barry J

2012-05-16

In humans and other animals, the vigor with which a reward is pursued depends on its desirability, that is, on the reward's predicted value. Predicted value is generally context-dependent, varying according to the value of rewards obtained in the recent and distant past. Signals related to reward prediction and valuation are believed to be encoded in a circuit centered around midbrain dopamine neurons and their targets in the prefrontal cortex and basal ganglia. Notably absent from this hypothesized reward pathway are dopaminergic targets in the medial temporal lobe. Here we show that a key part of the medial temporal lobe memory system previously reported to be important for sensory mnemonic and perceptual processing, the rhinal cortex (Rh), is required for using memories of previous reward values to predict the value of forthcoming rewards. We tested monkeys with bilateral Rh lesions on a task in which reward size varied across blocks of uncued trials. In this experiment, the only cues for predicting current reward value are the sizes of rewards delivered in previous blocks. Unexpectedly, monkeys with Rh ablations, but not intact controls, were insensitive to differences in predicted reward, responding as if they expected all rewards to be of equal magnitude. Thus, it appears that Rh is critical for using memory of previous rewards to predict the value of forthcoming rewards. These results are in agreement with accumulating evidence that Rh is critical for establishing the relationships between temporally interleaved events, which is a key element of episodic memory.

Activation of D1/5 Dopamine Receptors: A Common Mechanism for Enhancing Extinction of Fear and Reward-Seeking Behaviors.

Science.gov (United States)

Abraham, Antony D; Neve, Kim A; Lattal, K Matthew

2016-07-01

Dopamine is critical for many processes that drive learning and memory, including motivation, prediction error, incentive salience, memory consolidation, and response output. Theories of dopamine's function in these processes have, for the most part, been developed from behavioral approaches that examine learning mechanisms in appetitive tasks. A parallel and growing literature indicates that dopamine signaling is involved in consolidation of memories into stable representations in aversive tasks such as fear conditioning. Relatively little is known about how dopamine may modulate memories that form during extinction, when organisms learn that the relation between previously associated events is severed. We investigated whether fear and reward extinction share common mechanisms that could be enhanced with dopamine D1/5 receptor activation. Pharmacological activation of dopamine D1/5 receptors (with SKF 81297) enhanced extinction of both cued and contextual fear. These effects also occurred in the extinction of cocaine-induced conditioned place preference, suggesting that the observed effects on extinction were not specific to a particular type of procedure (aversive or appetitive). A cAMP/PKA biased D1 agonist (SKF 83959) did not affect fear extinction, whereas a broadly efficacious D1 agonist (SKF 83822) promoted fear extinction. Together, these findings show that dopamine D1/5 receptor activation is a target for the enhancement of fear or reward extinction.

Lighting up the brain's reward circuitry.

Science.gov (United States)

Lobo, Mary Kay

2012-07-01

The brain's reward circuit is critical for mediating natural reward behaviors including food, sex, and social interaction. Drugs of abuse take over this circuit and produce persistent molecular and cellular alterations in the brain regions and their neural circuitry that make up the reward pathway. Recent use of optogenetic technologies has provided novel insights into the functional and molecular role of the circuitry and cell subtypes within these circuits that constitute this pathway. This perspective will address the current and future use of light-activated proteins, including those involved in modulating neuronal activity, cellular signaling, and molecular properties in the neural circuitry mediating rewarding stimuli and maladaptive responses to drugs of abuse. © 2012 New York Academy of Sciences.

Reward prediction error signal enhanced by striatum-amygdala interaction explains the acceleration of probabilistic reward learning by emotion.

Science.gov (United States)

Watanabe, Noriya; Sakagami, Masamichi; Haruno, Masahiko

2013-03-06

Learning does not only depend on rationality, because real-life learning cannot be isolated from emotion or social factors. Therefore, it is intriguing to determine how emotion changes learning, and to identify which neural substrates underlie this interaction. Here, we show that the task-independent presentation of an emotional face before a reward-predicting cue increases the speed of cue-reward association learning in human subjects compared with trials in which a neutral face is presented. This phenomenon was attributable to an increase in the learning rate, which regulates reward prediction errors. Parallel to these behavioral findings, functional magnetic resonance imaging demonstrated that presentation of an emotional face enhanced reward prediction error (RPE) signal in the ventral striatum. In addition, we also found a functional link between this enhanced RPE signal and increased activity in the amygdala following presentation of an emotional face. Thus, this study revealed an acceleration of cue-reward association learning by emotion, and underscored a role of striatum-amygdala interactions in the modulation of the reward prediction errors by emotion.

Distinct Motivational Effects of Contingent and Noncontingent Rewards.

Science.gov (United States)

Manohar, Sanjay G; Finzi, Rebecca Dawn; Drew, Daniel; Husain, Masud

2017-07-01

When rewards are available, people expend more energy, increasing their motivational vigor. In theory, incentives might drive behavior for two distinct reasons: First, they increase expected reward; second, they increase the difference in subjective value between successful and unsuccessful performance, which increases contingency-the degree to which action determines outcome. Previous studies of motivational vigor have never compared these directly. Here, we indexed motivational vigor by measuring the speed of eye movements toward a target after participants heard a cue indicating how outcomes would be determined. Eye movements were faster when the cue indicated that monetary rewards would be contingent on performance than when the cue indicated that rewards would be random. But even when the cue indicated that a reward was guaranteed regardless of speed, movement was still faster than when no reward was available. Motivation by contingent and certain rewards was uncorrelated across individuals, which suggests that there are two separable, independent components of motivation. Contingent motivation generated autonomic arousal, and unlike noncontingent motivation, was effective with penalties as well as rewards.

Potential production of palm oil-based foaming agent as fire extinguisher of peatlands in Indonesia: Literature review

Science.gov (United States)

Subekti, P.; Hambali, E.; Suryani, A.; Suryadarma, P.

2017-05-01

This study aims to analyze the potential aplication of of palm oil-based foaming agent as peat fires fighter in Indonesia. From literature review, it has been known that the foaming agent able to form foam to extinguish fire, wrap and refrigerate the burning peat. It is necessary to develop the production and application of foaming agent in Indonesia because peat fires occur almost every year that caused smoke haze. Potential raw material for the production of environmental friendly foaming agent as foam extinguishing for peat fires in Indonesia aong other is palm oil due to abundant availability, sustainable, and foam product easily degraded in the environment of the burnt areas. Production of foaming agent as fire-fighting in Indonesia is one alternative to reduce the time to control the fire and smog disaster impact. Application of palm oil as a raw material for fire-fighting is contribute to increase the value added and the development of palm oil downstream industry.

Mechanisms of impulsive choice: III. The role of reward processes

Science.gov (United States)

Marshall, Andrew T.

2015-01-01

Two experiments examined the relationship between reward processing and impulsive choice. In Experiment 1, rats chose between a smaller-sooner (SS) reward (1 pellet, 10 s) and a larger-later (LL) reward (1, 2, and 4 pellets, 30 s). The rats then experienced concurrent variable-interval 30-s schedules with variations in reward magnitude to evaluate reward magnitude discrimination. LL choice behavior positively correlated with reward magnitude discrimination. In Experiment 2, rats chose between an SS reward (1 pellet, 10 s) and an LL reward (2 and 4 pellets, 30 s). The rats then received either a reward intervention which consisted of concurrent fixed-ratio schedules associated with different magnitudes to improve their reward magnitude discrimination, or a control task. All rats then experienced a post-intervention impulsive choice task followed by a reward magnitude discrimination task to assess intervention efficacy. The rats that received the intervention exhibited increases in post-intervention LL choice behavior, and made more responses for larger-reward magnitudes in the reward magnitude discrimination task, suggesting that the intervention heightened sensitivities to reward magnitude. The results suggest that reward magnitude discrimination plays a key role in individual differences in impulsive choice, and could be a potential target for further intervention developments. PMID:26506254

Informationally administered reward enhances intrinsic motivation in schizophrenia.

Science.gov (United States)

Lee, Hyeon-Seung; Jang, Seon-Kyeong; Lee, Ga-Young; Park, Seon-Cheol; Medalia, Alice; Choi, Kee-Hong

2017-10-01

Even when individuals with schizophrenia have an intact ability to enjoy rewarding moments, the means to assist them to translate rewarding experiences into goal-directed behaviors is unclear. The present study sought to determine whether informationally administered rewards enhance intrinsic motivation to foster goal-directed behaviors in individuals with schizophrenia (SZ) and healthy controls (HCs). Eighty-four participants (SZ=43, HCs=41) were randomly assigned to conditions involving either a performance-contingent reward with an informationally administered reward or a task-contingent reward with no feedback. Participants were asked to play two cognitive games of equalized difficulty. Accuracy, self-reported intrinsic motivation, free-choice intrinsic motivation (i.e., game play during a free-choice observation period), and perceived competency were measured. Intrinsic motivation and perceived competency in the cognitive games were similar between the two participant groups. The informationally administered reward significantly enhanced self-reported intrinsic motivation and perceived competency in both the groups. The likelihood that individuals with schizophrenia would play the game during the free-choice observation period was four times greater in the informationally administered reward condition than that in the no-feedback condition. Our findings suggest that, in the context of cognitive remediation, individuals with schizophrenia would benefit from informationally administered rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

Basolateral amygdala lesions abolish mutual reward preferences in rats.

Science.gov (United States)

Hernandez-Lallement, Julen; van Wingerden, Marijn; Schäble, Sandra; Kalenscher, Tobias

2016-01-01

In a recent study, we demonstrated that rats prefer mutual rewards in a Prosocial Choice Task. Here, employing the same task, we show that the integrity of basolateral amygdala was necessary for the expression of mutual reward preferences. Actor rats received bilateral excitotoxic (n=12) or sham lesions (n=10) targeting the basolateral amygdala and were subsequently tested in a Prosocial Choice Task where they could decide between rewarding ("Both Reward") or not rewarding a partner rat ("Own Reward"), either choice yielding identical reward to the actors themselves. To manipulate the social context and control for secondary reinforcement sources, actor rats were paired with either a partner rat (partner condition) or with an inanimate rat toy (toy condition). Sham-operated animals revealed a significant preference for the Both-Reward-option in the partner condition, but not in the toy condition. Amygdala-lesioned animals exhibited significantly lower Both-Reward preferences than the sham group in the partner but not in the toy condition, suggesting that basolateral amygdala was required for the expression of mutual reward preferences. Critically, in a reward magnitude discrimination task in the same experimental setup, both sham-operated and amygdala-lesioned animals preferred large over small rewards, suggesting that amygdala lesion effects were restricted to decision making in social contexts, leaving self-oriented behavior unaffected. Copyright © 2015 Elsevier Inc. All rights reserved.

Reward disrupts reactivated human skill memory

OpenAIRE

Dayan, Eran; Laor-Maayany, Rony; Censor, Nitzan

2016-01-01

Accumulating evidence across species and memory domains shows that when an existing memory is reactivated, it becomes susceptible to modifications. However, the potential role of reward signals in these mechanisms underlying human memory dynamics is unknown. Leaning on a wealth of findings on the role of reward in reinforcing memory, we tested the impact of reinforcing a skill memory trace with monetary reward following memory reactivation, on strengthening of the memory trace. Reinforcing re...

Reward and Attentional Control in Visual Search

Science.gov (United States)

Anderson, Brian A.; Wampler, Emma K.; Laurent, Patryk A.

2015-01-01

It has long been known that the control of attention in visual search depends both on voluntary, top-down deployment according to context-specific goals, and on involuntary, stimulus-driven capture based on the physical conspicuity of perceptual objects. Recent evidence suggests that pairing target stimuli with reward can modulate the voluntary deployment of attention, but there is little evidence that reward modulates the involuntary deployment of attention to task-irrelevant distractors. We report several experiments that investigate the role of reward learning on attentional control. Each experiment involved a training phase and a test phase. In the training phase, different colors were associated with different amounts of monetary reward. In the test phase, color was not task-relevant and participants searched for a shape singleton; in most experiments no reward was delivered in the test phase. We first show that attentional capture by physically salient distractors is magnified by a previous association with reward. In subsequent experiments we demonstrate that physically inconspicuous stimuli previously associated with reward capture attention persistently during extinction—even several days after training. Furthermore, vulnerability to attentional capture by high-value stimuli is negatively correlated across individuals with working memory capacity and positively correlated with trait impulsivity. An analysis of intertrial effects reveals that value-driven attentional capture is spatially specific. Finally, when reward is delivered at test contingent on the task-relevant shape feature, recent reward history modulates value-driven attentional capture by the irrelevant color feature. The influence of learned value on attention may provide a useful model of clinical syndromes characterized by similar failures of cognitive control, including addiction, attention-deficit/hyperactivity disorder, and obesity. PMID:23437631

Reward-enhanced memory in younger and older adults.

Science.gov (United States)

Spaniol, Julia; Schain, Cécile; Bowen, Holly J

2014-09-01

We investigated how the anticipation of remote monetary reward modulates intentional episodic memory formation in younger and older adults. On the basis of prior findings of preserved reward-cognition interactions in aging, we predicted that reward anticipation would be associated with enhanced memory in both younger and older adults. On the basis of previous demonstrations of a time-dependent effect of reward anticipation on memory, we expected the memory enhancement to increase with study-test delay. In Experiment 1, younger and older participants encoded a series of picture stimuli associated with high- or low-reward values. At test (24-hr postencoding), recognition hits resulted in either high or low monetary rewards, whereas false alarms were penalized to discourage guessing. Experiment 2 was similar to Experiment 1, but the study-test delay was manipulated within subjects (immediate vs 24hr). In Experiment 1, younger and older adults showed enhanced recognition for high-reward pictures compared with low-reward pictures. Experiment 2 replicated this finding and additionally showed that the effect did not extend to immediate recognition. The current findings provide support for a time-dependent mechanism of reward-based memory enhancement. They also suggest that aging leaves intact the positive influence of reward anticipation on intentional long-term memory formation. © The Author 2013. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Fluctuations in nucleus accumbens extracellular glutamate and glucose during motivated glucose-drinking behavior: dissecting the neurochemistry of reward.

Science.gov (United States)

Wakabayashi, Ken T; Myal, Stephanie E; Kiyatkin, Eugene A

2015-02-01

While motivated behavior involves multiple neurochemical systems, few studies have focused on the role of glutamate, the brain's excitatory neurotransmitter, and glucose, the energetic substrate of neural activity in reward-related neural processes. Here, we used high-speed amperometry with enzyme-based substrate-sensitive and control, enzyme-free biosensors to examine second-scale fluctuations in the extracellular levels of these substances in the nucleus accumbens shell during glucose-drinking behavior in trained rats. Glutamate rose rapidly after the presentation of a glucose-containing cup and before the initiation of drinking (reward seeking), decreased more slowly to levels below baseline during consumption (sensory reward), and returned to baseline when the ingested glucose reached the brain (metabolic reward). When water was substituted for glucose, glutamate rapidly increased with cup presentation and in contrast to glucose drinking, increased above baseline after rats tasted the water and refused to drink further. Therefore, extracellular glutamate show distinct changes associated with key events of motivated drinking behavior and opposite dynamics during sensory and metabolic components of reward. In contrast to glutamate, glucose increased at each stimulus and behavioral event, showing a sustained elevation during the entire behavior and a robust post-ingestion rise that correlated with the gradual return of glutamate levels to their baseline. By comparing active drinking with passive intra-gastric glucose delivery, we revealed that fluctuations in extracellular glucose are highly dynamic, reflecting a balance between rapid delivery because of neural activity, intense metabolism, and the influence of ingested glucose reaching the brain. Published 2014. This article is a U.S. Government work and is in the public domain in the USA.

Dynamics of neuronal circuits in addiction: reward, antireward, and emotional memory.

Science.gov (United States)

Koob, G F

2009-05-01

Drug addiction is conceptualized as chronic, relapsing compulsive use of drugs with significant dysregulation of brain hedonic systems. Compulsive drug use is accompanied by decreased function of brain substrates for drug positive reinforcement and recruitment of brain substrates mediating the negative reinforcement of motivational withdrawal. The neural substrates for motivational withdrawal ("dark side" of addiction) involve recruitment of elements of the extended amygdala and the brain stress systems, including corticotropin-releasing factor and norepinephrine. These changes, combined with decreased reward function, are hypothesized to persist in the form of an allostatic state that forms a powerful motivational background for relapse. Relapse also involves a key role for the basolateral amygdala in mediating the motivational effects of stimuli previously paired with drug seeking and drug motivational withdrawal. The basolateral amygdala has a key role in mediating emotional memories in general. The hypothesis argued here is that brain stress systems activated by the motivational consequences of drug withdrawal can not only form the basis for negative reinforcement that drives drug seeking, but also potentiate associative mechanisms that perpetuate the emotional state and help drive the allostatic state of addiction.

Information search with situation-specific reward functions

Directory of Open Access Journals (Sweden)

Bjorn Meder

2012-03-01

Full Text Available can strongly conflict with the goal of obtaining information for improving payoffs. Two environments with such a conflict were identified through computer optimization. Three subsequent experiments investigated people's search behavior in these environments. Experiments 1 and 2 used a multiple-cue probabilistic category-learning task to convey environmental probabilities. In a subsequent search task subjects could query only a single feature before making a classification decision. The crucial manipulation concerned the search-task reward structure. The payoffs corresponded either to accuracy, with equal rewards associated with the two categories, or to an asymmetric payoff function, with different rewards associated with each category. In Experiment 1, in which learning-task feedback corresponded to the true category, people later preferentially searched the accuracy-maximizing feature, whether or not this would improve monetary rewards. In Experiment 2, an asymmetric reward structure was used during learning. Subjects searched the reward-maximizing feature when asymmetric payoffs were preserved in the search task. However, if search-task payoffs corresponded to accuracy, subjects preferentially searched a feature that was suboptimal for reward and accuracy alike. Importantly, this feature would have been most useful, under the learning-task payoff structure. Experiment 3 found that, if words and numbers are used to convey environmental probabilities, neither reward nor accuracy consistently predicts search. These findings emphasize the necessity of taking into account people's goals and search-and-decision processes during learning, thereby challenging current models of information search.

Inhibiting food reward: delay discounting, food reward sensitivity, and palatable food intake in overweight and obese women.

Science.gov (United States)

Appelhans, Bradley M; Woolf, Kathleen; Pagoto, Sherry L; Schneider, Kristin L; Whited, Matthew C; Liebman, Rebecca

2011-11-01

Overeating is believed to result when the appetitive motivation to consume palatable food exceeds an individual's capacity for inhibitory control of eating. This hypothesis was supported in recent studies involving predominantly normal weight women, but has not been tested in obese populations. The current study tested the interaction between food reward sensitivity and inhibitory control in predicting palatable food intake among energy-replete overweight and obese women (N = 62). Sensitivity to palatable food reward was measured with the Power of Food Scale. Inhibitory control was assessed with a computerized choice task that captures the tendency to discount large delayed rewards relative to smaller immediate rewards. Participants completed an eating in the absence of hunger protocol in which homeostatic energy needs were eliminated with a bland preload of plain oatmeal, followed by a bogus laboratory taste test of palatable and bland snacks. The interaction between food reward sensitivity and inhibitory control was a significant predictor of palatable food intake in regression analyses controlling for BMI and the amount of preload consumed. Probing this interaction indicated that higher food reward sensitivity predicted greater palatable food intake at low levels of inhibitory control, but was not associated with intake at high levels of inhibitory control. As expected, no associations were found in a similar regression analysis predicting intake of bland foods. Findings support a neurobehavioral model of eating behavior in which sensitivity to palatable food reward drives overeating only when accompanied by insufficient inhibitory control. Strengthening inhibitory control could enhance weight management programs.

Role stress, role reward, and mental health in a multiethnic sample of midlife women: results from the Study of Women's Health Across the Nation (SWAN).

Science.gov (United States)

Lanza di Scalea, Teresa; Matthews, Karen A; Avis, Nancy E; Thurston, Rebecca C; Brown, Charlotte; Harlow, Sioban; Bromberger, Joyce T

2012-05-01

Little is known about the independent associations of reward and stress within specific roles with multiple measures of mental health in an ethnically diverse community sample of midlife women. The objective of this study is to examine if (1) role reward (within each role and across roles) contributes directly to mental health and buffers the negative impact of role stress and (2) associations among role occupancy, role stress, and role reward and mental health vary by race/ethnicity. With separate logistic regression analysis, we investigated cross-sectional relationships between role stress and role reward with presence/absence of high depressive symptoms (Center for Epidemiologic Studies Depression Scale [CES-D≥16]), anxiety symptoms (feeling tense or nervous, irritable or grouchy, fearful for no reason, and heart pounding or racing total score≥4), or low social functioning (bottom 25th percentile of the Short-Form-36 [SF-36] social functioning subscale) in 2549 women participating in the third visit of the Study of Women's Health Across the Nation (SWAN), a longitudinal population-based study of menopause. High reward across roles attenuated the negative impact of role stress on social functioning but not on anxiety or depression. High reward marriage buffered the impact of marital stress on depression, and high reward mothering buffered the effect of maternal stress on depression and social functioning. Compared to Caucasians, Hispanics and Chinese with high stress across roles had better social functioning, and African American mothers had lower odds of high depressive symptoms. Role reward buffers the negative impact of stress on social functioning and depression, but not on anxiety. Minorities may respond to role stress by seeking social support.

Neurocircuitry of drug reward

Science.gov (United States)

Ikemoto, Satoshi; Bonci, Antonello

2013-01-01

In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. PMID:23664810

Neural reward and punishment sensitivity in cigarette smokers.

Science.gov (United States)

Potts, Geoffrey F; Bloom, Erika L; Evans, David E; Drobes, David J

2014-11-01

Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Employee Reward Systems in Organizations

Directory of Open Access Journals (Sweden)

Došenović Dragana

2016-06-01

Full Text Available Employee rewarding is one of the activities of human resource management concerning the management of money, goods and services that employees receive from their employer in exchange for their work. Given that a properly designed reward system is one of the conditions for a stable business, successful performance of work activities and the achievement of set objectives in each organization, the basic theme of this paper is the employee reward system, with a special focus on different elements of it. The purpose of this paper is to describe the role and significance of the observed system and to draw attention to its role in employee’s motivation.

Prosocial Choice in Rats Depends on Food-Seeking Behavior Displayed by Recipients.

Science.gov (United States)

Márquez, Cristina; Rennie, Scott M; Costa, Diana F; Moita, Marta A

2015-06-29

Animals often are prosocial, displaying behaviors that result in a benefit to one another [1-15] even in the absence of self-benefit [16-21] (but see [22-25]). Several factors have been proposed to modulate these behaviors, namely familiarity [6, 13, 18, 20] or display of seeking behavior [16, 21]. Rats have been recently shown to be prosocial under distress [17, 18] (but see [26-29]); however, what drives prosociality in these animals remains unclear. To address this issue, we developed a two-choice task in which prosocial behavior did not yield a benefit or a cost to the focal rat. We used a double T-maze in which only the focal rat controlled access to the food-baited arms of its own and the recipient rat's maze. In this task, the focal rat could choose between one side of the maze, which yielded food only to itself (selfish choice), and the opposite side, which yielded food to itself and the recipient rat (prosocial choice). Rats showed a high proportion of prosocial choices. By manipulating reward delivery to the recipient and its ability to display a preference for the baited arm, we found that the display of food-seeking behavior leading to reward was necessary to drive prosocial choices. In addition, we found that there was more social investigation between rats in selfish trials than in prosocial trials, which may have influenced the focals' choices. This study shows that rats provide access to food to others in the absence of added direct self-benefit, bringing new insights into the factors that drive prosociality. Copyright © 2015 Elsevier Ltd. All rights reserved.

[Neurons in NAc core and BLA are activated during cocaine context-associated reward memory retrieval in mice].

Science.gov (United States)

Wang, Jun-Jun; Yao, Wen-Qing; Chen, Yue-Jun; Ma, Lan; Tao, Ye-Zheng

2014-10-25

The intense associative memories that develop between cocaine-paired contexts and rewarding stimuli make addiction hard to cure by contributing to cocaine seeking and relapse. So it's of great importance to examine the neurobiological basis of addiction memory. Cocaine conditioned place preference (CPP) used in this study is a form of Pavlovian conditioning which can establish associations between drug and contextual factors. c-Fos and Zif268 are commonly used immediate early gene (IEG) makers to identify neurons that are activated after a stimulus or behavioral conditioning. This study was designed to reveal neuronal c-Fos, Zif268 expression pattern in 10 brain regions following cocaine context-associated reward memory retrieval in mice, combining animal behavioral study and immunofluorescence method. C57BL/6 mice were randomly divided into 3 groups: Saline retrieval, Cocaine retrieval, and No retrieval of cocaine groups. Cocaine retrieval and No retrieval of cocaine underwent CPP training (one side paired with cocaine, and the other side with saline) except that No retrieval of cocaine group didn't undergo CPP test. Saline retrieval group received saline injections (i.p) on both sides. The results showed that: Neuronal c-Fos, Zif268 protein expression levels in nucleus accumbens (NAc) core both were elevated in Cocaine retrieval group compared with those in Saline retrieval (Control) group during cocaine context-associated reward memory retrieval. Zif268 protein expression level in basolateral amygdala (BLA) was also elevated in Cocaine retrieval group compared with that in control mice. Elevation was not seen in other regions such as hippocampus, prefrontal cortex (PFC). Thus, NAc core and BLA were activated during cocaine context-associated reward memory retrieval. The results suggest that neurons that are activated in NAc core and BLA are crucial basis of cocaine context-associated reward memory.

Role of delay-based reward in the spatial cooperation

Science.gov (United States)

Wang, Xu-Wen; Nie, Sen; Jiang, Luo-Luo; Wang, Bing-Hong; Chen, Shi-Ming

2017-01-01

Strategy selection in games, a typical decision making, usually brings noticeable reward for players which have discounted value if the delay appears. The discounted value is measure: earning sooner with a small reward or later with a delayed larger reward. Here, we investigate effects of delayed rewards on the cooperation in structured population. It is found that delayed reward supports the spreading of cooperation in square lattice, small-world and random networks. In particular, intermediate reward differences between delays impel the highest cooperation level. Interestingly, cooperative individuals with the same delay time steps form clusters to resist the invasion of defects, and cooperative individuals with lowest delay reward survive because they form the largest clusters in the lattice.

Motivational orientation modulates the neural response to reward.

Science.gov (United States)

Linke, Julia; Kirsch, Peter; King, Andrea V; Gass, Achim; Hennerici, Michael G; Bongers, André; Wessa, Michèle

2010-02-01

Motivational orientation defines the source of motivation for an individual to perform a particular action and can either originate from internal desires (e.g., interest) or external compensation (e.g., money). To this end, motivational orientation should influence the way positive or negative feedback is processed during learning situations and this might in turn have an impact on the learning process. In the present study, we thus investigated whether motivational orientation, i.e., extrinsic and intrinsic motivation modulates the neural response to reward and punishment as well as learning from reward and punishment in 33 healthy individuals. To assess neural responses to reward, punishment and learning of reward contingencies we employed a probabilistic reversal learning task during functional magnetic resonance imaging. Extrinsic and intrinsic motivation were assessed with a self-report questionnaire. Rewarding trials fostered activation in the medial orbitofrontal cortex and anterior cingulate gyrus (ACC) as well as the amygdala and nucleus accumbens, whereas for punishment an increased neural response was observed in the medial and inferior prefrontal cortex, the superior parietal cortex and the insula. High extrinsic motivation was positively correlated to increased neural responses to reward in the ACC, amygdala and putamen, whereas a negative relationship between intrinsic motivation and brain activation in these brain regions was observed. These findings show that motivational orientation indeed modulates the responsiveness to reward delivery in major components of the human reward system and therefore extends previous results showing a significant influence of individual differences in reward-related personality traits on the neural processing of reward. Copyright (c) 2009 Elsevier Inc. All rights reserved.

Nicotine Withdrawal Induces Neural Deficits in Reward Processing.

Science.gov (United States)

Oliver, Jason A; Evans, David E; Addicott, Merideth A; Potts, Geoffrey F; Brandon, Thomas H; Drobes, David J

2017-06-01

Nicotine withdrawal reduces neurobiological responses to nonsmoking rewards. Insight into these reward deficits could inform the development of targeted interventions. This study examined the effect of withdrawal on neural and behavioral responses during a reward prediction task. Smokers (N = 48) attended two laboratory sessions following overnight abstinence. Withdrawal was manipulated by having participants smoke three regular nicotine (0.6 mg yield; satiation) or very low nicotine (0.05 mg yield; withdrawal) cigarettes. Electrophysiological recordings of neural activity were obtained while participants completed a reward prediction task that involved viewing four combinations of predictive and reward-determining stimuli: (1) Unexpected Reward; (2) Predicted Reward; (3) Predicted Punishment; (4) Unexpected Punishment. The task evokes a medial frontal negativity that mimics the phasic pattern of dopaminergic firing in ventral tegmental regions associated with reward prediction errors. Nicotine withdrawal decreased the amplitude of the medial frontal negativity equally across all trial types (p nicotine dependence (p Nicotine withdrawal had equivocal impact across trial types, suggesting reward processing deficits are unlikely to stem from changes in phasic dopaminergic activity during prediction errors. Effects on tonic activity may be more pronounced. Pharmacological interventions directly targeting the dopamine system and behavioral interventions designed to increase reward motivation and responsiveness (eg, behavioral activation) may aid in mitigating withdrawal symptoms and potentially improving smoking cessation outcomes. Findings from this study indicate nicotine withdrawal impacts reward processing signals that are observable in smokers' neural activity. This may play a role in the subjective aversive experience of nicotine withdrawal and potentially contribute to smoking relapse. Interventions that address abnormal responding to both pleasant and

A Fly's Eye View of Natural and Drug Reward.

Science.gov (United States)

Lowenstein, Eve G; Velazquez-Ulloa, Norma A

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster , dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila . This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster , including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding

Trial-by-Trial Modulation of Associative Memory Formation by Reward Prediction Error and Reward Anticipation as Revealed by a Biologically Plausible Computational Model.

Science.gov (United States)

Aberg, Kristoffer C; Müller, Julia; Schwartz, Sophie

2017-01-01

Anticipation and delivery of rewards improves memory formation, but little effort has been made to disentangle their respective contributions to memory enhancement. Moreover, it has been suggested that the effects of reward on memory are mediated by dopaminergic influences on hippocampal plasticity. Yet, evidence linking memory improvements to actual reward computations reflected in the activity of the dopaminergic system, i.e., prediction errors and expected values, is scarce and inconclusive. For example, different previous studies reported that the magnitude of prediction errors during a reinforcement learning task was a positive, negative, or non-significant predictor of successfully encoding simultaneously presented images. Individual sensitivities to reward and punishment have been found to influence the activation of the dopaminergic reward system and could therefore help explain these seemingly discrepant results. Here, we used a novel associative memory task combined with computational modeling and showed independent effects of reward-delivery and reward-anticipation on memory. Strikingly, the computational approach revealed positive influences from both reward delivery, as mediated by prediction error magnitude, and reward anticipation, as mediated by magnitude of expected value, even in the absence of behavioral effects when analyzed using standard methods, i.e., by collapsing memory performance across trials within conditions. We additionally measured trait estimates of reward and punishment sensitivity and found that individuals with increased reward (vs. punishment) sensitivity had better memory for associations encoded during positive (vs. negative) prediction errors when tested after 20 min, but a negative trend when tested after 24 h. In conclusion, modeling trial-by-trial fluctuations in the magnitude of reward, as we did here for prediction errors and expected value computations, provides a comprehensive and biologically plausible description of

MIL SPEC 28 Square Foot Fire Burnback and Extinguishment Testing of FireAde, FlameOut II and Hawk ALLFIRE

National Research Council Canada - National Science Library

Barrett, Kimberly D; Kalberer, Jennifer L

2008-01-01

... for hydrocarbon fuel fires. This report documents the evaluation performed on the fire extinguishing agents FireAde 2000 AFFF LP, FlameOut II and Hawk ALLFORE in accordance with the parameters set forth in Military Specification ( MIL SPEC...

A new perspective on human reward research: How consciously and unconsciously perceived reward information influences performance.

NARCIS (Netherlands)

Zedelius, Claire; Veling, Harm; Custers, Ruud; Bijleveld, Erik; Chiew, K.S.; Aarts, Henk

2014-01-01

The question of how human performance can be improved through rewards is a recurrent topic of interest in psychology and neuroscience. Traditional, cognitive approaches to this topic have focused solely on consciously communicated rewards. Recently, a largely neuroscience-inspired perspective has

A new perspective on human reward research: How consciously and unconsciously perceived reward information influences performance

NARCIS (Netherlands)

Zedelius, C.M.; Veling, H.P.; Custers, R.; Bijleveld, E.H.; Chiew, K.S.; Aarts, H.A.G.

2014-01-01

The question of how human performance can be improved through rewards is a recurrent topic of interest in psychology and neuroscience. Traditional, cognitive approaches to this topic have focused solely on consciously communicated rewards. Recently, a largely neuroscience-inspired perspective has

Reward learning and negative emotion during rapid attentional competition

Directory of Open Access Journals (Sweden)

Takemasa eYokoyama

2015-03-01

Full Text Available Learned stimulus-reward associations influence how attention is allocated, such that stimuli rewarded in the past are favored in situations involving limited resources and competition. At the same time, task-irrelevant, high-arousal negative stimuli capture attention and divert resources away from tasks resulting in poor behavioral performance. Yet, investigations of how reward learning and negative stimuli affect perceptual and attentional processing have been conducted in a largely independent fashion. We have recently reported that performance-based monetary rewards reduce negative stimuli interference during perception. The goal of the present study was to investigate how stimuli associated with past monetary rewards compete with negative stimuli during a subsequent attentional task when, critically, no performance-based rewards were at stake. Across two experiments, we found that target stimuli that were associated with high reward reduced the interference effect of potent, negative distractors. Similar to our recent findings with performance-based rewards, our results demonstrate that reward-associated stimuli reduce the deleterious impact of negative stimuli on behavior.

A system extinguishing a fire by insulating a liquid fuel

International Nuclear Information System (INIS)

Colome, Jacques; Duchene, Alain; Regnier, Jean.

1975-01-01

The invention refers to a system for quickly extinguishing a liquid fuel body on fire by insulating it completely from the ambient air. It applies particularly to the case of a high temperature liquid sodium sheet flowing accidentally from a circuit belonging to a fast neutron reactor. The system in question includes a lower receptacle for collecting the liquid fuel and a top cover shutting off the receptacle. This cover has inclined channels to take the liquid fuel flow and openings to allow this liquid through at the bottom end of the channels. These openings are closed by retractable shutters moving away under the pressure of the liquid in the channels and closing automatically after the liquid has flowed into the receptacle [fr

Pavlovian-conditioned alcohol-seeking behavior in rats is invigorated by the interaction between discrete and contextual alcohol cues: implications for relapse

Science.gov (United States)

Remedios, Jessica; Woods, Catherine; Tardif, Catherine; Janak, Patricia H; Chaudhri, Nadia

2014-01-01

Introduction Drug craving can be independently stimulated by cues that are directly associated with drug intake (discrete drug cues), as well as by environmental contexts in which drug use occurs (contextual drug cues). We tested the hypothesis that the context in which a discrete alcohol-predictive cue is experienced can influence how robustly that cue stimulates alcohol-seeking behavior. Methods Male, Long-Evans rats received Pavlovian discrimination training (PDT) sessions in which one conditioned stimulus (CS+; 16 trials/session) was paired with ethanol (0.2 mL/CS+) and a second stimulus (CS−; 16 trials/session) was not. PDT occurred in a specific context, and entries into a fluid port where ethanol was delivered were measured during each CS. Next, rats were acclimated to an alternate (nonalcohol) context where cues and ethanol were withheld. Responses to the nonextinguished CS+ and CS− were then tested without ethanol in the alcohol-associated PDT context, the nonalcohol context or a third, novel context. Results Across PDT the CS+ elicited more port entries than the CS−, indicative of Pavlovian discrimination learning. At test, the CS+ elicited more port entries than the CS− in all three contexts: however, alcohol seeking driven by the CS+ was more robust in the alcohol-associated context. In a separate experiment, extinguishing the context-alcohol association did not influence subsequent CS+ responding but reduced alcohol seeking during non-CS+ intervals during a spontaneous recovery test. Conclusion These results indicate that alcohol-seeking behavior driven by a discrete Pavlovian alcohol cue is strongly invigorated by an alcohol context, and suggest that contexts may function as excitatory Pavlovian conditioned stimuli that directly trigger alcohol-seeking behavior. PMID:24683519

Dopamine signaling in reward-related behaviors.

Science.gov (United States)

Baik, Ja-Hyun

2013-01-01

Dopamine (DA) regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DA mesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural reward such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

Dopamine Signaling in reward-related behaviors

Directory of Open Access Journals (Sweden)

Ja-Hyun eBaik

2013-10-01

Full Text Available Dopamine (DA regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DAmesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural rewards such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

Flammability of self-extinguishing kenaf/ABS nanoclays composite for aircraft secondary structure

Science.gov (United States)

Karunakaran, S.; Majid, D. L.; Mohd Tawil, M. L.

2016-10-01

This study investigates the flammability properties of kenaf fiber reinforced acrylonitrile butadiene styrene (ABS) with nanoclays composites. Natural fiber is one of the potential materials to be used with thermoplastic as a composite due to its attractive properties such as lightweight and strong. In this paper, flammability properties of this material are evaluated through Underwriters Laboratory 94 Horizontal Burning (UL94 HB), which has been conducted for both controlled and uncontrolled conditions, smoke density and limiting oxygen index tests (LOI). These flammability tests are in compliance with the Federal Aviation Regulation (FAR) requirement. The results from UL94 HB and smoke density tests show that the presence of nanoclays with effective composition of kenaf fiber reinforced ABS has enhanced the burning characteristics of the material by hindering propagation of flame spread over the surface of the material through char formation. Consequently, this decreases the burning rate and produces low amount of smoke during burning. On contrary, through LOI test, this material requires less oxygen to burn when exposed to fire, which hinders the enhancement of burning characteristics. This is due to burning mechanism exhibited by nanoclays that catalyzes barrier formation and flame propagation rate over the surface of the biocomposite material. Overall, these experimental results suggest that this biocomposite material is capable of self-extinguishing and possesses effective fire extinction. The observed novel synergism from the result obtained is promising to be implemented in secondary structures of aircraft with significant benefits such as cost-effective, lightweight and biodegradable self-extinguishing biocomposite.

Reward Anticipation in Ventral Striatum and Individual Sensitivity to Reward : A Pilot Study of a Child-Friendly fMRI Task

NARCIS (Netherlands)

van Hulst, Branko M; de Zeeuw, Patrick; Lupas, Kellina; Bos, Dienke J; Neggers, Sebastiaan F W; Durston, Sarah

2015-01-01

Reward processing has been implicated in developmental disorders. However, the classic task to probe reward anticipation, the monetary incentive delay task, has an abstract coding of reward and no storyline and may therefore be less appropriate for use with developmental populations. We modified the

Adenosine A2A receptors in the nucleus accumbens bi-directionally alter cocaine seeking in rats.

Science.gov (United States)

O'Neill, Casey E; LeTendre, McKenzie L; Bachtell, Ryan K

2012-04-01

Repeated cocaine administration enhances dopamine D(2) receptor sensitivity in the mesolimbic dopamine system, which contributes to drug relapse. Adenosine A(2A) receptors are colocalized with D(2) receptors on nucleus accumbens (NAc) medium spiny neurons where they antagonize D(2) receptor activity. Thus, A(2A) receptors represent a target for reducing enhanced D(2) receptor sensitivity that contributes to cocaine relapse. The aim of these studies were to determine the effects of adenosine A(2A) receptor modulation in the NAc on cocaine seeking in rats that were trained to lever press for cocaine. Following at least 15 daily self-administration sessions and 1 week of abstinence, lever pressing was extinguished in daily extinction sessions. We subsequently assessed the effects of intra-NAc core microinjections of the A(2A) receptor agonist, CGS 21680 (4-[2-[[6-amino-9-(N-ethyl-b-D-ribofuranuronamidosyl)-9H-purin-2-yl]amino]ethyl]benzenepropanoic acid hydrochloride), and the A(2A) receptor antagonist, MSX-3 (3,7-dihydro-8-[(1E)-2-(3-methoxyphenyl)ethenyl]-7-methyl-3-[3-(phosphonooxy)propyl-1-(2-propynyl)-1H-purine-2,6-dione disodium salt hydrate), in modulating cocaine- and quinpirole-induced reinstatement to cocaine seeking. Intra-NAc pretreatment of CGS 21680 reduced both cocaine- and quinpirole-induced reinstatement. These effects were specific to cocaine reinstatement as intra-NAc CGS 21680 had no effect on sucrose seeking in rats trained to self-administer sucrose pellets. Intra-NAc treatment with MSX-3 modestly reinstated cocaine seeking when given alone, and exacerbated both cocaine- and quinpirole-induced reinstatement. Interestingly, the exacerbation of cocaine seeking produced by MSX-3 was only observed at sub-threshold doses of cocaine and quinpirole, suggesting that removing tonic A(2A) receptor activity enables behaviors mediated by dopamine receptors. Taken together, these findings suggest that A(2A) receptor stimulation reduces, while A(2A) blockade

Adenosine A2A Receptors in the Nucleus Accumbens Bi-Directionally Alter Cocaine Seeking in Rats

Science.gov (United States)

O'Neill, Casey E; LeTendre, Mckenzie L; Bachtell, Ryan K

2012-01-01

Repeated cocaine administration enhances dopamine D2 receptor sensitivity in the mesolimbic dopamine system, which contributes to drug relapse. Adenosine A2A receptors are colocalized with D2 receptors on nucleus accumbens (NAc) medium spiny neurons where they antagonize D2 receptor activity. Thus, A2A receptors represent a target for reducing enhanced D2 receptor sensitivity that contributes to cocaine relapse. The aim of these studies were to determine the effects of adenosine A2A receptor modulation in the NAc on cocaine seeking in rats that were trained to lever press for cocaine. Following at least 15 daily self-administration sessions and 1 week of abstinence, lever pressing was extinguished in daily extinction sessions. We subsequently assessed the effects of intra-NAc core microinjections of the A2A receptor agonist, CGS 21680 (4-[2-[[6-amino-9-(N-ethyl-b--ribofuranuronamidosyl)-9H-purin-2-yl]amino]ethyl]benzenepropanoic acid hydrochloride), and the A2A receptor antagonist, MSX-3 (3,7-dihydro-8-[(1E)-2-(3-methoxyphenyl)ethenyl]-7-methyl-3-[3-(phosphonooxy)propyl-1-(2-propynyl)-1H-purine-2,6-dione disodium salt hydrate), in modulating cocaine- and quinpirole-induced reinstatement to cocaine seeking. Intra-NAc pretreatment of CGS 21680 reduced both cocaine- and quinpirole-induced reinstatement. These effects were specific to cocaine reinstatement as intra-NAc CGS 21680 had no effect on sucrose seeking in rats trained to self-administer sucrose pellets. Intra-NAc treatment with MSX-3 modestly reinstated cocaine seeking when given alone, and exacerbated both cocaine- and quinpirole-induced reinstatement. Interestingly, the exacerbation of cocaine seeking produced by MSX-3 was only observed at sub-threshold doses of cocaine and quinpirole, suggesting that removing tonic A2A receptor activity enables behaviors mediated by dopamine receptors. Taken together, these findings suggest that A2A receptor stimulation reduces, while A2A blockade amplifies, D2 receptor

Pain and suicidality: insights from reward and addiction neuroscience.

Science.gov (United States)

Elman, Igor; Borsook, David; Volkow, Nora D

2013-10-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. Published by Elsevier Ltd.

Prosocial reward learning in children and adolescents

Directory of Open Access Journals (Sweden)

Youngbin Kwak

2016-10-01

Full Text Available Adolescence is a period of increased sensitivity to social contexts. To evaluate how social context sensitivity changes over development – and influences reward learning – we investigated how children and adolescents perceive and integrate rewards for oneself and others during a dynamic risky-decision-making task. Children and adolescents (N=75, 8-16 yrs performed the Social Gambling Task (SGT, (Kwak et al., 2014 and completed a set of questionnaires measuring other-regarding behavior. In the SGT, participants choose amongst four card decks that have different payout structures for oneself and for a charity. We examined patterns of choices, overall decision strategies, and how reward outcomes led to trial-by-trial adjustments in behavior, as estimated using a reinforcement-learning model. Performance of children and adolescents was compared to data from a previously collected sample of adults (N=102 performing the identical task. We found that that children/adolescents were not only more sensitive to rewards directed to the charity than self but also showed greater prosocial tendencies on independent measures of other-regarding behavior. Children and adolescents also showed less use of a strategy that prioritizes rewards for self at the expense of rewards for others. These results support the conclusion that, compared to adults, children and adolescents show greater sensitivity to outcomes for others when making decisions and learning about potential rewards.

Improving control over the impulse for reward: sensitivity of harmful alcohol drinkers to delayed reward but not immediate punishment.

Science.gov (United States)

Rossiter, Sarah; Thompson, Julian; Hester, Robert

2012-09-01

Cognitive control dysfunction has been identified in dependent alcohol users and implicated in the transition from abuse to dependence, although evidence of dyscontrol in chronic but non-dependent 'harmful' alcohol abusers is mixed. The current study examined harmful alcohol users response inhibition over rewarding stimuli in the presence of monetary reward and punishment, to determine whether changes in sensitivity to these factors, noted in imaging studies of dependent users, influences impulse control. Harmful (n=30) and non-hazardous (n=55) alcohol users were administered a Monetary Incentive Go/No-go task that required participants to inhibit a prepotent motor response associated with reward. Harmful alcohol users showed a significantly poorer ability to withhold their impulse for a rewarding stimulus in the presence of immediate monetary punishment for failure, while retaining equivalent response inhibition performance under neutral conditions (associated with neither monetary loss or gain), and significantly better performance under delayed reward conditions. The results of the present study suggest that non-dependent alcohol abusers have altered sensitivity to reward and punishment that influences their impulse control for reward, in the absence of gross dyscontrol that is consistent with past findings in which such performance contingencies were not used. The ability of delayed monetary reward, but not punishment, to increase sustained impulse control in this sample has implications for the mechanism that might underlie the transition from alcohol abuse to dependence, as well as intervention strategies aimed at preventing this transition. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Adaptive scaling of reward in episodic memory: a replication study.

Science.gov (United States)

Mason, Alice; Ludwig, Casimir; Farrell, Simon

2017-11-01

Reward is thought to enhance episodic memory formation via dopaminergic consolidation. Bunzeck, Dayan, Dolan, and Duzel [(2010). A common mechanism for adaptive scaling of reward and novelty. Human Brain Mapping, 31, 1380-1394] provided functional magnetic resonance imaging (fMRI) and behavioural evidence that reward and episodic memory systems are sensitive to the contextual value of a reward-whether it is relatively higher or lower-as opposed to absolute value or prediction error. We carried out a direct replication of their behavioural study and did not replicate their finding that memory performance associated with reward follows this pattern of adaptive scaling. An effect of reward outcome was in the opposite direction to that in the original study, with lower reward outcomes leading to better memory than higher outcomes. There was a marginal effect of reward context, suggesting that expected value affected memory performance. We discuss the robustness of the reward memory relationship to variations in reward context, and whether other reward-related factors have a more reliable influence on episodic memory.

Influence of reward motivation on human declarative memory.

Science.gov (United States)

Miendlarzewska, Ewa A; Bavelier, Daphne; Schwartz, Sophie

2016-02-01

Motivational relevance can prioritize information for memory encoding and consolidation based on reward value. In this review, we pinpoint the possible psychological and neural mechanisms by which reward promotes learning, from guiding attention to enhancing memory consolidation. We then discuss how reward value can spill-over from one conditioned stimulus to a non-conditioned stimulus. Such generalization can occur across perceptually similar items or through more complex relations, such as associative or logical inferences. Existing evidence suggests that the neurotransmitter dopamine boosts the formation of declarative memory for rewarded information and may also control the generalization of reward values. In particular, temporally-correlated activity in the hippocampus and in regions of the dopaminergic circuit may mediate value-based decisions and facilitate cross-item integration. Given the importance of generalization in learning, our review points to the need to study not only how reward affects later memory but how learned reward values may generalize to related representations and ultimately alter memory structure. Copyright © 2015 Elsevier Ltd. All rights reserved.

Incentives for healthy behaviors: experience from Florida Medicaid's Enhanced Benefit Rewards program.

Science.gov (United States)

Hall, Allyson G; Lemak, Christy Harris; Landry, Amy Yarbrough; Duncan, R Paul

2013-04-01

Engaging individuals in their own health care proves challenging for policy makers, health plans, and providers. Florida Medicaid introduced the Enhanced Benefits Rewards (EBR) program in 2006, providing financial incentives as rewards to beneficiaries who engage in health care seeking and healthy behaviors. This study analyzed beneficiary survey data from 2009 to determine predictors associated with awareness of and participation in the EBR program. Non-English speakers, those in a racial and ethnic minority group, those with less than a high school education, and those with limited or no connection to a health care provider were associated with lower awareness of the program. Among those aware of the program, these factors were also associated with reduced likelihood of engaging in the program. Individuals in fair or poor health were also less likely to engage in an approved behavior. Individuals who speak Spanish at home and those without a high school diploma were more likely than other groups to spend their earned program credits. Findings underscore the fact that initial engagement in such a program can prove challenging as different groups are not equally likely to be aware of or participate in an approved activity or redeem a credit. Physicians may play important roles in encouraging participation in programs to incentivize healthy behaviors.

Belief reward shaping in reinforcement learning

CSIR Research Space (South Africa)

Marom, O

2018-02-01

Full Text Available A key challenge in many reinforcement learning problems is delayed rewards, which can significantly slow down learning. Although reward shaping has previously been introduced to accelerate learning by bootstrapping an agent with additional...

Effect of current on the maximum possible reward.

Science.gov (United States)

Gallistel, C R; Leon, M; Waraczynski, M; Hanau, M S

1991-12-01

Using a 2-lever choice paradigm with concurrent variable interval schedules of reward, it was found that when pulse frequency is increased, the preference-determining rewarding effect of 0.5-s trains of brief cathodal pulses delivered to the medial forebrain bundle of the rat saturates (stops increasing) at values ranging from 200 to 631 pulses/s (pps). Raising the current lowered the saturation frequency, which confirms earlier, more extensive findings showing that the rewarding effect of short trains saturates at pulse frequencies that vary from less than 100 pps to more than 800 pps, depending on the current. It was also found that the maximum possible reward--the magnitude of the reward at or beyond the saturation pulse frequency--increases with increasing current. Thus, increasing the current reduces the saturation frequency but increases the subjective magnitude of the maximum possible reward.

Structural and Functional Plasticity within the Nucleus Accumbens and Prefrontal Cortex Associated with Time-Dependent Increases in Food Cue-Seeking Behavior.

Science.gov (United States)

Dingess, Paige M; Darling, Rebecca A; Derman, Rifka C; Wulff, Shaun S; Hunter, Melissa L; Ferrario, Carrie R; Brown, Travis E

2017-11-01

Urges to consume food can be driven by stimuli in the environment that are associated with previous food experience. Identifying adaptations within brain reward circuits that facilitate cue-induced food seeking is critical for understanding and preventing the overconsumption of food and subsequent weight gain. Utilizing electrophysiological, biochemical, and DiI labeling, we examined functional and structural changes in the nucleus accumbens (NAc) and prefrontal cortex (PFC) associated with time-dependent increases in food craving ('incubation of craving'). Rats self-administered 60% high fat or chow 45 mg pellets and were then tested for incubation of craving either 1 or 30 days after training. High fat was chosen for comparison to determine whether palatability differentially affected incubation and/or plasticity. Rats showed robust incubation of craving for both food rewards, although responding for cues previously associated with high fat was greater than chow at both 1 and 30 days. In addition, previous experience with high-fat consumption reduced dendritic spine density in the PFC at both time points. In contrast, incubation was associated with an increase in NAc spine density and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor (AMPAR)-mediated transmission at 30 days in both groups. Finally, incubation of craving for chow and high fat was accompanied by an increase in calcium-permeable and calcium-impermeable AMPARs, respectively. Our results suggest that incubation of food craving alters brain reward circuitry and macronutrient composition specifically induces cortical changes in a way that may facilitate maladaptive food-seeking behaviors.

Associations among smoking, anhedonia, and reward learning in depression.

Science.gov (United States)

Liverant, Gabrielle I; Sloan, Denise M; Pizzagalli, Diego A; Harte, Christopher B; Kamholz, Barbara W; Rosebrock, Laina E; Cohen, Andrew L; Fava, Maurizio; Kaplan, Gary B

2014-09-01

Depression and cigarette smoking co-occur at high rates. However, the etiological mechanisms that contribute to this relationship remain unclear. Anhedonia and associated impairments in reward learning are key features of depression, which also have been linked to the onset and maintenance of cigarette smoking. However, few studies have investigated differences in anhedonia and reward learning among depressed smokers and depressed nonsmokers. The goal of this study was to examine putative differences in anhedonia and reward learning in depressed smokers (n=36) and depressed nonsmokers (n=44). To this end, participants completed self-report measures of anhedonia and behavioral activation (BAS reward responsiveness scores) and as well as a probabilistic reward task rooted in signal detection theory, which measures reward learning (Pizzagalli, Jahn, & O'Shea, 2005). When considering self-report measures, depressed smokers reported higher trait anhedonia and reduced BAS reward responsiveness scores compared to depressed nonsmokers. In contrast to self-report measures, nicotine-satiated depressed smokers demonstrated greater acquisition of reward-based learning compared to depressed nonsmokers as indexed by the probabilistic reward task. Findings may point to a potential mechanism underlying the frequent co-occurrence of smoking and depression. These results highlight the importance of continued investigation of the role of anhedonia and reward system functioning in the co-occurrence of depression and nicotine abuse. Results also may support the use of treatments targeting reward learning (e.g., behavioral activation) to enhance smoking cessation among individuals with depression. Copyright © 2014. Published by Elsevier Ltd.

Extinguishing a learned response in a free-ranging gray wolf (Canis lupus)

Science.gov (United States)

Mech, L. David

2017-01-01

A free-ranging Gray Wolf (Canis lupus), habituated to human presence (the author) on Ellesmere Island, Canada, learned to anticipate experimental feeding by a human, became impatient, persistent, and bold and exhibited stalking behaviour toward the food source. Only after the author offered the wolf about 90 clumps of dry soil over a period of 45 minutes in three bouts, did the wolf give up this behaviour. To my knowledge, this is the first example of extinguishing a learned response in a free-ranging wolf and provides new insight into the learning behaviour of such animals.

Extending Markov Automata with State and Action Rewards

NARCIS (Netherlands)

Guck, Dennis; Timmer, Mark; Blom, Stefan; Bertrand, N.; Bortolussi, L.

This presentation introduces the Markov Reward Automaton (MRA), an extension of the Markov automaton that allows the modelling of systems incorporating rewards in addition to nondeterminism, discrete probabilistic choice and continuous stochastic timing. Our models support both rewards that are

Functional requirements for reward-modulated spike-timing-dependent plasticity.

Science.gov (United States)

Frémaux, Nicolas; Sprekeler, Henning; Gerstner, Wulfram

2010-10-06

Recent experiments have shown that spike-timing-dependent plasticity is influenced by neuromodulation. We derive theoretical conditions for successful learning of reward-related behavior for a large class of learning rules where Hebbian synaptic plasticity is conditioned on a global modulatory factor signaling reward. We show that all learning rules in this class can be separated into a term that captures the covariance of neuronal firing and reward and a second term that presents the influence of unsupervised learning. The unsupervised term, which is, in general, detrimental for reward-based learning, can be suppressed if the neuromodulatory signal encodes the difference between the reward and the expected reward-but only if the expected reward is calculated for each task and stimulus separately. If several tasks are to be learned simultaneously, the nervous system needs an internal critic that is able to predict the expected reward for arbitrary stimuli. We show that, with a critic, reward-modulated spike-timing-dependent plasticity is capable of learning motor trajectories with a temporal resolution of tens of milliseconds. The relation to temporal difference learning, the relevance of block-based learning paradigms, and the limitations of learning with a critic are discussed.

A test of the reward-contrast hypothesis.

Science.gov (United States)

Dalecki, Stefan J; Panoz-Brown, Danielle E; Crystal, Jonathon D

2017-12-01

Source memory, a facet of episodic memory, is the memory of the origin of information. Whereas source memory in rats is sustained for at least a week, spatial memory degraded after approximately a day. Different forgetting functions may suggest that two memory systems (source memory and spatial memory) are dissociated. However, in previous work, the two tasks used baiting conditions consisting of chocolate and chow flavors; notably, the source memory task used the relatively better flavor. Thus, according to the reward-contrast hypothesis, when chocolate and chow were presented within the same context (i.e., within a single radial maze trial), the chocolate location was more memorable than the chow location because of contrast. We tested the reward-contrast hypothesis using baiting configurations designed to produce reward-contrast. The reward-contrast hypothesis predicts that under these conditions, spatial memory will survive a 24-h retention interval. We documented elimination of spatial memory performance after a 24-h retention interval using a reward-contrast baiting pattern. These data suggest that reward contrast does not explain our earlier findings that source memory survives unusually long retention intervals. Copyright © 2017 Elsevier B.V. All rights reserved.