A Mechanistic Neural Field Theory of How Anesthesia Suppresses Consciousness: Synaptic Drive Dynamics, Bifurcations, Attractors, and Partial State Equipartitioning.

Science.gov (United States)

Hou, Saing Paul; Haddad, Wassim M; Meskin, Nader; Bailey, James M

2015-12-01

With the advances in biochemistry, molecular biology, and neurochemistry there has been impressive progress in understanding the molecular properties of anesthetic agents. However, there has been little focus on how the molecular properties of anesthetic agents lead to the observed macroscopic property that defines the anesthetic state, that is, lack of responsiveness to noxious stimuli. In this paper, we use dynamical system theory to develop a mechanistic mean field model for neural activity to study the abrupt transition from consciousness to unconsciousness as the concentration of the anesthetic agent increases. The proposed synaptic drive firing-rate model predicts the conscious-unconscious transition as the applied anesthetic concentration increases, where excitatory neural activity is characterized by a Poincaré-Andronov-Hopf bifurcation with the awake state transitioning to a stable limit cycle and then subsequently to an asymptotically stable unconscious equilibrium state. Furthermore, we address the more general question of synchronization and partial state equipartitioning of neural activity without mean field assumptions. This is done by focusing on a postulated subset of inhibitory neurons that are not themselves connected to other inhibitory neurons. Finally, several numerical experiments are presented to illustrate the different aspects of the proposed theory.

Cognitive phase transitions in the cerebral cortex enhancing the neuron doctrine by modeling neural fields

CERN Document Server

Kozma, Robert

2016-01-01

This intriguing book was born out of the many discussions the authors had in the past 10 years about the role of scale-free structure and dynamics in producing intelligent behavior in brains. The microscopic dynamics of neural networks is well described by the prevailing paradigm based in a narrow interpretation of the neuron doctrine. This book broadens the doctrine by incorporating the dynamics of neural fields, as first revealed by modeling with differential equations (K-sets).  The book broadens that approach by application of random graph theory (neuropercolation). The book concludes with diverse commentaries that exemplify the wide range of mathematical/conceptual approaches to neural fields. This book is intended for researchers, postdocs, and graduate students, who see the limitations of network theory and seek a beachhead from which to embark on mesoscopic and macroscopic neurodynamics.

Dynamic training algorithm for dynamic neural networks

International Nuclear Information System (INIS)

Tan, Y.; Van Cauwenberghe, A.; Liu, Z.

1996-01-01

The widely used backpropagation algorithm for training neural networks based on the gradient descent has a significant drawback of slow convergence. A Gauss-Newton method based recursive least squares (RLS) type algorithm with dynamic error backpropagation is presented to speed-up the learning procedure of neural networks with local recurrent terms. Finally, simulation examples concerning the applications of the RLS type algorithm to identification of nonlinear processes using a local recurrent neural network are also included in this paper

Autonomy in action: linking the act of looking to memory formation in infancy via dynamic neural fields.

Science.gov (United States)

Perone, Sammy; Spencer, John P

2013-01-01

Looking is a fundamental exploratory behavior by which infants acquire knowledge about the world. In theories of infant habituation, however, looking as an exploratory behavior has been deemphasized relative to the reliable nature with which looking indexes active cognitive processing. We present a new theory that connects looking to the dynamics of memory formation and formally implement this theory in a Dynamic Neural Field model that learns autonomously as it actively looks and looks away from a stimulus. We situate this model in a habituation task and illustrate the mechanisms by which looking, encoding, working memory formation, and long-term memory formation give rise to habituation across multiple stimulus and task contexts. We also illustrate how the act of looking and the temporal dynamics of learning affect each other. Finally, we test a new hypothesis about the sources of developmental differences in looking. Copyright © 2012 Cognitive Science Society, Inc.

A Neural Network Approach to Fluid Quantity Measurement in Dynamic Environments

CERN Document Server

Terzic, Edin; Nagarajah, Romesh; Alamgir, Muhammad

2012-01-01

Sloshing causes liquid to fluctuate, making accurate level readings difficult to obtain in dynamic environments. The measurement system described uses a single-tube capacitive sensor to obtain an instantaneous level reading of the fluid surface, thereby accurately determining the fluid quantity in the presence of slosh. A neural network based classification technique has been applied to predict the actual quantity of the fluid contained in a tank under sloshing conditions.   In A neural network approach to fluid quantity measurement in dynamic environments, effects of temperature variations and contamination on the capacitive sensor are discussed, and the authors propose that these effects can also be eliminated with the proposed neural network based classification system. To examine the performance of the classification system, many field trials were carried out on a running vehicle at various tank volume levels that range from 5 L to 50 L. The effectiveness of signal enhancement on the neural network base...

Dynamics of neural cryptography.

Science.gov (United States)

Ruttor, Andreas; Kinzel, Wolfgang; Kanter, Ido

2007-05-01

Synchronization of neural networks has been used for public channel protocols in cryptography. In the case of tree parity machines the dynamics of both bidirectional synchronization and unidirectional learning is driven by attractive and repulsive stochastic forces. Thus it can be described well by a random walk model for the overlap between participating neural networks. For that purpose transition probabilities and scaling laws for the step sizes are derived analytically. Both these calculations as well as numerical simulations show that bidirectional interaction leads to full synchronization on average. In contrast, successful learning is only possible by means of fluctuations. Consequently, synchronization is much faster than learning, which is essential for the security of the neural key-exchange protocol. However, this qualitative difference between bidirectional and unidirectional interaction vanishes if tree parity machines with more than three hidden units are used, so that those neural networks are not suitable for neural cryptography. In addition, the effective number of keys which can be generated by the neural key-exchange protocol is calculated using the entropy of the weight distribution. As this quantity increases exponentially with the system size, brute-force attacks on neural cryptography can easily be made unfeasible.

Dynamics of neural cryptography

International Nuclear Information System (INIS)

Ruttor, Andreas; Kinzel, Wolfgang; Kanter, Ido

2007-01-01

Synchronization of neural networks has been used for public channel protocols in cryptography. In the case of tree parity machines the dynamics of both bidirectional synchronization and unidirectional learning is driven by attractive and repulsive stochastic forces. Thus it can be described well by a random walk model for the overlap between participating neural networks. For that purpose transition probabilities and scaling laws for the step sizes are derived analytically. Both these calculations as well as numerical simulations show that bidirectional interaction leads to full synchronization on average. In contrast, successful learning is only possible by means of fluctuations. Consequently, synchronization is much faster than learning, which is essential for the security of the neural key-exchange protocol. However, this qualitative difference between bidirectional and unidirectional interaction vanishes if tree parity machines with more than three hidden units are used, so that those neural networks are not suitable for neural cryptography. In addition, the effective number of keys which can be generated by the neural key-exchange protocol is calculated using the entropy of the weight distribution. As this quantity increases exponentially with the system size, brute-force attacks on neural cryptography can easily be made unfeasible

Dynamics of neural cryptography

Science.gov (United States)

Ruttor, Andreas; Kinzel, Wolfgang; Kanter, Ido

2007-05-01

Synchronization of neural networks has been used for public channel protocols in cryptography. In the case of tree parity machines the dynamics of both bidirectional synchronization and unidirectional learning is driven by attractive and repulsive stochastic forces. Thus it can be described well by a random walk model for the overlap between participating neural networks. For that purpose transition probabilities and scaling laws for the step sizes are derived analytically. Both these calculations as well as numerical simulations show that bidirectional interaction leads to full synchronization on average. In contrast, successful learning is only possible by means of fluctuations. Consequently, synchronization is much faster than learning, which is essential for the security of the neural key-exchange protocol. However, this qualitative difference between bidirectional and unidirectional interaction vanishes if tree parity machines with more than three hidden units are used, so that those neural networks are not suitable for neural cryptography. In addition, the effective number of keys which can be generated by the neural key-exchange protocol is calculated using the entropy of the weight distribution. As this quantity increases exponentially with the system size, brute-force attacks on neural cryptography can easily be made unfeasible.

Developing Dynamic Field Theory Architectures for Embodied Cognitive Systems with cedar.

Science.gov (United States)

Lomp, Oliver; Richter, Mathis; Zibner, Stephan K U; Schöner, Gregor

2016-01-01

Embodied artificial cognitive systems, such as autonomous robots or intelligent observers, connect cognitive processes to sensory and effector systems in real time. Prime candidates for such embodied intelligence are neurally inspired architectures. While components such as forward neural networks are well established, designing pervasively autonomous neural architectures remains a challenge. This includes the problem of tuning the parameters of such architectures so that they deliver specified functionality under variable environmental conditions and retain these functions as the architectures are expanded. The scaling and autonomy problems are solved, in part, by dynamic field theory (DFT), a theoretical framework for the neural grounding of sensorimotor and cognitive processes. In this paper, we address how to efficiently build DFT architectures that control embodied agents and how to tune their parameters so that the desired cognitive functions emerge while such agents are situated in real environments. In DFT architectures, dynamic neural fields or nodes are assigned dynamic regimes, that is, attractor states and their instabilities, from which cognitive function emerges. Tuning thus amounts to determining values of the dynamic parameters for which the components of a DFT architecture are in the specified dynamic regime under the appropriate environmental conditions. The process of tuning is facilitated by the software framework cedar , which provides a graphical interface to build and execute DFT architectures. It enables to change dynamic parameters online and visualize the activation states of any component while the agent is receiving sensory inputs in real time. Using a simple example, we take the reader through the workflow of conceiving of DFT architectures, implementing them on embodied agents, tuning their parameters, and assessing performance while the system is coupled to real sensory inputs.

Advanced models of neural networks nonlinear dynamics and stochasticity in biological neurons

CERN Document Server

Rigatos, Gerasimos G

2015-01-01

This book provides a complete study on neural structures exhibiting nonlinear and stochastic dynamics, elaborating on neural dynamics by introducing advanced models of neural networks. It overviews the main findings in the modelling of neural dynamics in terms of electrical circuits and examines their stability properties with the use of dynamical systems theory. It is suitable for researchers and postgraduate students engaged with neural networks and dynamical systems theory.

Dynamic Information Encoding With Dynamic Synapses in Neural Adaptation

Science.gov (United States)

Li, Luozheng; Mi, Yuanyuan; Zhang, Wenhao; Wang, Da-Hui; Wu, Si

2018-01-01

Adaptation refers to the general phenomenon that the neural system dynamically adjusts its response property according to the statistics of external inputs. In response to an invariant stimulation, neuronal firing rates first increase dramatically and then decrease gradually to a low level close to the background activity. This prompts a question: during the adaptation, how does the neural system encode the repeated stimulation with attenuated firing rates? It has been suggested that the neural system may employ a dynamical encoding strategy during the adaptation, the information of stimulus is mainly encoded by the strong independent spiking of neurons at the early stage of the adaptation; while the weak but synchronized activity of neurons encodes the stimulus information at the later stage of the adaptation. The previous study demonstrated that short-term facilitation (STF) of electrical synapses, which increases the synchronization between neurons, can provide a mechanism to realize dynamical encoding. In the present study, we further explore whether short-term plasticity (STP) of chemical synapses, an interaction form more common than electrical synapse in the cortex, can support dynamical encoding. We build a large-size network with chemical synapses between neurons. Notably, facilitation of chemical synapses only enhances pair-wise correlations between neurons mildly, but its effect on increasing synchronization of the network can be significant, and hence it can serve as a mechanism to convey the stimulus information. To read-out the stimulus information, we consider that a downstream neuron receives balanced excitatory and inhibitory inputs from the network, so that the downstream neuron only responds to synchronized firings of the network. Therefore, the response of the downstream neuron indicates the presence of the repeated stimulation. Overall, our study demonstrates that STP of chemical synapse can serve as a mechanism to realize dynamical neural

Developing dynamic field theory architectures for embodied cognitive systems with cedar

Directory of Open Access Journals (Sweden)

Oliver Lomp

2016-11-01

Full Text Available Embodied artificial cognitive systems such as autonomous robots or intelligent observers connect cognitive processes to sensory and effector systems in real time. Prime candidates for such embodied intelligence are neurally inspired architectures. While components such as forward neural networks are well established, designing pervasively autonomous neural architectures remains a challenge. This includes the problem of tuning the parameters of such architectures so that they deliver specified functionality under variable environmental conditions and retain these functions as the architectures are expanded. The scaling and autonomy problems are solved, in part, by dynamic field theory (DFT, a theoretical framework for the neural grounding of sensorimotor and cognitive processes. In this paper, we address how to efficiently build DFT architectures that control embodied agents and how to tune their parameters so that the desired cognitive functions emerge while such agents are situated in real environments. In DFT architectures, dynamic neural fields or nodes are assigned dynamic regimes, that is, attractor states and their instabilities, from which cognitive function emerges. Tuning thus amounts to determining values of the dynamic parameters for which the components of a DFT architecture are in the specified dynamic regime under the appropriate environmental conditions. The process of tuning is facilitated by the software framework cedar, which provides a graphical interface to build and execute DFT architectures. It enables to change dynamic parameters online and visualize the activation states of any component while the agent is receiving sensory inputs in real-time. Using a simple example, we take the reader through the workflow of conceiving of DFT architectures, implementing them on embodied agents, tuning their parameters, and assessing performance while the system is coupled to real sensory inputs.

EDITORIAL: Special issue on applied neurodynamics: from neural dynamics to neural engineering Special issue on applied neurodynamics: from neural dynamics to neural engineering

Science.gov (United States)

Chiel, Hillel J.; Thomas, Peter J.

2011-12-01

, the sun, earth and moon) proved to be far more difficult. In the late nineteenth century, Poincaré made significant progress on this problem, introducing a geometric method of reasoning about solutions to differential equations (Diacu and Holmes 1996). This work had a powerful impact on mathematicians and physicists, and also began to influence biology. In his 1925 book, based on his work starting in 1907, and that of others, Lotka used nonlinear differential equations and concepts from dynamical systems theory to analyze a wide variety of biological problems, including oscillations in the numbers of predators and prey (Lotka 1925). Although little was known in detail about the function of the nervous system, Lotka concluded his book with speculations about consciousness and the implications this might have for creating a mathematical formulation of biological systems. Much experimental work in the 1930s and 1940s focused on the biophysical mechanisms of excitability in neural tissue, and Rashevsky and others continued to apply tools and concepts from nonlinear dynamical systems theory as a means of providing a more general framework for understanding these results (Rashevsky 1960, Landahl and Podolsky 1949). The publication of Hodgkin and Huxley's classic quantitative model of the action potential in 1952 created a new impetus for these studies (Hodgkin and Huxley 1952). In 1955, FitzHugh published an important paper that summarized much of the earlier literature, and used concepts from phase plane analysis such as asymptotic stability, saddle points, separatrices and the role of noise to provide a deeper theoretical and conceptual understanding of threshold phenomena (Fitzhugh 1955, Izhikevich and FitzHugh 2006). The Fitzhugh-Nagumo equations constituted an important two-dimensional simplification of the four-dimensional Hodgkin and Huxley equations, and gave rise to an extensive literature of analysis. Many of the papers in this special issue build on tools

Coordination: Neural, Behavioral and Social Dynamics

CERN Document Server

Fuchs, Armin

2008-01-01

One of the most striking features of Coordination Dynamics is its interdisciplinary character. The problems we are trying to solve in this field range from behavioral phenomena of interlimb coordination and coordination between stimuli and movements (perception-action tasks) through neural activation patterns that can be observed during these tasks to clinical applications and social behavior. It is not surprising that close collaboration among scientists from different fields as psychology, kinesiology, neurology and even physics are imperative to deal with the enormous difficulties we are facing when we try to understand a system as complex as the human brain. The chapters in this volume are not simply write-ups of the lectures given by the experts at the meeting but are written in a way that they give sufficient introductory information to be comprehensible and useful for all interested scientists and students.

Neutral Theory and Scale-Free Neural Dynamics

Science.gov (United States)

Martinello, Matteo; Hidalgo, Jorge; Maritan, Amos; di Santo, Serena; Plenz, Dietmar; Muñoz, Miguel A.

2017-10-01

Neural tissues have been consistently observed to be spontaneously active and to generate highly variable (scale-free distributed) outbursts of activity in vivo and in vitro. Understanding whether these heterogeneous patterns of activity stem from the underlying neural dynamics operating at the edge of a phase transition is a fascinating possibility, as criticality has been argued to entail many possible important functional advantages in biological computing systems. Here, we employ a well-accepted model for neural dynamics to elucidate an alternative scenario in which diverse neuronal avalanches, obeying scaling, can coexist simultaneously, even if the network operates in a regime far from the edge of any phase transition. We show that perturbations to the system state unfold dynamically according to a "neutral drift" (i.e., guided only by stochasticity) with respect to the background of endogenous spontaneous activity, and that such a neutral dynamics—akin to neutral theories of population genetics and of biogeography—implies marginal propagation of perturbations and scale-free distributed causal avalanches. We argue that causal information, not easily accessible to experiments, is essential to elucidate the nature and statistics of neural avalanches, and that neutral dynamics is likely to play an important role in the cortex functioning. We discuss the implications of these findings to design new empirical approaches to shed further light on how the brain processes and stores information.

Learning the condition of satisfaction of an elementary behavior in dynamic field theory

OpenAIRE

Luciw, M; Kazerounian, S; Lahkman, K; Richter, M; Sandamirskaya, Y

2015-01-01

In order to proceed along an action sequence, an autonomous agent has to recognize that the intended final condition of the previous action has been achieved. In previous work, we have shown how a sequence of actions can be generated by an embodied agent using a neural-dynamic architecture for behavioral organization, in which each action has an intention and condition of satisfaction. These components are represented by dynamic neural fields, and are coupled to motors...

Gamma Oscillations and Neural Field DCMs Can Reveal Cortical Excitability and Microstructure

Directory of Open Access Journals (Sweden)

Dimitris Pinotsis

2014-05-01

Full Text Available This paper shows how gamma oscillations can be combined with neural population models and dynamic causal modeling (DCM to distinguish among alternative hypotheses regarding cortical excitability and microstructure. This approach exploits inter-subject variability and trial-specific effects associated with modulations in the peak frequency of gamma oscillations. Neural field models are used to evaluate model evidence and obtain parameter estimates using invasive and non-invasive gamma recordings. Our overview comprises two parts: in the first part, we use neural fields to simulate neural activity and distinguish the effects of post synaptic filtering on predicted responses in terms of synaptic rate constants that correspond to different timescales and distinct neurotransmitters. We focus on model predictions of conductance and convolution based field models and show that these can yield spectral responses that are sensitive to biophysical properties of local cortical circuits like synaptic kinetics and filtering; we also consider two different mechanisms for this filtering: a nonlinear mechanism involving specific conductances and a linear convolution of afferent firing rates producing post synaptic potentials. In the second part of this paper, we use neural fields quantitatively—to fit empirical data recorded during visual stimulation. We present two studies of spectral responses obtained from the visual cortex during visual perception experiments: in the first study, MEG data were acquired during a task designed to show how activity in the gamma band is related to visual perception, while in the second study, we exploited high density electrocorticographic (ECoG data to study the effect of varying stimulus contrast on cortical excitability and gamma peak frequency.

Semi-empirical neural network models of controlled dynamical systems

Directory of Open Access Journals (Sweden)

Mihail V. Egorchev

2017-12-01

Full Text Available A simulation approach is discussed for maneuverable aircraft motion as nonlinear controlled dynamical system under multiple and diverse uncertainties including knowledge imperfection concerning simulated plant and its environment exposure. The suggested approach is based on a merging of theoretical knowledge for the plant with training tools of artificial neural network field. The efficiency of this approach is demonstrated using the example of motion modeling and the identification of the aerodynamic characteristics of a maneuverable aircraft. A semi-empirical recurrent neural network based model learning algorithm is proposed for multi-step ahead prediction problem. This algorithm sequentially states and solves numerical optimization subproblems of increasing complexity, using each solution as initial guess for subsequent subproblem. We also consider a procedure for representative training set acquisition that utilizes multisine control signals.

Shaping the learning curve: epigenetic dynamics in neural plasticity

Directory of Open Access Journals (Sweden)

Zohar Ziv Bronfman

2014-07-01

Full Text Available A key characteristic of learning and neural plasticity is state-dependent acquisition dynamics reflected by the non-linear learning curve that links increase in learning with practice. Here we propose that the manner by which epigenetic states of individual cells change during learning contributes to the shape of the neural and behavioral learning curve. We base our suggestion on recent studies showing that epigenetic mechanisms such as DNA methylation, histone acetylation and RNA-mediated gene regulation are intimately involved in the establishment and maintenance of long-term neural plasticity, reflecting specific learning-histories and influencing future learning. Our model, which is the first to suggest a dynamic molecular account of the shape of the learning curve, leads to several testable predictions regarding the link between epigenetic dynamics at the promoter, gene-network and neural-network levels. This perspective opens up new avenues for therapeutic interventions in neurological pathologies.

Collaborative Recurrent Neural Networks forDynamic Recommender Systems

Science.gov (United States)

2016-11-22

JMLR: Workshop and Conference Proceedings 63:366–381, 2016 ACML 2016 Collaborative Recurrent Neural Networks for Dynamic Recommender Systems Young...an unprece- dented scale. Although such activity logs are abundantly available, most approaches to recommender systems are based on the rating...Recurrent Neural Network, Recommender System , Neural Language Model, Collaborative Filtering 1. Introduction As ever larger parts of the population

An introduction to neural networks surgery, a field of neuromodulation which is based on advances in neural networks science and digitised brain imaging.

Science.gov (United States)

Sakas, D E; Panourias, I G; Simpson, B A

2007-01-01

Operative Neuromodulation is the field of altering electrically or chemically the signal transmission in the nervous system by implanted devices in order to excite, inhibit or tune the activities of neurons or neural networks and produce therapeutic effects. The present article reviews relevant literature on procedures or devices applied either in contact with the cerebral cortex or cranial nerves or in deep sites inside the brain in order to treat various refractory neurological conditions such as: a) chronic pain (facial, somatic, deafferentation, phantom limb), b) movement disorders (Parkinson's disease, dystonia, Tourette syndrome), c) epilepsy, d) psychiatric disease, e) hearing deficits, and f) visual loss. These data indicate that in operative neuromodulation, a new field emerges that is based on neural networks research and on advances in digitised stereometric brain imaging which allow precise localisation of cerebral neural networks and their relay stations; this field can be described as Neural networks surgery because it aims to act extrinsically or intrinsically on neural networks and to alter therapeutically the neural signal transmission with the use of implantable electrical or electronic devices. The authors also review neurotechnology literature relevant to neuroengineering, nanotechnologies, brain computer interfaces, hybrid cultured probes, neuromimetics, neuroinformatics, neurocomputation, and computational neuromodulation; the latter field is dedicated to the study of the biophysical and mathematical characteristics of electrochemical neuromodulation. The article also brings forward particularly interesting lines of research such as the carbon nanofibers electrode arrays for simultaneous electrochemical recording and stimulation, closed-loop systems for responsive neuromodulation, and the intracortical electrodes for restoring hearing or vision. The present review of cerebral neuromodulatory procedures highlights the transition from the

Wide-field optical mapping of neural activity and brain haemodynamics: considerations and novel approaches

Science.gov (United States)

Ma, Ying; Shaik, Mohammed A.; Kozberg, Mariel G.; Thibodeaux, David N.; Zhao, Hanzhi T.; Yu, Hang

2016-01-01

Although modern techniques such as two-photon microscopy can now provide cellular-level three-dimensional imaging of the intact living brain, the speed and fields of view of these techniques remain limited. Conversely, two-dimensional wide-field optical mapping (WFOM), a simpler technique that uses a camera to observe large areas of the exposed cortex under visible light, can detect changes in both neural activity and haemodynamics at very high speeds. Although WFOM may not provide single-neuron or capillary-level resolution, it is an attractive and accessible approach to imaging large areas of the brain in awake, behaving mammals at speeds fast enough to observe widespread neural firing events, as well as their dynamic coupling to haemodynamics. Although such wide-field optical imaging techniques have a long history, the advent of genetically encoded fluorophores that can report neural activity with high sensitivity, as well as modern technologies such as light emitting diodes and sensitive and high-speed digital cameras have driven renewed interest in WFOM. To facilitate the wider adoption and standardization of WFOM approaches for neuroscience and neurovascular coupling research, we provide here an overview of the basic principles of WFOM, considerations for implementation of wide-field fluorescence imaging of neural activity, spectroscopic analysis and interpretation of results. This article is part of the themed issue ‘Interpreting BOLD: a dialogue between cognitive and cellular neuroscience’. PMID:27574312

Wide-field optical mapping of neural activity and brain haemodynamics: considerations and novel approaches.

Science.gov (United States)

Ma, Ying; Shaik, Mohammed A; Kim, Sharon H; Kozberg, Mariel G; Thibodeaux, David N; Zhao, Hanzhi T; Yu, Hang; Hillman, Elizabeth M C

2016-10-05

Although modern techniques such as two-photon microscopy can now provide cellular-level three-dimensional imaging of the intact living brain, the speed and fields of view of these techniques remain limited. Conversely, two-dimensional wide-field optical mapping (WFOM), a simpler technique that uses a camera to observe large areas of the exposed cortex under visible light, can detect changes in both neural activity and haemodynamics at very high speeds. Although WFOM may not provide single-neuron or capillary-level resolution, it is an attractive and accessible approach to imaging large areas of the brain in awake, behaving mammals at speeds fast enough to observe widespread neural firing events, as well as their dynamic coupling to haemodynamics. Although such wide-field optical imaging techniques have a long history, the advent of genetically encoded fluorophores that can report neural activity with high sensitivity, as well as modern technologies such as light emitting diodes and sensitive and high-speed digital cameras have driven renewed interest in WFOM. To facilitate the wider adoption and standardization of WFOM approaches for neuroscience and neurovascular coupling research, we provide here an overview of the basic principles of WFOM, considerations for implementation of wide-field fluorescence imaging of neural activity, spectroscopic analysis and interpretation of results.This article is part of the themed issue 'Interpreting BOLD: a dialogue between cognitive and cellular neuroscience'. © 2016 The Authors.

Identification of Complex Dynamical Systems with Neural Networks (2/2)

CERN Multimedia

CERN. Geneva

2016-01-01

The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...

Identification of Complex Dynamical Systems with Neural Networks (1/2)

CERN Multimedia

CERN. Geneva

2016-01-01

The identification and analysis of high dimensional nonlinear systems is obviously a challenging task. Neural networks have been proven to be universal approximators but this still leaves the identification task a hard one. To do it efficiently, we have to violate some of the rules of classical regression theory. Furthermore we should focus on the interpretation of the resulting model to overcome its black box character. First, we will discuss function approximation with 3 layer feedforward neural networks up to new developments in deep neural networks and deep learning. These nets are not only of interest in connection with image analysis but are a center point of the current artificial intelligence developments. Second, we will focus on the analysis of complex dynamical system in the form of state space models realized as recurrent neural networks. After the introduction of small open dynamical systems we will study dynamical systems on manifolds. Here manifold and dynamics have to be identified in parall...

Neural Computations in a Dynamical System with Multiple Time Scales.

Science.gov (United States)

Mi, Yuanyuan; Lin, Xiaohan; Wu, Si

2016-01-01

Neural systems display rich short-term dynamics at various levels, e.g., spike-frequency adaptation (SFA) at the single-neuron level, and short-term facilitation (STF) and depression (STD) at the synapse level. These dynamical features typically cover a broad range of time scales and exhibit large diversity in different brain regions. It remains unclear what is the computational benefit for the brain to have such variability in short-term dynamics. In this study, we propose that the brain can exploit such dynamical features to implement multiple seemingly contradictory computations in a single neural circuit. To demonstrate this idea, we use continuous attractor neural network (CANN) as a working model and include STF, SFA and STD with increasing time constants in its dynamics. Three computational tasks are considered, which are persistent activity, adaptation, and anticipative tracking. These tasks require conflicting neural mechanisms, and hence cannot be implemented by a single dynamical feature or any combination with similar time constants. However, with properly coordinated STF, SFA and STD, we show that the network is able to implement the three computational tasks concurrently. We hope this study will shed light on the understanding of how the brain orchestrates its rich dynamics at various levels to realize diverse cognitive functions.

Neural dynamics in reconfigurable silicon.

Science.gov (United States)

Basu, A; Ramakrishnan, S; Petre, C; Koziol, S; Brink, S; Hasler, P E

2010-10-01

A neuromorphic analog chip is presented that is capable of implementing massively parallel neural computations while retaining the programmability of digital systems. We show measurements from neurons with Hopf bifurcations and integrate and fire neurons, excitatory and inhibitory synapses, passive dendrite cables, coupled spiking neurons, and central pattern generators implemented on the chip. This chip provides a platform for not only simulating detailed neuron dynamics but also uses the same to interface with actual cells in applications such as a dynamic clamp. There are 28 computational analog blocks (CAB), each consisting of ion channels with tunable parameters, synapses, winner-take-all elements, current sources, transconductance amplifiers, and capacitors. There are four other CABs which have programmable bias generators. The programmability is achieved using floating gate transistors with on-chip programming control. The switch matrix for interconnecting the components in CABs also consists of floating-gate transistors. Emphasis is placed on replicating the detailed dynamics of computational neural models. Massive computational area efficiency is obtained by using the reconfigurable interconnect as synaptic weights, resulting in more than 50 000 possible 9-b accurate synapses in 9 mm(2).

Neural Population Dynamics during Reaching Are Better Explained by a Dynamical System than Representational Tuning.

Science.gov (United States)

Michaels, Jonathan A; Dann, Benjamin; Scherberger, Hansjörg

2016-11-01

Recent models of movement generation in motor cortex have sought to explain neural activity not as a function of movement parameters, known as representational models, but as a dynamical system acting at the level of the population. Despite evidence supporting this framework, the evaluation of representational models and their integration with dynamical systems is incomplete in the literature. Using a representational velocity-tuning based simulation of center-out reaching, we show that incorporating variable latency offsets between neural activity and kinematics is sufficient to generate rotational dynamics at the level of neural populations, a phenomenon observed in motor cortex. However, we developed a covariance-matched permutation test (CMPT) that reassigns neural data between task conditions independently for each neuron while maintaining overall neuron-to-neuron relationships, revealing that rotations based on the representational model did not uniquely depend on the underlying condition structure. In contrast, rotations based on either a dynamical model or motor cortex data depend on this relationship, providing evidence that the dynamical model more readily explains motor cortex activity. Importantly, implementing a recurrent neural network we demonstrate that both representational tuning properties and rotational dynamics emerge, providing evidence that a dynamical system can reproduce previous findings of representational tuning. Finally, using motor cortex data in combination with the CMPT, we show that results based on small numbers of neurons or conditions should be interpreted cautiously, potentially informing future experimental design. Together, our findings reinforce the view that representational models lack the explanatory power to describe complex aspects of single neuron and population level activity.

Efficient Neural Network Modeling for Flight and Space Dynamics Simulation

Directory of Open Access Journals (Sweden)

Ayman Hamdy Kassem

2011-01-01

Full Text Available This paper represents an efficient technique for neural network modeling of flight and space dynamics simulation. The technique will free the neural network designer from guessing the size and structure for the required neural network model and will help to minimize the number of neurons. For linear flight/space dynamics systems, the technique can find the network weights and biases directly by solving a system of linear equations without the need for training. Nonlinear flight dynamic systems can be easily modeled by training its linearized models keeping the same network structure. The training is fast, as it uses the linear system knowledge to speed up the training process. The technique is tested on different flight/space dynamic models and showed promising results.

Two-photon imaging and analysis of neural network dynamics

International Nuclear Information System (INIS)

Luetcke, Henry; Helmchen, Fritjof

2011-01-01

The glow of a starry night sky, the smell of a freshly brewed cup of coffee or the sound of ocean waves breaking on the beach are representations of the physical world that have been created by the dynamic interactions of thousands of neurons in our brains. How the brain mediates perceptions, creates thoughts, stores memories and initiates actions remains one of the most profound puzzles in biology, if not all of science. A key to a mechanistic understanding of how the nervous system works is the ability to measure and analyze the dynamics of neuronal networks in the living organism in the context of sensory stimulation and behavior. Dynamic brain properties have been fairly well characterized on the microscopic level of individual neurons and on the macroscopic level of whole brain areas largely with the help of various electrophysiological techniques. However, our understanding of the mesoscopic level comprising local populations of hundreds to thousands of neurons (so-called 'microcircuits') remains comparably poor. Predominantly, this has been due to the technical difficulties involved in recording from large networks of neurons with single-cell spatial resolution and near-millisecond temporal resolution in the brain of living animals. In recent years, two-photon microscopy has emerged as a technique which meets many of these requirements and thus has become the method of choice for the interrogation of local neural circuits. Here, we review the state-of-research in the field of two-photon imaging of neuronal populations, covering the topics of microscope technology, suitable fluorescent indicator dyes, staining techniques, and in particular analysis techniques for extracting relevant information from the fluorescence data. We expect that functional analysis of neural networks using two-photon imaging will help to decipher fundamental operational principles of neural microcircuits.

Two-photon imaging and analysis of neural network dynamics

Science.gov (United States)

Lütcke, Henry; Helmchen, Fritjof

2011-08-01

The glow of a starry night sky, the smell of a freshly brewed cup of coffee or the sound of ocean waves breaking on the beach are representations of the physical world that have been created by the dynamic interactions of thousands of neurons in our brains. How the brain mediates perceptions, creates thoughts, stores memories and initiates actions remains one of the most profound puzzles in biology, if not all of science. A key to a mechanistic understanding of how the nervous system works is the ability to measure and analyze the dynamics of neuronal networks in the living organism in the context of sensory stimulation and behavior. Dynamic brain properties have been fairly well characterized on the microscopic level of individual neurons and on the macroscopic level of whole brain areas largely with the help of various electrophysiological techniques. However, our understanding of the mesoscopic level comprising local populations of hundreds to thousands of neurons (so-called 'microcircuits') remains comparably poor. Predominantly, this has been due to the technical difficulties involved in recording from large networks of neurons with single-cell spatial resolution and near-millisecond temporal resolution in the brain of living animals. In recent years, two-photon microscopy has emerged as a technique which meets many of these requirements and thus has become the method of choice for the interrogation of local neural circuits. Here, we review the state-of-research in the field of two-photon imaging of neuronal populations, covering the topics of microscope technology, suitable fluorescent indicator dyes, staining techniques, and in particular analysis techniques for extracting relevant information from the fluorescence data. We expect that functional analysis of neural networks using two-photon imaging will help to decipher fundamental operational principles of neural microcircuits.

Two-photon imaging and analysis of neural network dynamics

Energy Technology Data Exchange (ETDEWEB)

Luetcke, Henry; Helmchen, Fritjof [Brain Research Institute, University of Zurich, Winterthurerstrasse 190, CH-8057 Zurich (Switzerland)

2011-08-15

The glow of a starry night sky, the smell of a freshly brewed cup of coffee or the sound of ocean waves breaking on the beach are representations of the physical world that have been created by the dynamic interactions of thousands of neurons in our brains. How the brain mediates perceptions, creates thoughts, stores memories and initiates actions remains one of the most profound puzzles in biology, if not all of science. A key to a mechanistic understanding of how the nervous system works is the ability to measure and analyze the dynamics of neuronal networks in the living organism in the context of sensory stimulation and behavior. Dynamic brain properties have been fairly well characterized on the microscopic level of individual neurons and on the macroscopic level of whole brain areas largely with the help of various electrophysiological techniques. However, our understanding of the mesoscopic level comprising local populations of hundreds to thousands of neurons (so-called 'microcircuits') remains comparably poor. Predominantly, this has been due to the technical difficulties involved in recording from large networks of neurons with single-cell spatial resolution and near-millisecond temporal resolution in the brain of living animals. In recent years, two-photon microscopy has emerged as a technique which meets many of these requirements and thus has become the method of choice for the interrogation of local neural circuits. Here, we review the state-of-research in the field of two-photon imaging of neuronal populations, covering the topics of microscope technology, suitable fluorescent indicator dyes, staining techniques, and in particular analysis techniques for extracting relevant information from the fluorescence data. We expect that functional analysis of neural networks using two-photon imaging will help to decipher fundamental operational principles of neural microcircuits.

Convergent dynamics for multistable delayed neural networks

International Nuclear Information System (INIS)

Shih, Chih-Wen; Tseng, Jui-Pin

2008-01-01

This investigation aims at developing a methodology to establish convergence of dynamics for delayed neural network systems with multiple stable equilibria. The present approach is general and can be applied to several network models. We take the Hopfield-type neural networks with both instantaneous and delayed feedbacks to illustrate the idea. We shall construct the complete dynamical scenario which comprises exactly 2 n stable equilibria and exactly (3 n − 2 n ) unstable equilibria for the n-neuron network. In addition, it is shown that every solution of the system converges to one of the equilibria as time tends to infinity. The approach is based on employing the geometrical structure of the network system. Positively invariant sets and componentwise dynamical properties are derived under the geometrical configuration. An iteration scheme is subsequently designed to confirm the convergence of dynamics for the system. Two examples with numerical simulations are arranged to illustrate the present theory

Neural Network Based Real-time Correction of Transducer Dynamic Errors

Science.gov (United States)

Roj, J.

2013-12-01

In order to carry out real-time dynamic error correction of transducers described by a linear differential equation, a novel recurrent neural network was developed. The network structure is based on solving this equation with respect to the input quantity when using the state variables. It is shown that such a real-time correction can be carried out using simple linear perceptrons. Due to the use of a neural technique, knowledge of the dynamic parameters of the transducer is not necessary. Theoretical considerations are illustrated by the results of simulation studies performed for the modeled second order transducer. The most important properties of the neural dynamic error correction, when emphasizing the fundamental advantages and disadvantages, are discussed.

Can Neural Activity Propagate by Endogenous Electrical Field?

Science.gov (United States)

Qiu, Chen; Shivacharan, Rajat S.; Zhang, Mingming

2015-01-01

It is widely accepted that synaptic transmissions and gap junctions are the major governing mechanisms for signal traveling in the neural system. Yet, a group of neural waves, either physiological or pathological, share the same speed of ∼0.1 m/s without synaptic transmission or gap junctions, and this speed is not consistent with axonal conduction or ionic diffusion. The only explanation left is an electrical field effect. We tested the hypothesis that endogenous electric fields are sufficient to explain the propagation with in silico and in vitro experiments. Simulation results show that field effects alone can indeed mediate propagation across layers of neurons with speeds of 0.12 ± 0.09 m/s with pathological kinetics, and 0.11 ± 0.03 m/s with physiologic kinetics, both generating weak field amplitudes of ∼2–6 mV/mm. Further, the model predicted that propagation speed values are inversely proportional to the cell-to-cell distances, but do not significantly change with extracellular resistivity, membrane capacitance, or membrane resistance. In vitro recordings in mice hippocampi produced similar speeds (0.10 ± 0.03 m/s) and field amplitudes (2.5–5 mV/mm), and by applying a blocking field, the propagation speed was greatly reduced. Finally, osmolarity experiments confirmed the model's prediction that cell-to-cell distance inversely affects propagation speed. Together, these results show that despite their weak amplitude, electric fields can be solely responsible for spike propagation at ∼0.1 m/s. This phenomenon could be important to explain the slow propagation of epileptic activity and other normal propagations at similar speeds. SIGNIFICANCE STATEMENT Neural activity (waves or spikes) can propagate using well documented mechanisms such as synaptic transmission, gap junctions, or diffusion. However, the purpose of this paper is to provide an explanation for experimental data showing that neural signals can propagate by means other than synaptic

Neural attractor network for application in visual field data classification

International Nuclear Information System (INIS)

Fink, Wolfgang

2004-01-01

The purpose was to introduce a novel method for computer-based classification of visual field data derived from perimetric examination, that may act as a ' counsellor', providing an independent 'second opinion' to the diagnosing physician. The classification system consists of a Hopfield-type neural attractor network that obtains its input data from perimetric examination results. An iterative relaxation process determines the states of the neurons dynamically. Therefore, even 'noisy' perimetric output, e.g., early stages of a disease, may eventually be classified correctly according to the predefined idealized visual field defect (scotoma) patterns, stored as attractors of the network, that are found with diseases of the eye, optic nerve and the central nervous system. Preliminary tests of the classification system on real visual field data derived from perimetric examinations have shown a classification success of over 80%. Some of the main advantages of the Hopfield-attractor-network-based approach over feed-forward type neural networks are: (1) network architecture is defined by the classification problem; (2) no training is required to determine the neural coupling strengths; (3) assignment of an auto-diagnosis confidence level is possible by means of an overlap parameter and the Hamming distance. In conclusion, the novel method for computer-based classification of visual field data, presented here, furnishes a valuable first overview and an independent 'second opinion' in judging perimetric examination results, pointing towards a final diagnosis by a physician. It should not be considered a substitute for the diagnosing physician. Thanks to the worldwide accessibility of the Internet, the classification system offers a promising perspective towards modern computer-assisted diagnosis in both medicine and tele-medicine, for example and in particular, with respect to non-ophthalmic clinics or in communities where perimetric expertise is not readily available

Discriminating lysosomal membrane protein types using dynamic neural network.

Science.gov (United States)

Tripathi, Vijay; Gupta, Dwijendra Kumar

2014-01-01

This work presents a dynamic artificial neural network methodology, which classifies the proteins into their classes from their sequences alone: the lysosomal membrane protein classes and the various other membranes protein classes. In this paper, neural networks-based lysosomal-associated membrane protein type prediction system is proposed. Different protein sequence representations are fused to extract the features of a protein sequence, which includes seven feature sets; amino acid (AA) composition, sequence length, hydrophobic group, electronic group, sum of hydrophobicity, R-group, and dipeptide composition. To reduce the dimensionality of the large feature vector, we applied the principal component analysis. The probabilistic neural network, generalized regression neural network, and Elman regression neural network (RNN) are used as classifiers and compared with layer recurrent network (LRN), a dynamic network. The dynamic networks have memory, i.e. its output depends not only on the input but the previous outputs also. Thus, the accuracy of LRN classifier among all other artificial neural networks comes out to be the highest. The overall accuracy of jackknife cross-validation is 93.2% for the data-set. These predicted results suggest that the method can be effectively applied to discriminate lysosomal associated membrane proteins from other membrane proteins (Type-I, Outer membrane proteins, GPI-Anchored) and Globular proteins, and it also indicates that the protein sequence representation can better reflect the core feature of membrane proteins than the classical AA composition.

A stochastic-field description of finite-size spiking neural networks.

Science.gov (United States)

Dumont, Grégory; Payeur, Alexandre; Longtin, André

2017-08-01

Neural network dynamics are governed by the interaction of spiking neurons. Stochastic aspects of single-neuron dynamics propagate up to the network level and shape the dynamical and informational properties of the population. Mean-field models of population activity disregard the finite-size stochastic fluctuations of network dynamics and thus offer a deterministic description of the system. Here, we derive a stochastic partial differential equation (SPDE) describing the temporal evolution of the finite-size refractory density, which represents the proportion of neurons in a given refractory state at any given time. The population activity-the density of active neurons per unit time-is easily extracted from this refractory density. The SPDE includes finite-size effects through a two-dimensional Gaussian white noise that acts both in time and along the refractory dimension. For an infinite number of neurons the standard mean-field theory is recovered. A discretization of the SPDE along its characteristic curves allows direct simulations of the activity of large but finite spiking networks; this constitutes the main advantage of our approach. Linearizing the SPDE with respect to the deterministic asynchronous state allows the theoretical investigation of finite-size activity fluctuations. In particular, analytical expressions for the power spectrum and autocorrelation of activity fluctuations are obtained. Moreover, our approach can be adapted to incorporate multiple interacting populations and quasi-renewal single-neuron dynamics.

Neural Based Orthogonal Data Fitting The EXIN Neural Networks

CERN Document Server

Cirrincione, Giansalvo

2008-01-01

Written by three leaders in the field of neural based algorithms, Neural Based Orthogonal Data Fitting proposes several neural networks, all endowed with a complete theory which not only explains their behavior, but also compares them with the existing neural and traditional algorithms. The algorithms are studied from different points of view, including: as a differential geometry problem, as a dynamic problem, as a stochastic problem, and as a numerical problem. All algorithms have also been analyzed on real time problems (large dimensional data matrices) and have shown accurate solutions. Wh

Integration of Continuous-Time Dynamics in a Spiking Neural Network Simulator

Directory of Open Access Journals (Sweden)

Jan Hahne

2017-05-01

Full Text Available Contemporary modeling approaches to the dynamics of neural networks include two important classes of models: biologically grounded spiking neuron models and functionally inspired rate-based units. We present a unified simulation framework that supports the combination of the two for multi-scale modeling, enables the quantitative validation of mean-field approaches by spiking network simulations, and provides an increase in reliability by usage of the same simulation code and the same network model specifications for both model classes. While most spiking simulations rely on the communication of discrete events, rate models require time-continuous interactions between neurons. Exploiting the conceptual similarity to the inclusion of gap junctions in spiking network simulations, we arrive at a reference implementation of instantaneous and delayed interactions between rate-based models in a spiking network simulator. The separation of rate dynamics from the general connection and communication infrastructure ensures flexibility of the framework. In addition to the standard implementation we present an iterative approach based on waveform-relaxation techniques to reduce communication and increase performance for large-scale simulations of rate-based models with instantaneous interactions. Finally we demonstrate the broad applicability of the framework by considering various examples from the literature, ranging from random networks to neural-field models. The study provides the prerequisite for interactions between rate-based and spiking models in a joint simulation.

Integration of Continuous-Time Dynamics in a Spiking Neural Network Simulator.

Science.gov (United States)

Hahne, Jan; Dahmen, David; Schuecker, Jannis; Frommer, Andreas; Bolten, Matthias; Helias, Moritz; Diesmann, Markus

2017-01-01

Contemporary modeling approaches to the dynamics of neural networks include two important classes of models: biologically grounded spiking neuron models and functionally inspired rate-based units. We present a unified simulation framework that supports the combination of the two for multi-scale modeling, enables the quantitative validation of mean-field approaches by spiking network simulations, and provides an increase in reliability by usage of the same simulation code and the same network model specifications for both model classes. While most spiking simulations rely on the communication of discrete events, rate models require time-continuous interactions between neurons. Exploiting the conceptual similarity to the inclusion of gap junctions in spiking network simulations, we arrive at a reference implementation of instantaneous and delayed interactions between rate-based models in a spiking network simulator. The separation of rate dynamics from the general connection and communication infrastructure ensures flexibility of the framework. In addition to the standard implementation we present an iterative approach based on waveform-relaxation techniques to reduce communication and increase performance for large-scale simulations of rate-based models with instantaneous interactions. Finally we demonstrate the broad applicability of the framework by considering various examples from the literature, ranging from random networks to neural-field models. The study provides the prerequisite for interactions between rate-based and spiking models in a joint simulation.

Sensorimotor learning biases choice behavior: a learning neural field model for decision making.

Directory of Open Access Journals (Sweden)

Christian Klaes

Full Text Available According to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action choices which are based on ambiguous sensory input, the frontoparietal sensorimotor areas are considered part of the common underlying neural substrate for selection and specification of action. These areas have been shown capable of encoding alternative spatial motor goals in parallel during movement planning, and show signatures of competitive value-based selection among these goals. Since the same network is also involved in learning sensorimotor associations, competitive action selection (decision making should not only be driven by the sensory evidence and expected reward in favor of either action, but also by the subject's learning history of different sensorimotor associations. Previous computational models of competitive neural decision making used predefined associations between sensory input and corresponding motor output. Such hard-wiring does not allow modeling of how decisions are influenced by sensorimotor learning or by changing reward contingencies. We present a dynamic neural field model which learns arbitrary sensorimotor associations with a reward-driven Hebbian learning algorithm. We show that the model accurately simulates the dynamics of action selection with different reward contingencies, as observed in monkey cortical recordings, and that it correctly predicted the pattern of choice errors in a control experiment. With our adaptive model we demonstrate how network plasticity, which is required for association learning and adaptation to new reward contingencies, can influence choice behavior. The field model provides an integrated and dynamic account for the operations of sensorimotor integration, working memory and action

Neural Computations in a Dynamical System with Multiple Time Scales

Directory of Open Access Journals (Sweden)

Yuanyuan Mi

2016-09-01

Full Text Available Neural systems display rich short-term dynamics at various levels, e.g., spike-frequencyadaptation (SFA at single neurons, and short-term facilitation (STF and depression (STDat neuronal synapses. These dynamical features typically covers a broad range of time scalesand exhibit large diversity in different brain regions. It remains unclear what the computationalbenefit for the brain to have such variability in short-term dynamics is. In this study, we proposethat the brain can exploit such dynamical features to implement multiple seemingly contradictorycomputations in a single neural circuit. To demonstrate this idea, we use continuous attractorneural network (CANN as a working model and include STF, SFA and STD with increasing timeconstants in their dynamics. Three computational tasks are considered, which are persistent activity,adaptation, and anticipative tracking. These tasks require conflicting neural mechanisms, andhence cannot be implemented by a single dynamical feature or any combination with similar timeconstants. However, with properly coordinated STF, SFA and STD, we show that the network isable to implement the three computational tasks concurrently. We hope this study will shed lighton the understanding of how the brain orchestrates its rich dynamics at various levels to realizediverse cognitive functions.

Rich spectrum of neural field dynamics in the presence of short-term synaptic depression

Science.gov (United States)

Wang, He; Lam, Kin; Fung, C. C. Alan; Wong, K. Y. Michael; Wu, Si

2015-09-01

In continuous attractor neural networks (CANNs), spatially continuous information such as orientation, head direction, and spatial location is represented by Gaussian-like tuning curves that can be displaced continuously in the space of the preferred stimuli of the neurons. We investigate how short-term synaptic depression (STD) can reshape the intrinsic dynamics of the CANN model and its responses to a single static input. In particular, CANNs with STD can support various complex firing patterns and chaotic behaviors. These chaotic behaviors have the potential to encode various stimuli in the neuronal system.

Oscillatory phase dynamics in neural entrainment underpin illusory percepts of time.

Science.gov (United States)

Herrmann, Björn; Henry, Molly J; Grigutsch, Maren; Obleser, Jonas

2013-10-02

Neural oscillatory dynamics are a candidate mechanism to steer perception of time and temporal rate change. While oscillator models of time perception are strongly supported by behavioral evidence, a direct link to neural oscillations and oscillatory entrainment has not yet been provided. In addition, it has thus far remained unaddressed how context-induced illusory percepts of time are coded for in oscillator models of time perception. To investigate these questions, we used magnetoencephalography and examined the neural oscillatory dynamics that underpin pitch-induced illusory percepts of temporal rate change. Human participants listened to frequency-modulated sounds that varied over time in both modulation rate and pitch, and judged the direction of rate change (decrease vs increase). Our results demonstrate distinct neural mechanisms of rate perception: Modulation rate changes directly affected listeners' rate percept as well as the exact frequency of the neural oscillation. However, pitch-induced illusory rate changes were unrelated to the exact frequency of the neural responses. The rate change illusion was instead linked to changes in neural phase patterns, which allowed for single-trial decoding of percepts. That is, illusory underestimations or overestimations of perceived rate change were tightly coupled to increased intertrial phase coherence and changes in cerebro-acoustic phase lag. The results provide insight on how illusory percepts of time are coded for by neural oscillatory dynamics.

Dynamics of a neural system with a multiscale architecture

Science.gov (United States)

Breakspear, Michael; Stam, Cornelis J

2005-01-01

The architecture of the brain is characterized by a modular organization repeated across a hierarchy of spatial scales—neurons, minicolumns, cortical columns, functional brain regions, and so on. It is important to consider that the processes governing neural dynamics at any given scale are not only determined by the behaviour of other neural structures at that scale, but also by the emergent behaviour of smaller scales, and the constraining influence of activity at larger scales. In this paper, we introduce a theoretical framework for neural systems in which the dynamics are nested within a multiscale architecture. In essence, the dynamics at each scale are determined by a coupled ensemble of nonlinear oscillators, which embody the principle scale-specific neurobiological processes. The dynamics at larger scales are ‘slaved’ to the emergent behaviour of smaller scales through a coupling function that depends on a multiscale wavelet decomposition. The approach is first explicated mathematically. Numerical examples are then given to illustrate phenomena such as between-scale bifurcations, and how synchronization in small-scale structures influences the dynamics in larger structures in an intuitive manner that cannot be captured by existing modelling approaches. A framework for relating the dynamical behaviour of the system to measured observables is presented and further extensions to capture wave phenomena and mode coupling are suggested. PMID:16087448

Fluctuation-Driven Neural Dynamics Reproduce Drosophila Locomotor Patterns.

Directory of Open Access Journals (Sweden)

Andrea Maesani

2015-11-01

Full Text Available The neural mechanisms determining the timing of even simple actions, such as when to walk or rest, are largely mysterious. One intriguing, but untested, hypothesis posits a role for ongoing activity fluctuations in neurons of central action selection circuits that drive animal behavior from moment to moment. To examine how fluctuating activity can contribute to action timing, we paired high-resolution measurements of freely walking Drosophila melanogaster with data-driven neural network modeling and dynamical systems analysis. We generated fluctuation-driven network models whose outputs-locomotor bouts-matched those measured from sensory-deprived Drosophila. From these models, we identified those that could also reproduce a second, unrelated dataset: the complex time-course of odor-evoked walking for genetically diverse Drosophila strains. Dynamical models that best reproduced both Drosophila basal and odor-evoked locomotor patterns exhibited specific characteristics. First, ongoing fluctuations were required. In a stochastic resonance-like manner, these fluctuations allowed neural activity to escape stable equilibria and to exceed a threshold for locomotion. Second, odor-induced shifts of equilibria in these models caused a depression in locomotor frequency following olfactory stimulation. Our models predict that activity fluctuations in action selection circuits cause behavioral output to more closely match sensory drive and may therefore enhance navigation in complex sensory environments. Together these data reveal how simple neural dynamics, when coupled with activity fluctuations, can give rise to complex patterns of animal behavior.

Reconstruction of coupling architecture of neural field networks from vector time series

Science.gov (United States)

Sysoev, Ilya V.; Ponomarenko, Vladimir I.; Pikovsky, Arkady

2018-04-01

We propose a method of reconstruction of the network coupling matrix for a basic voltage-model of the neural field dynamics. Assuming that the multivariate time series of observations from all nodes are available, we describe a technique to find coupling constants which is unbiased in the limit of long observations. Furthermore, the method is generalized for reconstruction of networks with time-delayed coupling, including the reconstruction of unknown time delays. The approach is compared with other recently proposed techniques.

Biophysical Neural Spiking, Bursting, and Excitability Dynamics in Reconfigurable Analog VLSI.

Science.gov (United States)

Yu, T; Sejnowski, T J; Cauwenberghs, G

2011-10-01

We study a range of neural dynamics under variations in biophysical parameters underlying extended Morris-Lecar and Hodgkin-Huxley models in three gating variables. The extended models are implemented in NeuroDyn, a four neuron, twelve synapse continuous-time analog VLSI programmable neural emulation platform with generalized channel kinetics and biophysical membrane dynamics. The dynamics exhibit a wide range of time scales extending beyond 100 ms neglected in typical silicon models of tonic spiking neurons. Circuit simulations and measurements show transition from tonic spiking to tonic bursting dynamics through variation of a single conductance parameter governing calcium recovery. We similarly demonstrate transition from graded to all-or-none neural excitability in the onset of spiking dynamics through the variation of channel kinetic parameters governing the speed of potassium activation. Other combinations of variations in conductance and channel kinetic parameters give rise to phasic spiking and spike frequency adaptation dynamics. The NeuroDyn chip consumes 1.29 mW and occupies 3 mm × 3 mm in 0.5 μm CMOS, supporting emerging developments in neuromorphic silicon-neuron interfaces.

Front Propagation in Stochastic Neural Fields

KAUST Repository

Bressloff, Paul C.; Webber, Matthew A.

2012-01-01

We analyze the effects of extrinsic multiplicative noise on front propagation in a scalar neural field with excitatory connections. Using a separation of time scales, we represent the fluctuating front in terms of a diffusive-like displacement

Optimal path-finding through mental exploration based on neural energy field gradients.

Science.gov (United States)

Wang, Yihong; Wang, Rubin; Zhu, Yating

2017-02-01

Rodent animal can accomplish self-locating and path-finding task by forming a cognitive map in the hippocampus representing the environment. In the classical model of the cognitive map, the system (artificial animal) needs large amounts of physical exploration to study spatial environment to solve path-finding problems, which costs too much time and energy. Although Hopfield's mental exploration model makes up for the deficiency mentioned above, the path is still not efficient enough. Moreover, his model mainly focused on the artificial neural network, and clear physiological meanings has not been addressed. In this work, based on the concept of mental exploration, neural energy coding theory has been applied to the novel calculation model to solve the path-finding problem. Energy field is constructed on the basis of the firing power of place cell clusters, and the energy field gradient can be used in mental exploration to solve path-finding problems. The study shows that the new mental exploration model can efficiently find the optimal path, and present the learning process with biophysical meaning as well. We also analyzed the parameters of the model which affect the path efficiency. This new idea verifies the importance of place cell and synapse in spatial memory and proves that energy coding is effective to study cognitive activities. This may provide the theoretical basis for the neural dynamics mechanism of spatial memory.

Empirical Modeling of the Plasmasphere Dynamics Using Neural Networks

Science.gov (United States)

Zhelavskaya, I. S.; Shprits, Y.; Spasojevic, M.

2017-12-01

We present a new empirical model for reconstructing the global dynamics of the cold plasma density distribution based only on solar wind data and geomagnetic indices. Utilizing the density database obtained using the NURD (Neural-network-based Upper hybrid Resonance Determination) algorithm for the period of October 1, 2012 - July 1, 2016, in conjunction with solar wind data and geomagnetic indices, we develop a neural network model that is capable of globally reconstructing the dynamics of the cold plasma density distribution for 2 ≤ L ≤ 6 and all local times. We validate and test the model by measuring its performance on independent datasets withheld from the training set and by comparing the model predicted global evolution with global images of He+ distribution in the Earth's plasmasphere from the IMAGE Extreme UltraViolet (EUV) instrument. We identify the parameters that best quantify the plasmasphere dynamics by training and comparing multiple neural networks with different combinations of input parameters (geomagnetic indices, solar wind data, and different durations of their time history). We demonstrate results of both local and global plasma density reconstruction. This study illustrates how global dynamics can be reconstructed from local in-situ observations by using machine learning techniques.

Development of an accident diagnosis system using a dynamic neural network for nuclear power plants

International Nuclear Information System (INIS)

Lee, Seung Jun; Kim, Jong Hyun; Seong, Poong Hyun

2004-01-01

In this work, an accident diagnosis system using the dynamic neural network is developed. In order to help the plant operators to quickly identify the problem, perform diagnosis and initiate recovery actions ensuring the safety of the plant, many operator support system and accident diagnosis systems have been developed. Neural networks have been recognized as a good method to implement an accident diagnosis system. However, conventional accident diagnosis systems that used neural networks did not consider a time factor sufficiently. If the neural network could be trained according to time, it is possible to perform more efficient and detailed accidents analysis. Therefore, this work suggests a dynamic neural network which has different features from existing dynamic neural networks. And a simple accident diagnosis system is implemented in order to validate the dynamic neural network. After training of the prototype, several accident diagnoses were performed. The results show that the prototype can detect the accidents correctly with good performances

Standard representation and unified stability analysis for dynamic artificial neural network models.

Science.gov (United States)

Kim, Kwang-Ki K; Patrón, Ernesto Ríos; Braatz, Richard D

2018-02-01

An overview is provided of dynamic artificial neural network models (DANNs) for nonlinear dynamical system identification and control problems, and convex stability conditions are proposed that are less conservative than past results. The three most popular classes of dynamic artificial neural network models are described, with their mathematical representations and architectures followed by transformations based on their block diagrams that are convenient for stability and performance analyses. Classes of nonlinear dynamical systems that are universally approximated by such models are characterized, which include rigorous upper bounds on the approximation errors. A unified framework and linear matrix inequality-based stability conditions are described for different classes of dynamic artificial neural network models that take additional information into account such as local slope restrictions and whether the nonlinearities within the DANNs are odd. A theoretical example shows reduced conservatism obtained by the conditions. Copyright © 2017. Published by Elsevier Ltd.

Nonlinear identification of process dynamics using neural networks

International Nuclear Information System (INIS)

Parlos, A.G.; Atiya, A.F.; Chong, K.T.

1992-01-01

In this paper the nonlinear identification of process dynamics encountered in nuclear power plant components is addressed, in an input-output sense, using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the model structure to be identified. The feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of temporal variations in the system nonlinearities. The standard backpropagation learning algorithm is modified, and it is used for the supervised training of the proposed hybrid network. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The response of representative steam generator is predicted using a neural network, and it is compared to the response obtained from a sophisticated computer model based on first principles. The transient responses compare well, although further research is warranted to determine the predictive capabilities of these networks during more severe operational transients and accident scenarios

The quest for a Quantum Neural Network

OpenAIRE

Schuld, M.; Sinayskiy, I.; Petruccione, F.

2014-01-01

With the overwhelming success in the field of quantum information in the last decades, the "quest" for a Quantum Neural Network (QNN) model began in order to combine quantum computing with the striking properties of neural computing. This article presents a systematic approach to QNN research, which so far consists of a conglomeration of ideas and proposals. It outlines the challenge of combining the nonlinear, dissipative dynamics of neural computing and the linear, unitary dynamics of quant...

Neural field model of memory-guided search.

Science.gov (United States)

Kilpatrick, Zachary P; Poll, Daniel B

2017-12-01

Many organisms can remember locations they have previously visited during a search. Visual search experiments have shown exploration is guided away from these locations, reducing redundancies in the search path before finding a hidden target. We develop and analyze a two-layer neural field model that encodes positional information during a search task. A position-encoding layer sustains a bump attractor corresponding to the searching agent's current location, and search is modeled by velocity input that propagates the bump. A memory layer sustains persistent activity bounded by a wave front, whose edges expand in response to excitatory input from the position layer. Search can then be biased in response to remembered locations, influencing velocity inputs to the position layer. Asymptotic techniques are used to reduce the dynamics of our model to a low-dimensional system of equations that track the bump position and front boundary. Performance is compared for different target-finding tasks.

Neural field model of memory-guided search

Science.gov (United States)

Kilpatrick, Zachary P.; Poll, Daniel B.

2017-12-01

Many organisms can remember locations they have previously visited during a search. Visual search experiments have shown exploration is guided away from these locations, reducing redundancies in the search path before finding a hidden target. We develop and analyze a two-layer neural field model that encodes positional information during a search task. A position-encoding layer sustains a bump attractor corresponding to the searching agent's current location, and search is modeled by velocity input that propagates the bump. A memory layer sustains persistent activity bounded by a wave front, whose edges expand in response to excitatory input from the position layer. Search can then be biased in response to remembered locations, influencing velocity inputs to the position layer. Asymptotic techniques are used to reduce the dynamics of our model to a low-dimensional system of equations that track the bump position and front boundary. Performance is compared for different target-finding tasks.

Spatiotemporal neural network dynamics for the processing of dynamic facial expressions

Science.gov (United States)

Sato, Wataru; Kochiyama, Takanori; Uono, Shota

2015-01-01

The dynamic facial expressions of emotion automatically elicit multifaceted psychological activities; however, the temporal profiles and dynamic interaction patterns of brain activities remain unknown. We investigated these issues using magnetoencephalography. Participants passively observed dynamic facial expressions of fear and happiness, or dynamic mosaics. Source-reconstruction analyses utilizing functional magnetic-resonance imaging data revealed higher activation in broad regions of the bilateral occipital and temporal cortices in response to dynamic facial expressions than in response to dynamic mosaics at 150–200 ms and some later time points. The right inferior frontal gyrus exhibited higher activity for dynamic faces versus mosaics at 300–350 ms. Dynamic causal-modeling analyses revealed that dynamic faces activated the dual visual routes and visual–motor route. Superior influences of feedforward and feedback connections were identified before and after 200 ms, respectively. These results indicate that hierarchical, bidirectional neural network dynamics within a few hundred milliseconds implement the processing of dynamic facial expressions. PMID:26206708

Spatiotemporal neural network dynamics for the processing of dynamic facial expressions.

Science.gov (United States)

Sato, Wataru; Kochiyama, Takanori; Uono, Shota

2015-07-24

The dynamic facial expressions of emotion automatically elicit multifaceted psychological activities; however, the temporal profiles and dynamic interaction patterns of brain activities remain unknown. We investigated these issues using magnetoencephalography. Participants passively observed dynamic facial expressions of fear and happiness, or dynamic mosaics. Source-reconstruction analyses utilizing functional magnetic-resonance imaging data revealed higher activation in broad regions of the bilateral occipital and temporal cortices in response to dynamic facial expressions than in response to dynamic mosaics at 150-200 ms and some later time points. The right inferior frontal gyrus exhibited higher activity for dynamic faces versus mosaics at 300-350 ms. Dynamic causal-modeling analyses revealed that dynamic faces activated the dual visual routes and visual-motor route. Superior influences of feedforward and feedback connections were identified before and after 200 ms, respectively. These results indicate that hierarchical, bidirectional neural network dynamics within a few hundred milliseconds implement the processing of dynamic facial expressions.

Nonlinear Dynamics and Chaos in Fractional-Order Hopfield Neural Networks with Delay

Directory of Open Access Journals (Sweden)

Xia Huang

2013-01-01

Full Text Available A fractional-order two-neuron Hopfield neural network with delay is proposed based on the classic well-known Hopfield neural networks, and further, the complex dynamical behaviors of such a network are investigated. A great variety of interesting dynamical phenomena, including single-periodic, multiple-periodic, and chaotic motions, are found to exist. The existence of chaotic attractors is verified by the bifurcation diagram and phase portraits as well.

Protein Secondary Structure Prediction Using Deep Convolutional Neural Fields.

Science.gov (United States)

Wang, Sheng; Peng, Jian; Ma, Jianzhu; Xu, Jinbo

2016-01-11

Protein secondary structure (SS) prediction is important for studying protein structure and function. When only the sequence (profile) information is used as input feature, currently the best predictors can obtain ~80% Q3 accuracy, which has not been improved in the past decade. Here we present DeepCNF (Deep Convolutional Neural Fields) for protein SS prediction. DeepCNF is a Deep Learning extension of Conditional Neural Fields (CNF), which is an integration of Conditional Random Fields (CRF) and shallow neural networks. DeepCNF can model not only complex sequence-structure relationship by a deep hierarchical architecture, but also interdependency between adjacent SS labels, so it is much more powerful than CNF. Experimental results show that DeepCNF can obtain ~84% Q3 accuracy, ~85% SOV score, and ~72% Q8 accuracy, respectively, on the CASP and CAMEO test proteins, greatly outperforming currently popular predictors. As a general framework, DeepCNF can be used to predict other protein structure properties such as contact number, disorder regions, and solvent accessibility.

Application of CMAC Neural Network to Solar Energy Heliostat Field Fault Diagnosis

Directory of Open Access Journals (Sweden)

Neng-Sheng Pai

2013-01-01

Full Text Available Solar energy heliostat fields comprise numerous sun tracking platforms. As a result, fault detection is a highly challenging problem. Accordingly, the present study proposes a cerebellar model arithmetic computer (CMAC neutral network for automatically diagnosing faults within the heliostat field in accordance with the rotational speed, vibration, and temperature characteristics of the individual heliostat transmission systems. As compared with radial basis function (RBF neural network and back propagation (BP neural network in the heliostat field fault diagnosis, the experimental results show that the proposed neural network has a low training time, good robustness, and a reliable diagnostic performance. As a result, it provides an ideal solution for fault diagnosis in modern, large-scale heliostat fields.

Soft tissue deformation modelling through neural dynamics-based reaction-diffusion mechanics.

Science.gov (United States)

Zhang, Jinao; Zhong, Yongmin; Gu, Chengfan

2018-05-30

Soft tissue deformation modelling forms the basis of development of surgical simulation, surgical planning and robotic-assisted minimally invasive surgery. This paper presents a new methodology for modelling of soft tissue deformation based on reaction-diffusion mechanics via neural dynamics. The potential energy stored in soft tissues due to a mechanical load to deform tissues away from their rest state is treated as the equivalent transmembrane potential energy, and it is distributed in the tissue masses in the manner of reaction-diffusion propagation of nonlinear electrical waves. The reaction-diffusion propagation of mechanical potential energy and nonrigid mechanics of motion are combined to model soft tissue deformation and its dynamics, both of which are further formulated as the dynamics of cellular neural networks to achieve real-time computational performance. The proposed methodology is implemented with a haptic device for interactive soft tissue deformation with force feedback. Experimental results demonstrate that the proposed methodology exhibits nonlinear force-displacement relationship for nonlinear soft tissue deformation. Homogeneous, anisotropic and heterogeneous soft tissue material properties can be modelled through the inherent physical properties of mass points. Graphical abstract Soft tissue deformation modelling with haptic feedback via neural dynamics-based reaction-diffusion mechanics.

Front Propagation in Stochastic Neural Fields

KAUST Repository

Bressloff, Paul C.

2012-01-01

We analyze the effects of extrinsic multiplicative noise on front propagation in a scalar neural field with excitatory connections. Using a separation of time scales, we represent the fluctuating front in terms of a diffusive-like displacement (wandering) of the front from its uniformly translating position at long time scales, and fluctuations in the front profile around its instantaneous position at short time scales. One major result of our analysis is a comparison between freely propagating fronts and fronts locked to an externally moving stimulus. We show that the latter are much more robust to noise, since the stochastic wandering of the mean front profile is described by an Ornstein-Uhlenbeck process rather than a Wiener process, so that the variance in front position saturates in the long time limit rather than increasing linearly with time. Finally, we consider a stochastic neural field that supports a pulled front in the deterministic limit, and show that the wandering of such a front is now subdiffusive. © 2012 Society for Industrial and Applied Mathematics.

A class of convergent neural network dynamics

Science.gov (United States)

Fiedler, Bernold; Gedeon, Tomáš

1998-01-01

We consider a class of systems of differential equations in Rn which exhibits convergent dynamics. We find a Lyapunov function and show that every bounded trajectory converges to the set of equilibria. Our result generalizes the results of Cohen and Grossberg (1983) for convergent neural networks. It replaces the symmetry assumption on the matrix of weights by the assumption on the structure of the connections in the neural network. We prove the convergence result also for a large class of Lotka-Volterra systems. These are naturally defined on the closed positive orthant. We show that there are no heteroclinic cycles on the boundary of the positive orthant for the systems in this class.

Dynamic simulation of a steam generator by neural networks

International Nuclear Information System (INIS)

Masini, R.; Padovani, E.; Ricotti, M.E.; Zio, E.

1999-01-01

Numerical simulation by computers of the dynamic evolution of complex systems and components is a fundamental phase of any modern engineering design activity. This is of particular importance for risk-based design projects which require that the system behavior be analyzed under several and often extreme conditions. The traditional methods of simulation typically entail long, iterative, processes which lead to large simulation times, often exceeding the transients real time. Artificial neural networks (ANNs) may be exploited in this context, their advantages residing mainly in the speed of computation, in the capability of generalizing from few examples, in the robustness to noisy and partially incomplete data and in the capability of performing empirical input-output mapping without complete knowledge of the underlying physics. In this paper we present a novel approach to dynamic simulation by ANNs based on a superposition scheme in which a set of networks are individually trained, each one to respond to a different input forcing function. The dynamic simulation of a steam generator is considered as an example to show the potentialities of this tool and to point out the difficulties and crucial issues which typically arise when attempting to establish an efficient neural network simulator. The structure of the networks system is such to feedback, at each time step, a portion of the past evolution of the transient and this allows a good reproduction of also non-linear dynamic behaviors. A nice characteristic of the approach is that the modularization of the training reduces substantially its burden and gives this neural simulation tool a nice feature of transportability. (orig.)

Dynamic Pricing in Electronic Commerce Using Neural Network

Science.gov (United States)

Ghose, Tapu Kumar; Tran, Thomas T.

In this paper, we propose an approach where feed-forward neural network is used for dynamically calculating a competitive price of a product in order to maximize sellers’ revenue. In the approach we considered that along with product price other attributes such as product quality, delivery time, after sales service and seller’s reputation contribute in consumers purchase decision. We showed that once the sellers, by using their limited prior knowledge, set an initial price of a product our model adjusts the price automatically with the help of neural network so that sellers’ revenue is maximized.

Two-Dimensional Bumps in Piecewise Smooth Neural Fields with Synaptic Depression

KAUST Repository

Bressloff, Paul C.

2011-01-01

We analyze radially symmetric bumps in a two-dimensional piecewise-smooth neural field model with synaptic depression. The continuum dynamics is described in terms of a nonlocal integrodifferential equation, in which the integral kernel represents the spatial distribution of synaptic weights between populations of neurons whose mean firing rate is taken to be a Heaviside function of local activity. Synaptic depression dynamically reduces the strength of synaptic weights in response to increases in activity. We show that in the case of a Mexican hat weight distribution, sufficiently strong synaptic depression can destabilize a stationary bump solution that would be stable in the absence of depression. Numerically it is found that the resulting instability leads to the formation of a traveling spot. The local stability of a bump is determined by solutions to a system of pseudolinear equations that take into account the sign of perturbations around the circular bump boundary. © 2011 Society for Industrial and Applied Mathematics.

A neural network approach to the study of dynamics and structure of molecular systems

International Nuclear Information System (INIS)

Getino, C.; Sumpter, B.G.; Noid, D.W.

1994-01-01

Neural networks are used to study intramolecular energy flow in molecular systems (tetratomics to macromolecules), developing new techniques for efficient analysis of data obtained from molecular-dynamics and quantum mechanics calculations. Neural networks can map phase space points to intramolecular vibrational energies along a classical trajectory (example of complicated coordinate transformation), producing reasonably accurate values for any region of the multidimensional phase space of a tetratomic molecule. Neural network energy flow predictions are found to significantly enhance the molecular-dynamics method to longer time-scales and extensive averaging of trajectories for macromolecular systems. Pattern recognition abilities of neural networks can be used to discern phase space features. Neural networks can also expand model calculations by interpolation of costly quantum mechanical ab initio data, used to develop semiempirical potential energy functions

Chaos Synchronization Using Adaptive Dynamic Neural Network Controller with Variable Learning Rates

Directory of Open Access Journals (Sweden)

Chih-Hong Kao

2011-01-01

Full Text Available This paper addresses the synchronization of chaotic gyros with unknown parameters and external disturbance via an adaptive dynamic neural network control (ADNNC system. The proposed ADNNC system is composed of a neural controller and a smooth compensator. The neural controller uses a dynamic RBF (DRBF network to online approximate an ideal controller. The DRBF network can create new hidden neurons online if the input data falls outside the hidden layer and prune the insignificant hidden neurons online if the hidden neuron is inappropriate. The smooth compensator is designed to compensate for the approximation error between the neural controller and the ideal controller. Moreover, the variable learning rates of the parameter adaptation laws are derived based on a discrete-type Lyapunov function to speed up the convergence rate of the tracking error. Finally, the simulation results which verified the chaotic behavior of two nonlinear identical chaotic gyros can be synchronized using the proposed ADNNC scheme.

Dynamic Learning from Adaptive Neural Control of Uncertain Robots with Guaranteed Full-State Tracking Precision

Directory of Open Access Journals (Sweden)

Min Wang

2017-01-01

Full Text Available A dynamic learning method is developed for an uncertain n-link robot with unknown system dynamics, achieving predefined performance attributes on the link angular position and velocity tracking errors. For a known nonsingular initial robotic condition, performance functions and unconstrained transformation errors are employed to prevent the violation of the full-state tracking error constraints. By combining two independent Lyapunov functions and radial basis function (RBF neural network (NN approximator, a novel and simple adaptive neural control scheme is proposed for the dynamics of the unconstrained transformation errors, which guarantees uniformly ultimate boundedness of all the signals in the closed-loop system. In the steady-state control process, RBF NNs are verified to satisfy the partial persistent excitation (PE condition. Subsequently, an appropriate state transformation is adopted to achieve the accurate convergence of neural weight estimates. The corresponding experienced knowledge on unknown robotic dynamics is stored in NNs with constant neural weight values. Using the stored knowledge, a static neural learning controller is developed to improve the full-state tracking performance. A comparative simulation study on a 2-link robot illustrates the effectiveness of the proposed scheme.

Synchrony-induced modes of oscillation of a neural field model

Science.gov (United States)

Esnaola-Acebes, Jose M.; Roxin, Alex; Avitabile, Daniele; Montbrió, Ernest

2017-11-01

We investigate the modes of oscillation of heterogeneous ring networks of quadratic integrate-and-fire (QIF) neurons with nonlocal, space-dependent coupling. Perturbations of the equilibrium state with a particular wave number produce transient standing waves with a specific temporal frequency, analogously to those in a tense string. In the neuronal network, the equilibrium corresponds to a spatially homogeneous, asynchronous state. Perturbations of this state excite the network's oscillatory modes, which reflect the interplay of episodes of synchronous spiking with the excitatory-inhibitory spatial interactions. In the thermodynamic limit, an exact low-dimensional neural field model describing the macroscopic dynamics of the network is derived. This allows us to obtain formulas for the Turing eigenvalues of the spatially homogeneous state and hence to obtain its stability boundary. We find that the frequency of each Turing mode depends on the corresponding Fourier coefficient of the synaptic pattern of connectivity. The decay rate instead is identical for all oscillation modes as a consequence of the heterogeneity-induced desynchronization of the neurons. Finally, we numerically compute the spectrum of spatially inhomogeneous solutions branching from the Turing bifurcation, showing that similar oscillatory modes operate in neural bump states and are maintained away from onset.

Neural dynamics of the cognitive map in the hippocampus.

Science.gov (United States)

Wagatsuma, Hiroaki; Yamaguchi, Yoko

2007-06-01

The rodent hippocampus has been thought to represent the spatial environment as a cognitive map. In the classical theory, the cognitive map has been explained as a consequence of the fact that different spatial regions are assigned to different cell populations in the framework of rate coding. Recently, the relation between place cell firing and local field oscillation theta in terms of theta phase precession was experimentally discovered and suggested as a temporal coding mechanism leading to memory formation of behavioral sequences accompanied with asymmetric Hebbian plasticity. The cognitive map theory is apparently outside of the sequence memory view. Therefore, theoretical analysis is necessary to consider the biological neural dynamics for the sequence encoding of the memory of behavioral sequences, providing the cognitive map formation. In this article, we summarize the theoretical neural dynamics of the real-time sequence encoding by theta phase precession, called theta phase coding, and review a series of theoretical models with the theta phase coding that we previously reported. With respect to memory encoding functions, instantaneous memory formation of one-time experience was first demonstrated, and then the ability of integration of memories of behavioral sequences into a network of the cognitive map was shown. In terms of memory retrieval functions, theta phase coding enables the hippocampus to represent the spatial location in the current behavioral context even with ambiguous sensory input when multiple sequences were coded. Finally, for utilization, retrieved temporal sequences in the hippocampus can be available for action selection, through the process of reverting theta rhythm-dependent activities to information in the behavioral time scale. This theoretical approach allows us to investigate how the behavioral sequences are encoded, updated, retrieved and used in the hippocampus, as the real-time interaction with the external environment. It may

Dynamic Adaptive Neural Network Arrays: A Neuromorphic Architecture

Energy Technology Data Exchange (ETDEWEB)

Disney, Adam [University of Tennessee (UT); Reynolds, John [University of Tennessee (UT)

2015-01-01

Dynamic Adaptive Neural Network Array (DANNA) is a neuromorphic hardware implementation. It differs from most other neuromorphic projects in that it allows for programmability of structure, and it is trained or designed using evolutionary optimization. This paper describes the DANNA structure, how DANNA is trained using evolutionary optimization, and an application of DANNA to a very simple classification task.

Linking dynamic patterns of neural activity in orbitofrontal cortex with decision making.

Science.gov (United States)

Rich, Erin L; Stoll, Frederic M; Rudebeck, Peter H

2018-04-01

Humans and animals demonstrate extraordinary flexibility in choice behavior, particularly when deciding based on subjective preferences. We evaluate options on different scales, deliberate, and often change our minds. Little is known about the neural mechanisms that underlie these dynamic aspects of decision-making, although neural activity in orbitofrontal cortex (OFC) likely plays a central role. Recent evidence from studies in macaques shows that attention modulates value responses in OFC, and that ensembles of OFC neurons dynamically signal different options during choices. When contexts change, these ensembles flexibly remap to encode the new task. Determining how these dynamic patterns emerge and relate to choices will inform models of decision-making and OFC function. Copyright © 2017 Elsevier Ltd. All rights reserved.

Qualitative analysis and control of complex neural networks with delays

CERN Document Server

Wang, Zhanshan; Zheng, Chengde

2016-01-01

This book focuses on the stability of the dynamical neural system, synchronization of the coupling neural system and their applications in automation control and electrical engineering. The redefined concept of stability, synchronization and consensus are adopted to provide a better explanation of the complex neural network. Researchers in the fields of dynamical systems, computer science, electrical engineering and mathematics will benefit from the discussions on complex systems. The book will also help readers to better understand the theory behind the control technique and its design.

An Artificial Neural Network Based Short-term Dynamic Prediction of Algae Bloom

Directory of Open Access Journals (Sweden)

Yao Junyang

2014-06-01

Full Text Available This paper proposes a method of short-term prediction of algae bloom based on artificial neural network. Firstly, principal component analysis is applied to water environmental factors in algae bloom raceway ponds to get main factors that influence the formation of algae blooms. Then, a model of short-term dynamic prediction based on neural network is built with the current chlorophyll_a values as input and the chlorophyll_a values in the next moment as output to realize short-term dynamic prediction of algae bloom. Simulation results show that the model can realize short-term prediction of algae bloom effectively.

Global neural dynamic surface tracking control of strict-feedback systems with application to hypersonic flight vehicle.

Science.gov (United States)

Xu, Bin; Yang, Chenguang; Pan, Yongping

2015-10-01

This paper studies both indirect and direct global neural control of strict-feedback systems in the presence of unknown dynamics, using the dynamic surface control (DSC) technique in a novel manner. A new switching mechanism is designed to combine an adaptive neural controller in the neural approximation domain, together with the robust controller that pulls the transient states back into the neural approximation domain from the outside. In comparison with the conventional control techniques, which could only achieve semiglobally uniformly ultimately bounded stability, the proposed control scheme guarantees all the signals in the closed-loop system are globally uniformly ultimately bounded, such that the conventional constraints on initial conditions of the neural control system can be relaxed. The simulation studies of hypersonic flight vehicle (HFV) are performed to demonstrate the effectiveness of the proposed global neural DSC design.

Robust fault detection of wind energy conversion systems based on dynamic neural networks.

Science.gov (United States)

Talebi, Nasser; Sadrnia, Mohammad Ali; Darabi, Ahmad

2014-01-01

Occurrence of faults in wind energy conversion systems (WECSs) is inevitable. In order to detect the occurred faults at the appropriate time, avoid heavy economic losses, ensure safe system operation, prevent damage to adjacent relevant systems, and facilitate timely repair of failed components; a fault detection system (FDS) is required. Recurrent neural networks (RNNs) have gained a noticeable position in FDSs and they have been widely used for modeling of complex dynamical systems. One method for designing an FDS is to prepare a dynamic neural model emulating the normal system behavior. By comparing the outputs of the real system and neural model, incidence of the faults can be identified. In this paper, by utilizing a comprehensive dynamic model which contains both mechanical and electrical components of the WECS, an FDS is suggested using dynamic RNNs. The presented FDS detects faults of the generator's angular velocity sensor, pitch angle sensors, and pitch actuators. Robustness of the FDS is achieved by employing an adaptive threshold. Simulation results show that the proposed scheme is capable to detect the faults shortly and it has very low false and missed alarms rate.

Parametric models to relate spike train and LFP dynamics with neural information processing.

Science.gov (United States)

Banerjee, Arpan; Dean, Heather L; Pesaran, Bijan

2012-01-01

Spike trains and local field potentials (LFPs) resulting from extracellular current flows provide a substrate for neural information processing. Understanding the neural code from simultaneous spike-field recordings and subsequent decoding of information processing events will have widespread applications. One way to demonstrate an understanding of the neural code, with particular advantages for the development of applications, is to formulate a parametric statistical model of neural activity and its covariates. Here, we propose a set of parametric spike-field models (unified models) that can be used with existing decoding algorithms to reveal the timing of task or stimulus specific processing. Our proposed unified modeling framework captures the effects of two important features of information processing: time-varying stimulus-driven inputs and ongoing background activity that occurs even in the absence of environmental inputs. We have applied this framework for decoding neural latencies in simulated and experimentally recorded spike-field sessions obtained from the lateral intraparietal area (LIP) of awake, behaving monkeys performing cued look-and-reach movements to spatial targets. Using both simulated and experimental data, we find that estimates of trial-by-trial parameters are not significantly affected by the presence of ongoing background activity. However, including background activity in the unified model improves goodness of fit for predicting individual spiking events. Uncovering the relationship between the model parameters and the timing of movements offers new ways to test hypotheses about the relationship between neural activity and behavior. We obtained significant spike-field onset time correlations from single trials using a previously published data set where significantly strong correlation was only obtained through trial averaging. We also found that unified models extracted a stronger relationship between neural response latency and trial

Bio-Inspired Neural Model for Learning Dynamic Models

Science.gov (United States)

Duong, Tuan; Duong, Vu; Suri, Ronald

2009-01-01

A neural-network mathematical model that, relative to prior such models, places greater emphasis on some of the temporal aspects of real neural physical processes, has been proposed as a basis for massively parallel, distributed algorithms that learn dynamic models of possibly complex external processes by means of learning rules that are local in space and time. The algorithms could be made to perform such functions as recognition and prediction of words in speech and of objects depicted in video images. The approach embodied in this model is said to be "hardware-friendly" in the following sense: The algorithms would be amenable to execution by special-purpose computers implemented as very-large-scale integrated (VLSI) circuits that would operate at relatively high speeds and low power demands.

Artificial Neural Networks for Nonlinear Dynamic Response Simulation in Mechanical Systems

DEFF Research Database (Denmark)

Christiansen, Niels Hørbye; Høgsberg, Jan Becker; Winther, Ole

2011-01-01

It is shown how artificial neural networks can be trained to predict dynamic response of a simple nonlinear structure. Data generated using a nonlinear finite element model of a simplified wind turbine is used to train a one layer artificial neural network. When trained properly the network is ab...... to perform accurate response prediction much faster than the corresponding finite element model. Initial result indicate a reduction in cpu time by two orders of magnitude....

A comparison between wavelet based static and dynamic neural network approaches for runoff prediction

Science.gov (United States)

Shoaib, Muhammad; Shamseldin, Asaad Y.; Melville, Bruce W.; Khan, Mudasser Muneer

2016-04-01

In order to predict runoff accurately from a rainfall event, the multilayer perceptron type of neural network models are commonly used in hydrology. Furthermore, the wavelet coupled multilayer perceptron neural network (MLPNN) models has also been found superior relative to the simple neural network models which are not coupled with wavelet. However, the MLPNN models are considered as static and memory less networks and lack the ability to examine the temporal dimension of data. Recurrent neural network models, on the other hand, have the ability to learn from the preceding conditions of the system and hence considered as dynamic models. This study for the first time explores the potential of wavelet coupled time lagged recurrent neural network (TLRNN) models for runoff prediction using rainfall data. The Discrete Wavelet Transformation (DWT) is employed in this study to decompose the input rainfall data using six of the most commonly used wavelet functions. The performance of the simple and the wavelet coupled static MLPNN models is compared with their counterpart dynamic TLRNN models. The study found that the dynamic wavelet coupled TLRNN models can be considered as alternative to the static wavelet MLPNN models. The study also investigated the effect of memory depth on the performance of static and dynamic neural network models. The memory depth refers to how much past information (lagged data) is required as it is not known a priori. The db8 wavelet function is found to yield the best results with the static MLPNN models and with the TLRNN models having small memory depths. The performance of the wavelet coupled TLRNN models with large memory depths is found insensitive to the selection of the wavelet function as all wavelet functions have similar performance.

On DSS Implementation in the Dynamic Model of the Digital Oil field

Science.gov (United States)

Korovin, Iakov S.; Khisamutdinov, Maksim V.; Kalyaev, Anatoly I.

2018-02-01

Decision support systems (DSS), especially based on the artificial intelligence (AI) techniques are been widely applied in different domains nowadays. In the paper we depict an approach of implementing DSS in to Digital Oil Field (DOF) dynamic model structure in order to reduce the human factor influence, considering the automation of all production processes to be the DOF model clue element. As the basic tool of data handling we propose the hybrid application on artificial neural networks and evolutional algorithms.

Direct imaging of neural currents using ultra-low field magnetic resonance techniques

Science.gov (United States)

Volegov, Petr L [Los Alamos, NM; Matlashov, Andrei N [Los Alamos, NM; Mosher, John C [Los Alamos, NM; Espy, Michelle A [Los Alamos, NM; Kraus, Jr., Robert H.

2009-08-11

Using resonant interactions to directly and tomographically image neural activity in the human brain using magnetic resonance imaging (MRI) techniques at ultra-low field (ULF), the present inventors have established an approach that is sensitive to magnetic field distributions local to the spin population in cortex at the Larmor frequency of the measurement field. Because the Larmor frequency can be readily manipulated (through varying B.sub.m), one can also envision using ULF-DNI to image the frequency distribution of the local fields in cortex. Such information, taken together with simultaneous acquisition of MEG and ULF-NMR signals, enables non-invasive exploration of the correlation between local fields induced by neural activity in cortex and more `distant` measures of brain activity such as MEG and EEG.

Models of neural dynamics in brain information processing - the developments of 'the decade'

International Nuclear Information System (INIS)

Borisyuk, G N; Borisyuk, R M; Kazanovich, Yakov B; Ivanitskii, Genrikh R

2002-01-01

Neural network models are discussed that have been developed during the last decade with the purpose of reproducing spatio-temporal patterns of neural activity in different brain structures. The main goal of the modeling was to test hypotheses of synchronization, temporal and phase relations in brain information processing. The models being considered are those of temporal structure of spike sequences, of neural activity dynamics, and oscillatory models of attention and feature integration. (reviews of topical problems)

Context-dependent retrieval of information by neural-network dynamics with continuous attractors.

Science.gov (United States)

Tsuboshita, Yukihiro; Okamoto, Hiroshi

2007-08-01

Memory retrieval in neural networks has traditionally been described by dynamic systems with discrete attractors. However, recent neurophysiological findings of graded persistent activity suggest that memory retrieval in the brain is more likely to be described by dynamic systems with continuous attractors. To explore what sort of information processing is achieved by continuous-attractor dynamics, keyword extraction from documents by a network of bistable neurons, which gives robust continuous attractors, is examined. Given an associative network of terms, a continuous attractor led by propagation of neuronal activation in this network appears to represent keywords that express underlying meaning of a document encoded in the initial state of the network-activation pattern. A dominant hypothesis in cognitive psychology is that long-term memory is archived in the network structure, which resembles associative networks of terms. Our results suggest that keyword extraction by the neural-network dynamics with continuous attractors might symbolically represent context-dependent retrieval of short-term memory from long-term memory in the brain.

Neural Architectures for Control

Science.gov (United States)

Peterson, James K.

1991-01-01

The cerebellar model articulated controller (CMAC) neural architectures are shown to be viable for the purposes of real-time learning and control. Software tools for the exploration of CMAC performance are developed for three hardware platforms, the MacIntosh, the IBM PC, and the SUN workstation. All algorithm development was done using the C programming language. These software tools were then used to implement an adaptive critic neuro-control design that learns in real-time how to back up a trailer truck. The truck backer-upper experiment is a standard performance measure in the neural network literature, but previously the training of the controllers was done off-line. With the CMAC neural architectures, it was possible to train the neuro-controllers on-line in real-time on a MS-DOS PC 386. CMAC neural architectures are also used in conjunction with a hierarchical planning approach to find collision-free paths over 2-D analog valued obstacle fields. The method constructs a coarse resolution version of the original problem and then finds the corresponding coarse optimal path using multipass dynamic programming. CMAC artificial neural architectures are used to estimate the analog transition costs that dynamic programming requires. The CMAC architectures are trained in real-time for each obstacle field presented. The coarse optimal path is then used as a baseline for the construction of a fine scale optimal path through the original obstacle array. These results are a very good indication of the potential power of the neural architectures in control design. In order to reach as wide an audience as possible, we have run a seminar on neuro-control that has met once per week since 20 May 1991. This seminar has thoroughly discussed the CMAC architecture, relevant portions of classical control, back propagation through time, and adaptive critic designs.

Parameter estimation of breast tumour using dynamic neural network from thermal pattern

Directory of Open Access Journals (Sweden)

Elham Saniei

2016-11-01

Full Text Available This article presents a new approach for estimating the depth, size, and metabolic heat generation rate of a tumour. For this purpose, the surface temperature distribution of a breast thermal image and the dynamic neural network was used. The research consisted of two steps: forward and inverse. For the forward section, a finite element model was created. The Pennes bio-heat equation was solved to find surface and depth temperature distributions. Data from the analysis, then, were used to train the dynamic neural network model (DNN. Results from the DNN training/testing confirmed those of the finite element model. For the inverse section, the trained neural network was applied to estimate the depth temperature distribution (tumour position from the surface temperature profile, extracted from the thermal image. Finally, tumour parameters were obtained from the depth temperature distribution. Experimental findings (20 patients were promising in terms of the model’s potential for retrieving tumour parameters.

A state space approach for piecewise-linear recurrent neural networks for identifying computational dynamics from neural measurements.

Directory of Open Access Journals (Sweden)

Daniel Durstewitz

2017-06-01

Full Text Available The computational and cognitive properties of neural systems are often thought to be implemented in terms of their (stochastic network dynamics. Hence, recovering the system dynamics from experimentally observed neuronal time series, like multiple single-unit recordings or neuroimaging data, is an important step toward understanding its computations. Ideally, one would not only seek a (lower-dimensional state space representation of the dynamics, but would wish to have access to its statistical properties and their generative equations for in-depth analysis. Recurrent neural networks (RNNs are a computationally powerful and dynamically universal formal framework which has been extensively studied from both the computational and the dynamical systems perspective. Here we develop a semi-analytical maximum-likelihood estimation scheme for piecewise-linear RNNs (PLRNNs within the statistical framework of state space models, which accounts for noise in both the underlying latent dynamics and the observation process. The Expectation-Maximization algorithm is used to infer the latent state distribution, through a global Laplace approximation, and the PLRNN parameters iteratively. After validating the procedure on toy examples, and using inference through particle filters for comparison, the approach is applied to multiple single-unit recordings from the rodent anterior cingulate cortex (ACC obtained during performance of a classical working memory task, delayed alternation. Models estimated from kernel-smoothed spike time data were able to capture the essential computational dynamics underlying task performance, including stimulus-selective delay activity. The estimated models were rarely multi-stable, however, but rather were tuned to exhibit slow dynamics in the vicinity of a bifurcation point. In summary, the present work advances a semi-analytical (thus reasonably fast maximum-likelihood estimation framework for PLRNNs that may enable to recover

Computational modeling of neural plasticity for self-organization of neural networks.

Science.gov (United States)

Chrol-Cannon, Joseph; Jin, Yaochu

2014-11-01

Self-organization in biological nervous systems during the lifetime is known to largely occur through a process of plasticity that is dependent upon the spike-timing activity in connected neurons. In the field of computational neuroscience, much effort has been dedicated to building up computational models of neural plasticity to replicate experimental data. Most recently, increasing attention has been paid to understanding the role of neural plasticity in functional and structural neural self-organization, as well as its influence on the learning performance of neural networks for accomplishing machine learning tasks such as classification and regression. Although many ideas and hypothesis have been suggested, the relationship between the structure, dynamics and learning performance of neural networks remains elusive. The purpose of this article is to review the most important computational models for neural plasticity and discuss various ideas about neural plasticity's role. Finally, we suggest a few promising research directions, in particular those along the line that combines findings in computational neuroscience and systems biology, and their synergetic roles in understanding learning, memory and cognition, thereby bridging the gap between computational neuroscience, systems biology and computational intelligence. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Neural basis for dynamic updating of object representation in visual working memory.

Science.gov (United States)

Takahama, Sachiko; Miyauchi, Satoru; Saiki, Jun

2010-02-15

In real world, objects have multiple features and change dynamically. Thus, object representations must satisfy dynamic updating and feature binding. Previous studies have investigated the neural activity of dynamic updating or feature binding alone, but not both simultaneously. We investigated the neural basis of feature-bound object representation in a dynamically updating situation by conducting a multiple object permanence tracking task, which required observers to simultaneously process both the maintenance and dynamic updating of feature-bound objects. Using an event-related design, we separated activities during memory maintenance and change detection. In the search for regions showing selective activation in dynamic updating of feature-bound objects, we identified a network during memory maintenance that was comprised of the inferior precentral sulcus, superior parietal lobule, and middle frontal gyrus. In the change detection period, various prefrontal regions, including the anterior prefrontal cortex, were activated. In updating object representation of dynamically moving objects, the inferior precentral sulcus closely cooperates with a so-called "frontoparietal network", and subregions of the frontoparietal network can be decomposed into those sensitive to spatial updating and feature binding. The anterior prefrontal cortex identifies changes in object representation by comparing memory and perceptual representations rather than maintaining object representations per se, as previously suggested. Copyright 2009 Elsevier Inc. All rights reserved.

Forecasting influenza-like illness dynamics for military populations using neural networks and social media.

Directory of Open Access Journals (Sweden)

Svitlana Volkova

Full Text Available This work is the first to take advantage of recurrent neural networks to predict influenza-like illness (ILI dynamics from various linguistic signals extracted from social media data. Unlike other approaches that rely on timeseries analysis of historical ILI data and the state-of-the-art machine learning models, we build and evaluate the predictive power of neural network architectures based on Long Short Term Memory (LSTMs units capable of nowcasting (predicting in "real-time" and forecasting (predicting the future ILI dynamics in the 2011 - 2014 influenza seasons. To build our models we integrate information people post in social media e.g., topics, embeddings, word ngrams, stylistic patterns, and communication behavior using hashtags and mentions. We then quantitatively evaluate the predictive power of different social media signals and contrast the performance of the-state-of-the-art regression models with neural networks using a diverse set of evaluation metrics. Finally, we combine ILI and social media signals to build a joint neural network model for ILI dynamics prediction. Unlike the majority of the existing work, we specifically focus on developing models for local rather than national ILI surveillance, specifically for military rather than general populations in 26 U.S. and six international locations., and analyze how model performance depends on the amount of social media data available per location. Our approach demonstrates several advantages: (a Neural network architectures that rely on LSTM units trained on social media data yield the best performance compared to previously used regression models. (b Previously under-explored language and communication behavior features are more predictive of ILI dynamics than stylistic and topic signals expressed in social media. (c Neural network models learned exclusively from social media signals yield comparable or better performance to the models learned from ILI historical data, thus

Forecasting influenza-like illness dynamics for military populations using neural networks and social media.

Science.gov (United States)

Volkova, Svitlana; Ayton, Ellyn; Porterfield, Katherine; Corley, Courtney D

2017-01-01

This work is the first to take advantage of recurrent neural networks to predict influenza-like illness (ILI) dynamics from various linguistic signals extracted from social media data. Unlike other approaches that rely on timeseries analysis of historical ILI data and the state-of-the-art machine learning models, we build and evaluate the predictive power of neural network architectures based on Long Short Term Memory (LSTMs) units capable of nowcasting (predicting in "real-time") and forecasting (predicting the future) ILI dynamics in the 2011 - 2014 influenza seasons. To build our models we integrate information people post in social media e.g., topics, embeddings, word ngrams, stylistic patterns, and communication behavior using hashtags and mentions. We then quantitatively evaluate the predictive power of different social media signals and contrast the performance of the-state-of-the-art regression models with neural networks using a diverse set of evaluation metrics. Finally, we combine ILI and social media signals to build a joint neural network model for ILI dynamics prediction. Unlike the majority of the existing work, we specifically focus on developing models for local rather than national ILI surveillance, specifically for military rather than general populations in 26 U.S. and six international locations., and analyze how model performance depends on the amount of social media data available per location. Our approach demonstrates several advantages: (a) Neural network architectures that rely on LSTM units trained on social media data yield the best performance compared to previously used regression models. (b) Previously under-explored language and communication behavior features are more predictive of ILI dynamics than stylistic and topic signals expressed in social media. (c) Neural network models learned exclusively from social media signals yield comparable or better performance to the models learned from ILI historical data, thus, signals from

Dynamic neural network-based methods for compensation of nonlinear effects in multimode communication lines

Science.gov (United States)

Sidelnikov, O. S.; Redyuk, A. A.; Sygletos, S.

2017-12-01

We consider neural network-based schemes of digital signal processing. It is shown that the use of a dynamic neural network-based scheme of signal processing ensures an increase in the optical signal transmission quality in comparison with that provided by other methods for nonlinear distortion compensation.

Magnetic field induced dynamical chaos.

Science.gov (United States)

Ray, Somrita; Baura, Alendu; Bag, Bidhan Chandra

2013-12-01

In this article, we have studied the dynamics of a particle having charge in the presence of a magnetic field. The motion of the particle is confined in the x-y plane under a two dimensional nonlinear potential. We have shown that constant magnetic field induced dynamical chaos is possible even for a force which is derived from a simple potential. For a given strength of the magnetic field, initial position, and velocity of the particle, the dynamics may be regular, but it may become chaotic when the field is time dependent. Chaotic dynamics is very often if the field is time dependent. Origin of chaos has been explored using the Hamiltonian function of the dynamics in terms of action and angle variables. Applicability of the present study has been discussed with a few examples.

Application of artificial neural networks for predicting the impact of rolling dynamic compaction using dynamic cone penetrometer test results

Directory of Open Access Journals (Sweden)

R.A.T.M. Ranasinghe

2017-04-01

Full Text Available Rolling dynamic compaction (RDC, which involves the towing of a noncircular module, is now widespread and accepted among many other soil compaction methods. However, to date, there is no accurate method for reliable prediction of the densification of soil and the extent of ground improvement by means of RDC. This study presents the application of artificial neural networks (ANNs for a priori prediction of the effectiveness of RDC. The models are trained with in situ dynamic cone penetration (DCP test data obtained from previous civil projects associated with the 4-sided impact roller. The predictions from the ANN models are in good agreement with the measured field data, as indicated by the model correlation coefficient of approximately 0.8. It is concluded that the ANN models developed in this study can be successfully employed to provide more accurate prediction of the performance of the RDC on a range of soil types.

Complex Dynamical Network Control for Trajectory Tracking Using Delayed Recurrent Neural Networks

Directory of Open Access Journals (Sweden)

Jose P. Perez

2014-01-01

Full Text Available In this paper, the problem of trajectory tracking is studied. Based on the V-stability and Lyapunov theory, a control law that achieves the global asymptotic stability of the tracking error between a delayed recurrent neural network and a complex dynamical network is obtained. To illustrate the analytic results, we present a tracking simulation of a dynamical network with each node being just one Lorenz’s dynamical system and three identical Chen’s dynamical systems.

Dynamics and genetic fuzzy neural network vibration control design of a smart flexible four-bar linkage mechanism

International Nuclear Information System (INIS)

Rong Bao; Rui Xiaoting; Tao Ling

2012-01-01

In this paper, a dynamic modeling method and an active vibration control scheme for a smart flexible four-bar linkage mechanism featuring piezoelectric actuators and strain gauge sensors are presented. The dynamics of this smart mechanism is described by the Discrete Time Transfer Matrix Method of Multibody System (MS-DTTMM). Then a nonlinear fuzzy neural network control is employed to suppress the vibration of this smart mechanism. For improving the dynamic performance of the fuzzy neural network, a genetic algorithm based on the MS-DTTMM is designed offline to tune the initial parameters of the fuzzy neural network. The MS-DTTMM avoids the global dynamics equations of the system, which results in the matrices involved are always very small, so the computational efficiency of the dynamic analysis and control system optimization can be greatly improved. Formulations of the method as well as a numerical simulation are given to demonstrate the proposed dynamic method and control scheme.

Out-of-equilibrium dynamical mean-field equations for the perceptron model

Science.gov (United States)

Agoritsas, Elisabeth; Biroli, Giulio; Urbani, Pierfrancesco; Zamponi, Francesco

2018-02-01

Perceptrons are the building blocks of many theoretical approaches to a wide range of complex systems, ranging from neural networks and deep learning machines, to constraint satisfaction problems, glasses and ecosystems. Despite their applicability and importance, a detailed study of their Langevin dynamics has never been performed yet. Here we derive the mean-field dynamical equations that describe the continuous random perceptron in the thermodynamic limit, in a very general setting with arbitrary noise and friction kernels, not necessarily related by equilibrium relations. We derive the equations in two ways: via a dynamical cavity method, and via a path-integral approach in its supersymmetric formulation. The end point of both approaches is the reduction of the dynamics of the system to an effective stochastic process for a representative dynamical variable. Because the perceptron is formally very close to a system of interacting particles in a high dimensional space, the methods we develop here can be transferred to the study of liquid and glasses in high dimensions. Potentially interesting applications are thus the study of the glass transition in active matter, the study of the dynamics around the jamming transition, and the calculation of rheological properties in driven systems.

Predicting physical time series using dynamic ridge polynomial neural networks.

Directory of Open Access Journals (Sweden)

Dhiya Al-Jumeily

Full Text Available Forecasting naturally occurring phenomena is a common problem in many domains of science, and this has been addressed and investigated by many scientists. The importance of time series prediction stems from the fact that it has wide range of applications, including control systems, engineering processes, environmental systems and economics. From the knowledge of some aspects of the previous behaviour of the system, the aim of the prediction process is to determine or predict its future behaviour. In this paper, we consider a novel application of a higher order polynomial neural network architecture called Dynamic Ridge Polynomial Neural Network that combines the properties of higher order and recurrent neural networks for the prediction of physical time series. In this study, four types of signals have been used, which are; The Lorenz attractor, mean value of the AE index, sunspot number, and heat wave temperature. The simulation results showed good improvements in terms of the signal to noise ratio in comparison to a number of higher order and feedforward neural networks in comparison to the benchmarked techniques.

A Neural Theory of Visual Attention: Bridging Cognition and Neurophysiology

Science.gov (United States)

Bundesen, Claus; Habekost, Thomas; Kyllingsbaek, Soren

2005-01-01

A neural theory of visual attention (NTVA) is presented. NTVA is a neural interpretation of C. Bundesen's (1990) theory of visual attention (TVA). In NTVA, visual processing capacity is distributed across stimuli by dynamic remapping of receptive fields of cortical cells such that more processing resources (cells) are devoted to behaviorally…

Stochastic Neural Field Theory and the System-Size Expansion

KAUST Repository

Bressloff, Paul C.

2010-01-01

We analyze a master equation formulation of stochastic neurodynamics for a network of synaptically coupled homogeneous neuronal populations each consisting of N identical neurons. The state of the network is specified by the fraction of active or spiking neurons in each population, and transition rates are chosen so that in the thermodynamic or deterministic limit (N → ∞) we recover standard activity-based or voltage-based rate models. We derive the lowest order corrections to these rate equations for large but finite N using two different approximation schemes, one based on the Van Kampen system-size expansion and the other based on path integral methods. Both methods yield the same series expansion of the moment equations, which at O(1/N) can be truncated to form a closed system of equations for the first-and second-order moments. Taking a continuum limit of the moment equations while keeping the system size N fixed generates a system of integrodifferential equations for the mean and covariance of the corresponding stochastic neural field model. We also show how the path integral approach can be used to study large deviation or rare event statistics underlying escape from the basin of attraction of a stable fixed point of the mean-field dynamics; such an analysis is not possible using the system-size expansion since the latter cannot accurately determine exponentially small transitions. © by SIAM.

Advanced neural network-based computational schemes for robust fault diagnosis

CERN Document Server

Mrugalski, Marcin

2014-01-01

The present book is devoted to problems of adaptation of artificial neural networks to robust fault diagnosis schemes. It presents neural networks-based modelling and estimation techniques used for designing robust fault diagnosis schemes for non-linear dynamic systems. A part of the book focuses on fundamental issues such as architectures of dynamic neural networks, methods for designing of neural networks and fault diagnosis schemes as well as the importance of robustness. The book is of a tutorial value and can be perceived as a good starting point for the new-comers to this field. The book is also devoted to advanced schemes of description of neural model uncertainty. In particular, the methods of computation of neural networks uncertainty with robust parameter estimation are presented. Moreover, a novel approach for system identification with the state-space GMDH neural network is delivered. All the concepts described in this book are illustrated by both simple academic illustrative examples and practica...

A constructive mean-field analysis of multi-population neural networks with random synaptic weights and stochastic inputs.

Science.gov (United States)

Faugeras, Olivier; Touboul, Jonathan; Cessac, Bruno

2009-01-01

We deal with the problem of bridging the gap between two scales in neuronal modeling. At the first (microscopic) scale, neurons are considered individually and their behavior described by stochastic differential equations that govern the time variations of their membrane potentials. They are coupled by synaptic connections acting on their resulting activity, a nonlinear function of their membrane potential. At the second (mesoscopic) scale, interacting populations of neurons are described individually by similar equations. The equations describing the dynamical and the stationary mean-field behaviors are considered as functional equations on a set of stochastic processes. Using this new point of view allows us to prove that these equations are well-posed on any finite time interval and to provide a constructive method for effectively computing their unique solution. This method is proved to converge to the unique solution and we characterize its complexity and convergence rate. We also provide partial results for the stationary problem on infinite time intervals. These results shed some new light on such neural mass models as the one of Jansen and Rit (1995): their dynamics appears as a coarse approximation of the much richer dynamics that emerges from our analysis. Our numerical experiments confirm that the framework we propose and the numerical methods we derive from it provide a new and powerful tool for the exploration of neural behaviors at different scales.

Adaptive dynamic inversion robust control for BTT missile based on wavelet neural network

Science.gov (United States)

Li, Chuanfeng; Wang, Yongji; Deng, Zhixiang; Wu, Hao

2009-10-01

A new nonlinear control strategy incorporated the dynamic inversion method with wavelet neural networks is presented for the nonlinear coupling system of Bank-to-Turn(BTT) missile in reentry phase. The basic control law is designed by using the dynamic inversion feedback linearization method, and the online learning wavelet neural network is used to compensate the inversion error due to aerodynamic parameter errors, modeling imprecise and external disturbance in view of the time-frequency localization properties of wavelet transform. Weights adjusting laws are derived according to Lyapunov stability theory, which can guarantee the boundedness of all signals in the whole system. Furthermore, robust stability of the closed-loop system under this tracking law is proved. Finally, the six degree-of-freedom(6DOF) simulation results have shown that the attitude angles can track the anticipant command precisely under the circumstances of existing external disturbance and in the presence of parameter uncertainty. It means that the dependence on model by dynamic inversion method is reduced and the robustness of control system is enhanced by using wavelet neural network(WNN) to reconstruct inversion error on-line.

Pattern recognition neural-net by spatial mapping of biology visual field

Science.gov (United States)

Lin, Xin; Mori, Masahiko

2000-05-01

The method of spatial mapping in biology vision field is applied to artificial neural networks for pattern recognition. By the coordinate transform that is called the complex-logarithm mapping and Fourier transform, the input images are transformed into scale- rotation- and shift- invariant patterns, and then fed into a multilayer neural network for learning and recognition. The results of computer simulation and an optical experimental system are described.

Lukasiewicz-Topos Models of Neural Networks, Cell Genome and Interactome Nonlinear Dynamic Models

CERN Document Server

Baianu, I C

2004-01-01

A categorical and Lukasiewicz-Topos framework for Lukasiewicz Algebraic Logic models of nonlinear dynamics in complex functional systems such as neural networks, genomes and cell interactomes is proposed. Lukasiewicz Algebraic Logic models of genetic networks and signaling pathways in cells are formulated in terms of nonlinear dynamic systems with n-state components that allow for the generalization of previous logical models of both genetic activities and neural networks. An algebraic formulation of variable 'next-state functions' is extended to a Lukasiewicz Topos with an n-valued Lukasiewicz Algebraic Logic subobject classifier description that represents non-random and nonlinear network activities as well as their transformations in developmental processes and carcinogenesis.

Quantum dynamics in transverse-field Ising models from classical networks

Directory of Open Access Journals (Sweden)

Markus Schmitt, Markus Heyl

2018-02-01

Full Text Available The efficient representation of quantum many-body states with classical resources is a key challenge in quantum many-body theory. In this work we analytically construct classical networks for the description of the quantum dynamics in transverse-field Ising models that can be solved efficiently using Monte Carlo techniques. Our perturbative construction encodes time-evolved quantum states of spin-1/2 systems in a network of classical spins with local couplings and can be directly generalized to other spin systems and higher spins. Using this construction we compute the transient dynamics in one, two, and three dimensions including local observables, entanglement production, and Loschmidt amplitudes using Monte Carlo algorithms and demonstrate the accuracy of this approach by comparisons to exact results. We include a mapping to equivalent artificial neural networks, which were recently introduced to provide a universal structure for classical network wave functions.

Robustness analysis of uncertain dynamical neural networks with multiple time delays.

Science.gov (United States)

Senan, Sibel

2015-10-01

This paper studies the problem of global robust asymptotic stability of the equilibrium point for the class of dynamical neural networks with multiple time delays with respect to the class of slope-bounded activation functions and in the presence of the uncertainties of system parameters of the considered neural network model. By using an appropriate Lyapunov functional and exploiting the properties of the homeomorphism mapping theorem, we derive a new sufficient condition for the existence, uniqueness and global robust asymptotic stability of the equilibrium point for the class of neural networks with multiple time delays. The obtained stability condition basically relies on testing some relationships imposed on the interconnection matrices of the neural system, which can be easily verified by using some certain properties of matrices. An instructive numerical example is also given to illustrate the applicability of our result and show the advantages of this new condition over the previously reported corresponding results. Copyright © 2015 Elsevier Ltd. All rights reserved.

Alternating current electric field effects on neural stem cell viability and differentiation.

Science.gov (United States)

Matos, Marvi A; Cicerone, Marcus T

2010-01-01

Methods utilizing stem cells hold tremendous promise for tissue engineering applications; however, many issues must be worked out before these therapies can be routinely applied. Utilization of external cues for preimplantation expansion and differentiation offers a potentially viable approach to the use of stem cells in tissue engineering. The studies reported here focus on the response of murine neural stem cells encapsulated in alginate hydrogel beads to alternating current electric fields. Cell viability and differentiation was studied as a function of electric field magnitude and frequency. We applied fields of frequency (0.1-10) Hz, and found a marked peak in neural stem cell viability under oscillatory electric fields with a frequency of 1 Hz. We also found an enhanced propensity for astrocyte differentiation over neuronal differentiation in the 1 Hz cultures, as compared to the other field frequencies we studied. Published 2010 American Institute of Chemical Engineers

A self-organizing model of perisaccadic visual receptive field dynamics in primate visual and oculomotor system.

Science.gov (United States)

Mender, Bedeho M W; Stringer, Simon M

2015-01-01

We propose and examine a model for how perisaccadic visual receptive field dynamics, observed in a range of primate brain areas such as LIP, FEF, SC, V3, V3A, V2, and V1, may develop through a biologically plausible process of unsupervised visually guided learning. These dynamics are associated with remapping, which is the phenomenon where receptive fields anticipate the consequences of saccadic eye movements. We find that a neural network model using a local associative synaptic learning rule, when exposed to visual scenes in conjunction with saccades, can account for a range of associated phenomena. In particular, our model demonstrates predictive and pre-saccadic remapping, responsiveness shifts around the time of saccades, and remapping from multiple directions.

DO DYNAMIC NEURAL NETWORKS STAND A BETTER CHANCE IN FRACTIONALLY INTEGRATED PROCESS FORECASTING?

Directory of Open Access Journals (Sweden)

Majid Delavari

2013-04-01

Full Text Available The main purpose of the present study was to investigate the capabilities of two generations of models such as those based on dynamic neural network (e.g., Nonlinear Neural network Auto Regressive or NNAR model and a regressive (Auto Regressive Fractionally Integrated Moving Average model which is based on Fractional Integration Approach in forecasting daily data related to the return index of Tehran Stock Exchange (TSE. In order to compare these models under similar conditions, Mean Square Error (MSE and also Root Mean Square Error (RMSE were selected as criteria for the models’ simulated out-of-sample forecasting performance. Besides, fractal markets hypothesis was examined and according to the findings, fractal structure was confirmed to exist in the time series under investigation. Another finding of the study was that dynamic artificial neural network model had the best performance in out-of-sample forecasting based on the criteria introduced for calculating forecasting error in comparison with the ARFIMA model.

Gradient Learning in Spiking Neural Networks by Dynamic Perturbation of Conductances

International Nuclear Information System (INIS)

Fiete, Ila R.; Seung, H. Sebastian

2006-01-01

We present a method of estimating the gradient of an objective function with respect to the synaptic weights of a spiking neural network. The method works by measuring the fluctuations in the objective function in response to dynamic perturbation of the membrane conductances of the neurons. It is compatible with recurrent networks of conductance-based model neurons with dynamic synapses. The method can be interpreted as a biologically plausible synaptic learning rule, if the dynamic perturbations are generated by a special class of 'empiric' synapses driven by random spike trains from an external source

Neural dynamics of motion perception: direction fields, apertures, and resonant grouping.

Science.gov (United States)

Grossberg, S; Mingolla, E

1993-03-01

A neural network model of global motion segmentation by visual cortex is described. Called the motion boundary contour system (BCS), the model clarifies how ambiguous local movements on a complex moving shape are actively reorganized into a coherent global motion signal. Unlike many previous researchers, we analyze how a coherent motion signal is imparted to all regions of a moving figure, not only to regions at which unambiguous motion signals exist. The model hereby suggests a solution to the global aperture problem. The motion BCS describes how preprocessing of motion signals by a motion oriented contrast (MOC) filter is joined to long-range cooperative grouping mechanisms in a motion cooperative-competitive (MOCC) loop to control phenomena such as motion capture. The motion BCS is computed in parallel with the static BCS of Grossberg and Mingolla (1985a, 1985b, 1987). Homologous properties of the motion BCS and the static BCS, specialized to process motion directions and static orientations, respectively, support a unified explanation of many data about static form perception and motion form perception that have heretofore been unexplained or treated separately. Predictions about microscopic computational differences of the parallel cortical streams V1-->MT and V1-->V2-->MT are made--notably, the magnocellular thick stripe and parvocellular interstripe streams. It is shown how the motion BCS can compute motion directions that may be synthesized from multiple orientations with opposite directions of contrast. Interactions of model simple cells, complex cells, hyper-complex cells, and bipole cells are described, with special emphasis given to new functional roles in direction disambiguation for endstopping at multiple processing stages and to the dynamic interplay of spatially short-range and long-range interactions.

The simplest problem in the collective dynamics of neural networks: is synchrony stable?

International Nuclear Information System (INIS)

Timme, Marc; Wolf, Fred

2008-01-01

For spiking neural networks we consider the stability problem of global synchrony, arguably the simplest non-trivial collective dynamics in such networks. We find that even this simplest dynamical problem—local stability of synchrony—is non-trivial to solve and requires novel methods for its solution. In particular, the discrete mode of pulsed communication together with the complicated connectivity of neural interaction networks requires a non-standard approach. The dynamics in the vicinity of the synchronous state is determined by a multitude of linear operators, in contrast to a single stability matrix in conventional linear stability theory. This unusual property qualitatively depends on network topology and may be neglected for globally coupled homogeneous networks. For generic networks, however, the number of operators increases exponentially with the size of the network. We present methods to treat this multi-operator problem exactly. First, based on the Gershgorin and Perron–Frobenius theorems, we derive bounds on the eigenvalues that provide important information about the synchronization process but are not sufficient to establish the asymptotic stability or instability of the synchronous state. We then present a complete analysis of asymptotic stability for topologically strongly connected networks using simple graph-theoretical considerations. For inhibitory interactions between dissipative (leaky) oscillatory neurons the synchronous state is stable, independent of the parameters and the network connectivity. These results indicate that pulse-like interactions play a profound role in network dynamical systems, and in particular in the dynamics of biological synchronization, unless the coupling is homogeneous and all-to-all. The concepts introduced here are expected to also facilitate the exact analysis of more complicated dynamical network states, for instance the irregular balanced activity in cortical neural networks

Firing rate dynamics in recurrent spiking neural networks with intrinsic and network heterogeneity.

Science.gov (United States)

Ly, Cheng

2015-12-01

Heterogeneity of neural attributes has recently gained a lot of attention and is increasing recognized as a crucial feature in neural processing. Despite its importance, this physiological feature has traditionally been neglected in theoretical studies of cortical neural networks. Thus, there is still a lot unknown about the consequences of cellular and circuit heterogeneity in spiking neural networks. In particular, combining network or synaptic heterogeneity and intrinsic heterogeneity has yet to be considered systematically despite the fact that both are known to exist and likely have significant roles in neural network dynamics. In a canonical recurrent spiking neural network model, we study how these two forms of heterogeneity lead to different distributions of excitatory firing rates. To analytically characterize how these types of heterogeneities affect the network, we employ a dimension reduction method that relies on a combination of Monte Carlo simulations and probability density function equations. We find that the relationship between intrinsic and network heterogeneity has a strong effect on the overall level of heterogeneity of the firing rates. Specifically, this relationship can lead to amplification or attenuation of firing rate heterogeneity, and these effects depend on whether the recurrent network is firing asynchronously or rhythmically firing. These observations are captured with the aforementioned reduction method, and furthermore simpler analytic descriptions based on this dimension reduction method are developed. The final analytic descriptions provide compact and descriptive formulas for how the relationship between intrinsic and network heterogeneity determines the firing rate heterogeneity dynamics in various settings.

A solution for two-dimensional mazes with use of chaotic dynamics in a recurrent neural network model.

Science.gov (United States)

Suemitsu, Yoshikazu; Nara, Shigetoshi

2004-09-01

Chaotic dynamics introduced into a neural network model is applied to solving two-dimensional mazes, which are ill-posed problems. A moving object moves from the position at t to t + 1 by simply defined motion function calculated from firing patterns of the neural network model at each time step t. We have embedded several prototype attractors that correspond to the simple motion of the object orienting toward several directions in two-dimensional space in our neural network model. Introducing chaotic dynamics into the network gives outputs sampled from intermediate state points between embedded attractors in a state space, and these dynamics enable the object to move in various directions. System parameter switching between a chaotic and an attractor regime in the state space of the neural network enables the object to move to a set target in a two-dimensional maze. Results of computer simulations show that the success rate for this method over 300 trials is higher than that of random walk. To investigate why the proposed method gives better performance, we calculate and discuss statistical data with respect to dynamical structure.

Rock property estimates using multiple seismic attributes and neural networks; Pegasus Field, West Texas

Energy Technology Data Exchange (ETDEWEB)

Schuelke, J.S.; Quirein, J.A.; Sarg, J.F.

1998-12-31

This case study shows the benefit of using multiple seismic trace attributes and the pattern recognition capabilities of neural networks to predict reservoir architecture and porosity distribution in the Pegasus Field, West Texas. The study used the power of neural networks to integrate geologic, borehole and seismic data. Illustrated are the improvements between the new neural network approach and the more traditional method of seismic trace inversion for porosity estimation. Comprehensive statistical methods and interpretational/subjective measures are used in the prediction of porosity from seismic attributes. A 3-D volume of seismic derived porosity estimates for the Devonian reservoir provide a very detailed estimate of porosity, both spatially and vertically, for the field. The additional reservoir porosity detail provided, between the well control, allows for optimal placement of horizontal wells and improved field development. 6 refs., 2 figs.

Effects of Aging on Cortical Neural Dynamics and Local Sleep Homeostasis in Mice.

Science.gov (United States)

McKillop, Laura E; Fisher, Simon P; Cui, Nanyi; Peirson, Stuart N; Foster, Russell G; Wafford, Keith A; Vyazovskiy, Vladyslav V

2018-04-18

Healthy aging is associated with marked effects on sleep, including its daily amount and architecture, as well as the specific EEG oscillations. Neither the neurophysiological underpinnings nor the biological significance of these changes are understood, and crucially the question remains whether aging is associated with reduced sleep need or a diminished capacity to generate sufficient sleep. Here we tested the hypothesis that aging may affect local cortical networks, disrupting the capacity to generate and sustain sleep oscillations, and with it the local homeostatic response to sleep loss. We performed chronic recordings of cortical neural activity and local field potentials from the motor cortex in young and older male C57BL/6J mice, during spontaneous waking and sleep, as well as during sleep after sleep deprivation. In older animals, we observed an increase in the incidence of non-rapid eye movement sleep local field potential slow waves and their associated neuronal silent (OFF) periods, whereas the overall pattern of state-dependent cortical neuronal firing was generally similar between ages. Furthermore, we observed that the response to sleep deprivation at the level of local cortical network activity was not affected by aging. Our data thus suggest that the local cortical neural dynamics and local sleep homeostatic mechanisms, at least in the motor cortex, are not impaired during healthy senescence in mice. This indicates that powerful protective or compensatory mechanisms may exist to maintain neuronal function stable across the life span, counteracting global changes in sleep amount and architecture. SIGNIFICANCE STATEMENT The biological significance of age-dependent changes in sleep is unknown but may reflect either a diminished sleep need or a reduced capacity to generate deep sleep stages. As aging has been linked to profound disruptions in cortical sleep oscillations and because sleep need is reflected in specific patterns of cortical activity, we

Data Driven Broiler Weight Forecasting using Dynamic Neural Network Models

DEFF Research Database (Denmark)

Johansen, Simon Vestergaard; Bendtsen, Jan Dimon; Riisgaard-Jensen, Martin

2017-01-01

In this article, the dynamic influence of environmental broiler house conditions and broiler growth is investigated. Dynamic neural network forecasting models have been trained on farm-scale broiler batch production data from 12 batches from the same house. The model forecasts future broiler weight...... and uses environmental conditions such as heating, ventilation, and temperature along with broiler behavior such as feed and water consumption. Training data and forecasting data is analyzed to explain when the model might fail at generalizing. We present ensemble broiler weight forecasts to day 7, 14, 21...

Action Potential Modulation of Neural Spin Networks Suggests Possible Role of Spin

CERN Document Server

Hu, H P

2004-01-01

In this paper we show that nuclear spin networks in neural membranes are modulated by action potentials through J-coupling, dipolar coupling and chemical shielding tensors and perturbed by microscopically strong and fluctuating internal magnetic fields produced largely by paramagnetic oxygen. We suggest that these spin networks could be involved in brain functions since said modulation inputs information carried by the neural spike trains into them, said perturbation activates various dynamics within them and the combination of the two likely produce stochastic resonance thus synchronizing said dynamics to the neural firings. Although quantum coherence is desirable and may indeed exist, it is not required for these spin networks to serve as the subatomic components for the conventional neural networks.

Research on wind field algorithm of wind lidar based on BP neural network and grey prediction

Science.gov (United States)

Chen, Yong; Chen, Chun-Li; Luo, Xiong; Zhang, Yan; Yang, Ze-hou; Zhou, Jie; Shi, Xiao-ding; Wang, Lei

2018-01-01

This paper uses the BP neural network and grey algorithm to forecast and study radar wind field. In order to reduce the residual error in the wind field prediction which uses BP neural network and grey algorithm, calculating the minimum value of residual error function, adopting the residuals of the gray algorithm trained by BP neural network, using the trained network model to forecast the residual sequence, using the predicted residual error sequence to modify the forecast sequence of the grey algorithm. The test data show that using the grey algorithm modified by BP neural network can effectively reduce the residual value and improve the prediction precision.

Design of Neural Networks for Fast Convergence and Accuracy: Dynamics and Control

Science.gov (United States)

Maghami, Peiman G.; Sparks, Dean W., Jr.

1997-01-01

A procedure for the design and training of artificial neural networks, used for rapid and efficient controls and dynamics design and analysis for flexible space systems, has been developed. Artificial neural networks are employed, such that once properly trained, they provide a means of evaluating the impact of design changes rapidly. Specifically, two-layer feedforward neural networks are designed to approximate the functional relationship between the component/spacecraft design changes and measures of its performance or nonlinear dynamics of the system/components. A training algorithm, based on statistical sampling theory, is presented, which guarantees that the trained networks provide a designer-specified degree of accuracy in mapping the functional relationship. Within each iteration of this statistical-based algorithm, a sequential design algorithm is used for the design and training of the feedforward network to provide rapid convergence to the network goals. Here, at each sequence a new network is trained to minimize the error of previous network. The proposed method should work for applications wherein an arbitrary large source of training data can be generated. Two numerical examples are performed on a spacecraft application in order to demonstrate the feasibility of the proposed approach.

Models of neural dynamics in brain information processing - the developments of 'the decade'

Energy Technology Data Exchange (ETDEWEB)

Borisyuk, G N; Borisyuk, R M; Kazanovich, Yakov B [Institute of Mathematical Problems of Biology, Russian Academy of Sciences, Pushchino, Moscow region (Russian Federation); Ivanitskii, Genrikh R [Institute for Theoretical and Experimental Biophysics, Russian Academy of Sciences, Pushchino, Moscow region (Russian Federation)

2002-10-31

Neural network models are discussed that have been developed during the last decade with the purpose of reproducing spatio-temporal patterns of neural activity in different brain structures. The main goal of the modeling was to test hypotheses of synchronization, temporal and phase relations in brain information processing. The models being considered are those of temporal structure of spike sequences, of neural activity dynamics, and oscillatory models of attention and feature integration. (reviews of topical problems)

Neural network-based adaptive dynamic surface control for permanent magnet synchronous motors.

Science.gov (United States)

Yu, Jinpeng; Shi, Peng; Dong, Wenjie; Chen, Bing; Lin, Chong

2015-03-01

This brief considers the problem of neural networks (NNs)-based adaptive dynamic surface control (DSC) for permanent magnet synchronous motors (PMSMs) with parameter uncertainties and load torque disturbance. First, NNs are used to approximate the unknown and nonlinear functions of PMSM drive system and a novel adaptive DSC is constructed to avoid the explosion of complexity in the backstepping design. Next, under the proposed adaptive neural DSC, the number of adaptive parameters required is reduced to only one, and the designed neural controllers structure is much simpler than some existing results in literature, which can guarantee that the tracking error converges to a small neighborhood of the origin. Then, simulations are given to illustrate the effectiveness and potential of the new design technique.

Predicting local field potentials with recurrent neural networks.

Science.gov (United States)

Kim, Louis; Harer, Jacob; Rangamani, Akshay; Moran, James; Parks, Philip D; Widge, Alik; Eskandar, Emad; Dougherty, Darin; Chin, Sang Peter

2016-08-01

We present a Recurrent Neural Network using LSTM (Long Short Term Memory) that is capable of modeling and predicting Local Field Potentials. We train and test the network on real data recorded from epilepsy patients. We construct networks that predict multi-channel LFPs for 1, 10, and 100 milliseconds forward in time. Our results show that prediction using LSTM outperforms regression when predicting 10 and 100 millisecond forward in time.

A Neural Information Field Approach to Computational Cognition

Science.gov (United States)

2016-11-18

effects of distraction during list memory . These distractions include short and long delays before recall, and continuous distraction (forced rehearsal... memory encoding and replay in hippocampus. Computational Neuroscience Society (CNS), p. 166, 2014. D. A. Pinotsis, Neural Field Coding of Short Term ...performance of children learning to count in a SPA model; proposed a new SPA model of cognitive load using the N-back task; developed a new model of the

Neural networks dynamic hysteresis model for piezoceramic actuator based on hysteresis operator of first-order differential equation

International Nuclear Information System (INIS)

Dang Xuanju; Tan Yonghong

2005-01-01

A new neural networks dynamic hysteresis model for piezoceramic actuator is proposed by combining the Preisach model with diagonal recurrent neural networks. The Preisach model is based on elementary rate-independent operators and is not suitable for modeling piezoceramic actuator across a wide frequency band because of the rate-dependent hysteresis characteristic of the piezoceramic actuator. The structure of the developed model is based on the structure of the Preisach model, in which the rate-independent relay hysteresis operators (cells) are replaced by the rate-dependent hysteresis operators of first-order differential equation. The diagonal recurrent neural networks being modified by an adjustable factor can be used to model the hysteresis behavior of the pizeoceramic actuator because its structure is similar to the structure of the modified Preisach model. Therefore, the proposed model not only possesses that of the Preisach model, but also can be used for describing its dynamic hysteresis behavior. Through the experimental results of both the approximation and the prediction, the effectiveness of the neural networks dynamic hysteresis model for the piezoceramic actuator is demonstrated

Forecasting financial asset processes: stochastic dynamics via learning neural networks.

Science.gov (United States)

Giebel, S; Rainer, M

2010-01-01

Models for financial asset dynamics usually take into account their inherent unpredictable nature by including a suitable stochastic component into their process. Unknown (forward) values of financial assets (at a given time in the future) are usually estimated as expectations of the stochastic asset under a suitable risk-neutral measure. This estimation requires the stochastic model to be calibrated to some history of sufficient length in the past. Apart from inherent limitations, due to the stochastic nature of the process, the predictive power is also limited by the simplifying assumptions of the common calibration methods, such as maximum likelihood estimation and regression methods, performed often without weights on the historic time series, or with static weights only. Here we propose a novel method of "intelligent" calibration, using learning neural networks in order to dynamically adapt the parameters of the stochastic model. Hence we have a stochastic process with time dependent parameters, the dynamics of the parameters being themselves learned continuously by a neural network. The back propagation in training the previous weights is limited to a certain memory length (in the examples we consider 10 previous business days), which is similar to the maximal time lag of autoregressive processes. We demonstrate the learning efficiency of the new algorithm by tracking the next-day forecasts for the EURTRY and EUR-HUF exchange rates each.

Dynamical networks: Finding, measuring, and tracking neural population activity using network science

Directory of Open Access Journals (Sweden)

Mark D. Humphries

2017-12-01

Full Text Available Systems neuroscience is in a headlong rush to record from as many neurons at the same time as possible. As the brain computes and codes using neuron populations, it is hoped these data will uncover the fundamentals of neural computation. But with hundreds, thousands, or more simultaneously recorded neurons come the inescapable problems of visualizing, describing, and quantifying their interactions. Here I argue that network science provides a set of scalable, analytical tools that already solve these problems. By treating neurons as nodes and their interactions as links, a single network can visualize and describe an arbitrarily large recording. I show that with this description we can quantify the effects of manipulating a neural circuit, track changes in population dynamics over time, and quantitatively define theoretical concepts of neural populations such as cell assemblies. Using network science as a core part of analyzing population recordings will thus provide both qualitative and quantitative advances to our understanding of neural computation.

Emerging phenomena in neural networks with dynamic synapses and their computational implications

Directory of Open Access Journals (Sweden)

Joaquin J. eTorres

2013-04-01

Full Text Available In this paper we review our research on the effect and computational role of dynamical synapses on feed-forward and recurrent neural networks. Among others, we report on the appearance of a new class of dynamical memories which result from the destabilisation of learned memory attractors. This has important consequences for dynamic information processing allowing the system to sequentially access the information stored in the memories under changing stimuli. Although storage capacity of stable memories also decreases, our study demonstrated the positive effect of synaptic facilitation to recover maximum storage capacity and to enlarge the capacity of the system for memory recall in noisy conditions. Possibly, the new dynamical behaviour can be associated with the voltage transitions between up and down states observed in cortical areas in the brain. We investigated the conditions for which the permanence times in the up state are power-law distributed, which is a sign for criticality, and concluded that the experimentally observed large variability of permanence times could be explained as the result of noisy dynamic synapses with large recovery times. Finally, we report how short-term synaptic processes can transmit weak signals throughout more than one frequency range in noisy neural networks, displaying a kind of stochastic multi-resonance. This effect is due to competition between activity-dependent synaptic fluctuations (due to dynamic synapses and the existence of neuron firing threshold which adapts to the incoming mean synaptic input.

Workshop on Thermal Field Theory to Neural Networks

CERN Document Server

Veneziano, Gabriele; Aurenche, Patrick

1996-01-01

Tanguy Altherr was a Fellow in the Theory Division at CERN, on leave from LAPP (CNRS) Annecy. At the time of his accidental death in July 1994, he was only 31.A meeting was organized at CERN, covering the various aspects of his scientific interests: thermal field theory and its applications to hot or dense media, neural networks and its applications to high energy data analysis. Speakers were among his closest collaborators and friends.

Artificial Neural Network-Based Early-Age Concrete Strength Monitoring Using Dynamic Response Signals.

Science.gov (United States)

Kim, Junkyeong; Lee, Chaggil; Park, Seunghee

2017-06-07

Concrete is one of the most common materials used to construct a variety of civil infrastructures. However, since concrete might be susceptible to brittle fracture, it is essential to confirm the strength of concrete at the early-age stage of the curing process to prevent unexpected collapse. To address this issue, this study proposes a novel method to estimate the early-age strength of concrete, by integrating an artificial neural network algorithm with a dynamic response measurement of the concrete material. The dynamic response signals of the concrete, including both electromechanical impedances and guided ultrasonic waves, are obtained from an embedded piezoelectric sensor module. The cross-correlation coefficient of the electromechanical impedance signals and the amplitude of the guided ultrasonic wave signals are selected to quantify the variation in dynamic responses according to the strength of the concrete. Furthermore, an artificial neural network algorithm is used to verify a relationship between the variation in dynamic response signals and concrete strength. The results of an experimental study confirm that the proposed approach can be effectively applied to estimate the strength of concrete material from the early-age stage of the curing process.

Spatiotemporal Dynamics and Reliable Computations in Recurrent Spiking Neural Networks

Science.gov (United States)

Pyle, Ryan; Rosenbaum, Robert

2017-01-01

Randomly connected networks of excitatory and inhibitory spiking neurons provide a parsimonious model of neural variability, but are notoriously unreliable for performing computations. We show that this difficulty is overcome by incorporating the well-documented dependence of connection probability on distance. Spatially extended spiking networks exhibit symmetry-breaking bifurcations and generate spatiotemporal patterns that can be trained to perform dynamical computations under a reservoir computing framework.

Spatiotemporal Dynamics and Reliable Computations in Recurrent Spiking Neural Networks.

Science.gov (United States)

Pyle, Ryan; Rosenbaum, Robert

2017-01-06

Randomly connected networks of excitatory and inhibitory spiking neurons provide a parsimonious model of neural variability, but are notoriously unreliable for performing computations. We show that this difficulty is overcome by incorporating the well-documented dependence of connection probability on distance. Spatially extended spiking networks exhibit symmetry-breaking bifurcations and generate spatiotemporal patterns that can be trained to perform dynamical computations under a reservoir computing framework.

Dynamics of continuous-time bidirectional associative memory neural networks with impulses and their discrete counterparts

International Nuclear Information System (INIS)

Huo Haifeng; Li Wantong

2009-01-01

This paper is concerned with the global stability characteristics of a system of equations modelling the dynamics of continuous-time bidirectional associative memory neural networks with impulses. Sufficient conditions which guarantee the existence of a unique equilibrium and its exponential stability of the networks are obtained. For the goal of computation, discrete-time analogues of the corresponding continuous-time bidirectional associative memory neural networks with impulses are also formulated and studied. Our results show that the above continuous-time and discrete-time systems with impulses preserve the dynamics of the networks without impulses when we make some modifications and impose some additional conditions on the systems, the convergence characteristics dynamics of the networks are preserved by both continuous-time and discrete-time systems with some restriction imposed on the impulse effect.

Obtaining Arbitrary Prescribed Mean Field Dynamics for Recurrently Coupled Networks of Type-I Spiking Neurons with Analytically Determined Weights

Directory of Open Access Journals (Sweden)

Wilten eNicola

2016-02-01

Full Text Available A fundamental question in computational neuroscience is how to connect a network of spiking neurons to produce desired macroscopic or mean field dynamics. One possible approach is through the Neural Engineering Framework (NEF. The NEF approach requires quantities called decoders which are solved through an optimization problem requiring large matrix inversion. Here, we show how a decoder can be obtained analytically for type I and certain type II firing rates as a function of the heterogeneity of its associated neuron. These decoders generate approximants for functions that converge to the desired function in mean-squared error like 1/N, where N is the number of neurons in the network. We refer to these decoders as scale-invariant decoders due to their structure. These decoders generate weights for a network of neurons through the NEF formula for weights. These weights force the spiking network to have arbitrary and prescribed mean field dynamics. The weights generated with scale-invariant decoders all lie on low dimensional hypersurfaces asymptotically. We demonstrate the applicability of these scale-invariant decoders and weight surfaces by constructing networks of spiking theta neurons that replicate the dynamics of various well known dynamical systems such as the neural integrator, Van der Pol system and the Lorenz system. As these decoders are analytically determined and non-unique, the weights are also analytically determined and non-unique. We discuss the implications for measured weights of neuronal networks

Obtaining Arbitrary Prescribed Mean Field Dynamics for Recurrently Coupled Networks of Type-I Spiking Neurons with Analytically Determined Weights.

Science.gov (United States)

Nicola, Wilten; Tripp, Bryan; Scott, Matthew

2016-01-01

A fundamental question in computational neuroscience is how to connect a network of spiking neurons to produce desired macroscopic or mean field dynamics. One possible approach is through the Neural Engineering Framework (NEF). The NEF approach requires quantities called decoders which are solved through an optimization problem requiring large matrix inversion. Here, we show how a decoder can be obtained analytically for type I and certain type II firing rates as a function of the heterogeneity of its associated neuron. These decoders generate approximants for functions that converge to the desired function in mean-squared error like 1/N, where N is the number of neurons in the network. We refer to these decoders as scale-invariant decoders due to their structure. These decoders generate weights for a network of neurons through the NEF formula for weights. These weights force the spiking network to have arbitrary and prescribed mean field dynamics. The weights generated with scale-invariant decoders all lie on low dimensional hypersurfaces asymptotically. We demonstrate the applicability of these scale-invariant decoders and weight surfaces by constructing networks of spiking theta neurons that replicate the dynamics of various well known dynamical systems such as the neural integrator, Van der Pol system and the Lorenz system. As these decoders are analytically determined and non-unique, the weights are also analytically determined and non-unique. We discuss the implications for measured weights of neuronal networks.

Dynamic neural networking as a basis for plasticity in the control of heart rate.

Science.gov (United States)

Kember, G; Armour, J A; Zamir, M

2013-01-21

A model is proposed in which the relationship between individual neurons within a neural network is dynamically changing to the effect of providing a measure of "plasticity" in the control of heart rate. The neural network on which the model is based consists of three populations of neurons residing in the central nervous system, the intrathoracic extracardiac nervous system, and the intrinsic cardiac nervous system. This hierarchy of neural centers is used to challenge the classical view that the control of heart rate, a key clinical index, resides entirely in central neuronal command (spinal cord, medulla oblongata, and higher centers). Our results indicate that dynamic networking allows for the possibility of an interplay among the three populations of neurons to the effect of altering the order of control of heart rate among them. This interplay among the three levels of control allows for different neural pathways for the control of heart rate to emerge under different blood flow demands or disease conditions and, as such, it has significant clinical implications because current understanding and treatment of heart rate anomalies are based largely on a single level of control and on neurons acting in unison as a single entity rather than individually within a (plastically) interconnected network. Copyright © 2012 Elsevier Ltd. All rights reserved.

Resolution enhancement in neural networks with dynamical synapses

Directory of Open Access Journals (Sweden)

C. C. Alan Fung

2013-06-01

Full Text Available Conventionally, information is represented by spike rates in the neural system. Here, we consider the ability of temporally modulated activities in neuronal networks to carry information extra to spike rates. These temporal modulations, commonly known as population spikes, are due to the presence of synaptic depression in a neuronal network model. We discuss its relevance to an experiment on transparent motions in macaque monkeys by Treue et al. in 2000. They found that if the moving directions of objects are too close, the firing rate profile will be very similar to that with one direction. As the difference in the moving directions of objects is large enough, the neuronal system would respond in such a way that the network enhances the resolution in the moving directions of the objects. In this paper, we propose that this behavior can be reproduced by neural networks with dynamical synapses when there are multiple external inputs. We will demonstrate how resolution enhancement can be achieved, and discuss the conditions under which temporally modulated activities are able to enhance information processing performances in general.

Neural field theory of perceptual echo and implications for estimating brain connectivity

Science.gov (United States)

Robinson, P. A.; Pagès, J. C.; Gabay, N. C.; Babaie, T.; Mukta, K. N.

2018-04-01

Neural field theory is used to predict and analyze the phenomenon of perceptual echo in which random input stimuli at one location are correlated with electroencephalographic responses at other locations. It is shown that this echo correlation (EC) yields an estimate of the transfer function from the stimulated point to other locations. Modal analysis then explains the observed spatiotemporal structure of visually driven EC and the dominance of the alpha frequency; two eigenmodes of similar amplitude dominate the response, leading to temporal beating and a line of low correlation that runs from the crown of the head toward the ears. These effects result from mode splitting and symmetry breaking caused by interhemispheric coupling and cortical folding. It is shown how eigenmodes obtained from functional magnetic resonance imaging experiments can be combined with temporal dynamics from EC or other evoked responses to estimate the spatiotemporal transfer function between any two points and hence their effective connectivity.

Multiplex visibility graphs to investigate recurrent neural network dynamics

Science.gov (United States)

Bianchi, Filippo Maria; Livi, Lorenzo; Alippi, Cesare; Jenssen, Robert

2017-03-01

A recurrent neural network (RNN) is a universal approximator of dynamical systems, whose performance often depends on sensitive hyperparameters. Tuning them properly may be difficult and, typically, based on a trial-and-error approach. In this work, we adopt a graph-based framework to interpret and characterize internal dynamics of a class of RNNs called echo state networks (ESNs). We design principled unsupervised methods to derive hyperparameters configurations yielding maximal ESN performance, expressed in terms of prediction error and memory capacity. In particular, we propose to model time series generated by each neuron activations with a horizontal visibility graph, whose topological properties have been shown to be related to the underlying system dynamics. Successively, horizontal visibility graphs associated with all neurons become layers of a larger structure called a multiplex. We show that topological properties of such a multiplex reflect important features of ESN dynamics that can be used to guide the tuning of its hyperparamers. Results obtained on several benchmarks and a real-world dataset of telephone call data records show the effectiveness of the proposed methods.

Embedding recurrent neural networks into predator-prey models.

Science.gov (United States)

Moreau, Yves; Louiès, Stephane; Vandewalle, Joos; Brenig, Leon

1999-03-01

We study changes of coordinates that allow the embedding of ordinary differential equations describing continuous-time recurrent neural networks into differential equations describing predator-prey models-also called Lotka-Volterra systems. We transform the equations for the neural network first into quasi-monomial form (Brenig, L. (1988). Complete factorization and analytic solutions of generalized Lotka-Volterra equations. Physics Letters A, 133(7-8), 378-382), where we express the vector field of the dynamical system as a linear combination of products of powers of the variables. In practice, this transformation is possible only if the activation function is the hyperbolic tangent or the logistic sigmoid. From this quasi-monomial form, we can directly transform the system further into Lotka-Volterra equations. The resulting Lotka-Volterra system is of higher dimension than the original system, but the behavior of its first variables is equivalent to the behavior of the original neural network. We expect that this transformation will permit the application of existing techniques for the analysis of Lotka-Volterra systems to recurrent neural networks. Furthermore, our results show that Lotka-Volterra systems are universal approximators of dynamical systems, just as are continuous-time neural networks.

Predictive Modeling of Mechanical Properties of Welded Joints Based on Dynamic Fuzzy RBF Neural Network

Directory of Open Access Journals (Sweden)

ZHANG Yongzhi

2016-10-01

Full Text Available A dynamic fuzzy RBF neural network model was built to predict the mechanical properties of welded joints, and the purpose of the model was to overcome the shortcomings of static neural networks including structural identification, dynamic sample training and learning algorithm. The structure and parameters of the model are no longer head of default, dynamic adaptive adjustment in the training, suitable for dynamic sample data for learning, learning algorithm introduces hierarchical learning and fuzzy rule pruning strategy, to accelerate the training speed of model and make the model more compact. Simulation of the model was carried out by using three kinds of thickness and different process TC4 titanium alloy TIG welding test data. The results show that the model has higher prediction accuracy, which is suitable for predicting the mechanical properties of welded joints, and has opened up a new way for the on-line control of the welding process.

Artificial neural networks for control of a grid-connected rectifier/inverter under disturbance, dynamic and power converter switching conditions.

Science.gov (United States)

Li, Shuhui; Fairbank, Michael; Johnson, Cameron; Wunsch, Donald C; Alonso, Eduardo; Proaño, Julio L

2014-04-01

Three-phase grid-connected converters are widely used in renewable and electric power system applications. Traditionally, grid-connected converters are controlled with standard decoupled d-q vector control mechanisms. However, recent studies indicate that such mechanisms show limitations in their applicability to dynamic systems. This paper investigates how to mitigate such restrictions using a neural network to control a grid-connected rectifier/inverter. The neural network implements a dynamic programming algorithm and is trained by using back-propagation through time. To enhance performance and stability under disturbance, additional strategies are adopted, including the use of integrals of error signals to the network inputs and the introduction of grid disturbance voltage to the outputs of a well-trained network. The performance of the neural-network controller is studied under typical vector control conditions and compared against conventional vector control methods, which demonstrates that the neural vector control strategy proposed in this paper is effective. Even in dynamic and power converter switching environments, the neural vector controller shows strong ability to trace rapidly changing reference commands, tolerate system disturbances, and satisfy control requirements for a faulted power system.

Dynamics of neural networks with continuous attractors

Science.gov (United States)

Fung, C. C. Alan; Wong, K. Y. Michael; Wu, Si

2008-10-01

We investigate the dynamics of continuous attractor neural networks (CANNs). Due to the translational invariance of their neuronal interactions, CANNs can hold a continuous family of stationary states. We systematically explore how their neutral stability facilitates the tracking performance of a CANN, which is believed to have wide applications in brain functions. We develop a perturbative approach that utilizes the dominant movement of the network stationary states in the state space. We quantify the distortions of the bump shape during tracking, and study their effects on the tracking performance. Results are obtained on the maximum speed for a moving stimulus to be trackable, and the reaction time to catch up an abrupt change in stimulus.

A neural theory of visual attention

DEFF Research Database (Denmark)

Bundesen, Claus; Habekost, Thomas; Kyllingsbæk, Søren

2005-01-01

A neural theory of visual attention (NTVA) is presented. NTVA is a neural interpretation of C. Bundesen's (1990) theory of visual attention (TVA). In NTVA, visual processing capacity is distributed across stimuli by dynamic remapping of receptive fields of cortical cells such that more processing...... resources (cells) are devoted to behaviorally important objects than to less important ones. By use of the same basic equations used in TVA, NTVA accounts for a wide range of known attentional effects in human performance (reaction times and error rates) and a wide range of effects observed in firing rates...

Pseudo dynamic transitional modeling of building heating energy demand using artificial neural network

NARCIS (Netherlands)

Paudel, S.; Elmtiri, M.; Kling, W.L.; Corre, le O.; Lacarriere, B.

2014-01-01

This paper presents the building heating demand prediction model with occupancy profile and operational heating power level characteristics in short time horizon (a couple of days) using artificial neural network. In addition, novel pseudo dynamic transitional model is introduced, which consider

Learning by stimulation avoidance: A principle to control spiking neural networks dynamics.

Science.gov (United States)

Sinapayen, Lana; Masumori, Atsushi; Ikegami, Takashi

2017-01-01

Learning based on networks of real neurons, and learning based on biologically inspired models of neural networks, have yet to find general learning rules leading to widespread applications. In this paper, we argue for the existence of a principle allowing to steer the dynamics of a biologically inspired neural network. Using carefully timed external stimulation, the network can be driven towards a desired dynamical state. We term this principle "Learning by Stimulation Avoidance" (LSA). We demonstrate through simulation that the minimal sufficient conditions leading to LSA in artificial networks are also sufficient to reproduce learning results similar to those obtained in biological neurons by Shahaf and Marom, and in addition explains synaptic pruning. We examined the underlying mechanism by simulating a small network of 3 neurons, then scaled it up to a hundred neurons. We show that LSA has a higher explanatory power than existing hypotheses about the response of biological neural networks to external simulation, and can be used as a learning rule for an embodied application: learning of wall avoidance by a simulated robot. In other works, reinforcement learning with spiking networks can be obtained through global reward signals akin simulating the dopamine system; we believe that this is the first project demonstrating sensory-motor learning with random spiking networks through Hebbian learning relying on environmental conditions without a separate reward system.

Localized states in an unbounded neural field equation with smooth firing rate function: a multi-parameter analysis.

Science.gov (United States)

Faye, Grégory; Rankin, James; Chossat, Pascal

2013-05-01

The existence of spatially localized solutions in neural networks is an important topic in neuroscience as these solutions are considered to characterize working (short-term) memory. We work with an unbounded neural network represented by the neural field equation with smooth firing rate function and a wizard hat spatial connectivity. Noting that stationary solutions of our neural field equation are equivalent to homoclinic orbits in a related fourth order ordinary differential equation, we apply normal form theory for a reversible Hopf bifurcation to prove the existence of localized solutions; further, we present results concerning their stability. Numerical continuation is used to compute branches of localized solution that exhibit snaking-type behaviour. We describe in terms of three parameters the exact regions for which localized solutions persist.

Neural Dynamics and Information Representation in Microcircuits of Motor Cortex

Directory of Open Access Journals (Sweden)

Yasuhiro eTsubo

2013-05-01

Full Text Available The brain has to analyze and respond to external events that can change rapidly from time to time, suggesting that information processing by the brain may be essentially dynamic rather than static. The dynamical features of neural computation are of significant importance in motor cortex that governs the process of movement generation and learning. In this paper, we discuss these features based primarily on our recent findings on neural dynamics and information coding in the microcircuit of rat motor cortex. In fact, cortical neurons show a variety of dynamical behavior from rhythmic activity in various frequency bands to highly irregular spike firing. Of particular interest are the similarity and dissimilarity of the neuronal response properties in different layers of motor cortex. By conducting electrophysiological recordings in slice preparation, we report the phase response curves of neurons in different cortical layers to demonstrate their layer-dependent synchronization properties. We then study how motor cortex recruits task-related neurons in different layers for voluntary arm movements by simultaneous juxtacellular and multiunit recordings from behaving rats. The results suggest an interesting difference in the spectrum of functional activity between the superficial and deep layers. Furthermore, the task-related activities recorded from various layers exhibited power law distributions of inter-spike intervals (ISIs, in contrast to a general belief that ISIs obey Poisson or Gamma distributions in cortical neurons. We present a theoretical argument that this power law of in vivo neurons may represent the maximization of the entropy of firing rate with limited energy consumption of spike generation. Though further studies are required to fully clarify the functional implications of this coding principle, it may shed new light on information representations by neurons and circuits in motor cortex.

Neural networks for tracking of unknown SISO discrete-time nonlinear dynamic systems.

Science.gov (United States)

Aftab, Muhammad Saleheen; Shafiq, Muhammad

2015-11-01

This article presents a Lyapunov function based neural network tracking (LNT) strategy for single-input, single-output (SISO) discrete-time nonlinear dynamic systems. The proposed LNT architecture is composed of two feedforward neural networks operating as controller and estimator. A Lyapunov function based back propagation learning algorithm is used for online adjustment of the controller and estimator parameters. The controller and estimator error convergence and closed-loop system stability analysis is performed by Lyapunov stability theory. Moreover, two simulation examples and one real-time experiment are investigated as case studies. The achieved results successfully validate the controller performance. Copyright © 2015 ISA. Published by Elsevier Ltd. All rights reserved.

Optimization of matrix tablets controlled drug release using Elman dynamic neural networks and decision trees.

Science.gov (United States)

Petrović, Jelena; Ibrić, Svetlana; Betz, Gabriele; Đurić, Zorica

2012-05-30

The main objective of the study was to develop artificial intelligence methods for optimization of drug release from matrix tablets regardless of the matrix type. Static and dynamic artificial neural networks of the same topology were developed to model dissolution profiles of different matrix tablets types (hydrophilic/lipid) using formulation composition, compression force used for tableting and tablets porosity and tensile strength as input data. Potential application of decision trees in discovering knowledge from experimental data was also investigated. Polyethylene oxide polymer and glyceryl palmitostearate were used as matrix forming materials for hydrophilic and lipid matrix tablets, respectively whereas selected model drugs were diclofenac sodium and caffeine. Matrix tablets were prepared by direct compression method and tested for in vitro dissolution profiles. Optimization of static and dynamic neural networks used for modeling of drug release was performed using Monte Carlo simulations or genetic algorithms optimizer. Decision trees were constructed following discretization of data. Calculated difference (f(1)) and similarity (f(2)) factors for predicted and experimentally obtained dissolution profiles of test matrix tablets formulations indicate that Elman dynamic neural networks as well as decision trees are capable of accurate predictions of both hydrophilic and lipid matrix tablets dissolution profiles. Elman neural networks were compared to most frequently used static network, Multi-layered perceptron, and superiority of Elman networks have been demonstrated. Developed methods allow simple, yet very precise way of drug release predictions for both hydrophilic and lipid matrix tablets having controlled drug release. Copyright © 2012 Elsevier B.V. All rights reserved.

Nonlinear dynamics analysis of a self-organizing recurrent neural network: chaos waning.

Science.gov (United States)

Eser, Jürgen; Zheng, Pengsheng; Triesch, Jochen

2014-01-01

Self-organization is thought to play an important role in structuring nervous systems. It frequently arises as a consequence of plasticity mechanisms in neural networks: connectivity determines network dynamics which in turn feed back on network structure through various forms of plasticity. Recently, self-organizing recurrent neural network models (SORNs) have been shown to learn non-trivial structure in their inputs and to reproduce the experimentally observed statistics and fluctuations of synaptic connection strengths in cortex and hippocampus. However, the dynamics in these networks and how they change with network evolution are still poorly understood. Here we investigate the degree of chaos in SORNs by studying how the networks' self-organization changes their response to small perturbations. We study the effect of perturbations to the excitatory-to-excitatory weight matrix on connection strengths and on unit activities. We find that the network dynamics, characterized by an estimate of the maximum Lyapunov exponent, becomes less chaotic during its self-organization, developing into a regime where only few perturbations become amplified. We also find that due to the mixing of discrete and (quasi-)continuous variables in SORNs, small perturbations to the synaptic weights may become amplified only after a substantial delay, a phenomenon we propose to call deferred chaos.

Atom dynamics in laser fields

International Nuclear Information System (INIS)

Jang, Su; Mi, No Gin

2004-12-01

This book introduces coherent dynamics of internal state, spread of atoms wave speed, semiclassical atoms density matrix such as dynamics equation in both still and moving atoms, excitation of atoms in movement by light, dipole radiating power, quantum statistical mechanics by atoms in movement, semiclassical atoms in movement, atoms in movement in the uniform magnetic field including effects of uniform magnetic field, atom cooling using laser such as Doppler cooling, atom traps using laser and mirrors, radiant heat which particles receive, and near field interactions among atoms in laser light.

Identification and prediction of dynamic systems using an interactively recurrent self-evolving fuzzy neural network.

Science.gov (United States)

Lin, Yang-Yin; Chang, Jyh-Yeong; Lin, Chin-Teng

2013-02-01

This paper presents a novel recurrent fuzzy neural network, called an interactively recurrent self-evolving fuzzy neural network (IRSFNN), for prediction and identification of dynamic systems. The recurrent structure in an IRSFNN is formed as an external loops and internal feedback by feeding the rule firing strength of each rule to others rules and itself. The consequent part in the IRSFNN is composed of a Takagi-Sugeno-Kang (TSK) or functional-link-based type. The proposed IRSFNN employs a functional link neural network (FLNN) to the consequent part of fuzzy rules for promoting the mapping ability. Unlike a TSK-type fuzzy neural network, the FLNN in the consequent part is a nonlinear function of input variables. An IRSFNNs learning starts with an empty rule base and all of the rules are generated and learned online through a simultaneous structure and parameter learning. An on-line clustering algorithm is effective in generating fuzzy rules. The consequent update parameters are derived by a variable-dimensional Kalman filter algorithm. The premise and recurrent parameters are learned through a gradient descent algorithm. We test the IRSFNN for the prediction and identification of dynamic plants and compare it to other well-known recurrent FNNs. The proposed model obtains enhanced performance results.

The Temporal Derivative of Expected Utility: A Neural Mechanism for Dynamic Decision-making

Science.gov (United States)

Zhang, Xian; Hirsch, Joy

2012-01-01

Real world tasks involving moving targets, such as driving a vehicle, are performed based on continuous decisions thought to depend upon the temporal derivative of the expected utility (∂V/∂t), where the expected utility (V) is the effective value of a future reward. However, those neural mechanisms that underlie dynamic decision-making are not well understood. This study investigates human neural correlates of both V and ∂V/∂t using fMRI and a novel experimental paradigm based on a pursuit-evasion game optimized to isolate components of dynamic decision processes. Our behavioral data show that players of the pursuit-evasion game adopt an exponential discounting function, supporting the expected utility theory. The continuous functions of V and ∂V/∂t were derived from the behavioral data and applied as regressors in fMRI analysis, enabling temporal resolution that exceeded the sampling rate of image acquisition, hyper-temporal resolution, by taking advantage of numerous trials that provide rich and independent manipulation of those variables. V and ∂V/∂t were each associated with distinct neural activity. Specifically, ∂V/∂t was associated with anterior and posterior cingulate cortices, superior parietal lobule, and ventral pallidum, whereas V was primarily associated with supplementary motor, pre and post central gyri, cerebellum, and thalamus. The association between the ∂V/∂t and brain regions previously related to decision-making is consistent with the primary role of the temporal derivative of expected utility in dynamic decision-making. PMID:22963852

The temporal derivative of expected utility: a neural mechanism for dynamic decision-making.

Science.gov (United States)

Zhang, Xian; Hirsch, Joy

2013-01-15

Real world tasks involving moving targets, such as driving a vehicle, are performed based on continuous decisions thought to depend upon the temporal derivative of the expected utility (∂V/∂t), where the expected utility (V) is the effective value of a future reward. However, the neural mechanisms that underlie dynamic decision-making are not well understood. This study investigates human neural correlates of both V and ∂V/∂t using fMRI and a novel experimental paradigm based on a pursuit-evasion game optimized to isolate components of dynamic decision processes. Our behavioral data show that players of the pursuit-evasion game adopt an exponential discounting function, supporting the expected utility theory. The continuous functions of V and ∂V/∂t were derived from the behavioral data and applied as regressors in fMRI analysis, enabling temporal resolution that exceeded the sampling rate of image acquisition, hyper-temporal resolution, by taking advantage of numerous trials that provide rich and independent manipulation of those variables. V and ∂V/∂t were each associated with distinct neural activity. Specifically, ∂V/∂t was associated with anterior and posterior cingulate cortices, superior parietal lobule, and ventral pallidum, whereas V was primarily associated with supplementary motor, pre and post central gyri, cerebellum, and thalamus. The association between the ∂V/∂t and brain regions previously related to decision-making is consistent with the primary role of the temporal derivative of expected utility in dynamic decision-making. Copyright © 2012 Elsevier Inc. All rights reserved.

A one-layer recurrent neural network for constrained pseudoconvex optimization and its application for dynamic portfolio optimization.

Science.gov (United States)

Liu, Qingshan; Guo, Zhishan; Wang, Jun

2012-02-01

In this paper, a one-layer recurrent neural network is proposed for solving pseudoconvex optimization problems subject to linear equality and bound constraints. Compared with the existing neural networks for optimization (e.g., the projection neural networks), the proposed neural network is capable of solving more general pseudoconvex optimization problems with equality and bound constraints. Moreover, it is capable of solving constrained fractional programming problems as a special case. The convergence of the state variables of the proposed neural network to achieve solution optimality is guaranteed as long as the designed parameters in the model are larger than the derived lower bounds. Numerical examples with simulation results illustrate the effectiveness and characteristics of the proposed neural network. In addition, an application for dynamic portfolio optimization is discussed. Copyright © 2011 Elsevier Ltd. All rights reserved.

Dynamically Partitionable Autoassociative Networks as a Solution to the Neural Binding Problem

Directory of Open Access Journals (Sweden)

Kenneth Jeffrey Hayworth

2012-09-01

Full Text Available An outstanding question in theoretical neuroscience is how the brain solves the neural binding problem. In vision, binding can be summarized as the ability to represent that certain properties belong to one object while other properties belong to a different object. I review the binding problem in visual and other domains, and review its simplest proposed solution – the anatomical binding hypothesis. This hypothesis has traditionally been rejected as a true solution because it seems to require a type of one-to-one wiring of neurons that would be impossible in a biological system (as opposed to an engineered system like a computer. I show that this requirement for one-to-one wiring can be loosened by carefully considering how the neural representation is actually put to use by the rest of the brain. This leads to a solution where a symbol is represented not as a particular pattern of neural activation but instead as a piece of a global stable attractor state. I introduce the Dynamically Partitionable AutoAssociative Network (DPAAN as an implementation of this solution and show how DPANNs can be used in systems which perform perceptual binding and in systems that implement syntax-sensitive rules. Finally I show how the core parts of the cognitive architecture ACT-R can be neurally implemented using a DPAAN as ACT-R’s global workspace. Because the DPAAN solution to the binding problem requires only ‘flat’ neural representations (as opposed to the phase encoded representation hypothesized in neural synchrony solutions it is directly compatible with the most well developed neural models of learning, memory, and pattern recognition.

Robust segmentation of medical images using competitive hop field neural network as a clustering tool

International Nuclear Information System (INIS)

Golparvar Roozbahani, R.; Ghassemian, M. H.; Sharafat, A. R.

2001-01-01

This paper presents the application of competitive Hop field neural network for medical images segmentation. Our proposed approach consists of Two steps: 1) translating segmentation of the given medical image into an optimization problem, and 2) solving this problem by a version of Hop field network known as competitive Hop field neural network. Segmentation is considered as a clustering problem and its validity criterion is based on both intra set distance and inter set distance. The algorithm proposed in this paper is based on gray level features only. This leads to near optimal solutions if both intra set distance and inter set distance are considered at the same time. If only one of these distances is considered, the result of segmentation process by competitive Hop field neural network will be far from optimal solution and incorrect even for very simple cases. Furthermore, sometimes the algorithm receives at unacceptable states. Both these problems may be solved by contributing both in tera distance and inter distances in the segmentation (optimization) process. The performance of the proposed algorithm is tested on both phantom and real medical images. The promising results and the robustness of algorithm to system noises show near optimal solutions

Effective electric fields along realistic DTI-based neural trajectories for modelling the stimulation mechanisms of TMS

International Nuclear Information System (INIS)

De Geeter, N; Crevecoeur, G; Dupré, L; Leemans, A

2015-01-01

In transcranial magnetic stimulation (TMS), an applied alternating magnetic field induces an electric field in the brain that can interact with the neural system. It is generally assumed that this induced electric field is the crucial effect exciting a certain region of the brain. More specifically, it is the component of this field parallel to the neuron’s local orientation, the so-called effective electric field, that can initiate neuronal stimulation. Deeper insights on the stimulation mechanisms can be acquired through extensive TMS modelling. Most models study simple representations of neurons with assumed geometries, whereas we embed realistic neural trajectories computed using tractography based on diffusion tensor images. This way of modelling ensures a more accurate spatial distribution of the effective electric field that is in addition patient and case specific. The case study of this paper focuses on the single pulse stimulation of the left primary motor cortex with a standard figure-of-eight coil. Including realistic neural geometry in the model demonstrates the strong and localized variations of the effective electric field between the tracts themselves and along them due to the interplay of factors such as the tract’s position and orientation in relation to the TMS coil, the neural trajectory and its course along the white and grey matter interface. Furthermore, the influence of changes in the coil orientation is studied. Investigating the impact of tissue anisotropy confirms that its contribution is not negligible. Moreover, assuming isotropic tissues lead to errors of the same size as rotating or tilting the coil with 10 degrees. In contrast, the model proves to be less sensitive towards the not well-known tissue conductivity values. (paper)

Dynamics of delay-coupled FitzHugh-Nagumo neural rings

Science.gov (United States)

Mao, Xiaochen; Sun, Jianqiao; Li, Shaofan

2018-01-01

This paper studies the dynamical behaviors of a pair of FitzHugh-Nagumo neural networks with bidirectional delayed couplings. It presents a detailed analysis of delay-independent and delay-dependent stabilities and the existence of bifurcated oscillations. Illustrative examples are performed to validate the analytical results and to discover interesting phenomena. It is shown that the network exhibits a variety of complicated activities, such as multiple stability switches, the coexistence of periodic and quasi-periodic oscillations, the coexistence of periodic and chaotic orbits, and the coexisting chaotic attractors.

A Neural Network Approach to Fluid Level Measurement in Dynamic Environments Using a Single Capacitive Sensor

Directory of Open Access Journals (Sweden)

Edin TERZIC

2010-03-01

Full Text Available A measurement system has been developed using a single tube capacitive sensor to accurately determine the fluid level in vehicular fuel tanks. A novel approach based on artificial neural networks based signal pre-processing and classification has been described in this article. A broad investigation on the Backpropagation neural network and some selected signal pre-processing filters, namely, Moving Mean, Moving Median, and Wavelet Filter has also been presented. An on field drive trial was conducted under normal driving conditions at various fuel volumes ranging from 5 L to 50 L to acquire training samples from the capacitive sensor. A second field trial was conducted to obtain test samples to verify the performance of the neural network. The neural network was trained and verified with 50 % of the training and test samples. The results obtained using the neural network approach having different filtration methods are compared with the results obtained using simple Moving Mean and Moving Median functions. It is demonstrated that the Backpropagation neural network with Moving Median filter produced the most accurate outcome compared with the other signal filtration methods.

Electric field effects in hyperexcitable neural tissue: A review

International Nuclear Information System (INIS)

Durand, D.M.

2003-01-01

Uniform electric fields applied to neural tissue can modulate neuronal excitability with a threshold value of about 1mV mm -1 in normal physiological conditions. However, electric fields could have a lower threshold in conditions where field sensitivity is enhanced, such as those simulating epilepsy. Uniform electrical fields were applied to hippocampal brain slices exposed to picrotoxin, high potassium or low calcium solutions. The results in the low calcium medium show that neuronal activity can be completely blocked in 10% of the 30 slices tested with a field amplitude of 1mV mm -1 . These results suggest that the threshold for this effect is clearly smaller than 1mV mm -1 . The hypothesis that the extracellular resistance could affect the sensitivity to the electrical fields was tested by measuring the effect of the osmolarity of the extracellular solution on the efficacy of the field. A 10% decrease on osmolarity resulted in a 56% decrease ( n =4) in the minimum field required for full suppression. A 14% in osmolarity produced an 81% increase in the minimum field required for full suppression. These results show that the extracellular volume can modulate the efficacy of the field and could lower the threshold field amplitudes to values lower than ∼1mmV mm -. (author)

A Neural Network Model of the Structure and Dynamics of Human Personality

Science.gov (United States)

Read, Stephen J.; Monroe, Brian M.; Brownstein, Aaron L.; Yang, Yu; Chopra, Gurveen; Miller, Lynn C.

2010-01-01

We present a neural network model that aims to bridge the historical gap between dynamic and structural approaches to personality. The model integrates work on the structure of the trait lexicon, the neurobiology of personality, temperament, goal-based models of personality, and an evolutionary analysis of motives. It is organized in terms of two…

Point process modeling and estimation: Advances in the analysis of dynamic neural spiking data

Science.gov (United States)

Deng, Xinyi

2016-08-01

A common interest of scientists in many fields is to understand the relationship between the dynamics of a physical system and the occurrences of discrete events within such physical system. Seismologists study the connection between mechanical vibrations of the Earth and the occurrences of earthquakes so that future earthquakes can be better predicted. Astrophysicists study the association between the oscillating energy of celestial regions and the emission of photons to learn the Universe's various objects and their interactions. Neuroscientists study the link between behavior and the millisecond-timescale spike patterns of neurons to understand higher brain functions. Such relationships can often be formulated within the framework of state-space models with point process observations. The basic idea is that the dynamics of the physical systems are driven by the dynamics of some stochastic state variables and the discrete events we observe in an interval are noisy observations with distributions determined by the state variables. This thesis proposes several new methodological developments that advance the framework of state-space models with point process observations at the intersection of statistics and neuroscience. In particular, we develop new methods 1) to characterize the rhythmic spiking activity using history-dependent structure, 2) to model population spike activity using marked point process models, 3) to allow for real-time decision making, and 4) to take into account the need for dimensionality reduction for high-dimensional state and observation processes. We applied these methods to a novel problem of tracking rhythmic dynamics in the spiking of neurons in the subthalamic nucleus of Parkinson's patients with the goal of optimizing placement of deep brain stimulation electrodes. We developed a decoding algorithm that can make decision in real-time (for example, to stimulate the neurons or not) based on various sources of information present in

Statistical mechanics of attractor neural network models with synaptic depression

International Nuclear Information System (INIS)

Igarashi, Yasuhiko; Oizumi, Masafumi; Otsubo, Yosuke; Nagata, Kenji; Okada, Masato

2009-01-01

Synaptic depression is known to control gain for presynaptic inputs. Since cortical neurons receive thousands of presynaptic inputs, and their outputs are fed into thousands of other neurons, the synaptic depression should influence macroscopic properties of neural networks. We employ simple neural network models to explore the macroscopic effects of synaptic depression. Systems with the synaptic depression cannot be analyzed due to asymmetry of connections with the conventional equilibrium statistical-mechanical approach. Thus, we first propose a microscopic dynamical mean field theory. Next, we derive macroscopic steady state equations and discuss the stabilities of steady states for various types of neural network models.

Neural pathways in processing of sexual arousal: a dynamic causal modeling study.

Science.gov (United States)

Seok, J-W; Park, M-S; Sohn, J-H

2016-09-01

Three decades of research have investigated brain processing of visual sexual stimuli with neuroimaging methods. These researchers have found that sexual arousal stimuli elicit activity in a broad neural network of cortical and subcortical brain areas that are known to be associated with cognitive, emotional, motivational and physiological components. However, it is not completely understood how these neural systems integrate and modulated incoming information. Therefore, we identify cerebral areas whose activations were correlated with sexual arousal using event-related functional magnetic resonance imaging and used the dynamic causal modeling method for searching the effective connectivity about the sexual arousal processing network. Thirteen heterosexual males were scanned while they passively viewed alternating short trials of erotic and neutral pictures on a monitor. We created a subset of seven models based on our results and previous studies and selected a dominant connectivity model. Consequently, we suggest a dynamic causal model of the brain processes mediating the cognitive, emotional, motivational and physiological factors of human male sexual arousal. These findings are significant implications for the neuropsychology of male sexuality.

Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion.

Science.gov (United States)

Kumar, Rajesh; Srivastava, Smriti; Gupta, J R P

2017-03-01

In this paper adaptive control of nonlinear dynamical systems using diagonal recurrent neural network (DRNN) is proposed. The structure of DRNN is a modification of fully connected recurrent neural network (FCRNN). Presence of self-recurrent neurons in the hidden layer of DRNN gives it an ability to capture the dynamic behaviour of the nonlinear plant under consideration (to be controlled). To ensure stability, update rules are developed using lyapunov stability criterion. These rules are then used for adjusting the various parameters of DRNN. The responses of plants obtained with DRNN are compared with those obtained when multi-layer feed forward neural network (MLFFNN) is used as a controller. Also, in example 4, FCRNN is also investigated and compared with DRNN and MLFFNN. Robustness of the proposed control scheme is also tested against parameter variations and disturbance signals. Four simulation examples including one-link robotic manipulator and inverted pendulum are considered on which the proposed controller is applied. The results so obtained show the superiority of DRNN over MLFFNN as a controller. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

Predicting the topology of dynamic neural networks for the simulation of electronic circuits

NARCIS (Netherlands)

Schilders, W.H.A.

2009-01-01

In this paper we discuss the use of the state-space modelling MOESP algorithm to generate precise information about the number of neurons and hidden layers in dynamic neural networks developed for the behavioural modelling of electronic circuits. The Bartels–Stewart algorithm is used to transform

Modeling of quasistatic magnetic hysteresis with feed-forward neural networks

International Nuclear Information System (INIS)

Makaveev, Dimitre; Dupre, Luc; De Wulf, Marc; Melkebeek, Jan

2001-01-01

A modeling technique for rate-independent (quasistatic) scalar magnetic hysteresis is presented, using neural networks. Based on the theory of dynamic systems and the wiping-out and congruency properties of the classical scalar Preisach hysteresis model, the choice of a feed-forward neural network model is motivated. The neural network input parameters at each time step are the corresponding magnetic field strength and memory state, thereby assuring accurate prediction of the change of magnetic induction. For rate-independent hysteresis, the current memory state can be determined by the last extreme magnetic field strength and induction values, kept in memory. The choice of a network training set is motivated and the performance of the network is illustrated for a test set not used during training. Very accurate prediction of both major and minor hysteresis loops is observed, proving that the neural network technique is suitable for hysteresis modeling. [copyright] 2001 American Institute of Physics

Storage capacity of attractor neural networks with depressing synapses

International Nuclear Information System (INIS)

Torres, Joaquin J.; Pantic, Lovorka; Kappen, Hilbert J.

2002-01-01

We compute the capacity of a binary neural network with dynamic depressing synapses to store and retrieve an infinite number of patterns. We use a biologically motivated model of synaptic depression and a standard mean-field approach. We find that at T=0 the critical storage capacity decreases with the degree of the depression. We confirm the validity of our main mean-field results with numerical simulations

Dynamical Behaviors of Stochastic Reaction-Diffusion Cohen-Grossberg Neural Networks with Delays

Directory of Open Access Journals (Sweden)

Li Wan

2012-01-01

Full Text Available This paper investigates dynamical behaviors of stochastic Cohen-Grossberg neural network with delays and reaction diffusion. By employing Lyapunov method, Poincaré inequality and matrix technique, some sufficient criteria on ultimate boundedness, weak attractor, and asymptotic stability are obtained. Finally, a numerical example is given to illustrate the correctness and effectiveness of our theoretical results.

Self-organizing neural networks for automatic detection and classification of contrast-enhancing lesions in dynamic MR-mammography

International Nuclear Information System (INIS)

Vomweg, T.W.; Teifke, A.; Kauczor, H.U.; Achenbach, T.; Rieker, O.; Schreiber, W.G.; Heitmann, K.R.; Beier, T.; Thelen, M.

2005-01-01

Purpose: Investigation and statistical evaluation of 'Self-Organizing Maps', a special type of neural networks in the field of artificial intelligence, classifying contrast enhancing lesions in dynamic MR-mammography. Material and Methods: 176 investigations with proven histology after core biopsy or operation were randomly divided into two groups. Several Self-Organizing Maps were trained by investigations of the first group to detect and classify contrast enhancing lesions in dynamic MR-mammography. Each single pixel's signal/time curve of all patients within the second group was analyzed by the Self-Organizing Maps. The likelihood of malignancy was visualized by color overlays on the MR-images. At last assessment of contrast-enhancing lesions by each different network was rated visually and evaluated statistically. Results: A well balanced neural network achieved a sensitivity of 90.5% and a specificity of 72.2% in predicting malignancy of 88 enhancing lesions. Detailed analysis of false-positive results revealed that every second fibroadenoma showed a 'typical malignant' signal/time curve without any chance to differentiate between fibroadenomas and malignant tissue regarding contrast enhancement alone; but this special group of lesions was represented by a well-defined area of the Self-Organizing Map. Discussion: Self-Organizing Maps are capable of classifying a dynamic signal/time curve as 'typical benign' or 'typical malignant'. Therefore, they can be used as second opinion. In view of the now known localization of fibroadenomas enhancing like malignant tumors at the Self-Organizing Map, these lesions could be passed to further analysis by additional post-processing elements (e.g., based on T2-weighted series or morphology analysis) in the future. (orig.)

The effects of noise on binocular rivalry waves: a stochastic neural field model

International Nuclear Information System (INIS)

Webber, Matthew A; Bressloff, Paul C

2013-01-01

We analyze the effects of extrinsic noise on traveling waves of visual perception in a competitive neural field model of binocular rivalry. The model consists of two one-dimensional excitatory neural fields, whose activity variables represent the responses to left-eye and right-eye stimuli, respectively. The two networks mutually inhibit each other, and slow adaptation is incorporated into the model by taking the network connections to exhibit synaptic depression. We first show how, in the absence of any noise, the system supports a propagating composite wave consisting of an invading activity front in one network co-moving with a retreating front in the other network. Using a separation of time scales and perturbation methods previously developed for stochastic reaction–diffusion equations, we then show how extrinsic noise in the activity variables leads to a diffusive-like displacement (wandering) of the composite wave from its uniformly translating position at long time scales, and fluctuations in the wave profile around its instantaneous position at short time scales. We use our analysis to calculate the first-passage-time distribution for a stochastic rivalry wave to travel a fixed distance, which we find to be given by an inverse Gaussian. Finally, we investigate the effects of noise in the depression variables, which under an adiabatic approximation lead to quenched disorder in the neural fields during propagation of a wave. (paper)

Fractional Hopfield Neural Networks: Fractional Dynamic Associative Recurrent Neural Networks.

Science.gov (United States)

Pu, Yi-Fei; Yi, Zhang; Zhou, Ji-Liu

2017-10-01

This paper mainly discusses a novel conceptual framework: fractional Hopfield neural networks (FHNN). As is commonly known, fractional calculus has been incorporated into artificial neural networks, mainly because of its long-term memory and nonlocality. Some researchers have made interesting attempts at fractional neural networks and gained competitive advantages over integer-order neural networks. Therefore, it is naturally makes one ponder how to generalize the first-order Hopfield neural networks to the fractional-order ones, and how to implement FHNN by means of fractional calculus. We propose to introduce a novel mathematical method: fractional calculus to implement FHNN. First, we implement fractor in the form of an analog circuit. Second, we implement FHNN by utilizing fractor and the fractional steepest descent approach, construct its Lyapunov function, and further analyze its attractors. Third, we perform experiments to analyze the stability and convergence of FHNN, and further discuss its applications to the defense against chip cloning attacks for anticounterfeiting. The main contribution of our work is to propose FHNN in the form of an analog circuit by utilizing a fractor and the fractional steepest descent approach, construct its Lyapunov function, prove its Lyapunov stability, analyze its attractors, and apply FHNN to the defense against chip cloning attacks for anticounterfeiting. A significant advantage of FHNN is that its attractors essentially relate to the neuron's fractional order. FHNN possesses the fractional-order-stability and fractional-order-sensitivity characteristics.

Low-Dimensional Models of "Neuro-Glio-Vascular Unit" for Describing Neural Dynamics under Normal and Energy-Starved Conditions.

Science.gov (United States)

Chhabria, Karishma; Chakravarthy, V Srinivasa

2016-01-01

The motivation of developing simple minimal models for neuro-glio-vascular (NGV) system arises from a recent modeling study elucidating the bidirectional information flow within the NGV system having 89 dynamic equations (1). While this was one of the first attempts at formulating a comprehensive model for neuro-glio-vascular system, it poses severe restrictions in scaling up to network levels. On the contrary, low--dimensional models are convenient devices in simulating large networks that also provide an intuitive understanding of the complex interactions occurring within the NGV system. The key idea underlying the proposed models is to describe the glio-vascular system as a lumped system, which takes neural firing rate as input and returns an "energy" variable (analogous to ATP) as output. To this end, we present two models: biophysical neuro-energy (Model 1 with five variables), comprising KATP channel activity governed by neuronal ATP dynamics, and the dynamic threshold (Model 2 with three variables), depicting the dependence of neural firing threshold on the ATP dynamics. Both the models show different firing regimes, such as continuous spiking, phasic, and tonic bursting depending on the ATP production coefficient, ɛp, and external current. We then demonstrate that in a network comprising such energy-dependent neuron units, ɛp could modulate the local field potential (LFP) frequency and amplitude. Interestingly, low-frequency LFP dominates under low ɛp conditions, which is thought to be reminiscent of seizure-like activity observed in epilepsy. The proposed "neuron-energy" unit may be implemented in building models of NGV networks to simulate data obtained from multimodal neuroimaging systems, such as functional near infrared spectroscopy coupled to electroencephalogram and functional magnetic resonance imaging coupled to electroencephalogram. Such models could also provide a theoretical basis for devising optimal neurorehabilitation strategies, such as

A Dynamic Connectome Supports the Emergence of Stable Computational Function of Neural Circuits through Reward-Based Learning.

Science.gov (United States)

Kappel, David; Legenstein, Robert; Habenschuss, Stefan; Hsieh, Michael; Maass, Wolfgang

2018-01-01

Synaptic connections between neurons in the brain are dynamic because of continuously ongoing spine dynamics, axonal sprouting, and other processes. In fact, it was recently shown that the spontaneous synapse-autonomous component of spine dynamics is at least as large as the component that depends on the history of pre- and postsynaptic neural activity. These data are inconsistent with common models for network plasticity and raise the following questions: how can neural circuits maintain a stable computational function in spite of these continuously ongoing processes, and what could be functional uses of these ongoing processes? Here, we present a rigorous theoretical framework for these seemingly stochastic spine dynamics and rewiring processes in the context of reward-based learning tasks. We show that spontaneous synapse-autonomous processes, in combination with reward signals such as dopamine, can explain the capability of networks of neurons in the brain to configure themselves for specific computational tasks, and to compensate automatically for later changes in the network or task. Furthermore, we show theoretically and through computer simulations that stable computational performance is compatible with continuously ongoing synapse-autonomous changes. After reaching good computational performance it causes primarily a slow drift of network architecture and dynamics in task-irrelevant dimensions, as observed for neural activity in motor cortex and other areas. On the more abstract level of reinforcement learning the resulting model gives rise to an understanding of reward-driven network plasticity as continuous sampling of network configurations.

Unloading arm movement modeling using neural networks for a rotary hearth furnace

Directory of Open Access Journals (Sweden)

Iulia Inoan

2011-12-01

Full Text Available Neural networks are being applied in many fields of engineering having nowadays a wide range of application. Neural networks are very useful for modeling dynamic processes for which the mathematical modeling is hard to obtain, or for processes that can’t be modeled using mathematical equations. This paper describes the modeling process for the unloading arm movement from a rotary hearth furnace using neural networks with back propagation algorithm. In this case the designed network was trained using the simulation results from a previous calculated mathematical model.

Stochastic Nonlinear Evolutional Model of the Large-Scaled Neuronal Population and Dynamic Neural Coding Subject to Stimulation

International Nuclear Information System (INIS)

Wang Rubin; Yu Wei

2005-01-01

In this paper, we investigate how the population of neuronal oscillators deals with information and the dynamic evolution of neural coding when the external stimulation acts on it. Numerically computing method is used to describe the evolution process of neural coding in three-dimensioned space. The numerical result proves that only the suitable stimulation can change the coupling structure and plasticity of neurons

Cell dynamic morphology classification using deep convolutional neural networks.

Science.gov (United States)

Li, Heng; Pang, Fengqian; Shi, Yonggang; Liu, Zhiwen

2018-05-15

Cell morphology is often used as a proxy measurement of cell status to understand cell physiology. Hence, interpretation of cell dynamic morphology is a meaningful task in biomedical research. Inspired by the recent success of deep learning, we here explore the application of convolutional neural networks (CNNs) to cell dynamic morphology classification. An innovative strategy for the implementation of CNNs is introduced in this study. Mouse lymphocytes were collected to observe the dynamic morphology, and two datasets were thus set up to investigate the performances of CNNs. Considering the installation of deep learning, the classification problem was simplified from video data to image data, and was then solved by CNNs in a self-taught manner with the generated image data. CNNs were separately performed in three installation scenarios and compared with existing methods. Experimental results demonstrated the potential of CNNs in cell dynamic morphology classification, and validated the effectiveness of the proposed strategy. CNNs were successfully applied to the classification problem, and outperformed the existing methods in the classification accuracy. For the installation of CNNs, transfer learning was proved to be a promising scheme. © 2018 International Society for Advancement of Cytometry. © 2018 International Society for Advancement of Cytometry.

Differential Neural Networks for Identification and Filtering in Nonlinear Dynamic Games

Directory of Open Access Journals (Sweden)

Emmanuel García

2014-01-01

Full Text Available This paper deals with the problem of identifying and filtering a class of continuous-time nonlinear dynamic games (nonlinear differential games subject to additive and undesired deterministic perturbations. Moreover, the mathematical model of this class is completely unknown with the exception of the control actions of each player, and even though the deterministic noises are known, their power (or their effect is not. Therefore, two differential neural networks are designed in order to obtain a feedback (perfect state information pattern for the mentioned class of games. In this way, the stability conditions for two state identification errors and for a filtering error are established, the upper bounds of these errors are obtained, and two new learning laws for each neural network are suggested. Finally, an illustrating example shows the applicability of this approach.

A modified dynamic evolving neural-fuzzy approach to modeling customer satisfaction for affective design.

Science.gov (United States)

Kwong, C K; Fung, K Y; Jiang, Huimin; Chan, K Y; Siu, Kin Wai Michael

2013-01-01

Affective design is an important aspect of product development to achieve a competitive edge in the marketplace. A neural-fuzzy network approach has been attempted recently to model customer satisfaction for affective design and it has been proved to be an effective one to deal with the fuzziness and non-linearity of the modeling as well as generate explicit customer satisfaction models. However, such an approach to modeling customer satisfaction has two limitations. First, it is not suitable for the modeling problems which involve a large number of inputs. Second, it cannot adapt to new data sets, given that its structure is fixed once it has been developed. In this paper, a modified dynamic evolving neural-fuzzy approach is proposed to address the above mentioned limitations. A case study on the affective design of mobile phones was conducted to illustrate the effectiveness of the proposed methodology. Validation tests were conducted and the test results indicated that: (1) the conventional Adaptive Neuro-Fuzzy Inference System (ANFIS) failed to run due to a large number of inputs; (2) the proposed dynamic neural-fuzzy model outperforms the subtractive clustering-based ANFIS model and fuzzy c-means clustering-based ANFIS model in terms of their modeling accuracy and computational effort.

A Modified Dynamic Evolving Neural-Fuzzy Approach to Modeling Customer Satisfaction for Affective Design

Directory of Open Access Journals (Sweden)

C. K. Kwong

2013-01-01

Full Text Available Affective design is an important aspect of product development to achieve a competitive edge in the marketplace. A neural-fuzzy network approach has been attempted recently to model customer satisfaction for affective design and it has been proved to be an effective one to deal with the fuzziness and non-linearity of the modeling as well as generate explicit customer satisfaction models. However, such an approach to modeling customer satisfaction has two limitations. First, it is not suitable for the modeling problems which involve a large number of inputs. Second, it cannot adapt to new data sets, given that its structure is fixed once it has been developed. In this paper, a modified dynamic evolving neural-fuzzy approach is proposed to address the above mentioned limitations. A case study on the affective design of mobile phones was conducted to illustrate the effectiveness of the proposed methodology. Validation tests were conducted and the test results indicated that: (1 the conventional Adaptive Neuro-Fuzzy Inference System (ANFIS failed to run due to a large number of inputs; (2 the proposed dynamic neural-fuzzy model outperforms the subtractive clustering-based ANFIS model and fuzzy c-means clustering-based ANFIS model in terms of their modeling accuracy and computational effort.

Optimal system size for complex dynamics in random neural networks near criticality

Energy Technology Data Exchange (ETDEWEB)

Wainrib, Gilles, E-mail: wainrib@math.univ-paris13.fr [Laboratoire Analyse Géométrie et Applications, Université Paris XIII, Villetaneuse (France); García del Molino, Luis Carlos, E-mail: garciadelmolino@ijm.univ-paris-diderot.fr [Institute Jacques Monod, Université Paris VII, Paris (France)

2013-12-15

In this article, we consider a model of dynamical agents coupled through a random connectivity matrix, as introduced by Sompolinsky et al. [Phys. Rev. Lett. 61(3), 259–262 (1988)] in the context of random neural networks. When system size is infinite, it is known that increasing the disorder parameter induces a phase transition leading to chaotic dynamics. We observe and investigate here a novel phenomenon in the sub-critical regime for finite size systems: the probability of observing complex dynamics is maximal for an intermediate system size when the disorder is close enough to criticality. We give a more general explanation of this type of system size resonance in the framework of extreme values theory for eigenvalues of random matrices.

Optimal system size for complex dynamics in random neural networks near criticality

International Nuclear Information System (INIS)

Wainrib, Gilles; García del Molino, Luis Carlos

2013-01-01

In this article, we consider a model of dynamical agents coupled through a random connectivity matrix, as introduced by Sompolinsky et al. [Phys. Rev. Lett. 61(3), 259–262 (1988)] in the context of random neural networks. When system size is infinite, it is known that increasing the disorder parameter induces a phase transition leading to chaotic dynamics. We observe and investigate here a novel phenomenon in the sub-critical regime for finite size systems: the probability of observing complex dynamics is maximal for an intermediate system size when the disorder is close enough to criticality. We give a more general explanation of this type of system size resonance in the framework of extreme values theory for eigenvalues of random matrices

Biological oscillations for learning walking coordination: dynamic recurrent neural network functionally models physiological central pattern generator.

Science.gov (United States)

Hoellinger, Thomas; Petieau, Mathieu; Duvinage, Matthieu; Castermans, Thierry; Seetharaman, Karthik; Cebolla, Ana-Maria; Bengoetxea, Ana; Ivanenko, Yuri; Dan, Bernard; Cheron, Guy

2013-01-01

The existence of dedicated neuronal modules such as those organized in the cerebral cortex, thalamus, basal ganglia, cerebellum, or spinal cord raises the question of how these functional modules are coordinated for appropriate motor behavior. Study of human locomotion offers an interesting field for addressing this central question. The coordination of the elevation of the 3 leg segments under a planar covariation rule (Borghese et al., 1996) was recently modeled (Barliya et al., 2009) by phase-adjusted simple oscillators shedding new light on the understanding of the central pattern generator (CPG) processing relevant oscillation signals. We describe the use of a dynamic recurrent neural network (DRNN) mimicking the natural oscillatory behavior of human locomotion for reproducing the planar covariation rule in both legs at different walking speeds. Neural network learning was based on sinusoid signals integrating frequency and amplitude features of the first three harmonics of the sagittal elevation angles of the thigh, shank, and foot of each lower limb. We verified the biological plausibility of the neural networks. Best results were obtained with oscillations extracted from the first three harmonics in comparison to oscillations outside the harmonic frequency peaks. Physiological replication steadily increased with the number of neuronal units from 1 to 80, where similarity index reached 0.99. Analysis of synaptic weighting showed that the proportion of inhibitory connections consistently increased with the number of neuronal units in the DRNN. This emerging property in the artificial neural networks resonates with recent advances in neurophysiology of inhibitory neurons that are involved in central nervous system oscillatory activities. The main message of this study is that this type of DRNN may offer a useful model of physiological central pattern generator for gaining insights in basic research and developing clinical applications.

SuperNeurons: Dynamic GPU Memory Management for Training Deep Neural Networks

OpenAIRE

Wang, Linnan; Ye, Jinmian; Zhao, Yiyang; Wu, Wei; Li, Ang; Song, Shuaiwen Leon; Xu, Zenglin; Kraska, Tim

2018-01-01

Going deeper and wider in neural architectures improves the accuracy, while the limited GPU DRAM places an undesired restriction on the network design domain. Deep Learning (DL) practitioners either need change to less desired network architectures, or nontrivially dissect a network across multiGPUs. These distract DL practitioners from concentrating on their original machine learning tasks. We present SuperNeurons: a dynamic GPU memory scheduling runtime to enable the network training far be...

Neural networks in signal processing

International Nuclear Information System (INIS)

Govil, R.

2000-01-01

Nuclear Engineering has matured during the last decade. In research and design, control, supervision, maintenance and production, mathematical models and theories are used extensively. In all such applications signal processing is embedded in the process. Artificial Neural Networks (ANN), because of their nonlinear, adaptive nature are well suited to such applications where the classical assumptions of linearity and second order Gaussian noise statistics cannot be made. ANN's can be treated as nonparametric techniques, which can model an underlying process from example data. They can also adopt their model parameters to statistical change with time. Algorithms in the framework of Neural Networks in Signal processing have found new applications potentials in the field of Nuclear Engineering. This paper reviews the fundamentals of Neural Networks in signal processing and their applications in tasks such as recognition/identification and control. The topics covered include dynamic modeling, model based ANN's, statistical learning, eigen structure based processing and generalization structures. (orig.)

Neural network approach to time-dependent dividing surfaces in classical reaction dynamics

Science.gov (United States)

Schraft, Philippe; Junginger, Andrej; Feldmaier, Matthias; Bardakcioglu, Robin; Main, Jörg; Wunner, Günter; Hernandez, Rigoberto

2018-04-01

In a dynamical system, the transition between reactants and products is typically mediated by an energy barrier whose properties determine the corresponding pathways and rates. The latter is the flux through a dividing surface (DS) between the two corresponding regions, and it is exact only if it is free of recrossings. For time-independent barriers, the DS can be attached to the top of the corresponding saddle point of the potential energy surface, and in time-dependent systems, the DS is a moving object. The precise determination of these direct reaction rates, e.g., using transition state theory, requires the actual construction of a DS for a given saddle geometry, which is in general a demanding methodical and computational task, especially in high-dimensional systems. In this paper, we demonstrate how such time-dependent, global, and recrossing-free DSs can be constructed using neural networks. In our approach, the neural network uses the bath coordinates and time as input, and it is trained in a way that its output provides the position of the DS along the reaction coordinate. An advantage of this procedure is that, once the neural network is trained, the complete information about the dynamical phase space separation is stored in the network's parameters, and a precise distinction between reactants and products can be made for all possible system configurations, all times, and with little computational effort. We demonstrate this general method for two- and three-dimensional systems and explain its straightforward extension to even more degrees of freedom.

The effects of noise on binocular rivalry waves: a stochastic neural field model

KAUST Repository

Webber, Matthew A

2013-03-12

We analyze the effects of extrinsic noise on traveling waves of visual perception in a competitive neural field model of binocular rivalry. The model consists of two one-dimensional excitatory neural fields, whose activity variables represent the responses to left-eye and right-eye stimuli, respectively. The two networks mutually inhibit each other, and slow adaptation is incorporated into the model by taking the network connections to exhibit synaptic depression. We first show how, in the absence of any noise, the system supports a propagating composite wave consisting of an invading activity front in one network co-moving with a retreating front in the other network. Using a separation of time scales and perturbation methods previously developed for stochastic reaction-diffusion equations, we then show how extrinsic noise in the activity variables leads to a diffusive-like displacement (wandering) of the composite wave from its uniformly translating position at long time scales, and fluctuations in the wave profile around its instantaneous position at short time scales. We use our analysis to calculate the first-passage-time distribution for a stochastic rivalry wave to travel a fixed distance, which we find to be given by an inverse Gaussian. Finally, we investigate the effects of noise in the depression variables, which under an adiabatic approximation lead to quenched disorder in the neural fields during propagation of a wave. © 2013 IOP Publishing Ltd and SISSA Medialab srl.

Adaptive Neural Output-Feedback Control for a Class of Nonlower Triangular Nonlinear Systems With Unmodeled Dynamics.

Science.gov (United States)

Wang, Huanqing; Liu, Peter Xiaoping; Li, Shuai; Wang, Ding

2017-08-29

This paper presents the development of an adaptive neural controller for a class of nonlinear systems with unmodeled dynamics and immeasurable states. An observer is designed to estimate system states. The structure consistency of virtual control signals and the variable partition technique are combined to overcome the difficulties appearing in a nonlower triangular form. An adaptive neural output-feedback controller is developed based on the backstepping technique and the universal approximation property of the radial basis function (RBF) neural networks. By using the Lyapunov stability analysis, the semiglobally and uniformly ultimate boundedness of all signals within the closed-loop system is guaranteed. The simulation results show that the controlled system converges quickly, and all the signals are bounded. This paper is novel at least in the two aspects: 1) an output-feedback control strategy is developed for a class of nonlower triangular nonlinear systems with unmodeled dynamics and 2) the nonlinear disturbances and their bounds are the functions of all states, which is in a more general form than existing results.

Dynamic plasticity in coupled avian midbrain maps

Science.gov (United States)

Atwal, Gurinder Singh

2004-12-01

Internal mapping of the external environment is carried out using the receptive fields of topographic neurons in the brain, and in a normal barn owl the aural and visual subcortical maps are aligned from early experiences. However, instantaneous misalignment of the aural and visual stimuli has been observed to result in adaptive behavior, manifested by functional and anatomical changes of the auditory processing system. Using methods of information theory and statistical mechanics a model of the adaptive dynamics of the aural receptive field is presented and analyzed. The dynamics is determined by maximizing the mutual information between the neural output and the weighted sensory neural inputs, admixed with noise, subject to biophysical constraints. The reduced costs of neural rewiring, as in the case of young barn owls, reveal two qualitatively different types of receptive field adaptation depending on the magnitude of the audiovisual misalignment. By letting the misalignment increase with time, it is shown that the ability to adapt can be increased even when neural rewiring costs are high, in agreement with recent experimental reports of the increased plasticity of the auditory space map in adult barn owls due to incremental learning. Finally, a critical speed of misalignment is identified, demarcating the crossover from adaptive to nonadaptive behavior.

Effective electric fields along realistic DTI-based neural trajectories for modelling the stimulation mechanisms of TMS

NARCIS (Netherlands)

De Geeter, N.; Crevecoeur, G.; Leemans, A.; Dupré, L.

2015-01-01

In transcranial magnetic stimulation (TMS), an applied alternating magnetic field induces an electric field in the brain that can interact with the neural system. It is generally assumed that this induced electric field is the crucial effect exciting a certain region of the brain. More specifically,

Quantum perceptron over a field and neural network architecture selection in a quantum computer.

Science.gov (United States)

da Silva, Adenilton José; Ludermir, Teresa Bernarda; de Oliveira, Wilson Rosa

2016-04-01

In this work, we propose a quantum neural network named quantum perceptron over a field (QPF). Quantum computers are not yet a reality and the models and algorithms proposed in this work cannot be simulated in actual (or classical) computers. QPF is a direct generalization of a classical perceptron and solves some drawbacks found in previous models of quantum perceptrons. We also present a learning algorithm named Superposition based Architecture Learning algorithm (SAL) that optimizes the neural network weights and architectures. SAL searches for the best architecture in a finite set of neural network architectures with linear time over the number of patterns in the training set. SAL is the first learning algorithm to determine neural network architectures in polynomial time. This speedup is obtained by the use of quantum parallelism and a non-linear quantum operator. Copyright © 2016 Elsevier Ltd. All rights reserved.

Synchronization of cellular neural networks of neutral type via dynamic feedback controller

International Nuclear Information System (INIS)

Park, Ju H.

2009-01-01

In this paper, we aim to study global synchronization for neural networks with neutral delay. A dynamic feedback control scheme is proposed to achieve the synchronization between drive network and response network. By utilizing the Lyapunov function and linear matrix inequalities (LMIs), we derive simple and efficient criterion in terms of LMIs for synchronization. The feedback controllers can be easily obtained by solving the derived LMIs.

Behavioural modelling using the MOESP algorithm, dynamic neural networks and the Bartels-Stewart algorithm

NARCIS (Netherlands)

Schilders, W.H.A.; Meijer, P.B.L.; Ciggaar, E.

2008-01-01

In this paper we discuss the use of the state-space modelling MOESP algorithm to generate precise information about the number of neurons and hidden layers in dynamic neural networks developed for the behavioural modelling of electronic circuits. The Bartels–Stewart algorithm is used to transform

Dynamic cultural influences on neural representations of the self.

Science.gov (United States)

Chiao, Joan Y; Harada, Tokiko; Komeda, Hidetsugu; Li, Zhang; Mano, Yoko; Saito, Daisuke; Parrish, Todd B; Sadato, Norihiro; Iidaka, Tetsuya

2010-01-01

People living in multicultural environments often encounter situations which require them to acquire different cultural schemas and to switch between these cultural schemas depending on their immediate sociocultural context. Prior behavioral studies show that priming cultural schemas reliably impacts mental processes and behavior underlying self-concept. However, less well understood is whether or not cultural priming affects neurobiological mechanisms underlying the self. Here we examined whether priming cultural values of individualism and collectivism in bicultural individuals affects neural activity in cortical midline structures underlying self-relevant processes using functional magnetic resonance imaging. Biculturals primed with individualistic values showed increased activation within medial prefrontal cortex (MPFC) and posterior cingulate cortex (PCC) during general relative to contextual self-judgments, whereas biculturals primed with collectivistic values showed increased response within MPFC and PCC during contextual relative to general self-judgments. Moreover, degree of cultural priming was positively correlated with degree of MPFC and PCC activity during culturally congruent self-judgments. These findings illustrate the dynamic influence of culture on neural representations underlying the self and, more broadly, suggest a neurobiological basis by which people acculturate to novel environments.

A Neural Network Model to Learn Multiple Tasks under Dynamic Environments

Science.gov (United States)

Tsumori, Kenji; Ozawa, Seiichi

When environments are dynamically changed for agents, the knowledge acquired in an environment might be useless in future. In such dynamic environments, agents should be able to not only acquire new knowledge but also modify old knowledge in learning. However, modifying all knowledge acquired before is not efficient because the knowledge once acquired may be useful again when similar environment reappears and some knowledge can be shared among different environments. To learn efficiently in such environments, we propose a neural network model that consists of the following modules: resource allocating network, long-term & short-term memory, and environment change detector. We evaluate the model under a class of dynamic environments where multiple function approximation tasks are sequentially given. The experimental results demonstrate that the proposed model possesses stable incremental learning, accurate environmental change detection, proper association and recall of old knowledge, and efficient knowledge transfer.

Low-dimensional models of ‘Neuro-glio-vascular unit’ for describing neural dynamics under normal and energy-starved conditions

Directory of Open Access Journals (Sweden)

Karishma eChhabria

2016-03-01

Full Text Available The motivation of developing simple minimal models for neuro-glio-vascular system arises from a recent modeling study elucidating the bidirectional information flow within the neuro-glio-vascular system having 89 dynamic equations (Chander and Chakravarthy 2012. While this was one of the first attempts at formulating a comprehensive model for neuro-glia-vascular system, it poses severe restrictions in scaling up to network levels. On the contrary, low dimensional models are convenient devices in simulating large networks that also provide an intuitive understanding of the complex interactions occurring within the neuro-glio-vascular system. The key idea underlying the proposed models is to describe the glio-vascular system as a lumped system which takes neural firing rate as input and returns an ‘energy’ variable (analogous to ATP as output. To this end we present two models: Biophysical neuro-energy (Model #1 with 5 variables, comprising of KATP channel activity governed by neuronal ATP dynamics and the Dynamic threshold (Model #2 with 3 variables depicting the dependence of neural firing threshold on the ATP dynamics. Both the models show different firing regimes such as continuous spiking, phasic and tonic bursting depending on the ATP production coefficient, εp and external current. We then demonstrate that in a network comprising of such energy-dependent neuron units, εp could modulate the Local field potential (LFP frequency and amplitude. Interestingly, low frequency LFP dominates under low εp conditions, which is thought to be reminiscent of seizure-like activity observed in epilepsy. The proposed ‘neuron-energy’ unit may be implemented in building models of neuro-glio-vascular networks to simulate data obtained from multimodal neuroimaging systems such as fNIRS-EEG and fMRI-EEG. Such models could also provide a theoretical basis for devising optimal neurorehabilitation strategies such as non-invasive brain stimulation for

Extracting functional components of neural dynamics with Independent Component Analysis and inverse Current Source Density.

Science.gov (United States)

Lęski, Szymon; Kublik, Ewa; Swiejkowski, Daniel A; Wróbel, Andrzej; Wójcik, Daniel K

2010-12-01

Local field potentials have good temporal resolution but are blurred due to the slow spatial decay of the electric field. For simultaneous recordings on regular grids one can reconstruct efficiently the current sources (CSD) using the inverse Current Source Density method (iCSD). It is possible to decompose the resultant spatiotemporal information about the current dynamics into functional components using Independent Component Analysis (ICA). We show on test data modeling recordings of evoked potentials on a grid of 4 × 5 × 7 points that meaningful results are obtained with spatial ICA decomposition of reconstructed CSD. The components obtained through decomposition of CSD are better defined and allow easier physiological interpretation than the results of similar analysis of corresponding evoked potentials in the thalamus. We show that spatiotemporal ICA decompositions can perform better for certain types of sources but it does not seem to be the case for the experimental data studied. Having found the appropriate approach to decomposing neural dynamics into functional components we use the technique to study the somatosensory evoked potentials recorded on a grid spanning a large part of the forebrain. We discuss two example components associated with the first waves of activation of the somatosensory thalamus. We show that the proposed method brings up new, more detailed information on the time and spatial location of specific activity conveyed through various parts of the somatosensory thalamus in the rat.

Spatial and Angular Resolution Enhancement of Light Fields Using Convolutional Neural Networks

Science.gov (United States)

Gul, M. Shahzeb Khan; Gunturk, Bahadir K.

2018-05-01

Light field imaging extends the traditional photography by capturing both spatial and angular distribution of light, which enables new capabilities, including post-capture refocusing, post-capture aperture control, and depth estimation from a single shot. Micro-lens array (MLA) based light field cameras offer a cost-effective approach to capture light field. A major drawback of MLA based light field cameras is low spatial resolution, which is due to the fact that a single image sensor is shared to capture both spatial and angular information. In this paper, we present a learning based light field enhancement approach. Both spatial and angular resolution of captured light field is enhanced using convolutional neural networks. The proposed method is tested with real light field data captured with a Lytro light field camera, clearly demonstrating spatial and angular resolution improvement.

Population coding and decoding in a neural field: a computational study.

Science.gov (United States)

Wu, Si; Amari, Shun-Ichi; Nakahara, Hiroyuki

2002-05-01

This study uses a neural field model to investigate computational aspects of population coding and decoding when the stimulus is a single variable. A general prototype model for the encoding process is proposed, in which neural responses are correlated, with strength specified by a gaussian function of their difference in preferred stimuli. Based on the model, we study the effect of correlation on the Fisher information, compare the performances of three decoding methods that differ in the amount of encoding information being used, and investigate the implementation of the three methods by using a recurrent network. This study not only rediscovers main results in existing literatures in a unified way, but also reveals important new features, especially when the neural correlation is strong. As the neural correlation of firing becomes larger, the Fisher information decreases drastically. We confirm that as the width of correlation increases, the Fisher information saturates and no longer increases in proportion to the number of neurons. However, we prove that as the width increases further--wider than (sqrt)2 times the effective width of the turning function--the Fisher information increases again, and it increases without limit in proportion to the number of neurons. Furthermore, we clarify the asymptotic efficiency of the maximum likelihood inference (MLI) type of decoding methods for correlated neural signals. It shows that when the correlation covers a nonlocal range of population (excepting the uniform correlation and when the noise is extremely small), the MLI type of method, whose decoding error satisfies the Cauchy-type distribution, is not asymptotically efficient. This implies that the variance is no longer adequate to measure decoding accuracy.

A mathematical analysis of the effects of Hebbian learning rules on the dynamics and structure of discrete-time random recurrent neural networks.

Science.gov (United States)

Siri, Benoît; Berry, Hugues; Cessac, Bruno; Delord, Bruno; Quoy, Mathias

2008-12-01

We present a mathematical analysis of the effects of Hebbian learning in random recurrent neural networks, with a generic Hebbian learning rule, including passive forgetting and different timescales, for neuronal activity and learning dynamics. Previous numerical work has reported that Hebbian learning drives the system from chaos to a steady state through a sequence of bifurcations. Here, we interpret these results mathematically and show that these effects, involving a complex coupling between neuronal dynamics and synaptic graph structure, can be analyzed using Jacobian matrices, which introduce both a structural and a dynamical point of view on neural network evolution. Furthermore, we show that sensitivity to a learned pattern is maximal when the largest Lyapunov exponent is close to 0. We discuss how neural networks may take advantage of this regime of high functional interest.

An Incremental Time-delay Neural Network for Dynamical Recurrent Associative Memory

Institute of Scientific and Technical Information of China (English)

无

2002-01-01

An incremental time-delay neural network based on synapse growth, which is suitable for dynamic control and learning of autonomous robots, is proposed to improve the learning and retrieving performance of dynamical recurrent associative memory architecture. The model allows steady and continuous establishment of associative memory for spatio-temporal regularities and time series in discrete sequence of inputs. The inserted hidden units can be taken as the long-term memories that expand the capacity of network and sometimes may fade away under certain condition. Preliminary experiment has shown that this incremental network may be a promising approach to endow autonomous robots with the ability of adapting to new data without destroying the learned patterns. The system also benefits from its potential chaos character for emergence.

Effects of neuronal loss in the dynamic model of neural networks

International Nuclear Information System (INIS)

Yoon, B-G; Choi, J; Choi, M Y

2008-01-01

We study the phase transitions and dynamic behavior of the dynamic model of neural networks, with an emphasis on the effects of neuronal loss due to external stress. In the absence of loss the overall results obtained numerically are found to agree excellently with the theoretical ones. When the external stress is turned on, some neurons may deteriorate and die; such loss of neurons, in general, weakens the memory in the system. As the loss increases beyond a critical value, the order parameter measuring the strength of memory decreases to zero either continuously or discontinuously, namely, the system loses its memory via a second- or a first-order transition, depending on the ratio of the refractory period to the duration of action potential

Neural network modeling of chaotic dynamics in nuclear reactor flows

International Nuclear Information System (INIS)

Welstead, S.T.

1992-01-01

Neural networks have many scientific applications in areas such as pattern classification and time series prediction. The universal approximation property of these networks, however, can also be exploited to provide researchers with tool for modeling observed nonlinear phenomena. It has been shown that multilayer feed forward networks can capture important global nonlinear properties, such as chaotic dynamics, merely by training the network on a finite set of observed data. The network itself then provides a model of the process that generated the data. Characterizations such as the existence and general shape of a strange attractor and the sign of the largest Lyapunov exponent can then be extracted from the neural network model. In this paper, the author applies this idea to data generated from a nonlinear process that is representative of convective flows that can arise in nuclear reactor applications. Such flows play a role in forced convection heat removal from pressurized water reactors and boiling water reactors, and decay heat removal from liquid-metal-cooled reactors, either by natural convection or by thermosyphons

Representation of neural networks as Lotka-Volterra systems

International Nuclear Information System (INIS)

Moreau, Yves; Vandewalle, Joos; Louies, Stephane; Brenig, Leon

1999-01-01

We study changes of coordinates that allow the representation of the ordinary differential equations describing continuous-time recurrent neural networks into differential equations describing predator-prey models--also called Lotka-Volterra systems. We transform the equations for the neural network first into quasi-monomial form, where we express the vector field of the dynamical system as a linear combination of products of powers of the variables. In practice, this transformation is possible only if the activation function is the hyperbolic tangent or the logistic sigmoied. From this quasi-monomial form, we can directly transform the system further into Lotka-Volterra equations. The resulting Lotka-Volterra system is of higher dimension than the original system, but the behavior of its first variables is equivalent to the behavior of the original neural network

Comparative sensitivity of human and rat neural cultures to chemical-induced inhibition of neurite outgrowth

Energy Technology Data Exchange (ETDEWEB)

Harrill, Joshua A.; Freudenrich, Theresa M.; Robinette, Brian L.; Mundy, William R., E-mail: mundy.william@epa.gov

2011-11-15

There is a need for rapid, efficient and cost-effective alternatives to traditional in vivo developmental neurotoxicity testing. In vitro cell culture models can recapitulate many of the key cellular processes of nervous system development, including neurite outgrowth, and may be used as screening tools to identify potential developmental neurotoxicants. The present study compared primary rat cortical cultures and human embryonic stem cell-derived neural cultures in terms of: 1) reproducibility of high content image analysis based neurite outgrowth measurements, 2) dynamic range of neurite outgrowth measurements and 3) sensitivity to chemicals which have been shown to inhibit neurite outgrowth. There was a large increase in neurite outgrowth between 2 and 24 h in both rat and human cultures. Image analysis data collected across multiple cultures demonstrated that neurite outgrowth measurements in rat cortical cultures were more reproducible and had higher dynamic range as compared to human neural cultures. Human neural cultures were more sensitive than rat cortical cultures to chemicals previously shown to inhibit neurite outgrowth. Parallel analysis of morphological (neurite count, neurite length) and cytotoxicity (neurons per field) measurements were used to detect selective effects on neurite outgrowth. All chemicals which inhibited neurite outgrowth in rat cortical cultures did so at concentrations which did not concurrently affect the number of neurons per field, indicating selective effects on neurite outgrowth. In contrast, more than half the chemicals which inhibited neurite outgrowth in human neural cultures did so at concentrations which concurrently decreased the number of neurons per field, indicating that effects on neurite outgrowth were secondary to cytotoxicity. Overall, these data demonstrate that the culture models performed differently in terms of reproducibility, dynamic range and sensitivity to neurite outgrowth inhibitors. While human neural

Comparative sensitivity of human and rat neural cultures to chemical-induced inhibition of neurite outgrowth

International Nuclear Information System (INIS)

Harrill, Joshua A.; Freudenrich, Theresa M.; Robinette, Brian L.; Mundy, William R.

2011-01-01

There is a need for rapid, efficient and cost-effective alternatives to traditional in vivo developmental neurotoxicity testing. In vitro cell culture models can recapitulate many of the key cellular processes of nervous system development, including neurite outgrowth, and may be used as screening tools to identify potential developmental neurotoxicants. The present study compared primary rat cortical cultures and human embryonic stem cell-derived neural cultures in terms of: 1) reproducibility of high content image analysis based neurite outgrowth measurements, 2) dynamic range of neurite outgrowth measurements and 3) sensitivity to chemicals which have been shown to inhibit neurite outgrowth. There was a large increase in neurite outgrowth between 2 and 24 h in both rat and human cultures. Image analysis data collected across multiple cultures demonstrated that neurite outgrowth measurements in rat cortical cultures were more reproducible and had higher dynamic range as compared to human neural cultures. Human neural cultures were more sensitive than rat cortical cultures to chemicals previously shown to inhibit neurite outgrowth. Parallel analysis of morphological (neurite count, neurite length) and cytotoxicity (neurons per field) measurements were used to detect selective effects on neurite outgrowth. All chemicals which inhibited neurite outgrowth in rat cortical cultures did so at concentrations which did not concurrently affect the number of neurons per field, indicating selective effects on neurite outgrowth. In contrast, more than half the chemicals which inhibited neurite outgrowth in human neural cultures did so at concentrations which concurrently decreased the number of neurons per field, indicating that effects on neurite outgrowth were secondary to cytotoxicity. Overall, these data demonstrate that the culture models performed differently in terms of reproducibility, dynamic range and sensitivity to neurite outgrowth inhibitors. While human neural

On the genesis of spike-wave oscillations in a mean-field model of human thalamic and corticothalamic dynamics

International Nuclear Information System (INIS)

Rodrigues, Serafim; Terry, John R.; Breakspear, Michael

2006-01-01

In this Letter, the genesis of spike-wave activity-a hallmark of many generalized epileptic seizures-is investigated in a reduced mean-field model of human neural activity. Drawing upon brain modelling and dynamical systems theory, we demonstrate that the thalamic circuitry of the system is crucial for the generation of these abnormal rhythms, observing that the combination of inhibition from reticular nuclei and excitation from the cortical signal, interplay to generate the spike-wave oscillation. The mechanism revealed provides an explanation of why approaches based on linear stability and Heaviside approximations to the activation function have failed to explain the phenomena of spike-wave behaviour in mean-field models. A mathematical understanding of this transition is a crucial step towards relating spiking network models and mean-field approaches to human brain modelling

Autonomous dynamics in neural networks: the dHAN concept and associative thought processes

Science.gov (United States)

Gros, Claudius

2007-02-01

The neural activity of the human brain is dominated by self-sustained activities. External sensory stimuli influence this autonomous activity but they do not drive the brain directly. Most standard artificial neural network models are however input driven and do not show spontaneous activities. It constitutes a challenge to develop organizational principles for controlled, self-sustained activity in artificial neural networks. Here we propose and examine the dHAN concept for autonomous associative thought processes in dense and homogeneous associative networks. An associative thought-process is characterized, within this approach, by a time-series of transient attractors. Each transient state corresponds to a stored information, a memory. The subsequent transient states are characterized by large associative overlaps, which are identical to acquired patterns. Memory states, the acquired patterns, have such a dual functionality. In this approach the self-sustained neural activity has a central functional role. The network acquires a discrimination capability, as external stimuli need to compete with the autonomous activity. Noise in the input is readily filtered-out. Hebbian learning of external patterns occurs coinstantaneous with the ongoing associative thought process. The autonomous dynamics needs a long-term working-point optimization which acquires within the dHAN concept a dual functionality: It stabilizes the time development of the associative thought process and limits runaway synaptic growth, which generically occurs otherwise in neural networks with self-induced activities and Hebbian-type learning rules.

An implantable wireless neural interface for recording cortical circuit dynamics in moving primates

Science.gov (United States)

Borton, David A.; Yin, Ming; Aceros, Juan; Nurmikko, Arto

2013-04-01

Objective. Neural interface technology suitable for clinical translation has the potential to significantly impact the lives of amputees, spinal cord injury victims and those living with severe neuromotor disease. Such systems must be chronically safe, durable and effective. Approach. We have designed and implemented a neural interface microsystem, housed in a compact, subcutaneous and hermetically sealed titanium enclosure. The implanted device interfaces the brain with a 510k-approved, 100-element silicon-based microelectrode array via a custom hermetic feedthrough design. Full spectrum neural signals were amplified (0.1 Hz to 7.8 kHz, 200× gain) and multiplexed by a custom application specific integrated circuit, digitized and then packaged for transmission. The neural data (24 Mbps) were transmitted by a wireless data link carried on a frequency-shift-key-modulated signal at 3.2 and 3.8 GHz to a receiver 1 m away by design as a point-to-point communication link for human clinical use. The system was powered by an embedded medical grade rechargeable Li-ion battery for 7 h continuous operation between recharge via an inductive transcutaneous wireless power link at 2 MHz. Main results. Device verification and early validation were performed in both swine and non-human primate freely-moving animal models and showed that the wireless implant was electrically stable, effective in capturing and delivering broadband neural data, and safe for over one year of testing. In addition, we have used the multichannel data from these mobile animal models to demonstrate the ability to decode neural population dynamics associated with motor activity. Significance. We have developed an implanted wireless broadband neural recording device evaluated in non-human primate and swine. The use of this new implantable neural interface technology can provide insight into how to advance human neuroprostheses beyond the present early clinical trials. Further, such tools enable mobile

Neural mechanisms of the mind, Aristotle, Zadeh, and fMRI.

Science.gov (United States)

Perlovsky, Leonid I

2010-05-01

Processes in the mind: perception, cognition, concepts, instincts, emotions, and higher cognitive abilities for abstract thinking, beautiful music are considered here within a neural modeling fields (NMFs) paradigm. Its fundamental mathematical mechanism is a process "from vague-fuzzy to crisp," called dynamic logic (DL). This paper discusses why this paradigm is necessary mathematically, and relates it to a psychological description of the mind. Surprisingly, the process from "vague to crisp" corresponds to Aristotelian understanding of mental functioning. Recent functional magnetic resonance imaging (fMRI) measurements confirmed this process in neural mechanisms of perception.

Topological defects control collective dynamics in neural progenitor cell cultures

Science.gov (United States)

Kawaguchi, Kyogo; Kageyama, Ryoichiro; Sano, Masaki

2017-04-01

Cultured stem cells have become a standard platform not only for regenerative medicine and developmental biology but also for biophysical studies. Yet, the characterization of cultured stem cells at the level of morphology and of the macroscopic patterns resulting from cell-to-cell interactions remains largely qualitative. Here we report on the collective dynamics of cultured murine neural progenitor cells (NPCs), which are multipotent stem cells that give rise to cells in the central nervous system. At low densities, NPCs moved randomly in an amoeba-like fashion. However, NPCs at high density elongated and aligned their shapes with one another, gliding at relatively high velocities. Although the direction of motion of individual cells reversed stochastically along the axes of alignment, the cells were capable of forming an aligned pattern up to length scales similar to that of the migratory stream observed in the adult brain. The two-dimensional order of alignment within the culture showed a liquid-crystalline pattern containing interspersed topological defects with winding numbers of +1/2 and -1/2 (half-integer due to the nematic feature that arises from the head-tail symmetry of cell-to-cell interaction). We identified rapid cell accumulation at +1/2 defects and the formation of three-dimensional mounds. Imaging at the single-cell level around the defects allowed us to quantify the velocity field and the evolving cell density; cells not only concentrate at +1/2 defects, but also escape from -1/2 defects. We propose a generic mechanism for the instability in cell density around the defects that arises from the interplay between the anisotropic friction and the active force field.

Dynamical system with plastic self-organized velocity field as an alternative conceptual model of a cognitive system.

Science.gov (United States)

Janson, Natalia B; Marsden, Christopher J

2017-12-05

It is well known that architecturally the brain is a neural network, i.e. a collection of many relatively simple units coupled flexibly. However, it has been unclear how the possession of this architecture enables higher-level cognitive functions, which are unique to the brain. Here, we consider the brain from the viewpoint of dynamical systems theory and hypothesize that the unique feature of the brain, the self-organized plasticity of its architecture, could represent the means of enabling the self-organized plasticity of its velocity vector field. We propose that, conceptually, the principle of cognition could amount to the existence of appropriate rules governing self-organization of the velocity field of a dynamical system with an appropriate account of stimuli. To support this hypothesis, we propose a simple non-neuromorphic mathematical model with a plastic self-organized velocity field, which has no prototype in physical world. This system is shown to be capable of basic cognition, which is illustrated numerically and with musical data. Our conceptual model could provide an additional insight into the working principles of the brain. Moreover, hardware implementations of plastic velocity fields self-organizing according to various rules could pave the way to creating artificial intelligence of a novel type.

AUC-Maximized Deep Convolutional Neural Fields for Protein Sequence Labeling.

Science.gov (United States)

Wang, Sheng; Sun, Siqi; Xu, Jinbo

2016-09-01

Deep Convolutional Neural Networks (DCNN) has shown excellent performance in a variety of machine learning tasks. This paper presents Deep Convolutional Neural Fields (DeepCNF), an integration of DCNN with Conditional Random Field (CRF), for sequence labeling with an imbalanced label distribution. The widely-used training methods, such as maximum-likelihood and maximum labelwise accuracy, do not work well on imbalanced data. To handle this, we present a new training algorithm called maximum-AUC for DeepCNF. That is, we train DeepCNF by directly maximizing the empirical Area Under the ROC Curve (AUC), which is an unbiased measurement for imbalanced data. To fulfill this, we formulate AUC in a pairwise ranking framework, approximate it by a polynomial function and then apply a gradient-based procedure to optimize it. Our experimental results confirm that maximum-AUC greatly outperforms the other two training methods on 8-state secondary structure prediction and disorder prediction since their label distributions are highly imbalanced and also has similar performance as the other two training methods on solvent accessibility prediction, which has three equally-distributed labels. Furthermore, our experimental results show that our AUC-trained DeepCNF models greatly outperform existing popular predictors of these three tasks. The data and software related to this paper are available at https://github.com/realbigws/DeepCNF_AUC.

Adult subependymal neural precursors, but not differentiated cells, undergo rapid cathodal migration in the presence of direct current electric fields.

Directory of Open Access Journals (Sweden)

Robart Babona-Pilipos

Full Text Available BACKGROUND: The existence of neural stem and progenitor cells (together termed neural precursor cells in the adult mammalian brain has sparked great interest in utilizing these cells for regenerative medicine strategies. Endogenous neural precursors within the adult forebrain subependyma can be activated following injury, resulting in their proliferation and migration toward lesion sites where they differentiate into neural cells. The administration of growth factors and immunomodulatory agents following injury augments this activation and has been shown to result in behavioural functional recovery following stroke. METHODS AND FINDINGS: With the goal of enhancing neural precursor migration to facilitate the repair process we report that externally applied direct current electric fields induce rapid and directed cathodal migration of pure populations of undifferentiated adult subependyma-derived neural precursors. Using time-lapse imaging microscopy in vitro we performed an extensive single-cell kinematic analysis demonstrating that this galvanotactic phenomenon is a feature of undifferentiated precursors, and not differentiated phenotypes. Moreover, we have shown that the migratory response of the neural precursors is a direct effect of the electric field and not due to chemotactic gradients. We also identified that epidermal growth factor receptor (EGFR signaling plays a role in the galvanotactic response as blocking EGFR significantly attenuates the migratory behaviour. CONCLUSIONS: These findings suggest direct current electric fields may be implemented in endogenous repair paradigms to promote migration and tissue repair following neurotrauma.

Neural network based adaptive control for nonlinear dynamic regimes

Science.gov (United States)

Shin, Yoonghyun

Adaptive control designs using neural networks (NNs) based on dynamic inversion are investigated for aerospace vehicles which are operated at highly nonlinear dynamic regimes. NNs play a key role as the principal element of adaptation to approximately cancel the effect of inversion error, which subsequently improves robustness to parametric uncertainty and unmodeled dynamics in nonlinear regimes. An adaptive control scheme previously named 'composite model reference adaptive control' is further developed so that it can be applied to multi-input multi-output output feedback dynamic inversion. It can have adaptive elements in both the dynamic compensator (linear controller) part and/or in the conventional adaptive controller part, also utilizing state estimation information for NN adaptation. This methodology has more flexibility and thus hopefully greater potential than conventional adaptive designs for adaptive flight control in highly nonlinear flight regimes. The stability of the control system is proved through Lyapunov theorems, and validated with simulations. The control designs in this thesis also include the use of 'pseudo-control hedging' techniques which are introduced to prevent the NNs from attempting to adapt to various actuation nonlinearities such as actuator position and rate saturations. Control allocation is introduced for the case of redundant control effectors including thrust vectoring nozzles. A thorough comparison study of conventional and NN-based adaptive designs for a system under a limit cycle, wing-rock, is included in this research, and the NN-based adaptive control designs demonstrate their performances for two highly maneuverable aerial vehicles, NASA F-15 ACTIVE and FQM-117B unmanned aerial vehicle (UAV), operated under various nonlinearities and uncertainties.

Artificial neural networks for dynamic monitoring of simulated-operating parameters of high temperature gas cooled engineering test reactor (HTTR)

International Nuclear Information System (INIS)

Seker, Serhat; Tuerkcan, Erdinc; Ayaz, Emine; Barutcu, Burak

2003-01-01

This paper addresses to the problem of utilisation of the artificial neural networks (ANNs) for detecting anomalies as well as physical parameters of a nuclear power plant during power operation in real time. Three different types of neural network algorithms were used namely, feed-forward neural network (back-propagation, BP) and two types of recurrent neural networks (RNN). The data used in this paper were gathered from the simulation of the power operation of the Japan's High Temperature Engineering Testing Reactor (HTTR). For the wide range of power operation, 56 signals were generated by the reactor dynamic simulation code for several hours of normal power operation at different power ramps between 30 and 100% nominal power. Paper will compare the outcomes of different neural networks and presents the neural network system and the determination of physical parameters from the simulated operating data

Combining BMI stimulation and mathematical modeling for acute stroke recovery and neural repair

Directory of Open Access Journals (Sweden)

Sara L Gonzalez Andino

2011-07-01

Full Text Available Rehabilitation is a neural plasticity-exploiting approach that forces undamaged neural circuits to undertake the functionality of other circuits damaged by stroke. It aims to partial restoration of the neural functions by circuit remodeling rather than by the regeneration of damaged circuits. The core hypothesis of the present paper is that - in stroke - Brain Machine Interfaces can be designed to target neural repair instead of rehabilitation. To support this hypothesis we first review existing evidence on the role of endogenous or externally applied electric fields on all processes involved in CNS repair. We then describe our own results to illustrate the neuroprotective and neuroregenerative effects of BMI- electrical stimulation on sensory deprivation-related degenerative processes of the CNS. Finally, we discuss three of the crucial issues involved in the design of neural repair-oriented BMIs: when to stimulate, where to stimulate and - the particularly important but unsolved issue of - how to stimulate. We argue that optimal parameters for the electrical stimulation can be determined from studying and modeling the dynamics of the electric fields that naturally emerge at the central and peripheral nervous system during spontaneous healing in both, experimental animals and human patients. We conclude that a closed-loop BMI that defines the optimal stimulation parameters from a priori developed experimental models of the dynamics of spontaneous repair and the on-line monitoring of neural activity might place BMIs as an alternative or complement to stem-cell transplantation or pharmacological approaches, intensively pursued nowadays.

Neural dynamics during repetitive visual stimulation

Science.gov (United States)

Tsoneva, Tsvetomira; Garcia-Molina, Gary; Desain, Peter

2015-12-01

Objective. Steady-state visual evoked potentials (SSVEPs), the brain responses to repetitive visual stimulation (RVS), are widely utilized in neuroscience. Their high signal-to-noise ratio and ability to entrain oscillatory brain activity are beneficial for their applications in brain-computer interfaces, investigation of neural processes underlying brain rhythmic activity (steady-state topography) and probing the causal role of brain rhythms in cognition and emotion. This paper aims at analyzing the space and time EEG dynamics in response to RVS at the frequency of stimulation and ongoing rhythms in the delta, theta, alpha, beta, and gamma bands. Approach.We used electroencephalography (EEG) to study the oscillatory brain dynamics during RVS at 10 frequencies in the gamma band (40-60 Hz). We collected an extensive EEG data set from 32 participants and analyzed the RVS evoked and induced responses in the time-frequency domain. Main results. Stable SSVEP over parieto-occipital sites was observed at each of the fundamental frequencies and their harmonics and sub-harmonics. Both the strength and the spatial propagation of the SSVEP response seem sensitive to stimulus frequency. The SSVEP was more localized around the parieto-occipital sites for higher frequencies (>54 Hz) and spread to fronto-central locations for lower frequencies. We observed a strong negative correlation between stimulation frequency and relative power change at that frequency, the first harmonic and the sub-harmonic components over occipital sites. Interestingly, over parietal sites for sub-harmonics a positive correlation of relative power change and stimulation frequency was found. A number of distinct patterns in delta (1-4 Hz), theta (4-8 Hz), alpha (8-12 Hz) and beta (15-30 Hz) bands were also observed. The transient response, from 0 to about 300 ms after stimulation onset, was accompanied by increase in delta and theta power over fronto-central and occipital sites, which returned to baseline

The equilibrium of neural firing: A mathematical theory

Energy Technology Data Exchange (ETDEWEB)

Lan, Sizhong, E-mail: lsz@fuyunresearch.org [Fuyun Research, Beijing, 100055 (China)

2014-12-15

Inspired by statistical thermodynamics, we presume that neuron system has equilibrium condition with respect to neural firing. We show that, even with dynamically changeable neural connections, it is inevitable for neural firing to evolve to equilibrium. To study the dynamics between neural firing and neural connections, we propose an extended communication system where noisy channel has the tendency towards fixed point, implying that neural connections are always attracted into fixed points such that equilibrium can be reached. The extended communication system and its mathematics could be useful back in thermodynamics.

Neural Dynamics Associated with Semantic and Episodic Memory for Faces: Evidence from Multiple Frequency Bands

Science.gov (United States)

Zion-Golumbic, Elana; Kutas, Marta; Bentin, Shlomo

2010-01-01

Prior semantic knowledge facilitates episodic recognition memory for faces. To examine the neural manifestation of the interplay between semantic and episodic memory, we investigated neuroelectric dynamics during the creation (study) and the retrieval (test) of episodic memories for famous and nonfamous faces. Episodic memory effects were evident…

The influence of mental fatigue and motivation on neural network dynamics; an EEG coherence study

NARCIS (Netherlands)

Lorist, Monicque M.; Bezdan, Eniko; Caat, Michael ten; Span, Mark M.; Roerdink, Jos B.T.M.; Maurits, Natasha M.

2009-01-01

The purpose of the present study is to examine the effects of mental fatigue and motivation on neural network dynamics activated during task switching. Mental fatigue was induced by 2 h of continuous performance; after which subjects were motivated by using social comparison and monetary reward as

Accurate Natural Trail Detection Using a Combination of a Deep Neural Network and Dynamic Programming.

Science.gov (United States)

Adhikari, Shyam Prasad; Yang, Changju; Slot, Krzysztof; Kim, Hyongsuk

2018-01-10

This paper presents a vision sensor-based solution to the challenging problem of detecting and following trails in highly unstructured natural environments like forests, rural areas and mountains, using a combination of a deep neural network and dynamic programming. The deep neural network (DNN) concept has recently emerged as a very effective tool for processing vision sensor signals. A patch-based DNN is trained with supervised data to classify fixed-size image patches into "trail" and "non-trail" categories, and reshaped to a fully convolutional architecture to produce trail segmentation map for arbitrary-sized input images. As trail and non-trail patches do not exhibit clearly defined shapes or forms, the patch-based classifier is prone to misclassification, and produces sub-optimal trail segmentation maps. Dynamic programming is introduced to find an optimal trail on the sub-optimal DNN output map. Experimental results showing accurate trail detection for real-world trail datasets captured with a head mounted vision system are presented.

Synchronization control of Hodgkin-Huxley neurons exposed to ELF electric field

International Nuclear Information System (INIS)

Che Yanqiu; Wang Jiang; Zhou Sisi; Deng Bin

2009-01-01

This paper presents an adaptive neural network H ∞ control for unidirectional synchronization of modified Hodgkin-Huxley (HH) neurons exposed to extremely low frequency (ELF) electric field. The proposed modified HH neurons exhibit periodic and chaotic dynamics in response to sinusoidal electric field stimulation. Based on the Lyapunov stability theory, we derive the updated laws of neural network for approximating the nonlinear uncertain functions of the error dynamical system. The H ∞ design technique makes the controller robust to unmodeled dynamics, disturbances and approximate errors. The proposed controller not only ensures closed-loop stability, but also guarantees an H ∞ performance for the synchronization error system. The states of the controlled slave system exponentially synchronize with that of the master one after control. The simulation results demonstrate the validity of the proposed method.

Information content of neural networks with self-control and variable activity

International Nuclear Information System (INIS)

Bolle, D.; Amari, S.I.; Dominguez Carreta, D.R.C.; Massolo, G.

2001-01-01

A self-control mechanism for the dynamics of neural networks with variable activity is discussed using a recursive scheme for the time evolution of the local field. It is based upon the introduction of a self-adapting time-dependent threshold as a function of both the neural and pattern activity in the network. This mechanism leads to an improvement of the information content of the network as well as an increase of the storage capacity and the basins of attraction. Different architectures are considered and the results are compared with numerical simulations

Male veterans with PTSD exhibit aberrant neural dynamics during working memory processing: an MEG study.

Science.gov (United States)

McDermott, Timothy J; Badura-Brack, Amy S; Becker, Katherine M; Ryan, Tara J; Khanna, Maya M; Heinrichs-Graham, Elizabeth; Wilson, Tony W

2016-06-01

Posttraumatic stress disorder (PTSD) is associated with executive functioning deficits, including disruptions in working memory. In this study, we examined the neural dynamics of working memory processing in veterans with PTSD and a matched healthy control sample using magnetoencephalography (MEG). Our sample of recent combat veterans with PTSD and demographically matched participants without PTSD completed a working memory task during a 306-sensor MEG recording. The MEG data were preprocessed and transformed into the time-frequency domain. Significant oscillatory brain responses were imaged using a beamforming approach to identify spatiotemporal dynamics. Fifty-one men were included in our analyses: 27 combat veterans with PTSD and 24 controls. Across all participants, a dynamic wave of neural activity spread from posterior visual cortices to left frontotemporal regions during encoding, consistent with a verbal working memory task, and was sustained throughout maintenance. Differences related to PTSD emerged during early encoding, with patients exhibiting stronger α oscillatory responses than controls in the right inferior frontal gyrus (IFG). Differences spread to the right supramarginal and temporal cortices during later encoding where, along with the right IFG, they persisted throughout the maintenance period. This study focused on men with combat-related PTSD using a verbal working memory task. Future studies should evaluate women and the impact of various traumatic experiences using diverse tasks. Posttraumatic stress disorder is associated with neurophysiological abnormalities during working memory encoding and maintenance. Veterans with PTSD engaged a bilateral network, including the inferior prefrontal cortices and supramarginal gyri. Right hemispheric neural activity likely reflects compensatory processing, as veterans with PTSD work to maintain accurate performance despite known cognitive deficits associated with the disorder.

EDITORIAL: Why we need a new journal in neural engineering

Science.gov (United States)

Durand, Dominique M.

2004-03-01

laboratory but also in the publication of scientific papers. We do, therefore, need a new journal that provides a platform for this emerging interdisciplinary field of neural engineering where neuroscientists, neurobiologists and engineers can publish their work in one periodical that spans the disciplines. Journal of Neural Engineering will provide this platform. The new journal will publish full-length articles of the highest quality and importance in the field of neural engineering at the molecular, cellular and systems levels. The scope of Journal of Neural Engineering encompasses experimental, computational and theoretical aspects of neural interfacing, neuroelectronics, neuromechanical systems, neuroinformatics, neuroimaging, neural prostheses, artificial and biological neural circuits, neural control, neural tissue regeneration, neural signal processing, neural modeling and neuro-computation. The scope of the journal has both depth and breadth in areas relevant to the interface between neuroscience and engineering. There will be two Editors-in-Chief, with expertise covering both engineering and neuroscience. Experts in the areas encompassed by the journal's scope have been identified for the Editorial Board and the composition of the board will be continually updated to address the developments in this new and exciting field. The first issue of this new journal covers a variety of topics that combine neuroscience and engineering: mental state recognition from EEG signals, analysis of body motion in Parkinson's patients, non-linear dynamics of the respiratory system, automatic identification of saccade-related visual evoked potentials, multiple electrode stimulators, algorithms to estimate the causal relationship between brain sources, diffusion tensor imaging in the brain and phase synchronization of neural activity in vitro. This broad array of manuscripts focusing on neural imaging, neurophysiology, neural signal processing, neuroelectronics and neuro-dynamics can

Adaptive online inverse control of a shape memory alloy wire actuator using a dynamic neural network

Science.gov (United States)

Mai, Huanhuan; Song, Gangbing; Liao, Xiaofeng

2013-01-01

Shape memory alloy (SMA) actuators exhibit severe hysteresis, a nonlinear behavior, which complicates control strategies and limits their applications. This paper presents a new approach to controlling an SMA actuator through an adaptive inverse model based controller that consists of a dynamic neural network (DNN) identifier, a copy dynamic neural network (CDNN) feedforward term and a proportional (P) feedback action. Unlike fixed hysteresis models used in most inverse controllers, the proposed one uses a DNN to identify online the relationship between the applied voltage to the actuator and the displacement (the inverse model). Even without a priori knowledge of the SMA hysteresis and without pre-training, the proposed controller can precisely control the SMA wire actuator in various tracking tasks by identifying online the inverse model of the SMA actuator. Experiments were conducted, and experimental results demonstrated real-time modeling capabilities of DNN and the performance of the adaptive inverse controller.

Dynamic phase transitions and dynamic phase diagrams of the spin-2 Blume-Capel model under an oscillating magnetic field within the effective-field theory

Energy Technology Data Exchange (ETDEWEB)

Ertas, Mehmet [Department of Physics, Erciyes University, 38039 Kayseri (Turkey); Institute of Science, Erciyes University, 38039 Kayseri (Turkey); Deviren, Bayram [Department of Physics, Nevsehir University, 50300 Nevsehir (Turkey); Keskin, Mustafa, E-mail: keskin@erciyes.edu.tr [Department of Physics, Erciyes University, 38039 Kayseri (Turkey)

2012-03-15

The dynamic phase transitions are studied in the kinetic spin-2 Blume-Capel model under a time-dependent oscillating magnetic field using the effective-field theory with correlations. The effective-field dynamic equation for the average magnetization is derived by employing the Glauber transition rates and the phases in the system are obtained by solving this dynamic equation. The nature (first- or second-order) of the dynamic phase transition is characterized by investigating the thermal behavior of the dynamic magnetization and the dynamic phase transition temperatures are obtained. The dynamic phase diagrams are constructed in the reduced temperature and magnetic field amplitude plane and are of seven fundamental types. Phase diagrams contain the paramagnetic (P), ferromagnetic-2 (F{sub 2}) and three coexistence or mixed phase regions, namely the F{sub 2}+P, F{sub 1}+P and F{sub 2}+F{sub 1}+P, which strongly depend on the crystal-field interaction (D) parameter. The system also exhibits the dynamic tricritical behavior. - Highlights: Black-Right-Pointing-Pointer Dynamic phase transitions are studied in spin-2 BC model using EFT. Black-Right-Pointing-Pointer Dynamic phase diagrams are constructed in (T/zJ, h/zJ) plane. Black-Right-Pointing-Pointer Seven fundamental types of dynamic phase diagrams are found in the system. Black-Right-Pointing-Pointer System exhibits dynamic tricritical behavior.

Stimulation of neural differentiation in human bone marrow mesenchymal stem cells by extremely low-frequency electromagnetic fields incorporated with MNPs.

Science.gov (United States)

Choi, Yun-Kyong; Lee, Dong Heon; Seo, Young-Kwon; Jung, Hyun; Park, Jung-Keug; Cho, Hyunjin

2014-10-01

Human bone marrow-derived mesenchymal stem cells (hBM-MSCs) have been investigated as a new cell-therapeutic solution due to their capacity that could differentiate into neural-like cells. Extremely low-frequency electromagnetic fields (ELF-EMFs) therapy has emerged as a novel technique, using mechanical stimulus to differentiate hBM-MSCs and significantly enhance neuronal differentiation to affect cellular and molecular reactions. Magnetic iron oxide (Fe3O4) nanoparticles (MNPs) have recently achieved widespread use for biomedical applications and polyethylene glycol (PEG)-labeled nanoparticles are used to increase their circulation time, aqueous solubility, biocompatibility, and nonspecific cellular uptake as well as to decrease immunogenicity. Many studies have used MNP-labeled cells for differentiation, but there have been no reports of MNP-labeled neural differentiation combined with EMFs. In this study, synthesized PEG-phospholipid encapsulated magnetite (Fe3O4) nanoparticles are used on hBM-MSCs to improve their intracellular uptake. The PEGylated nanoparticles were exposed to the cells under 50 Hz of EMFs to improve neural differentiation. First, we measured cell viability and intracellular iron content in hBM-MSCs after treatment with MNPs. Analysis was conducted by RT-PCR, and immunohistological analysis using neural cell type-specific genes and antibodies after exposure to 50 Hz electromagnetic fields. These results suggest that electromagnetic fields enhance neural differentiation in hBM-MSCs incorporated with MNPs and would be an effective method for differentiating neural cells.

A neural approach for the numerical modeling of two-dimensional magnetic hysteresis

International Nuclear Information System (INIS)

Cardelli, E.; Faba, A.; Laudani, A.; Riganti Fulginei, F.; Salvini, A.

2015-01-01

This paper deals with a neural network approach to model magnetic hysteresis at macro-magnetic scale. Such approach to the problem seems promising in order to couple the numerical treatment of magnetic hysteresis to FEM numerical solvers of the Maxwell's equations in time domain, as in case of the non-linear dynamic analysis of electrical machines, and other similar devices, making possible a full computer simulation in a reasonable time. The neural system proposed consists of four inputs representing the magnetic field and the magnetic inductions components at each time step and it is trained by 2-d measurements performed on the magnetic material to be modeled. The magnetic induction B is assumed as entry point and the output of the neural system returns the predicted value of the field H at the same time step. A suitable partitioning of the neural system, described in the paper, makes the computing process rather fast. Validations with experimental tests and simulations for non-symmetric and minor loops are presented

Feasibility and resolution limits of opto-magnetic imaging of neural network activity in brain slices using color centers in diamond

DEFF Research Database (Denmark)

Karadas, Mürsel; Wojciechowski, Adam M.; Huck, Alexander

2018-01-01

We suggest a novel approach for wide-field imaging of the neural network dynamics of brain slices that uses highly sensitivity magnetometry based on nitrogen-vacancy (NV) centers in diamond. Invitro recordings in brain slices is a proven method for the characterization of electrical neural activi...... cell. Our results suggest that imaging of slice activity will be possible with the upcoming generation of NV magnetic field sensors, while single-shot imaging of planar cell activity remains challenging....

Enhanced Dynamic Model of Pneumatic Muscle Actuator with Elman Neural Network

Directory of Open Access Journals (Sweden)

Alexander Hošovský

2015-01-01

Full Text Available To make effective use of model-based control system design techniques, one needs a good model which captures system’s dynamic properties in the range of interest. Here an analytical model of pneumatic muscle actuator with two pneumatic artificial muscles driving a rotational joint is developed. Use of analytical model makes it possible to retain the physical interpretation of the model and the model is validated using open-loop responses. Since it was considered important to design a robust controller based on this model, the effect of changed moment of inertia (as a representation of uncertain parameter was taken into account and compared with nominal case. To improve the accuracy of the model, these effects are treated as a disturbance modeled using the recurrent (Elman neural network. Recurrent neural network was preferred over feedforward type due to its better long-term prediction capabilities well suited for simulation use of the model. The results confirm that this method improves the model performance (tested for five of the measured variables: joint angle, muscle pressures, and muscle forces while retaining its physical interpretation.

Neural dynamics of object-based multifocal visual spatial attention and priming: object cueing, useful-field-of-view, and crowding.

Science.gov (United States)

Foley, Nicholas C; Grossberg, Stephen; Mingolla, Ennio

2012-08-01

How are spatial and object attention coordinated to achieve rapid object learning and recognition during eye movement search? How do prefrontal priming and parietal spatial mechanisms interact to determine the reaction time costs of intra-object attention shifts, inter-object attention shifts, and shifts between visible objects and covertly cued locations? What factors underlie individual differences in the timing and frequency of such attentional shifts? How do transient and sustained spatial attentional mechanisms work and interact? How can volition, mediated via the basal ganglia, influence the span of spatial attention? A neural model is developed of how spatial attention in the where cortical stream coordinates view-invariant object category learning in the what cortical stream under free viewing conditions. The model simulates psychological data about the dynamics of covert attention priming and switching requiring multifocal attention without eye movements. The model predicts how "attentional shrouds" are formed when surface representations in cortical area V4 resonate with spatial attention in posterior parietal cortex (PPC) and prefrontal cortex (PFC), while shrouds compete among themselves for dominance. Winning shrouds support invariant object category learning, and active surface-shroud resonances support conscious surface perception and recognition. Attentive competition between multiple objects and cues simulates reaction-time data from the two-object cueing paradigm. The relative strength of sustained surface-driven and fast-transient motion-driven spatial attention controls individual differences in reaction time for invalid cues. Competition between surface-driven attentional shrouds controls individual differences in detection rate of peripheral targets in useful-field-of-view tasks. The model proposes how the strength of competition can be mediated, though learning or momentary changes in volition, by the basal ganglia. A new explanation of

Fabrication of micropatterned hydrogels for neural culture systems using dynamic mask projection photolithography.

Science.gov (United States)

Curley, J Lowry; Jennings, Scott R; Moore, Michael J

2011-02-11

Increasingly, patterned cell culture environments are becoming a relevant technique to study cellular characteristics, and many researchers believe in the need for 3D environments to represent in vitro experiments which better mimic in vivo qualities. Studies in fields such as cancer research, neural engineering, cardiac physiology, and cell-matrix interaction have shown cell behavior differs substantially between traditional monolayer cultures and 3D constructs. Hydrogels are used as 3D environments because of their variety, versatility and ability to tailor molecular composition through functionalization. Numerous techniques exist for creation of constructs as cell-supportive matrices, including electrospinning, elastomer stamps, inkjet printing, additive photopatterning, static photomask projection-lithography, and dynamic mask microstereolithography. Unfortunately, these methods involve multiple production steps and/or equipment not readily adaptable to conventional cell and tissue culture methods. The technique employed in this protocol adapts the latter two methods, using a digital micromirror device (DMD) to create dynamic photomasks for crosslinking geometrically specific poly-(ethylene glycol) (PEG) hydrogels, induced through UV initiated free radical polymerization. The resulting "2.5D" structures provide a constrained 3D environment for neural growth. We employ a dual-hydrogel approach, where PEG serves as a cell-restrictive region supplying structure to an otherwise shapeless but cell-permissive self-assembling gel made from either Puramatrix or agarose. The process is a quick simple one step fabrication which is highly reproducible and easily adapted for use with conventional cell culture methods and substrates. Whole tissue explants, such as embryonic dorsal root ganglia (DRG), can be incorporated into the dual hydrogel constructs for experimental assays such as neurite outgrowth. Additionally, dissociated cells can be encapsulated in the

Fuzzy Counter Propagation Neural Network Control for a Class of Nonlinear Dynamical Systems.

Science.gov (United States)

Sakhre, Vandana; Jain, Sanjeev; Sapkal, Vilas S; Agarwal, Dev P

2015-01-01

Fuzzy Counter Propagation Neural Network (FCPN) controller design is developed, for a class of nonlinear dynamical systems. In this process, the weight connecting between the instar and outstar, that is, input-hidden and hidden-output layer, respectively, is adjusted by using Fuzzy Competitive Learning (FCL). FCL paradigm adopts the principle of learning, which is used to calculate Best Matched Node (BMN) which is proposed. This strategy offers a robust control of nonlinear dynamical systems. FCPN is compared with the existing network like Dynamic Network (DN) and Back Propagation Network (BPN) on the basis of Mean Absolute Error (MAE), Mean Square Error (MSE), Best Fit Rate (BFR), and so forth. It envisages that the proposed FCPN gives better results than DN and BPN. The effectiveness of the proposed FCPN algorithms is demonstrated through simulations of four nonlinear dynamical systems and multiple input and single output (MISO) and a single input and single output (SISO) gas furnace Box-Jenkins time series data.

Fuzzy Counter Propagation Neural Network Control for a Class of Nonlinear Dynamical Systems

Directory of Open Access Journals (Sweden)

Vandana Sakhre

2015-01-01

Full Text Available Fuzzy Counter Propagation Neural Network (FCPN controller design is developed, for a class of nonlinear dynamical systems. In this process, the weight connecting between the instar and outstar, that is, input-hidden and hidden-output layer, respectively, is adjusted by using Fuzzy Competitive Learning (FCL. FCL paradigm adopts the principle of learning, which is used to calculate Best Matched Node (BMN which is proposed. This strategy offers a robust control of nonlinear dynamical systems. FCPN is compared with the existing network like Dynamic Network (DN and Back Propagation Network (BPN on the basis of Mean Absolute Error (MAE, Mean Square Error (MSE, Best Fit Rate (BFR, and so forth. It envisages that the proposed FCPN gives better results than DN and BPN. The effectiveness of the proposed FCPN algorithms is demonstrated through simulations of four nonlinear dynamical systems and multiple input and single output (MISO and a single input and single output (SISO gas furnace Box-Jenkins time series data.

Discrete Dynamics Lab

Science.gov (United States)

Wuensche, Andrew

DDLab is interactive graphics software for creating, visualizing, and analyzing many aspects of Cellular Automata, Random Boolean Networks, and Discrete Dynamical Networks in general and studying their behavior, both from the time-series perspective — space-time patterns, and from the state-space perspective — attractor basins. DDLab is relevant to research, applications, and education in the fields of complexity, self-organization, emergent phenomena, chaos, collision-based computing, neural networks, content addressable memory, genetic regulatory networks, dynamical encryption, generative art and music, and the study of the abstract mathematical/physical/dynamical phenomena in their own right.

Using a virtual cortical module implementing a neural field model to modulate brain rhythms in Parkinson's disease

Directory of Open Access Journals (Sweden)

Julien Modolo

2010-06-01

Full Text Available We propose a new method for selective modulation of cortical rhythms based on neural field theory, in which the activity of a cortical area is extensively monitored using a two-dimensional microelectrode array. The example of Parkinson's disease illustrates the proposed method, in which a neural field model is assumed to accurately describe experimentally recorded activity. In addition, we propose a new closed-loop stimulation signal that is both space- and time- dependent. This method is especially designed to specifically modulate a targeted brain rhythm, without interfering with other rhythms. A new class of neuroprosthetic devices is also proposed, in which the multielectrode array is seen as an artificial neural network interacting with biological tissue. Such a bio-inspired approach may provide a solution to optimize interactions between the stimulation device and the cortex aiming to attenuate or augment specific cortical rhythms. The next step will be to validate this new approach experimentally in patients with Parkinson's disease.

Learning and adaptation: neural and behavioural mechanisms behind behaviour change

Science.gov (United States)

Lowe, Robert; Sandamirskaya, Yulia

2018-01-01

This special issue presents perspectives on learning and adaptation as they apply to a number of cognitive phenomena including pupil dilation in humans and attention in robots, natural language acquisition and production in embodied agents (robots), human-robot game play and social interaction, neural-dynamic modelling of active perception and neural-dynamic modelling of infant development in the Piagetian A-not-B task. The aim of the special issue, through its contributions, is to highlight some of the critical neural-dynamic and behavioural aspects of learning as it grounds adaptive responses in robotic- and neural-dynamic systems.

Quantitative theory of driven nonlinear brain dynamics.

Science.gov (United States)

Roberts, J A; Robinson, P A

2012-09-01

Strong periodic stimuli such as bright flashing lights evoke nonlinear responses in the brain and interact nonlinearly with ongoing cortical activity, but the underlying mechanisms for these phenomena are poorly understood at present. The dominant features of these experimentally observed dynamics are reproduced by the dynamics of a quantitative neural field model subject to periodic drive. Model power spectra over a range of drive frequencies show agreement with multiple features of experimental measurements, exhibiting nonlinear effects including entrainment over a range of frequencies around the natural alpha frequency f(α), subharmonic entrainment near 2f(α), and harmonic generation. Further analysis of the driven dynamics as a function of the drive parameters reveals rich nonlinear dynamics that is predicted to be observable in future experiments at high drive amplitude, including period doubling, bistable phase-locking, hysteresis, wave mixing, and chaos indicated by positive Lyapunov exponents. Moreover, photosensitive seizures are predicted for physiologically realistic model parameters yielding bistability between healthy and seizure dynamics. These results demonstrate the applicability of neural field models to the new regime of periodically driven nonlinear dynamics, enabling interpretation of experimental data in terms of specific generating mechanisms and providing new tests of the theory. Copyright © 2012 Elsevier Inc. All rights reserved.

Generalized activity equations for spiking neural network dynamics

Directory of Open Access Journals (Sweden)

Michael A Buice

2013-11-01

Full Text Available Much progress has been made in uncovering the computational capabilities of spiking neural networks. However, spiking neurons will always be more expensive to simulate compared to rate neurons because of the inherent disparity in time scales - the spike duration time is much shorter than the inter-spike time, which is much shorter than any learning time scale. In numerical analysis, this is a classic stiff problem. Spiking neurons are also much more difficult to study analytically. One possible approach to making spiking networks more tractable is to augment mean field activity models with some information about spiking correlations. For example, such a generalized activity model could carry information about spiking rates and correlations between spikes self-consistently. Here, we will show how this can be accomplished by constructing a complete formal probabilistic description of the network and then expanding around a small parameter such as the inverse of the number of neurons in the network. The mean field theory of the system gives a rate-like description. The first order terms in the perturbation expansion keep track of covariances.

Deep recurrent neural network reveals a hierarchy of process memory during dynamic natural vision.

Science.gov (United States)

Shi, Junxing; Wen, Haiguang; Zhang, Yizhen; Han, Kuan; Liu, Zhongming

2018-05-01

The human visual cortex extracts both spatial and temporal visual features to support perception and guide behavior. Deep convolutional neural networks (CNNs) provide a computational framework to model cortical representation and organization for spatial visual processing, but unable to explain how the brain processes temporal information. To overcome this limitation, we extended a CNN by adding recurrent connections to different layers of the CNN to allow spatial representations to be remembered and accumulated over time. The extended model, or the recurrent neural network (RNN), embodied a hierarchical and distributed model of process memory as an integral part of visual processing. Unlike the CNN, the RNN learned spatiotemporal features from videos to enable action recognition. The RNN better predicted cortical responses to natural movie stimuli than the CNN, at all visual areas, especially those along the dorsal stream. As a fully observable model of visual processing, the RNN also revealed a cortical hierarchy of temporal receptive window, dynamics of process memory, and spatiotemporal representations. These results support the hypothesis of process memory, and demonstrate the potential of using the RNN for in-depth computational understanding of dynamic natural vision. © 2018 Wiley Periodicals, Inc.

Adaptive online inverse control of a shape memory alloy wire actuator using a dynamic neural network

International Nuclear Information System (INIS)

Mai, Huanhuan; Liao, Xiaofeng; Song, Gangbing

2013-01-01

Shape memory alloy (SMA) actuators exhibit severe hysteresis, a nonlinear behavior, which complicates control strategies and limits their applications. This paper presents a new approach to controlling an SMA actuator through an adaptive inverse model based controller that consists of a dynamic neural network (DNN) identifier, a copy dynamic neural network (CDNN) feedforward term and a proportional (P) feedback action. Unlike fixed hysteresis models used in most inverse controllers, the proposed one uses a DNN to identify online the relationship between the applied voltage to the actuator and the displacement (the inverse model). Even without a priori knowledge of the SMA hysteresis and without pre-training, the proposed controller can precisely control the SMA wire actuator in various tracking tasks by identifying online the inverse model of the SMA actuator. Experiments were conducted, and experimental results demonstrated real-time modeling capabilities of DNN and the performance of the adaptive inverse controller. (paper)

Neural correlates of the perception of dynamic versus static facial expressions of emotion.

Science.gov (United States)

Kessler, Henrik; Doyen-Waldecker, Cornelia; Hofer, Christian; Hoffmann, Holger; Traue, Harald C; Abler, Birgit

2011-04-20

This study investigated brain areas involved in the perception of dynamic facial expressions of emotion. A group of 30 healthy subjects was measured with fMRI when passively viewing prototypical facial expressions of fear, disgust, sadness and happiness. Using morphing techniques, all faces were displayed as still images and also dynamically as a film clip with the expressions evolving from neutral to emotional. Irrespective of a specific emotion, dynamic stimuli selectively activated bilateral superior temporal sulcus, visual area V5, fusiform gyrus, thalamus and other frontal and parietal areas. Interaction effects of emotion and mode of presentation (static/dynamic) were only found for the expression of happiness, where static faces evoked greater activity in the medial prefrontal cortex. Our results confirm previous findings on neural correlates of the perception of dynamic facial expressions and are in line with studies showing the importance of the superior temporal sulcus and V5 in the perception of biological motion. Differential activation in the fusiform gyrus for dynamic stimuli stands in contrast to classical models of face perception but is coherent with new findings arguing for a more general role of the fusiform gyrus in the processing of socially relevant stimuli.

Chaos control of the brushless direct current motor using adaptive dynamic surface control based on neural network with the minimum weights

International Nuclear Information System (INIS)

Luo, Shaohua; Wu, Songli; Gao, Ruizhen

2015-01-01

This paper investigates chaos control for the brushless DC motor (BLDCM) system by adaptive dynamic surface approach based on neural network with the minimum weights. The BLDCM system contains parameter perturbation, chaotic behavior, and uncertainty. With the help of radial basis function (RBF) neural network to approximate the unknown nonlinear functions, the adaptive law is established to overcome uncertainty of the control gain. By introducing the RBF neural network and adaptive technology into the dynamic surface control design, a robust chaos control scheme is developed. It is proved that the proposed control approach can guarantee that all signals in the closed-loop system are globally uniformly bounded, and the tracking error converges to a small neighborhood of the origin. Simulation results are provided to show that the proposed approach works well in suppressing chaos and parameter perturbation

Chaos control of the brushless direct current motor using adaptive dynamic surface control based on neural network with the minimum weights.

Science.gov (United States)

Luo, Shaohua; Wu, Songli; Gao, Ruizhen

2015-07-01

This paper investigates chaos control for the brushless DC motor (BLDCM) system by adaptive dynamic surface approach based on neural network with the minimum weights. The BLDCM system contains parameter perturbation, chaotic behavior, and uncertainty. With the help of radial basis function (RBF) neural network to approximate the unknown nonlinear functions, the adaptive law is established to overcome uncertainty of the control gain. By introducing the RBF neural network and adaptive technology into the dynamic surface control design, a robust chaos control scheme is developed. It is proved that the proposed control approach can guarantee that all signals in the closed-loop system are globally uniformly bounded, and the tracking error converges to a small neighborhood of the origin. Simulation results are provided to show that the proposed approach works well in suppressing chaos and parameter perturbation.

Convergence dynamics of hybrid bidirectional associative memory neural networks with distributed delays

International Nuclear Information System (INIS)

Liao Xiaofeng; Wong, K.-W.; Yang Shizhong

2003-01-01

In this Letter, the characteristics of the convergence dynamics of hybrid bidirectional associative memory neural networks with distributed transmission delays are studied. Without assuming the symmetry of synaptic connection weights and the monotonicity and differentiability of activation functions, the Lyapunov functionals are constructed and the generalized Halanay-type inequalities are employed to derive the delay-independent sufficient conditions under which the networks converge exponentially to the equilibria associated with temporally uniform external inputs. Some examples are given to illustrate the correctness of our results

Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons.

Science.gov (United States)

Buesing, Lars; Bill, Johannes; Nessler, Bernhard; Maass, Wolfgang

2011-11-01

The organization of computations in networks of spiking neurons in the brain is still largely unknown, in particular in view of the inherently stochastic features of their firing activity and the experimentally observed trial-to-trial variability of neural systems in the brain. In principle there exists a powerful computational framework for stochastic computations, probabilistic inference by sampling, which can explain a large number of macroscopic experimental data in neuroscience and cognitive science. But it has turned out to be surprisingly difficult to create a link between these abstract models for stochastic computations and more detailed models of the dynamics of networks of spiking neurons. Here we create such a link and show that under some conditions the stochastic firing activity of networks of spiking neurons can be interpreted as probabilistic inference via Markov chain Monte Carlo (MCMC) sampling. Since common methods for MCMC sampling in distributed systems, such as Gibbs sampling, are inconsistent with the dynamics of spiking neurons, we introduce a different approach based on non-reversible Markov chains that is able to reflect inherent temporal processes of spiking neuronal activity through a suitable choice of random variables. We propose a neural network model and show by a rigorous theoretical analysis that its neural activity implements MCMC sampling of a given distribution, both for the case of discrete and continuous time. This provides a step towards closing the gap between abstract functional models of cortical computation and more detailed models of networks of spiking neurons.

Real-time emulation of neural images in the outer retinal circuit.

Science.gov (United States)

Hasegawa, Jun; Yagi, Tetsuya

2008-12-01

We describe a novel real-time system that emulates the architecture and functionality of the vertebrate retina. This system reconstructs the neural images formed by the retinal neurons in real time by using a combination of analog and digital systems consisting of a neuromorphic silicon retina chip, a field-programmable gate array, and a digital computer. While the silicon retina carries out the spatial filtering of input images instantaneously, using the embedded resistive networks that emulate the receptive field structure of the outer retinal neurons, the digital computer carries out the temporal filtering of the spatially filtered images to emulate the dynamical properties of the outer retinal circuits. The emulations of the neural image, including 128 x 128 bipolar cells, are carried out at a frame rate of 62.5 Hz. The emulation of the response to the Hermann grid and a spot of light and an annulus of lights has demonstrated that the system responds as expected by previous physiological and psychophysical observations. Furthermore, the emulated dynamics of neural images in response to natural scenes revealed the complex nature of retinal neuron activity. We have concluded that the system reflects the spatiotemporal responses of bipolar cells in the vertebrate retina. The proposed emulation system is expected to aid in understanding the visual computation in the retina and the brain.

Degradation Prediction Model Based on a Neural Network with Dynamic Windows

Science.gov (United States)

Zhang, Xinghui; Xiao, Lei; Kang, Jianshe

2015-01-01

Tracking degradation of mechanical components is very critical for effective maintenance decision making. Remaining useful life (RUL) estimation is a widely used form of degradation prediction. RUL prediction methods when enough run-to-failure condition monitoring data can be used have been fully researched, but for some high reliability components, it is very difficult to collect run-to-failure condition monitoring data, i.e., from normal to failure. Only a certain number of condition indicators in certain period can be used to estimate RUL. In addition, some existing prediction methods have problems which block RUL estimation due to poor extrapolability. The predicted value converges to a certain constant or fluctuates in certain range. Moreover, the fluctuant condition features also have bad effects on prediction. In order to solve these dilemmas, this paper proposes a RUL prediction model based on neural network with dynamic windows. This model mainly consists of three steps: window size determination by increasing rate, change point detection and rolling prediction. The proposed method has two dominant strengths. One is that the proposed approach does not need to assume the degradation trajectory is subject to a certain distribution. The other is it can adapt to variation of degradation indicators which greatly benefits RUL prediction. Finally, the performance of the proposed RUL prediction model is validated by real field data and simulation data. PMID:25806873

Connectivity effects in the dynamic model of neural networks

International Nuclear Information System (INIS)

Choi, J; Choi, M Y; Yoon, B-G

2009-01-01

We study, via extensive Monte Carlo calculations, the effects of connectivity in the dynamic model of neural networks, to observe that the Mattis-state order parameter increases with the number of coupled neurons. Such effects appear more pronounced when the average number of connections is increased by introducing shortcuts in the network. In particular, the power spectra of the order parameter at stationarity are found to exhibit power-law behavior, depending on how the average number of connections is increased. The cluster size distribution of the 'memory-unmatched' sites also follows a power law and possesses strong correlations with the power spectra. It is further observed that the distribution of waiting times for neuron firing fits roughly to a power law, again depending on how neuronal connections are increased

Dynamic phase diagrams of the Ising metamagnet in an oscillating magnetic field within the effective-field theory

Energy Technology Data Exchange (ETDEWEB)

Deviren, Bayram [Department of Physics, Nevsehir University, 50300 Nevsehir (Turkey); Institute of Science, Erciyes University, 38039 Kayseri (Turkey); Keskin, Mustafa, E-mail: keskin@erciyes.edu.t [Department of Physics, Erciyes University, 38039 Kayseri (Turkey)

2010-07-12

Dynamic aspects of a two-sublattice Ising metamagnet on honeycomb, square and hexagonal lattices under the presence of a time-dependent oscillating external magnetic field are studied by using the effective-field theory with correlations. The set of effective-field dynamic equations is derived by employing Glauber transition rates. The phases in the system are obtained by solving these dynamic equations. The thermal behavior of the dynamic staggered magnetization, the hysteresis loop area and correlation are investigated in order to characterize the nature of the dynamic transitions and to obtain dynamic phase transition temperatures. The phase diagrams are constructed in two different planes, and exhibit dynamic tricritical behavior, which strongly depends on interaction parameters. In order to investigate the spin correlation effect on the dynamic phase diagrams of the system, the results are also given within the framework of the dynamic mean-field approximation.

Dynamic phase diagrams of the Ising metamagnet in an oscillating magnetic field within the effective-field theory

International Nuclear Information System (INIS)

Deviren, Bayram; Keskin, Mustafa

2010-01-01

Dynamic aspects of a two-sublattice Ising metamagnet on honeycomb, square and hexagonal lattices under the presence of a time-dependent oscillating external magnetic field are studied by using the effective-field theory with correlations. The set of effective-field dynamic equations is derived by employing Glauber transition rates. The phases in the system are obtained by solving these dynamic equations. The thermal behavior of the dynamic staggered magnetization, the hysteresis loop area and correlation are investigated in order to characterize the nature of the dynamic transitions and to obtain dynamic phase transition temperatures. The phase diagrams are constructed in two different planes, and exhibit dynamic tricritical behavior, which strongly depends on interaction parameters. In order to investigate the spin correlation effect on the dynamic phase diagrams of the system, the results are also given within the framework of the dynamic mean-field approximation.

Decoding of Human Movements Based on Deep Brain Local Field Potentials Using Ensemble Neural Networks

Directory of Open Access Journals (Sweden)

Mohammad S. Islam

2017-01-01

Full Text Available Decoding neural activities related to voluntary and involuntary movements is fundamental to understanding human brain motor circuits and neuromotor disorders and can lead to the development of neuromotor prosthetic devices for neurorehabilitation. This study explores using recorded deep brain local field potentials (LFPs for robust movement decoding of Parkinson’s disease (PD and Dystonia patients. The LFP data from voluntary movement activities such as left and right hand index finger clicking were recorded from patients who underwent surgeries for implantation of deep brain stimulation electrodes. Movement-related LFP signal features were extracted by computing instantaneous power related to motor response in different neural frequency bands. An innovative neural network ensemble classifier has been proposed and developed for accurate prediction of finger movement and its forthcoming laterality. The ensemble classifier contains three base neural network classifiers, namely, feedforward, radial basis, and probabilistic neural networks. The majority voting rule is used to fuse the decisions of the three base classifiers to generate the final decision of the ensemble classifier. The overall decoding performance reaches a level of agreement (kappa value at about 0.729±0.16 for decoding movement from the resting state and about 0.671±0.14 for decoding left and right visually cued movements.

Dynamic neural networks based on-line identification and control of high performance motor drives

Science.gov (United States)

Rubaai, Ahmed; Kotaru, Raj

1995-01-01

In the automated and high-tech industries of the future, there wil be a need for high performance motor drives both in the low-power range and in the high-power range. To meet very straight demands of tracking and regulation in the two quadrants of operation, advanced control technologies are of a considerable interest and need to be developed. In response a dynamics learning control architecture is developed with simultaneous on-line identification and control. the feature of the proposed approach, to efficiently combine the dual task of system identification (learning) and adaptive control of nonlinear motor drives into a single operation is presented. This approach, therefore, not only adapts to uncertainties of the dynamic parameters of the motor drives but also learns about their inherent nonlinearities. In fact, most of the neural networks based adaptive control approaches in use have an identification phase entirely separate from the control phase. Because these approaches separate the identification and control modes, it is not possible to cope with dynamic changes in a controlled process. Extensive simulation studies have been conducted and good performance was observed. The robustness characteristics of neuro-controllers to perform efficiently in a noisy environment is also demonstrated. With this initial success, the principal investigator believes that the proposed approach with the suggested neural structure can be used successfully for the control of high performance motor drives. Two identification and control topologies based on the model reference adaptive control technique are used in this present analysis. No prior knowledge of load dynamics is assumed in either topology while the second topology also assumes no knowledge of the motor parameters.

Quantitative Live Imaging of Human Embryonic Stem Cell Derived Neural Rosettes Reveals Structure-Function Dynamics Coupled to Cortical Development.

Science.gov (United States)

Ziv, Omer; Zaritsky, Assaf; Yaffe, Yakey; Mutukula, Naresh; Edri, Reuven; Elkabetz, Yechiel

2015-10-01

Neural stem cells (NSCs) are progenitor cells for brain development, where cellular spatial composition (cytoarchitecture) and dynamics are hypothesized to be linked to critical NSC capabilities. However, understanding cytoarchitectural dynamics of this process has been limited by the difficulty to quantitatively image brain development in vivo. Here, we study NSC dynamics within Neural Rosettes--highly organized multicellular structures derived from human pluripotent stem cells. Neural rosettes contain NSCs with strong epithelial polarity and are expected to perform apical-basal interkinetic nuclear migration (INM)--a hallmark of cortical radial glial cell development. We developed a quantitative live imaging framework to characterize INM dynamics within rosettes. We first show that the tendency of cells to follow the INM orientation--a phenomenon we referred to as radial organization, is associated with rosette size, presumably via mechanical constraints of the confining structure. Second, early forming rosettes, which are abundant with founder NSCs and correspond to the early proliferative developing cortex, show fast motions and enhanced radial organization. In contrast, later derived rosettes, which are characterized by reduced NSC capacity and elevated numbers of differentiated neurons, and thus correspond to neurogenesis mode in the developing cortex, exhibit slower motions and decreased radial organization. Third, later derived rosettes are characterized by temporal instability in INM measures, in agreement with progressive loss in rosette integrity at later developmental stages. Finally, molecular perturbations of INM by inhibition of actin or non-muscle myosin-II (NMII) reduced INM measures. Our framework enables quantification of cytoarchitecture NSC dynamics and may have implications in functional molecular studies, drug screening, and iPS cell-based platforms for disease modeling.

Quantitative Live Imaging of Human Embryonic Stem Cell Derived Neural Rosettes Reveals Structure-Function Dynamics Coupled to Cortical Development.

Directory of Open Access Journals (Sweden)

Omer Ziv

2015-10-01

Full Text Available Neural stem cells (NSCs are progenitor cells for brain development, where cellular spatial composition (cytoarchitecture and dynamics are hypothesized to be linked to critical NSC capabilities. However, understanding cytoarchitectural dynamics of this process has been limited by the difficulty to quantitatively image brain development in vivo. Here, we study NSC dynamics within Neural Rosettes--highly organized multicellular structures derived from human pluripotent stem cells. Neural rosettes contain NSCs with strong epithelial polarity and are expected to perform apical-basal interkinetic nuclear migration (INM--a hallmark of cortical radial glial cell development. We developed a quantitative live imaging framework to characterize INM dynamics within rosettes. We first show that the tendency of cells to follow the INM orientation--a phenomenon we referred to as radial organization, is associated with rosette size, presumably via mechanical constraints of the confining structure. Second, early forming rosettes, which are abundant with founder NSCs and correspond to the early proliferative developing cortex, show fast motions and enhanced radial organization. In contrast, later derived rosettes, which are characterized by reduced NSC capacity and elevated numbers of differentiated neurons, and thus correspond to neurogenesis mode in the developing cortex, exhibit slower motions and decreased radial organization. Third, later derived rosettes are characterized by temporal instability in INM measures, in agreement with progressive loss in rosette integrity at later developmental stages. Finally, molecular perturbations of INM by inhibition of actin or non-muscle myosin-II (NMII reduced INM measures. Our framework enables quantification of cytoarchitecture NSC dynamics and may have implications in functional molecular studies, drug screening, and iPS cell-based platforms for disease modeling.

Modeling and control of magnetorheological fluid dampers using neural networks

Science.gov (United States)

Wang, D. H.; Liao, W. H.

2005-02-01

Due to the inherent nonlinear nature of magnetorheological (MR) fluid dampers, one of the challenging aspects for utilizing these devices to achieve high system performance is the development of accurate models and control algorithms that can take advantage of their unique characteristics. In this paper, the direct identification and inverse dynamic modeling for MR fluid dampers using feedforward and recurrent neural networks are studied. The trained direct identification neural network model can be used to predict the damping force of the MR fluid damper on line, on the basis of the dynamic responses across the MR fluid damper and the command voltage, and the inverse dynamic neural network model can be used to generate the command voltage according to the desired damping force through supervised learning. The architectures and the learning methods of the dynamic neural network models and inverse neural network models for MR fluid dampers are presented, and some simulation results are discussed. Finally, the trained neural network models are applied to predict and control the damping force of the MR fluid damper. Moreover, validation methods for the neural network models developed are proposed and used to evaluate their performance. Validation results with different data sets indicate that the proposed direct identification dynamic model using the recurrent neural network can be used to predict the damping force accurately and the inverse identification dynamic model using the recurrent neural network can act as a damper controller to generate the command voltage when the MR fluid damper is used in a semi-active mode.

A neural model for transient identification in dynamic processes with 'don't know' response

International Nuclear Information System (INIS)

Mol, Antonio C. de A.; Martinez, Aquilino S.; Schirru, Roberto

2003-01-01

This work presents an approach for neural network based transient identification which allows either dynamic identification or a 'don't know' response. The approach uses two 'jump' multilayer neural networks (NN) trained with the backpropagation algorithm. The 'jump' network is used because it is useful to dealing with very complex patterns, which is the case of the space of the state variables during some abnormal events. The first one is responsible for the dynamic identification. This NN uses, as input, a short set (in a moving time window) of recent measurements of each variable avoiding the necessity of using starting events. The other one is used to validate the instantaneous identification (from the first net) through the validation of each variable. This net is responsible for allowing the system to provide a 'don't know' response. In order to validate the method, a Nuclear Power Plant (NPP) transient identification problem comprising 15 postulated accidents, simulated for a pressurized water reactor (PWR), was proposed in the validation process it has been considered noisy data in order to evaluate the method robustness. Obtained results reveal the ability of the method in dealing with both dynamic identification of transients and correct 'don't know' response. Another important point studied in this work is that the system has shown to be independent of a trigger signal which indicates the beginning of the transient, thus making it robust in relation to this limitation

Dynamical mass generation in QED with weak magnetic fields

International Nuclear Information System (INIS)

Ayala, A.; Rojas, E.; Bashir, A.; Raya, A.

2006-01-01

We study the dynamical generation of masses for fundamental fermions in quenched quantum electrodynamics in the presence of magnetic fields using Schwinger-Dyson equations. We show that, contrary to the case where the magnetic field is strong, in the weak field limit eB << m(0)2, where m(0) is the value of the dynamically generated mass in the absence of the magnetic field, masses are generated above a critical value of the coupling and that this value is the same as in the case with no magnetic field. We carry out a numerical analysis to study the magnetic field dependence of the mass function above critical coupling and show that in this regime the dynamically generated mass and the chiral condensate for the lowest Landau level increase proportionally to (eB)2

Electric arc behaviour in dynamic magnetic fields

International Nuclear Information System (INIS)

Put'ko, V.F.

2000-01-01

The behaviour of an electric arc in different time-dependent (dynamic) magnetic fields was investigated. New possibilities were found for spatial and energy stabilisation of a discharge, for intensifying heat exchange, extending the electric arc and distributed control of electric arc plasma. Rotating, alternating and travelling magnetic fields were studied. It was found that under the effect of a relatively low frequency of variations of dynamic magnetic fields (f 1000 Hz) the arc stabilised at the axis of the discharge chamber, the pulsation level decreased and discharge stability increased. The borders between these two arc existence modes were formed by a certain critical field variation frequency the period of which was determined by the heat relaxation time of the discharge. (author)

Hybrid neural network bushing model for vehicle dynamics simulation

International Nuclear Information System (INIS)

Sohn, Jeong Hyun; Lee, Seung Kyu; Yoo, Wan Suk

2008-01-01

Although the linear model was widely used for the bushing model in vehicle suspension systems, it could not express the nonlinear characteristics of bushing in terms of the amplitude and the frequency. An artificial neural network model was suggested to consider the hysteretic responses of bushings. This model, however, often diverges due to the uncertainties of the neural network under the unexpected excitation inputs. In this paper, a hybrid neural network bushing model combining linear and neural network is suggested. A linear model was employed to represent linear stiffness and damping effects, and the artificial neural network algorithm was adopted to take into account the hysteretic responses. A rubber test was performed to capture bushing characteristics, where sine excitation with different frequencies and amplitudes is applied. Random test results were used to update the weighting factors of the neural network model. It is proven that the proposed model has more robust characteristics than a simple neural network model under step excitation input. A full car simulation was carried out to verify the proposed bushing models. It was shown that the hybrid model results are almost identical to the linear model under several maneuvers

Effects of bursting dynamic features on the generation of multi-clustered structure of neural network with symmetric spike-timing-dependent plasticity learning rule

International Nuclear Information System (INIS)

Liu, Hui; Song, Yongduan; Xue, Fangzheng; Li, Xiumin

2015-01-01

In this paper, the generation of multi-clustered structure of self-organized neural network with different neuronal firing patterns, i.e., bursting or spiking, has been investigated. The initially all-to-all-connected spiking neural network or bursting neural network can be self-organized into clustered structure through the symmetric spike-timing-dependent plasticity learning for both bursting and spiking neurons. However, the time consumption of this clustering procedure of the burst-based self-organized neural network (BSON) is much shorter than the spike-based self-organized neural network (SSON). Our results show that the BSON network has more obvious small-world properties, i.e., higher clustering coefficient and smaller shortest path length than the SSON network. Also, the results of larger structure entropy and activity entropy of the BSON network demonstrate that this network has higher topological complexity and dynamical diversity, which benefits for enhancing information transmission of neural circuits. Hence, we conclude that the burst firing can significantly enhance the efficiency of clustering procedure and the emergent clustered structure renders the whole network more synchronous and therefore more sensitive to weak input. This result is further confirmed from its improved performance on stochastic resonance. Therefore, we believe that the multi-clustered neural network which self-organized from the bursting dynamics has high efficiency in information processing

Effects of bursting dynamic features on the generation of multi-clustered structure of neural network with symmetric spike-timing-dependent plasticity learning rule

Energy Technology Data Exchange (ETDEWEB)

Liu, Hui; Song, Yongduan; Xue, Fangzheng; Li, Xiumin, E-mail: xmli@cqu.edu.cn [Key Laboratory of Dependable Service Computing in Cyber Physical Society of Ministry of Education, Chongqing University, Chongqing 400044 (China); College of Automation, Chongqing University, Chongqing 400044 (China)

2015-11-15

In this paper, the generation of multi-clustered structure of self-organized neural network with different neuronal firing patterns, i.e., bursting or spiking, has been investigated. The initially all-to-all-connected spiking neural network or bursting neural network can be self-organized into clustered structure through the symmetric spike-timing-dependent plasticity learning for both bursting and spiking neurons. However, the time consumption of this clustering procedure of the burst-based self-organized neural network (BSON) is much shorter than the spike-based self-organized neural network (SSON). Our results show that the BSON network has more obvious small-world properties, i.e., higher clustering coefficient and smaller shortest path length than the SSON network. Also, the results of larger structure entropy and activity entropy of the BSON network demonstrate that this network has higher topological complexity and dynamical diversity, which benefits for enhancing information transmission of neural circuits. Hence, we conclude that the burst firing can significantly enhance the efficiency of clustering procedure and the emergent clustered structure renders the whole network more synchronous and therefore more sensitive to weak input. This result is further confirmed from its improved performance on stochastic resonance. Therefore, we believe that the multi-clustered neural network which self-organized from the bursting dynamics has high efficiency in information processing.

Dynamical principles in neuroscience

International Nuclear Information System (INIS)

Rabinovich, Mikhail I.; Varona, Pablo; Selverston, Allen I.; Abarbanel, Henry D. I.

2006-01-01

Dynamical modeling of neural systems and brain functions has a history of success over the last half century. This includes, for example, the explanation and prediction of some features of neural rhythmic behaviors. Many interesting dynamical models of learning and memory based on physiological experiments have been suggested over the last two decades. Dynamical models even of consciousness now exist. Usually these models and results are based on traditional approaches and paradigms of nonlinear dynamics including dynamical chaos. Neural systems are, however, an unusual subject for nonlinear dynamics for several reasons: (i) Even the simplest neural network, with only a few neurons and synaptic connections, has an enormous number of variables and control parameters. These make neural systems adaptive and flexible, and are critical to their biological function. (ii) In contrast to traditional physical systems described by well-known basic principles, first principles governing the dynamics of neural systems are unknown. (iii) Many different neural systems exhibit similar dynamics despite having different architectures and different levels of complexity. (iv) The network architecture and connection strengths are usually not known in detail and therefore the dynamical analysis must, in some sense, be probabilistic. (v) Since nervous systems are able to organize behavior based on sensory inputs, the dynamical modeling of these systems has to explain the transformation of temporal information into combinatorial or combinatorial-temporal codes, and vice versa, for memory and recognition. In this review these problems are discussed in the context of addressing the stimulating questions: What can neuroscience learn from nonlinear dynamics, and what can nonlinear dynamics learn from neuroscience?

Dynamical principles in neuroscience

Science.gov (United States)

Rabinovich, Mikhail I.; Varona, Pablo; Selverston, Allen I.; Abarbanel, Henry D. I.

2006-10-01

Dynamical modeling of neural systems and brain functions has a history of success over the last half century. This includes, for example, the explanation and prediction of some features of neural rhythmic behaviors. Many interesting dynamical models of learning and memory based on physiological experiments have been suggested over the last two decades. Dynamical models even of consciousness now exist. Usually these models and results are based on traditional approaches and paradigms of nonlinear dynamics including dynamical chaos. Neural systems are, however, an unusual subject for nonlinear dynamics for several reasons: (i) Even the simplest neural network, with only a few neurons and synaptic connections, has an enormous number of variables and control parameters. These make neural systems adaptive and flexible, and are critical to their biological function. (ii) In contrast to traditional physical systems described by well-known basic principles, first principles governing the dynamics of neural systems are unknown. (iii) Many different neural systems exhibit similar dynamics despite having different architectures and different levels of complexity. (iv) The network architecture and connection strengths are usually not known in detail and therefore the dynamical analysis must, in some sense, be probabilistic. (v) Since nervous systems are able to organize behavior based on sensory inputs, the dynamical modeling of these systems has to explain the transformation of temporal information into combinatorial or combinatorial-temporal codes, and vice versa, for memory and recognition. In this review these problems are discussed in the context of addressing the stimulating questions: What can neuroscience learn from nonlinear dynamics, and what can nonlinear dynamics learn from neuroscience?

Internal representation of task rules by recurrent dynamics: the importance of the diversity of neural responses

Directory of Open Access Journals (Sweden)

Mattia Rigotti

2010-10-01

Full Text Available Neural activity of behaving animals, especially in the prefrontal cortex, is highly heterogeneous, with selective responses to diverse aspects of the executed task. We propose a general model of recurrent neural networks that perform complex rule-based tasks, and we show that the diversity of neuronal responses plays a fundamental role when the behavioral responses are context dependent. Specifically, we found that when the inner mental states encoding the task rules are represented by stable patterns of neural activity (attractors of the neural dynamics, the neurons must be selective for combinations of sensory stimuli and inner mental states. Such mixed selectivity is easily obtained by neurons that connect with random synaptic strengths both to the recurrent network and to neurons encoding sensory inputs. The number of randomly connected neurons needed to solve a task is on average only three times as large as the number of neurons needed in a network designed ad hoc. Moreover, the number of needed neurons grows only linearly with the number of task-relevant events and mental states, provided that each neuron responds to a large proportion of events (dense/distributed coding. A biologically realistic implementation of the model captures several aspects of the activity recorded from monkeys performing context dependent tasks. Our findings explain the importance of the diversity of neural responses and provide us with simple and general principles for designing attractor neural networks that perform complex computation.

Strong field control of predissociation dynamics.

Science.gov (United States)

Corrales, María E; Balerdi, Garikoitz; Loriot, Vincent; de Nalda, Rebeca; Bañares, Luis

2013-01-01

Strong field control scenarios are investigated in the CH3I predissociation dynamics at the origin of the second absorption B-band, in which state-selective electronic predissociation occurs through the crossing with a valence dissociative state. Dynamic Stark control (DSC) and pump-dump strategies are shown capable of altering both the predissociation lifetime and the product branching ratio.

An Attractor-Based Complexity Measurement for Boolean Recurrent Neural Networks

Science.gov (United States)

Cabessa, Jérémie; Villa, Alessandro E. P.

2014-01-01

We provide a novel refined attractor-based complexity measurement for Boolean recurrent neural networks that represents an assessment of their computational power in terms of the significance of their attractor dynamics. This complexity measurement is achieved by first proving a computational equivalence between Boolean recurrent neural networks and some specific class of -automata, and then translating the most refined classification of -automata to the Boolean neural network context. As a result, a hierarchical classification of Boolean neural networks based on their attractive dynamics is obtained, thus providing a novel refined attractor-based complexity measurement for Boolean recurrent neural networks. These results provide new theoretical insights to the computational and dynamical capabilities of neural networks according to their attractive potentialities. An application of our findings is illustrated by the analysis of the dynamics of a simplified model of the basal ganglia-thalamocortical network simulated by a Boolean recurrent neural network. This example shows the significance of measuring network complexity, and how our results bear new founding elements for the understanding of the complexity of real brain circuits. PMID:24727866

On the identification of instabilities with neural networks on JET

International Nuclear Information System (INIS)

Murari, A.; Arena, P.; Buscarino, A.; Fortuna, L.; Iachello, M.

2013-01-01

JET plasmas are affected by various instabilities, which can be particularly dangerous in high performance discharges. An identification method, based on the use of advanced neural networks, called Recurrent Neural Networks (RNNs), has been applied to ELMs. The potential of the recurrent networks to identify the dynamics of the instabilities has been first tested using synthetic data. The networks have then been applied to JET experimental signals. An appropriate selection of the networks topology allows identifying quite well the time evolution of the edge temperature and of the magnetic fields, considered the best indicators of the ELMs. A quite limited number of periodic oscillations are used to train the networks, which then manage to follow quite well the dynamics of the instabilities, in a recurrent configuration on one of the inputs. The time evolution of the aforementioned signals, also during intervals not used in the training and never seen by the networks, are properly reproduced. A careful analysis of the various terms in the RNNs has the potential to give clear indications about the nature of these instabilities and their dynamical behaviour

Nonlinear Dynamic Surface Control of Chaos in Permanent Magnet Synchronous Motor Based on the Minimum Weights of RBF Neural Network

Directory of Open Access Journals (Sweden)

Shaohua Luo

2014-01-01

Full Text Available This paper is concerned with the problem of the nonlinear dynamic surface control (DSC of chaos based on the minimum weights of RBF neural network for the permanent magnet synchronous motor system (PMSM wherein the unknown parameters, disturbances, and chaos are presented. RBF neural network is used to approximate the nonlinearities and an adaptive law is employed to estimate unknown parameters. Then, a simple and effective controller is designed by introducing dynamic surface control technique on the basis of first-order filters. Asymptotically tracking stability in the sense of uniformly ultimate boundedness is achieved in a short time. Finally, the performance of the proposed controller is testified through simulation results.

Death and rebirth of neural activity in sparse inhibitory networks

Science.gov (United States)

Angulo-Garcia, David; Luccioli, Stefano; Olmi, Simona; Torcini, Alessandro

2017-05-01

Inhibition is a key aspect of neural dynamics playing a fundamental role for the emergence of neural rhythms and the implementation of various information coding strategies. Inhibitory populations are present in several brain structures, and the comprehension of their dynamics is strategical for the understanding of neural processing. In this paper, we clarify the mechanisms underlying a general phenomenon present in pulse-coupled heterogeneous inhibitory networks: inhibition can induce not only suppression of neural activity, as expected, but can also promote neural re-activation. In particular, for globally coupled systems, the number of firing neurons monotonically reduces upon increasing the strength of inhibition (neuronal death). However, the random pruning of connections is able to reverse the action of inhibition, i.e. in a random sparse network a sufficiently strong synaptic strength can surprisingly promote, rather than depress, the activity of neurons (neuronal rebirth). Thus, the number of firing neurons reaches a minimum value at some intermediate synaptic strength. We show that this minimum signals a transition from a regime dominated by neurons with a higher firing activity to a phase where all neurons are effectively sub-threshold and their irregular firing is driven by current fluctuations. We explain the origin of the transition by deriving a mean field formulation of the problem able to provide the fraction of active neurons as well as the first two moments of their firing statistics. The introduction of a synaptic time scale does not modify the main aspects of the reported phenomenon. However, for sufficiently slow synapses the transition becomes dramatic, and the system passes from a perfectly regular evolution to irregular bursting dynamics. In this latter regime the model provides predictions consistent with experimental findings for a specific class of neurons, namely the medium spiny neurons in the striatum.

Cascading a systolic array and a feedforward neural network for navigation and obstacle avoidance using potential fields

Science.gov (United States)

Plumer, Edward S.

1991-01-01

A technique is developed for vehicle navigation and control in the presence of obstacles. A potential function was devised that peaks at the surface of obstacles and has its minimum at the proper vehicle destination. This function is computed using a systolic array and is guaranteed not to have local minima. A feedfoward neural network is then used to control the steering of the vehicle using local potential field information. In this case, the vehicle is a trailer truck backing up. Previous work has demonstrated the capability of a neural network to control steering of such a trailer truck backing to a loading platform, but without obstacles. Now, the neural network was able to learn to navigate a trailer truck around obstacles while backing toward its destination. The network is trained in an obstacle free space to follow the negative gradient of the field, after which the network is able to control and navigate the truck to its target destination in a space of obstacles which may be stationary or movable.

Dynamics of Gauge Fields at High Temperature

NARCIS (Netherlands)

Nauta, B.J.

2000-01-01

An effective description of dynamical Bose fields is provided by the classical (high-temperature) limit of thermal field theory. The main subject of this thesis is to improve the ensuing classical field theory, that is, to include the dominant quantum corrections and to add counter terms for the

Dynamic Changes in Amygdala Psychophysiological Connectivity Reveal Distinct Neural Networks for Facial Expressions of Basic Emotions.

Science.gov (United States)

Diano, Matteo; Tamietto, Marco; Celeghin, Alessia; Weiskrantz, Lawrence; Tatu, Mona-Karina; Bagnis, Arianna; Duca, Sergio; Geminiani, Giuliano; Cauda, Franco; Costa, Tommaso

2017-03-27

The quest to characterize the neural signature distinctive of different basic emotions has recently come under renewed scrutiny. Here we investigated whether facial expressions of different basic emotions modulate the functional connectivity of the amygdala with the rest of the brain. To this end, we presented seventeen healthy participants (8 females) with facial expressions of anger, disgust, fear, happiness, sadness and emotional neutrality and analyzed amygdala's psychophysiological interaction (PPI). In fact, PPI can reveal how inter-regional amygdala communications change dynamically depending on perception of various emotional expressions to recruit different brain networks, compared to the functional interactions it entertains during perception of neutral expressions. We found that for each emotion the amygdala recruited a distinctive and spatially distributed set of structures to interact with. These changes in amygdala connectional patters characterize the dynamic signature prototypical of individual emotion processing, and seemingly represent a neural mechanism that serves to implement the distinctive influence that each emotion exerts on perceptual, cognitive, and motor responses. Besides these differences, all emotions enhanced amygdala functional integration with premotor cortices compared to neutral faces. The present findings thus concur to reconceptualise the structure-function relation between brain-emotion from the traditional one-to-one mapping toward a network-based and dynamic perspective.

Stability of bumps in piecewise smooth neural fields with nonlinear adaptation

KAUST Repository

Kilpatrick, Zachary P.

2010-06-01

We study the linear stability of stationary bumps in piecewise smooth neural fields with local negative feedback in the form of synaptic depression or spike frequency adaptation. The continuum dynamics is described in terms of a nonlocal integrodifferential equation, in which the integral kernel represents the spatial distribution of synaptic weights between populations of neurons whose mean firing rate is taken to be a Heaviside function of local activity. Discontinuities in the adaptation variable associated with a bump solution means that bump stability cannot be analyzed by constructing the Evans function for a network with a sigmoidal gain function and then taking the high-gain limit. In the case of synaptic depression, we show that linear stability can be formulated in terms of solutions to a system of pseudo-linear equations. We thus establish that sufficiently strong synaptic depression can destabilize a bump that is stable in the absence of depression. These instabilities are dominated by shift perturbations that evolve into traveling pulses. In the case of spike frequency adaptation, we show that for a wide class of perturbations the activity and adaptation variables decouple in the linear regime, thus allowing us to explicitly determine stability in terms of the spectrum of a smooth linear operator. We find that bumps are always unstable with respect to this class of perturbations, and destabilization of a bump can result in either a traveling pulse or a spatially localized breather. © 2010 Elsevier B.V. All rights reserved.

Artificial neural networks in NDT

International Nuclear Information System (INIS)

Abdul Aziz Mohamed

2001-01-01

Artificial neural networks, simply known as neural networks, have attracted considerable interest in recent years largely because of a growing recognition of the potential of these computational paradigms as powerful alternative models to conventional pattern recognition or function approximation techniques. The neural networks approach is having a profound effect on almost all fields, and has been utilised in fields Where experimental inter-disciplinary work is being carried out. Being a multidisciplinary subject with a broad knowledge base, Nondestructive Testing (NDT) or Nondestructive Evaluation (NDE) is no exception. This paper explains typical applications of neural networks in NDT/NDE. Three promising types of neural networks are highlighted, namely, back-propagation, binary Hopfield and Kohonen's self-organising maps. (Author)

Complex dynamics of a delayed discrete neural network of two nonidentical neurons.

Science.gov (United States)

Chen, Yuanlong; Huang, Tingwen; Huang, Yu

2014-03-01

In this paper, we discover that a delayed discrete Hopfield neural network of two nonidentical neurons with self-connections and no self-connections can demonstrate chaotic behaviors. To this end, we first transform the model, by a novel way, into an equivalent system which has some interesting properties. Then, we identify the chaotic invariant set for this system and show that the dynamics of this system within this set is topologically conjugate to the dynamics of the full shift map with two symbols. This confirms chaos in the sense of Devaney. Our main results generalize the relevant results of Huang and Zou [J. Nonlinear Sci. 15, 291-303 (2005)], Kaslik and Balint [J. Nonlinear Sci. 18, 415-432 (2008)] and Chen et al. [Sci. China Math. 56(9), 1869-1878 (2013)]. We also give some numeric simulations to verify our theoretical results.

Differential receptive field organizations give rise to nearly identical neural correlations across three parallel sensory maps in weakly electric fish.

Science.gov (United States)

Hofmann, Volker; Chacron, Maurice J

2017-09-01

Understanding how neural populations encode sensory information thereby leading to perception and behavior (i.e., the neural code) remains an important problem in neuroscience. When investigating the neural code, one must take into account the fact that neural activities are not independent but are actually correlated with one another. Such correlations are seen ubiquitously and have a strong impact on neural coding. Here we investigated how differences in the antagonistic center-surround receptive field (RF) organization across three parallel sensory maps influence correlations between the activities of electrosensory pyramidal neurons. Using a model based on known anatomical differences in receptive field center size and overlap, we initially predicted large differences in correlated activity across the maps. However, in vivo electrophysiological recordings showed that, contrary to modeling predictions, electrosensory pyramidal neurons across all three segments displayed nearly identical correlations. To explain this surprising result, we incorporated the effects of RF surround in our model. By systematically varying both the RF surround gain and size relative to that of the RF center, we found that multiple RF structures gave rise to similar levels of correlation. In particular, incorporating known physiological differences in RF structure between the three maps in our model gave rise to similar levels of correlation. Our results show that RF center overlap alone does not determine correlations which has important implications for understanding how RF structure influences correlated neural activity.

Statistical mechanics of a multiconnected Hopfield neural-network model in a transverse field

International Nuclear Information System (INIS)

Ma, Y.; Gong, C.

1995-01-01

The Hopfield neural-network model with p-spin interactions in the presence of a transverse field is introduced and solved exactly in the limit p→∞. In the phase diagrams drawn as a function of the temperature, the important results such as reentrance are found, and the effects of the quantum fluctuations on the phase transitions, the retrieval phase, and the storage ratio α are examined

Derivation of mean-field dynamics for fermions

International Nuclear Information System (INIS)

Petrat, Soeren

2014-01-01

In this work, we derive the time-dependent Hartree(-Fock) equations as an effective dynamics for fermionic many-particle systems. Our main results are the first for a quantum mechanical mean-field dynamics for fermions; in previous works, the mean-field limit is usually either coupled to a semiclassical limit, or the interaction is scaled down so much, that the system behaves freely for large particle number N. We mainly consider systems with total kinetic energy bounded by const.N and long-range interaction potentials, e.g., Coulomb interaction. Examples for such systems are large molecules or certain solid states. Our analysis also applies to attractive interactions, as, e.g., in fermionic stars. The fermionic Hartree(-Fock) equations are a standard tool to describe, e.g., excited states or chemical reactions of large molecules (like proteins). A deeper understanding of these equations as an approximation to the time evolution of a many body quantum system is thus highly relevant. We consider the fermionic Hartree equations (i.e., the Hartree-Fock equations without exchange term) in this work, since the exchange term is subleading in our setting. The main result is that the fermionic Hartree dynamics approximates the Schroedinger dynamics well for large N. This statement becomes exact in the thermodynamic limit N→∞. We give explicit values for the rates of convergence. We prove two types of results. The first type is very general and concerns arbitrary free Hamiltonians (e.g., relativistic, non-relativistic, with external fields) and arbitrary interactions. The theorems give explicit conditions on the solutions to the fermionic Hartree equations under which a derivation of the mean-field dynamics succeeds. The second type of results scrutinizes situations where the conditions are fulfilled. These results are about non-relativistic free Hamiltonians with external fields, systems with total kinetic energy bounded by const.N and with long-range interactions of

Neural substrates and behavioral profiles of romantic jealousy and its temporal dynamics.

Science.gov (United States)

Sun, Yan; Yu, Hongbo; Chen, Jie; Liang, Jie; Lu, Lin; Zhou, Xiaolin; Shi, Jie

2016-06-07

Jealousy is not only a way of experiencing love but also a stabilizer of romantic relationships, although morbid romantic jealousy is maladaptive. Being engaged in a formal romantic relationship can tune one's romantic jealousy towards a specific target. Little is known about how the human brain processes romantic jealousy by now. Here, by combining scenario-based imagination and functional MRI, we investigated the behavioral and neural correlates of romantic jealousy and their development across stages (before vs. after being in a formal relationship). Romantic jealousy scenarios elicited activations primarily in the basal ganglia (BG) across stages, and were significantly higher after the relationship was established in both the behavioral rating and BG activation. The intensity of romantic jealousy was related to the intensity of romantic happiness, which mainly correlated with ventral medial prefrontal cortex activation. The increase in jealousy across stages was associated with the tendency for interpersonal aggression. These results bridge the gap between the theoretical conceptualization of romantic jealousy and its neural correlates and shed light on the dynamic changes in jealousy.

Neural dynamics underlying attentional orienting to auditory representations in short-term memory.

Science.gov (United States)

Backer, Kristina C; Binns, Malcolm A; Alain, Claude

2015-01-21

Sounds are ephemeral. Thus, coherent auditory perception depends on "hearing" back in time: retrospectively attending that which was lost externally but preserved in short-term memory (STM). Current theories of auditory attention assume that sound features are integrated into a perceptual object, that multiple objects can coexist in STM, and that attention can be deployed to an object in STM. Recording electroencephalography from humans, we tested these assumptions, elucidating feature-general and feature-specific neural correlates of auditory attention to STM. Alpha/beta oscillations and frontal and posterior event-related potentials indexed feature-general top-down attentional control to one of several coexisting auditory representations in STM. Particularly, task performance during attentional orienting was correlated with alpha/low-beta desynchronization (i.e., power suppression). However, attention to one feature could occur without simultaneous processing of the second feature of the representation. Therefore, auditory attention to memory relies on both feature-specific and feature-general neural dynamics. Copyright © 2015 the authors 0270-6474/15/351307-12$15.00/0.

Brain Dynamics in Predicting Driving Fatigue Using a Recurrent Self-Evolving Fuzzy Neural Network.

Science.gov (United States)

Liu, Yu-Ting; Lin, Yang-Yin; Wu, Shang-Lin; Chuang, Chun-Hsiang; Lin, Chin-Teng

2016-02-01

This paper proposes a generalized prediction system called a recurrent self-evolving fuzzy neural network (RSEFNN) that employs an on-line gradient descent learning rule to address the electroencephalography (EEG) regression problem in brain dynamics for driving fatigue. The cognitive states of drivers significantly affect driving safety; in particular, fatigue driving, or drowsy driving, endangers both the individual and the public. For this reason, the development of brain-computer interfaces (BCIs) that can identify drowsy driving states is a crucial and urgent topic of study. Many EEG-based BCIs have been developed as artificial auxiliary systems for use in various practical applications because of the benefits of measuring EEG signals. In the literature, the efficacy of EEG-based BCIs in recognition tasks has been limited by low resolutions. The system proposed in this paper represents the first attempt to use the recurrent fuzzy neural network (RFNN) architecture to increase adaptability in realistic EEG applications to overcome this bottleneck. This paper further analyzes brain dynamics in a simulated car driving task in a virtual-reality environment. The proposed RSEFNN model is evaluated using the generalized cross-subject approach, and the results indicate that the RSEFNN is superior to competing models regardless of the use of recurrent or nonrecurrent structures.

Robust model predictive control of nonlinear systems with unmodeled dynamics and bounded uncertainties based on neural networks.

Science.gov (United States)

Yan, Zheng; Wang, Jun

2014-03-01

This paper presents a neural network approach to robust model predictive control (MPC) for constrained discrete-time nonlinear systems with unmodeled dynamics affected by bounded uncertainties. The exact nonlinear model of underlying process is not precisely known, but a partially known nominal model is available. This partially known nonlinear model is first decomposed to an affine term plus an unknown high-order term via Jacobian linearization. The linearization residue combined with unmodeled dynamics is then modeled using an extreme learning machine via supervised learning. The minimax methodology is exploited to deal with bounded uncertainties. The minimax optimization problem is reformulated as a convex minimization problem and is iteratively solved by a two-layer recurrent neural network. The proposed neurodynamic approach to nonlinear MPC improves the computational efficiency and sheds a light for real-time implementability of MPC technology. Simulation results are provided to substantiate the effectiveness and characteristics of the proposed approach.

Tracking control of air-breathing hypersonic vehicles with non-affine dynamics via improved neural back-stepping design.

Science.gov (United States)

Bu, Xiangwei; He, Guangjun; Wang, Ke

2018-04-01

This study considers the design of a new back-stepping control approach for air-breathing hypersonic vehicle (AHV) non-affine models via neural approximation. The AHV's non-affine dynamics is decomposed into velocity subsystem and altitude subsystem to be controlled separately, and robust adaptive tracking control laws are developed using improved back-stepping designs. Neural networks are applied to estimate the unknown non-affine dynamics, which guarantees the addressed controllers with satisfactory robustness against uncertainties. In comparison with the existing control methodologies, the special contributions are that the non-affine issue is handled by constructing two low-pass filters based on model transformations, and virtual controllers are treated as intermediate variables such that they aren't needed for back-stepping designs any more. Lyapunov techniques are employed to show the uniformly ultimately boundedness of all closed-loop signals. Finally, simulation results are presented to verify the tracking performance and superiorities of the investigated control strategy. Copyright © 2018 ISA. Published by Elsevier Ltd. All rights reserved.

Potential Mechanisms and Functions of Intermittent Neural Synchronization

Directory of Open Access Journals (Sweden)

Sungwoo Ahn

2017-05-01

Full Text Available Neural synchronization is believed to play an important role in different brain functions. Synchrony in cortical and subcortical circuits is frequently variable in time and not perfect. Few long intervals of desynchronized dynamics may be functionally different from many short desynchronized intervals although the average synchrony may be the same. Recent analysis of imperfect synchrony in different neural systems reported one common feature: neural oscillations may go out of synchrony frequently, but primarily for a short time interval. This study explores potential mechanisms and functional advantages of this short desynchronizations dynamics using computational neuroscience techniques. We show that short desynchronizations are exhibited in coupled neurons if their delayed rectifier potassium current has relatively large values of the voltage-dependent activation time-constant. The delayed activation of potassium current is associated with generation of quickly-rising action potential. This “spikiness” is a very general property of neurons. This may explain why very different neural systems exhibit short desynchronization dynamics. We also show how the distribution of desynchronization durations may be independent of the synchronization strength. Finally, we show that short desynchronization dynamics requires weaker synaptic input to reach a pre-set synchrony level. Thus, this dynamics allows for efficient regulation of synchrony and may promote efficient formation of synchronous neural assemblies.

Direct Adaptive Aircraft Control Using Dynamic Cell Structure Neural Networks

Science.gov (United States)

Jorgensen, Charles C.

1997-01-01

A Dynamic Cell Structure (DCS) Neural Network was developed which learns topology representing networks (TRNS) of F-15 aircraft aerodynamic stability and control derivatives. The network is integrated into a direct adaptive tracking controller. The combination produces a robust adaptive architecture capable of handling multiple accident and off- nominal flight scenarios. This paper describes the DCS network and modifications to the parameter estimation procedure. The work represents one step towards an integrated real-time reconfiguration control architecture for rapid prototyping of new aircraft designs. Performance was evaluated using three off-line benchmarks and on-line nonlinear Virtual Reality simulation. Flight control was evaluated under scenarios including differential stabilator lock, soft sensor failure, control and stability derivative variations, and air turbulence.

Calsyntenins Are Expressed in a Dynamic and Partially Overlapping Manner during Neural Development

Directory of Open Access Journals (Sweden)

Gemma de Ramon Francàs

2017-08-01

Full Text Available Calsyntenins form a family of linker proteins between distinct populations of vesicles and kinesin motors for axonal transport. They were implicated in synapse formation and synaptic plasticity by findings in worms, mice and humans. These findings were in accordance with the postsynaptic localization of the Calsyntenins in the adult brain. However, they also affect the formation of neural circuits, as loss of Calsyntenin-1 (Clstn1 was shown to interfere with axonal branching and axon guidance. Despite the fact that Calsyntenins were discovered originally in embryonic chicken motoneurons, their distribution in the developing nervous system has not been analyzed in detail so far. Here, we summarize our analysis of the temporal and spatial expression patterns of the cargo-docking proteins Clstn1, Clstn2 and Clstn3 during neural development by comparing the dynamic distribution of their mRNAs by in situ hybridization in the spinal cord, the cerebellum, the retina and the tectum, as well as in the dorsal root ganglia (DRG.

Recovery of Dynamics and Function in Spiking Neural Networks with Closed-Loop Control.

Science.gov (United States)

Vlachos, Ioannis; Deniz, Taşkin; Aertsen, Ad; Kumar, Arvind

2016-02-01

There is a growing interest in developing novel brain stimulation methods to control disease-related aberrant neural activity and to address basic neuroscience questions. Conventional methods for manipulating brain activity rely on open-loop approaches that usually lead to excessive stimulation and, crucially, do not restore the original computations performed by the network. Thus, they are often accompanied by undesired side-effects. Here, we introduce delayed feedback control (DFC), a conceptually simple but effective method, to control pathological oscillations in spiking neural networks (SNNs). Using mathematical analysis and numerical simulations we show that DFC can restore a wide range of aberrant network dynamics either by suppressing or enhancing synchronous irregular activity. Importantly, DFC, besides steering the system back to a healthy state, also recovers the computations performed by the underlying network. Finally, using our theory we identify the role of single neuron and synapse properties in determining the stability of the closed-loop system.

Strong-field dissociation dynamics

International Nuclear Information System (INIS)

DiMauro, L.F.; Yang, Baorui.

1993-01-01

The strong-field dissociation behavior of diatomic molecules is examined under two distinctive physical scenarios. In the first scenario, the dissociation of the isolated hydrogen and deuterium molecular ions is discussed. The dynamics of above-threshold dissociation (ATD) are investigated over a wide range of green and infrared intensities and compared to a dressed-state model. The second situation arises when strong-field neutral dissociation is followed by ionization of the atomic fragments. The study results in a direct measure of the atomic fragment's ac-Stark shift by observing the intensity-dependent shifts in the electron or nuclear fragment kinetic energy. 8 figs., 14 refs

Suppression of anomalous synchronization and nonstationary behavior of neural network under small-world topology

Science.gov (United States)

Boaretto, B. R. R.; Budzinski, R. C.; Prado, T. L.; Kurths, J.; Lopes, S. R.

2018-05-01

It is known that neural networks under small-world topology can present anomalous synchronization and nonstationary behavior for weak coupling regimes. Here, we propose methods to suppress the anomalous synchronization and also to diminish the nonstationary behavior occurring in weakly coupled neural network under small-world topology. We consider a network of 2000 thermally sensitive identical neurons, based on the model of Hodgkin-Huxley in a small-world topology, with the probability of adding non local connection equal to p = 0 . 001. Based on experimental protocols to suppress anomalous synchronization, as well as nonstationary behavior of the neural network dynamics, we make use of (i) external stimulus (pulsed current); (ii) biologic parameters changing (neuron membrane conductance changes); and (iii) body temperature changes. Quantification analysis to evaluate phase synchronization makes use of the Kuramoto's order parameter, while recurrence quantification analysis, particularly the determinism, computed over the easily accessible mean field of network, the local field potential (LFP), is used to evaluate nonstationary states. We show that the methods proposed can control the anomalous synchronization and nonstationarity occurring for weak coupling parameter without any effect on the individual neuron dynamics, neither in the expected asymptotic synchronized states occurring for large values of the coupling parameter.

Dental anomalies in different cleft groups related to neural crest developmental fields contributes to the understanding of cleft aetiology

DEFF Research Database (Denmark)

Riis, Louise Claudius; Kjær, Inger; Mølsted, Kirsten

2014-01-01

OBJECTIVE: To analyze dental deviations in three cleft groups and relate findings to embryological neural crest fields (frontonasal, maxillary, and palatal). The overall purpose was to evaluate how fields are involved in different cleft types. DESIGN: Retrospective audit of clinical photographs...

Dynamics of classical and quantum fields an introduction

CERN Document Server

Setlur, Girish S

2014-01-01

Dynamics of Classical and Quantum Fields: An Introduction focuses on dynamical fields in non-relativistic physics. Written by a physicist for physicists, the book is designed to help readers develop analytical skills related to classical and quantum fields at the non-relativistic level, and think about the concepts and theory through numerous problems. In-depth yet accessible, the book presents new and conventional topics in a self-contained manner that beginners would find useful. A partial list of topics covered includes: Geometrical meaning of Legendre transformation in classical mechanics Dynamical symmetries in the context of Noether's theorem The derivation of the stress energy tensor of the electromagnetic field, the expression for strain energy in elastic bodies, and the Navier Stokes equation Concepts of right and left movers in case of a Fermi gas explained Functional integration is interpreted as a limit of a sequence of ordinary integrations Path integrals for one and two quantum particles and for...

A stochastic phase-field model determined from molecular dynamics

KAUST Repository

von Schwerin, Erik

2010-03-17

The dynamics of dendritic growth of a crystal in an undercooled melt is determined by macroscopic diffusion-convection of heat and by capillary forces acting on the nanometer scale of the solid-liquid interface width. Its modelling is useful for instance in processing techniques based on casting. The phase-field method is widely used to study evolution of such microstructural phase transformations on a continuum level; it couples the energy equation to a phenomenological Allen-Cahn/Ginzburg-Landau equation modelling the dynamics of an order parameter determining the solid and liquid phases, including also stochastic fluctuations to obtain the qualitatively correct result of dendritic side branching. This work presents a method to determine stochastic phase-field models from atomistic formulations by coarse-graining molecular dynamics. It has three steps: (1) a precise quantitative atomistic definition of the phase-field variable, based on the local potential energy; (2) derivation of its coarse-grained dynamics model, from microscopic Smoluchowski molecular dynamics (that is Brownian or over damped Langevin dynamics); and (3) numerical computation of the coarse-grained model functions. The coarse-grained model approximates Gibbs ensemble averages of the atomistic phase-field, by choosing coarse-grained drift and diffusion functions that minimize the approximation error of observables in this ensemble average. © EDP Sciences, SMAI, 2010.

A stochastic phase-field model determined from molecular dynamics

KAUST Repository

von Schwerin, Erik; Szepessy, Anders

2010-01-01

The dynamics of dendritic growth of a crystal in an undercooled melt is determined by macroscopic diffusion-convection of heat and by capillary forces acting on the nanometer scale of the solid-liquid interface width. Its modelling is useful for instance in processing techniques based on casting. The phase-field method is widely used to study evolution of such microstructural phase transformations on a continuum level; it couples the energy equation to a phenomenological Allen-Cahn/Ginzburg-Landau equation modelling the dynamics of an order parameter determining the solid and liquid phases, including also stochastic fluctuations to obtain the qualitatively correct result of dendritic side branching. This work presents a method to determine stochastic phase-field models from atomistic formulations by coarse-graining molecular dynamics. It has three steps: (1) a precise quantitative atomistic definition of the phase-field variable, based on the local potential energy; (2) derivation of its coarse-grained dynamics model, from microscopic Smoluchowski molecular dynamics (that is Brownian or over damped Langevin dynamics); and (3) numerical computation of the coarse-grained model functions. The coarse-grained model approximates Gibbs ensemble averages of the atomistic phase-field, by choosing coarse-grained drift and diffusion functions that minimize the approximation error of observables in this ensemble average. © EDP Sciences, SMAI, 2010.

Neural network regulation driven by autonomous neural firings

Science.gov (United States)

Cho, Myoung Won

2016-07-01

Biological neurons naturally fire spontaneously due to the existence of a noisy current. Such autonomous firings may provide a driving force for network formation because synaptic connections can be modified due to neural firings. Here, we study the effect of autonomous firings on network formation. For the temporally asymmetric Hebbian learning, bidirectional connections lose their balance easily and become unidirectional ones. Defining the difference between reciprocal connections as new variables, we could express the learning dynamics as if Ising model spins interact with each other in magnetism. We present a theoretical method to estimate the interaction between the new variables in a neural system. We apply the method to some network systems and find some tendencies of autonomous neural network regulation.

Neural Networks: Implementations and Applications

OpenAIRE

Vonk, E.; Veelenturf, L.P.J.; Jain, L.C.

1996-01-01

Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas

Embedding responses in spontaneous neural activity shaped through sequential learning.

Directory of Open Access Journals (Sweden)

Tomoki Kurikawa

Full Text Available Recent experimental measurements have demonstrated that spontaneous neural activity in the absence of explicit external stimuli has remarkable spatiotemporal structure. This spontaneous activity has also been shown to play a key role in the response to external stimuli. To better understand this role, we proposed a viewpoint, "memories-as-bifurcations," that differs from the traditional "memories-as-attractors" viewpoint. Memory recall from the memories-as-bifurcations viewpoint occurs when the spontaneous neural activity is changed to an appropriate output activity upon application of an input, known as a bifurcation in dynamical systems theory, wherein the input modifies the flow structure of the neural dynamics. Learning, then, is a process that helps create neural dynamical systems such that a target output pattern is generated as an attractor upon a given input. Based on this novel viewpoint, we introduce in this paper an associative memory model with a sequential learning process. Using a simple hebbian-type learning, the model is able to memorize a large number of input/output mappings. The neural dynamics shaped through the learning exhibit different bifurcations to make the requested targets stable upon an increase in the input, and the neural activity in the absence of input shows chaotic dynamics with occasional approaches to the memorized target patterns. These results suggest that these dynamics facilitate the bifurcations to each target attractor upon application of the corresponding input, which thus increases the capacity for learning. This theoretical finding about the behavior of the spontaneous neural activity is consistent with recent experimental observations in which the neural activity without stimuli wanders among patterns evoked by previously applied signals. In addition, the neural networks shaped by learning properly reflect the correlations of input and target-output patterns in a similar manner to those designed in

Dynamic phase transitions and dynamic phase diagrams in the kinetic spin-5/2 Blume–Capel model in an oscillating external magnetic field: Effective-field theory and the Glauber-type stochastic dynamics approach

International Nuclear Information System (INIS)

Ertaş, Mehmet; Keskin, Mustafa; Deviren, Bayram

2012-01-01

Using an effective field theory with correlations, we study a kinetic spin-5/2 Blume–Capel model with bilinear exchange interaction and single-ion crystal field on a square lattice. The effective-field dynamic equation is derived by employing the Glauber transition rates. First, the phases in the kinetic system are obtained by solving this dynamic equation. Then, the thermal behavior of the dynamic magnetization, the hysteresis loop area and correlation are investigated in order to characterize the nature of the dynamic transitions and to obtain dynamic phase transition temperatures. Finally, we present the phase diagrams in two planes, namely (T/zJ, h 0 /zJ) and (T/zJ, D/zJ), where T absolute temperature, h 0 , the amplitude of the oscillating field, D, crystal field interaction or single-ion anisotropy constant and z denotes the nearest-neighbor sites of the central site. The phase diagrams exhibit four fundamental phases and ten mixed phases which are composed of binary, ternary and tetrad combination of fundamental phases, depending on the crystal field interaction parameter. Moreover, the phase diagrams contain a dynamic tricritical point (T), a double critical end point (B), a multicritical point (A) and zero-temperature critical point (Z). - Highlights: ► The effective-field theory is used to study the kinetic spin-5/2 Ising Blume–Capel model. ► Time variations of average order parameter have been studied to find phases in the system. ► The dynamic magnetization, hysteresis loop area and correlation have been calculated. ► The dynamic phase boundaries of the system depend on D/zJ. ► The dynamic phase diagrams are presented in the (T/zJ, h 0 /zJ) and (D/zJ, T/zJ) planes.

Dynamic phase transitions and dynamic phase diagrams in the kinetic spin-5/2 Blume-Capel model in an oscillating external magnetic field: Effective-field theory and the Glauber-type stochastic dynamics approach

Energy Technology Data Exchange (ETDEWEB)

Ertas, Mehmet [Department of Physics, Erciyes University, 38039 Kayseri (Turkey); Keskin, Mustafa, E-mail: keskin@erciyes.edu.tr [Department of Physics, Erciyes University, 38039 Kayseri (Turkey); Deviren, Bayram [Department of Physics, Nevsehir University, 50300 Nevsehir (Turkey)

2012-04-15

Using an effective field theory with correlations, we study a kinetic spin-5/2 Blume-Capel model with bilinear exchange interaction and single-ion crystal field on a square lattice. The effective-field dynamic equation is derived by employing the Glauber transition rates. First, the phases in the kinetic system are obtained by solving this dynamic equation. Then, the thermal behavior of the dynamic magnetization, the hysteresis loop area and correlation are investigated in order to characterize the nature of the dynamic transitions and to obtain dynamic phase transition temperatures. Finally, we present the phase diagrams in two planes, namely (T/zJ, h{sub 0}/zJ) and (T/zJ, D/zJ), where T absolute temperature, h{sub 0}, the amplitude of the oscillating field, D, crystal field interaction or single-ion anisotropy constant and z denotes the nearest-neighbor sites of the central site. The phase diagrams exhibit four fundamental phases and ten mixed phases which are composed of binary, ternary and tetrad combination of fundamental phases, depending on the crystal field interaction parameter. Moreover, the phase diagrams contain a dynamic tricritical point (T), a double critical end point (B), a multicritical point (A) and zero-temperature critical point (Z). - Highlights: Black-Right-Pointing-Pointer The effective-field theory is used to study the kinetic spin-5/2 Ising Blume-Capel model. Black-Right-Pointing-Pointer Time variations of average order parameter have been studied to find phases in the system. Black-Right-Pointing-Pointer The dynamic magnetization, hysteresis loop area and correlation have been calculated. Black-Right-Pointing-Pointer The dynamic phase boundaries of the system depend on D/zJ. Black-Right-Pointing-Pointer The dynamic phase diagrams are presented in the (T/zJ, h{sub 0}/zJ) and (D/zJ, T/zJ) planes.

Field-based dynamic light scattering microscopy: theory and numerical analysis.

Science.gov (United States)

Joo, Chulmin; de Boer, Johannes F

2013-11-01

We present a theoretical framework for field-based dynamic light scattering microscopy based on a spectral-domain optical coherence phase microscopy (SD-OCPM) platform. SD-OCPM is an interferometric microscope capable of quantitative measurement of amplitude and phase of scattered light with high phase stability. Field-based dynamic light scattering (F-DLS) analysis allows for direct evaluation of complex-valued field autocorrelation function and measurement of localized diffusive and directional dynamic properties of biological and material samples with high spatial resolution. In order to gain insight into the information provided by F-DLS microscopy, theoretical and numerical analyses are performed to evaluate the effect of numerical aperture of the imaging optics. We demonstrate that sharp focusing of fields affects the measured diffusive and transport velocity, which leads to smaller values for the dynamic properties in the sample. An approach for accurately determining the dynamic properties of the samples is discussed.

Inflationary dynamics of kinetically-coupled gauge fields

DEFF Research Database (Denmark)

Ferreira, Ricardo J. Z.; Ganc, Jonathan

2015-01-01

We investigate the inflationary dynamics of two kinetically-coupled massless U(1) gauge fields with time-varying kinetic-term coefficients. Ensuring that the system does not have strongly coupled regimes shrinks the parameter space. Also, we further restrict ourselves to systems that can be quant......We investigate the inflationary dynamics of two kinetically-coupled massless U(1) gauge fields with time-varying kinetic-term coefficients. Ensuring that the system does not have strongly coupled regimes shrinks the parameter space. Also, we further restrict ourselves to systems that can...... be quantized using the standard creation, annihilation operator algebra. This second constraint limits us to scenarios where the system can be diagonalized into the sum of two decoupled, massless, vector fields with a varying kinetic-term coefficient. Such a system might be interesting for magnetogenesis...... because of how the strong coupling problem generalizes. We explore this idea by assuming that one of the gauge fields is the Standard Model U(1) field and that the other dark gauge field has no particles charged under its gauge group. We consider whether it would be possible to transfer a magnetic field...

Simultaneous fitting of a potential-energy surface and its corresponding force fields using feedforward neural networks

Science.gov (United States)

Pukrittayakamee, A.; Malshe, M.; Hagan, M.; Raff, L. M.; Narulkar, R.; Bukkapatnum, S.; Komanduri, R.

2009-04-01

An improved neural network (NN) approach is presented for the simultaneous development of accurate potential-energy hypersurfaces and corresponding force fields that can be utilized to conduct ab initio molecular dynamics and Monte Carlo studies on gas-phase chemical reactions. The method is termed as combined function derivative approximation (CFDA). The novelty of the CFDA method lies in the fact that although the NN has only a single output neuron that represents potential energy, the network is trained in such a way that the derivatives of the NN output match the gradient of the potential-energy hypersurface. Accurate force fields can therefore be computed simply by differentiating the network. Both the computed energies and the gradients are then accurately interpolated using the NN. This approach is superior to having the gradients appear in the output layer of the NN because it greatly simplifies the required architecture of the network. The CFDA permits weighting of function fitting relative to gradient fitting. In every test that we have run on six different systems, CFDA training (without a validation set) has produced smaller out-of-sample testing error than early stopping (with a validation set) or Bayesian regularization (without a validation set). This indicates that CFDA training does a better job of preventing overfitting than the standard methods currently in use. The training data can be obtained using an empirical potential surface or any ab initio method. The accuracy and interpolation power of the method have been tested for the reaction dynamics of H+HBr using an analytical potential. The results show that the present NN training technique produces more accurate fits to both the potential-energy surface as well as the corresponding force fields than the previous methods. The fitting and interpolation accuracy is so high (rms error=1.2 cm-1) that trajectories computed on the NN potential exhibit point-by-point agreement with corresponding

Dynamic shielding of the magnetic fields

Directory of Open Access Journals (Sweden)

RAU, M.

2010-11-01

Full Text Available The paper presents a comparative study of the methods used to control and compensate the direct and alternative magnetic fields. Two frequently used methods in the electromagnetic compatibility of the complex biomagnetism installations were analyzed. The two methods refer to the use of inductive magnetic field sensors (only for alternative fields and of fluxgate magnetometers as active transducers which measures both the direct and alternative components of the magnetic field. The applications of the dynamic control of the magnetic field are: control of the magnetic field of the military ships, control of parasite magnetic field produced by power transformers and the electrical networks, protection of the mass spectrometers, electronic microscopes, SQUID and optical pumping magnetometers for applications in biomagnetism.

Complex dynamics of a delayed discrete neural network of two nonidentical neurons

Energy Technology Data Exchange (ETDEWEB)

Chen, Yuanlong [Mathematics Department, GuangDong University of Finance, Guangzhou 510521 (China); Huang, Tingwen [Mathematics Department, Texas A and M University at Qatar, P. O. Box 23874, Doha (Qatar); Huang, Yu, E-mail: stshyu@mail.sysu.edu.cn [Mathematics Department, Sun Yat-Sen University, Guangzhou 510275, People' s Republic China (China)

2014-03-15

In this paper, we discover that a delayed discrete Hopfield neural network of two nonidentical neurons with self-connections and no self-connections can demonstrate chaotic behaviors. To this end, we first transform the model, by a novel way, into an equivalent system which has some interesting properties. Then, we identify the chaotic invariant set for this system and show that the dynamics of this system within this set is topologically conjugate to the dynamics of the full shift map with two symbols. This confirms chaos in the sense of Devaney. Our main results generalize the relevant results of Huang and Zou [J. Nonlinear Sci. 15, 291–303 (2005)], Kaslik and Balint [J. Nonlinear Sci. 18, 415–432 (2008)] and Chen et al. [Sci. China Math. 56(9), 1869–1878 (2013)]. We also give some numeric simulations to verify our theoretical results.

Complex dynamics of a delayed discrete neural network of two nonidentical neurons

International Nuclear Information System (INIS)

Chen, Yuanlong; Huang, Tingwen; Huang, Yu

2014-01-01

In this paper, we discover that a delayed discrete Hopfield neural network of two nonidentical neurons with self-connections and no self-connections can demonstrate chaotic behaviors. To this end, we first transform the model, by a novel way, into an equivalent system which has some interesting properties. Then, we identify the chaotic invariant set for this system and show that the dynamics of this system within this set is topologically conjugate to the dynamics of the full shift map with two symbols. This confirms chaos in the sense of Devaney. Our main results generalize the relevant results of Huang and Zou [J. Nonlinear Sci. 15, 291–303 (2005)], Kaslik and Balint [J. Nonlinear Sci. 18, 415–432 (2008)] and Chen et al. [Sci. China Math. 56(9), 1869–1878 (2013)]. We also give some numeric simulations to verify our theoretical results

Bottom-up driven involuntary auditory evoked field change: constant sound sequencing amplifies but does not sharpen neural activity.

Science.gov (United States)

Okamoto, Hidehiko; Stracke, Henning; Lagemann, Lothar; Pantev, Christo

2010-01-01

The capability of involuntarily tracking certain sound signals during the simultaneous presence of noise is essential in human daily life. Previous studies have demonstrated that top-down auditory focused attention can enhance excitatory and inhibitory neural activity, resulting in sharpening of frequency tuning of auditory neurons. In the present study, we investigated bottom-up driven involuntary neural processing of sound signals in noisy environments by means of magnetoencephalography. We contrasted two sound signal sequencing conditions: "constant sequencing" versus "random sequencing." Based on a pool of 16 different frequencies, either identical (constant sequencing) or pseudorandomly chosen (random sequencing) test frequencies were presented blockwise together with band-eliminated noises to nonattending subjects. The results demonstrated that the auditory evoked fields elicited in the constant sequencing condition were significantly enhanced compared with the random sequencing condition. However, the enhancement was not significantly different between different band-eliminated noise conditions. Thus the present study confirms that by constant sound signal sequencing under nonattentive listening the neural activity in human auditory cortex can be enhanced, but not sharpened. Our results indicate that bottom-up driven involuntary neural processing may mainly amplify excitatory neural networks, but may not effectively enhance inhibitory neural circuits.

Vascular dynamics aid a coupled neurovascular network learn sparse independent features: A computational model

Directory of Open Access Journals (Sweden)

Ryan Thomas Philips

2016-02-01

Full Text Available Cerebral vascular dynamics are generally thought to be controlled by neural activity in a unidirectional fashion. However, both computational modeling and experimental evidence point to the feedback effects of vascular dynamics on neural activity. Vascular feedback in the form of glucose and oxygen controls neuronal ATP, either directly or via the agency of astrocytes, which in turn modulates neural firing. Recently, a detailed model of the neuron-astrocyte-vessel system has shown how vasomotion can modulate neural firing. Similarly, arguing from known cerebrovascular physiology, an approach known as `hemoneural hypothesis' postulates functional modulation of neural activity by vascular feedback. To instantiate this perspective, we present a computational model in which a network of `vascular units' supplies energy to a neural network. The complex dynamics of the vascular network, modeled by a network of oscillators, turns neurons ON and OFF randomly. The informational consequence of such dynamics is explored in the context of an auto-encoder network. In the proposed model, each vascular unit supplies energy to a subset of hidden neurons of an autoencoder network, which constitutes its `projective field'. Neurons that receive adequate energy in a given trial have reduced threshold, and thus are prone to fire. Dynamics of the vascular network are governed by changes in the reconstruction error of the auto-encoder network, interpreted as the neuronal demand. Vascular feedback causes random inactivation of a subset of hidden neurons in every trial. We observe that, under conditions of desynchronized vascular dynamics, the output reconstruction error is low and the feature vectors learnt are sparse and independent. Our earlier modeling study highlighted the link between desynchronized vascular dynamics and efficient energy delivery in skeletal muscle. We now show that desynchronized vascular dynamics leads to efficient training in an auto

Dynamic neural network models of the premotoneuronal circuitry controlling wrist movements in primates.

Science.gov (United States)

Maier, M A; Shupe, L E; Fetz, E E

2005-10-01

Dynamic recurrent neural networks were derived to simulate neuronal populations generating bidirectional wrist movements in the monkey. The models incorporate anatomical connections of cortical and rubral neurons, muscle afferents, segmental interneurons and motoneurons; they also incorporate the response profiles of four populations of neurons observed in behaving monkeys. The networks were derived by gradient descent algorithms to generate the eight characteristic patterns of motor unit activations observed during alternating flexion-extension wrist movements. The resulting model generated the appropriate input-output transforms and developed connection strengths resembling those in physiological pathways. We found that this network could be further trained to simulate additional tasks, such as experimentally observed reflex responses to limb perturbations that stretched or shortened the active muscles, and scaling of response amplitudes in proportion to inputs. In the final comprehensive network, motor units are driven by the combined activity of cortical, rubral, spinal and afferent units during step tracking and perturbations. The model displayed many emergent properties corresponding to physiological characteristics. The resulting neural network provides a working model of premotoneuronal circuitry and elucidates the neural mechanisms controlling motoneuron activity. It also predicts several features to be experimentally tested, for example the consequences of eliminating inhibitory connections in cortex and red nucleus. It also reveals that co-contraction can be achieved by simultaneous activation of the flexor and extensor circuits without invoking features specific to co-contraction.

Dynamics on networks: the role of local dynamics and global networks on the emergence of hypersynchronous neural activity.

Directory of Open Access Journals (Sweden)

Helmut Schmidt

2014-11-01

Full Text Available Graph theory has evolved into a useful tool for studying complex brain networks inferred from a variety of measures of neural activity, including fMRI, DTI, MEG and EEG. In the study of neurological disorders, recent work has discovered differences in the structure of graphs inferred from patient and control cohorts. However, most of these studies pursue a purely observational approach; identifying correlations between properties of graphs and the cohort which they describe, without consideration of the underlying mechanisms. To move beyond this necessitates the development of computational modeling approaches to appropriately interpret network interactions and the alterations in brain dynamics they permit, which in the field of complexity sciences is known as dynamics on networks. In this study we describe the development and application of this framework using modular networks of Kuramoto oscillators. We use this framework to understand functional networks inferred from resting state EEG recordings of a cohort of 35 adults with heterogeneous idiopathic generalized epilepsies and 40 healthy adult controls. Taking emergent synchrony across the global network as a proxy for seizures, our study finds that the critical strength of coupling required to synchronize the global network is significantly decreased for the epilepsy cohort for functional networks inferred from both theta (3-6 Hz and low-alpha (6-9 Hz bands. We further identify left frontal regions as a potential driver of seizure activity within these networks. We also explore the ability of our method to identify individuals with epilepsy, observing up to 80% predictive power through use of receiver operating characteristic analysis. Collectively these findings demonstrate that a computer model based analysis of routine clinical EEG provides significant additional information beyond standard clinical interpretation, which should ultimately enable a more appropriate mechanistic

Pulse-coupled neural nets: translation, rotation, scale, distortion, and intensity signal invariance for images.

Science.gov (United States)

Johnson, J L

1994-09-10

The linking-field neural network model of Eckhorn et al. [Neural Comput. 2, 293-307 (1990)] was introduced to explain the experimentally observed synchronous activity among neural assemblies in the cat cortex induced by feature-dependent visual activity. The model produces synchronous bursts of pulses from neurons with similar activity, effectively grouping them by phase and pulse frequency. It gives a basic new function: grouping by similarity. The synchronous bursts are obtained in the limit of strong linking strengths. The linking-field model in the limit of moderate-to-weak linking characterized by few if any multiple bursts is investigated. In this limit dynamic, locally periodic traveling waves exist whose time signal encodes the geometrical structure of a two-dimensional input image. The signal can be made insensitive to translation, scale, rotation, distortion, and intensity. The waves transmit information beyond the physical interconnect distance. The model is implemented in an optical hybrid demonstration system. Results of the simulations and the optical system are presented.

Identification of nonlinear dynamics in power plant components using neural networks

International Nuclear Information System (INIS)

Parlos, A.G.; Fernandez, B.; Tsai, W.K.

1990-01-01

Advances in digital computer technology have enabled widespread implementation of closed-loop digital control systems in a variety of industries. In some instances, however, the complexity of the plant and the uncertainty associated with the parameters involved in the mathematical modeling narrow the range of applicability of most systematic control system design methodologies. A multiyear project has been initiated to assess the feasibility of the artificial neural networks (ANNs) technology for computerized enhanced diagnostics and control of nuclear power plant components. At this stage of the project, a new methodology, based on backpropagation learning, has been developed for identifying the nonlinear dynamic systems from a set of input-output data known as the training set

The Neural Border: Induction, Specification and Maturation of the territory that generates Neural Crest cells.

Science.gov (United States)

Pla, Patrick; Monsoro-Burq, Anne H

2018-05-28

The neural crest is induced at the edge between the neural plate and the nonneural ectoderm, in an area called the neural (plate) border, during gastrulation and neurulation. In recent years, many studies have explored how this domain is patterned, and how the neural crest is induced within this territory, that also participates to the prospective dorsal neural tube, the dorsalmost nonneural ectoderm, as well as placode derivatives in the anterior area. This review highlights the tissue interactions, the cell-cell signaling and the molecular mechanisms involved in this dynamic spatiotemporal patterning, resulting in the induction of the premigratory neural crest. Collectively, these studies allow building a complex neural border and early neural crest gene regulatory network, mostly composed by transcriptional regulations but also, more recently, including novel signaling interactions. Copyright © 2018. Published by Elsevier Inc.

Fractional dynamics of charged particles in magnetic fields

Science.gov (United States)

Coronel-Escamilla, A.; Gómez-Aguilar, J. F.; Alvarado-Méndez, E.; Guerrero-Ramírez, G. V.; Escobar-Jiménez, R. F.

2016-02-01

In many physical applications the electrons play a relevant role. For example, when a beam of electrons accelerated to relativistic velocities is used as an active medium to generate Free Electron Lasers (FEL), the electrons are bound to atoms, but move freely in a magnetic field. The relaxation time, longitudinal effects and transverse variations of the optical field are parameters that play an important role in the efficiency of this laser. The electron dynamics in a magnetic field is a means of radiation source for coupling to the electric field. The transverse motion of the electrons leads to either gain or loss energy from or to the field, depending on the position of the particle regarding the phase of the external radiation field. Due to the importance to know with great certainty the displacement of charged particles in a magnetic field, in this work we study the fractional dynamics of charged particles in magnetic fields. Newton’s second law is considered and the order of the fractional differential equation is (0;1]. Based on the Grünwald-Letnikov (GL) definition, the discretization of fractional differential equations is reported to get numerical simulations. Comparison between the numerical solutions obtained on Euler’s numerical method for the classical case and the GL definition in the fractional approach proves the good performance of the numerical scheme applied. Three application examples are shown: constant magnetic field, ramp magnetic field and harmonic magnetic field. In the first example the results obtained show bistability. Dissipative effects are observed in the system and the standard dynamic is recovered when the order of the fractional derivative is 1.

Classification of networks of automata by dynamical mean field theory

International Nuclear Information System (INIS)

Burda, Z.; Jurkiewicz, J.; Flyvbjerg, H.

1990-01-01

Dynamical mean field theory is used to classify the 2 24 =65,536 different networks of binary automata on a square lattice with nearest neighbour interactions. Application of mean field theory gives 700 different mean field classes, which fall in seven classes of different asymptotic dynamics characterized by fixed points and two-cycles. (orig.)

Dynamic magnetic behavior of the mixed-spin bilayer system in an oscillating field within the mean-field theory

International Nuclear Information System (INIS)

Ertaş, Mehmet; Keskin, Mustafa

2012-01-01

The dynamic magnetic behavior of the mixed Ising bilayer system (σ=2 and S=5/2), with a crystal-field interaction in an oscillating field are studied, within the mean-field approach, by using the Glauber-type stochastic dynamics for both ferromagnetic/ferromagnetic and antiferromagnetic/ferromagnetic interactions. The time variations of average magnetizations and the temperature dependence of the dynamic magnetizations are investigated. The dynamic phase diagrams are presented in the reduced temperature and magnetic field amplitude plane and they exhibit several ordered phases, coexistence phase regions and critical points as well as a re-entrant behavior depending on interaction parameters. -- Highlights: ► Dynamic magnetic behavior of the mixed Ising bilayer system is investigated within the Glauber-type stochastic dynamics. ► The time variations of average magnetizations are studied to find the phases. ► The temperature dependence of the dynamic magnetizations is investigated to obtain the dynamic phase transition points. ► The dynamic phase diagrams are presented and they exhibit several ordered phases, coexistence phase regions and critical points as well as a re-entrant behavior.

Dynamic magnetic behavior of the mixed-spin bilayer system in an oscillating field within the mean-field theory

Energy Technology Data Exchange (ETDEWEB)

Ertaş, Mehmet [Department of Physics, Erciyes University, 38039 Kayseri (Turkey); Keskin, Mustafa, E-mail: keskin@erciyes.edu.tr [Department of Physics, Erciyes University, 38039 Kayseri (Turkey)

2012-07-23

The dynamic magnetic behavior of the mixed Ising bilayer system (σ=2 and S=5/2), with a crystal-field interaction in an oscillating field are studied, within the mean-field approach, by using the Glauber-type stochastic dynamics for both ferromagnetic/ferromagnetic and antiferromagnetic/ferromagnetic interactions. The time variations of average magnetizations and the temperature dependence of the dynamic magnetizations are investigated. The dynamic phase diagrams are presented in the reduced temperature and magnetic field amplitude plane and they exhibit several ordered phases, coexistence phase regions and critical points as well as a re-entrant behavior depending on interaction parameters. -- Highlights: ► Dynamic magnetic behavior of the mixed Ising bilayer system is investigated within the Glauber-type stochastic dynamics. ► The time variations of average magnetizations are studied to find the phases. ► The temperature dependence of the dynamic magnetizations is investigated to obtain the dynamic phase transition points. ► The dynamic phase diagrams are presented and they exhibit several ordered phases, coexistence phase regions and critical points as well as a re-entrant behavior.

Dark-Bright Soliton Dynamics Beyond the Mean-Field Approximation

Science.gov (United States)

Katsimiga, Garyfallia; Koutentakis, Georgios; Mistakidis, Simeon; Kevrekidis, Panagiotis; Schmelcher, Peter; Theory Group of Fundamental Processes in Quantum Physics Team

2017-04-01

The dynamics of dark bright solitons beyond the mean-field approximation is investigated. We first examine the case of a single dark-bright soliton and its oscillations within a parabolic trap. Subsequently, we move to the setting of collisions, comparing the mean-field approximation to that involving multiple orbitals in both the dark and the bright component. Fragmentation is present and significantly affects the dynamics, especially in the case of slower solitons and in that of lower atom numbers. It is shown that the presence of fragmentation allows for bipartite entanglement between the distinguishable species. Most importantly the interplay between fragmentation and entanglement leads to the decay of each of the initial mean-field dark-bright solitons into fast and slow fragmented dark-bright structures. A variety of excitations including dark-bright solitons in multiple (concurrently populated) orbitals is observed. Dark-antidark states and domain-wall-bright soliton complexes can also be observed to arise spontaneously in the beyond mean-field dynamics. Deutsche Forschungsgemeinschaft (DFG) in the framework of the SFB 925 ``Light induced dynamics and control of correlated quantum systems''.

Dynamic Phase Transitions In The Spin-2 Ising System Under An Oscillating Magnetic Field Within The Effective-Field Theory

International Nuclear Information System (INIS)

Ertas, Mehmet; Keskin, Mustafa; Deviren, Bayram

2010-01-01

The dynamic phase transitions are studied in the spin-2 Ising model under a time-dependent oscillating magnetic field by using the effective-field theory with correlations. The effective-field dynamic equation is derived by employing the Glauber transition rates and the phases in the system are obtained by solving this dynamic equation. The nature (first- or second-order) of the dynamic phase transition is characterized by investigating the thermal behavior of the dynamic order parameter and the dynamic phase transition temperatures are obtained. The dynamic phase diagrams are presented in (T/zJ, h/zJ) plane.

Real-time object tracking system based on field-programmable gate array and convolution neural network

Directory of Open Access Journals (Sweden)

Congyi Lyu

2016-12-01

Full Text Available Vision-based object tracking has lots of applications in robotics, like surveillance, navigation, motion capturing, and so on. However, the existing object tracking systems still suffer from the challenging problem of high computation consumption in the image processing algorithms. The problem can prevent current systems from being used in many robotic applications which have limitations of payload and power, for example, micro air vehicles. In these applications, the central processing unit- or graphics processing unit-based computers are not good choices due to the high weight and power consumption. To address the problem, this article proposed a real-time object tracking system based on field-programmable gate array, convolution neural network, and visual servo technology. The time-consuming image processing algorithms, such as distortion correction, color space convertor, and Sobel edge, Harris corner features detector, and convolution neural network were redesigned using the programmable gates in field-programmable gate array. Based on the field-programmable gate array-based image processing, an image-based visual servo controller was designed to drive a two degree of freedom manipulator to track the target in real time. Finally, experiments on the proposed system were performed to illustrate the effectiveness of the real-time object tracking system.

Neural dynamics of morphological processing in spoken word comprehension: Laterality and automaticity

Directory of Open Access Journals (Sweden)

Caroline M. Whiting

2013-11-01

Full Text Available Rapid and automatic processing of grammatical complexity is argued to take place during speech comprehension, engaging a left-lateralised fronto-temporal language network. Here we address how neural activity in these regions is modulated by the grammatical properties of spoken words. We used combined magneto- and electroencephalography (MEG, EEG to delineate the spatiotemporal patterns of activity that support the recognition of morphologically complex words in English with inflectional (-s and derivational (-er affixes (e.g. bakes, baker. The mismatch negativity (MMN, an index of linguistic memory traces elicited in a passive listening paradigm, was used to examine the neural dynamics elicited by morphologically complex words. Results revealed an initial peak 130-180 ms after the deviation point with a major source in left superior temporal cortex. The localisation of this early activation showed a sensitivity to two grammatical properties of the stimuli: 1 the presence of morphological complexity, with affixed words showing increased left-laterality compared to non-affixed words; and 2 the grammatical category, with affixed verbs showing greater left-lateralisation in inferior frontal gyrus compared to affixed nouns (bakes vs. beaks. This automatic brain response was additionally sensitive to semantic coherence (the meaning of the stem vs. the meaning of the whole form in fronto-temporal regions. These results demonstrate that the spatiotemporal pattern of neural activity in spoken word processing is modulated by the presence of morphological structure, predominantly engaging the left-hemisphere’s fronto-temporal language network, and does not require focused attention on the linguistic input.

Modeling emotional dynamics : currency versus field.

Energy Technology Data Exchange (ETDEWEB)

Sallach, D .L.; Decision and Information Sciences; Univ. of Chicago

2008-08-01

Randall Collins has introduced a simplified model of emotional dynamics in which emotional energy, heightened and focused by interaction rituals, serves as a common denominator for social exchange: a generic form of currency, except that it is active in a far broader range of social transactions. While the scope of this theory is attractive, the specifics of the model remain unconvincing. After a critical assessment of the currency theory of emotion, a field model of emotion is introduced that adds expressiveness by locating emotional valence within its cognitive context, thereby creating an integrated orientation field. The result is a model which claims less in the way of motivational specificity, but is more satisfactory in modeling the dynamic interaction between cognitive and emotional orientations at both individual and social levels.

Online Recorded Data-Based Composite Neural Control of Strict-Feedback Systems With Application to Hypersonic Flight Dynamics.

Science.gov (United States)

Xu, Bin; Yang, Daipeng; Shi, Zhongke; Pan, Yongping; Chen, Badong; Sun, Fuchun

2017-09-25

This paper investigates the online recorded data-based composite neural control of uncertain strict-feedback systems using the backstepping framework. In each step of the virtual control design, neural network (NN) is employed for uncertainty approximation. In previous works, most designs are directly toward system stability ignoring the fact how the NN is working as an approximator. In this paper, to enhance the learning ability, a novel prediction error signal is constructed to provide additional correction information for NN weight update using online recorded data. In this way, the neural approximation precision is highly improved, and the convergence speed can be faster. Furthermore, the sliding mode differentiator is employed to approximate the derivative of the virtual control signal, and thus, the complex analysis of the backstepping design can be avoided. The closed-loop stability is rigorously established, and the boundedness of the tracking error can be guaranteed. Through simulation of hypersonic flight dynamics, the proposed approach exhibits better tracking performance.

Short-term synaptic plasticity and heterogeneity in neural systems

Science.gov (United States)

Mejias, J. F.; Kappen, H. J.; Longtin, A.; Torres, J. J.

2013-01-01

We review some recent results on neural dynamics and information processing which arise when considering several biophysical factors of interest, in particular, short-term synaptic plasticity and neural heterogeneity. The inclusion of short-term synaptic plasticity leads to enhanced long-term memory capacities, a higher robustness of memory to noise, and irregularity in the duration of the so-called up cortical states. On the other hand, considering some level of neural heterogeneity in neuron models allows neural systems to optimize information transmission in rate coding and temporal coding, two strategies commonly used by neurons to codify information in many brain areas. In all these studies, analytical approximations can be made to explain the underlying dynamics of these neural systems.

Bio-inspired spiking neural network for nonlinear systems control.

Science.gov (United States)

Pérez, Javier; Cabrera, Juan A; Castillo, Juan J; Velasco, Juan M

2018-08-01

Spiking neural networks (SNN) are the third generation of artificial neural networks. SNN are the closest approximation to biological neural networks. SNNs make use of temporal spike trains to command inputs and outputs, allowing a faster and more complex computation. As demonstrated by biological organisms, they are a potentially good approach to designing controllers for highly nonlinear dynamic systems in which the performance of controllers developed by conventional techniques is not satisfactory or difficult to implement. SNN-based controllers exploit their ability for online learning and self-adaptation to evolve when transferred from simulations to the real world. SNN's inherent binary and temporary way of information codification facilitates their hardware implementation compared to analog neurons. Biological neural networks often require a lower number of neurons compared to other controllers based on artificial neural networks. In this work, these neuronal systems are imitated to perform the control of non-linear dynamic systems. For this purpose, a control structure based on spiking neural networks has been designed. Particular attention has been paid to optimizing the structure and size of the neural network. The proposed structure is able to control dynamic systems with a reduced number of neurons and connections. A supervised learning process using evolutionary algorithms has been carried out to perform controller training. The efficiency of the proposed network has been verified in two examples of dynamic systems control. Simulations show that the proposed control based on SNN exhibits superior performance compared to other approaches based on Neural Networks and SNNs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Nonlinear analysis and synthesis of video images using deep dynamic bottleneck neural networks for face recognition.

Science.gov (United States)

Moghadam, Saeed Montazeri; Seyyedsalehi, Seyyed Ali

2018-05-31

Nonlinear components extracted from deep structures of bottleneck neural networks exhibit a great ability to express input space in a low-dimensional manifold. Sharing and combining the components boost the capability of the neural networks to synthesize and interpolate new and imaginary data. This synthesis is possibly a simple model of imaginations in human brain where the components are expressed in a nonlinear low dimensional manifold. The current paper introduces a novel Dynamic Deep Bottleneck Neural Network to analyze and extract three main features of videos regarding the expression of emotions on the face. These main features are identity, emotion and expression intensity that are laid in three different sub-manifolds of one nonlinear general manifold. The proposed model enjoying the advantages of recurrent networks was used to analyze the sequence and dynamics of information in videos. It is noteworthy to mention that this model also has also the potential to synthesize new videos showing variations of one specific emotion on the face of unknown subjects. Experiments on discrimination and recognition ability of extracted components showed that the proposed model has an average of 97.77% accuracy in recognition of six prominent emotions (Fear, Surprise, Sadness, Anger, Disgust, and Happiness), and 78.17% accuracy in the recognition of intensity. The produced videos revealed variations from neutral to the apex of an emotion on the face of the unfamiliar test subject which is on average 0.8 similar to reference videos in the scale of the SSIM method. Copyright © 2018 Elsevier Ltd. All rights reserved.

The Dose-Dependent Effects of Vascular Risk Factors on Dynamic Compensatory Neural Processes in Mild Cognitive Impairment

Directory of Open Access Journals (Sweden)

Haifeng Chen

2018-05-01

Full Text Available Background/Objectives: Mild cognitive impairment (MCI has been associated with risk for Alzheimer's Disease (AD. Previous investigations have suggested that vascular risk factors (VRFs were associated with cognitive decline and AD pathogenesis, and the intervention of VRFs may be a possible way to prevent dementia. However, in MCI, little is known about the potential impacts of VRFs on neural networks and their neural substrates, which may be a neuroimaging biomarker of the disease progression.Methods: 128 elderly Han Chinese participants (67 MCI subjects and 61 matched normal elderly with or without VRFs (hypertension, diabetes mellitus, hypercholesterolemia, smoking and alcohol drinking underwent the resting-state functional magnetic resonance imaging (fMRI and neuropsychological tests. We obtained the default mode network (DMN to identify alterations in MCI with the varying number of the VRF and analyzed the significant correlation with behavioral performance.Results: The effects of VRF on the DMN were primarily in bilateral dorsolateral prefrontal cortex (DLPFC (i.e., middle frontal gyrus. Normal elderly showed the gradually increased functional activity of DLPFC, while a fluctuant activation of DLPFC was displayed in MCI with the growing number of the VRF. Interestingly, the left DLPFC further displayed significantly dynamic correlation with executive function as the variation of VRF loading. Initial level of compensation was observed in normal aging and none-vascular risk factor (NVRF MCI, while these compensatory neural processes were suppressed in One-VRF MCI and were subsequently re-aroused in Over-One-VRF MCI.Conclusions: These findings suggested that the dose-dependent effects of VRF on DLPFC were highlighted in MCI, and the dynamic compensatory neural processes that fluctuated along with variations of VRF loading could be key role in the progression of MCI.

Adaptive neural network output feedback control for stochastic nonlinear systems with unknown dead-zone and unmodeled dynamics.

Science.gov (United States)

Tong, Shaocheng; Wang, Tong; Li, Yongming; Zhang, Huaguang

2014-06-01

This paper discusses the problem of adaptive neural network output feedback control for a class of stochastic nonlinear strict-feedback systems. The concerned systems have certain characteristics, such as unknown nonlinear uncertainties, unknown dead-zones, unmodeled dynamics and without the direct measurements of state variables. In this paper, the neural networks (NNs) are employed to approximate the unknown nonlinear uncertainties, and then by representing the dead-zone as a time-varying system with a bounded disturbance. An NN state observer is designed to estimate the unmeasured states. Based on both backstepping design technique and a stochastic small-gain theorem, a robust adaptive NN output feedback control scheme is developed. It is proved that all the variables involved in the closed-loop system are input-state-practically stable in probability, and also have robustness to the unmodeled dynamics. Meanwhile, the observer errors and the output of the system can be regulated to a small neighborhood of the origin by selecting appropriate design parameters. Simulation examples are also provided to illustrate the effectiveness of the proposed approach.

Mean-field theory of nuclear structure and dynamics

International Nuclear Information System (INIS)

Negele, J.W.

1982-01-01

The physical and theoretical foundations are presented for the mean-field theory of nuclear structure and dynamics. Salient features of the many-body theory of stationary states are reviewed to motivate the time-dependent mean-field approximation. The time-dependent Hartree-Fock approximation and its limitations are discussed and general theoretical formulations are presented which yield time-dependent mean-field equations in lowest approximation and provide suitable frameworks for overcoming various conceptual and practical limitations of the mean-field theory. Particular emphasis is placed on recent developments utilizing functional integral techniques to obtain a quantum mean-field theory applicable to quantized eigenstates, spontaneous fission, the nuclear partition function, and scattering problems. Applications to a number of simple, idealized systems are presented to verify the approximations for solvable problems and to elucidate the essential features of mean-field dynamics. Finally, calculations utilizing moderately realistic geometries and interactions are reviewed which address heavy-ion collisions, fusion, strongly damped collisions, and fission

Finite temperature dynamics of a Holstein polaron: The thermo-field dynamics approach

Science.gov (United States)

Chen, Lipeng; Zhao, Yang

2017-12-01

Combining the multiple Davydov D2 Ansatz with the method of thermo-field dynamics, we study finite temperature dynamics of a Holstein polaron on a lattice. It has been demonstrated, using the hierarchy equations of motion method as a benchmark, that our approach provides an efficient, robust description of finite temperature dynamics of the Holstein polaron in the simultaneous presence of diagonal and off-diagonal exciton-phonon coupling. The method of thermo-field dynamics handles temperature effects in the Hilbert space with key numerical advantages over other treatments of finite-temperature dynamics based on quantum master equations in the Liouville space or wave function propagation with Monte Carlo importance sampling. While for weak to moderate diagonal coupling temperature increases inhibit polaron mobility, it is found that off-diagonal coupling induces phonon-assisted transport that dominates at high temperatures. Results on the mean square displacements show that band-like transport features dominate the diagonal coupling cases, and there exists a crossover from band-like to hopping transport with increasing temperature when including off-diagonal coupling. As a proof of concept, our theory provides a unified treatment of coherent and incoherent transport in molecular crystals and is applicable to any temperature.

Characterization of the disruption of neural control strategies for dynamic fingertip forces from attractor reconstruction.

Directory of Open Access Journals (Sweden)

Lorenzo Peppoloni

Full Text Available The Strength-Dexterity (SD test measures the ability of the pulps of the thumb and index finger to compress a compliant and slender spring prone to buckling at low forces (<3N. We know that factors such as aging and neurodegenerative conditions bring deteriorating physiological changes (e.g., at the level of motor cortex, cerebellum, and basal ganglia, which lead to an overall loss of dexterous ability. However, little is known about how these changes reflect upon the dynamics of the underlying biological system. The spring-hand system exhibits nonlinear dynamical behavior and here we characterize the dynamical behavior of the phase portraits using attractor reconstruction. Thirty participants performed the SD test: 10 young adults, 10 older adults, and 10 older adults with Parkinson's disease (PD. We used delayed embedding of the applied force to reconstruct its attractor. We characterized the distribution of points of the phase portraits by their density (number of distant points and interquartile range and geometric features (trajectory length and size. We find phase portraits from older adults exhibit more distant points (p = 0.028 than young adults and participants with PD have larger interquartile ranges (p = 0.001, trajectory lengths (p = 0.005, and size (p = 0.003 than their healthy counterparts. The increased size of the phase portraits with healthy aging suggests a change in the dynamical properties of the system, which may represent a weakening of the neural control strategy. In contrast, the distortion of the attractor in PD suggests a fundamental change in the underlying biological system, and disruption of the neural control strategy. This ability to detect differences in the biological mechanisms of dexterity in healthy and pathological aging provides a simple means to assess their disruption in neurodegenerative conditions and justifies further studies to understand the link with the physiological changes.

Self: an adaptive pressure arising from self-organization, chaotic dynamics, and neural Darwinism.

Science.gov (United States)

Bruzzo, Angela Alessia; Vimal, Ram Lakhan Pandey

2007-12-01

In this article, we establish a model to delineate the emergence of "self" in the brain making recourse to the theory of chaos. Self is considered as the subjective experience of a subject. As essential ingredients of subjective experiences, our model includes wakefulness, re-entry, attention, memory, and proto-experiences. The stability as stated by chaos theory can potentially describe the non-linear function of "self" as sensitive to initial conditions and can characterize it as underlying order from apparently random signals. Self-similarity is discussed as a latent menace of a pathological confusion between "self" and "others". Our test hypothesis is that (1) consciousness might have emerged and evolved from a primordial potential or proto-experience in matter, such as the physical attractions and repulsions experienced by electrons, and (2) "self" arises from chaotic dynamics, self-organization and selective mechanisms during ontogenesis, while emerging post-ontogenically as an adaptive pressure driven by both volume and synaptic-neural transmission and influencing the functional connectivity of neural nets (structure).

Dynamic characterization of oil fields, complex stratigraphically using genetic algorithms

International Nuclear Information System (INIS)

Gonzalez, Santiago; Hidrobo, Eduardo A

2004-01-01

A novel methodology is presented in this paper for the characterization of highly heterogeneous oil fields by integration of the oil fields dynamic information to the static updated model. The objective of the oil field's characterization process is to build an oil field model, as realistic as possible, through the incorporation of all the available information. The classical approach consists in producing a model based in the oil field's static information, having as the process final stage the validation model with the dynamic information available. It is important to clarify that the term validation implies a punctual process by nature, generally intended to secure the required coherence between productive zones and petrophysical properties. The objective of the proposed methodology is to enhance the prediction capacity of the oil field's model by previously integrating, parameters inherent to the oil field's fluid dynamics by a process of dynamic data inversion through an optimization procedure based on evolutionary computation. The proposed methodology relies on the construction of the oil field's high-resolution static model, escalated by means of hybrid techniques while aiming to preserve the oil field's heterogeneity. Afterwards, using an analytic simulator as reference, the scaled model is methodically modified by means of an optimization process that uses genetic algorithms and production data as conditional information. The process's final product is a model that observes the static and dynamic conditions of the oil field with the capacity to minimize the economic impact that generates production historical adjustments to the simulation tasks. This final model features some petrophysical properties (porosity, permeability and water saturation), as modified to achieve a better adjustment of the simulated production's history versus the real one history matching. Additionally, the process involves a slight modification of relative permeability, which has

Dynamic scattering theory for dark-field electron holography of 3D strain fields

International Nuclear Information System (INIS)

Lubk, Axel; Javon, Elsa; Cherkashin, Nikolay; Reboh, Shay; Gatel, Christophe; Hÿtch, Martin

2014-01-01

Dark-field electron holography maps strain in crystal lattices into reconstructed phases over large fields of view. Here we investigate the details of the lattice strain–reconstructed phase relationship by applying dynamic scattering theory both analytically and numerically. We develop efficient analytic linear projection rules for 3D strain fields, facilitating a straight-forward calculation of reconstructed phases from 3D strained materials. They are used in the following to quantify the influence of various experimental parameters like strain magnitude, specimen thickness, excitation error and surface relaxation. - Author-Highlights: • We derive a simple dynamic scattering formalism for dark field electron holography based on a perturbative two-beam theory. • The formalism facilitates the projection of 3D strain fields by a simple weighting integral. • The weighted projection depends analytically on the diffraction order, the excitation error and the specimen thickness. • The weighting integral formalism represents an important prerequisite towards the development of tomographic strain reconstruction techniques

Ab initio molecular dynamics in a finite homogeneous electric field.

Science.gov (United States)

Umari, P; Pasquarello, Alfredo

2002-10-07

We treat homogeneous electric fields within density functional calculations with periodic boundary conditions. A nonlocal energy functional depending on the applied field is used within an ab initio molecular dynamics scheme. The reliability of the method is demonstrated in the case of bulk MgO for the Born effective charges, and the high- and low-frequency dielectric constants. We evaluate the static dielectric constant by performing a damped molecular dynamics in an electric field and avoiding the calculation of the dynamical matrix. Application of this method to vitreous silica shows good agreement with experiment and illustrates its potential for systems of large size.

The most general cosmological dynamics for ELKO matter fields

International Nuclear Information System (INIS)

Fabbri, Luca

2011-01-01

Not long ago, the definition of eigenspinors of charge-conjugation belonging to a special Wigner class has lead to the unexpected theoretical discovery of a form of matter with spin 1/2 and mass dimension 1, called ELKO matter field; ELKO matter fields defined in flat spacetimes have been later extended to curved and twisted spacetimes, in order to include in their dynamics the coupling to gravitational fields possessing both metric and torsional degrees of freedom: the inclusion of non-commuting spinorial covariant derivatives allows for the introduction of more general dynamical terms influencing the behaviour of ELKO matter fields. In this Letter, we shall solve the theoretical problem of finding the most general dynamics for ELKO matter, and we will face the phenomenological issue concerning how the new dynamical terms may affect the behavior of ELKO matter; we will see that new effects will arise for which the very existence of ELKO matter will be endangered, due to the fact that ELKOs will turn incompatible with the cosmological principle. Thus we have that anisotropic universes must be taken into account if ELKOs are to be considered in their most general form.

Dynamical similarity of geomagnetic field reversals.

Science.gov (United States)

Valet, Jean-Pierre; Fournier, Alexandre; Courtillot, Vincent; Herrero-Bervera, Emilio

2012-10-04

No consensus has been reached so far on the properties of the geomagnetic field during reversals or on the main features that might reveal its dynamics. A main characteristic of the reversing field is a large decrease in the axial dipole and the dominant role of non-dipole components. Other features strongly depend on whether they are derived from sedimentary or volcanic records. Only thermal remanent magnetization of lava flows can capture faithful records of a rapidly varying non-dipole field, but, because of episodic volcanic activity, sequences of overlying flows yield incomplete records. Here we show that the ten most detailed volcanic records of reversals can be matched in a very satisfactory way, under the assumption of a common duration, revealing common dynamical characteristics. We infer that the reversal process has remained unchanged, with the same time constants and durations, at least since 180 million years ago. We propose that the reversing field is characterized by three successive phases: a precursory event, a 180° polarity switch and a rebound. The first and third phases reflect the emergence of the non-dipole field with large-amplitude secular variation. They are rarely both recorded at the same site owing to the rapidly changing field geometry and last for less than 2,500 years. The actual transit between the two polarities does not last longer than 1,000 years and might therefore result from mechanisms other than those governing normal secular variation. Such changes are too brief to be accurately recorded by most sediments.

The neural dynamics of reward value and risk coding in the human orbitofrontal cortex.

Science.gov (United States)

Li, Yansong; Vanni-Mercier, Giovanna; Isnard, Jean; Mauguière, François; Dreher, Jean-Claude

2016-04-01

The orbitofrontal cortex is known to carry information regarding expected reward, risk and experienced outcome. Yet, due to inherent limitations in lesion and neuroimaging methods, the neural dynamics of these computations has remained elusive in humans. Here, taking advantage of the high temporal definition of intracranial recordings, we characterize the neurophysiological signatures of the intact orbitofrontal cortex in processing information relevant for risky decisions. Local field potentials were recorded from the intact orbitofrontal cortex of patients suffering from drug-refractory partial epilepsy with implanted depth electrodes as they performed a probabilistic reward learning task that required them to associate visual cues with distinct reward probabilities. We observed three successive signals: (i) around 400 ms after cue presentation, the amplitudes of the local field potentials increased with reward probability; (ii) a risk signal emerged during the late phase of reward anticipation and during the outcome phase; and (iii) an experienced value signal appeared at the time of reward delivery. Both the medial and lateral orbitofrontal cortex encoded risk and reward probability while the lateral orbitofrontal cortex played a dominant role in coding experienced value. The present study provides the first evidence from intracranial recordings that the human orbitofrontal cortex codes reward risk both during late reward anticipation and during the outcome phase at a time scale of milliseconds. Our findings offer insights into the rapid mechanisms underlying the ability to learn structural relationships from the environment. © The Author (2016). Published by Oxford University Press on behalf of the Guarantors of Brain. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Mean-field theory of active electrolytes: Dynamic adsorption and overscreening

Science.gov (United States)

Frydel, Derek; Podgornik, Rudolf

2018-05-01

We investigate active electrolytes within the mean-field level of description. The focus is on how the double-layer structure of passive, thermalized charges is affected by active dynamics of constituting ions. One feature of active dynamics is that particles adhere to hard surfaces, regardless of chemical properties of a surface and specifically in complete absence of any chemisorption or physisorption. To carry out the mean-field analysis of the system that is out of equilibrium, we develop the "mean-field simulation" technique, where the simulated system consists of charged parallel sheets moving on a line and obeying active dynamics, with the interaction strength rescaled by the number of sheets. The mean-field limit becomes exact in the limit of an infinite number of movable sheets.

Towards a theory of cortical columns: From spiking neurons to interacting neural populations of finite size.

Science.gov (United States)

Schwalger, Tilo; Deger, Moritz; Gerstner, Wulfram

2017-04-01

Neural population equations such as neural mass or field models are widely used to study brain activity on a large scale. However, the relation of these models to the properties of single neurons is unclear. Here we derive an equation for several interacting populations at the mesoscopic scale starting from a microscopic model of randomly connected generalized integrate-and-fire neuron models. Each population consists of 50-2000 neurons of the same type but different populations account for different neuron types. The stochastic population equations that we find reveal how spike-history effects in single-neuron dynamics such as refractoriness and adaptation interact with finite-size fluctuations on the population level. Efficient integration of the stochastic mesoscopic equations reproduces the statistical behavior of the population activities obtained from microscopic simulations of a full spiking neural network model. The theory describes nonlinear emergent dynamics such as finite-size-induced stochastic transitions in multistable networks and synchronization in balanced networks of excitatory and inhibitory neurons. The mesoscopic equations are employed to rapidly integrate a model of a cortical microcircuit consisting of eight neuron types, which allows us to predict spontaneous population activities as well as evoked responses to thalamic input. Our theory establishes a general framework for modeling finite-size neural population dynamics based on single cell and synapse parameters and offers an efficient approach to analyzing cortical circuits and computations.

Thermo field dynamics: a quantum field theory at finite temperature

International Nuclear Information System (INIS)

Mancini, F.; Marinaro, M.; Matsumoto, H.

1988-01-01

A brief review of the theory of thermo field dynamics (TFD) is presented. TFD is introduced and developed by Umezawa and his coworkers at finite temperature. The most significant concept in TFD is that of a thermal vacuum which satisfies some conditions denoted as thermal state conditions. The TFD permits to reformulate theories at finite temperature. There is no need in an additional principle to determine particle distributions at T ≠ 0. Temperature and other macroscopic parameters are introduced in the definition of the vacuum state. All operator formalisms used in quantum field theory at T=0 are preserved, although the field degrees of freedom are doubled. 8 refs

Aeroelasticity of morphing wings using neural networks

Science.gov (United States)

Natarajan, Anand

In this dissertation, neural networks are designed to effectively model static non-linear aeroelastic problems in adaptive structures and linear dynamic aeroelastic systems with time varying stiffness. The use of adaptive materials in aircraft wings allows for the change of the contour or the configuration of a wing (morphing) in flight. The use of smart materials, to accomplish these deformations, can imply that the stiffness of the wing with a morphing contour changes as the contour changes. For a rapidly oscillating body in a fluid field, continuously adapting structural parameters may render the wing to behave as a time variant system. Even the internal spars/ribs of the aircraft wing which define the wing stiffness can be made adaptive, that is, their stiffness can be made to vary with time. The immediate effect on the structural dynamics of the wing, is that, the wing motion is governed by a differential equation with time varying coefficients. The study of this concept of a time varying torsional stiffness, made possible by the use of active materials and adaptive spars, in the dynamic aeroelastic behavior of an adaptable airfoil is performed here. Another type of aeroelastic problem of an adaptive structure that is investigated here, is the shape control of an adaptive bump situated on the leading edge of an airfoil. Such a bump is useful in achieving flow separation control for lateral directional maneuverability of the aircraft. Since actuators are being used to create this bump on the wing surface, the energy required to do so needs to be minimized. The adverse pressure drag as a result of this bump needs to be controlled so that the loss in lift over the wing is made minimal. The design of such a "spoiler bump" on the surface of the airfoil is an optimization problem of maximizing pressure drag due to flow separation while minimizing the loss in lift and energy required to deform the bump. One neural network is trained using the CFD code FLUENT to

Neural network modeling for near wall turbulent flow

International Nuclear Information System (INIS)

Milano, Michele; Koumoutsakos, Petros

2002-01-01

A neural network methodology is developed in order to reconstruct the near wall field in a turbulent flow by exploiting flow fields provided by direct numerical simulations. The results obtained from the neural network methodology are compared with the results obtained from prediction and reconstruction using proper orthogonal decomposition (POD). Using the property that the POD is equivalent to a specific linear neural network, a nonlinear neural network extension is presented. It is shown that for a relatively small additional computational cost nonlinear neural networks provide us with improved reconstruction and prediction capabilities for the near wall velocity fields. Based on these results advantages and drawbacks of both approaches are discussed with an outlook toward the development of near wall models for turbulence modeling and control

Dynamic behaviors of spin-1/2 bilayer system within Glauber-type stochastic dynamics based on the effective-field theory

International Nuclear Information System (INIS)

Ertaş, Mehmet; Kantar, Ersin; Keskin, Mustafa

2014-01-01

The dynamic phase transitions (DPTs) and dynamic phase diagrams of the kinetic spin-1/2 bilayer system in the presence of a time-dependent oscillating external magnetic field are studied by using Glauber-type stochastic dynamics based on the effective-field theory with correlations for the ferromagnetic/ferromagnetic (FM/FM), antiferromagnetic/ferromagnetic (AFM/FM) and antiferromagnetic/antiferromagnetic (AFM/AFM) interactions. The time variations of average magnetizations and the temperature dependence of the dynamic magnetizations are investigated. The dynamic phase diagrams for the amplitude of the oscillating field versus temperature were presented. The results are compared with the results of the same system within Glauber-type stochastic dynamics based on the mean-field theory. - Highlights: • The Ising bilayer system is investigated within the Glauber dynamics based on EFT. • The time variations of average order parameters to find phases are studied. • The dynamic phase diagrams are found for the different interaction parameters. • The system displays the critical points as well as a re-entrant behavior

Dynamic behaviors of spin-1/2 bilayer system within Glauber-type stochastic dynamics based on the effective-field theory

Energy Technology Data Exchange (ETDEWEB)

Ertaş, Mehmet; Kantar, Ersin, E-mail: ersinkantar@erciyes.edu.tr; Keskin, Mustafa

2014-05-01

The dynamic phase transitions (DPTs) and dynamic phase diagrams of the kinetic spin-1/2 bilayer system in the presence of a time-dependent oscillating external magnetic field are studied by using Glauber-type stochastic dynamics based on the effective-field theory with correlations for the ferromagnetic/ferromagnetic (FM/FM), antiferromagnetic/ferromagnetic (AFM/FM) and antiferromagnetic/antiferromagnetic (AFM/AFM) interactions. The time variations of average magnetizations and the temperature dependence of the dynamic magnetizations are investigated. The dynamic phase diagrams for the amplitude of the oscillating field versus temperature were presented. The results are compared with the results of the same system within Glauber-type stochastic dynamics based on the mean-field theory. - Highlights: • The Ising bilayer system is investigated within the Glauber dynamics based on EFT. • The time variations of average order parameters to find phases are studied. • The dynamic phase diagrams are found for the different interaction parameters. • The system displays the critical points as well as a re-entrant behavior.

An analysis of nonlinear dynamics underlying neural activity related to auditory induction in the rat auditory cortex.

Science.gov (United States)

Noto, M; Nishikawa, J; Tateno, T

2016-03-24

A sound interrupted by silence is perceived as discontinuous. However, when high-intensity noise is inserted during the silence, the missing sound may be perceptually restored and be heard as uninterrupted. This illusory phenomenon is called auditory induction. Recent electrophysiological studies have revealed that auditory induction is associated with the primary auditory cortex (A1). Although experimental evidence has been accumulating, the neural mechanisms underlying auditory induction in A1 neurons are poorly understood. To elucidate this, we used both experimental and computational approaches. First, using an optical imaging method, we characterized population responses across auditory cortical fields to sound and identified five subfields in rats. Next, we examined neural population activity related to auditory induction with high temporal and spatial resolution in the rat auditory cortex (AC), including the A1 and several other AC subfields. Our imaging results showed that tone-burst stimuli interrupted by a silent gap elicited early phasic responses to the first tone and similar or smaller responses to the second tone following the gap. In contrast, tone stimuli interrupted by broadband noise (BN), considered to cause auditory induction, considerably suppressed or eliminated responses to the tone following the noise. Additionally, tone-burst stimuli that were interrupted by notched noise centered at the tone frequency, which is considered to decrease the strength of auditory induction, partially restored the second responses from the suppression caused by BN. To phenomenologically mimic the neural population activity in the A1 and thus investigate the mechanisms underlying auditory induction, we constructed a computational model from the periphery through the AC, including a nonlinear dynamical system. The computational model successively reproduced some of the above-mentioned experimental results. Therefore, our results suggest that a nonlinear, self

Noninvasive Deep Brain Stimulation via Temporally Interfering Electric Fields.

Science.gov (United States)

Grossman, Nir; Bono, David; Dedic, Nina; Kodandaramaiah, Suhasa B; Rudenko, Andrii; Suk, Ho-Jun; Cassara, Antonino M; Neufeld, Esra; Kuster, Niels; Tsai, Li-Huei; Pascual-Leone, Alvaro; Boyden, Edward S

2017-06-01

We report a noninvasive strategy for electrically stimulating neurons at depth. By delivering to the brain multiple electric fields at frequencies too high to recruit neural firing, but which differ by a frequency within the dynamic range of neural firing, we can electrically stimulate neurons throughout a region where interference between the multiple fields results in a prominent electric field envelope modulated at the difference frequency. We validated this temporal interference (TI) concept via modeling and physics experiments, and verified that neurons in the living mouse brain could follow the electric field envelope. We demonstrate the utility of TI stimulation by stimulating neurons in the hippocampus of living mice without recruiting neurons of the overlying cortex. Finally, we show that by altering the currents delivered to a set of immobile electrodes, we can steerably evoke different motor patterns in living mice. Copyright © 2017 Elsevier Inc. All rights reserved.

Application of neural networks in coastal engineering

Digital Repository Service at National Institute of Oceanography (India)

Mandal, S.

the neural network attractive. A neural network is an information processing system modeled on the structure of the dynamic process. It can solve the complex/nonlinear problems quickly once trained by operating on problems using an interconnected number...

Elements of an algorithm for optimizing a parameter-structural neural network

Science.gov (United States)

Mrówczyńska, Maria

2016-06-01

The field of processing information provided by measurement results is one of the most important components of geodetic technologies. The dynamic development of this field improves classic algorithms for numerical calculations in the aspect of analytical solutions that are difficult to achieve. Algorithms based on artificial intelligence in the form of artificial neural networks, including the topology of connections between neurons have become an important instrument connected to the problem of processing and modelling processes. This concept results from the integration of neural networks and parameter optimization methods and makes it possible to avoid the necessity to arbitrarily define the structure of a network. This kind of extension of the training process is exemplified by the algorithm called the Group Method of Data Handling (GMDH), which belongs to the class of evolutionary algorithms. The article presents a GMDH type network, used for modelling deformations of the geometrical axis of a steel chimney during its operation.

Formation and field-driven dynamics of nematic spheroids.

Science.gov (United States)

Fu, Fred; Abukhdeir, Nasser Mohieddin

2017-07-19

Unlike the canonical application of liquid crystals (LCs), LC displays, emerging technologies based on LC materials are increasingly leveraging the presence of nanoscale defects. The inherent nanoscale characteristics of LC defects present both significant opportunities as well as barriers for the application of this fascinating class of materials. Simulation-based approaches to the study of the effects of confinement and interface anchoring conditions on LC domains has resulted in significant progress over the past decade, where simulations are now able to access experimentally-relevant length scales while simultaneously capturing nanoscale defect structures. In this work, continuum simulations were performed in order to study the dynamics of micron-scale nematic LC spheroids of varying shape. Nematic spheroids are one of the simplest inherently defect-containing LC structures and are relevant to polymer-dispersed LC-based "smart" window technology. Simulation results include nematic phase formation and external field-switching dynamics of nematic spheroids ranging in shape from oblate to prolate. Results include both qualitative and quantitative insight into the complex coupling of nanoscale defect dynamics and structure transitions to micron-scale reorientation. Dynamic mechanisms are presented and related to structural transitions in LC defects present in the nematic domain. Domain-averaged metrics including order parameters and response times are determined for a range of experimentally-accessible electric field strengths. These results have both fundamental and technological relevance, in that increased understanding of LC dynamics in the presence of defects is a key barrier to continued advancement in the field.

Fragility in dynamic networks: application to neural networks in the epileptic cortex.

Science.gov (United States)

Sritharan, Duluxan; Sarma, Sridevi V

2014-10-01

Epilepsy is a network phenomenon characterized by atypical activity at the neuronal and population levels during seizures, including tonic spiking, increased heterogeneity in spiking rates, and synchronization. The etiology of epilepsy is unclear, but a common theme among proposed mechanisms is that structural connectivity between neurons is altered. It is hypothesized that epilepsy arises not from random changes in connectivity, but from specific structural changes to the most fragile nodes or neurons in the network. In this letter, the minimum energy perturbation on functional connectivity required to destabilize linear networks is derived. Perturbation results are then applied to a probabilistic nonlinear neural network model that operates at a stable fixed point. That is, if a small stimulus is applied to the network, the activation probabilities of each neuron respond transiently but eventually recover to their baseline values. When the perturbed network is destabilized, the activation probabilities shift to larger or smaller values or oscillate when a small stimulus is applied. Finally, the structural modifications to the neural network that achieve the functional perturbation are derived. Simulations of the unperturbed and perturbed networks qualitatively reflect neuronal activity observed in epilepsy patients, suggesting that the changes in network dynamics due to destabilizing perturbations, including the emergence of an unstable manifold or a stable limit cycle, may be indicative of neuronal or population dynamics during seizure. That is, the epileptic cortex is always on the brink of instability and minute changes in the synaptic weights associated with the most fragile node can suddenly destabilize the network to cause seizures. Finally, the theory developed here and its interpretation of epileptic networks enables the design of a straightforward feedback controller that first detects when the network has destabilized and then applies linear state

Fast-forward of quantum adiabatic dynamics in electro-magnetic field

OpenAIRE

Masuda, Shumpei; Nakamura, Katsuhiro

2010-01-01

We show a method to accelerate quantum adiabatic dynamics of wavefunctions under electro-magnetic field by developing the previous theory (Masuda & Nakamura 2008 and 2010). Firstly we investigate the orbital dynamics of a charged particle. We derive the driving field which accelerates quantum adiabatic dynamics in order to obtain the final adiabatic states except for the spatially uniform phase such as the adiabatic phase in any desired short time. Fast-forward of adiabatic squeezing and tran...

Dynamical Mean Field Approximation Applied to Quantum Field Theory

CERN Document Server

Akerlund, Oscar; Georges, Antoine; Werner, Philipp

2013-12-04

We apply the Dynamical Mean Field (DMFT) approximation to the real, scalar phi^4 quantum field theory. By comparing to lattice Monte Carlo calculations, perturbation theory and standard mean field theory, we test the quality of the approximation in two, three, four and five dimensions. The quantities considered in these tests are the critical coupling for the transition to the ordered phase and the associated critical exponents nu and beta. We also map out the phase diagram in four dimensions. In two and three dimensions, DMFT incorrectly predicts a first order phase transition for all bare quartic couplings, which is problematic, because the second order nature of the phase transition of lattice phi^4-theory is crucial for taking the continuum limit. Nevertheless, by extrapolating the behaviour away from the phase transition, one can obtain critical couplings and critical exponents. They differ from those of mean field theory and are much closer to the correct values. In four dimensions the transition is sec...

Exploring neural cell dynamics with digital holographic microscopy

KAUST Repository

Marquet, Pierre; Depeursinge, Christian D.; Magistretti, Pierre J.

2013-01-01

In this review, we summarize how the new concept of digital optics applied to the field of holographic microscopy has allowed the development of a reliable and flexible digital holographic quantitative phase microscopy (DH-QPM) technique at the nanoscale particularly suitable for cell imaging. Particular emphasis is placed on the original biological ormation provided by the quantitative phase signal. We present the most relevant DH-QPM applications in the field of cell biology, including automated cell counts, recognition, classification, three-dimensional tracking, discrimination between physiological and pathophysiological states, and the study of cell membrane fluctuations at the nanoscale. In the last part, original results show how DH-QPM can address two important issues in the field of neurobiology, namely, multiple-site optical recording of neuronal activity and noninvasive visualization of dendritic spine dynamics resulting from a full digital holographic microscopy tomographic approach. Copyright © 2013 by Annual Reviews.

Exploring neural cell dynamics with digital holographic microscopy

KAUST Repository

Marquet, Pierre

2013-07-11

In this review, we summarize how the new concept of digital optics applied to the field of holographic microscopy has allowed the development of a reliable and flexible digital holographic quantitative phase microscopy (DH-QPM) technique at the nanoscale particularly suitable for cell imaging. Particular emphasis is placed on the original biological ormation provided by the quantitative phase signal. We present the most relevant DH-QPM applications in the field of cell biology, including automated cell counts, recognition, classification, three-dimensional tracking, discrimination between physiological and pathophysiological states, and the study of cell membrane fluctuations at the nanoscale. In the last part, original results show how DH-QPM can address two important issues in the field of neurobiology, namely, multiple-site optical recording of neuronal activity and noninvasive visualization of dendritic spine dynamics resulting from a full digital holographic microscopy tomographic approach. Copyright © 2013 by Annual Reviews.

Effective-field theory for dynamic phase diagrams of the kinetic spin-3/2 Blume–Capel model under a time oscillating longitudinal field

Energy Technology Data Exchange (ETDEWEB)

Ertaş, Mehmet [Department of Physics, Erciyes University, 38039 Kayseri (Turkey); Kocakaplan, Yusuf [Institute of Science, Erciyes University, 38039 Kayseri (Turkey); Keskin, Mustafa, E-mail: keskin@erciyes.edu.tr [Department of Physics, Erciyes University, 38039 Kayseri (Turkey)

2013-12-15

Dynamic phase diagrams are presented for the kinetic spin-3/2 Blume–Capel model under a time oscillating longitudinal field by use of the effective-field theory with correlations. The dynamic equation of the average magnetization is obtained for the square lattice by utilizing the Glauber-type stochastic process. Dynamic phase diagrams are presented in the reduced temperature and the magnetic field amplitude plane. We also investigated the effect of longitudinal field frequency. Finally, the discussion and comparison of the phase diagrams are given. - Highlights: • Dynamic behaviors in the spin-3/2 Blume–Capel system is investigated by the effective-field theory based on the Glauber-type stochastic dynamics. • The dynamic phase transitions and dynamic phase diagrams are obtained. • The effects of the longitudinal field frequency on the dynamic phase diagrams of the system are investigated. • Dynamic phase diagrams exhibit several ordered phases, coexistence phase regions and several critical points as well as a re-entrant behavior.

Effective-field theory for dynamic phase diagrams of the kinetic spin-3/2 Blume–Capel model under a time oscillating longitudinal field

International Nuclear Information System (INIS)

Ertaş, Mehmet; Kocakaplan, Yusuf; Keskin, Mustafa

2013-01-01

Dynamic phase diagrams are presented for the kinetic spin-3/2 Blume–Capel model under a time oscillating longitudinal field by use of the effective-field theory with correlations. The dynamic equation of the average magnetization is obtained for the square lattice by utilizing the Glauber-type stochastic process. Dynamic phase diagrams are presented in the reduced temperature and the magnetic field amplitude plane. We also investigated the effect of longitudinal field frequency. Finally, the discussion and comparison of the phase diagrams are given. - Highlights: • Dynamic behaviors in the spin-3/2 Blume–Capel system is investigated by the effective-field theory based on the Glauber-type stochastic dynamics. • The dynamic phase transitions and dynamic phase diagrams are obtained. • The effects of the longitudinal field frequency on the dynamic phase diagrams of the system are investigated. • Dynamic phase diagrams exhibit several ordered phases, coexistence phase regions and several critical points as well as a re-entrant behavior

Dynamics of dissociation versus ionization in strong laser fields

International Nuclear Information System (INIS)

DiMauro, L.F.; Yang, B.

1993-01-01

In this paper, experimental results are presented which clearly demonstrate the effectiveness that an external field has in altering the dissociation dynamics. The experiment examines the strong-field dissociation dynamics of molecular hydrogen ions and its deuterated isotopes. These studies involve multiphoton excitation in the intensity regime of 10 11-14 W/cm 2 with the fundamental and second harmonic of a ND:YAG or ND:YLF laser system. Measurements include energy resolved electron and mass spectroscopy which provide useful probes in elucidating the interaction dynamics predicted by existing models. The example this in this paper, examines the strong-field dissociation of H 2 + , HD + , and D 2 + at green (0.5 μm) and (1μm) frequencies. The diatomic ions are formed via multiphonon ionization of the neutral precursor which is physically separable from the dissociation process. This study provides the first observation of the dynamics associated with the above threshold dissociation (ATD) process and analogies will be made with the more familiar above threshold ionization (ATI) phenomenon

Molecular Dynamics Simulations with Quantum Mechanics/Molecular Mechanics and Adaptive Neural Networks.

Science.gov (United States)

Shen, Lin; Yang, Weitao

2018-03-13

Direct molecular dynamics (MD) simulation with ab initio quantum mechanical and molecular mechanical (QM/MM) methods is very powerful for studying the mechanism of chemical reactions in a complex environment but also very time-consuming. The computational cost of QM/MM calculations during MD simulations can be reduced significantly using semiempirical QM/MM methods with lower accuracy. To achieve higher accuracy at the ab initio QM/MM level, a correction on the existing semiempirical QM/MM model is an attractive idea. Recently, we reported a neural network (NN) method as QM/MM-NN to predict the potential energy difference between semiempirical and ab initio QM/MM approaches. The high-level results can be obtained using neural network based on semiempirical QM/MM MD simulations, but the lack of direct MD samplings at the ab initio QM/MM level is still a deficiency that limits the applications of QM/MM-NN. In the present paper, we developed a dynamic scheme of QM/MM-NN for direct MD simulations on the NN-predicted potential energy surface to approximate ab initio QM/MM MD. Since some configurations excluded from the database for NN training were encountered during simulations, which may cause some difficulties on MD samplings, an adaptive procedure inspired by the selection scheme reported by Behler [ Behler Int. J. Quantum Chem. 2015 , 115 , 1032 ; Behler Angew. Chem., Int. Ed. 2017 , 56 , 12828 ] was employed with some adaptions to update NN and carry out MD iteratively. We further applied the adaptive QM/MM-NN MD method to the free energy calculation and transition path optimization on chemical reactions in water. The results at the ab initio QM/MM level can be well reproduced using this method after 2-4 iteration cycles. The saving in computational cost is about 2 orders of magnitude. It demonstrates that the QM/MM-NN with direct MD simulations has great potentials not only for the calculation of thermodynamic properties but also for the characterization of

On the origin of reproducible sequential activity in neural circuits

Science.gov (United States)

Afraimovich, V. S.; Zhigulin, V. P.; Rabinovich, M. I.

2004-12-01

Robustness and reproducibility of sequential spatio-temporal responses is an essential feature of many neural circuits in sensory and motor systems of animals. The most common mathematical images of dynamical regimes in neural systems are fixed points, limit cycles, chaotic attractors, and continuous attractors (attractive manifolds of neutrally stable fixed points). These are not suitable for the description of reproducible transient sequential neural dynamics. In this paper we present the concept of a stable heteroclinic sequence (SHS), which is not an attractor. SHS opens the way for understanding and modeling of transient sequential activity in neural circuits. We show that this new mathematical object can be used to describe robust and reproducible sequential neural dynamics. Using the framework of a generalized high-dimensional Lotka-Volterra model, that describes the dynamics of firing rates in an inhibitory network, we present analytical results on the existence of the SHS in the phase space of the network. With the help of numerical simulations we confirm its robustness in presence of noise in spite of the transient nature of the corresponding trajectories. Finally, by referring to several recent neurobiological experiments, we discuss possible applications of this new concept to several problems in neuroscience.

Neural network control of focal position during time-lapse microscopy of cells.

Science.gov (United States)

Wei, Ling; Roberts, Elijah

2018-05-09

Live-cell microscopy is quickly becoming an indispensable technique for studying the dynamics of cellular processes. Maintaining the specimen in focus during image acquisition is crucial for high-throughput applications, especially for long experiments or when a large sample is being continuously scanned. Automated focus control methods are often expensive, imperfect, or ill-adapted to a specific application and are a bottleneck for widespread adoption of high-throughput, live-cell imaging. Here, we demonstrate a neural network approach for automatically maintaining focus during bright-field microscopy. Z-stacks of yeast cells growing in a microfluidic device were collected and used to train a convolutional neural network to classify images according to their z-position. We studied the effect on prediction accuracy of the various hyperparameters of the neural network, including downsampling, batch size, and z-bin resolution. The network was able to predict the z-position of an image with ±1 μm accuracy, outperforming human annotators. Finally, we used our neural network to control microscope focus in real-time during a 24 hour growth experiment. The method robustly maintained the correct focal position compensating for 40 μm of focal drift and was insensitive to changes in the field of view. About ~100 annotated z-stacks were required to train the network making our method quite practical for custom autofocus applications.

Open quantum generalisation of Hopfield neural networks

Science.gov (United States)

Rotondo, P.; Marcuzzi, M.; Garrahan, J. P.; Lesanovsky, I.; Müller, M.

2018-03-01

We propose a new framework to understand how quantum effects may impact on the dynamics of neural networks. We implement the dynamics of neural networks in terms of Markovian open quantum systems, which allows us to treat thermal and quantum coherent effects on the same footing. In particular, we propose an open quantum generalisation of the Hopfield neural network, the simplest toy model of associative memory. We determine its phase diagram and show that quantum fluctuations give rise to a qualitatively new non-equilibrium phase. This novel phase is characterised by limit cycles corresponding to high-dimensional stationary manifolds that may be regarded as a generalisation of storage patterns to the quantum domain.

Event- and Time-Driven Techniques Using Parallel CPU-GPU Co-processing for Spiking Neural Networks.

Science.gov (United States)

Naveros, Francisco; Garrido, Jesus A; Carrillo, Richard R; Ros, Eduardo; Luque, Niceto R

2017-01-01

Modeling and simulating the neural structures which make up our central neural system is instrumental for deciphering the computational neural cues beneath. Higher levels of biological plausibility usually impose higher levels of complexity in mathematical modeling, from neural to behavioral levels. This paper focuses on overcoming the simulation problems (accuracy and performance) derived from using higher levels of mathematical complexity at a neural level. This study proposes different techniques for simulating neural models that hold incremental levels of mathematical complexity: leaky integrate-and-fire (LIF), adaptive exponential integrate-and-fire (AdEx), and Hodgkin-Huxley (HH) neural models (ranged from low to high neural complexity). The studied techniques are classified into two main families depending on how the neural-model dynamic evaluation is computed: the event-driven or the time-driven families. Whilst event-driven techniques pre-compile and store the neural dynamics within look-up tables, time-driven techniques compute the neural dynamics iteratively during the simulation time. We propose two modifications for the event-driven family: a look-up table recombination to better cope with the incremental neural complexity together with a better handling of the synchronous input activity. Regarding the time-driven family, we propose a modification in computing the neural dynamics: the bi-fixed-step integration method. This method automatically adjusts the simulation step size to better cope with the stiffness of the neural model dynamics running in CPU platforms. One version of this method is also implemented for hybrid CPU-GPU platforms. Finally, we analyze how the performance and accuracy of these modifications evolve with increasing levels of neural complexity. We also demonstrate how the proposed modifications which constitute the main contribution of this study systematically outperform the traditional event- and time-driven techniques under

Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity

Science.gov (United States)

Moses, David A.; Mesgarani, Nima; Leonard, Matthew K.; Chang, Edward F.

2016-10-01

Objective. The superior temporal gyrus (STG) and neighboring brain regions play a key role in human language processing. Previous studies have attempted to reconstruct speech information from brain activity in the STG, but few of them incorporate the probabilistic framework and engineering methodology used in modern speech recognition systems. In this work, we describe the initial efforts toward the design of a neural speech recognition (NSR) system that performs continuous phoneme recognition on English stimuli with arbitrary vocabulary sizes using the high gamma band power of local field potentials in the STG and neighboring cortical areas obtained via electrocorticography. Approach. The system implements a Viterbi decoder that incorporates phoneme likelihood estimates from a linear discriminant analysis model and transition probabilities from an n-gram phonemic language model. Grid searches were used in an attempt to determine optimal parameterizations of the feature vectors and Viterbi decoder. Main results. The performance of the system was significantly improved by using spatiotemporal representations of the neural activity (as opposed to purely spatial representations) and by including language modeling and Viterbi decoding in the NSR system. Significance. These results emphasize the importance of modeling the temporal dynamics of neural responses when analyzing their variations with respect to varying stimuli and demonstrate that speech recognition techniques can be successfully leveraged when decoding speech from neural signals. Guided by the results detailed in this work, further development of the NSR system could have applications in the fields of automatic speech recognition and neural prosthetics.

Orbital effect of the magnetic field in dynamical mean-field theory

Science.gov (United States)

Acheche, S.; Arsenault, L.-F.; Tremblay, A.-M. S.

2017-12-01

The availability of large magnetic fields at international facilities and of simulated magnetic fields that can reach the flux-quantum-per-unit-area level in cold atoms calls for systematic studies of orbital effects of the magnetic field on the self-energy of interacting systems. Here we demonstrate theoretically that orbital effects of magnetic fields can be treated within single-site dynamical mean-field theory with a translationally invariant quantum impurity problem. As an example, we study the one-band Hubbard model on the square lattice using iterated perturbation theory as an impurity solver. We recover the expected quantum oscillations in the scattering rate, and we show that the magnetic fields allow the interaction-induced effective mass to be measured through the single-particle density of states accessible in tunneling experiments. The orbital effect of magnetic fields on scattering becomes particularly important in the Hofstadter butterfly regime.

Handwritten dynamics assessment through convolutional neural networks: An application to Parkinson's disease identification.

Science.gov (United States)

Pereira, Clayton R; Pereira, Danilo R; Rosa, Gustavo H; Albuquerque, Victor H C; Weber, Silke A T; Hook, Christian; Papa, João P

2018-04-16

Parkinson's disease (PD) is considered a degenerative disorder that affects the motor system, which may cause tremors, micrography, and the freezing of gait. Although PD is related to the lack of dopamine, the triggering process of its development is not fully understood yet. In this work, we introduce convolutional neural networks to learn features from images produced by handwritten dynamics, which capture different information during the individual's assessment. Additionally, we make available a dataset composed of images and signal-based data to foster the research related to computer-aided PD diagnosis. The proposed approach was compared against raw data and texture-based descriptors, showing suitable results, mainly in the context of early stage detection, with results nearly to 95%. The analysis of handwritten dynamics using deep learning techniques showed to be useful for automatic Parkinson's disease identification, as well as it can outperform handcrafted features. Copyright © 2018 Elsevier B.V. All rights reserved.

Application of cellular neural network (CNN) method to the nuclear reactor dynamics equations

International Nuclear Information System (INIS)

Hadad, K.; Piroozmand, A.

2007-01-01

This paper describes the application of a multilayer cellular neural network (CNN) to model and solve the nuclear reactor dynamic equations. An equivalent electrical circuit is analyzed and the governing equations of a bare, homogeneous reactor core are modeled via CNN. The validity of the CNN result is compared with numerical solution of the system of nonlinear governing partial differential equations (PDE) using MATLAB. Steady state as well as transient simulations, show very good comparison between the two methods. We used our CNN model to simulate space-time response of different reactivity excursions in a typical nuclear reactor. On line solution of reactor dynamic equations is used as an aid to reactor operation decision making. The complete algorithm could also be implemented using very large scale integrated circuit (VLSI) circuitry. The efficiency of the calculation method makes it useful for small size nuclear reactors such as the ones used in space missions

Fixed-time stability of dynamical systems and fixed-time synchronization of coupled discontinuous neural networks.

Science.gov (United States)

Hu, Cheng; Yu, Juan; Chen, Zhanheng; Jiang, Haijun; Huang, Tingwen

2017-05-01

In this paper, the fixed-time stability of dynamical systems and the fixed-time synchronization of coupled discontinuous neural networks are investigated under the framework of Filippov solution. Firstly, by means of reduction to absurdity, a theorem of fixed-time stability is established and a high-precision estimation of the settling-time is given. It is shown by theoretic proof that the estimation bound of the settling time given in this paper is less conservative and more accurate compared with the classical results. Besides, as an important application, the fixed-time synchronization of coupled neural networks with discontinuous activation functions is proposed. By designing a discontinuous control law and using the theory of differential inclusions, some new criteria are derived to ensure the fixed-time synchronization of the addressed coupled networks. Finally, two numerical examples are provided to show the effectiveness and validity of the theoretical results. Copyright © 2017 Elsevier Ltd. All rights reserved.

FEM-based neural-network approach to nonlinear modeling with application to longitudinal vehicle dynamics control.

Science.gov (United States)

Kalkkuhl, J; Hunt, K J; Fritz, H

1999-01-01

An finite-element methods (FEM)-based neural-network approach to Nonlinear AutoRegressive with eXogenous input (NARX) modeling is presented. The method uses multilinear interpolation functions on C0 rectangular elements. The local and global structure of the resulting model is analyzed. It is shown that the model can be interpreted both as a local model network and a single layer feedforward neural network. The main aim is to use the model for nonlinear control design. The proposed FEM NARX description is easily accessible to feedback linearizing control techniques. Its use with a two-degrees of freedom nonlinear internal model controller is discussed. The approach is applied to modeling of the nonlinear longitudinal dynamics of an experimental lorry, using measured data. The modeling results are compared with local model network and multilayer perceptron approaches. A nonlinear speed controller was designed based on the identified FEM model. The controller was implemented in a test vehicle, and several experimental results are presented.

Different propagation speeds of recalled sequences in plastic spiking neural networks

Science.gov (United States)

Huang, Xuhui; Zheng, Zhigang; Hu, Gang; Wu, Si; Rasch, Malte J.

2015-03-01

Neural networks can generate spatiotemporal patterns of spike activity. Sequential activity learning and retrieval have been observed in many brain areas, and e.g. is crucial for coding of episodic memory in the hippocampus or generating temporal patterns during song production in birds. In a recent study, a sequential activity pattern was directly entrained onto the neural activity of the primary visual cortex (V1) of rats and subsequently successfully recalled by a local and transient trigger. It was observed that the speed of activity propagation in coordinates of the retinotopically organized neural tissue was constant during retrieval regardless how the speed of light stimulation sweeping across the visual field during training was varied. It is well known that spike-timing dependent plasticity (STDP) is a potential mechanism for embedding temporal sequences into neural network activity. How training and retrieval speeds relate to each other and how network and learning parameters influence retrieval speeds, however, is not well described. We here theoretically analyze sequential activity learning and retrieval in a recurrent neural network with realistic synaptic short-term dynamics and STDP. Testing multiple STDP rules, we confirm that sequence learning can be achieved by STDP. However, we found that a multiplicative nearest-neighbor (NN) weight update rule generated weight distributions and recall activities that best matched the experiments in V1. Using network simulations and mean-field analysis, we further investigated the learning mechanisms and the influence of network parameters on recall speeds. Our analysis suggests that a multiplicative STDP rule with dominant NN spike interaction might be implemented in V1 since recall speed was almost constant in an NMDA-dominant regime. Interestingly, in an AMPA-dominant regime, neural circuits might exhibit recall speeds that instead follow the change in stimulus speeds. This prediction could be tested in

Neural dynamics of learning sound-action associations.

Directory of Open Access Journals (Sweden)

Adam McNamara

Full Text Available A motor component is pre-requisite to any communicative act as one must inherently move to communicate. To learn to make a communicative act, the brain must be able to dynamically associate arbitrary percepts to the neural substrate underlying the pre-requisite motor activity. We aimed to investigate whether brain regions involved in complex gestures (ventral pre-motor cortex, Brodmann Area 44 were involved in mediating association between novel abstract auditory stimuli and novel gestural movements. In a functional resonance imaging (fMRI study we asked participants to learn associations between previously unrelated novel sounds and meaningless gestures inside the scanner. We use functional connectivity analysis to eliminate the often present confound of 'strategic covert naming' when dealing with BA44 and to rule out effects of non-specific reductions in signal. Brodmann Area 44, a region incorporating Broca's region showed strong, bilateral, negative correlation of BOLD (blood oxygen level dependent response with learning of sound-action associations during data acquisition. Left-inferior-parietal-lobule (l-IPL and bilateral loci in and around visual area V5, right-orbital-frontal-gyrus, right-hippocampus, left-para-hippocampus, right-head-of-caudate, right-insula and left-lingual-gyrus also showed decreases in BOLD response with learning. Concurrent with these decreases in BOLD response, an increasing connectivity between areas of the imaged network as well as the right-middle-frontal-gyrus with rising learning performance was revealed by a psychophysiological interaction (PPI analysis. The increasing connectivity therefore occurs within an increasingly energy efficient network as learning proceeds. Strongest learning related connectivity between regions was found when analysing BA44 and l-IPL seeds. The results clearly show that BA44 and l-IPL is dynamically involved in linking gesture and sound and therefore provides evidence that one of

Modeling the dynamics of the lead bismuth eutectic experimental accelerator driven system by an infinite impulse response locally recurrent neural network

International Nuclear Information System (INIS)

Zio, Enrico; Pedroni, Nicola; Broggi, Matteo; Golea, Lucia Roxana

2009-01-01

In this paper, an infinite impulse response locally recurrent neural network (IIR-LRNN) is employed for modelling the dynamics of the Lead Bismuth Eutectic eXperimental Accelerator Driven System (LBE-XADS). The network is trained by recursive back-propagation (RBP) and its ability in estimating transients is tested under various conditions. The results demonstrate the robustness of the locally recurrent scheme in the reconstruction of complex nonlinear dynamic relationships

String Analysis for Dynamic Field Access

DEFF Research Database (Denmark)

Madsen, Magnus; Andreasen, Esben

2014-01-01

domains to reason about dynamic field access in a static analysis tool. A key feature of the domains is that the equal, concatenate and join operations take Ο(1) time. Experimental evaluation on four common JavaScript libraries, including jQuery and Prototype, shows that traditional string domains...

The brain as a dynamic physical system.

Science.gov (United States)

McKenna, T M; McMullen, T A; Shlesinger, M F

1994-06-01

The brain is a dynamic system that is non-linear at multiple levels of analysis. Characterization of its non-linear dynamics is fundamental to our understanding of brain function. Identifying families of attractors in phase space analysis, an approach which has proven valuable in describing non-linear mechanical and electrical systems, can prove valuable in describing a range of behaviors and associated neural activity including sensory and motor repertoires. Additionally, transitions between attractors may serve as useful descriptors for analysing state changes in neurons and neural ensembles. Recent observations of synchronous neural activity, and the emerging capability to record the spatiotemporal dynamics of neural activity by voltage-sensitive dyes and electrode arrays, provide opportunities for observing the population dynamics of neural ensembles within a dynamic systems context. New developments in the experimental physics of complex systems, such as the control of chaotic systems, selection of attractors, attractor switching and transient states, can be a source of powerful new analytical tools and insights into the dynamics of neural systems.

Diagonalization of propagators in thermo field dynamics for relativistic quantum fields

International Nuclear Information System (INIS)

Henning, P.A.; Umezawa, H.

1992-09-01

Two-point functions for interacting quantum fields in statistical systems can be diagnolized by matrix transformations. It is shown, that within the framework of time-dependent Thermo Field Dynamics this diagonalization can be understood as a thermal Bogoliubov transformation to non-interacting statistical quasi-particles. The condition for their unperturbed propagation relates these states to the thermodynamic properties of the system: It requires global equilibrium for stationary situations, or specifies the time evolution according to a kinetic equation. (orig.)

Passivation and control of partially known SISO nonlinear systems via dynamic neural networks

Directory of Open Access Journals (Sweden)

Reyes-Reyes J.

2000-01-01

Full Text Available In this paper, an adaptive technique is suggested to provide the passivity property for a class of partially known SISO nonlinear systems. A simple Dynamic Neural Network (DNN, containing only two neurons and without any hidden-layers, is used to identify the unknown nonlinear system. By means of a Lyapunov-like analysis the new learning law for this DNN, guarantying both successful identification and passivation effects, is derived. Based on this adaptive DNN model, an adaptive feedback controller, serving for wide class of nonlinear systems with an a priori incomplete model description, is designed. Two typical examples illustrate the effectiveness of the suggested approach.

Dynamically important magnetic fields near accreting supermassive black holes.

Science.gov (United States)

Zamaninasab, M; Clausen-Brown, E; Savolainen, T; Tchekhovskoy, A

2014-06-05

Accreting supermassive black holes at the centres of active galaxies often produce 'jets'--collimated bipolar outflows of relativistic particles. Magnetic fields probably play a critical role in jet formation and in accretion disk physics. A dynamically important magnetic field was recently found near the Galactic Centre black hole. If this is common and if the field continues to near the black hole event horizon, disk structures will be affected, invalidating assumptions made in standard models. Here we report that jet magnetic field and accretion disk luminosity are tightly correlated over seven orders of magnitude for a sample of 76 radio-loud active galaxies. We conclude that the jet-launching regions of these radio-loud galaxies are threaded by dynamically important fields, which will affect the disk properties. These fields obstruct gas infall, compress the accretion disk vertically, slow down the disk rotation by carrying away its angular momentum in an outflow and determine the directionality of jets.

Steering Micro-Robotic Swarm by Dynamic Actuating Fields

NARCIS (Netherlands)

Chao, Q.; Yu, J; Dai, C.; Xu, T; Zhang, L.; Wang, C.C.; Jin, X.

2016-01-01

We present a general solution for steering microrobotic
swarm by dynamic actuating fields. In our approach, the
motion of micro-robots is controlled by changing the actuating
direction of a field applied to them. The time-series sequence
of actuating field’s directions can be

The relativistic mean-field description of nuclei and nuclear dynamics

International Nuclear Information System (INIS)

Reinhard, P.G.

1989-01-01

The relativistic mean-field model of the nucleus is reviewed. It describes the nucleus as a system of Dirac-Nucleons which interact in a relativistic covariant manner via meson fields. The meson fields are treated as mean fields, i.e. as non quantal c-number fields. The effects of the Dirac sea of the nucleons is neglected. The model is interpreted as a phenomenological ansatz providing a selfconsistent relativistic description of nuclei and nuclear dynamics. It is viewed, so to say, as the relativistic generalisation of the Skyrme-Hartree-Fock ansatz. The capability and the limitations of the model to describe nuclear properties are discussed. Recent applications to spherical and deformed nuclei and to nuclear dynamics are presented. (orig.)

Dynamic polarizability of a complex atom in strong laser fields

International Nuclear Information System (INIS)

Rapoport, L.P.; Klinskikh, A.F.; Mordvinov, V.V.

1997-01-01

An asymptotic expansion of the dynamic polarizability of a complex atom in a strong circularly polarized light field is found for the case of high frequencies. The self-consistent approximation of the Hartree-Fock type for the ''atom+field'' system is developed, within the framework of which a numerical calculation of the dynamic polarizability of Ne, Kr, and Ar atoms in a strong radiation field is performed. The strong field effect is shown to manifest itself not only in a change of the energy spectrum and the character of behavior of the wave functions of atomic electrons, but also in a modification of the one-electron self-consistent potential for the atom in the field

An Event-Driven Classifier for Spiking Neural Networks Fed with Synthetic or Dynamic Vision Sensor Data

Directory of Open Access Journals (Sweden)

Evangelos Stromatias

2017-06-01

Full Text Available This paper introduces a novel methodology for training an event-driven classifier within a Spiking Neural Network (SNN System capable of yielding good classification results when using both synthetic input data and real data captured from Dynamic Vision Sensor (DVS chips. The proposed supervised method uses the spiking activity provided by an arbitrary topology of prior SNN layers to build histograms and train the classifier in the frame domain using the stochastic gradient descent algorithm. In addition, this approach can cope with leaky integrate-and-fire neuron models within the SNN, a desirable feature for real-world SNN applications, where neural activation must fade away after some time in the absence of inputs. Consequently, this way of building histograms captures the dynamics of spikes immediately before the classifier. We tested our method on the MNIST data set using different synthetic encodings and real DVS sensory data sets such as N-MNIST, MNIST-DVS, and Poker-DVS using the same network topology and feature maps. We demonstrate the effectiveness of our approach by achieving the highest classification accuracy reported on the N-MNIST (97.77% and Poker-DVS (100% real DVS data sets to date with a spiking convolutional network. Moreover, by using the proposed method we were able to retrain the output layer of a previously reported spiking neural network and increase its performance by 2%, suggesting that the proposed classifier can be used as the output layer in works where features are extracted using unsupervised spike-based learning methods. In addition, we also analyze SNN performance figures such as total event activity and network latencies, which are relevant for eventual hardware implementations. In summary, the paper aggregates unsupervised-trained SNNs with a supervised-trained SNN classifier, combining and applying them to heterogeneous sets of benchmarks, both synthetic and from real DVS chips.

An Event-Driven Classifier for Spiking Neural Networks Fed with Synthetic or Dynamic Vision Sensor Data.

Science.gov (United States)

Stromatias, Evangelos; Soto, Miguel; Serrano-Gotarredona, Teresa; Linares-Barranco, Bernabé

2017-01-01

This paper introduces a novel methodology for training an event-driven classifier within a Spiking Neural Network (SNN) System capable of yielding good classification results when using both synthetic input data and real data captured from Dynamic Vision Sensor (DVS) chips. The proposed supervised method uses the spiking activity provided by an arbitrary topology of prior SNN layers to build histograms and train the classifier in the frame domain using the stochastic gradient descent algorithm. In addition, this approach can cope with leaky integrate-and-fire neuron models within the SNN, a desirable feature for real-world SNN applications, where neural activation must fade away after some time in the absence of inputs. Consequently, this way of building histograms captures the dynamics of spikes immediately before the classifier. We tested our method on the MNIST data set using different synthetic encodings and real DVS sensory data sets such as N-MNIST, MNIST-DVS, and Poker-DVS using the same network topology and feature maps. We demonstrate the effectiveness of our approach by achieving the highest classification accuracy reported on the N-MNIST (97.77%) and Poker-DVS (100%) real DVS data sets to date with a spiking convolutional network. Moreover, by using the proposed method we were able to retrain the output layer of a previously reported spiking neural network and increase its performance by 2%, suggesting that the proposed classifier can be used as the output layer in works where features are extracted using unsupervised spike-based learning methods. In addition, we also analyze SNN performance figures such as total event activity and network latencies, which are relevant for eventual hardware implementations. In summary, the paper aggregates unsupervised-trained SNNs with a supervised-trained SNN classifier, combining and applying them to heterogeneous sets of benchmarks, both synthetic and from real DVS chips.

Dynamic Skin Patterns in Cephalopods

Directory of Open Access Journals (Sweden)

Martin J. How

2017-06-01

Full Text Available Cephalopods are unrivaled in the natural world in their ability to alter their visual appearance. These mollusks have evolved a complex system of dermal units under neural, hormonal, and muscular control to produce an astonishing variety of body patterns. With parallels to the pixels on a television screen, cephalopod chromatophores can be coordinated to produce dramatic, dynamic, and rhythmic displays, defined collectively here as “dynamic patterns.” This study examines the nature, context, and potential functions of dynamic patterns across diverse cephalopod taxa. Examples are presented for 21 species, including 11 previously unreported in the scientific literature. These range from simple flashing or flickering patterns, to highly complex passing wave patterns involving multiple skin fields.

Dynamic Skin Patterns in Cephalopods

Science.gov (United States)

How, Martin J.; Norman, Mark D.; Finn, Julian; Chung, Wen-Sung; Marshall, N. Justin

2017-01-01

Cephalopods are unrivaled in the natural world in their ability to alter their visual appearance. These mollusks have evolved a complex system of dermal units under neural, hormonal, and muscular control to produce an astonishing variety of body patterns. With parallels to the pixels on a television screen, cephalopod chromatophores can be coordinated to produce dramatic, dynamic, and rhythmic displays, defined collectively here as “dynamic patterns.” This study examines the nature, context, and potential functions of dynamic patterns across diverse cephalopod taxa. Examples are presented for 21 species, including 11 previously unreported in the scientific literature. These range from simple flashing or flickering patterns, to highly complex passing wave patterns involving multiple skin fields. PMID:28674500

Towards a theory of cortical columns: From spiking neurons to interacting neural populations of finite size