WorldWideScience

Sample records for nonlinear continuous neural

  1. Neural-Fuzzy Digital Strategy of Continuous-Time Nonlinear Systems Using Adaptive Prediction and Random-Local-Optimization Design

    Directory of Open Access Journals (Sweden)

    Zhi-Ren Tsai

    2013-01-01

    Full Text Available A tracking problem, time-delay, uncertainty and stability analysis of a predictive control system are considered. The predictive control design is based on the input and output of neural plant model (NPM, and a recursive fuzzy predictive tracker has scaling factors which limit the value zone of measured data and cause the tuned parameters to converge to obtain a robust control performance. To improve the further control performance, the proposed random-local-optimization design (RLO for a model/controller uses offline initialization to obtain a near global optimal model/controller. Other issues are the considerations of modeling error, input-delay, sampling distortion, cost, greater flexibility, and highly reliable digital products of the model-based controller for the continuous-time (CT nonlinear system. They are solved by a recommended two-stage control design with the first-stage (offline RLO and second-stage (online adaptive steps. A theorizing method is then put forward to replace the sensitivity calculation, which reduces the calculation of Jacobin matrices of the back-propagation (BP method. Finally, the feedforward input of reference signals helps the digital fuzzy controller improve the control performance, and the technique works to control the CT systems precisely.

  2. Neural networks in continuous optical media

    International Nuclear Information System (INIS)

    Anderson, D.Z.

    1987-01-01

    The authors' interest is to see to what extent neural models can be implemented using continuous optical elements. Thus these optical networks represent a continuous distribution of neuronlike processors rather than a discrete collection. Most neural models have three characteristic features: interconnections; adaptivity; and nonlinearity. In their optical representation the interconnections are implemented with linear one- and two-port optical elements such as lenses and holograms. Real-time holographic media allow these interconnections to become adaptive. The nonlinearity is achieved with gain, for example, from two-beam coupling in photorefractive media or a pumped dye medium. Using these basic optical elements one can in principle construct continuous representations of a number of neural network models. The authors demonstrated two devices based on continuous optical elements: an associative memory which recalls an entire object when addressed with a partial object and a tracking novelty filter which identifies time-dependent features in an optical scene. These devices demonstrate the potential of distributed optical elements to implement more formal models of neural networks

  3. Neural Networks for Non-linear Control

    DEFF Research Database (Denmark)

    Sørensen, O.

    1994-01-01

    This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process.......This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process....

  4. Stability analysis of embedded nonlinear predictor neural generalized predictive controller

    Directory of Open Access Journals (Sweden)

    Hesham F. Abdel Ghaffar

    2014-03-01

    Full Text Available Nonlinear Predictor-Neural Generalized Predictive Controller (NGPC is one of the most advanced control techniques that are used with severe nonlinear processes. In this paper, a hybrid solution from NGPC and Internal Model Principle (IMP is implemented to stabilize nonlinear, non-minimum phase, variable dead time processes under high disturbance values over wide range of operation. Also, the superiority of NGPC over linear predictive controllers, like GPC, is proved for severe nonlinear processes over wide range of operation. The necessary conditions required to stabilize NGPC is derived using Lyapunov stability analysis for nonlinear processes. The NGPC stability conditions and improvement in disturbance suppression are verified by both simulation using Duffing’s nonlinear equation and real-time using continuous stirred tank reactor. Up to our knowledge, the paper offers the first hardware embedded Neural GPC which has been utilized to verify NGPC–IMP improvement in realtime.

  5. Feedforward Nonlinear Control Using Neural Gas Network

    OpenAIRE

    Machón-González, Iván; López-García, Hilario

    2017-01-01

    Nonlinear systems control is a main issue in control theory. Many developed applications suffer from a mathematical foundation not as general as the theory of linear systems. This paper proposes a control strategy of nonlinear systems with unknown dynamics by means of a set of local linear models obtained by a supervised neural gas network. The proposed approach takes advantage of the neural gas feature by which the algorithm yields a very robust clustering procedure. The direct model of the ...

  6. Nonlinear programming with feedforward neural networks.

    Energy Technology Data Exchange (ETDEWEB)

    Reifman, J.

    1999-06-02

    We provide a practical and effective method for solving constrained optimization problems by successively training a multilayer feedforward neural network in a coupled neural-network/objective-function representation. Nonlinear programming problems are easily mapped into this representation which has a simpler and more transparent method of solution than optimization performed with Hopfield-like networks and poses very mild requirements on the functions appearing in the problem. Simulation results are illustrated and compared with an off-the-shelf optimization tool.

  7. Feedforward Nonlinear Control Using Neural Gas Network

    Directory of Open Access Journals (Sweden)

    Iván Machón-González

    2017-01-01

    Full Text Available Nonlinear systems control is a main issue in control theory. Many developed applications suffer from a mathematical foundation not as general as the theory of linear systems. This paper proposes a control strategy of nonlinear systems with unknown dynamics by means of a set of local linear models obtained by a supervised neural gas network. The proposed approach takes advantage of the neural gas feature by which the algorithm yields a very robust clustering procedure. The direct model of the plant constitutes a piece-wise linear approximation of the nonlinear system and each neuron represents a local linear model for which a linear controller is designed. The neural gas model works as an observer and a controller at the same time. A state feedback control is implemented by estimation of the state variables based on the local transfer function that was provided by the local linear model. The gradient vectors obtained by the supervised neural gas algorithm provide a robust procedure for feedforward nonlinear control, that is, supposing the inexistence of disturbances.

  8. A Recurrent Neural Network for Nonlinear Fractional Programming

    Directory of Open Access Journals (Sweden)

    Quan-Ju Zhang

    2012-01-01

    Full Text Available This paper presents a novel recurrent time continuous neural network model which performs nonlinear fractional optimization subject to interval constraints on each of the optimization variables. The network is proved to be complete in the sense that the set of optima of the objective function to be minimized with interval constraints coincides with the set of equilibria of the neural network. It is also shown that the network is primal and globally convergent in the sense that its trajectory cannot escape from the feasible region and will converge to an exact optimal solution for any initial point being chosen in the feasible interval region. Simulation results are given to demonstrate further the global convergence and good performance of the proposing neural network for nonlinear fractional programming problems with interval constraints.

  9. Continuous variable tripartite entanglement from twin nonlinearities

    International Nuclear Information System (INIS)

    Olsen, M K; Bradley, A S

    2006-01-01

    In this work, we analyse and compare the continuous variable tripartite entanglement available from the use of two concurrent or cascaded χ (2) nonlinearities. We examine both idealized travelling-wave models and more experimentally realistic intracavity models, showing that tripartite entangled outputs are readily producible. These may be a useful resource for applications such as quantum cryptography and teleportation

  10. Identification of Non-Linear Structures using Recurrent Neural Networks

    DEFF Research Database (Denmark)

    Kirkegaard, Poul Henning; Nielsen, Søren R. K.; Hansen, H. I.

    Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure.......Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure....

  11. Identification of Non-Linear Structures using Recurrent Neural Networks

    DEFF Research Database (Denmark)

    Kirkegaard, Poul Henning; Nielsen, Søren R. K.; Hansen, H. I.

    1995-01-01

    Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure.......Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure....

  12. Adaptive Neural Control for a Class of Outputs Time-Delay Nonlinear Systems

    Directory of Open Access Journals (Sweden)

    Ruliang Wang

    2012-01-01

    Full Text Available This paper considers an adaptive neural control for a class of outputs time-delay nonlinear systems with perturbed or no. Based on RBF neural networks, the radius basis function (RBF neural networks is employed to estimate the unknown continuous functions. The proposed control guarantees that all closed-loop signals remain bounded. The simulation results demonstrate the effectiveness of the proposed control scheme.

  13. Nonlinear control strategy based on using a shape-tunable neural controller

    Energy Technology Data Exchange (ETDEWEB)

    Chen, C.; Peng, S. [Feng Chia Univ, Taichung (Taiwan, Province of China). Department of chemical Engineering; Chang, W. [Feng Chia Univ, Taichung (Taiwan, Province of China). Department of Automatic Control

    1997-08-01

    In this paper, a nonlinear control strategy based on using a shape-tunable neural network is developed for adaptive control of nonlinear processes. Based on the steepest descent method, a learning algorithm that enables the neural controller to possess the ability of automatic controller output range adjustment is derived. The novel feature of automatic output range adjustment provides the neural controller more flexibility and capability, and therefore the scaling procedure, which is usually unavoidable for the conventional fixed-shape neural controllers, becomes unnecessary. The advantages and effectiveness of the proposed nonlinear control strategy are demonstrated through the challenge problem of controlling an open-loop unstable nonlinear continuous stirred tank reactor (CSTR). 14 refs., 11 figs.

  14. Finite time convergent learning law for continuous neural networks.

    Science.gov (United States)

    Chairez, Isaac

    2014-02-01

    This paper addresses the design of a discontinuous finite time convergent learning law for neural networks with continuous dynamics. The neural network was used here to obtain a non-parametric model for uncertain systems described by a set of ordinary differential equations. The source of uncertainties was the presence of some external perturbations and poor knowledge of the nonlinear function describing the system dynamics. A new adaptive algorithm based on discontinuous algorithms was used to adjust the weights of the neural network. The adaptive algorithm was derived by means of a non-standard Lyapunov function that is lower semi-continuous and differentiable in almost the whole space. A compensator term was included in the identifier to reject some specific perturbations using a nonlinear robust algorithm. Two numerical examples demonstrated the improvements achieved by the learning algorithm introduced in this paper compared to classical schemes with continuous learning methods. The first one dealt with a benchmark problem used in the paper to explain how the discontinuous learning law works. The second one used the methane production model to show the benefits in engineering applications of the learning law proposed in this paper. Copyright © 2013 Elsevier Ltd. All rights reserved.

  15. Nonlinear adaptive inverse control via the unified model neural network

    Science.gov (United States)

    Jeng, Jin-Tsong; Lee, Tsu-Tian

    1999-03-01

    In this paper, we propose a new nonlinear adaptive inverse control via a unified model neural network. In order to overcome nonsystematic design and long training time in nonlinear adaptive inverse control, we propose the approximate transformable technique to obtain a Chebyshev Polynomials Based Unified Model (CPBUM) neural network for the feedforward/recurrent neural networks. It turns out that the proposed method can use less training time to get an inverse model. Finally, we apply this proposed method to control magnetic bearing system. The experimental results show that the proposed nonlinear adaptive inverse control architecture provides a greater flexibility and better performance in controlling magnetic bearing systems.

  16. Continual Learning through Evolvable Neural Turing Machines

    DEFF Research Database (Denmark)

    Lüders, Benno; Schläger, Mikkel; Risi, Sebastian

    2016-01-01

    Continual learning, i.e. the ability to sequentially learn tasks without catastrophic forgetting of previously learned ones, is an important open challenge in machine learning. In this paper we take a step in this direction by showing that the recently proposed Evolving Neural Turing Machine (ENTM...

  17. Nonlinear signal processing using neural networks: Prediction and system modelling

    Energy Technology Data Exchange (ETDEWEB)

    Lapedes, A.; Farber, R.

    1987-06-01

    The backpropagation learning algorithm for neural networks is developed into a formalism for nonlinear signal processing. We illustrate the method by selecting two common topics in signal processing, prediction and system modelling, and show that nonlinear applications can be handled extremely well by using neural networks. The formalism is a natural, nonlinear extension of the linear Least Mean Squares algorithm commonly used in adaptive signal processing. Simulations are presented that document the additional performance achieved by using nonlinear neural networks. First, we demonstrate that the formalism may be used to predict points in a highly chaotic time series with orders of magnitude increase in accuracy over conventional methods including the Linear Predictive Method and the Gabor-Volterra-Weiner Polynomial Method. Deterministic chaos is thought to be involved in many physical situations including the onset of turbulence in fluids, chemical reactions and plasma physics. Secondly, we demonstrate the use of the formalism in nonlinear system modelling by providing a graphic example in which it is clear that the neural network has accurately modelled the nonlinear transfer function. It is interesting to note that the formalism provides explicit, analytic, global, approximations to the nonlinear maps underlying the various time series. Furthermore, the neural net seems to be extremely parsimonious in its requirements for data points from the time series. We show that the neural net is able to perform well because it globally approximates the relevant maps by performing a kind of generalized mode decomposition of the maps. 24 refs., 13 figs.

  18. Simulation of nonlinear random vibrations using artificial neural networks

    Energy Technology Data Exchange (ETDEWEB)

    Paez, T.L.; Tucker, S.; O`Gorman, C.

    1997-02-01

    The simulation of mechanical system random vibrations is important in structural dynamics, but it is particularly difficult when the system under consideration is nonlinear. Artificial neural networks provide a useful tool for the modeling of nonlinear systems, however, such modeling may be inefficient or insufficiently accurate when the system under consideration is complex. This paper shows that there are several transformations that can be used to uncouple and simplify the components of motion of a complex nonlinear system, thereby making its modeling and random vibration simulation, via component modeling with artificial neural networks, a much simpler problem. A numerical example is presented.

  19. Adaptive nonlinear control using input normalized neural networks

    International Nuclear Information System (INIS)

    Leeghim, Henzeh; Seo, In Ho; Bang, Hyo Choong

    2008-01-01

    An adaptive feedback linearization technique combined with the neural network is addressed to control uncertain nonlinear systems. The neural network-based adaptive control theory has been widely studied. However, the stability analysis of the closed-loop system with the neural network is rather complicated and difficult to understand, and sometimes unnecessary assumptions are involved. As a result, unnecessary assumptions for stability analysis are avoided by using the neural network with input normalization technique. The ultimate boundedness of the tracking error is simply proved by the Lyapunov stability theory. A new simple update law as an adaptive nonlinear control is derived by the simplification of the input normalized neural network assuming the variation of the uncertain term is sufficiently small

  20. Neural correlates of continuous causal word generation.

    Science.gov (United States)

    Wende, Kim C; Straube, Benjamin; Stratmann, Mirjam; Sommer, Jens; Kircher, Tilo; Nagels, Arne

    2012-09-01

    Causality provides a natural structure for organizing our experience and language. Causal reasoning during speech production is a distinct aspect of verbal communication, whose related brain processes are yet unknown. The aim of the current study was to investigate the neural mechanisms underlying the continuous generation of cause-and-effect coherences during overt word production. During fMRI data acquisition participants performed three verbal fluency tasks on identical cue words: A novel causal verbal fluency task (CVF), requiring the production of multiple reasons to a given cue word (e.g. reasons for heat are fire, sun etc.), a semantic (free association, FA, e.g. associations with heat are sweat, shower etc.) and a phonological control task (phonological verbal fluency, PVF, e.g. rhymes with heat are meat, wheat etc.). We found that, in contrast to PVF, both CVF and FA activated a left lateralized network encompassing inferior frontal, inferior parietal and angular regions, with further bilateral activation in middle and inferior as well as superior temporal gyri and the cerebellum. For CVF contrasted against FA, we found greater bold responses only in the left middle frontal cortex. Large overlaps in the neural activations during free association and causal verbal fluency indicate that the access to causal relationships between verbal concepts is at least partly based on the semantic neural network. The selective activation in the left middle frontal cortex for causal verbal fluency suggests that distinct neural processes related to cause-and-effect-relations are associated with the recruitment of middle frontal brain areas. Copyright © 2012 Elsevier Inc. All rights reserved.

  1. Nonlinear dynamical system approaches towards neural prosthesis

    International Nuclear Information System (INIS)

    Torikai, Hiroyuki; Hashimoto, Sho

    2011-01-01

    An asynchronous discrete-state spiking neurons is a wired system of shift registers that can mimic nonlinear dynamics of an ODE-based neuron model. The control parameter of the neuron is the wiring pattern among the registers and thus they are suitable for on-chip learning. In this paper an asynchronous discrete-state spiking neuron is introduced and its typical nonlinear phenomena are demonstrated. Also, a learning algorithm for a set of neurons is presented and it is demonstrated that the algorithm enables the set of neurons to reconstruct nonlinear dynamics of another set of neurons with unknown parameter values. The learning function is validated by FPGA experiments.

  2. Nonlinear seismic analysis of continuous RC bridge

    Directory of Open Access Journals (Sweden)

    Čokić Miloš M.

    2017-01-01

    Full Text Available Nonlinear static analysis, known as a pushover method (NSPA is oftenly used to study the behaviour of a bridge structure under the seismic action. It is shown that the Equivalent Linearization Method - ELM, recommended in FEMA 440, is appropriate for the response analysis of the bridge columns, with different geometric characteristics, quantity and distribution of steel reinforcement. The subject of analysis is a bridge structure with a carriageway plate - a continuous beam with three spans, with the 24 + 40 + 24 m range. Main girder is made of prestressed concrete and it has a box cross section of a constant height. It is important to study the behaviour, not only in the transverse, but also in the longitudinal direction of the bridge axis, when analysing the bridge columns exposed to horizontal seismic actions. The columns were designed according to EN1992, parts 1 and 2. Seismic action analysis is conducted according to EN 1998: 2004 standard. Response spectrum type 1, for the ground type B, was applied and the analysis also includes 20% of traffic load. The analysis includes the values of columns displacement and ductility. To describe the behaviour of elements under the earthquake action in both - longitudinal and transverse direction, pushover curves were formed.

  3. Dynamics of neural networks with continuous attractors

    Science.gov (United States)

    Fung, C. C. Alan; Wong, K. Y. Michael; Wu, Si

    2008-10-01

    We investigate the dynamics of continuous attractor neural networks (CANNs). Due to the translational invariance of their neuronal interactions, CANNs can hold a continuous family of stationary states. We systematically explore how their neutral stability facilitates the tracking performance of a CANN, which is believed to have wide applications in brain functions. We develop a perturbative approach that utilizes the dominant movement of the network stationary states in the state space. We quantify the distortions of the bump shape during tracking, and study their effects on the tracking performance. Results are obtained on the maximum speed for a moving stimulus to be trackable, and the reaction time to catch up an abrupt change in stimulus.

  4. Distributed Adaptive Neural Control for Stochastic Nonlinear Multiagent Systems.

    Science.gov (United States)

    Wang, Fang; Chen, Bing; Lin, Chong; Li, Xuehua

    2016-11-14

    In this paper, a consensus tracking problem of nonlinear multiagent systems is investigated under a directed communication topology. All the followers are modeled by stochastic nonlinear systems in nonstrict feedback form, where nonlinearities and stochastic disturbance terms are totally unknown. Based on the structural characteristic of neural networks (in Lemma 4), a novel distributed adaptive neural control scheme is put forward. The raised control method not only effectively handles unknown nonlinearities in nonstrict feedback systems, but also copes with the interactions among agents and coupling terms. Based on the stochastic Lyapunov functional method, it is indicated that all the signals of the closed-loop system are bounded in probability and all followers' outputs are convergent to a neighborhood of the output of leader. At last, the efficiency of the control method is testified by a numerical example.

  5. Implementation of neural network based non-linear predictive

    DEFF Research Database (Denmark)

    Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole

    1998-01-01

    The paper describes a control method for non-linear systems based on generalized predictive control. Generalized predictive control (GPC) was developed to control linear systems including open loop unstable and non-minimum phase systems, but has also been proposed extended for the control of non......-linear systems. GPC is model-based and in this paper we propose the use of a neural network for the modeling of the system. Based on the neural network model a controller with extended control horizon is developed and the implementation issues are discussed, with particular emphasis on an efficient Quasi......-Newton optimization algorithm. The performance is demonstrated on a pneumatic servo system....

  6. Nonlinear Time Series Analysis via Neural Networks

    Science.gov (United States)

    Volná, Eva; Janošek, Michal; Kocian, Václav; Kotyrba, Martin

    This article deals with a time series analysis based on neural networks in order to make an effective forex market [Moore and Roche, J. Int. Econ. 58, 387-411 (2002)] pattern recognition. Our goal is to find and recognize important patterns which repeatedly appear in the market history to adapt our trading system behaviour based on them.

  7. Neural Generalized Predictive Control of a non-linear Process

    DEFF Research Database (Denmark)

    Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole

    1998-01-01

    The use of neural network in non-linear control is made difficult by the fact the stability and robustness is not guaranteed and that the implementation in real time is non-trivial. In this paper we introduce a predictive controller based on a neural network model which has promising stability qu...... detail and discuss the implementation difficulties. The neural generalized predictive controller is tested on a pneumatic servo sys-tem.......The use of neural network in non-linear control is made difficult by the fact the stability and robustness is not guaranteed and that the implementation in real time is non-trivial. In this paper we introduce a predictive controller based on a neural network model which has promising stability...... qualities. The controller is a non-linear version of the well-known generalized predictive controller developed in linear control theory. It involves minimization of a cost function which in the present case has to be done numerically. Therefore, we develop the numerical algorithms necessary in substantial...

  8. NONLINEAR PLANT PIECEWISE-CONTINUOUS MODEL MATRIX PARAMETERS ESTIMATION

    Directory of Open Access Journals (Sweden)

    Roman L. Leibov

    2017-09-01

    Full Text Available This paper presents a nonlinear plant piecewise-continuous model matrix parameters estimation technique using nonlinear model time responses and random search method. One of piecewise-continuous model application areas is defined. The results of proposed approach application for aircraft turbofan engine piecewisecontinuous model formation are presented

  9. Solution of continuous nonlinear PDEs through order completion

    CERN Document Server

    Oberguggenberger, MB

    1994-01-01

    This work inaugurates a new and general solution method for arbitrary continuous nonlinear PDEs. The solution method is based on Dedekind order completion of usual spaces of smooth functions defined on domains in Euclidean spaces. However, the nonlinear PDEs dealt with need not satisfy any kind of monotonicity properties. Moreover, the solution method is completely type independent. In other words, it does not assume anything about the nonlinear PDEs, except for the continuity of their left hand term, which includes the unkown function. Furthermore the right hand term of such nonlinear PDEs can in fact be given any discontinuous and measurable function.

  10. Bio-inspired spiking neural network for nonlinear systems control.

    Science.gov (United States)

    Pérez, Javier; Cabrera, Juan A; Castillo, Juan J; Velasco, Juan M

    2018-08-01

    Spiking neural networks (SNN) are the third generation of artificial neural networks. SNN are the closest approximation to biological neural networks. SNNs make use of temporal spike trains to command inputs and outputs, allowing a faster and more complex computation. As demonstrated by biological organisms, they are a potentially good approach to designing controllers for highly nonlinear dynamic systems in which the performance of controllers developed by conventional techniques is not satisfactory or difficult to implement. SNN-based controllers exploit their ability for online learning and self-adaptation to evolve when transferred from simulations to the real world. SNN's inherent binary and temporary way of information codification facilitates their hardware implementation compared to analog neurons. Biological neural networks often require a lower number of neurons compared to other controllers based on artificial neural networks. In this work, these neuronal systems are imitated to perform the control of non-linear dynamic systems. For this purpose, a control structure based on spiking neural networks has been designed. Particular attention has been paid to optimizing the structure and size of the neural network. The proposed structure is able to control dynamic systems with a reduced number of neurons and connections. A supervised learning process using evolutionary algorithms has been carried out to perform controller training. The efficiency of the proposed network has been verified in two examples of dynamic systems control. Simulations show that the proposed control based on SNN exhibits superior performance compared to other approaches based on Neural Networks and SNNs. Copyright © 2018 Elsevier Ltd. All rights reserved.

  11. Nonlinear analysis and control of a continuous fermentation process

    DEFF Research Database (Denmark)

    Szederkényi, G.; Kristensen, Niels Rode; Hangos, K.M

    2002-01-01

    Different types of nonlinear controllers are designed and compared for a simple continuous bioreactor operating near optimal productivity. This operating point is located close to a fold bifurcation point. Nonlinear analysis of stability, controllability and zero dynamics is used to investigate o...... are recommended for the simple fermenter. Passivity based controllers have been found to be globally stable, not very sensitive to the uncertainties in the reaction rate and controller parameter but they require full nonlinear state feedback....

  12. Non-linear feedback neural networks VLSI implementations and applications

    CERN Document Server

    Ansari, Mohd Samar

    2014-01-01

    This book aims to present a viable alternative to the Hopfield Neural Network (HNN) model for analog computation. It is well known that the standard HNN suffers from problems of convergence to local minima, and requirement of a large number of neurons and synaptic weights. Therefore, improved solutions are needed. The non-linear synapse neural network (NoSyNN) is one such possibility and is discussed in detail in this book. This book also discusses the applications in computationally intensive tasks like graph coloring, ranking, and linear as well as quadratic programming. The material in the book is useful to students, researchers and academician working in the area of analog computation.

  13. Implementation of neural network based non-linear predictive control

    DEFF Research Database (Denmark)

    Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole

    1999-01-01

    This paper describes a control method for non-linear systems based on generalized predictive control. Generalized predictive control (GPC) was developed to control linear systems, including open-loop unstable and non-minimum phase systems, but has also been proposed to be extended for the control...... of non-linear systems. GPC is model based and in this paper we propose the use of a neural network for the modeling of the system. Based on the neural network model, a controller with extended control horizon is developed and the implementation issues are discussed, with particular emphasis...... on an efficient quasi-Newton algorithm. The performance is demonstrated on a pneumatic servo system....

  14. Automatic Target Recognition Using Nonlinear Autoregressive Neural Networks

    Science.gov (United States)

    2014-03-27

    series. Chakraborty et al. (1992) modeled flour prices over an eight year period for the cities of Buffalo, Minneapolis and Kansas City via a neural...on stock and commodity market prices (Kaastra & Boyd, 1996) with a goal of discovering non-linear relationships via ANNs which might provide an...Time Series A vector of past observations from a specific time interval is an example of a time series. For example, monthly stock prices from 2000

  15. Fast non-linear extraction of plasma equilibrium parameters using a neural network mapping

    International Nuclear Information System (INIS)

    Lister, J.B.; Schnurrenberger, H.

    1990-07-01

    The shaping of non-circular plasmas requires a non-linear mapping between the measured diagnostic signals and selected equilibrium parameters. The particular configuration of Neural Network known as the multi-layer perceptron provides a powerful and general technique for formulating an arbitrary continuous non-linear multi-dimensional mapping. This technique has been successfully applied to the extraction of equilibrium parameters from measurements of single-null diverted plasmas in the DIII-D tokamak; the results are compared with a purely linear mapping. The method is promising, and hardware implementation is straightforward. (author) 15 refs., 7 figs

  16. Fast non-linear extraction of plasma equilibrium parameters using a neural network mapping

    International Nuclear Information System (INIS)

    Lister, J.B.; Schnurrenberger, H.

    1991-01-01

    The shaping of non-circular plasmas requires a non-linear mapping between the measured diagnostic signals and selected equilibrium parameters. The particular configuration of neural network known as the multilayer perceptron provides a powerful and general technique for formulating an arbitrary continuous non-linear multi-dimensional mapping. This technique has been successfully applied to the extraction of equilibrium parameters from measurements of single-null diverted plasmas in the DIII-D tokamak; the results are compared with a purely linear mapping. The method is promising, and hardware implementation is straightforward. (author). 17 refs, 8 figs, 2 tab

  17. Neural networks for feedback feedforward nonlinear control systems.

    Science.gov (United States)

    Parisini, T; Zoppoli, R

    1994-01-01

    This paper deals with the problem of designing feedback feedforward control strategies to drive the state of a dynamic system (in general, nonlinear) so as to track any desired trajectory joining the points of given compact sets, while minimizing a certain cost function (in general, nonquadratic). Due to the generality of the problem, conventional methods are difficult to apply. Thus, an approximate solution is sought by constraining control strategies to take on the structure of multilayer feedforward neural networks. After discussing the approximation properties of neural control strategies, a particular neural architecture is presented, which is based on what has been called the "linear-structure preserving principle". The original functional problem is then reduced to a nonlinear programming one, and backpropagation is applied to derive the optimal values of the synaptic weights. Recursive equations to compute the gradient components are presented, which generalize the classical adjoint system equations of N-stage optimal control theory. Simulation results related to nonlinear nonquadratic problems show the effectiveness of the proposed method.

  18. Nonlinear Time Series Prediction Using Chaotic Neural Networks

    Science.gov (United States)

    Li, Ke-Ping; Chen, Tian-Lun

    2001-06-01

    A nonlinear feedback term is introduced into the evaluation equation of weights of the backpropagation algorithm for neural network, the network becomes a chaotic one. For the purpose of that we can investigate how the different feedback terms affect the process of learning and forecasting, we use the model to forecast the nonlinear time series which is produced by Makey-Glass equation. By selecting the suitable feedback term, the system can escape from the local minima and converge to the global minimum or its approximate solutions, and the forecasting results are better than those of backpropagation algorithm. The project supported by National Basic Research Project "Nonlinear Science" and National Natural Science Foundation of China under Grant No. 60074020

  19. Spatially Nonlinear Interdependence of Alpha-Oscillatory Neural Networks under Chan Meditation

    Directory of Open Access Journals (Sweden)

    Pei-Chen Lo

    2013-01-01

    Full Text Available This paper reports the results of our investigation of the effects of Chan meditation on brain electrophysiological behaviors from the viewpoint of spatially nonlinear interdependence among regional neural networks. Particular emphasis is laid on the alpha-dominated EEG (electroencephalograph. Continuous-time wavelet transform was adopted to detect the epochs containing substantial alpha activities. Nonlinear interdependence quantified by similarity index S(X∣Y, the influence of source signal Y on sink signal X, was applied to the nonlinear dynamical model in phase space reconstructed from multichannel EEG. Experimental group involved ten experienced Chan-Meditation practitioners, while control group included ten healthy subjects within the same age range, yet, without any meditation experience. Nonlinear interdependence among various cortical regions was explored for five local neural-network regions, frontal, posterior, right-temporal, left-temporal, and central regions. In the experimental group, the inter-regional interaction was evaluated for the brain dynamics under three different stages, at rest (stage R, pre-meditation background recording, in Chan meditation (stage M, and the unique Chakra-focusing practice (stage C. Experimental group exhibits stronger interactions among various local neural networks at stages M and C compared with those at stage R. The intergroup comparison demonstrates that Chan-meditation brain possesses better cortical inter-regional interactions than the resting brain of control group.

  20. Differential Neural Networks for Identification and Filtering in Nonlinear Dynamic Games

    Directory of Open Access Journals (Sweden)

    Emmanuel García

    2014-01-01

    Full Text Available This paper deals with the problem of identifying and filtering a class of continuous-time nonlinear dynamic games (nonlinear differential games subject to additive and undesired deterministic perturbations. Moreover, the mathematical model of this class is completely unknown with the exception of the control actions of each player, and even though the deterministic noises are known, their power (or their effect is not. Therefore, two differential neural networks are designed in order to obtain a feedback (perfect state information pattern for the mentioned class of games. In this way, the stability conditions for two state identification errors and for a filtering error are established, the upper bounds of these errors are obtained, and two new learning laws for each neural network are suggested. Finally, an illustrating example shows the applicability of this approach.

  1. Nonlinear identification of process dynamics using neural networks

    International Nuclear Information System (INIS)

    Parlos, A.G.; Atiya, A.F.; Chong, K.T.

    1992-01-01

    In this paper the nonlinear identification of process dynamics encountered in nuclear power plant components is addressed, in an input-output sense, using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the model structure to be identified. The feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of temporal variations in the system nonlinearities. The standard backpropagation learning algorithm is modified, and it is used for the supervised training of the proposed hybrid network. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The response of representative steam generator is predicted using a neural network, and it is compared to the response obtained from a sophisticated computer model based on first principles. The transient responses compare well, although further research is warranted to determine the predictive capabilities of these networks during more severe operational transients and accident scenarios

  2. Continuous nonlinear optimization for engineering applications in GAMS technology

    CERN Document Server

    Andrei, Neculai

    2017-01-01

    This book presents the theoretical details and computational performances of algorithms used for solving continuous nonlinear optimization applications imbedded in GAMS. Aimed toward scientists and graduate students who utilize optimization methods to model and solve problems in mathematical programming, operations research, business, engineering, and industry, this book enables readers with a background in nonlinear optimization and linear algebra to use GAMS technology to understand and utilize its important capabilities to optimize algorithms for modeling and solving complex, large-scale, continuous nonlinear optimization problems or applications. Beginning with an overview of constrained nonlinear optimization methods, this book moves on to illustrate key aspects of mathematical modeling through modeling technologies based on algebraically oriented modeling languages. Next, the main feature of GAMS, an algebraically oriented language that allows for high-level algebraic representation of mathematical opti...

  3. Typology of nonlinear activity waves in a layered neural continuum.

    Science.gov (United States)

    Koch, Paul; Leisman, Gerry

    2006-04-01

    Neural tissue, a medium containing electro-chemical energy, can amplify small increments in cellular activity. The growing disturbance, measured as the fraction of active cells, manifests as propagating waves. In a layered geometry with a time delay in synaptic signals between the layers, the delay is instrumental in determining the amplified wavelengths. The growth of the waves is limited by the finite number of neural cells in a given region of the continuum. As wave growth saturates, the resulting activity patterns in space and time show a variety of forms, ranging from regular monochromatic waves to highly irregular mixtures of different spatial frequencies. The type of wave configuration is determined by a number of parameters, including alertness and synaptic conditioning as well as delay. For all cases studied, using numerical solution of the nonlinear Wilson-Cowan (1973) equations, there is an interval in delay in which the wave mixing occurs. As delay increases through this interval, during a series of consecutive waves propagating through a continuum region, the activity within that region changes from a single-frequency to a multiple-frequency pattern and back again. The diverse spatio-temporal patterns give a more concrete form to several metaphors advanced over the years to attempt an explanation of cognitive phenomena: Activity waves embody the "holographic memory" (Pribram, 1991); wave mixing provides a plausible cause of the competition called "neural Darwinism" (Edelman, 1988); finally the consecutive generation of growing neural waves can explain the discontinuousness of "psychological time" (Stroud, 1955).

  4. Simulations of nonlinear continuous wave pressure fields in FOCUS

    Science.gov (United States)

    Zhao, Xiaofeng; Hamilton, Mark F.; McGough, Robert J.

    2017-03-01

    The Khokhlov - Zabolotskaya - Kuznetsov (KZK) equation is a parabolic approximation to the Westervelt equation that models the effects of diffraction, attenuation, and nonlinearity. Although the KZK equation is only valid in the far field of the paraxial region for mildly focused or unfocused transducers, the KZK equation is widely applied in medical ultrasound simulations. For a continuous wave input, the KZK equation is effectively modeled by the Bergen Code [J. Berntsen, Numerical Calculations of Finite Amplitude Sound Beams, in M. F. Hamilton and D. T. Blackstock, editors, Frontiers of Nonlinear Acoustics: Proceedings of 12th ISNA, Elsevier, 1990], which is a finite difference model that utilizes operator splitting. Similar C++ routines have been developed for FOCUS, the `Fast Object-Oriented C++ Ultrasound Simulator' (http://www.egr.msu.edu/˜fultras-web) to calculate nonlinear pressure fields generated by axisymmetric flat circular and spherically focused ultrasound transducers. This new routine complements an existing FOCUS program that models nonlinear ultrasound propagation with the angular spectrum approach [P. T. Christopher and K. J. Parker, J. Acoust. Soc. Am. 90, 488-499 (1991)]. Results obtained from these two nonlinear ultrasound simulation approaches are evaluated and compared for continuous wave linear simulations. The simulation results match closely in the farfield of the paraxial region, but the results differ in the nearfield. The nonlinear pressure field generated by a spherically focused transducer with a peak surface pressure of 0.2MPa radiating in a lossy medium with β = 3.5 is simulated, and the computation times are also evaluated. The nonlinear simulation results demonstrate acceptable agreement in the focal zone. These two related nonlinear simulation approaches are now included with FOCUS to enable convenient simulations of nonlinear pressure fields on desktop and laptop computers.

  5. Numerical simulation of nonlinear continuity equations by evolving diffeomorphisms

    KAUST Repository

    Carrillo, José A.

    2016-09-22

    In this paper we present a numerical scheme for nonlinear continuity equations, which is based on the gradient flow formulation of an energy functional with respect to the quadratic transportation distance. It can be applied to a large class of nonlinear continuity equations, whose dynamics are driven by internal energies, given external potentials and/or interaction energies. The solver is based on its variational formulation as a gradient flow with respect to the Wasserstein distance. Positivity of solutions as well as energy decrease of the semi-discrete scheme are guaranteed by its construction. We illustrate this property with various examples in spatial dimension one and two.

  6. Neural network based adaptive control for nonlinear dynamic regimes

    Science.gov (United States)

    Shin, Yoonghyun

    Adaptive control designs using neural networks (NNs) based on dynamic inversion are investigated for aerospace vehicles which are operated at highly nonlinear dynamic regimes. NNs play a key role as the principal element of adaptation to approximately cancel the effect of inversion error, which subsequently improves robustness to parametric uncertainty and unmodeled dynamics in nonlinear regimes. An adaptive control scheme previously named 'composite model reference adaptive control' is further developed so that it can be applied to multi-input multi-output output feedback dynamic inversion. It can have adaptive elements in both the dynamic compensator (linear controller) part and/or in the conventional adaptive controller part, also utilizing state estimation information for NN adaptation. This methodology has more flexibility and thus hopefully greater potential than conventional adaptive designs for adaptive flight control in highly nonlinear flight regimes. The stability of the control system is proved through Lyapunov theorems, and validated with simulations. The control designs in this thesis also include the use of 'pseudo-control hedging' techniques which are introduced to prevent the NNs from attempting to adapt to various actuation nonlinearities such as actuator position and rate saturations. Control allocation is introduced for the case of redundant control effectors including thrust vectoring nozzles. A thorough comparison study of conventional and NN-based adaptive designs for a system under a limit cycle, wing-rock, is included in this research, and the NN-based adaptive control designs demonstrate their performances for two highly maneuverable aerial vehicles, NASA F-15 ACTIVE and FQM-117B unmanned aerial vehicle (UAV), operated under various nonlinearities and uncertainties.

  7. Advanced models of neural networks nonlinear dynamics and stochasticity in biological neurons

    CERN Document Server

    Rigatos, Gerasimos G

    2015-01-01

    This book provides a complete study on neural structures exhibiting nonlinear and stochastic dynamics, elaborating on neural dynamics by introducing advanced models of neural networks. It overviews the main findings in the modelling of neural dynamics in terms of electrical circuits and examines their stability properties with the use of dynamical systems theory. It is suitable for researchers and postgraduate students engaged with neural networks and dynamical systems theory.

  8. Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation.

    Science.gov (United States)

    Li, Shuai; Li, Yangming

    2013-10-28

    The Sylvester equation is often encountered in mathematics and control theory. For the general time-invariant Sylvester equation problem, which is defined in the domain of complex numbers, the Bartels-Stewart algorithm and its extensions are effective and widely used with an O(n³) time complexity. When applied to solving the time-varying Sylvester equation, the computation burden increases intensively with the decrease of sampling period and cannot satisfy continuous realtime calculation requirements. For the special case of the general Sylvester equation problem defined in the domain of real numbers, gradient-based recurrent neural networks are able to solve the time-varying Sylvester equation in real time, but there always exists an estimation error while a recently proposed recurrent neural network by Zhang et al [this type of neural network is called Zhang neural network (ZNN)] converges to the solution ideally. The advancements in complex-valued neural networks cast light to extend the existing real-valued ZNN for solving the time-varying real-valued Sylvester equation to its counterpart in the domain of complex numbers. In this paper, a complex-valued ZNN for solving the complex-valued Sylvester equation problem is investigated and the global convergence of the neural network is proven with the proposed nonlinear complex-valued activation functions. Moreover, a special type of activation function with a core function, called sign-bi-power function, is proven to enable the ZNN to converge in finite time, which further enhances its advantage in online processing. In this case, the upper bound of the convergence time is also derived analytically. Simulations are performed to evaluate and compare the performance of the neural network with different parameters and activation functions. Both theoretical analysis and numerical simulations validate the effectiveness of the proposed method.

  9. Neural-network-observer-based optimal control for unknown nonlinear systems using adaptive dynamic programming

    Science.gov (United States)

    Liu, Derong; Huang, Yuzhu; Wang, Ding; Wei, Qinglai

    2013-09-01

    In this paper, an observer-based optimal control scheme is developed for unknown nonlinear systems using adaptive dynamic programming (ADP) algorithm. First, a neural-network (NN) observer is designed to estimate system states. Then, based on the observed states, a neuro-controller is constructed via ADP method to obtain the optimal control. In this design, two NN structures are used: a three-layer NN is used to construct the observer which can be applied to systems with higher degrees of nonlinearity and without a priori knowledge of system dynamics, and a critic NN is employed to approximate the value function. The optimal control law is computed using the critic NN and the observer NN. Uniform ultimate boundedness of the closed-loop system is guaranteed. The actor, critic, and observer structures are all implemented in real-time, continuously and simultaneously. Finally, simulation results are presented to demonstrate the effectiveness of the proposed control scheme.

  10. Neural feedback linearization adaptive control for affine nonlinear systems based on neural network estimator

    Directory of Open Access Journals (Sweden)

    Bahita Mohamed

    2011-01-01

    Full Text Available In this work, we introduce an adaptive neural network controller for a class of nonlinear systems. The approach uses two Radial Basis Functions, RBF networks. The first RBF network is used to approximate the ideal control law which cannot be implemented since the dynamics of the system are unknown. The second RBF network is used for on-line estimating the control gain which is a nonlinear and unknown function of the states. The updating laws for the combined estimator and controller are derived through Lyapunov analysis. Asymptotic stability is established with the tracking errors converging to a neighborhood of the origin. Finally, the proposed method is applied to control and stabilize the inverted pendulum system.

  11. Signaling on the continuous spectrum of nonlinear optical fiber.

    Science.gov (United States)

    Tavakkolnia, Iman; Safari, Majid

    2017-08-07

    This paper studies different signaling techniques on the continuous spectrum (CS) of nonlinear optical fiber defined by nonlinear Fourier transform. Three different signaling techniques are proposed and analyzed based on the statistics of the noise added to CS after propagation along the nonlinear optical fiber. The proposed methods are compared in terms of error performance, distance reach, and complexity. Furthermore, the effect of chromatic dispersion on the data rate and noise in nonlinear spectral domain is investigated. It is demonstrated that, for a given sequence of CS symbols, an optimal bandwidth (or symbol rate) can be determined so that the temporal duration of the propagated signal at the end of the fiber is minimized. In effect, the required guard interval between the subsequently transmitted data packets in time is minimized and the effective data rate is significantly enhanced. Moreover, by selecting the proper signaling method and design criteria a distance reach of 7100 km is reported by only singling on CS at a rate of 9.6 Gbps.

  12. Adaptive near-optimal neuro controller for continuous-time nonaffine nonlinear systems with constrained input.

    Science.gov (United States)

    Esfandiari, Kasra; Abdollahi, Farzaneh; Talebi, Heidar Ali

    2017-09-01

    In this paper, an identifier-critic structure is introduced to find an online near-optimal controller for continuous-time nonaffine nonlinear systems having saturated control signal. By employing two Neural Networks (NNs), the solution of Hamilton-Jacobi-Bellman (HJB) equation associated with the cost function is derived without requiring a priori knowledge about system dynamics. Weights of the identifier and critic NNs are tuned online and simultaneously such that unknown terms are approximated accurately and the control signal is kept between the saturation bounds. The convergence of NNs' weights, identification error, and system states is guaranteed using Lyapunov's direct method. Finally, simulation results are performed on two nonlinear systems to confirm the effectiveness of the proposed control strategy. Copyright © 2017 Elsevier Ltd. All rights reserved.

  13. Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints

    Science.gov (United States)

    Yang, Xiong; Liu, Derong; Wang, Ding

    2014-03-01

    In this paper, an adaptive reinforcement learning-based solution is developed for the infinite-horizon optimal control problem of constrained-input continuous-time nonlinear systems in the presence of nonlinearities with unknown structures. Two different types of neural networks (NNs) are employed to approximate the Hamilton-Jacobi-Bellman equation. That is, an recurrent NN is constructed to identify the unknown dynamical system, and two feedforward NNs are used as the actor and the critic to approximate the optimal control and the optimal cost, respectively. Based on this framework, the action NN and the critic NN are tuned simultaneously, without the requirement for the knowledge of system drift dynamics. Moreover, by using Lyapunov's direct method, the weights of the action NN and the critic NN are guaranteed to be uniformly ultimately bounded, while keeping the closed-loop system stable. To demonstrate the effectiveness of the present approach, simulation results are illustrated.

  14. MEG and fMRI fusion for nonlinear estimation of neural and BOLD signal changes

    Directory of Open Access Journals (Sweden)

    Sergey M Plis

    2010-11-01

    Full Text Available The combined analysis of MEG/EEG and functional MRI measurements can lead to improvement in the description of the dynamical and spatial properties of brain activity. In this paper we empirically demonstrate this improvement using simulated and recorded task related MEG and fMRI activity. Neural activity estimates were derived using a dynamic Bayesian network with continuous real valued parameters by means of a sequential Monte Carlo technique. In synthetic data, we show that MEG and fMRI fusion improves estimation of the indirectly observed neural activity and smooths tracking of the BOLD response. In recordings of task related neural activity the combination of MEG and fMRI produces a result with greater SNR, that confirms the expectation arising from the nature of the experiment. The highly nonlinear model of the BOLD response poses a difficult inference problem for neural activity estimation; computational requirements are also high due to the time and space complexity. We show that joint analysis of the data improves the system's behavior by stabilizing the differential equations system and by requiring fewer computational resources.

  15. Optimal control of nonlinear continuous-time systems in strict-feedback form.

    Science.gov (United States)

    Zargarzadeh, Hassan; Dierks, Travis; Jagannathan, Sarangapani

    2015-10-01

    This paper proposes a novel optimal tracking control scheme for nonlinear continuous-time systems in strict-feedback form with uncertain dynamics. The optimal tracking problem is transformed into an equivalent optimal regulation problem through a feedforward adaptive control input that is generated by modifying the standard backstepping technique. Subsequently, a neural network-based optimal control scheme is introduced to estimate the cost, or value function, over an infinite horizon for the resulting nonlinear continuous-time systems in affine form when the internal dynamics are unknown. The estimated cost function is then used to obtain the optimal feedback control input; therefore, the overall optimal control input for the nonlinear continuous-time system in strict-feedback form includes the feedforward plus the optimal feedback terms. It is shown that the estimated cost function minimizes the Hamilton-Jacobi-Bellman estimation error in a forward-in-time manner without using any value or policy iterations. Finally, optimal output feedback control is introduced through the design of a suitable observer. Lyapunov theory is utilized to show the overall stability of the proposed schemes without requiring an initial admissible controller. Simulation examples are provided to validate the theoretical results.

  16. Nonlinear adaptive optimization of biomass productivity in continuous bioreactors

    Energy Technology Data Exchange (ETDEWEB)

    Sauvaire, P; Mellichamp, D A; Agrawal, P [California Univ., Santa Barbara, CA (United States). Dept. of Chemical and Nuclear Engineering

    1991-11-01

    A novel on-line adaptive optimization algorithm is developed and applied to continuous biological reactors. The algorithm makes use of a simple nonlinear estimation model that relates either the cell-mass productivity or the cell-mass concentration to the dilution rate. On-line estimation is used to recursively identify the parameters in the nonlinear process model and to periodically calculate and steer the bioreactor to the dilution rate that yields optimum cell-mass productivity. Thus, the algorithm does not require an accurate process model, locates the optimum dilution rate online, and maintains the bioreactors at this optimum condition at all times. The features of the proposed new algorithm are compared with those of other adaptive optimization techniques presented in the literature. A detailed simulation study using three different microbial system models was conducted to illustrate the performance of the optimization algorithms. (orig.).

  17. Artificial Neural Networks for Nonlinear Dynamic Response Simulation in Mechanical Systems

    DEFF Research Database (Denmark)

    Christiansen, Niels Hørbye; Høgsberg, Jan Becker; Winther, Ole

    2011-01-01

    It is shown how artificial neural networks can be trained to predict dynamic response of a simple nonlinear structure. Data generated using a nonlinear finite element model of a simplified wind turbine is used to train a one layer artificial neural network. When trained properly the network is ab...... to perform accurate response prediction much faster than the corresponding finite element model. Initial result indicate a reduction in cpu time by two orders of magnitude....

  18. Hamiltonian-Driven Adaptive Dynamic Programming for Continuous Nonlinear Dynamical Systems.

    Science.gov (United States)

    Yang, Yongliang; Wunsch, Donald; Yin, Yixin

    2017-08-01

    This paper presents a Hamiltonian-driven framework of adaptive dynamic programming (ADP) for continuous time nonlinear systems, which consists of evaluation of an admissible control, comparison between two different admissible policies with respect to the corresponding the performance function, and the performance improvement of an admissible control. It is showed that the Hamiltonian can serve as the temporal difference for continuous-time systems. In the Hamiltonian-driven ADP, the critic network is trained to output the value gradient. Then, the inner product between the critic and the system dynamics produces the value derivative. Under some conditions, the minimization of the Hamiltonian functional is equivalent to the value function approximation. An iterative algorithm starting from an arbitrary admissible control is presented for the optimal control approximation with its convergence proof. The implementation is accomplished by a neural network approximation. Two simulation studies demonstrate the effectiveness of Hamiltonian-driven ADP.

  19. Dynamic neural network-based methods for compensation of nonlinear effects in multimode communication lines

    Science.gov (United States)

    Sidelnikov, O. S.; Redyuk, A. A.; Sygletos, S.

    2017-12-01

    We consider neural network-based schemes of digital signal processing. It is shown that the use of a dynamic neural network-based scheme of signal processing ensures an increase in the optical signal transmission quality in comparison with that provided by other methods for nonlinear distortion compensation.

  20. Tracking Control Based on Recurrent Neural Networks for Nonlinear Systems with Multiple Inputs and Unknown Deadzone

    Directory of Open Access Journals (Sweden)

    J. Humberto Pérez-Cruz

    2012-01-01

    Full Text Available This paper deals with the problem of trajectory tracking for a broad class of uncertain nonlinear systems with multiple inputs each one subject to an unknown symmetric deadzone. On the basis of a model of the deadzone as a combination of a linear term and a disturbance-like term, a continuous-time recurrent neural network is directly employed in order to identify the uncertain dynamics. By using a Lyapunov analysis, the exponential convergence of the identification error to a bounded zone is demonstrated. Subsequently, by a proper control law, the state of the neural network is compelled to follow a bounded reference trajectory. This control law is designed in such a way that the singularity problem is conveniently avoided and the exponential convergence to a bounded zone of the difference between the state of the neural identifier and the reference trajectory can be proven. Thus, the exponential convergence of the tracking error to a bounded zone and the boundedness of all closed-loop signals can be guaranteed. One of the main advantages of the proposed strategy is that the controller can work satisfactorily without any specific knowledge of an upper bound for the unmodeled dynamics and/or the disturbance term.

  1. Absolute stability of nonlinear systems with time delays and applications to neural networks

    Directory of Open Access Journals (Sweden)

    Xinzhi Liu

    2001-01-01

    Full Text Available In this paper, absolute stability of nonlinear systems with time delays is investigated. Sufficient conditions on absolute stability are derived by using the comparison principle and differential inequalities. These conditions are simple and easy to check. In addition, exponential stability conditions for some special cases of nonlinear delay systems are discussed. Applications of those results to cellular neural networks are presented.

  2. Continuity and change in children's longitudinal neural responses to numbers.

    Science.gov (United States)

    Emerson, Robert W; Cantlon, Jessica F

    2015-03-01

    Human children possess the ability to approximate numerical quantity nonverbally from a young age. Over the course of early childhood, children develop increasingly precise representations of numerical values, including a symbolic number system that allows them to conceive of numerical information as Arabic numerals or number words. Functional brain imaging studies of adults report that activity in bilateral regions of the intraparietal sulcus (IPS) represents a key neural correlate of numerical cognition. Developmental neuroimaging studies indicate that the right IPS develops its number-related neural response profile more rapidly than the left IPS during early childhood. One prediction that can be derived from previous findings is that there is longitudinal continuity in the number-related neural responses of the right IPS over development while the development of the left IPS depends on the acquisition of numerical skills. We tested this hypothesis using fMRI in a longitudinal design with children ages 4 to 9. We found that neural responses in the right IPS are correlated over a 1-2-year period in young children whereas left IPS responses change systematically as a function of children's numerical discrimination acuity. The data are consistent with the hypothesis that functional properties of the right IPS in numerical processing are stable over early childhood whereas the functions of the left IPS are dynamically modulated by the development of numerical skills. © 2014 John Wiley & Sons Ltd.

  3. A continuous-time neural model for sequential action.

    Science.gov (United States)

    Kachergis, George; Wyatte, Dean; O'Reilly, Randall C; de Kleijn, Roy; Hommel, Bernhard

    2014-11-05

    Action selection, planning and execution are continuous processes that evolve over time, responding to perceptual feedback as well as evolving top-down constraints. Existing models of routine sequential action (e.g. coffee- or pancake-making) generally fall into one of two classes: hierarchical models that include hand-built task representations, or heterarchical models that must learn to represent hierarchy via temporal context, but thus far lack goal-orientedness. We present a biologically motivated model of the latter class that, because it is situated in the Leabra neural architecture, affords an opportunity to include both unsupervised and goal-directed learning mechanisms. Moreover, we embed this neurocomputational model in the theoretical framework of the theory of event coding (TEC), which posits that actions and perceptions share a common representation with bidirectional associations between the two. Thus, in this view, not only does perception select actions (along with task context), but actions are also used to generate perceptions (i.e. intended effects). We propose a neural model that implements TEC to carry out sequential action control in hierarchically structured tasks such as coffee-making. Unlike traditional feedforward discrete-time neural network models, which use static percepts to generate static outputs, our biological model accepts continuous-time inputs and likewise generates non-stationary outputs, making short-timescale dynamic predictions. © 2014 The Author(s) Published by the Royal Society. All rights reserved.

  4. Nonlinear wave propagation in discrete and continuous systems

    Science.gov (United States)

    Rothos, V. M.

    2016-09-01

    In this review we try to capture some of the recent excitement induced by a large volume of theoretical and computational studies addressing nonlinear Schrödinger models (discrete and continuous) and the localized structures that they support. We focus on some prototypical structures, namely the breather solutions and solitary waves. In particular, we investigate the bifurcation of travelling wave solution in Discrete NLS system applying dynamical systems methods. Next, we examine the combined effects of cubic and quintic terms of the long range type in the dynamics of a double well potential. The relevant bifurcations, the stability of the branches and their dynamical implications are examined both in the reduced (ODE) and in the full (PDE) setting. We also offer an outlook on interesting possibilities for future work on this theme.

  5. Continuous Online Sequence Learning with an Unsupervised Neural Network Model.

    Science.gov (United States)

    Cui, Yuwei; Ahmad, Subutar; Hawkins, Jeff

    2016-09-14

    The ability to recognize and predict temporal sequences of sensory inputs is vital for survival in natural environments. Based on many known properties of cortical neurons, hierarchical temporal memory (HTM) sequence memory recently has been proposed as a theoretical framework for sequence learning in the cortex. In this letter, we analyze properties of HTM sequence memory and apply it to sequence learning and prediction problems with streaming data. We show the model is able to continuously learn a large number of variableorder temporal sequences using an unsupervised Hebbian-like learning rule. The sparse temporal codes formed by the model can robustly handle branching temporal sequences by maintaining multiple predictions until there is sufficient disambiguating evidence. We compare the HTM sequence memory with other sequence learning algorithms, including statistical methods: autoregressive integrated moving average; feedforward neural networks-time delay neural network and online sequential extreme learning machine; and recurrent neural networks-long short-term memory and echo-state networks on sequence prediction problems with both artificial and real-world data. The HTM model achieves comparable accuracy to other state-of-the-art algorithms. The model also exhibits properties that are critical for sequence learning, including continuous online learning, the ability to handle multiple predictions and branching sequences with high-order statistics, robustness to sensor noise and fault tolerance, and good performance without task-specific hyperparameter tuning. Therefore, the HTM sequence memory not only advances our understanding of how the brain may solve the sequence learning problem but is also applicable to real-world sequence learning problems from continuous data streams.

  6. Neural-Based Compensation of Nonlinearities in an Airplane Longitudinal Model with Dynamic-Inversion Control

    Directory of Open Access Journals (Sweden)

    YanBin Liu

    2017-01-01

    Full Text Available The inversion design approach is a very useful tool for the complex multiple-input-multiple-output nonlinear systems to implement the decoupling control goal, such as the airplane model and spacecraft model. In this work, the flight control law is proposed using the neural-based inversion design method associated with the nonlinear compensation for a general longitudinal model of the airplane. First, the nonlinear mathematic model is converted to the equivalent linear model based on the feedback linearization theory. Then, the flight control law integrated with this inversion model is developed to stabilize the nonlinear system and relieve the coupling effect. Afterwards, the inversion control combined with the neural network and nonlinear portion is presented to improve the transient performance and attenuate the uncertain effects on both external disturbances and model errors. Finally, the simulation results demonstrate the effectiveness of this controller.

  7. Approximate N-Player Nonzero-Sum Game Solution for an Uncertain Continuous Nonlinear System.

    Science.gov (United States)

    Johnson, Marcus; Kamalapurkar, Rushikesh; Bhasin, Shubhendu; Dixon, Warren E

    2015-08-01

    An approximate online equilibrium solution is developed for an N -player nonzero-sum game subject to continuous-time nonlinear unknown dynamics and an infinite horizon quadratic cost. A novel actor-critic-identifier structure is used, wherein a robust dynamic neural network is used to asymptotically identify the uncertain system with additive disturbances, and a set of critic and actor NNs are used to approximate the value functions and equilibrium policies, respectively. The weight update laws for the actor neural networks (NNs) are generated using a gradient-descent method, and the critic NNs are generated by least square regression, which are both based on the modified Bellman error that is independent of the system dynamics. A Lyapunov-based stability analysis shows that uniformly ultimately bounded tracking is achieved, and a convergence analysis demonstrates that the approximate control policies converge to a neighborhood of the optimal solutions. The actor, critic, and identifier structures are implemented in real time continuously and simultaneously. Simulations on two and three player games illustrate the performance of the developed method.

  8. Nonlinear MIMO Control of a Continuous Cooling Crystallizer

    Directory of Open Access Journals (Sweden)

    Pedro Alberto Quintana-Hernández

    2012-01-01

    Full Text Available In this work, a feedback control algorithm was developed based on geometric control theory. A nonisothermal seeded continuous crystallizer model was used to test the algorithm. The control objectives were the stabilization of the third moment of the crystal size distribution (μ3 and the crystallizer temperature (T; the manipulated variables were the stirring rate and the coolant flow rate. The nonlinear control (NLC was tested at operating conditions established within the metastable zone. Step changes of magnitudes ±0.0015 and ±0.5°C were introduced into the set point values of the third moment and crystallizer temperature, respectively. In addition, a step change of ±1°C was introduced as a disturbance in the feeding temperature. Closed-loop stability was analyzed by calculating the eigenvalues of the internal dynamics. The system presented a stable dynamic behavior when the operation conditions maintain the crystallizer concentration within the metastable zone. Closed-loop simulations with the NLC were compared with simulations that used a classic PID controller. The PID controllers were tuned by minimizing the integral of the absolute value of the error (IAE criterion. The results showed that the NLC provided a suitable option for continuous crystallization control. For all analyzed cases, the IAEs obtained with NLC were smaller than those obtained with the PID controller.

  9. Nonlinear System Identification Using Neural Networks Trained with Natural Gradient Descent

    Directory of Open Access Journals (Sweden)

    Ibnkahla Mohamed

    2003-01-01

    Full Text Available We use natural gradient (NG learning neural networks (NNs for modeling and identifying nonlinear systems with memory. The nonlinear system is comprised of a discrete-time linear filter followed by a zero-memory nonlinearity . The NN model is composed of a linear adaptive filter followed by a two-layer memoryless nonlinear NN. A Kalman filter-based technique and a search-and-converge method have been employed for the NG algorithm. It is shown that the NG descent learning significantly outperforms the ordinary gradient descent and the Levenberg-Marquardt (LM procedure in terms of convergence speed and mean squared error (MSE performance.

  10. Nonlinear neural network for hemodynamic model state and input estimation using fMRI data

    KAUST Repository

    Karam, Ayman M.

    2014-11-01

    Originally inspired by biological neural networks, artificial neural networks (ANNs) are powerful mathematical tools that can solve complex nonlinear problems such as filtering, classification, prediction and more. This paper demonstrates the first successful implementation of ANN, specifically nonlinear autoregressive with exogenous input (NARX) networks, to estimate the hemodynamic states and neural activity from simulated and measured real blood oxygenation level dependent (BOLD) signals. Blocked and event-related BOLD data are used to test the algorithm on real experiments. The proposed method is accurate and robust even in the presence of signal noise and it does not depend on sampling interval. Moreover, the structure of the NARX networks is optimized to yield the best estimate with minimal network architecture. The results of the estimated neural activity are also discussed in terms of their potential use.

  11. On the synchronization of neural networks containing time-varying delays and sector nonlinearity

    International Nuclear Information System (INIS)

    Yan, J.-J.; Lin, J.-S.; Hung, M.-L.; Liao, T.-L.

    2007-01-01

    We present a systematic design procedure for synchronization of neural networks subject to time-varying delays and sector nonlinearity in the control input. Based on the drive-response concept and the Lyapunov stability theorem, a memoryless decentralized control law is proposed which guarantees exponential synchronization even when input nonlinearity is present. The supplementary requirement that the time-derivative of time-varying delays must be smaller than one is released for the proposed control scheme. A four-dimensional Hopfield neural network with time-varying delays is presented as the illustrative example to demonstrate the effectiveness of the proposed synchronization scheme

  12. Synchronization of chaotic recurrent neural networks with time-varying delays using nonlinear feedback control

    International Nuclear Information System (INIS)

    Cui Baotong; Lou Xuyang

    2009-01-01

    In this paper, a new method to synchronize two identical chaotic recurrent neural networks is proposed. Using the drive-response concept, a nonlinear feedback control law is derived to achieve the state synchronization of the two identical chaotic neural networks. Furthermore, based on the Lyapunov method, a delay independent sufficient synchronization condition in terms of linear matrix inequality (LMI) is obtained. A numerical example with graphical illustrations is given to illuminate the presented synchronization scheme

  13. A novel nonlinear adaptive filter using a pipelined second-order Volterra recurrent neural network.

    Science.gov (United States)

    Zhao, Haiquan; Zhang, Jiashu

    2009-12-01

    To enhance the performance and overcome the heavy computational complexity of recurrent neural networks (RNN), a novel nonlinear adaptive filter based on a pipelined second-order Volterra recurrent neural network (PSOVRNN) is proposed in this paper. A modified real-time recurrent learning (RTRL) algorithm of the proposed filter is derived in much more detail. The PSOVRNN comprises of a number of simple small-scale second-order Volterra recurrent neural network (SOVRNN) modules. In contrast to the standard RNN, these modules of a PSOVRNN can be performed simultaneously in a pipelined parallelism fashion, which can lead to a significant improvement in its total computational efficiency. Moreover, since each module of the PSOVRNN is a SOVRNN in which nonlinearity is introduced by the recursive second-order Volterra (RSOV) expansion, its performance can be further improved. Computer simulations have demonstrated that the PSOVRNN performs better than the pipelined recurrent neural network (PRNN) and RNN for nonlinear colored signals prediction and nonlinear channel equalization. However, the superiority of the PSOVRNN over the PRNN is at the cost of increasing computational complexity due to the introduced nonlinear expansion of each module.

  14. Neural network-based nonlinear model predictive control vs. linear quadratic gaussian control

    Science.gov (United States)

    Cho, C.; Vance, R.; Mardi, N.; Qian, Z.; Prisbrey, K.

    1997-01-01

    One problem with the application of neural networks to the multivariable control of mineral and extractive processes is determining whether and how to use them. The objective of this investigation was to compare neural network control to more conventional strategies and to determine if there are any advantages in using neural network control in terms of set-point tracking, rise time, settling time, disturbance rejection and other criteria. The procedure involved developing neural network controllers using both historical plant data and simulation models. Various control patterns were tried, including both inverse and direct neural network plant models. These were compared to state space controllers that are, by nature, linear. For grinding and leaching circuits, a nonlinear neural network-based model predictive control strategy was superior to a state space-based linear quadratic gaussian controller. The investigation pointed out the importance of incorporating state space into neural networks by making them recurrent, i.e., feeding certain output state variables into input nodes in the neural network. It was concluded that neural network controllers can have better disturbance rejection, set-point tracking, rise time, settling time and lower set-point overshoot, and it was also concluded that neural network controllers can be more reliable and easy to implement in complex, multivariable plants.

  15. Integral reinforcement learning for continuous-time input-affine nonlinear systems with simultaneous invariant explorations.

    Science.gov (United States)

    Lee, Jae Young; Park, Jin Bae; Choi, Yoon Ho

    2015-05-01

    This paper focuses on a class of reinforcement learning (RL) algorithms, named integral RL (I-RL), that solve continuous-time (CT) nonlinear optimal control problems with input-affine system dynamics. First, we extend the concepts of exploration, integral temporal difference, and invariant admissibility to the target CT nonlinear system that is governed by a control policy plus a probing signal called an exploration. Then, we show input-to-state stability (ISS) and invariant admissibility of the closed-loop systems with the policies generated by integral policy iteration (I-PI) or invariantly admissible PI (IA-PI) method. Based on these, three online I-RL algorithms named explorized I-PI and integral Q -learning I, II are proposed, all of which generate the same convergent sequences as I-PI and IA-PI under the required excitation condition on the exploration. All the proposed methods are partially or completely model free, and can simultaneously explore the state space in a stable manner during the online learning processes. ISS, invariant admissibility, and convergence properties of the proposed methods are also investigated, and related with these, we show the design principles of the exploration for safe learning. Neural-network-based implementation methods for the proposed schemes are also presented in this paper. Finally, several numerical simulations are carried out to verify the effectiveness of the proposed methods.

  16. Linear and nonlinear ARMA model parameter estimation using an artificial neural network

    Science.gov (United States)

    Chon, K. H.; Cohen, R. J.

    1997-01-01

    This paper addresses parametric system identification of linear and nonlinear dynamic systems by analysis of the input and output signals. Specifically, we investigate the relationship between estimation of the system using a feedforward neural network model and estimation of the system by use of linear and nonlinear autoregressive moving-average (ARMA) models. By utilizing a neural network model incorporating a polynomial activation function, we show the equivalence of the artificial neural network to the linear and nonlinear ARMA models. We compare the parameterization of the estimated system using the neural network and ARMA approaches by utilizing data generated by means of computer simulations. Specifically, we show that the parameters of a simulated ARMA system can be obtained from the neural network analysis of the simulated data or by conventional least squares ARMA analysis. The feasibility of applying neural networks with polynomial activation functions to the analysis of experimental data is explored by application to measurements of heart rate (HR) and instantaneous lung volume (ILV) fluctuations.

  17. A real nonlinear integrable couplings of continuous soliton hierarchy and its Hamiltonian structure

    International Nuclear Information System (INIS)

    Yu Fajun

    2011-01-01

    Some integrable coupling systems of existing papers are linear integrable couplings. In the Letter, beginning with Lax pairs from special non-semisimple matrix Lie algebras, we establish a scheme for constructing real nonlinear integrable couplings of continuous soliton hierarchy. A direct application to the AKNS spectral problem leads to a novel nonlinear integrable couplings, then we consider the Hamiltonian structures of nonlinear integrable couplings of AKNS hierarchy with the component-trace identity. - Highlights: → We establish a scheme to construct real nonlinear integrable couplings. → We obtain a novel nonlinear integrable couplings of AKNS hierarchy. → Hamiltonian structure of nonlinear integrable couplings AKNS hierarchy is presented.

  18. Neural sources of performance decline during continuous multitasking.

    Science.gov (United States)

    Al-Hashimi, Omar; Zanto, Theodore P; Gazzaley, Adam

    2015-10-01

    Multitasking performance costs have largely been characterized by experiments that involve two overlapping and punctuated perceptual stimuli, as well as punctuated responses to each task. Here, participants engaged in a continuous performance paradigm during fMRI recording to identify neural signatures associated with multitasking costs under more natural conditions. Our results demonstrated that only a single brain region, the superior parietal lobule (SPL), exhibited a significant relationship with multitasking performance, such that increased activation in the multitasking condition versus the singletasking condition was associated with higher task performance (i.e., least multitasking cost). Together, these results support previous research indicating that parietal regions underlie multitasking abilities and that performance costs are related to a bottleneck in control processes involving the SPL that serves to divide attention between two tasks. Copyright © 2015. Published by Elsevier Ltd.

  19. Stability analysis for stochastic BAM nonlinear neural network with delays

    Science.gov (United States)

    Lv, Z. W.; Shu, H. S.; Wei, G. L.

    2008-02-01

    In this paper, stochastic bidirectional associative memory neural networks with constant or time-varying delays is considered. Based on a Lyapunov-Krasovskii functional and the stochastic stability analysis theory, we derive several sufficient conditions in order to guarantee the global asymptotically stable in the mean square. Our investigation shows that the stochastic bidirectional associative memory neural networks are globally asymptotically stable in the mean square if there are solutions to some linear matrix inequalities(LMIs). Hence, the global asymptotic stability of the stochastic bidirectional associative memory neural networks can be easily checked by the Matlab LMI toolbox. A numerical example is given to demonstrate the usefulness of the proposed global asymptotic stability criteria.

  20. Stability analysis for stochastic BAM nonlinear neural network with delays

    International Nuclear Information System (INIS)

    Lv, Z W; Shu, H S; Wei, G L

    2008-01-01

    In this paper, stochastic bidirectional associative memory neural networks with constant or time-varying delays is considered. Based on a Lyapunov-Krasovskii functional and the stochastic stability analysis theory, we derive several sufficient conditions in order to guarantee the global asymptotically stable in the mean square. Our investigation shows that the stochastic bidirectional associative memory neural networks are globally asymptotically stable in the mean square if there are solutions to some linear matrix inequalities(LMIs). Hence, the global asymptotic stability of the stochastic bidirectional associative memory neural networks can be easily checked by the Matlab LMI toolbox. A numerical example is given to demonstrate the usefulness of the proposed global asymptotic stability criteria

  1. Nonlinear identification and control a neural network approach

    CERN Document Server

    Liu, G P

    2001-01-01

    The series Advances in Industrial Control aims to report and encourage technology transfer in control engineering. The rapid development of control technology has an impact on all areas of the control discipline. New theory, new controllers, actuators, sensors, new industrial processes, computer methods, new applications, new philosophies . . . , new challenges. Much of this development work resides in industrial reports, feasibility study papers and the reports of advanced collaborative projects. The series otTers an opportunity for researchers to present an extended exposition of such new work in all aspects of industrial control for wider and rapid dissemination. The time for nonlinear control to enter routine application seems to be approaching. Nonlinear control has had a long gestation period but much ofthe past has been concerned with methods that involve formal nonlinear functional model representations. It seems more likely that the breakthough will come through the use of other more flexible and ame...

  2. Passivation and control of partially known SISO nonlinear systems via dynamic neural networks

    Directory of Open Access Journals (Sweden)

    Reyes-Reyes J.

    2000-01-01

    Full Text Available In this paper, an adaptive technique is suggested to provide the passivity property for a class of partially known SISO nonlinear systems. A simple Dynamic Neural Network (DNN, containing only two neurons and without any hidden-layers, is used to identify the unknown nonlinear system. By means of a Lyapunov-like analysis the new learning law for this DNN, guarantying both successful identification and passivation effects, is derived. Based on this adaptive DNN model, an adaptive feedback controller, serving for wide class of nonlinear systems with an a priori incomplete model description, is designed. Two typical examples illustrate the effectiveness of the suggested approach.

  3. Modelling the continuous cooling transformation diagram of engineering steels using neural networks. Part I. Phase regions

    Energy Technology Data Exchange (ETDEWEB)

    Wolk, P.J. van der; Wang, J. [Delft Univ. of Technology (Netherlands); Sietsma, J.; Zwaag, S. van der [Delft Univ. of Technology, Lab. for Materials Science (Netherlands)

    2002-12-01

    A neural network model for the calculation of the phase regions of the continuous cooling transformation (CCT) diagram of engineering steels has been developed. The model is based on experimental CCT diagrams of 459 low-alloy steels, and calculates the CCT diagram as a function of composition and austenitisation temperature. In considering the composition, 9 alloying elements are taken into account. The model reproduces the original diagrams rather accurately, with deviations that are not larger than the average experimental inaccuracy of the experimental diagrams. Therefore, it can be considered an adequate alternative to the experimental determination of the CCT diagram of a certain steel within the composition range used. The effects of alloying elements can be quantified, either individually or in combination, with the model. Nonlinear composition dependencies are observed. (orig.)

  4. A novel joint-processing adaptive nonlinear equalizer using a modular recurrent neural network for chaotic communication systems.

    Science.gov (United States)

    Zhao, Haiquan; Zeng, Xiangping; Zhang, Jiashu; Liu, Yangguang; Wang, Xiaomin; Li, Tianrui

    2011-01-01

    To eliminate nonlinear channel distortion in chaotic communication systems, a novel joint-processing adaptive nonlinear equalizer based on a pipelined recurrent neural network (JPRNN) is proposed, using a modified real-time recurrent learning (RTRL) algorithm. Furthermore, an adaptive amplitude RTRL algorithm is adopted to overcome the deteriorating effect introduced by the nesting process. Computer simulations illustrate that the proposed equalizer outperforms the pipelined recurrent neural network (PRNN) and recurrent neural network (RNN) equalizers. Copyright © 2010 Elsevier Ltd. All rights reserved.

  5. Neural network modeling of nonlinear systems based on Volterra series extension of a linear model

    Science.gov (United States)

    Soloway, Donald I.; Bialasiewicz, Jan T.

    1992-01-01

    A Volterra series approach was applied to the identification of nonlinear systems which are described by a neural network model. A procedure is outlined by which a mathematical model can be developed from experimental data obtained from the network structure. Applications of the results to the control of robotic systems are discussed.

  6. Pinning Synchronization of Delayed Neural Networks with Nonlinear Inner-Coupling

    Directory of Open Access Journals (Sweden)

    Yangling Wang

    2011-01-01

    Full Text Available Without assuming the symmetry and irreducibility of the outer-coupling weight configuration matrices, we investigate the pinning synchronization of delayed neural networks with nonlinear inner-coupling. Some delay-dependent controlled stability criteria in terms of linear matrix inequality (LMI are obtained. An example is presented to show the application of the criteria obtained in this paper.

  7. An Application of Non-Linear Autoregressive Neural Networks to Predict Energy Consumption in Public Buildings

    Directory of Open Access Journals (Sweden)

    Luis Gonzaga Baca Ruiz

    2016-08-01

    Full Text Available This paper addresses the problem of energy consumption prediction using neural networks over a set of public buildings. Since energy consumption in the public sector comprises a substantial share of overall consumption, the prediction of such consumption represents a decisive issue in the achievement of energy savings. In our experiments, we use the data provided by an energy consumption monitoring system in a compound of faculties and research centers at the University of Granada, and provide a methodology to predict future energy consumption using nonlinear autoregressive (NAR and the nonlinear autoregressive neural network with exogenous inputs (NARX, respectively. Results reveal that NAR and NARX neural networks are both suitable for performing energy consumption prediction, but also that exogenous data may help to improve the accuracy of predictions.

  8. Forecasting hourly global solar radiation using hybrid k-means and nonlinear autoregressive neural network models

    International Nuclear Information System (INIS)

    Benmouiza, Khalil; Cheknane, Ali

    2013-01-01

    Highlights: • An unsupervised clustering algorithm with a neural network model was explored. • The forecasting results of solar radiation time series and the comparison of their performance was simulated. • A new method was proposed combining k-means algorithm and NAR network to provide better prediction results. - Abstract: In this paper, we review our work for forecasting hourly global horizontal solar radiation based on the combination of unsupervised k-means clustering algorithm and artificial neural networks (ANN). k-Means algorithm focused on extracting useful information from the data with the aim of modeling the time series behavior and find patterns of the input space by clustering the data. On the other hand, nonlinear autoregressive (NAR) neural networks are powerful computational models for modeling and forecasting nonlinear time series. Taking the advantage of both methods, a new method was proposed combining k-means algorithm and NAR network to provide better forecasting results

  9. Singularity-Free Neural Control for the Exponential Trajectory Tracking in Multiple-Input Uncertain Systems with Unknown Deadzone Nonlinearities

    Directory of Open Access Journals (Sweden)

    J. Humberto Pérez-Cruz

    2014-01-01

    Full Text Available The trajectory tracking for a class of uncertain nonlinear systems in which the number of possible states is equal to the number of inputs and each input is preceded by an unknown symmetric deadzone is considered. The unknown dynamics is identified by means of a continuous time recurrent neural network in which the control singularity is conveniently avoided by guaranteeing the invertibility of the coupling matrix. Given this neural network-based mathematical model of the uncertain system, a singularity-free feedback linearization control law is developed in order to compel the system state to follow a reference trajectory. By means of Lyapunov-like analysis, the exponential convergence of the tracking error to a bounded zone can be proven. Likewise, the boundedness of all closed-loop signals can be guaranteed.

  10. Lukasiewicz-Topos Models of Neural Networks, Cell Genome and Interactome Nonlinear Dynamic Models

    CERN Document Server

    Baianu, I C

    2004-01-01

    A categorical and Lukasiewicz-Topos framework for Lukasiewicz Algebraic Logic models of nonlinear dynamics in complex functional systems such as neural networks, genomes and cell interactomes is proposed. Lukasiewicz Algebraic Logic models of genetic networks and signaling pathways in cells are formulated in terms of nonlinear dynamic systems with n-state components that allow for the generalization of previous logical models of both genetic activities and neural networks. An algebraic formulation of variable 'next-state functions' is extended to a Lukasiewicz Topos with an n-valued Lukasiewicz Algebraic Logic subobject classifier description that represents non-random and nonlinear network activities as well as their transformations in developmental processes and carcinogenesis.

  11. Adaptive Control of Nonlinear Discrete-Time Systems by Using OS-ELM Neural Networks

    Directory of Open Access Journals (Sweden)

    Xiao-Li Li

    2014-01-01

    Full Text Available As a kind of novel feedforward neural network with single hidden layer, ELM (extreme learning machine neural networks are studied for the identification and control of nonlinear dynamic systems. The property of simple structure and fast convergence of ELM can be shown clearly. In this paper, we are interested in adaptive control of nonlinear dynamic plants by using OS-ELM (online sequential extreme learning machine neural networks. Based on data scope division, the problem that training process of ELM neural network is sensitive to the initial training data is also solved. According to the output range of the controlled plant, the data corresponding to this range will be used to initialize ELM. Furthermore, due to the drawback of conventional adaptive control, when the OS-ELM neural network is used for adaptive control of the system with jumping parameters, the topological structure of the neural network can be adjusted dynamically by using multiple model switching strategy, and an MMAC (multiple model adaptive control will be used to improve the control performance. Simulation results are included to complement the theoretical results.

  12. Identification of Nonlinear Oscillatory Activity Embedded in Broadband Neural Signals

    Czech Academy of Sciences Publication Activity Database

    Vejmelka, Martin; Paluš, Milan; Šušmáková, K.

    2010-01-01

    Roč. 20, č. 2 (2010), s. 117-128 ISSN 0129-0657 R&D Projects: GA MŠk 7E08027 EU Projects: European Commission(XE) 200728 - BRAINSYNC Institutional research plan: CEZ:AV0Z10300504 Keywords : nonlinear dynamical systems * oscillations * random processes * time series analysis * EEG Subject RIV: FH - Neurology Impact factor: 4.237, year: 2010

  13. Robust nonlinear autoregressive moving average model parameter estimation using stochastic recurrent artificial neural networks

    DEFF Research Database (Denmark)

    Chon, K H; Hoyer, D; Armoundas, A A

    1999-01-01

    In this study, we introduce a new approach for estimating linear and nonlinear stochastic autoregressive moving average (ARMA) model parameters, given a corrupt signal, using artificial recurrent neural networks. This new approach is a two-step approach in which the parameters of the deterministic...... part of the stochastic ARMA model are first estimated via a three-layer artificial neural network (deterministic estimation step) and then reestimated using the prediction error as one of the inputs to the artificial neural networks in an iterative algorithm (stochastic estimation step). The prediction...... error is obtained by subtracting the corrupt signal of the estimated ARMA model obtained via the deterministic estimation step from the system output response. We present computer simulation examples to show the efficacy of the proposed stochastic recurrent neural network approach in obtaining accurate...

  14. Nonlinear Model Predictive Control Based on a Self-Organizing Recurrent Neural Network.

    Science.gov (United States)

    Han, Hong-Gui; Zhang, Lu; Hou, Ying; Qiao, Jun-Fei

    2016-02-01

    A nonlinear model predictive control (NMPC) scheme is developed in this paper based on a self-organizing recurrent radial basis function (SR-RBF) neural network, whose structure and parameters are adjusted concurrently in the training process. The proposed SR-RBF neural network is represented in a general nonlinear form for predicting the future dynamic behaviors of nonlinear systems. To improve the modeling accuracy, a spiking-based growing and pruning algorithm and an adaptive learning algorithm are developed to tune the structure and parameters of the SR-RBF neural network, respectively. Meanwhile, for the control problem, an improved gradient method is utilized for the solution of the optimization problem in NMPC. The stability of the resulting control system is proved based on the Lyapunov stability theory. Finally, the proposed SR-RBF neural network-based NMPC (SR-RBF-NMPC) is used to control the dissolved oxygen (DO) concentration in a wastewater treatment process (WWTP). Comparisons with other existing methods demonstrate that the SR-RBF-NMPC can achieve a considerably better model fitting for WWTP and a better control performance for DO concentration.

  15. Adaptive Neural Control of Nonaffine Nonlinear Systems without Differential Condition for Nonaffine Function

    Directory of Open Access Journals (Sweden)

    Chaojiao Sun

    2016-01-01

    Full Text Available An adaptive neural control scheme is proposed for nonaffine nonlinear system without using the implicit function theorem or mean value theorem. The differential conditions on nonaffine nonlinear functions are removed. The control-gain function is modeled with the nonaffine function probably being indifferentiable. Furthermore, only a semibounded condition for nonaffine nonlinear function is required in the proposed method, and the basic idea of invariant set theory is then constructively introduced to cope with the difficulty in the control design for nonaffine nonlinear systems. It is rigorously proved that all the closed-loop signals are bounded and the tracking error converges to a small residual set asymptotically. Finally, simulation examples are provided to demonstrate the effectiveness of the designed method.

  16. Identification of weak nonlinearities on damping and stiffness by the continuous wavelet transform

    Science.gov (United States)

    Ta, Minh-Nghi; Lardiès, Joseph

    2006-05-01

    We consider the free response of a nonlinear vibrating system. Using the ridges and skeletons of the continuous wavelet transform, we identify weak nonlinearities on damping and stiffness and estimate their physical parameters. The crucial choice of the son wavelet function is obtained using an optimization technique based on the entropy of the continuous wavelet transform. The method is applied to simulated single-degree-of-freedom systems and multi-degree-of-freedom systems with nonlinearities on damping and stiffness. Experimental validation of the nonlinear identification and parameter estimation method is presented. The experimental system is a clamped beam with nonlinearities on damping and stiffness and these nonlinearities are identified and quantified from a displacement sensor.

  17. Continuous dependence estimates for viscosity solutions of fully nonlinear degenerate elliptic equations

    Directory of Open Access Journals (Sweden)

    Espen R. Jakobsen

    2002-05-01

    Full Text Available Using the maximum principle for semicontinuous functions [3,4], we prove a general ``continuous dependence on the nonlinearities'' estimate for bounded Holder continuous viscosity solutions of fully nonlinear degenerate elliptic equations. Furthermore, we provide existence, uniqueness, and Holder continuity results for bounded viscosity solutions of such equations. Our results are general enough to encompass Hamilton-Jacobi-Bellman-Isaacs's equations of zero-sum, two-player stochastic differential games. An immediate consequence of the results obtained herein is a rate of convergence for the vanishing viscosity method for fully nonlinear degenerate elliptic equations.

  18. Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics

    Science.gov (United States)

    Lv, Yongfeng; Na, Jing; Yang, Qinmin; Wu, Xing; Guo, Yu

    2016-01-01

    An online adaptive optimal control is proposed for continuous-time nonlinear systems with completely unknown dynamics, which is achieved by developing a novel identifier-critic-based approximate dynamic programming algorithm with a dual neural network (NN) approximation structure. First, an adaptive NN identifier is designed to obviate the requirement of complete knowledge of system dynamics, and a critic NN is employed to approximate the optimal value function. Then, the optimal control law is computed based on the information from the identifier NN and the critic NN, so that the actor NN is not needed. In particular, a novel adaptive law design method with the parameter estimation error is proposed to online update the weights of both identifier NN and critic NN simultaneously, which converge to small neighbourhoods around their ideal values. The closed-loop system stability and the convergence to small vicinity around the optimal solution are all proved by means of the Lyapunov theory. The proposed adaptation algorithm is also improved to achieve finite-time convergence of the NN weights. Finally, simulation results are provided to exemplify the efficacy of the proposed methods.

  19. Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI

    Energy Technology Data Exchange (ETDEWEB)

    Olyaee, Saeed; Hamedi, Samaneh, E-mail: s_olyaee@srttu.edu [Nano-photonics and Optoelectronics Research Laboratory (NORLab), Faculty of Electrical and Computer Engineering, Shahid Rajaee Teacher Training University (SRTTU), Lavizan, 16788, Tehran (Iran, Islamic Republic of)

    2011-02-01

    In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.

  20. Adaptive Neural Tracking Control for Discrete-Time Switched Nonlinear Systems with Dead Zone Inputs

    Directory of Open Access Journals (Sweden)

    Jidong Wang

    2017-01-01

    Full Text Available In this paper, the adaptive neural controllers of subsystems are proposed for a class of discrete-time switched nonlinear systems with dead zone inputs under arbitrary switching signals. Due to the complicated framework of the discrete-time switched nonlinear systems and the existence of the dead zone, it brings about difficulties for controlling such a class of systems. In addition, the radial basis function neural networks are employed to approximate the unknown terms of each subsystem. Switched update laws are designed while the parameter estimation is invariable until its corresponding subsystem is active. Then, the closed-loop system is stable and all the signals are bounded. Finally, to illustrate the effectiveness of the proposed method, an example is employed.

  1. Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI

    International Nuclear Information System (INIS)

    Olyaee, Saeed; Hamedi, Samaneh

    2011-01-01

    In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.

  2. Non-Linear State Estimation Using Pre-Trained Neural Networks

    DEFF Research Database (Denmark)

    Bayramoglu, Enis; Andersen, Nils Axel; Ravn, Ole

    2010-01-01

    effecting the transformation. This function is approximated by a neural network using offline training. The training is based on monte carlo sampling. A way to obtain parametric distributions of flexible shape to be used easily with these networks is also presented. The method can also be used to improve...... other parametric methods around regions with strong non-linearities by including them inside the network....

  3. Experiments in nonlinear dynamics using control-based continuation: Tracking stable and unstable response curves

    DEFF Research Database (Denmark)

    Bureau, Emil; Schilder, Frank; Santos, Ilmar

    2014-01-01

    We show how to implement control-based continuation in a nonlinear experiment using existing and freely available software. We demonstrate that it is possible to track the complete frequency response, including the unstable branches, for a harmonically forced impact oscillator.......We show how to implement control-based continuation in a nonlinear experiment using existing and freely available software. We demonstrate that it is possible to track the complete frequency response, including the unstable branches, for a harmonically forced impact oscillator....

  4. A Unified Approach to Adaptive Neural Control for Nonlinear Discrete-Time Systems With Nonlinear Dead-Zone Input.

    Science.gov (United States)

    Liu, Yan-Jun; Gao, Ying; Tong, Shaocheng; Chen, C L Philip

    2016-01-01

    In this paper, an effective adaptive control approach is constructed to stabilize a class of nonlinear discrete-time systems, which contain unknown functions, unknown dead-zone input, and unknown control direction. Different from linear dead zone, the dead zone, in this paper, is a kind of nonlinear dead zone. To overcome the noncausal problem, which leads to the control scheme infeasible, the systems can be transformed into a m -step-ahead predictor. Due to nonlinear dead-zone appearance, the transformed predictor still contains the nonaffine function. In addition, it is assumed that the gain function of dead-zone input and the control direction are unknown. These conditions bring about the difficulties and the complicacy in the controller design. Thus, the implicit function theorem is applied to deal with nonaffine dead-zone appearance, the problem caused by the unknown control direction can be resolved through applying the discrete Nussbaum gain, and the neural networks are used to approximate the unknown function. Based on the Lyapunov theory, all the signals of the resulting closed-loop system are proved to be semiglobal uniformly ultimately bounded. Moreover, the tracking error is proved to be regulated to a small neighborhood around zero. The feasibility of the proposed approach is demonstrated by a simulation example.

  5. Fuzzy Counter Propagation Neural Network Control for a Class of Nonlinear Dynamical Systems.

    Science.gov (United States)

    Sakhre, Vandana; Jain, Sanjeev; Sapkal, Vilas S; Agarwal, Dev P

    2015-01-01

    Fuzzy Counter Propagation Neural Network (FCPN) controller design is developed, for a class of nonlinear dynamical systems. In this process, the weight connecting between the instar and outstar, that is, input-hidden and hidden-output layer, respectively, is adjusted by using Fuzzy Competitive Learning (FCL). FCL paradigm adopts the principle of learning, which is used to calculate Best Matched Node (BMN) which is proposed. This strategy offers a robust control of nonlinear dynamical systems. FCPN is compared with the existing network like Dynamic Network (DN) and Back Propagation Network (BPN) on the basis of Mean Absolute Error (MAE), Mean Square Error (MSE), Best Fit Rate (BFR), and so forth. It envisages that the proposed FCPN gives better results than DN and BPN. The effectiveness of the proposed FCPN algorithms is demonstrated through simulations of four nonlinear dynamical systems and multiple input and single output (MISO) and a single input and single output (SISO) gas furnace Box-Jenkins time series data.

  6. Robust model predictive control for constrained continuous-time nonlinear systems

    Science.gov (United States)

    Sun, Tairen; Pan, Yongping; Zhang, Jun; Yu, Haoyong

    2018-02-01

    In this paper, a robust model predictive control (MPC) is designed for a class of constrained continuous-time nonlinear systems with bounded additive disturbances. The robust MPC consists of a nonlinear feedback control and a continuous-time model-based dual-mode MPC. The nonlinear feedback control guarantees the actual trajectory being contained in a tube centred at the nominal trajectory. The dual-mode MPC is designed to ensure asymptotic convergence of the nominal trajectory to zero. This paper extends current results on discrete-time model-based tube MPC and linear system model-based tube MPC to continuous-time nonlinear model-based tube MPC. The feasibility and robustness of the proposed robust MPC have been demonstrated by theoretical analysis and applications to a cart-damper springer system and a one-link robot manipulator.

  7. Global dissipativity of continuous-time recurrent neural networks with time delay

    International Nuclear Information System (INIS)

    Liao Xiaoxin; Wang Jun

    2003-01-01

    This paper addresses the global dissipativity of a general class of continuous-time recurrent neural networks. First, the concepts of global dissipation and global exponential dissipation are defined and elaborated. Next, the sets of global dissipativity and global exponentially dissipativity are characterized using the parameters of recurrent neural network models. In particular, it is shown that the Hopfield network and cellular neural networks with or without time delays are dissipative systems

  8. Analysis on evaluation ability of nonlinear safety assessment model of coal mines based on artificial neural network

    Institute of Scientific and Technical Information of China (English)

    SHI Shi-liang; LIU Hai-bo; LIU Ai-hua

    2004-01-01

    Based on the integration analysis of goods and shortcomings of various methods used in safety assessment of coal mines, combining nonlinear feature of mine safety sub-system, this paper establishes the neural network assessment model of mine safety, analyzes the ability of artificial neural network to evaluate mine safety state, and lays the theoretical foundation of artificial neural network using in the systematic optimization of mine safety assessment and getting reasonable accurate safety assessment result.

  9. Exact solutions of nonlinear differential equations using continued fractions

    International Nuclear Information System (INIS)

    Ditto, W.L.; Pickett, T.J.

    1990-01-01

    The continued-fraction conversion method (J. Math. Phys. (N.Y.), 29, 1761 (1988)) is used to generate a homologous family of exact solutions to the Lane-Emden equation φ(r) '' + 2φ(r)'/r + αφ(r) p = 0, for p=5. An exact solution is also obtained for a generalization of the Lane-Emden equation of the form -φ '' (r) -2φ(r)'/r + αφ(r) 2p+1 + λφ(r) 4p+1 = 0 for arbitrary α, γ and p. A condition is established for the generation of exact solutions from the method

  10. Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints.

    Science.gov (United States)

    Liu, Derong; Yang, Xiong; Wang, Ding; Wei, Qinglai

    2015-07-01

    The design of stabilizing controller for uncertain nonlinear systems with control constraints is a challenging problem. The constrained-input coupled with the inability to identify accurately the uncertainties motivates the design of stabilizing controller based on reinforcement-learning (RL) methods. In this paper, a novel RL-based robust adaptive control algorithm is developed for a class of continuous-time uncertain nonlinear systems subject to input constraints. The robust control problem is converted to the constrained optimal control problem with appropriately selecting value functions for the nominal system. Distinct from typical action-critic dual networks employed in RL, only one critic neural network (NN) is constructed to derive the approximate optimal control. Meanwhile, unlike initial stabilizing control often indispensable in RL, there is no special requirement imposed on the initial control. By utilizing Lyapunov's direct method, the closed-loop optimal control system and the estimated weights of the critic NN are proved to be uniformly ultimately bounded. In addition, the derived approximate optimal control is verified to guarantee the uncertain nonlinear system to be stable in the sense of uniform ultimate boundedness. Two simulation examples are provided to illustrate the effectiveness and applicability of the present approach.

  11. Switched-Observer-Based Adaptive Neural Control of MIMO Switched Nonlinear Systems With Unknown Control Gains.

    Science.gov (United States)

    Long, Lijun; Zhao, Jun

    2017-07-01

    In this paper, the problem of adaptive neural output-feedback control is addressed for a class of multi-input multioutput (MIMO) switched uncertain nonlinear systems with unknown control gains. Neural networks (NNs) are used to approximate unknown nonlinear functions. In order to avoid the conservativeness caused by adoption of a common observer for all subsystems, an MIMO NN switched observer is designed to estimate unmeasurable states. A new switched observer-based adaptive neural control technique for the problem studied is then provided by exploiting the classical average dwell time (ADT) method and the backstepping method and the Nussbaum gain technique. It effectively handles the obstacle about the coexistence of multiple Nussbaum-type function terms, and improves the classical ADT method, since the exponential decline property of Lyapunov functions for individual subsystems is no longer satisfied. It is shown that the technique proposed is able to guarantee semiglobal uniformly ultimately boundedness of all the signals in the closed-loop system under a class of switching signals with ADT, and the tracking errors converge to a small neighborhood of the origin. The effectiveness of the approach proposed is illustrated by its application to a two inverted pendulum system.

  12. Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion.

    Science.gov (United States)

    Kumar, Rajesh; Srivastava, Smriti; Gupta, J R P

    2017-03-01

    In this paper adaptive control of nonlinear dynamical systems using diagonal recurrent neural network (DRNN) is proposed. The structure of DRNN is a modification of fully connected recurrent neural network (FCRNN). Presence of self-recurrent neurons in the hidden layer of DRNN gives it an ability to capture the dynamic behaviour of the nonlinear plant under consideration (to be controlled). To ensure stability, update rules are developed using lyapunov stability criterion. These rules are then used for adjusting the various parameters of DRNN. The responses of plants obtained with DRNN are compared with those obtained when multi-layer feed forward neural network (MLFFNN) is used as a controller. Also, in example 4, FCRNN is also investigated and compared with DRNN and MLFFNN. Robustness of the proposed control scheme is also tested against parameter variations and disturbance signals. Four simulation examples including one-link robotic manipulator and inverted pendulum are considered on which the proposed controller is applied. The results so obtained show the superiority of DRNN over MLFFNN as a controller. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

  13. Bifurcation analysis and spatio-temporal patterns of nonlinear oscillations in a delayed neural network with unidirectional coupling

    International Nuclear Information System (INIS)

    Song Yongli; Tadé, Moses O; Zhang Tonghua

    2009-01-01

    In this paper, a delayed neural network with unidirectional coupling is considered which consists of two two-dimensional nonlinear differential equation systems with exponential decay where one system receives a delayed input from the other system. Some parameter regions are given for conditional/absolute stability and Hopf bifurcations by using the theory of functional differential equations. Conditions ensuring the stability and direction of the Hopf bifurcation are determined by applying the normal form theory and the centre manifold theorem. We also investigate the spatio-temporal patterns of bifurcating periodic oscillations by using the symmetric bifurcation theory of delay-differential equations combined with representation theory of Lie groups. Then the global continuation of phase-locked periodic solutions is investigated. Numerical simulations are given to illustrate the results obtained

  14. E-I balance emerges naturally from continuous Hebbian learning in autonomous neural networks.

    Science.gov (United States)

    Trapp, Philip; Echeveste, Rodrigo; Gros, Claudius

    2018-06-12

    Spontaneous brain activity is characterized in part by a balanced asynchronous chaotic state. Cortical recordings show that excitatory (E) and inhibitory (I) drivings in the E-I balanced state are substantially larger than the overall input. We show that such a state arises naturally in fully adapting networks which are deterministic, autonomously active and not subject to stochastic external or internal drivings. Temporary imbalances between excitatory and inhibitory inputs lead to large but short-lived activity bursts that stabilize irregular dynamics. We simulate autonomous networks of rate-encoding neurons for which all synaptic weights are plastic and subject to a Hebbian plasticity rule, the flux rule, that can be derived from the stationarity principle of statistical learning. Moreover, the average firing rate is regulated individually via a standard homeostatic adaption of the bias of each neuron's input-output non-linear function. Additionally, networks with and without short-term plasticity are considered. E-I balance may arise only when the mean excitatory and inhibitory weights are themselves balanced, modulo the overall activity level. We show that synaptic weight balance, which has been considered hitherto as given, naturally arises in autonomous neural networks when the here considered self-limiting Hebbian synaptic plasticity rule is continuously active.

  15. Analytic continuation of solutions of some nonlinear convolution partial differential equations

    Directory of Open Access Journals (Sweden)

    Hidetoshi Tahara

    2015-01-01

    Full Text Available The paper considers a problem of analytic continuation of solutions of some nonlinear convolution partial differential equations which naturally appear in the summability theory of formal solutions of nonlinear partial differential equations. Under a suitable assumption it is proved that any local holomorphic solution has an analytic extension to a certain sector and its extension has exponential growth when the variable goes to infinity in the sector.

  16. Generating entangled states of continuous variables via cross-Kerr nonlinearity

    Energy Technology Data Exchange (ETDEWEB)

    Zhang Zhiming [Center for Quantum Physics, COMSATS Institute of Information Technology, Islamabad (Pakistan); Khosa, Ashfaq H [Center for Quantum Physics, COMSATS Institute of Information Technology, Islamabad (Pakistan); Ikram, Manzoor [Center for Quantum Physics, COMSATS Institute of Information Technology, Islamabad (Pakistan); Zubairy, M Suhail [Center for Quantum Physics, COMSATS Institute of Information Technology, Islamabad (Pakistan)

    2007-05-28

    We propose a scheme for generating entanglement of quantum states with continuous variables (coherent states and squeezed vacuum states) of electromagnetical fields. The scheme involves cross-Kerr nonlinearity. It was shown that the cross-Kerr nonlinearity required for generating the superposition and entanglement of squeezed vacuum states is smaller than that required for coherent states. It was also found that the fidelity monotonously decreases with both the increase of the amplitude of the input coherent field and the increase of the deviation of the nonlinear phase shift from {pi}.

  17. Nonlinear analysis and synthesis of video images using deep dynamic bottleneck neural networks for face recognition.

    Science.gov (United States)

    Moghadam, Saeed Montazeri; Seyyedsalehi, Seyyed Ali

    2018-05-31

    Nonlinear components extracted from deep structures of bottleneck neural networks exhibit a great ability to express input space in a low-dimensional manifold. Sharing and combining the components boost the capability of the neural networks to synthesize and interpolate new and imaginary data. This synthesis is possibly a simple model of imaginations in human brain where the components are expressed in a nonlinear low dimensional manifold. The current paper introduces a novel Dynamic Deep Bottleneck Neural Network to analyze and extract three main features of videos regarding the expression of emotions on the face. These main features are identity, emotion and expression intensity that are laid in three different sub-manifolds of one nonlinear general manifold. The proposed model enjoying the advantages of recurrent networks was used to analyze the sequence and dynamics of information in videos. It is noteworthy to mention that this model also has also the potential to synthesize new videos showing variations of one specific emotion on the face of unknown subjects. Experiments on discrimination and recognition ability of extracted components showed that the proposed model has an average of 97.77% accuracy in recognition of six prominent emotions (Fear, Surprise, Sadness, Anger, Disgust, and Happiness), and 78.17% accuracy in the recognition of intensity. The produced videos revealed variations from neutral to the apex of an emotion on the face of the unfamiliar test subject which is on average 0.8 similar to reference videos in the scale of the SSIM method. Copyright © 2018 Elsevier Ltd. All rights reserved.

  18. Neural networks for tracking of unknown SISO discrete-time nonlinear dynamic systems.

    Science.gov (United States)

    Aftab, Muhammad Saleheen; Shafiq, Muhammad

    2015-11-01

    This article presents a Lyapunov function based neural network tracking (LNT) strategy for single-input, single-output (SISO) discrete-time nonlinear dynamic systems. The proposed LNT architecture is composed of two feedforward neural networks operating as controller and estimator. A Lyapunov function based back propagation learning algorithm is used for online adjustment of the controller and estimator parameters. The controller and estimator error convergence and closed-loop system stability analysis is performed by Lyapunov stability theory. Moreover, two simulation examples and one real-time experiment are investigated as case studies. The achieved results successfully validate the controller performance. Copyright © 2015 ISA. Published by Elsevier Ltd. All rights reserved.

  19. Linear and Non-linear Multi-Input Multi-Output Model Predictive Control of Continuous Stirred Tank Reactor

    Directory of Open Access Journals (Sweden)

    Muayad Al-Qaisy

    2015-02-01

    Full Text Available In this article, multi-input multi-output (MIMO linear model predictive controller (LMPC based on state space model and nonlinear model predictive controller based on neural network (NNMPC are applied on a continuous stirred tank reactor (CSTR. The idea is to have a good control system that will be able to give optimal performance, reject high load disturbance, and track set point change. In order to study the performance of the two model predictive controllers, MIMO Proportional-Integral-Derivative controller (PID strategy is used as benchmark. The LMPC, NNMPC, and PID strategies are used for controlling the residual concentration (CA and reactor temperature (T. NNMPC control shows a superior performance over the LMPC and PID controllers by presenting a smaller overshoot and shorter settling time.

  20. Recurrent fuzzy neural network backstepping control for the prescribed output tracking performance of nonlinear dynamic systems.

    Science.gov (United States)

    Han, Seong-Ik; Lee, Jang-Myung

    2014-01-01

    This paper proposes a backstepping control system that uses a tracking error constraint and recurrent fuzzy neural networks (RFNNs) to achieve a prescribed tracking performance for a strict-feedback nonlinear dynamic system. A new constraint variable was defined to generate the virtual control that forces the tracking error to fall within prescribed boundaries. An adaptive RFNN was also used to obtain the required improvement on the approximation performances in order to avoid calculating the explosive number of terms generated by the recursive steps of traditional backstepping control. The boundedness and convergence of the closed-loop system was confirmed based on the Lyapunov stability theory. The prescribed performance of the proposed control scheme was validated by using it to control the prescribed error of a nonlinear system and a robot manipulator. © 2013 ISA. Published by Elsevier Ltd. All rights reserved.

  1. TCSC Nonlinear Adaptive Damping Controller Design Based on RBF Neural Network to Enhance Power System Stability

    DEFF Research Database (Denmark)

    Yao, Wei; Fang, Jiakun; Zhao, Ping

    2013-01-01

    the characteristics of the conventional PID, but adjust the parameters of PID controller online using identified Jacobian information from RBFNN. Hence, it has strong adaptability to the variation of the system operating condition. The effectiveness of the proposed controller is tested on a two-machine five-bus power...... system and a four-machine two-area power system under different operating conditions in comparison with the lead-lag damping controller tuned by evolutionary algorithm (EA). Simulation results show that the proposed damping controller achieves good robust performance for damping the low frequency......In this paper, a nonlinear adaptive damping controller based on radial basis function neural network (RBFNN), which can infinitely approximate to nonlinear system, is proposed for thyristor controlled series capacitor (TCSC). The proposed TCSC adaptive damping controller can not only have...

  2. Event-Based Impulsive Control of Continuous-Time Dynamic Systems and Its Application to Synchronization of Memristive Neural Networks.

    Science.gov (United States)

    Zhu, Wei; Wang, Dandan; Liu, Lu; Feng, Gang

    2017-08-18

    This paper investigates exponential stabilization of continuous-time dynamic systems (CDSs) via event-based impulsive control (EIC) approaches, where the impulsive instants are determined by certain state-dependent triggering condition. The global exponential stability criteria via EIC are derived for nonlinear and linear CDSs, respectively. It is also shown that there is no Zeno-behavior for the concerned closed loop control system. In addition, the developed event-based impulsive scheme is applied to the synchronization problem of master and slave memristive neural networks. Furthermore, a self-triggered impulsive control scheme is developed to avoid continuous communication between the master system and slave system. Finally, two numerical simulation examples are presented to illustrate the effectiveness of the proposed event-based impulsive controllers.

  3. A Comparative Study of Neural Networks and Fuzzy Systems in Modeling of a Nonlinear Dynamic System

    Directory of Open Access Journals (Sweden)

    Metin Demirtas

    2011-07-01

    Full Text Available The aim of this paper is to compare the neural networks and fuzzy modeling approaches on a nonlinear system. We have taken Permanent Magnet Brushless Direct Current (PMBDC motor data and have generated models using both approaches. The predictive performance of both methods was compared on the data set for model configurations. The paper describes the results of these tests and discusses the effects of changing model parameters on predictive and practical performance. Modeling sensitivity was used to compare for two methods.

  4. Pre-Trained Neural Networks used for Non-Linear State Estimation

    DEFF Research Database (Denmark)

    Bayramoglu, Enis; Andersen, Nils Axel; Ravn, Ole

    2011-01-01

    of the paramters in the distribution. This transformation is approximated by a neural network using offline training, which is based on monte carlo sampling. In the paper, there will also be presented a method to construct a flexible distributions well suited for covering the effect of the non-linearities......The paper focuses on nonlinear state estimation assuming non-Gaussian distributions of the states and the disturbances. The posterior distribution and the aposteriori distribution is described by a chosen family of paramtric distributions. The state transformation then results in a transformation...

  5. Nonlinear Inference in Partially Observed Physical Systems and Deep Neural Networks

    Science.gov (United States)

    Rozdeba, Paul J.

    The problem of model state and parameter estimation is a significant challenge in nonlinear systems. Due to practical considerations of experimental design, it is often the case that physical systems are partially observed, meaning that data is only available for a subset of the degrees of freedom required to fully model the observed system's behaviors and, ultimately, predict future observations. Estimation in this context is highly complicated by the presence of chaos, stochasticity, and measurement noise in dynamical systems. One of the aims of this dissertation is to simultaneously analyze state and parameter estimation in as a regularized inverse problem, where the introduction of a model makes it possible to reverse the forward problem of partial, noisy observation; and as a statistical inference problem using data assimilation to transfer information from measurements to the model states and parameters. Ultimately these two formulations achieve the same goal. Similar aspects that appear in both are highlighted as a means for better understanding the structure of the nonlinear inference problem. An alternative approach to data assimilation that uses model reduction is then examined as a way to eliminate unresolved nonlinear gating variables from neuron models. In this formulation, only measured variables enter into the model, and the resulting errors are themselves modeled by nonlinear stochastic processes with memory. Finally, variational annealing, a data assimilation method previously applied to dynamical systems, is introduced as a potentially useful tool for understanding deep neural network training in machine learning by exploiting similarities between the two problems.

  6. Nonlinear 2D arm dynamics in response to continuous and pulse-shaped force perturbations.

    Science.gov (United States)

    Happee, Riender; de Vlugt, Erwin; van Vliet, Bart

    2015-01-01

    Ample evidence exists regarding the nonlinearity of the neuromuscular system but linear models are widely applied to capture postural dynamics. This study quantifies the nonlinearity of human arm postural dynamics applying 2D continuous force perturbations (0.2-40 Hz) inducing three levels of hand displacement (5, 15, 45 mm RMS) followed by force-pulse perturbations inducing large hand displacements (up to 250 mm) in a position task (PT) and a relax task (RT) recording activity of eight shoulder and elbow muscles. The continuous perturbation data were used to analyze the 2D endpoint dynamics in the frequency domain and to identify reflexive and intrinsic parameters of a linear neuromuscular shoulder-elbow model. Subsequently, it was assessed to what extent the large displacements in response to force pulses could be predicted from the 'small amplitude' linear neuromuscular model. Continuous and pulse perturbation responses with varying amplitudes disclosed highly nonlinear effects. In PT, a larger continuous perturbation induced stiffening with a factor of 1.5 attributed to task adaptation evidenced by increased co-contraction and reflexive activity. This task adaptation was even more profound in the pulse responses where reflexes and displacements were strongly affected by the presence and amplitude of preceding continuous perturbations. In RT, a larger continuous perturbation resulted in yielding with a factor of 3.8 attributed to nonlinear mechanical properties as no significant reflexive activity was found. Pulse perturbations always resulted in yielding where a model fitted to the preceding 5-mm continuous perturbations predicted only 37% of the recorded peak displacements in RT and 79% in PT. This demonstrates that linear neuromuscular models, identified using continuous perturbations with small amplitudes, strongly underestimate displacements in pulse-shaped (e.g., impact) loading conditions. The data will be used to validate neuromuscular models including

  7. Universal continuous-variable quantum computation: Requirement of optical nonlinearity for photon counting

    International Nuclear Information System (INIS)

    Bartlett, Stephen D.; Sanders, Barry C.

    2002-01-01

    Although universal continuous-variable quantum computation cannot be achieved via linear optics (including squeezing), homodyne detection, and feed-forward, inclusion of ideal photon-counting measurements overcomes this obstacle. These measurements are sometimes described by arrays of beam splitters to distribute the photons across several modes. We show that such a scheme cannot be used to implement ideal photon counting and that such measurements necessarily involve nonlinear evolution. However, this requirement of nonlinearity can be moved ''off-line,'' thereby permitting universal continuous-variable quantum computation with linear optics

  8. Nonlinear recurrent neural networks for finite-time solution of general time-varying linear matrix equations.

    Science.gov (United States)

    Xiao, Lin; Liao, Bolin; Li, Shuai; Chen, Ke

    2018-02-01

    In order to solve general time-varying linear matrix equations (LMEs) more efficiently, this paper proposes two nonlinear recurrent neural networks based on two nonlinear activation functions. According to Lyapunov theory, such two nonlinear recurrent neural networks are proved to be convergent within finite-time. Besides, by solving differential equation, the upper bounds of the finite convergence time are determined analytically. Compared with existing recurrent neural networks, the proposed two nonlinear recurrent neural networks have a better convergence property (i.e., the upper bound is lower), and thus the accurate solutions of general time-varying LMEs can be obtained with less time. At last, various different situations have been considered by setting different coefficient matrices of general time-varying LMEs and a great variety of computer simulations (including the application to robot manipulators) have been conducted to validate the better finite-time convergence of the proposed two nonlinear recurrent neural networks. Copyright © 2017 Elsevier Ltd. All rights reserved.

  9. Fuzzy Wavelet Neural Network Using a Correntropy Criterion for Nonlinear System Identification

    Directory of Open Access Journals (Sweden)

    Leandro L. S. Linhares

    2015-01-01

    Full Text Available Recent researches have demonstrated that the Fuzzy Wavelet Neural Networks (FWNNs are an efficient tool to identify nonlinear systems. In these structures, features related to fuzzy logic, wavelet functions, and neural networks are combined in an architecture similar to the Adaptive Neurofuzzy Inference Systems (ANFIS. In practical applications, the experimental data set used in the identification task often contains unknown noise and outliers, which decrease the FWNN model reliability. In order to reduce the negative effects of these erroneous measurements, this work proposes the direct use of a similarity measure based on information theory in the FWNN learning procedure. The Mean Squared Error (MSE cost function is replaced by the Maximum Correntropy Criterion (MCC in the traditional error backpropagation (BP algorithm. The input-output maps of a real nonlinear system studied in this work are identified from an experimental data set corrupted by different outliers rates and additive white Gaussian noise. The results demonstrate the advantages of the proposed cost function using the MCC as compared to the MSE. This work also investigates the influence of the kernel size on the performance of the MCC in the BP algorithm, since it is the only free parameter of correntropy.

  10. Breakout Prediction Based on BP Neural Network in Continuous Casting Process

    Directory of Open Access Journals (Sweden)

    Zhang Ben-guo

    2016-01-01

    Full Text Available An improved BP neural network model was presented by modifying the learning algorithm of the traditional BP neural network, based on the Levenberg-Marquardt algorithm, and was applied to the breakout prediction system in the continuous casting process. The results showed that the accuracy rate of the model for the temperature pattern of sticking breakout was 96.43%, and the quote rate was 100%, that verified the feasibility of the model.

  11. Numerical tools for musical instruments acoustics: analysing nonlinear physical models using continuation of periodic solutions

    OpenAIRE

    Karkar , Sami; Vergez , Christophe; Cochelin , Bruno

    2012-01-01

    International audience; We propose a new approach based on numerical continuation and bifurcation analysis for the study of physical models of instruments that produce self- sustained oscillation. Numerical continuation consists in following how a given solution of a set of equations is modified when one (or several) parameter of these equations are allowed to vary. Several physical models (clarinet, saxophone, and violin) are formulated as nonlinear dynamical systems, whose periodic solution...

  12. Adaptive Backstepping-Based Neural Tracking Control for MIMO Nonlinear Switched Systems Subject to Input Delays.

    Science.gov (United States)

    Niu, Ben; Li, Lu

    2018-06-01

    This brief proposes a new neural-network (NN)-based adaptive output tracking control scheme for a class of disturbed multiple-input multiple-output uncertain nonlinear switched systems with input delays. By combining the universal approximation ability of radial basis function NNs and adaptive backstepping recursive design with an improved multiple Lyapunov function (MLF) scheme, a novel adaptive neural output tracking controller design method is presented for the switched system. The feature of the developed design is that different coordinate transformations are adopted to overcome the conservativeness caused by adopting a common coordinate transformation for all subsystems. It is shown that all the variables of the resulting closed-loop system are semiglobally uniformly ultimately bounded under a class of switching signals in the presence of MLF and that the system output can follow the desired reference signal. To demonstrate the practicability of the obtained result, an adaptive neural output tracking controller is designed for a mass-spring-damper system.

  13. Pseudo-transient Continuation Based Variable Relaxation Solve in Nonlinear Magnetohydrodynamic Simulations

    Energy Technology Data Exchange (ETDEWEB)

    Jin Chen

    2009-12-07

    Efficient and robust Variable Relaxation Solver, based on pseudo-transient continuation, is developed to solve nonlinear anisotropic thermal conduction arising from fusion plasma simulations. By adding first and/or second order artificial time derivatives to the system, this type of method advances the resulting time-dependent nonlinear PDEs to steady state, which is the solution to be sought. In this process, only the stiffness matrix itself is involved so that the numerical complexity and errors can be greatly reduced. In fact, this work is an extension of integrating efficient linear elliptic solvers for fusion simulation on Cray XIE. Two schemes are derived in this work, first and second order Variable Relaxations. Four factors are observed to be critical for efficiency and preservation of solution's symmetric structure arising from periodic boundary condition: refining meshes in different coordinate directions, initializing nonlinear process, varying time steps in both temporal and spatial directions, and accurately generating nonlinear stiffness matrix. First finer mesh scale should be taken in strong transport direction; Next the system is carefully initialized by the solution with linear conductivity; Third, time step and relaxation factor are vertex-based varied and optimized at each time step; Finally, the nonlinear stiffness matrix is updated by just scaling corresponding linear one with the vector generated from nonlinear thermal conductivity.

  14. Pseudo-transient Continuation Based Variable Relaxation Solve in Nonlinear Magnetohydrodynamic Simulations

    International Nuclear Information System (INIS)

    Chen, Jin

    2009-01-01

    Efficient and robust Variable Relaxation Solver, based on pseudo-transient continuation, is developed to solve nonlinear anisotropic thermal conduction arising from fusion plasma simulations. By adding first and/or second order artificial time derivatives to the system, this type of method advances the resulting time-dependent nonlinear PDEs to steady state, which is the solution to be sought. In this process, only the stiffness matrix itself is involved so that the numerical complexity and errors can be greatly reduced. In fact, this work is an extension of integrating efficient linear elliptic solvers for fusion simulation on Cray XIE. Two schemes are derived in this work, first and second order Variable Relaxations. Four factors are observed to be critical for efficiency and preservation of solution's symmetric structure arising from periodic boundary condition: refining meshes in different coordinate directions, initializing nonlinear process, varying time steps in both temporal and spatial directions, and accurately generating nonlinear stiffness matrix. First finer mesh scale should be taken in strong transport direction; Next the system is carefully initialized by the solution with linear conductivity; Third, time step and relaxation factor are vertex-based varied and optimized at each time step; Finally, the nonlinear stiffness matrix is updated by just scaling corresponding linear one with the vector generated from nonlinear thermal conductivity.

  15. Robust model predictive control of nonlinear systems with unmodeled dynamics and bounded uncertainties based on neural networks.

    Science.gov (United States)

    Yan, Zheng; Wang, Jun

    2014-03-01

    This paper presents a neural network approach to robust model predictive control (MPC) for constrained discrete-time nonlinear systems with unmodeled dynamics affected by bounded uncertainties. The exact nonlinear model of underlying process is not precisely known, but a partially known nominal model is available. This partially known nonlinear model is first decomposed to an affine term plus an unknown high-order term via Jacobian linearization. The linearization residue combined with unmodeled dynamics is then modeled using an extreme learning machine via supervised learning. The minimax methodology is exploited to deal with bounded uncertainties. The minimax optimization problem is reformulated as a convex minimization problem and is iteratively solved by a two-layer recurrent neural network. The proposed neurodynamic approach to nonlinear MPC improves the computational efficiency and sheds a light for real-time implementability of MPC technology. Simulation results are provided to substantiate the effectiveness and characteristics of the proposed approach.

  16. Neural Network Based Finite-Time Stabilization for Discrete-Time Markov Jump Nonlinear Systems with Time Delays

    Directory of Open Access Journals (Sweden)

    Fei Chen

    2013-01-01

    Full Text Available This paper deals with the finite-time stabilization problem for discrete-time Markov jump nonlinear systems with time delays and norm-bounded exogenous disturbance. The nonlinearities in different jump modes are parameterized by neural networks. Subsequently, a linear difference inclusion state space representation for a class of neural networks is established. Based on this, sufficient conditions are derived in terms of linear matrix inequalities to guarantee stochastic finite-time boundedness and stochastic finite-time stabilization of the closed-loop system. A numerical example is illustrated to verify the efficiency of the proposed technique.

  17. Real-time neural network-based self-tuning control of a nonlinear electro-hydraulic servomotor

    Energy Technology Data Exchange (ETDEWEB)

    Canelon, J.I.; Ortega, A.G. [Univ. del Zulia, Maracaibo, Zulia (Venezuela, Bolivarian Republic of). School of Electrical Engineering; Shieh, L.S. [Houston Univ., Houston, TX (United States). Dept. of Electrical and Computer Engineering; Bastidas, J.I. [Univ. del Zulia, Maracaibo, Zulia (Venezuela, Bolivarian Republic of). School of Mechanical Engineering; Zhang, Y.; Akujuobi, C.M. [Prairie View A and M Univ., Prairie View, TX (United States). Center of Excellence for Communication Systems Technology Research and Dept. of Engineering Technology

    2010-08-13

    For high power applications, hydraulic actuators offer many advantages over electromagnetic actuators, including higher torque/mass ratios; smaller control gains; excellent torque capability; filtered high frequency noise; better heat transfer characteristics; smaller size; higher speed of response of the servomechanism; cheaper hardware; and higher reliability. Therefore, any application that requires a large force applied smoothly by an actuator is a candidate for hydraulic power. Examples of such applications include vehicle steering and braking systems; roll mills; drilling rigs; heavy duty crane and presses; and industrial robots and actuators for aircraft control surfaces such as ailerons and flaps. It is extremely important to create effective control strategies for hydraulic systems. This paper outlined the real-time implementation of a neural network-based approach, for self-tuning control of the angular position of a nonlinear electro-hydraulic servomotor. Using an online training algorithm, a neural network autoregressive moving-average model with exogenous input (ARMAX) model of the system was identified and continuously updated and an optimal linear ARMAX model was determined. The paper briefly depicted the neural network-based self-tuning control approach and a description of the experimental equipment (hardware and software) was presented including the implementation details. The experimental results were discussed and conclusions were summarized. It was found that the approach proved to be very effective in the control of this fast dynamics system, outperforming a fine tuned PI controller. Therefore, although the self-tuning approach was computationally demanding, it was feasible for real-time implementation. 22 refs., 6 figs.

  18. Fuzzy Counter Propagation Neural Network Control for a Class of Nonlinear Dynamical Systems

    Directory of Open Access Journals (Sweden)

    Vandana Sakhre

    2015-01-01

    Full Text Available Fuzzy Counter Propagation Neural Network (FCPN controller design is developed, for a class of nonlinear dynamical systems. In this process, the weight connecting between the instar and outstar, that is, input-hidden and hidden-output layer, respectively, is adjusted by using Fuzzy Competitive Learning (FCL. FCL paradigm adopts the principle of learning, which is used to calculate Best Matched Node (BMN which is proposed. This strategy offers a robust control of nonlinear dynamical systems. FCPN is compared with the existing network like Dynamic Network (DN and Back Propagation Network (BPN on the basis of Mean Absolute Error (MAE, Mean Square Error (MSE, Best Fit Rate (BFR, and so forth. It envisages that the proposed FCPN gives better results than DN and BPN. The effectiveness of the proposed FCPN algorithms is demonstrated through simulations of four nonlinear dynamical systems and multiple input and single output (MISO and a single input and single output (SISO gas furnace Box-Jenkins time series data.

  19. Comparison of three nonlinear filters for fault detection in continuous glucose monitors.

    Science.gov (United States)

    Mahmoudi, Zeinab; Wendt, Sabrina Lyngbye; Boiroux, Dimitri; Hagdrup, Morten; Norgaard, Kirsten; Poulsen, Niels Kjolstad; Madsen, Henrik; Jorgensen, John Bagterp

    2016-08-01

    The purpose of this study is to compare the performance of three nonlinear filters in online drift detection of continuous glucose monitors. The nonlinear filters are the extended Kalman filter (EKF), the unscented Kalman filter (UKF), and the particle filter (PF). They are all based on a nonlinear model of the glucose-insulin dynamics in people with type 1 diabetes. Drift is modelled by a Gaussian random walk and is detected based on the statistical tests of the 90-min prediction residuals of the filters. The unscented Kalman filter had the highest average F score of 85.9%, and the smallest average detection delay of 84.1%, with the average detection sensitivity of 82.6%, and average specificity of 91.0%.

  20. Lexical decoder for continuous speech recognition: sequential neural network approach

    International Nuclear Information System (INIS)

    Iooss, Christine

    1991-01-01

    The work presented in this dissertation concerns the study of a connectionist architecture to treat sequential inputs. In this context, the model proposed by J.L. Elman, a recurrent multilayers network, is used. Its abilities and its limits are evaluated. Modifications are done in order to treat erroneous or noisy sequential inputs and to classify patterns. The application context of this study concerns the realisation of a lexical decoder for analytical multi-speakers continuous speech recognition. Lexical decoding is completed from lattices of phonemes which are obtained after an acoustic-phonetic decoding stage relying on a K Nearest Neighbors search technique. Test are done on sentences formed from a lexicon of 20 words. The results are obtained show the ability of the proposed connectionist model to take into account the sequentiality at the input level, to memorize the context and to treat noisy or erroneous inputs. (author) [fr

  1. Voice reinstatement modulates neural indices of continuous word recognition.

    Science.gov (United States)

    Campeanu, Sandra; Craik, Fergus I M; Backer, Kristina C; Alain, Claude

    2014-09-01

    The present study was designed to examine listeners' ability to use voice information incidentally during spoken word recognition. We recorded event-related brain potentials (ERPs) during a continuous recognition paradigm in which participants indicated on each trial whether the spoken word was "new" or "old." Old items were presented at 2, 8 or 16 words following the first presentation. Context congruency was manipulated by having the same word repeated by either the same speaker or a different speaker. The different speaker could share the gender, accent or neither feature with the word presented the first time. Participants' accuracy was greatest when the old word was spoken by the same speaker than by a different speaker. In addition, accuracy decreased with increasing lag. The correct identification of old words was accompanied by an enhanced late positivity over parietal sites, with no difference found between voice congruency conditions. In contrast, an earlier voice reinstatement effect was observed over frontal sites, an index of priming that preceded recollection in this task. Our results provide further evidence that acoustic and semantic information are integrated into a unified trace and that acoustic information facilitates spoken word recollection. Copyright © 2014 Elsevier Ltd. All rights reserved.

  2. Identification of nonlinear dynamics in power plant components using neural networks

    International Nuclear Information System (INIS)

    Parlos, A.G.; Fernandez, B.; Tsai, W.K.

    1990-01-01

    Advances in digital computer technology have enabled widespread implementation of closed-loop digital control systems in a variety of industries. In some instances, however, the complexity of the plant and the uncertainty associated with the parameters involved in the mathematical modeling narrow the range of applicability of most systematic control system design methodologies. A multiyear project has been initiated to assess the feasibility of the artificial neural networks (ANNs) technology for computerized enhanced diagnostics and control of nuclear power plant components. At this stage of the project, a new methodology, based on backpropagation learning, has been developed for identifying the nonlinear dynamic systems from a set of input-output data known as the training set

  3. A comparative study between nonlinear regression and artificial neural network approaches for modelling wild oat (Avena fatua) field emergence

    Science.gov (United States)

    Non-linear regression techniques are used widely to fit weed field emergence patterns to soil microclimatic indices using S-type functions. Artificial neural networks present interesting and alternative features for such modeling purposes. In this work, a univariate hydrothermal-time based Weibull m...

  4. Non-linear auto-regressive models for cross-frequency coupling in neural time series

    Science.gov (United States)

    Tallot, Lucille; Grabot, Laetitia; Doyère, Valérie; Grenier, Yves; Gramfort, Alexandre

    2017-01-01

    We address the issue of reliably detecting and quantifying cross-frequency coupling (CFC) in neural time series. Based on non-linear auto-regressive models, the proposed method provides a generative and parametric model of the time-varying spectral content of the signals. As this method models the entire spectrum simultaneously, it avoids the pitfalls related to incorrect filtering or the use of the Hilbert transform on wide-band signals. As the model is probabilistic, it also provides a score of the model “goodness of fit” via the likelihood, enabling easy and legitimate model selection and parameter comparison; this data-driven feature is unique to our model-based approach. Using three datasets obtained with invasive neurophysiological recordings in humans and rodents, we demonstrate that these models are able to replicate previous results obtained with other metrics, but also reveal new insights such as the influence of the amplitude of the slow oscillation. Using simulations, we demonstrate that our parametric method can reveal neural couplings with shorter signals than non-parametric methods. We also show how the likelihood can be used to find optimal filtering parameters, suggesting new properties on the spectrum of the driving signal, but also to estimate the optimal delay between the coupled signals, enabling a directionality estimation in the coupling. PMID:29227989

  5. Ensemble Nonlinear Autoregressive Exogenous Artificial Neural Networks for Short-Term Wind Speed and Power Forecasting.

    Science.gov (United States)

    Men, Zhongxian; Yee, Eugene; Lien, Fue-Sang; Yang, Zhiling; Liu, Yongqian

    2014-01-01

    Short-term wind speed and wind power forecasts (for a 72 h period) are obtained using a nonlinear autoregressive exogenous artificial neural network (ANN) methodology which incorporates either numerical weather prediction or high-resolution computational fluid dynamics wind field information as an exogenous input. An ensemble approach is used to combine the predictions from many candidate ANNs in order to provide improved forecasts for wind speed and power, along with the associated uncertainties in these forecasts. More specifically, the ensemble ANN is used to quantify the uncertainties arising from the network weight initialization and from the unknown structure of the ANN. All members forming the ensemble of neural networks were trained using an efficient particle swarm optimization algorithm. The results of the proposed methodology are validated using wind speed and wind power data obtained from an operational wind farm located in Northern China. The assessment demonstrates that this methodology for wind speed and power forecasting generally provides an improvement in predictive skills when compared to the practice of using an "optimal" weight vector from a single ANN while providing additional information in the form of prediction uncertainty bounds.

  6. Adaptive Neural Network Control for Nonlinear Hydraulic Servo-System with Time-Varying State Constraints

    Directory of Open Access Journals (Sweden)

    Shu-Min Lu

    2017-01-01

    Full Text Available An adaptive neural network control problem is addressed for a class of nonlinear hydraulic servo-systems with time-varying state constraints. In view of the low precision problem of the traditional hydraulic servo-system which is caused by the tracking errors surpassing appropriate bound, the previous works have shown that the constraint for the system is a good way to solve the low precision problem. Meanwhile, compared with constant constraints, the time-varying state constraints are more general in the actual systems. Therefore, when the states of the system are forced to obey bounded time-varying constraint conditions, the high precision tracking performance of the system can be easily realized. In order to achieve this goal, the time-varying barrier Lyapunov function (TVBLF is used to prevent the states from violating time-varying constraints. By the backstepping design, the adaptive controller will be obtained. A radial basis function neural network (RBFNN is used to estimate the uncertainties. Based on analyzing the stability of the hydraulic servo-system, we show that the error signals are bounded in the compacts sets; the time-varying state constrains are never violated and all singles of the hydraulic servo-system are bounded. The simulation and experimental results show that the tracking accuracy of system is improved and the controller has fast tracking ability and strong robustness.

  7. Dynamics of continuous-time bidirectional associative memory neural networks with impulses and their discrete counterparts

    International Nuclear Information System (INIS)

    Huo Haifeng; Li Wantong

    2009-01-01

    This paper is concerned with the global stability characteristics of a system of equations modelling the dynamics of continuous-time bidirectional associative memory neural networks with impulses. Sufficient conditions which guarantee the existence of a unique equilibrium and its exponential stability of the networks are obtained. For the goal of computation, discrete-time analogues of the corresponding continuous-time bidirectional associative memory neural networks with impulses are also formulated and studied. Our results show that the above continuous-time and discrete-time systems with impulses preserve the dynamics of the networks without impulses when we make some modifications and impose some additional conditions on the systems, the convergence characteristics dynamics of the networks are preserved by both continuous-time and discrete-time systems with some restriction imposed on the impulse effect.

  8. Global asymptotic stability of Cohen-Grossberg neural network with continuously distributed delays

    International Nuclear Information System (INIS)

    Wan Li; Sun Jianhua

    2005-01-01

    The convergence dynamical behaviors of Cohen-Grossberg neural network with continuously distributed delays are discussed. By using Brouwer's fixed point theorem, matrix theory and analysis techniques such as Gronwall inequality, some new sufficient conditions guaranteeing the existence, uniqueness of an equilibrium point and its global asymptotic stability are obtained. An example is given to illustrate the theoretical results

  9. Global exponential stability of cellular neural networks with continuously distributed delays and impulses

    International Nuclear Information System (INIS)

    Wang Yixuan; Xiong Wanmin; Zhou Qiyuan; Xiao Bing; Yu Yuehua

    2006-01-01

    In this Letter cellular neural networks with continuously distributed delays and impulses are considered. Sufficient conditions for the existence and global exponential stability of a unique equilibrium point are established by using the fixed point theorem and differential inequality techniques. The results of this Letter are new and they complement previously known results

  10. Non-intrusive reduced order modeling of nonlinear problems using neural networks

    Science.gov (United States)

    Hesthaven, J. S.; Ubbiali, S.

    2018-06-01

    We develop a non-intrusive reduced basis (RB) method for parametrized steady-state partial differential equations (PDEs). The method extracts a reduced basis from a collection of high-fidelity solutions via a proper orthogonal decomposition (POD) and employs artificial neural networks (ANNs), particularly multi-layer perceptrons (MLPs), to accurately approximate the coefficients of the reduced model. The search for the optimal number of neurons and the minimum amount of training samples to avoid overfitting is carried out in the offline phase through an automatic routine, relying upon a joint use of the Latin hypercube sampling (LHS) and the Levenberg-Marquardt (LM) training algorithm. This guarantees a complete offline-online decoupling, leading to an efficient RB method - referred to as POD-NN - suitable also for general nonlinear problems with a non-affine parametric dependence. Numerical studies are presented for the nonlinear Poisson equation and for driven cavity viscous flows, modeled through the steady incompressible Navier-Stokes equations. Both physical and geometrical parametrizations are considered. Several results confirm the accuracy of the POD-NN method and show the substantial speed-up enabled at the online stage as compared to a traditional RB strategy.

  11. An estimation of the domain of attraction and convergence rate for Hopfield continuous feedback neural networks

    International Nuclear Information System (INIS)

    Cao Jinde

    2004-01-01

    In this Letter, the domain of attraction of memory patterns and exponential convergence rate of the network trajectories to memory patterns for Hopfield continuous associative memory are estimated by means of matrix measure and comparison principle. A new estimation is given for the domain of attraction of memory patterns and exponential convergence rate. These results can be used for the evaluation of fault-tolerance capability and the synthesis procedures for Hopfield continuous feedback associative memory neural networks

  12. A Neural-Network-Based Nonlinear Adaptive State-Observer for Pressurized Water Reactors

    Directory of Open Access Journals (Sweden)

    Zhe Dong

    2013-10-01

    Full Text Available Although there have been some severe nuclear accidents such as Three Mile Island (USA, Chernobyl (Ukraine and Fukushima (Japan, nuclear fission energy is still a source of clean energy that can substitute for fossil fuels in a centralized way and in a great amount with commercial availability and economic competitiveness. Since the pressurized water reactor (PWR is the most widely used nuclear fission reactor, its safe, stable and efficient operation is meaningful to the current rebirth of the nuclear fission energy industry. Power-level regulation is an important technique which can deeply affect the operation stability and efficiency of PWRs. Compared with the classical power-level controllers, the advanced power-level regulators could strengthen both the closed-loop stability and control performance by feeding back the internal state-variables. However, not all of the internal state variables of a PWR can be obtained directly by measurements. To implement advanced PWR power-level control law, it is necessary to develop a state-observer to reconstruct the unmeasurable state-variables. Since a PWR is naturally a complex nonlinear system with parameters varying with power-level, fuel burnup, xenon isotope production, control rod worth and etc., it is meaningful to design a nonlinear observer for the PWR with adaptability to system uncertainties. Due to this and the strong learning capability of the multi-layer perceptron (MLP neural network, an MLP-based nonlinear adaptive observer is given for PWRs. Based upon Lyapunov stability theory, it is proved theoretically that this newly-built observer can provide bounded and convergent state-observation. This observer is then applied to the state-observation of a special PWR, i.e., the nuclear heating reactor (NHR, and numerical simulation results not only verify its feasibility but also give the relationship between the observation performance and observer parameters.

  13. A novel method to produce nonlinear empirical physical formulas for experimental nonlinear electro-optical responses of doped nematic liquid crystals: Feedforward neural network approach

    Energy Technology Data Exchange (ETDEWEB)

    Yildiz, Nihat, E-mail: nyildiz@cumhuriyet.edu.t [Cumhuriyet University, Faculty of Science and Literature, Department of Physics, 58140 Sivas (Turkey); San, Sait Eren; Okutan, Mustafa [Department of Physics, Gebze Institute of Technology, P.O. Box 141, Gebze 41400, Kocaeli (Turkey); Kaya, Hueseyin [Cumhuriyet University, Faculty of Science and Literature, Department of Physics, 58140 Sivas (Turkey)

    2010-04-15

    Among other significant obstacles, inherent nonlinearity in experimental physical response data poses severe difficulty in empirical physical formula (EPF) construction. In this paper, we applied a novel method (namely layered feedforward neural network (LFNN) approach) to produce explicit nonlinear EPFs for experimental nonlinear electro-optical responses of doped nematic liquid crystals (NLCs). Our motivation was that, as we showed in a previous theoretical work, an appropriate LFNN, due to its exceptional nonlinear function approximation capabilities, is highly relevant to EPF construction. Therefore, in this paper, we obtained excellently produced LFNN approximation functions as our desired EPFs for above-mentioned highly nonlinear response data of NLCs. In other words, by using suitable LFNNs, we successfully fitted the experimentally measured response and predicted the new (yet-to-be measured) response data. The experimental data (response versus input) were diffraction and dielectric properties versus bias voltage; and they were all taken from our previous experimental work. We conclude that in general, LFNN can be applied to construct various types of EPFs for the corresponding various nonlinear physical perturbation (thermal, electronic, molecular, electric, optical, etc.) data of doped NLCs.

  14. A novel method to produce nonlinear empirical physical formulas for experimental nonlinear electro-optical responses of doped nematic liquid crystals: Feedforward neural network approach

    International Nuclear Information System (INIS)

    Yildiz, Nihat; San, Sait Eren; Okutan, Mustafa; Kaya, Hueseyin

    2010-01-01

    Among other significant obstacles, inherent nonlinearity in experimental physical response data poses severe difficulty in empirical physical formula (EPF) construction. In this paper, we applied a novel method (namely layered feedforward neural network (LFNN) approach) to produce explicit nonlinear EPFs for experimental nonlinear electro-optical responses of doped nematic liquid crystals (NLCs). Our motivation was that, as we showed in a previous theoretical work, an appropriate LFNN, due to its exceptional nonlinear function approximation capabilities, is highly relevant to EPF construction. Therefore, in this paper, we obtained excellently produced LFNN approximation functions as our desired EPFs for above-mentioned highly nonlinear response data of NLCs. In other words, by using suitable LFNNs, we successfully fitted the experimentally measured response and predicted the new (yet-to-be measured) response data. The experimental data (response versus input) were diffraction and dielectric properties versus bias voltage; and they were all taken from our previous experimental work. We conclude that in general, LFNN can be applied to construct various types of EPFs for the corresponding various nonlinear physical perturbation (thermal, electronic, molecular, electric, optical, etc.) data of doped NLCs.

  15. Data-Driven Zero-Sum Neuro-Optimal Control for a Class of Continuous-Time Unknown Nonlinear Systems With Disturbance Using ADP.

    Science.gov (United States)

    Wei, Qinglai; Song, Ruizhuo; Yan, Pengfei

    2016-02-01

    This paper is concerned with a new data-driven zero-sum neuro-optimal control problem for continuous-time unknown nonlinear systems with disturbance. According to the input-output data of the nonlinear system, an effective recurrent neural network is introduced to reconstruct the dynamics of the nonlinear system. Considering the system disturbance as a control input, a two-player zero-sum optimal control problem is established. Adaptive dynamic programming (ADP) is developed to obtain the optimal control under the worst case of the disturbance. Three single-layer neural networks, including one critic and two action networks, are employed to approximate the performance index function, the optimal control law, and the disturbance, respectively, for facilitating the implementation of the ADP method. Convergence properties of the ADP method are developed to show that the system state will converge to a finite neighborhood of the equilibrium. The weight matrices of the critic and the two action networks are also convergent to finite neighborhoods of their optimal ones. Finally, the simulation results will show the effectiveness of the developed data-driven ADP methods.

  16. A Nonlinear Autoregressive Exogenous (NARX Neural Network Model for the Prediction of the Daily Direct Solar Radiation

    Directory of Open Access Journals (Sweden)

    Zina Boussaada

    2018-03-01

    Full Text Available The solar photovoltaic (PV energy has an important place among the renewable energy sources. Therefore, several researchers have been interested by its modelling and its prediction, in order to improve the management of the electrical systems which include PV arrays. Among the existing techniques, artificial neural networks have proved their performance in the prediction of the solar radiation. However, the existing neural network models don’t satisfy the requirements of certain specific situations such as the one analyzed in this paper. The aim of this research work is to supply, with electricity, a race sailboat using exclusively renewable sources. The developed solution predicts the direct solar radiation on a horizontal surface. For that, a Nonlinear Autoregressive Exogenous (NARX neural network is used. All the specific conditions of the sailboat operation are taken into account. The results show that the best prediction performance is obtained when the training phase of the neural network is performed periodically.

  17. New recursive-least-squares algorithms for nonlinear active control of sound and vibration using neural networks.

    Science.gov (United States)

    Bouchard, M

    2001-01-01

    In recent years, a few articles describing the use of neural networks for nonlinear active control of sound and vibration were published. Using a control structure with two multilayer feedforward neural networks (one as a nonlinear controller and one as a nonlinear plant model), steepest descent algorithms based on two distinct gradient approaches were introduced for the training of the controller network. The two gradient approaches were sometimes called the filtered-x approach and the adjoint approach. Some recursive-least-squares algorithms were also introduced, using the adjoint approach. In this paper, an heuristic procedure is introduced for the development of recursive-least-squares algorithms based on the filtered-x and the adjoint gradient approaches. This leads to the development of new recursive-least-squares algorithms for the training of the controller neural network in the two networks structure. These new algorithms produce a better convergence performance than previously published algorithms. Differences in the performance of algorithms using the filtered-x and the adjoint gradient approaches are discussed in the paper. The computational load of the algorithms discussed in the paper is evaluated for multichannel systems of nonlinear active control. Simulation results are presented to compare the convergence performance of the algorithms, showing the convergence gain provided by the new algorithms.

  18. Research on Adaptive Neural Network Control System Based on Nonlinear U-Model with Time-Varying Delay

    Directory of Open Access Journals (Sweden)

    Fengxia Xu

    2014-01-01

    Full Text Available U-model can approximate a large class of smooth nonlinear time-varying delay system to any accuracy by using time-varying delay parameters polynomial. This paper proposes a new approach, namely, U-model approach, to solving the problems of analysis and synthesis for nonlinear systems. Based on the idea of discrete-time U-model with time-varying delay, the identification algorithm of adaptive neural network is given for the nonlinear model. Then, the controller is designed by using the Newton-Raphson formula and the stability analysis is given for the closed-loop nonlinear systems. Finally, illustrative examples are given to show the validity and applicability of the obtained results.

  19. Decoupled ARX and RBF Neural Network Modeling Using PCA and GA Optimization for Nonlinear Distributed Parameter Systems.

    Science.gov (United States)

    Zhang, Ridong; Tao, Jili; Lu, Renquan; Jin, Qibing

    2018-02-01

    Modeling of distributed parameter systems is difficult because of their nonlinearity and infinite-dimensional characteristics. Based on principal component analysis (PCA), a hybrid modeling strategy that consists of a decoupled linear autoregressive exogenous (ARX) model and a nonlinear radial basis function (RBF) neural network model are proposed. The spatial-temporal output is first divided into a few dominant spatial basis functions and finite-dimensional temporal series by PCA. Then, a decoupled ARX model is designed to model the linear dynamics of the dominant modes of the time series. The nonlinear residual part is subsequently parameterized by RBFs, where genetic algorithm is utilized to optimize their hidden layer structure and the parameters. Finally, the nonlinear spatial-temporal dynamic system is obtained after the time/space reconstruction. Simulation results of a catalytic rod and a heat conduction equation demonstrate the effectiveness of the proposed strategy compared to several other methods.

  20. Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity

    Science.gov (United States)

    Moses, David A.; Mesgarani, Nima; Leonard, Matthew K.; Chang, Edward F.

    2016-10-01

    Objective. The superior temporal gyrus (STG) and neighboring brain regions play a key role in human language processing. Previous studies have attempted to reconstruct speech information from brain activity in the STG, but few of them incorporate the probabilistic framework and engineering methodology used in modern speech recognition systems. In this work, we describe the initial efforts toward the design of a neural speech recognition (NSR) system that performs continuous phoneme recognition on English stimuli with arbitrary vocabulary sizes using the high gamma band power of local field potentials in the STG and neighboring cortical areas obtained via electrocorticography. Approach. The system implements a Viterbi decoder that incorporates phoneme likelihood estimates from a linear discriminant analysis model and transition probabilities from an n-gram phonemic language model. Grid searches were used in an attempt to determine optimal parameterizations of the feature vectors and Viterbi decoder. Main results. The performance of the system was significantly improved by using spatiotemporal representations of the neural activity (as opposed to purely spatial representations) and by including language modeling and Viterbi decoding in the NSR system. Significance. These results emphasize the importance of modeling the temporal dynamics of neural responses when analyzing their variations with respect to varying stimuli and demonstrate that speech recognition techniques can be successfully leveraged when decoding speech from neural signals. Guided by the results detailed in this work, further development of the NSR system could have applications in the fields of automatic speech recognition and neural prosthetics.

  1. FEM-based neural-network approach to nonlinear modeling with application to longitudinal vehicle dynamics control.

    Science.gov (United States)

    Kalkkuhl, J; Hunt, K J; Fritz, H

    1999-01-01

    An finite-element methods (FEM)-based neural-network approach to Nonlinear AutoRegressive with eXogenous input (NARX) modeling is presented. The method uses multilinear interpolation functions on C0 rectangular elements. The local and global structure of the resulting model is analyzed. It is shown that the model can be interpreted both as a local model network and a single layer feedforward neural network. The main aim is to use the model for nonlinear control design. The proposed FEM NARX description is easily accessible to feedback linearizing control techniques. Its use with a two-degrees of freedom nonlinear internal model controller is discussed. The approach is applied to modeling of the nonlinear longitudinal dynamics of an experimental lorry, using measured data. The modeling results are compared with local model network and multilayer perceptron approaches. A nonlinear speed controller was designed based on the identified FEM model. The controller was implemented in a test vehicle, and several experimental results are presented.

  2. Sub-wavelength patterning of organic monolayers via nonlinear processing with continuous-wave lasers

    Energy Technology Data Exchange (ETDEWEB)

    Mathieu, Mareike; Hartmann, Nils, E-mail: nils.hartmann@uni-due.de [Fakultaet fuer Chemie, Universitaet Duisburg-Essen, 45117 Essen (Germany); CeNIDE-Center for Nanointegration Duisburg-Essen, 47048 Duisburg (Germany); NETZ-NanoEnergieTechnikZentrum, 47048 Duisburg (Germany)

    2010-12-15

    In recent years, nonlinear processing with continuous-wave lasers has been demonstrated to be a facile means of rapid nanopatterning of organic monolayers down to the sub-100 nm range. In this study, we report on laser patterning of thiol-based organic monolayers with sub-wavelength resolution. Au-coated silicon substrates are functionalized with 1-hexadecanethiol. Irradiation with a focused beam of an Ar{sup +} laser operating at {lambda}=514 nm allows one to locally remove the monolayer. Subsequently, the patterns are transferred into the Au film via selective etching in a ferri-/ferrocyanide solution. Despite a 1/e{sup 2} spot diameter of about 2.8 {mu}m, structures with lateral dimensions down to 250 nm are fabricated. The underlying nonlinear dependence of the patterning process on laser intensity is traced back to the interplay between the laser-induced transient local temperature rise and the thermally activated desorption of the thiol molecules. A simple thermokinetic analysis of the data allows us to determine the effective kinetic parameters. These results complement our previous work on photothermal laser patterning of ultrathin organic coatings, such as silane-based organic monolayers, organo/silicon interfaces and supported membranes. A general introduction to nonlinear laser processing of organic monolayers is presented.

  3. C-RNN-GAN: Continuous recurrent neural networks with adversarial training

    OpenAIRE

    Mogren, Olof

    2016-01-01

    Generative adversarial networks have been proposed as a way of efficiently training deep generative neural networks. We propose a generative adversarial model that works on continuous sequential data, and apply it by training it on a collection of classical music. We conclude that it generates music that sounds better and better as the model is trained, report statistics on generated music, and let the reader judge the quality by downloading the generated songs.

  4. Nonlinear Dynamic Surface Control of Chaos in Permanent Magnet Synchronous Motor Based on the Minimum Weights of RBF Neural Network

    Directory of Open Access Journals (Sweden)

    Shaohua Luo

    2014-01-01

    Full Text Available This paper is concerned with the problem of the nonlinear dynamic surface control (DSC of chaos based on the minimum weights of RBF neural network for the permanent magnet synchronous motor system (PMSM wherein the unknown parameters, disturbances, and chaos are presented. RBF neural network is used to approximate the nonlinearities and an adaptive law is employed to estimate unknown parameters. Then, a simple and effective controller is designed by introducing dynamic surface control technique on the basis of first-order filters. Asymptotically tracking stability in the sense of uniformly ultimate boundedness is achieved in a short time. Finally, the performance of the proposed controller is testified through simulation results.

  5. Nonlinear dynamic systems identification using recurrent interval type-2 TSK fuzzy neural network - A novel structure.

    Science.gov (United States)

    El-Nagar, Ahmad M

    2018-01-01

    In this study, a novel structure of a recurrent interval type-2 Takagi-Sugeno-Kang (TSK) fuzzy neural network (FNN) is introduced for nonlinear dynamic and time-varying systems identification. It combines the type-2 fuzzy sets (T2FSs) and a recurrent FNN to avoid the data uncertainties. The fuzzy firing strengths in the proposed structure are returned to the network input as internal variables. The interval type-2 fuzzy sets (IT2FSs) is used to describe the antecedent part for each rule while the consequent part is a TSK-type, which is a linear function of the internal variables and the external inputs with interval weights. All the type-2 fuzzy rules for the proposed RIT2TSKFNN are learned on-line based on structure and parameter learning, which are performed using the type-2 fuzzy clustering. The antecedent and consequent parameters of the proposed RIT2TSKFNN are updated based on the Lyapunov function to achieve network stability. The obtained results indicate that our proposed network has a small root mean square error (RMSE) and a small integral of square error (ISE) with a small number of rules and a small computation time compared with other type-2 FNNs. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

  6. Mobile robot nonlinear feedback control based on Elman neural network observer

    Directory of Open Access Journals (Sweden)

    Khaled Al-Mutib

    2015-12-01

    Full Text Available This article presents a new approach to control a wheeled mobile robot without velocity measurement. The controller developed is based on kinematic model as well as dynamics model to take into account parameters of dynamics. These parameters related to dynamic equations are identified using a proposed methodology. Input–output feedback linearization is considered with a slight modification in the mathematical expressions to implement the dynamic controller and analyze the nonlinear internal behavior. The developed controllers require sensors to obtain the states needed for the closed-loop system. However, some states may not be available due to the absence of the sensors because of the cost, the weight limitation, reliability, induction of errors, failure, and so on. Particularly, for the velocity measurements, the required accuracy may not be achieved in practical applications due to the existence of significant errors induced by stochastic or cyclical noise. In this article, Elman neural network is proposed to work as an observer to estimate the velocity needed to complete the full state required for the closed-loop control and account for all the disturbances and model parameter uncertainties. Different simulations are carried out to demonstrate the feasibility of the approach in tracking different reference trajectories in comparison with other paradigms.

  7. Automatic Assessing of Tremor Severity Using Nonlinear Dynamics, Artificial Neural Networks and Neuro-Fuzzy Classifier

    Directory of Open Access Journals (Sweden)

    GEMAN, O.

    2014-02-01

    Full Text Available Neurological diseases like Alzheimer, epilepsy, Parkinson's disease, multiple sclerosis and other dementias influence the lives of patients, their families and society. Parkinson's disease (PD is a neurodegenerative disease that occurs due to loss of dopamine, a neurotransmitter and slow destruction of neurons. Brain area affected by progressive destruction of neurons is responsible for controlling movements, and patients with PD reveal rigid and uncontrollable gestures, postural instability, small handwriting and tremor. Commercial activity-promoting gaming systems such as the Nintendo Wii and Xbox Kinect can be used as tools for tremor, gait or other biomedical signals acquisitions. They also can aid for rehabilitation in clinical settings. This paper emphasizes the use of intelligent optical sensors or accelerometers in biomedical signal acquisition, and of the specific nonlinear dynamics parameters or fuzzy logic in Parkinson's disease tremor analysis. Nowadays, there is no screening test for early detection of PD. So, we investigated a method to predict PD, based on the image processing of the handwriting belonging to a candidate of PD. For classification and discrimination between healthy people and PD people we used Artificial Neural Networks (Radial Basis Function - RBF and Multilayer Perceptron - MLP and an Adaptive Neuro-Fuzzy Classifier (ANFC. In general, the results may be expressed as a prognostic (risk degree to contact PD.

  8. Adaptive Neural Output-Feedback Control for a Class of Nonlower Triangular Nonlinear Systems With Unmodeled Dynamics.

    Science.gov (United States)

    Wang, Huanqing; Liu, Peter Xiaoping; Li, Shuai; Wang, Ding

    2017-08-29

    This paper presents the development of an adaptive neural controller for a class of nonlinear systems with unmodeled dynamics and immeasurable states. An observer is designed to estimate system states. The structure consistency of virtual control signals and the variable partition technique are combined to overcome the difficulties appearing in a nonlower triangular form. An adaptive neural output-feedback controller is developed based on the backstepping technique and the universal approximation property of the radial basis function (RBF) neural networks. By using the Lyapunov stability analysis, the semiglobally and uniformly ultimate boundedness of all signals within the closed-loop system is guaranteed. The simulation results show that the controlled system converges quickly, and all the signals are bounded. This paper is novel at least in the two aspects: 1) an output-feedback control strategy is developed for a class of nonlower triangular nonlinear systems with unmodeled dynamics and 2) the nonlinear disturbances and their bounds are the functions of all states, which is in a more general form than existing results.

  9. Periodic oscillations in linear continuous media coupled with nonlinear discrete systems

    International Nuclear Information System (INIS)

    Lupini, R.

    1998-01-01

    A general derivation of partial differential equations with boundary conditions in the form of ordinary differential equations is obtained using the principle of stationary action for a Lagrangian function composed of continuous plus discrete parts in interaction across the boundaries of a 1-dimensional medium. This approach leads directly to the theorem of energy conservation. For linear continuous medium, homogeneous Dirichlet condition at one boundary, and nonlinear oscillator at the other boundary, the entire differential problem reduces to a nonlinear differential-difference equation of neutral type and of the second order. The lag parameter is τ = l/c, where c is the phase speed, l the length of the continuum. The Author investigate the problem of the occurrence of periodic solutions of period integer multiple of the lag (super harmonic solutions) in the case of zero inertia of the boundary system. The problem for such oscillations is shown to reduce to systems of ordinary differential equations with matching conditions in a phase space of lower dimensionality: Phase-plane techniques are used to determine solutions of period 4τ, 8τ and 6τ

  10. Context-dependent retrieval of information by neural-network dynamics with continuous attractors.

    Science.gov (United States)

    Tsuboshita, Yukihiro; Okamoto, Hiroshi

    2007-08-01

    Memory retrieval in neural networks has traditionally been described by dynamic systems with discrete attractors. However, recent neurophysiological findings of graded persistent activity suggest that memory retrieval in the brain is more likely to be described by dynamic systems with continuous attractors. To explore what sort of information processing is achieved by continuous-attractor dynamics, keyword extraction from documents by a network of bistable neurons, which gives robust continuous attractors, is examined. Given an associative network of terms, a continuous attractor led by propagation of neuronal activation in this network appears to represent keywords that express underlying meaning of a document encoded in the initial state of the network-activation pattern. A dominant hypothesis in cognitive psychology is that long-term memory is archived in the network structure, which resembles associative networks of terms. Our results suggest that keyword extraction by the neural-network dynamics with continuous attractors might symbolically represent context-dependent retrieval of short-term memory from long-term memory in the brain.

  11. Nonlinear dynamics analysis of a self-organizing recurrent neural network: chaos waning.

    Science.gov (United States)

    Eser, Jürgen; Zheng, Pengsheng; Triesch, Jochen

    2014-01-01

    Self-organization is thought to play an important role in structuring nervous systems. It frequently arises as a consequence of plasticity mechanisms in neural networks: connectivity determines network dynamics which in turn feed back on network structure through various forms of plasticity. Recently, self-organizing recurrent neural network models (SORNs) have been shown to learn non-trivial structure in their inputs and to reproduce the experimentally observed statistics and fluctuations of synaptic connection strengths in cortex and hippocampus. However, the dynamics in these networks and how they change with network evolution are still poorly understood. Here we investigate the degree of chaos in SORNs by studying how the networks' self-organization changes their response to small perturbations. We study the effect of perturbations to the excitatory-to-excitatory weight matrix on connection strengths and on unit activities. We find that the network dynamics, characterized by an estimate of the maximum Lyapunov exponent, becomes less chaotic during its self-organization, developing into a regime where only few perturbations become amplified. We also find that due to the mixing of discrete and (quasi-)continuous variables in SORNs, small perturbations to the synaptic weights may become amplified only after a substantial delay, a phenomenon we propose to call deferred chaos.

  12. Zero-sum two-player game theoretic formulation of affine nonlinear discrete-time systems using neural networks.

    Science.gov (United States)

    Mehraeen, Shahab; Dierks, Travis; Jagannathan, S; Crow, Mariesa L

    2013-12-01

    In this paper, the nearly optimal solution for discrete-time (DT) affine nonlinear control systems in the presence of partially unknown internal system dynamics and disturbances is considered. The approach is based on successive approximate solution of the Hamilton-Jacobi-Isaacs (HJI) equation, which appears in optimal control. Successive approximation approach for updating control and disturbance inputs for DT nonlinear affine systems are proposed. Moreover, sufficient conditions for the convergence of the approximate HJI solution to the saddle point are derived, and an iterative approach to approximate the HJI equation using a neural network (NN) is presented. Then, the requirement of full knowledge of the internal dynamics of the nonlinear DT system is relaxed by using a second NN online approximator. The result is a closed-loop optimal NN controller via offline learning. A numerical example is provided illustrating the effectiveness of the approach.

  13. Adaptive control of nonlinear system using online error minimum neural networks.

    Science.gov (United States)

    Jia, Chao; Li, Xiaoli; Wang, Kang; Ding, Dawei

    2016-11-01

    In this paper, a new learning algorithm named OEM-ELM (Online Error Minimized-ELM) is proposed based on ELM (Extreme Learning Machine) neural network algorithm and the spreading of its main structure. The core idea of this OEM-ELM algorithm is: online learning, evaluation of network performance, and increasing of the number of hidden nodes. It combines the advantages of OS-ELM and EM-ELM, which can improve the capability of identification and avoid the redundancy of networks. The adaptive control based on the proposed algorithm OEM-ELM is set up which has stronger adaptive capability to the change of environment. The adaptive control of chemical process Continuous Stirred Tank Reactor (CSTR) is also given for application. The simulation results show that the proposed algorithm with respect to the traditional ELM algorithm can avoid network redundancy and improve the control performance greatly. Copyright © 2016 ISA. Published by Elsevier Ltd. All rights reserved.

  14. Adaptive Neural Networks Decentralized FTC Design for Nonstrict-Feedback Nonlinear Interconnected Large-Scale Systems Against Actuator Faults.

    Science.gov (United States)

    Li, Yongming; Tong, Shaocheng

    The problem of active fault-tolerant control (FTC) is investigated for the large-scale nonlinear systems in nonstrict-feedback form. The nonstrict-feedback nonlinear systems considered in this paper consist of unstructured uncertainties, unmeasured states, unknown interconnected terms, and actuator faults (e.g., bias fault and gain fault). A state observer is designed to solve the unmeasurable state problem. Neural networks (NNs) are used to identify the unknown lumped nonlinear functions so that the problems of unstructured uncertainties and unknown interconnected terms can be solved. By combining the adaptive backstepping design principle with the combination Nussbaum gain function property, a novel NN adaptive output-feedback FTC approach is developed. The proposed FTC controller can guarantee that all signals in all subsystems are bounded, and the tracking errors for each subsystem converge to a small neighborhood of zero. Finally, numerical results of practical examples are presented to further demonstrate the effectiveness of the proposed control strategy.The problem of active fault-tolerant control (FTC) is investigated for the large-scale nonlinear systems in nonstrict-feedback form. The nonstrict-feedback nonlinear systems considered in this paper consist of unstructured uncertainties, unmeasured states, unknown interconnected terms, and actuator faults (e.g., bias fault and gain fault). A state observer is designed to solve the unmeasurable state problem. Neural networks (NNs) are used to identify the unknown lumped nonlinear functions so that the problems of unstructured uncertainties and unknown interconnected terms can be solved. By combining the adaptive backstepping design principle with the combination Nussbaum gain function property, a novel NN adaptive output-feedback FTC approach is developed. The proposed FTC controller can guarantee that all signals in all subsystems are bounded, and the tracking errors for each subsystem converge to a small

  15. A novel neural-net-based nonlinear adaptive control and application to the cross-direction deviations control of a polymer film spread line

    International Nuclear Information System (INIS)

    Chen Zengqiang; Li Xiang; Liu Zhongxin; Yuan Zhuzhi

    2008-01-01

    A novel neural adaptive controller is presented to effectively control multivariable nonlinear systems. The proposed neural controller has been successfully applied to the cross-direction deviation control system of a polymer film spread line, whose good performance has been verified with real-time running results

  16. Continual and One-Shot Learning Through Neural Networks with Dynamic External Memory

    DEFF Research Database (Denmark)

    Lüders, Benno; Schläger, Mikkel; Korach, Aleksandra

    2017-01-01

    it easier to find unused memory location and therefor facilitates the evolution of continual learning networks. Our results suggest that augmenting evolving networks with an external memory component is not only a viable mechanism for adaptive behaviors in neuroevolution but also allows these networks...... a new task is learned. This paper takes a step in overcoming this limitation by building on the recently proposed Evolving Neural Turing Machine (ENTM) approach. In the ENTM, neural networks are augmented with an external memory component that they can write to and read from, which allows them to store...... associations quickly and over long periods of time. The results in this paper demonstrate that the ENTM is able to perform one-shot learning in reinforcement learning tasks without catastrophic forgetting of previously stored associations. Additionally, we introduce a new ENTM default jump mechanism that makes...

  17. Estimation of non-linear continuous time models for the heat exchange dynamics of building integrated photovoltaic modules

    DEFF Research Database (Denmark)

    Jimenez, M.J.; Madsen, Henrik; Bloem, J.J.

    2008-01-01

    This paper focuses on a method for linear or non-linear continuous time modelling of physical systems using discrete time data. This approach facilitates a more appropriate modelling of more realistic non-linear systems. Particularly concerning advanced building components, convective and radiati...... that a description of the non-linear heat transfer is essential. The resulting model is a non-linear first order stochastic differential equation for the heat transfer of the PV component....... heat interchanges are non-linear effects and represent significant contributions in a variety of components such as photovoltaic integrated facades or roofs and those using these effects as passive cooling strategies, etc. Since models are approximations of the physical system and data is encumbered...

  18. Engineering non-linear resonator mode interactions in circuit QED by continuous driving: Introduction

    Science.gov (United States)

    Pfaff, Wolfgang; Reagor, Matthew; Heeres, Reinier; Ofek, Nissim; Chou, Kevin; Blumoff, Jacob; Leghtas, Zaki; Touzard, Steven; Sliwa, Katrina; Holland, Eric; Krastanov, Stefan; Frunzio, Luigi; Devoret, Michel; Jiang, Liang; Schoelkopf, Robert

    2015-03-01

    High-Q microwave resonators show great promise for storing and manipulating quantum states in circuit QED. Using resonator modes as such a resource in quantum information processing applications requires the ability to manipulate the state of a resonator efficiently. Further, one must engineer appropriate coupling channels without spoiling the coherence properties of the resonator. We present an architecture that combines millisecond lifetimes for photonic quantum states stored in a linear resonator with fast measurement provided by a low-Q readout resonator. We demonstrate experimentally how a continuous drive on a transmon can be utilized to generate highly non-classical photonic states inside the high-Q resonator via effective nonlinear resonator mode interactions. Our approach opens new avenues for using modes of long-lived linear resonators in the circuit QED platform for quantum information processing tasks.

  19. Accuracy Improvement of the Method of Multiple Scales for Nonlinear Vibration Analyses of Continuous Systems with Quadratic and Cubic Nonlinearities

    Directory of Open Access Journals (Sweden)

    Akira Abe

    2010-01-01

    and are the driving and natural frequencies, respectively. The application of Galerkin's procedure to the equation of motion yields nonlinear ordinary differential equations with quadratic and cubic nonlinear terms. The steady-state responses are obtained by using the discretization approach of the MMS in which the definition of the detuning parameter, expressing the relationship between the natural frequency and the driving frequency, is changed in an attempt to improve the accuracy of the solutions. The validity of the solutions is discussed by comparing them with solutions of the direct approach of the MMS and the finite difference method.

  20. The reliability of nonlinear least-squares algorithm for data analysis of neural response activity during sinusoidal rotational stimulation in semicircular canal neurons.

    Science.gov (United States)

    Ren, Pengyu; Li, Bowen; Dong, Shiyao; Chen, Lin; Zhang, Yuelin

    2018-01-01

    Although many mathematical methods were used to analyze the neural activity under sinusoidal stimulation within linear response range in vestibular system, the reliabilities of these methods are still not reported, especially in nonlinear response range. Here we chose nonlinear least-squares algorithm (NLSA) with sinusoidal model to analyze the neural response of semicircular canal neurons (SCNs) during sinusoidal rotational stimulation (SRS) over a nonlinear response range. Our aim was to acquire a reliable mathematical method for data analysis under SRS in vestibular system. Our data indicated that the reliability of this method in an entire SCNs population was quite satisfactory. However, the reliability was strongly negatively depended on the neural discharge regularity. In addition, stimulation parameters were the vital impact factors influencing the reliability. The frequency had a significant negative effect but the amplitude had a conspicuous positive effect on the reliability. Thus, NLSA with sinusoidal model resulted a reliable mathematical tool for data analysis of neural response activity under SRS in vestibular system and more suitable for those under the stimulation with low frequency but high amplitude, suggesting that this method can be used in nonlinear response range. This method broke out of the restriction of neural activity analysis under nonlinear response range and provided a solid foundation for future study in nonlinear response range in vestibular system.

  1. Dynamics of a linear system coupled to a chain of light nonlinear oscillators analyzed through a continuous approximation

    Science.gov (United States)

    Charlemagne, S.; Ture Savadkoohi, A.; Lamarque, C.-H.

    2018-07-01

    The continuous approximation is used in this work to describe the dynamics of a nonlinear chain of light oscillators coupled to a linear main system. A general methodology is applied to an example where the chain has local nonlinear restoring forces. The slow invariant manifold is detected at fast time scale. At slow time scale, equilibrium and singular points are sought around this manifold in order to predict periodic regimes and strongly modulated responses of the system. Analytical predictions are in good accordance with numerical results and represent a potent tool for designing nonlinear chains for passive control purposes.

  2. Adaptive neural network output feedback control for stochastic nonlinear systems with unknown dead-zone and unmodeled dynamics.

    Science.gov (United States)

    Tong, Shaocheng; Wang, Tong; Li, Yongming; Zhang, Huaguang

    2014-06-01

    This paper discusses the problem of adaptive neural network output feedback control for a class of stochastic nonlinear strict-feedback systems. The concerned systems have certain characteristics, such as unknown nonlinear uncertainties, unknown dead-zones, unmodeled dynamics and without the direct measurements of state variables. In this paper, the neural networks (NNs) are employed to approximate the unknown nonlinear uncertainties, and then by representing the dead-zone as a time-varying system with a bounded disturbance. An NN state observer is designed to estimate the unmeasured states. Based on both backstepping design technique and a stochastic small-gain theorem, a robust adaptive NN output feedback control scheme is developed. It is proved that all the variables involved in the closed-loop system are input-state-practically stable in probability, and also have robustness to the unmodeled dynamics. Meanwhile, the observer errors and the output of the system can be regulated to a small neighborhood of the origin by selecting appropriate design parameters. Simulation examples are also provided to illustrate the effectiveness of the proposed approach.

  3. Asymmetric continuous-time neural networks without local traps for solving constraint satisfaction problems.

    Directory of Open Access Journals (Sweden)

    Botond Molnár

    Full Text Available There has been a long history of using neural networks for combinatorial optimization and constraint satisfaction problems. Symmetric Hopfield networks and similar approaches use steepest descent dynamics, and they always converge to the closest local minimum of the energy landscape. For finding global minima additional parameter-sensitive techniques are used, such as classical simulated annealing or the so-called chaotic simulated annealing, which induces chaotic dynamics by addition of extra terms to the energy landscape. Here we show that asymmetric continuous-time neural networks can solve constraint satisfaction problems without getting trapped in non-solution attractors. We concentrate on a model solving Boolean satisfiability (k-SAT, which is a quintessential NP-complete problem. There is a one-to-one correspondence between the stable fixed points of the neural network and the k-SAT solutions and we present numerical evidence that limit cycles may also be avoided by appropriately choosing the parameters of the model. This optimal parameter region is fairly independent of the size and hardness of instances, this way parameters can be chosen independently of the properties of problems and no tuning is required during the dynamical process. The model is similar to cellular neural networks already used in CNN computers. On an analog device solving a SAT problem would take a single operation: the connection weights are determined by the k-SAT instance and starting from any initial condition the system searches until finding a solution. In this new approach transient chaotic behavior appears as a natural consequence of optimization hardness and not as an externally induced effect.

  4. 3D position estimation using an artificial neural network for a continuous scintillator PET detector

    International Nuclear Information System (INIS)

    Wang, Y; Zhu, W; Cheng, X; Li, D

    2013-01-01

    Continuous crystal based PET detectors have features of simple design, low cost, good energy resolution and high detection efficiency. Through single-end readout of scintillation light, direct three-dimensional (3D) position estimation could be another advantage that the continuous crystal detector would have. In this paper, we propose to use artificial neural networks to simultaneously estimate the plane coordinate and DOI coordinate of incident γ photons with detected scintillation light. Using our experimental setup with an ‘8 + 8’ simplified signal readout scheme, the training data of perpendicular irradiation on the front surface and one side surface are obtained, and the plane (x, y) networks and DOI networks are trained and evaluated. The test results show that the artificial neural network for DOI estimation is as effective as for plane estimation. The performance of both estimators is presented by resolution and bias. Without bias correction, the resolution of the plane estimator is on average better than 2 mm and that of the DOI estimator is about 2 mm over the whole area of the detector. With bias correction, the resolution at the edge area for plane estimation or at the end of the block away from the readout PMT for DOI estimation becomes worse, as we expect. The comprehensive performance of the 3D positioning by a neural network is accessed by the experimental test data of oblique irradiations. To show the combined effect of the 3D positioning over the whole area of the detector, the 2D flood images of oblique irradiation are presented with and without bias correction. (paper)

  5. Continuous Timescale Long-Short Term Memory Neural Network for Human Intent Understanding

    Directory of Open Access Journals (Sweden)

    Zhibin Yu

    2017-08-01

    Full Text Available Understanding of human intention by observing a series of human actions has been a challenging task. In order to do so, we need to analyze longer sequences of human actions related with intentions and extract the context from the dynamic features. The multiple timescales recurrent neural network (MTRNN model, which is believed to be a kind of solution, is a useful tool for recording and regenerating a continuous signal for dynamic tasks. However, the conventional MTRNN suffers from the vanishing gradient problem which renders it impossible to be used for longer sequence understanding. To address this problem, we propose a new model named Continuous Timescale Long-Short Term Memory (CTLSTM in which we inherit the multiple timescales concept into the Long-Short Term Memory (LSTM recurrent neural network (RNN that addresses the vanishing gradient problem. We design an additional recurrent connection in the LSTM cell outputs to produce a time-delay in order to capture the slow context. Our experiments show that the proposed model exhibits better context modeling ability and captures the dynamic features on multiple large dataset classification tasks. The results illustrate that the multiple timescales concept enhances the ability of our model to handle longer sequences related with human intentions and hence proving to be more suitable for complex tasks, such as intention recognition.

  6. Characterization of nonuniform chaos in area-preserving nonlinear maps through a continuous archetype

    International Nuclear Information System (INIS)

    Cerbelli, S.; Giona, M.

    2008-01-01

    Numerical investigations conducted over a wealth of nonlinear area-preserving smooth maps (e.g. the Standard Map) showed that these systems possess physically relevant features that are not captured by any continuous archetype of two-dimensional conservative dynamics. Among these properties are the dispersive behavior of stretch factor statistics, the multifractal character of the measure associated with invariant foliations, the sign-alternating property, accounting for the nestedly bent structure of invariant foliations, and the strict inequality between the topological entropy, h top , and the Lyapunov exponent, Λ. We refer to systems possessing all of these properties as nonuniformly chaotic. In this article, we present a globally continuous, piecewise-smooth area-preserving transformation, the toral homeomorphism H, as an archetype of nonuniformly chaotic behavior. The relatively simple structure of point set dynamics and the closed-form knowledge of the pointwise expanding and contracting invariant directions associated with H, permits to derive either analytically, or with arbitrary numerical precision, the standard chaotic properties as well as the dynamics of the physically relevant properties that define nonuniform chaos. Potentialities and limitations of the model proposed in representing geometric and statistical properties of physically relevant smooth systems are discussed in detail

  7. A Novel Modeling Method for Aircraft Engine Using Nonlinear Autoregressive Exogenous (NARX) Models Based on Wavelet Neural Networks

    Science.gov (United States)

    Yu, Bing; Shu, Wenjun; Cao, Can

    2018-05-01

    A novel modeling method for aircraft engine using nonlinear autoregressive exogenous (NARX) models based on wavelet neural networks is proposed. The identification principle and process based on wavelet neural networks are studied, and the modeling scheme based on NARX is proposed. Then, the time series data sets from three types of aircraft engines are utilized to build the corresponding NARX models, and these NARX models are validated by the simulation. The results show that all the best NARX models can capture the original aircraft engine's dynamic characteristic well with the high accuracy. For every type of engine, the relative identification errors of its best NARX model and the component level model are no more than 3.5 % and most of them are within 1 %.

  8. On structure-exploiting trust-region regularized nonlinear least squares algorithms for neural-network learning.

    Science.gov (United States)

    Mizutani, Eiji; Demmel, James W

    2003-01-01

    This paper briefly introduces our numerical linear algebra approaches for solving structured nonlinear least squares problems arising from 'multiple-output' neural-network (NN) models. Our algorithms feature trust-region regularization, and exploit sparsity of either the 'block-angular' residual Jacobian matrix or the 'block-arrow' Gauss-Newton Hessian (or Fisher information matrix in statistical sense) depending on problem scale so as to render a large class of NN-learning algorithms 'efficient' in both memory and operation costs. Using a relatively large real-world nonlinear regression application, we shall explain algorithmic strengths and weaknesses, analyzing simulation results obtained by both direct and iterative trust-region algorithms with two distinct NN models: 'multilayer perceptrons' (MLP) and 'complementary mixtures of MLP-experts' (or neuro-fuzzy modular networks).

  9. Neural network-based robust actuator fault diagnosis for a non-linear multi-tank system.

    Science.gov (United States)

    Mrugalski, Marcin; Luzar, Marcel; Pazera, Marcin; Witczak, Marcin; Aubrun, Christophe

    2016-03-01

    The paper is devoted to the problem of the robust actuator fault diagnosis of the dynamic non-linear systems. In the proposed method, it is assumed that the diagnosed system can be modelled by the recurrent neural network, which can be transformed into the linear parameter varying form. Such a system description allows developing the designing scheme of the robust unknown input observer within H∞ framework for a class of non-linear systems. The proposed approach is designed in such a way that a prescribed disturbance attenuation level is achieved with respect to the actuator fault estimation error, while guaranteeing the convergence of the observer. The application of the robust unknown input observer enables actuator fault estimation, which allows applying the developed approach to the fault tolerant control tasks. Copyright © 2016 ISA. Published by Elsevier Ltd. All rights reserved.

  10. Prediction of hot-ductility of steels during continuous casting using artificial neural networks

    International Nuclear Information System (INIS)

    Liu, W.J.; Emadi, D.; Essadiqi, E.

    2000-01-01

    During continuous casting, transversal cracks can be developed due to tensile stress in temperature regions where the steel exhibits a low ductility. The cracking tendency during continuous casting depends on the steel chemistry and the casting parameters such as lubrication, mold type, secondary cooling and bending/unbending temperatures. To prevent cracking one needs to predict the hot-ductility of a material under continuous-casting conditions. However, hot-ductility is one of the poorly understood material behaviors and cannot be readily modeled using conventional techniques. In the present study, we used an alternative method, namely Artificial Neural Networks (ANN), to model the ductility of a steel under continuous casting conditions. A hot-ductility database was established based on published literature. Several standard three-layer ANN models were then trained using data randomly selected from the database. The outputs of the ANN models were subsequently compared with the remaining data in the database. The results indicate that ANN is a suitable modelling technique for hot-ductility prediction. (author)

  11. Integration of Continuous-Time Dynamics in a Spiking Neural Network Simulator

    Directory of Open Access Journals (Sweden)

    Jan Hahne

    2017-05-01

    Full Text Available Contemporary modeling approaches to the dynamics of neural networks include two important classes of models: biologically grounded spiking neuron models and functionally inspired rate-based units. We present a unified simulation framework that supports the combination of the two for multi-scale modeling, enables the quantitative validation of mean-field approaches by spiking network simulations, and provides an increase in reliability by usage of the same simulation code and the same network model specifications for both model classes. While most spiking simulations rely on the communication of discrete events, rate models require time-continuous interactions between neurons. Exploiting the conceptual similarity to the inclusion of gap junctions in spiking network simulations, we arrive at a reference implementation of instantaneous and delayed interactions between rate-based models in a spiking network simulator. The separation of rate dynamics from the general connection and communication infrastructure ensures flexibility of the framework. In addition to the standard implementation we present an iterative approach based on waveform-relaxation techniques to reduce communication and increase performance for large-scale simulations of rate-based models with instantaneous interactions. Finally we demonstrate the broad applicability of the framework by considering various examples from the literature, ranging from random networks to neural-field models. The study provides the prerequisite for interactions between rate-based and spiking models in a joint simulation.

  12. Integration of Continuous-Time Dynamics in a Spiking Neural Network Simulator.

    Science.gov (United States)

    Hahne, Jan; Dahmen, David; Schuecker, Jannis; Frommer, Andreas; Bolten, Matthias; Helias, Moritz; Diesmann, Markus

    2017-01-01

    Contemporary modeling approaches to the dynamics of neural networks include two important classes of models: biologically grounded spiking neuron models and functionally inspired rate-based units. We present a unified simulation framework that supports the combination of the two for multi-scale modeling, enables the quantitative validation of mean-field approaches by spiking network simulations, and provides an increase in reliability by usage of the same simulation code and the same network model specifications for both model classes. While most spiking simulations rely on the communication of discrete events, rate models require time-continuous interactions between neurons. Exploiting the conceptual similarity to the inclusion of gap junctions in spiking network simulations, we arrive at a reference implementation of instantaneous and delayed interactions between rate-based models in a spiking network simulator. The separation of rate dynamics from the general connection and communication infrastructure ensures flexibility of the framework. In addition to the standard implementation we present an iterative approach based on waveform-relaxation techniques to reduce communication and increase performance for large-scale simulations of rate-based models with instantaneous interactions. Finally we demonstrate the broad applicability of the framework by considering various examples from the literature, ranging from random networks to neural-field models. The study provides the prerequisite for interactions between rate-based and spiking models in a joint simulation.

  13. Global exponential synchronization of inertial memristive neural networks with time-varying delay via nonlinear controller.

    Science.gov (United States)

    Gong, Shuqing; Yang, Shaofu; Guo, Zhenyuan; Huang, Tingwen

    2018-06-01

    The paper is concerned with the synchronization problem of inertial memristive neural networks with time-varying delay. First, by choosing a proper variable substitution, inertial memristive neural networks described by second-order differential equations can be transformed into first-order differential equations. Then, a novel controller with a linear diffusive term and discontinuous sign term is designed. By using the controller, the sufficient conditions for assuring the global exponential synchronization of the derive and response neural networks are derived based on Lyapunov stability theory and some inequality techniques. Finally, several numerical simulations are provided to substantiate the effectiveness of the theoretical results. Copyright © 2018 Elsevier Ltd. All rights reserved.

  14. Decentralized adaptive neural control for high-order interconnected stochastic nonlinear time-delay systems with unknown system dynamics.

    Science.gov (United States)

    Si, Wenjie; Dong, Xunde; Yang, Feifei

    2018-03-01

    This paper is concerned with the problem of decentralized adaptive backstepping state-feedback control for uncertain high-order large-scale stochastic nonlinear time-delay systems. For the control design of high-order large-scale nonlinear systems, only one adaptive parameter is constructed to overcome the over-parameterization, and neural networks are employed to cope with the difficulties raised by completely unknown system dynamics and stochastic disturbances. And then, the appropriate Lyapunov-Krasovskii functional and the property of hyperbolic tangent functions are used to deal with the unknown unmatched time-delay interactions of high-order large-scale systems for the first time. At last, on the basis of Lyapunov stability theory, the decentralized adaptive neural controller was developed, and it decreases the number of learning parameters. The actual controller can be designed so as to ensure that all the signals in the closed-loop system are semi-globally uniformly ultimately bounded (SGUUB) and the tracking error converges in the small neighborhood of zero. The simulation example is used to further show the validity of the design method. Copyright © 2018 Elsevier Ltd. All rights reserved.

  15. Identification of canonical neural events during continuous gameplay of an 8-bit style video game.

    Science.gov (United States)

    Cavanagh, James F; Castellanos, Joel

    2016-06-01

    Cognitive neuroscience suffers from a unique and pervasive problem of generalizability. Since neural findings are often interpreted in the context of a specific manipulation during a carefully controlled task, it is hard to transfer knowledge from one task to another. In this report we address problems of generalizability with two methodological advancements. First, we aimed to transcend status quo experimental procedures with a continuous, engaging task environment. To this end, we created a novel 8-bit style continuous space shooter video game that elicits a multitude of goal-oriented events, such as crashing into a wall or blowing up an enemy with a missile. Second, we aimed to objectively define the psychological significance of these events. To achieve this aim, we used pattern classification of EEG data to derive predictive weights from carefully controlled pre-game exemplar events (oddball target detection and gambling wins and losses) and transferred those weights to EEG activities during video game events. All major goal-oriented events (crashes into the wall, crashes into an enemy, missile hit on an enemy) had a significant between-task transfer bias towards oddball target weights in the time range of the canonical P3, indicating the presence of similar salience detection processes. Missile hits on an enemy were specifically identified as gambling wins, confirming the hypothesis that this goal-oriented event was appetitive. These findings suggest that it is possible to identify the contribution of canonical neural activities during otherwise ambiguous and uncontrolled task performance. Copyright © 2016 Elsevier Inc. All rights reserved.

  16. Categorical and continuous - disentangling the neural correlates of the carry effect in multi-digit addition

    Directory of Open Access Journals (Sweden)

    Dressel Katharina

    2010-11-01

    Full Text Available Abstract Background Recently it was suggested that the carry effect observed in addition involves both categorical and continuous processing characteristics. Methods In the present study, we aimed at identifying the specific neural correlates associated with processing either categorical or continuous aspects of the carry effect in an fMRI study on multi-digit addition. Results In line with our expectations, we observed two distinct parts of the fronto-parietal network subserving numerical cognition to be associated with either one of these two characteristics. On the one hand, the categorical aspect of the carry effect was associated with left-hemispheric language areas and the basal ganglia probably reflecting increased demands on procedural and problem solving processes. Complementarily, the continuous aspect of the carry effect was associated with increased intraparietal activation indicating increasing demands on magnitude processing as well as place-value integration with increasing unit sum. Conclusions In summary, the findings suggest representations and processes underlying the carry effect in multi-digit addition to be more complex and interactive than assumed previously.

  17. Nonlinear Dynamics and Chaos in Fractional-Order Hopfield Neural Networks with Delay

    Directory of Open Access Journals (Sweden)

    Xia Huang

    2013-01-01

    Full Text Available A fractional-order two-neuron Hopfield neural network with delay is proposed based on the classic well-known Hopfield neural networks, and further, the complex dynamical behaviors of such a network are investigated. A great variety of interesting dynamical phenomena, including single-periodic, multiple-periodic, and chaotic motions, are found to exist. The existence of chaotic attractors is verified by the bifurcation diagram and phase portraits as well.

  18. An analysis of nonlinear dynamics underlying neural activity related to auditory induction in the rat auditory cortex.

    Science.gov (United States)

    Noto, M; Nishikawa, J; Tateno, T

    2016-03-24

    A sound interrupted by silence is perceived as discontinuous. However, when high-intensity noise is inserted during the silence, the missing sound may be perceptually restored and be heard as uninterrupted. This illusory phenomenon is called auditory induction. Recent electrophysiological studies have revealed that auditory induction is associated with the primary auditory cortex (A1). Although experimental evidence has been accumulating, the neural mechanisms underlying auditory induction in A1 neurons are poorly understood. To elucidate this, we used both experimental and computational approaches. First, using an optical imaging method, we characterized population responses across auditory cortical fields to sound and identified five subfields in rats. Next, we examined neural population activity related to auditory induction with high temporal and spatial resolution in the rat auditory cortex (AC), including the A1 and several other AC subfields. Our imaging results showed that tone-burst stimuli interrupted by a silent gap elicited early phasic responses to the first tone and similar or smaller responses to the second tone following the gap. In contrast, tone stimuli interrupted by broadband noise (BN), considered to cause auditory induction, considerably suppressed or eliminated responses to the tone following the noise. Additionally, tone-burst stimuli that were interrupted by notched noise centered at the tone frequency, which is considered to decrease the strength of auditory induction, partially restored the second responses from the suppression caused by BN. To phenomenologically mimic the neural population activity in the A1 and thus investigate the mechanisms underlying auditory induction, we constructed a computational model from the periphery through the AC, including a nonlinear dynamical system. The computational model successively reproduced some of the above-mentioned experimental results. Therefore, our results suggest that a nonlinear, self

  19. Augmented Nonlinear Controller for Maximum Power-Point Tracking with Artificial Neural Network in Grid-Connected Photovoltaic Systems

    Directory of Open Access Journals (Sweden)

    Suliang Ma

    2016-11-01

    Full Text Available Photovoltaic (PV systems have non-linear characteristics that generate maximum power at one particular operating point. Environmental factors such as irradiance and temperature variations greatly affect the maximum power point (MPP. Diverse offline and online techniques have been introduced for tracking the MPP. Here, to track the MPP, an augmented-state feedback linearized (AFL non-linear controller combined with an artificial neural network (ANN is proposed. This approach linearizes the non-linear characteristics in PV systems and DC/DC converters, for tracking and optimizing the PV system operation. It also reduces the dependency of the designed controller on linearized models, to provide global stability. A complete model of the PV system is simulated. The existing maximum power-point tracking (MPPT and DC/DC boost-converter controller techniques are compared with the proposed ANN method. Two case studies, which simulate realistic circumstances, are presented to demonstrate the effectiveness and superiority of the proposed method. The AFL with ANN controller can provide good dynamic operation, faster convergence speed, and fewer operating-point oscillations around the MPP. It also tracks the global maxima under different conditions, especially irradiance-mutating situations, more effectively than the conventional methods. Detailed mathematical models and a control approach for a three-phase grid-connected intelligent hybrid system are proposed using MATLAB/Simulink.

  20. Frequency comb generation by a continuous-wave-pumped optical parametric oscillator based on cascading quadratic nonlinearities.

    Science.gov (United States)

    Ulvila, Ville; Phillips, C R; Halonen, Lauri; Vainio, Markku

    2013-11-01

    We report optical frequency comb generation by a continuous-wave pumped optical parametric oscillator (OPO) without any active modulation. The OPO is configured as singly resonant with an additional nonlinear crystal (periodically poled MgO:LiNbO3) placed inside the OPO for phase mismatched second harmonic generation (SHG) of the resonating signal beam. The phase mismatched SHG causes cascading χ(2) nonlinearities, which can substantially increase the effective χ(3) nonlinearity in MgO:LiNbO3, leading to spectral broadening of the OPO signal beam via self-phase modulation. The OPO generates a stable 4 THz wide (-30 dB) frequency comb centered at 1.56 μm.

  1. Nonlinear transfer function encodes synchronization in a neural network from the mammalian brain.

    Science.gov (United States)

    Menendez de la Prida, L; Sanchez-Andres, J V

    1999-09-01

    Synchronization is one of the mechanisms by which the brain encodes information. The observed synchronization of neuronal activity has, however, several levels of fluctuations, which presumably regulate local features of specific areas. This means that biological neural networks should have an intrinsic mechanism able to synchronize the neuronal activity but also to preserve the firing capability of individual cells. Here, we investigate the input-output relationship of a biological neural network from developing mammalian brain, i.e., the hippocampus. We show that the probability of occurrence of synchronous output activity (which consists in stereotyped population bursts recorded throughout the hippocampus) is encoded by a sigmoidal transfer function of the input frequency. Under this scope, low-frequency inputs will not produce any coherent output while high-frequency inputs will determine a synchronous pattern of output activity (population bursts). We analyze the effect of the network size (N) on the parameters of the transfer function (threshold and slope). We found that sigmoidal functions realistically simulate the synchronous output activity of hippocampal neural networks. This outcome is particularly important in the application of results from neural network models to neurobiology.

  2. Comparative nonlinear modeling of renal autoregulation in rats: Volterra approach versus artificial neural networks

    DEFF Research Database (Denmark)

    Chon, K H; Holstein-Rathlou, N H; Marsh, D J

    1998-01-01

    kernel estimation method based on Laguerre expansions. The results for the two types of artificial neural networks and the Volterra models are comparable in terms of normalized mean square error (NMSE) of the respective output prediction for independent testing data. However, the Volterra models obtained...

  3. Continuous-wave to pulse regimes for a family of passively mode-locked lasers with saturable nonlinearity

    Science.gov (United States)

    Dikandé, Alain M.; Voma Titafan, J.; Essimbi, B. Z.

    2017-10-01

    The transition dynamics from continuous-wave to pulse regimes of operation for a generic model of passively mode-locked lasers with saturable absorbers, characterized by an active medium with non-Kerr nonlinearity, are investigated analytically and numerically. The system is described by a complex Ginzburg-Landau equation with a general m:n saturable nonlinearity (i.e {I}m/{(1+{{Γ }}I)}n, where I is the field intensity and m and n are two positive numbers), coupled to a two-level gain equation. An analysis of stability of continuous waves, following the modulational instability approach, provides a global picture of the self-starting dynamics in the system. The analysis reveals two distinct routes depending on values of the couple (m, n), and on the dispersion regime: in the normal dispersion regime, when m = 2 and n is arbitrary, the self-starting requires positive values of the fast saturable absorber and nonlinearity coefficients, but negative values of these two parameters for the family with m = 0. However, when the spectral filter is negative, the laser can self-start for certain values of the input field and the nonlinearity saturation coefficient Γ. The present work provides a general map for the self-starting mechanisms of rare-earth doped figure-eight fiber lasers, as well as Kerr-lens mode-locked solid-state lasers.

  4. Nonlinear forecasting of stream flows using a chaotic approach and artificial neural networks

    Directory of Open Access Journals (Sweden)

    Hakan Tongal

    2013-07-01

    Full Text Available This paper evaluates the forecasting performance of two nonlinear models, k-nearest neighbor (kNN and feed-forward neural networks (FFNN, using stream flow data of the Kızılırmak River, the longest river in Turkey. For the kNN model, the required parameters are delay time, number of nearest neigh- bors and embedding dimension. The optimal delay time was obtained with the mutual information function; the number of nearest neighbors was obtained with the optimization process that minimi- zes RMSE as a function of the neighbor number and the embedding dimension was obtained with the correlation dimension method. The correlation dimension of the Kızılırmak River was d = 2.702, which was used in forming the input structure of the FFNN. The nearest integer above the correlation dimension (i.e., 3 provided the minimal number of required variables to characterize the system, and the maximum number of required variables was obtained with the nearest integer above the value 2d + 1 (Takens, 1981 (i.e., 7. Two FFNN models were developed that incorporate 3 and 7 lagged discharge values and the predicted performance compared to that of the kNN model. The results showed that the kNN model was superior to the FFNN model in stream flow forecasting. However, as a result from the kNN model structure, the model failed in the prediction of peak values. Additionally, it was found that the correlation dimension (if it existed could successfully be used in time series where the determina- tion of the input structure is difficult because of high inter-dependency, as in stream flow time series.  Resumen Este trabajo evalúa el desempeño de pronóstico de dos modelos no lineares, de método de clasificación no paramétrico kNN y de redes neuronales con alimentación avanzada (FNNN, usando datos de flujo del río Kizilirmak, el mayor de Turquía. Para el modelo kNN, los parámetros requeridos son tiempo de retraso, número de vecindarios cercanos y dimensión de

  5. Synchronization of chaotic systems and identification of nonlinear systems by using recurrent hierarchical type-2 fuzzy neural networks.

    Science.gov (United States)

    Mohammadzadeh, Ardashir; Ghaemi, Sehraneh

    2015-09-01

    This paper proposes a novel approach for training of proposed recurrent hierarchical interval type-2 fuzzy neural networks (RHT2FNN) based on the square-root cubature Kalman filters (SCKF). The SCKF algorithm is used to adjust the premise part of the type-2 FNN and the weights of defuzzification and the feedback weights. The recurrence property in the proposed network is the output feeding of each membership function to itself. The proposed RHT2FNN is employed in the sliding mode control scheme for the synchronization of chaotic systems. Unknown functions in the sliding mode control approach are estimated by RHT2FNN. Another application of the proposed RHT2FNN is the identification of dynamic nonlinear systems. The effectiveness of the proposed network and its learning algorithm is verified by several simulation examples. Furthermore, the universal approximation of RHT2FNNs is also shown. Copyright © 2015 ISA. Published by Elsevier Ltd. All rights reserved.

  6. Cooperative learning neural network output feedback control of uncertain nonlinear multi-agent systems under directed topologies

    Science.gov (United States)

    Wang, W.; Wang, D.; Peng, Z. H.

    2017-09-01

    Without assuming that the communication topologies among the neural network (NN) weights are to be undirected and the states of each agent are measurable, the cooperative learning NN output feedback control is addressed for uncertain nonlinear multi-agent systems with identical structures in strict-feedback form. By establishing directed communication topologies among NN weights to share their learned knowledge, NNs with cooperative learning laws are employed to identify the uncertainties. By designing NN-based κ-filter observers to estimate the unmeasurable states, a new cooperative learning output feedback control scheme is proposed to guarantee that the system outputs can track nonidentical reference signals with bounded tracking errors. A simulation example is given to demonstrate the effectiveness of the theoretical results.

  7. Adaptive neural control for dual-arm coordination of humanoid robot with unknown nonlinearities in output mechanism.

    Science.gov (United States)

    Liu, Zhi; Chen, Ci; Zhang, Yun; Chen, C L P

    2015-03-01

    To achieve an excellent dual-arm coordination of the humanoid robot, it is essential to deal with the nonlinearities existing in the system dynamics. The literatures so far on the humanoid robot control have a common assumption that the problem of output hysteresis could be ignored. However, in the practical applications, the output hysteresis is widely spread; and its existing limits the motion/force performances of the robotic system. In this paper, an adaptive neural control scheme, which takes the unknown output hysteresis and computational efficiency into account, is presented and investigated. In the controller design, the prior knowledge of system dynamics is assumed to be unknown. The motion error is guaranteed to converge to a small neighborhood of the origin by Lyapunov's stability theory. Simultaneously, the internal force is kept bounded and its error can be made arbitrarily small.

  8. Supervised local error estimation for nonlinear image registration using convolutional neural networks

    NARCIS (Netherlands)

    Eppenhof, Koen A.J.; Pluim, Josien P.W.; Styner, M.A.; Angelini, E.D.

    2017-01-01

    Error estimation in medical image registration is valuable when validating, comparing, or combining registration methods. To validate a nonlinear image registration method, ideally the registration error should be known for the entire image domain. We propose a supervised method for the estimation

  9. Synthetic Jet Actuator-Based Aircraft Tracking Using a Continuous Robust Nonlinear Control Strategy

    Directory of Open Access Journals (Sweden)

    N. Ramos-Pedroza

    2017-01-01

    Full Text Available A robust nonlinear control law that achieves trajectory tracking control for unmanned aerial vehicles (UAVs equipped with synthetic jet actuators (SJAs is presented in this paper. A key challenge in the control design is that the dynamic characteristics of SJAs are nonlinear and contain parametric uncertainty. The challenge resulting from the uncertain SJA actuator parameters is mitigated via innovative algebraic manipulation in the tracking error system derivation along with a robust nonlinear control law employing constant SJA parameter estimates. A key contribution of the paper is a rigorous analysis of the range of SJA actuator parameter uncertainty within which asymptotic UAV trajectory tracking can be achieved. A rigorous stability analysis is carried out to prove semiglobal asymptotic trajectory tracking. Detailed simulation results are included to illustrate the effectiveness of the proposed control law in the presence of wind gusts and varying levels of SJA actuator parameter uncertainty.

  10. Nonlinear Control of an Active Magnetic Bearing System Achieved Using a Fuzzy Control with Radial Basis Function Neural Network

    Directory of Open Access Journals (Sweden)

    Seng-Chi Chen

    2014-01-01

    Full Text Available Studies on active magnetic bearing (AMB systems are increasing in popularity and practical applications. Magnetic bearings cause less noise, friction, and vibration than the conventional mechanical bearings; however, the control of AMB systems requires further investigation. The magnetic force has a highly nonlinear relation to the control current and the air gap. This paper proposes an intelligent control method for positioning an AMB system that uses a neural fuzzy controller (NFC. The mathematical model of an AMB system comprises identification followed by collection of information from this system. A fuzzy logic controller (FLC, the parameters of which are adjusted using a radial basis function neural network (RBFNN, is applied to the unbalanced vibration in an AMB system. The AMB system exhibited a satisfactory control performance, with low overshoot, and produced improved transient and steady-state responses under various operating conditions. The NFC has been verified on a prototype AMB system. The proposed controller can be feasibly applied to AMB systems exposed to various external disturbances; demonstrating the effectiveness of the NFC with self-learning and self-improving capacities is proven.

  11. Short-Term Forecasting of Electric Loads Using Nonlinear Autoregressive Artificial Neural Networks with Exogenous Vector Inputs

    Directory of Open Access Journals (Sweden)

    Jaime Buitrago

    2017-01-01

    Full Text Available Short-term load forecasting is crucial for the operations planning of an electrical grid. Forecasting the next 24 h of electrical load in a grid allows operators to plan and optimize their resources. The purpose of this study is to develop a more accurate short-term load forecasting method utilizing non-linear autoregressive artificial neural networks (ANN with exogenous multi-variable input (NARX. The proposed implementation of the network is new: the neural network is trained in open-loop using actual load and weather data, and then, the network is placed in closed-loop to generate a forecast using the predicted load as the feedback input. Unlike the existing short-term load forecasting methods using ANNs, the proposed method uses its own output as the input in order to improve the accuracy, thus effectively implementing a feedback loop for the load, making it less dependent on external data. Using the proposed framework, mean absolute percent errors in the forecast in the order of 1% have been achieved, which is a 30% improvement on the average error using feedforward ANNs, ARMAX and state space methods, which can result in large savings by avoiding commissioning of unnecessary power plants. The New England electrical load data are used to train and validate the forecast prediction.

  12. Linear modeling of nonlinear systems using artificial neural networks based on I/O data and its application in power plant boiler modeling

    International Nuclear Information System (INIS)

    Ghaffari, A.; Nikkhah Bahrami, M.; Mohammadzaheri, M.

    2005-01-01

    In this paper a new method for linear modeling of nonlinear systems is presented. The method is based on the design of an artificial neural network with two layers. The network is trained only according to the input-output data of the system. The weights of connections in this network, represents the coefficients of the transfer function. For systems with linear behavior the method of least square error represents the best linear model of the system. However, for nonlinear systems, such as some subsystems in power plants boilers LSE does not represent the best linear approximation of the system, necessarily. In this paper a new linear modeling method is presented and applied to some subsystems in a power plant boiler. Comparison between the transfer function obtained in this way and by least square error method,shows that the neural network method gives better linear models for these nonlinear systems

  13. Recurrent-Neural-Network-Based Multivariable Adaptive Control for a Class of Nonlinear Dynamic Systems With Time-Varying Delay.

    Science.gov (United States)

    Hwang, Chih-Lyang; Jan, Chau

    2016-02-01

    At the beginning, an approximate nonlinear autoregressive moving average (NARMA) model is employed to represent a class of multivariable nonlinear dynamic systems with time-varying delay. It is known that the disadvantages of robust control for the NARMA model are as follows: 1) suitable control parameters for larger time delay are more sensitive to achieving desirable performance; 2) it only deals with bounded uncertainty; and 3) the nominal NARMA model must be learned in advance. Due to the dynamic feature of the NARMA model, a recurrent neural network (RNN) is online applied to learn it. However, the system performance becomes deteriorated due to the poor learning of the larger variation of system vector functions. In this situation, a simple network is employed to compensate the upper bound of the residue caused by the linear parameterization of the approximation error of RNN. An e -modification learning law with a projection for weight matrix is applied to guarantee its boundedness without persistent excitation. Under suitable conditions, the semiglobally ultimately bounded tracking with the boundedness of estimated weight matrix is obtained by the proposed RNN-based multivariable adaptive control. Finally, simulations are presented to verify the effectiveness and robustness of the proposed control.

  14. An Artificial Neural Network-Based Algorithm for Evaluation of Fatigue Crack Propagation Considering Nonlinear Damage Accumulation.

    Science.gov (United States)

    Zhang, Wei; Bao, Zhangmin; Jiang, Shan; He, Jingjing

    2016-06-17

    In the aerospace and aviation sectors, the damage tolerance concept has been applied widely so that the modeling analysis of fatigue crack growth has become more and more significant. Since the process of crack propagation is highly nonlinear and determined by many factors, such as applied stress, plastic zone in the crack tip, length of the crack, etc. , it is difficult to build up a general and flexible explicit function to accurately quantify this complicated relationship. Fortunately, the artificial neural network (ANN) is considered a powerful tool for establishing the nonlinear multivariate projection which shows potential in handling the fatigue crack problem. In this paper, a novel fatigue crack calculation algorithm based on a radial basis function (RBF)-ANN is proposed to study this relationship from the experimental data. In addition, a parameter called the equivalent stress intensity factor is also employed as training data to account for loading interaction effects. The testing data is then placed under constant amplitude loading with different stress ratios or overloads used for model validation. Moreover, the Forman and Wheeler equations are also adopted to compare with our proposed algorithm. The current investigation shows that the ANN-based approach can deliver a better agreement with the experimental data than the other two models, which supports that the RBF-ANN has nontrivial advantages in handling the fatigue crack growth problem. Furthermore, it implies that the proposed algorithm is possibly a sophisticated and promising method to compute fatigue crack growth in terms of loading interaction effects.

  15. Neural network based online simultaneous policy update algorithm for solving the HJI equation in nonlinear H∞ control.

    Science.gov (United States)

    Wu, Huai-Ning; Luo, Biao

    2012-12-01

    It is well known that the nonlinear H∞ state feedback control problem relies on the solution of the Hamilton-Jacobi-Isaacs (HJI) equation, which is a nonlinear partial differential equation that has proven to be impossible to solve analytically. In this paper, a neural network (NN)-based online simultaneous policy update algorithm (SPUA) is developed to solve the HJI equation, in which knowledge of internal system dynamics is not required. First, we propose an online SPUA which can be viewed as a reinforcement learning technique for two players to learn their optimal actions in an unknown environment. The proposed online SPUA updates control and disturbance policies simultaneously; thus, only one iterative loop is needed. Second, the convergence of the online SPUA is established by proving that it is mathematically equivalent to Newton's method for finding a fixed point in a Banach space. Third, we develop an actor-critic structure for the implementation of the online SPUA, in which only one critic NN is needed for approximating the cost function, and a least-square method is given for estimating the NN weight parameters. Finally, simulation studies are provided to demonstrate the effectiveness of the proposed algorithm.

  16. Predicting non-linear dynamics by stable local learning in a recurrent spiking neural network.

    Science.gov (United States)

    Gilra, Aditya; Gerstner, Wulfram

    2017-11-27

    The brain needs to predict how the body reacts to motor commands, but how a network of spiking neurons can learn non-linear body dynamics using local, online and stable learning rules is unclear. Here, we present a supervised learning scheme for the feedforward and recurrent connections in a network of heterogeneous spiking neurons. The error in the output is fed back through fixed random connections with a negative gain, causing the network to follow the desired dynamics. The rule for Feedback-based Online Local Learning Of Weights (FOLLOW) is local in the sense that weight changes depend on the presynaptic activity and the error signal projected onto the postsynaptic neuron. We provide examples of learning linear, non-linear and chaotic dynamics, as well as the dynamics of a two-link arm. Under reasonable approximations, we show, using the Lyapunov method, that FOLLOW learning is uniformly stable, with the error going to zero asymptotically.

  17. The effect of continuous, nonlinearly transformed visual feedback on rapid aiming movements.

    NARCIS (Netherlands)

    Rieger, Martina; Verwey, Willem B.; Massen, Cristina

    2008-01-01

    We investigated the ability to adjust to nonlinear transformations that allow people to control external systems like machines and tools. Earlier research (Verwey and Heuer 2007) showed that in the presence of just terminal feedback participants develop an internal model of such transformations that

  18. Continuous variable tripartite entanglement and Einstein-Podolsky-Rosen correlations from triple nonlinearities

    International Nuclear Information System (INIS)

    Olsen, M K; Bradley, A S; Reid, M D

    2006-01-01

    We compare theoretically the tripartite entanglement available from the use of three concurrent χ (2) nonlinearities and three independent squeezed states mixed on beamsplitters, using an appropriate version of the van Loock-Furusawa inequalities. We also define three-mode generalizations of the Einstein-Podolsky-Rosen paradox which are an alternative for demonstrating the inseparability of the density matrix

  19. Nonlinear waveform distortion and shock formation in the near field of a continuous wave piston source

    Science.gov (United States)

    Sapozhnikov, Oleg A.; Khokhlova, Vera A.; Cathignol, Dominique

    2004-05-01

    A classical effect of nonlinear acoustics is that a plane sinusoidal acoustic wave propagating in a nonlinear medium transforms to a sawtooth wave with one shock per cycle. However, the waveform evolution can be quite different in the near field of a plane source due to diffraction. Previous numerical simulations of nonlinear acoustic waves in the near field of a circular piston source predict the development of two shocks per wave cycle [Khokhlova et al., J. Acoust. Soc. Am. 110, 95-108 (2001)]. Moreover, at some locations the peak pressure may be up to 4 times the source amplitude. The motivation of this work was to experimentally verify and further explain the phenomena of the nonlinear waveform distortion. Measurements were conducted in water with a 47-mm-diameter unfocused transducer, working at 1-MHz frequency. For pressure amplitudes higher than 0.5 MPa, two shocks per cycle were observed in the waveform beyond the last minimum of the fundamental harmonic amplitude. With the increase of the observation distance, these two shocks collided and formed one shock (per cycle), i.e., the waveform developed into the classical sawtooth wave. The experimental results were in a very good agreement with the modeling based on the Khokhlov-Zabolotskaya-Kuznetsov (KZK) equation.

  20. Improved Minimum Entropy Filtering for Continuous Nonlinear Non-Gaussian Systems Using a Generalized Density Evolution Equation

    Directory of Open Access Journals (Sweden)

    Jinliang Xu

    2013-06-01

    Full Text Available This paper investigates the filtering problem for multivariate continuous nonlinear non-Gaussian systems based on an improved minimum error entropy (MEE criterion. The system is described by a set of nonlinear continuous equations with non-Gaussian system noises and measurement noises. The recently developed generalized density evolution equation is utilized to formulate the joint probability density function (PDF of the estimation errors. Combining the entropy of the estimation error with the mean squared error, a novel performance index is constructed to ensure the estimation error not only has small uncertainty but also approaches to zero. According to the conjugate gradient method, the optimal filter gain matrix is then obtained by minimizing the improved minimum error entropy criterion. In addition, the condition is proposed to guarantee that the estimation error dynamics is exponentially bounded in the mean square sense. Finally, the comparative simulation results are presented to show that the proposed MEE filter is superior to nonlinear unscented Kalman filter (UKF.

  1. Global exponential stability of BAM neural networks with transmission delays and nonlinear impulses

    International Nuclear Information System (INIS)

    Huang Zhenkun; Xia Yonghui

    2008-01-01

    In this paper, a class of bidirectional associative memory (BAM) networks with transmission delays and nonlinear impulses are studied. Some new sufficient conditions are established for the existence and global exponential stability of a unique equilibrium, which generalize and improve the previously known results. The sufficient conditions are easy to verify and when the impulsive jumps are linear or absent the results reduce to those of common impulsive or non-impulsive systems. Finally, an example is given to show the feasibility and effectiveness of our results

  2. Robust synchronization of coupled neural oscillators using the derivative-free nonlinear Kalman Filter.

    Science.gov (United States)

    Rigatos, Gerasimos

    2014-12-01

    A synchronizing control scheme for coupled neural oscillators of the FitzHugh-Nagumo type is proposed. Using differential flatness theory the dynamical model of two coupled neural oscillators is transformed into an equivalent model in the linear canonical (Brunovsky) form. A similar linearized description is succeeded using differential geometry methods and the computation of Lie derivatives. For such a model it becomes possible to design a state feedback controller that assures the synchronization of the membrane's voltage variations for the two neurons. To compensate for disturbances that affect the neurons' model as well as for parametric uncertainties and variations a disturbance observer is designed based on Kalman Filtering. This consists of implementation of the standard Kalman Filter recursion on the linearized equivalent model of the coupled neurons and computation of state and disturbance estimates using the diffeomorphism (relations about state variables transformation) provided by differential flatness theory. After estimating the disturbance terms in the neurons' model their compensation becomes possible. The performance of the synchronization control loop is tested through simulation experiments.

  3. Dynamic stability of a vertically excited non-linear continuous system

    Czech Academy of Sciences Publication Activity Database

    Náprstek, Jiří; Fischer, Cyril

    2015-01-01

    Roč. 155, July (2015), s. 106-114 ISSN 0045-7949 R&D Projects: GA ČR(CZ) GA15-01035S Institutional support: RVO:68378297 Keywords : non-linear systems * auto-parametric systems * semi-trivial solution * dynamic stability * system recovery * post- critical response Subject RIV: JM - Building Engineering Impact factor: 2.425, year: 2015 http://www.sciencedirect.com/science/article/pii/S0045794915000024

  4. Robust adaptive controller design for a class of uncertain nonlinear systems using online T-S fuzzy-neural modeling approach.

    Science.gov (United States)

    Chien, Yi-Hsing; Wang, Wei-Yen; Leu, Yih-Guang; Lee, Tsu-Tian

    2011-04-01

    This paper proposes a novel method of online modeling and control via the Takagi-Sugeno (T-S) fuzzy-neural model for a class of uncertain nonlinear systems with some kinds of outputs. Although studies about adaptive T-S fuzzy-neural controllers have been made on some nonaffine nonlinear systems, little is known about the more complicated uncertain nonlinear systems. Because the nonlinear functions of the systems are uncertain, traditional T-S fuzzy control methods can model and control them only with great difficulty, if at all. Instead of modeling these uncertain functions directly, we propose that a T-S fuzzy-neural model approximates a so-called virtual linearized system (VLS) of the system, which includes modeling errors and external disturbances. We also propose an online identification algorithm for the VLS and put significant emphasis on robust tracking controller design using an adaptive scheme for the uncertain systems. Moreover, the stability of the closed-loop systems is proven by using strictly positive real Lyapunov theory. The proposed overall scheme guarantees that the outputs of the closed-loop systems asymptotically track the desired output trajectories. To illustrate the effectiveness and applicability of the proposed method, simulation results are given in this paper.

  5. Efficient continuous-wave nonlinear frequency conversion in high-Q gallium nitride photonic crystal cavities on silicon

    Directory of Open Access Journals (Sweden)

    Mohamed Sabry Mohamed

    2017-03-01

    Full Text Available We report on nonlinear frequency conversion from the telecom range via second harmonic generation (SHG and third harmonic generation (THG in suspended gallium nitride slab photonic crystal (PhC cavities on silicon, under continuous-wave resonant excitation. Optimized two-dimensional PhC cavities with augmented far-field coupling have been characterized with quality factors as high as 4.4 × 104, approaching the computed theoretical values. The strong enhancement in light confinement has enabled efficient SHG, achieving a normalized conversion efficiency of 2.4 × 10−3 W−1, as well as simultaneous THG. SHG emission power of up to 0.74 nW has been detected without saturation. The results herein validate the suitability of gallium nitride for integrated nonlinear optical processing.

  6. Stability Analysis of Continuous-Time and Discrete-Time Quaternion-Valued Neural Networks With Linear Threshold Neurons.

    Science.gov (United States)

    Chen, Xiaofeng; Song, Qiankun; Li, Zhongshan; Zhao, Zhenjiang; Liu, Yurong

    2018-07-01

    This paper addresses the problem of stability for continuous-time and discrete-time quaternion-valued neural networks (QVNNs) with linear threshold neurons. Applying the semidiscretization technique to the continuous-time QVNNs, the discrete-time analogs are obtained, which preserve the dynamical characteristics of their continuous-time counterparts. Via the plural decomposition method of quaternion, homeomorphic mapping theorem, as well as Lyapunov theorem, some sufficient conditions on the existence, uniqueness, and global asymptotical stability of the equilibrium point are derived for the continuous-time QVNNs and their discrete-time analogs, respectively. Furthermore, a uniform sufficient condition on the existence, uniqueness, and global asymptotical stability of the equilibrium point is obtained for both continuous-time QVNNs and their discrete-time version. Finally, two numerical examples are provided to substantiate the effectiveness of the proposed results.

  7. LMI-based stability and performance conditions for continuous-time nonlinear systems in Takagi-Sugeno's form.

    Science.gov (United States)

    Lam, H K; Leung, Frank H F

    2007-10-01

    This correspondence presents the stability analysis and performance design of the continuous-time fuzzy-model-based control systems. The idea of the nonparallel-distributed-compensation (non-PDC) control laws is extended to the continuous-time fuzzy-model-based control systems. A nonlinear controller with non-PDC control laws is proposed to stabilize the continuous-time nonlinear systems in Takagi-Sugeno's form. To produce the stability-analysis result, a parameter-dependent Lyapunov function (PDLF) is employed. However, two difficulties are usually encountered: 1) the time-derivative terms produced by the PDLF will complicate the stability analysis and 2) the stability conditions are not in the form of linear-matrix inequalities (LMIs) that aid the design of feedback gains. To tackle the first difficulty, the time-derivative terms are represented by some weighted-sum terms in some existing approaches, which will increase the number of stability conditions significantly. In view of the second difficulty, some positive-definitive terms are added in order to cast the stability conditions into LMIs. In this correspondence, the favorable properties of the membership functions and nonlinear control laws, which allow the introduction of some free matrices, are employed to alleviate the two difficulties while retaining the favorable properties of PDLF-based approach. LMI-based stability conditions are derived to ensure the system stability. Furthermore, based on a common scalar performance index, LMI-based performance conditions are derived to guarantee the system performance. Simulation examples are given to illustrate the effectiveness of the proposed approach.

  8. Continuous-measurement-enhanced self-trapping of degenerate ultracold atoms in a double well: Nonlinear quantum Zeno effect

    International Nuclear Information System (INIS)

    Li Weidong; Liu Jie

    2006-01-01

    In the present paper we investigate the influence of measurements on the quantum dynamics of degenerate Bose atoms gases in a symmetric double well. We show that continuous measurements enhance asymmetry on the density distribution of the atoms and broaden the parameter regime for self-trapping. We term this phenomenon as nonlinear quantum Zeno effect in analog to the celebrated Zeno effect in a linear quantum system. Under discontinuous measurements, the self-trapping due to the atomic interaction in the degenerate bosons is shown to be destroyed completely. Underlying physics is revealed and possible experimental realization is discussed

  9. Existence and global exponential stability of periodic solution to BAM neural networks with periodic coefficients and continuously distributed delays

    International Nuclear Information System (INIS)

    Zhou Tiejun; Chen Anping; Zhou Yuyuan

    2005-01-01

    By using the continuation theorem of coincidence degree theory and Liapunov function, we obtain some sufficient criteria to ensure the existence and global exponential stability of periodic solution to the bidirectional associative memory (BAM) neural networks with periodic coefficients and continuously distributed delays. These results improve and generalize the works of papers [J. Cao, L. Wang, Phys. Rev. E 61 (2000) 1825] and [Z. Liu, A. Chen, J. Cao, L. Huang, IEEE Trans. Circuits Systems I 50 (2003) 1162]. An example is given to illustrate that the criteria are feasible

  10. Existence and global exponential stability of periodic solution to BAM neural networks with periodic coefficients and continuously distributed delays

    Science.gov (United States)

    Zhou, distributed delays [rapid communication] T.; Chen, A.; Zhou, Y.

    2005-08-01

    By using the continuation theorem of coincidence degree theory and Liapunov function, we obtain some sufficient criteria to ensure the existence and global exponential stability of periodic solution to the bidirectional associative memory (BAM) neural networks with periodic coefficients and continuously distributed delays. These results improve and generalize the works of papers [J. Cao, L. Wang, Phys. Rev. E 61 (2000) 1825] and [Z. Liu, A. Chen, J. Cao, L. Huang, IEEE Trans. Circuits Systems I 50 (2003) 1162]. An example is given to illustrate that the criteria are feasible.

  11. Comparison of the Gen Expression Programming, Nonlinear Time Series and Artificial Neural Network in Estimating the River Daily Flow (Case Study: The Karun River

    Directory of Open Access Journals (Sweden)

    R. Zamani

    2015-06-01

    Full Text Available Today, the daily flow forecasting of rivers is an important issue in hydrology and water resources and thus can be used the results of daily river flow modeling in water resources management, droughts and floods monitoring. In this study, due to the importance of this issue, using nonlinear time series models and artificial intelligence (Artificial Neural Network and Gen Expression Programming, the daily flow modeling has been at the time interval (1981-2012 in the Armand hydrometric station on the Karun River. Armand station upstream basin is one of the most basins in the North Karun basin and includes four sub basins (Vanak, Middle Karun, Beheshtabad and Kohrang.The results of this study shown that artificial intelligence models have superior than nonlinear time series in flow daily simulation in the Karun River. As well as, modeling and comparison of artificial intelligence models showed that the Gen Expression Programming have evaluation criteria better than artificial neural network.

  12. Investigating Nonlinear Shoreline Multiperiod Change from Orthophoto Map Information by Using a Neural Network Model

    Directory of Open Access Journals (Sweden)

    Tienfuan Kerh

    2014-01-01

    Full Text Available The effects of extreme weather and overdevelopment may cause some coastal areas to exhibit erosion problems, which in turn may contribute to creating disasters of varying scale, particularly in regions comprising islands. This study used aerial survey information from three periods (1990, 2001, and 2010 and used graphical software to establish the spatial data of six beaches surrounding the island of Taiwan. An overlaying technique was then implemented to compare the sandy area of each beach in the aforementioned study periods. In addition, an artificial neural network model was developed based on available digitised coordinates for predicting coastline variation for 2015 and 2020. An onsite investigation was performed using a global positioning system for comparing the beaches. The results revealed that two beaches from this study may have experienced significant changes in total sandy areas under a statistical 95% confidence interval. The proposed method and the result of this study may provide a valuable reference in follow-up research and applications.

  13. Stability of bumps in piecewise smooth neural fields with nonlinear adaptation

    KAUST Repository

    Kilpatrick, Zachary P.

    2010-06-01

    We study the linear stability of stationary bumps in piecewise smooth neural fields with local negative feedback in the form of synaptic depression or spike frequency adaptation. The continuum dynamics is described in terms of a nonlocal integrodifferential equation, in which the integral kernel represents the spatial distribution of synaptic weights between populations of neurons whose mean firing rate is taken to be a Heaviside function of local activity. Discontinuities in the adaptation variable associated with a bump solution means that bump stability cannot be analyzed by constructing the Evans function for a network with a sigmoidal gain function and then taking the high-gain limit. In the case of synaptic depression, we show that linear stability can be formulated in terms of solutions to a system of pseudo-linear equations. We thus establish that sufficiently strong synaptic depression can destabilize a bump that is stable in the absence of depression. These instabilities are dominated by shift perturbations that evolve into traveling pulses. In the case of spike frequency adaptation, we show that for a wide class of perturbations the activity and adaptation variables decouple in the linear regime, thus allowing us to explicitly determine stability in terms of the spectrum of a smooth linear operator. We find that bumps are always unstable with respect to this class of perturbations, and destabilization of a bump can result in either a traveling pulse or a spatially localized breather. © 2010 Elsevier B.V. All rights reserved.

  14. Robust artificial neural network for reliability and sensitivity analyses of complex non-linear systems.

    Science.gov (United States)

    Oparaji, Uchenna; Sheu, Rong-Jiun; Bankhead, Mark; Austin, Jonathan; Patelli, Edoardo

    2017-12-01

    Artificial Neural Networks (ANNs) are commonly used in place of expensive models to reduce the computational burden required for uncertainty quantification, reliability and sensitivity analyses. ANN with selected architecture is trained with the back-propagation algorithm from few data representatives of the input/output relationship of the underlying model of interest. However, different performing ANNs might be obtained with the same training data as a result of the random initialization of the weight parameters in each of the network, leading to an uncertainty in selecting the best performing ANN. On the other hand, using cross-validation to select the best performing ANN based on the ANN with the highest R 2 value can lead to biassing in the prediction. This is as a result of the fact that the use of R 2 cannot determine if the prediction made by ANN is biased. Additionally, R 2 does not indicate if a model is adequate, as it is possible to have a low R 2 for a good model and a high R 2 for a bad model. Hence, in this paper, we propose an approach to improve the robustness of a prediction made by ANN. The approach is based on a systematic combination of identical trained ANNs, by coupling the Bayesian framework and model averaging. Additionally, the uncertainties of the robust prediction derived from the approach are quantified in terms of confidence intervals. To demonstrate the applicability of the proposed approach, two synthetic numerical examples are presented. Finally, the proposed approach is used to perform a reliability and sensitivity analyses on a process simulation model of a UK nuclear effluent treatment plant developed by National Nuclear Laboratory (NNL) and treated in this study as a black-box employing a set of training data as a test case. This model has been extensively validated against plant and experimental data and used to support the UK effluent discharge strategy. Copyright © 2017 Elsevier Ltd. All rights reserved.

  15. Evapotranspiration Modeling by Linear, Nonlinear Regression and Artificial Neural Network in Greenhouse (Case study Reference Crop, Cucumber and Tomato

    Directory of Open Access Journals (Sweden)

    vahid Rezaverdinejad

    2017-01-01

    important models to estimate ETc in greenhouse. The inputs of these models are net radiation, temperature, day after planting and air vapour pressure deficit (or relative humidity. Materials and Methods: In this study, daily ETc of reference crop, greenhouse tomato and cucumber crops were measured using lysimeter method in Urmia region. Several linear, nonlinear regressions and artificial neural networks were considered for ETc modelling in greenhouse. For this purpose, the effective meteorological parameters on ETc process includes: air temperature (T, air humidity (RH, air pressure (P, air vapour pressure deficit (VPD, day after planting (N and greenhouse net radiation (SR were considered and measured. According to the goodness of fit, different models of artificial neural networks and regression were compared and evaluated. Furthermore, based on partial derivatives of regression models, sensitivity analysis was conducted. The accuracy and performance of the employed models was judged by ten statistical indices namely root mean square error (RMSE, normalized root mean square error (NRMSE and coefficient of determination (R2. Results and Discussion: Based on the results, the most accurate regression model to reference ETc prediction was obtained three variables exponential function of VPD, RH and SR with RMSE=0.378 mm day-1. The RMSE of optimal artificial neural network to reference ET prediction for train and test data sets were obtained 0.089 and 0.365 mm day-1, respectively. The performance of logarithmic and exponential functions to prediction of cucumber ETc were proper, with high dependent variables especially, and the most accurate regression model to cucumber ET prediction was obtained for exponential function of five variables: VPD, N, T, RH and SR with RMSE=0.353 mm day-1. In addition, for tomato ET prediction, the most accurate regression model was obtained for exponential function of four variables: VPD, N, RH and SR with RMSE= 0.329 mm day-1. The best

  16. Modelling the continuous cooling transformation diagram of engineering steels using neural networks. Part II. Microstructure and hardness

    Energy Technology Data Exchange (ETDEWEB)

    Wolk, P.J. van der; Wang, J. [Delft Univ. of Technology (Netherlands); Sietsma, J.; Zwaag, S. van der [Delft Univ. of Technology, Lab. for Materials Science (Netherlands)

    2002-12-01

    The neural network model of Van der Wolk et al. (2002) describes the effect of composition on the phase regions of the continuous cooling transformation (CCT) diagram, yet does not consider the fractions of microstructural components and the hardness data that are often quoted in CCT diagrams. In the present paper, the construction of two more neural network models, one for the fractions of ferrite, pearlite, bainite and martensite in the microstructure, and one for the hardness after cooling, using the data of 338 and 412 diagrams, respectively. The accuracy of each model was found to be similar to the expected experimental error; moreover, the models were found to be mutually consistent, although they have been constructed independently. Furthermore, the trends in these properties for alloying elements can be quantified with the models, and are largely in line with metallurgical expectations. (orig.)

  17. Recurrent neural network approach to quantum signal: coherent state restoration for continuous-variable quantum key distribution

    Science.gov (United States)

    Lu, Weizhao; Huang, Chunhui; Hou, Kun; Shi, Liting; Zhao, Huihui; Li, Zhengmei; Qiu, Jianfeng

    2018-05-01

    In continuous-variable quantum key distribution (CV-QKD), weak signal carrying information transmits from Alice to Bob; during this process it is easily influenced by unknown noise which reduces signal-to-noise ratio, and strongly impacts reliability and stability of the communication. Recurrent quantum neural network (RQNN) is an artificial neural network model which can perform stochastic filtering without any prior knowledge of the signal and noise. In this paper, a modified RQNN algorithm with expectation maximization algorithm is proposed to process the signal in CV-QKD, which follows the basic rule of quantum mechanics. After RQNN, noise power decreases about 15 dBm, coherent signal recognition rate of RQNN is 96%, quantum bit error rate (QBER) drops to 4%, which is 6.9% lower than original QBER, and channel capacity is notably enlarged.

  18. Distributed Adaptive Neural Network Output Tracking of Leader-Following High-Order Stochastic Nonlinear Multiagent Systems With Unknown Dead-Zone Input.

    Science.gov (United States)

    Hua, Changchun; Zhang, Liuliu; Guan, Xinping

    2017-01-01

    This paper studies the problem of distributed output tracking consensus control for a class of high-order stochastic nonlinear multiagent systems with unknown nonlinear dead-zone under a directed graph topology. The adaptive neural networks are used to approximate the unknown nonlinear functions and a new inequality is used to deal with the completely unknown dead-zone input. Then, we design the controllers based on backstepping method and the dynamic surface control technique. It is strictly proved that the resulting closed-loop system is stable in probability in the sense of semiglobally uniform ultimate boundedness and the tracking errors between the leader and the followers approach to a small residual set based on Lyapunov stability theory. Finally, two simulation examples are presented to show the effectiveness and the advantages of the proposed techniques.

  19. Modeling and Properties of Nonlinear Stochastic Dynamical System of Continuous Culture

    Science.gov (United States)

    Wang, Lei; Feng, Enmin; Ye, Jianxiong; Xiu, Zhilong

    The stochastic counterpart to the deterministic description of continuous fermentation with ordinary differential equation is investigated in the process of glycerol bio-dissimilation to 1,3-propanediol by Klebsiella pneumoniae. We briefly discuss the continuous fermentation process driven by three-dimensional Brownian motion and Lipschitz coefficients, which is suitable for the factual fermentation. Subsequently, we study the existence and uniqueness of solutions for the stochastic system as well as the boundedness of the Two-order Moment and the Markov property of the solution. Finally stochastic simulation is carried out under the Stochastic Euler-Maruyama method.

  20. From point process observations to collective neural dynamics: Nonlinear Hawkes process GLMs, low-dimensional dynamics and coarse graining.

    Science.gov (United States)

    Truccolo, Wilson

    2016-11-01

    This review presents a perspective on capturing collective dynamics in recorded neuronal ensembles based on multivariate point process models, inference of low-dimensional dynamics and coarse graining of spatiotemporal measurements. A general probabilistic framework for continuous time point processes reviewed, with an emphasis on multivariate nonlinear Hawkes processes with exogenous inputs. A point process generalized linear model (PP-GLM) framework for the estimation of discrete time multivariate nonlinear Hawkes processes is described. The approach is illustrated with the modeling of collective dynamics in neocortical neuronal ensembles recorded in human and non-human primates, and prediction of single-neuron spiking. A complementary approach to capture collective dynamics based on low-dimensional dynamics ("order parameters") inferred via latent state-space models with point process observations is presented. The approach is illustrated by inferring and decoding low-dimensional dynamics in primate motor cortex during naturalistic reach and grasp movements. Finally, we briefly review hypothesis tests based on conditional inference and spatiotemporal coarse graining for assessing collective dynamics in recorded neuronal ensembles. Published by Elsevier Ltd.

  1. New continual analogs of two-dimensional Toda lattices related with nonlinear integro-differential equations

    International Nuclear Information System (INIS)

    Savel'ev, M.V.

    1988-01-01

    Continual ''extensions'' of two-dimensional Toda lattices are proposed. They are described by integro-differential equations, generally speaking, with singular kernels, depending on new (third) variable. The problem of their integrability on the corresponding class of the initial discrete system solutions is discussed. The latter takes place, in particular, for the kernel coinciding with the causal function

  2. Continuous Dependence on Modeling in the Cauchy Problem for Nonlinear Elliptic Equations.

    Science.gov (United States)

    1987-04-01

    problema di Cauchy per le equazione di tipo ellitico, Ann. Mat. Pura Appl., 46 (1958), pp. 131-153 [18] P. W. Schaefer, On the Cauchy problem for an...Continued) PP 438 PP 448 Fletcher, Jean W. Supply Problems in the Naval Reserve, Cymrot, Donald J., Military Retiremnt and Social Security: A 14 pp

  3. Spiking Neural Classifier with Lumped Dendritic Nonlinearity and Binary Synapses: A Current Mode VLSI Implementation and Analysis.

    Science.gov (United States)

    Bhaduri, Aritra; Banerjee, Amitava; Roy, Subhrajit; Kar, Sougata; Basu, Arindam

    2018-03-01

    We present a neuromorphic current mode implementation of a spiking neural classifier with lumped square law dendritic nonlinearity. It has been shown previously in software simulations that such a system with binary synapses can be trained with structural plasticity algorithms to achieve comparable classification accuracy with fewer synaptic resources than conventional algorithms. We show that even in real analog systems with manufacturing imperfections (CV of 23.5% and 14.4% for dendritic branch gains and leaks respectively), this network is able to produce comparable results with fewer synaptic resources. The chip fabricated in [Formula: see text]m complementary metal oxide semiconductor has eight dendrites per cell and uses two opposing cells per class to cancel common-mode inputs. The chip can operate down to a [Formula: see text] V and dissipates 19 nW of static power per neuronal cell and [Formula: see text] 125 pJ/spike. For two-class classification problems of high-dimensional rate encoded binary patterns, the hardware achieves comparable performance as software implementation of the same with only about a 0.5% reduction in accuracy. On two UCI data sets, the IC integrated circuit has classification accuracy comparable to standard machine learners like support vector machines and extreme learning machines while using two to five times binary synapses. We also show that the system can operate on mean rate encoded spike patterns, as well as short bursts of spikes. To the best of our knowledge, this is the first attempt in hardware to perform classification exploiting dendritic properties and binary synapses.

  4. Engineering non-linear resonator mode interactions in circuit QED by continuous driving: Manipulation of a photonic quantum memory

    Science.gov (United States)

    Reagor, Matthew; Pfaff, Wolfgang; Heeres, Reinier; Ofek, Nissim; Chou, Kevin; Blumoff, Jacob; Leghtas, Zaki; Touzard, Steven; Sliwa, Katrina; Holland, Eric; Albert, Victor V.; Frunzio, Luigi; Devoret, Michel H.; Jiang, Liang; Schoelkopf, Robert J.

    2015-03-01

    Recent advances in circuit QED have shown great potential for using microwave resonators as quantum memories. In particular, it is possible to encode the state of a quantum bit in non-classical photonic states inside a high-Q linear resonator. An outstanding challenge is to perform controlled operations on such a photonic state. We demonstrate experimentally how a continuous drive on a transmon qubit coupled to a high-Q storage resonator can be used to induce non-linear dynamics of the resonator. Tailoring the drive properties allows us to cancel or enhance non-linearities in the system such that we can manipulate the state stored in the cavity. This approach can be used to either counteract undesirable evolution due to the bare Hamiltonian of the system or, ultimately, to perform logical operations on the state encoded in the cavity field. Our method provides a promising pathway towards performing universal control for quantum states stored in high-coherence resonators in the circuit QED platform.

  5. Estimating Time Series Soil Moisture by Applying Recurrent Nonlinear Autoregressive Neural Networks to Passive Microwave Data over the Heihe River Basin, China

    Directory of Open Access Journals (Sweden)

    Zheng Lu

    2017-06-01

    Full Text Available A method using a nonlinear auto-regressive neural network with exogenous input (NARXnn to retrieve time series soil moisture (SM that is spatially and temporally continuous and high quality over the Heihe River Basin (HRB in China was investigated in this study. The input training data consisted of the X-band dual polarization brightness temperature (TB and the Ka-band V polarization TB from the Advanced Microwave Scanning Radiometer II (AMSR2, Global Land Satellite product (GLASS Leaf Area Index (LAI, precipitation from the Tropical Rainfall Measuring Mission (TRMM and the Global Precipitation Measurement (GPM, and a global 30 arc-second elevation (GTOPO-30. The output training data were generated from fused SM products of the Japan Aerospace Exploration Agency (JAXA and the Land Surface Parameter Model (LPRM. The reprocessed fused SM from two years (2013 and 2014 was inputted into the NARXnn for training; subsequently, SM during a third year (2015 was estimated. Direct and indirect validations were then performed during the period 2015 by comparing with in situ measurements, SM from JAXA, LPRM and the Global Land Data Assimilation System (GLDAS, as well as precipitation data from TRMM and GPM. The results showed that the SM predictions from NARXnn performed best, as indicated by their higher correlation coefficients (R ≥ 0.85 for the whole year of 2015, lower Bias values (absolute value of Bias ≤ 0.02 and root mean square error values (RMSE ≤ 0.06, and their improved response to precipitation. This method is being used to produce the NARXnn SM product over the HRB in China.

  6. Novel delay-distribution-dependent stability analysis for continuous-time recurrent neural networks with stochastic delay

    International Nuclear Information System (INIS)

    Wang Shen-Quan; Feng Jian; Zhao Qing

    2012-01-01

    In this paper, the problem of delay-distribution-dependent stability is investigated for continuous-time recurrent neural networks (CRNNs) with stochastic delay. Different from the common assumptions on time delays, it is assumed that the probability distribution of the delay taking values in some intervals is known a priori. By making full use of the information concerning the probability distribution of the delay and by using a tighter bounding technique (the reciprocally convex combination method), less conservative asymptotic mean-square stable sufficient conditions are derived in terms of linear matrix inequalities (LMIs). Two numerical examples show that our results are better than the existing ones. (general)

  7. A self-adaption compensation control for hysteresis nonlinearity in piezo-actuated stages based on Pi-sigma fuzzy neural network

    Science.gov (United States)

    Xu, Rui; Zhou, Miaolei

    2018-04-01

    Piezo-actuated stages are widely applied in the high-precision positioning field nowadays. However, the inherent hysteresis nonlinearity in piezo-actuated stages greatly deteriorates the positioning accuracy of piezo-actuated stages. This paper first utilizes a nonlinear autoregressive moving average with exogenous inputs (NARMAX) model based on the Pi-sigma fuzzy neural network (PSFNN) to construct an online rate-dependent hysteresis model for describing the hysteresis nonlinearity in piezo-actuated stages. In order to improve the convergence rate of PSFNN and modeling precision, we adopt the gradient descent algorithm featuring three different learning factors to update the model parameters. The convergence of the NARMAX model based on the PSFNN is analyzed effectively. To ensure that the parameters can converge to the true values, the persistent excitation condition is considered. Then, a self-adaption compensation controller is designed for eliminating the hysteresis nonlinearity in piezo-actuated stages. A merit of the proposed controller is that it can directly eliminate the complex hysteresis nonlinearity in piezo-actuated stages without any inverse dynamic models. To demonstrate the effectiveness of the proposed model and control methods, a set of comparative experiments are performed on piezo-actuated stages. Experimental results show that the proposed modeling and control methods have excellent performance.

  8. Data on copula modeling of mixed discrete and continuous neural time series.

    Science.gov (United States)

    Hu, Meng; Li, Mingyao; Li, Wu; Liang, Hualou

    2016-06-01

    Copula is an important tool for modeling neural dependence. Recent work on copula has been expanded to jointly model mixed time series in neuroscience ("Hu et al., 2016, Joint Analysis of Spikes and Local Field Potentials using Copula" [1]). Here we present further data for joint analysis of spike and local field potential (LFP) with copula modeling. In particular, the details of different model orders and the influence of possible spike contamination in LFP data from the same and different electrode recordings are presented. To further facilitate the use of our copula model for the analysis of mixed data, we provide the Matlab codes, together with example data.

  9. A Nonlinear Programming and Artificial Neural Network Approach for Optimizing the Performance of a Job Dispatching Rule in a Wafer Fabrication Factory

    Directory of Open Access Journals (Sweden)

    Toly Chen

    2012-01-01

    Full Text Available A nonlinear programming and artificial neural network approach is presented in this study to optimize the performance of a job dispatching rule in a wafer fabrication factory. The proposed methodology fuses two existing rules and constructs a nonlinear programming model to choose the best values of parameters in the two rules by dynamically maximizing the standard deviation of the slack, which has been shown to benefit scheduling performance by several studies. In addition, a more effective approach is also applied to estimate the remaining cycle time of a job, which is empirically shown to be conducive to the scheduling performance. The efficacy of the proposed methodology was validated with a simulated case; evidence was found to support its effectiveness. We also suggested several directions in which it can be exploited in the future.

  10. Stochastic Nonlinear Evolutional Model of the Large-Scaled Neuronal Population and Dynamic Neural Coding Subject to Stimulation

    International Nuclear Information System (INIS)

    Wang Rubin; Yu Wei

    2005-01-01

    In this paper, we investigate how the population of neuronal oscillators deals with information and the dynamic evolution of neural coding when the external stimulation acts on it. Numerically computing method is used to describe the evolution process of neural coding in three-dimensioned space. The numerical result proves that only the suitable stimulation can change the coupling structure and plasticity of neurons

  11. Isolating the Neural Mechanisms of Interference During Continuous Multisensory Dual-task Performance

    Science.gov (United States)

    2014-01-01

    of multitasking impairments have focused on the performance of two tasks presented in close temporal proximity on discrete trials; however, such...simultaneously and continuously monitor both auditory communications from pilots and visual radar displays. Drivers may choose to hold a cell phone

  12. Online Solution of Two-Player Zero-Sum Games for Continuous-Time Nonlinear Systems With Completely Unknown Dynamics.

    Science.gov (United States)

    Fu, Yue; Chai, Tianyou

    2016-12-01

    Regarding two-player zero-sum games of continuous-time nonlinear systems with completely unknown dynamics, this paper presents an online adaptive algorithm for learning the Nash equilibrium solution, i.e., the optimal policy pair. First, for known systems, the simultaneous policy updating algorithm (SPUA) is reviewed. A new analytical method to prove the convergence is presented. Then, based on the SPUA, without using a priori knowledge of any system dynamics, an online algorithm is proposed to simultaneously learn in real time either the minimal nonnegative solution of the Hamilton-Jacobi-Isaacs (HJI) equation or the generalized algebraic Riccati equation for linear systems as a special case, along with the optimal policy pair. The approximate solution to the HJI equation and the admissible policy pair is reexpressed by the approximation theorem. The unknown constants or weights of each are identified simultaneously by resorting to the recursive least square method. The convergence of the online algorithm to the optimal solutions is provided. A practical online algorithm is also developed. Simulation results illustrate the effectiveness of the proposed method.

  13. Multi-scale Quantitative Precipitation Forecasting Using Nonlinear and Nonstationary Teleconnection Signals and Artificial Neural Network Models

    Science.gov (United States)

    Global sea surface temperature (SST) anomalies can affect terrestrial precipitation via ocean-atmosphere interaction known as climate teleconnection. Non-stationary and non-linear characteristics of the ocean-atmosphere system make the identification of the teleconnection signals...

  14. Mutual Connectivity Analysis (MCA) Using Generalized Radial Basis Function Neural Networks for Nonlinear Functional Connectivity Network Recovery in Resting-State Functional MRI.

    Science.gov (United States)

    DSouza, Adora M; Abidin, Anas Zainul; Nagarajan, Mahesh B; Wismüller, Axel

    2016-03-29

    We investigate the applicability of a computational framework, called mutual connectivity analysis (MCA), for directed functional connectivity analysis in both synthetic and resting-state functional MRI data. This framework comprises of first evaluating non-linear cross-predictability between every pair of time series prior to recovering the underlying network structure using community detection algorithms. We obtain the non-linear cross-prediction score between time series using Generalized Radial Basis Functions (GRBF) neural networks. These cross-prediction scores characterize the underlying functionally connected networks within the resting brain, which can be extracted using non-metric clustering approaches, such as the Louvain method. We first test our approach on synthetic models with known directional influence and network structure. Our method is able to capture the directional relationships between time series (with an area under the ROC curve = 0.92 ± 0.037) as well as the underlying network structure (Rand index = 0.87 ± 0.063) with high accuracy. Furthermore, we test this method for network recovery on resting-state fMRI data, where results are compared to the motor cortex network recovered from a motor stimulation sequence, resulting in a strong agreement between the two (Dice coefficient = 0.45). We conclude that our MCA approach is effective in analyzing non-linear directed functional connectivity and in revealing underlying functional network structure in complex systems.

  15. DOE Final Report -NON-LINEAR WAVES IN CONTINUOUS MEDIA- BES- Division of Engineering and Materials Science

    International Nuclear Information System (INIS)

    Seth J. Putterman

    2006-01-01

    FINAL REPORT ON : NON-LINEAR WAVES IN CONTINUOUS MEDIA Doe DE FG03-87ER13686 (001312-001) Submitted January 10, 2006 by Seth J. Putterman 310-8252269 Physics Department University of California Los Angeles, CA 90095 puherman at ritva.physics.ucla.edu NON-LINEAR WAVES IN CONTINUOUS MEDIA I am happy to report that this project has been a big success. For over 10 years the DOE [Division of Materials Sciences and Engineering] has funded our research program on the overarching theme of spontaneous energy focusing phenomena. These effects occur when a nonlinear macroscopic system is excited so as to drive it far from equilibrium. The subsequent relaxation to equilibrium does not occur smoothly but instead is accompanied by the formation of structured domains where the energy density is highly concentrated. A signature example is picosecond sonoluminescence [1] wherein a smooth sound wave has its energy density focused by 12 orders of magnitude to generate a clock-like string of picosecond flashes of ultraviolet light. Our earlier work on solitons [2] demonstrated how uniform surface waves break up into stable localized structures. Our experimental work on turbulence produced photos of localized structures lying many standard deviations outside the range of gaussian statistics[3]. This effect is referred to as intermittency. Our recent work on friction finds its motivation in those theories of sonoluminescence which invoke frictional electricity. In its most common form this is the generation of a spark when we touch a doorknob after walking over a carpet. Our reading of the literature on this subject indicated that frictional electricity like sonoluminescence is not understood. So to probe triboelectrification we set up a modern version of an experiment performed by Bernoulli in 1700. Here sparking is caused by the rubbing of glass against mercury. We indeed observed flashes of light which were accompanied by events of stick-slip friction at the interface between the

  16. Polythiophene derivative functionalized with disperse red 1 chromophore: Its third-order nonlinear optical properties through Z-scan technique under continuous and femtosecond irradiation

    Science.gov (United States)

    de la Garza-Rubí, R. M. A.; Güizado-Rodríguez, M.; Mayorga-Cruz, D.; Basurto-Pensado, M. A.; Guerrero-Álvarez, J. A.; Ramos-Ortiz, G.; Rodríguez, M.; Maldonado, J. L.

    2015-08-01

    A copolymer of 3-hexylthiophene and thiophene functionalized with disperse red 1, poly(3-HT-co-TDR1), was synthesized. Chemical structure, molecular weight distribution, optical and thermal properties of this copolymer were characterized by NMR, FT-IR, UV-vis, GPC and DSC-TGA. An optical nonlinear analysis by Z-scan method was also performed for both continuous wave (CW) and pulsed laser pumping. In the CW regime the nonlinearities were evaluated in solid films, and a negative nonlinear refractive index in the range 2.7-4.1 × 10-4 cm2/W was obtained. These values are notoriously high and allowed to observe self-defocusing effects at very low laser intensities: below 1 mW. Further, nonlinear self-phase modulation patterns, during laser irradiation, were also observed. In the pulsed excitation the nonlinear response was evaluated in solution resulting in large two-photon absorption cross section of 5725 GM for the whole copolymer chain and with a value of 232 GM per repeated monomeric unit.

  17. Application of neural network and pattern recognition software to the automated analysis of continuous nuclear monitoring of on-load reactors

    Energy Technology Data Exchange (ETDEWEB)

    Howell, J.A.; Eccleston, G.W.; Halbig, J.K.; Klosterbuer, S.F. [Los Alamos National Lab., NM (United States); Larson, T.W. [California Polytechnic State Univ., San Luis Obispo, CA (US)

    1993-08-01

    Automated analysis using pattern recognition and neural network software can help interpret data, call attention to potential anomalies, and improve safeguards effectiveness. Automated software analysis, based on pattern recognition and neural networks, was applied to data collected from a radiation core discharge monitor system located adjacent to an on-load reactor core. Unattended radiation sensors continuously collect data to monitor on-line refueling operations in the reactor. The huge volume of data collected from a number of radiation channels makes it difficult for a safeguards inspector to review it all, check for consistency among the measurement channels, and find anomalies. Pattern recognition and neural network software can analyze large volumes of data from continuous, unattended measurements, thereby improving and automating the detection of anomalies. The authors developed a prototype pattern recognition program that determines the reactor power level and identifies the times when fuel bundles are pushed through the core during on-line refueling. Neural network models were also developed to predict fuel bundle burnup to calculate the region on the on-load reactor face from which fuel bundles were discharged based on the radiation signals. In the preliminary data set, which was limited and consisted of four distinct burnup regions, the neural network model correctly predicted the burnup region with an accuracy of 92%.

  18. Long Short-Term Memory Projection Recurrent Neural Network Architectures for Piano’s Continuous Note Recognition

    Directory of Open Access Journals (Sweden)

    YuKang Jia

    2017-01-01

    Full Text Available Long Short-Term Memory (LSTM is a kind of Recurrent Neural Networks (RNN relating to time series, which has achieved good performance in speech recogniton and image recognition. Long Short-Term Memory Projection (LSTMP is a variant of LSTM to further optimize speed and performance of LSTM by adding a projection layer. As LSTM and LSTMP have performed well in pattern recognition, in this paper, we combine them with Connectionist Temporal Classification (CTC to study piano’s continuous note recognition for robotics. Based on the Beijing Forestry University music library, we conduct experiments to show recognition rates and numbers of iterations of LSTM with a single layer, LSTMP with a single layer, and Deep LSTM (DLSTM, LSTM with multilayers. As a result, the single layer LSTMP proves performing much better than the single layer LSTM in both time and the recognition rate; that is, LSTMP has fewer parameters and therefore reduces the training time, and, moreover, benefiting from the projection layer, LSTMP has better performance, too. The best recognition rate of LSTMP is 99.8%. As for DLSTM, the recognition rate can reach 100% because of the effectiveness of the deep structure, but compared with the single layer LSTMP, DLSTM needs more training time.

  19. Forecasting the EMU inflation rate: Linear econometric vs. non-linear computational models using genetic neural fuzzy systems

    DEFF Research Database (Denmark)

    Kooths, Stefan; Mitze, Timo Friedel; Ringhut, Eric

    2004-01-01

    This paper compares the predictive power of linear econometric and non-linear computational models for forecasting the inflation rate in the European Monetary Union (EMU). Various models of both types are developed using different monetary and real activity indicators. They are compared according...

  20. Mixed integer non-linear programming and Artificial Neural Network based approach to ancillary services dispatch in competitive electricity markets

    International Nuclear Information System (INIS)

    Canizes, Bruno; Soares, João; Faria, Pedro; Vale, Zita

    2013-01-01

    Highlights: • Ancillary services market management. • Ancillary services requirements forecast based on Artificial Neural Network. • Ancillary services clearing mechanisms without complex bids and with complex bids. - Abstract: Ancillary services represent a good business opportunity that must be considered by market players. This paper presents a new methodology for ancillary services market dispatch. The method considers the bids submitted to the market and includes a market clearing mechanism based on deterministic optimization. An Artificial Neural Network is used for day-ahead prediction of Regulation Down, regulation-up, Spin Reserve and Non-Spin Reserve requirements. Two test cases based on California Independent System Operator data concerning dispatch of Regulation Down, Regulation Up, Spin Reserve and Non-Spin Reserve services are included in this paper to illustrate the application of the proposed method: (1) dispatch considering simple bids; (2) dispatch considering complex bids

  1. Fouling resistance prediction using artificial neural network nonlinear auto-regressive with exogenous input model based on operating conditions and fluid properties correlations

    Energy Technology Data Exchange (ETDEWEB)

    Biyanto, Totok R. [Department of Engineering Physics, Institute Technology of Sepuluh Nopember Surabaya, Surabaya, Indonesia 60111 (Indonesia)

    2016-06-03

    Fouling in a heat exchanger in Crude Preheat Train (CPT) refinery is an unsolved problem that reduces the plant efficiency, increases fuel consumption and CO{sub 2} emission. The fouling resistance behavior is very complex. It is difficult to develop a model using first principle equation to predict the fouling resistance due to different operating conditions and different crude blends. In this paper, Artificial Neural Networks (ANN) MultiLayer Perceptron (MLP) with input structure using Nonlinear Auto-Regressive with eXogenous (NARX) is utilized to build the fouling resistance model in shell and tube heat exchanger (STHX). The input data of the model are flow rates and temperatures of the streams of the heat exchanger, physical properties of product and crude blend data. This model serves as a predicting tool to optimize operating conditions and preventive maintenance of STHX. The results show that the model can capture the complexity of fouling characteristics in heat exchanger due to thermodynamic conditions and variations in crude oil properties (blends). It was found that the Root Mean Square Error (RMSE) are suitable to capture the nonlinearity and complexity of the STHX fouling resistance during phases of training and validation.

  2. Multi-step ahead nonlinear identification of Lorenz's chaotic system using radial basis neural network with learning by clustering and particle swarm optimization

    International Nuclear Information System (INIS)

    Guerra, Fabio A.; Coelho, Leandro dos S.

    2008-01-01

    An important problem in engineering is the identification of nonlinear systems, among them radial basis function neural networks (RBF-NN) using Gaussian activation functions models, which have received particular attention due to their potential to approximate nonlinear behavior. Several design methods have been proposed for choosing the centers and spread of Gaussian functions and training the RBF-NN. The selection of RBF-NN parameters such as centers, spreads, and weights can be understood as a system identification problem. This paper presents a hybrid training approach based on clustering methods (k-means and c-means) to tune the centers of Gaussian functions used in the hidden layer of RBF-NNs. This design also uses particle swarm optimization (PSO) for centers (local clustering search method) and spread tuning, and the Penrose-Moore pseudoinverse for the adjustment of RBF-NN weight outputs. Simulations involving this RBF-NN design to identify Lorenz's chaotic system indicate that the performance of the proposed method is superior to that of the conventional RBF-NN trained for k-means and the Penrose-Moore pseudoinverse for multi-step ahead forecasting

  3. Design of an Adaptive PID Neural Controller for Continuous Stirred Tank Reactor based on Particle Swarm Optimization

    OpenAIRE

    Khulood A. Dagher; Ahmed S. Al-Araji

    2013-01-01

    A particle swarm optimization algorithm and neural network like self-tuning PID controller for CSTR system is presented. The scheme of the discrete-time PID control structure is based on neural network and tuned the parameters of the PID controller by using a particle swarm optimization PSO technique as a simple and fast training algorithm. The proposed method has advantage that it is not necessary to use a combined structure of identification and decision because it used PSO. Simulation resu...

  4. Stability switches, oscillatory multistability, and spatio-temporal patterns of nonlinear oscillations in recurrently delay coupled neural networks.

    Science.gov (United States)

    Song, Yongli; Makarov, Valeri A; Velarde, Manuel G

    2009-08-01

    A model of time-delay recurrently coupled spatially segregated neural assemblies is here proposed. We show that it operates like some of the hierarchical architectures of the brain. Each assembly is a neural network with no delay in the local couplings between the units. The delay appears in the long range feedforward and feedback inter-assemblies communications. Bifurcation analysis of a simple four-units system in the autonomous case shows the richness of the dynamical behaviors in a biophysically plausible parameter region. We find oscillatory multistability, hysteresis, and stability switches of the rest state provoked by the time delay. Then we investigate the spatio-temporal patterns of bifurcating periodic solutions by using the symmetric local Hopf bifurcation theory of delay differential equations and derive the equation describing the flow on the center manifold that enables us determining the direction of Hopf bifurcations and stability of the bifurcating periodic orbits. We also discuss computational properties of the system due to the delay when an external drive of the network mimicks external sensory input.

  5. Morphological neural networks

    Energy Technology Data Exchange (ETDEWEB)

    Ritter, G.X.; Sussner, P. [Univ. of Florida, Gainesville, FL (United States)

    1996-12-31

    The theory of artificial neural networks has been successfully applied to a wide variety of pattern recognition problems. In this theory, the first step in computing the next state of a neuron or in performing the next layer neural network computation involves the linear operation of multiplying neural values by their synaptic strengths and adding the results. Thresholding usually follows the linear operation in order to provide for nonlinearity of the network. In this paper we introduce a novel class of neural networks, called morphological neural networks, in which the operations of multiplication and addition are replaced by addition and maximum (or minimum), respectively. By taking the maximum (or minimum) of sums instead of the sum of products, morphological network computation is nonlinear before thresholding. As a consequence, the properties of morphological neural networks are drastically different than those of traditional neural network models. In this paper we consider some of these differences and provide some particular examples of morphological neural network.

  6. Analysis of neural progenitors from embryogenesis to juvenile adult in Xenopus laevis reveals biphasic neurogenesis and continuous lengthening of the cell cycle

    Directory of Open Access Journals (Sweden)

    Raphaël Thuret

    2015-12-01

    Full Text Available Xenopus laevis is a prominent model system for studying neural development, but our understanding of the long-term temporal dynamics of neurogenesis remains incomplete. Here, we present the first continuous description of neurogenesis in X. laevis, covering the entire period of development from the specification of neural ectoderm during gastrulation to juvenile frog. We have used molecular markers to identify progenitors and neurons, short-term bromodeoxyuridine (BrdU incorporation to map the generation of newborn neurons and dual pulse S-phase labelling to characterise changes in their cell cycle length. Our study revealed the persistence of Sox3-positive progenitor cells from the earliest stages of neural development through to the juvenile adult. Two periods of intense neuronal generation were observed, confirming the existence of primary and secondary waves of neurogenesis, punctuated by a period of quiescence before metamorphosis and culminating in another period of quiescence in the young adult. Analysis of multiple parameters indicates that neural progenitors alternate between global phases of differentiation and amplification and that, regardless of their behaviour, their cell cycle lengthens monotonically during development, at least at the population level.

  7. Neurite extension and neuronal differentiation of human induced pluripotent stem cell derived neural stem cells on polyethylene glycol hydrogels containing a continuous Young's Modulus gradient.

    Science.gov (United States)

    Mosley, Matthew C; Lim, Hyun Ju; Chen, Jing; Yang, Yueh-Hsun; Li, Shenglan; Liu, Ying; Smith Callahan, Laura A

    2017-03-01

    Mechanotransduction in neural cells involves multiple signaling pathways that are not fully understood. Differences in lineage and maturation state are suggested causes for conflicting reports on neural cell mechanosensitivity. To optimize matrices for use in stem cell therapy treatments transplanting human induced pluripotent stem cell derived neural stem cells (hNSC) into lesions after spinal cord injury, the effects of Young's Modulus changes on hNSC behavior must be understood. The present study utilizes polyethylene glycol hydrogels containing a continuous gradient in Young's modulus to examine changes in the Young's Modulus of the culture substrate on hNSC neurite extension and neural differentiation. Changes in the Young's Modulus of the polyethylene glycol hydrogels was found to affect neurite extension and cellular organization on the matrices. hNSC cultured on 907 Pa hydrogels were found to extend longer neurites than hNSC cultured on other tested Young's Moduli hydrogels. The gene expression of β tubulin III and microtubule-associated protein 2 in hNSC was affected by changes in the Young's Modulus of the hydrogel. The combinatory method approach used in the present study demonstrates that hNSC are mechanosensitive and the matrix Young's Modulus should be a design consideration for hNSC transplant applications. © 2016 Wiley Periodicals, Inc. J Biomed Mater Res Part A: 105A: 824-833, 2017. © 2016 Wiley Periodicals, Inc.

  8. Monte Carlo aided treatments of the nonlinear inverse PGNAA measurement problem for various continuous on-line applications

    International Nuclear Information System (INIS)

    Gardner, R.P.; Guo, P.; Sood, A.; Mayo, C.W.; Dobbs, C.L.

    1998-01-01

    A review of our work on the application of the PGNAA method as applied to five industrial applications is given. Some introductory material is first given on the importance and use of Monte Carlo simulation in this area, some comments on the place of PGNAA in elemental analysis, and a brief description of the Monte Carlo - Library Least-Squares (MCLLS) approach to the nonlinear inverse PGNAA analysis problem. Then the applications of PGNAA are discussed for: (1) on-line bulk coal analysis, (2) nuclear oil well logging, (3) vitrified waste, (4) the analysis of sodium and aluminium in 'green liquor' in the presence of chlorine, and (5) the conveyor belt sorting of aluminum alloy samples. It is concluded that PGNAA is a rapidly emerging important new technology and measurement approach. (author)

  9. Generation of three-mode continuous-variable entanglement by cascaded nonlinear interactions in a quasiperiodic superlattice

    International Nuclear Information System (INIS)

    Yu, Y. B.; Xie, Z. D.; Yu, X. Q.; Li, H. X.; Xu, P.; Yao, H. M.; Zhu, S. N.

    2006-01-01

    The generation of three-mode continuous-variable entanglement in a quasiperiodically optical superlattice is studied theoretically in this paper. This work is based on the previous experiment result in which three-color light generated from a quasiperiodically optical superlattice through a stimulated parametric down-conversion cascaded with a sum-frequency process. The degree of quadrature phase amplitude correlations, a nonclassical characteristic, among the three mode was discussed by a sufficient inseparability criterion for continuous-variable entanglement, which was proposed by van Loock and Furusawa

  10. Analysis of transverse vibration and stability issues of discrete-continuous elastic systems with nonlinearly variable parameters

    Directory of Open Access Journals (Sweden)

    Jaroszewicz Jerzy

    2018-01-01

    Full Text Available The work is devoted to methods of analysis of vibrations and stability of discrete-continuous, multi-parameter models of beams, shafts, rotors, vanes, converting to homogeneous and one-dimensional. The properties of Cauchy's influence function and the characteristic series method were used to solve the boundary problem. It has been shown that the methods are an effective tool for solving boundary problems described by ordinary fourth-and second-order differential equations with variable parameters. Particular attention should be paid to the solution of the border problem of two-parameter elastic systems with variable distribution of parameters. Universal beam-specific equations with typical support conditions including vertical support, which do not depend on beam shape and axial load type, are recorded. The shape and type of load are considered in the form of an impact function that corresponds to any change in cross-section of the support and continuous axial load, so that the functions describing the stiffness, the mass and the continuous load are complete. As a result of the solution of the boundary vibration problem of freely bent support and any change in its cross-section, loaded with any longitudinal load, arranged on the resilient substrate, strict relations between the own frequency parameters and the load parameters were derived. Using the methods, simple calculations were made, easy to use in engineering practice and conditions of use were given. Experimental studies have confirmed the high accuracy of theoretical calculations using the proposed methods and formulas.

  11. Support vector machine regression (SVR/LS-SVM)--an alternative to neural networks (ANN) for analytical chemistry? Comparison of nonlinear methods on near infrared (NIR) spectroscopy data.

    Science.gov (United States)

    Balabin, Roman M; Lomakina, Ekaterina I

    2011-04-21

    In this study, we make a general comparison of the accuracy and robustness of five multivariate calibration models: partial least squares (PLS) regression or projection to latent structures, polynomial partial least squares (Poly-PLS) regression, artificial neural networks (ANNs), and two novel techniques based on support vector machines (SVMs) for multivariate data analysis: support vector regression (SVR) and least-squares support vector machines (LS-SVMs). The comparison is based on fourteen (14) different datasets: seven sets of gasoline data (density, benzene content, and fractional composition/boiling points), two sets of ethanol gasoline fuel data (density and ethanol content), one set of diesel fuel data (total sulfur content), three sets of petroleum (crude oil) macromolecules data (weight percentages of asphaltenes, resins, and paraffins), and one set of petroleum resins data (resins content). Vibrational (near-infrared, NIR) spectroscopic data are used to predict the properties and quality coefficients of gasoline, biofuel/biodiesel, diesel fuel, and other samples of interest. The four systems presented here range greatly in composition, properties, strength of intermolecular interactions (e.g., van der Waals forces, H-bonds), colloid structure, and phase behavior. Due to the high diversity of chemical systems studied, general conclusions about SVM regression methods can be made. We try to answer the following question: to what extent can SVM-based techniques replace ANN-based approaches in real-world (industrial/scientific) applications? The results show that both SVR and LS-SVM methods are comparable to ANNs in accuracy. Due to the much higher robustness of the former, the SVM-based approaches are recommended for practical (industrial) application. This has been shown to be especially true for complicated, highly nonlinear objects.

  12. Exponential stability of Cohen-Grossberg neural networks with a general class of activation functions

    International Nuclear Information System (INIS)

    Wan Anhua; Wang Miansen; Peng Jigen; Qiao Hong

    2006-01-01

    In this Letter, the dynamics of Cohen-Grossberg neural networks model are investigated. The activation functions are only assumed to be Lipschitz continuous, which provide a much wider application domain for neural networks than the previous results. By means of the extended nonlinear measure approach, new and relaxed sufficient conditions for the existence, uniqueness and global exponential stability of equilibrium of the neural networks are obtained. Moreover, an estimate for the exponential convergence rate of the neural networks is precisely characterized. Our results improve those existing ones

  13. Training trajectories by continuous recurrent multilayer networks.

    Science.gov (United States)

    Leistritz, L; Galicki, M; Witte, H; Kochs, E

    2002-01-01

    This paper addresses the problem of training trajectories by means of continuous recurrent neural networks whose feedforward parts are multilayer perceptrons. Such networks can approximate a general nonlinear dynamic system with arbitrary accuracy. The learning process is transformed into an optimal control framework where the weights are the controls to be determined. A training algorithm based upon a variational formulation of Pontryagin's maximum principle is proposed for such networks. Computer examples demonstrating the efficiency of the given approach are also presented.

  14. Neural Networks for Optimal Control

    DEFF Research Database (Denmark)

    Sørensen, O.

    1995-01-01

    Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process.......Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process....

  15. Simplified LQG Control with Neural Networks

    DEFF Research Database (Denmark)

    Sørensen, O.

    1997-01-01

    A new neural network application for non-linear state control is described. One neural network is modelled to form a Kalmann predictor and trained to act as an optimal state observer for a non-linear process. Another neural network is modelled to form a state controller and trained to produce...

  16. Linear and non-linear analyses of Conner's Continuous Performance Test-II discriminate adult patients with attention deficit hyperactivity disorder from patients with mood and anxiety disorders.

    Science.gov (United States)

    Fasmer, Ole Bernt; Mjeldheim, Kristin; Førland, Wenche; Hansen, Anita L; Syrstad, Vigdis Elin Giæver; Oedegaard, Ketil J; Berle, Jan Øystein

    2016-08-11

    Attention Deficit Hyperactivity Disorder (ADHD) is a heterogeneous disorder. Therefore it is important to look for factors that can contribute to better diagnosis and classification of these patients. The aims of the study were to characterize adult psychiatric out-patients with a mixture of mood, anxiety and attentional problems using an objective neuropsychological test of attention combined with an assessment of mood instability. Newly referred patients (n = 99; aged 18-65 years) requiring diagnostic evaluation of ADHD, mood or anxiety disorders were recruited, and were given a comprehensive diagnostic evaluation including the self-report form of the cyclothymic temperament scale and Conner's Continuous Performance Test II (CPT-II). In addition to the traditional measures from this test we have extracted raw data and analysed time series using linear and non-linear mathematical methods. Fifty patients fulfilled criteria for ADHD, while 49 did not, and were given other psychiatric diagnoses (clinical controls). When compared to the clinical controls the ADHD patients had more omission and commission errors, and higher reaction time variability. Analyses of response times showed higher values for skewness in the ADHD patients, and lower values for sample entropy and symbolic dynamics. Among the ADHD patients 59 % fulfilled criteria for a cyclothymic temperament, and this group had higher reaction time variability and lower scores on complexity than the group without this temperament. The CPT-II is a useful instrument in the assessment of ADHD in adult patients. Additional information from this test was obtained by analyzing response times using linear and non-linear methods, and this showed that ADHD patients with a cyclothymic temperament were different from those without this temperament.

  17. Novel chemometric strategy based on the application of artificial neural networks to crossed mixture design for the improvement of recombinant protein production in continuous culture.

    Science.gov (United States)

    Didier, Caroline; Forno, Guillermina; Etcheverrigaray, Marina; Kratje, Ricardo; Goicoechea, Héctor

    2009-09-21

    The optimal blends of six compounds that should be present in culture media used in recombinant protein production were determined by means of artificial neural networks (ANN) coupled with crossed mixture experimental design. This combination constitutes a novel approach to develop a medium for cultivating genetically engineered mammalian cells. The compounds were collected in two mixtures of three elements each, and the experimental space was determined by a crossed mixture design. Empirical data from 51 experimental units were used in a multiresponse analysis to train artificial neural networks which satisfy different requirements, in order to define two new culture media (Medium 1 and Medium 2) to be used in a continuous biopharmaceutical production process. These media were tested in a bioreactor to produce a recombinant protein in CHO cells. Remarkably, for both predicted media all responses satisfied the predefined goals pursued during the analysis, except in the case of the specific growth rate (mu) observed for Medium 1. ANN analysis proved to be a suitable methodology to be used when dealing with complex experimental designs, as frequently occurs in the optimization of production processes in the biotechnology area. The present work is a new example of the use of ANN for the resolution of a complex, real life system, successfully employed in the context of a biopharmaceutical production process.

  18. Application of neural networks in coastal engineering

    Digital Repository Service at National Institute of Oceanography (India)

    Mandal, S.

    the neural network attractive. A neural network is an information processing system modeled on the structure of the dynamic process. It can solve the complex/nonlinear problems quickly once trained by operating on problems using an interconnected number...

  19. Modeling and Control of CSTR using Model based Neural Network Predictive Control

    OpenAIRE

    Shrivastava, Piyush

    2012-01-01

    This paper presents a predictive control strategy based on neural network model of the plant is applied to Continuous Stirred Tank Reactor (CSTR). This system is a highly nonlinear process; therefore, a nonlinear predictive method, e.g., neural network predictive control, can be a better match to govern the system dynamics. In the paper, the NN model and the way in which it can be used to predict the behavior of the CSTR process over a certain prediction horizon are described, and some commen...

  20. On-line scheme for parameter estimation of nonlinear lithium ion battery equivalent circuit models using the simplified refined instrumental variable method for a modified Wiener continuous-time model

    International Nuclear Information System (INIS)

    Allafi, Walid; Uddin, Kotub; Zhang, Cheng; Mazuir Raja Ahsan Sha, Raja; Marco, James

    2017-01-01

    Highlights: •Off-line estimation approach for continuous-time domain for non-invertible function. •Model reformulated to multi-input-single-output; nonlinearity described by sigmoid. •Method directly estimates parameters of nonlinear ECM from the measured-data. •Iterative on-line technique leads to smoother convergence. •The model is validated off-line and on-line using NCA battery. -- Abstract: The accuracy of identifying the parameters of models describing lithium ion batteries (LIBs) in typical battery management system (BMS) applications is critical to the estimation of key states such as the state of charge (SoC) and state of health (SoH). In applications such as electric vehicles (EVs) where LIBs are subjected to highly demanding cycles of operation and varying environmental conditions leading to non-trivial interactions of ageing stress factors, this identification is more challenging. This paper proposes an algorithm that directly estimates the parameters of a nonlinear battery model from measured input and output data in the continuous time-domain. The simplified refined instrumental variable method is extended to estimate the parameters of a Wiener model where there is no requirement for the nonlinear function to be invertible. To account for nonlinear battery dynamics, in this paper, the typical linear equivalent circuit model (ECM) is enhanced by a block-oriented Wiener configuration where the nonlinear memoryless block following the typical ECM is defined to be a sigmoid static nonlinearity. The nonlinear Weiner model is reformulated in the form of a multi-input, single-output linear model. This linear form allows the parameters of the nonlinear model to be estimated using any linear estimator such as the well-established least squares (LS) algorithm. In this paper, the recursive least square (RLS) method is adopted for online parameter estimation. The approach was validated on experimental data measured from an 18650-type Graphite

  1. Neural network-based model reference adaptive control system.

    Science.gov (United States)

    Patino, H D; Liu, D

    2000-01-01

    In this paper, an approach to model reference adaptive control based on neural networks is proposed and analyzed for a class of first-order continuous-time nonlinear dynamical systems. The controller structure can employ either a radial basis function network or a feedforward neural network to compensate adaptively the nonlinearities in the plant. A stable controller-parameter adjustment mechanism, which is determined using the Lyapunov theory, is constructed using a sigma-modification-type updating law. The evaluation of control error in terms of the neural network learning error is performed. That is, the control error converges asymptotically to a neighborhood of zero, whose size is evaluated and depends on the approximation error of the neural network. In the design and analysis of neural network-based control systems, it is important to take into account the neural network learning error and its influence on the control error of the plant. Simulation results showing the feasibility and performance of the proposed approach are given.

  2. Identification of a Typical CSTR Using Optimal Focused Time Lagged Recurrent Neural Network Model with Gamma Memory Filter

    OpenAIRE

    Naikwad, S. N.; Dudul, S. V.

    2009-01-01

    A focused time lagged recurrent neural network (FTLR NN) with gamma memory filter is designed to learn the subtle complex dynamics of a typical CSTR process. Continuous stirred tank reactor exhibits complex nonlinear operations where reaction is exothermic. It is noticed from literature review that process control of CSTR using neuro-fuzzy systems was attempted by many, but optimal neural network model for identification of CSTR process is not yet available. As CSTR process includes tempora...

  3. Optimization of operational conditions in continuous electrodeionization method for maximizing Strontium and Cesium removal from aqueous solutions using artificial neural network

    Energy Technology Data Exchange (ETDEWEB)

    Zahakifar, Fazel; Keshtkar, Alireza; Nazemi, Ehsan; Zaheri, Adib [Nuclear Science and Technology Research Institute, Tehran (Iran, Islamic Republic of)

    2017-09-01

    Strontium (Sr) and Cesium (Cs) are two important nuclear fission products which are present in the radioactive wastewater resulting from nuclear power plants. They should be treated by considering environmental and economic aspects. In this study, artificial neural network (ANN) was implemented to evaluate the optimal experimental conditions in continuous electrodeionization method in order to achieve the highest removal percentage of Sr and Ce from aqueous solutions. Three control factors at three levels were tested in experiments for Sr and Cs: Feed concentration (10, 50 and 100 mg/L), flow rate (2.5, 3.75 and 5 mL/min) and voltage (5, 7.5 and 10 V). The obtained data from the experiments were used to train two ANNs. The three control factors were utilized as the inputs of ANNs and two quality responses were used as the outputs, separately (each ANN for one quality response). After training the ANNs, 1024 different control factor levels with various quality responses were predicted and finally the optimum control factor levels were obtained. Results demonstrated that the optimum levels of the control factors for maximum removing of Sr (97.6%) had an applied voltage of 10 V, a flow rate of 2.5 mL/min and a feed concentration of 10 mg/L. As for Cs (67.8%) they were 10 V, 2.55 mL/min and 50 mg/L, respectively.

  4. Sequential neural models with stochastic layers

    DEFF Research Database (Denmark)

    Fraccaro, Marco; Sønderby, Søren Kaae; Paquet, Ulrich

    2016-01-01

    How can we efficiently propagate uncertainty in a latent state representation with recurrent neural networks? This paper introduces stochastic recurrent neural networks which glue a deterministic recurrent neural network and a state space model together to form a stochastic and sequential neural...... generative model. The clear separation of deterministic and stochastic layers allows a structured variational inference network to track the factorization of the model's posterior distribution. By retaining both the nonlinear recursive structure of a recurrent neural network and averaging over...

  5. Rigorous Derivation of a Nonlinear Diffusion Equation as Fast-Reaction Limit of a Continuous Coagulation-Fragmentation Model with Diffusion

    KAUST Repository

    Carrillo, J. A.; Desvillettes, L.; Fellner, K.

    2009-01-01

    Weak solutions of the spatially inhomogeneous (diffusive) Aizenmann-Bak model of coagulation-breakup within a bounded domain with homogeneous Neumann boundary conditions are shown to converge, in the fast reaction limit, towards local equilibria determined by their mass. Moreover, this mass is the solution of a nonlinear diffusion equation whose nonlinearity depends on the (size-dependent) diffusion coefficient. Initial data are assumed to have integrable zero order moment and square integrable first order moment in size, and finite entropy. In contrast to our previous result [5], we are able to show the convergence without assuming uniform bounds from above and below on the number density of clusters. © Taylor & Francis Group, LLC.

  6. Rigorous Derivation of a Nonlinear Diffusion Equation as Fast-Reaction Limit of a Continuous Coagulation-Fragmentation Model with Diffusion

    KAUST Repository

    Carrillo, J. A.

    2009-10-30

    Weak solutions of the spatially inhomogeneous (diffusive) Aizenmann-Bak model of coagulation-breakup within a bounded domain with homogeneous Neumann boundary conditions are shown to converge, in the fast reaction limit, towards local equilibria determined by their mass. Moreover, this mass is the solution of a nonlinear diffusion equation whose nonlinearity depends on the (size-dependent) diffusion coefficient. Initial data are assumed to have integrable zero order moment and square integrable first order moment in size, and finite entropy. In contrast to our previous result [5], we are able to show the convergence without assuming uniform bounds from above and below on the number density of clusters. © Taylor & Francis Group, LLC.

  7. Distributed Extreme Learning Machine for Nonlinear Learning over Network

    Directory of Open Access Journals (Sweden)

    Songyan Huang

    2015-02-01

    Full Text Available Distributed data collection and analysis over a network are ubiquitous, especially over a wireless sensor network (WSN. To our knowledge, the data model used in most of the distributed algorithms is linear. However, in real applications, the linearity of systems is not always guaranteed. In nonlinear cases, the single hidden layer feedforward neural network (SLFN with radial basis function (RBF hidden neurons has the ability to approximate any continuous functions and, thus, may be used as the nonlinear learning system. However, confined by the communication cost, using the distributed version of the conventional algorithms to train the neural network directly is usually prohibited. Fortunately, based on the theorems provided in the extreme learning machine (ELM literature, we only need to compute the output weights of the SLFN. Computing the output weights itself is a linear learning problem, although the input-output mapping of the overall SLFN is still nonlinear. Using the distributed algorithmto cooperatively compute the output weights of the SLFN, we obtain a distributed extreme learning machine (dELM for nonlinear learning in this paper. This dELM is applied to the regression problem and classification problem to demonstrate its effectiveness and advantages.

  8. Entrepreneurship Education: Non-Linearity in the Satisfaction – Continuation Relationship = Podjetniško izobraževanje: nelineranost v razmerju med zadovoljstvom in nadaljevanjem izobraževanja

    Directory of Open Access Journals (Sweden)

    Boštjan Antoncic

    2007-06-01

    Full Text Available In this paper we propose one possible explanation of the interrelationships between education continuation or avoidance, satisfaction level, and experience (entrepreneurial maturity of potential and practicing entrepreneurs. By using the cusp catastrophe model we propose that relationship between education satisfaction and continuation tends to be linear for less experienced entrepreneurs (pre-entrepreneurs, whereas for more experienced entrepreneurs the relationship is proposed to be positive but non-linear (s-shaped. Data were collected with a structured questionnaire from 122 participants in management and entrepreneurship education and training programs. The proposed model was tested with linear and non-linear regression equations. The relationship between satisfaction and continuation (loyalty was found to be positive for all entrepreneurial and nonentrepreneurial groups. The appropriate functional form for the satisfaction-continuation relationship discovered for non-entrepreneurs and people that are only thinking about entrepreneurship (maybe-entrepreneurs is close to linear and less steep than for more entrepreneurial groups. By contrast, prospective entrepreneurs (people in the process of pre-start up and practicing entrepreneurs tend to be more sensitive to their education satisfaction in their future education continuation decisions. The appropriate functional form for these entrepreneurial groups tends to be cubical, which is close to the s-shaped function proposed in the cusp model. The study provided evidence that the relationships between entrepreneurial maturity, education satisfaction and education continuation may be modeled as a cusp catastrophe model. The proposed model can be helpful for education and for training providers (and marketers in explaining and predicting of education loyalty or the switching behavior of entrepreneurs.

  9. Exponential stability for stochastic delayed recurrent neural networks with mixed time-varying delays and impulses: the continuous-time case

    International Nuclear Information System (INIS)

    Karthik Raja, U; Leelamani, A; Raja, R; Samidurai, R

    2013-01-01

    In this paper, the exponential stability for a class of stochastic neural networks with time-varying delays and impulsive effects is considered. By constructing suitable Lyapunov functionals and by using the linear matrix inequality optimization approach, we obtain sufficient delay-dependent criteria to ensure the exponential stability of stochastic neural networks with time-varying delays and impulses. Two numerical examples with simulation results are provided to illustrate the effectiveness of the obtained results over those already existing in the literature. (paper)

  10. Dynamics of nonlinear feedback control

    OpenAIRE

    Snippe, H.P.; Hateren, J.H. van

    2007-01-01

    Feedback control in neural systems is ubiquitous. Here we study the mathematics of nonlinear feedback control. We compare models in which the input is multiplied by a dynamic gain (multiplicative control) with models in which the input is divided by a dynamic attenuation (divisive control). The gain signal (resp. the attenuation signal) is obtained through a concatenation of an instantaneous nonlinearity and a linear low-pass filter operating on the output of the feedback loop. For input step...

  11. An Artificial Neural Network Controller for Intelligent Transportation Systems Applications

    Science.gov (United States)

    1996-01-01

    An Autonomous Intelligent Cruise Control (AICC) has been designed using a feedforward artificial neural network, as an example for utilizing artificial neural networks for nonlinear control problems arising in intelligent transportation systems appli...

  12. Combination of highly nonlinear fiber, an optical bandpass filter, and a Fabry-Perot filter to improve the signal-to-noise ratio of a supercontinuum continuous-wave optical source.

    Science.gov (United States)

    Nan, Yinbo; Huo, Li; Lou, Caiyun

    2005-05-20

    We present a theoretical study of a supercontinuum (SC) continuous-wave (cw) optical source generation in highly nonlinear fiber and its noise properties through numerical simulations based on the nonlinear Schrödinger equation. Fluctuations of pump pulses generate substructures between the longitudinal modes that result in the generation of white noise and then in degradation of coherence and in a decrease of the modulation depths and the signal-to-noise ratio (SNR). A scheme for improvement of the SNR of a multiwavelength cw optical source based on a SC by use of the combination of a highly nonlinear fiber (HNLF), an optical bandpass filter, and a Fabry-Perot (FP) filter is presented. Numerical simulations show that the improvement in modulation depth is relative to the HNLF's length, the 3-dB bandwidth of the optical bandpass filter, and the reflection ratio of the FP filter and that the average improvement in modulation depth is 13.7 dB under specified conditions.

  13. Active Control of Sound based on Diagonal Recurrent Neural Network

    NARCIS (Netherlands)

    Jayawardhana, Bayu; Xie, Lihua; Yuan, Shuqing

    2002-01-01

    Recurrent neural network has been known for its dynamic mapping and better suited for nonlinear dynamical system. Nonlinear controller may be needed in cases where the actuators exhibit the nonlinear characteristics, or in cases when the structure to be controlled exhibits nonlinear behavior. The

  14. A one-parameter family of hamiltonian structures for the KP hierarchy and a continuous deformation of the nonlinear WKP algebra

    International Nuclear Information System (INIS)

    Figueroa-O'Farrill, J.M.; Mas, J.; Ramos, E.

    1993-01-01

    The KP hierarchy is hamiltonian relative to a one-parameter family of Poisson structures obtained from a generalized Adler map in the space of formal pseudodifferential symbols with noninteger powers. The resulting W-algebra is a one-parameter deformation of W KP admitting a central extension for generic values of the parameter, reducing naturally to W n for special values of the parameter, and contracting to the centrally extended W 1+∞ , W ∞ and further truncations. In the classical limit, all algebras in the one-parameter family are equivalent and isomorphic to W KP . The reduction induced by setting the spin-one field to zero yields a one-parameter deformation of W ∞ which contracts to a new nonlinear algebra of the W ∞ -type. (orig.)

  15. Nonlinear optics

    International Nuclear Information System (INIS)

    Boyd, R.W.

    1992-01-01

    Nonlinear optics is the study of the interaction of intense laser light with matter. This book is a textbook on nonlinear optics at the level of a beginning graduate student. The intent of the book is to provide an introduction to the field of nonlinear optics that stresses fundamental concepts and that enables the student to go on to perform independent research in this field. This book covers the areas of nonlinear optics, quantum optics, quantum electronics, laser physics, electrooptics, and modern optics

  16. Dynamics of nonlinear feedback control

    NARCIS (Netherlands)

    Snippe, H.P.; Hateren, J.H. van

    Feedback control in neural systems is ubiquitous. Here we study the mathematics of nonlinear feedback control. We compare models in which the input is multiplied by a dynamic gain (multiplicative control) with models in which the input is divided by a dynamic attenuation (divisive control). The gain

  17. Nonlinear optics

    CERN Document Server

    Bloembergen, Nicolaas

    1996-01-01

    Nicolaas Bloembergen, recipient of the Nobel Prize for Physics (1981), wrote Nonlinear Optics in 1964, when the field of nonlinear optics was only three years old. The available literature has since grown by at least three orders of magnitude.The vitality of Nonlinear Optics is evident from the still-growing number of scientists and engineers engaged in the study of new nonlinear phenomena and in the development of new nonlinear devices in the field of opto-electronics. This monograph should be helpful in providing a historical introduction and a general background of basic ideas both for expe

  18. Evolvable Neural Software System

    Science.gov (United States)

    Curtis, Steven A.

    2009-01-01

    The Evolvable Neural Software System (ENSS) is composed of sets of Neural Basis Functions (NBFs), which can be totally autonomously created and removed according to the changing needs and requirements of the software system. The resulting structure is both hierarchical and self-similar in that a given set of NBFs may have a ruler NBF, which in turn communicates with other sets of NBFs. These sets of NBFs may function as nodes to a ruler node, which are also NBF constructs. In this manner, the synthetic neural system can exhibit the complexity, three-dimensional connectivity, and adaptability of biological neural systems. An added advantage of ENSS over a natural neural system is its ability to modify its core genetic code in response to environmental changes as reflected in needs and requirements. The neural system is fully adaptive and evolvable and is trainable before release. It continues to rewire itself while on the job. The NBF is a unique, bilevel intelligence neural system composed of a higher-level heuristic neural system (HNS) and a lower-level, autonomic neural system (ANS). Taken together, the HNS and the ANS give each NBF the complete capabilities of a biological neural system to match sensory inputs to actions. Another feature of the NBF is the Evolvable Neural Interface (ENI), which links the HNS and ANS. The ENI solves the interface problem between these two systems by actively adapting and evolving from a primitive initial state (a Neural Thread) to a complicated, operational ENI and successfully adapting to a training sequence of sensory input. This simulates the adaptation of a biological neural system in a developmental phase. Within the greater multi-NBF and multi-node ENSS, self-similar ENI s provide the basis for inter-NBF and inter-node connectivity.

  19. Calculating the Mean Amplitude of Glycemic Excursions from Continuous Glucose Data Using an Open-Code Programmable Algorithm Based on the Integer Nonlinear Method.

    Science.gov (United States)

    Yu, Xuefei; Lin, Liangzhuo; Shen, Jie; Chen, Zhi; Jian, Jun; Li, Bin; Xin, Sherman Xuegang

    2018-01-01

    The mean amplitude of glycemic excursions (MAGE) is an essential index for glycemic variability assessment, which is treated as a key reference for blood glucose controlling at clinic. However, the traditional "ruler and pencil" manual method for the calculation of MAGE is time-consuming and prone to error due to the huge data size, making the development of robust computer-aided program an urgent requirement. Although several software products are available instead of manual calculation, poor agreement among them is reported. Therefore, more studies are required in this field. In this paper, we developed a mathematical algorithm based on integer nonlinear programming. Following the proposed mathematical method, an open-code computer program named MAGECAA v1.0 was developed and validated. The results of the statistical analysis indicated that the developed program was robust compared to the manual method. The agreement among the developed program and currently available popular software is satisfied, indicating that the worry about the disagreement among different software products is not necessary. The open-code programmable algorithm is an extra resource for those peers who are interested in the related study on methodology in the future.

  20. On-line identification of hybrid systems using an adaptive growing and pruning RBF neural network

    DEFF Research Database (Denmark)

    Alizadeh, Tohid

    2008-01-01

    This paper introduces an adaptive growing and pruning radial basis function (GAP-RBF) neural network for on-line identification of hybrid systems. The main idea is to identify a global nonlinear model that can predict the continuous outputs of hybrid systems. In the proposed approach, GAP......-RBF neural network uses a modified unscented kalman filter (UKF) with forgetting factor scheme as the required on-line learning algorithm. The effectiveness of the resulting identification approach is tested and evaluated on a simulated benchmark hybrid system....

  1. A Tensor-Product-Kernel Framework for Multiscale Neural Activity Decoding and Control

    Science.gov (United States)

    Li, Lin; Brockmeier, Austin J.; Choi, John S.; Francis, Joseph T.; Sanchez, Justin C.; Príncipe, José C.

    2014-01-01

    Brain machine interfaces (BMIs) have attracted intense attention as a promising technology for directly interfacing computers or prostheses with the brain's motor and sensory areas, thereby bypassing the body. The availability of multiscale neural recordings including spike trains and local field potentials (LFPs) brings potential opportunities to enhance computational modeling by enriching the characterization of the neural system state. However, heterogeneity on data type (spike timing versus continuous amplitude signals) and spatiotemporal scale complicates the model integration of multiscale neural activity. In this paper, we propose a tensor-product-kernel-based framework to integrate the multiscale activity and exploit the complementary information available in multiscale neural activity. This provides a common mathematical framework for incorporating signals from different domains. The approach is applied to the problem of neural decoding and control. For neural decoding, the framework is able to identify the nonlinear functional relationship between the multiscale neural responses and the stimuli using general purpose kernel adaptive filtering. In a sensory stimulation experiment, the tensor-product-kernel decoder outperforms decoders that use only a single neural data type. In addition, an adaptive inverse controller for delivering electrical microstimulation patterns that utilizes the tensor-product kernel achieves promising results in emulating the responses to natural stimulation. PMID:24829569

  2. A novel method combining cellular neural networks and the coupled nonlinear oscillators' paradigm involving a related bifurcation analysis for robust image contrast enhancement in dynamically changing difficult visual environments

    International Nuclear Information System (INIS)

    Chedjou, Jean Chamberlain; Kyamakya, Kyandoghere

    2010-01-01

    It is well known that a machine vision-based analysis of a dynamic scene, for example in the context of advanced driver assistance systems (ADAS), does require real-time processing capabilities. Therefore, the system used must be capable of performing both robust and ultrafast analyses. Machine vision in ADAS must fulfil the above requirements when dealing with a dynamically changing visual context (i.e. driving in darkness or in a foggy environment, etc). Among the various challenges related to the analysis of a dynamic scene, this paper focuses on contrast enhancement, which is a well-known basic operation to improve the visual quality of an image (dynamic or static) suffering from poor illumination. The key objective is to develop a systematic and fundamental concept for image contrast enhancement that should be robust despite a dynamic environment and that should fulfil the real-time constraints by ensuring an ultrafast analysis. It is demonstrated that the new approach developed in this paper is capable of fulfilling the expected requirements. The proposed approach combines the good features of the 'coupled oscillators'-based signal processing paradigm with the good features of the 'cellular neural network (CNN)'-based one. The first paradigm in this combination is the 'master system' and consists of a set of coupled nonlinear ordinary differential equations (ODEs) that are (a) the so-called 'van der Pol oscillator' and (b) the so-called 'Duffing oscillator'. It is then implemented or realized on top of a 'slave system' platform consisting of a CNN-processors platform. An offline bifurcation analysis is used to find out, a priori, the windows of parameter settings in which the coupled oscillator system exhibits the best and most appropriate behaviours of interest for an optimal resulting image processing quality. In the frame of the extensive bifurcation analysis carried out, analytical formulae have been derived, which are capable of determining the various

  3. Aeroelasticity of morphing wings using neural networks

    Science.gov (United States)

    Natarajan, Anand

    In this dissertation, neural networks are designed to effectively model static non-linear aeroelastic problems in adaptive structures and linear dynamic aeroelastic systems with time varying stiffness. The use of adaptive materials in aircraft wings allows for the change of the contour or the configuration of a wing (morphing) in flight. The use of smart materials, to accomplish these deformations, can imply that the stiffness of the wing with a morphing contour changes as the contour changes. For a rapidly oscillating body in a fluid field, continuously adapting structural parameters may render the wing to behave as a time variant system. Even the internal spars/ribs of the aircraft wing which define the wing stiffness can be made adaptive, that is, their stiffness can be made to vary with time. The immediate effect on the structural dynamics of the wing, is that, the wing motion is governed by a differential equation with time varying coefficients. The study of this concept of a time varying torsional stiffness, made possible by the use of active materials and adaptive spars, in the dynamic aeroelastic behavior of an adaptable airfoil is performed here. Another type of aeroelastic problem of an adaptive structure that is investigated here, is the shape control of an adaptive bump situated on the leading edge of an airfoil. Such a bump is useful in achieving flow separation control for lateral directional maneuverability of the aircraft. Since actuators are being used to create this bump on the wing surface, the energy required to do so needs to be minimized. The adverse pressure drag as a result of this bump needs to be controlled so that the loss in lift over the wing is made minimal. The design of such a "spoiler bump" on the surface of the airfoil is an optimization problem of maximizing pressure drag due to flow separation while minimizing the loss in lift and energy required to deform the bump. One neural network is trained using the CFD code FLUENT to

  4. Genetic learning in rule-based and neural systems

    Science.gov (United States)

    Smith, Robert E.

    1993-01-01

    The design of neural networks and fuzzy systems can involve complex, nonlinear, and ill-conditioned optimization problems. Often, traditional optimization schemes are inadequate or inapplicable for such tasks. Genetic Algorithms (GA's) are a class of optimization procedures whose mechanics are based on those of natural genetics. Mathematical arguments show how GAs bring substantial computational leverage to search problems, without requiring the mathematical characteristics often necessary for traditional optimization schemes (e.g., modality, continuity, availability of derivative information, etc.). GA's have proven effective in a variety of search tasks that arise in neural networks and fuzzy systems. This presentation begins by introducing the mechanism and theoretical underpinnings of GA's. GA's are then related to a class of rule-based machine learning systems called learning classifier systems (LCS's). An LCS implements a low-level production-system that uses a GA as its primary rule discovery mechanism. This presentation illustrates how, despite its rule-based framework, an LCS can be thought of as a competitive neural network. Neural network simulator code for an LCS is presented. In this context, the GA is doing more than optimizing and objective function. It is searching for an ecology of hidden nodes with limited connectivity. The GA attempts to evolve this ecology such that effective neural network performance results. The GA is particularly well adapted to this task, given its naturally-inspired basis. The LCS/neural network analogy extends itself to other, more traditional neural networks. Conclusions to the presentation discuss the implications of using GA's in ecological search problems that arise in neural and fuzzy systems.

  5. Nonlinear Science

    CERN Document Server

    Yoshida, Zensho

    2010-01-01

    This book gives a general, basic understanding of the mathematical structure "nonlinearity" that lies in the depths of complex systems. Analyzing the heterogeneity that the prefix "non" represents with respect to notions such as the linear space, integrability and scale hierarchy, "nonlinear science" is explained as a challenge of deconstruction of the modern sciences. This book is not a technical guide to teach mathematical tools of nonlinear analysis, nor a zoology of so-called nonlinear phenomena. By critically analyzing the structure of linear theories, and cl

  6. Nonlinear oscillations

    CERN Document Server

    Nayfeh, Ali Hasan

    1995-01-01

    Nonlinear Oscillations is a self-contained and thorough treatment of the vigorous research that has occurred in nonlinear mechanics since 1970. The book begins with fundamental concepts and techniques of analysis and progresses through recent developments and provides an overview that abstracts and introduces main nonlinear phenomena. It treats systems having a single degree of freedom, introducing basic concepts and analytical methods, and extends concepts and methods to systems having degrees of freedom. Most of this material cannot be found in any other text. Nonlinear Oscillations uses sim

  7. Non-Linear Response to Periodic Forcing of Methane-Air Global and Detailed Kinetics in Continuous Stirred Tank Reactors Close to Extinction Conditions

    Directory of Open Access Journals (Sweden)

    Francesco Saverio Marra

    2015-09-01

    Full Text Available This paper focus on the behavior of a continuous stirred tank reactor (CSTR subject to perturbations of finite amplitude and frequency. Two main objectives are pursued: to determine the extinction line in the equivalence ratio (φ - residence time (τ plane, fixed the thermodynamic state conditions; and to characterize the response of the chemical system to periodic forcing of the residence time. Transient simulations of combustion of methane with air, using both global single-step and detailed chemical kinetic mechanisms, have been conducted and the corresponding asymptotic solutions analyzed. Results indicate very different dynamical behaviors, posing the issue of a proper choice of the kinetic scheme for the numerical study of combustion oscillations.

  8. Nonlinear systems

    CERN Document Server

    Palmero, Faustino; Lemos, M; Sánchez-Rey, Bernardo; Casado-Pascual, Jesús

    2018-01-01

    This book presents an overview of the most recent advances in nonlinear science. It provides a unified view of nonlinear properties in many different systems and highlights many  new developments. While volume 1 concentrates on mathematical theory and computational techniques and challenges, which are essential for the study of nonlinear science, this second volume deals with nonlinear excitations in several fields. These excitations can be localized and transport energy and matter in the form of breathers, solitons, kinks or quodons with very different characteristics, which are discussed in the book. They can also transport electric charge, in which case they are known as polarobreathers or solectrons. Nonlinear excitations can influence function and structure in biology, as for example, protein folding. In crystals and other condensed matter, they can modify transport properties, reaction kinetics and interact with defects. There are also engineering applications in electric lattices, Josephson junction a...

  9. Continuous Dropout.

    Science.gov (United States)

    Shen, Xu; Tian, Xinmei; Liu, Tongliang; Xu, Fang; Tao, Dacheng

    2017-10-03

    Dropout has been proven to be an effective algorithm for training robust deep networks because of its ability to prevent overfitting by avoiding the co-adaptation of feature detectors. Current explanations of dropout include bagging, naive Bayes, regularization, and sex in evolution. According to the activation patterns of neurons in the human brain, when faced with different situations, the firing rates of neurons are random and continuous, not binary as current dropout does. Inspired by this phenomenon, we extend the traditional binary dropout to continuous dropout. On the one hand, continuous dropout is considerably closer to the activation characteristics of neurons in the human brain than traditional binary dropout. On the other hand, we demonstrate that continuous dropout has the property of avoiding the co-adaptation of feature detectors, which suggests that we can extract more independent feature detectors for model averaging in the test stage. We introduce the proposed continuous dropout to a feedforward neural network and comprehensively compare it with binary dropout, adaptive dropout, and DropConnect on Modified National Institute of Standards and Technology, Canadian Institute for Advanced Research-10, Street View House Numbers, NORB, and ImageNet large scale visual recognition competition-12. Thorough experiments demonstrate that our method performs better in preventing the co-adaptation of feature detectors and improves test performance.

  10. Information transmission and recovery in neural communications channels

    International Nuclear Information System (INIS)

    Eguia, M. C.; Rabinovich, M. I.; Abarbanel, H. D. I.

    2000-01-01

    Biological neural communications channels transport environmental information from sensors through chains of active dynamical neurons to neural centers for decisions and actions to achieve required functions. These kinds of communications channels are able to create information and to transfer information from one time scale to the other because of the intrinsic nonlinear dynamics of the component neurons. We discuss a very simple neural information channel composed of sensory input in the form of a spike train that arrives at a model neuron, then moves through a realistic synapse to a second neuron where the information in the initial sensory signal is read. Our model neurons are four-dimensional generalizations of the Hindmarsh-Rose neuron, and we use a model of chemical synapse derived from first-order kinetics. The four-dimensional model neuron has a rich variety of dynamical behaviors, including periodic bursting, chaotic bursting, continuous spiking, and multistability. We show that, for many of these regimes, the parameters of the chemical synapse can be tuned so that information about the stimulus that is unreadable at the first neuron in the channel can be recovered by the dynamical activity of the synapse and the second neuron. Information creation by nonlinear dynamical systems that allow chaotic oscillations is familiar in their autonomous oscillations. It is associated with the instabilities that lead to positive Lyapunov exponents in their dynamical behavior. Our results indicate how nonlinear neurons acting as input/output systems along a communications channel can recover information apparently ''lost'' in earlier junctions on the channel. Our measure of information transmission is the average mutual information between elements, and because the channel is active and nonlinear, the average mutual information between the sensory source and the final neuron may be greater than the average mutual information at an earlier neuron in the channel. This

  11. Dynamic training algorithm for dynamic neural networks

    International Nuclear Information System (INIS)

    Tan, Y.; Van Cauwenberghe, A.; Liu, Z.

    1996-01-01

    The widely used backpropagation algorithm for training neural networks based on the gradient descent has a significant drawback of slow convergence. A Gauss-Newton method based recursive least squares (RLS) type algorithm with dynamic error backpropagation is presented to speed-up the learning procedure of neural networks with local recurrent terms. Finally, simulation examples concerning the applications of the RLS type algorithm to identification of nonlinear processes using a local recurrent neural network are also included in this paper

  12. Adaptive optimization and control using neural networks

    Energy Technology Data Exchange (ETDEWEB)

    Mead, W.C.; Brown, S.K.; Jones, R.D.; Bowling, P.S.; Barnes, C.W.

    1993-10-22

    Recent work has demonstrated the ability of neural-network-based controllers to optimize and control machines with complex, non-linear, relatively unknown control spaces. We present a brief overview of neural networks via a taxonomy illustrating some capabilities of different kinds of neural networks. We present some successful control examples, particularly the optimization and control of a small-angle negative ion source.

  13. The quest for a Quantum Neural Network

    OpenAIRE

    Schuld, M.; Sinayskiy, I.; Petruccione, F.

    2014-01-01

    With the overwhelming success in the field of quantum information in the last decades, the "quest" for a Quantum Neural Network (QNN) model began in order to combine quantum computing with the striking properties of neural computing. This article presents a systematic approach to QNN research, which so far consists of a conglomeration of ideas and proposals. It outlines the challenge of combining the nonlinear, dissipative dynamics of neural computing and the linear, unitary dynamics of quant...

  14. Hybrid Modeling and Optimization of Yogurt Starter Culture Continuous Fermentation

    Directory of Open Access Journals (Sweden)

    Silviya Popova

    2009-10-01

    Full Text Available The present paper presents a hybrid model of yogurt starter mixed culture fermentation. The main nonlinearities within a classical structure of continuous process model are replaced by neural networks. The new hybrid model accounts for the dependence of the two microorganisms' kinetics from the on-line measured characteristics of the culture medium - pH. Then the model was used further for calculation of the optimal time profile of pH. The obtained results are with agreement with the experimental once.

  15. Prediction based chaos control via a new neural network

    International Nuclear Information System (INIS)

    Shen Liqun; Wang Mao; Liu Wanyu; Sun Guanghui

    2008-01-01

    In this Letter, a new chaos control scheme based on chaos prediction is proposed. To perform chaos prediction, a new neural network architecture for complex nonlinear approximation is proposed. And the difficulty in building and training the neural network is also reduced. Simulation results of Logistic map and Lorenz system show the effectiveness of the proposed chaos control scheme and the proposed neural network

  16. Nonlinear optics

    CERN Document Server

    Boyd, Robert W

    2013-01-01

    Nonlinear Optics is an advanced textbook for courses dealing with nonlinear optics, quantum electronics, laser physics, contemporary and quantum optics, and electrooptics. Its pedagogical emphasis is on fundamentals rather than particular, transitory applications. As a result, this textbook will have lasting appeal to a wide audience of electrical engineering, physics, and optics students, as well as those in related fields such as materials science and chemistry.Key Features* The origin of optical nonlinearities, including dependence on the polarization of light* A detailed treatment of the q

  17. Nonlinear systems

    National Research Council Canada - National Science Library

    Drazin, P. G

    1992-01-01

    This book is an introduction to the theories of bifurcation and chaos. It treats the solution of nonlinear equations, especially difference and ordinary differential equations, as a parameter varies...

  18. Nonlinear analysis

    CERN Document Server

    Gasinski, Leszek

    2005-01-01

    Hausdorff Measures and Capacity. Lebesgue-Bochner and Sobolev Spaces. Nonlinear Operators and Young Measures. Smooth and Nonsmooth Analysis and Variational Principles. Critical Point Theory. Eigenvalue Problems and Maximum Principles. Fixed Point Theory.

  19. Mathematical modeling and applications in nonlinear dynamics

    CERN Document Server

    Merdan, Hüseyin

    2016-01-01

    The book covers nonlinear physical problems and mathematical modeling, including molecular biology, genetics, neurosciences, artificial intelligence with classical problems in mechanics and astronomy and physics. The chapters present nonlinear mathematical modeling in life science and physics through nonlinear differential equations, nonlinear discrete equations and hybrid equations. Such modeling can be effectively applied to the wide spectrum of nonlinear physical problems, including the KAM (Kolmogorov-Arnold-Moser (KAM)) theory, singular differential equations, impulsive dichotomous linear systems, analytical bifurcation trees of periodic motions, and almost or pseudo- almost periodic solutions in nonlinear dynamical systems. Provides methods for mathematical models with switching, thresholds, and impulses, each of particular importance for discontinuous processes Includes qualitative analysis of behaviors on Tumor-Immune Systems and methods of analysis for DNA, neural networks and epidemiology Introduces...

  20. Wave transmission in nonlinear lattices

    International Nuclear Information System (INIS)

    Hennig, D.; Tsironis, G.P.

    1999-01-01

    The interplay of nonlinearity with lattice discreteness leads to phenomena and propagation properties quite distinct from those appearing in continuous nonlinear systems. For a large variety of condensed matter and optics applications the continuous wave approximation is not appropriate. In the present review we discuss wave transmission properties in one dimensional nonlinear lattices. Our paradigmatic equations are discrete nonlinear Schroedinger equations and their study is done through a dynamical systems approach. We focus on stationary wave properties and utilize well known results from the theory of dynamical systems to investigate various aspects of wave transmission and wave localization. We analyze in detail the more general dynamical system corresponding to the equation that interpolates between the non-integrable discrete nonlinear Schroedinger equation and the integrable Albowitz-Ladik equation. We utilize this analysis in a nonlinear Kronig-Penney model and investigate transmission and band modification properties. We discuss the modifications that are effected through an electric field and the nonlinear Wannier-Stark localization effects that are induced. Several applications are described, such as polarons in one dimensional lattices, semiconductor superlattices and one dimensional nonlinear photonic band gap systems. (Copyright (c) 1999 Elsevier Science B.V., Amsterdam. All rights reserved.)

  1. Numeral eddy current sensor modelling based on genetic neural network

    International Nuclear Information System (INIS)

    Yu Along

    2008-01-01

    This paper presents a method used to the numeral eddy current sensor modelling based on the genetic neural network to settle its nonlinear problem. The principle and algorithms of genetic neural network are introduced. In this method, the nonlinear model parameters of the numeral eddy current sensor are optimized by genetic neural network (GNN) according to measurement data. So the method remains both the global searching ability of genetic algorithm and the good local searching ability of neural network. The nonlinear model has the advantages of strong robustness, on-line modelling and high precision. The maximum nonlinearity error can be reduced to 0.037% by using GNN. However, the maximum nonlinearity error is 0.075% using the least square method

  2. Understanding the Implications of Neural Population Activity on Behavior

    Science.gov (United States)

    Briguglio, John

    Learning how neural activity in the brain leads to the behavior we exhibit is one of the fundamental questions in Neuroscience. In this dissertation, several lines of work are presented to that use principles of neural coding to understand behavior. In one line of work, we formulate the efficient coding hypothesis in a non-traditional manner in order to test human perceptual sensitivity to complex visual textures. We find a striking agreement between how variable a particular texture signal is and how sensitive humans are to its presence. This reveals that the efficient coding hypothesis is still a guiding principle for neural organization beyond the sensory periphery, and that the nature of cortical constraints differs from the peripheral counterpart. In another line of work, we relate frequency discrimination acuity to neural responses from auditory cortex in mice. It has been previously observed that optogenetic manipulation of auditory cortex, in addition to changing neural responses, evokes changes in behavioral frequency discrimination. We are able to account for changes in frequency discrimination acuity on an individual basis by examining the Fisher information from the neural population with and without optogenetic manipulation. In the third line of work, we address the question of what a neural population should encode given that its inputs are responses from another group of neurons. Drawing inspiration from techniques in machine learning, we train Deep Belief Networks on fake retinal data and show the emergence of Garbor-like filters, reminiscent of responses in primary visual cortex. In the last line of work, we model the state of a cortical excitatory-inhibitory network during complex adaptive stimuli. Using a rate model with Wilson-Cowan dynamics, we demonstrate that simple non-linearities in the signal transferred from inhibitory to excitatory neurons can account for real neural recordings taken from auditory cortex. This work establishes and tests

  3. Time series prediction: statistical and neural techniques

    Science.gov (United States)

    Zahirniak, Daniel R.; DeSimio, Martin P.

    1996-03-01

    In this paper we compare the performance of nonlinear neural network techniques to those of linear filtering techniques in the prediction of time series. Specifically, we compare the results of using the nonlinear systems, known as multilayer perceptron and radial basis function neural networks, with the results obtained using the conventional linear Wiener filter, Kalman filter and Widrow-Hoff adaptive filter in predicting future values of stationary and non- stationary time series. Our results indicate the performance of each type of system is heavily dependent upon the form of the time series being predicted and the size of the system used. In particular, the linear filters perform adequately for linear or near linear processes while the nonlinear systems perform better for nonlinear processes. Since the linear systems take much less time to be developed, they should be tried prior to using the nonlinear systems when the linearity properties of the time series process are unknown.

  4. Nonlinear optimization

    CERN Document Server

    Ruszczynski, Andrzej

    2011-01-01

    Optimization is one of the most important areas of modern applied mathematics, with applications in fields from engineering and economics to finance, statistics, management science, and medicine. While many books have addressed its various aspects, Nonlinear Optimization is the first comprehensive treatment that will allow graduate students and researchers to understand its modern ideas, principles, and methods within a reasonable time, but without sacrificing mathematical precision. Andrzej Ruszczynski, a leading expert in the optimization of nonlinear stochastic systems, integrates the theory and the methods of nonlinear optimization in a unified, clear, and mathematically rigorous fashion, with detailed and easy-to-follow proofs illustrated by numerous examples and figures. The book covers convex analysis, the theory of optimality conditions, duality theory, and numerical methods for solving unconstrained and constrained optimization problems. It addresses not only classical material but also modern top...

  5. Artificial Neural Network-Based Three-dimensional Continuous Response Relationship Construction of 3Cr20Ni10W2 Heat-Resisting Alloy and Its Application in Finite Element Simulation

    Science.gov (United States)

    Li, Le; Wang, Li-yong

    2018-04-01

    The application of accurate constitutive relationship in finite element simulation would significantly contribute to accurate simulation results, which plays a critical role in process design and optimization. In this investigation, the true stress-strain data of 3Cr20Ni10W2 heat-resisting alloy were obtained from a series of isothermal compression tests conducted in a wide temperature range of 1203-1403 K and strain rate range of 0.01-10 s-1 on a Gleeble 1500 testing machine. Then the constitutive relationship was modeled by an optimally constructed and well-trained back-propagation artificial neural network (BP-ANN). The evaluation of the BP-ANN model revealed that it has admirable performance in characterizing and predicting the flow behaviors of 3Cr20Ni10W2 heat-resisting alloy. Meanwhile, a comparison between improved Arrhenius-type constitutive equation and BP-ANN model shows that the latter has higher accuracy. Consequently, the developed BP-ANN model was used to predict abundant stress-strain data beyond the limited experimental conditions and construct the three-dimensional continuous response relationship for temperature, strain rate, strain, and stress. Finally, the three-dimensional continuous response relationship was applied to the numerical simulation of isothermal compression tests. The results show that such constitutive relationship can significantly promote the accuracy improvement of numerical simulation for hot forming processes.

  6. Probabilistic models for neural populations that naturally capture global coupling and criticality.

    Science.gov (United States)

    Humplik, Jan; Tkačik, Gašper

    2017-09-01

    Advances in multi-unit recordings pave the way for statistical modeling of activity patterns in large neural populations. Recent studies have shown that the summed activity of all neurons strongly shapes the population response. A separate recent finding has been that neural populations also exhibit criticality, an anomalously large dynamic range for the probabilities of different population activity patterns. Motivated by these two observations, we introduce a class of probabilistic models which takes into account the prior knowledge that the neural population could be globally coupled and close to critical. These models consist of an energy function which parametrizes interactions between small groups of neurons, and an arbitrary positive, strictly increasing, and twice differentiable function which maps the energy of a population pattern to its probability. We show that: 1) augmenting a pairwise Ising model with a nonlinearity yields an accurate description of the activity of retinal ganglion cells which outperforms previous models based on the summed activity of neurons; 2) prior knowledge that the population is critical translates to prior expectations about the shape of the nonlinearity; 3) the nonlinearity admits an interpretation in terms of a continuous latent variable globally coupling the system whose distribution we can infer from data. Our method is independent of the underlying system's state space; hence, it can be applied to other systems such as natural scenes or amino acid sequences of proteins which are also known to exhibit criticality.

  7. A neural network driving curve generation method for the heavy-haul train

    Directory of Open Access Journals (Sweden)

    Youneng Huang

    2016-05-01

    Full Text Available The heavy-haul train has a series of characteristics, such as the locomotive traction properties, the longer length of train, and the nonlinear train pipe pressure during train braking. When the train is running on a continuous long and steep downgrade railway line, the safety of the train is ensured by cycle braking, which puts high demands on the driving skills of the driver. In this article, a driving curve generation method for the heavy-haul train based on a neural network is proposed. First, in order to describe the nonlinear characteristics of train braking, the neural network model is constructed and trained by practical driving data. In the neural network model, various nonlinear neurons are interconnected to work for information processing and transmission. The target value of train braking pressure reduction and release time is achieved by modeling the braking process. The equation of train motion is computed to obtain the driving curve. Finally, in four typical operation scenarios, comparing the curve data generated by the method with corresponding practical data of the Shuohuang heavy-haul railway line, the results show that the method is effective.

  8. Nonlinear fibre optics overview

    DEFF Research Database (Denmark)

    Travers, J. C.; Frosz, Michael Henoch; Dudley, J. M.

    2010-01-01

    The optical fiber based supercontinuum source has recently become a significant scientific and commercial success, with applications ranging from frequency comb production to advanced medical imaging. This one-of-a-kind book explains the theory of fiber supercontinuum broadening, describes......, provides a background to the associated nonlinear optical processes, treats the generation mechanisms from continuous wave to femtosecond pulse pump regimes and highlights the diverse applications. A full discussion of numerical methods and comprehensive computer code are also provided, enabling readers...

  9. Neural networks

    International Nuclear Information System (INIS)

    Denby, Bruce; Lindsey, Clark; Lyons, Louis

    1992-01-01

    The 1980s saw a tremendous renewal of interest in 'neural' information processing systems, or 'artificial neural networks', among computer scientists and computational biologists studying cognition. Since then, the growth of interest in neural networks in high energy physics, fueled by the need for new information processing technologies for the next generation of high energy proton colliders, can only be described as explosive

  10. Nonlinear Dynamic Phenomena in Mechanics

    CERN Document Server

    Warminski, Jerzy; Cartmell, Matthew P

    2012-01-01

    Nonlinear phenomena should play a crucial role in the design and control of engineering systems and structures as they can drastically change the prevailing dynamical responses. This book covers theoretical and applications-based problems of nonlinear dynamics concerned with both discrete and continuous systems of interest in civil and mechanical engineering. They include pendulum-like systems, slender footbridges, shape memory alloys, sagged elastic cables and non-smooth problems. Pendulums can be used as a dynamic absorber mounted in high buildings, bridges or chimneys. Geometrical nonlinear

  11. Algebraic and adaptive learning in neural control systems

    Science.gov (United States)

    Ferrari, Silvia

    A systematic approach is developed for designing adaptive and reconfigurable nonlinear control systems that are applicable to plants modeled by ordinary differential equations. The nonlinear controller comprising a network of neural networks is taught using a two-phase learning procedure realized through novel techniques for initialization, on-line training, and adaptive critic design. A critical observation is that the gradients of the functions defined by the neural networks must equal corresponding linear gain matrices at chosen operating points. On-line training is based on a dual heuristic adaptive critic architecture that improves control for large, coupled motions by accounting for actual plant dynamics and nonlinear effects. An action network computes the optimal control law; a critic network predicts the derivative of the cost-to-go with respect to the state. Both networks are algebraically initialized based on prior knowledge of satisfactory pointwise linear controllers and continue to adapt on line during full-scale simulations of the plant. On-line training takes place sequentially over discrete periods of time and involves several numerical procedures. A backpropagating algorithm called Resilient Backpropagation is modified and successfully implemented to meet these objectives, without excessive computational expense. This adaptive controller is as conservative as the linear designs and as effective as a global nonlinear controller. The method is successfully implemented for the full-envelope control of a six-degree-of-freedom aircraft simulation. The results show that the on-line adaptation brings about improved performance with respect to the initialization phase during aircraft maneuvers that involve large-angle and coupled dynamics, and parameter variations.

  12. XXIII International Conference on Nonlinear Dynamics of Electronic Systems

    CERN Document Server

    Stoop, Ruedi; Stramaglia, Sebastiano

    2017-01-01

    This book collects contributions to the XXIII international conference “Nonlinear dynamics of electronic systems”. Topics range from non-linearity in electronic circuits to synchronisation effects in complex networks to biological systems, neural dynamics and the complex organisation of the brain. Resting on a solid mathematical basis, these investigations address highly interdisciplinary problems in physics, engineering, biology and biochemistry.

  13. Nonlinear silicon photonics

    Science.gov (United States)

    Tsia, Kevin K.; Jalali, Bahram

    2010-05-01

    An intriguing optical property of silicon is that it exhibits a large third-order optical nonlinearity, with orders-ofmagnitude larger than that of silica glass in the telecommunication band. This allows efficient nonlinear optical interaction at relatively low power levels in a small footprint. Indeed, we have witnessed a stunning progress in harnessing the Raman and Kerr effects in silicon as the mechanisms for enabling chip-scale optical amplification, lasing, and wavelength conversion - functions that until recently were perceived to be beyond the reach of silicon. With all the continuous efforts developing novel techniques, nonlinear silicon photonics is expected to be able to reach even beyond the prior achievements. Instead of providing a comprehensive overview of this field, this manuscript highlights a number of new branches of nonlinear silicon photonics, which have not been fully recognized in the past. In particular, they are two-photon photovoltaic effect, mid-wave infrared (MWIR) silicon photonics, broadband Raman effects, inverse Raman scattering, and periodically-poled silicon (PePSi). These novel effects and techniques could create a new paradigm for silicon photonics and extend its utility beyond the traditionally anticipated applications.

  14. EDITORIAL: Why we need a new journal in neural engineering

    Science.gov (United States)

    Durand, Dominique M.

    2004-03-01

    laboratory but also in the publication of scientific papers. We do, therefore, need a new journal that provides a platform for this emerging interdisciplinary field of neural engineering where neuroscientists, neurobiologists and engineers can publish their work in one periodical that spans the disciplines. Journal of Neural Engineering will provide this platform. The new journal will publish full-length articles of the highest quality and importance in the field of neural engineering at the molecular, cellular and systems levels. The scope of Journal of Neural Engineering encompasses experimental, computational and theoretical aspects of neural interfacing, neuroelectronics, neuromechanical systems, neuroinformatics, neuroimaging, neural prostheses, artificial and biological neural circuits, neural control, neural tissue regeneration, neural signal processing, neural modeling and neuro-computation. The scope of the journal has both depth and breadth in areas relevant to the interface between neuroscience and engineering. There will be two Editors-in-Chief, with expertise covering both engineering and neuroscience. Experts in the areas encompassed by the journal's scope have been identified for the Editorial Board and the composition of the board will be continually updated to address the developments in this new and exciting field. The first issue of this new journal covers a variety of topics that combine neuroscience and engineering: mental state recognition from EEG signals, analysis of body motion in Parkinson's patients, non-linear dynamics of the respiratory system, automatic identification of saccade-related visual evoked potentials, multiple electrode stimulators, algorithms to estimate the causal relationship between brain sources, diffusion tensor imaging in the brain and phase synchronization of neural activity in vitro. This broad array of manuscripts focusing on neural imaging, neurophysiology, neural signal processing, neuroelectronics and neuro-dynamics can

  15. Nonlinear Motion Tracking by Deep Learning Architecture

    Science.gov (United States)

    Verma, Arnav; Samaiya, Devesh; Gupta, Karunesh K.

    2018-03-01

    In the world of Artificial Intelligence, object motion tracking is one of the major problems. The extensive research is being carried out to track people in crowd. This paper presents a unique technique for nonlinear motion tracking in the absence of prior knowledge of nature of nonlinear path that the object being tracked may follow. We achieve this by first obtaining the centroid of the object and then using the centroid as the current example for a recurrent neural network trained using real-time recurrent learning. We have tweaked the standard algorithm slightly and have accumulated the gradient for few previous iterations instead of using just the current iteration as is the norm. We show that for a single object, such a recurrent neural network is highly capable of approximating the nonlinearity of its path.

  16. IMNN: Information Maximizing Neural Networks

    Science.gov (United States)

    Charnock, Tom; Lavaux, Guilhem; Wandelt, Benjamin D.

    2018-04-01

    This software trains artificial neural networks to find non-linear functionals of data that maximize Fisher information: information maximizing neural networks (IMNNs). As compressing large data sets vastly simplifies both frequentist and Bayesian inference, important information may be inadvertently missed. Likelihood-free inference based on automatically derived IMNN summaries produces summaries that are good approximations to sufficient statistics. IMNNs are robustly capable of automatically finding optimal, non-linear summaries of the data even in cases where linear compression fails: inferring the variance of Gaussian signal in the presence of noise, inferring cosmological parameters from mock simulations of the Lyman-α forest in quasar spectra, and inferring frequency-domain parameters from LISA-like detections of gravitational waveforms. In this final case, the IMNN summary outperforms linear data compression by avoiding the introduction of spurious likelihood maxima.

  17. Nonlinear Elliptic Differential Equations with Multivalued Nonlinearities

    Indian Academy of Sciences (India)

    In this paper we study nonlinear elliptic boundary value problems with monotone and nonmonotone multivalued nonlinearities. First we consider the case of monotone nonlinearities. In the first result we assume that the multivalued nonlinearity is defined on all R R . Assuming the existence of an upper and of a lower ...

  18. Neural networks and orbit control in accelerators

    International Nuclear Information System (INIS)

    Bozoki, E.; Friedman, A.

    1994-01-01

    An overview of the architecture, workings and training of Neural Networks is given. We stress the aspects which are important for the use of Neural Networks for orbit control in accelerators and storage rings, especially its ability to cope with the nonlinear behavior of the orbit response to 'kicks' and the slow drift in the orbit response during long-term operation. Results obtained for the two NSLS storage rings with several network architectures and various training methods for each architecture are given

  19. Stochastic Computational Approach for Complex Nonlinear Ordinary Differential Equations

    International Nuclear Information System (INIS)

    Khan, Junaid Ali; Raja, Muhammad Asif Zahoor; Qureshi, Ijaz Mansoor

    2011-01-01

    We present an evolutionary computational approach for the solution of nonlinear ordinary differential equations (NLODEs). The mathematical modeling is performed by a feed-forward artificial neural network that defines an unsupervised error. The training of these networks is achieved by a hybrid intelligent algorithm, a combination of global search with genetic algorithm and local search by pattern search technique. The applicability of this approach ranges from single order NLODEs, to systems of coupled differential equations. We illustrate the method by solving a variety of model problems and present comparisons with solutions obtained by exact methods and classical numerical methods. The solution is provided on a continuous finite time interval unlike the other numerical techniques with comparable accuracy. With the advent of neuroprocessors and digital signal processors the method becomes particularly interesting due to the expected essential gains in the execution speed. (general)

  20. Applying neural networks to optimize instrumentation performance

    Energy Technology Data Exchange (ETDEWEB)

    Start, S.E.; Peters, G.G.

    1995-06-01

    Well calibrated instrumentation is essential in providing meaningful information about the status of a plant. Signals from plant instrumentation frequently have inherent non-linearities, may be affected by environmental conditions and can therefore cause calibration difficulties for the people who maintain them. Two neural network approaches are described in this paper for improving the accuracy of a non-linear, temperature sensitive level probe ised in Expermental Breeder Reactor II (EBR-II) that was difficult to calibrate.

  1. Applying neural networks to optimize instrumentation performance

    International Nuclear Information System (INIS)

    Start, S.E.; Peters, G.G.

    1995-01-01

    Well calibrated instrumentation is essential in providing meaningful information about the status of a plant. Signals from plant instrumentation frequently have inherent non-linearities, may be affected by environmental conditions and can therefore cause calibration difficulties for the people who maintain them. Two neural network approaches are described in this paper for improving the accuracy of a non-linear, temperature sensitive level probe ised in Expermental Breeder Reactor II (EBR-II) that was difficult to calibrate

  2. Neural network error correction for solving coupled ordinary differential equations

    Science.gov (United States)

    Shelton, R. O.; Darsey, J. A.; Sumpter, B. G.; Noid, D. W.

    1992-01-01

    A neural network is presented to learn errors generated by a numerical algorithm for solving coupled nonlinear differential equations. The method is based on using a neural network to correctly learn the error generated by, for example, Runge-Kutta on a model molecular dynamics (MD) problem. The neural network programs used in this study were developed by NASA. Comparisons are made for training the neural network using backpropagation and a new method which was found to converge with fewer iterations. The neural net programs, the MD model and the calculations are discussed.

  3. A Low-Cost Maximum Power Point Tracking System Based on Neural Network Inverse Model Controller

    Directory of Open Access Journals (Sweden)

    Carlos Robles Algarín

    2018-01-01

    Full Text Available This work presents the design, modeling, and implementation of a neural network inverse model controller for tracking the maximum power point of a photovoltaic (PV module. A nonlinear autoregressive network with exogenous inputs (NARX was implemented in a serial-parallel architecture. The PV module mathematical modeling was developed, a buck converter was designed to operate in the continuous conduction mode with a switching frequency of 20 KHz, and the dynamic neural controller was designed using the Neural Network Toolbox from Matlab/Simulink (MathWorks, Natick, MA, USA, and it was implemented on an open-hardware Arduino Mega board. To obtain the reference signals for the NARX and determine the 65 W PV module behavior, a system made of a 0.8 W PV cell, a temperature sensor, a voltage sensor and a static neural network, was used. To evaluate performance a comparison with the P&O traditional algorithm was done in terms of response time and oscillations around the operating point. Simulation results demonstrated the superiority of neural controller over the P&O. Implementation results showed that approximately the same power is obtained with both controllers, but the P&O controller presents oscillations between 7 W and 10 W, in contrast to the inverse controller, which had oscillations between 1 W and 2 W.

  4. Adaptive neural network/expert system that learns fault diagnosis for different structures

    Science.gov (United States)

    Simon, Solomon H.

    1992-08-01

    Corporations need better real-time monitoring and control systems to improve productivity by watching quality and increasing production flexibility. The innovative technology to achieve this goal is evolving in the form artificial intelligence and neural networks applied to sensor processing, fusion, and interpretation. By using these advanced Al techniques, we can leverage existing systems and add value to conventional techniques. Neural networks and knowledge-based expert systems can be combined into intelligent sensor systems which provide real-time monitoring, control, evaluation, and fault diagnosis for production systems. Neural network-based intelligent sensor systems are more reliable because they can provide continuous, non-destructive monitoring and inspection. Use of neural networks can result in sensor fusion and the ability to model highly, non-linear systems. Improved models can provide a foundation for more accurate performance parameters and predictions. We discuss a research software/hardware prototype which integrates neural networks, expert systems, and sensor technologies and which can adapt across a variety of structures to perform fault diagnosis. The flexibility and adaptability of the prototype in learning two structures is presented. Potential applications are discussed.

  5. Artificial frame filling using adaptive neural fuzzy inference system for particle image velocimetry dataset

    Science.gov (United States)

    Akdemir, Bayram; Doǧan, Sercan; Aksoy, Muharrem H.; Canli, Eyüp; Özgören, Muammer

    2015-03-01

    Liquid behaviors are very important for many areas especially for Mechanical Engineering. Fast camera is a way to observe and search the liquid behaviors. Camera traces the dust or colored markers travelling in the liquid and takes many pictures in a second as possible as. Every image has large data structure due to resolution. For fast liquid velocity, there is not easy to evaluate or make a fluent frame after the taken images. Artificial intelligence has much popularity in science to solve the nonlinear problems. Adaptive neural fuzzy inference system is a common artificial intelligence in literature. Any particle velocity in a liquid has two dimension speed and its derivatives. Adaptive Neural Fuzzy Inference System has been used to create an artificial frame between previous and post frames as offline. Adaptive neural fuzzy inference system uses velocities and vorticities to create a crossing point vector between previous and post points. In this study, Adaptive Neural Fuzzy Inference System has been used to fill virtual frames among the real frames in order to improve image continuity. So this evaluation makes the images much understandable at chaotic or vorticity points. After executed adaptive neural fuzzy inference system, the image dataset increase two times and has a sequence as virtual and real, respectively. The obtained success is evaluated using R2 testing and mean squared error. R2 testing has a statistical importance about similarity and 0.82, 0.81, 0.85 and 0.8 were obtained for velocities and derivatives, respectively.

  6. Neural networks in signal processing

    International Nuclear Information System (INIS)

    Govil, R.

    2000-01-01

    Nuclear Engineering has matured during the last decade. In research and design, control, supervision, maintenance and production, mathematical models and theories are used extensively. In all such applications signal processing is embedded in the process. Artificial Neural Networks (ANN), because of their nonlinear, adaptive nature are well suited to such applications where the classical assumptions of linearity and second order Gaussian noise statistics cannot be made. ANN's can be treated as nonparametric techniques, which can model an underlying process from example data. They can also adopt their model parameters to statistical change with time. Algorithms in the framework of Neural Networks in Signal processing have found new applications potentials in the field of Nuclear Engineering. This paper reviews the fundamentals of Neural Networks in signal processing and their applications in tasks such as recognition/identification and control. The topics covered include dynamic modeling, model based ANN's, statistical learning, eigen structure based processing and generalization structures. (orig.)

  7. Neural Networks

    International Nuclear Information System (INIS)

    Smith, Patrick I.

    2003-01-01

    Physicists use large detectors to measure particles created in high-energy collisions at particle accelerators. These detectors typically produce signals indicating either where ionization occurs along the path of the particle, or where energy is deposited by the particle. The data produced by these signals is fed into pattern recognition programs to try to identify what particles were produced, and to measure the energy and direction of these particles. Ideally, there are many techniques used in this pattern recognition software. One technique, neural networks, is particularly suitable for identifying what type of particle caused by a set of energy deposits. Neural networks can derive meaning from complicated or imprecise data, extract patterns, and detect trends that are too complex to be noticed by either humans or other computer related processes. To assist in the advancement of this technology, Physicists use a tool kit to experiment with several neural network techniques. The goal of this research is interface a neural network tool kit into Java Analysis Studio (JAS3), an application that allows data to be analyzed from any experiment. As the final result, a physicist will have the ability to train, test, and implement a neural network with the desired output while using JAS3 to analyze the results or output. Before an implementation of a neural network can take place, a firm understanding of what a neural network is and how it works is beneficial. A neural network is an artificial representation of the human brain that tries to simulate the learning process [5]. It is also important to think of the word artificial in that definition as computer programs that use calculations during the learning process. In short, a neural network learns by representative examples. Perhaps the easiest way to describe the way neural networks learn is to explain how the human brain functions. The human brain contains billions of neural cells that are responsible for processing

  8. Evolvable synthetic neural system

    Science.gov (United States)

    Curtis, Steven A. (Inventor)

    2009-01-01

    An evolvable synthetic neural system includes an evolvable neural interface operably coupled to at least one neural basis function. Each neural basis function includes an evolvable neural interface operably coupled to a heuristic neural system to perform high-level functions and an autonomic neural system to perform low-level functions. In some embodiments, the evolvable synthetic neural system is operably coupled to one or more evolvable synthetic neural systems in a hierarchy.

  9. Optimal Brain Surgeon on Artificial Neural Networks in

    DEFF Research Database (Denmark)

    Christiansen, Niels Hørbye; Job, Jonas Hultmann; Klyver, Katrine

    2012-01-01

    It is shown how the procedure know as optimal brain surgeon can be used to trim and optimize artificial neural networks in nonlinear structural dynamics. Beside optimizing the neural network, and thereby minimizing computational cost in simulation, the surgery procedure can also serve as a quick...

  10. Modelling the permeability of polymers: a neural network approach

    NARCIS (Netherlands)

    Wessling, Matthias; Mulder, M.H.V.; Bos, A.; Bos, A.; van der Linden, M.K.T.; Bos, M.; van der Linden, W.E.

    1994-01-01

    In this short communication, the prediction of the permeability of carbon dioxide through different polymers using a neural network is studied. A neural network is a numeric-mathematical construction that can model complex non-linear relationships. Here it is used to correlate the IR spectrum of a

  11. Nonlinear Elasticity

    Science.gov (United States)

    Fu, Y. B.; Ogden, R. W.

    2001-05-01

    This collection of papers by leading researchers in the field of finite, nonlinear elasticity concerns itself with the behavior of objects that deform when external forces or temperature gradients are applied. This process is extremely important in many industrial settings, such as aerospace and rubber industries. This book covers the various aspects of the subject comprehensively with careful explanations of the basic theories and individual chapters each covering a different research direction. The authors discuss the use of symbolic manipulation software as well as computer algorithm issues. The emphasis is placed firmly on covering modern, recent developments, rather than the very theoretical approach often found. The book will be an excellent reference for both beginners and specialists in engineering, applied mathematics and physics.

  12. Nonlinear resonances

    CERN Document Server

    Rajasekar, Shanmuganathan

    2016-01-01

    This introductory text presents the basic aspects and most important features of various types of resonances and anti-resonances in dynamical systems. In particular, for each resonance, it covers the theoretical concepts, illustrates them with case studies, and reviews the available information on mechanisms, characterization, numerical simulations, experimental realizations, possible quantum analogues, applications and significant advances made over the years. Resonances are one of the most fundamental phenomena exhibited by nonlinear systems and refer to specific realizations of maximum response of a system due to the ability of that system to store and transfer energy received from an external forcing source. Resonances are of particular importance in physical, engineering and biological systems - they can prove to be advantageous in many applications, while leading to instability and even disasters in others. The book is self-contained, providing the details of mathematical derivations and techniques invo...

  13. Decentralized neural control application to robotics

    CERN Document Server

    Garcia-Hernandez, Ramon; Sanchez, Edgar N; Alanis, Alma y; Ruz-Hernandez, Jose A

    2017-01-01

    This book provides a decentralized approach for the identification and control of robotics systems. It also presents recent research in decentralized neural control and includes applications to robotics. Decentralized control is free from difficulties due to complexity in design, debugging, data gathering and storage requirements, making it preferable for interconnected systems. Furthermore, as opposed to the centralized approach, it can be implemented with parallel processors. This approach deals with four decentralized control schemes, which are able to identify the robot dynamics. The training of each neural network is performed on-line using an extended Kalman filter (EKF). The first indirect decentralized control scheme applies the discrete-time block control approach, to formulate a nonlinear sliding manifold. The second direct decentralized neural control scheme is based on the backstepping technique, approximated by a high order neural network. The third control scheme applies a decentralized neural i...

  14. Research on Fault Diagnosis Method Based on Rule Base Neural Network

    Directory of Open Access Journals (Sweden)

    Zheng Ni

    2017-01-01

    Full Text Available The relationship between fault phenomenon and fault cause is always nonlinear, which influences the accuracy of fault location. And neural network is effective in dealing with nonlinear problem. In order to improve the efficiency of uncertain fault diagnosis based on neural network, a neural network fault diagnosis method based on rule base is put forward. At first, the structure of BP neural network is built and the learning rule is given. Then, the rule base is built by fuzzy theory. An improved fuzzy neural construction model is designed, in which the calculated methods of node function and membership function are also given. Simulation results confirm the effectiveness of this method.

  15. Linking structure and activity in nonlinear spiking networks.

    Directory of Open Access Journals (Sweden)

    Gabriel Koch Ocker

    2017-06-01

    Full Text Available Recent experimental advances are producing an avalanche of data on both neural connectivity and neural activity. To take full advantage of these two emerging datasets we need a framework that links them, revealing how collective neural activity arises from the structure of neural connectivity and intrinsic neural dynamics. This problem of structure-driven activity has drawn major interest in computational neuroscience. Existing methods for relating activity and architecture in spiking networks rely on linearizing activity around a central operating point and thus fail to capture the nonlinear responses of individual neurons that are the hallmark of neural information processing. Here, we overcome this limitation and present a new relationship between connectivity and activity in networks of nonlinear spiking neurons by developing a diagrammatic fluctuation expansion based on statistical field theory. We explicitly show how recurrent network structure produces pairwise and higher-order correlated activity, and how nonlinearities impact the networks' spiking activity. Our findings open new avenues to investigating how single-neuron nonlinearities-including those of different cell types-combine with connectivity to shape population activity and function.

  16. Linking structure and activity in nonlinear spiking networks.

    Science.gov (United States)

    Ocker, Gabriel Koch; Josić, Krešimir; Shea-Brown, Eric; Buice, Michael A

    2017-06-01

    Recent experimental advances are producing an avalanche of data on both neural connectivity and neural activity. To take full advantage of these two emerging datasets we need a framework that links them, revealing how collective neural activity arises from the structure of neural connectivity and intrinsic neural dynamics. This problem of structure-driven activity has drawn major interest in computational neuroscience. Existing methods for relating activity and architecture in spiking networks rely on linearizing activity around a central operating point and thus fail to capture the nonlinear responses of individual neurons that are the hallmark of neural information processing. Here, we overcome this limitation and present a new relationship between connectivity and activity in networks of nonlinear spiking neurons by developing a diagrammatic fluctuation expansion based on statistical field theory. We explicitly show how recurrent network structure produces pairwise and higher-order correlated activity, and how nonlinearities impact the networks' spiking activity. Our findings open new avenues to investigating how single-neuron nonlinearities-including those of different cell types-combine with connectivity to shape population activity and function.

  17. Neural control of magnetic suspension systems

    Science.gov (United States)

    Gray, W. Steven

    1993-01-01

    The purpose of this research program is to design, build and test (in cooperation with NASA personnel from the NASA Langley Research Center) neural controllers for two different small air-gap magnetic suspension systems. The general objective of the program is to study neural network architectures for the purpose of control in an experimental setting and to demonstrate the feasibility of the concept. The specific objectives of the research program are: (1) to demonstrate through simulation and experimentation the feasibility of using neural controllers to stabilize a nonlinear magnetic suspension system; (2) to investigate through simulation and experimentation the performance of neural controllers designs under various types of parametric and nonparametric uncertainty; (3) to investigate through simulation and experimentation various types of neural architectures for real-time control with respect to performance and complexity; and (4) to benchmark in an experimental setting the performance of neural controllers against other types of existing linear and nonlinear compensator designs. To date, the first one-dimensional, small air-gap magnetic suspension system has been built, tested and delivered to the NASA Langley Research Center. The device is currently being stabilized with a digital linear phase-lead controller. The neural controller hardware is under construction. Two different neural network paradigms are under consideration, one based on hidden layer feedforward networks trained via back propagation and one based on using Gaussian radial basis functions trained by analytical methods related to stability conditions. Some advanced nonlinear control algorithms using feedback linearization and sliding mode control are in simulation studies.

  18. The nonlinear universe chaos, emergence, life

    CERN Document Server

    Scott, A C

    2007-01-01

    Written in Alwyn Scott’s inimitable style – lucid and accessible – The Nonlinear Universe surveys and explores the explosion of activity in nonlinear science that began in the 1970s and 1980s and continues today. The book explains the wide-ranging implications of nonlinear phenomena for future developments in many areas of modern science, including mathematics, physics, engineering, chemistry, biology, and neuroscience. Arguably as important as quantum theory, modern nonlinear science – and an appreciation of its implications – is essential for understanding scientific developments of the twenty-first century.

  19. Behaviour in O of the Neural Networks Training Cost

    DEFF Research Database (Denmark)

    Goutte, Cyril

    1998-01-01

    We study the behaviour in zero of the derivatives of the cost function used when training non-linear neural networks. It is shown that a fair number offirst, second and higher order derivatives vanish in zero, validating the belief that 0 is a peculiar and potentially harmful location. These calc......We study the behaviour in zero of the derivatives of the cost function used when training non-linear neural networks. It is shown that a fair number offirst, second and higher order derivatives vanish in zero, validating the belief that 0 is a peculiar and potentially harmful location....... These calculations arerelated to practical and theoretical aspects of neural networks training....

  20. Visualization of neural networks using saliency maps

    DEFF Research Database (Denmark)

    Mørch, Niels J.S.; Kjems, Ulrik; Hansen, Lars Kai

    1995-01-01

    The saliency map is proposed as a new method for understanding and visualizing the nonlinearities embedded in feedforward neural networks, with emphasis on the ill-posed case, where the dimensionality of the input-field by far exceeds the number of examples. Several levels of approximations...

  1. Neural Chaos and Free Will Problem

    Czech Academy of Sciences Publication Activity Database

    Andrey, Ladislav

    1997-01-01

    Roč. 4, č. 1 (1997), s. 23 ISSN 1355-8250. [The Brain and Self Workshop: Toward a Science of Consciousness. Elsinore, 21.08.1997-24.08.1997] R&D Projects: GA ČR GA201/95/0992 Keywords : free will and agency * attention * emotion * neural networks and connectionism * nonlinear dynamics

  2. Based on BP Neural Network Stock Prediction

    Science.gov (United States)

    Liu, Xiangwei; Ma, Xin

    2012-01-01

    The stock market has a high profit and high risk features, on the stock market analysis and prediction research has been paid attention to by people. Stock price trend is a complex nonlinear function, so the price has certain predictability. This article mainly with improved BP neural network (BPNN) to set up the stock market prediction model, and…

  3. "Geo-statistics methods and neural networks in geophysical applications: A case study"

    Science.gov (United States)

    Rodriguez Sandoval, R.; Urrutia Fucugauchi, J.; Ramirez Cruz, L. C.

    2008-12-01

    The study is focus in the Ebano-Panuco basin of northeastern Mexico, which is being explored for hydrocarbon reservoirs. These reservoirs are in limestones and there is interest in determining porosity and permeability in the carbonate sequences. The porosity maps presented in this study are estimated from application of multiattribute and neural networks techniques, which combine geophysics logs and 3-D seismic data by means of statistical relationships. The multiattribute analysis is a process to predict a volume of any underground petrophysical measurement from well-log and seismic data. The data consist of a series of target logs from wells which tie a 3-D seismic volume. The target logs are neutron porosity logs. From the 3-D seismic volume a series of sample attributes is calculated. The objective of this study is to derive a set of attributes and the target log values. The selected set is determined by a process of forward stepwise regression. The analysis can be linear or nonlinear. In the linear mode the method consists of a series of weights derived by least-square minimization. In the nonlinear mode, a neural network is trained using the select attributes as inputs. In this case we used a probabilistic neural network PNN. The method is applied to a real data set from PEMEX. For better reservoir characterization the porosity distribution was estimated using both techniques. The case shown a continues improvement in the prediction of the porosity from the multiattribute to the neural network analysis. The improvement is in the training and the validation, which are important indicators of the reliability of the results. The neural network showed an improvement in resolution over the multiattribute analysis. The final maps provide more realistic results of the porosity distribution.

  4. Quantitative theory of driven nonlinear brain dynamics.

    Science.gov (United States)

    Roberts, J A; Robinson, P A

    2012-09-01

    Strong periodic stimuli such as bright flashing lights evoke nonlinear responses in the brain and interact nonlinearly with ongoing cortical activity, but the underlying mechanisms for these phenomena are poorly understood at present. The dominant features of these experimentally observed dynamics are reproduced by the dynamics of a quantitative neural field model subject to periodic drive. Model power spectra over a range of drive frequencies show agreement with multiple features of experimental measurements, exhibiting nonlinear effects including entrainment over a range of frequencies around the natural alpha frequency f(α), subharmonic entrainment near 2f(α), and harmonic generation. Further analysis of the driven dynamics as a function of the drive parameters reveals rich nonlinear dynamics that is predicted to be observable in future experiments at high drive amplitude, including period doubling, bistable phase-locking, hysteresis, wave mixing, and chaos indicated by positive Lyapunov exponents. Moreover, photosensitive seizures are predicted for physiologically realistic model parameters yielding bistability between healthy and seizure dynamics. These results demonstrate the applicability of neural field models to the new regime of periodically driven nonlinear dynamics, enabling interpretation of experimental data in terms of specific generating mechanisms and providing new tests of the theory. Copyright © 2012 Elsevier Inc. All rights reserved.

  5. [Nonlinear magnetohydrodynamics

    International Nuclear Information System (INIS)

    1994-01-01

    Resistive MHD equilibrium, even for small resistivity, differs greatly from ideal equilibrium, as do the dynamical consequences of its instabilities. The requirement, imposed by Faraday's law, that time independent magnetic fields imply curl-free electric fields, greatly restricts the electric fields allowed inside a finite-resistivity plasma. If there is no flow and the implications of the Ohm's law are taken into account (and they need not be, for ideal equilibria), the electric field must equal the resistivity times the current density. The vanishing of the divergence of the current density then provides a partial differential equation which, together with boundary conditions, uniquely determines the scalar potential, the electric field, and the current density, for any given resistivity profile. The situation parallels closely that of driven shear flows in hydrodynamics, in that while dissipative steady states are somewhat more complex than ideal ones, there are vastly fewer of them to consider. Seen in this light, the vast majority of ideal MHD equilibria are just irrelevant, incapable of being set up in the first place. The steady state whose stability thresholds and nonlinear behavior needs to be investigated ceases to be an arbitrary ad hoc exercise dependent upon the whim of the investigator, but is determined by boundary conditions and choice of resistivity profile

  6. Dynamics of nonlinear feedback control.

    Science.gov (United States)

    Snippe, H P; van Hateren, J H

    2007-05-01

    Feedback control in neural systems is ubiquitous. Here we study the mathematics of nonlinear feedback control. We compare models in which the input is multiplied by a dynamic gain (multiplicative control) with models in which the input is divided by a dynamic attenuation (divisive control). The gain signal (resp. the attenuation signal) is obtained through a concatenation of an instantaneous nonlinearity and a linear low-pass filter operating on the output of the feedback loop. For input steps, the dynamics of gain and attenuation can be very different, depending on the mathematical form of the nonlinearity and the ordering of the nonlinearity and the filtering in the feedback loop. Further, the dynamics of feedback control can be strongly asymmetrical for increment versus decrement steps of the input. Nevertheless, for each of the models studied, the nonlinearity in the feedback loop can be chosen such that immediately after an input step, the dynamics of feedback control is symmetric with respect to increments versus decrements. Finally, we study the dynamics of the output of the control loops and find conditions under which overshoots and undershoots of the output relative to the steady-state output occur when the models are stimulated with low-pass filtered steps. For small steps at the input, overshoots and undershoots of the output do not occur when the filtering in the control path is faster than the low-pass filtering at the input. For large steps at the input, however, results depend on the model, and for some of the models, multiple overshoots and undershoots can occur even with a fast control path.

  7. Replication of chaos in neural networks, economics and physics

    CERN Document Server

    Akhmet, Marat

    2016-01-01

    This book presents detailed descriptions of chaos for continuous-time systems. It is the first-ever book to consider chaos as an input for differential and hybrid equations. Chaotic sets and chaotic functions are used as inputs for systems with attractors: equilibrium points, cycles and tori. The findings strongly suggest that chaos theory can proceed from the theory of differential equations to a higher level than previously thought. The approach selected is conducive to the in-depth analysis of different types of chaos. The appearance of deterministic chaos in neural networks, economics and mechanical systems is discussed theoretically and supported by simulations. As such, the book offers a valuable resource for mathematicians, physicists, engineers and economists studying nonlinear chaotic dynamics.

  8. Periodic waves in nonlinear metamaterials

    International Nuclear Information System (INIS)

    Liu, Wen-Jun; Xiao, Jing-Hua; Yan, Jie-Yun; Tian, Bo

    2012-01-01

    Periodic waves are presented in this Letter. With symbolic computation, equations for monochromatic waves are studied, and analytic periodic waves are obtained. Factors affecting properties of periodic waves are analyzed. Nonlinear metamaterials, with the continuous distribution of the dielectric permittivity obtained, are different from the ones with the discrete distribution. -- Highlights: ► Equations for the monochromatic waves in transverse magnetic polarization have been studied. ► Analytic periodic waves for the equations have been obtained. ► Periodic waves are theoretically presented and studied in the nonlinear metamaterials.

  9. Finite elements of nonlinear continua

    CERN Document Server

    Oden, John Tinsley

    1972-01-01

    Geared toward undergraduate and graduate students, this text extends applications of the finite element method from linear problems in elastic structures to a broad class of practical, nonlinear problems in continuum mechanics. It treats both theory and applications from a general and unifying point of view.The text reviews the thermomechanical principles of continuous media and the properties of the finite element method, and then brings them together to produce discrete physical models of nonlinear continua. The mathematical properties of these models are analyzed, along with the numerical s

  10. Hybrid Cubature Kalman filtering for identifying nonlinear models from sampled recording: Estimation of neuronal dynamics.

    Science.gov (United States)

    Madi, Mahmoud K; Karameh, Fadi N

    2017-01-01

    Kalman filtering methods have long been regarded as efficient adaptive Bayesian techniques for estimating hidden states in models of linear dynamical systems under Gaussian uncertainty. Recent advents of the Cubature Kalman filter (CKF) have extended this efficient estimation property to nonlinear systems, and also to hybrid nonlinear problems where by the processes are continuous and the observations are discrete (continuous-discrete CD-CKF). Employing CKF techniques, therefore, carries high promise for modeling many biological phenomena where the underlying processes exhibit inherently nonlinear, continuous, and noisy dynamics and the associated measurements are uncertain and time-sampled. This paper investigates the performance of cubature filtering (CKF and CD-CKF) in two flagship problems arising in the field of neuroscience upon relating brain functionality to aggregate neurophysiological recordings: (i) estimation of the firing dynamics and the neural circuit model parameters from electric potentials (EP) observations, and (ii) estimation of the hemodynamic model parameters and the underlying neural drive from BOLD (fMRI) signals. First, in simulated neural circuit models, estimation accuracy was investigated under varying levels of observation noise (SNR), process noise structures, and observation sampling intervals (dt). When compared to the CKF, the CD-CKF consistently exhibited better accuracy for a given SNR, sharp accuracy increase with higher SNR, and persistent error reduction with smaller dt. Remarkably, CD-CKF accuracy shows only a mild deterioration for non-Gaussian process noise, specifically with Poisson noise, a commonly assumed form of background fluctuations in neuronal systems. Second, in simulated hemodynamic models, parametric estimates were consistently improved under CD-CKF. Critically, time-localization of the underlying neural drive, a determinant factor in fMRI-based functional connectivity studies, was significantly more accurate

  11. Hybrid Cubature Kalman filtering for identifying nonlinear models from sampled recording: Estimation of neuronal dynamics

    Science.gov (United States)

    2017-01-01

    Kalman filtering methods have long been regarded as efficient adaptive Bayesian techniques for estimating hidden states in models of linear dynamical systems under Gaussian uncertainty. Recent advents of the Cubature Kalman filter (CKF) have extended this efficient estimation property to nonlinear systems, and also to hybrid nonlinear problems where by the processes are continuous and the observations are discrete (continuous-discrete CD-CKF). Employing CKF techniques, therefore, carries high promise for modeling many biological phenomena where the underlying processes exhibit inherently nonlinear, continuous, and noisy dynamics and the associated measurements are uncertain and time-sampled. This paper investigates the performance of cubature filtering (CKF and CD-CKF) in two flagship problems arising in the field of neuroscience upon relating brain functionality to aggregate neurophysiological recordings: (i) estimation of the firing dynamics and the neural circuit model parameters from electric potentials (EP) observations, and (ii) estimation of the hemodynamic model parameters and the underlying neural drive from BOLD (fMRI) signals. First, in simulated neural circuit models, estimation accuracy was investigated under varying levels of observation noise (SNR), process noise structures, and observation sampling intervals (dt). When compared to the CKF, the CD-CKF consistently exhibited better accuracy for a given SNR, sharp accuracy increase with higher SNR, and persistent error reduction with smaller dt. Remarkably, CD-CKF accuracy shows only a mild deterioration for non-Gaussian process noise, specifically with Poisson noise, a commonly assumed form of background fluctuations in neuronal systems. Second, in simulated hemodynamic models, parametric estimates were consistently improved under CD-CKF. Critically, time-localization of the underlying neural drive, a determinant factor in fMRI-based functional connectivity studies, was significantly more accurate

  12. The nonlinear dynamics of the Oklo natural reactor

    International Nuclear Information System (INIS)

    Bilanovic, Z.; Harms, A.A.

    1985-01-01

    An analysis of the Oklo natural reactor, a self-sustaining and self-regulating critical assembly that existed some 2 billion years ago in Gabon, Africa, is presented. Nonlinear continuous dif ferential and nonlinear discrete iterative formulations are established and selected parameter characterizations identified. Conceivable power oscillations are calculated and discussed. Some implications of nonlinear mappings for nuclear simulation are suggested

  13. Exponential Growth of Nonlinear Ballooning Instability

    International Nuclear Information System (INIS)

    Zhu, P.; Hegna, C. C.; Sovinec, C. R.

    2009-01-01

    Recent ideal magnetohydrodynamic (MHD) theory predicts that a perturbation evolving from a linear ballooning instability will continue to grow exponentially in the intermediate nonlinear phase at the same linear growth rate. This prediction is confirmed in ideal MHD simulations. When the Lagrangian compression, a measure of the ballooning nonlinearity, becomes of the order of unity, the intermediate nonlinear phase is entered, during which the maximum plasma displacement amplitude as well as the total kinetic energy continues to grow exponentially at the rate of the corresponding linear phase.

  14. Nonlinear beam mechanics

    NARCIS (Netherlands)

    Westra, H.J.R.

    2012-01-01

    In this Thesis, nonlinear dynamics and nonlinear interactions are studied from a micromechanical point of view. Single and doubly clamped beams are used as model systems where nonlinearity plays an important role. The nonlinearity also gives rise to rich dynamic behavior with phenomena like

  15. Analysis of neural data

    CERN Document Server

    Kass, Robert E; Brown, Emery N

    2014-01-01

    Continual improvements in data collection and processing have had a huge impact on brain research, producing data sets that are often large and complicated. By emphasizing a few fundamental principles, and a handful of ubiquitous techniques, Analysis of Neural Data provides a unified treatment of analytical methods that have become essential for contemporary researchers. Throughout the book ideas are illustrated with more than 100 examples drawn from the literature, ranging from electrophysiology, to neuroimaging, to behavior. By demonstrating the commonality among various statistical approaches the authors provide the crucial tools for gaining knowledge from diverse types of data. Aimed at experimentalists with only high-school level mathematics, as well as computationally-oriented neuroscientists who have limited familiarity with statistics, Analysis of Neural Data serves as both a self-contained introduction and a reference work.

  16. Thermoelastic steam turbine rotor control based on neural network

    Science.gov (United States)

    Rzadkowski, Romuald; Dominiczak, Krzysztof; Radulski, Wojciech; Szczepanik, R.

    2015-12-01

    Considered here are Nonlinear Auto-Regressive neural networks with eXogenous inputs (NARX) as a mathematical model of a steam turbine rotor for controlling steam turbine stress on-line. In order to obtain neural networks that locate critical stress and temperature points in the steam turbine during transient states, an FE rotor model was built. This model was used to train the neural networks on the basis of steam turbine transient operating data. The training included nonlinearity related to steam turbine expansion, heat exchange and rotor material properties during transients. Simultaneous neural networks are algorithms which can be implemented on PLC controllers. This allows for the application neural networks to control steam turbine stress in industrial power plants.

  17. Neural network modeling for near wall turbulent flow

    International Nuclear Information System (INIS)

    Milano, Michele; Koumoutsakos, Petros

    2002-01-01

    A neural network methodology is developed in order to reconstruct the near wall field in a turbulent flow by exploiting flow fields provided by direct numerical simulations. The results obtained from the neural network methodology are compared with the results obtained from prediction and reconstruction using proper orthogonal decomposition (POD). Using the property that the POD is equivalent to a specific linear neural network, a nonlinear neural network extension is presented. It is shown that for a relatively small additional computational cost nonlinear neural networks provide us with improved reconstruction and prediction capabilities for the near wall velocity fields. Based on these results advantages and drawbacks of both approaches are discussed with an outlook toward the development of near wall models for turbulence modeling and control

  18. Issues in the use of neural networks in information retrieval

    CERN Document Server

    Iatan, Iuliana F

    2017-01-01

    This book highlights the ability of neural networks (NNs) to be excellent pattern matchers and their importance in information retrieval (IR), which is based on index term matching. The book defines a new NN-based method for learning image similarity and describes how to use fuzzy Gaussian neural networks to predict personality. It introduces the fuzzy Clifford Gaussian network, and two concurrent neural models: (1) concurrent fuzzy nonlinear perceptron modules, and (2) concurrent fuzzy Gaussian neural network modules. Furthermore, it explains the design of a new model of fuzzy nonlinear perceptron based on alpha level sets and describes a recurrent fuzzy neural network model with a learning algorithm based on the improved particle swarm optimization method.

  19. Hidden neural networks: application to speech recognition

    DEFF Research Database (Denmark)

    Riis, Søren Kamaric

    1998-01-01

    We evaluate the hidden neural network HMM/NN hybrid on two speech recognition benchmark tasks; (1) task independent isolated word recognition on the Phonebook database, and (2) recognition of broad phoneme classes in continuous speech from the TIMIT database. It is shown how hidden neural networks...

  20. Neural Network Algorithm for Particle Loading

    International Nuclear Information System (INIS)

    Lewandowski, J.L.V.

    2003-01-01

    An artificial neural network algorithm for continuous minimization is developed and applied to the case of numerical particle loading. It is shown that higher-order moments of the probability distribution function can be efficiently renormalized using this technique. A general neural network for the renormalization of an arbitrary number of moments is given

  1. NNSYSID and NNCTRL Tools for system identification and control with neural networks

    DEFF Research Database (Denmark)

    Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad

    2001-01-01

    choose among several designs such as direct inverse control, internal model control, nonlinear feedforward, feedback linearisation, optimal control, gain scheduling based on instantaneous linearisation of neural network models and nonlinear model predictive control. This article gives an overview......Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...... a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can...

  2. NNSYSID and NNCTRL Tools for system identification and control with neural networks

    DEFF Research Database (Denmark)

    Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad

    2001-01-01

    a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can...... choose among several designs such as direct inverse control, internal model control, nonlinear feedforward, feedback linearisation, optimal control, gain scheduling based on instantaneous linearisation of neural network models and nonlinear model predictive control. This article gives an overview......Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...

  3. Workshop on Nonlinear Phenomena in Complex Systems

    CERN Document Server

    1989-01-01

    This book contains a thorough treatment of neural networks, cellular-automata and synergetics, in an attempt to provide three different approaches to nonlinear phenomena in complex systems. These topics are of major interest to physicists active in the fields of statistical mechanics and dynamical systems. They have been developed with a high degree of sophistication and include the refinements necessary to work with the complexity of real systems as well as the more recent research developments in these areas.

  4. Nonlinear behaviour of cantilevered carbon nanotube resonators based on a new nonlinear electrostatic load model

    Science.gov (United States)

    Farokhi, Hamed; Païdoussis, Michael P.; Misra, Arun K.

    2018-04-01

    The present study examines the nonlinear behaviour of a cantilevered carbon nanotube (CNT) resonator and its mass detection sensitivity, employing a new nonlinear electrostatic load model. More specifically, a 3D finite element model is developed in order to obtain the electrostatic load distribution on cantilevered CNT resonators. A new nonlinear electrostatic load model is then proposed accounting for the end effects due to finite length. Additionally, a new nonlinear size-dependent continuum model is developed for the cantilevered CNT resonator, employing the modified couple stress theory (to account for size-effects) together with the Kelvin-Voigt model (to account for nonlinear damping); the size-dependent model takes into account all sources of nonlinearity, i.e. geometrical and inertial nonlinearities as well as nonlinearities associated with damping, small-scale, and electrostatic load. The nonlinear equation of motion of the cantilevered CNT resonator is obtained based on the new models developed for the CNT resonator and the electrostatic load. The Galerkin method is then applied to the nonlinear equation of motion, resulting in a set of nonlinear ordinary differential equations, consisting of geometrical, inertial, electrical, damping, and size-dependent nonlinear terms. This high-dimensional nonlinear discretized model is solved numerically utilizing the pseudo-arclength continuation technique. The nonlinear static and dynamic responses of the system are examined for various cases, investigating the effect of DC and AC voltages, length-scale parameter, nonlinear damping, and electrostatic load. Moreover, the mass detection sensitivity of the system is examined for possible application of the CNT resonator as a nanosensor.

  5. Neural Networks

    Directory of Open Access Journals (Sweden)

    Schwindling Jerome

    2010-04-01

    Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.

  6. An Improved Neural Network Training Algorithm for Wi-Fi Fingerprinting Positioning

    Directory of Open Access Journals (Sweden)

    Esmond Mok

    2013-09-01

    Full Text Available Ubiquitous positioning provides continuous positional information in both indoor and outdoor environments for a wide spectrum of location based service (LBS applications. With the rapid development of the low-cost and high speed data communication, Wi-Fi networks in many metropolitan cities, strength of signals propagated from the Wi-Fi access points (APs namely received signal strength (RSS have been cleverly adopted for indoor positioning. In this paper, a Wi-Fi positioning algorithm based on neural network modeling of Wi-Fi signal patterns is proposed. This algorithm is based on the correlation between the initial parameter setting for neural network training and output of the mean square error to obtain better modeling of the nonlinear highly complex Wi-Fi signal power propagation surface. The test results show that this neural network based data processing algorithm can significantly improve the neural network training surface to achieve the highest possible accuracy of the Wi-Fi fingerprinting positioning method.

  7. Local Dynamics in Trained Recurrent Neural Networks.

    Science.gov (United States)

    Rivkind, Alexander; Barak, Omri

    2017-06-23

    Learning a task induces connectivity changes in neural circuits, thereby changing their dynamics. To elucidate task-related neural dynamics, we study trained recurrent neural networks. We develop a mean field theory for reservoir computing networks trained to have multiple fixed point attractors. Our main result is that the dynamics of the network's output in the vicinity of attractors is governed by a low-order linear ordinary differential equation. The stability of the resulting equation can be assessed, predicting training success or failure. As a consequence, networks of rectified linear units and of sigmoidal nonlinearities are shown to have diametrically different properties when it comes to learning attractors. Furthermore, a characteristic time constant, which remains finite at the edge of chaos, offers an explanation of the network's output robustness in the presence of variability of the internal neural dynamics. Finally, the proposed theory predicts state-dependent frequency selectivity in the network response.

  8. Machine Learning Topological Invariants with Neural Networks

    Science.gov (United States)

    Zhang, Pengfei; Shen, Huitao; Zhai, Hui

    2018-02-01

    In this Letter we supervisedly train neural networks to distinguish different topological phases in the context of topological band insulators. After training with Hamiltonians of one-dimensional insulators with chiral symmetry, the neural network can predict their topological winding numbers with nearly 100% accuracy, even for Hamiltonians with larger winding numbers that are not included in the training data. These results show a remarkable success that the neural network can capture the global and nonlinear topological features of quantum phases from local inputs. By opening up the neural network, we confirm that the network does learn the discrete version of the winding number formula. We also make a couple of remarks regarding the role of the symmetry and the opposite effect of regularization techniques when applying machine learning to physical systems.

  9. Additive Feed Forward Control with Neural Networks

    DEFF Research Database (Denmark)

    Sørensen, O.

    1999-01-01

    This paper demonstrates a method to control a non-linear, multivariable, noisy process using trained neural networks. The basis for the method is a trained neural network controller acting as the inverse process model. A training method for obtaining such an inverse process model is applied....... A suitable 'shaped' (low-pass filtered) reference is used to overcome problems with excessive control action when using a controller acting as the inverse process model. The control concept is Additive Feed Forward Control, where the trained neural network controller, acting as the inverse process model......, is placed in a supplementary pure feed-forward path to an existing feedback controller. This concept benefits from the fact, that an existing, traditional designed, feedback controller can be retained without any modifications, and after training the connection of the neural network feed-forward controller...

  10. Local Dynamics in Trained Recurrent Neural Networks

    Science.gov (United States)

    Rivkind, Alexander; Barak, Omri

    2017-06-01

    Learning a task induces connectivity changes in neural circuits, thereby changing their dynamics. To elucidate task-related neural dynamics, we study trained recurrent neural networks. We develop a mean field theory for reservoir computing networks trained to have multiple fixed point attractors. Our main result is that the dynamics of the network's output in the vicinity of attractors is governed by a low-order linear ordinary differential equation. The stability of the resulting equation can be assessed, predicting training success or failure. As a consequence, networks of rectified linear units and of sigmoidal nonlinearities are shown to have diametrically different properties when it comes to learning attractors. Furthermore, a characteristic time constant, which remains finite at the edge of chaos, offers an explanation of the network's output robustness in the presence of variability of the internal neural dynamics. Finally, the proposed theory predicts state-dependent frequency selectivity in the network response.

  11. NEURAL NETWORKS FOR STOCK MARKET OPTION PRICING

    Directory of Open Access Journals (Sweden)

    Sergey A. Sannikov

    2017-03-01

    Full Text Available Introduction: The use of neural networks for non-linear models helps to understand where linear model drawbacks, coused by their specification, reveal themselves. This paper attempts to find this out. The objective of research is to determine the meaning of “option prices calculation using neural networks”. Materials and Methods: We use two kinds of variables: endogenous (variables included in the model of neural network and variables affecting on the model (permanent disturbance. Results: All data are divided into 3 sets: learning, affirming and testing. All selected variables are normalised from 0 to 1. Extreme values of income were shortcut. Discussion and Conclusions: Using the 33-14-1 neural network with direct links we obtained two sets of forecasts. Optimal criteria of strategies in stock markets’ option pricing were developed.

  12. Nonlinear Modeling of the PEMFC Based On NNARX Approach

    OpenAIRE

    Shan-Jen Cheng; Te-Jen Chang; Kuang-Hsiung Tan; Shou-Ling Kuo

    2015-01-01

    Polymer Electrolyte Membrane Fuel Cell (PEMFC) is such a time-vary nonlinear dynamic system. The traditional linear modeling approach is hard to estimate structure correctly of PEMFC system. From this reason, this paper presents a nonlinear modeling of the PEMFC using Neural Network Auto-regressive model with eXogenous inputs (NNARX) approach. The multilayer perception (MLP) network is applied to evaluate the structure of the NNARX model of PEMFC. The validity and accurac...

  13. Nonlinear PCA: characterizing interactions between modes of brain activity.

    OpenAIRE

    Friston, K; Phillips, J; Chawla, D; Büchel, C

    2000-01-01

    This paper presents a nonlinear principal component analysis (PCA) that identifies underlying sources causing the expression of spatial modes or patterns of activity in neuroimaging time-series. The critical aspect of this technique is that, in relation to conventional PCA, the sources can interact to produce (second-order) spatial modes that represent the modulation of one (first-order) spatial mode by another. This nonlinear PCA uses a simple neural network architecture that embodies a spec...

  14. Intelligent neural network diagnostic system

    International Nuclear Information System (INIS)

    Mohamed, A.H.

    2010-01-01

    Recently, artificial neural network (ANN) has made a significant mark in the domain of diagnostic applications. Neural networks are used to implement complex non-linear mappings (functions) using simple elementary units interrelated through connections with adaptive weights. The performance of the ANN is mainly depending on their topology structure and weights. Some systems have been developed using genetic algorithm (GA) to optimize the topology of the ANN. But, they suffer from some limitations. They are : (1) The computation time requires for training the ANN several time reaching for the average weight required, (2) Slowness of GA for optimization process and (3) Fitness noise appeared in the optimization of ANN. This research suggests new issues to overcome these limitations for finding optimal neural network architectures to learn particular problems. This proposed methodology is used to develop a diagnostic neural network system. It has been applied for a 600 MW turbo-generator as a case of real complex systems. The proposed system has proved its significant performance compared to two common methods used in the diagnostic applications.

  15. Generalized Projective Synchronization between Two Different Neural Networks with Mixed Time Delays

    Directory of Open Access Journals (Sweden)

    Xuefei Wu

    2012-01-01

    Full Text Available The generalized projective synchronization (GPS between two different neural networks with nonlinear coupling and mixed time delays is considered. Several kinds of nonlinear feedback controllers are designed to achieve GPS between two different such neural networks. Some results for GPS of these neural networks are proved theoretically by using the Lyapunov stability theory and the LaSalle invariance principle. Moreover, by comparison, we determine an optimal nonlinear controller from several ones and provide an adaptive update law for it. Computer simulations are provided to show the effectiveness and feasibility of the proposed methods.

  16. Neural robust stabilization via event-triggering mechanism and adaptive learning technique.

    Science.gov (United States)

    Wang, Ding; Liu, Derong

    2018-06-01

    The robust control synthesis of continuous-time nonlinear systems with uncertain term is investigated via event-triggering mechanism and adaptive critic learning technique. We mainly focus on combining the event-triggering mechanism with adaptive critic designs, so as to solve the nonlinear robust control problem. This can not only make better use of computation and communication resources, but also conduct controller design from the view of intelligent optimization. Through theoretical analysis, the nonlinear robust stabilization can be achieved by obtaining an event-triggered optimal control law of the nominal system with a newly defined cost function and a certain triggering condition. The adaptive critic technique is employed to facilitate the event-triggered control design, where a neural network is introduced as an approximator of the learning phase. The performance of the event-triggered robust control scheme is validated via simulation studies and comparisons. The present method extends the application domain of both event-triggered control and adaptive critic control to nonlinear systems possessing dynamical uncertainties. Copyright © 2018 Elsevier Ltd. All rights reserved.

  17. Forecasting with nonlinear time series models

    DEFF Research Database (Denmark)

    Kock, Anders Bredahl; Teräsvirta, Timo

    In this paper, nonlinear models are restricted to mean nonlinear parametric models. Several such models popular in time series econo- metrics are presented and some of their properties discussed. This in- cludes two models based on universal approximators: the Kolmogorov- Gabor polynomial model...... applied to economic fore- casting problems, is briefly highlighted. A number of large published studies comparing macroeconomic forecasts obtained using different time series models are discussed, and the paper also contains a small simulation study comparing recursive and direct forecasts in a partic...... and two versions of a simple artificial neural network model. Techniques for generating multi-period forecasts from nonlinear models recursively are considered, and the direct (non-recursive) method for this purpose is mentioned as well. Forecasting with com- plex dynamic systems, albeit less frequently...

  18. Neural Networks in Control Applications

    DEFF Research Database (Denmark)

    Sørensen, O.

    are examined. The models are separated into three groups representing input/output descriptions as well as state space descriptions: - Models, where all in- and outputs are measurable (static networks). - Models, where some inputs are non-measurable (recurrent networks). - Models, where some in- and some...... outputs are non-measurable (recurrent networks with incomplete state information). The three groups are ordered in increasing complexity, and for each group it is shown how to solve the problems concerning training and application of the specific model type. Of particular interest are the model types...... Kalmann filter) representing state space description. The potentials of neural networks for control of non-linear processes are also examined, focusing on three different groups of control concepts, all considered as generalizations of known linear control concepts to handle also non-linear processes...

  19. Continuous auditing & continuous monitoring : Continuous value?

    NARCIS (Netherlands)

    van Hillo, Rutger; Weigand, Hans; Espana, S; Ralyte, J; Souveyet, C

    2016-01-01

    Advancements in information technology, new laws and regulations and rapidly changing business conditions have led to a need for more timely and ongoing assurance with effectively working controls. Continuous Auditing (CA) and Continuous Monitoring (CM) technologies have made this possible by

  20. Collapse in a forced three-dimensional nonlinear Schrodinger equation

    DEFF Research Database (Denmark)

    Lushnikov, P.M.; Saffman, M.

    2000-01-01

    We derive sufficient conditions for the occurrence of collapse in a forced three-dimensional nonlinear Schrodinger equation without dissipation. Numerical studies continue the results to the case of finite dissipation.......We derive sufficient conditions for the occurrence of collapse in a forced three-dimensional nonlinear Schrodinger equation without dissipation. Numerical studies continue the results to the case of finite dissipation....

  1. Stability of a neural predictive controller scheme on a neural model

    DEFF Research Database (Denmark)

    Luther, Jim Benjamin; Sørensen, Paul Haase

    2009-01-01

    In previous works presenting various forms of neural-network-based predictive controllers, the main emphasis has been on the implementation aspects, i.e. the development of a robust optimization algorithm for the controller, which will be able to perform in real time. However, the stability issue....... The resulting controller is tested on a nonlinear pneumatic servo system.......In previous works presenting various forms of neural-network-based predictive controllers, the main emphasis has been on the implementation aspects, i.e. the development of a robust optimization algorithm for the controller, which will be able to perform in real time. However, the stability issue...... has not been addressed specifically for these controllers. On the other hand a number of results concerning the stability of receding horizon controllers on a nonlinear system exist. In this paper we present a proof of stability for a predictive controller controlling a neural network model...

  2. Seminar “Nonlinear Dynamics”

    OpenAIRE

    Статья Редакционная

    2014-01-01

    The workshop of the Nonlinear Dynamics scientific-educational center continued its work in 2014, focusing on methods of the dynamical system analysis and studies of their behavior. More than 30 talks in the field of scientific-educational center research have been made this year. The talk topics included numerical analysis of traveling waves in the Fisher–KPP equation with delay and simulations of the twophase heat distribution problem using heterogeneous computing architectures. In a number ...

  3. Nonlinear dynamics experiment in the Tevatron

    International Nuclear Information System (INIS)

    Merminga, N.; Edwards, D.; Finley, D.

    1989-01-01

    Results of the continuing analysis of the nonlinear dynamics experiment E778 are presented. Sixteen special sextupoles introduced nonlinearities in the Tevatron. 'Smear,' which is one of the parameters used to quantify the degree of nonlinearity, was extracted from the data and compared with calculation. Injection efficiency in the presence of nonlinearities was studied. Measurements of the dynamic aperture were performed. The final results in one degree of freedom of the smear, the injection efficiency and the dynamic aperture are presented. Particles captured on nonlinear resonance islands were directly observed and measurements were performed. The capture efficiency was extracted from the data and compared with prediction. The influence of tune modulation on the stability of these islands was investigated. Plans for future measurements are discussed. 4 refs., 6 figs

  4. Computational mechanics of nonlinear response of shells

    Energy Technology Data Exchange (ETDEWEB)

    Kraetzig, W.B. (Bochum Univ. (Germany, F.R.). Inst. fuer Statik und Dynamik); Onate, E. (Universidad Politecnica de Cataluna, Barcelona (Spain). Escuela Tecnica Superior de Ingenieros de Caminos) (eds.)

    1990-01-01

    Shell structures and their components are utilized in a wide spectrum of engineering fields reaching from space and aircraft structures, pipes and pressure vessels over liquid storage tanks, off-shore installations, cooling towers and domes, to bodyworks of motor vehicles. Of continuously increasing importance is their nonlinear behavior, in which large deformations and large rotations are involved as well as nonlinear material properties. The book starts with a survey about nonlinear shell theories from the rigorous point of view of continuum mechanics, this starting point being unavoidable for modern computational concepts. There follows a series of papers on nonlinear, especially unstable shell responses, which draw computational connections to well established tools in the field of static and dynamic stability of systems. Several papers are then concerned with new finite element derivations for nonlinear shell problems, and finally a series of authors contribute to specific applications opening a small window of the above mentioned wide spectrum. (orig./HP) With 159 figs.

  5. Computational mechanics of nonlinear response of shells

    International Nuclear Information System (INIS)

    Kraetzig, W.B.; Onate, E.

    1990-01-01

    Shell structures and their components are utilized in a wide spectrum of engineering fields reaching from space and aircraft structures, pipes and pressure vessels over liquid storage tanks, off-shore installations, cooling towers and domes, to bodyworks of motor vehicles. Of continuously increasing importance is their nonlinear behavior, in which large deformations and large rotations are involved as well as nonlinear material properties. The book starts with a survey about nonlinear shell theories from the rigorous point of view of continuum mechanics, this starting point being unavoidable for modern computational concepts. There follows a series of papers on nonlinear, especially unstable shell responses, which draw computational connections to well established tools in the field of static and dynamic stability of systems. Several papers are then concerned with new finite element derivations for nonlinear shell problems, and finally a series of authors contribute to specific applications opening a small window of the above mentioned wide spectrum. (orig./HP) With 159 figs

  6. Solitary waves on nonlinear elastic rods. II

    DEFF Research Database (Denmark)

    Sørensen, Mads Peter; Christiansen, Peter Leth; Lomdahl, P. S.

    1987-01-01

    In continuation of an earlier study of propagation of solitary waves on nonlinear elastic rods, numerical investigations of blowup, reflection, and fission at continuous and discontinuous variation of the cross section for the rod and reflection at the end of the rod are presented. The results ar...... are compared with predictions of conservation theorems for energy and momentum....

  7. On Poisson Nonlinear Transformations

    Directory of Open Access Journals (Sweden)

    Nasir Ganikhodjaev

    2014-01-01

    Full Text Available We construct the family of Poisson nonlinear transformations defined on the countable sample space of nonnegative integers and investigate their trajectory behavior. We have proved that these nonlinear transformations are regular.

  8. Identification of a Typical CSTR Using Optimal Focused Time Lagged Recurrent Neural Network Model with Gamma Memory Filter

    Directory of Open Access Journals (Sweden)

    S. N. Naikwad

    2009-01-01

    Full Text Available A focused time lagged recurrent neural network (FTLR NN with gamma memory filter is designed to learn the subtle complex dynamics of a typical CSTR process. Continuous stirred tank reactor exhibits complex nonlinear operations where reaction is exothermic. It is noticed from literature review that process control of CSTR using neuro-fuzzy systems was attempted by many, but optimal neural network model for identification of CSTR process is not yet available. As CSTR process includes temporal relationship in the input-output mappings, time lagged recurrent neural network is particularly used for identification purpose. The standard back propagation algorithm with momentum term has been proposed in this model. The various parameters like number of processing elements, number of hidden layers, training and testing percentage, learning rule and transfer function in hidden and output layer are investigated on the basis of performance measures like MSE, NMSE, and correlation coefficient on testing data set. Finally effects of different norms are tested along with variation in gamma memory filter. It is demonstrated that dynamic NN model has a remarkable system identification capability for the problems considered in this paper. Thus FTLR NN with gamma memory filter can be used to learn underlying highly nonlinear dynamics of the system, which is a major contribution of this paper.

  9. Higher Order Continuous SI Engine Observers

    DEFF Research Database (Denmark)

    Vesterholm, Thomas; Hendricks, Elbert; Houbak, Niels

    1992-01-01

    A nonlinear compensator for the fuel film dynamics and a second order nonlinear observer for a spark ignition engine are presented in this paper. The compensator and observer are realized as continuous differential equations and an especially designed integration algorithm is used to integrate them...

  10. Antenna analysis using neural networks

    Science.gov (United States)

    Smith, William T.

    1992-01-01

    Conventional computing schemes have long been used to analyze problems in electromagnetics (EM). The vast majority of EM applications require computationally intensive algorithms involving numerical integration and solutions to large systems of equations. The feasibility of using neural network computing algorithms for antenna analysis is investigated. The ultimate goal is to use a trained neural network algorithm to reduce the computational demands of existing reflector surface error compensation techniques. Neural networks are computational algorithms based on neurobiological systems. Neural nets consist of massively parallel interconnected nonlinear computational elements. They are often employed in pattern recognition and image processing problems. Recently, neural network analysis has been applied in the electromagnetics area for the design of frequency selective surfaces and beam forming networks. The backpropagation training algorithm was employed to simulate classical antenna array synthesis techniques. The Woodward-Lawson (W-L) and Dolph-Chebyshev (D-C) array pattern synthesis techniques were used to train the neural network. The inputs to the network were samples of the desired synthesis pattern. The outputs are the array element excitations required to synthesize the desired pattern. Once trained, the network is used to simulate the W-L or D-C techniques. Various sector patterns and cosecant-type patterns (27 total) generated using W-L synthesis were used to train the network. Desired pattern samples were then fed to the neural network. The outputs of the network were the simulated W-L excitations. A 20 element linear array was used. There were 41 input pattern samples with 40 output excitations (20 real parts, 20 imaginary). A comparison between the simulated and actual W-L techniques is shown for a triangular-shaped pattern. Dolph-Chebyshev is a different class of synthesis technique in that D-C is used for side lobe control as opposed to pattern

  11. Nonlinear behavior of the radiative condensation instability

    International Nuclear Information System (INIS)

    McCarthy, D.; Drake, J.F.

    1991-01-01

    An investigation of the nonlinear behavior of the radiative condensation instability is presented in a simple one-dimensional magnetized plasma. It is shown that the radiative condensation is typically a nonlinear instability---the growth of the instability is stronger once the disturbance reaches finite amplitude. Moreover, classical parallel thermal conduction is insufficient by itself to saturate the instability. Radiative collapse continues until the temperature in the high density condensation falls sufficiently to reduce the radiation rate

  12. On Stabilization of Nonautonomous Nonlinear Systems

    International Nuclear Information System (INIS)

    Bogdanov, A. Yu.

    2008-01-01

    The procedures to obtain the sufficient conditions of asymptotic stability for nonlinear nonstationary continuous-time systems are discussed. We consider different types of the following general controlled system: x = X(t,x,u) = F(t,x)+B(t,x)u, x(t 0 ) = x 0 . (*) The basis of investigation is limiting equations, limiting Lyapunov functions, etc. The improved concept of observability of the pair of functional matrices is presented. By these results the problem of synthesis of asymptotically stable control nonlinear nonautonomous systems (with linear parts) involving the quadratic time-dependent Lyapunov functions is solved as well as stabilizing a given unstable system with nonlinear control law.

  13. Advances in nonlinear optics

    CERN Document Server

    Chen, Xianfeng; Zeng, Heping; Guo, Qi; She, Weilong

    2015-01-01

    This book presents an overview of the state of the art of nonlinear optics from weak light nonlinear optics, ultrafast nonlinear optics to electro-optical theory and applications. Topics range from the fundamental studies of the interaction between matter and radiation to the development of devices, components, and systems of tremendous commercial interest for widespread applications in optical telecommunications, medicine, and biotechnology.

  14. Neural networks and applications tutorial

    Science.gov (United States)

    Guyon, I.

    1991-09-01

    The importance of neural networks has grown dramatically during this decade. While only a few years ago they were primarily of academic interest, now dozens of companies and many universities are investigating the potential use of these systems and products are beginning to appear. The idea of building a machine whose architecture is inspired by that of the brain has roots which go far back in history. Nowadays, technological advances of computers and the availability of custom integrated circuits, permit simulations of hundreds or even thousands of neurons. In conjunction, the growing interest in learning machines, non-linear dynamics and parallel computation spurred renewed attention in artificial neural networks. Many tentative applications have been proposed, including decision systems (associative memories, classifiers, data compressors and optimizers), or parametric models for signal processing purposes (system identification, automatic control, noise canceling, etc.). While they do not always outperform standard methods, neural network approaches are already used in some real world applications for pattern recognition and signal processing tasks. The tutorial is divided into six lectures, that where presented at the Third Graduate Summer Course on Computational Physics (September 3-7, 1990) on Parallel Architectures and Applications, organized by the European Physical Society: (1) Introduction: machine learning and biological computation. (2) Adaptive artificial neurons (perceptron, ADALINE, sigmoid units, etc.): learning rules and implementations. (3) Neural network systems: architectures, learning algorithms. (4) Applications: pattern recognition, signal processing, etc. (5) Elements of learning theory: how to build networks which generalize. (6) A case study: a neural network for on-line recognition of handwritten alphanumeric characters.

  15. The influence of cochlear traveling wave and neural adaptation on auditory brainstem responses

    DEFF Research Database (Denmark)

    Junius, D.; Dau, Torsten

    2005-01-01

    of the responses to the single components, as a function of stimulus level. In the first experiment, a single rising chirp was temporally and spectrally embedded in two steady-state tones. In the second experiment, the stimulus consisted of a continuous alternating train of chirps: each rising chirp was followed...... by the temporally reversed (falling) chirp. In both experiments, the transitions between stimulus components were continuous. For stimulation levels up to approximately 70 dB SPL, the responses to the embedded chirp corresponded to the responses to the single chirp. At high stimulus levels (80-100 dB SPL......), disparities occurred between the responses, reflecting a nonlinearity in the processing when neural activity is integrated across frequency. In the third experiment, the effect of within-train rate on wave-V response was investigated. The response to the chirp presented at a within-train rate of 95 Hz...

  16. Halo Mitigation Using Nonlinear Lattices

    CERN Document Server

    Sonnad, Kiran G

    2005-01-01

    This work shows that halos in beams with space charge effects can be controlled by combining nonlinear focusing and collimation. The study relies on Particle-in-Cell (PIC) simulations for a one dimensional, continuous focusing model. The PIC simulation results show that nonlinear focusing leads to damping of the beam oscillations thereby reducing the mismatch. It is well established that reduced mismatch leads to reduced halo formation. However, the nonlinear damping is accompanied by emittance growth causing the beam to spread in phase space. As a result, inducing nonlinear damping alone cannot help mitigate the halo. To compensate for this expansion in phase space, the beam is collimated in the simulation and further evolution of the beam shows that the halo is not regenerated. The focusing model used in the PIC is analysed using the Lie Transform perturbation theory showing that by averaging over a lattice period, one can reuduce the focusing force to a form that is identical to that used in the PIC simula...

  17. Modelling the nonlinearity of piezoelectric actuators in active ...

    African Journals Online (AJOL)

    Piezoelectric actuators have great capabilities as elements of intelligent structures for active vibration cancellation. One problem with this type of actuator is its nonlinear behaviour. In active vibration control systems, it is important to have an accurate model of the control branch. This paper demonstrates the ability of neural ...

  18. Supervised Learning with Complex-valued Neural Networks

    CERN Document Server

    Suresh, Sundaram; Savitha, Ramasamy

    2013-01-01

    Recent advancements in the field of telecommunications, medical imaging and signal processing deal with signals that are inherently time varying, nonlinear and complex-valued. The time varying, nonlinear characteristics of these signals can be effectively analyzed using artificial neural networks.  Furthermore, to efficiently preserve the physical characteristics of these complex-valued signals, it is important to develop complex-valued neural networks and derive their learning algorithms to represent these signals at every step of the learning process. This monograph comprises a collection of new supervised learning algorithms along with novel architectures for complex-valued neural networks. The concepts of meta-cognition equipped with a self-regulated learning have been known to be the best human learning strategy. In this monograph, the principles of meta-cognition have been introduced for complex-valued neural networks in both the batch and sequential learning modes. For applications where the computati...

  19. Quantum Nonlinear Optics

    CERN Document Server

    Hanamura, Eiichi; Yamanaka, Akio

    2007-01-01

    This graduate-level textbook gives an introductory overview of the fundamentals of quantum nonlinear optics. Based on the quantum theory of radiation, Quantum Nonlinear Optics incorporates the exciting developments in novel nonlinear responses of materials (plus laser oscillation and superradiance) developed over the past decade. It deals with the organization of radiation field, interaction between electronic system and radiation field, statistics of light, mutual manipulation of light and matter, laser oscillation, dynamics of light, nonlinear optical response, and nonlinear spectroscopy, as well as ultrashort and ultrastrong laser pulse. Also considered are Q-switching, mode locking and pulse compression. Experimental and theoretical aspects are intertwined throughout.

  20. Nonlinear dynamics and complexity

    CERN Document Server

    Luo, Albert; Fu, Xilin

    2014-01-01

    This important collection presents recent advances in nonlinear dynamics including analytical solutions, chaos in Hamiltonian systems, time-delay, uncertainty, and bio-network dynamics. Nonlinear Dynamics and Complexity equips readers to appreciate this increasingly main-stream approach to understanding complex phenomena in nonlinear systems as they are examined in a broad array of disciplines. The book facilitates a better understanding of the mechanisms and phenomena in nonlinear dynamics and develops the corresponding mathematical theory to apply nonlinear design to practical engineering.

  1. Distributed nonlinear optical response

    DEFF Research Database (Denmark)

    Nikolov, Nikola Ivanov

    2005-01-01

    of bound states of out of phase bright solitons and dark solitons. Also, the newly introduced analogy between the nonlocal cubic nonlinear and the quadratic nonlinear media, presented in paper B and Chapter 3 is discussed. In particular it supplies intuitive physical meaning of the formation of solitons...... in quadratic nonlinear media. In the second part of the report (Chapter 4), the possibility to obtain light with ultrabroad spectrum due to the interplay of many nonlinear effects based on cubic nonlinearity is investigated thoroughly. The contribution of stimulated Raman scattering, a delayed nonlinear...... a modified nonlinear Schroedinger model equation. Chapter 4 and papers D and E are dedicated to this part of the research....

  2. Hybrid digital signal processing and neural networks applications in PWRs

    International Nuclear Information System (INIS)

    Eryurek, E.; Upadhyaya, B.R.; Kavaklioglu, K.

    1991-01-01

    Signal validation and plant subsystem tracking in power and process industries require the prediction of one or more state variables. Both heteroassociative and auotassociative neural networks were applied for characterizing relationships among sets of signals. A multi-layer neural network paradigm was applied for sensor and process monitoring in a Pressurized Water Reactor (PWR). This nonlinear interpolation technique was found to be very effective for these applications

  3. Gear Fault Diagnosis Based on BP Neural Network

    Science.gov (United States)

    Huang, Yongsheng; Huang, Ruoshi

    2018-03-01

    Gear transmission is more complex, widely used in machinery fields, which form of fault has some nonlinear characteristics. This paper uses BP neural network to train the gear of four typical failure modes, and achieves satisfactory results. Tested by using test data, test results have an agreement with the actual results. The results show that the BP neural network can effectively solve the complex state of gear fault in the gear fault diagnosis.

  4. Optimization of material composition of nonhomogeneous plate for thermal stress relaxation making use of neural network. Analysis taking into account the relative heat transfer at boundary surfaces when subjected to unsteady heat supply

    International Nuclear Information System (INIS)

    Ootao, Yoshihiro; Kawamura, Ryuusuke; Tanigawa, Yoshinobu; Imamura, Ryuutarou

    1998-01-01

    In this study, a neural network is applied to optimization problems of material compositions for a nonhomogeneous plate with arbitrarily distributed and continuously varied material properties such as Functionally Graded Material. Unsteady temperature distribution for such nonhomogeneous plate is evaluated by taking into account the bounds of the number of the layers. Furthermore, the thermal stress components for an infinitely long nonhomogeneous plate are formulated under the mechanical condition of being traction free. As a numerical example, the plate composed of zirconium oxide and titanium alloy is considered. And, as the optimization problem of minimizing the thermal stress distribution, the numerical calculations are carried out making use of neural network, and the optimum material composition is determined taking into account the effect of temperature-dependency of material properties. Furthermore, the results obtained by neural network and ordinary nonlinear programming method are compared. (author)

  5. Continuous Problem of Function Continuity

    Science.gov (United States)

    Jayakody, Gaya; Zazkis, Rina

    2015-01-01

    We examine different definitions presented in textbooks and other mathematical sources for "continuity of a function at a point" and "continuous function" in the context of introductory level Calculus. We then identify problematic issues related to definitions of continuity and discontinuity: inconsistency and absence of…

  6. Adaptive Filtering Using Recurrent Neural Networks

    Science.gov (United States)

    Parlos, Alexander G.; Menon, Sunil K.; Atiya, Amir F.

    2005-01-01

    A method for adaptive (or, optionally, nonadaptive) filtering has been developed for estimating the states of complex process systems (e.g., chemical plants, factories, or manufacturing processes at some level of abstraction) from time series of measurements of system inputs and outputs. The method is based partly on the fundamental principles of the Kalman filter and partly on the use of recurrent neural networks. The standard Kalman filter involves an assumption of linearity of the mathematical model used to describe a process system. The extended Kalman filter accommodates a nonlinear process model but still requires linearization about the state estimate. Both the standard and extended Kalman filters involve the often unrealistic assumption that process and measurement noise are zero-mean, Gaussian, and white. In contrast, the present method does not involve any assumptions of linearity of process models or of the nature of process noise; on the contrary, few (if any) assumptions are made about process models, noise models, or the parameters of such models. In this regard, the method can be characterized as one of nonlinear, nonparametric filtering. The method exploits the unique ability of neural networks to approximate nonlinear functions. In a given case, the process model is limited mainly by limitations of the approximation ability of the neural networks chosen for that case. Moreover, despite the lack of assumptions regarding process noise, the method yields minimum- variance filters. In that they do not require statistical models of noise, the neural- network-based state filters of this method are comparable to conventional nonlinear least-squares estimators.

  7. Artificial neural network cardiopulmonary modeling and diagnosis

    Science.gov (United States)

    Kangas, Lars J.; Keller, Paul E.

    1997-01-01

    The present invention is a method of diagnosing a cardiopulmonary condition in an individual by comparing data from a progressive multi-stage test for the individual to a non-linear multi-variate model, preferably a recurrent artificial neural network having sensor fusion. The present invention relies on a cardiovascular model developed from physiological measurements of an individual. Any differences between the modeled parameters and the parameters of an individual at a given time are used for diagnosis.

  8. Neural computation and the computational theory of cognition.

    Science.gov (United States)

    Piccinini, Gualtiero; Bahar, Sonya

    2013-04-01

    We begin by distinguishing computationalism from a number of other theses that are sometimes conflated with it. We also distinguish between several important kinds of computation: computation in a generic sense, digital computation, and analog computation. Then, we defend a weak version of computationalism-neural processes are computations in the generic sense. After that, we reject on empirical grounds the common assimilation of neural computation to either analog or digital computation, concluding that neural computation is sui generis. Analog computation requires continuous signals; digital computation requires strings of digits. But current neuroscientific evidence indicates that typical neural signals, such as spike trains, are graded like continuous signals but are constituted by discrete functional elements (spikes); thus, typical neural signals are neither continuous signals nor strings of digits. It follows that neural computation is sui generis. Finally, we highlight three important consequences of a proper understanding of neural computation for the theory of cognition. First, understanding neural computation requires a specially designed mathematical theory (or theories) rather than the mathematical theories of analog or digital computation. Second, several popular views about neural computation turn out to be incorrect. Third, computational theories of cognition that rely on non-neural notions of computation ought to be replaced or reinterpreted in terms of neural computation. Copyright © 2012 Cognitive Science Society, Inc.

  9. Modular representation of layered neural networks.

    Science.gov (United States)

    Watanabe, Chihiro; Hiramatsu, Kaoru; Kashino, Kunio

    2018-01-01

    Layered neural networks have greatly improved the performance of various applications including image processing, speech recognition, natural language processing, and bioinformatics. However, it is still difficult to discover or interpret knowledge from the inference provided by a layered neural network, since its internal representation has many nonlinear and complex parameters embedded in hierarchical layers. Therefore, it becomes important to establish a new methodology by which layered neural networks can be understood. In this paper, we propose a new method for extracting a global and simplified structure from a layered neural network. Based on network analysis, the proposed method detects communities or clusters of units with similar connection patterns. We show its effectiveness by applying it to three use cases. (1) Network decomposition: it can decompose a trained neural network into multiple small independent networks thus dividing the problem and reducing the computation time. (2) Training assessment: the appropriateness of a trained result with a given hyperparameter or randomly chosen initial parameters can be evaluated by using a modularity index. And (3) data analysis: in practical data it reveals the community structure in the input, hidden, and output layers, which serves as a clue for discovering knowledge from a trained neural network. Copyright © 2017 Elsevier Ltd. All rights reserved.

  10. neural control system

    International Nuclear Information System (INIS)

    Elshazly, A.A.E.

    2002-01-01

    Automatic power stabilization control is the desired objective for any reactor operation , especially, nuclear power plants. A major problem in this area is inevitable gap between a real plant ant the theory of conventional analysis and the synthesis of linear time invariant systems. in particular, the trajectory tracking control of a nonlinear plant is a class of problems in which the classical linear transfer function methods break down because no transfer function can represent the system over the entire operating region . there is a considerable amount of research on the model-inverse approach using feedback linearization technique. however, this method requires a prices plant model to implement the exact linearizing feedback, for nuclear reactor systems, this approach is not an easy task because of the uncertainty in the plant parameters and un-measurable state variables . therefore, artificial neural network (ANN) is used either in self-tuning control or in improving the conventional rule-based exper system.the main objective of this thesis is to suggest an ANN, based self-learning controller structure . this method is capable of on-line reinforcement learning and control for a nuclear reactor with a totally unknown dynamics model. previously, researches are based on back- propagation algorithm . back -propagation (BP), fast back -propagation (FBP), and levenberg-marquardt (LM), algorithms are discussed and compared for reinforcement learning. it is found that, LM algorithm is quite superior

  11. Nonlinearity of colloid systems oxyhydrate systems

    CERN Document Server

    Sucharev, Yuri I

    2008-01-01

    The present monograph is the first systematic study of the non-linear characteristic of gel oxy-hydrate systems involving d- and f- elements. These are the oxyhydrates of rare-earth elements and oxides - hydroxides of d- elements (zirconium, niobium, titanium, etc.) The non-linearity of these gel systems introduces fundamental peculiarities into their structure and, consequently, their properties. The polymer-conformational diversity of energetically congenial gel fragments, which continu-ously transform under the effect of, for instance, system dissipation heat, is central to the au-thor's hy

  12. Control of beam halo-chaos using neural network self-adaptation method

    International Nuclear Information System (INIS)

    Fang Jinqing; Huang Guoxian; Luo Xiaoshu

    2004-11-01

    Taking the advantages of neural network control method for nonlinear complex systems, control of beam halo-chaos in the periodic focusing channels (network) of high intensity accelerators is studied by feed-forward back-propagating neural network self-adaptation method. The envelope radius of high-intensity proton beam is reached to the matching beam radius by suitably selecting the control structure of neural network and the linear feedback coefficient, adjusted the right-coefficient of neural network. The beam halo-chaos is obviously suppressed and shaking size is much largely reduced after the neural network self-adaptation control is applied. (authors)

  13. Using Elman recurrent neural networks with conjugate gradient algorithm in determining the anesthetic the amount of anesthetic medicine to be applied.

    Science.gov (United States)

    Güntürkün, Rüştü

    2010-08-01

    In this study, Elman recurrent neural networks have been defined by using conjugate gradient algorithm in order to determine the depth of anesthesia in the continuation stage of the anesthesia and to estimate the amount of medicine to be applied at that moment. The feed forward neural networks are also used for comparison. The conjugate gradient algorithm is compared with back propagation (BP) for training of the neural Networks. The applied artificial neural network is composed of three layers, namely the input layer, the hidden layer and the output layer. The nonlinear activation function sigmoid (sigmoid function) has been used in the hidden layer and the output layer. EEG data has been recorded with Nihon Kohden 9200 brand 22-channel EEG device. The international 8-channel bipolar 10-20 montage system (8 TB-b system) has been used in assembling the recording electrodes. EEG data have been recorded by being sampled once in every 2 milliseconds. The artificial neural network has been designed so as to have 60 neurons in the input layer, 30 neurons in the hidden layer and 1 neuron in the output layer. The values of the power spectral density (PSD) of 10-second EEG segments which correspond to the 1-50 Hz frequency range; the ratio of the total power of PSD values of the EEG segment at that moment in the same range to the total of PSD values of EEG segment taken prior to the anesthesia.

  14. Drift vortices in continuous media

    International Nuclear Information System (INIS)

    Chernousenko, V.M.; Chernenko, I.V.; Chernyshenko, S.V.

    1989-01-01

    The work is devoted to investigation into the problems of large-scale cortex drift and generation in continuous media based on the solution of notably non-linear differential equations. Using the capability of the modern computer technique it is possible to consider a series of cases with regard to medium viscosity and its inhomogeneity and with regard to three-dimensional vortex nature. Based on the solutions obtained the large-scale steady-state vortex generation processes are considered. The results can be used when studying non-linear phenomena in plasma and processes of substance and energy transfer in non-equilibrium media. 16 refs.; 5 figs

  15. Nonlinear Dirac Equations

    Directory of Open Access Journals (Sweden)

    Wei Khim Ng

    2009-02-01

    Full Text Available We construct nonlinear extensions of Dirac's relativistic electron equation that preserve its other desirable properties such as locality, separability, conservation of probability and Poincaré invariance. We determine the constraints that the nonlinear term must obey and classify the resultant non-polynomial nonlinearities in a double expansion in the degree of nonlinearity and number of derivatives. We give explicit examples of such nonlinear equations, studying their discrete symmetries and other properties. Motivated by some previously suggested applications we then consider nonlinear terms that simultaneously violate Lorentz covariance and again study various explicit examples. We contrast our equations and construction procedure with others in the literature and also show that our equations are not gauge equivalent to the linear Dirac equation. Finally we outline various physical applications for these equations.

  16. Nonlinear graphene plasmonics

    Science.gov (United States)

    Ooi, Kelvin J. A.; Tan, Dawn T. H.

    2017-10-01

    The rapid development of graphene has opened up exciting new fields in graphene plasmonics and nonlinear optics. Graphene's unique two-dimensional band structure provides extraordinary linear and nonlinear optical properties, which have led to extreme optical confinement in graphene plasmonics and ultrahigh nonlinear optical coefficients, respectively. The synergy between graphene's linear and nonlinear optical properties gave rise to nonlinear graphene plasmonics, which greatly augments graphene-based nonlinear device performance beyond a billion-fold. This nascent field of research will eventually find far-reaching revolutionary technological applications that require device miniaturization, low power consumption and a broad range of operating wavelengths approaching the far-infrared, such as optical computing, medical instrumentation and security applications.

  17. Stationary nonlinear Airy beams

    International Nuclear Information System (INIS)

    Lotti, A.; Faccio, D.; Couairon, A.; Papazoglou, D. G.; Panagiotopoulos, P.; Tzortzakis, S.; Abdollahpour, D.

    2011-01-01

    We demonstrate the existence of an additional class of stationary accelerating Airy wave forms that exist in the presence of third-order (Kerr) nonlinearity and nonlinear losses. Numerical simulations and experiments, in agreement with the analytical model, highlight how these stationary solutions sustain the nonlinear evolution of Airy beams. The generic nature of the Airy solution allows extension of these results to other settings, and a variety of applications are suggested.

  18. Generalized Nonlinear Yule Models

    OpenAIRE

    Lansky, Petr; Polito, Federico; Sacerdote, Laura

    2016-01-01

    With the aim of considering models with persistent memory we propose a fractional nonlinear modification of the classical Yule model often studied in the context of macrovolution. Here the model is analyzed and interpreted in the framework of the development of networks such as the World Wide Web. Nonlinearity is introduced by replacing the linear birth process governing the growth of the in-links of each specific webpage with a fractional nonlinear birth process with completely general birth...

  19. Chaos Control and Synchronization of Cellular Neural Network with Delays Based on OPNCL Control

    International Nuclear Information System (INIS)

    Qian, Tang; Xing-Yuan, Wang

    2010-01-01

    The problem of chaos control and complete synchronization of cellular neural network with delays is studied. Based on the open plus nonlinear closed loop (OPNCL) method, the control scheme and synchronization scheme are designed. Both the schemes can achieve the chaos control and complete synchronization of chaotic neural network respectively, and their validity is further verified by numerical simulation experiments. (general)

  20. Daily rainfall-runoff modelling by neural networks in semi-arid zone ...

    African Journals Online (AJOL)

    This research work will allow checking efficiency of formal neural networks for flows' modelling of wadi Ouahrane's basin from rainfall-runoff relation which is non-linear. Two models of neural networks were optimized through supervised learning and compared in order to achieve this goal, the first model with input rain, and ...

  1. Forecasting macroeconomic variables using neural network models and three automated model selection techniques

    DEFF Research Database (Denmark)

    Kock, Anders Bredahl; Teräsvirta, Timo

    2016-01-01

    When forecasting with neural network models one faces several problems, all of which influence the accuracy of the forecasts. First, neural networks are often hard to estimate due to their highly nonlinear structure. To alleviate the problem, White (2006) presented a solution (QuickNet) that conv...

  2. Nonlinear evolution equations

    CERN Document Server

    Uraltseva, N N

    1995-01-01

    This collection focuses on nonlinear problems in partial differential equations. Most of the papers are based on lectures presented at the seminar on partial differential equations and mathematical physics at St. Petersburg University. Among the topics explored are the existence and properties of solutions of various classes of nonlinear evolution equations, nonlinear imbedding theorems, bifurcations of solutions, and equations of mathematical physics (Navier-Stokes type equations and the nonlinear Schrödinger equation). The book will be useful to researchers and graduate students working in p

  3. Nonlinear Physics of Plasmas

    CERN Document Server

    Kono, Mitsuo

    2010-01-01

    A nonlinearity is one of the most important notions in modern physics. A plasma is rich in nonlinearities and provides a variety of behaviors inherent to instabilities, coherent wave structures and turbulence. The book covers the basic concepts and mathematical methods, necessary to comprehend nonlinear problems widely encountered in contemporary plasmas, but also in other fields of physics and current research on self-organized structures and magnetized plasma turbulence. The analyses make use of strongly nonlinear models solved by analytical techniques backed by extensive simulations and available experiments. The text is written for senior undergraduates, graduate students, lecturers and researchers in laboratory, space and fusion plasmas.

  4. Nonlinear optics at interfaces

    International Nuclear Information System (INIS)

    Chen, C.K.

    1980-12-01

    Two aspects of surface nonlinear optics are explored in this thesis. The first part is a theoretical and experimental study of nonlinear intraction of surface plasmons and bulk photons at metal-dielectric interfaces. The second part is a demonstration and study of surface enhanced second harmonic generation at rough metal surfaces. A general formulation for nonlinear interaction of surface plasmons at metal-dielectric interfaces is presented and applied to both second and third order nonlinear processes. Experimental results for coherent second and third harmonic generation by surface plasmons and surface coherent antiStokes Raman spectroscopy (CARS) are shown to be in good agreement with the theory

  5. Nonlinear drift tearing mode

    International Nuclear Information System (INIS)

    Zelenyj, L.M.; Kuznetsova, M.M.

    1989-01-01

    Nonlinear study of magnetic perturbation development under single-mode conditions in collision-free plasma in configurations with the magnetic field shear is investigated. Results are obtained with regard of transverse component of electrical field and its effect on ion dynamics within wide range of ion Larmor radius value and values of magnetic field shear. Increments of nonlinear drift tearing mode are obtained and it is shown that excitation drastic conditions of even linearly stable modes are possible. Mechanism of instability nonlinear stabilization is considered and the value of magnetic island at the saturation threshold is estimeted. Energy of nonlinear drift tearing mode is discussed

  6. Nonlinear functional analysis

    CERN Document Server

    Deimling, Klaus

    1985-01-01

    topics. However, only a modest preliminary knowledge is needed. In the first chapter, where we introduce an important topological concept, the so-called topological degree for continuous maps from subsets ofRn into Rn, you need not know anything about functional analysis. Starting with Chapter 2, where infinite dimensions first appear, one should be familiar with the essential step of consider­ ing a sequence or a function of some sort as a point in the corresponding vector space of all such sequences or functions, whenever this abstraction is worthwhile. One should also work out the things which are proved in § 7 and accept certain basic principles of linear functional analysis quoted there for easier references, until they are applied in later chapters. In other words, even the 'completely linear' sections which we have included for your convenience serve only as a vehicle for progress in nonlinearity. Another point that makes the text introductory is the use of an essentially uniform mathematical languag...

  7. Deep Gate Recurrent Neural Network

    Science.gov (United States)

    2016-11-22

    and Fred Cummins. Learning to forget: Continual prediction with lstm . Neural computation, 12(10):2451–2471, 2000. Alex Graves. Generating sequences...DSGU) and Simple Gated Unit (SGU), which are structures for learning long-term dependencies. Compared to traditional Long Short-Term Memory ( LSTM ) and...Gated Recurrent Unit (GRU), both structures require fewer parameters and less computation time in sequence classification tasks. Unlike GRU and LSTM

  8. Computational intelligence synergies of fuzzy logic, neural networks and evolutionary computing

    CERN Document Server

    Siddique, Nazmul

    2013-01-01

    Computational Intelligence: Synergies of Fuzzy Logic, Neural Networks and Evolutionary Computing presents an introduction to some of the cutting edge technological paradigms under the umbrella of computational intelligence. Computational intelligence schemes are investigated with the development of a suitable framework for fuzzy logic, neural networks and evolutionary computing, neuro-fuzzy systems, evolutionary-fuzzy systems and evolutionary neural systems. Applications to linear and non-linear systems are discussed with examples. Key features: Covers all the aspect

  9. Polarization Nonlinear Optics of Quadratically Nonlinear Azopolymers

    International Nuclear Information System (INIS)

    Konorov, S.O.; Akimov, D.A.; Ivanov, A.A.; Petrov, A.N.; Alfimov, M.V.; Yakimanskii, A.V.; Smirnov, N.N.; Ivanova, V.N.; Kudryavtsev, V.V.; Podshivalov, A.A.; Sokolova, I.M.; Zheltikov, A.M.

    2005-01-01

    The polarization properties of second harmonic and sum-frequency signals generated by femtosecond laser pulses in films of polymers containing covalent groups of an azobenzothiazole chromophore polarized by an external electric field are investigated. It is shown that the methods of polarization nonlinear optics make it possible to determine the structure of oriented molecular dipoles and reveal important properties of the motion of collectivized πelectrons in organic molecules with strong optical nonlinearities. The polarization measurements show that the tensor of quadratic nonlinear optical susceptibility of chromophore fragments oriented by an external field in macromolecules of the noted azopolymers has a degenerate form. This is indicative of a predominantly one-dimensional character of motion of collectivized π electrons along an extended group of atoms in such molecules

  10. Business continuity

    International Nuclear Information System (INIS)

    Breunhoelder, Gert

    2002-01-01

    This presentation deals with the following keypoints: Information Technology (IT) Business Continuity and Recovery essential for any business; lessons learned after Sept. 11 event; Detailed planning, redundancy and testing being the key elements for probability estimation of disasters

  11. Chaos, patterns, coherent structures, and turbulence: Reflections on nonlinear science.

    Science.gov (United States)

    Ecke, Robert E

    2015-09-01

    The paradigms of nonlinear science were succinctly articulated over 25 years ago as deterministic chaos, pattern formation, coherent structures, and adaptation/evolution/learning. For chaos, the main unifying concept was universal routes to chaos in general nonlinear dynamical systems, built upon a framework of bifurcation theory. Pattern formation focused on spatially extended nonlinear systems, taking advantage of symmetry properties to develop highly quantitative amplitude equations of the Ginzburg-Landau type to describe early nonlinear phenomena in the vicinity of critical points. Solitons, mathematically precise localized nonlinear wave states, were generalized to a larger and less precise class of coherent structures such as, for example, concentrated regions of vorticity from laboratory wake flows to the Jovian Great Red Spot. The combination of these three ideas was hoped to provide the tools and concepts for the understanding and characterization of the strongly nonlinear problem of fluid turbulence. Although this early promise has been largely unfulfilled, steady progress has been made using the approaches of nonlinear science. I provide a series of examples of bifurcations and chaos, of one-dimensional and two-dimensional pattern formation, and of turbulence to illustrate both the progress and limitations of the nonlinear science approach. As experimental and computational methods continue to improve, the promise of nonlinear science to elucidate fluid turbulence continues to advance in a steady manner, indicative of the grand challenge nature of strongly nonlinear multi-scale dynamical systems.

  12. Continuous tokamaks

    International Nuclear Information System (INIS)

    Peng, Y.K.M.

    1978-04-01

    A tokamak configuration is proposed that permits the rapid replacement of a plasma discharge in a ''burn'' chamber by another one in a time scale much shorter than the elementary thermal time constant of the chamber first wall. With respect to the chamber, the effective duty cycle factor can thus be made arbitrarily close to unity minimizing the cyclic thermal stress in the first wall. At least one plasma discharge always exists in the new tokamak configuration, hence, a continuous tokamak. By incorporating adiabatic toroidal compression, configurations of continuous tokamak compressors are introduced. To operate continuous tokamaks, it is necessary to introduce the concept of mixed poloidal field coils, which spatially groups all the poloidal field coils into three sets, all contributing simultaneously to inducing the plasma current and maintaining the proper plasma shape and position. Preliminary numerical calculations of axisymmetric MHD equilibria in continuous tokamaks indicate the feasibility of their continued plasma operation. Advanced concepts of continuous tokamaks to reduce the topological complexity and to allow the burn plasma aspect ratio to decrease for increased beta are then suggested

  13. Assessing artificial neural networks and statistical methods for infilling missing soil moisture records

    Science.gov (United States)

    Dumedah, Gift; Walker, Jeffrey P.; Chik, Li

    2014-07-01

    Soil moisture information is critically important for water management operations including flood forecasting, drought monitoring, and groundwater recharge estimation. While an accurate and continuous record of soil moisture is required for these applications, the available soil moisture data, in practice, is typically fraught with missing values. There are a wide range of methods available to infilling hydrologic variables, but a thorough inter-comparison between statistical methods and artificial neural networks has not been made. This study examines 5 statistical methods including monthly averages, weighted Pearson correlation coefficient, a method based on temporal stability of soil moisture, and a weighted merging of the three methods, together with a method based on the concept of rough sets. Additionally, 9 artificial neural networks are examined, broadly categorized into feedforward, dynamic, and radial basis networks. These 14 infilling methods were used to estimate missing soil moisture records and subsequently validated against known values for 13 soil moisture monitoring stations for three different soil layer depths in the Yanco region in southeast Australia. The evaluation results show that the top three highest performing methods are the nonlinear autoregressive neural network, rough sets method, and monthly replacement. A high estimation accuracy (root mean square error (RMSE) of about 0.03 m/m) was found in the nonlinear autoregressive network, due to its regression based dynamic network which allows feedback connections through discrete-time estimation. An equally high accuracy (0.05 m/m RMSE) in the rough sets procedure illustrates the important role of temporal persistence of soil moisture, with the capability to account for different soil moisture conditions.

  14. Nonlinear classical theory of electromagnetism

    International Nuclear Information System (INIS)

    Pisello, D.

    1977-01-01

    A topological theory of electric charge is given. Einstein's criteria for the completion of classical electromagnetic theory are summarized and their relation to quantum theory and the principle of complementarity is indicated. The inhibiting effect that this principle has had on the development of physical thought is discussed. Developments in the theory of functions on nonlinear spaces provide the conceptual framework required for the completion of electromagnetism. The theory is based on an underlying field which is a continuous mapping of space-time into points on the two-sphere. (author)

  15. Modeling and control of magnetorheological fluid dampers using neural networks

    Science.gov (United States)

    Wang, D. H.; Liao, W. H.

    2005-02-01

    Due to the inherent nonlinear nature of magnetorheological (MR) fluid dampers, one of the challenging aspects for utilizing these devices to achieve high system performance is the development of accurate models and control algorithms that can take advantage of their unique characteristics. In this paper, the direct identification and inverse dynamic modeling for MR fluid dampers using feedforward and recurrent neural networks are studied. The trained direct identification neural network model can be used to predict the damping force of the MR fluid damper on line, on the basis of the dynamic responses across the MR fluid damper and the command voltage, and the inverse dynamic neural network model can be used to generate the command voltage according to the desired damping force through supervised learning. The architectures and the learning methods of the dynamic neural network models and inverse neural network models for MR fluid dampers are presented, and some simulation results are discussed. Finally, the trained neural network models are applied to predict and control the damping force of the MR fluid damper. Moreover, validation methods for the neural network models developed are proposed and used to evaluate their performance. Validation results with different data sets indicate that the proposed direct identification dynamic model using the recurrent neural network can be used to predict the damping force accurately and the inverse identification dynamic model using the recurrent neural network can act as a damper controller to generate the command voltage when the MR fluid damper is used in a semi-active mode.

  16. Focus issue introduction: nonlinear photonics.

    Science.gov (United States)

    Akhmediev, Nail; Rottwitt, Karsten

    2012-11-19

    It is now 23 years since the first Topical Meeting "Nonlinear Guided Wave Phenomena" (Houston, TX, February 2-4, 1989) has been organised by George Stegeman and Allan Boardman with support of the Optical Society of America. These series of the OSA conferences known as NLGW, continued under the name "Nonlinear Photonics" starting from 2007. The latest one, in Colorado Springs in June 17-21, 2012 has been a great success despite the fierce fires advancing around the city at the time of the conference. This Focus issue is a collection of several papers presented at the conference with extended content submitted to Optics Express. Although this collection is small in comparison to the total number of papers presented at the conference, it gives a flavor of the topics considered at the meeting. It is also worthy to mention here that the next meeting "Nonlinear Photonics" is planned to be held in Barcelona - one of the main European centers on this subject.

  17. Nonlinear dynamics in Nuclotron

    International Nuclear Information System (INIS)

    Dinev, D.

    1997-01-01

    The paper represents an extensive study of the nonlinear beam dynamics in the Nuclotron. Chromatic effects, including the dependence of the betatron tunes on the amplitude, and chromatic perturbations have been investigated taking into account the measured field imperfections. Beam distortion, smear, dynamic aperture and nonlinear acceptance have been calculated for different particle energies and betatron tunes

  18. Nonlinear Optics and Applications

    Science.gov (United States)

    Abdeldayem, Hossin A. (Editor); Frazier, Donald O. (Editor)

    2007-01-01

    Nonlinear optics is the result of laser beam interaction with materials and started with the advent of lasers in the early 1960s. The field is growing daily and plays a major role in emerging photonic technology. Nonlinear optics play a major role in many of the optical applications such as optical signal processing, optical computers, ultrafast switches, ultra-short pulsed lasers, sensors, laser amplifiers, and many others. This special review volume on Nonlinear Optics and Applications is intended for those who want to be aware of the most recent technology. This book presents a survey of the recent advances of nonlinear optical applications. Emphasis will be on novel devices and materials, switching technology, optical computing, and important experimental results. Recent developments in topics which are of historical interest to researchers, and in the same time of potential use in the fields of all-optical communication and computing technologies, are also included. Additionally, a few new related topics which might provoke discussion are presented. The book includes chapters on nonlinear optics and applications; the nonlinear Schrodinger and associated equations that model spatio-temporal propagation; the supercontinuum light source; wideband ultrashort pulse fiber laser sources; lattice fabrication as well as their linear and nonlinear light guiding properties; the second-order EO effect (Pockels), the third-order (Kerr) and thermo-optical effects in optical waveguides and their applications in optical communication; and, the effect of magnetic field and its role in nonlinear optics, among other chapters.

  19. Nonlinearities and synchronization in musical acoustics and music psychology

    CERN Document Server

    Bader, Rolf

    2013-01-01

    Nonlinearities are a crucial and founding principle in nearly all musical systems, may they be musical instruments, timbre or rhythm perception and production, or neural networks of music perception. This volume gives an overview about present and past research in these fields. In Musical Acoustics, on the one hand the nonlinearities in musical instruments often produce the musically interesting features. On the other, musical instruments are nonlinear by nature, and tone production is the result of synchronization and self-organization within the instruments. Furthermore, as nearly all musical instruments are driven by impulses an Impulse Pattern Formulation (IPF) is suggested, an iterative framework holding for all musical instruments. It appears that this framework is able to reproduce the complex and perceptionally most salient initial transients of musical instruments. In Music Psychology, nonlinearities are present in all areas of musical features, like pitch, timbre, or rhythm perception. In terms of r...

  20. Nonlinear optical systems

    CERN Document Server

    Lugiato, Luigi; Brambilla, Massimo

    2015-01-01

    Guiding graduate students and researchers through the complex world of laser physics and nonlinear optics, this book provides an in-depth exploration of the dynamics of lasers and other relevant optical systems, under the umbrella of a unitary spatio-temporal vision. Adopting a balanced approach, the book covers traditional as well as special topics in laser physics, quantum electronics and nonlinear optics, treating them from the viewpoint of nonlinear dynamical systems. These include laser emission, frequency generation, solitons, optically bistable systems, pulsations and chaos and optical pattern formation. It also provides a coherent and up-to-date treatment of the hierarchy of nonlinear optical models and of the rich variety of phenomena they describe, helping readers to understand the limits of validity of each model and the connections among the phenomena. It is ideal for graduate students and researchers in nonlinear optics, quantum electronics, laser physics and photonics.

  1. An Application to the Prediction of LOD Change Based on General Regression Neural Network

    Science.gov (United States)

    Zhang, X. H.; Wang, Q. J.; Zhu, J. J.; Zhang, H.

    2011-07-01

    Traditional prediction of the LOD (length of day) change was based on linear models, such as the least square model and the autoregressive technique, etc. Due to the complex non-linear features of the LOD variation, the performances of the linear model predictors are not fully satisfactory. This paper applies a non-linear neural network - general regression neural network (GRNN) model to forecast the LOD change, and the results are analyzed and compared with those obtained with the back propagation neural network and other models. The comparison shows that the performance of the GRNN model in the prediction of the LOD change is efficient and feasible.

  2. A hyperstable neural network for the modelling and control of ...

    Indian Academy of Sciences (India)

    Computer control; neural networks; nonlinear systems; adaptive ... considered in their design and so they are not applicable for many actual real-world .... particularly in the presence of unmodelled dynamics such as time delays. .... showing the algorithm operating successfully on such a (non-favoured) system, is a respec-.

  3. Artificial Neural Network Based State Estimators Integrated into Kalmtool

    DEFF Research Database (Denmark)

    Bayramoglu, Enis; Ravn, Ole; Poulsen, Niels Kjølstad

    2012-01-01

    In this paper we present a toolbox enabling easy evaluation and comparison of dierent ltering algorithms. The toolbox is called Kalmtool and is a set of MATLAB tools for state estimation of nonlinear systems. The toolbox now contains functions for Articial Neural Network Based State Estimation as...

  4. Application of neural networks in coastal engineering - An overview

    Digital Repository Service at National Institute of Oceanography (India)

    Mandal, S.; Patil, S.G.; Manjunatha, Y.R.; Hegde, A.V.

    Artificial Neural Network (ANN) is being applied to solve a wide variety of coastal/ocean engineering problems. In practical terms ANNs are non-linear modeling tools and they can be used to model complex relationship between the input and output...

  5. Detecting danger labels with RAM-based neural networks

    DEFF Research Database (Denmark)

    Jørgensen, T.M.; Christensen, S.S.; Andersen, A.W.

    1996-01-01

    An image processing system for the automatic location of danger labels on the back of containers is presented. The system uses RAM-based neural networks to locate and classify labels after a pre-processing step involving specially designed non-linear edge filters and RGB-to-HSV conversion. Result...

  6. Empirical modeling of nuclear power plants using neural networks

    International Nuclear Information System (INIS)

    Parlos, A.G.; Atiya, A.; Chong, K.T.

    1991-01-01

    A summary of a procedure for nonlinear identification of process dynamics encountered in nuclear power plant components is presented in this paper using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the nonlinear structure for system identification. In the overall identification process, the feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of time-dependent system nonlinearities. The standard backpropagation learning algorithm is modified and is used to train the proposed hybrid network in a supervised manner. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The nonlinear response of a representative steam generator is predicted using a neural network and is compared to the response obtained from a sophisticated physical model during both high- and low-power operation. The transient responses compare well, though further research is warranted for training and testing of recurrent neural networks during more severe operational transients and accident scenarios

  7. Sturm-Liouville BVPs with Caratheodory nonlinearities

    Directory of Open Access Journals (Sweden)

    Abdelhamid Benmezai

    2016-11-01

    Full Text Available In this article we study the existence and multiplicity of solutions for several classes of Sturm-Liouville boundary value problems having Caratheodory nonlinearities. Many results existing in the literature for such boundary value problems in the continuous framework will find in this work their extensions to the Caratheodory setting.

  8. Kernel Temporal Differences for Neural Decoding

    Science.gov (United States)

    Bae, Jihye; Sanchez Giraldo, Luis G.; Pohlmeyer, Eric A.; Francis, Joseph T.; Sanchez, Justin C.; Príncipe, José C.

    2015-01-01

    We study the feasibility and capability of the kernel temporal difference (KTD)(λ) algorithm for neural decoding. KTD(λ) is an online, kernel-based learning algorithm, which has been introduced to estimate value functions in reinforcement learning. This algorithm combines kernel-based representations with the temporal difference approach to learning. One of our key observations is that by using strictly positive definite kernels, algorithm's convergence can be guaranteed for policy evaluation. The algorithm's nonlinear functional approximation capabilities are shown in both simulations of policy evaluation and neural decoding problems (policy improvement). KTD can handle high-dimensional neural states containing spatial-temporal information at a reasonable computational complexity allowing real-time applications. When the algorithm seeks a proper mapping between a monkey's neural states and desired positions of a computer cursor or a robot arm, in both open-loop and closed-loop experiments, it can effectively learn the neural state to action mapping. Finally, a visualization of the coadaptation process between the decoder and the subject shows the algorithm's capabilities in reinforcement learning brain machine interfaces. PMID:25866504

  9. Continuity theory

    CERN Document Server

    Nel, Louis

    2016-01-01

    This book presents a detailed, self-contained theory of continuous mappings. It is mainly addressed to students who have already studied these mappings in the setting of metric spaces, as well as multidimensional differential calculus. The needed background facts about sets, metric spaces and linear algebra are developed in detail, so as to provide a seamless transition between students' previous studies and new material. In view of its many novel features, this book will be of interest also to mature readers who have studied continuous mappings from the subject's classical texts and wish to become acquainted with a new approach. The theory of continuous mappings serves as infrastructure for more specialized mathematical theories like differential equations, integral equations, operator theory, dynamical systems, global analysis, topological groups, topological rings and many more. In light of the centrality of the topic, a book of this kind fits a variety of applications, especially those that contribute to ...

  10. Neural Tube Defects

    Science.gov (United States)

    Neural tube defects are birth defects of the brain, spine, or spinal cord. They happen in the ... that she is pregnant. The two most common neural tube defects are spina bifida and anencephaly. In ...

  11. Using function approximation to determine neural network accuracy

    International Nuclear Information System (INIS)

    Wichman, R.F.; Alexander, J.

    2013-01-01

    Many, if not most, control processes demonstrate nonlinear behavior in some portion of their operating range and the ability of neural networks to model non-linear dynamics makes them very appealing for control. Control of high reliability safety systems, and autonomous control in process or robotic applications, however, require accurate and consistent control and neural networks are only approximators of various functions so their degree of approximation becomes important. In this paper, the factors affecting the ability of a feed-forward back-propagation neural network to accurately approximate a non-linear function are explored. Compared to pattern recognition using a neural network for function approximation provides an easy and accurate method for determining the network's accuracy. In contrast to other techniques, we show that errors arising in function approximation or curve fitting are caused by the neural network itself rather than scatter in the data. A method is proposed that provides improvements in the accuracy achieved during training and resulting ability of the network to generalize after training. Binary input vectors provided a more accurate model than with scalar inputs and retraining using a small number of the outlier x,y pairs improved generalization. (author)

  12. Saturation and stability of nonlinear photonic crystals

    International Nuclear Information System (INIS)

    Franco-Ortiz, M; Corella-Madueño, A; Rosas-Burgos, R A; Adrian Reyes, J; Avendaño, Carlos G

    2017-01-01

    We consider a one-dimensional photonic crystal made by an infinite set of nonlinear nematic films immersed in a linear dielectric medium. The thickness of each equidistant film is negligible and its refraction index depends continuously on the electric field intensity, giving rise to all the involved nonlinear terms, which joints from a starting linear index for negligible amplitudes to a final saturation index for extremely large field intensities. We show that the nonlinear exact solutions of this system form an intensity-dependent band structure which we calculate and analyze. Next, we ponder a finite version of this system; that is, we take a finite array of linear dielectric stacks of the same size separated by the same nonlinear extremely thin nematic slabs and find the reflection coefficients for this arrangement and obtain the dependence on the wave number and intensity of the incident wave. As a final step we analyze the stability of the analytical solutions of the nonlinear crystal by following the evolution of an additive amplitude to the analytical nonlinear solution we have found here. We discuss our results and state our conclusions. (paper)

  13. Neural tissue-spheres

    DEFF Research Database (Denmark)

    Andersen, Rikke K; Johansen, Mathias; Blaabjerg, Morten

    2007-01-01

    By combining new and established protocols we have developed a procedure for isolation and propagation of neural precursor cells from the forebrain subventricular zone (SVZ) of newborn rats. Small tissue blocks of the SVZ were dissected and propagated en bloc as free-floating neural tissue...... content, thus allowing experimental studies of neural precursor cells and their niche...

  14. Continuation calculus

    NARCIS (Netherlands)

    Geron, B.; Geuvers, J.H.; de'Liguoro, U.; Saurin, A.

    2013-01-01

    Programs with control are usually modeled using lambda calculus extended with control operators. Instead of modifying lambda calculus, we consider a different model of computation. We introduce continuation calculus, or CC, a deterministic model of computation that is evaluated using only head

  15. Riemann-Cartan geometry of nonlinear disclination mechanics

    KAUST Repository

    Yavari, A.; Goriely, A.

    2012-01-01

    In the continuous theory of defects in nonlinear elastic solids, it is known that a distribution of disclinations leads, in general, to a non-trivial residual stress field. To study this problem, we consider the particular case of determining

  16. Nonlinear photonic metasurfaces

    Science.gov (United States)

    Li, Guixin; Zhang, Shuang; Zentgraf, Thomas

    2017-03-01

    Compared with conventional optical elements, 2D photonic metasurfaces, consisting of arrays of antennas with subwavelength thickness (the 'meta-atoms'), enable the manipulation of light-matter interactions on more compact platforms. The use of metasurfaces with spatially varying arrangements of meta-atoms that have subwavelength lateral resolution allows control of the polarization, phase and amplitude of light. Many exotic phenomena have been successfully demonstrated in linear optics; however, to meet the growing demand for the integration of more functionalities into a single optoelectronic circuit, the tailorable nonlinear optical properties of metasurfaces will also need to be exploited. In this Review, we discuss the design of nonlinear photonic metasurfaces — in particular, the criteria for choosing the materials and symmetries of the meta-atoms — for the realization of nonlinear optical chirality, nonlinear geometric Berry phase and nonlinear wavefront engineering. Finally, we survey the application of nonlinear photonic metasurfaces in optical switching and modulation, and we conclude with an outlook on their use for terahertz nonlinear optics and quantum information processing.

  17. Nonlinear crack mechanics

    International Nuclear Information System (INIS)

    Khoroshun, L.P.

    1995-01-01

    The characteristic features of the deformation and failure of actual materials in the vicinity of a crack tip are due to their physical nonlinearity in the stress-concentration zone, which is a result of plasticity, microfailure, or a nonlinear dependence of the interatomic forces on the distance. Therefore, adequate models of the failure mechanics must be nonlinear, in principle, although linear failure mechanics is applicable if the zone of nonlinear deformation is small in comparison with the crack length. Models of crack mechanics are based on analytical solutions of the problem of the stress-strain state in the vicinity of the crack. On account of the complexity of the problem, nonlinear models are bason on approximate schematic solutions. In the Leonov-Panasyuk-Dugdale nonlinear model, one of the best known, the actual two-dimensional plastic zone (the nonlinearity zone) is replaced by a narrow one-dimensional zone, which is then modeled by extending the crack with a specified normal load equal to the yield point. The condition of finite stress is applied here, and hence the length of the plastic zone is determined. As a result of this approximation, the displacement in the plastic zone at the abscissa is nonzero

  18. Neural network-based optimal adaptive output feedback control of a helicopter UAV.

    Science.gov (United States)

    Nodland, David; Zargarzadeh, Hassan; Jagannathan, Sarangapani

    2013-07-01

    Helicopter unmanned aerial vehicles (UAVs) are widely used for both military and civilian operations. Because the helicopter UAVs are underactuated nonlinear mechanical systems, high-performance controller design for them presents a challenge. This paper introduces an optimal controller design via an output feedback for trajectory tracking of a helicopter UAV, using a neural network (NN). The output-feedback control system utilizes the backstepping methodology, employing kinematic and dynamic controllers and an NN observer. The online approximator-based dynamic controller learns the infinite-horizon Hamilton-Jacobi-Bellman equation in continuous time and calculates the corresponding optimal control input by minimizing a cost function, forward-in-time, without using the value and policy iterations. Optimal tracking is accomplished by using a single NN utilized for the cost function approximation. The overall closed-loop system stability is demonstrated using Lyapunov analysis. Finally, simulation results are provided to demonstrate the effectiveness of the proposed control design for trajectory tracking.

  19. Non-Linear Back-propagation: Doing Back-Propagation withoutDerivatives of the Activation Function

    DEFF Research Database (Denmark)

    Hertz, John; Krogh, Anders Stærmose; Lautrup, Benny

    1997-01-01

    The conventional linear back-propagation algorithm is replaced by a non-linear version, which avoids the necessity for calculating the derivative of the activation function. This may be exploited in hardware realizations of neural processors. In this paper we derive the non-linear back...

  20. Nonlinear wave equations

    CERN Document Server

    Li, Tatsien

    2017-01-01

    This book focuses on nonlinear wave equations, which are of considerable significance from both physical and theoretical perspectives. It also presents complete results on the lower bound estimates of lifespan (including the global existence), which are established for classical solutions to the Cauchy problem of nonlinear wave equations with small initial data in all possible space dimensions and with all possible integer powers of nonlinear terms. Further, the book proposes the global iteration method, which offers a unified and straightforward approach for treating these kinds of problems. Purely based on the properties of solut ions to the corresponding linear problems, the method simply applies the contraction mapping principle.

  1. Biological Networks Entropies: Examples in Neural Memory Networks, Genetic Regulation Networks and Social Epidemic Networks

    Directory of Open Access Journals (Sweden)

    Jacques Demongeot

    2018-01-01

    Full Text Available Networks used in biological applications at different scales (molecule, cell and population are of different types: neuronal, genetic, and social, but they share the same dynamical concepts, in their continuous differential versions (e.g., non-linear Wilson-Cowan system as well as in their discrete Boolean versions (e.g., non-linear Hopfield system; in both cases, the notion of interaction graph G(J associated to its Jacobian matrix J, and also the concepts of frustrated nodes, positive or negative circuits of G(J, kinetic energy, entropy, attractors, structural stability, etc., are relevant and useful for studying the dynamics and the robustness of these systems. We will give some general results available for both continuous and discrete biological networks, and then study some specific applications of three new notions of entropy: (i attractor entropy, (ii isochronal entropy and (iii entropy centrality; in three domains: a neural network involved in the memory evocation, a genetic network responsible of the iron control and a social network accounting for the obesity spread in high school environment.

  2. Continuation calculus

    Directory of Open Access Journals (Sweden)

    Bram Geron

    2013-09-01

    Full Text Available Programs with control are usually modeled using lambda calculus extended with control operators. Instead of modifying lambda calculus, we consider a different model of computation. We introduce continuation calculus, or CC, a deterministic model of computation that is evaluated using only head reduction, and argue that it is suitable for modeling programs with control. It is demonstrated how to define programs, specify them, and prove them correct. This is shown in detail by presenting in CC a list multiplication program that prematurely returns when it encounters a zero. The correctness proof includes termination of the program. In continuation calculus we can model both call-by-name and call-by-value. In addition, call-by-name functions can be applied to call-by-value results, and conversely.

  3. Spatial nonlinearities: Cascading effects in the earth system

    Science.gov (United States)

    Peters, Debra P.C.; Pielke, R.A.; Bestelmeyer, B.T.; Allen, Craig D.; Munson-McGee, Stuart; Havstad, K. M.; Canadell, Josep G.; Pataki, Diane E.; Pitelka, Louis F.

    2006-01-01

    Nonlinear behavior is prevalent in all aspects of the Earth System, including ecological responses to global change (Gallagher and Appenzeller 1999; Steffen et al. 2004). Nonlinear behavior refers to a large, discontinuous change in response to a small change in a driving variable (Rial et al. 2004). In contrast to linear systems where responses are smooth, well-behaved, continuous functions, nonlinear systems often undergo sharp or discontinuous transitions resulting from the crossing of thresholds. These nonlinear responses can result in surprising behavior that makes forecasting difficult (Kaplan and Glass 1995). Given that many system dynamics are nonlinear, it is imperative that conceptual and quantitative tools be developed to increase our understanding of the processes leading to nonlinear behavior in order to determine if forecasting can be improved under future environmental changes (Clark et al. 2001).

  4. Advanced in Nonlinear Optics and Laser Research and Development

    International Nuclear Information System (INIS)

    Jackel, S.; Kotler, Z; Lavi, R.; Sternklar, S.

    1996-01-01

    The Nonlinear Optics Group (NLOG) at Soreq NRC is engaged in the development of fundamental and applied technology in the related fields of nonlinear optics and laser development. Our work in nonlinear optics started with the goal of improving laser performance. These efforts were successful and opened the way for R and D in nonlinear optics for other applications. Today we use nonlinear optics to enable continuous tunability of lasers, control the path of light beams, modulate a light signal rapidly, provide optical data storage, and supply new means of microscopically probing biological and inorganic samples. Technology maturation and interaction with users will show which aspects of nonlinear optics will make the most impact

  5. ChainMail based neural dynamics modeling of soft tissue deformation for surgical simulation.

    Science.gov (United States)

    Zhang, Jinao; Zhong, Yongmin; Smith, Julian; Gu, Chengfan

    2017-07-20

    Realistic and real-time modeling and simulation of soft tissue deformation is a fundamental research issue in the field of surgical simulation. In this paper, a novel cellular neural network approach is presented for modeling and simulation of soft tissue deformation by combining neural dynamics of cellular neural network with ChainMail mechanism. The proposed method formulates the problem of elastic deformation into cellular neural network activities to avoid the complex computation of elasticity. The local position adjustments of ChainMail are incorporated into the cellular neural network as the local connectivity of cells, through which the dynamic behaviors of soft tissue deformation are transformed into the neural dynamics of cellular neural network. Experiments demonstrate that the proposed neural network approach is capable of modeling the soft tissues' nonlinear deformation and typical mechanical behaviors. The proposed method not only improves ChainMail's linear deformation with the nonlinear characteristics of neural dynamics but also enables the cellular neural network to follow the principle of continuum mechanics to simulate soft tissue deformation.

  6. PWR system simulation and parameter estimation with neural networks

    International Nuclear Information System (INIS)

    Akkurt, Hatice; Colak, Uener

    2002-01-01

    A detailed nonlinear model for a typical PWR system has been considered for the development of simulation software. Each component in the system has been represented by appropriate differential equations. The SCILAB software was used for solving nonlinear equations to simulate steady-state and transient operational conditions. Overall system has been constructed by connecting individual components to each other. The validity of models for individual components and overall system has been verified. The system response against given transients have been analyzed. A neural network has been utilized to estimate system parameters during transients. Different transients have been imposed in training and prediction stages with neural networks. Reactor power and system reactivity during the transient event have been predicted by the neural network. Results show that neural networks estimations are in good agreement with the calculated response of the reactor system. The maximum errors are within ±0.254% for power and between -0.146 and 0.353% for reactivity prediction cases. Steam generator parameters, pressure and water level, are also successfully predicted by the neural network employed in this study. The noise imposed on the input parameters of the neural network deteriorates the power estimation capability whereas the reactivity estimation capability is not significantly affected

  7. PWR system simulation and parameter estimation with neural networks

    Energy Technology Data Exchange (ETDEWEB)

    Akkurt, Hatice; Colak, Uener E-mail: uc@nuke.hacettepe.edu.tr

    2002-11-01

    A detailed nonlinear model for a typical PWR system has been considered for the development of simulation software. Each component in the system has been represented by appropriate differential equations. The SCILAB software was used for solving nonlinear equations to simulate steady-state and transient operational conditions. Overall system has been constructed by connecting individual components to each other. The validity of models for individual components and overall system has been verified. The system response against given transients have been analyzed. A neural network has been utilized to estimate system parameters during transients. Different transients have been imposed in training and prediction stages with neural networks. Reactor power and system reactivity during the transient event have been predicted by the neural network. Results show that neural networks estimations are in good agreement with the calculated response of the reactor system. The maximum errors are within {+-}0.254% for power and between -0.146 and 0.353% for reactivity prediction cases. Steam generator parameters, pressure and water level, are also successfully predicted by the neural network employed in this study. The noise imposed on the input parameters of the neural network deteriorates the power estimation capability whereas the reactivity estimation capability is not significantly affected.

  8. On application of kernel PCA for generating stimulus features for fMRI during continuous music listening.

    Science.gov (United States)

    Tsatsishvili, Valeri; Burunat, Iballa; Cong, Fengyu; Toiviainen, Petri; Alluri, Vinoo; Ristaniemi, Tapani

    2018-06-01

    There has been growing interest towards naturalistic neuroimaging experiments, which deepen our understanding of how human brain processes and integrates incoming streams of multifaceted sensory information, as commonly occurs in real world. Music is a good example of such complex continuous phenomenon. In a few recent fMRI studies examining neural correlates of music in continuous listening settings, multiple perceptual attributes of music stimulus were represented by a set of high-level features, produced as the linear combination of the acoustic descriptors computationally extracted from the stimulus audio. NEW METHOD: fMRI data from naturalistic music listening experiment were employed here. Kernel principal component analysis (KPCA) was applied to acoustic descriptors extracted from the stimulus audio to generate a set of nonlinear stimulus features. Subsequently, perceptual and neural correlates of the generated high-level features were examined. The generated features captured musical percepts that were hidden from the linear PCA features, namely Rhythmic Complexity and Event Synchronicity. Neural correlates of the new features revealed activations associated to processing of complex rhythms, including auditory, motor, and frontal areas. Results were compared with the findings in the previously published study, which analyzed the same fMRI data but applied linear PCA for generating stimulus features. To enable comparison of the results, methodology for finding stimulus-driven functional maps was adopted from the previous study. Exploiting nonlinear relationships among acoustic descriptors can lead to the novel high-level stimulus features, which can in turn reveal new brain structures involved in music processing. Copyright © 2018 Elsevier B.V. All rights reserved.

  9. Neural electrical activity and neural network growth.

    Science.gov (United States)

    Gafarov, F M

    2018-05-01

    The development of central and peripheral neural system depends in part on the emergence of the correct functional connectivity in its input and output pathways. Now it is generally accepted that molecular factors guide neurons to establish a primary scaffold that undergoes activity-dependent refinement for building a fully functional circuit. However, a number of experimental results obtained recently shows that the neuronal electrical activity plays an important role in the establishing of initial interneuronal connections. Nevertheless, these processes are rather difficult to study experimentally, due to the absence of theoretical description and quantitative parameters for estimation of the neuronal activity influence on growth in neural networks. In this work we propose a general framework for a theoretical description of the activity-dependent neural network growth. The theoretical description incorporates a closed-loop growth model in which the neural activity can affect neurite outgrowth, which in turn can affect neural activity. We carried out the detailed quantitative analysis of spatiotemporal activity patterns and studied the relationship between individual cells and the network as a whole to explore the relationship between developing connectivity and activity patterns. The model, developed in this work will allow us to develop new experimental techniques for studying and quantifying the influence of the neuronal activity on growth processes in neural networks and may lead to a novel techniques for constructing large-scale neural networks by self-organization. Copyright © 2018 Elsevier Ltd. All rights reserved.

  10. Adaptive neural network controller for the molten steel level control of strip casting processes

    International Nuclear Information System (INIS)

    Chen, Hung Yi; Huang, Shiuh Jer

    2010-01-01

    The twin-roll strip casting process is a steel-strip production method which combines continuous casting and hot rolling processes. The production line from molten liquid steel to the final steel-strip is shortened and the production cost is reduced significantly as compared to conventional continuous casting. The quality of strip casting process depends on many process parameters, such as molten steel level in the pool, solidification position, and roll gap. Their relationships are complex and the strip casting process has the properties of nonlinear uncertainty and time-varying characteristics. It is difficult to establish an accurate process model for designing a model-based controller to monitor the strip quality. In this paper, a model-free adaptive neural network controller is developed to overcome this problem. The proposed control strategy is based on a neural network structure combined with a sliding-mode control scheme. An adaptive rule is employed to on-line adjust the weights of radial basis functions by using the reaching condition of a specified sliding surface. This surface has the on-line learning ability to respond to the system's nonlinear and time-varying behaviors. Since this model-free controller has a simple control structure and small number of control parameters, it is easy to implement. Simulation results, based on a semi experimental system dynamic model and parameters, are executed to show the control performance of the proposed intelligent controller. In addition, the control performance is compared with that of a traditional Pid controller

  11. Chimera States in Neural Oscillators

    Science.gov (United States)

    Bahar, Sonya; Glaze, Tera

    2014-03-01

    Chimera states have recently been explored both theoretically and experimentally, in various coupled nonlinear oscillators, ranging from phase-oscillator models to coupled chemical reactions. In a chimera state, both coherent and incoherent (or synchronized and desynchronized) states occur simultaneously in populations of identical oscillators. We investigate chimera behavior in a population of neural oscillators using the Huber-Braun model, a Hodgkin-Huxley-like model originally developed to characterize the temperature-dependent bursting behavior of mammalian cold receptors. One population of neurons is allowed to synchronize, with each neuron receiving input from all the others in its group (global within-group coupling). Subsequently, a second population of identical neurons is placed under an identical global within-group coupling, and the two populations are also coupled to each other (between-group coupling). For certain values of the coupling constants, the neurons in the two populations exhibit radically different synchronization behavior. We will discuss the range of chimera activity in the model, and discuss its implications for actual neural activity, such as unihemispheric sleep.

  12. Multiple simultaneous fault diagnosis via hierarchical and single artificial neural networks

    International Nuclear Information System (INIS)

    Eslamloueyan, R.; Shahrokhi, M.; Bozorgmehri, R.

    2003-01-01

    Process fault diagnosis involves interpreting the current status of the plant given sensor reading and process knowledge. There has been considerable work done in this area with a variety of approaches being proposed for process fault diagnosis. Neural networks have been used to solve process fault diagnosis problems in chemical process, as they are well suited for recognizing multi-dimensional nonlinear patterns. In this work, the use of Hierarchical Artificial Neural Networks in diagnosing the multi-faults of a chemical process are discussed and compared with that of Single Artificial Neural Networks. The lower efficiency of Hierarchical Artificial Neural Networks , in comparison to Single Artificial Neural Networks, in process fault diagnosis is elaborated and analyzed. Also, the concept of a multi-level selection switch is presented and developed to improve the performance of hierarchical artificial neural networks. Simulation results indicate that application of multi-level selection switch increase the performance of the hierarchical artificial neural networks considerably

  13. Advanced neural network-based computational schemes for robust fault diagnosis

    CERN Document Server

    Mrugalski, Marcin

    2014-01-01

    The present book is devoted to problems of adaptation of artificial neural networks to robust fault diagnosis schemes. It presents neural networks-based modelling and estimation techniques used for designing robust fault diagnosis schemes for non-linear dynamic systems. A part of the book focuses on fundamental issues such as architectures of dynamic neural networks, methods for designing of neural networks and fault diagnosis schemes as well as the importance of robustness. The book is of a tutorial value and can be perceived as a good starting point for the new-comers to this field. The book is also devoted to advanced schemes of description of neural model uncertainty. In particular, the methods of computation of neural networks uncertainty with robust parameter estimation are presented. Moreover, a novel approach for system identification with the state-space GMDH neural network is delivered. All the concepts described in this book are illustrated by both simple academic illustrative examples and practica...

  14. Non-invasive neural stimulation

    Science.gov (United States)

    Tyler, William J.; Sanguinetti, Joseph L.; Fini, Maria; Hool, Nicholas

    2017-05-01

    Neurotechnologies for non-invasively interfacing with neural circuits have been evolving from those capable of sensing neural activity to those capable of restoring and enhancing human brain function. Generally referred to as non-invasive neural stimulation (NINS) methods, these neuromodulation approaches rely on electrical, magnetic, photonic, and acoustic or ultrasonic energy to influence nervous system activity, brain function, and behavior. Evidence that has been surmounting for decades shows that advanced neural engineering of NINS technologies will indeed transform the way humans treat diseases, interact with information, communicate, and learn. The physics underlying the ability of various NINS methods to modulate nervous system activity can be quite different from one another depending on the energy modality used as we briefly discuss. For members of commercial and defense industry sectors that have not traditionally engaged in neuroscience research and development, the science, engineering and technology required to advance NINS methods beyond the state-of-the-art presents tremendous opportunities. Within the past few years alone there have been large increases in global investments made by federal agencies, foundations, private investors and multinational corporations to develop advanced applications of NINS technologies. Driven by these efforts NINS methods and devices have recently been introduced to mass markets via the consumer electronics industry. Further, NINS continues to be explored in a growing number of defense applications focused on enhancing human dimensions. The present paper provides a brief introduction to the field of non-invasive neural stimulation by highlighting some of the more common methods in use or under current development today.

  15. Prediction of Weld Penetration in FCAW of HSLA steel using Artificial Neural Networks

    International Nuclear Information System (INIS)

    Asl, Y. Dadgar; Mostafa, N. B.; Panahizadeh, V. R.; Seyedkashi, S. M. H.

    2011-01-01

    Flux-cored arc welding (FCAW) is a semiautomatic or automatic arc welding process that requires a continuously-fed consumable tubular electrode containing a flux. The main FCAW process parameters affecting the depth of penetration are welding current, arc voltage, nozzle-to-work distance, torch angle and welding speed. Shallow depth of penetration may contribute to failure of a welded structure since penetration determines the stress-carrying capacity of a welded joint. To avoid such occurrences; the welding process parameters influencing the weld penetration must be properly selected to obtain an acceptable weld penetration and hence a high quality joint. Artificial neural networks (ANN), also called neural networks (NN), are computational models used to express complex non-linear relationships between input and output data. In this paper, artificial neural network (ANN) method is used to predict the effects of welding current, arc voltage, nozzle-to-work distance, torch angle and welding speed on weld penetration depth in gas shielded FCAW of a grade of high strength low alloy steel. 32 experimental runs were carried out using the bead-on-plate welding technique. Weld penetrations were measured and on the basis of these 32 sets of experimental data, a feed-forward back-propagation neural network was created. 28 sets of the experiments were used as the training data and the remaining 4 sets were used for the testing phase of the network. The ANN has one hidden layer with eight neurons and is trained after 840 iterations. The comparison between the experimental results and ANN results showed that the trained network could predict the effects of the FCAW process parameters on weld penetration adequately.

  16. Intrinsic gain modulation and adaptive neural coding.

    Directory of Open Access Journals (Sweden)

    Sungho Hong

    2008-07-01

    Full Text Available In many cases, the computation of a neural system can be reduced to a receptive field, or a set of linear filters, and a thresholding function, or gain curve, which determines the firing probability; this is known as a linear/nonlinear model. In some forms of sensory adaptation, these linear filters and gain curve adjust very rapidly to changes in the variance of a randomly varying driving input. An apparently similar but previously unrelated issue is the observation of gain control by background noise in cortical neurons: the slope of the firing rate versus current (f-I curve changes with the variance of background random input. Here, we show a direct correspondence between these two observations by relating variance-dependent changes in the gain of f-I curves to characteristics of the changing empirical linear/nonlinear model obtained by sampling. In the case that the underlying system is fixed, we derive relationships relating the change of the gain with respect to both mean and variance with the receptive fields derived from reverse correlation on a white noise stimulus. Using two conductance-based model neurons that display distinct gain modulation properties through a simple change in parameters, we show that coding properties of both these models quantitatively satisfy the predicted relationships. Our results describe how both variance-dependent gain modulation and adaptive neural computation result from intrinsic nonlinearity.

  17. Optical resonators and neural networks

    Science.gov (United States)

    Anderson, Dana Z.

    1986-08-01

    It may be possible to implement neural network models using continuous field optical architectures. These devices offer the inherent parallelism of propagating waves and an information density in principle dictated by the wavelength of light and the quality of the bulk optical elements. Few components are needed to construct a relatively large equivalent network. Various associative memories based on optical resonators have been demonstrated in the literature, a ring resonator design is discussed in detail here. Information is stored in a holographic medium and recalled through a competitive processes in the gain medium supplying energy to the ring rsonator. The resonator memory is the first realized example of a neural network function implemented with this kind of architecture.

  18. Photostable nonlinear optical polycarbonates

    NARCIS (Netherlands)

    Faccini, M.; Balakrishnan, M.; Diemeer, Mart; Torosantucci, Riccardo; Driessen, A.; Reinhoudt, David; Verboom, Willem

    2008-01-01

    Highly thermal and photostable nonlinear optical polymers were obtained by covalently incorporating the tricyanovinylidenediphenylaminobenzene (TCVDPA) chromophore to a polycarbonate backbone. NLO polycarbonates with different chromophore attachment modes and flexibilities were synthesized. In spite

  19. Nonlinear singular elliptic equations

    International Nuclear Information System (INIS)

    Dong Minh Duc.

    1988-09-01

    We improve the Poincare inequality, the Sobolev imbedding theorem and the Trudinger imbedding theorem and prove a Mountain pass theorem. Applying these results we study a nonlinear singular mixed boundary problem. (author). 22 refs

  20. Nonlinear Optical Terahertz Technology

    Data.gov (United States)

    National Aeronautics and Space Administration — We develop a new approach to generation of THz radiation. Our method relies on mixing two optical frequency beams in a nonlinear crystalline Whispering Gallery Mode...