Neural Networks for Non-linear Control
DEFF Research Database (Denmark)
Sørensen, O.
1994-01-01
This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process.......This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process....
Neural Networks for Non-linear Control
DEFF Research Database (Denmark)
Sørensen, O.
1994-01-01
This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process.......This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process....
Nonlinear programming with feedforward neural networks.
Energy Technology Data Exchange (ETDEWEB)
Reifman, J.
1999-06-02
We provide a practical and effective method for solving constrained optimization problems by successively training a multilayer feedforward neural network in a coupled neural-network/objective-function representation. Nonlinear programming problems are easily mapped into this representation which has a simpler and more transparent method of solution than optimization performed with Hopfield-like networks and poses very mild requirements on the functions appearing in the problem. Simulation results are illustrated and compared with an off-the-shelf optimization tool.
Nonlinear System Control Using Neural Networks
Directory of Open Access Journals (Sweden)
Jaroslava Žilková
2006-10-01
Full Text Available The paper is focused especially on presenting possibilities of applying off-linetrained artificial neural networks at creating the system inverse models that are used atdesigning control algorithm for non-linear dynamic system. The ability of cascadefeedforward neural networks to model arbitrary non-linear functions and their inverses isexploited. This paper presents a quasi-inverse neural model, which works as a speedcontroller of an induction motor. The neural speed controller consists of two cascadefeedforward neural networks subsystems. The first subsystem provides desired statorcurrent components for control algorithm and the second subsystem providescorresponding voltage components for PWM converter. The availability of the proposedcontroller is verified through the MATLAB simulation. The effectiveness of the controller isdemonstrated for different operating conditions of the drive system.
Multilingual Text Detection with Nonlinear Neural Network
Directory of Open Access Journals (Sweden)
Lin Li
2015-01-01
Full Text Available Multilingual text detection in natural scenes is still a challenging task in computer vision. In this paper, we apply an unsupervised learning algorithm to learn language-independent stroke feature and combine unsupervised stroke feature learning and automatically multilayer feature extraction to improve the representational power of text feature. We also develop a novel nonlinear network based on traditional Convolutional Neural Network that is able to detect multilingual text regions in the images. The proposed method is evaluated on standard benchmarks and multilingual dataset and demonstrates improvement over the previous work.
Nonlinear system identification and control based on modular neural networks.
Puscasu, Gheorghe; Codres, Bogdan
2011-08-01
A new approach for nonlinear system identification and control based on modular neural networks (MNN) is proposed in this paper. The computational complexity of neural identification can be greatly reduced if the whole system is decomposed into several subsystems. This is obtained using a partitioning algorithm. Each local nonlinear model is associated with a nonlinear controller. These are also implemented by neural networks. The switching between the neural controllers is done by a dynamical switcher, also implemented by neural networks, that tracks the different operating points. The proposed multiple modelling and control strategy has been successfully tested on simulated laboratory scale liquid-level system.
Identification of Non-Linear Structures using Recurrent Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Nielsen, Søren R. K.; Hansen, H. I.
1995-01-01
Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure.......Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure....
Identification of Non-Linear Structures using Recurrent Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Nielsen, Søren R. K.; Hansen, H. I.
Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure.......Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure....
Identification of Non-Linear Structures using Recurrent Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Nielsen, Søren R. K.; Hansen, H. I.
1995-01-01
Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure.......Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure....
Neural networks for function approximation in nonlinear control
Linse, Dennis J.; Stengel, Robert F.
1990-01-01
Two neural network architectures are compared with a classical spline interpolation technique for the approximation of functions useful in a nonlinear control system. A standard back-propagation feedforward neural network and a cerebellar model articulation controller (CMAC) neural network are presented, and their results are compared with a B-spline interpolation procedure that is updated using recursive least-squares parameter identification. Each method is able to accurately represent a one-dimensional test function. Tradeoffs between size requirements, speed of operation, and speed of learning indicate that neural networks may be practical for identification and adaptation in a nonlinear control environment.
Implementation of neural network based non-linear predictive control
DEFF Research Database (Denmark)
Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole
1999-01-01
of non-linear systems. GPC is model based and in this paper we propose the use of a neural network for the modeling of the system. Based on the neural network model, a controller with extended control horizon is developed and the implementation issues are discussed, with particular emphasis...
A novel neural network for nonlinear convex programming.
Gao, Xing-Bao
2004-05-01
In this paper, we present a neural network for solving the nonlinear convex programming problem in real time by means of the projection method. The main idea is to convert the convex programming problem into a variational inequality problem. Then a dynamical system and a convex energy function are constructed for resulting variational inequality problem. It is shown that the proposed neural network is stable in the sense of Lyapunov and can converge to an exact optimal solution of the original problem. Compared with the existing neural networks for solving the nonlinear convex programming problem, the proposed neural network has no Lipschitz condition, no adjustable parameter, and its structure is simple. The validity and transient behavior of the proposed neural network are demonstrated by some simulation results.
Interval standard neural network models for nonlinear systems
Institute of Scientific and Technical Information of China (English)
无
2006-01-01
A neural-network-based robust control design is suggested for control of a class of nonlinear systems. The design approach employs a neural network, whose activation functions satisfy the sector conditions, to approximate the nonlinear system. To improve the approximation performance and to account for the parameter perturbations during operation, a novel neural network model termed standard neural network model (SNNM) is proposed. If the uncertainty is bounded, the SNNM is called an interval SNNM (ISNNM). A state-feedback control law is designed for the nonlinear system modelled by an ISNNM such that the closed-loop system is globally, robustly, and asymptotically stable. The control design equations are shown to be a set of linear matrix inequalities (LMIs) that can be easily solved by available convex optimization algorithms. An example is given to illustrate the control design procedure, and the performance of the proposed approach is compared with that of a related method reported in literature.
Nonlinear Time Series Analysis via Neural Networks
Volná, Eva; Janošek, Michal; Kocian, Václav; Kotyrba, Martin
This article deals with a time series analysis based on neural networks in order to make an effective forex market [Moore and Roche, J. Int. Econ. 58, 387-411 (2002)] pattern recognition. Our goal is to find and recognize important patterns which repeatedly appear in the market history to adapt our trading system behaviour based on them.
Adaptive Neural Network Based Control of Noncanonical Nonlinear Systems.
Zhang, Yanjun; Tao, Gang; Chen, Mou
2016-09-01
This paper presents a new study on the adaptive neural network-based control of a class of noncanonical nonlinear systems with large parametric uncertainties. Unlike commonly studied canonical form nonlinear systems whose neural network approximation system models have explicit relative degree structures, which can directly be used to derive parameterized controllers for adaptation, noncanonical form nonlinear systems usually do not have explicit relative degrees, and thus their approximation system models are also in noncanonical forms. It is well-known that the adaptive control of noncanonical form nonlinear systems involves the parameterization of system dynamics. As demonstrated in this paper, it is also the case for noncanonical neural network approximation system models. Effective control of such systems is an open research problem, especially in the presence of uncertain parameters. This paper shows that it is necessary to reparameterize such neural network system models for adaptive control design, and that such reparameterization can be realized using a relative degree formulation, a concept yet to be studied for general neural network system models. This paper then derives the parameterized controllers that guarantee closed-loop stability and asymptotic output tracking for noncanonical form neural network system models. An illustrative example is presented with the simulation results to demonstrate the control design procedure, and to verify the effectiveness of such a new design method.
New cooperative projection neural network for nonlinearly constrained variational inequality
Institute of Scientific and Technical Information of China (English)
XIA YouSheng
2009-01-01
This paper proposes a new cooperative projection neural network (CPNN), which combines automat-ically three individual neural network models with a common projection term. As a special case, the proposed CPNN can include three recent recurrent neural networks for solving monotone variational in-equality problems with limit or linear constraints, respectively. Under the monotonicity condition of the corresponding Lagrangian mapping, the proposed CPNN is theoretically guaranteed to solve monotone variational inequality problems and a class of nonmonotone variational inequality problems with linear and nonlinear constraints. Unlike the extended projection neural network, the proposed CPNN has no limitation on the initial point for global convergence. Compared with other related cooperative neural networks and numerical optimization algorithms, the proposed CPNN has a low computational complex-ity and requires weak convergence conditions. An application in real-time grasping force optimization and examples demonstrate good performance of the proposed CPNN.
A Recurrent Neural Network for Nonlinear Fractional Programming
Directory of Open Access Journals (Sweden)
Quan-Ju Zhang
2012-01-01
Full Text Available This paper presents a novel recurrent time continuous neural network model which performs nonlinear fractional optimization subject to interval constraints on each of the optimization variables. The network is proved to be complete in the sense that the set of optima of the objective function to be minimized with interval constraints coincides with the set of equilibria of the neural network. It is also shown that the network is primal and globally convergent in the sense that its trajectory cannot escape from the feasible region and will converge to an exact optimal solution for any initial point being chosen in the feasible interval region. Simulation results are given to demonstrate further the global convergence and good performance of the proposing neural network for nonlinear fractional programming problems with interval constraints.
Application of dynamic recurrent neural networks in nonlinear system identification
Du, Yun; Wu, Xueli; Sun, Huiqin; Zhang, Suying; Tian, Qiang
2006-11-01
An adaptive identification method of simple dynamic recurrent neural network (SRNN) for nonlinear dynamic systems is presented in this paper. This method based on the theory that by using the inner-states feed-back of dynamic network to describe the nonlinear kinetic characteristics of system can reflect the dynamic characteristics more directly, deduces the recursive prediction error (RPE) learning algorithm of SRNN, and improves the algorithm by studying topological structure on recursion layer without the weight values. The simulation results indicate that this kind of neural network can be used in real-time control, due to its less weight values, simpler learning algorithm, higher identification speed, and higher precision of model. It solves the problems of intricate in training algorithm and slow rate in convergence caused by the complicate topological structure in usual dynamic recurrent neural network.
An Adaptive Neural Network Model for Nonlinear Programming Problems
Institute of Scientific and Technical Information of China (English)
Xiang-sun Zhang; Xin-jian Zhuo; Zhu-jun Jing
2002-01-01
In this paper a canonical neural network with adaptively changing synaptic weights and activation function parameters is presented to solve general nonlinear programming problems. The basic part of the model is a sub-network used to find a solution of quadratic programming problems with simple upper and lower bounds. By sequentially activating the sub-network under the control of an external computer or a special analog or digital processor that adjusts the weights and parameters, one then solves general nonlinear programming problems. Convergence proof and numerical results are given.
Nonlinear system identification based on internal recurrent neural networks.
Puscasu, Gheorghe; Codres, Bogdan; Stancu, Alexandru; Murariu, Gabriel
2009-04-01
A novel approach for nonlinear complex system identification based on internal recurrent neural networks (IRNN) is proposed in this paper. The computational complexity of neural identification can be greatly reduced if the whole system is decomposed into several subsystems. This approach employs internal state estimation when no measurements coming from the sensors are available for the system states. A modified backpropagation algorithm is introduced in order to train the IRNN for nonlinear system identification. The performance of the proposed design approach is proven on a car simulator case study.
Robust nonlinear system identification using neural-network models.
Lu, S; Basar, T
1998-01-01
We study the problem of identification for nonlinear systems in the presence of unknown driving noise, using both feedforward multilayer neural network and radial basis function network models. Our objective is to resolve the difficulty associated with the persistency of excitation condition inherent to the standard schemes in the neural identification literature. This difficulty is circumvented here by a novel formulation and by using a new class of identification algorithms recently obtained by Didinsky et al. We show how these algorithms can be exploited to successfully identify the nonlinearity in the system using neural-network models. By embedding the original problem in one with noise-perturbed state measurements, we present a class of identifiers (under L1 and L2 cost criteria) which secure a good approximant for the system nonlinearity provided that some global optimization technique is used. In this respect, many available learning algorithms in the current neural-network literature, e.g., the backpropagation scheme and the genetic algorithms-based scheme, with slight modifications, can ensure the identification of the system nonlinearity. Subsequently, we address the same problem under a third, worst case L(infinity) criterion for an RBF modeling. We present a neural-network version of an H(infinity)-based identification algorithm from Didinsky et al and show how, along with an appropriate choice of control input to enhance excitation, under both full-state-derivative information (FSDI) and noise-perturbed full-state-information (NPFSI), it leads to satisfaction of a relevant persistency of excitation condition, and thereby to robust identification of the nonlinearity. Results from several simulation studies have been included to demonstrate the effectiveness of these algorithms.
A neural feedforward network with a polynomial nonlinearity
DEFF Research Database (Denmark)
Hoffmann, Nils
1992-01-01
A novel neural network based on the Wiener model is proposed. The network is composed of a hidden layer of preprocessing neurons followed by a polynomial nonlinearity and a linear output neuron. The author tries to solve the problem of finding an appropriate preprocessing method by using a modified...... backpropagation algorithm. It is shown by the use of calculation trees that the proposed approach is simple to implement, and that the computational complexity is not much larger than for the alternative method of using PCA to determine the weights in the preprocessing network. A simulation is given which...... indicates superior performance of the proposed network compared to the PCA network...
Wavelet neural network based fault diagnosis in nonlinear analog circuits
Institute of Scientific and Technical Information of China (English)
Yin Shirong; Chen Guangju; Xie Yongle
2006-01-01
The theories of diagnosing nonlinear analog circuits by means of the transient response testing are studied. Wavelet analysis is made to extract the transient response signature of nonlinear circuits and compress the signature dada. The best wavelet function is selected based on the between-category total scatter of signature. The fault dictionary of nonlinear circuits is constructed based on improved back-propagation(BP) neural network. Experimental results demonstrate that the method proposed has high diagnostic sensitivity and fast fault identification and deducibility.
Nonlinear Time Series Forecast Using Radial Basis Function Neural Networks
Institute of Scientific and Technical Information of China (English)
ZHENGXin; CHENTian-Lun
2003-01-01
In the research of using Radial Basis Function Neural Network (RBF NN) forecasting nonlinear time series, we investigate how the different clusterings affect the process of learning and forecasting. We find that k-means clustering is very suitable. In order to increase the precision we introduce a nonlinear feedback term to escape from the local minima of energy, then we use the model to forecast the nonlinear time series which are produced by Mackey-Glass equation and stocks. By selecting the k-means clustering and the suitable feedback term, much better forecasting results are obtained.
Nonlinear Time Series Forecast Using Radial Basis Function Neural Networks
Institute of Scientific and Technical Information of China (English)
ZHENG Xin; CHEN Tian-Lun
2003-01-01
In the research of using Radial Basis Function Neural Network (RBF NN) forecasting nonlinear timeseries, we investigate how the different clusterings affect the process of learning and forecasting. We find that k-meansclustering is very suitable. In order to increase the precision we introduce a nonlinear feedback term to escape from thelocal minima of energy, then we use the model to forecast the nonlinear time series which are produced by Mackey-Glassequation and stocks. By selecting the k-means clustering and the suitable feedback term, much better forecasting resultsare obtained.
Nonlinear Decoupling PID Control Using Neural Networks and Multiple Models
Institute of Scientific and Technical Information of China (English)
无
2006-01-01
For a class of complex industrial processes with strong nonlinearity, serious coupling and uncertainty, a nonlinear decoupling proportional-integral-differential (PID) controller is proposed, which consists of a traditional PID controller, a decoupling compensator and a feedforward compensator for the unmodeled dynamics. The parameters of such controller is selected based on the generalized minimum variance control law. The unmodeled dynamics is estimated and compensated by neural networks, a switching mechanism is introduced to improve tracking performance, then a nonlinear decoupling PID control algorithm is proposed. All signals in such switching system are globally bounded and the tracking error is convergent. Simulations show effectiveness of the algorithm.
Non-linear feedback neural networks VLSI implementations and applications
Ansari, Mohd Samar
2014-01-01
This book aims to present a viable alternative to the Hopfield Neural Network (HNN) model for analog computation. It is well known that the standard HNN suffers from problems of convergence to local minima, and requirement of a large number of neurons and synaptic weights. Therefore, improved solutions are needed. The non-linear synapse neural network (NoSyNN) is one such possibility and is discussed in detail in this book. This book also discusses the applications in computationally intensive tasks like graph coloring, ranking, and linear as well as quadratic programming. The material in the book is useful to students, researchers and academician working in the area of analog computation.
Nonlinear Time Series Prediction Using Chaotic Neural Networks
Institute of Scientific and Technical Information of China (English)
LI KePing; CHEN TianLun
2001-01-01
A nonlinear feedback term is introduced into the evaluation equation of weights of the backpropagation algorithm for neural network, the network becomes a chaotic one. For the purpose of that we can investigate how the different feedback terms affect the process of learning and forecasting, we use the model to forecast the nonlinear time series which is produced by Makey-Glass equation. By selecting the suitable feedback term, the system can escape from the local minima and converge to the global minimum or its approximate solutions, and the forecasting results are better than those of backpropagation algorithm.``
Nonlinear Time Series Model for Shape Classification Using Neural Networks
Institute of Scientific and Technical Information of China (English)
无
2000-01-01
A complex nonlinear exponential autoregressive (CNEAR) model for invariant feature extraction is developed for recognizing arbitrary shapes on a plane. A neural network is used to calculate the CNEAR coefficients. The coefficients, which constitute the feature set, are proven to be invariant to boundary transformations such as translation, rotation, scale and choice of starting point in tracing the boundary. The feature set is then used as the input to a complex multilayer perceptron (C-MLP) network for learning and classification. Experimental results show that complicated shapes can be accurately recognized even with the low-order model and that the classification method has good fault tolerance when noise is present.
Artificial Neural Networks for Nonlinear Dynamic Response Simulation in Mechanical Systems
DEFF Research Database (Denmark)
Christiansen, Niels Hørbye; Høgsberg, Jan Becker; Winther, Ole
2011-01-01
It is shown how artificial neural networks can be trained to predict dynamic response of a simple nonlinear structure. Data generated using a nonlinear finite element model of a simplified wind turbine is used to train a one layer artificial neural network. When trained properly the network is able...
A Comparison between Neural Networks and Wavelet Networks in Nonlinear System Identification
Directory of Open Access Journals (Sweden)
S. Ehsan Razavi
2012-01-01
Full Text Available In this study, identification of a nonlinear function will be presented by neural network and wavelet network methods. Behavior of a nonlinear system can be identified by intelligent methods. Two groups of the most common and at the same time the most effective of neural networks methods are multilayer perceptron and radial basis function that will be used for nonlinear system identification. The selected structure is series - parallel method that after network training by a series of training random data, the output is estimated and the nonlinear function is compared to a sinusoidal input. Then, wavelet network is used for identification and we will use Orthogonal Least Squares (OLS method for wavelet selection to reduce the volume of calculations and increase the convergence speed.
Neural network-based H∞ filtering for nonlinear systems with time-delays
Institute of Scientific and Technical Information of China (English)
无
2008-01-01
A novel H∞ design methodology for a neural network-based nonlinear filtering scheme is addressed.Firstly,neural networks are employed to approximate the nonlinearities.Next,the nonlinear dynamic system is represented by the mode-dependent linear difference inclusion (LDI).Finally,based on the LDI model,a neural network-based nonlinear filter (NNBNF) is developed to minimize the upper bound of H∞ gain index of the estimation error under some linear matrix inequality (LMI) constraints.Compared with the existing nonlinear filters,NNBNF is time-invariant and numerically tractable.The validity and applicability of the proposed approach are successfully demonstrated in an illustrative example.
The Projection Neural Network for Solving Convex Nonlinear Programming
Yang, Yongqing; Xu, Xianyun
In this paper, a projection neural network for solving convex optimization is investigated. Using Lyapunov stability theory and LaSalle invariance principle, the proposed network is showed to be globally stable and converge to exact optimal solution. Two examples show the effectiveness of the proposed neural network model.
Advanced models of neural networks nonlinear dynamics and stochasticity in biological neurons
Rigatos, Gerasimos G
2015-01-01
This book provides a complete study on neural structures exhibiting nonlinear and stochastic dynamics, elaborating on neural dynamics by introducing advanced models of neural networks. It overviews the main findings in the modelling of neural dynamics in terms of electrical circuits and examines their stability properties with the use of dynamical systems theory. It is suitable for researchers and postgraduate students engaged with neural networks and dynamical systems theory.
MODELING NONLINEAR DYNAMICS OF CIRCULATING FLUIDIZED BEDS USING NEURAL NETWORKS
Institute of Scientific and Technical Information of China (English)
Wei; Chen; Atsushi; Tsutsumi; Haiyan; Lin; Kentaro; Otawara
2005-01-01
In the present work, artificial neural networks (ANNs) were proposed to model nonlinear dynamic behaviors of local voidage fluctuations induced by highly turbulent interactions between the gas and solid phases in circulating fluidized beds. The fluctuations of local voidage were measured by using an optical transmittance probe at various axial and radial positions in a circulating fluidized bed with a riser of 0.10 m in inner diameter and 10 m in height. The ANNs trained with experimental time series were applied to make short-term and long-term predictions of dynamic characteristics in the circulating fluidized bed. An early stop approach was adopted to enhance the long-term prediction capability of ANNs. The performance of the trained ANN was evaluated in terms of time-averaged characteristics, power spectra, cycle number and short-term predictability analysis of time series measured and predicted by the model.
Implementation of neural network based non-linear predictive
DEFF Research Database (Denmark)
Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole
1998-01-01
-linear systems. GPC is model-based and in this paper we propose the use of a neural network for the modeling of the system. Based on the neural network model a controller with extended control horizon is developed and the implementation issues are discussed, with particular emphasis on an efficient Quasi...
Directory of Open Access Journals (Sweden)
Wu Huaiqin
2009-01-01
Full Text Available This paper considers a new class of additive neural networks where the neuron activations are modelled by discontinuous functions with nonlinear growth. By Leray-Schauder alternative theorem in differential inclusion theory, matrix theory, and generalized Lyapunov approach, a general result is derived which ensures the existence and global asymptotical stability of a unique periodic solution for such neural networks. The obtained results can be applied to neural networks with a broad range of activation functions assuming neither boundedness nor monotonicity, and also show that Forti's conjecture for discontinuous neural networks with nonlinear growth activations is true.
Directory of Open Access Journals (Sweden)
Bahita Mohamed
2011-01-01
Full Text Available In this work, we introduce an adaptive neural network controller for a class of nonlinear systems. The approach uses two Radial Basis Functions, RBF networks. The first RBF network is used to approximate the ideal control law which cannot be implemented since the dynamics of the system are unknown. The second RBF network is used for on-line estimating the control gain which is a nonlinear and unknown function of the states. The updating laws for the combined estimator and controller are derived through Lyapunov analysis. Asymptotic stability is established with the tracking errors converging to a neighborhood of the origin. Finally, the proposed method is applied to control and stabilize the inverted pendulum system.
Nonlinear modeling of PEMFC based on neural networks identification
Institute of Scientific and Technical Information of China (English)
SUN Tao; CAO Guang-yi; ZHU Xin-jian
2005-01-01
The proton exchange membrane generation technology is highly efficient and clean, and is considered as the most hopeful "green" power technology. The operating principles of proton exchange membrane fuel cell (PEMFC) system involve thermodynamics, electrochemistry, hydrodynamics and mass transfer theory, which comprise a complex nonlinear system, for which it is difficult to establish a mathematical model. This paper first simply analyzes the necessity of the PEMFC generation technology, then introduces the generating principle from four aspects: electrode, single cell, stack, system; and then uses the approach and self-study ability of artificial neural network to build the model of nonlinear system, and adapts the Levenberg-Marquardt BP (LMBP) to build the electric characteristic model of PEMFC. The model uses experimental data as training specimens, on the condition the system is provided enough hydrogen. Considering the flow velocity of air (or oxygen) and the cell operational temperature as inputs, the cell voltage and current density as the outputs and establishing the electric characteristic model of PEMFC according to the different cell temperatures. The voltage-current output curves of model has some guidance effect for improving the cell performance, and provide basic data for optimizing cell performance that have practical significance.
Nonlinear wind prediction using a fuzzy modular temporal neural network
Energy Technology Data Exchange (ETDEWEB)
Wu, G.G. [GeoControl Systems, Inc., Houston, TX (United States); Zhijie Dou [West Texas A& M Univ., Canyon, TX (United States)
1995-12-31
This paper introduces a new approach utilizing a fuzzy classifier and a modular temporal neural network to predict wind speed and direction for advanced wind turbine control systems. The fuzzy classifier estimates wind patterns and then assigns weights accordingly to each module of the temporal neural network. A temporal network with the finite-duration impulse response and multiple-layer structure is used to represent the underlying dynamics of physical phenomena. Using previous wind measurements and information given by the classifier, the modular network trained by a standard back-propagation algorithm predicts wind speed and direction effectively. Meanwhile, the feedback from the network helps auto-tuning the classifier.
Determining the input dimension of a neural network for nonlinear time series prediction
Institute of Scientific and Technical Information of China (English)
张胜; 刘红星; 高敦堂; 都思丹
2003-01-01
Determining the input dimension of a feed-forward neural network for nonlinear time series prediction plays an important role in the modelling.The paper first summarizes the current methods for determining the input dimension of the neural network.Then inspired by the fact that the correlation dimension of a nonlinear dynamic system is the mostimportant feature of it,the paper presents a new idea that the input dimension of the neural network for nonlinear time series prediction can be taken as an integer just greater than or equal to the correlation dimension.Finally,some wlidation examples and results are given.
A Fuzzy-Neural Network Control of Nonlinear Dynamic Systems
Institute of Scientific and Technical Information of China (English)
无
2000-01-01
In this paper,an adaptive dynamic control scheme based on a fuzzy neural network is presented,that presents utilizes both feed-forward and feedback controller elements.The former of the two elements comprises a neural network with both identification and control role,and the latter is a fuzzy neural algorithm,which is introduced to provide additional control enhancement.The feedforward controller provides only coarse control,whereas the feedback oontroller can generate on-line conditional proposition rule automatically to improve the overall control action.These properties make the design very versatile and applicable to a range of industrial applications.
Institute of Scientific and Technical Information of China (English)
无
2002-01-01
The nonlinear dynamical behaviors of artificial neural network (ANN) and their application to science and engineering were summarized. The mechanism of two kinds of dynamical processes, i.e. weight dynamics and activation dynamics in neural networks, and the stability of computing in structural analysis and design were stated briefly. It was successfully applied to nonlinear neural network to evaluate the stability of underground stope structure in a gold mine. With the application of BP network, it is proven that the neuro-computing is a practical and advanced tool for solving large-scale underground rock engineering problems.
A hyperstable neural network for the modelling and control of nonlinear systems
Indian Academy of Sciences (India)
K Warwick; Q M Zhu; Z Ma
2000-04-01
A multivariable hyperstable robust adaptive decoupling control algorithm based on a neural network is presented for the control of nonlinear multivariable coupled systems with unknown parameters and structure. The Popov theorem is used in the design of the controller. The modelling errors, coupling action and other uncertainties of the system are identified on-line by a neural network. The identified results are taken as compensation signals such that the robust adaptive control of nonlinear systems is realised. Simulation results are given.
Model algorithm control using neural networks for input delayed nonlinear control system
Institute of Scientific and Technical Information of China (English)
Yuanliang Zhang; Kil To Chong
2015-01-01
The performance of the model algorithm control method is partial y based on the accuracy of the system’s model. It is diffi-cult to obtain a good model of a nonlinear system, especial y when the nonlinearity is high. Neural networks have the ability to“learn”the characteristics of a system through nonlinear mapping to rep-resent nonlinear functions as wel as their inverse functions. This paper presents a model algorithm control method using neural net-works for nonlinear time delay systems. Two neural networks are used in the control scheme. One neural network is trained as the model of the nonlinear time delay system, and the other one pro-duces the control inputs. The neural networks are combined with the model algorithm control method to control the nonlinear time delay systems. Three examples are used to il ustrate the proposed control method. The simulation results show that the proposed control method has a good control performance for nonlinear time delay systems.
Institute of Scientific and Technical Information of China (English)
顾成奎; 王正欧; 孙雅明
2003-01-01
A new method for identifying nonlinear time-varying systems with unknown structure is presented. The method extends the application area of basis sequence identification. The essential idea is to utilize the learning and nonlinear approximating ability of neural networks to model the non-linearity of the system, characterize time-varying dynamics of the system by the time-varying parametric vector of the network, then the parametric vector of the network is approximated by a weighted sum of known basis sequences. Because of black-box modeling ability of neural networks, the presented method can identify nonlinear time-varying systems with unknown structure. In order to improve the real-time capability of the algorithm, the neural network is trained by a simple fast learning algorithm based on local least squares presented by the authors. The effectiveness and the performance of the method are demonstrated by some simulation results.
Representation of nonlinear random transformations by non-gaussian stochastic neural networks.
Turchetti, Claudio; Crippa, Paolo; Pirani, Massimiliano; Biagetti, Giorgio
2008-06-01
The learning capability of neural networks is equivalent to modeling physical events that occur in the real environment. Several early works have demonstrated that neural networks belonging to some classes are universal approximators of input-output deterministic functions. Recent works extend the ability of neural networks in approximating random functions using a class of networks named stochastic neural networks (SNN). In the language of system theory, the approximation of both deterministic and stochastic functions falls within the identification of nonlinear no-memory systems. However, all the results presented so far are restricted to the case of Gaussian stochastic processes (SPs) only, or to linear transformations that guarantee this property. This paper aims at investigating the ability of stochastic neural networks to approximate nonlinear input-output random transformations, thus widening the range of applicability of these networks to nonlinear systems with memory. In particular, this study shows that networks belonging to a class named non-Gaussian stochastic approximate identity neural networks (SAINNs) are capable of approximating the solutions of large classes of nonlinear random ordinary differential transformations. The effectiveness of this approach is demonstrated and discussed by some application examples.
Neural network-based nonlinear model predictive control vs. linear quadratic gaussian control
Cho, C.; Vance, R.; Mardi, N.; Qian, Z.; Prisbrey, K.
1997-01-01
One problem with the application of neural networks to the multivariable control of mineral and extractive processes is determining whether and how to use them. The objective of this investigation was to compare neural network control to more conventional strategies and to determine if there are any advantages in using neural network control in terms of set-point tracking, rise time, settling time, disturbance rejection and other criteria. The procedure involved developing neural network controllers using both historical plant data and simulation models. Various control patterns were tried, including both inverse and direct neural network plant models. These were compared to state space controllers that are, by nature, linear. For grinding and leaching circuits, a nonlinear neural network-based model predictive control strategy was superior to a state space-based linear quadratic gaussian controller. The investigation pointed out the importance of incorporating state space into neural networks by making them recurrent, i.e., feeding certain output state variables into input nodes in the neural network. It was concluded that neural network controllers can have better disturbance rejection, set-point tracking, rise time, settling time and lower set-point overshoot, and it was also concluded that neural network controllers can be more reliable and easy to implement in complex, multivariable plants.
Characterization of nonlinear dynamic systems using artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Urbina, A. [Univ. of Texas, El Paso, TX (United States); Hunter, N.F. [Los Alamos National Lab., NM (United States). Engineering Science and Analysis Div.; Paez, T.L. [Sandia National Labs., Albuquerque, NM (United States). Experimental Structural Dynamics Dept.
1998-12-01
The efficient characterization of nonlinear systems is an important goal of vibration and model testing. The authors build a nonlinear system model based on the acceleration time series response of a single input, multiple output system. A series of local linear models are used as a template to train artificial neutral networks (ANNs). The trained ANNs map measured time series responses into states of a nonlinear system. Another NN propagates response states in time, and a third ANN inverts the original map, transforming states into acceleration predictions in the measurement domain. The technique is illustrated using a nonlinear oscillator, in which quadratic and cubic stiffness terms play a major part in the system`s response. Reasonable maps are obtained for the states, and accurate, long-term response predictions are made for data outside the training data set.
Nonlinear neural network for hemodynamic model state and input estimation using fMRI data
Karam, Ayman M.
2014-11-01
Originally inspired by biological neural networks, artificial neural networks (ANNs) are powerful mathematical tools that can solve complex nonlinear problems such as filtering, classification, prediction and more. This paper demonstrates the first successful implementation of ANN, specifically nonlinear autoregressive with exogenous input (NARX) networks, to estimate the hemodynamic states and neural activity from simulated and measured real blood oxygenation level dependent (BOLD) signals. Blocked and event-related BOLD data are used to test the algorithm on real experiments. The proposed method is accurate and robust even in the presence of signal noise and it does not depend on sampling interval. Moreover, the structure of the NARX networks is optimized to yield the best estimate with minimal network architecture. The results of the estimated neural activity are also discussed in terms of their potential use.
Absolute stability of nonlinear systems with time delays and applications to neural networks
Directory of Open Access Journals (Sweden)
Xinzhi Liu
2001-01-01
Full Text Available In this paper, absolute stability of nonlinear systems with time delays is investigated. Sufficient conditions on absolute stability are derived by using the comparison principle and differential inequalities. These conditions are simple and easy to check. In addition, exponential stability conditions for some special cases of nonlinear delay systems are discussed. Applications of those results to cellular neural networks are presented.
Koyuncu, A.; Cigeroglu, E.; Özgüven, H. N.
2017-10-01
In this study, a new approach is proposed for identification of structural nonlinearities by employing cascaded optimization and neural networks. Linear finite element model of the system and frequency response functions measured at arbitrary locations of the system are used in this approach. Using the finite element model, a training data set is created, which appropriately spans the possible nonlinear configurations space of the system. A classification neural network trained on these data sets then localizes and determines the types of all nonlinearities associated with the nonlinear degrees of freedom in the system. A new training data set spanning the parametric space associated with the determined nonlinearities is created to facilitate parametric identification. Utilizing this data set, initially, a feed forward regression neural network is trained, which parametrically identifies the classified nonlinearities. Then, the results obtained are further improved by carrying out an optimization which uses network identified values as starting points. Unlike identification methods available in literature, the proposed approach does not require data collection from the degrees of freedoms where nonlinear elements are attached, and furthermore, it is sufficiently accurate even in the presence of measurement noise. The application of the proposed approach is demonstrated on an example system with nonlinear elements and on a real life experimental setup with a local nonlinearity.
NONLINEAR MODELING AND CONTROLLING OF ARTIFICIAL MUSCLE SYSTEM USING NEURAL NETWORKS
Institute of Scientific and Technical Information of China (English)
Tian Sheping; Ding Guoqing; Yan Detian; Lin Liangming
2004-01-01
The pneumatic artificial muscles are widely used in the fields of medical robots,etc.Neural networks are applied to modeling and controlling of artificial muscle system.A single-joint artificial muscle test system is designed.The recursive prediction error (RPE) algorithm which yields faster convergence than back propagation (BP) algorithm is applied to train the neural networks.The realization of RPE algorithm is given.The difference of modeling of artificial muscles using neural networks with different input nodes and different hidden layer nodes is discussed.On this basis the nonlinear control scheme using neural networks for artificial muscle system has been introduced.The experimental results show that the nonlinear control scheme yields faster response and higher control accuracy than the traditional linear control scheme.
A new neural network model for the feedback stabilization of nonlinear systems
Institute of Scientific and Technical Information of China (English)
Mei-qin LIU; Sen-lin ZHANG; Gang-long YAN
2008-01-01
A new neural network model termed 'standard neural network model' (SNNM) is presented,and a state-feedback control law is then designed for the SNNM to stabilize the closed-loop system.The control design constraints are shown to be a set of linear matrix inequalities (LMIs),which can be easily solved by the MATLAB LMI Control Toolbox to determine the control law.Most recurrent neural networks (including the chaotic neural network) and nonlinear systems modeled by neural networks or Takagi and Sugeno (T-S) fuzzy models can be transformed into the SNNMs to be stabilization controllers synthesized in the framework of a unified SNNM.Finally,three numerical examples are provided to illustrate the design developed in this paper.
Sensor Fault Diagnosis for a Class of Time Delay Uncertain Nonlinear Systems Using Neural Network
Institute of Scientific and Technical Information of China (English)
Mou Chen; Chang-Sheng Jiang; Qing-Xian Wu
2008-01-01
In this paper, a sliding mode observer scheme of sensor fault diagnosis is proposed for a class of time delay nonlinear systems with input uncertainty based on neural network. The sensor fault and the system input uncertainty are assumed to be unknown but bounded. The radial basis function (RBF) neural network is used to approximate the sensor fault. Based on the output of the RBF neural network, the sliding mode observer is presented. Using the Lyapunov method, a criterion for stability is given in terms of matrix inequality. Finally, an example is given for illustrating the availability of the fault diagnosis based on the proposed sliding mode observer.
Linear and nonlinear ARMA model parameter estimation using an artificial neural network
Chon, K. H.; Cohen, R. J.
1997-01-01
This paper addresses parametric system identification of linear and nonlinear dynamic systems by analysis of the input and output signals. Specifically, we investigate the relationship between estimation of the system using a feedforward neural network model and estimation of the system by use of linear and nonlinear autoregressive moving-average (ARMA) models. By utilizing a neural network model incorporating a polynomial activation function, we show the equivalence of the artificial neural network to the linear and nonlinear ARMA models. We compare the parameterization of the estimated system using the neural network and ARMA approaches by utilizing data generated by means of computer simulations. Specifically, we show that the parameters of a simulated ARMA system can be obtained from the neural network analysis of the simulated data or by conventional least squares ARMA analysis. The feasibility of applying neural networks with polynomial activation functions to the analysis of experimental data is explored by application to measurements of heart rate (HR) and instantaneous lung volume (ILV) fluctuations.
A high-performance feedback neural network for solving convex nonlinear programming problems.
Leung, Yee; Chen, Kai-Zhou; Gao, Xing-Bao
2003-01-01
Based on a new idea of successive approximation, this paper proposes a high-performance feedback neural network model for solving convex nonlinear programming problems. Differing from existing neural network optimization models, no dual variables, penalty parameters, or Lagrange multipliers are involved in the proposed network. It has the least number of state variables and is very simple in structure. In particular, the proposed network has better asymptotic stability. For an arbitrarily given initial point, the trajectory of the network converges to an optimal solution of the convex nonlinear programming problem under no more than the standard assumptions. In addition, the network can also solve linear programming and convex quadratic programming problems, and the new idea of a feedback network may be used to solve other optimization problems. Feasibility and efficiency are also substantiated by simulation examples.
Institute of Scientific and Technical Information of China (English)
Endong LIU; Yuanwei JING; Siying ZHANG
2005-01-01
Based on high order dynamic neural network,this paper presents the tracking problem for uncertain nonlinear composite system,which contains external disturbance,whose nonlinearities are assumed to be unknown.A smooth controller is designed to guarantee a uniform ultimate boundedness property for the tracking error and all other signals in the closed loop.Certain measures are utilized to test its performance.No a priori knowledge of an upper bound on the "optimal" weight and modeling error is required;the weights of neural networks are updated on-line.Numerical simulations performed on a simple example illustrate and clarify the approach.
Application of BP neural networks in non-linearity correction of optical tweezers
Institute of Scientific and Technical Information of China (English)
Ziqiang WANG; Yinmei LI; Liren LOU; Henghua WEI; Zhong WANG
2008-01-01
The back-propagation (BP) neural network is proposed to correct nonlinearity and optimize the force measurement and calibration of an optical tweezer sys-tem. Considering the low convergence rate of the BP algo-rithm, the Levenberg-Marquardt (LM) algorithm is used to improve the BP network. The proposed method is experimentally studied for force calibration in a typical optical tweezer system using hydromechanics. The result shows that with the nonlinear correction using BP net-works, the range of force measurement of an optical tweezer system is enlarged by 30% and the precision is also improved compared with the polynomial fitting method. It is demonstrated that nonlinear correction by the neural network method effectively improves the per-formance of optical tweezers without adding or changing the measuring system.
Lukasiewicz-Topos Models of Neural Networks, Cell Genome and Interactome Nonlinear Dynamic Models
Baianu, I C
2004-01-01
A categorical and Lukasiewicz-Topos framework for Lukasiewicz Algebraic Logic models of nonlinear dynamics in complex functional systems such as neural networks, genomes and cell interactomes is proposed. Lukasiewicz Algebraic Logic models of genetic networks and signaling pathways in cells are formulated in terms of nonlinear dynamic systems with n-state components that allow for the generalization of previous logical models of both genetic activities and neural networks. An algebraic formulation of variable 'next-state functions' is extended to a Lukasiewicz Topos with an n-valued Lukasiewicz Algebraic Logic subobject classifier description that represents non-random and nonlinear network activities as well as their transformations in developmental processes and carcinogenesis.
A novel nonlinear adaptive filter using a pipelined second-order Volterra recurrent neural network.
Zhao, Haiquan; Zhang, Jiashu
2009-12-01
To enhance the performance and overcome the heavy computational complexity of recurrent neural networks (RNN), a novel nonlinear adaptive filter based on a pipelined second-order Volterra recurrent neural network (PSOVRNN) is proposed in this paper. A modified real-time recurrent learning (RTRL) algorithm of the proposed filter is derived in much more detail. The PSOVRNN comprises of a number of simple small-scale second-order Volterra recurrent neural network (SOVRNN) modules. In contrast to the standard RNN, these modules of a PSOVRNN can be performed simultaneously in a pipelined parallelism fashion, which can lead to a significant improvement in its total computational efficiency. Moreover, since each module of the PSOVRNN is a SOVRNN in which nonlinearity is introduced by the recursive second-order Volterra (RSOV) expansion, its performance can be further improved. Computer simulations have demonstrated that the PSOVRNN performs better than the pipelined recurrent neural network (PRNN) and RNN for nonlinear colored signals prediction and nonlinear channel equalization. However, the superiority of the PSOVRNN over the PRNN is at the cost of increasing computational complexity due to the introduced nonlinear expansion of each module.
Adaptive Control of Nonlinear Discrete-Time Systems by Using OS-ELM Neural Networks
Directory of Open Access Journals (Sweden)
Xiao-Li Li
2014-01-01
Full Text Available As a kind of novel feedforward neural network with single hidden layer, ELM (extreme learning machine neural networks are studied for the identification and control of nonlinear dynamic systems. The property of simple structure and fast convergence of ELM can be shown clearly. In this paper, we are interested in adaptive control of nonlinear dynamic plants by using OS-ELM (online sequential extreme learning machine neural networks. Based on data scope division, the problem that training process of ELM neural network is sensitive to the initial training data is also solved. According to the output range of the controlled plant, the data corresponding to this range will be used to initialize ELM. Furthermore, due to the drawback of conventional adaptive control, when the OS-ELM neural network is used for adaptive control of the system with jumping parameters, the topological structure of the neural network can be adjusted dynamically by using multiple model switching strategy, and an MMAC (multiple model adaptive control will be used to improve the control performance. Simulation results are included to complement the theoretical results.
CONTROL OF NONLINEAR PROCESS USING NEURAL NETWORK BASED MODEL PREDICTIVE CONTROL
Directory of Open Access Journals (Sweden)
Dr.A.TRIVEDI
2011-04-01
Full Text Available This paper presents a Neural Network based Model Predictive Control (NNMPC strategy to control nonlinear process. Multilayer Perceptron Neural Network (MLP is chosen to represent a Nonlinear Auto Regressive with eXogenous signal (NARX model of a nonlinear system. NARX dynamic model is based on feed-forward architecture and offers good approximation capabilities along with robustness and accuracy. Based on the identified neural model, a generalized predictive control (GPC algorithm is implemented to control the composition in acontinuous stirred tank reactor (CSTR, whose parameters are optimally determined by solving quadratic performance index using well known Levenberg-Marquardt and Quasi-Newton algorithm. NNMPC is tuned by selecting few horizon parameters and weighting factor. The tracking performance of the NNMPC is tested using different amplitude function as a reference signal on CSTR application. Also the robustness and performance is tested in the presence of disturbance on random reference signal.
Dynamic Structure Neural Networks for Stable Adaptive Control of Nonlinear Systems
Fabri, S.; Kadirkamanathan, V.
1994-01-01
An adaptive control technique, using dynamic structure Gaussian radical basis function neural networks, that grow in time according to the location of the system's state in space is presented for the affine class of nonlinear systems having unknown or partially known dynamics. The method results in a network that is economic in terms of network size, for cases where the state spans only a small subset of state space, by utilising less basis functions than would have been the case if basis fun...
Nonlinear System Identification Using Neural Networks Trained with Natural Gradient Descent
Directory of Open Access Journals (Sweden)
Ibnkahla Mohamed
2003-01-01
Full Text Available We use natural gradient (NG learning neural networks (NNs for modeling and identifying nonlinear systems with memory. The nonlinear system is comprised of a discrete-time linear filter followed by a zero-memory nonlinearity . The NN model is composed of a linear adaptive filter followed by a two-layer memoryless nonlinear NN. A Kalman filter-based technique and a search-and-converge method have been employed for the NG algorithm. It is shown that the NG descent learning significantly outperforms the ordinary gradient descent and the Levenberg-Marquardt (LM procedure in terms of convergence speed and mean squared error (MSE performance.
Directory of Open Access Journals (Sweden)
Luis Gonzaga Baca Ruiz
2016-08-01
Full Text Available This paper addresses the problem of energy consumption prediction using neural networks over a set of public buildings. Since energy consumption in the public sector comprises a substantial share of overall consumption, the prediction of such consumption represents a decisive issue in the achievement of energy savings. In our experiments, we use the data provided by an energy consumption monitoring system in a compound of faculties and research centers at the University of Granada, and provide a methodology to predict future energy consumption using nonlinear autoregressive (NAR and the nonlinear autoregressive neural network with exogenous inputs (NARX, respectively. Results reveal that NAR and NARX neural networks are both suitable for performing energy consumption prediction, but also that exogenous data may help to improve the accuracy of predictions.
Passivation and control of partially known SISO nonlinear systems via dynamic neural networks
Reyes-Reyes J.; yu W.; Poznyak A. S.
2000-01-01
In this paper, an adaptive technique is suggested to provide the passivity property for a class of partially known SISO nonlinear systems. A simple Dynamic Neural Network (DNN), containing only two neurons and without any hidden-layers, is used to identify the unknown nonlinear system. By means of a Lyapunov-like analysis the new learning law for this DNN, guarantying both successful identification and passivation effects, is derived. Based on this adaptive DNN model, an adaptive feedback con...
DEFF Research Database (Denmark)
Chon, K H; Holstein-Rathlou, N H; Marsh, D J
1998-01-01
via the Laguerre expansion technique achieve this prediction NMSE with approximately half the number of free parameters relative to either neural-network model. However, both approaches are deemed effective in modeling nonlinear dynamic systems and their cooperative use is recommended in general....
Pinning Synchronization of Delayed Neural Networks with Nonlinear Inner-Coupling
Directory of Open Access Journals (Sweden)
Yangling Wang
2011-01-01
Full Text Available Without assuming the symmetry and irreducibility of the outer-coupling weight configuration matrices, we investigate the pinning synchronization of delayed neural networks with nonlinear inner-coupling. Some delay-dependent controlled stability criteria in terms of linear matrix inequality (LMI are obtained. An example is presented to show the application of the criteria obtained in this paper.
Directory of Open Access Journals (Sweden)
Nahid Ardalani
2011-07-01
Full Text Available This article describes linear and nonlinear Artificial Neural Network(ANN-based predictors as Autoregressive Moving Average models with Auxiliary input (ARMAX process for Signal to Interference plus Noise Ratio (SINR prediction in Direct Sequence Code Division Multiple Access (DS/CDMA systems. The Multi Layer Perceptron (MLP neural network with nonlinear function is used as nonlinear neural network and Adaptive Linear (Adaline predictor is used as linear predictor. The problem of complexity of the MLP and Adaline structures is solved by using the Minimum Mean Squared Error (MMSE principle to select the optimal numbers of input and hidden nodes by try and error role. Simulation results show that both of MLP and Adaline optimal neural networks can track the effect of deep fading due to using a 1.8 GHZ carrier frequency at the urban mobile speeds of 10 km/h, 50 km/h and 120 km/h with tolerable estimation errors. Therefore, the neural networkbased predictor is well suitable SINR-based predictor in closedloop power control to combat multi path fading in CDMA systems.
Nonlinear model predictive control with guaraneed stability based on pesudolinear neural networks
Institute of Scientific and Technical Information of China (English)
WANG Yongji; WANG Hong
2004-01-01
A nonlinear model predictive control problem based on pseudo-linear neural network (PNN) is discussed, in which the second order on-line optimization method is adopted. The recursive computation of Jacobian matrix is investigated. The stability of the closed loop model predictive control system is analyzed based on Lyapunov theory to obtain the sufficient condition for the asymptotical stability of the neural predictive control system. A simulation was carried out for an exothermic first-order reaction in a continuous stirred tank reactor. It is demonstrated that the proposed control strategy is applicable to some of nonlinear systems.
Adaptive Backstepping Output Feedback Control for SISO Nonlinear System Using Fuzzy Neural Networks
Institute of Scientific and Technical Information of China (English)
Shao-Cheng Tong; Yong-Ming Li
2009-01-01
In this paper, a new fuzzy-neural adaptive control approach is developed for a class of single-input and single-output (SISO) nonlinear systems with unmeasured states. Using fuzzy neural networks to approximate the unknown nonlinear functions, a fuzzy-neural adaptive observer is introduced for state estimation as well as system identification. Under the framework of the backstepping design, fuzzy-neural adaptive output feedback control is constructed rccursively. It is proven that the proposed fuzzy adaptive control approach guarantees the global boundedness property for all the signals, driving the tracking error to a small neighbordhood of the origin. Simulation example is included to illustrate the effectiveness of the proposed approach.
H∞ output tracking control of discrete-time nonlinear systems via standard neural network models.
Liu, Meiqin; Zhang, Senlin; Chen, Haiyang; Sheng, Weihua
2014-10-01
This brief proposes an output tracking control for a class of discrete-time nonlinear systems with disturbances. A standard neural network model is used to represent discrete-time nonlinear systems whose nonlinearity satisfies the sector conditions. H∞ control performance for the closed-loop system including the standard neural network model, the reference model, and state feedback controller is analyzed using Lyapunov-Krasovskii stability theorem and linear matrix inequality (LMI) approach. The H∞ controller, of which the parameters are obtained by solving LMIs, guarantees that the output of the closed-loop system closely tracks the output of a given reference model well, and reduces the influence of disturbances on the tracking error. Three numerical examples are provided to show the effectiveness of the proposed H∞ output tracking design approach.
Directory of Open Access Journals (Sweden)
Oscar Castillo
2013-01-01
Full Text Available Neural networks (NNs, type-1 fuzzy logic systems (T1FLSs, and interval type-2 fuzzy logic systems (IT2FLSs have been shown to be universal approximators, which means that they can approximate any nonlinear continuous function. Recent research shows that embedding an IT2FLS on an NN can be very effective for a wide number of nonlinear complex systems, especially when handling imperfect or incomplete information. In this paper we show, based on the Stone-Weierstrass theorem, that an interval type-2 fuzzy neural network (IT2FNN is a universal approximator, which uses a set of rules and interval type-2 membership functions (IT2MFs for this purpose. Simulation results of nonlinear function identification using the IT2FNN for one and three variables and for the Mackey-Glass chaotic time series prediction are presented to illustrate the concept of universal approximation.
Energy Technology Data Exchange (ETDEWEB)
Ritter, G.X.; Sussner, P. [Univ. of Florida, Gainesville, FL (United States)
1996-12-31
The theory of artificial neural networks has been successfully applied to a wide variety of pattern recognition problems. In this theory, the first step in computing the next state of a neuron or in performing the next layer neural network computation involves the linear operation of multiplying neural values by their synaptic strengths and adding the results. Thresholding usually follows the linear operation in order to provide for nonlinearity of the network. In this paper we introduce a novel class of neural networks, called morphological neural networks, in which the operations of multiplication and addition are replaced by addition and maximum (or minimum), respectively. By taking the maximum (or minimum) of sums instead of the sum of products, morphological network computation is nonlinear before thresholding. As a consequence, the properties of morphological neural networks are drastically different than those of traditional neural network models. In this paper we consider some of these differences and provide some particular examples of morphological neural network.
Nonlinear Model Predictive Control Based on a Self-Organizing Recurrent Neural Network.
Han, Hong-Gui; Zhang, Lu; Hou, Ying; Qiao, Jun-Fei
2016-02-01
A nonlinear model predictive control (NMPC) scheme is developed in this paper based on a self-organizing recurrent radial basis function (SR-RBF) neural network, whose structure and parameters are adjusted concurrently in the training process. The proposed SR-RBF neural network is represented in a general nonlinear form for predicting the future dynamic behaviors of nonlinear systems. To improve the modeling accuracy, a spiking-based growing and pruning algorithm and an adaptive learning algorithm are developed to tune the structure and parameters of the SR-RBF neural network, respectively. Meanwhile, for the control problem, an improved gradient method is utilized for the solution of the optimization problem in NMPC. The stability of the resulting control system is proved based on the Lyapunov stability theory. Finally, the proposed SR-RBF neural network-based NMPC (SR-RBF-NMPC) is used to control the dissolved oxygen (DO) concentration in a wastewater treatment process (WWTP). Comparisons with other existing methods demonstrate that the SR-RBF-NMPC can achieve a considerably better model fitting for WWTP and a better control performance for DO concentration.
Passivation and control of partially known SISO nonlinear systems via dynamic neural networks
Directory of Open Access Journals (Sweden)
Reyes-Reyes J.
2000-01-01
Full Text Available In this paper, an adaptive technique is suggested to provide the passivity property for a class of partially known SISO nonlinear systems. A simple Dynamic Neural Network (DNN, containing only two neurons and without any hidden-layers, is used to identify the unknown nonlinear system. By means of a Lyapunov-like analysis the new learning law for this DNN, guarantying both successful identification and passivation effects, is derived. Based on this adaptive DNN model, an adaptive feedback controller, serving for wide class of nonlinear systems with an a priori incomplete model description, is designed. Two typical examples illustrate the effectiveness of the suggested approach.
Multiple-model-and-neural-network-based nonlinear multivariable adaptive control
Institute of Scientific and Technical Information of China (English)
Yue FU; Tianyou CHAI
2007-01-01
A multivariable adaptive controller feasible for implementation on distributed computer systems (DCS) is presented for a class of uncertain nonlinear multivariable discrete time systems. The adaptive controller is composed of a linear adaptive controller, a neural network nonlinear adaptive controller and a switching mechanism. The linear controller can provide boundedness of the input and output signals, and the nonlinear controller can improve the performance of the system. The purpose of using the switching mechanism is to obtain the improved system performance and stability simultaneously. Theory analysis and simulation results are presented to show the effectiveness of the proposed method.
Identification of Nonlinear Dynamic Systems Using Hammerstein-Type Neural Network
Directory of Open Access Journals (Sweden)
Hongshan Yu
2014-01-01
Full Text Available Hammerstein model has been popularly applied to identify the nonlinear systems. In this paper, a Hammerstein-type neural network (HTNN is derived to formulate the well-known Hammerstein model. The HTNN consists of a nonlinear static gain in cascade with a linear dynamic part. First, the Lipschitz criterion for order determination is derived. Second, the backpropagation algorithm for updating the network weights is presented, and the stability analysis is also drawn. Finally, simulation results show that HTNN identification approach demonstrated identification performances.
Chung-Ming Kuan
2006-01-01
Artificial neural networks (ANNs) constitute a class of flexible nonlinear models designed to mimic biological neural systems. In this entry, we introduce ANN using familiar econometric terminology and provide an overview of ANN modeling approach and its implementation methods.
Design of asymptotic estimators: an approach based on neural networks and nonlinear programming.
Alessandri, Angelo; Cervellera, Cristiano; Sanguineti, Marcello
2007-01-01
A methodology to design state estimators for a class of nonlinear continuous-time dynamic systems that is based on neural networks and nonlinear programming is proposed. The estimator has the structure of a Luenberger observer with a linear gain and a parameterized (in general, nonlinear) function, whose argument is an innovation term representing the difference between the current measurement and its prediction. The problem of the estimator design consists in finding the values of the gain and of the parameters that guarantee the asymptotic stability of the estimation error. Toward this end, if a neural network is used to take on this function, the parameters (i.e., the neural weights) are chosen, together with the gain, by constraining the derivative of a quadratic Lyapunov function for the estimation error to be negative definite on a given compact set. It is proved that it is sufficient to impose the negative definiteness of such a derivative only on a suitably dense grid of sampling points. The gain is determined by solving a Lyapunov equation. The neural weights are searched for via nonlinear programming by minimizing a cost penalizing grid-point constraints that are not satisfied. Techniques based on low-discrepancy sequences are applied to deal with a small number of sampling points, and, hence, to reduce the computational burden required to optimize the parameters. Numerical results are reported and comparisons with those obtained by the extended Kalman filter are made.
Institute of Scientific and Technical Information of China (English)
Tao CHENG; Frank L.LEWIS
2007-01-01
In this paper,neural networks are used to approximately solve the finite-horizon constrained input H-infiniy state feedback control problem.The method is based on solving a related Hamilton-Jacobi-Isaacs equation of the corresponding finite-horizon zero-sum game.The game value function is approximated by a neural network wlth timevarying weights.It is shown that the neural network approximation converges uniformly to the game-value function and the resulting almost optimal constrained feedback controller provides closed-loop stability and bounded L2 gain.The result is an almost optimal H-infinity feedback controller with time-varying coefficients that is solved a priori off-line.The effectiveness of the method is shown on the Rotational/Translational Actuator benchmark nonlinear control problem.
Spatially Nonlinear Interdependence of Alpha-Oscillatory Neural Networks under Chan Meditation
Directory of Open Access Journals (Sweden)
Pei-Chen Lo
2013-01-01
Full Text Available This paper reports the results of our investigation of the effects of Chan meditation on brain electrophysiological behaviors from the viewpoint of spatially nonlinear interdependence among regional neural networks. Particular emphasis is laid on the alpha-dominated EEG (electroencephalograph. Continuous-time wavelet transform was adopted to detect the epochs containing substantial alpha activities. Nonlinear interdependence quantified by similarity index S(X∣Y, the influence of source signal Y on sink signal X, was applied to the nonlinear dynamical model in phase space reconstructed from multichannel EEG. Experimental group involved ten experienced Chan-Meditation practitioners, while control group included ten healthy subjects within the same age range, yet, without any meditation experience. Nonlinear interdependence among various cortical regions was explored for five local neural-network regions, frontal, posterior, right-temporal, left-temporal, and central regions. In the experimental group, the inter-regional interaction was evaluated for the brain dynamics under three different stages, at rest (stage R, pre-meditation background recording, in Chan meditation (stage M, and the unique Chakra-focusing practice (stage C. Experimental group exhibits stronger interactions among various local neural networks at stages M and C compared with those at stage R. The intergroup comparison demonstrates that Chan-meditation brain possesses better cortical inter-regional interactions than the resting brain of control group.
Neural-network-based approximate output regulation of discrete-time nonlinear systems.
Lan, Weiyao; Huang, Jie
2007-07-01
The existing approaches to the discrete-time nonlinear output regulation problem rely on the offline solution of a set of mixed nonlinear functional equations known as discrete regulator equations. For complex nonlinear systems, it is difficult to solve the discrete regulator equations even approximately. Moreover, for systems with uncertainty, these approaches cannot offer a reliable solution. By combining the approximation capability of the feedforward neural networks (NNs) with an online parameter optimization mechanism, we develop an approach to solving the discrete nonlinear output regulation problem without solving the discrete regulator equations explicitly. The approach of this paper can be viewed as a discrete counterpart of our previous paper on approximately solving the continuous-time nonlinear output regulation problem.
A Novel Method for Nonlinear Time Series Forecasting of Time-Delay Neural Network
Institute of Scientific and Technical Information of China (English)
JIANG Weijin; XU Yuhui
2006-01-01
Based on the idea of nonlinear prediction of phase space reconstruction, this paper presented a time delay BP neural network model, whose generalization capability was improved by Bayesian regularization.Furthermore, the model is applied to forecast the import and export trades in one industry.The results showed that the improved model has excellent generalization capabilities, which not only learned the historical curve, but efficiently predicted the trend of business.Comparing with common evaluation of forecasts, we put on a conclusion that nonlinear forecast can not only focus on data combination and precision improvement, it also can vividly reflect the nonlinear characteristic of the forecasting system.While analyzing the forecasting precision of the model, we give a model judgment by calculating the nonlinear characteristic value of the combined serial and original serial, proved that the forecasting model can reasonably catch' the dynamic characteristic of the nonlinear system which produced the origin serial.
Institute of Scientific and Technical Information of China (English)
SHI Shi-liang; LIU Hai-bo; LIU Ai-hua
2004-01-01
Based on the integration analysis of goods and shortcomings of various methods used in safety assessment of coal mines, combining nonlinear feature of mine safety sub-system, this paper establishes the neural network assessment model of mine safety, analyzes the ability of artificial neural network to evaluate mine safety state, and lays the theoretical foundation of artificial neural network using in the systematic optimization of mine safety assessment and getting reasonable accurate safety assessment result.
Solving Nonlinearly Separable Classifications in a Single-Layer Neural Network.
Conaway, Nolan; Kurtz, Kenneth J
2017-03-01
Since the work of Minsky and Papert ( 1969 ), it has been understood that single-layer neural networks cannot solve nonlinearly separable classifications (i.e., XOR). We describe and test a novel divergent autoassociative architecture capable of solving nonlinearly separable classifications with a single layer of weights. The proposed network consists of class-specific linear autoassociators. The power of the model comes from treating classification problems as within-class feature prediction rather than directly optimizing a discriminant function. We show unprecedented learning capabilities for a simple, single-layer network (i.e., solving XOR) and demonstrate that the famous limitation in acquiring nonlinearly separable problems is not just about the need for a hidden layer; it is about the choice between directly predicting classes or learning to classify indirectly by predicting features.
Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation.
Li, Shuai; Li, Yangming
2013-10-28
The Sylvester equation is often encountered in mathematics and control theory. For the general time-invariant Sylvester equation problem, which is defined in the domain of complex numbers, the Bartels-Stewart algorithm and its extensions are effective and widely used with an O(n³) time complexity. When applied to solving the time-varying Sylvester equation, the computation burden increases intensively with the decrease of sampling period and cannot satisfy continuous realtime calculation requirements. For the special case of the general Sylvester equation problem defined in the domain of real numbers, gradient-based recurrent neural networks are able to solve the time-varying Sylvester equation in real time, but there always exists an estimation error while a recently proposed recurrent neural network by Zhang et al [this type of neural network is called Zhang neural network (ZNN)] converges to the solution ideally. The advancements in complex-valued neural networks cast light to extend the existing real-valued ZNN for solving the time-varying real-valued Sylvester equation to its counterpart in the domain of complex numbers. In this paper, a complex-valued ZNN for solving the complex-valued Sylvester equation problem is investigated and the global convergence of the neural network is proven with the proposed nonlinear complex-valued activation functions. Moreover, a special type of activation function with a core function, called sign-bi-power function, is proven to enable the ZNN to converge in finite time, which further enhances its advantage in online processing. In this case, the upper bound of the convergence time is also derived analytically. Simulations are performed to evaluate and compare the performance of the neural network with different parameters and activation functions. Both theoretical analysis and numerical simulations validate the effectiveness of the proposed method.
Nonlinear modelling of a SOFC stack by improved neural networks identification
Institute of Scientific and Technical Information of China (English)
无
2007-01-01
The solid oxide fuel cell (SOFC) is a nonlinear system that is hard to model by conventional methods. So far, most existing models are based on conversion laws, which are too complicated to be applied to design a control system. To facilitate a valid control strategy design, this paper tries to avoid the internal complexities and presents a modelling study of SOFC performance by using a radial basis function (RBF) neural network based on a genetic algorithm (GA). During the process of modelling, the GA aims to optimize the parameters of RBF neural networks and the optimum values are regarded as the initial values of the RBF neural network parameters. The validity and accuracy of modelling are tested by simulations, whose results reveal that it is feasible to establish the model of SOFC stack by using RBF neural networks identification based on the GA. Furthermore, it is possible to design an online controller of a SOFC stack based on this GA-RBF neural network identification model.
Nonlinear inversion of electrical resistivity imaging using pruning Bayesian neural networks
Jiang, Fei-Bo; Dai, Qian-Wei; Dong, Li
2016-06-01
Conventional artificial neural networks used to solve electrical resistivity imaging (ERI) inversion problem suffer from overfitting and local minima. To solve these problems, we propose to use a pruning Bayesian neural network (PBNN) nonlinear inversion method and a sample design method based on the K-medoids clustering algorithm. In the sample design method, the training samples of the neural network are designed according to the prior information provided by the K-medoids clustering results; thus, the training process of the neural network is well guided. The proposed PBNN, based on Bayesian regularization, is used to select the hidden layer structure by assessing the effect of each hidden neuron to the inversion results. Then, the hyperparameter α k , which is based on the generalized mean, is chosen to guide the pruning process according to the prior distribution of the training samples under the small-sample condition. The proposed algorithm is more efficient than other common adaptive regularization methods in geophysics. The inversion of synthetic data and field data suggests that the proposed method suppresses the noise in the neural network training stage and enhances the generalization. The inversion results with the proposed method are better than those of the BPNN, RBFNN, and RRBFNN inversion methods as well as the conventional least squares inversion.
Nonlinear identification and control a neural network approach
Liu, G P
2001-01-01
The series Advances in Industrial Control aims to report and encourage technology transfer in control engineering. The rapid development of control technology has an impact on all areas of the control discipline. New theory, new controllers, actuators, sensors, new industrial processes, computer methods, new applications, new philosophies . . . , new challenges. Much of this development work resides in industrial reports, feasibility study papers and the reports of advanced collaborative projects. The series otTers an opportunity for researchers to present an extended exposition of such new work in all aspects of industrial control for wider and rapid dissemination. The time for nonlinear control to enter routine application seems to be approaching. Nonlinear control has had a long gestation period but much ofthe past has been concerned with methods that involve formal nonlinear functional model representations. It seems more likely that the breakthough will come through the use of other more flexible and ame...
Differential Neural Networks for Identification and Filtering in Nonlinear Dynamic Games
Directory of Open Access Journals (Sweden)
Emmanuel García
2014-01-01
Full Text Available This paper deals with the problem of identifying and filtering a class of continuous-time nonlinear dynamic games (nonlinear differential games subject to additive and undesired deterministic perturbations. Moreover, the mathematical model of this class is completely unknown with the exception of the control actions of each player, and even though the deterministic noises are known, their power (or their effect is not. Therefore, two differential neural networks are designed in order to obtain a feedback (perfect state information pattern for the mentioned class of games. In this way, the stability conditions for two state identification errors and for a filtering error are established, the upper bounds of these errors are obtained, and two new learning laws for each neural network are suggested. Finally, an illustrating example shows the applicability of this approach.
A high performance neural network for solving nonlinear programming problems with hybrid constraints
Tao, Qing; Cao, Jinde; Xue, Meisheng; Qiao, Hong
2001-09-01
A continuous neural network is proposed in this Letter for solving optimization problems. It not only can solve nonlinear programming problems with the constraints of equality and inequality, but also has a higher performance. The main advantage of the network is that it is an extension of Newton's gradient method for constrained problems, the dynamic behavior of the network under special constraints and the convergence rate can be investigated. Furthermore, the proposed network is simpler than the existing networks even for solving positive definite quadratic programming problems. The network considered is constrained by a projection operator on a convex set. The advanced performance of the proposed network is demonstrated by means of simulation of several numerical examples.
Neural networks for modelling and control of a non-linear dynamic system
Murray-Smith, R.; Neumerkel, D.; Sbarbaro-Hofer, D.
1992-01-01
The authors describe the use of neural nets to model and control a nonlinear second-order electromechanical model of a drive system with varying time constants and saturation effects. A model predictive control structure is used. This is compared with a proportional-integral (PI) controller with regard to performance and robustness against disturbances. Two feedforward network types, the multilayer perceptron and radial-basis-function nets, are used to model the system. The problems involved ...
Non-Minimum Phase Nonlinear System Predictive Control Based on Local Recurrent Neural Networks
Institute of Scientific and Technical Information of China (English)
张燕; 陈增强; 袁著祉
2003-01-01
After a recursive multi-step-ahead predictor for nonlinear systems based on local recurrent neural networks is introduced, an intelligent PID controller is adopted to correct the errors including identified model errors and accumulated errors produced in the recursive process. Characterized by predictive control, this method can achieve a good control accuracy and has good robustness. A simulation study shows that this control algorithm is very effective.
Dynamic neural network-based robust observers for uncertain nonlinear systems.
Dinh, H T; Kamalapurkar, R; Bhasin, S; Dixon, W E
2014-12-01
A dynamic neural network (DNN) based robust observer for uncertain nonlinear systems is developed. The observer structure consists of a DNN to estimate the system dynamics on-line, a dynamic filter to estimate the unmeasurable state and a sliding mode feedback term to account for modeling errors and exogenous disturbances. The observed states are proven to asymptotically converge to the system states of high-order uncertain nonlinear systems through Lyapunov-based analysis. Simulations and experiments on a two-link robot manipulator are performed to show the effectiveness of the proposed method in comparison to several other state estimation methods.
Adaptive neural network tracking control for a class of unknown nonlinear time-delay systems
Institute of Scientific and Technical Information of China (English)
Chen Weisheng; Li Junmin
2006-01-01
For a class of unknown nonlinear time-delay systems, an adaptive neural network (NN) control design approach is proposed. Backstepping, domination and adaptive bounding design technique are combined to construct a robust memoryless adaptive NN tracking controller. Unknown time-delay functions are approximated by NNs, such that the requirement on the nonlinear time-delay functions is relaxed. Based on Lyapunov-Krasoviskii functional, the sem-global uniformly ultimately boundedness (UUB) of all the signals in the closed-loop system is proved. The arbitrary output tracking accuracy is achieved by tuning the design parameters. The feasibility is investigated by an illustrative simulation example.
Nonlinear systems identification and control via dynamic multitime scales neural networks.
Fu, Zhi-Jun; Xie, Wen-Fang; Han, Xuan; Luo, Wei-Dong
2013-11-01
This paper deals with the adaptive nonlinear identification and trajectory tracking via dynamic multilayer neural network (NN) with different timescales. Two NN identifiers are proposed for nonlinear systems identification via dynamic NNs with different timescales including both fast and slow phenomenon. The first NN identifier uses the output signals from the actual system for the system identification. In the second NN identifier, all the output signals from nonlinear system are replaced with the state variables of the NNs. The online identification algorithms for both NN identifier parameters are proposed using Lyapunov function and singularly perturbed techniques. With the identified NN models, two indirect adaptive NN controllers for the nonlinear systems containing slow and fast dynamic processes are developed. For both developed adaptive NN controllers, the trajectory errors are analyzed and the stability of the systems is proved. Simulation results show that the controller based on the second identifier has better performance than that of the first identifier.
NONLINEAR EXTENSION OF ASYMMETRIC GARCH MODEL WITHIN NEURAL NETWORK FRAMEWORK
Directory of Open Access Journals (Sweden)
Josip Arnerić
2016-05-01
Full Text Available The importance of volatility for all market participants has led to the development and application of various econometric models. The most popular models in modelling volatility are GARCH type models because they can account excess kurtosis and asymmetric effects of financial time series. Since standard GARCH(1,1 model usually indicate high persistence in the conditional variance, the empirical researches turned to GJR-GARCH model and reveal its superiority in fitting the asymmetric heteroscedasticity in the data. In order to capture both asymmetry and nonlinearity in data, the goal of this paper is to develop a parsimonious NN model as an extension to GJR-GARCH model and to determine if GJR-GARCH-NN outperforms the GJR-GARCH model.
Wu, Li-Bing; Yang, Guang-Hong
2017-03-01
This paper investigates the problem of adaptive output neural network (NN) control for a class of stochastic nonaffine and nonlinear systems with actuator dead-zone inputs. First, based on the intermediate value theorem, a novel design scheme that converts the nonaffine system into the corresponding affine system is developed. In particular, the priori knowledge of the bound of the derivative of the nonaffine and nonlinear functions is removed; then, by employing NNs to approximate the appropriate nonlinear functions, the corresponding adaptive NN tracking controller with the adjustable parameter updated laws is designed through a backstepping technique. Furthermore, it is shown that all the closed-loop signals are bounded in probability, and the system output tracking error can converge to a small neighborhood in the sense of a mean quartic value. Finally, experimental simulations are provided to demonstrate the efficiency of the proposed adaptive NN tracking control method.
Neural-network predictive control for nonlinear dynamic systems with time-delay.
Huang, Jin-Quan; Lewis, F L
2003-01-01
A new recurrent neural-network predictive feedback control structure for a class of uncertain nonlinear dynamic time-delay systems in canonical form is developed and analyzed. The dynamic system has constant input and feedback time delays due to a communications channel. The proposed control structure consists of a linearized subsystem local to the controlled plant and a remote predictive controller located at the master command station. In the local linearized subsystem, a recurrent neural network with on-line weight tuning algorithm is employed to approximate the dynamics of the time-delay-free nonlinear plant. No linearity in the unknown parameters is required. No preliminary off-line weight learning is needed. The remote controller is a modified Smith predictor that provides prediction and maintains the desired tracking performance; an extra robustifying term is needed to guarantee stability. Rigorous stability proofs are given using Lyapunov analysis. The result is an adaptive neural net compensation scheme for unknown nonlinear systems with time delays. A simulation example is provided to demonstrate the effectiveness of the proposed control strategy.
Directory of Open Access Journals (Sweden)
Laila Khalilzadeh Ganjali-khani
2013-01-01
Full Text Available One of the most effective strategies for steam generator efficiency enhancement is to improve the control system. For such an improvement, it is essential to have an accurate model for the steam generator of power plant. In this paper, an industrial steam generator is considered as a nonlinear multivariable system for identification. An important step in nonlinear system identification is the development of a nonlinear model. In recent years, artificial neural networks have been successfully used for identification of nonlinear systems in many researches. Wavelet neural networks (WNNs also are used as a powerful tool for nonlinear system identification. In this paper we present a time delay neural network model and a WNN model in order to identify an industrial steam generator. Simulation results show the effectiveness of the proposed models in the system identification and demonstrate that the WNN model is more precise to estimate the plant outputs.
Kumar, Rajesh; Srivastava, Smriti; Gupta, J R P
2017-03-01
In this paper adaptive control of nonlinear dynamical systems using diagonal recurrent neural network (DRNN) is proposed. The structure of DRNN is a modification of fully connected recurrent neural network (FCRNN). Presence of self-recurrent neurons in the hidden layer of DRNN gives it an ability to capture the dynamic behaviour of the nonlinear plant under consideration (to be controlled). To ensure stability, update rules are developed using lyapunov stability criterion. These rules are then used for adjusting the various parameters of DRNN. The responses of plants obtained with DRNN are compared with those obtained when multi-layer feed forward neural network (MLFFNN) is used as a controller. Also, in example 4, FCRNN is also investigated and compared with DRNN and MLFFNN. Robustness of the proposed control scheme is also tested against parameter variations and disturbance signals. Four simulation examples including one-link robotic manipulator and inverted pendulum are considered on which the proposed controller is applied. The results so obtained show the superiority of DRNN over MLFFNN as a controller. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.
An Improved Differential Evolution Trained Neural Network Scheme for Nonlinear System Identification
Institute of Scientific and Technical Information of China (English)
Bidyadhar Subudhi; Debashisha Jena
2009-01-01
This paper prescnts an improved nonlinear system identification scheme using differential evolution (DE), neural network (NN) and Levenberg Marquardt algorithm (LM). With a view to achieve better convergence of NN weights optimization during the training, the DE and LM are used in a combined framework to train the NN. We present the convergence analysis of the DE and demonstrate the efficacy of the proposed improved system identification algorithm by exploiting the combined DE and LM training of the NN and suitably implementing it together with other system identification methods, namely NN and DE+NN on a numbcr of examples including a practical case study. The identification rcsults obtained through a series of simulation studies of these methods on different nonlinear systems demonstrate that the proposed DE and LM trained NN approach to nonlinear system identification can yield better identification results in terms of time of convergence and less identification error.
Han, Honggui; Wu, Xiao-Long; Qiao, Jun-Fei
2014-04-01
In this paper, a self-organizing fuzzy-neural-network with adaptive computation algorithm (SOFNN-ACA) is proposed for modeling a class of nonlinear systems. This SOFNN-ACA is constructed online via simultaneous structure and parameter learning processes. In structure learning, a set of fuzzy rules can be self-designed using an information-theoretic methodology. The fuzzy rules with high spiking intensities (SI) are divided into new ones. And the fuzzy rules with a small relative mutual information (RMI) value will be pruned in order to simplify the FNN structure. In parameter learning, the consequent part parameters are learned through the use of an ACA that incorporates an adaptive learning rate strategy into the learning process to accelerate the convergence speed. Then, the convergence of SOFNN-ACA is analyzed. Finally, the proposed SOFNN-ACA is used to model nonlinear systems. The modeling results demonstrate that this proposed SOFNN-ACA can model nonlinear systems effectively.
Stošovic, Miona V Andrejevic; Litovski, Vanco B
2013-11-01
Simulation is indispensable during the design of many biomedical prostheses that are based on fundamental electrical and electronic actions. However, simulation necessitates the use of adequate models. The main difficulties related to the modeling of such devices are their nonlinearity and dynamic behavior. Here we report the application of recurrent artificial neural networks for modeling of a nonlinear, two-terminal circuit equivalent to a specific implantable hearing device. The method is general in the sense that any nonlinear dynamic two-terminal device or circuit may be modeled in the same way. The model generated was successfully used for simulation and optimization of a driver (operational amplifier)-transducer ensemble. This confirms our claim that in addition to the proper design and optimization of the hearing actuator, optimization in the electronic domain, at the electronic driver circuit-to-actuator interface, should take place in order to achieve best performance of the complete hearing aid.
Robust MPC for a non-linear system - a neural network approach
Luzar, Marcel; Witczak, Marcin
2014-12-01
The aim of the paper is to design a robust actuator fault-tolerant control for a non-linear discrete-time system. Considered system is described by the Linear Parameter-Varying (LPV) model obtained with recurrent neural network. The proposed solution starts with a discretetime quasi-LPV system identification using artificial neural network. Subsequently, the robust controller is proposed, which does not take into account actuator saturation level and deals with the previously estimated faults. To check if the compensation problem is feasible, the robust invariant set is employed, which takes into account actuator saturation level. When the current state does not belong to the set, then a predictive control is performed in order to make such set larger. This makes it possible to increase the domain of attraction, which makes the proposed methodology an efficient solution for the fault-tolerant control. The last part of the paper presents an experimental results regarding wind turbines.
Directory of Open Access Journals (Sweden)
Qihong Chen
2014-01-01
Full Text Available This paper presents a neural network predictive control strategy to optimize power distribution for a fuel cell/ultracapacitor hybrid power system of a robot. We model the nonlinear power system by employing time variant auto-regressive moving average with exogenous (ARMAX, and using recurrent neural network to represent the complicated coefficients of the ARMAX model. Because the dynamic of the system is viewed as operating- state- dependent time varying local linear behavior in this frame, a linear constrained model predictive control algorithm is developed to optimize the power splitting between the fuel cell and ultracapacitor. The proposed algorithm significantly simplifies implementation of the controller and can handle multiple constraints, such as limiting substantial fluctuation of fuel cell current. Experiment and simulation results demonstrate that the control strategy can optimally split power between the fuel cell and ultracapacitor, limit the change rate of the fuel cell current, and so as to extend the lifetime of the fuel cell.
Chen, Qihong; Long, Rong; Quan, Shuhai; Zhang, Liyan
2014-01-01
This paper presents a neural network predictive control strategy to optimize power distribution for a fuel cell/ultracapacitor hybrid power system of a robot. We model the nonlinear power system by employing time variant auto-regressive moving average with exogenous (ARMAX), and using recurrent neural network to represent the complicated coefficients of the ARMAX model. Because the dynamic of the system is viewed as operating- state- dependent time varying local linear behavior in this frame, a linear constrained model predictive control algorithm is developed to optimize the power splitting between the fuel cell and ultracapacitor. The proposed algorithm significantly simplifies implementation of the controller and can handle multiple constraints, such as limiting substantial fluctuation of fuel cell current. Experiment and simulation results demonstrate that the control strategy can optimally split power between the fuel cell and ultracapacitor, limit the change rate of the fuel cell current, and so as to extend the lifetime of the fuel cell.
Chen, Mou; Tao, Gang; Jiang, Bin
2015-09-01
In this paper, a dynamic surface control (DSC) scheme is proposed for a class of uncertain strict-feedback nonlinear systems in the presence of input saturation and unknown external disturbance. The radial basis function neural network (RBFNN) is employed to approximate the unknown system function. To efficiently tackle the unknown external disturbance, a nonlinear disturbance observer (NDO) is developed. The developed NDO can relax the known boundary requirement of the unknown disturbance and can guarantee the disturbance estimation error converge to a bounded compact set. Using NDO and RBFNN, the DSC scheme is developed for uncertain nonlinear systems based on a backstepping method. Using a DSC technique, the problem of explosion of complexity inherent in the conventional backstepping method is avoided, which is specially important for designs using neural network approximations. Under the proposed DSC scheme, the ultimately bounded convergence of all closed-loop signals is guaranteed via Lyapunov analysis. Simulation results are given to show the effectiveness of the proposed DSC design using NDO and RBFNN.
Low-complexity nonlinear adaptive filter based on a pipelined bilinear recurrent neural network.
Zhao, Haiquan; Zeng, Xiangping; He, Zhengyou
2011-09-01
To reduce the computational complexity of the bilinear recurrent neural network (BLRNN), a novel low-complexity nonlinear adaptive filter with a pipelined bilinear recurrent neural network (PBLRNN) is presented in this paper. The PBLRNN, inheriting the modular architectures of the pipelined RNN proposed by Haykin and Li, comprises a number of BLRNN modules that are cascaded in a chained form. Each module is implemented by a small-scale BLRNN with internal dynamics. Since those modules of the PBLRNN can be performed simultaneously in a pipelined parallelism fashion, it would result in a significant improvement of computational efficiency. Moreover, due to nesting module, the performance of the PBLRNN can be further improved. To suit for the modular architectures, a modified adaptive amplitude real-time recurrent learning algorithm is derived on the gradient descent approach. Extensive simulations are carried out to evaluate the performance of the PBLRNN on nonlinear system identification, nonlinear channel equalization, and chaotic time series prediction. Experimental results show that the PBLRNN provides considerably better performance compared to the single BLRNN and RNN models.
A Comparative Study of Neural Networks and Fuzzy Systems in Modeling of a Nonlinear Dynamic System
Directory of Open Access Journals (Sweden)
Metin Demirtas
2011-07-01
Full Text Available The aim of this paper is to compare the neural networks and fuzzy modeling approaches on a nonlinear system. We have taken Permanent Magnet Brushless Direct Current (PMBDC motor data and have generated models using both approaches. The predictive performance of both methods was compared on the data set for model configurations. The paper describes the results of these tests and discusses the effects of changing model parameters on predictive and practical performance. Modeling sensitivity was used to compare for two methods.
PkANN I: Non-Linear Matter Power Spectrum Estimation through Artificial Neural Networks
Agarwal, Shankar; Feldman, Hume A; Lahav, Ofer; Thomas, Shaun A
2012-01-01
We investigate a new approach to confront small-scale non-linearities in the power spectrum of matter fluctuations. This ever-present and pernicious uncertainty is often the Achilles' heel in cosmological studies and must be reduced if we are to see the advent of precision cosmology in the late-time Universe. We show that an optimally trained Artificial Neural Network (ANN), when presented with a set of cosmological parameters ($\\Omega_{\\rm m} h^2, \\Omega_{\\rm b} h^2, n_s, w_0, \\sigma_8, \\sum m_\
Pre-Trained Neural Networks used for Non-Linear State Estimation
DEFF Research Database (Denmark)
Bayramoglu, Enis; Andersen, Nils Axel; Ravn, Ole
2011-01-01
The paper focuses on nonlinear state estimation assuming non-Gaussian distributions of the states and the disturbances. The posterior distribution and the aposteriori distribution is described by a chosen family of paramtric distributions. The state transformation then results in a transformation...... of the paramters in the distribution. This transformation is approximated by a neural network using offline training, which is based on monte carlo sampling. In the paper, there will also be presented a method to construct a flexible distributions well suited for covering the effect of the non...
Institute of Scientific and Technical Information of China (English)
无
2007-01-01
A new type controller, BP neural-networks-based sliding mode controller is developed for a class of large-scale nonlinear systems with unknown bounds of high-order interconnections in this paper. It is shown that decentralized BP neural networks are used to adaptively learn the uncertainty bounds of interconnected subsystems in the Lyapunov sense, and the outputs of the decentralized BP neural networks are then used as the parameters of the sliding mode controller to compensate for the effects of subsystems uncertainties. Using this scheme, not only strong robustness with respect to uncertainty dynamics and nonlinearities can be obtained, but also the output tracking error between the actual output of each subsystem and the corresponding desired reference output can asymptotically converge to zero. A simulation example is presented to support the validity of the proposed BP neural-networks-based sliding mode controller.
Cooperative tracking control of nonlinear multiagent systems using self-structuring neural networks.
Chen, Gang; Song, Yong-Duan
2014-08-01
This paper considers a cooperative tracking problem for a group of nonlinear multiagent systems under a directed graph that characterizes the interaction between the leader and the followers. All the networked systems can have different dynamics and all the dynamics are unknown. A neural network (NN) with flexible structure is used to approximate the unknown dynamics at each node. Considering that the leader is a neighbor of only a subset of the followers and the followers have only local interactions, we introduce a cooperative dynamic observer at each node to overcome the deficiency of the traditional tracking control strategies. An observer-based cooperative controller design framework is proposed with the aid of graph tools, Lyapunov-based design method, self-structuring NN, and separation principle. It is proved that each agent can follow the active leader only if the communication graph contains a spanning tree. Simulation results on networked robots are provided to show the effectiveness of the proposed control algorithms.
Directory of Open Access Journals (Sweden)
Ebrahim Parcham
2014-07-01
Full Text Available Classifying similar images is one of the most interesting and essential image processing operations. Presented methods have some disadvantages like: low accuracy in analysis step and low speed in feature extraction process. In this paper, a new method for image classification is proposed in which similarity weight is revised by means of information in related and unrelated images. Based on researchers’ idea, most of real world similarity measurement systems are nonlinear. Thus, traditional linear methods are not capable of recognizing nonlinear relationship and correlation in such systems. Undoubtedly, Self Organizing Map neural networks are strongest networks for data mining and nonlinear analysis of sophisticated spaces purposes. In our proposed method, we obtain images with the most similarity measure by extracting features of our target image and comparing them with the features of other images. We took advantage of NLPCA algorithm for feature extraction which is a nonlinear algorithm that has the ability to recognize the smallest variations even in noisy images. Finally, we compare the run time and efficiency of our proposed method with previous proposed methods.
Santosa, H.; Hobara, Y.
2017-01-01
The electric field amplitude of very low frequency (VLF) transmitter from Hawaii (NPM) has been continuously recorded at Chofu (CHF), Tokyo, Japan. The VLF amplitude variability indicates lower ionospheric perturbation in the D region (60-90 km altitude range) around the NPM-CHF propagation path. We carried out the prediction of daily nighttime mean VLF amplitude by using Nonlinear Autoregressive with Exogenous Input Neural Network (NARX NN). The NARX NN model, which was built based on the daily input variables of various physical parameters such as stratospheric temperature, total column ozone, cosmic rays, Dst, and Kp indices possess good accuracy during the model building. The fitted model was constructed within the training period from 1 January 2011 to 4 February 2013 by using three algorithms, namely, Bayesian Neural Network (BRANN), Levenberg Marquardt Neural Network (LMANN), and Scaled Conjugate Gradient (SCG). The LMANN has the largest Pearson correlation coefficient (r) of 0.94 and smallest root-mean-square error (RMSE) of 1.19 dB. The constructed models by using LMANN were applied to predict the VLF amplitude from 5 February 2013 to 31 December 2013. As a result the one step (1 day) ahead predicted nighttime VLF amplitude has the r of 0.93 and RMSE of 2.25 dB. We conclude that the model built according to the proposed methodology provides good predictions of the electric field amplitude of VLF waves for NPM-CHF (midlatitude) propagation path.
Esfandiari, Kasra; Abdollahi, Farzaneh; Talebi, Heidar Ali
2015-10-01
This paper presents a tracking control methodology for a class of uncertain nonlinear systems subject to input saturation constraint and external disturbances. Unlike most previous approaches on saturated systems, which assumed affine nonlinear systems, in this paper, tracking control problem is solved for uncertain nonaffine nonlinear systems with input saturation. To deal with the saturation constraint, an auxiliary system is constructed and a modified tracking error is defined. Then, by employing implicit function theorem, mean value theorem, and modified tracking error, updating rules are derived based on the well-known back-propagation (BP) algorithm, which has been proven to be the most relevant updating rule to control problems. However, most of the previous approaches on BP algorithm suffer from lack of stability analysis. By injecting a damping term to the standard BP algorithm, uniformly ultimately boundedness of all the signals of the closed-loop system is ensured via Lyapunov's direct method. Furthermore, the presented approach employs nonlinear in parameter neural networks. Hence, the proposed scheme is applicable to systems with higher degrees of nonlinearity. Using a high-gain observer to reconstruct the states of the system, an output feedback controller is also presented. Finally, the simulation results performed on a Duffing-Holmes chaotic system, a generalized pendulum-type system, and a numerical system are presented to demonstrate the effectiveness of the suggested state and output feedback control schemes.
Adaptive identifier for uncertain complex nonlinear systems based on continuous neural networks.
Alfaro-Ponce, Mariel; Cruz, Amadeo Argüelles; Chairez, Isaac
2014-03-01
This paper presents the design of a complex-valued differential neural network identifier for uncertain nonlinear systems defined in the complex domain. This design includes the construction of an adaptive algorithm to adjust the parameters included in the identifier. The algorithm is obtained based on a special class of controlled Lyapunov functions. The quality of the identification process is characterized using the practical stability framework. Indeed, the region where the identification error converges is derived by the same Lyapunov method. This zone is defined by the power of uncertainties and perturbations affecting the complex-valued uncertain dynamics. Moreover, this convergence zone is reduced to its lowest possible value using ideas related to the so-called ellipsoid methodology. Two simple but informative numerical examples are developed to show how the identifier proposed in this paper can be used to approximate uncertain nonlinear systems valued in the complex domain.
Han, Seong-Ik; Lee, Jang-Myung
2014-01-01
This paper proposes a backstepping control system that uses a tracking error constraint and recurrent fuzzy neural networks (RFNNs) to achieve a prescribed tracking performance for a strict-feedback nonlinear dynamic system. A new constraint variable was defined to generate the virtual control that forces the tracking error to fall within prescribed boundaries. An adaptive RFNN was also used to obtain the required improvement on the approximation performances in order to avoid calculating the explosive number of terms generated by the recursive steps of traditional backstepping control. The boundedness and convergence of the closed-loop system was confirmed based on the Lyapunov stability theory. The prescribed performance of the proposed control scheme was validated by using it to control the prescribed error of a nonlinear system and a robot manipulator.
Fuzzy Wavelet Neural Network Using a Correntropy Criterion for Nonlinear System Identification
Directory of Open Access Journals (Sweden)
Leandro L. S. Linhares
2015-01-01
Full Text Available Recent researches have demonstrated that the Fuzzy Wavelet Neural Networks (FWNNs are an efficient tool to identify nonlinear systems. In these structures, features related to fuzzy logic, wavelet functions, and neural networks are combined in an architecture similar to the Adaptive Neurofuzzy Inference Systems (ANFIS. In practical applications, the experimental data set used in the identification task often contains unknown noise and outliers, which decrease the FWNN model reliability. In order to reduce the negative effects of these erroneous measurements, this work proposes the direct use of a similarity measure based on information theory in the FWNN learning procedure. The Mean Squared Error (MSE cost function is replaced by the Maximum Correntropy Criterion (MCC in the traditional error backpropagation (BP algorithm. The input-output maps of a real nonlinear system studied in this work are identified from an experimental data set corrupted by different outliers rates and additive white Gaussian noise. The results demonstrate the advantages of the proposed cost function using the MCC as compared to the MSE. This work also investigates the influence of the kernel size on the performance of the MCC in the BP algorithm, since it is the only free parameter of correntropy.
Miao, Zhiyong; Shi, Hongyang; Zhang, Yi; Xu, Fan
2017-10-01
In this paper, a new variational Bayesian adaptive cubature Kalman filter (VBACKF) is proposed for nonlinear state estimation. Although the conventional VBACKF performs better than cubature Kalman filtering (CKF) in solving nonlinear systems with time-varying measurement noise, its performance may degrade due to the uncertainty of the system model. To overcome this drawback, a multilayer feed-forward neural network (MFNN) is used to aid the conventional VBACKF, generalizing it to attain higher estimation accuracy and robustness. In the proposed neural-network-aided variational Bayesian adaptive cubature Kalman filter (NN-VBACKF), the MFNN is used to turn the state estimation of the VBACKF adaptively, and it is used for both state estimation and in the online training paradigm simultaneously. To evaluate the performance of the proposed method, it is compared with CKF and VBACKF via target tracking problems. The simulation results demonstrate that the estimation accuracy and robustness of the proposed method are better than those of the CKF and VBACKF.
Nonlinear model identification and adaptive model predictive control using neural networks.
Akpan, Vincent A; Hassapis, George D
2011-04-01
This paper presents two new adaptive model predictive control algorithms, both consisting of an on-line process identification part and a predictive control part. Both parts are executed at each sampling instant. The predictive control part of the first algorithm is the Nonlinear Model Predictive Control strategy and the control part of the second algorithm is the Generalized Predictive Control strategy. In the identification parts of both algorithms the process model is approximated by a series-parallel neural network structure which is trained by a recursive least squares (ARLS) method. The two control algorithms have been applied to: 1) the temperature control of a fluidized bed furnace reactor (FBFR) of a pilot plant and 2) the auto-pilot control of an F-16 aircraft. The training and validation data of the neural network are obtained from the open-loop simulation of the FBFR and the nonlinear F-16 aircraft models. The identification and control simulation results show that the first algorithm outperforms the second one at the expense of extra computation time.
Institute of Scientific and Technical Information of China (English)
CHENMou; JIANGChang-sheng; CHENWen-hua
2004-01-01
A new decentralized robust control method is discussed for a class of nonlinear interconnected largescale system with unknown bounded disturbance and unknown nonlinear function term. A decentralized control law is proposed which combines the approximation method of neural network with sliding mode control. The decentralized controller consists of an equivalent controller and an adaptive sliding mode controller. The sliding mode controller is a robust controller used to reduce the track error of the control system. The neural networks are used to approximate the unknown nonlinear functions, meanwhile the approximation errors of the neural networks are applied to the weight value updated law to improve performance of the system. Finally, an example demonstrates the availability of the decentralized control method.
Eppenhof, Koen A. J.; Pluim, Josien P. W.
2017-02-01
Error estimation in medical image registration is valuable when validating, comparing, or combining registration methods. To validate a nonlinear image registration method, ideally the registration error should be known for the entire image domain. We propose a supervised method for the estimation of a registration error map for nonlinear image registration. The method is based on a convolutional neural network that estimates the norm of the residual deformation from patches around each pixel in two registered images. This norm is interpreted as the registration error, and is defined for every pixel in the image domain. The network is trained using a set of artificially deformed images. Each training example is a pair of images: the original image, and a random deformation of that image. No manually labeled ground truth error is required. At test time, only the two registered images are required as input. We train and validate the network on registrations in a set of 2D digital subtraction angiography sequences, such that errors up to eight pixels can be estimated. We show that for this range of errors the convolutional network is able to learn the registration error in pairs of 2D registered images at subpixel precision. Finally, we present a proof of principle for the extension to 3D registration problems in chest CTs, showing that the method has the potential to estimate errors in 3D registration problems.
Directory of Open Access Journals (Sweden)
Fei Chen
2013-01-01
Full Text Available This paper deals with the finite-time stabilization problem for discrete-time Markov jump nonlinear systems with time delays and norm-bounded exogenous disturbance. The nonlinearities in different jump modes are parameterized by neural networks. Subsequently, a linear difference inclusion state space representation for a class of neural networks is established. Based on this, sufficient conditions are derived in terms of linear matrix inequalities to guarantee stochastic finite-time boundedness and stochastic finite-time stabilization of the closed-loop system. A numerical example is illustrated to verify the efficiency of the proposed technique.
Lu, Bao-Liang; Ito, Koji
2003-09-01
In this paper we present a method for converting general nonlinear programming (NLP) problems into separable programming (SP) problems by using feedforward neural networks (FNNs). The basic idea behind the method is to use two useful features of FNNs: their ability to approximate arbitrary continuous nonlinear functions with a desired degree of accuracy and their ability to express nonlinear functions in terms of parameterized compositions of functions of single variables. According to these two features, any nonseparable objective functions and/or constraints in NLP problems can be approximately expressed as separable functions with FNNs. Therefore, any NLP problems can be converted into SP problems. The proposed method has three prominent features. (a) It is more general than existing transformation techniques; (b) it can be used to formulate optimization problems as SP problems even when their precise analytic objective function and/or constraints are unknown; (c) the SP problems obtained by the proposed method may highly facilitate the selection of grid points for piecewise linear approximation of nonlinear functions. We analyze the computational complexity of the proposed method and compare it with an existing transformation approach. We also present several examples to demonstrate the method and the performance of the simplex method with the restricted basis entry rule for solving SP problems.
Ibnkahla, Mohamed
2012-12-01
Neural network (NN) approaches have been widely applied for modeling and identification of nonlinear multiple-input multiple-output (MIMO) systems. This paper proposes a stochastic analysis of a class of these NN algorithms. The class of MIMO systems considered in this paper is composed of a set of single-input nonlinearities followed by a linear combiner. The NN model consists of a set of single-input memoryless NN blocks followed by a linear combiner. A gradient descent algorithm is used for the learning process. Here we give analytical expressions for the mean squared error (MSE), explore the stationary points of the algorithm, evaluate the misadjustment error due to weight fluctuations, and derive recursions for the mean weight transient behavior during the learning process. The paper shows that in the case of independent inputs, the adaptive linear combiner identifies the linear combining matrix of the MIMO system (to within a scaling diagonal matrix) and that each NN block identifies the corresponding unknown nonlinearity to within a scale factor. The paper also investigates the particular case of linear identification of the nonlinear MIMO system. It is shown in this case that, for independent inputs, the adaptive linear combiner identifies a scaled version of the unknown linear combining matrix. The paper is supported with computer simulations which confirm the theoretical results.
Men, Zhongxian; Yee, Eugene; Lien, Fue-Sang; Yang, Zhiling; Liu, Yongqian
2014-01-01
Short-term wind speed and wind power forecasts (for a 72 h period) are obtained using a nonlinear autoregressive exogenous artificial neural network (ANN) methodology which incorporates either numerical weather prediction or high-resolution computational fluid dynamics wind field information as an exogenous input. An ensemble approach is used to combine the predictions from many candidate ANNs in order to provide improved forecasts for wind speed and power, along with the associated uncertainties in these forecasts. More specifically, the ensemble ANN is used to quantify the uncertainties arising from the network weight initialization and from the unknown structure of the ANN. All members forming the ensemble of neural networks were trained using an efficient particle swarm optimization algorithm. The results of the proposed methodology are validated using wind speed and wind power data obtained from an operational wind farm located in Northern China. The assessment demonstrates that this methodology for wind speed and power forecasting generally provides an improvement in predictive skills when compared to the practice of using an "optimal" weight vector from a single ANN while providing additional information in the form of prediction uncertainty bounds.
Dynamic learning from adaptive neural network control of a class of nonaffine nonlinear systems.
Dai, Shi-Lu; Wang, Cong; Wang, Min
2014-01-01
This paper studies the problem of learning from adaptive neural network (NN) control of a class of nonaffine nonlinear systems in uncertain dynamic environments. In the control design process, a stable adaptive NN tracking control design technique is proposed for the nonaffine nonlinear systems with a mild assumption by combining a filtered tracking error with the implicit function theorem, input-to-state stability, and the small-gain theorem. The proposed stable control design technique not only overcomes the difficulty in controlling nonaffine nonlinear systems but also relaxes constraint conditions of the considered systems. In the learning process, the partial persistent excitation (PE) condition of radial basis function NNs is satisfied during tracking control to a recurrent reference trajectory. Under the PE condition and an appropriate state transformation, the proposed adaptive NN control is shown to be capable of acquiring knowledge on the implicit desired control input dynamics in the stable control process and of storing the learned knowledge in memory. Subsequently, an NN learning control design technique that effectively exploits the learned knowledge without re-adapting to the controller parameters is proposed to achieve closed-loop stability and improved control performance. Simulation studies are performed to demonstrate the effectiveness of the proposed design techniques.
Directory of Open Access Journals (Sweden)
Mohammad Reza Zakerzadeh
2011-01-01
Full Text Available Preisach model is a well-known hysteresis identification method in which the hysteresis is modeled by linear combination of hysteresis operators. Although Preisach model describes the main features of system with hysteresis behavior, due to its rigorous numerical nature, it is not convenient to use in real-time control applications. Here a novel neural network approach based on the Preisach model is addressed, provides accurate hysteresis nonlinearity modeling in comparison with the classical Preisach model and can be used for many applications such as hysteresis nonlinearity control and identification in SMA and Piezo actuators and performance evaluation in some physical systems such as magnetic materials. To evaluate the proposed approach, an experimental apparatus consisting one-dimensional flexible aluminum beam actuated with an SMA wire is used. It is shown that the proposed ANN-based Preisach model can identify hysteresis nonlinearity more accurately than the classical one. It also has powerful ability to precisely predict the higher-order hysteresis minor loops behavior even though only the first-order reversal data are in use. It is also shown that to get the same precise results in the classical Preisach model, many more data should be used, and this directly increases the experimental cost.
Shimelevich, M. I.; Obornev, E. A.; Obornev, I. E.; Rodionov, E. A.
2017-07-01
The iterative approximation neural network method for solving conditionally well-posed nonlinear inverse problems of geophysics is presented. The method is based on the neural network approximation of the inverse operator. The inverse problem is solved in the class of grid (block) models of the medium on a regularized parameterization grid. The construction principle of this grid relies on using the calculated values of the continuity modulus of the inverse operator and its modifications determining the degree of ambiguity of the solutions. The method provides approximate solutions of inverse problems with the maximal degree of detail given the specified degree of ambiguity with the total number of the sought parameters n × 103 of the medium. The a priori and a posteriori estimates of the degree of ambiguity of the approximated solutions are calculated. The work of the method is illustrated by the example of the three-dimensional (3D) inversion of the synthesized 2D areal geoelectrical (audio magnetotelluric sounding, AMTS) data corresponding to the schematic model of a kimberlite pipe.
2016-01-01
Photovoltaic (PV) systems have non-linear characteristics that generate maximum power at one particular operating point. Environmental factors such as irradiance and temperature variations greatly affect the maximum power point (MPP). Diverse offline and online techniques have been introduced for tracking the MPP. Here, to track the MPP, an augmented-state feedback linearized (AFL) non-linear controller combined with an artificial neural network (ANN) is proposed. This approach linearizes the...
A Neural Network Based Hybrid Mixture Model to Extract Information from Non-linear Mixed Pixels
Directory of Open Access Journals (Sweden)
Uttam Kumar
2012-09-01
Full Text Available Signals acquired by sensors in the real world are non-linear combinations, requiring non-linear mixture models to describe the resultant mixture spectra for the endmember’s (pure pixel’s distribution. This communication discusses inferring class fraction through a novel hybrid mixture model (HMM. HMM is a three-step process, where the endmembers are first derived from the images themselves using the N-FINDR algorithm. These endmembers are used by the linear mixture model (LMM in the second step that provides an abundance estimation in a linear fashion. Finally, the abundance values along with the training samples representing the actual ground proportions are fed into neural network based multi-layer perceptron (MLP architecture as input to train the neurons. The neural output further refines the abundance estimates to account for the non-linear nature of the mixing classes of interest. HMM is first implemented and validated on simulated hyper spectral data of 200 bands and subsequently on real time MODIS data with a spatial resolution of 250 m. The results on computer simulated data show that the method gives acceptable results for unmixing pixels with an overall RMSE of 0.0089 ± 0.0022 with LMM and 0.0030 ± 0.0001 with the HMM when compared to actual class proportions. The unmixed MODIS images showed overall RMSE with HMM as 0.0191 ± 0.022 as compared to the LMM output considered alone that had an overall RMSE of 0.2005 ± 0.41, indicating that individual class abundances obtained from HMM are very close to the real observations.
Neural networks for emulation variational method for data assimilation in nonlinear dynamics
Energy Technology Data Exchange (ETDEWEB)
Morais Furtado, Helaine Cristina; Fraga de Campos Velho, Haroldo; Macau, Elbert E N, E-mail: helaine.furtado@lac.inpe.br, E-mail: haroldo@lac.inpe.br, E-mail: elbert@lac.inpe.br [Laboratorio Associado de Computacao e Matematica Aplicada, Sao Jose dos Campos (Brazil)
2011-03-01
Description of a physical phenomenon through differential equations has errors involved, since the mathematical model is always an approximation of reality. For an operational prediction system, one strategy to improve the prediction is to add some information from the real dynamics into mathematical model. This additional information consists of observations on the phenomenon. However, the observational data insertion should be done carefully, for avoiding a worse performance of the prediction. Technical data assimilation are tools to combine data from physical-mathematics model with observational data to obtain a better forecast. The goal of this work is to present the performance of the Neural Network Multilayer Perceptrons trained to emulate a Variational method in context of data assimilation. Techniques for data assimilation are applied for the Lorenz systems; which presents a strong nonlinearity and chaotic nature.
Karabiber, Fethullah; Vecchio, Pietro; Grassi, Giuseppe
2011-12-01
The Bio-inspired (Bi-i) Cellular Vision System is a computing platform consisting of sensing, array sensing-processing, and digital signal processing. The platform is based on the Cellular Neural/Nonlinear Network (CNN) paradigm. This article presents the implementation of a novel CNN-based segmentation algorithm onto the Bi-i system. Each part of the algorithm, along with the corresponding implementation on the hardware platform, is carefully described through the article. The experimental results, carried out for Foreman and Car-phone video sequences, highlight the feasibility of the approach, which provides a frame rate of about 26 frames/s. Comparisons with existing CNN-based methods show that the conceived approach is more accurate, thus representing a good trade-off between real-time requirements and accuracy.
Linear and Nonlinear Electrical Models of Neurons for Hopfield Neural Network
Sarwar, Farah; Iqbal, Shaukat; Hussain, Muhammad Waqar
2016-11-01
A novel electrical model of neuron is proposed in this presentation. The suggested neural network model has linear/nonlinear input-output characteristics. This new deterministic model has joint biological properties in excellent agreement with the earlier deterministic neuron model of Hopfield and Tank and to the stochastic neuron model of McCulloch and Pitts. It is an accurate portrayal of differential equation presented by Hopfield and Tank to mimic neurons. Operational amplifiers, resistances, capacitor, and diodes are used to design this system. The presented biological model of neurons remains to be advantageous for simulations. Impulse response is studied and conferred to certify the stability and strength of this innovative model. A simple illustration is mapped to demonstrate the exactness of the intended system. Precisely mapped illustration exhibits 100 % accurate results.
Adaptive output feedback control for nonlinear time-delay systems using neural network
Institute of Scientific and Technical Information of China (English)
Weisheng CHEN; Junmin LI
2006-01-01
This paper extends the adaptive neural network (NN) control approaches to a class of unknown output feedback nonlinear time-delay systems. An adaptive output feedback NN tracking controller is designed by backstepping technique. NNs are used to approximate unknown functions dependent on time delay. Delay-dependent filters are introduced for state estimation. The domination method is used to deal with the smooth time-delay basis functions. The adaptive bounding technique is employed to estimate the upper bound of the NN approximation errors. Based on LyapunovKrasovskii functional, the semi-global uniform ultimate boundedness of all the signals in the closed-loop system is proved.The feasibility is investigated by two illustrative simulation examples.
Directory of Open Access Journals (Sweden)
Vecchio Pietro
2011-01-01
Full Text Available Abstract The Bio-inspired (Bi-i Cellular Vision System is a computing platform consisting of sensing, array sensing-processing, and digital signal processing. The platform is based on the Cellular Neural/Nonlinear Network (CNN paradigm. This article presents the implementation of a novel CNN-based segmentation algorithm onto the Bi-i system. Each part of the algorithm, along with the corresponding implementation on the hardware platform, is carefully described through the article. The experimental results, carried out for Foreman and Car-phone video sequences, highlight the feasibility of the approach, which provides a frame rate of about 26 frames/s. Comparisons with existing CNN-based methods show that the conceived approach is more accurate, thus representing a good trade-off between real-time requirements and accuracy.
Liu, Yan-Jun; Li, Jing; Tong, Shaocheng; Chen, C L Philip
2016-07-01
In order to stabilize a class of uncertain nonlinear strict-feedback systems with full-state constraints, an adaptive neural network control method is investigated in this paper. The state constraints are frequently emerged in the real-life plants and how to avoid the violation of state constraints is an important task. By introducing a barrier Lyapunov function (BLF) to every step in a backstepping procedure, a novel adaptive backstepping design is well developed to ensure that the full-state constraints are not violated. At the same time, one remarkable feature is that the minimal learning parameters are employed in BLF backstepping design. By making use of Lyapunov analysis, we can prove that all the signals in the closed-loop system are semiglobal uniformly ultimately bounded and the output is well driven to follow the desired output. Finally, a simulation is given to verify the effectiveness of the method.
Adaptive Output-feedback Regulation for Nonlinear Delayed Systems Using Neural Network
Institute of Scientific and Technical Information of China (English)
无
2008-01-01
A novel adaptive neural network (NN) output-feedback regulation algorithm for a class of nonlinear time-varying time-delay systems is proposed. Both the designed observer and controller are independent of time delay. Different from the existing results,where the upper bounding functions of time-delay terms are assumed to be known, we only use an NN to compensate for all unknown upper bounding functions without that assumption. The proposed design method is proved to be able to guarantee semi-global uniform ultimate boundedness of all the signals in the closed system, and the system output is proved to converge to a small neighborhood of the origin. The simulation results verify the effectiveness of the control scheme.
Non-linear regression techniques are used widely to fit weed field emergence patterns to soil microclimatic indices using S-type functions. Artificial neural networks present interesting and alternative features for such modeling purposes. In this work, a univariate hydrothermal-time based Weibull m...
DEFF Research Database (Denmark)
Chon, K H; Hoyer, D; Armoundas, A A;
1999-01-01
part of the stochastic ARMA model are first estimated via a three-layer artificial neural network (deterministic estimation step) and then reestimated using the prediction error as one of the inputs to the artificial neural networks in an iterative algorithm (stochastic estimation step). The prediction...
Bouchard, M
2001-01-01
In recent years, a few articles describing the use of neural networks for nonlinear active control of sound and vibration were published. Using a control structure with two multilayer feedforward neural networks (one as a nonlinear controller and one as a nonlinear plant model), steepest descent algorithms based on two distinct gradient approaches were introduced for the training of the controller network. The two gradient approaches were sometimes called the filtered-x approach and the adjoint approach. Some recursive-least-squares algorithms were also introduced, using the adjoint approach. In this paper, an heuristic procedure is introduced for the development of recursive-least-squares algorithms based on the filtered-x and the adjoint gradient approaches. This leads to the development of new recursive-least-squares algorithms for the training of the controller neural network in the two networks structure. These new algorithms produce a better convergence performance than previously published algorithms. Differences in the performance of algorithms using the filtered-x and the adjoint gradient approaches are discussed in the paper. The computational load of the algorithms discussed in the paper is evaluated for multichannel systems of nonlinear active control. Simulation results are presented to compare the convergence performance of the algorithms, showing the convergence gain provided by the new algorithms.
Ondra, V.; Sever, I. A.; Schwingshackl, C. W.
2017-01-01
This paper presents a method for detection and characterisation of structural non-linearities from a single frequency response function using the Hilbert transform in the frequency domain and artificial neural networks. A frequency response function is described based on its Hilbert transform using several common and newly introduced scalar parameters, termed non-linearity indexes, to create training data of the artificial neural network. This network is subsequently used to detect the existence of non-linearity and classify its type. The theoretical background of the method is given and its usage is demonstrated on different numerical test cases created by single degree of freedom non-linear systems and a lumped parameter multi degree of freedom system with a geometric non-linearity. The method is also applied to several experimentally measured frequency response functions obtained from a cantilever beam with a clearance non-linearity and an under-platform damper experimental rig with a complex friction contact interface. It is shown that the method is a fast and noise-robust means of detecting and characterising non-linear behaviour from a single frequency response function.
Neural Networks for Optimal Control
DEFF Research Database (Denmark)
Sørensen, O.
1995-01-01
Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process.......Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process....
Neural Networks for Optimal Control
DEFF Research Database (Denmark)
Sørensen, O.
1995-01-01
Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process.......Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process....
Directory of Open Access Journals (Sweden)
Elaheh Saeedi
2014-07-01
Full Text Available In this paper, a decentralized adaptive controller with using wavelet neural network is used for a class of large-scale nonlinear systems with time- delay unknown nonlinear non- affine subsystems. The entered interruptions in subsystems are considered nonlinear with time delay, this is closer the reality, compared with the case in which the delay is not considered for interruptions. In this paper, the output weights of wavelet neural network and the other parameters of wavelet are adjusted online. The stability of close loop system is guaranteed with using the Lyapanov- Krasovskii method. Moreover the stability of close loop systems, guaranteed tracking error is converging to neighborhood zero and also all of the signals in the close loop system are bounded. Finally, the proposed method, simulated and applied for the control of two inverted pendulums that connected by a spring and the computer results, show that the efficiency of suggested method in this paper.
Memristor-based cellular nonlinear/neural network: design, analysis, and applications.
Duan, Shukai; Hu, Xiaofang; Dong, Zhekang; Wang, Lidan; Mazumder, Pinaki
2015-06-01
Cellular nonlinear/neural network (CNN) has been recognized as a powerful massively parallel architecture capable of solving complex engineering problems by performing trillions of analog operations per second. The memristor was theoretically predicted in the late seventies, but it garnered nascent research interest due to the recent much-acclaimed discovery of nanocrossbar memories by engineers at the Hewlett-Packard Laboratory. The memristor is expected to be co-integrated with nanoscale CMOS technology to revolutionize conventional von Neumann as well as neuromorphic computing. In this paper, a compact CNN model based on memristors is presented along with its performance analysis and applications. In the new CNN design, the memristor bridge circuit acts as the synaptic circuit element and substitutes the complex multiplication circuit used in traditional CNN architectures. In addition, the negative differential resistance and nonlinear current-voltage characteristics of the memristor have been leveraged to replace the linear resistor in conventional CNNs. The proposed CNN design has several merits, for example, high density, nonvolatility, and programmability of synaptic weights. The proposed memristor-based CNN design operations for implementing several image processing functions are illustrated through simulation and contrasted with conventional CNNs. Monte-Carlo simulation has been used to demonstrate the behavior of the proposed CNN due to the variations in memristor synaptic weights.
A Neural-Network-Based Nonlinear Adaptive State-Observer for Pressurized Water Reactors
Directory of Open Access Journals (Sweden)
Zhe Dong
2013-10-01
Full Text Available Although there have been some severe nuclear accidents such as Three Mile Island (USA, Chernobyl (Ukraine and Fukushima (Japan, nuclear fission energy is still a source of clean energy that can substitute for fossil fuels in a centralized way and in a great amount with commercial availability and economic competitiveness. Since the pressurized water reactor (PWR is the most widely used nuclear fission reactor, its safe, stable and efficient operation is meaningful to the current rebirth of the nuclear fission energy industry. Power-level regulation is an important technique which can deeply affect the operation stability and efficiency of PWRs. Compared with the classical power-level controllers, the advanced power-level regulators could strengthen both the closed-loop stability and control performance by feeding back the internal state-variables. However, not all of the internal state variables of a PWR can be obtained directly by measurements. To implement advanced PWR power-level control law, it is necessary to develop a state-observer to reconstruct the unmeasurable state-variables. Since a PWR is naturally a complex nonlinear system with parameters varying with power-level, fuel burnup, xenon isotope production, control rod worth and etc., it is meaningful to design a nonlinear observer for the PWR with adaptability to system uncertainties. Due to this and the strong learning capability of the multi-layer perceptron (MLP neural network, an MLP-based nonlinear adaptive observer is given for PWRs. Based upon Lyapunov stability theory, it is proved theoretically that this newly-built observer can provide bounded and convergent state-observation. This observer is then applied to the state-observation of a special PWR, i.e., the nuclear heating reactor (NHR, and numerical simulation results not only verify its feasibility but also give the relationship between the observation performance and observer parameters.
1992-09-01
input. The architecture of artificial neural-network has three main levels: topological, data flow, and neurodynamics . The architectural and...and neurodynamics . The presentation here will follow the guidelines of Neural Computing by NeuralWare, Inc. [NC91], who developed the basic software... neurodynamics , describes in detail the operations that act upon the data within a processing element. This level defines the functions and the
Sha, Daohang
2010-01-01
Back-propagation with gradient method is the most popular learning algorithm for feed-forward neural networks. However, it is critical to determine a proper fixed learning rate for the algorithm. In this paper, an optimized recursive algorithm is presented for online learning based on matrix operation and optimization methods analytically, which can avoid the trouble to select a proper learning rate for the gradient method. The proof of weak convergence of the proposed algorithm also is given. Although this approach is proposed for three-layer, feed-forward neural networks, it could be extended to multiple layer feed-forward neural networks. The effectiveness of the proposed algorithms applied to the identification of behavior of a two-input and two-output non-linear dynamic system is demonstrated by simulation experiments.
Doulamis, A D; Doulamis, N D; Kollias, S D
2003-01-01
Multimedia services and especially digital video is expected to be the major traffic component transmitted over communication networks [such as internet protocol (IP)-based networks]. For this reason, traffic characterization and modeling of such services are required for an efficient network operation. The generated models can be used as traffic rate predictors, during the network operation phase (online traffic modeling), or as video generators for estimating the network resources, during the network design phase (offline traffic modeling). In this paper, an adaptable neural-network architecture is proposed covering both cases. The scheme is based on an efficient recursive weight estimation algorithm, which adapts the network response to current conditions. In particular, the algorithm updates the network weights so that 1) the network output, after the adaptation, is approximately equal to current bit rates (current traffic statistics) and 2) a minimal degradation over the obtained network knowledge is provided. It can be shown that the proposed adaptable neural-network architecture simulates a recursive nonlinear autoregressive model (RNAR) similar to the notation used in the linear case. The algorithm presents low computational complexity and high efficiency in tracking traffic rates in contrast to conventional retraining schemes. Furthermore, for the problem of offline traffic modeling, a novel correlation mechanism is proposed for capturing the burstness of the actual MPEG video traffic. The performance of the model is evaluated using several real-life MPEG coded video sources of long duration and compared with other linear/nonlinear techniques used for both cases. The results indicate that the proposed adaptable neural-network architecture presents better performance than other examined techniques.
Directory of Open Access Journals (Sweden)
David E. Allen
2016-03-01
Full Text Available This paper features an analysis of major currency exchange rate movements in relation to the US dollar, as constituted in US dollar terms. Euro, British pound, Chinese yuan, and Japanese yen are modelled using a variety of non-linear models, including smooth transition regression models, logistic smooth transition regressions models, threshold autoregressive models, nonlinear autoregressive models, and additive nonlinear autoregressive models, plus Neural Network models. The models are evaluated on the basis of error metrics for twenty day out-of-sample forecasts using the mean average percentage errors (MAPE. The results suggest that there is no dominating class of time series models, and the different currency pairs relationships with the US dollar are captured best by neural net regression models, over the ten year sample of daily exchange rate returns data, from August 2005 to August 2015.
Ouyang, Huei-Tau
2017-08-01
Accurate inundation level forecasting during typhoon invasion is crucial for organizing response actions such as the evacuation of people from areas that could potentially flood. This paper explores the ability of nonlinear autoregressive neural networks with exogenous inputs (NARX) to predict inundation levels induced by typhoons. Two types of NARX architecture were employed: series-parallel (NARX-S) and parallel (NARX-P). Based on cross-correlation analysis of rainfall and water-level data from historical typhoon records, 10 NARX models (five of each architecture type) were constructed. The forecasting ability of each model was assessed by considering coefficient of efficiency (CE), relative time shift error (RTS), and peak water-level error (PE). The results revealed that high CE performance could be achieved by employing more model input variables. Comparisons of the two types of model demonstrated that the NARX-S models outperformed the NARX-P models in terms of CE and RTS, whereas both performed exceptionally in terms of PE and without significant difference. The NARX-S and NARX-P models with the highest overall performance were identified and their predictions were compared with those of traditional ARX-based models. The NARX-S model outperformed the ARX-based models in all three indexes, whereas the NARX-P model exhibited comparable CE performance and superior RTS and PE performance.
Robust Integral of Neural Network and Error Sign Control of MIMO Nonlinear Systems.
Yang, Qinmin; Jagannathan, Sarangapani; Sun, Youxian
2015-12-01
This paper presents a novel state-feedback control scheme for the tracking control of a class of multi-input multioutput continuous-time nonlinear systems with unknown dynamics and bounded disturbances. First, the control law consisting of the robust integral of a neural network (NN) output plus sign of the tracking error feedback multiplied with an adaptive gain is introduced. The NN in the control law learns the system dynamics in an online manner, while the NN residual reconstruction errors and the bounded disturbances are overcome by the error sign signal. Since both of the NN output and the error sign signal are included in the integral, the continuity of the control input is ensured. The controller structure and the NN weight update law are novel in contrast with the previous effort, and the semiglobal asymptotic tracking performance is still guaranteed by using the Lyapunov analysis. In addition, the NN weights and all other signals are proved to be bounded simultaneously. The proposed approach also relaxes the need for the upper bounds of certain terms, which are usually required in the previous designs. Finally, the theoretical results are substantiated with simulations.
Directory of Open Access Journals (Sweden)
GEMAN, O.
2014-02-01
Full Text Available Neurological diseases like Alzheimer, epilepsy, Parkinson's disease, multiple sclerosis and other dementias influence the lives of patients, their families and society. Parkinson's disease (PD is a neurodegenerative disease that occurs due to loss of dopamine, a neurotransmitter and slow destruction of neurons. Brain area affected by progressive destruction of neurons is responsible for controlling movements, and patients with PD reveal rigid and uncontrollable gestures, postural instability, small handwriting and tremor. Commercial activity-promoting gaming systems such as the Nintendo Wii and Xbox Kinect can be used as tools for tremor, gait or other biomedical signals acquisitions. They also can aid for rehabilitation in clinical settings. This paper emphasizes the use of intelligent optical sensors or accelerometers in biomedical signal acquisition, and of the specific nonlinear dynamics parameters or fuzzy logic in Parkinson's disease tremor analysis. Nowadays, there is no screening test for early detection of PD. So, we investigated a method to predict PD, based on the image processing of the handwriting belonging to a candidate of PD. For classification and discrimination between healthy people and PD people we used Artificial Neural Networks (Radial Basis Function - RBF and Multilayer Perceptron - MLP and an Adaptive Neuro-Fuzzy Classifier (ANFC. In general, the results may be expressed as a prognostic (risk degree to contact PD.
Mobile robot nonlinear feedback control based on Elman neural network observer
Directory of Open Access Journals (Sweden)
Khaled Al-Mutib
2015-12-01
Full Text Available This article presents a new approach to control a wheeled mobile robot without velocity measurement. The controller developed is based on kinematic model as well as dynamics model to take into account parameters of dynamics. These parameters related to dynamic equations are identified using a proposed methodology. Input–output feedback linearization is considered with a slight modification in the mathematical expressions to implement the dynamic controller and analyze the nonlinear internal behavior. The developed controllers require sensors to obtain the states needed for the closed-loop system. However, some states may not be available due to the absence of the sensors because of the cost, the weight limitation, reliability, induction of errors, failure, and so on. Particularly, for the velocity measurements, the required accuracy may not be achieved in practical applications due to the existence of significant errors induced by stochastic or cyclical noise. In this article, Elman neural network is proposed to work as an observer to estimate the velocity needed to complete the full state required for the closed-loop control and account for all the disturbances and model parameter uncertainties. Different simulations are carried out to demonstrate the feasibility of the approach in tracking different reference trajectories in comparison with other paradigms.
The characteristics of nonlinear chaotic dynamics in quantum cellular neural networks
Institute of Scientific and Technical Information of China (English)
Wang Sen; Cai Li; Kang Qiang; Wu Gang; Li Qin
2008-01-01
With the polarization of quantum-dot cell and quantum phase serving as state variables, this paper does both theoretical analysis and simulation for the complex nonlinear dynamical behaviour of a three-cell-coupled Quantum Cel- lular Neural Network (QCNN), including equilibrium points, bifurcation and chaotic behaviour. Different phenomena, such as quasi-periodic, chaotic and hyper-chaotic states as well as bifurcations are revealed. The system's bifurcation and chaotic behaviour under the influence of the different coupling parameters are analysed. And it finds that the unbalanced ceils coupled QCNN is easy to cause chaotic oscillation and the system response enters into chaotic state from quasi-periodic state by quasi-period bifurcation; however, the balanced cells coupled QCNN also can be chaotic when coupling parameters is in some region. Additionally, both the unbalanced and balanced cells coupled QCNNs can possess hyper-chaotic behaviour. It provides valuable information about QCNNs for future application in high-parallel signal processing and novel ultra-small chaotic generators.
Non-Linear State Estimation Using Pre-Trained Neural Networks
DEFF Research Database (Denmark)
Bayramoglu, Enis; Andersen, Nils Axel; Ravn, Ole
2010-01-01
effecting the transformation. This function is approximated by a neural network using offline training. The training is based on monte carlo sampling. A way to obtain parametric distributions of flexible shape to be used easily with these networks is also presented. The method can also be used to improve...
Directory of Open Access Journals (Sweden)
Schwindling Jerome
2010-04-01
Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Intelligent adaptive nonlinear flight control for a high performance aircraft with neural networks.
Savran, Aydogan; Tasaltin, Ramazan; Becerikli, Yasar
2006-04-01
This paper describes the development of a neural network (NN) based adaptive flight control system for a high performance aircraft. The main contribution of this work is that the proposed control system is able to compensate the system uncertainties, adapt to the changes in flight conditions, and accommodate the system failures. The underlying study can be considered in two phases. The objective of the first phase is to model the dynamic behavior of a nonlinear F-16 model using NNs. Therefore a NN-based adaptive identification model is developed for three angular rates of the aircraft. An on-line training procedure is developed to adapt the changes in the system dynamics and improve the identification accuracy. In this procedure, a first-in first-out stack is used to store a certain history of the input-output data. The training is performed over the whole data in the stack at every stage. To speed up the convergence rate and enhance the accuracy for achieving the on-line learning, the Levenberg-Marquardt optimization method with a trust region approach is adapted to train the NNs. The objective of the second phase is to develop intelligent flight controllers. A NN-based adaptive PID control scheme that is composed of an emulator NN, an estimator NN, and a discrete time PID controller is developed. The emulator NN is used to calculate the system Jacobian required to train the estimator NN. The estimator NN, which is trained on-line by propagating the output error through the emulator, is used to adjust the PID gains. The NN-based adaptive PID control system is applied to control three angular rates of the nonlinear F-16 model. The body-axis pitch, roll, and yaw rates are fed back via the PID controllers to the elevator, aileron, and rudder actuators, respectively. The resulting control system has learning, adaptation, and fault-tolerant abilities. It avoids the storage and interpolation requirements for the too many controller parameters of a typical flight control
Directory of Open Access Journals (Sweden)
Fengxia Xu
2014-01-01
Full Text Available U-model can approximate a large class of smooth nonlinear time-varying delay system to any accuracy by using time-varying delay parameters polynomial. This paper proposes a new approach, namely, U-model approach, to solving the problems of analysis and synthesis for nonlinear systems. Based on the idea of discrete-time U-model with time-varying delay, the identification algorithm of adaptive neural network is given for the nonlinear model. Then, the controller is designed by using the Newton-Raphson formula and the stability analysis is given for the closed-loop nonlinear systems. Finally, illustrative examples are given to show the validity and applicability of the obtained results.
Zhang, Ridong; Tao, Jili; Lu, Renquan; Jin, Qibing
2016-12-08
Modeling of distributed parameter systems is difficult because of their nonlinearity and infinite-dimensional characteristics. Based on principal component analysis (PCA), a hybrid modeling strategy that consists of a decoupled linear autoregressive exogenous (ARX) model and a nonlinear radial basis function (RBF) neural network model are proposed. The spatial-temporal output is first divided into a few dominant spatial basis functions and finite-dimensional temporal series by PCA. Then, a decoupled ARX model is designed to model the linear dynamics of the dominant modes of the time series. The nonlinear residual part is subsequently parameterized by RBFs, where genetic algorithm is utilized to optimize their hidden layer structure and the parameters. Finally, the nonlinear spatial-temporal dynamic system is obtained after the time/space reconstruction. Simulation results of a catalytic rod and a heat conduction equation demonstrate the effectiveness of the proposed strategy compared to several other methods.
Simplified LQG Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1997-01-01
A new neural network application for non-linear state control is described. One neural network is modelled to form a Kalmann predictor and trained to act as an optimal state observer for a non-linear process. Another neural network is modelled to form a state controller and trained to produce...
Application of nonlinear neural network to analyze the stope structure parameters
Energy Technology Data Exchange (ETDEWEB)
Lai, X.; Cai, M.; Zhang, B. [University of Science and Technoogy of Beijing (China). Civil and Environmental School
2001-06-01
In this paper, the state-of-the-art of neural computing in geotechnical structural analysis and design has been surveyed. Its computing strategies and research trends are given. The principle of the BP neural networks and computing for constitutive modelling have been discussed, then achieved in applying to analyse the underground stope structure parameters in the Xincheng gold mine with the applications of BP network, it is proven that the neurocomputing is a practical tool for solving large-scale rock underground structural engineering problems. 4 refs., 2 figs., 2 tabs.
Fuzzy logic systems are equivalent to feedforward neural networks
Institute of Scientific and Technical Information of China (English)
李洪兴
2000-01-01
Fuzzy logic systems and feedforward neural networks are equivalent in essence. First, interpolation representations of fuzzy logic systems are introduced and several important conclusions are given. Then three important kinds of neural networks are defined, i.e. linear neural networks, rectangle wave neural networks and nonlinear neural networks. Then it is proved that nonlinear neural networks can be represented by rectangle wave neural networks. Based on the results mentioned above, the equivalence between fuzzy logic systems and feedforward neural networks is proved, which will be very useful for theoretical research or applications on fuzzy logic systems or neural networks by means of combining fuzzy logic systems with neural networks.
Neural Network for Combining Linear and Non-Linear Modelling of Dynamic Systems
DEFF Research Database (Denmark)
Madsen, Per Printz
1994-01-01
The purpose of this paper is to develop a method to combine linear models with MLP networks. In other words to find a method to make a non-linear and multivariable model that performs at least as good as a linear model, when the training data lacks information.......The purpose of this paper is to develop a method to combine linear models with MLP networks. In other words to find a method to make a non-linear and multivariable model that performs at least as good as a linear model, when the training data lacks information....
Directory of Open Access Journals (Sweden)
J. Reyes-Reyes
2000-01-01
Full Text Available In this paper, an adaptive technique is suggested to provide the passivity property for a class of partially known SISO nonlinear systems. A simple Dynamic Neural Network (DNN, containing only two neurons and without any hidden-layers, is used to identify the unknown nonlinear system. By means of a Lyapunov-like analysis the new learning law for this DNN, guarantying both successful identification and passivation effects, is derived. Based on this adaptive DNN model, an adaptive feedback controller, serving for wide class of nonlinear systems with an a priori incomplete model description, is designed. Two typical examples illustrate the effectiveness of the suggested approach.
Nonlinear dynamics analysis of a self-organizing recurrent neural network: chaos waning.
Directory of Open Access Journals (Sweden)
Jürgen Eser
Full Text Available Self-organization is thought to play an important role in structuring nervous systems. It frequently arises as a consequence of plasticity mechanisms in neural networks: connectivity determines network dynamics which in turn feed back on network structure through various forms of plasticity. Recently, self-organizing recurrent neural network models (SORNs have been shown to learn non-trivial structure in their inputs and to reproduce the experimentally observed statistics and fluctuations of synaptic connection strengths in cortex and hippocampus. However, the dynamics in these networks and how they change with network evolution are still poorly understood. Here we investigate the degree of chaos in SORNs by studying how the networks' self-organization changes their response to small perturbations. We study the effect of perturbations to the excitatory-to-excitatory weight matrix on connection strengths and on unit activities. We find that the network dynamics, characterized by an estimate of the maximum Lyapunov exponent, becomes less chaotic during its self-organization, developing into a regime where only few perturbations become amplified. We also find that due to the mixing of discrete and (quasi-continuous variables in SORNs, small perturbations to the synaptic weights may become amplified only after a substantial delay, a phenomenon we propose to call deferred chaos.
Nonlinear dynamics analysis of a self-organizing recurrent neural network: chaos waning.
Eser, Jürgen; Zheng, Pengsheng; Triesch, Jochen
2014-01-01
Self-organization is thought to play an important role in structuring nervous systems. It frequently arises as a consequence of plasticity mechanisms in neural networks: connectivity determines network dynamics which in turn feed back on network structure through various forms of plasticity. Recently, self-organizing recurrent neural network models (SORNs) have been shown to learn non-trivial structure in their inputs and to reproduce the experimentally observed statistics and fluctuations of synaptic connection strengths in cortex and hippocampus. However, the dynamics in these networks and how they change with network evolution are still poorly understood. Here we investigate the degree of chaos in SORNs by studying how the networks' self-organization changes their response to small perturbations. We study the effect of perturbations to the excitatory-to-excitatory weight matrix on connection strengths and on unit activities. We find that the network dynamics, characterized by an estimate of the maximum Lyapunov exponent, becomes less chaotic during its self-organization, developing into a regime where only few perturbations become amplified. We also find that due to the mixing of discrete and (quasi-)continuous variables in SORNs, small perturbations to the synaptic weights may become amplified only after a substantial delay, a phenomenon we propose to call deferred chaos.
Gupta, S; Gupta, Sanjay
2002-01-01
This paper initiates the study of quantum computing within the constraints of using a polylogarithmic ($O(\\log^k n), k\\geq 1$) number of qubits and a polylogarithmic number of computation steps. The current research in the literature has focussed on using a polynomial number of qubits. A new mathematical model of computation called \\emph{Quantum Neural Networks (QNNs)} is defined, building on Deutsch's model of quantum computational network. The model introduces a nonlinear and irreversible gate, similar to the speculative operator defined by Abrams and Lloyd. The precise dynamics of this operator are defined and while giving examples in which nonlinear Schr\\"{o}dinger's equations are applied, we speculate on its possible implementation. The many practical problems associated with the current model of quantum computing are alleviated in the new model. It is shown that QNNs of logarithmic size and constant depth have the same computational power as threshold circuits, which are used for modeling neural network...
Institute of Scientific and Technical Information of China (English)
ZHOU Rong-yi; LIU Ai-qun; LI Shu-qing
2007-01-01
Directing at the non-linear dynamic characteristics of water inrush from coal seam floor and by the analysis of the shortages of current forecast methods for water inrush from coal seam floor,a new forecast method was raised based on wavelet neural network(WNN)that was a model combining wavelet function with artificiaI neural network.Firstly basic principle of WNN was described.then a forecast model for water inrush from coal seam floor based on WNN was established and analyzed,finally an example of forecasting the quantity of water inrush from coal floor was illustrated to verify the feasibility and superiority of this method.Conclusions show that the forecast result based on WNN is more precise and that using WNN model to forecast the quantity of water inrush from coal seam floor is feasible and practical.
Vonk, E.; Jain, L.C.; Veelenturf, L.P.J.
1995-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
Fuzzy Multiresolution Neural Networks
Ying, Li; Qigang, Shang; Na, Lei
A fuzzy multi-resolution neural network (FMRANN) based on particle swarm algorithm is proposed to approximate arbitrary nonlinear function. The active function of the FMRANN consists of not only the wavelet functions, but also the scaling functions, whose translation parameters and dilation parameters are adjustable. A set of fuzzy rules are involved in the FMRANN. Each rule either corresponding to a subset consists of scaling functions, or corresponding to a sub-wavelet neural network consists of wavelets with same dilation parameters. Incorporating the time-frequency localization and multi-resolution properties of wavelets with the ability of self-learning of fuzzy neural network, the approximation ability of FMRANN can be remarkable improved. A particle swarm algorithm is adopted to learn the translation and dilation parameters of the wavelets and adjusting the shape of membership functions. Simulation examples are presented to validate the effectiveness of FMRANN.
Nonlinear momentum transfer control of a gyrostat with a discrete damper using neural networks
Seo, In-Ho; Leeghim, Henzeh; Bang, Hyochoong
2008-03-01
An adaptive feedback linearization technique combined with neural networks is addressed for the momentum transfer control of a torque-free gyrostat with an attached spring-mass-dashpot damper. The neural network is used to adaptively compensate for the model error uncertainties of internal dynamics. The total spacecraft angular momentum component of the wheel spin axis is selected as an output function for the feedback linearization. Thus, a desired output function is predefined for which the total angular momentum of the spacecraft is absorbed into the wheel spin direction at the steady state with nutation angle converging to zero. The ultimate boundedness of the tracking error is proved by the Lyapunov stability theory. We also investigate the effect of rotor misalignment on the steady spin of the spacecraft and the initial stability condition to overcome the inverted turn due to unstable mass moment of inertia configuration. The effectiveness of the proposed control law is verified through a simulation study.
Directory of Open Access Journals (Sweden)
Janmenjoy Nayak
2015-09-01
Full Text Available In this paper, a Chemical Reaction Optimization (CRO based higher order neural network with a single hidden layer called Pi–Sigma Neural Network (PSNN has been proposed for data classification which maintains fast learning capability and avoids the exponential increase of number of weights and processing units. CRO is a recent metaheuristic optimization algorithm inspired by chemical reactions, free from intricate operator and parameter settings such as other algorithms and loosely couples chemical reactions with optimization. The performance of the proposed CRO-PSNN has been tested with various benchmark datasets from UCI machine learning repository and compared with the resulting performance of PSNN, GA-PSNN, PSO-PSNN. The methods have been implemented in MATLAB and the accuracy measures have been tested by using the ANOVA statistical tool. Experimental results show that the proposed method is fast, steady and reliable and provides better classification accuracy than others.
Institute of Scientific and Technical Information of China (English)
Chen Di-Lan; Zhang Wei-Dong
2008-01-01
This paper is concerned with the problem of robust H∞ control for structured uncertain stochastic neural networks with both discrete and distributed time varying delays. A sufficient condition is presented for the existence of H∞ control based on the Lyapunov stability theory. The stability criterion is described in terms of linear matrix inequalities (LMIs),which can be easily checked in practice. An example is provided to demonstrate the effectiveness of the proposed result.
Mohammadzadeh, Ardashir; Ghaemi, Sehraneh
2015-09-01
This paper proposes a novel approach for training of proposed recurrent hierarchical interval type-2 fuzzy neural networks (RHT2FNN) based on the square-root cubature Kalman filters (SCKF). The SCKF algorithm is used to adjust the premise part of the type-2 FNN and the weights of defuzzification and the feedback weights. The recurrence property in the proposed network is the output feeding of each membership function to itself. The proposed RHT2FNN is employed in the sliding mode control scheme for the synchronization of chaotic systems. Unknown functions in the sliding mode control approach are estimated by RHT2FNN. Another application of the proposed RHT2FNN is the identification of dynamic nonlinear systems. The effectiveness of the proposed network and its learning algorithm is verified by several simulation examples. Furthermore, the universal approximation of RHT2FNNs is also shown.
Neural network-based robust actuator fault diagnosis for a non-linear multi-tank system.
Mrugalski, Marcin; Luzar, Marcel; Pazera, Marcin; Witczak, Marcin; Aubrun, Christophe
2016-03-01
The paper is devoted to the problem of the robust actuator fault diagnosis of the dynamic non-linear systems. In the proposed method, it is assumed that the diagnosed system can be modelled by the recurrent neural network, which can be transformed into the linear parameter varying form. Such a system description allows developing the designing scheme of the robust unknown input observer within H∞ framework for a class of non-linear systems. The proposed approach is designed in such a way that a prescribed disturbance attenuation level is achieved with respect to the actuator fault estimation error, while guaranteeing the convergence of the observer. The application of the robust unknown input observer enables actuator fault estimation, which allows applying the developed approach to the fault tolerant control tasks.
Directory of Open Access Journals (Sweden)
Jaime Buitrago
2017-01-01
Full Text Available Short-term load forecasting is crucial for the operations planning of an electrical grid. Forecasting the next 24 h of electrical load in a grid allows operators to plan and optimize their resources. The purpose of this study is to develop a more accurate short-term load forecasting method utilizing non-linear autoregressive artificial neural networks (ANN with exogenous multi-variable input (NARX. The proposed implementation of the network is new: the neural network is trained in open-loop using actual load and weather data, and then, the network is placed in closed-loop to generate a forecast using the predicted load as the feedback input. Unlike the existing short-term load forecasting methods using ANNs, the proposed method uses its own output as the input in order to improve the accuracy, thus effectively implementing a feedback loop for the load, making it less dependent on external data. Using the proposed framework, mean absolute percent errors in the forecast in the order of 1% have been achieved, which is a 30% improvement on the average error using feedforward ANNs, ARMAX and state space methods, which can result in large savings by avoiding commissioning of unnecessary power plants. The New England electrical load data are used to train and validate the forecast prediction.
On the Capability of Artificial Neural Networks to Compensate Nonlinearities in Wavelength Sensing
Directory of Open Access Journals (Sweden)
Otto Manck
2009-04-01
Full Text Available An intelligent sensor for light wavelength readout, suitable for visible range optical applications, has been developed. Using buried triple photo-junction as basic pixel sensing element in combination with artificial neural network (ANN, the wavelength readout with a full-scale error of less than 1.5% over the range of 400 to 780 nm can be achieved. Through this work, the applicability of the ANN approach in optical sensing is investigated and compared with conventional methods, and a good compromise between accuracy and the possibility for on-chip implementation was thus found. Indeed, this technique can serve different purposes and may replace conventional methods.
一种组合神经网络非线性判决反馈均衡器%A New Nonlinear Adaptive Equalizer Based on Combined Neural Networks
Institute of Scientific and Technical Information of China (English)
王军锋; 张斌; 宋国乡
2003-01-01
A new nonlinear decision feedback adaptive equalizer based on Adaline neural network and radial-basis-function neural network is presented. Its structure and algorithm are also investigated. For a typical linear and non-linear channel models, computer simulation shows that its convergence speed is faster and its stable mean square erroris less.
Kypraios, Ioannis; Young, Rupert C. D.; Birch, Philip M.; Chatwin, Christopher R.
2003-08-01
The various types of synthetic discriminant function (sdf) filter result in a weighted linear superposition of the training set images. Neural network training procedures result in a non-linear superposition of the training set images or, effectively, a feature extraction process, which leads to better interpolation properties than achievable with the sdf filter. However, generally, shift invariance is lost since a data dependant non-linear weighting function is incorporated in the input data window. As a compromise, we train a non-linear superposition filter via neural network methods with the constraint of a linear input to allow for shift invariance. The filter can then be used in a frequency domain based optical correlator. Simulation results are presented that demonstrate the improved training set interpolation achieved by the non-linear filter as compared to a linear superposition filter.
Directory of Open Access Journals (Sweden)
Suliang Ma
2016-11-01
Full Text Available Photovoltaic (PV systems have non-linear characteristics that generate maximum power at one particular operating point. Environmental factors such as irradiance and temperature variations greatly affect the maximum power point (MPP. Diverse offline and online techniques have been introduced for tracking the MPP. Here, to track the MPP, an augmented-state feedback linearized (AFL non-linear controller combined with an artificial neural network (ANN is proposed. This approach linearizes the non-linear characteristics in PV systems and DC/DC converters, for tracking and optimizing the PV system operation. It also reduces the dependency of the designed controller on linearized models, to provide global stability. A complete model of the PV system is simulated. The existing maximum power-point tracking (MPPT and DC/DC boost-converter controller techniques are compared with the proposed ANN method. Two case studies, which simulate realistic circumstances, are presented to demonstrate the effectiveness and superiority of the proposed method. The AFL with ANN controller can provide good dynamic operation, faster convergence speed, and fewer operating-point oscillations around the MPP. It also tracks the global maxima under different conditions, especially irradiance-mutating situations, more effectively than the conventional methods. Detailed mathematical models and a control approach for a three-phase grid-connected intelligent hybrid system are proposed using MATLAB/Simulink.
Liu, Derong; Wang, Ding; Wang, Fei-Yue; Li, Hongliang; Yang, Xiong
2014-12-01
In this paper, the infinite horizon optimal robust guaranteed cost control of continuous-time uncertain nonlinear systems is investigated using neural-network-based online solution of Hamilton-Jacobi-Bellman (HJB) equation. By establishing an appropriate bounded function and defining a modified cost function, the optimal robust guaranteed cost control problem is transformed into an optimal control problem. It can be observed that the optimal cost function of the nominal system is nothing but the optimal guaranteed cost of the original uncertain system. A critic neural network is constructed to facilitate the solution of the modified HJB equation corresponding to the nominal system. More importantly, an additional stabilizing term is introduced for helping to verify the stability, which reinforces the updating process of the weight vector and reduces the requirement of an initial stabilizing control. The uniform ultimate boundedness of the closed-loop system is analyzed by using the Lyapunov approach as well. Two simulation examples are provided to verify the effectiveness of the present control approach.
Micheloyannis, Sifis; Sakkalis, Vagelis; Vourkas, Michalis; Stam, Cornelis J; Simos, Panagiotis G
2005-01-20
Using linear and non-linear methods, electroencephalographic (EEG) signals were measured at various brain regions to provide information regarding patterns of local and coordinated activity during performance of three arithmetic tasks (number comparison, single-digit multiplication, and two-digit multiplication) and two control tasks that did not require arithmetic operations. It was hypothesized that these measures would reveal the engagement of local and increasingly complex cortical networks as a function of task specificity and complexity. Results indicated regionally increased neuronal signalling as a function of task complexity at frontal, temporal and parietal brain regions, although more robust task-related changes in EEG-indices of activation were derived over the left hemisphere. Both linear and non-linear indices of synchronization among EEG signals recorded from over different brain regions were consistent with the notion of more "local" processing for the number comparison task. Conversely, multiplication tasks were associated with a widespread pattern of distant signal synchronizations, which could potentially indicate increased demands for neural networks cooperation during performance of tasks that involve a greater number of cognitive operations.
Hwang, Chih-Lyang; Jan, Chau
2016-02-01
At the beginning, an approximate nonlinear autoregressive moving average (NARMA) model is employed to represent a class of multivariable nonlinear dynamic systems with time-varying delay. It is known that the disadvantages of robust control for the NARMA model are as follows: 1) suitable control parameters for larger time delay are more sensitive to achieving desirable performance; 2) it only deals with bounded uncertainty; and 3) the nominal NARMA model must be learned in advance. Due to the dynamic feature of the NARMA model, a recurrent neural network (RNN) is online applied to learn it. However, the system performance becomes deteriorated due to the poor learning of the larger variation of system vector functions. In this situation, a simple network is employed to compensate the upper bound of the residue caused by the linear parameterization of the approximation error of RNN. An e -modification learning law with a projection for weight matrix is applied to guarantee its boundedness without persistent excitation. Under suitable conditions, the semiglobally ultimately bounded tracking with the boundedness of estimated weight matrix is obtained by the proposed RNN-based multivariable adaptive control. Finally, simulations are presented to verify the effectiveness and robustness of the proposed control.
Agarwal, Shankar; Feldman, Hume A; Lahav, Ofer; Thomas, Shaun A
2013-01-01
In this paper we introduce PkANN, a freely available software package for interpolating the non-linear matter power spectrum, constructed using Artificial Neural Networks (ANNs). Previously, using Halofit to calculate matter power spectrum, we demonstrated that ANNs can make extremely quick and accurate predictions of the power spectrum. Now, using a suite of 6380 N-body simulations spanning 580 cosmologies, we train ANNs to predict the power spectrum over the cosmological parameter space spanning $3\\sigma$ confidence level (CL) around the concordance cosmology. When presented with a set of cosmological parameters ($\\Omega_{\\rm m} h^2, \\Omega_{\\rm b} h^2, n_s, w, \\sigma_8, \\sum m_\
Li, Xiao-Jian; Yang, Guang-Hong
2016-10-26
This paper is concerned with the adaptive decentralized fault-tolerant tracking control problem for a class of uncertain interconnected nonlinear systems with unknown strong interconnections. An algebraic graph theory result is introduced to address the considered interconnections. In addition, to achieve the desirable tracking performance, a neural-network-based robust adaptive decentralized fault-tolerant control (FTC) scheme is given to compensate the actuator faults and system uncertainties. Furthermore, via the Lyapunov analysis method, it is proven that all the signals of the resulting closed-loop system are semiglobally bounded, and the tracking errors of each subsystem exponentially converge to a compact set, whose radius is adjustable by choosing different controller design parameters. Finally, the effectiveness and advantages of the proposed FTC approach are illustrated with two simulated examples.
Wen, Guoxing; Chen, C L Philip; Liu, Yan-Jun; Liu, Zhi
2016-10-11
Compared with the existing neural network (NN) or fuzzy logic system (FLS) based adaptive consensus methods, the proposed approach can greatly alleviate the computation burden because it needs only to update a few adaptive parameters online. In the multiagent agreement control, the system uncertainties derive from the unknown nonlinear dynamics are counteracted by employing the adaptive NNs; the state delays are compensated by designing a Lyapunov-Krasovskii functional. Finally, based on Lyapunov stability theory, it is demonstrated that the proposed consensus scheme can steer a multiagent system synchronizing to the predefined reference signals. Two simulation examples, a numerical multiagent system and a practical multimanipulator system, are carried out to further verify and testify the effectiveness of the proposed agreement approach.
Constructive neural network learning
Lin, Shaobo; Zeng, Jinshan; Zhang, Xiaoqin
2016-01-01
In this paper, we aim at developing scalable neural network-type learning systems. Motivated by the idea of "constructive neural networks" in approximation theory, we focus on "constructing" rather than "training" feed-forward neural networks (FNNs) for learning, and propose a novel FNNs learning system called the constructive feed-forward neural network (CFN). Theoretically, we prove that the proposed method not only overcomes the classical saturation problem for FNN approximation, but also ...
Stability prediction of berm breakwater using neural network
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Rao, S.; Manjunath, Y.R.
. In order to allow the network to learn both non-linear and linear relationships between input nodes and output nodes, multiple-layer networks are often used. Among many neural network architectures, the three layers feed forward backpropagation neural...
Generalized classifier neural network.
Ozyildirim, Buse Melis; Avci, Mutlu
2013-03-01
In this work a new radial basis function based classification neural network named as generalized classifier neural network, is proposed. The proposed generalized classifier neural network has five layers, unlike other radial basis function based neural networks such as generalized regression neural network and probabilistic neural network. They are input, pattern, summation, normalization and output layers. In addition to topological difference, the proposed neural network has gradient descent based optimization of smoothing parameter approach and diverge effect term added calculation improvements. Diverge effect term is an improvement on summation layer calculation to supply additional separation ability and flexibility. Performance of generalized classifier neural network is compared with that of the probabilistic neural network, multilayer perceptron algorithm and radial basis function neural network on 9 different data sets and with that of generalized regression neural network on 3 different data sets include only two classes in MATLAB environment. Better classification performance up to %89 is observed. Improved classification performances proved the effectivity of the proposed neural network.
Directory of Open Access Journals (Sweden)
Tienfuan Kerh
2014-01-01
Full Text Available The effects of extreme weather and overdevelopment may cause some coastal areas to exhibit erosion problems, which in turn may contribute to creating disasters of varying scale, particularly in regions comprising islands. This study used aerial survey information from three periods (1990, 2001, and 2010 and used graphical software to establish the spatial data of six beaches surrounding the island of Taiwan. An overlaying technique was then implemented to compare the sandy area of each beach in the aforementioned study periods. In addition, an artificial neural network model was developed based on available digitised coordinates for predicting coastline variation for 2015 and 2020. An onsite investigation was performed using a global positioning system for comparing the beaches. The results revealed that two beaches from this study may have experienced significant changes in total sandy areas under a statistical 95% confidence interval. The proposed method and the result of this study may provide a valuable reference in follow-up research and applications.
Cao, Hui; Li, Yao-Jiang; Zhou, Yan; Wang, Yan-Xia
2014-11-01
To deal with nonlinear characteristics of spectra data for the thermal power plant flue, a nonlinear partial least square (PLS) analysis method with internal model based on neural network is adopted in the paper. The latent variables of the independent variables and the dependent variables are extracted by PLS regression firstly, and then they are used as the inputs and outputs of neural network respectively to build the nonlinear internal model by train process. For spectra data of flue gases of the thermal power plant, PLS, the nonlinear PLS with the internal model of back propagation neural network (BP-NPLS), the non-linear PLS with the internal model of radial basis function neural network (RBF-NPLS) and the nonlinear PLS with the internal model of adaptive fuzzy inference system (ANFIS-NPLS) are compared. The root mean square error of prediction (RMSEP) of sulfur dioxide of BP-NPLS, RBF-NPLS and ANFIS-NPLS are reduced by 16.96%, 16.60% and 19.55% than that of PLS, respectively. The RMSEP of nitric oxide of BP-NPLS, RBF-NPLS and ANFIS-NPLS are reduced by 8.60%, 8.47% and 10.09% than that of PLS, respectively. The RMSEP of nitrogen dioxide of BP-NPLS, RBF-NPLS and ANFIS-NPLS are reduced by 2.11%, 3.91% and 3.97% than that of PLS, respectively. Experimental results show that the nonlinear PLS is more suitable for the quantitative analysis of glue gas than PLS. Moreover, by using neural network function which can realize high approximation of nonlinear characteristics, the nonlinear partial least squares method with internal model mentioned in this paper have well predictive capabilities and robustness, and could deal with the limitations of nonlinear partial least squares method with other internal model such as polynomial and spline functions themselves under a certain extent. ANFIS-NPLS has the best performance with the internal model of adaptive fuzzy inference system having ability to learn more and reduce the residuals effectively. Hence, ANFIS-NPLS is an
Neural Network Nonlinear Predictive Control Based on Tent-map Chaos Optimization%基于Tent混沌优化的神经网络预测控制
Institute of Scientific and Technical Information of China (English)
宋莹; 陈增强; 袁著祉
2007-01-01
With the unique ergodicity, irregularity, and special ability to avoid being trapped in local optima, chaos optimization has been a novel global optimization technique and has attracted considerable attention for application in various fields, such as nonlinear programming problems. In this article, a novel neural network nonlinear predictive control (NNPC) strategy based on the new Tent-map chaos optimization algorithm (TCOA) is presented. The feedforward neural network is used as the multi-step predictive model. In addition, the TCOA is applied to perform the nonlinear rolling optimization to enhance the convergence and accuracy in the NNPC. Simulation on a laboratory-scale liquid-level system is given to illustrate the effectiveness of the proposed method.
Neural network subtyping of depression.
Florio, T M; Parker, G; Austin, M P; Hickie, I; Mitchell, P; Wilhelm, K
1998-10-01
To examine the applicability of a neural network classification strategy to examine the independent contribution of psychomotor disturbance (PMD) and endogeneity symptoms to the DSM-III-R definition of melancholia. We studied 407 depressed patients with the clinical dataset comprising 17 endogeneity symptoms and the 18-item CORE measure of behaviourally rated PMD. A multilayer perception neural network was used to fit non-linear models of varying complexity. A linear discriminant function analysis was also used to generate a model for comparison with the non-linear models. Models (linear and non-linear) using PMD items only and endogeneity symptoms only had similar rates of successful classification, while non-linear models combining both PMD and symptoms scores achieved the best classifications. Our current non-linear model was superior to a linear analysis, a finding which may have wider application to psychiatric classification. Our non-linear analysis of depressive subtypes supports the binary view that melancholic and non-melancholic depression are separate clinical disorders rather than different forms of the same entity. This study illustrates how non-linear modelling with neural networks is a potentially fruitful approach to the study of the diagnostic taxonomy of psychiatric disorders and to clinical decision-making.
Directory of Open Access Journals (Sweden)
Wei Zhang
2016-06-01
Full Text Available In the aerospace and aviation sectors, the damage tolerance concept has been applied widely so that the modeling analysis of fatigue crack growth has become more and more significant. Since the process of crack propagation is highly nonlinear and determined by many factors, such as applied stress, plastic zone in the crack tip, length of the crack, etc., it is difficult to build up a general and flexible explicit function to accurately quantify this complicated relationship. Fortunately, the artificial neural network (ANN is considered a powerful tool for establishing the nonlinear multivariate projection which shows potential in handling the fatigue crack problem. In this paper, a novel fatigue crack calculation algorithm based on a radial basis function (RBF-ANN is proposed to study this relationship from the experimental data. In addition, a parameter called the equivalent stress intensity factor is also employed as training data to account for loading interaction effects. The testing data is then placed under constant amplitude loading with different stress ratios or overloads used for model validation. Moreover, the Forman and Wheeler equations are also adopted to compare with our proposed algorithm. The current investigation shows that the ANN-based approach can deliver a better agreement with the experimental data than the other two models, which supports that the RBF-ANN has nontrivial advantages in handling the fatigue crack growth problem. Furthermore, it implies that the proposed algorithm is possibly a sophisticated and promising method to compute fatigue crack growth in terms of loading interaction effects.
Directory of Open Access Journals (Sweden)
vahid Rezaverdinejad
2017-01-01
important models to estimate ETc in greenhouse. The inputs of these models are net radiation, temperature, day after planting and air vapour pressure deficit (or relative humidity. Materials and Methods: In this study, daily ETc of reference crop, greenhouse tomato and cucumber crops were measured using lysimeter method in Urmia region. Several linear, nonlinear regressions and artificial neural networks were considered for ETc modelling in greenhouse. For this purpose, the effective meteorological parameters on ETc process includes: air temperature (T, air humidity (RH, air pressure (P, air vapour pressure deficit (VPD, day after planting (N and greenhouse net radiation (SR were considered and measured. According to the goodness of fit, different models of artificial neural networks and regression were compared and evaluated. Furthermore, based on partial derivatives of regression models, sensitivity analysis was conducted. The accuracy and performance of the employed models was judged by ten statistical indices namely root mean square error (RMSE, normalized root mean square error (NRMSE and coefficient of determination (R2. Results and Discussion: Based on the results, the most accurate regression model to reference ETc prediction was obtained three variables exponential function of VPD, RH and SR with RMSE=0.378 mm day-1. The RMSE of optimal artificial neural network to reference ET prediction for train and test data sets were obtained 0.089 and 0.365 mm day-1, respectively. The performance of logarithmic and exponential functions to prediction of cucumber ETc were proper, with high dependent variables especially, and the most accurate regression model to cucumber ET prediction was obtained for exponential function of five variables: VPD, N, T, RH and SR with RMSE=0.353 mm day-1. In addition, for tomato ET prediction, the most accurate regression model was obtained for exponential function of four variables: VPD, N, RH and SR with RMSE= 0.329 mm day-1. The best
Directory of Open Access Journals (Sweden)
Neela Deshpande
2014-12-01
Full Text Available In the recent past Artificial Neural Networks (ANN have emerged out as a promising technique for predicting compressive strength of concrete. In the present study back propagation was used to predict the 28 day compressive strength of recycled aggregate concrete (RAC along with two other data driven techniques namely Model Tree (MT and Non-linear Regression (NLR. Recycled aggregate is the current need of the hour owing to its environmental friendly aspect of re-use of the construction waste. The study observed that, prediction of 28 day compressive strength of RAC was done better by ANN than NLR and MT. The input parameters were cubic meter proportions of Cement, Natural fine aggregate, Natural coarse Aggregates, recycled aggregates, Admixture and Water (also called as raw data. The study also concluded that ANN performs better when non-dimensional parameters like Sand–Aggregate ratio, Water–total materials ratio, Aggregate–Cement ratio, Water–Cement ratio and Replacement ratio of natural aggregates by recycled aggregates, were used as additional input parameters. Study of each network developed using raw data and each non dimensional parameter facilitated in studying the impact of each parameter on the performance of the models developed using ANN, MT and NLR as well as performance of the ANN models developed with limited number of inputs. The results indicate that ANN learn from the examples and grasp the fundamental domain rules governing strength of concrete.
Directory of Open Access Journals (Sweden)
Gurudeo Anand Tularam
2012-01-01
Full Text Available House price prediction continues to be important for government agencies insurance companies and real estate industry. This study investigates the performance of house sales price models based on linear and non-linear approaches to study the effects of selected variables. Linear stepwise Multivariate Regression (MR and nonlinear models of Neural Network (NN and Adaptive Neuro-Fuzzy (ANFIS are developed and compared. The GIS methods are used to integrate the data for the study area (Bathurst, Australia. While it was expected that the nonlinear methods would be much better the analysis shows NN and ANFIS are only slightly better than MR suggesting questions about high R2 often found in the literature. While structural data and macro-finance variables may contribute to higher R2 performance comparison was the goal of this study and besides the Australian data lacked structural elements. The results show that MR model could be improved. Also, the land value and location explained at best about 45% of the sale price variation. The analysis of price forecasts (within the 10% range of the actual prediction on average revealed that the non-linear models performed slightly better (29% than the linear (26%. The inclusion of social data improves the MR prediction in most of the suburbs. The suburbs analysis shows the importance of socially based locations and also variance due to types of housing dominant. In general terms of R2, the NN model (0.45 performed only slightly better than ANFIS 0.39 and better than MR (0.37; but the linear MRsoc performed better (0.42. In suburb level, the NN model (7/15 performed better than ANFIS (3/15 but the linear MR (5/15 was better than ANFIS. The improved linear MR (6/15 performed nearly as well as the non-linear NN. Linear methods appear to just as precise as the the more time consuming non linear methods in most cases for accounting for the differences and variation. However, when a much more in depth analysis is
Chaotic diagonal recurrent neural network
Institute of Scientific and Technical Information of China (English)
Wang Xing-Yuan; Zhang Yi
2012-01-01
We propose a novel neural network based on a diagonal recurrent neural network and chaos,and its structure andlearning algorithm are designed.The multilayer feedforward neural network,diagonal recurrent neural network,and chaotic diagonal recurrent neural network are used to approach the cubic symmetry map.The simulation results show that the approximation capability of the chaotic diagonal recurrent neural network is better than the other two neural networks.
Yang, Qianli; Pitkow, Xaq
2015-03-01
Most interesting natural sensory stimuli are encoded in the brain in a form that can only be decoded nonlinearly. But despite being a core function of the brain, nonlinear population codes are rarely studied and poorly understood. Interestingly, the few existing models of nonlinear codes are inconsistent with known architectural features of the brain. In particular, these codes have information content that scales with the size of the cortical population, even if that violates the data processing inequality by exceeding the amount of information entering the sensory system. Here we provide a valid theory of nonlinear population codes by generalizing recent work on information-limiting correlations in linear population codes. Although these generalized, nonlinear information-limiting correlations bound the performance of any decoder, they also make decoding more robust to suboptimal computation, allowing many suboptimal decoders to achieve nearly the same efficiency as an optimal decoder. Although these correlations are extremely difficult to measure directly, particularly for nonlinear codes, we provide a simple, practical test by which one can use choice-related activity in small populations of neurons to determine whether decoding is suboptimal or optimal and limited by correlated noise. We conclude by describing an example computation in the vestibular system where this theory applies. QY and XP was supported by a grant from the McNair foundation.
Adaptive optimization and control using neural networks
Energy Technology Data Exchange (ETDEWEB)
Mead, W.C.; Brown, S.K.; Jones, R.D.; Bowling, P.S.; Barnes, C.W.
1993-10-22
Recent work has demonstrated the ability of neural-network-based controllers to optimize and control machines with complex, non-linear, relatively unknown control spaces. We present a brief overview of neural networks via a taxonomy illustrating some capabilities of different kinds of neural networks. We present some successful control examples, particularly the optimization and control of a small-angle negative ion source.
Nonlinear prediction of gold prices based on BP neural network%基于 BP神经网络的黄金价格非线性预测
Institute of Scientific and Technical Information of China (English)
张延利
2013-01-01
针对黄金价格的非线性特征和神经网络的自身特点，利用BP神经网络建立了黄金价格的非线性预测模型。实证研究结果表明，BP神经网络模型具有较好的预测精度，可以为黄金投资和宏观经济决策提供一定的参考依据。%According to the neural network nonlinear characteristics of gold price and its own characteristics ,using BP neural network nonlinear prediction model was set up for the price of gold .The results show that the BP prediction has good accuracy and is available to provide references for the gold investment and macroeconomic decisions .
Neural Networks for Rapid Design and Analysis
Sparks, Dean W., Jr.; Maghami, Peiman G.
1998-01-01
Artificial neural networks have been employed for rapid and efficient dynamics and control analysis of flexible systems. Specifically, feedforward neural networks are designed to approximate nonlinear dynamic components over prescribed input ranges, and are used in simulations as a means to speed up the overall time response analysis process. To capture the recursive nature of dynamic components with artificial neural networks, recurrent networks, which use state feedback with the appropriate number of time delays, as inputs to the networks, are employed. Once properly trained, neural networks can give very good approximations to nonlinear dynamic components, and by their judicious use in simulations, allow the analyst the potential to speed up the analysis process considerably. To illustrate this potential speed up, an existing simulation model of a spacecraft reaction wheel system is executed, first conventionally, and then with an artificial neural network in place.
Wavelet Neural Networks for Adaptive Equalization
Institute of Scientific and Technical Information of China (English)
JIANGMinghu; DENGBeixing; GIELENGeorges; ZHANGBo
2003-01-01
A structure based on the Wavelet neural networks (WNNs) is proposed for nonlinear channel equalization in a digital communication system. The construction algorithm of the Minimum error probability (MEP) is presented and applied as a performance criterion to update the parameter matrix of wavelet networks. Our experimental results show that performance of the proposed wavelet networks based on equalizer can significantly improve the neural modeling accuracy, perform quite well in compensating the nonlinear distortion introduced by the channel, and outperform the conventional neural networks in signal to noise ratio and channel non-llnearity.
Energy Technology Data Exchange (ETDEWEB)
Jammes, B. [Centre National de la Recherche Scientifique (CNRS), 31 - Toulouse (France). Laboratoire d`Analyse et d`Architecture des Systemes; Dragos, A. [Bucharest Univ. Politechnica (Romania)
1998-11-01
In this paper, artificial neural networks are used to elaborate non-linear control of the average output voltage of Buck and Boost converters. The training of the regulator is based on the adjustment technique used by indirect adaptative command structures. These techniques require a system model and performances of inputs/outputs and state models are compared. It is shown that this approach allows to generate non-linear regulators for the converters under study, but it is preferable to introduce some modifications in order to facilitate the training of the regulator. (J.S.) 4 refs.
Neural network method for solving elastoplastic finite element problems
Institute of Scientific and Technical Information of China (English)
无
2006-01-01
A basic optimization principle of Artificial Neural Network-the Lagrange Programming Neural Network (LPNN) model for solving elastoplastic finite element problems is presented. The nonlinear problems of mechanics are represented as a neural network based optimization problem by adopting the nonlinear function as nerve cell transfer function. Finally, two simple elastoplastic problems are numerically simulated. LPNN optimization results for elastoplastic problem are found to be comparable to traditional Hopfield neural network optimization model.
Neural Networks: Implementations and Applications
Vonk, E.; Veelenturf, L.P.J.; Jain, L.C.
1996-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
Neural Networks: Implementations and Applications
Vonk, E.; Veelenturf, L.P.J.; Jain, L.C.
1996-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
De, Suvranu; Deo, Dhannanjay; Sankaranarayanan, Ganesh; Arikatla, Venkata S
2011-08-01
BACKGROUND: While an update rate of 30 Hz is considered adequate for real time graphics, a much higher update rate of about 1 kHz is necessary for haptics. Physics-based modeling of deformable objects, especially when large nonlinear deformations and complex nonlinear material properties are involved, at these very high rates is one of the most challenging tasks in the development of real time simulation systems. While some specialized solutions exist, there is no general solution for arbitrary nonlinearities. METHODS: In this work we present PhyNNeSS - a Physics-driven Neural Networks-based Simulation System - to address this long-standing technical challenge. The first step is an off-line pre-computation step in which a database is generated by applying carefully prescribed displacements to each node of the finite element models of the deformable objects. In the next step, the data is condensed into a set of coefficients describing neurons of a Radial Basis Function network (RBFN). During real-time computation, these neural networks are used to reconstruct the deformation fields as well as the interaction forces. RESULTS: We present realistic simulation examples from interactive surgical simulation with real time force feedback. As an example, we have developed a deformable human stomach model and a Penrose-drain model used in the Fundamentals of Laparoscopic Surgery (FLS) training tool box. CONCLUSIONS: A unique computational modeling system has been developed that is capable of simulating the response of nonlinear deformable objects in real time. The method distinguishes itself from previous efforts in that a systematic physics-based pre-computational step allows training of neural networks which may be used in real time simulations. We show, through careful error analysis, that the scheme is scalable, with the accuracy being controlled by the number of neurons used in the simulation. PhyNNeSS has been integrated into SoFMIS (Software Framework for Multimodal
Neural Generalized Predictive Control of a non-linear Process
DEFF Research Database (Denmark)
Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole
1998-01-01
The use of neural network in non-linear control is made difficult by the fact the stability and robustness is not guaranteed and that the implementation in real time is non-trivial. In this paper we introduce a predictive controller based on a neural network model which has promising stability...... detail and discuss the implementation difficulties. The neural generalized predictive controller is tested on a pneumatic servo sys-tem....
Heidari, Mohammad; Heidari, Ali; Homaei, Hadi
2014-01-01
The static pull-in instability of beam-type microelectromechanical systems (MEMS) is theoretically investigated. Two engineering cases including cantilever and double cantilever microbeam are considered. Considering the midplane stretching as the source of the nonlinearity in the beam behavior, a nonlinear size-dependent Euler-Bernoulli beam model is used based on a modified couple stress theory, capable of capturing the size effect. By selecting a range of geometric parameters such as beam lengths, width, thickness, gaps, and size effect, we identify the static pull-in instability voltage. A MAPLE package is employed to solve the nonlinear differential governing equations to obtain the static pull-in instability voltage of microbeams. Radial basis function artificial neural network with two functions has been used for modeling the static pull-in instability of microcantilever beam. The network has four inputs of length, width, gap, and the ratio of height to scale parameter of beam as the independent process variables, and the output is static pull-in voltage of microbeam. Numerical data, employed for training the network, and capabilities of the model have been verified in predicting the pull-in instability behavior. The output obtained from neural network model is compared with numerical results, and the amount of relative error has been calculated. Based on this verification error, it is shown that the radial basis function of neural network has the average error of 4.55% in predicting pull-in voltage of cantilever microbeam. Further analysis of pull-in instability of beam under different input conditions has been investigated and comparison results of modeling with numerical considerations shows a good agreement, which also proves the feasibility and effectiveness of the adopted approach. The results reveal significant influences of size effect and geometric parameters on the static pull-in instability voltage of MEMS.
Antenna analysis using neural networks
Smith, William T.
1992-01-01
Conventional computing schemes have long been used to analyze problems in electromagnetics (EM). The vast majority of EM applications require computationally intensive algorithms involving numerical integration and solutions to large systems of equations. The feasibility of using neural network computing algorithms for antenna analysis is investigated. The ultimate goal is to use a trained neural network algorithm to reduce the computational demands of existing reflector surface error compensation techniques. Neural networks are computational algorithms based on neurobiological systems. Neural nets consist of massively parallel interconnected nonlinear computational elements. They are often employed in pattern recognition and image processing problems. Recently, neural network analysis has been applied in the electromagnetics area for the design of frequency selective surfaces and beam forming networks. The backpropagation training algorithm was employed to simulate classical antenna array synthesis techniques. The Woodward-Lawson (W-L) and Dolph-Chebyshev (D-C) array pattern synthesis techniques were used to train the neural network. The inputs to the network were samples of the desired synthesis pattern. The outputs are the array element excitations required to synthesize the desired pattern. Once trained, the network is used to simulate the W-L or D-C techniques. Various sector patterns and cosecant-type patterns (27 total) generated using W-L synthesis were used to train the network. Desired pattern samples were then fed to the neural network. The outputs of the network were the simulated W-L excitations. A 20 element linear array was used. There were 41 input pattern samples with 40 output excitations (20 real parts, 20 imaginary). A comparison between the simulated and actual W-L techniques is shown for a triangular-shaped pattern. Dolph-Chebyshev is a different class of synthesis technique in that D-C is used for side lobe control as opposed to pattern
Optimizing neural network forecast by immune algorithm
Institute of Scientific and Technical Information of China (English)
YANG Shu-xia; LI Xiang; LI Ning; YANG Shang-dong
2006-01-01
Considering multi-factor influence, a forecasting model was built. The structure of BP neural network was designed, and immune algorithm was applied to optimize its network structure and weight. After training the data of power demand from the year 1980 to 2005 in China, a nonlinear network model was obtained on the relationship between power demand and the factors which had impacts on it, and thus the above proposed method was verified. Meanwhile, the results were compared to those of neural network optimized by genetic algorithm. The results show that this method is superior to neural network optimized by genetic algorithm and is one of the effective ways of time series forecast.
Hua, Changchun; Zhang, Liuliu; Guan, Xinping
2017-01-01
This paper studies the problem of distributed output tracking consensus control for a class of high-order stochastic nonlinear multiagent systems with unknown nonlinear dead-zone under a directed graph topology. The adaptive neural networks are used to approximate the unknown nonlinear functions and a new inequality is used to deal with the completely unknown dead-zone input. Then, we design the controllers based on backstepping method and the dynamic surface control technique. It is strictly proved that the resulting closed-loop system is stable in probability in the sense of semiglobally uniform ultimate boundedness and the tracking errors between the leader and the followers approach to a small residual set based on Lyapunov stability theory. Finally, two simulation examples are presented to show the effectiveness and the advantages of the proposed techniques.
DEFF Research Database (Denmark)
Krogh, Anders Stærmose; Riis, Søren Kamaric
1999-01-01
A general framework for hybrids of hidden Markov models (HMMs) and neural networks (NNs) called hidden neural networks (HNNs) is described. The article begins by reviewing standard HMMs and estimation by conditional maximum likelihood, which is used by the HNN. In the HNN, the usual HMM probability...... parameters are replaced by the outputs of state-specific neural networks. As opposed to many other hybrids, the HNN is normalized globally and therefore has a valid probabilistic interpretation. All parameters in the HNN are estimated simultaneously according to the discriminative conditional maximum...... likelihood criterion. The HNN can be viewed as an undirected probabilistic independence network (a graphical model), where the neural networks provide a compact representation of the clique functions. An evaluation of the HNN on the task of recognizing broad phoneme classes in the TIMIT database shows clear...
DEFF Research Database (Denmark)
Hansen, Lars Kai; Salamon, Peter
1990-01-01
We propose several means for improving the performance an training of neural networks for classification. We use crossvalidation as a tool for optimizing network parameters and architecture. We show further that the remaining generalization error can be reduced by invoking ensembles of similar...... networks....
Directory of Open Access Journals (Sweden)
Mohammad Heidari
2013-01-01
Full Text Available In this study, the static pull-in instability of beam-type micro-electromechanical system (MEMS is theoretically investigated. Considering the mid-plane stretching as the source of the nonlinearity in the beam behavior, a nonlinear size dependent Euler-Bernoulli beam model is used based on a modified couple stress theory, capable of capturing the size effect. Two supervised neural networks, namely, back propagation (BP and radial basis function (RBF, have been used for modeling the static pull-in instability of microcantilever beam. These networks have four inputs of length, width, gap, and the ratio of height to scale parameter of beam as the independent process variables, and the output is static pull-in voltage of microbeam. Numerical data employed for training the networks and capabilities of the models in predicting the pull-in instability behavior has been verified. Based on verification errors, it is shown that the radial basis function of neural network is superior in this particular case and has the average errors of 4.55% in predicting pull-in voltage of cantilever microbeam. Further analysis of pull-in instability of beam under different input conditions has been investigated and comparison results of modeling with numerical considerations show a good agreement, which also proves the feasibility and effectiveness of the adopted approach.
Neural Networks for Dynamic Flight Control
1993-12-01
uses the Adaline (22) model for development of the neural networks. Neural Graphics and other AFIT applications use a slightly different model. The...primary difference in the Nguyen application is that the Adaline uses the nonlinear function .f(a) = tanh(a) where standard backprop uses the sigmoid
Critical Branching Neural Networks
Kello, Christopher T.
2013-01-01
It is now well-established that intrinsic variations in human neural and behavioral activity tend to exhibit scaling laws in their fluctuations and distributions. The meaning of these scaling laws is an ongoing matter of debate between isolable causes versus pervasive causes. A spiking neural network model is presented that self-tunes to critical…
Critical Branching Neural Networks
Kello, Christopher T.
2013-01-01
It is now well-established that intrinsic variations in human neural and behavioral activity tend to exhibit scaling laws in their fluctuations and distributions. The meaning of these scaling laws is an ongoing matter of debate between isolable causes versus pervasive causes. A spiking neural network model is presented that self-tunes to critical…
Institute of Scientific and Technical Information of China (English)
张燕; 梁秀霞; 杨鹏; 陈增强; 袁著祉
2009-01-01
An adaptive inverse controller for nonliear discrete-time system is proposed in this paper. A compound neural network is constructed to identify the nonlinear system, which includes a linear part to approximate the nonlinear system and a recurrent neural network to minimize the difference between the linear model and the real nonlinear system. Because the current control input is not included in the input vector of recurrent neural network (RNN), the inverse control law can be calculated directly. This scheme can be used in real-time nonlinear single-input single-output (SISO) and multi-input multi-output (MIMO) system control with less computation work. Simulation studies have shown that this scheme is simple and affects good control accuracy and robustness.
[Application of artificial neural networks in infectious diseases].
Xu, Jun-fang; Zhou, Xiao-nong
2011-02-28
With the development of information technology, artificial neural networks has been applied to many research fields. Due to the special features such as nonlinearity, self-adaptation, and parallel processing, artificial neural networks are applied in medicine and biology. This review summarizes the application of artificial neural networks in the relative factors, prediction and diagnosis of infectious diseases in recent years.
Prediction based chaos control via a new neural network
Energy Technology Data Exchange (ETDEWEB)
Shen Liqun [School of Electrical Engineering and Automation, Harbin Institute of Technology, Harbin 150001 (China)], E-mail: liqunshen@gmail.com; Wang Mao [Space Control and Inertia Technology Research Center, Harbin Institute of Technology, Harbin 150001 (China); Liu Wanyu [School of Electrical Engineering and Automation, Harbin Institute of Technology, Harbin 150001 (China); Sun Guanghui [Space Control and Inertia Technology Research Center, Harbin Institute of Technology, Harbin 150001 (China)
2008-11-17
In this Letter, a new chaos control scheme based on chaos prediction is proposed. To perform chaos prediction, a new neural network architecture for complex nonlinear approximation is proposed. And the difficulty in building and training the neural network is also reduced. Simulation results of Logistic map and Lorenz system show the effectiveness of the proposed chaos control scheme and the proposed neural network.
Neural networks and graph theory
Institute of Scientific and Technical Information of China (English)
许进; 保铮
2002-01-01
The relationships between artificial neural networks and graph theory are considered in detail. The applications of artificial neural networks to many difficult problems of graph theory, especially NP-complete problems, and the applications of graph theory to artificial neural networks are discussed. For example graph theory is used to study the pattern classification problem on the discrete type feedforward neural networks, and the stability analysis of feedback artificial neural networks etc.
Institute of Scientific and Technical Information of China (English)
宋浩; 蔡遵生; 赵学庄; 李勇军; 习保民; 李燕妮
1999-01-01
A new method of controlling chemical chaos to attain the stabilized unstable periodic orbit (UPO) is proposed. It is an extension of the occasional proportional feedback (OPF) control strategy which spans the limitations of OPF, i.e. the linear region of the control rule, and extends to the whole chaotic region. It also expresses the nonlinear control rule with the back propogation-artificial neural network (BP-ANN) in order to increase the robustness of the control. Its effectiveness is examined through controlling an autocatalytic chaotic reaction model numerically.
2010-01-01
Back-propagation with gradient method is the most popular learning algorithm for feed-forward neural networks. However, it is critical to determine a proper fixed learning rate for the algorithm. In this paper, an optimized recursive algorithm is presented for online learning based on matrix operation and optimization methods analytically, which can avoid the trouble to select a proper learning rate for the gradient method. The proof of weak convergence of the proposed algorithm also is given...
Institute of Scientific and Technical Information of China (English)
张燕; 陈增强; 杨鹏; 袁著祉
2004-01-01
A nonlinear proportional-integral-derivative (PID) controller is constructed based on recurrent neural networks. In the control process of nonlinear multivariable systems, several nonlinear PID controllers have been adopted in parallel. Under the decoupling cost function, a decoupling control strategy is proposed. Then the stability condition of the controller is presented based on the Lyapunov theory. Simulation examples are given to show effectiveness of the proposed decoupling control.
Neural networks and applications tutorial
Guyon, I.
1991-09-01
The importance of neural networks has grown dramatically during this decade. While only a few years ago they were primarily of academic interest, now dozens of companies and many universities are investigating the potential use of these systems and products are beginning to appear. The idea of building a machine whose architecture is inspired by that of the brain has roots which go far back in history. Nowadays, technological advances of computers and the availability of custom integrated circuits, permit simulations of hundreds or even thousands of neurons. In conjunction, the growing interest in learning machines, non-linear dynamics and parallel computation spurred renewed attention in artificial neural networks. Many tentative applications have been proposed, including decision systems (associative memories, classifiers, data compressors and optimizers), or parametric models for signal processing purposes (system identification, automatic control, noise canceling, etc.). While they do not always outperform standard methods, neural network approaches are already used in some real world applications for pattern recognition and signal processing tasks. The tutorial is divided into six lectures, that where presented at the Third Graduate Summer Course on Computational Physics (September 3-7, 1990) on Parallel Architectures and Applications, organized by the European Physical Society: (1) Introduction: machine learning and biological computation. (2) Adaptive artificial neurons (perceptron, ADALINE, sigmoid units, etc.): learning rules and implementations. (3) Neural network systems: architectures, learning algorithms. (4) Applications: pattern recognition, signal processing, etc. (5) Elements of learning theory: how to build networks which generalize. (6) A case study: a neural network for on-line recognition of handwritten alphanumeric characters.
Zhang, Xiuyu; Su, Chun-Yi; Lin, Yan; Ma, Lianwei; Wang, Jianguo
2015-11-01
In this paper, an adaptive neural network (NN) dynamic surface control is proposed for a class of time-delay nonlinear systems with dynamic uncertainties and unknown hysteresis. The main advantages of the developed scheme are: 1) NNs are utilized to approximately describe nonlinearities and unknown dynamics of the nonlinear time-delay systems, making it possible to deal with unknown nonlinear uncertain systems and pursue the L∞ performance of the tracking error; 2) using the finite covering lemma together with the NNs approximators, the Krasovskii function is abandoned, which paves the way for obtaining the L∞ performance of the tracking error; 3) by introducing an initializing technique, the L∞ performance of the tracking error can be achieved; 4) using a generalized Prandtl-Ishlinskii (PI) model, the limitation of the traditional PI hysteresis model is overcome; and 5) by applying the Young's inequalities to deal with the weight vector of the NNs, the updated laws are needed only at the last controller design step with only two parameters being estimated, which reduces the computational burden. It is proved that the proposed scheme can guarantee semiglobal stability of the closed-loop system and achieves the L∞ performance of the tracking error. Simulation results for general second-order time-delay nonlinear systems and the tuning metal cutting system are presented to demonstrate the efficiency of the proposed method.
Neural networks in seismic discrimination
Energy Technology Data Exchange (ETDEWEB)
Dowla, F.U.
1995-01-01
Neural networks are powerful and elegant computational tools that can be used in the analysis of geophysical signals. At Lawrence Livermore National Laboratory, we have developed neural networks to solve problems in seismic discrimination, event classification, and seismic and hydrodynamic yield estimation. Other researchers have used neural networks for seismic phase identification. We are currently developing neural networks to estimate depths of seismic events using regional seismograms. In this paper different types of network architecture and representation techniques are discussed. We address the important problem of designing neural networks with good generalization capabilities. Examples of neural networks for treaty verification applications are also described.
Energy Technology Data Exchange (ETDEWEB)
Kondo, T. [School of Medical Sciences, The University of Tokushima., Tokushima (Japan)
1997-08-31
When neural network is applied to identification problem with complex structure, structure of the network becomes larger in its scale and more complex as its input variables increase, because of necessity on effect of high order in the input variable within the network. In this study, a neural network with self-selection ability of the input variables is proposed. This network can remove the neuron related to the input variables from inner portion of the network according to the prediction error estimation standard and construct a neural network only by means of the neuron related to useful input variables, even when it contains unnecessary variables for its input variable. In this paper, by comparing with identification results obtained by conventional neural network or improved GMDH method, its effectiveness could be elucidated. And, it applied to short-term forecasting problem of air pollution concentration, to compare its estimation accuracy with those of other prediction models. 18 refs., 10 figs., 3 tabs.
NARX neural networks for sequence processing tasks
Hristev, Eugen
2012-01-01
This project aims at researching and implementing a neural network architecture system for the NARX (Nonlinear AutoRegressive with eXogenous inputs) model, used in sequence processing tasks and particularly in time series prediction. The model can fallback to different types of architectures including time-delay neural networks and multi layer perceptron. The NARX simulator tests and compares the different architectures for both synthetic and real data, including the time series o...
Identification and Position Control of Marine Helm using Artificial Neural Network Neural Network
Directory of Open Access Journals (Sweden)
Hui ZHU
2008-02-01
Full Text Available If nonlinearities such as saturation of the amplifier gain and motor torque, gear backlash, and shaft compliances- just to name a few - are considered in the position control system of marine helm, traditional control methods are no longer sufficient to be used to improve the performance of the system. In this paper an alternative approach to traditional control methods - a neural network reference controller - is proposed to establish an adaptive control of the position of the marine helm to achieve the controlled variable at the command position. This neural network controller comprises of two neural networks. One is the plant model network used to identify the nonlinear system and the other the controller network used to control the output to follow the reference model. The experimental results demonstrate that this adaptive neural network reference controller has much better control performance than is obtained with traditional controllers.
Rule Extraction:Using Neural Networks or for Neural Networks?
Institute of Scientific and Technical Information of China (English)
Zhi-Hua Zhou
2004-01-01
In the research of rule extraction from neural networks, fidelity describes how well the rules mimic the behavior of a neural network while accuracy describes how well the rules can be generalized. This paper identifies the fidelity-accuracy dilemma. It argues to distinguish rule extraction using neural networks and rule extraction for neural networks according to their different goals, where fidelity and accuracy should be excluded from the rule quality evaluation framework, respectively.
Introduction to Artificial Neural Networks
DEFF Research Database (Denmark)
Larsen, Jan
1999-01-01
The note addresses introduction to signal analysis and classification based on artificial feed-forward neural networks.......The note addresses introduction to signal analysis and classification based on artificial feed-forward neural networks....
Simulation of photosynthetic production using neural network
Kmet, Tibor; Kmetova, Maria
2013-10-01
This paper deals with neural network based optimal control synthesis for solving optimal control problems with control and state constraints and discrete time delay. The optimal control problem is transcribed into nonlinear programming problem which is implemented with adaptive critic neural network. This approach is applicable to a wide class of nonlinear systems. The proposed simulation methods is illustrated by the optimal control problem of photosynthetic production described by discrete time delay differential equations. Results show that adaptive critic based systematic approach holds promise for obtaining the optimal control with control and state constraints.
Compressing Convolutional Neural Networks
Chen, Wenlin; Wilson, James T.; Tyree, Stephen; Weinberger, Kilian Q.; Chen, Yixin
2015-01-01
Convolutional neural networks (CNN) are increasingly used in many areas of computer vision. They are particularly attractive because of their ability to "absorb" great quantities of labeled data through millions of parameters. However, as model sizes increase, so do the storage and memory requirements of the classifiers. We present a novel network architecture, Frequency-Sensitive Hashed Nets (FreshNets), which exploits inherent redundancy in both convolutional layers and fully-connected laye...
Artificial neural network modelling
Samarasinghe, Sandhya
2016-01-01
This book covers theoretical aspects as well as recent innovative applications of Artificial Neural networks (ANNs) in natural, environmental, biological, social, industrial and automated systems. It presents recent results of ANNs in modelling small, large and complex systems under three categories, namely, 1) Networks, Structure Optimisation, Robustness and Stochasticity 2) Advances in Modelling Biological and Environmental Systems and 3) Advances in Modelling Social and Economic Systems. The book aims at serving undergraduates, postgraduates and researchers in ANN computational modelling. .
Critical branching neural networks.
Kello, Christopher T
2013-01-01
It is now well-established that intrinsic variations in human neural and behavioral activity tend to exhibit scaling laws in their fluctuations and distributions. The meaning of these scaling laws is an ongoing matter of debate between isolable causes versus pervasive causes. A spiking neural network model is presented that self-tunes to critical branching and, in doing so, simulates observed scaling laws as pervasive to neural and behavioral activity. These scaling laws are related to neural and cognitive functions, in that critical branching is shown to yield spiking activity with maximal memory and encoding capacities when analyzed using reservoir computing techniques. The model is also shown to account for findings of pervasive 1/f scaling in speech and cued response behaviors that are difficult to explain by isolable causes. Issues and questions raised by the model and its results are discussed from the perspectives of physics, neuroscience, computer and information sciences, and psychological and cognitive sciences.
Saurabh, K.; Dimri, A. P.
2016-05-01
Fog affects human life in a number of ways by reducing the visibility, hence affecting critical infrastructure, transportation, tourism or by the formation of frost, thus harming the standing crops. Smog is becoming a regular phenomenon in urban areas which is highly toxic to humans. Delhi was chosen as the area of study as it encounters all these hazards of fog stated apart from other political and economic reasons. The complex relationship behind the parameters and processes behind the formation of fog makes it extremely difficult to model and forecast it accurately. It is attempted to forecast the fog and understand its dynamics through a statistical downscaling technique of artificial neural network which is deemed accurate for short-term forecasting and usually outperform time-series models. The backpropagation neural network, which is a gradient descent algorithm where the network weights are moved along the negative of the gradient of the performance function, has been used for our analysis. Indian Meteorological Department (IMD) supported National Oceanic and Atmospheric Administration (NOAA) data had been used for carrying out the simulations. The model was found to have high accuracy but lacking in skill. An attempt has been made to present the data in a binary form by determining a threshold by the contingency table approach followed by its critical analysis. It is found that the calculation of an optimum threshold was also difficult to fix as the parameters of fog formation on which the model has been has been trained had shown some changes in their trend over a period of time.
Active Control of Sound based on Diagonal Recurrent Neural Network
Jayawardhana, Bayu; Xie, Lihua; Yuan, Shuqing
2002-01-01
Recurrent neural network has been known for its dynamic mapping and better suited for nonlinear dynamical system. Nonlinear controller may be needed in cases where the actuators exhibit the nonlinear characteristics, or in cases when the structure to be controlled exhibits nonlinear behavior. The fe
Active Control of Sound based on Diagonal Recurrent Neural Network
Jayawardhana, Bayu; Xie, Lihua; Yuan, Shuqing
2002-01-01
Recurrent neural network has been known for its dynamic mapping and better suited for nonlinear dynamical system. Nonlinear controller may be needed in cases where the actuators exhibit the nonlinear characteristics, or in cases when the structure to be controlled exhibits nonlinear behavior. The fe
Generalized Adaptive Artificial Neural Networks
Tawel, Raoul
1993-01-01
Mathematical model of supervised learning by artificial neural network provides for simultaneous adjustments of both temperatures of neurons and synaptic weights, and includes feedback as well as feedforward synaptic connections. Extension of mathematical model described in "Adaptive Neurons For Artificial Neural Networks" (NPO-17803). Dynamics of neural network represented in new model by less-restrictive continuous formalism.
Simulation Model of Magnetic Levitation Based on NARX Neural Networks
Directory of Open Access Journals (Sweden)
Dragan Antić
2013-04-01
Full Text Available In this paper, we present analysis of different training types for nonlinear autoregressive neural network, used for simulation of magnetic levitation system. First, the model of this highly nonlinear system is described and after that the Nonlinear Auto Regressive eXogenous (NARX of neural network model is given. Also, numerical optimization techniques for improved network training are described. It is verified that NARX neural network can be successfully used to simulate real magnetic levitation system if suitable training procedure is chosen, and the best two training types, obtained from experimental results, are described in details.
Santosa, H.; Hobara, Y.; Balikhin, M. A.
2015-12-01
Very Low Frequency (VLF) waves have been proposed as an approach to study and monitor the lower ionospheric conditions. The ionospheric perturbations are identified in relation with thunderstorm activity, geomagnetic storm and other factors. The temporal dependence of VLF amplitude has a complicated and large daily variabilities in general due to combinations of both effects from above (space weather effect) and below (atmospheric and crustal processes) of the ionosphere. Quantitative contributions from different external sources are not known well yet. Thus the modelling and prediction of VLF wave amplitude are important issues to study the lower ionospheric responses from various external parameters and to also detect the anomalies of the ionosphere. The purpose of the study is to model and predict nighttime average amplitude of VLF wave propagation from the VLF transmitter in Hawaii (NPM) to receiver in Chofu (CHO) Tokyo, Japan path using NARX neural network. The constructed model was trained for the target parameter of nighttime average amplitude of NPM-CHO path. The NARX model, which was built based on daily input variables of various physical parameters such as stratosphere temperature, cosmic rays and total column ozone, possessed good accuracies. As a result, the constructed models are capable of performing accurate multistep ahead predictions, while maintaining acceptable one step ahead prediction accuracy. The results of the predicted daily VLF amplitude are in good agreement with observed (true) value for one step ahead prediction (r = 0.92, RMSE = 1.99), multi-step ahead 5 days prediction (r = 0.91, RMSE = 1.14) and multi-step ahead 10 days prediction (r = 0.75, RMSE = 1.74). The developed model indicates the feasibility and reliability of predicting lower ionospheric properties by the NARX neural network approach, and provides physical insights on the responses of lower ionosphere due to various external forcing.
Interval probabilistic neural network.
Kowalski, Piotr A; Kulczycki, Piotr
2017-01-01
Automated classification systems have allowed for the rapid development of exploratory data analysis. Such systems increase the independence of human intervention in obtaining the analysis results, especially when inaccurate information is under consideration. The aim of this paper is to present a novel approach, a neural networking, for use in classifying interval information. As presented, neural methodology is a generalization of probabilistic neural network for interval data processing. The simple structure of this neural classification algorithm makes it applicable for research purposes. The procedure is based on the Bayes approach, ensuring minimal potential losses with regard to that which comes about through classification errors. In this article, the topological structure of the network and the learning process are described in detail. Of note, the correctness of the procedure proposed here has been verified by way of numerical tests. These tests include examples of both synthetic data, as well as benchmark instances. The results of numerical verification, carried out for different shapes of data sets, as well as a comparative analysis with other methods of similar conditioning, have validated both the concept presented here and its positive features.
Prediction of Parametric Roll Resonance by Multilayer Perceptron Neural Network
DEFF Research Database (Denmark)
Míguez González, M; López Peña, F.; Díaz Casás, V.
2011-01-01
acknowledged in the last few years. This work proposes a prediction system based on a multilayer perceptron (MP) neural network. The training and testing of the MP network is accomplished by feeding it with simulated data of a three degrees-of-freedom nonlinear model of a fishing vessel. The neural network...
Prediction of Parametric Roll Resonance by Multilayer Perceptron Neural Network
DEFF Research Database (Denmark)
Míguez González, M; López Peña, F.; Díaz Casás, V.
2011-01-01
acknowledged in the last few years. This work proposes a prediction system based on a multilayer perceptron (MP) neural network. The training and testing of the MP network is accomplished by feeding it with simulated data of a three degrees-of-freedom nonlinear model of a fishing vessel. The neural network...
Fast implementation of neural network classification
Seo, Guiwon; Ok, Jiheon; Lee, Chulhee
2013-09-01
Most artificial neural networks use a nonlinear activation function that includes sigmoid and hyperbolic tangent functions. Most artificial networks employ nonlinear functions such as these sigmoid and hyperbolic tangent functions, which incur high complexity costs, particularly during hardware implementation. In this paper, we propose new polynomial approximation methods for nonlinear activation functions that can substantially reduce complexity without sacrificing performance. The proposed approximation methods were applied to pattern classification problems. Experimental results show that the processing time was reduced by up to 50% without any performance degradations in terms of computer simulation.
Konovalov, I B
2002-01-01
The nonlinear features of the relationships between particulate matter (PM) and volatile organic compounds (VOC) and oxides of nitrogen (NOx) are derived directly from data of long-term routine measurements of NOx, VOC, and total suspended PM. The main idea of the method used for the analysis is creation of special empirical models based on artificial neural networks of the perceptron type. These models which are in essence the nonlinear extension of commonly used linear regression models are believed to provide the best fit for the real nonlinear PM-NOx-VOC relationships under different observed levels of air pollution and various meteorological conditions. It is believed that such models may be useful in context of various scientific and practical problems concerning PM. The method is demonstrated by the example of two empirical models created with independent data-sets collected at two air quality monitoring stations at South Coast Air Basin, California. It is shown that in spite of considerable distance b...
Additive Feed Forward Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1999-01-01
This paper demonstrates a method to control a non-linear, multivariable, noisy process using trained neural networks. The basis for the method is a trained neural network controller acting as the inverse process model. A training method for obtaining such an inverse process model is applied....... A suitable 'shaped' (low-pass filtered) reference is used to overcome problems with excessive control action when using a controller acting as the inverse process model. The control concept is Additive Feed Forward Control, where the trained neural network controller, acting as the inverse process model......, is placed in a supplementary pure feed-forward path to an existing feedback controller. This concept benefits from the fact, that an existing, traditional designed, feedback controller can be retained without any modifications, and after training the connection of the neural network feed-forward controller...
TIME SERIES FORECASTING USING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
BOGDAN OANCEA
2013-05-01
Full Text Available Recent studies have shown the classification and prediction power of the Neural Networks. It has been demonstrated that a NN can approximate any continuous function. Neural networks have been successfully used for forecasting of financial data series. The classical methods used for time series prediction like Box-Jenkins or ARIMA assumes that there is a linear relationship between inputs and outputs. Neural Networks have the advantage that can approximate nonlinear functions. In this paper we compared the performances of different feed forward and recurrent neural networks and training algorithms for predicting the exchange rate EUR/RON and USD/RON. We used data series with daily exchange rates starting from 2005 until 2013.
Additive Feed Forward Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1999-01-01
This paper demonstrates a method to control a non-linear, multivariable, noisy process using trained neural networks. The basis for the method is a trained neural network controller acting as the inverse process model. A training method for obtaining such an inverse process model is applied....... A suitable 'shaped' (low-pass filtered) reference is used to overcome problems with excessive control action when using a controller acting as the inverse process model. The control concept is Additive Feed Forward Control, where the trained neural network controller, acting as the inverse process model......, is placed in a supplementary pure feed-forward path to an existing feedback controller. This concept benefits from the fact, that an existing, traditional designed, feedback controller can be retained without any modifications, and after training the connection of the neural network feed-forward controller...
Chiang, Tung-Sheng; Chiu, Chian-Song
This paper proposes the sliding mode control using LMI techniques and adaptive recurrent fuzzy neural network (RFNN) for a class of uncertain nonlinear time-delay systems. First, a novel TS recurrent fuzzy neural network (TS-RFNN) is developed to provide more flexible and powerful compensation of system uncertainty. Then, the TS-RFNN based sliding model control is proposed for uncertain time-delay systems. In detail, sliding surface design is derived to cope with the non-Isidori-Bynes canonical form of dynamics, unknown delay time, and mismatched uncertainties. Based on the Lyapunov-Krasoviskii method, the asymptotic stability condition of the sliding motion is formulated into solving a Linear Matrix Inequality (LMI) problem which is independent on the time-varying delay. Furthermore, the input coupling uncertainty is also taken into our consideration. The overall controlled system achieves asymptotic stability even if considering poor modeling. The contributions include: i) asymptotic sliding surface is designed from solving a simple and legible delay-independent LMI; and ii) the TS-RFNN is more realizable (due to fewer fuzzy rules being used). Finally, simulation results demonstrate the validity of the proposed control scheme.
Energy Technology Data Exchange (ETDEWEB)
Gentili, Pier Luigi, E-mail: pierluigi.gentili@unipg.it [Department of Chemistry, Biology and Biotechnology, University of Perugia, 06123 Perugia (Italy); Gotoda, Hiroshi [Department of Mechanical Engineering, Ritsumeikan University, 1-1-1 Nojihigashi, Kusatsu-shi, Shiga 525-8577 (Japan); Dolnik, Milos; Epstein, Irving R. [Department of Chemistry, Brandeis University, Waltham, Massachusetts 02454-9110 (United States)
2015-01-15
Forecasting of aperiodic time series is a compelling challenge for science. In this work, we analyze aperiodic spectrophotometric data, proportional to the concentrations of two forms of a thermoreversible photochromic spiro-oxazine, that are generated when a cuvette containing a solution of the spiro-oxazine undergoes photoreaction and convection due to localized ultraviolet illumination. We construct the phase space for the system using Takens' theorem and we calculate the Lyapunov exponents and the correlation dimensions to ascertain the chaotic character of the time series. Finally, we predict the time series using three distinct methods: a feed-forward neural network, fuzzy logic, and a local nonlinear predictor. We compare the performances of these three methods.
Niu, Ben; Qin, Tian; Fan, Xiaodong
2016-10-01
In this paper, an adaptive neural network tracking control approach is proposed for a class of switched stochastic pure-feedback nonlinear systems with backlash-like hysteresis. In the design procedure, an affine variable is constructed, which avoids the use of the mean value theorem, and the additional first-order low-pass filter is employed to deal with the problem of explosion of complexity. Then, a common Lyapunov function and a state feedback controller are explicitly obtained for all subsystems. It is proved that the proposed controller that guarantees all signals in the closed-loop system are semi-globally uniformly ultimately bounded and the tracking error remains an adjustable neighbourhood of the origin. Finally, simulation results show the effectiveness of the presented control design approach.
Stability analysis of discrete-time BAM neural networks based on standard neural network models
Institute of Scientific and Technical Information of China (English)
ZHANG Sen-lin; LIU Mei-qin
2005-01-01
To facilitate stability analysis of discrete-time bidirectional associative memory (BAM) neural networks, they were converted into novel neural network models, termed standard neural network models (SNNMs), which interconnect linear dynamic systems and bounded static nonlinear operators. By combining a number of different Lyapunov functionals with S-procedure, some useful criteria of global asymptotic stability and global exponential stability of the equilibrium points of SNNMs were derived. These stability conditions were formulated as linear matrix inequalities (LMIs). So global stability of the discrete-time BAM neural networks could be analyzed by using the stability results of the SNNMs. Compared to the existing stability analysis methods, the proposed approach is easy to implement, less conservative, and is applicable to other recurrent neural networks.
Neural-networks-based Modelling and a Fuzzy Neural Networks Controller of MCFC
Institute of Scientific and Technical Information of China (English)
无
2002-01-01
Molten Carbonate Fuel Cells (MCFC) are produced with a highly efficient and clean power generation technology which will soon be widely utilized. The temperature characters of MCFC stack are briefly analyzed. A radial basis function (RBF) neural networks identification technology is applied to set up the temperature nonlinear model of MCFC stack, and the identification structure, algorithm and modeling training process are given in detail. A fuzzy controller of MCFC stack is designed. In order to improve its online control ability, a neural network trained by the I/O data of a fuzzy controller is designed. The neural networks can memorize and expand the inference rules of the fuzzy controller and substitute for the fuzzy controller to control MCFC stack online. A detailed design of the controller is given. The validity of MCFC stack modelling based on neural networks and the superior performance of the fuzzy neural networks controller are proved by Simulations.
Applying neural networks to optimize instrumentation performance
Energy Technology Data Exchange (ETDEWEB)
Start, S.E.; Peters, G.G.
1995-06-01
Well calibrated instrumentation is essential in providing meaningful information about the status of a plant. Signals from plant instrumentation frequently have inherent non-linearities, may be affected by environmental conditions and can therefore cause calibration difficulties for the people who maintain them. Two neural network approaches are described in this paper for improving the accuracy of a non-linear, temperature sensitive level probe ised in Expermental Breeder Reactor II (EBR-II) that was difficult to calibrate.
Visualization of neural networks using saliency maps
DEFF Research Database (Denmark)
Mørch, Niels J.S.; Kjems, Ulrik; Hansen, Lars Kai
1995-01-01
The saliency map is proposed as a new method for understanding and visualizing the nonlinearities embedded in feedforward neural networks, with emphasis on the ill-posed case, where the dimensionality of the input-field by far exceeds the number of examples. Several levels of approximations...
Directory of Open Access Journals (Sweden)
Kapil Nahar
2012-12-01
Full Text Available An artificial neural network is an information-processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information.The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurons working in unison to solve specific problems.Ann’s, like people, learn by example.
Neural networks for triggering
Energy Technology Data Exchange (ETDEWEB)
Denby, B. (Fermi National Accelerator Lab., Batavia, IL (USA)); Campbell, M. (Michigan Univ., Ann Arbor, MI (USA)); Bedeschi, F. (Istituto Nazionale di Fisica Nucleare, Pisa (Italy)); Chriss, N.; Bowers, C. (Chicago Univ., IL (USA)); Nesti, F. (Scuola Normale Superiore, Pisa (Italy))
1990-01-01
Two types of neural network beauty trigger architectures, based on identification of electrons in jets and recognition of secondary vertices, have been simulated in the environment of the Fermilab CDF experiment. The efficiencies for B's and rejection of background obtained are encouraging. If hardware tests are successful, the electron identification architecture will be tested in the 1991 run of CDF. 10 refs., 5 figs., 1 tab.
Directory of Open Access Journals (Sweden)
Kapil Nahar
2012-12-01
Full Text Available An artificial neural network is an information-processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information. The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurons working in unison to solve specific problems. Ann’s, like people, learn by example.
Nonlinear correction of sensors based on neural network model%基于神经网络模型的传感器非线性校正
Institute of Scientific and Technical Information of China (English)
田社平; 赵阳; 韦红雨; 王志武
2006-01-01
Back propagation (BP) neural network models are applied to correct nonlinear characteristics of sensors in this paper. Two sensors of the same type are used to measure two interrelated measurands and their outputs are put into the trained neural network model to obtain linear input-output characteristics. A Recursive Prediction Error(RPE) algorithm, which converges fast, is applied to train the neural network model. As an example, a correction method based on BP is applied to reduce the nonlinear output errors of range sensors. Experimental results show that linear input-output characteristics can be obtained by connecting the trained neural network model with the range sensors. The correction precision increases with the increasing number of nodes in the hidden layer. When the number of nodes in the hidden layer is 40 and the neural network model converges in about 100 iterations,the Error Index(EI) is 9.6×10-6.%讨论了BP神经网络模型在传感器非线性补偿中的应用.给出了相应的补偿方法,即采用两个相同的传感器对同一被测量进行不同的测量,其测量结果作为神经网络模型的输入,经过补偿后的传感器具有线性的输入输出关系.采用递推预报误差算法(PRE)训练神经网络,具有收敛速度快、收敛精度高的特点.以距离传感器为例,将基于BP神经网络的校正方法应用于减少距离传感器的非线性输出误差.实验结果表明,将训练后的神经网络接入距离传感器可以得到线性的输入-输出关系,增加神经网络隐层节点的数目可以提高校正精度.当隐层节点数取为40时,用于距离传感器非线性校正的神经网络模型在训练100步后的误差指数(EI)为9.6×10-6.结果表明:本文提出的基于神经网络模型的传感器非线性校正方法是行之有效的.
Matrix representation of a Neural Network
DEFF Research Database (Denmark)
Christensen, Bjørn Klint
This paper describes the implementation of a three-layer feedforward backpropagation neural network. The paper does not explain feedforward, backpropagation or what a neural network is. It is assumed, that the reader knows all this. If not please read chapters 2, 8 and 9 in Parallel Distributed...... Processing, by David Rummelhart (Rummelhart 1986) for an easy-to-read introduction. What the paper does explain is how a matrix representation of a neural net allows for a very simple implementation. The matrix representation is introduced in (Rummelhart 1986, chapter 9), but only for a two-layer linear...... network and the feedforward algorithm. This paper develops the idea further to three-layer non-linear networks and the backpropagation algorithm. Figure 1 shows the layout of a three-layer network. There are I input nodes, J hidden nodes and K output nodes all indexed from 0. Bias-node for the hidden...
Numeral eddy current sensor modelling based on genetic neural network
Institute of Scientific and Technical Information of China (English)
Yu A-Long
2008-01-01
This paper presents a method used to the numeral eddy current sensor modelling based on the genetic neural network to settle its nonlinear problem. The principle and algorithms of genetic neural network are introduced. In this method, the nonlinear model parameters of the numeral eddy current sensor are optimized by genetic neural network (GNN) according to measurement data. So the method remains both the global searching ability of genetic algorithm and the good local searching ability of neural network. The nonlinear model has the advantages of strong robustness,on-line modelling and high precision.The maximum nonlinearity error can be reduced to 0.037% by using GNN.However, the maximum nonlinearity error is 0.075% using the least square method.
A Bionic Neural Network for Fish-Robot Locomotion
Institute of Scientific and Technical Information of China (English)
Dai-bing Zhang; De-wen Hu; Lin-cheng Shen; Hai-bin Xie
2006-01-01
A bionic neural network for fish-robot locomotion is presented. The bionic neural network inspired from fish neural network consists of one high level controller and one chain of central pattern generators (CPGs). Each CPG contains a nonlinear neural Zhang oscillator which shows properties similar to sine-cosine model. Simulation results show that the bionic neural network presents a good performance in controlling the fish-robot to execute various motions such as startup,stop,forward swimming,backward swimming,turn right and turn left.
VOLTAGE COMPENSATION USING ARTIFICIAL NEURAL NETWORK
African Journals Online (AJOL)
VOLTAGE COMPENSATION USING ARTIFICIAL NEURAL NETWORK: A CASE STUDY OF RUMUOLA DISTRIBUTION NETWORK. ... The artificial neural networks controller engaged to controlling the dynamic voltage ... Article Metrics.
Zhang, Yunong; Wang, Jun
2002-06-01
A recurrent neural network called the dual neural network is proposed in this Letter for solving the strictly convex quadratic programming problems. Compared to other recurrent neural networks, the proposed dual network with fewer neurons can solve quadratic programming problems subject to equality, inequality, and bound constraints. The dual neural network is shown to be globally exponentially convergent to optimal solutions of quadratic programming problems. In addition, compared to neural networks containing high-order nonlinear terms, the dynamic equation of the proposed dual neural network is piecewise linear, and the network architecture is thus much simpler. The global convergence behavior of the dual neural network is demonstrated by an illustrative numerical example.
Position Sensorless Driving of BLDCM Using Neural Networks
Guo, Hai-Jiao; Sagawa, Seiji; Ichinokura, Osamu
A sensorless driving method of brushless DC Motors (BLDCM) using neural network has been studied in this paper. Considering the nonlinear characteristics and the parameter error of the modeling, neural networks are introduced to estimate the electromotive force (EMF). The results of simulation and experiment using offline trained neural networks show the proposed method is useful. In addition, the robustness about the parameters is discussed.
Biyanto, Totok R.
2016-06-01
Fouling in a heat exchanger in Crude Preheat Train (CPT) refinery is an unsolved problem that reduces the plant efficiency, increases fuel consumption and CO2 emission. The fouling resistance behavior is very complex. It is difficult to develop a model using first principle equation to predict the fouling resistance due to different operating conditions and different crude blends. In this paper, Artificial Neural Networks (ANN) MultiLayer Perceptron (MLP) with input structure using Nonlinear Auto-Regressive with eXogenous (NARX) is utilized to build the fouling resistance model in shell and tube heat exchanger (STHX). The input data of the model are flow rates and temperatures of the streams of the heat exchanger, physical properties of product and crude blend data. This model serves as a predicting tool to optimize operating conditions and preventive maintenance of STHX. The results show that the model can capture the complexity of fouling characteristics in heat exchanger due to thermodynamic conditions and variations in crude oil properties (blends). It was found that the Root Mean Square Error (RMSE) are suitable to capture the nonlinearity and complexity of the STHX fouling resistance during phases of training and validation.
Energy Technology Data Exchange (ETDEWEB)
Biyanto, Totok R. [Department of Engineering Physics, Institute Technology of Sepuluh Nopember Surabaya, Surabaya, Indonesia 60111 (Indonesia)
2016-06-03
Fouling in a heat exchanger in Crude Preheat Train (CPT) refinery is an unsolved problem that reduces the plant efficiency, increases fuel consumption and CO{sub 2} emission. The fouling resistance behavior is very complex. It is difficult to develop a model using first principle equation to predict the fouling resistance due to different operating conditions and different crude blends. In this paper, Artificial Neural Networks (ANN) MultiLayer Perceptron (MLP) with input structure using Nonlinear Auto-Regressive with eXogenous (NARX) is utilized to build the fouling resistance model in shell and tube heat exchanger (STHX). The input data of the model are flow rates and temperatures of the streams of the heat exchanger, physical properties of product and crude blend data. This model serves as a predicting tool to optimize operating conditions and preventive maintenance of STHX. The results show that the model can capture the complexity of fouling characteristics in heat exchanger due to thermodynamic conditions and variations in crude oil properties (blends). It was found that the Root Mean Square Error (RMSE) are suitable to capture the nonlinearity and complexity of the STHX fouling resistance during phases of training and validation.
Directory of Open Access Journals (Sweden)
Ruofeng Rao
2013-01-01
Full Text Available The robust exponential stability of delayed fuzzy Markovian-jumping Cohen-Grossberg neural networks (CGNNs with nonlinear p-Laplace diffusion is studied. Fuzzy mathematical model brings a great difficulty in setting up LMI criteria for the stability, and stochastic functional differential equations model with nonlinear diffusion makes it harder. To study the stability of fuzzy CGNNs with diffusion, we have to construct a Lyapunov-Krasovskii functional in non-matrix form. But stochastic mathematical formulae are always described in matrix forms. By way of some variational methods in W1,p(Ω, Itô formula, Dynkin formula, the semi-martingale convergence theorem, Schur Complement Theorem, and LMI technique, the LMI-based criteria on the robust exponential stability and almost sure exponential robust stability are finally obtained, the feasibility of which can efficiently be computed and confirmed by computer MatLab LMI toolbox. It is worth mentioning that even corollaries of the main results of this paper improve some recent related existing results. Moreover, some numerical examples are presented to illustrate the effectiveness and less conservatism of the proposed method due to the significant improvement in the allowable upper bounds of time delays.
Distributed Adaptive Neural Control for Stochastic Nonlinear Multiagent Systems.
Wang, Fang; Chen, Bing; Lin, Chong; Li, Xuehua
2016-11-14
In this paper, a consensus tracking problem of nonlinear multiagent systems is investigated under a directed communication topology. All the followers are modeled by stochastic nonlinear systems in nonstrict feedback form, where nonlinearities and stochastic disturbance terms are totally unknown. Based on the structural characteristic of neural networks (in Lemma 4), a novel distributed adaptive neural control scheme is put forward. The raised control method not only effectively handles unknown nonlinearities in nonstrict feedback systems, but also copes with the interactions among agents and coupling terms. Based on the stochastic Lyapunov functional method, it is indicated that all the signals of the closed-loop system are bounded in probability and all followers' outputs are convergent to a neighborhood of the output of leader. At last, the efficiency of the control method is testified by a numerical example.
Neural Network Approaches to Visual Motion Perception
Institute of Scientific and Technical Information of China (English)
郭爱克; 杨先一
1994-01-01
This paper concerns certain difficult problems in image processing and perception: neuro-computation of visual motion information. The first part of this paper deals with the spatial physiological integration by the figure-ground discrimination neural network in the visual system of the fly. We have outlined the fundamental organization and algorithms of this neural network, and mainly concentrated on the results of computer simulations of spatial physiological integration. It has been shown that the gain control mechanism , the nonlinearity of synaptic transmission characteristic , the interaction between the two eyes , and the directional selectivity of the pool cells play decisive roles in the spatial physiological integration. In the second part, we have presented a self-organizing neural network for the perception of visual motion by using a retinotopic array of Reichardt’s motion detectors and Kohonen’s self-organizing maps. It .has been demonstrated by computer simulations that the network is abl
Trimaran Resistance Artificial Neural Network
2011-01-01
11th International Conference on Fast Sea Transportation FAST 2011, Honolulu, Hawaii, USA, September 2011 Trimaran Resistance Artificial Neural Network Richard...Trimaran Resistance Artificial Neural Network 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) 5d. PROJECT NUMBER 5e... Artificial Neural Network and is restricted to the center and side-hull configurations tested. The value in the parametric model is that it is able to
Optimal Brain Surgeon on Artificial Neural Networks in
DEFF Research Database (Denmark)
Christiansen, Niels Hørbye; Job, Jonas Hultmann; Klyver, Katrine;
2012-01-01
It is shown how the procedure know as optimal brain surgeon can be used to trim and optimize artificial neural networks in nonlinear structural dynamics. Beside optimizing the neural network, and thereby minimizing computational cost in simulation, the surgery procedure can also serve as a quick...
Modelling the permeability of polymers: a neural network approach
Wessling, M.; Mulder, M.H.V.; Bos, A.; Linden, van der M.K.T.; Bos, M.; Linden, van der W.E.
1994-01-01
In this short communication, the prediction of the permeability of carbon dioxide through different polymers using a neural network is studied. A neural network is a numeric-mathematical construction that can model complex non-linear relationships. Here it is used to correlate the IR spectrum of a p
THE ARTIFICIAL NEURAL NETWORK OF FORECASTING OPEN MINING SLOPE STABILITY
Institute of Scientific and Technical Information of China (English)
魏春启; 白润才
2000-01-01
The artificial neural network model which forecasts Open Mining Slope stability is established by neural network theory and method. The nonlinear reflection relation between stability target of open mining slope and its influence factor is described. The method of forecasting Open Mining Slope stability is brought forward.
[Artificial neural networks in Neurosciences].
Porras Chavarino, Carmen; Salinas Martínez de Lecea, José María
2011-11-01
This article shows that artificial neural networks are used for confirming the relationships between physiological and cognitive changes. Specifically, we explore the influence of a decrease of neurotransmitters on the behaviour of old people in recognition tasks. This artificial neural network recognizes learned patterns. When we change the threshold of activation in some units, the artificial neural network simulates the experimental results of old people in recognition tasks. However, the main contributions of this paper are the design of an artificial neural network and its operation inspired by the nervous system and the way the inputs are coded and the process of orthogonalization of patterns.
Artificial neural networks in neurosurgery.
Azimi, Parisa; Mohammadi, Hasan Reza; Benzel, Edward C; Shahzadi, Sohrab; Azhari, Shirzad; Montazeri, Ali
2015-03-01
Artificial neural networks (ANNs) effectively analyze non-linear data sets. The aimed was A review of the relevant published articles that focused on the application of ANNs as a tool for assisting clinical decision-making in neurosurgery. A literature review of all full publications in English biomedical journals (1993-2013) was undertaken. The strategy included a combination of key words 'artificial neural networks', 'prognostic', 'brain', 'tumor tracking', 'head', 'tumor', 'spine', 'classification' and 'back pain' in the title and abstract of the manuscripts using the PubMed search engine. The major findings are summarized, with a focus on the application of ANNs for diagnostic and prognostic purposes. Finally, the future of ANNs in neurosurgery is explored. A total of 1093 citations were identified and screened. In all, 57 citations were found to be relevant. Of these, 50 articles were eligible for inclusion in this review. The synthesis of the data showed several applications of ANN in neurosurgery, including: (1) diagnosis and assessment of disease progression in low back pain, brain tumours and primary epilepsy; (2) enhancing clinically relevant information extraction from radiographic images, intracranial pressure processing, low back pain and real-time tumour tracking; (3) outcome prediction in epilepsy, brain metastases, lumbar spinal stenosis, lumbar disc herniation, childhood hydrocephalus, trauma mortality, and the occurrence of symptomatic cerebral vasospasm in patients with aneurysmal subarachnoid haemorrhage; (4) the use in the biomechanical assessments of spinal disease. ANNs can be effectively employed for diagnosis, prognosis and outcome prediction in neurosurgery.
Hervás, C; Toledo, R; Silva, M
2001-01-01
The suitability of pruned computational neural networks (CNNs) for resolving nonlinear multicomponent systems involving synergistic effects by use of oscillating chemical reaction-based methods implemented using the analyte pulse perturbation technique is demonstrated. The CNN input data used for this purpose are estimates provided by the Levenberg-Marquardt method in the form of a three-parameter Gaussian curve associated with the singular profile obtained when the oscillating system is perturbed by an analyte mixture. The performance of the proposed method was assessed by applying it to the resolution of mixtures of pyrogallol and gallic acid based on their perturbating effect on a classical oscillating chemical system, viz. the Belousov-Zhabotinskyi reaction. A straightforward network topology (3:3:2, with 18 connections after pruning) allowed the resolution of mixtures of the two analytes in concentration ratios from 1:7 to 6:2 with a standard error of prediction for the testing set of 4.01 and 8.98% for pyrogallol and gallic acid, respectively. The reduced dimensions of the selected CNN architecture allowed a mathematical transformation of the input vector into the output one that can be easily implemented via software. Finally, the suitability of response surface analysis as an alternative to CNNs was also tested. The results were poor (relative errors were high), which confirms that properly selected pruned CNNs are effective tools for solving the analytical problem addressed in this work.
ON THE STABILITY OF THE CELLULAR NEURAL NETWORKS WITH TIME LAGS
Vladimir RASVAN; Daniela DANCIU
2004-01-01
Cellular neural networks (CNNs) are recurrent artificial neural networks. Due to their cyclic connections and to the neurons’ nonlinear activation functions, recurrent neural networks are nonlinear dynamic systems, which display stable and unstable fixed points, limit cycles and chaotic behavior. Since the field of neural networks is still a young one, improving the stability conditions for such systems is an obvious and quasipermanent task. This paper focuses on CNNs affected by time delays....
Study on Adaptive Control with Neural Network Compensation
Institute of Scientific and Technical Information of China (English)
单剑锋; 黄忠华; 崔占忠
2004-01-01
A scheme of adaptive control based on a recurrent neural network with a neural network compensation is presented for a class of nonlinear systems with a nonlinear prefix. The recurrent neural network is used to identify the unknown nonlinear part and compensate the difference between the real output and the identified model output. The identified model of the controlled object consists of a linear model and the neural network. The generalized minimum variance control method is used to identify pareters, which can deal with the problem of adaptive control of systems with unknown nonlinear part, which can not be controlled by traditional methods. Simulation results show that this algorithm has higher precision, faster convergent speed.
Heiden, Uwe
1980-01-01
The purpose of this work is a unified and general treatment of activity in neural networks from a mathematical pOint of view. Possible applications of the theory presented are indica ted throughout the text. However, they are not explored in de tail for two reasons : first, the universal character of n- ral activity in nearly all animals requires some type of a general approach~ secondly, the mathematical perspicuity would suffer if too many experimental details and empirical peculiarities were interspersed among the mathematical investigation. A guide to many applications is supplied by the references concerning a variety of specific issues. Of course the theory does not aim at covering all individual problems. Moreover there are other approaches to neural network theory (see e.g. Poggio-Torre, 1978) based on the different lev els at which the nervous system may be viewed. The theory is a deterministic one reflecting the average be havior of neurons or neuron pools. In this respect the essay is writt...
Global sea surface temperature (SST) anomalies can affect terrestrial precipitation via ocean-atmosphere interaction known as climate teleconnection. Non-stationary and non-linear characteristics of the ocean-atmosphere system make the identification of the teleconnection signals...
Term Structure of Interest Rates Based on Artificial Neural Network
Institute of Scientific and Technical Information of China (English)
无
2007-01-01
In light of the nonlinear approaching capability of artificial neural networks ( ANN), the term structure of interest rates is predicted using The generalized regression neural network (GRNN) and back propagation (BP) neural networks models. The prediction performance is measured with US interest rate data. Then, RBF and BP models are compared with Vasicek's model and Cox-Ingersoll-Ross (CIR) model. The comparison reveals that neural network models outperform Vasicek's model and CIR model,which are more precise and closer to the real market situation.
Neural Network Inverse Adaptive Controller Based on Davidon Least Square
Institute of Scientific and Technical Information of China (English)
无
2000-01-01
General neural network inverse adaptive controller haa two flaws: the first is the slow convergence speed; the second is the invalidation to the non-minimum phase system.These defects limit the scope in which the neural network inverse adaptive controller is used.We employ Davidon least squares in training the multi-layer feedforward neural network used in approximating the inverse model of plant to expedite the convergence,and then through constructing the pseudo-plant,a neural network inverse adaptive controller is put forward which is still effective to the nonlinear non-minimum phase system.The simulation results show the validity of this scheme.
IDENTIFICATION AND CONTROL OF AN ASYNCHRONOUS MACHINE USING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
A ZERGAOUI
2000-06-01
Full Text Available In this work, we present the application of artificial neural networks to the identification and control of the asynchronous motor, which is a complex nonlinear system with variable internal dynamics. We show that neural networks can be applied to control the stator currents of the induction motor. The results of the different simulations are presented to evaluate the performance of the neural controller proposed.
Issues in the use of neural networks in information retrieval
Iatan, Iuliana F
2017-01-01
This book highlights the ability of neural networks (NNs) to be excellent pattern matchers and their importance in information retrieval (IR), which is based on index term matching. The book defines a new NN-based method for learning image similarity and describes how to use fuzzy Gaussian neural networks to predict personality. It introduces the fuzzy Clifford Gaussian network, and two concurrent neural models: (1) concurrent fuzzy nonlinear perceptron modules, and (2) concurrent fuzzy Gaussian neural network modules. Furthermore, it explains the design of a new model of fuzzy nonlinear perceptron based on alpha level sets and describes a recurrent fuzzy neural network model with a learning algorithm based on the improved particle swarm optimization method.
Thermoelastic steam turbine rotor control based on neural network
Rzadkowski, Romuald; Dominiczak, Krzysztof; Radulski, Wojciech; Szczepanik, R.
2015-12-01
Considered here are Nonlinear Auto-Regressive neural networks with eXogenous inputs (NARX) as a mathematical model of a steam turbine rotor for controlling steam turbine stress on-line. In order to obtain neural networks that locate critical stress and temperature points in the steam turbine during transient states, an FE rotor model was built. This model was used to train the neural networks on the basis of steam turbine transient operating data. The training included nonlinearity related to steam turbine expansion, heat exchange and rotor material properties during transients. Simultaneous neural networks are algorithms which can be implemented on PLC controllers. This allows for the application neural networks to control steam turbine stress in industrial power plants.
Yildiz, Nihat; Karabacak, Mehmet; Kurt, Mustafa; Akkoyun, Serkan
2012-05-01
Being directly related to the electric charge distributions in a molecule, the vibrational spectra intensities are both experimentally and theoretically important physical quantities. However, these intensities are inherently highly nonlinear and of complex pattern. Therefore, in particular for unknown detailed spatial molecular structures, it is difficult to make ab initio intensity calculations to compare with new experimental data. In this respect, we very recently initiated entirely novel layered feedforward neural network (LFNN) approach to construct empirical physical formulas (EPFs) for density functional theory (DFT) vibrational spectra of some molecules. In this paper, as a new and far improved contribution to our novel molecular vibrational spectra LFNN-EPF approach, we constructed LFFN-EPFs for absorbances and intensities of 6-choloronicotinic acid (6-CNA) molecule. The 6-CNA data, borrowed from our previous study, was entirely different and much larger than the vibrational intensity data of our formerly used LFNN-EPF molecules. In line with our another previous work which theoretically proved the LFNN relevance to EPFs, although the 6-CNA DFT absorbance and intensity were inherently highly nonlinear and sharply fluctuating in character, still the optimally constructed train set LFFN-EPFs very successfully fitted the absorbances and intensities. Moreover, test set (i.e. yet-to-be measured experimental data) LFNN-EPFs consistently and successfully predicted the absorbance and intensity data. This simply means that the physical law embedded in the 6-CNA vibrational data was successfully extracted by the LFNN-EPFs. In conclusion, these vibrational LFNN-EPFs are of explicit form. Therefore, by various suitable operations of mathematical analysis, they can be used to estimate the electronic charge distributions of the unknown molecule of the significant complexity. Additionally, these estimations can be combined with those of theoretical DFT atomic polar
Tagliaferri, Roberto; Longo, Giuseppe; Milano, Leopoldo; Acernese, Fausto; Barone, Fabrizio; Ciaramella, Angelo; De Rosa, Rosario; Donalek, Ciro; Eleuteri, Antonio; Raiconi, Giancarlo; Sessa, Salvatore; Staiano, Antonino; Volpicelli, Alfredo
2003-01-01
In the last decade, the use of neural networks (NN) and of other soft computing methods has begun to spread also in the astronomical community which, due to the required accuracy of the measurements, is usually reluctant to use automatic tools to perform even the most common tasks of data reduction and data mining. The federation of heterogeneous large astronomical databases which is foreseen in the framework of the astrophysical virtual observatory and national virtual observatory projects, is, however, posing unprecedented data mining and visualization problems which will find a rather natural and user friendly answer in artificial intelligence tools based on NNs, fuzzy sets or genetic algorithms. This review is aimed to both astronomers (who often have little knowledge of the methodological background) and computer scientists (who often know little about potentially interesting applications), and therefore will be structured as follows: after giving a short introduction to the subject, we shall summarize the methodological background and focus our attention on some of the most interesting fields of application, namely: object extraction and classification, time series analysis, noise identification, and data mining. Most of the original work described in the paper has been performed in the framework of the AstroNeural collaboration (Napoli-Salerno).
Sahoo, Avimanyu; Xu, Hao; Jagannathan, Sarangapani
2016-01-01
This paper presents a novel adaptive neural network (NN) control of single-input and single-output uncertain nonlinear discrete-time systems under event sampled NN inputs. In this control scheme, the feedback signals are transmitted, and the NN weights are tuned in an aperiodic manner at the event sampled instants. After reviewing the NN approximation property with event sampled inputs, an adaptive state estimator (SE), consisting of linearly parameterized NNs, is utilized to approximate the unknown system dynamics in an event sampled context. The SE is viewed as a model and its approximated dynamics and the state vector, during any two events, are utilized for the event-triggered controller design. An adaptive event-trigger condition is derived by using both the estimated NN weights and a dead-zone operator to determine the event sampling instants. This condition both facilitates the NN approximation and reduces the transmission of feedback signals. The ultimate boundedness of both the NN weight estimation error and the system state vector is demonstrated through the Lyapunov approach. As expected, during an initial online learning phase, events are observed more frequently. Over time with the convergence of the NN weights, the inter-event times increase, thereby lowering the number of triggered events. These claims are illustrated through the simulation results.
Logic Mining Using Neural Networks
Sathasivam, Saratha
2008-01-01
Knowledge could be gained from experts, specialists in the area of interest, or it can be gained by induction from sets of data. Automatic induction of knowledge from data sets, usually stored in large databases, is called data mining. Data mining methods are important in the management of complex systems. There are many technologies available to data mining practitioners, including Artificial Neural Networks, Regression, and Decision Trees. Neural networks have been successfully applied in wide range of supervised and unsupervised learning applications. Neural network methods are not commonly used for data mining tasks, because they often produce incomprehensible models, and require long training times. One way in which the collective properties of a neural network may be used to implement a computational task is by way of the concept of energy minimization. The Hopfield network is well-known example of such an approach. The Hopfield network is useful as content addressable memory or an analog computer for s...
Neural Networks in Control Applications
DEFF Research Database (Denmark)
Sørensen, O.
The intention of this report is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: - Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. - Amongst numerous training algorithms, only four algorithms are examined, all...... in a recursive form (sample updating). The simplest is the Back Probagation Error Algorithm, and the most complex is the recursive Prediction Error Method using a Gauss-Newton search direction. - Over-fitting is often considered to be a serious problem when training neural networks. This problem is specifically...
On analog implementations of discrete neural networks
Energy Technology Data Exchange (ETDEWEB)
Beiu, V.; Moore, K.R.
1998-12-01
The paper will show that in order to obtain minimum size neural networks (i.e., size-optimal) for implementing any Boolean function, the nonlinear activation function of the neutrons has to be the identity function. The authors shall shortly present many results dealing with the approximation capabilities of neural networks, and detail several bounds on the size of threshold gate circuits. Based on a constructive solution for Kolmogorov`s superpositions they will show that implementing Boolean functions can be done using neurons having an identity nonlinear function. It follows that size-optimal solutions can be obtained only using analog circuitry. Conclusions, and several comments on the required precision are ending the paper.
Medical diagnosis using neural network
Kamruzzaman, S M; Siddiquee, Abu Bakar; Mazumder, Md Ehsanul Hoque
2010-01-01
This research is to search for alternatives to the resolution of complex medical diagnosis where human knowledge should be apprehended in a general fashion. Successful application examples show that human diagnostic capabilities are significantly worse than the neural diagnostic system. This paper describes a modified feedforward neural network constructive algorithm (MFNNCA), a new algorithm for medical diagnosis. The new constructive algorithm with backpropagation; offer an approach for the incremental construction of near-minimal neural network architectures for pattern classification. The algorithm starts with minimal number of hidden units in the single hidden layer; additional units are added to the hidden layer one at a time to improve the accuracy of the network and to get an optimal size of a neural network. The MFNNCA was tested on several benchmarking classification problems including the cancer, heart disease and diabetes. Experimental results show that the MFNNCA can produce optimal neural networ...
Nonlinear dynamics of neural delayed feedback
Energy Technology Data Exchange (ETDEWEB)
Longtin, A.
1990-01-01
Neural delayed feedback is a property shared by many circuits in the central and peripheral nervous systems. The evolution of the neural activity in these circuits depends on their present state as well as on their past states, due to finite propagation time of neural activity along the feedback loop. These systems are often seen to undergo a change from a quiescent state characterized by low level fluctuations to an oscillatory state. We discuss the problem of analyzing this transition using techniques from nonlinear dynamics and stochastic processes. Our main goal is to characterize the nonlinearities which enable autonomous oscillations to occur and to uncover the properties of the noise sources these circuits interact with. The concepts are illustrated on the human pupil light reflex (PLR) which has been studied both theoretically and experimentally using this approach. 5 refs., 3 figs.
Development of programmable artificial neural networks
Meade, Andrew J.
1993-01-01
Conventionally programmed digital computers can process numbers with great speed and precision, but do not easily recognize patterns or imprecise or contradictory data. Instead of being programmed in the conventional sense, artificial neural networks are capable of self-learning through exposure to repeated examples. However, the training of an ANN can be a time consuming and unpredictable process. A general method is being developed to mate the adaptability of the ANN with the speed and precision of the digital computer. This method was successful in building feedforward networks that can approximate functions and their partial derivatives from examples in a single iteration. The general method also allows the formation of feedforward networks that can approximate the solution to nonlinear ordinary and partial differential equations to desired accuracy without the need of examples. It is believed that continued research will produce artificial neural networks that can be used with confidence in practical scientific computing and engineering applications.
Diagnosing process faults using neural network models
Energy Technology Data Exchange (ETDEWEB)
Buescher, K.L.; Jones, R.D.; Messina, M.J.
1993-11-01
In order to be of use for realistic problems, a fault diagnosis method should have the following three features. First, it should apply to nonlinear processes. Second, it should not rely on extensive amounts of data regarding previous faults. Lastly, it should detect faults promptly. The authors present such a scheme for static (i.e., non-dynamic) systems. It involves using a neural network to create an associative memory whose fixed points represent the normal behavior of the system.
Adaptive Filtering Using Recurrent Neural Networks
Parlos, Alexander G.; Menon, Sunil K.; Atiya, Amir F.
2005-01-01
A method for adaptive (or, optionally, nonadaptive) filtering has been developed for estimating the states of complex process systems (e.g., chemical plants, factories, or manufacturing processes at some level of abstraction) from time series of measurements of system inputs and outputs. The method is based partly on the fundamental principles of the Kalman filter and partly on the use of recurrent neural networks. The standard Kalman filter involves an assumption of linearity of the mathematical model used to describe a process system. The extended Kalman filter accommodates a nonlinear process model but still requires linearization about the state estimate. Both the standard and extended Kalman filters involve the often unrealistic assumption that process and measurement noise are zero-mean, Gaussian, and white. In contrast, the present method does not involve any assumptions of linearity of process models or of the nature of process noise; on the contrary, few (if any) assumptions are made about process models, noise models, or the parameters of such models. In this regard, the method can be characterized as one of nonlinear, nonparametric filtering. The method exploits the unique ability of neural networks to approximate nonlinear functions. In a given case, the process model is limited mainly by limitations of the approximation ability of the neural networks chosen for that case. Moreover, despite the lack of assumptions regarding process noise, the method yields minimum- variance filters. In that they do not require statistical models of noise, the neural- network-based state filters of this method are comparable to conventional nonlinear least-squares estimators.
Integration of Unascertained Method with Neural Networks and Its Application
Directory of Open Access Journals (Sweden)
Huawang Shi
2011-11-01
Full Text Available This paper presents the adoption of artificial neural network (ANN model and Unascertained system to assist decision-makers in forecasting the early warning of financial in China. Artificial neural network (ANN has outstanding characteristics in machine learning, fault, tolerant, parallel reasoning and processing nonlinear problem abilities. Unascertained system that imitates the human brain's thinking logical is a kind of mathematical tools used to deal with imprecise and uncertain knowledge. Integrating unascertained method with neural network technology, the reasoning process of network coding can be tracked, and the output of the network can be given a physical explanation. Application case shows that combines unascertained systems with feedforward artificial neural networks can obtain more reasonable and more advantage of nonlinear mapping that can handle more complete type of data.
Institute of Scientific and Technical Information of China (English)
王赟松; 刘钦龙; 高卫中
2004-01-01
标准BP神经网络算法收敛速度慢是限制其广泛应用的主要原因.为此,以标准BP算法为基础,应用最小二乘法理论,提出了一种收敛速度快的BP算法--NLMSBP算法.仿真结果表明,和标准BP算法及其它改进形式比较,NLMSBP算法收敛速度大大提高,稳定性并未降低,这为BP神经网络应用于实时性要求高的场合提供了算法基础.该算法缺点是计算量大,所需计算机内存大,不适于大型网络的计算.%That standard backpropagation(BP) algorithm for training neural networks converges slowly is the main reason why it cannot be used widely in practical applications. Therefore, a new kind of BP algorithm, called the NLMSBP algorithm for short, is put forward in this paper by using solutions for a nonlinear least mean square problem. The experimental results have proved that the algorithm converges very fast and has good stability compared with the standard BP algorithm and the other modifications. It is suitable for training the network with a few thousands of weights and offsets and high training precision demand. If the computer memory is enough, the superiority of the algorithm over the others is very notable. Indeed, it is worth popularizing.
Artificial Neural Network Analysis System
2007-11-02
Contract No. DASG60-00-M-0201 Purchase request no.: Foot in the Door-01 Title Name: Artificial Neural Network Analysis System Company: Atlantic... Artificial Neural Network Analysis System 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) Powell, Bruce C 5d. PROJECT NUMBER 5e. TASK NUMBER...34) 27-02-2001 Report Type N/A Dates Covered (from... to) ("DD MON YYYY") 28-10-2000 27-02-2001 Title and Subtitle Artificial Neural Network Analysis
Decoupling Control Method Based on Neural Network for Missiles
Institute of Scientific and Technical Information of China (English)
ZHAN Li; LUO Xi-shuang; ZHANG Tian-qiao
2005-01-01
In order to make the static state feedback nonlinear decoupling control law for a kind of missile to be easy for implementation in practice, an improvement is discussed. The improvement method is to introduce a BP neural network to approximate the decoupling control laws which are designed for different aerodynamic characteristic points, so a new decoupling control law based on BP neural network is produced after the network training. The simulation results on an example illustrate the approach obtained feasible and effective.
Nanda, Trushnamayee; Sahoo, Bhabagrahi; Beria, Harsh; Chatterjee, Chandranath
2016-08-01
Although flood forecasting and warning system is a very important non-structural measure in flood-prone river basins, poor raingauge network as well as unavailability of rainfall data in real-time could hinder its accuracy at different lead times. Conversely, since the real-time satellite-based rainfall products are now becoming available for the data-scarce regions, their integration with the data-driven models could be effectively used for real-time flood forecasting. To address these issues in operational streamflow forecasting, a new data-driven model, namely, the wavelet-based non-linear autoregressive with exogenous inputs (WNARX) is proposed and evaluated in comparison with four other data-driven models, viz., the linear autoregressive moving average with exogenous inputs (ARMAX), static artificial neural network (ANN), wavelet-based ANN (WANN), and dynamic nonlinear autoregressive with exogenous inputs (NARX) models. First, the quality of input rainfall products of Tropical Rainfall Measuring Mission Multi-satellite Precipitation Analysis (TMPA), viz., TRMM and TRMM-real-time (RT) rainfall products is assessed through statistical evaluation. The results reveal that the satellite rainfall products moderately correlate with the observed rainfall, with the gauge-adjusted TRMM product outperforming the real-time TRMM-RT product. The TRMM rainfall product better captures the ground observations up to 95 percentile range (30.11 mm/day), although the hit rate decreases for high rainfall intensity. The effect of antecedent rainfall (AR) and climate forecast system reanalysis (CFSR) temperature product on the catchment response is tested in all the developed models. The results reveal that, during real-time flow simulation, the satellite-based rainfall products generally perform worse than the gauge-based rainfall. Moreover, as compared to the existing models, the flow forecasting by the WNARX model is way better than the other four models studied herein with the
Modular, Hierarchical Learning By Artificial Neural Networks
Baldi, Pierre F.; Toomarian, Nikzad
1996-01-01
Modular and hierarchical approach to supervised learning by artificial neural networks leads to neural networks more structured than neural networks in which all neurons fully interconnected. These networks utilize general feedforward flow of information and sparse recurrent connections to achieve dynamical effects. The modular organization, sparsity of modular units and connections, and fact that learning is much more circumscribed are all attractive features for designing neural-network hardware. Learning streamlined by imitating some aspects of biological neural networks.
Identification of Nonlinear Systems Using Neurofuzzy Networks
Institute of Scientific and Technical Information of China (English)
LI Ying; JIAO Licheng
2001-01-01
This paper presents a compound neu-ral network model, I.e., adaptive neurofuzzy network(ANFN), which can be used for identifying the com-plicated nonlinear system. The proposed ANFN has asimple structure and exploits a hybrid algorithm com-bining supervised learning and unsupervised learning.In addition, ANFN is capable of overcoming the errorof system identification due to the existence of somechanging points and improving the accuracy of identi-fication of the whole system. The effectiveness of themodel and its algorithm are tested on the identifica-tion results of missile attacking area.
Neural networks and statistical learning
Du, Ke-Lin
2014-01-01
Providing a broad but in-depth introduction to neural network and machine learning in a statistical framework, this book provides a single, comprehensive resource for study and further research. All the major popular neural network models and statistical learning approaches are covered with examples and exercises in every chapter to develop a practical working understanding of the content. Each of the twenty-five chapters includes state-of-the-art descriptions and important research results on the respective topics. The broad coverage includes the multilayer perceptron, the Hopfield network, associative memory models, clustering models and algorithms, the radial basis function network, recurrent neural networks, principal component analysis, nonnegative matrix factorization, independent component analysis, discriminant analysis, support vector machines, kernel methods, reinforcement learning, probabilistic and Bayesian networks, data fusion and ensemble learning, fuzzy sets and logic, neurofuzzy models, hardw...
Neural Networks in Control Applications
DEFF Research Database (Denmark)
Sørensen, O.
examined, and it appears that considering 'normal' neural network models with, say, 500 samples, the problem of over-fitting is neglible, and therefore it is not taken into consideration afterwards. Numerous model types, often met in control applications, are implemented as neural network models....... - Control concepts including parameter estimation - Control concepts including inverse modelling - Control concepts including optimal control For each of the three groups, different control concepts and specific training methods are detailed described.Further, all control concepts are tested on the same......The intention of this report is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...
The holographic neural network: Performance comparison with other neural networks
Klepko, Robert
1991-10-01
The artificial neural network shows promise for use in recognition of high resolution radar images of ships. The holographic neural network (HNN) promises a very large data storage capacity and excellent generalization capability, both of which can be achieved with only a few learning trials, unlike most neural networks which require on the order of thousands of learning trials. The HNN is specially designed for pattern association storage, and mathematically realizes the storage and retrieval mechanisms of holograms. The pattern recognition capability of the HNN was studied, and its performance was compared with five other commonly used neural networks: the Adaline, Hamming, bidirectional associative memory, recirculation, and back propagation networks. The patterns used for testing represented artificial high resolution radar images of ships, and appear as a two dimensional topology of peaks with various amplitudes. The performance comparisons showed that the HNN does not perform as well as the other neural networks when using the same test data. However, modification of the data to make it appear more Gaussian distributed, improved the performance of the network. The HNN performs best if the data is completely Gaussian distributed.
Adaptive Neural Control for a Class of Outputs Time-Delay Nonlinear Systems
Directory of Open Access Journals (Sweden)
Ruliang Wang
2012-01-01
Full Text Available This paper considers an adaptive neural control for a class of outputs time-delay nonlinear systems with perturbed or no. Based on RBF neural networks, the radius basis function (RBF neural networks is employed to estimate the unknown continuous functions. The proposed control guarantees that all closed-loop signals remain bounded. The simulation results demonstrate the effectiveness of the proposed control scheme.
Functional expansion representations of artificial neural networks
Gray, W. Steven
1992-01-01
In the past few years, significant interest has developed in using artificial neural networks to model and control nonlinear dynamical systems. While there exists many proposed schemes for accomplishing this and a wealth of supporting empirical results, most approaches to date tend to be ad hoc in nature and rely mainly on heuristic justifications. The purpose of this project was to further develop some analytical tools for representing nonlinear discrete-time input-output systems, which when applied to neural networks would give insight on architecture selection, pruning strategies, and learning algorithms. A long term goal is to determine in what sense, if any, a neural network can be used as a universal approximator for nonliner input-output maps with memory (i.e., realized by a dynamical system). This property is well known for the case of static or memoryless input-output maps. The general architecture under consideration in this project was a single-input, single-output recurrent feedforward network.
Neural networks: Application to medical imaging
Clarke, Laurence P.
1994-01-01
The research mission is the development of computer assisted diagnostic (CAD) methods for improved diagnosis of medical images including digital x-ray sensors and tomographic imaging modalities. The CAD algorithms include advanced methods for adaptive nonlinear filters for image noise suppression, hybrid wavelet methods for feature segmentation and enhancement, and high convergence neural networks for feature detection and VLSI implementation of neural networks for real time analysis. Other missions include (1) implementation of CAD methods on hospital based picture archiving computer systems (PACS) and information networks for central and remote diagnosis and (2) collaboration with defense and medical industry, NASA, and federal laboratories in the area of dual use technology conversion from defense or aerospace to medicine.
NNSYSID - toolbox for system identification with neural networks
DEFF Research Database (Denmark)
Norgaard, M.; Ravn, Ole; Poulsen, Niels Kjølstad
2002-01-01
The NNSYSID toolset for System Identification has been developed as an add on to MATLAB(R). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains a number of nonlinear model structures based on neural networks, effective training algorithms...
NNSYSID - toolbox for system identification with neural networks
DEFF Research Database (Denmark)
Norgaard, M.; Ravn, Ole; Poulsen, Niels Kjølstad
2002-01-01
The NNSYSID toolset for System Identification has been developed as an add on to MATLAB(R). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains a number of nonlinear model structures based on neural networks, effective training algorithms...
Neural Network Communications Signal Processing
1994-08-01
Technical Information Report for the Neural Network Communications Signal Processing Program, CDRL A003, 31 March 1993. Software Development Plan for...track changing jamming conditions to provide the decoder with the best log- likelihood ratio metrics at a given time. As part of our development plan we...Artificial Neural Networks (ICANN-91) Volume 2, June 24-28, 1991, pp. 1677-1680. Kohonen, Teuvo, Raivio, Kimmo, Simula, Oli, Venta , 011i, Henriksson
What are artificial neural networks?
DEFF Research Database (Denmark)
Krogh, Anders
2008-01-01
Artificial neural networks have been applied to problems ranging from speech recognition to prediction of protein secondary structure, classification of cancers and gene prediction. How do they work and what might they be good for? Udgivelsesdato: 2008-Feb......Artificial neural networks have been applied to problems ranging from speech recognition to prediction of protein secondary structure, classification of cancers and gene prediction. How do they work and what might they be good for? Udgivelsesdato: 2008-Feb...
Institute of Scientific and Technical Information of China (English)
郭兰平; 俞建宁; 张建刚; 漆玉娟; 张旭东
2011-01-01
提出一种基于遗传算法和RBF神经网络相结合的时间序列预测模型,克服了单个神经网络在非线性时间序列预测中容易陷入局部极小值及网络训练速度缓慢的问题.以居民消费价格指数数据进行训练和测试,与传统的BP神经网络预测模型相比较,该模型的预测精度是令人满意的,数值模拟证明了该方法的有效性和可行性.%A time series forecasting model based on genetic algorithm and RBF neural network is proposed.The problem that single neural network in nonlinear time series forecasting easily gets into the local minimum and neural network has a very slow study rate is overcome. The model is then used to forecast the inhabitant consumer price index (CPI). Compared with the traditional BP neural network forecast model, this model forecast precision is satisfying. Numerical simulation illustrates the feasibility of the technique.
Optically excited synapse for neural networks.
Boyd, G D
1987-07-15
What can optics with its promise of parallelism do for neural networks which require matrix multipliers? An all optical approach requires optical logic devices which are still in their infancy. An alternative is to retain electronic logic while optically addressing the synapse matrix. This paper considers several versions of an optically addressed neural network compatible with VLSI that could be fabricated with the synapse connection unspecified. This optical matrix multiplier circuit is compared to an all electronic matrix multiplier. For the optical version a synapse consisting of back-to-back photodiodes is found to have a suitable i-v characteristic for optical matrix multiplication (a linear region) plus a clipping or nonlinear region as required for neural networks. Four photodiodes per synapse are required. The strength of the synapse connection is controlled by the optical power and is thus an adjustable parameter. The synapse network can be programmed in various ways such as a shadow mask of metal, imaged mask (static), or light valve or an acoustooptic scanned laser beam or array of beams (dynamic). A milliwatt from LEDs or lasers is adequate power. The neuron has a linear transfer function and is either a summing amplifier, in which case the synapse signal is current, or an integrator, in which case the synapse signal is charge, the choice of which depends on the programming mode. Optical addressing and settling times of microseconds are anticipated. Electronic neural networks using single-value resistor synapses or single-bit programmable synapses have been demonstrated in the high-gain region of discrete single-value feedback. As an alternative to these networks and the above proposed optical synapses, an electronic analog-voltage vector matrix multiplier is considered using MOSFETS as the variable conductance in CMOS VLSI. It is concluded that a shadow mask addressed (static) optical neural network is promising.
VLSI implementation of neural networks.
Wilamowski, B M; Binfet, J; Kaynak, M O
2000-06-01
Currently, fuzzy controllers are the most popular choice for hardware implementation of complex control surfaces because they are easy to design. Neural controllers are more complex and hard to train, but provide an outstanding control surface with much less error than that of a fuzzy controller. There are also some problems that have to be solved before the networks can be implemented on VLSI chips. First, an approximation function needs to be developed because CMOS neural networks have an activation function different than any function used in neural network software. Next, this function has to be used to train the network. Finally, the last problem for VLSI designers is the quantization effect caused by discrete values of the channel length (L) and width (W) of MOS transistor geometries. Two neural networks were designed in 1.5 microm technology. Using adequate approximation functions solved the problem of activation function. With this approach, trained networks were characterized by very small errors. Unfortunately, when the weights were quantized, errors were increased by an order of magnitude. However, even though the errors were enlarged, the results obtained from neural network hardware implementations were superior to the results obtained with fuzzy system approach.
Complex-Valued Neural Networks
Hirose, Akira
2012-01-01
This book is the second enlarged and revised edition of the first successful monograph on complex-valued neural networks (CVNNs) published in 2006, which lends itself to graduate and undergraduate courses in electrical engineering, informatics, control engineering, mechanics, robotics, bioengineering, and other relevant fields. In the second edition the recent trends in CVNNs research are included, resulting in e.g. almost a doubled number of references. The parametron invented in 1954 is also referred to with discussion on analogy and disparity. Also various additional arguments on the advantages of the complex-valued neural networks enhancing the difference to real-valued neural networks are given in various sections. The book is useful for those beginning their studies, for instance, in adaptive signal processing for highly functional sensing and imaging, control in unknown and changing environment, robotics inspired by human neural systems, and brain-like information processing, as well as interdisciplina...
Fractional Hopfield Neural Networks: Fractional Dynamic Associative Recurrent Neural Networks.
Pu, Yi-Fei; Yi, Zhang; Zhou, Ji-Liu
2016-07-14
This paper mainly discusses a novel conceptual framework: fractional Hopfield neural networks (FHNN). As is commonly known, fractional calculus has been incorporated into artificial neural networks, mainly because of its long-term memory and nonlocality. Some researchers have made interesting attempts at fractional neural networks and gained competitive advantages over integer-order neural networks. Therefore, it is naturally makes one ponder how to generalize the first-order Hopfield neural networks to the fractional-order ones, and how to implement FHNN by means of fractional calculus. We propose to introduce a novel mathematical method: fractional calculus to implement FHNN. First, we implement fractor in the form of an analog circuit. Second, we implement FHNN by utilizing fractor and the fractional steepest descent approach, construct its Lyapunov function, and further analyze its attractors. Third, we perform experiments to analyze the stability and convergence of FHNN, and further discuss its applications to the defense against chip cloning attacks for anticounterfeiting. The main contribution of our work is to propose FHNN in the form of an analog circuit by utilizing a fractor and the fractional steepest descent approach, construct its Lyapunov function, prove its Lyapunov stability, analyze its attractors, and apply FHNN to the defense against chip cloning attacks for anticounterfeiting. A significant advantage of FHNN is that its attractors essentially relate to the neuron's fractional order. FHNN possesses the fractional-order-stability and fractional-order-sensitivity characteristics.
Supervised Learning with Complex-valued Neural Networks
Suresh, Sundaram; Savitha, Ramasamy
2013-01-01
Recent advancements in the field of telecommunications, medical imaging and signal processing deal with signals that are inherently time varying, nonlinear and complex-valued. The time varying, nonlinear characteristics of these signals can be effectively analyzed using artificial neural networks. Furthermore, to efficiently preserve the physical characteristics of these complex-valued signals, it is important to develop complex-valued neural networks and derive their learning algorithms to represent these signals at every step of the learning process. This monograph comprises a collection of new supervised learning algorithms along with novel architectures for complex-valued neural networks. The concepts of meta-cognition equipped with a self-regulated learning have been known to be the best human learning strategy. In this monograph, the principles of meta-cognition have been introduced for complex-valued neural networks in both the batch and sequential learning modes. For applications where the computati...
Artificial neural networks: theoretical background and pharmaceutical applications: a review.
Wesolowski, Marek; Suchacz, Bogdan
2012-01-01
In recent times, there has been a growing interest in artificial neural networks, which are a rough simulation of the information processing ability of the human brain, as modern and vastly sophisticated computational techniques. This interest has also been reflected in the pharmaceutical sciences. This paper presents a review of articles on the subject of the application of neural networks as effective tools assisting the solution of various problems in science and the pharmaceutical industry, especially those characterized by multivariate and nonlinear dependencies. After a short description of theoretical background and practical basics concerning the computations performed by means of neural networks, the most important pharmaceutical applications of neural networks, with suitable references, are demonstrated. The huge role played by neural networks in pharmaceutical analysis, pharmaceutical technology, and searching for the relationships between the chemical structure and the properties of newly synthesized compounds as candidates for drugs is discussed.
Optimal Control Problem of Feeding Adaptations of Daphnia and Neural Network Simulation
Kmet', Tibor; Kmet'ov, Mria
2010-09-01
A neural network based optimal control synthesis is presented for solving optimal control problems with control and state constraints and open final time. The optimal control problem is transcribed into nonlinear programming problem, which is implemented with adaptive critic neural network [9] and recurrent neural network for solving nonlinear proprojection equations [10]. The proposed simulation methods is illustrated by the optimal control problem of feeding adaptation of filter feeders of Daphnia. Results show that adaptive critic based systematic approach and neural network solving of nonlinear equations hold promise for obtaining the optimal control with control and state constraints and open final time.
Application of Artificial Neural Network in Indicator Diagram
Institute of Scientific and Technical Information of China (English)
WuXiaodong; JiangHua; HanGuoqing
2004-01-01
Indicator diagram plays an important role in identifying the production state of oil wells. With an ability to reflect any non-linear mapping relationship, the artificial neural network (ANN) can be used in shape identification. This paper illuminates ANN realization in identifying fault kinds of indicator diagrams, including a back-propagation algorithm, characteristics of the indicator diagram and some examples. It is concluded that the buildup of a neural network and the abstract of indicator diagrams are important to successful application.
Neural network correction of astrometric chromaticity
Gai, M
2005-01-01
In this paper we deal with the problem of chromaticity, i.e. apparent position variation of stellar images with their spectral distribution, using neural networks to analyse and process astronomical images. The goal is to remove this relevant source of systematic error in the data reduction of high precision astrometric experiments, like Gaia. This task can be accomplished thanks to the capability of neural networks to solve a nonlinear approximation problem, i.e. to construct an hypersurface that approximates a given set of scattered data couples. Images are encoded associating each of them with conveniently chosen moments, evaluated along the y axis. The technique proposed, in the current framework, reduces the initial chromaticity of few milliarcseconds to values of few microarcseconds.
Optimization of recurrent neural networks for time series modeling
DEFF Research Database (Denmark)
Pedersen, Morten With
1997-01-01
The present thesis is about optimization of recurrent neural networks applied to time series modeling. In particular is considered fully recurrent networks working from only a single external input, one layer of nonlinear hidden units and a li near output unit applied to prediction of discrete time...
A neural network method to evaluate consolidation coefficient
Institute of Scientific and Technical Information of China (English)
无
2003-01-01
Many methods to calculate the consolidation coefficient of soil depend on judgment of testing curves of consolidation,and the calculation result is influenced by artificial factors. In this work, based on the main principle of back propagation neural network, a neural network model to determine the consolidation coefficient is established. The essence of the method is to simulate a serial of compression ratio and time factor curves because the neural network is able to process the nonlinear problems. It is demonstrated that this BP model has high precision and fast convergence. Such method avoids artificial influence factor successfully and is adapted to computer processing.
Neural Network Model for the Constitutive Relations of Soil
Institute of Scientific and Technical Information of China (English)
Zeng Jing; Wang Jing-tao
2003-01-01
The soil constitutive relation is one of the important issues in soil mechanics. It is very difficult to establish mathematical models because of the complexity of soil mechanical behavior. We propose a new method of neural network analysis for establishing soil constitutive models. Based on triaxial experiments of sand in the laboratory, the nonlinear constitutive models of sand expressed by the neural network were set up. In comparison with Duncan-Chang's model, the neural network method for sand modeling has been proved to be more convenient, accurate and it has a strong fault-tolerance function.
An information theoretic approach for combining neural network process models.
Sridhar, D V.; Bartlett, E B.; Seagrave, R C.
1999-07-01
Typically neural network modelers in chemical engineering focus on identifying and using a single, hopefully optimal, neural network model. Using a single optimal model implicitly assumes that one neural network model can extract all the information available in a given data set and that the other candidate models are redundant. In general, there is no assurance that any individual model has extracted all relevant information from the data set. Recently, Wolpert (Neural Networks, 5(2), 241 (1992)) proposed the idea of stacked generalization to combine multiple models. Sridhar, Seagrave and Barlett (AIChE J., 42, 2529 (1996)) implemented the stacked generalization for neural network models by integrating multiple neural networks into an architecture known as stacked neural networks (SNNs). SNNs consist of a combination of the candidate neural networks and were shown to provide improved modeling of chemical processes. However, in Sridhar's work SNNs were limited to using a linear combination of artificial neural networks. While a linear combination is simple and easy to use, it can utilize only those model outputs that have a high linear correlation to the output. Models that are useful in a nonlinear sense are wasted if a linear combination is used. In this work we propose an information theoretic stacking (ITS) algorithm for combining neural network models. The ITS algorithm identifies and combines useful models regardless of the nature of their relationship to the actual output. The power of the ITS algorithm is demonstrated through three examples including application to a dynamic process modeling problem. The results obtained demonstrate that the SNNs developed using the ITS algorithm can achieve highly improved performance as compared to selecting and using a single hopefully optimal network or using SNNs based on a linear combination of neural networks.
Multigradient for Neural Networks for Equalizers
Directory of Open Access Journals (Sweden)
Chulhee Lee
2003-06-01
Full Text Available Recently, a new training algorithm, multigradient, has been published for neural networks and it is reported that the multigradient outperforms the backpropagation when neural networks are used as a classifier. When neural networks are used as an equalizer in communications, they can be viewed as a classifier. In this paper, we apply the multigradient algorithm to train the neural networks that are used as equalizers. Experiments show that the neural networks trained using the multigradient noticeably outperforms the neural networks trained by the backpropagation.
System Identification, Prediction, Simulation and Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1997-01-01
The intention of this paper is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: 1) Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. 2) Amongst numerous training algorithms, only the Recursive Prediction Error Method using...... a Gauss-Newton search direction is applied. 3) Amongst numerous model types, often met in control applications, only the Non-linear ARMAX (NARMAX) model, representing input/output description, is examined. A simulated example confirms that a neural network has the potential to perform excellent System...
Institute of Scientific and Technical Information of China (English)
那靖; 任雪梅; 黄鸿
2008-01-01
A new adaptive time-delay positive feedback con-troller (ATPFC) is presented for a class of nonlinear time-delay systems. The proposed control scheme consists of a neural networks-based identification and a time-delay positive feedback controller. Two high-order neural networks (HONN) incorpo-rated with a special dynamic identification model are employed to identify the nonlinear system. Based on the identified model,local linearization compensation is used to deal with the un-known nonlinearity of the system. A time-delay-free inverse model of the linearized system and a desired reference model are utilized to constitute the feedback controller, which can lead the system output to track the trajectory of a reference model.Rigorous stability analysis for both the identification and the tracking error of the closcd-loop control system is provided by means of Lyapunov stability criterion. Simulation results are in-cluded to demonstrate the effectiveness of the proposed scheme.
Relations Between Wavelet Network and Feedforward Neural Network
Institute of Scientific and Technical Information of China (English)
刘志刚; 何正友; 钱清泉
2002-01-01
A comparison of construction forms and base functions is made between feedforward neural network and wavelet network. The relations between them are studied from the constructions of wavelet functions or dilation functions in wavelet network by different activation functions in feedforward neural network. It is concluded that some wavelet function is equal to the linear combination of several neurons in feedforward neural network.
Discussion of stability in a class of models on recurrent wavelet neural networks
Institute of Scientific and Technical Information of China (English)
DENG Ren; LI Zhu-xin; FAN You-hong
2007-01-01
Based on wavelet neural networks (WNNs) and recurrent neural networks (RNNs), a class of models on recurrent wavelet neural networks (RWNNs) is proposed.The new networks possess the advantages of WNNs and RNNs. In this paper, asymptotic stability of RWNNs is researched according to the Lyapunov theorem, and some theorems and formulae are given. The simulation results show the excellent performance of the networks in nonlinear dynamic system recognition.
Steam turbine stress control using NARX neural network
Dominiczak, Krzysztof; Rzadkowski, Romuald; Radulski, Wojciech
2015-11-01
Considered here is concept of steam turbine stress control, which is based on Nonlinear AutoRegressive neural networks with eXogenous inputs. Using NARX neural networks,whichwere trained based on experimentally validated FE model allows to control stresses in protected thickwalled steam turbine element with FE model quality. Additionally NARX neural network, which were trained base on FE model, includes: nonlinearity of steam expansion in turbine steam path during transients, nonlinearity of heat exchange inside the turbine during transients and nonlinearity of material properties during transients. In this article NARX neural networks stress controls is shown as an example of HP rotor of 18K390 turbine. HP part thermodynamic model as well as heat exchange model in vicinity of HP rotor,whichwere used in FE model of the HP rotor and the HP rotor FE model itself were validated based on experimental data for real turbine transient events. In such a way it is ensured that NARX neural network behave as real HP rotor during steam turbine transient events.
基于反馈神经网络的动态化工过程建模%Modeling Nonlinear Dynamic Chemical Process Base on Artificial Neural Networks
Institute of Scientific and Technical Information of China (English)
吴建锋; 何小荣; 等
2001-01-01
A new recurrent neural network, based on dynamic characteristics of chemical process, is put forward in this article. The structures of state feedback, time-delayed nodes and the integrated nodes are well combined in its structure so as to make the network memorize more past system states and keeping it from being too complex.The static BP algorithm is successfully used to train it. The new recurrent neural network is used to build models for a single-input-single-output (SISO) system and a multi-input-single-output (MISO) system and then the models are compared with other models based on BP neural networks.The comparison result shows multi-layer feed forward neural networks. The result shows that models based on the new recurrent neural networks are more reliable and have high capability of antijamming.%针对非线性动态化工过程建模存在的问题，提出了一种新的反馈神经网络结构，并将状态反馈、时间序列延迟以及集中节点的概念结合起来，用于提高反馈神经网络的性能，同时又使得网络结构不至于太复杂。在用此网络结构建模的时候，成功地将BP算法用于网络模型的训练。文中将这种反馈神经网络结构分别对一个单输入单输出(SISO)的非线性动态系统和一个多输入单输出(SIMO)的连续全混釜(CSTR)模型进行建模，并将所得模型与基于静态BP神经网络所得的模型在模型输出精度和抗干扰性等方面进行了比较，证明了该反馈神经网络在动态过程建模中能够比静态BP模型更好地反映出动态过程的输入输出关系，并具有一定的抗干扰能力。
Nonlinear Dynamic Modelling of Sensors Based on Recursive Neural Network%基于递归神经网络的传感器非线性动态建模
Institute of Scientific and Technical Information of China (English)
田社平; 丁国清; 颜德田; 石猛
2004-01-01
Nonlinear dynamic modelling of sensors is an important aspect in the field of instrument technique.The recursive neural network is proposed for nonlinear dynamic modelling of sensors,as its architecture is determined only by the number of nodes in the input,hidden and output layers.With the feedback behavior,the recursive neural network can catch up with the dynamic response of the system.The recursive neural network which involves dynamic elements and feedback connections has important capabilities that are not found in feedforward networks,such as the ability to store information for later use and higher predicting precision.A recursive prediction error algorithm which converges fast is applied to training the recursive neural network.Experimental results show that the performance of the recursive neural network model conforms to the sensor to be modeled,and the method is not only effective but of high precision.%根据动态校准实验结果建立传感器的动态数学模型, 以研究传感器的动态性能, 是动态测试的一个重要内容. 讨论了递归神经网络模型在传感器动态建模中的应用, 给出了递归神经网络模型的结构及相应的训练算法. 由于其反馈特征, 使得递归神经网络模型能获取系统的动态响应. 该方法特别适用于传感器非线性动态建模, 而且避免了传感器模型阶次的选择的困难. 试验结果表明, 应用递归神经网络对传感器进行动态建模是一种行之有效的方法.
Plant Growth Models Using Artificial Neural Networks
Bubenheim, David
1997-01-01
In this paper, we descrive our motivation and approach to devloping models and the neural network architecture. Initial use of the artificial neural network for modeling the single plant process of transpiration is presented.
Ocean wave forecasting using recurrent neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Prabaharan, N.
, merchant vessel routing, nearshore construction, etc. more efficiently and safely. This paper describes an artificial neural network, namely recurrent neural network with rprop update algorithm and is applied for wave forecasting. Measured ocean waves off...
Generalization performance of regularized neural network models
DEFF Research Database (Denmark)
Larsen, Jan; Hansen, Lars Kai
1994-01-01
Architecture optimization is a fundamental problem of neural network modeling. The optimal architecture is defined as the one which minimizes the generalization error. This paper addresses estimation of the generalization performance of regularized, complete neural network models. Regularization...
Improved transformer protection using probabilistic neural network ...
African Journals Online (AJOL)
user
This article presents a novel technique to distinguish between magnetizing inrush ... Protective relaying, Probabilistic neural network, Active power relays, Power ... Forward Neural Network (MFFNN) with back-propagation learning technique.
Behaviour in O of the Neural Networks Training Cost
DEFF Research Database (Denmark)
Goutte, Cyril
1998-01-01
We study the behaviour in zero of the derivatives of the cost function used when training non-linear neural networks. It is shown that a fair number offirst, second and higher order derivatives vanish in zero, validating the belief that 0 is a peculiar and potentially harmful location. These calc......We study the behaviour in zero of the derivatives of the cost function used when training non-linear neural networks. It is shown that a fair number offirst, second and higher order derivatives vanish in zero, validating the belief that 0 is a peculiar and potentially harmful location...
Neural Network for Sparse Reconstruction
Directory of Open Access Journals (Sweden)
Qingfa Li
2014-01-01
Full Text Available We construct a neural network based on smoothing approximation techniques and projected gradient method to solve a kind of sparse reconstruction problems. Neural network can be implemented by circuits and can be seen as an important method for solving optimization problems, especially large scale problems. Smoothing approximation is an efficient technique for solving nonsmooth optimization problems. We combine these two techniques to overcome the difficulties of the choices of the step size in discrete algorithms and the item in the set-valued map of differential inclusion. In theory, the proposed network can converge to the optimal solution set of the given problem. Furthermore, some numerical experiments show the effectiveness of the proposed network in this paper.
The Physics of Neural Networks
Gutfreund, Hanoch; Toulouse, Gerard
The following sections are included: * Introduction * Historical Perspective * Why Statistical Physics? * Purpose and Outline of the Paper * Basic Elements of Neural Network Models * The Biological Neuron * From the Biological to the Formal Neuron * The Formal Neuron * Network Architecture * Network Dynamics * Basic Functions of Neural Network Models * Associative Memory * Learning * Categorization * Generalization * Optimization * The Hopfield Model * Solution of the Model * The Merit of the Hopfield Model * Beyond the Standard Model * The Gardner Approach * A Microcanonical Formulation * The Case of Biased Patterns * A Canonical Formulation * Constraints on the Synaptic Weights * Learning with Errors * Learning with Noise * Hierarchically Correlated Data and Categorization * Hierarchical Data Structures * Storage of Hierarchical Data Structures * Categorization * Generalization * Learning a Classification Task * The Reference Perceptron Problem * The Contiguity Problem * Discussion - Issues of Relevance * The Notion of Attractors and Modes of Computation * The Nature of Attractors * Temporal versus Spatial Coding * Acknowledgements * References
Distributed Extreme Learning Machine for Nonlinear Learning over Network
Songyan Huang; Chunguang Li
2015-01-01
Distributed data collection and analysis over a network are ubiquitous, especially over a wireless sensor network (WSN). To our knowledge, the data model used in most of the distributed algorithms is linear. However, in real applications, the linearity of systems is not always guaranteed. In nonlinear cases, the single hidden layer feedforward neural network (SLFN) with radial basis function (RBF) hidden neurons has the ability to approximate any continuous functions and, thus, may be used as...
Linearizing the Characteristics of Gas Sensors using Neural Network
Directory of Open Access Journals (Sweden)
Gowri shankari B
2015-03-01
Full Text Available The paper describes implementing arbitrary connected neural network with more powerful network architecture to be embedded in inexpensive microcontroller. Our objective is to extend linear region of operation of nonlinear sensors. In order to implement more powerful neural network architectures on microcontrollers, the special Neuron by Neuron computing routine was developed in assembly language to allow fastest and shortest code. Embedded neural network requires hyperbolic tangent with great precision was used as a neuron activation function. Implementing neural network in microcontroller makes superior to other systems in faster response, smaller errors, and smoother surfaces. But its efficient implementation on microcontroller with simplified arithmetic was another challenge. This process was then demonstrated on gas sensor problem as they were mainly used accurately in measuring gas leakage in industry.
Meta-Learning Evolutionary Artificial Neural Networks
Abraham, Ajith
2004-01-01
In this paper, we present MLEANN (Meta-Learning Evolutionary Artificial Neural Network), an automatic computational framework for the adaptive optimization of artificial neural networks wherein the neural network architecture, activation function, connection weights; learning algorithm and its parameters are adapted according to the problem. We explored the performance of MLEANN and conventionally designed artificial neural networks for function approximation problems. To evaluate the compara...
Building a Chaotic Proved Neural Network
Bahi, Jacques M; Salomon, Michel
2011-01-01
Chaotic neural networks have received a great deal of attention these last years. In this paper we establish a precise correspondence between the so-called chaotic iterations and a particular class of artificial neural networks: global recurrent multi-layer perceptrons. We show formally that it is possible to make these iterations behave chaotically, as defined by Devaney, and thus we obtain the first neural networks proven chaotic. Several neural networks with different architectures are trained to exhibit a chaotical behavior.
Practical Application of Neural Networks in State Space Control
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon
In the present thesis we address some problems in discrete-time state space control of nonlinear dynamical systems and attempt to solve them using generic nonlinear models based on artificial neural networks. The main aim of the work is to examine how well such control algorithms perform when...... applied to a realistic process. The thesis therefore strives to provide a thorough treatment of two classes of neural network-based controllers, and to make a rigorous comparison between them and a classical linear controller. Thus, the thesis starts out with a short review of some relevant system...... theoretic notions followed by a detailed description of the topology, neuron functions and learning rules of the two types of neural networks treated in the thesis, the multilayer perceptron and the neurofuzzy networks. In both cases, a Least Squares second-order gradient method is used to train...
Move Ordering using Neural Networks
Kocsis, L.; Uiterwijk, J.; Van Den Herik, J.
2001-01-01
© Springer-Verlag Berlin Heidelberg 2001. The efficiency of alpha-beta search algorithms heavily depends on the order in which the moves are examined. This paper focuses on using neural networks to estimate the likelihood of a move being the best in a certain position. The moves considered more like
Neural Network based Consumption Forecasting
DEFF Research Database (Denmark)
Madsen, Per Printz
2016-01-01
This paper describe a Neural Network based method for consumption forecasting. This work has been financed by the The ENCOURAGE project. The aims of The ENCOURAGE project is to develop embedded intelligence and integration technologies that will directly optimize energy use in buildings and enable...
Spin glasses and neural networks
Energy Technology Data Exchange (ETDEWEB)
Parga, N. (Comision Nacional de Energia Atomica, San Carlos de Bariloche (Argentina). Centro Atomico Bariloche; Universidad Nacional de Cuyo, San Carlos de Bariloche (Argentina). Inst. Balseiro)
1989-07-01
The mean-field theory of spin glass models has been used as a prototype of systems with frustration and disorder. One of the most interesting related systems are models of associative memories. In these lectures we review the main concepts developed to solve the Sherrington-Kirkpatrick model and its application to neural networks. (orig.).
Artificial neural networks in medicine
Energy Technology Data Exchange (ETDEWEB)
Keller, P.E.
1994-07-01
This Technology Brief provides an overview of artificial neural networks (ANN). A definition and explanation of an ANN is given and situations in which an ANN is used are described. ANN applications to medicine specifically are then explored and the areas in which it is currently being used are discussed. Included are medical diagnostic aides, biochemical analysis, medical image analysis and drug development.
Competition Based Neural Networks for Assignment Problems
Institute of Scientific and Technical Information of China (English)
李涛; LuyuanFang
1991-01-01
Competition based neural networks have been used to solve the generalized assignment problem and the quadratic assignment problem.Both problems are very difficult and are ε approximation complete.The neural network approach has yielded highly competitive performance and good performance for the quadratic assignment problem.These neural networks are guaranteed to produce feasible solutions.
Analysis of neural networks through base functions
van der Zwaag, B.J.; Slump, Cornelis H.; Spaanenburg, L.
Problem statement. Despite their success-story, neural networks have one major disadvantage compared to other techniques: the inability to explain comprehensively how a trained neural network reaches its output; neural networks are not only (incorrectly) seen as a "magic tool" but possibly even more
Analysis of Neural Networks through Base Functions
Zwaag, van der B.J.; Slump, C.H.; Spaanenburg, L.
2002-01-01
Problem statement. Despite their success-story, neural networks have one major disadvantage compared to other techniques: the inability to explain comprehensively how a trained neural network reaches its output; neural networks are not only (incorrectly) seen as a "magic tool" but possibly even more
Niebur, Dagmar
1995-01-01
Electric power systems represent complex systems involving many electrical components whoseoperation has to be planned, analyzed, monitored and controlled. The time-scale of tasks in electricpower systems extends from long term planning years ahead to milliseconds in the area of control. The behavior of power systems is highly non-linear. Monitoring and control involves several hundred variables which are only partly available by measurements.
Niebur, Dagmar
1995-01-01
Electric power systems represent complex systems involving many electrical components whoseoperation has to be planned, analyzed, monitored and controlled. The time-scale of tasks in electricpower systems extends from long term planning years ahead to milliseconds in the area of control. The behavior of power systems is highly non-linear. Monitoring and control involves several hundred variables which are only partly available by measurements.
Nonlinear correction of PSD with genetic algorithm based on neural network%遗传算法和神经网络结合的PSD非线性校正
Institute of Scientific and Technical Information of China (English)
刘春; 马颖
2015-01-01
针对光电位置传感器（ PSD）检测系统在大坝变形观测中所呈现的非线性问题，建立改进的遗传算法和LM-BP神经网络结合的模型，对PSD的非线性进行补偿？该方法先用遗传算法对LM-BP网络的权阈值进行优化后再用LM-BP网络逼近任意非线性函数的特点对实际位置数据与理想值进行拟合后并进行测试，经过多次任意产生的种群优化后选择较为优秀个体作为神经网络的和阈值，并对任意位置进行校正，仿真结果表明，该方法克服了LM-BP网络对初始权阈值的依赖和泛化能力弱的特点，多次实验平均误差都小于1％，其泛化能力优于标准的遗传算法和神经网络结合的模型。%The position sensitive detector ( PSD) detection system in the observation of dam deformation can present nonlinear problem, so an improved genetic algorithm based on LM-BP neural network model is established to com-pensate the nonlinearity of PSD.Firstly, this method optimized the weight and threshold of LM-BP network by ge-netic algorithm, and let the actual position data fitted with the ideal value with the characteristics of LM-BP network to approximate any nonlinear function.The more excellent individual was chosen as the neural network weight value and threshold value after a population of optimizations repeatly and randomly.Finally, arbitrary position was correc-ted.The simulation results show that this method overcomes the dependent of LM-BP network on initial weight threshold and no-strongly generalization ability.The average error is less than 1% through several experiment ob-servations.Also, the generalization ability is better than the standard genetic algorithm based on neural network.
An Adaptive-PSO-Based Self-Organizing RBF Neural Network.
Han, Hong-Gui; Lu, Wei; Hou, Ying; Qiao, Jun-Fei
2016-10-24
In this paper, a self-organizing radial basis function (SORBF) neural network is designed to improve both accuracy and parsimony with the aid of adaptive particle swarm optimization (APSO). In the proposed APSO algorithm, to avoid being trapped into local optimal values, a nonlinear regressive function is developed to adjust the inertia weight. Furthermore, the APSO algorithm can optimize both the network size and the parameters of an RBF neural network simultaneously. As a result, the proposed APSO-SORBF neural network can effectively generate a network model with a compact structure and high accuracy. Moreover, the analysis of convergence is given to guarantee the successful application of the APSO-SORBF neural network. Finally, multiple numerical examples are presented to illustrate the effectiveness of the proposed APSO-SORBF neural network. The results demonstrate that the proposed method is more competitive in solving nonlinear problems than some other existing SORBF neural networks.
Institute of Scientific and Technical Information of China (English)
刘济; 高丽君
2014-01-01
It is significant to estimate the important process variables when process models are unknown. Therefore, the method of combining unscented Kalman filter(UKF) with neural network is used to solve the state estimation problems for a class of nonlinear systems whose models are unknown. The dynamic neural network is used to model for the nonlinear system, and the state and weights are updated at the same time by using UKF, which can achieve the purposes that the neural network approximate the real model, and the estimated values follow the real values. Two simulation examples are given to verify that the proposed approach gets good effects of estimation, and the greater the proportion of state in the output, the higher the estimation precision.%在模型未知的情况下，估计过程的重要变量尤为重要。鉴于此，采用不敏卡尔曼滤波(UKF)与神经网络相结合的方法，解决一类未知模型非线性系统的状态估计问题。采用动态神经网络对非线性系统进行建模，利用UKF对状态和权值进行同时更新，从而达到神经网络逼近真实模型，估计值跟随真实值的目的。通过两个仿真实例表明了所提出的方法具有良好的估计效果，并且状态在输出中的比重越大，其估计精度越高。
Fuzzy neural network image filter based on GA
Institute of Scientific and Technical Information of China (English)
刘涵; 刘丁; 李琦
2004-01-01
A new nonlinear image filter using fuzzy neural network based on genetic algorithm is proposed. The learning of network parameters is performed by genetic algorithm with the efficient binary encoding scheme. In the following,fuzzy reasoning embedded in the network aims at restoring noisy pixels without degrading the quality of fine details. It is shown by experiments that the filter is very effective in removing impulse noise and significantly outperforms conventional filters.
NNSYSID and NNCTRL Tools for system identification and control with neural networks
DEFF Research Database (Denmark)
Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad
2001-01-01
choose among several designs such as direct inverse control, internal model control, nonlinear feedforward, feedback linearisation, optimal control, gain scheduling based on instantaneous linearisation of neural network models and nonlinear model predictive control. This article gives an overview......Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...... a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can...
NNSYSID and NNCTRL Tools for system identification and control with neural networks
DEFF Research Database (Denmark)
Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad
2001-01-01
Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...... a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can...... choose among several designs such as direct inverse control, internal model control, nonlinear feedforward, feedback linearisation, optimal control, gain scheduling based on instantaneous linearisation of neural network models and nonlinear model predictive control. This article gives an overview...
National Research Council Canada - National Science Library
Belciug, Smaranda; Gorunescu, Florin
2014-01-01
.... Due to their adaptive learning and nonlinear mapping properties, the artificial neural networks are widely used to support the human decision capabilities, avoiding variability in practice and errors...
NNSYSID and NNCTRL Tools for system identification and control with neural networks
DEFF Research Database (Denmark)
Nørgaard, Magnus; Ravn, Ole; Poulsen, Niels Kjølstad
2001-01-01
Two toolsets for use with MATLAB have been developed: the neural network based system identification toolbox (NNSYSID) and the neural network based control system design toolkit (NNCTRL). The NNSYSID toolbox has been designed to assist identification of nonlinear dynamic systems. It contains...... a number of nonlinear model structures based on neural networks, effective training algorithms and tools for model validation and model structure selection. The NNCTRL toolkit is an add-on to NNSYSID and provides tools for design and simulation of control systems based on neural networks. The user can...
Quantum computing in neural networks
Gralewicz, P
2004-01-01
According to the statistical interpretation of quantum theory, quantum computers form a distinguished class of probabilistic machines (PMs) by encoding n qubits in 2n pbits. This raises the possibility of a large-scale quantum computing using PMs, especially with neural networks which have the innate capability for probabilistic information processing. Restricting ourselves to a particular model, we construct and numerically examine the performance of neural circuits implementing universal quantum gates. A discussion on the physiological plausibility of proposed coding scheme is also provided.
Temporal solar irradiance variability analysis using neural networks
Tebabal, Ambelu; Damtie, Baylie; Nigussie, Melessew
A feed-forward neural network which can account for nonlinear relationship was used to model total solar irradiance (TSI). A single layer feed-forward neural network with Levenberg-marquardt back-propagation algorithm have been implemented for modeling daily total solar irradiance from daily photometric sunspot index, and core-to-wing ratio of Mg II index data. In order to obtain the optimum neural network for TSI modeling, the root mean square error (RMSE) and mean absolute error (MAE) have been taken into account. The modeled and measured TSI have the correlation coefficient of about R=0.97. The neural networks (NNs) model output indicates that reconstructed TSI from solar proxies (photometric sunspot index and Mg II) can explain 94% of the variance of TSI. This modeled TSI using NNs further strengthens the view that surface magnetism indeed plays a dominant role in modulating solar irradiance.
Wind power prediction based on genetic neural network
Zhang, Suhan
2017-04-01
The scale of grid connected wind farms keeps increasing. To ensure the stability of power system operation, make a reasonable scheduling scheme and improve the competitiveness of wind farm in the electricity generation market, it's important to accurately forecast the short-term wind power. To reduce the influence of the nonlinear relationship between the disturbance factor and the wind power, the improved prediction model based on genetic algorithm and neural network method is established. To overcome the shortcomings of long training time of BP neural network and easy to fall into local minimum and improve the accuracy of the neural network, genetic algorithm is adopted to optimize the parameters and topology of neural network. The historical data is used as input to predict short-term wind power. The effectiveness and feasibility of the method is verified by the actual data of a certain wind farm as an example.
Robust adaptive neural network control with supervisory controller
Institute of Scientific and Technical Information of China (English)
张天平; 梅建东
2004-01-01
The problem of direct adaptive neural network control for a class of uncertain nonlinear systems with unknown constant control gain is studied in this paper. Based on the supervisory control strategy and the approximation capability of multilayer neural networks (MNNs), a novel design scheme of direct adaptive neural network controller is proposed.The adaptive law of the adjustable parameter vector and the matrix of weights in the neural networks and the gain of sliding mode control term to adaptively compensate for the residual and the approximation error of MNNs is determined by using a Lyapunov method. The approach does not require the optimal approximation error to be square-integrable or the supremum of the optimal approximation error to be known. By theoretical analysis, the closed-loop control system is proven to be globally stable in the sense that all signals involved are bounded, with tracking error converging to zero.Simulation results demonstrate the effectiveness of the approach.
Active Noise Feedback Control Using a Neural Network
Directory of Open Access Journals (Sweden)
Zhang Qizhi
2001-01-01
Full Text Available The active noise control (ANC is discussed. Many digital ANC systems often based on the filter-x algorithm for finite impulse response (FIR filter use adaptive filtering techniques. But if the primary noise path is nonlinear, the control system based on adaptive filter technology will be invalid. In this paper, an adaptive active nonlinear noise feedback control approach using a neural network is derived. The feedback control system drives a secondary signal to destructively interfere with the original noise to cut down the noise power. An on-line learning algorithm based on the error gradient descent method was proposed, and the local stability of closed loop system is proved using the discrete Lyapunov function. A nonlinear simulation example shows that the adaptive active noise feedback control method based on a neural network is very effective to the nonlinear noise control.
Nonlinear dynamics of direction-selective recurrent neural media.
Xie, Xiaohui; Giese, Martin A
2002-05-01
The direction selectivity of cortical neurons can be accounted for by asymmetric lateral connections. Such lateral connectivity leads to a network dynamics with characteristic properties that can be exploited for distinguishing in neurophysiological experiments this mechanism for direction selectivity from other possible mechanisms. We present a mathematical analysis for a class of direction-selective neural models with asymmetric lateral connections. Contrasting with earlier theoretical studies that have analyzed approximations of the network dynamics by neglecting nonlinearities using methods from linear systems theory, we study the network dynamics with nonlinearity taken into consideration. We show that asymmetrically coupled networks can stabilize stimulus-locked traveling pulse solutions that are appropriate for the modeling of the responses of direction-selective neurons. In addition, our analysis shows that outside a certain regime of stimulus speeds the stability of these solutions breaks down, giving rise to lurching activity waves with specific spatiotemporal periodicity. These solutions, and the bifurcation by which they arise, cannot be easily accounted for by classical models for direction selectivity.
Discontinuities in recurrent neural networks.
Gavaldá, R; Siegelmann, H T
1999-04-01
This article studies the computational power of various discontinuous real computational models that are based on the classical analog recurrent neural network (ARNN). This ARNN consists of finite number of neurons; each neuron computes a polynomial net function and a sigmoid-like continuous activation function. We introduce arithmetic networks as ARNN augmented with a few simple discontinuous (e.g., threshold or zero test) neurons. We argue that even with weights restricted to polynomial time computable reals, arithmetic networks are able to compute arbitrarily complex recursive functions. We identify many types of neural networks that are at least as powerful as arithmetic nets, some of which are not in fact discontinuous, but they boost other arithmetic operations in the net function (e.g., neurons that can use divisions and polynomial net functions inside sigmoid-like continuous activation functions). These arithmetic networks are equivalent to the Blum-Shub-Smale model, when the latter is restricted to a bounded number of registers. With respect to implementation on digital computers, we show that arithmetic networks with rational weights can be simulated with exponential precision, but even with polynomial-time computable real weights, arithmetic networks are not subject to any fixed precision bounds. This is in contrast with the ARNN that are known to demand precision that is linear in the computation time. When nontrivial periodic functions (e.g., fractional part, sine, tangent) are added to arithmetic networks, the resulting networks are computationally equivalent to a massively parallel machine. Thus, these highly discontinuous networks can solve the presumably intractable class of PSPACE-complete problems in polynomial time.
Recurrent neural network for vehicle dead-reckoning
Institute of Scientific and Technical Information of China (English)
Ma Haibo; Zhang Liguo; Chen Yangzhou
2008-01-01
For vehicle integrated navigation systems, real-time estimating states of the dead reckoning (DR) unit is much more difficult than that of the other measuring sensors under indefinite noises and nonlinear characteristics.Compared with the well known, extended Kalman filter (EKF), a recurrent neural network is proposed for the solution, which not only improves the location precision and the adaptive ability of resisting disturbances, but also avoids calculating the analytic derivation and Jacobiaa matrices of the nonlinear system model. To test the performances of the recurrent neural network, these two methods are used to estimate the state of the vehicle's DR navigation system. Simulation results show that the recurrent neural network is superior to the EKF and is a more ideal filtering method for vehicle DR navigation.
Active Noise Feedback Control Using a Neural Network
Zhang Qizhi; Jia Yongle
2001-01-01
The active noise control (ANC) is discussed. Many digital ANC systems often based on the filter-x algorithm for finite impulse response (FIR) filter use adaptive filtering techniques. But if the primary noise path is nonlinear, the control system based on adaptive filter technology will be invalid. In this paper, an adaptive active nonlinear noise feedback control approach using a neural network is derived. The feedback control system drives a secondary signal to destructively interfere with ...
Adaptive control of system with hysteresis using neural networks
Institute of Scientific and Technical Information of China (English)
Li Chuntao; Tan Yonghong
2006-01-01
An adaptive control scheme is developed for a class of single-input nonlinear systems preceded by unknown hysteresis, which is a non-differentiable and multi-value mapping nonlinearity. The controller based on the three-layer neural network (NN), whose weights are derived from Lyapunov stability analysis, guarantees closed-loop semiglobal stability and convergence of the tracking errors to a small residual set. An example is used to confirm the effectiveness of the proposed control scheme.
Improved Local Weather Forecasts Using Artificial Neural Networks
DEFF Research Database (Denmark)
Wollsen, Morten Gill; Jørgensen, Bo Nørregaard
2015-01-01
Solar irradiance and temperature forecasts are used in many different control systems. Such as intelligent climate control systems in commercial greenhouses, where the solar irradiance affects the use of supplemental lighting. This paper proposes a novel method to predict the forthcoming weather...... using an artificial neural network. The neural network used is a NARX network, which is known to model non-linear systems well. The predictions are compared to both a design reference year as well as commercial weather forecasts based upon numerical modelling. The results presented in this paper show...
Comparison of Gompertz and neural network models of broiler growth.
Roush, W B; Dozier, W A; Branton, S L
2006-04-01
Neural networks offer an alternative to regression analysis for biological growth modeling. Very little research has been conducted to model animal growth using artificial neural networks. Twenty-five male chicks (Ross x Ross 308) were raised in an environmental chamber. Body weights were determined daily and feed and water were provided ad libitum. The birds were fed a starter diet (23% CP and 3,200 kcal of ME/kg) from 0 to 21 d, and a grower diet (20% CP and 3,200 kcal of ME/ kg) from 22 to 70 d. Dead and female birds were not included in the study. Average BW of 18 birds were used as the data points for the growth curve to be modeled. Training data consisted of alternate-day weights starting with the first day. Validation data consisted of BW at all other age periods. Comparison was made between the modeling by the Gompertz nonlinear regression equation and neural network modeling. Neural network models were developed with the Neuroshell Predictor. Accuracy of the models was determined by mean square error (MSE), mean absolute deviation (MAD), mean absolute percentage error (MAPE), and bias. The Gompertz equation was fit for the data. Forecasting error measurements were based on the difference between the model and the observed values. For the training data, the lowest MSE, MAD, MAPE, and bias were noted for the neural-developed neural network. For the validation data, the lowest MSE and MAD were noted with the genetic algorithm-developed neural network. Lowest bias was for the neural-developed network. As measured by bias, the Gompertz equation underestimated the values whereas the neural- and genetic-developed neural networks produced little or no overestimation of the observed BW responses. Past studies have attempted to interpret the biological significance of the estimates of the parameters of an equation. However, it may be more practical to ignore the relevance of parameter estimates and focus on the ability to predict responses.
Fiber optic Adaline neural networks
Ghosh, Anjan K.; Trepka, Jim; Paparao, Palacharla
1993-02-01
Optoelectronic realization of adaptive filters and equalizers using fiber optic tapped delay lines and spatial light modulators has been discussed recently. We describe the design of a single layer fiber optic Adaline neural network which can be used as a bit pattern classifier. In our realization we employ as few electronic devices as possible and use optical computation to utilize the advantages of optics in processing speed, parallelism, and interconnection. The new optical neural network described in this paper is designed for optical processing of guided lightwave signals, not electronic signals. We analyzed the convergence or learning characteristics of the optically implemented Adaline in the presence of errors in the hardware, and we studied methods for improving the convergence rate of the Adaline.
Neural Networks Methodology and Applications
Dreyfus, Gérard
2005-01-01
Neural networks represent a powerful data processing technique that has reached maturity and broad application. When clearly understood and appropriately used, they are a mandatory component in the toolbox of any engineer who wants make the best use of the available data, in order to build models, make predictions, mine data, recognize shapes or signals, etc. Ranging from theoretical foundations to real-life applications, this book is intended to provide engineers and researchers with clear methodologies for taking advantage of neural networks in industrial, financial or banking applications, many instances of which are presented in the book. For the benefit of readers wishing to gain deeper knowledge of the topics, the book features appendices that provide theoretical details for greater insight, and algorithmic details for efficient programming and implementation. The chapters have been written by experts ands seemlessly edited to present a coherent and comprehensive, yet not redundant, practically-oriented...
Detecting danger labels with RAM-based neural networks
DEFF Research Database (Denmark)
Jørgensen, T.M.; Christensen, S.S.; Andersen, A.W.
1996-01-01
An image processing system for the automatic location of danger labels on the back of containers is presented. The system uses RAM-based neural networks to locate and classify labels after a pre-processing step involving specially designed non-linear edge filters and RGB-to-HSV conversion. Results...
Artificial Neural Network Based State Estimators Integrated into Kalmtool
DEFF Research Database (Denmark)
Bayramoglu, Enis; Ravn, Ole; Poulsen, Niels Kjølstad
2012-01-01
In this paper we present a toolbox enabling easy evaluation and comparison of dierent ltering algorithms. The toolbox is called Kalmtool and is a set of MATLAB tools for state estimation of nonlinear systems. The toolbox now contains functions for Articial Neural Network Based State Estimation...
Neural network-based control using Lyapunov functions
Luxemburg, Leon A.
1993-01-01
We have successfully demonstrated how the problem of stabilization of plants can be reduced to a problem of approximation of functions. Neural networks have been shown to have approximating and interpolating properties. This approach is good for linear and nonlinear plants. Software has been generated to demonstrate this approach.
Neural Networks for Speech Application.
1987-11-01
operation and neurocrience theories of how neurons process information in the brain. design. Early studies by McCulloch and Pitts dunng the forties led to...developed the commercially available Mark III and Mark IV neurocom- established by McCulloch and Pits. puters that model neural networks and run...ORGANIZERS Infonuiaonienes (1986) FOR Lashley, K. Brain Mehaius and Cblali (129)SPEECHOTECH McCullch. W and Pitts . W, ’A Logical Calculusof the
Analog electronic neural network circuits
Energy Technology Data Exchange (ETDEWEB)
Graf, H.P.; Jackel, L.D. (AT and T Bell Labs., Holmdel, NJ (USA))
1989-07-01
The large interconnectivity and moderate precision required in neural network models present new opportunities for analog computing. This paper discusses analog circuits for a variety of problems such as pattern matching, optimization, and learning. Most of the circuits build so far are relatively small, exploratory designs. The most mature circuits are those for template matching. Chips performing this function are now being applied to pattern recognition problems.
Institute of Scientific and Technical Information of China (English)
王东; 徐超; 万强
2015-01-01
Modeling of mechanic joint is a challenge for the complex multi - scale,multi - physics and nonlinear physics behaviors on the interface,introducing additional flexibility and damping to the overall structural dynamics. The Iwan model is applied to model and simulate the joint beam system. The nonlin-earity characteristics are extracted by EMD method and applied to train the backpropagation neural net-works. Then,the nonlinear mechanic model is identified by the experimental nonlinearity of jointed beam,which is applied to simulate the joint interface invested by the result of experiment. The results show that:based on the BP neural networks,the nonlinear characteristics can be applied to establish the nonlinear mechanic model of joint interface and the simulation and experimental results have a good coher-ence.%连接界面上存在的多尺度、多物理场和非线性的物理机理是引起结构能量耗散和刚度非线性的主要原因。采用 Iwan 模型模拟连接结构进行连接梁的动力学仿真，利用 EMD（Empirical Mode Decomposition，EMD）提取时域信号的非线性特征训练 BP 神经网络，再设计连接梁实验辨识连接界面的非线性力学模型参数，将辨识建立模型运用在连接结构中进行数值仿真并与实验结果对比。结果表明：利用 EMD 非线性特征进行 BP 神经网络训练能够建立有效的连接界面非线性力学模型，仿真结果与实验结果具有较好的一致性。
Institute of Scientific and Technical Information of China (English)
张国平; 王正欧; 袁国林
2001-01-01
混沌神经网络具有全局搜索能力，但其运用至今主要局限于组合优化．通过对普通Hopfield优化网络引入混沌噪声退火过程，提出了一种用于约束非线性全局优化的混沌退火神经网络，它易于实现，原理简明，应用广泛．对很复杂的测试函数的数字试验表明，该模型能够高效、可靠地搜索到全局最优，其性能超过遗传算法GAMAS．%Chaotic neural networks have global searching ability.But their applications are generally confined to combinatorial optimization to date.By introducing chaotic noise annealing process into conventional Hopfield network,this paper proposes a new chaotic annealing neural network (CANN) for global optimization of continuous constrained non-linear programming.It is easy to implement,conceptually simple,and generally applicable.Numerical experiments on severe test functions manifest that CANN is efficient and reliable to search for global optimum and outperforms the existing genetic algorithm GAMAS for the same purpose.
The LILARTI neural network system
Energy Technology Data Exchange (ETDEWEB)
Allen, J.D. Jr.; Schell, F.M.; Dodd, C.V.
1992-10-01
The material of this Technical Memorandum is intended to provide the reader with conceptual and technical background information on the LILARTI neural network system of detail sufficient to confer an understanding of the LILARTI method as it is presently allied and to facilitate application of the method to problems beyond the scope of this document. Of particular importance in this regard are the descriptive sections and the Appendices which include operating instructions, partial listings of program output and data files, and network construction information.
Process Neural Networks Theory and Applications
He, Xingui
2010-01-01
"Process Neural Networks - Theory and Applications" proposes the concept and model of a process neural network for the first time, showing how it expands the mapping relationship between the input and output of traditional neural networks, and enhancing the expression capability for practical problems, with broad applicability to solving problems relating to process in practice. Some theoretical problems such as continuity, functional approximation capability, and computing capability, are strictly proved. The application methods, network construction principles, and optimization alg
A New Modeling Method Based on Genetic Neural Network for Numeral Eddy Current Sensor
Institute of Scientific and Technical Information of China (English)
Along Yu; Zheng Li
2006-01-01
In this paper, we present a method used to the numeral eddy current sensor modeling based on genetic neural network to settle its nonlinear problem. The principle and algorithms of genetic neural network are introduced. In this method,the nonlinear model parameters of the numeral eddy current sensor are optimized by genetic neural network (GNN) according to measurement data. So the method remains both the global searching ability of genetic algorithm and the good local searching ability of neural network. The nonlinear model has the advantages of strong robustness, on-line scaling and high precision. The maximum nonlinearity error can be reduced to 0.037% using GNN. However, the maximum nonlinearity error is 0.075% using least square method (LMS).
Generalized Projective Synchronization between Two Different Neural Networks with Mixed Time Delays
Directory of Open Access Journals (Sweden)
Xuefei Wu
2012-01-01
Full Text Available The generalized projective synchronization (GPS between two different neural networks with nonlinear coupling and mixed time delays is considered. Several kinds of nonlinear feedback controllers are designed to achieve GPS between two different such neural networks. Some results for GPS of these neural networks are proved theoretically by using the Lyapunov stability theory and the LaSalle invariance principle. Moreover, by comparison, we determine an optimal nonlinear controller from several ones and provide an adaptive update law for it. Computer simulations are provided to show the effectiveness and feasibility of the proposed methods.
Gain Scheduling Control of Nonlinear Systems Based on Neural State Space Models
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon; Stoustrup, Jakob
2003-01-01
This paper presents a novel method for gain scheduling control of nonlinear systems based on extraction of local linear state space models from neural networks with direct application to robust control. A neural state space model of the system is first trained based on in- and output training...... samples from the system, after which linearized state space models are extracted from the neural network in a number of operating points according to a simple and computationally cheap scheme. Robust observer-based controllers can then be designed in each of these operating points,and gain scheduling...
Novel quantum inspired binary neural network algorithm
Indian Academy of Sciences (India)
OM PRAKASH PATEL; ARUNA TIWARI
2016-11-01
In this paper, a quantum based binary neural network algorithm is proposed, named as novel quantum binary neural network algorithm (NQ-BNN). It forms a neural network structure by deciding weights and separability parameter in quantum based manner. Quantum computing concept represents solution probabilistically and gives large search space to find optimal value of required parameters using Gaussian random number generator. The neural network structure forms constructively having three number of layers input layer: hidden layer and output layer. A constructive way of deciding the network eliminates the unnecessary training of neural network. A new parameter that is a quantum separability parameter (QSP) is introduced here, which finds an optimal separability plane to classify input samples. During learning, it searches for an optimal separability plane. This parameter is taken as the threshold of neuron for learning of neural network. This algorithm is tested with three benchmark datasets and produces improved results than existing quantum inspired and other classification approaches.
Institute of Scientific and Technical Information of China (English)
戚海永
2013-01-01
利用正交试验法对输送带速度、喷气压力和分选次数等因素对煤矸分选效果进行了试验研究,并利用非线性PSO-BP神经网络对分选效果进行了预测.试验结果表明,分矸率与混矸率呈现相反的趋势,第3组试验,即带速为0.11 m/s,喷气压力为0.7 MPa,分选次数为3的时候,分选效果最好,混矸率最低；非线性PSO-BP神经网络预测效果与传统PSO-BP神经网络相比,具有更高的准确性,与试验值更加吻合,对煤矸分选预测具有更高的参考价值.%The influences of velocity of conveyance belt,air jet pressure and separation number on coal and gangue separation effects were studied by orthogonal experiments,and nonlinear PSO-BP neutral network was applied to predict the separation effects.The experimental result show:the gangue separation ratio and the gangue mixture ratio had the opposite variation trend; in the third group of experiment,while the belt velocity being 0.11 m/s,air jet pressure being 0.7 MPa and separation number being three,the gangue separation effects were the best and the gangue mixture ratio was the lowest; contrasted with traditional PSO-BP neural network,the nonlinear PSO-BP neural network had higher prediction accuracy that was much closer to the experimental value,which offered references for prediction of coal and gangue separation effects.
Practical neural network recipies in C++
Masters
2014-01-01
This text serves as a cookbook for neural network solutions to practical problems using C++. It will enable those with moderate programming experience to select a neural network model appropriate to solving a particular problem, and to produce a working program implementing that network. The book provides guidance along the entire problem-solving path, including designing the training set, preprocessing variables, training and validating the network, and evaluating its performance. Though the book is not intended as a general course in neural networks, no background in neural works is assum
Three-dimensional thinning by neural networks
Shen, Jun; Shen, Wei
1995-10-01
3D thinning is widely used in 3D object representation in computer vision and in trajectory planning in robotics to find the topological structure of the free space. In the present paper, we propose a 3D image thinning method by neural networks. Each voxel in the 3D image corresponds to a set of neurons, called 3D Thinron, in the network. Taking the 3D Thinron as the elementary unit, the global structure of the network is a 3D array in which each Thinron is connected with the 26 neighbors in the neighborhood 3 X 3 X 3. As to the Thinron itself, the set of neurons are organized in multiple layers. In the first layer, we have neurons for boundary analysis, connectivity analysis and connectivity verification, taking as input the voxels in the 3 X 3 X 3 neighborhood and the intermediate outputs of neighboring Thinrons. In the second layer, we have the neurons for synthetical analysis to give the intermediate output of Thinron. In the third layer, we have the decision neurons whose state determines the final output. All neurons in the Thinron are the adaline neurons of Widrow, except the connectivity analysis and verification neurons which are nonlinear neurons. With the 3D Thinron neural network, the state transition of the network will take place automatically, and the network converges to the final steady state, which gives the result medial surface of 3D objects, preserving the connectivity in the initial image. The method presented is simulated and tested for 3D images, experimental results are reported.
Understanding Neural Networks for Machine Learning using Microsoft Neural Network Algorithm
National Research Council Canada - National Science Library
Nagesh Ramprasad
2016-01-01
.... In this research, focus is on the Microsoft Neural System Algorithm. The Microsoft Neural System Algorithm is a simple implementation of the adaptable and popular neural networks that are used in the machine learning...
Neural network modeling of emotion
Levine, Daniel S.
2007-03-01
This article reviews the history and development of computational neural network modeling of cognitive and behavioral processes that involve emotion. The exposition starts with models of classical conditioning dating from the early 1970s. Then it proceeds toward models of interactions between emotion and attention. Then models of emotional influences on decision making are reviewed, including some speculative (not and not yet simulated) models of the evolution of decision rules. Through the late 1980s, the neural networks developed to model emotional processes were mainly embodiments of significant functional principles motivated by psychological data. In the last two decades, network models of these processes have become much more detailed in their incorporation of known physiological properties of specific brain regions, while preserving many of the psychological principles from the earlier models. Most network models of emotional processes so far have dealt with positive and negative emotion in general, rather than specific emotions such as fear, joy, sadness, and anger. But a later section of this article reviews a few models relevant to specific emotions: one family of models of auditory fear conditioning in rats, and one model of induced pleasure enhancing creativity in humans. Then models of emotional disorders are reviewed. The article concludes with philosophical statements about the essential contributions of emotion to intelligent behavior and the importance of quantitative theories and models to the interdisciplinary enterprise of understanding the interactions of emotion, cognition, and behavior.
Wavelet Neural Networks for Adaptive Equalization by Using the Orthogonal Least Square Algorithm
Institute of Scientific and Technical Information of China (English)
JIANG Minghu(江铭虎); DENG Beixing(邓北星); Georges Gielen
2004-01-01
Equalizers are widely used in digital communication systems for corrupted or time varying channels. To overcome performance decline for noisy and nonlinear channels, many kinds of neural network models have been used in nonlinear equalization. In this paper, we propose a new nonlinear channel equalization, which is structured by wavelet neural networks. The orthogonal least square algorithm is applied to update the weighting matrix of wavelet networks to form a more compact wavelet basis unit, thus obtaining good equalization performance. The experimental results show that performance of the proposed equalizer based on wavelet networks can significantly improve the neural modeling accuracy and outperform conventional neural network equalization in signal to noise ratio and channel non-linearity.
MEMBRAIN NEURAL NETWORK FOR VISUAL PATTERN RECOGNITION
Directory of Open Access Journals (Sweden)
Artur Popko
2013-06-01
Full Text Available Recognition of visual patterns is one of significant applications of Artificial Neural Networks, which partially emulate human thinking in the domain of artificial intelligence. In the paper, a simplified neural approach to recognition of visual patterns is portrayed and discussed. This paper is dedicated for investigators in visual patterns recognition, Artificial Neural Networking and related disciplines. The document describes also MemBrain application environment as a powerful and easy to use neural networks’ editor and simulator supporting ANN.
Energy Technology Data Exchange (ETDEWEB)
Mjalli, F.S.; Al-Asheh, S. [Chemical Engineering Department, Qatar University, Doha (Qatar)
2005-10-01
In this work advanced nonlinear neural networks based control system design algorithms are adopted to control a mechanistic model for an ethanol fermentation process. The process model equations for such systems are highly nonlinear. A neural network strategy has been implemented in this work for capturing the dynamics of the mechanistic model for the fermentation process. The neural network achieved has been validated against the mechanistic model. Two neural network based nonlinear control strategies have also been adopted using the model identified. The performance of the feedback linearization technique was compared to neural network model predictive control in terms of stability and set point tracking capabilities. Under servo conditions, the feedback linearization algorithm gave comparable tracking and stability. The feedback linearization controller achieved the control target faster than the model predictive one but with vigorous and sudden controller moves. (Abstract Copyright [2005], Wiley Periodicals, Inc.)
Artificial neural networks modeling gene-environment interaction
Directory of Open Access Journals (Sweden)
Günther Frauke
2012-05-01
Full Text Available Abstract Background Gene-environment interactions play an important role in the etiological pathway of complex diseases. An appropriate statistical method for handling a wide variety of complex situations involving interactions between variables is still lacking, especially when continuous variables are involved. The aim of this paper is to explore the ability of neural networks to model different structures of gene-environment interactions. A simulation study is set up to compare neural networks with standard logistic regression models. Eight different structures of gene-environment interactions are investigated. These structures are characterized by penetrance functions that are based on sigmoid functions or on combinations of linear and non-linear effects of a continuous environmental factor and a genetic factor with main effect or with a masking effect only. Results In our simulation study, neural networks are more successful in modeling gene-environment interactions than logistic regression models. This outperfomance is especially pronounced when modeling sigmoid penetrance functions, when distinguishing between linear and nonlinear components, and when modeling masking effects of the genetic factor. Conclusion Our study shows that neural networks are a promising approach for analyzing gene-environment interactions. Especially, if no prior knowledge of the correct nature of the relationship between co-variables and response variable is present, neural networks provide a valuable alternative to regression methods that are limited to the analysis of linearly separable data.
Salience-Affected Neural Networks
Remmelzwaal, Leendert A; Ellis, George F R
2010-01-01
We present a simple neural network model which combines a locally-connected feedforward structure, as is traditionally used to model inter-neuron connectivity, with a layer of undifferentiated connections which model the diffuse projections from the human limbic system to the cortex. This new layer makes it possible to model global effects such as salience, at the same time as the local network processes task-specific or local information. This simple combination network displays interactions between salience and regular processing which correspond to known effects in the developing brain, such as enhanced learning as a result of heightened affect. The cortex biases neuronal responses to affect both learning and memory, through the use of diffuse projections from the limbic system to the cortex. Standard ANNs do not model this non-local flow of information represented by the ascending systems, which are a significant feature of the structure of the brain, and although they do allow associational learning with...
Training Input-Output Recurrent Neural Networks through Spectral Methods
Sedghi, Hanie; Anandkumar, Anima
2016-01-01
We consider the problem of training input-output recurrent neural networks (RNN) for sequence labeling tasks. We propose a novel spectral approach for learning the network parameters. It is based on decomposition of the cross-moment tensor between the output and a non-linear transformation of the input, based on score functions. We guarantee consistent learning with polynomial sample and computational complexity under transparent conditions such as non-degeneracy of model parameters, polynomi...
Dynamic Analysis of Structures Using Neural Networks
Directory of Open Access Journals (Sweden)
N. Ahmadi
2008-01-01
Full Text Available In the recent years, neural networks are considered as the best candidate for fast approximation with arbitrary accuracy in the time consuming problems. Dynamic analysis of structures against earthquake has the time consuming process. We employed two kinds of neural networks: Generalized Regression neural network (GR and Back-Propagation Wavenet neural network (BPW, for approximating of dynamic time history response of frame structures. GR is a traditional radial basis function neural network while BPW categorized as a wavelet neural network. In BPW, sigmoid activation functions of hidden layer neurons are substituted with wavelets and weights training are achieved using Scaled Conjugate Gradient (SCG algorithm. Comparison the results of BPW with those of GR in the dynamic analysis of eight story steel frame indicates that accuracy of the properly trained BPW was better than that of GR and therefore, BPW can be efficiently used for approximate dynamic analysis of structures.
Speech transmission index from running speech: A neural network approach
Li, F. F.; Cox, T. J.
2003-04-01
Speech transmission index (STI) is an important objective parameter concerning speech intelligibility for sound transmission channels. It is normally measured with specific test signals to ensure high accuracy and good repeatability. Measurement with running speech was previously proposed, but accuracy is compromised and hence applications limited. A new approach that uses artificial neural networks to accurately extract the STI from received running speech is developed in this paper. Neural networks are trained on a large set of transmitted speech examples with prior knowledge of the transmission channels' STIs. The networks perform complicated nonlinear function mappings and spectral feature memorization to enable accurate objective parameter extraction from transmitted speech. Validations via simulations demonstrate the feasibility of this new method on a one-net-one-speech extract basis. In this case, accuracy is comparable with normal measurement methods. This provides an alternative to standard measurement techniques, and it is intended that the neural network method can facilitate occupied room acoustic measurements.
Fast Algorithms for Convolutional Neural Networks
Lavin, Andrew; Gray, Scott
2015-01-01
Deep convolutional neural networks take GPU days of compute time to train on large data sets. Pedestrian detection for self driving cars requires very low latency. Image recognition for mobile phones is constrained by limited processing resources. The success of convolutional neural networks in these situations is limited by how fast we can compute them. Conventional FFT based convolution is fast for large filters, but state of the art convolutional neural networks use small, 3x3 filters. We ...
Modelling Microwave Devices Using Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Andrius Katkevičius
2012-04-01
Full Text Available Artificial neural networks (ANN have recently gained attention as fast and flexible equipment for modelling and designing microwave devices. The paper reviews the opportunities to use them for undertaking the tasks on the analysis and synthesis. The article focuses on what tasks might be solved using neural networks, what challenges might rise when using artificial neural networks for carrying out tasks on microwave devices and discusses problem-solving techniques for microwave devices with intermittent characteristics.Article in Lithuanian
Rule Extraction using Artificial Neural Networks
2010-01-01
Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions are not as interpretable as those of decision trees. In many applications, it is desirable to extract knowledge from trained neural networks so that the users can...
Forecasting Exchange Rate Using Neural Networks
Raksaseree, Sukhita
2009-01-01
The artificial neural network models become increasingly popular among researchers and investors since many studies have shown that it has superior performance over the traditional statistical model. This paper aims to investigate the neural network performance in forecasting foreign exchange rates based on backpropagation algorithm. The forecast of Thai Baht against seven currencies are conducted to observe the performance of the neural network models using the performance criteria for both ...
Semantic Interpretation of An Artificial Neural Network
1995-12-01
ARTIFICIAL NEURAL NETWORK .7,’ THESIS Stanley Dale Kinderknecht Captain, USAF 770 DEAT7ET77,’H IR O C 7... ARTIFICIAL NEURAL NETWORK THESIS Stanley Dale Kinderknecht Captain, USAF AFIT/GCS/ENG/95D-07 Approved for public release; distribution unlimited The views...Government. AFIT/GCS/ENG/95D-07 SEMANTIC INTERPRETATION OF AN ARTIFICIAL NEURAL NETWORK THESIS Presented to the Faculty of the School of Engineering of
Feature Weight Tuning for Recursive Neural Networks
2014-01-01
This paper addresses how a recursive neural network model can automatically leave out useless information and emphasize important evidence, in other words, to perform "weight tuning" for higher-level representation acquisition. We propose two models, Weighted Neural Network (WNN) and Binary-Expectation Neural Network (BENN), which automatically control how much one specific unit contributes to the higher-level representation. The proposed model can be viewed as incorporating a more powerful c...
Parameter estimation in space systems using recurrent neural networks
Parlos, Alexander G.; Atiya, Amir F.; Sunkel, John W.
1991-01-01
The identification of time-varying parameters encountered in space systems is addressed, using artificial neural systems. A hybrid feedforward/feedback neural network, namely a recurrent multilayer perception, is used as the model structure in the nonlinear system identification. The feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of temporal variations in the system nonlinearities. The standard back-propagation-learning algorithm is modified and it is used for both the off-line and on-line supervised training of the proposed hybrid network. The performance of recurrent multilayer perceptron networks in identifying parameters of nonlinear dynamic systems is investigated by estimating the mass properties of a representative large spacecraft. The changes in the spacecraft inertia are predicted using a trained neural network, during two configurations corresponding to the early and late stages of the spacecraft on-orbit assembly sequence. The proposed on-line mass properties estimation capability offers encouraging results, though, further research is warranted for training and testing the predictive capabilities of these networks beyond nominal spacecraft operations.
Neural network emulation of a rainfall-runoff model
Directory of Open Access Journals (Sweden)
R. J. Abrahart
2007-02-01
Full Text Available The potential of an artificial neural network to perform simple non-linear hydrological transformations is examined. Four neural network models were developed to emulate different facets of a recognised non-linear hydrological transformation equation that possessed a small number of variables and contained no temporal component. The modeling process was based on a set of uniform random distributions. The cloning operation facilitated a direct comparison with the exact equation-based relationship. It also provided broader information about the power of a neural network to emulate existing equations and model non-linear relationships. Several comparisons with least squares multiple linear regression were performed. The first experiment involved a direct emulation of the Xinanjiang Rainfall-Runoff Model. The next two experiments were designed to assess the competencies of two neural solutions that were developed on a reduced number of inputs. This involved the omission and conflation of previous inputs. The final experiment used derived variables to model intrinsic but otherwise concealed internal relationships that are of hydrological interest. Two recent studies have suggested that neural solutions offer no worthwhile improvements in comparison to traditional weighted linear transfer functions for capturing the non-linear nature of hydrological relationships. Yet such fundamental properties are intrinsic aspects of catchment processes that cannot be excluded or ignored. The results from the four experiments that are reported in this paper are used to challenge the interpretations from these two earlier studies and thus further the debate with regards to the appropriateness of neural networks for hydrological modelling.
Institute of Scientific and Technical Information of China (English)
罗立强; 甘露; 吴晓军; 吉昂; 梁国立
2001-01-01
提出了神经网络基本参数-NNFP 算法。将 NNFP 算法应用于X射线荧光定量分析中，与理论α系数相比，NNFP 算法提高了非线性基体效应校正能力和预测准确度。%An algorithm of combining neural networks with the fundamental parameters(NNFP) was proposed and compared with the theoretical alpha coefficient based on classical matrix correction models. The results show that NNFP has more powerful ability of correcting the nonlinear matrix effects than the theoretical alpha coefficient and partial least-square regression(PLS) in X-ray fluorescence analysis.
GLOBAL ATTRACTIVITY AND GLOBAL EXPONENTIAL STABILITY FOR DELAYED HOPFIELD NEURAL NETWORK MODELS
Institute of Scientific and Technical Information of China (English)
蒲志林; 徐道义
2001-01-01
Some global properties such as global attractivity and global exponential stability for delayed Hopfield neural networks model, under the weaker assumptions on nonlinear activation functions, are concerned. By constructing suitable Liapunov function, some simpler criteria for global attractivity and global exponential stability for Hopfield continuous neural networks with time delays are presented.
Suppressing Halo-chaos for Intense Ion Beamby Neural Network Adaptation Control Strategy
Institute of Scientific and Technical Information of China (English)
FANGJin-qing; LUOXiao-shu; WENGJia-qiang; ZHULun-wu
2003-01-01
Neural network has some advantages of adaptation, learn-self, self-organization and suitable for high-dimension for various applications in many fields, especially among them the feed-forward back-propagating neural network self-adaptation method is suitable for control of nonlinear systems.
Fuzzy neural network theory and application
Liu, Puyin
2004-01-01
This book systematically synthesizes research achievements in the field of fuzzy neural networks in recent years. It also provides a comprehensive presentation of the developments in fuzzy neural networks, with regard to theory as well as their application to system modeling and image restoration. Special emphasis is placed on the fundamental concepts and architecture analysis of fuzzy neural networks. The book is unique in treating all kinds of fuzzy neural networks and their learning algorithms and universal approximations, and employing simulation examples which are carefully designed to he
Application of RBF Neural Network in OptimizingMachining Parameters
Institute of Scientific and Technical Information of China (English)
朱喜林; 吴博达; 武星星
2004-01-01
In machining processes, errors of rough in dimension, shape and location lead to changes in processing quantity, and the material of a workpiece may not be uniform. For these reasons, cutting force changes in machining, making the machining system deformable. Consequently errors in workpieces may occur. This is called the error reflection phenomenon. Generally, such errors can be reduced through repeated processing while using appropriate processing quantity in each processing based on operator's experience.According to the theory of error reflection, the error reflection coefficient indicates the extent to which errors of rough influence errors of workpieces. It is related to several factors such as machining condition, hardness of the workpiece, etc. This non-linear relation cannot be worked out using any formula. RBF neural network can approximate a non-linear function within any precision and be trained fast. In this paper, non-linear mapping ability of a fuzzy-neural network is utilized to approximate the non-linear relation. After training of the network with swatch collection obtained in experiments, an appropriate output can be obtained when an input is given. In this way, one can get the required number of processing and the processing quantity each time from the machining condition. Angular rigidity of a machining system,hardness of workpiece, etc., can be input in a form of fuzzy values. Feasibility in solving error reflection and optimizing machining parameters with a RBF neural network is verified by a simulation test with MATLAB.
FUZZY NEURAL NETWORK FOR MACHINE PARTS RECOGNITION SYSTEM
Institute of Scientific and Technical Information of China (English)
Luo Xiaobin; Yin Guofu; Chen Ke; Hu Xiaobing; Luo Yang
2003-01-01
The primary purpose is to develop a robust adaptive machine parts recognition system. A fuzzy neural network classifier is proposed for machine parts classifier. It is an efficient modeling method. Through learning, it can approach a random nonlinear function. A fuzzy neural network classifier is presented based on fuzzy mapping model. It is used for machine parts classification. The experimental system of machine parts classification is introduced. A robust least square back-propagation (RLSBP) training algorithm which combines robust least square (RLS) with back-propagation (BP) algorithm is put forward. Simulation and experimental results show that the learning property of RLSBP is superior to BP.
Neural networks for nuclear spectroscopy
Energy Technology Data Exchange (ETDEWEB)
Keller, P.E.; Kangas, L.J.; Hashem, S.; Kouzes, R.T. [Pacific Northwest Lab., Richland, WA (United States)] [and others
1995-12-31
In this paper two applications of artificial neural networks (ANNs) in nuclear spectroscopy analysis are discussed. In the first application, an ANN assigns quality coefficients to alpha particle energy spectra. These spectra are used to detect plutonium contamination in the work environment. The quality coefficients represent the levels of spectral degradation caused by miscalibration and foreign matter affecting the instruments. A set of spectra was labeled with quality coefficients by an expert and used to train the ANN expert system. Our investigation shows that the expert knowledge of spectral quality can be transferred to an ANN system. The second application combines a portable gamma-ray spectrometer with an ANN. In this system the ANN is used to automatically identify, radioactive isotopes in real-time from their gamma-ray spectra. Two neural network paradigms are examined: the linear perception and the optimal linear associative memory (OLAM). A comparison of the two paradigms shows that OLAM is superior to linear perception for this application. Both networks have a linear response and are useful in determining the composition of an unknown sample when the spectrum of the unknown is a linear superposition of known spectra. One feature of this technique is that it uses the whole spectrum in the identification process instead of only the individual photo-peaks. For this reason, it is potentially more useful for processing data from lower resolution gamma-ray spectrometers. This approach has been tested with data generated by Monte Carlo simulations and with field data from sodium iodide and Germanium detectors. With the ANN approach, the intense computation takes place during the training process. Once the network is trained, normal operation consists of propagating the data through the network, which results in rapid identification of samples. This approach is useful in situations that require fast response where precise quantification is less important.
Electronic circuits modeling using artificial neural networks
Directory of Open Access Journals (Sweden)
Andrejević Miona V.
2003-01-01
Full Text Available In this paper artificial neural networks (ANN are applied to modeling of electronic circuits. ANNs are used for application of the black-box modeling concept in the time domain. Modeling process is described, so the topology of the ANN, the testing signal used for excitation, together with the complexity of ANN are considered. The procedure is first exemplified in modeling of resistive circuits. MOS transistor, as a four-terminal device, is modeled. Then nonlinear negative resistive characteristic is modeled in order to be used as a piece-wise linear resistor in Chua's circuit. Examples of modeling nonlinear dynamic circuits are given encompassing a variety of modeling problems. A nonlinear circuit containing quartz oscillator is considered for modeling. Verification of the concept is performed by verifying the ability of the model to generalize i.e. to create acceptable responses to excitations not used during training. Implementation of these models within a behavioral simulator is exemplified. Every model is implemented in realistic surrounding in order to show its interaction, and of course, its usage and purpose.
Systolic implementation of neural networks
Energy Technology Data Exchange (ETDEWEB)
De Groot, A.J.; Parker, S.R.
1989-01-01
The backpropagation algorithm for error gradient calculations in multilayer, feed-forward neural networks is derived in matrix form involving inner and outer products. It is demonstrated that these calculations can be carried out efficiently using systolic processing techniques, particularly using the SPRINT, a 64-element systolic processor developed at Lawrence Livermore National Laboratory. This machine contains one million synapses, and forward-propagates 12 million connections per second, using 100 watts of power. When executing the algorithm, each SPRINT processor performs useful work 97% of the time. The theory and applications are confirmed by some nontrivial examples involving seismic signal recognition. 4 refs., 7 figs.
Magnitude Sensitive Competitive Neural Networks
Pelayo Campillos, Enrique; Buldain Pérez, David; Orrite Uruñuela, Carlos
2014-01-01
En esta Tesis se presentan un conjunto de redes neuronales llamadas Magnitude Sensitive Competitive Neural Networks (MSCNNs). Se trata de un conjunto de algoritmos de Competitive Learning que incluyen un término de magnitud como un factor de modulación de la distancia usada en la competición. Al igual que otros métodos competitivos, MSCNNs realizan la cuantización vectorial de los datos, pero el término de magnitud guía el entrenamiento de los centroides de modo que se representan con alto de...
Institute of Scientific and Technical Information of China (English)
王正齐; 刘贤兴
2013-01-01
The bearingless induction motor is a nonlinear, multi-variable and strongly coupled system. For this system, a novel internal model control strategy based on neural network αth-order inverse system theory is proposed in this paper to realize the decoupling control. By cascading the ath-order inverse model approximated by the dynamic neural network with the original system, the nonlinear bearingless induction motor system is decoupled into four independent pseudo-linear subsystems, that is, two radial displacement subsystems, a speed subsystem and a rotor flux subsystem. Then, the internal model control method is introduced to the four pseudo-linear subsystems to ensure the robustness and antijamming ability of the closed-loop system. The effectiveness and superiority of the proposed strategy are demonstrated by simulation and experiment.%针对无轴承异步电机非线性、多变量、强耦合的特点,提出一种基于神经网络α阶逆系统方法的非线性内模控制策略.将用动态神经网络逼近的无轴承异步电机α阶逆模型与原系统复合,将非线性的无轴承异步电机原系统解耦成转子径向位移、转速和转子磁链四个独立的伪线性子系统.为了保证系统的鲁棒性,对伪线性系统引入内模控制,仿真和实验研究验证了所提控制方法的有效性.
Investigating rainfall estimation from radar measurements using neural networks
Directory of Open Access Journals (Sweden)
A. Alqudah
2013-03-01
Full Text Available Rainfall observed on the ground is dependent on the four dimensional structure of precipitation aloft. Scanning radars can observe the four dimensional structure of precipitation. Neural network is a nonparametric method to represent the nonlinear relationship between radar measurements and rainfall rate. The relationship is derived directly from a dataset consisting of radar measurements and rain gauge measurements. The performance of neural network based rainfall estimation is subject to many factors, such as the representativeness and sufficiency of the training dataset, the generalization capability of the network to new data, seasonal changes, and regional changes. Improving the performance of the neural network for real time applications is of great interest. The goal of this paper is to investigate the performance of rainfall estimation based on Radial Basis Function (RBF neural networks using radar reflectivity as input and rain gauge as the target. Data from Melbourne, Florida NEXRAD (Next Generation Weather Radar ground radar (KMLB over different years along with rain gauge measurements are used to conduct various investigations related to this problem. A direct gauge comparison study is done to demonstrate the improvement brought in by the neural networks and to show the feasibility of this system. The principal components analysis (PCA technique is also used to reduce the dimensionality of the training dataset. Reducing the dimensionality of the input training data will reduce the training time as well as reduce the network complexity which will also avoid over fitting.
Miconi, Thomas
2017-02-23
Neural activity during cognitive tasks exhibits complex dynamics that flexibly encode task-relevant variables. Chaotic recurrent networks, which spontaneously generate rich dynamics, have been proposed as a model of cortical computation during cognitive tasks. However, existing methods for training these networks are either biologically implausible, and/or require a continuous, real-time error signal to guide learning. Here we show that a biologically plausible learning rule can train such recurrent networks, guided solely by delayed, phasic rewards at the end of each trial. Networks endowed with this learning rule can successfully learn nontrivial tasks requiring flexible (context-dependent) associations, memory maintenance, nonlinear mixed selectivities, and coordination among multiple outputs. The resulting networks replicate complex dynamics previously observed in animal cortex, such as dynamic encoding of task features and selective integration of sensory inputs. We conclude that recurrent neural networks offer a plausible model of cortical dynamics during both learning and performance of flexible behavior.
Sleep scoring using artificial neural networks.
Ronzhina, Marina; Janoušek, Oto; Kolářová, Jana; Nováková, Marie; Honzík, Petr; Provazník, Ivo
2012-06-01
Rapid development of computer technologies leads to the intensive automation of many different processes traditionally performed by human experts. One of the spheres characterized by the introduction of new high intelligence technologies substituting analysis performed by humans is sleep scoring. This refers to the classification task and can be solved - next to other classification methods - by use of artificial neural networks (ANN). ANNs are parallel adaptive systems suitable for solving of non-linear problems. Using ANN for automatic sleep scoring is especially promising because of new ANN learning algorithms allowing faster classification without decreasing the performance. Both appropriate preparation of training data as well as selection of the ANN model make it possible to perform effective and correct recognizing of relevant sleep stages. Such an approach is highly topical, taking into consideration the fact that there is no automatic scorer utilizing ANN technology available at present.
The Laplacian spectrum of neural networks.
de Lange, Siemon C; de Reus, Marcel A; van den Heuvel, Martijn P
2014-01-13
The brain is a complex network of neural interactions, both at the microscopic and macroscopic level. Graph theory is well suited to examine the global network architecture of these neural networks. Many popular graph metrics, however, encode average properties of individual network elements. Complementing these "conventional" graph metrics, the eigenvalue spectrum of the normalized Laplacian describes a network's structure directly at a systems level, without referring to individual nodes or connections. In this paper, the Laplacian spectra of the macroscopic anatomical neuronal networks of the macaque and cat, and the microscopic network of the Caenorhabditis elegans were examined. Consistent with conventional graph metrics, analysis of the Laplacian spectra revealed an integrative community structure in neural brain networks. Extending previous findings of overlap of network attributes across species, similarity of the Laplacian spectra across the cat, macaque and C. elegans neural networks suggests a certain level of consistency in the overall architecture of the anatomical neural networks of these species. Our results further suggest a specific network class for neural networks, distinct from conceptual small-world and scale-free models as well as several empirical networks.
The Laplacian spectrum of neural networks
de Lange, Siemon C.; de Reus, Marcel A.; van den Heuvel, Martijn P.
2014-01-01
The brain is a complex network of neural interactions, both at the microscopic and macroscopic level. Graph theory is well suited to examine the global network architecture of these neural networks. Many popular graph metrics, however, encode average properties of individual network elements. Complementing these “conventional” graph metrics, the eigenvalue spectrum of the normalized Laplacian describes a network's structure directly at a systems level, without referring to individual nodes or connections. In this paper, the Laplacian spectra of the macroscopic anatomical neuronal networks of the macaque and cat, and the microscopic network of the Caenorhabditis elegans were examined. Consistent with conventional graph metrics, analysis of the Laplacian spectra revealed an integrative community structure in neural brain networks. Extending previous findings of overlap of network attributes across species, similarity of the Laplacian spectra across the cat, macaque and C. elegans neural networks suggests a certain level of consistency in the overall architecture of the anatomical neural networks of these species. Our results further suggest a specific network class for neural networks, distinct from conceptual small-world and scale-free models as well as several empirical networks. PMID:24454286
Advanced neural network-based computational schemes for robust fault diagnosis
Mrugalski, Marcin
2014-01-01
The present book is devoted to problems of adaptation of artificial neural networks to robust fault diagnosis schemes. It presents neural networks-based modelling and estimation techniques used for designing robust fault diagnosis schemes for non-linear dynamic systems. A part of the book focuses on fundamental issues such as architectures of dynamic neural networks, methods for designing of neural networks and fault diagnosis schemes as well as the importance of robustness. The book is of a tutorial value and can be perceived as a good starting point for the new-comers to this field. The book is also devoted to advanced schemes of description of neural model uncertainty. In particular, the methods of computation of neural networks uncertainty with robust parameter estimation are presented. Moreover, a novel approach for system identification with the state-space GMDH neural network is delivered. All the concepts described in this book are illustrated by both simple academic illustrative examples and practica...
Neural Network Controlled Visual Saccades
Johnson, Jeffrey D.; Grogan, Timothy A.
1989-03-01
The paper to be presented will discuss research on a computer vision system controlled by a neural network capable of learning through classical (Pavlovian) conditioning. Through the use of unconditional stimuli (reward and punishment) the system will develop scan patterns of eye saccades necessary to differentiate and recognize members of an input set. By foveating only those portions of the input image that the system has found to be necessary for recognition the drawback of computational explosion as the size of the input image grows is avoided. The model incorporates many features found in animal vision systems, and is governed by understandable and modifiable behavior patterns similar to those reported by Pavlov in his classic study. These behavioral patterns are a result of a neuronal model, used in the network, explicitly designed to reproduce this behavior.
Review of neural network modelling of cracking process
Rosli, M. N.; Aziz, N.
2016-11-01
Cracking process is a very important process that converts low value products into high value products such as conversion of naphtha into ethylene and propylene. The process is nonlinear with extensive reaction network. Thus, nonlinear technique such as artificial neural network is explored to develop the model of the system. The paper will review and discuss the research works done on the technique in modelling cracking process using artificial neural network starting from early 1990s until recent development in 2015. Timeline is provided to show progression of work done throughout the years, the main issues addressed, and the proposed techniques for each. In the next section, the main objective of each work and each techniques explored by previous researchers is discussed in more detail. A table that summarizes previous works is provided to show common works done throughout the years. Lastly, potential gap for future works in the area is highlighted.
Video Traffic Prediction Using Neural Networks
Directory of Open Access Journals (Sweden)
Miloš Oravec
2008-10-01
Full Text Available In this paper, we consider video stream prediction for application in services likevideo-on-demand, videoconferencing, video broadcasting, etc. The aim is to predict thevideo stream for an efficient bandwidth allocation of the video signal. Efficient predictionof traffic generated by multimedia sources is an important part of traffic and congestioncontrol procedures at the network edges. As a tool for the prediction, we use neuralnetworks – multilayer perceptron (MLP, radial basis function networks (RBF networksand backpropagation through time (BPTT neural networks. At first, we briefly introducetheoretical background of neural networks, the prediction methods and the differencebetween them. We propose also video time-series processing using moving averages.Simulation results for each type of neural network together with final comparisons arepresented. For comparison purposes, also conventional (non-neural prediction isincluded. The purpose of our work is to construct suitable neural networks for variable bitrate video prediction and evaluate them. We use video traces from [1].
Neural networks with discontinuous/impact activations
Akhmet, Marat
2014-01-01
This book presents as its main subject new models in mathematical neuroscience. A wide range of neural networks models with discontinuities are discussed, including impulsive differential equations, differential equations with piecewise constant arguments, and models of mixed type. These models involve discontinuities, which are natural because huge velocities and short distances are usually observed in devices modeling the networks. A discussion of the models, appropriate for the proposed applications, is also provided. This book also: Explores questions related to the biological underpinning for models of neural networks\\ Considers neural networks modeling using differential equations with impulsive and piecewise constant argument discontinuities Provides all necessary mathematical basics for application to the theory of neural networks Neural Networks with Discontinuous/Impact Activations is an ideal book for researchers and professionals in the field of engineering mathematics that have an interest in app...
Adaptive neural control for a class of nonlinearly parametric time-delay systems.
Ho, Daniel W C; Li, Junmin; Niu, Yugang
2005-05-01
In this paper, an adaptive neural controller for a class of time-delay nonlinear systems with unknown nonlinearities is proposed. Based on a wavelet neural network (WNN) online approximation model, a state feedback adaptive controller is obtained by constructing a novel integral-type Lyapunov-Krasovskii functional, which also efficiently overcomes the controller singularity problem. It is shown that the proposed method guarantees the semiglobal boundedness of all signals in the adaptive closed-loop systems. An example is provided to illustrate the application of the approach.
Neural Networks for Emotion Classification
Sun, Yafei
2011-01-01
It is argued that for the computer to be able to interact with humans, it needs to have the communication skills of humans. One of these skills is the ability to understand the emotional state of the person. This thesis describes a neural network-based approach for emotion classification. We learn a classifier that can recognize six basic emotions with an average accuracy of 77% over the Cohn-Kanade database. The novelty of this work is that instead of empirically selecting the parameters of the neural network, i.e. the learning rate, activation function parameter, momentum number, the number of nodes in one layer, etc. we developed a strategy that can automatically select comparatively better combination of these parameters. We also introduce another way to perform back propagation. Instead of using the partial differential of the error function, we use optimal algorithm; namely Powell's direction set to minimize the error function. We were also interested in construction an authentic emotion databases. This...
Optimising the topology of complex neural networks
Jiang, Fei; Schoenauer, Marc
2007-01-01
In this paper, we study instances of complex neural networks, i.e. neural netwo rks with complex topologies. We use Self-Organizing Map neural networks whose n eighbourhood relationships are defined by a complex network, to classify handwr itten digits. We show that topology has a small impact on performance and robus tness to neuron failures, at least at long learning times. Performance may howe ver be increased (by almost 10%) by artificial evolution of the network topo logy. In our experimental conditions, the evolved networks are more random than their parents, but display a more heterogeneous degree distribution.
Stability analysis of embedded nonlinear predictor neural generalized predictive controller
Directory of Open Access Journals (Sweden)
Hesham F. Abdel Ghaffar
2014-03-01
Full Text Available Nonlinear Predictor-Neural Generalized Predictive Controller (NGPC is one of the most advanced control techniques that are used with severe nonlinear processes. In this paper, a hybrid solution from NGPC and Internal Model Principle (IMP is implemented to stabilize nonlinear, non-minimum phase, variable dead time processes under high disturbance values over wide range of operation. Also, the superiority of NGPC over linear predictive controllers, like GPC, is proved for severe nonlinear processes over wide range of operation. The necessary conditions required to stabilize NGPC is derived using Lyapunov stability analysis for nonlinear processes. The NGPC stability conditions and improvement in disturbance suppression are verified by both simulation using Duffing’s nonlinear equation and real-time using continuous stirred tank reactor. Up to our knowledge, the paper offers the first hardware embedded Neural GPC which has been utilized to verify NGPC–IMP improvement in realtime.
A new formulation for feedforward neural networks.
Razavi, Saman; Tolson, Bryan A
2011-10-01
Feedforward neural network is one of the most commonly used function approximation techniques and has been applied to a wide variety of problems arising from various disciplines. However, neural networks are black-box models having multiple challenges/difficulties associated with training and generalization. This paper initially looks into the internal behavior of neural networks and develops a detailed interpretation of the neural network functional geometry. Based on this geometrical interpretation, a new set of variables describing neural networks is proposed as a more effective and geometrically interpretable alternative to the traditional set of network weights and biases. Then, this paper develops a new formulation for neural networks with respect to the newly defined variables; this reformulated neural network (ReNN) is equivalent to the common feedforward neural network but has a less complex error response surface. To demonstrate the learning ability of ReNN, in this paper, two training methods involving a derivative-based (a variation of backpropagation) and a derivative-free optimization algorithms are employed. Moreover, a new measure of regularization on the basis of the developed geometrical interpretation is proposed to evaluate and improve the generalization ability of neural networks. The value of the proposed geometrical interpretation, the ReNN approach, and the new regularization measure are demonstrated across multiple test problems. Results show that ReNN can be trained more effectively and efficiently compared to the common neural networks and the proposed regularization measure is an effective indicator of how a network would perform in terms of generalization.
Drift chamber tracking with neural networks
Energy Technology Data Exchange (ETDEWEB)
Lindsey, C.S.; Denby, B.; Haggerty, H.
1992-10-01
We discuss drift chamber tracking with a commercial log VLSI neural network chip. Voltages proportional to the drift times in a 4-layer drift chamber were presented to the Intel ETANN chip. The network was trained to provide the intercept and slope of straight tracks traversing the chamber. The outputs were recorded and later compared off line to conventional track fits. Two types of network architectures were studied. Applications of neural network tracking to high energy physics detector triggers is discussed.
Neural Network-Based Active Control for Offshore Platforms
Institute of Scientific and Technical Information of China (English)
周亚军; 赵德有
2003-01-01
A new active control scheme, based on neural network, for the suppression of oscillation in multiple-degree-of-freedom (MDOF) offshore platforms, is studied in this paper. With the main advantages of neural network, i.e. the inherent robustness, fault tolerance, and generalized capability of its parallel massive interconnection structure, the active structural control of offshore platforms under random waves is accomplished by use of the BP neural network model. The neural network is trained offline with the data generated from numerical analysis, and it simulates the process of Classical Linear Quadratic Regular Control for the platform under random waves. After the learning phase, the trained network has learned about the nonlinear dynamic behavior of the active control system, and is capable of predicting the active control forces of the next time steps. The results obtained show that the active control is feasible and effective, and it finally overcomes time delay owing to the robustness, fault tolerance, and generalized capability of artificial neural network.
Exponential synchronization of general chaotic delayed neural networks via hybrid feedback
Institute of Scientific and Technical Information of China (English)
无
2008-01-01
This paper investigates the exponential synchronization problem of some chaotic delayed neural networks based on the proposed general neural network model, which is the interconnection of a linear delayed dynamic system and a bounded static nonlinear operator, and covers several well-known neural networks, such as Hopfield neural networks, cellular neural networks (CNNs), bidirectional associative memory (BAM) networks, recurrent multilayer perceptrons (RMLPs). By virtue of LyapunovKrasovskii stability theory and linear matrix inequality (LMI) technique, some exponential synchronization criteria are derived.Using the drive-response concept, hybrid feedback controllers are designed to synchronize two identical chaotic neural networks based on those synchronization criteria. Finally, detailed comparisons with existing results are made and numerical simulations are carried out to demonstrate the effectiveness of the established synchronization laws.
Coherence resonance in bursting neural networks.
Kim, June Hoan; Lee, Ho Jun; Min, Cheol Hong; Lee, Kyoung J
2015-10-01
Synchronized neural bursts are one of the most noticeable dynamic features of neural networks, being essential for various phenomena in neuroscience, yet their complex dynamics are not well understood. With extrinsic electrical and optical manipulations on cultured neural networks, we demonstrate that the regularity (or randomness) of burst sequences is in many cases determined by a (few) low-dimensional attractor(s) working under strong neural noise. Moreover, there is an optimal level of noise strength at which the regularity of the interburst interval sequence becomes maximal-a phenomenon of coherence resonance. The experimental observations are successfully reproduced through computer simulations on a well-established neural network model, suggesting that the same phenomena may occur in many in vivo as well as in vitro neural networks.
Dual adaptive dynamic control of mobile robots using neural networks.
Bugeja, Marvin K; Fabri, Simon G; Camilleri, Liberato
2009-02-01
This paper proposes two novel dual adaptive neural control schemes for the dynamic control of nonholonomic mobile robots. The two schemes are developed in discrete time, and the robot's nonlinear dynamic functions are assumed to be unknown. Gaussian radial basis function and sigmoidal multilayer perceptron neural networks are used for function approximation. In each scheme, the unknown network parameters are estimated stochastically in real time, and no preliminary offline neural network training is used. In contrast to other adaptive techniques hitherto proposed in the literature on mobile robots, the dual control laws presented in this paper do not rely on the heuristic certainty equivalence property but account for the uncertainty in the estimates. This results in a major improvement in tracking performance, despite the plant uncertainty and unmodeled dynamics. Monte Carlo simulation and statistical hypothesis testing are used to illustrate the effectiveness of the two proposed stochastic controllers as applied to the trajectory-tracking problem of a differentially driven wheeled mobile robot.
Adaptive Control of Flexible Redundant Manipulators Using Neural Networks
Institute of Scientific and Technical Information of China (English)
SONG Yimin; LI Jianxin; WANG Shiyu; LIU Jianping
2006-01-01
An investigation on the neural networks based active vibration control of flexible redundant manipulators was conducted.The smart links of the manipulator were synthesized with the flexible links to which were attached piezoceramic actuators and strain gauge sensors.A nonlinear adaptive control strategy named neural networks based indirect adaptive control (NNIAC) was employed to improve the dynamic performance of the manipulator.The mathematical model of the 4-layered dynamic recurrent neural networks (DRNN) was introduced.The neuro-identifier and the neurocontroller featuring the DRNN topology were designed off line so as to enhance the initial robustness of the NNIAC.By adjusting the neuro-identifier and the neuro-controller alternatively,the manipulator was controlled on line for achieving the desired dynamic performance.Finally,a planar 3R redundant manipulator with one smart link was utilized as an illustrative example.The simulation results proved the validity of the control strategy.
Fault Detection and Isolation (Fdi Via Neural Networks
Directory of Open Access Journals (Sweden)
Neeraj Prakash Srivastava,
2014-01-01
Full Text Available Recent approaches to fault detection and isolation for dynamic systems using methods of integrating quantitative and qualitative model information, based upon soft computing (SC methods are used. In this study, the use of SC methods is considered an important extension to the quantitative model-based approach for residual generation in FDI. When quantitative models are not readily available, a correctly trained neural network (NN can be used as a non-linear dynamic model of the system. However, the neural network does not easily provide insight into model. This main difficulty can be overcome using qualitative modeling or rule-based inference methods. The paper presents the properties of several methods of combining quantitative and qualitative system information and their practical value for fault diagnosis of Neural network. Keywords: Soft computing methods, fault-diagnosis, FDI
Development of target-tracking algorithms using neural network
Energy Technology Data Exchange (ETDEWEB)
Park, Dong Sun; Lee, Joon Whaoan; Yoon, Sook; Baek, Seong Hyun; Lee, Myung Jae [Chonbuk National University, Chonjoo (Korea)
1998-04-01
The utilization of remote-control robot system in atomic power plants or nuclear-related facilities grows rapidly, to protect workers form high radiation environments. Such applications require complete stability of the robot system, so that precisely tracking the robot is essential for the whole system. This research is to accomplish the goal by developing appropriate algorithms for remote-control robot systems. A neural network tracking system is designed and experimented to trace a robot Endpoint. This model is aimed to utilized the excellent capabilities of neural networks; nonlinear mapping between inputs and outputs, learning capability, and generalization capability. The neural tracker consists of two networks for position detection and prediction. Tracking algorithms are developed and experimented for the two models. Results of the experiments show that both models are promising as real-time target-tracking systems for remote-control robot systems. (author). 10 refs., 47 figs.
Dynamical analysis of uncertain neural networks with multiple time delays
Arik, Sabri
2016-02-01
This paper investigates the robust stability problem for dynamical neural networks in the presence of time delays and norm-bounded parameter uncertainties with respect to the class of non-decreasing, non-linear activation functions. By employing the Lyapunov stability and homeomorphism mapping theorems together, a new delay-independent sufficient condition is obtained for the existence, uniqueness and global asymptotic stability of the equilibrium point for the delayed uncertain neural networks. The condition obtained for robust stability establishes a matrix-norm relationship between the network parameters of the neural system, which can be easily verified by using properties of the class of the positive definite matrices. Some constructive numerical examples are presented to show the applicability of the obtained result and its advantages over the previously published corresponding literature results.
Dynamics of Transiently Chaotic Neural Network and Its Application to Optimization
Institute of Scientific and Technical Information of China (English)
YANG Li-Jiang; CHEN Tian-Lun; HUANG Wu-Qun
2001-01-01
Through adding a nonlinear self-feedback term in the evolution equations of neural network, we introduced a transiently chaotic neural network model. In order to utilize the transiently chaotic dynamics mechanism in optimization problem efficiently, we have analyzed the dynamical procedure of the transiently chaotic neural network rnodel and studied the function of the crucial bifurcation parameter which governs the chaotic behavior of the system. Based on the dynamical analysis of the transiently chaotic neural network model, chaotic annealing algorithm is also examined and improved. As an example, we applied chaotic annealing method to the traveling salesman problem and obtained good results.``
Distributed Extreme Learning Machine for Nonlinear Learning over Network
Directory of Open Access Journals (Sweden)
Songyan Huang
2015-02-01
Full Text Available Distributed data collection and analysis over a network are ubiquitous, especially over a wireless sensor network (WSN. To our knowledge, the data model used in most of the distributed algorithms is linear. However, in real applications, the linearity of systems is not always guaranteed. In nonlinear cases, the single hidden layer feedforward neural network (SLFN with radial basis function (RBF hidden neurons has the ability to approximate any continuous functions and, thus, may be used as the nonlinear learning system. However, confined by the communication cost, using the distributed version of the conventional algorithms to train the neural network directly is usually prohibited. Fortunately, based on the theorems provided in the extreme learning machine (ELM literature, we only need to compute the output weights of the SLFN. Computing the output weights itself is a linear learning problem, although the input-output mapping of the overall SLFN is still nonlinear. Using the distributed algorithmto cooperatively compute the output weights of the SLFN, we obtain a distributed extreme learning machine (dELM for nonlinear learning in this paper. This dELM is applied to the regression problem and classification problem to demonstrate its effectiveness and advantages.
Neural network classification - A Bayesian interpretation
Wan, Eric A.
1990-01-01
The relationship between minimizing a mean squared error and finding the optimal Bayesian classifier is reviewed. This provides a theoretical interpretation for the process by which neural networks are used in classification. A number of confidence measures are proposed to evaluate the performance of the neural network classifier within a statistical framework.
Adaptive Neurons For Artificial Neural Networks
Tawel, Raoul
1990-01-01
Training time decreases dramatically. In improved mathematical model of neural-network processor, temperature of neurons (in addition to connection strengths, also called weights, of synapses) varied during supervised-learning phase of operation according to mathematical formalism and not heuristic rule. Evidence that biological neural networks also process information at neuronal level.
Isolated Speech Recognition Using Artificial Neural Networks
2007-11-02
In this project Artificial Neural Networks are used as research tool to accomplish Automated Speech Recognition of normal speech. A small size...the first stage of this work are satisfactory and thus the application of artificial neural networks in conjunction with cepstral analysis in isolated word recognition holds promise.
Neural Network Algorithm for Particle Loading
Energy Technology Data Exchange (ETDEWEB)
J. L. V. Lewandowski
2003-04-25
An artificial neural network algorithm for continuous minimization is developed and applied to the case of numerical particle loading. It is shown that higher-order moments of the probability distribution function can be efficiently renormalized using this technique. A general neural network for the renormalization of an arbitrary number of moments is given.
Medical image analysis with artificial neural networks.
Jiang, J; Trundle, P; Ren, J
2010-12-01
Given that neural networks have been widely reported in the research community of medical imaging, we provide a focused literature survey on recent neural network developments in computer-aided diagnosis, medical image segmentation and edge detection towards visual content analysis, and medical image registration for its pre-processing and post-processing, with the aims of increasing awareness of how neural networks can be applied to these areas and to provide a foundation for further research and practical development. Representative techniques and algorithms are explained in detail to provide inspiring examples illustrating: (i) how a known neural network with fixed structure and training procedure could be applied to resolve a medical imaging problem; (ii) how medical images could be analysed, processed, and characterised by neural networks; and (iii) how neural networks could be expanded further to resolve problems relevant to medical imaging. In the concluding section, a highlight of comparisons among many neural network applications is included to provide a global view on computational intelligence with neural networks in medical imaging. Copyright © 2010 Elsevier Ltd. All rights reserved.
Creativity in design and artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Neocleous, C.C.; Esat, I.I. [Brunel Univ. Uxbridge (United Kingdom); Schizas, C.N. [Univ. of Cyprus, Nicosia (Cyprus)
1996-12-31
The creativity phase is identified as an integral part of the design phase. The characteristics of creative persons which are relevant to designing artificial neural networks manifesting aspects of creativity, are identified. Based on these identifications, a general framework of artificial neural network characteristics to implement such a goal are proposed.
Application of Neural Networks for Energy Reconstruction
Damgov, Jordan
2002-01-01
The possibility to use Neural Networks for reconstruction ofthe energy deposited in the calorimetry system of the CMS detector is investigated. It is shown that using feed-forward neural network, good linearity, Gaussian energy distribution and good energy resolution can be achieved. Significant improvement of the energy resolution and linearity is reached in comparison with other weighting methods for energy reconstruction.
The Use of Neural Network Technology to Model Swimming Performance
Silva, António José; Costa, Aldo Manuel; Oliveira, Paulo Moura; Reis, Victor Machado; Saavedra, José; Perl, Jurgen; Rouboa, Abel; Marinho, Daniel Almeida
2007-01-01
The aims of the present study were: to identify the factors which are able to explain the performance in the 200 meters individual medley and 400 meters front crawl events in young swimmers, to model the performance in those events using non-linear mathematic methods through artificial neural networks (multi-layer perceptrons) and to assess the neural network models precision to predict the performance. A sample of 138 young swimmers (65 males and 73 females) of national level was submitted to a test battery comprising four different domains: kinanthropometric evaluation, dry land functional evaluation (strength and flexibility), swimming functional evaluation (hydrodynamics, hydrostatic and bioenergetics characteristics) and swimming technique evaluation. To establish a profile of the young swimmer non-linear combinations between preponderant variables for each gender and swim performance in the 200 meters medley and 400 meters font crawl events were developed. For this purpose a feed forward neural network was used (Multilayer Perceptron) with three neurons in a single hidden layer. The prognosis precision of the model (error lower than 0.8% between true and estimated performances) is supported by recent evidence. Therefore, we consider that the neural network tool can be a good approach in the resolution of complex problems such as performance modeling and the talent identification in swimming and, possibly, in a wide variety of sports. Key pointsThe non-linear analysis resulting from the use of feed forward neural network allowed us the development of four performance models.The mean difference between the true and estimated results performed by each one of the four neural network models constructed was low.The neural network tool can be a good approach in the resolution of the performance modeling as an alternative to the standard statistical models that presume well-defined distributions and independence among all inputs.The use of neural networks for sports
Introduction to Concepts in Artificial Neural Networks
Niebur, Dagmar
1995-01-01
This introduction to artificial neural networks summarizes some basic concepts of computational neuroscience and the resulting models of artificial neurons. The terminology of biological and artificial neurons, biological and machine learning and neural processing is introduced. The concepts of supervised and unsupervised learning are explained with examples from the power system area. Finally, a taxonomy of different types of neurons and different classes of artificial neural networks is presented.
Rule Extraction using Artificial Neural Networks
Kamruzzaman, S M
2010-01-01
Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions are not as interpretable as those of decision trees. In many applications, it is desirable to extract knowledge from trained neural networks so that the users can gain a better understanding of the solution. This paper presents an efficient algorithm to extract rules from artificial neural networks. We use two-phase training algorithm for backpropagation learning. In the first phase, the number of hidden nodes of the network is determined automatically in a constructive fashion by adding nodes one after another based on the performance of the network on training data. In the second phase, the number of relevant input units of the network is determined using pruning algorithm. The ...
Adaptive neural control for a class of perturbed strict-feedback nonlinear time-delay systems.
Wang, Min; Chen, Bing; Shi, Peng
2008-06-01
This paper proposes a novel adaptive neural control scheme for a class of perturbed strict-feedback nonlinear time-delay systems with unknown virtual control coefficients. Based on the radial basis function neural network online approximation capability, an adaptive neural controller is presented by combining the backstepping approach and Lyapunov-Krasovskii functionals. The proposed controller guarantees the semiglobal boundedness of all the signals in the closed-loop system and contains minimal learning parameters. Finally, three simulation examples are given to demonstrate the effectiveness and applicability of the proposed scheme.
Adaptive Neural Control of Uncertain MIMO Nonlinear Systems With State and Input Constraints.
Chen, Ziting; Li, Zhijun; Chen, C L Philip
2016-03-17
An adaptive neural control strategy for multiple input multiple output nonlinear systems with various constraints is presented in this paper. To deal with the nonsymmetric input nonlinearity and the constrained states, the proposed adaptive neural control is combined with the backstepping method, radial basis function neural network, barrier Lyapunov function (BLF), and disturbance observer. By ensuring the boundedness of the BLF of the closed-loop system, it is demonstrated that the output tracking is achieved with all states remaining in the constraint sets and the general assumption on nonsingularity of unknown control coefficient matrices has been eliminated. The constructed adaptive neural control has been rigorously proved that it can guarantee the semiglobally uniformly ultimate boundedness of all signals in the closed-loop system. Finally, the simulation studies on a 2-DOF robotic manipulator system indicate that the designed adaptive control is effective.
International Conference on Artificial Neural Networks (ICANN)
Mladenov, Valeri; Kasabov, Nikola; Artificial Neural Networks : Methods and Applications in Bio-/Neuroinformatics
2015-01-01
The book reports on the latest theories on artificial neural networks, with a special emphasis on bio-neuroinformatics methods. It includes twenty-three papers selected from among the best contributions on bio-neuroinformatics-related issues, which were presented at the International Conference on Artificial Neural Networks, held in Sofia, Bulgaria, on September 10-13, 2013 (ICANN 2013). The book covers a broad range of topics concerning the theory and applications of artificial neural networks, including recurrent neural networks, super-Turing computation and reservoir computing, double-layer vector perceptrons, nonnegative matrix factorization, bio-inspired models of cell communities, Gestalt laws, embodied theory of language understanding, saccadic gaze shifts and memory formation, and new training algorithms for Deep Boltzmann Machines, as well as dynamic neural networks and kernel machines. It also reports on new approaches to reinforcement learning, optimal control of discrete time-delay systems, new al...
Computational intelligence synergies of fuzzy logic, neural networks and evolutionary computing
Siddique, Nazmul
2013-01-01
Computational Intelligence: Synergies of Fuzzy Logic, Neural Networks and Evolutionary Computing presents an introduction to some of the cutting edge technological paradigms under the umbrella of computational intelligence. Computational intelligence schemes are investigated with the development of a suitable framework for fuzzy logic, neural networks and evolutionary computing, neuro-fuzzy systems, evolutionary-fuzzy systems and evolutionary neural systems. Applications to linear and non-linear systems are discussed with examples. Key features: Covers all the aspect
Neural Network Autopilot System for a Mathematical Model of the Boeing 747
2007-11-02
perform linear maneuvers and regain steady state conditions when at non-linear conditions. DTIC QUALITY INSPECTED References [I] Hagan, M.T., Demuth ...References [I] Hagan, M.T., Demuth , H.B., Beale, M. Neural Network Design. PWS Publishing Company, Boston, MA, 1996. [2] Fausett, L. Fundamentals of...References [1] Hagan, M.T., Demuth , H.B., Beale, M. Neural Network Design. PWS Publishing Company Boston, MA, 1996. [2] Fausett, L. Fundamentals of Neural
THE USE OF NEURAL NETWORK TECHNOLOGY TO MODEL SWIMMING PERFORMANCE
Directory of Open Access Journals (Sweden)
António José Silva
2007-03-01
Full Text Available The aims of the present study were: to identify the factors which are able to explain the performance in the 200 meters individual medley and 400 meters front crawl events in young swimmers, to model the performance in those events using non-linear mathematic methods through artificial neural networks (multi-layer perceptrons and to assess the neural network models precision to predict the performance. A sample of 138 young swimmers (65 males and 73 females of national level was submitted to a test battery comprising four different domains: kinanthropometric evaluation, dry land functional evaluation (strength and flexibility, swimming functional evaluation (hydrodynamics, hydrostatic and bioenergetics characteristics and swimming technique evaluation. To establish a profile of the young swimmer non-linear combinations between preponderant variables for each gender and swim performance in the 200 meters medley and 400 meters font crawl events were developed. For this purpose a feed forward neural network was used (Multilayer Perceptron with three neurons in a single hidden layer. The prognosis precision of the model (error lower than 0.8% between true and estimated performances is supported by recent evidence. Therefore, we consider that the neural network tool can be a good approach in the resolution of complex problems such as performance modeling and the talent identification in swimming and, possibly, in a wide variety of sports
Defining a neural network controller structure for a rubbertuator robot.
Ozkan, M; Inoue, K; Negishi, K; Yamanaka, T
2000-01-01
Rubbertuator (Rubber-Actuator) robot arm is a pneumatic robot, unique with its lightweight, high power, compliant and spark free nature. Compressibility of air in the actuator tubes and the elastic nature of the rubber, however, are the two major sources of increased non-linearity and complexity in motion control. Soft computing, exploiting the tolerance of uncertainty and vagueness in cognitive reasoning has been offering easy to handle, robust, and low-priced solutions to several non-linear industrial applications. Nonetheless, the black-box approach in these systems results in application specific architectures with some important design parameters left for fine tuning (i.e. number of nodes in a neural network). In this study we propose a more systematic method in defining the structure of a soft computing technique, namely the backpropagation neural network, when used as a controller for rubbertuator robot systems. The structure of the neural network is based on the physical model of the robot, while the neural network itself is trained to learn the trajectory independent parameters of the model that are essential for defining the robot dynamics. The proposed system performance was compared with a well-tuned PID controller and shown to be more accurate in trajectory control for rubbertuator robots.
Neural Network Control of a Magnetically Suspended Rotor System
Choi, Benjamin B.
1998-01-01
Magnetic bearings offer significant advantages because they do not come into contact with other parts during operation, which can reduce maintenance. Higher speeds, no friction, no lubrication, weight reduction, precise position control, and active damping make them far superior to conventional contact bearings. However, there are technical barriers that limit the application of this technology in industry. One of them is the need for a nonlinear controller that can overcome the system nonlinearity and uncertainty inherent in magnetic bearings. At the NASA Lewis Research Center, a neural network was selected as a nonlinear controller because it generates a neural model without any detailed information regarding the internal working of the magnetic bearing system. It can be used even for systems that are too complex for an accurate system model to be derived. A feed-forward architecture with a back-propagation learning algorithm was selected because of its proven performance, accuracy, and relatively easy implementation.
Information flow among neural networks with Bayesian estimation
Institute of Scientific and Technical Information of China (English)
LI Yan; LI XiaoLi; OUYANG GaoXiang; GUAN XinPing
2007-01-01
Estimating the interaction among neural networks is an interesting issue in neuroscience. Some methods have been proposed to estimate the coupling strength among neural networks; however, few estimations of the coupling direction (information flow) among neural networks have been attempted. It is known that Bayesian estimator is based on a priori knowledge and a probability of event occurrence. In this paper, a new method is proposed to estimate coupling directions among neural networks with conditional mutual information that is estimated by Bayesian estimation. First, this method is applied to analyze the simulated EEG series generated by a nonlinear lumped-parameter model. In comparison with the conditional mutual information with Shannon entropy, it is found that this method is more successful in estimating the coupling direction, and is insensitive to the length of EEG series. Therefore, this method is suitable to analyze a short time series in practice. Second, we demonstrate how this method can be applied to the analysis of human intracranial epileptic electroencephalogram (EEG) recordings, and to indicate the coupling directions among neural networks. Therefore, this method helps to elucidate the epileptic focus localization.
Neural Networks for Signal Processing and Control
Hesselroth, Ted Daniel
Neural networks are developed for controlling a robot-arm and camera system and for processing images. The networks are based upon computational schemes that may be found in the brain. In the first network, a neural map algorithm is employed to control a five-joint pneumatic robot arm and gripper through feedback from two video cameras. The pneumatically driven robot arm employed shares essential mechanical characteristics with skeletal muscle systems. To control the position of the arm, 200 neurons formed a network representing the three-dimensional workspace embedded in a four-dimensional system of coordinates from the two cameras, and learned a set of pressures corresponding to the end effector positions, as well as a set of Jacobian matrices for interpolating between these positions. Because of the properties of the rubber-tube actuators of the arm, the position as a function of supplied pressure is nonlinear, nonseparable, and exhibits hysteresis. Nevertheless, through the neural network learning algorithm the position could be controlled to an accuracy of about one pixel (~3 mm) after two hundred learning steps. Applications of repeated corrections in each step via the Jacobian matrices leads to a very robust control algorithm since the Jacobians learned by the network have to satisfy the weak requirement that they yield a reduction of the distance between gripper and target. The second network is proposed as a model for the mammalian vision system in which backward connections from the primary visual cortex (V1) to the lateral geniculate nucleus play a key role. The application of hebbian learning to the forward and backward connections causes the formation of receptive fields which are sensitive to edges, bars, and spatial frequencies of preferred orientations. The receptive fields are learned in such a way as to maximize the rate of transfer of information from the LGN to V1. Orientational preferences are organized into a feature map in the primary visual
Subspace learning of neural networks
Cheng Lv, Jian; Zhou, Jiliu
2010-01-01
PrefaceChapter 1. Introduction1.1 Introduction1.1.1 Linear Neural Networks1.1.2 Subspace Learning1.2 Subspace Learning Algorithms1.2.1 PCA Learning Algorithms1.2.2 MCA Learning Algorithms1.2.3 ICA Learning Algorithms1.3 Methods for Convergence Analysis1.3.1 SDT Method1.3.2 DCT Method1.3.3 DDT Method1.4 Block Algorithms1.5 Simulation Data Set and Notation1.6 ConclusionsChapter 2. PCA Learning Algorithms with Constants Learning Rates2.1 Oja's PCA Learning Algorithms2.1.1 The Algorithms2.1.2 Convergence Issue2.2 Invariant Sets2.2.1 Properties of Invariant Sets2.2.2 Conditions for Invariant Sets2.
Abbaspour, Alireza; Aboutalebi, Payam; Yen, Kang K; Sargolzaei, Arman
2017-03-01
A new online detection strategy is developed to detect faults in sensors and actuators of unmanned aerial vehicle (UAV) systems. In this design, the weighting parameters of the Neural Network (NN) are updated by using the Extended Kalman Filter (EKF). Online adaptation of these weighting parameters helps to detect abrupt, intermittent, and incipient faults accurately. We apply the proposed fault detection system to a nonlinear dynamic model of the WVU YF-22 unmanned aircraft for its evaluation. The simulation results show that the new method has better performance in comparison with conventional recurrent neural network-based fault detection strategies.
Neural networks for damage identification
Energy Technology Data Exchange (ETDEWEB)
Paez, T.L.; Klenke, S.E.
1997-11-01
Efforts to optimize the design of mechanical systems for preestablished use environments and to extend the durations of use cycles establish a need for in-service health monitoring. Numerous studies have proposed measures of structural response for the identification of structural damage, but few have suggested systematic techniques to guide the decision as to whether or not damage has occurred based on real data. Such techniques are necessary because in field applications the environments in which systems operate and the measurements that characterize system behavior are random. This paper investigates the use of artificial neural networks (ANNs) to identify damage in mechanical systems. Two probabilistic neural networks (PNNs) are developed and used to judge whether or not damage has occurred in a specific mechanical system, based on experimental measurements. The first PNN is a classical type that casts Bayesian decision analysis into an ANN framework; it uses exemplars measured from the undamaged and damaged system to establish whether system response measurements of unknown origin come from the former class (undamaged) or the latter class (damaged). The second PNN establishes the character of the undamaged system in terms of a kernel density estimator of measures of system response; when presented with system response measures of unknown origin, it makes a probabilistic judgment whether or not the data come from the undamaged population. The physical system used to carry out the experiments is an aerospace system component, and the environment used to excite the system is a stationary random vibration. The results of damage identification experiments are presented along with conclusions rating the effectiveness of the approaches.
An integrated architecture of adaptive neural network control for dynamic systems
Energy Technology Data Exchange (ETDEWEB)
Ke, Liu; Tokar, R.; Mcvey, B.
1994-07-01
In this study, an integrated neural network control architecture for nonlinear dynamic systems is presented. Most of the recent emphasis in the neural network control field has no error feedback as the control input which rises the adaptation problem. The integrated architecture in this paper combines feed forward control and error feedback adaptive control using neural networks. The paper reveals the different internal functionality of these two kinds of neural network controllers for certain input styles, e.g., state feedback and error feedback. Feed forward neural network controllers with state feedback establish fixed control mappings which can not adapt when model uncertainties present. With error feedbacks, neural network controllers learn the slopes or the gains respecting to the error feedbacks, which are error driven adaptive control systems. The results demonstrate that the two kinds of control scheme can be combined to realize their individual advantages. Testing with disturbances added to the plant shows good tracking and adaptation.
Estimating Ads’ Click through Rate with Recurrent Neural Network
Directory of Open Access Journals (Sweden)
Chen Qiao-Hong
2016-01-01
Full Text Available With the development of the Internet, online advertising spreads across every corner of the world, the ads' click through rate (CTR estimation is an important method to improve the online advertising revenue. Compared with the linear model, the nonlinear models can study much more complex relationships between a large number of nonlinear characteristics, so as to improve the accuracy of the estimation of the ads’ CTR. The recurrent neural network (RNN based on Long-Short Term Memory (LSTM is an improved model of the feedback neural network with ring structure. The model overcomes the problem of the gradient of the general RNN. Experiments show that the RNN based on LSTM exceeds the linear models, and it can effectively improve the estimation effect of the ads’ click through rate.
Modelling and control PEMFC using fuzzy neural networks
Institute of Scientific and Technical Information of China (English)
无
2005-01-01
Proton exchange membrane generation technology is highly efficient, clean and considered as the most hopeful "green" power technology. The operating principles of proton exchange membrane fuel cell (PEMFC) system involve thermodynamics, electrochemistry, hydrodynamics and mass transfer theory, which comprise a complex nonlinear system, for which it is difficult to establish a mathematical model and control online. This paper first simply analyzes the characters of the PEMFC; and then uses the approach and self-study ability of artificial neural networks to build the model of the nonlinear system, and uses the adaptive neural-networks fuzzy infer system (ANFIS) to build the temperature model of PEMFC which is used as the reference model of the control system, and adjusts the model parameters to control it online. The model and control are implemented in SIMULINK environment. Simulation results showed that the test data and model agreed well, so it will be very useful for optimal and real-time control of PEMFC system.
Finite-Time Robust Stabilization for Stochastic Neural Networks
Directory of Open Access Journals (Sweden)
Weixiong Jin
2012-01-01
Full Text Available This paper is concerned with the finite-time stabilization for a class of stochastic neural networks (SNNs with noise perturbations. The purpose of the addressed problem is to design a nonlinear stabilizator which can stabilize the states of neural networks in finite time. Compared with the previous references, a continuous stabilizator is designed to realize such stabilization objective. Based on the recent finite-time stability theorem of stochastic nonlinear systems, sufficient conditions are established for ensuring the finite-time stability of the dynamics of SNNs in probability. Then, the gain parameters of the finite-time controller could be obtained by solving a linear matrix inequality and the robust finite-time stabilization could also be guaranteed for SNNs with uncertain parameters. Finally, two numerical examples are given to illustrate the effectiveness of the proposed design method.
Global stability analysis on a class of cellular neural networks
Institute of Scientific and Technical Information of China (English)
ZHANG; Yi
2001-01-01
［1］Chua， L. O., Yang, L., Cellular neural networks: Theory, IEEE Trans. CAS, 1988, (10): 1257.［2］Chua, L. O., Yang, L., Cellular neural networks: Applications, IEEE Trans. CAS, 1988, (10): 1273.［3］Chua, L. O., Roska, T., The CNN paradigm, IEEE Trans. CAS-I, 1993, (3): 147.［4］Matsumoto, T. Chua, L. O., Suzuki, H., CNN cloning template: Connected component detector, IEEE Trans. CAS, 1990, (8): 633.［5］Cao, L, Sun, Y, Yu, J., A CNN-based signature verification system，Proc. ICONIP′95, Beijing, 1995, 913—916.［6］Roska, T., Chua, L. O., The CNN universal machine: An analogic array computer, IEEE Trans. CAS Ⅱ, 1993, (3): 163.［7］Chua, L. O., Roska, T., Stability of a class of nonreciprocal cellular neural networks, IEEE Trans. CAS, 1990, (3): 1520.［8］Roska, T., Wu, C. W., Balsi, M. Et al., Stability and dynamics of delay type general and cellular neural networks, IEEE Trans. CAS, 1992, (6): 487.［9］Roska, T., Wu, C. W., Chua, L. O., Stability of cellular neural networks with dominant nonlinear and delaytype templates, IEEE Trans. CAS, 1993, (4): 270.［10］Civalleri, P. P., On stability of cellular neural networks with delay, IEEE Trans. CAS-I, 1993, (3): 157.［11］Gilli, G., Stability of cellular neural network and delayed cellular neural networks with nonpositive templates and nonmonotonic output functions, IEEE Trans CAS-I， 1994， (8)： 518.［12］Baldi, P., Atiya, A. F., How delays affect neural dynamics and learning, IEEE Trans. On Neural Networks, 1994, (4): 612.［13］Liao, X. X., Mathematic foundation of cellular neural networks (Ⅰ), Science in China, Ser. A, 1994, 37(9): 902.［14］Liao, X. X., Mathematic foundation of cellular neural networks (Ⅱ), Science in China, Ser. A, 1994, 37(9): 1037.［15］Zhang, Y., Global exponential stability and periodic solutions of delay Hopfild neural networks, International J. Sys. Sci., 1996, (2): 227.［16］Zhang Yi, Zhong, S. M., Li, Z. L., Periodic solutions and global
Learning Processes of Layered Neural Networks
Fujiki, Sumiyoshi; FUJIKI, Nahomi, M.
1995-01-01
A positive reinforcement type learning algorithm is formulated for a stochastic feed-forward neural network, and a learning equation similar to that of the Boltzmann machine algorithm is obtained. By applying a mean field approximation to the same stochastic feed-forward neural network, a deterministic analog feed-forward network is obtained and the back-propagation learning rule is re-derived.
Learning Algorithms of Multilayer Neural Networks
Fujiki, Sumiyoshi; FUJIKI, Nahomi, M.
1996-01-01
A positive reinforcement type learning algorithm is formulated for a stochastic feed-forward multilayer neural network, with far interlayer synaptic connections, and we obtain a learning rule similar to that of the Boltzmann machine on the same multilayer structure. By applying a mean field approximation to the stochastic feed-forward neural network, the generalized error back-propagation learning rule is derived for a deterministic analog feed-forward multilayer network with the far interlay...
Institute of Scientific and Technical Information of China (English)
何超; 徐立新; 张宇河
1999-01-01
目的为了消除普遍存在于伺服系统中的间隙非线性的影响,提出一种利用BP神经网络进行非线性补偿的方法.方法以某武器跟踪伺服系统为例,采用一个3层BP神经网络对其间隙非线性特性进行离线辨识,然后根据辨识结果设计一个非线性补偿器.结果仿真结果表明所提出的方法能够有效消除间隙特性引起的系统自振荡(极限环),并且能够提高系统精度.结论利用BP神经网络进行间隙非线性补偿的方法能够有效解决伺服系统中间隙特性带来的影响,且易于在工程中实现.%Aim To eliminate the influences of backlash nonlinear characteristics generally existing in servo systems, a nonlinear compensation method using backpropagation neural networks(BPNN) is presented. Methods Based on some weapon tracking servo system, a three-layer BPNN was used to off-line identify the backlash characteristics, then a nonlinear compensator was designed according to the identification results. Results The simulation results show that the method can effectively get rid of the sustained oscillation(limit cycle) of the system caused by the backlash characteristics, and can improve the system accuracy. Conclusion The method is effective on sloving the problems produced by the backlash characteristics in servo systems, and it can be easily accomplished in engineering.
Numerical solution of differential equations by artificial neural networks
Meade, Andrew J., Jr.
1995-01-01
Conventionally programmed digital computers can process numbers with great speed and precision, but do not easily recognize patterns or imprecise or contradictory data. Instead of being programmed in the conventional sense, artificial neural networks (ANN's) are capable of self-learning through exposure to repeated examples. However, the training of an ANN can be a time consuming and unpredictable process. A general method is being developed by the author to mate the adaptability of the ANN with the speed and precision of the digital computer. This method has been successful in building feedforward networks that can approximate functions and their partial derivatives from examples in a single iteration. The general method also allows the formation of feedforward networks that can approximate the solution to nonlinear ordinary and partial differential equations to desired accuracy without the need of examples. It is believed that continued research will produce artificial neural networks that can be used with confidence in practical scientific computing and engineering applications.
Neural Network Predictive Control for Vanadium Redox Flow Battery
Directory of Open Access Journals (Sweden)
Hai-Feng Shen
2013-01-01
Full Text Available The vanadium redox flow battery (VRB is a nonlinear system with unknown dynamics and disturbances. The flowrate of the electrolyte is an important control mechanism in the operation of a VRB system. Too low or too high flowrate is unfavorable for the safety and performance of VRB. This paper presents a neural network predictive control scheme to enhance the overall performance of the battery. A radial basis function (RBF network is employed to approximate the dynamics of the VRB system. The genetic algorithm (GA is used to obtain the optimum initial values of the RBF network parameters. The gradient descent algorithm is used to optimize the objective function of the predictive controller. Compared with the constant flowrate, the simulation results show that the flowrate optimized by neural network predictive controller can increase the power delivered by the battery during the discharge and decrease the power consumed during the charge.
Research of The Deeper Neural Networks
Directory of Open Access Journals (Sweden)
Xiao You Rong
2016-01-01
Full Text Available Neural networks (NNs have powerful computational abilities and could be used in a variety of applications; however, training these networks is still a difficult problem. With different network structures, many neural models have been constructed. In this report, a deeper neural networks (DNNs architecture is proposed. The training algorithm of deeper neural network insides searching the global optimal point in the actual error surface. Before the training algorithm is designed, the error surface of the deeper neural network is analyzed from simple to complicated, and the features of the error surface is obtained. Based on these characters, the initialization method and training algorithm of DNNs is designed. For the initialization, a block-uniform design method is proposed which separates the error surface into some blocks and finds the optimal block using the uniform design method. For the training algorithm, the improved gradient-descent method is proposed which adds a penalty term into the cost function of the old gradient descent method. This algorithm makes the network have a great approximating ability and keeps the network state stable. All of these improve the practicality of the neural network.
Capacitive MEMS accelerometer wide range modeling using artificial neural network
Directory of Open Access Journals (Sweden)
A. Baharodimehr
2009-08-01
Full Text Available This paper presents a nonlinear model for a capacitive microelectromechanical accelerometer (MEMA. System parameters ofthe accelerometer are developed using the effect of cubic term of the folded‐flexure spring. To solve this equation, we use theFEA method. The neural network (NN uses the Levenberg‐Marquardt (LM method for training the system to have a moreaccurate response. The designed NN can identify and predict the displacement of the movable mass of accelerometer. Thesimulation results are very promising.
CONTROL SCHEMES FOR CMAC NEURAL NETWORK-BASED VISUAL SERVOING
Institute of Scientific and Technical Information of China (English)
Wang Huaming; Xi Wenming; Zhu Jianying
2003-01-01
In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.
Acute appendicitis diagnosis using artificial neural networks.
Park, Sung Yun; Kim, Sung Min
2015-01-01
Artificial neural networks is one of pattern analyzer method which are rapidly applied on a bio-medical field. The aim of this research was to propose an appendicitis diagnosis system using artificial neural networks (ANNs). Data from 801 patients of the university hospital in Dongguk were used to construct artificial neural networks for diagnosing appendicitis and acute appendicitis. A radial basis function neural network structure (RBF), a multilayer neural network structure (MLNN), and a probabilistic neural network structure (PNN) were used for artificial neural network models. The Alvarado clinical scoring system was used for comparison with the ANNs. The accuracy of the RBF, PNN, MLNN, and Alvarado was 99.80%, 99.41%, 97.84%, and 72.19%, respectively. The area under ROC (receiver operating characteristic) curve of RBF, PNN, MLNN, and Alvarado was 0.998, 0.993, 0.985, and 0.633, respectively. The proposed models using ANNs for diagnosing appendicitis showed good performances, and were significantly better than the Alvarado clinical scoring system (p < 0.001). With cooperation among facilities, the accuracy for diagnosing this serious health condition can be improved.
Classical Conditioning with Pulsed Integrated Neural Networks: Circuits and System
DEFF Research Database (Denmark)
Lehmann, Torsten
1998-01-01
In this paper we investigate on-chip learning for pulsed, integrated neural networks. We discuss the implementational problems the technology imposes on learning systems and we find that abiologically inspired approach using simple circuit structures is most likely to bring success. We develop...... a suitable learning algorithm -- a continuous-time version of a temporal differential Hebbian learning algorithm for pulsed neural systems with non-linear synapses -- as well as circuits for the electronic implementation. Measurements from an experimental CMOS chip are presented. Finally, we use our test...
Mobility Prediction in Wireless Ad Hoc Networks using Neural Networks
Kaaniche, Heni
2010-01-01
Mobility prediction allows estimating the stability of paths in a mobile wireless Ad Hoc networks. Identifying stable paths helps to improve routing by reducing the overhead and the number of connection interruptions. In this paper, we introduce a neural network based method for mobility prediction in Ad Hoc networks. This method consists of a multi-layer and recurrent neural network using back propagation through time algorithm for training.
Neural network regulation driven by autonomous neural firings
Cho, Myoung Won
2016-07-01
Biological neurons naturally fire spontaneously due to the existence of a noisy current. Such autonomous firings may provide a driving force for network formation because synaptic connections can be modified due to neural firings. Here, we study the effect of autonomous firings on network formation. For the temporally asymmetric Hebbian learning, bidirectional connections lose their balance easily and become unidirectional ones. Defining the difference between reciprocal connections as new variables, we could express the learning dynamics as if Ising model spins interact with each other in magnetism. We present a theoretical method to estimate the interaction between the new variables in a neural system. We apply the method to some network systems and find some tendencies of autonomous neural network regulation.