Senashova, M. Yu.; Gorban, A. N.; Wunsch II, D. C.
2003-01-01
In this paper we solve the problem: how to determine maximal allowable errors, possible for signals and parameters of each element of a network proceeding from the condition that the vector of output signals of the network should be calculated with given accuracy? "Back-propagation of accuracy" is developed to solve this problem. The calculation of allowable errors for each element of network by back-propagation of accuracy is surprisingly similar to a back-propagation of error, because it is...
Neural network construction via back-propagation
A method is presented that combines back-propagation with multi-layer neural network construction. Back-propagation is used not only to adjust the weights but also the signal functions. Going from one network to an equivalent one that has additional linear units, the non-linearity of these units and thus their effective presence is then introduced via back-propagation (weight-splitting). The back-propagated error causes the network to include new units in order to minimize the error function. We also show how this formalism allows to escape local minima
Digital Backpropagation in the Nonlinear Fourier Domain
Wahls, Sander; Prilepsky, Jaroslaw E; Poor, H Vincent; Turitsyn, Sergei K
2015-01-01
Nonlinear and dispersive transmission impairments in coherent fiber-optic communication systems are often compensated by reverting the nonlinear Schr\\"odinger equation, which describes the evolution of the signal in the link, numerically. This technique is known as digital backpropagation. Typical digital backpropagation algorithms are based on split-step Fourier methods in which the signal has to be discretized in time and space. The need to discretize in both time and space however makes the real-time implementation of digital backpropagation a challenging problem. In this paper, a new fast algorithm for digital backpropagation based on nonlinear Fourier transforms is presented. Aiming at a proof of concept, the main emphasis will be put on fibers with normal dispersion in order to avoid the issue of solitonic components in the signal. However, it is demonstrated that the algorithm also works for anomalous dispersion if the signal power is low enough. Since the spatial evolution of a signal governed by the ...
Circular backpropagation networks for classification.
Ridella, S; Rovetta, S; Zunino, R
1997-01-01
The class of mapping networks is a general family of tools to perform a wide variety of tasks. This paper presents a standardized, uniform representation for this class of networks, and introduces a simple modification of the multilayer perceptron with interesting practical properties, especially well suited to cope with pattern classification tasks. The proposed model unifies the two main representation paradigms found in the class of mapping networks for classification, namely, the surface-based and the prototype-based schemes, while retaining the advantage of being trainable by backpropagation. The enhancement in the representation properties and the generalization performance are assessed through results about the worst-case requirement in terms of hidden units and about the Vapnik-Chervonenkis dimension and cover capacity. The theoretical properties of the network also suggest that the proposed modification to the multilayer perceptron is in many senses optimal. A number of experimental verifications also confirm theoretical results about the model's increased performances, as compared with the multilayer perceptron and the Gaussian radial basis functions network. PMID:18255613
Fuzzy neural network with fast backpropagation learning
Wang, Zhiling; De Sario, Marco; Guerriero, Andrea; Mugnuolo, Raffaele
1995-03-01
Neural filters with multilayer backpropagation network have been proved to be able to define mostly all linear or non-linear filters. Because of the slowness of the networks' convergency, however, the applicable fields have been limited. In this paper, fuzzy logic is introduced to adjust learning rate and momentum parameter depending upon output errors and training times. This makes the convergency of the network greatly improved. Test curves are shown to prove the fast filters' performance.
Memory-Efficient Backpropagation Through Time
Gruslys, Audrūnas; Munos, Remi; Danihelka, Ivo; Lanctot, Marc; Graves, Alex
2016-01-01
We propose a novel approach to reduce memory consumption of the backpropagation through time (BPTT) algorithm when training recurrent neural networks (RNNs). Our approach uses dynamic programming to balance a trade-off between caching of intermediate results and recomputation. The algorithm is capable of tightly fitting within almost any user-set memory budget while finding an optimal execution policy minimizing the computational cost. Computational devices have limited memory capacity and ma...
Tunneling Ionization Time Resolved by Backpropagation
Ni, Hongcheng; Saalmann, Ulf; Rost, Jan-Michael
2016-07-01
We determine the ionization time in tunneling ionization by an elliptically polarized light pulse relative to its maximum. This is achieved by a full quantum propagation of the electron wave function forward in time, followed by a classical backpropagation to identify tunneling parameters, in particular, the fraction of electrons that has tunneled out. We find that the ionization time is close to zero for single active electrons in helium and in hydrogen if the fraction of tunneled electrons is large. We expect our analysis to be essential to quantify ionization times for correlated electron motion.
The annealing robust backpropagation (ARBP) learning algorithm.
Chuang, C C; Su, S F; Hsiao, C C
2000-01-01
Multilayer feedforward neural networks are often referred to as universal approximators. Nevertheless, if the used training data are corrupted by large noise, such as outliers, traditional backpropagation learning schemes may not always come up with acceptable performance. Even though various robust learning algorithms have been proposed in the literature, those approaches still suffer from the initialization problem. In those robust learning algorithms, the so-called M-estimator is employed. For the M-estimation type of learning algorithms, the loss function is used to play the role in discriminating against outliers from the majority by degrading the effects of those outliers in learning. However, the loss function used in those algorithms may not correctly discriminate against those outliers. In this paper, the annealing robust backpropagation learning algorithm (ARBP) that adopts the annealing concept into the robust learning algorithms is proposed to deal with the problem of modeling under the existence of outliers. The proposed algorithm has been employed in various examples. Those results all demonstrated the superiority over other robust learning algorithms independent of outliers. In the paper, not only is the annealing concept adopted into the robust learning algorithms but also the annealing schedule k/t was found experimentally to achieve the best performance among other annealing schedules, where k is a constant and is the epoch number. PMID:18249835
TAO-robust backpropagation learning algorithm.
Pernía-Espinoza, Alpha V; Ordieres-Meré, Joaquín B; Martínez-de-Pisón, Francisco J; González-Marcos, Ana
2005-03-01
In several fields, as industrial modelling, multilayer feedforward neural networks are often used as universal function approximations. These supervised neural networks are commonly trained by a traditional backpropagation learning format, which minimises the mean squared error (mse) of the training data. However, in the presence of corrupted data (outliers) this training scheme may produce wrong models. We combine the benefits of the non-linear regression model tau-estimates [introduced by Tabatabai, M. A. Argyros, I. K. Robust Estimation and testing for general nonlinear regression models. Applied Mathematics and Computation. 58 (1993) 85-101] with the backpropagation algorithm to produce the TAO-robust learning algorithm, in order to deal with the problems of modelling with outliers. The cost function of this approach has a bounded influence function given by the weighted average of two psi functions, one corresponding to a very robust estimate and the other to a highly efficient estimate. The advantages of the proposed algorithm are studied with an example. PMID:15795116
Generalized Backpropagation Algorithms for Diffraction Tomography
Paladhi, Pavel Roy; Tayebi, Amin; Udpa, Lalita
2016-01-01
Filtered backpropagation (FBPP) is a well-known technique used for Diffraction Tomography (DT). For accurate reconstruction of a complex image using FBPP, full $360^{\\circ}$ angular coverage is necessary. However, it has been shown that using some inherent redundancies in projection data in a tomographic setup, accurate reconstruction is still possible with $270^{\\circ}$ coverage which is called the minimal-scan angle range. This can be done by applying weighing functions (or filters) on projection data of the object to eliminate the redundancies and accurately reconstruct the image from this lower angular coverage. This paper demonstrates procedures to generate many general classes of these weighing filters. These are all equivalent at $270^{\\circ}$ coverage but would perform differently at lower angular coverages and under presence of noise. This paper does a comparative analysis of different filters when angular coverage is lower than minimal-scan angle of $270^{\\circ}$. Simulation studies have been done t...
Privacy-preserving backpropagation neural network learning.
Chen, Tingting; Zhong, Sheng
2009-10-01
With the development of distributed computing environment , many learning problems now have to deal with distributed input data. To enhance cooperations in learning, it is important to address the privacy concern of each data holder by extending the privacy preservation notion to original learning algorithms. In this paper, we focus on preserving the privacy in an important learning model, multilayer neural networks. We present a privacy-preserving two-party distributed algorithm of backpropagation which allows a neural network to be trained without requiring either party to reveal her data to the other. We provide complete correctness and security analysis of our algorithms. The effectiveness of our algorithms is verified by experiments on various real world data sets. PMID:19709975
Optoelectronic Systems Trained With Backpropagation Through Time.
Hermans, Michiel; Dambre, Joni; Bienstman, Peter
2015-07-01
Delay-coupled optoelectronic systems form promising candidates to act as powerful information processing devices. In this brief, we consider such a system that has been studied before in the context of reservoir computing (RC). Instead of viewing the system as a random dynamical system, we see it as a true machine-learning model, which can be fully optimized. We use a recently introduced extension of backpropagation through time, an optimization algorithm originally designed for recurrent neural networks, and use it to let the network perform a difficult phoneme recognition task. We show that full optimization of all system parameters of delay-coupled optoelectronics systems yields a significant improvement over the previously applied RC approach. PMID:25137733
Prediction of tides using back-propagation neural networks
Mandal, S.
Prediction of tides is very much essential for human activities and to reduce the construction cost in marine environment. This paper presents an application of the artificial neural network with back-propagation procedures for accurate prediction...
Analog hardware for delta-backpropagation neural networks
Eberhardt, Silvio P. (Inventor)
1992-01-01
This is a fully parallel analog backpropagation learning processor which comprises a plurality of programmable resistive memory elements serving as synapse connections whose values can be weighted during learning with buffer amplifiers, summing circuits, and sample-and-hold circuits arranged in a plurality of neuron layers in accordance with delta-backpropagation algorithms modified so as to control weight changes due to circuit drift.
Pengenalan Pola Pin Barcode Menggunakan Metode Backpropagation dan Metode Perceptron
Hasiholan, Ardi
2015-01-01
Pattern recognition is one of the functions of the neural networks, where objects maybe identified by their patterns. This may assist in recognition of objects which patterns are damaged. Pattern recognition in neural networkcan make by using backpropagation and perceptron methods. In Backpropagation method, the network is trained with the pattern through three phases, namely forward propagation, backward propagation, and weights adjustment phases, repeated until the termination condition is ...
Error-backpropagation in temporally encoded networks of spiking neurons
Bohte, S.M.; La Poutré, J.A.; Kok, J.N.
2000-01-01
For a network of spiking neurons that encodes information in the timing of individual spike-times, we derive a supervised learning rule, emph{SpikeProp, akin to traditional error-backpropagation and show how to overcome the discontinuities introduced by thresholding. With this algorithm, we demonstr
Impairment mitigation in superchannels with digital backpropagation and MLSD
Porto da Silva, Edson; Larsen, Knud J.; Zibar, Darko
2015-01-01
We assess numerically the performance of single-carrier digital backpropagation (SC-DBP) and maximum-likelihood sequence detection (MLSD) for DP-QPSK and DP-16QAM superchannel transmission over dispersion uncompensated links for three different cases of spectral shaping: optical pre-filtering of ...
Backpropagation and ordered derivatives in the time scales calculus.
Seiffertt, John; Wunsch, Donald C
2010-08-01
Backpropagation is the most widely used neural network learning technique. It is based on the mathematical notion of an ordered derivative. In this paper, we present a formulation of ordered derivatives and the backpropagation training algorithm using the important emerging area of mathematics known as the time scales calculus. This calculus, with its potential for application to a wide variety of inter-disciplinary problems, is becoming a key area of mathematics. It is capable of unifying continuous and discrete analysis within one coherent theoretical framework. Using this calculus, we present here a generalization of backpropagation which is appropriate for cases beyond the specifically continuous or discrete. We develop a new multivariate chain rule of this calculus, define ordered derivatives on time scales, prove a key theorem about them, and derive the backpropagation weight update equations for a feedforward multilayer neural network architecture. By drawing together the time scales calculus and the area of neural network learning, we present the first connection of two major fields of research. PMID:20615808
Error-backpropagation in temporally encoded networks of spiking neurons
Bohte, Sander; La Poutré, Han; Kok, Joost
2000-01-01
For a network of spiking neurons that encodes information in the timing of individual spike-times, we derive a supervised learning rule, emph{SpikeProp, akin to traditional error-backpropagation and show how to overcome the discontinuities introduced by thresholding. With this algorithm, we demonstrate how networks of spiking neurons with biologically reasonable action potentials can perform complex non-linear classification in fast temporal coding just as well as rate-coded networks. We perf...
Conjugate descent formulation of backpropagation error in feedforward neural networks
Sharma NK; Kumar, S; Singh MP
2009-01-01
The feedforward neural network architecture uses backpropagation learning to determine optimal weights between different interconnected layers. This learning procedure uses a gradient descent technique applied to a sum-of-squares error function for the given input-output pattern. It employs an iterative procedure to minimise the error function for a given set of patterns, by adjusting the weights of the network. The first derivates of the error with respect to the weights identify the local e...
Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networks
Hernández-Lobato, José Miguel; Adams, Ryan P.
2015-01-01
Large multilayer neural networks trained with backpropagation have recently achieved state-of-the-art results in a wide range of problems. However, using backprop for neural net learning still has some disadvantages, e.g., having to tune a large number of hyperparameters to the data, lack of calibrated probabilistic predictions, and a tendency to overfit the training data. In principle, the Bayesian approach to learning neural networks does not have these problems. However, existing Bayesian ...
Newton's Method Backpropagation for Complex-Valued Holomorphic Multilayer Perceptrons
La Corte, Diana Thomson; Zou, Yi ming
2014-01-01
The study of Newton's method in complex-valued neural networks faces many difficulties. In this paper, we derive Newton's method backpropagation algorithms for complex-valued holomorphic multilayer perceptrons, and investigate the convergence of the one-step Newton steplength algorithm for the minimization of real-valued complex functions via Newton's method. To provide experimental support for the use of holomorphic activation functions, we perform a comparison of using sigmoidal functions v...
BACKPROPAGATION TRAINING ALGORITHM WITH ADAPTIVE PARAMETERS TO SOLVE DIGITAL PROBLEMS
R. Saraswathi
2011-01-01
Full Text Available An efficient technique namely Backpropagation training with adaptive parameters using Lyapunov Stability Theory for training single hidden layer feed forward network is proposed. A three-layered Feedforward neural network architecture is used to solve the selected problems. Sequential Training Mode is used to train the network. Lyapunov stability theory is employed to ensure the faster and steady state error convergence and to construct and energy surface with a single global minimum point through the adaptive adjustment of the weights and the adaptive parameter ß. To avoid local minima entrapment, an adaptive backpropagation algorithm based on Lyapunov stability theory is used. Lyapunov stability theory gives the algorithm, the efficiency of attaining a single global minimum point. The learning parameters used in this algorithm is responsible for the faster error convergence. The adaptive learning parameter used in this algorithm is chosen properly for faster error convergence. The error obtained has been asymptotically converged to zero according to Lyapunov Stability theory. The performance of the adaptive Backpropagation algorithm is measured by solving parity problem, half adder and full adder problems.
The Interchangeability of Learning Rate and Gain in Backpropagation Neural Networks
Thimm, Georg; Moerland, Perry,; Fiesler, Emile
1996-01-01
The backpropagation algorithm is widely used for training multilayer neural networks. In this publication the gain of its activation function(s) is investigated. In specific, it is proven that changing the gain of the activation function is equivalent to changing the learning rate and the weights. This simplifies the backpropagation learning rule by eliminating one of its parameters. The theorem can be extended to hold for some well-known variations on the backpropagation algorithm, such as u...
Learning Sensor Multiplexing Design through Back-propagation
Chakrabarti, Ayan
2016-01-01
Recent progress on many imaging and vision tasks has been driven by the use of deep feed-forward neural networks, which are trained by propagating gradients of a loss defined on the final output, back through the network up to the first layer that operates directly on the image. We propose back-propagating one step further---to learn camera sensor designs jointly with networks that carry out inference on the images they capture. In this paper, we specifically consider the design and inference...
Single-step digital backpropagation for nonlinearity mitigation
Secondini, Marco; Rommel, Simon; Meloni, Gianluca;
2015-01-01
Nonlinearity mitigation based on the enhanced split-step Fourier method (ESSFM) for the implementation of low-complexity digital backpropagation (DBP) is investigated and experimentally demonstrated. After reviewing the main computational aspects of DBP and of the conventional split-step Fourier...... method (SSFM), the ESSFM for dual-polarization signals is introduced. Computational complexity, latency, and power consumption of DBP based on the SSFM and ESSFM algorithms are estimated and compared. Effective low-complexity nonlinearity mitigation in a 112 Gb/s polarization-multiplexed QPSK system is...
Impact of Mutation Weights on Training Backpropagation Neural Networks
Lamia Abed Noor Muhammed
2014-07-01
Full Text Available Neural network is a computational approach, which based on the simulation of biology neural network. This approach is conducted by several parameters; learning rate, initialized weights, network architecture, and so on. However, this paper would be focused on one of these parameters that is weights. The aim is to shed lights on the mutation weights through training network and its effects on the results. The experiment was done using backpropagation neural network with one hidden layer. The results reveal the role of mutation in escape from the local minima and making the change
LVQ and backpropagation neural networks applied to NASA SSME data
Doniere, Timothy F.; Dhawan, Atam P.
1993-01-01
Feedfoward neural networks with backpropagation learning have been used as function approximators for modeling the space shuttle main engine (SSME) sensor signals. The modeling of these sensor signals is aimed at the development of a sensor fault detection system that can be used during ground test firings. The generalization capability of a neural network based function approximator depends on the training vectors which in this application may be derived from a number of SSME ground test-firings. This yields a large number of training vectors. Large training sets can cause the time required to train the network to be very large. Also, the network may not be able to generalize for large training sets. To reduce the size of the training sets, the SSME test-firing data is reduced using the learning vector quantization (LVQ) based technique. Different compression ratios were used to obtain compressed data in training the neural network model. The performance of the neural model trained using reduced sets of training patterns is presented and compared with the performance of the model trained using complete data. The LVQ can also be used as a function approximator. The performance of the LVQ as a function approximator using reduced training sets is presented and compared with the performance of the backpropagation network.
Premature saturation in backpropagation networks: Mechanism and necessary conditions
The mechanism that gives rise to the phenomenon of premature saturation of the output units of feedforward multilayer neural networks during training with the standard backpropagation algorithm is described. The entire process of premature saturation is characterized by three distinct stages and it is concluded that the momentum term plays the leading role in the occurrence of the phenomenon. The necessary conditions for the occurrence of premature saturation are presented and a new method is proposed, based on these conditions, that eliminates the occurrence of the phenomenon. Validity of the conditions and the proposed method are illustrated through simulation results. Three case studies are presented. The first two came from a training session for classification of three component failures in a nuclear power plant. The last case, comes from a training session for classification of welded fuel elements
Sheela Tiwari
2013-08-01
Full Text Available This paperexplores theapplicationof artificial neural networksfor online identification of a multimachinepower system.Arecurrent neural networkhas been proposedas the identifier of the two area, four machinesystemwhich is a benchmark system for studying electromechanical oscillations in multimachine powersystems. This neural identifier is trained using the static Backpropagation algorithm. The emphasis of thepaper is on investigating the performance of the variants of the Backpropagation algorithm in training theneural identifier. The paper also compares the performances of the neural identifiers trained usingvariantsof the Backpropagation algorithmover a wide range of operating conditions.The simulation resultsestablish a satisfactory performance of the trained neural identifiers in identification of the test powersystem
Reinforcement and backpropagation training for an optical neural network using self-lensing effects.
Cruz-Cabrera, A A; Yang, M; Cui, G; Behrman, E C; Steck, J E; Skinner, S R
2000-01-01
The optical bench training of an optical feedforward neural network, developed by the authors, is presented. The network uses an optical nonlinear material for neuron processing and a trainable applied optical pattern as the network weights. The nonlinear material, with the applied weight pattern, modulates the phase front of a forward propagating information beam by dynamically altering the index of refraction profile of the material. To verify that the network can be trained in real time, six logic gates were trained using a reinforcement training paradigm. More importantly, to demonstrate optical backpropagation, three gates were trained via optical error backpropagation. The output error is optically backpropagated, detected with a CCD camera, and the weight pattern is updated and stored on a computer. The obtained results lay the ground work for the implementation of multilayer neural networks that are trained using optical error backpropagation and are able to solve more complex problems. PMID:18249868
Equivalence of backpropagation and contrastive Hebbian learning in a layered network.
Xie, Xiaohui; Seung, H Sebastian
2003-02-01
Backpropagation and contrastive Hebbian learning are two methods of training networks with hidden neurons. Backpropagation computes an error signal for the output neurons and spreads it over the hidden neurons. Contrastive Hebbian learning involves clamping the output neurons at desired values and letting the effect spread through feedback connections over the entire network. To investigate the relationship between these two forms of learning, we consider a special case in which they are identical: a multilayer perceptron with linear output units, to which weak feedback connections have been added. In this case, the change in network state caused by clamping the output neurons turns out to be the same as the error signal spread by backpropagation, except for a scalar prefactor. This suggests that the functionality of backpropagation can be realized alternatively by a Hebbian-type learning algorithm, which is suitable for implementation in biological networks. PMID:12590814
Efficient Implementation of the Backpropagation Algorithm in FPGAs and Microcontrollers.
Ortega-Zamorano, Francisco; Jerez, Jose M; Urda Munoz, Daniel; Luque-Baena, Rafael M; Franco, Leonardo
2016-09-01
The well-known backpropagation learning algorithm is implemented in a field-programmable gate array (FPGA) board and a microcontroller, focusing in obtaining efficient implementations in terms of a resource usage and computational speed. The algorithm was implemented in both cases using a training/validation/testing scheme in order to avoid overfitting problems. For the case of the FPGA implementation, a new neuron representation that reduces drastically the resource usage was introduced by combining the input and first hidden layer units in a single module. Further, a time-division multiplexing scheme was implemented for carrying out product computations taking advantage of the built-in digital signal processor cores. In both implementations, the floating-point data type representation normally used in a personal computer (PC) has been changed to a more efficient one based on a fixed-point scheme, reducing system memory variable usage and leading to an increase in computation speed. The results show that the modifications proposed produced a clear increase in computation speed in comparison with the standard PC-based implementation, demonstrating the usefulness of the intrinsic parallelism of FPGAs in neurocomputational tasks and the suitability of both implementations of the algorithm for its application to the real world problems. PMID:26277004
Spackman, K. A.
1991-01-01
This paper presents maximum likelihood back-propagation (ML-BP), an approach to training neural networks. The widely reported original approach uses least squares back-propagation (LS-BP), minimizing the sum of squared errors (SSE). Unfortunately, least squares estimation does not give a maximum likelihood (ML) estimate of the weights in the network. Logistic regression, on the other hand, gives ML estimates for single layer linear models only. This report describes how to obtain ML estimates...
J. B. Habarulema
2012-05-01
Full Text Available In this work, results obtained by investigating the application of different neural network backpropagation training algorithms are presented. This was done to assess the performance accuracy of each training algorithm in total electron content (TEC estimations using identical datasets in models development and verification processes. Investigated training algorithms are standard backpropagation (SBP, backpropagation with weight delay (BPWD, backpropagation with momentum (BPM term, backpropagation with chunkwise weight update (BPC and backpropagation for batch (BPB training. These five algorithms are inbuilt functions within the Stuttgart Neural Network Simulator (SNNS and the main objective was to find out the training algorithm that generates the minimum error between the TEC derived from Global Positioning System (GPS observations and the modelled TEC data. Another investigated algorithm is the MatLab based Levenberg-Marquardt backpropagation (L-MBP, which achieves convergence after the least number of iterations during training. In this paper, neural network (NN models were developed using hourly TEC data (for 8 years: 2000–2007 derived from GPS observations over a receiver station located at Sutherland (SUTH (32.38° S, 20.81° E, South Africa. Verification of the NN models for all algorithms considered was performed on both "seen" and "unseen" data. Hourly TEC values over SUTH for 2003 formed the "seen" dataset. The "unseen" dataset consisted of hourly TEC data for 2002 and 2008 over Cape Town (CPTN (33.95° S, 18.47° E and SUTH, respectively. The models' verification showed that all algorithms investigated provide comparable results statistically, but differ significantly in terms of time required to achieve convergence during input-output data training/learning. This paper therefore provides a guide to neural network users for choosing appropriate algorithms based on the availability of computation capabilities used for research.
Training a Feed-Forward Neural Network with Artificial Bee Colony based Backpropagation Method
Sudarshan Nandy
2012-09-01
Full Text Available Back-propagation algorithm is one of the most widely used and popular techniques to optimize the feedforward neural network training. Nature inspired meta-heuristic algorithms also provide derivative-freesolution to optimize complex problem. Artificial bee colony algorithm is a nature inspired meta-heuristicalgorithm, mimicking the foraging or food source searching behaviour of bees in a bee colony and thisalgorithm is implemented in several applications for an improved optimized outcome. The proposedmethod in this paper includes an improved artificial bee colony algorithm based back-propagation neuralnetwork training method for fast and improved convergence rate of the hybrid neural network learningmethod. The result is analysed with the genetic algorithm based back-propagation method, and it isanother hybridized procedure of its kind. Analysis is performed over standard data sets, reflecting the lightof efficiency of proposed method in terms of convergence speed and rate.
Asif Ullah Khan
2011-03-01
Full Text Available Investment in stock market is one of the most popular type of investment. There are many conventional techniques being used and these include technical and fundamental analysis. The main aim of every investor is to earn maximum possible return on investments. The main issue with any approach is the proper weighting of criteria to obtain a list of stocks that are suitable for investments. This paper proposes an improved method for stock picking using self-organizing maps and genetic algorithm based backpropagation neural networks. The stock selected using self-organizing maps and genetic algorithm based backpropagation neural networks outperformed the BSE-30 Index by about 30.17% based on one and half month of stock data.
A simplification of the backpropagation-through-time algorithm for optimal neurocontrol.
Bersini, H; Gorrini, V
1997-01-01
Backpropagation-through-time (BPTT) is the temporal extension of backpropagation which allows a multilayer neural network to approximate an optimal state-feedback control law provided some prior knowledge (Jacobian matrices) of the process is available. In this paper, a simplified version of the BPTT algorithm is proposed which more closely respects the principle of optimality of dynamic programming. Besides being simpler, the new algorithm is less time-consuming and allows in some cases the discovery of better control laws. A formal justification of this simplification is attempted by mixing the Lagrangian calculus underlying BPTT with Bellman-Hamilton-Jacobi equations. The improvements due to this simplification are illustrated by two optimal control problems: the rendezvous and the bioreactor. PMID:18255645
Spackman, K A
1991-01-01
This paper presents maximum likelihood back-propagation (ML-BP), an approach to training neural networks. The widely reported original approach uses least squares back-propagation (LS-BP), minimizing the sum of squared errors (SSE). Unfortunately, least squares estimation does not give a maximum likelihood (ML) estimate of the weights in the network. Logistic regression, on the other hand, gives ML estimates for single layer linear models only. This report describes how to obtain ML estimates of the weights in a multi-layer model, and compares LS-BP to ML-BP using several examples. It shows that in many neural networks, least squares estimation gives inferior results and should be abandoned in favor of maximum likelihood estimation. Questions remain about the potential uses of multi-level connectionist models in such areas as diagnostic systems and risk-stratification in outcomes research. PMID:1807606
Attariuas Hicham; Bouhorma Mohammed; Sofi Anas
2012-01-01
ales forecasting is one of the most crucial issues addressed in business. Control and evaluation of future sales still seem concerned both researchers and policy makers and managers of companies. this research propose an intelligent hybrid sales forecasting system Delphi-FCBPN sales forecast based on Delphi Method, fuzzy clustering and Back-propagation (BP) Neural Networks with adaptive learning rate. The proposed model is constructed to integrate expert judgments, using Delphi method, in enh...
Cheng, Zhiyong; Soudry, Daniel; Mao, Zexi; Lan, Zhenzhong
2015-01-01
Compared to Multilayer Neural Networks with real weights, Binary Multilayer Neural Networks (BMNNs) can be implemented more efficiently on dedicated hardware. BMNNs have been demonstrated to be effective on binary classification tasks with Expectation BackPropagation (EBP) algorithm on high dimensional text datasets. In this paper, we investigate the capability of BMNNs using the EBP algorithm on multiclass image classification tasks. The performances of binary neural networks with multiple h...
A low communication overhead parallel implementation of the back-propagation algorithm
Alfonso, Marcelo; Kavka, Carlos; Printista, Alicia Marcela
2000-01-01
The back-propagation algorithm is one of the most widely used training algorithms for neural networks. The training phase of a multilayer perceptron by using this algorithm can take very long time making neural networks difficult to accept. One approach to solve this problem consists in the parallelization of the training algorithm. There exists many different approaches, however most of them are well adapted to specialized hardware. The idea to use a network of workstations as a genera...
Diagnosing coronary artery disease with a backpropagation neural network: Lessons learned
Turner, D.D. [Pacific Northwest Lab., Richland, WA (United States); Holmes, E.R. [Sacred Heart Medical Center, Spokane, WA (United States)
1995-12-31
The SPECT (single photon emitted computed tomography) procedure, while widely used for diagnosing coronary artery disease, is not a perfect technology. We have investigated using a backpropagation neural network to diagnose patients suffering from coronary artery disease that is independent from the SPECT procedure. The raw thallium-201 scintigrams produced before the SPECT tomographic reconstruction were used as input patterns for the backpropagation neural network, and the diagnoses resulting mainly from cardiac catheterization as the desired outputs for each pattern. Several preprocessing techniques were applied to the scintigrams, in an attempt to improve the information to noise ratio. After using the a procedure that extracted a subimage containing the heart from each scintigram, we used a data reduction technique, thereby encoding the scintigram in 12 values, which were the inputs to the backpropagation neural network. The network was then trained. This network per-formed superbly for patients suffering from inferolateral disease (classifying 10 out of 10 correctly), but performance was less than optimal for cases involving other coronary zones. While the scope of this project was limited to diagnosing coronary artery disease, this initial work can be extended to other medical imaging procedures, such as diagnosing breast cancer from a mammogram and evaluating lung perfusion studies.
Application of back-propagation neural networks to identification of seismic arrival types
Dai, Heng; MacBeth, Colin
1997-01-01
A back-propagation neural network (BPNN) approach is developed to identify P- and S-arrivals from three-component recordings of local earthquake data. The BPNN is trained by selecting trace segments of P- and S-waves and noise bursts converted into an attribute space based on the degree of polarization (DOP). After training, the network can automatically identify the type of arrival on earthquake recordings. Compared with manual analysis, a BPNN trained with nine groups of DOP segments can co...
Scanner color management model based on improved back-propagation neural network
Xinwu Li
2008-01-01
Scanner color management is one of the key techniques for color reproduction in information optics.A new scanner color management model is presented based on analyzing rendering principle of scanning objects.In this model,a standard color target is taken as experimental sample.Color blocks in color shade area are used to substitute complete color space to solve the difficulties in selecting experimental color blocks.Immune genetic algorithm is used to correct back-propagation neural network(BPNN)to speed up the convergence of the model.Experimental results show that the model can improve the accuracy of scanner color management.
Kerr, J.P.
1992-12-31
The objective of this study was to determine the feasibility of using an Artificial Neural Network (ANN), in particular a backpropagation ANN, to improve the speed and quality of the reconstruction of three-dimensional SPECT (single photon emission computed tomography) images. In addition, since the processing elements (PE)s in each layer of an ANN are independent of each other, the speed and efficiency of the neural network architecture could be better optimized by implementing the ANN on a massively parallel computer. The specific goals of this research were: to implement a fully interconnected backpropagation neural network on a serial computer and a SIMD parallel computer, to identify any reduction in the time required to train these networks on the parallel machine versus the serial machine, to determine if these neural networks can learn to recognize SPECT data by training them on a section of an actual SPECT image, and to determine from the knowledge obtained in this research if full SPECT image reconstruction by an ANN implemented on a parallel computer is feasible both in time required to train the network, and in quality of the images reconstructed.
A modified backpropagation algorithm for training neural networks on data with error bars
A method is proposed for training multilayer feedforward neural networks on data contaminated with noise. Specifically, we consider the case that the artificial neural system is required to learn a physical mapping when the available values of the target variable are subject to experimental uncertainties, but are characterized by error bars. The proposed method, based on maximum likelihood criterion for parameter estimation, involves simple modifications of the on-line backpropagation learning algorithm. These include incorporation of the error-bar assignments in a pattern-specific learning rate, together with epochal updating of a new measure of model accuracy that replaces the usual mean-square error. The extended backpropagation algorithm is successfully tested on two problems relevant to the modelling of atomic-mass systematics by neural networks. Provided the underlying mapping is reasonably smooth, neural nets trained with the new procedure are able to learn the true function to a good approximation even in the presence of high levels of Gaussian noise. (author). 26 refs, 2 figs, 5 tabs
Olawoyin, Richard
2016-10-01
The backpropagation (BP) artificial neural network (ANN) is a renowned and extensively functional mathematical tool used for time-series predictions and approximations; which also define results for non-linear functions. ANNs are vital tools in the predictions of toxicant levels, such as polycyclic aromatic hydrocarbons (PAH) potentially derived from anthropogenic activities in the microenvironment. In the present work, BP ANN was used as a prediction tool to study the potential toxicity of PAH carcinogens (PAHcarc) in soils. Soil samples (16 × 4 = 64) were collected from locations in South-southern Nigeria. The concentration of PAHcarc in laboratory cultivated white melilot, Melilotus alba roots grown on treated soils was predicted using ANN model training. Results indicated the Levenberg-Marquardt back-propagation training algorithm converged in 2.5E+04 epochs at an average RMSE value of 1.06E-06. The averagedR(2) comparison between the measured and predicted outputs was 0.9994. It may be deduced from this study that, analytical processes involving environmental risk assessment as used in this study can successfully provide prompt prediction and source identification of major soil toxicants. PMID:27424056
Ikhthison Mekongga
2014-02-01
Full Text Available The need for bandwidth has been increasing recently. This is because the development of internet infrastructure is also increasing so that we need an economic and efficient provider system. This can be achieved through good planning and a proper system. The prediction of the bandwidth consumption is one of the factors that support the planning for an efficient internet service provider system. Bandwidth consumption is predicted using ANN. ANN is an information processing system which has similar characteristics as the biologic al neural network. ANN is chosen to predict the consumption of the bandwidth because ANN has good approachability to non-linearity. The variable used in ANN is the historical load data. A bandwidth consumption information system was built using neural networks with a backpropagation algorithm to make the use of bandwidth more efficient in the future both in the rental rate of the bandwidth and in the usage of the bandwidth.Keywords: Forecasting, Bandwidth, Backpropagation
Omaima N. A.
2010-01-01
Full Text Available Problem statement: The problem inherent to any digital image is the large amount of bandwidth required for transmission or storage. This has driven the research area of image compression to develop algorithms that compress images to lower data rates with better quality. Artificial neural networks are becoming attractive in image processing where high computational performance and parallel architectures are required. Approach: In this research, a three layered Backpropagation Neural Network (BPNN was designed for building image compression/decompression system. The Backpropagation neural network algorithm (BP was used for training the designed BPNN. Many techniques were used to speed up and improve this algorithm by using different BPNN architecture and different values of learning rate and momentum variables. Results: Experiments had been achieved, the results obtained, such as Compression Ratio (CR and peak signal to noise ratio (PSNR are compared with the performance of BP with different BPNN architecture and different learning parameters. The efficiency of the designed BPNN comes from reducing the chance of error occurring during the compressed image transmission through analog or digital channel. Conclusion: The performance of the designed BPNN image compression system can be increased by modifying the network itself, learning parameters and weights. Practically, we can note that the BPNN has the ability to compress untrained images but not in the same performance of the trained images.
On nonlinearly-induced noise in single-channel optical links with digital backpropagation.
Beygi, Lotfollah; Irukulapati, Naga V; Agrell, Erik; Johannisson, Pontus; Karlsson, Magnus; Wymeersch, Henk; Serena, Paolo; Bononi, Alberto
2013-11-01
In this paper, we investigate the performance limits of electronic chromatic dispersion compensation (EDC) and digital backpropagation (DBP) for a single-channel non-dispersion-managed fiber-optical link. A known analytical method to derive the performance of the system with EDC is extended to derive a first-order approximation for the performance of the system with DBP. In contrast to the cubic growth of the variance of the nonlinear noise-like interference, often called nonlinear noise, with input power for EDC, a quadratic growth is observed with DBP using this approximation. Finally, we provide numerical results to verify the accuracy of the proposed approach and compare it with existing analytical models. PMID:24216860
Kerr, J.P.; Bartlett, E.B. [Iowa State Univ., Ames, IA (United States). Biomedical Engineering Program
1992-12-31
In this paper, the feasibility of reconstructing a single photon emission computed tomography (SPECT) image via the parallel implementation of a backpropagation neural network is shown. The MasPar, MP-1 is a single instruction multiple data (SIMD) massively parallel machine. It is composed of a 128 x 128 array of 4-bit processors. The neural network is distributed on the array by dedicating a processor to each node and each interconnection of the network. An 8 x 8 SPECT image slice section is projected into eight planes. It is shown that based on the projections, the neural network can produce the original SPECT slice image exactly. Likewise, when trained on two parallel slices, separated by one slice, the neural network is able to reproduce the center, untrained image to an RMS error of 0.001928.
Back-Propagation Artificial Neural Networks for Water Supply Pipeline Model
朱东海; 张土乔; 毛根海
2002-01-01
Water supply pipelines are the lifelines of a city. When pipelines burst, the burst site is difficult to locate by traditional methods such as manual tools or only by watching. In this paper, the burst site was identified using back-propagation (BP) artificial neural networks (ANN). The study is based on an indoor urban water supply model experiment. The key to appling BP ANN is to optimize the ANN's topological structure and learning parameters. This paper presents the optimizing method for a 3-layer BP neural network's topological structure and its learning parameters-learning ratio and the momentum factor. The indoor water supply pipeline model experimental results show that BP ANNs can be used to locate the burst point in urban water supply systems. The topological structure and learning parameters were optimized using the experimental results.
A new backpropagation learning algorithm for layered neural networks with nondifferentiable units.
Oohori, Takahumi; Naganuma, Hidenori; Watanabe, Kazuhisa
2007-05-01
We propose a digital version of the backpropagation algorithm (DBP) for three-layered neural networks with nondifferentiable binary units. This approach feeds teacher signals to both the middle and output layers, whereas with a simple perceptron, they are given only to the output layer. The additional teacher signals enable the DBP to update the coupling weights not only between the middle and output layers but also between the input and middle layers. A neural network based on DBP learning is fast and easy to implement in hardware. Simulation results for several linearly nonseparable problems such as XOR demonstrate that the DBP performs favorably when compared to the conventional approaches. Furthermore, in large-scale networks, simulation results indicate that the DBP provides high performance. PMID:17381272
Backpropagation architecture optimization and an application in nuclear power plant diagnostics
This paper presents a Dynamic Node Architecture (DNA) scheme to optimize the architecture of backpropagation Artificial Neural Networks (ANNs). This network scheme is used to develop an ANN based diagnostic adviser capable of identifying the operating status of a nuclear power plant. Specifically, a ''root'' network is trained to diagnose if the plant is in a normal operating condition or not. In the event of an abnormal condition, and other ''classifier'' network is trained to recognize the particular transient taking place. these networks are trained using plant instrumentation data gathered during simulations of the various transients and normal operating conditions at the Iowa Electric Light and Power Company's Duane Arnold Energy Center (DAEC) operator training simulator
Didi Supriyadi; Kusworo Adi; Eko Adi Sarwoko
2014-01-01
Dengue disease is a major health problem and endemic in several countries including Indonesia. Indonesia is included in the category "A" in the stratification of DHF by WHO in 2001 which indicates the high rate of treatment in hospital and deaths from dengue. The purpose of this study was to investigate the ability of artificial neural networks Backpropagation method for information of the spread of dengue fever in a region. In this study uses six input variables which...
Knoll, P; Mirzaei, S; Müllner, A; Leitha, T; Koriska, K; Köhn, H; Neumann, M
1999-02-01
At present, algorithms used in nuclear medicine to reconstruct single photon emission computerized tomography (SPECT) data are usually based on one of two principles: filtered backprojection and iterative methods. In this paper a different algorithm, applying an artificial neural network (multilayer perception) and error backpropagation as training method are used to reconstruct transaxial slices from SPECT data. The algorithm was implemented on an Elscint XPERT workstation (i486, 50 MHz), used as a routine digital image processing tool in our departments. Reconstruction time for a 64 x 64 matrix is approximately 45 s/transaxial slice. The algorithm has been validated by a mathematical model and tested on heart and Jaszczak phantoms. Phantom studies and very first clinical results ((111)In octreotide SPECT, 99mTc MDP bone SPECT) show in comparison with filtered backprojection an enhancement in image quality. PMID:10076982
The backpropagation algorithm in J, a fast prototyping tool for researching neural networks.
Brouwer, R K
1999-08-01
This paper illustrates the use of a powerful language, called J, that is ideal for simulating neural networks. The use of J is demonstrated by its application to a gradient descent method for training a multilayer perceptron. It is also shown how the back-propagation algorithm can be easily generalized to multilayer networks without any increase in complexity and that the algorithm can be completely expressed in an array notation which is directly executable through J. J is a general purpose language, which means that its user is given a flexibility not available in neural network simulators or in software packages such as MATLAB. Yet, because of its numerous operators, J allows a very succinct code to be used, leading to a tremendous decrease in development time. PMID:10586987
An equalized error backpropagation algorithm for the on-line training of multilayer perceptrons.
Martens, J P; Weymaere, N
2002-01-01
The error backpropagation (EBP) training of a multilayer perceptron (MLP) may require a very large number of training epochs. Although the training time can usually be reduced considerably by adopting an on-line training paradigm, it can still be excessive when large networks have to be trained on lots of data. In this paper, a new on-line training algorithm is presented. It is called equalized EBP (EEBP), and it offers improved accuracy, speed, and robustness against badly scaled inputs. A major characteristic of EEBP is its utilization of weight specific learning rates whose relative magnitudes are derived from a priori computable properties of the network and the training data. PMID:18244454
Analysis of the initial values in split-complex backpropagation algorithm.
Yang, Sheng-Sung; Siu, Sammy; Ho, Chia-Lu
2008-09-01
When a multilayer perceptron (MLP) is trained with the split-complex backpropagation (SCBP) algorithm, one observes a relatively strong dependence of the performance on the initial values. For the effective adjustments of the weights and biases in SCBP, we propose that the range of the initial values should be greater than that of the adjustment quantities. This criterion can reduce the misadjustment of the weights and biases. Based on the this criterion, the suitable range of the initial values can be estimated. The results show that the suitable range of the initial values depends on the property of the used communication channel and the structure of the MLP (the number of layers and the number of nodes in each layer). The results are studied using the equalizer scenarios. The simulation results show that the estimated range of the initial values gives significantly improved performance. PMID:18779088
Nonlinear inverse modeling of sensor based on back-propagation fuzzy logical system
Li Jun; Liu Junhua
2007-01-01
Objective To correct the nonlinear error of sensor output, a new approach to sensor inverse modeling based on Back-Propagation Fuzzy Logical System (BP FS) is presented. Methods The BP FS is a computationally efficient nonlinear universal approximator, which is capable of implementing complex nonlinear mapping from its input pattern space to the output with fast convergence speed. Results The neuro-fuzzy hybrid system, i.e. BP FS, is then applied to construct nonlinear inverse model of pressure sensor. The experimental results show that the proposed inverse modeling method automatically compensates the associated nonlinear error in pressure estimation, and thus the performance of pressure sensor is significantly improved. Conclusion The proposed method can be widely used in nonlinearity correction of various kinds of sensors to compensate the effects of nonlinearity and temperature on sensor output.
Ueda, Michihito; Nishitani, Yu; Kaneko, Yukihiro; Omote, Atsushi
2014-01-01
To realize an analog artificial neural network hardware, the circuit element for synapse function is important because the number of synapse elements is much larger than that of neuron elements. One of the candidates for this synapse element is a ferroelectric memristor. This device functions as a voltage controllable variable resistor, which can be applied to a synapse weight. However, its conductance shows hysteresis characteristics and dispersion to the input voltage. Therefore, the conductance values vary according to the history of the height and the width of the applied pulse voltage. Due to the difficulty of controlling the accurate conductance, it is not easy to apply the back-propagation learning algorithm to the neural network hardware having memristor synapses. To solve this problem, we proposed and simulated a learning operation procedure as follows. Employing a weight perturbation technique, we derived the error change. When the error reduced, the next pulse voltage was updated according to the back-propagation learning algorithm. If the error increased the amplitude of the next voltage pulse was set in such way as to cause similar memristor conductance but in the opposite voltage scanning direction. By this operation, we could eliminate the hysteresis and confirmed that the simulation of the learning operation converged. We also adopted conductance dispersion numerically in the simulation. We examined the probability that the error decreased to a designated value within a predetermined loop number. The ferroelectric has the characteristics that the magnitude of polarization does not become smaller when voltages having the same polarity are applied. These characteristics greatly improved the probability even if the learning rate was small, if the magnitude of the dispersion is adequate. Because the dispersion of analog circuit elements is inevitable, this learning operation procedure is useful for analog neural network hardware. PMID:25393715
Michihito Ueda
Full Text Available To realize an analog artificial neural network hardware, the circuit element for synapse function is important because the number of synapse elements is much larger than that of neuron elements. One of the candidates for this synapse element is a ferroelectric memristor. This device functions as a voltage controllable variable resistor, which can be applied to a synapse weight. However, its conductance shows hysteresis characteristics and dispersion to the input voltage. Therefore, the conductance values vary according to the history of the height and the width of the applied pulse voltage. Due to the difficulty of controlling the accurate conductance, it is not easy to apply the back-propagation learning algorithm to the neural network hardware having memristor synapses. To solve this problem, we proposed and simulated a learning operation procedure as follows. Employing a weight perturbation technique, we derived the error change. When the error reduced, the next pulse voltage was updated according to the back-propagation learning algorithm. If the error increased the amplitude of the next voltage pulse was set in such way as to cause similar memristor conductance but in the opposite voltage scanning direction. By this operation, we could eliminate the hysteresis and confirmed that the simulation of the learning operation converged. We also adopted conductance dispersion numerically in the simulation. We examined the probability that the error decreased to a designated value within a predetermined loop number. The ferroelectric has the characteristics that the magnitude of polarization does not become smaller when voltages having the same polarity are applied. These characteristics greatly improved the probability even if the learning rate was small, if the magnitude of the dispersion is adequate. Because the dispersion of analog circuit elements is inevitable, this learning operation procedure is useful for analog neural network hardware.
Acker, Corey D; Antic, Srdjan D
2009-03-01
Basal dendrites of prefrontal cortical neurons receive strong synaptic drive from recurrent excitatory synaptic inputs. Synaptic integration within basal dendrites is therefore likely to play an important role in cortical information processing. Both synaptic integration and synaptic plasticity depend crucially on dendritic membrane excitability and the backpropagation of action potentials. We carried out multisite voltage-sensitive dye imaging of membrane potential transients from thin basal branches of prefrontal cortical pyramidal neurons before and after application of channel blockers. We found that backpropagating action potentials (bAPs) are predominantly controlled by voltage-gated sodium and A-type potassium channels. In contrast, pharmacologically blocking the delayed rectifier potassium, voltage-gated calcium, or I(h) conductance had little effect on dendritic AP propagation. Optically recorded bAP waveforms were quantified and multicompartmental modeling was used to link the observed behavior with the underlying biophysical properties. The best-fit model included a nonuniform sodium channel distribution with decreasing conductance with distance from the soma, together with a nonuniform (increasing) A-type potassium conductance. AP amplitudes decline with distance in this model, but to a lesser extent than previously thought. We used this model to explore the mechanisms underlying two sets of published data involving high-frequency trains of APs and the local generation of sodium spikelets. We also explored the conditions under which I(A) down-regulation would produce branch strength potentiation in the proposed model. Finally, we discuss the hypothesis that a fraction of basal branches may have different membrane properties compared with sister branches in the same dendritic tree. PMID:19118105
Didi Supriyadi
2014-01-01
Full Text Available Dengue disease is a major health problem and endemic in several countries including Indonesia. Indonesia is included in the category "A" in the stratification of DHF by WHO in 2001 which indicates the high rate of treatment in hospital and deaths from dengue. The purpose of this study was to investigate the ability of artificial neural networks Backpropagation method for information of the spread of dengue fever in a region. In this study uses six input variables which are environmental factors that influence the spread of dengue fever, include average temperature - average, rainfall, number of rainy days, the population density, sea surface height, and the percentage of larvae-free number for which data is sourced from BMKG, BPS and the Public Health Service. Network architecture applied to a multilayer network that uses an input with 6 neurons, one hidden lay er and an output with the output neuron is one. From the results obtained by training the best network architecture is the number one hidden layer with the number of neurons obtained a total of 110 neurons and also the system can recognize the entire training data. The best training algorithm using a variable learning rate and momentum of 0.9 by 0.6 by the end of the training MSE 0.000999879. in the process of testing using test data obtained 17 tissue levels of approximately 88.23% accuracy. Therefore we can conclude that the network is implemented in this study when subjected to the test data other then the error rate of about 11.77%.Keywords : Artificial Neural Networks; Backpropagation; Dengue fever
Díaz Souto, Alberto; Napoli, Antonio; Adhikari, Susmita; Maalej, Zied; Lobato Polo, Adriana P.; Kuschnerov, Maxim; Prat Gomà, Josep Joan
2012-01-01
We investigate the joint implementation of back-propagation and RF-pilot tone for fiber nonlinear compensation in POLMUX-16QAM and show that the nonlinear tolerance is drastically improved when compared to OFDM system Peer Reviewed
Amit Kumar Ray; Navin Kumar Agrawal; Rakesh Kumar Sinha
2003-01-01
Three layered feed-forward backpropagation artificial neural network architecture is designed to classify sleep-wake stages in rats. Continuous three channel polygraphic signals such as electroencephalogram, electrooculogram and electromyogram were recorded from conscious rats for eight hours during day time. Signals were also stored in computer hard disk with the help of analog to digital converter and its compatible data acquisition software. The power spectra (in dB scale) of the digitized...
Salim Lahmiri
2014-01-01
This paper presents a forecasting model that integrates the discrete wavelet transform (DWT) and backpropagation neural networks (BPNN) for predicting financial time series. The presented model first uses the DWT to decompose the financial time series data. Then, the obtained approximation (low-frequency) and detail (high-frequency) components after decomposition of the original time series are used as input variables to forecast future stock prices. Indeed, while high-frequency components ca...
Taufikurrahman, Mohammad
2015-01-01
Neural networks is one of method which suitable for used to predict the time series data which include volatile. This research has been finished by using software Matlab 7.10.0 (R2010a). The research used the model neural network backpropagation. The aim to predict exchange rate Rupiah to Dollar U.S in 2014 from the research, discussion and the data process. To get exchange rate Rupiah for Dollar U.S in 2014 is 12.111,09.
Application of back-propagation neural networks to identification of seismic arrival types
Dai, Hengchang; MacBeth, Colin
1997-05-01
A back-propagation neural network (BPNN) approach is developed to identify P- and S-arrivals from three-component recordings of local earthquake data. The BPNN is trained by selecting trace segments of P- and S-waves and noise bursts converted into an attribute space based on the degree of polarization (DOP). After training, the network can automatically identify the type of arrival on earthquake recordings. Compared with manual analysis, a BPNN trained with nine groups of DOP segments can correctly identify 82.3% of the P-arrivals and 62.6% of the S-arrivals from one seismic station, and when trained with five groups from a training dataset selected from another seismic station, it can correctly identify 76.6% of the P-arrivals and 60.5% of S-arrivals. This approach is adaptive and needs only the onset time of arrivals as input, although its performance cannot be improved by simply adding more training datasets due to the complexity of DOP patterns. Our experience suggests that other information or another network may be necessary to improve its performance.
WU Shun-chuan(吴顺川); ZHANG You-pa(张友葩); GAO Yong-tao(高永涛)
2003-01-01
Taking the practical reinforced engineering of a reinforced soil retaining wall as an example, which located in Shandong Province and set on 104 national highway, the stress-spread behaviors of the anchor bars in the preforced proceeding were tested. According to the test data, and by use of the update backpropagation (BP) algorithm neural network(NN), the test method and it's mechanism were studied by the network, then the learning results show the mean square error(MSE) only at the 2.55% level, and the proof-testing results show the MSE at 4.38% level (the main aim is to build a NN directly from the in-situ test results (the learning phase)). Ipso-facto, the learning and adjustment abilities of the NN permit us to develop the test data, subsequently, 36 test data were acquired from the NN. By use of the provide data, as well as the failure situation and carried loading capacity of the retaining wall, finally, the choice the reasonable range interval distance of prestress cement grouting anchor bars were carried out, and the result was 2 m×2 m.
Low complexity digital backpropagation for high baud subcarrier-multiplexing systems.
Zhang, Fangyuan; Zhuge, Qunbi; Qiu, Meng; Plant, David V
2016-07-25
In this paper, we propose two modifications to reduce the complexity of the subcarrier-multiplexing (SCM) based digital backpropagation (DBP) for high symbol rate SCM systems. The first one is to reduce the number of interfering subcarriers (RS-SCM-DBP) when evaluating the cross-subcarrier nonlinearity (CSN). The second one is to replace the original frequency domain CSN filters with the infinite impulse response (IIR) filters (IIR-RS-SCM-DBP) in the CSN compensation. The performance of the proposed schemes are numerically evaluated in three-channel dual-polarization (DP) 16QAM wavelength-division multiplexing (WDM) transmissions. The aggregate symbol rate for each channel is 120 GBaud and the transmission distance is 1600 km. For the SCM system with 16 subcarriers, the IIR-RS-SCM-DBP with only 4 interfering subcarriers and 2 steps can achieve a 0.3 dB Q-factor improvement in the WDM transmission. Compared to the original SCM-DBP, the proposed IIR-RS-SCM-DBP reduces the complexity by 48% at a performance loss of only 0.07 dB. PMID:27464154
Khuriati, Ainie; Setiabudi, Wahyu; Nur, Muhammad; Istadi, Istadi
2015-12-01
Backpropgation neural network was trained to predict of combustible fraction heating value of MSW from the physical composition. Waste-to-Energy (WtE) is a viable option for municipal solid waste (MSW) management. The influence of the heating value of municipal solid waste (MSW) is very important on the implementation of WtE systems. As MSW is heterogeneous material, direct heating value measurements are often not feasible. In this study an empirical model was developed to describe the heating value of the combustible fraction of municipal solid waste as a function of its physical composition of MSW using backpropagation neural network. Sampling process was carried out at Jatibarang landfill. The weight of each sorting sample taken from each discharged MSW vehicle load is 100 kg. The MSW physical components were grouped into paper wastes, absorbent hygiene product waste, styrofoam waste, HD plastic waste, plastic waste, rubber waste, textile waste, wood waste, yard wastes, kitchen waste, coco waste, and miscellaneous combustible waste. Network was trained by 24 datasets with 1200, 769, and 210 epochs. The results of this analysis showed that the correlation from the physical composition is better than multiple regression method .
A back-propagation neural network for mineralogical mapping from AVIRIS data
Imaging spectrometers have the potential to identify surface mineralogy based on the unique absorption features in pixel spectra. A back-propagation neural network (BPN) is introduced to classify Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) of the Cuprite mining district (Nevada) data into mineral maps. The results are compared with the traditional acquired surface mineralogy maps from spectral angle mapping (SAM). There is no misclassification for the training set in the case of BPN; however 17 percent misclassification occurs in SAM. The validation accuracy of the SAM is 69 percent, whereas BPN results in 86 percent accuracy. The calibration accuracy of the BPN is higher than that of the SAM, suggesting that the training process of BPN is better than that of the SAM. The high classification accuracy obtained withthe BPN can beexplained by: (1) its ability to deal with complex relationships (e.g., 40 dimensions) and (2) the nature of the dataset, the minerals are highly concentrated and they are mostly represented by pure pixels. This paper demonstrates that BPN has superior classification ability when applied to imaging spectrometer data. (author)
Diaz-Robainas, Regino R.; Pandya, Abhijit S.; Huang, Ming Z.
1994-03-01
A method is developed to design simulations of neural-network based transfer functions, applicable to both linear and nonlinear structures. The algorithm used to implement the trainable neural mechanism is backpropagation. Using the trained structures as building blocks, a neural architecture is constructed in order to drive systems from expected inputs to satisfactory transient and steady-state output performance, in effect, the scope of control compensation; this method results in the design of neural-net control compensators. The algorithms are coded in a PC-based prolog, traditionally used for rule-based logic and Artificial Intelligence, rather than for Neural or Fuzzy models. Given a sequence representing the time-sample of a desired control input trajectory that will drive the plant to a desired output response, such a control input will be modelled as the desired output layer of an antecedent network driven by an error vector consistent with the closed-loop system's commanded behavior. This Controller network is trained to provide such an output profile for all expected inputs, in accordance with arbitrary specifications of rise-time, permitted overshoot, settling time, etc. The control vectors are generated as a by-product of this training. Additionally, a correlation is investigated between classical control parameters and the characteristics of the weight matrices, threshold vectors, and representation traits of the converged neural nets.
Neural network for processing both spatial and temporal data with time based back-propagation
Villarreal, James A. (Inventor); Shelton, Robert O. (Inventor)
1993-01-01
Neural networks are computing systems modeled after the paradigm of the biological brain. For years, researchers using various forms of neural networks have attempted to model the brain's information processing and decision-making capabilities. Neural network algorithms have impressively demonstrated the capability of modeling spatial information. On the other hand, the application of parallel distributed models to the processing of temporal data has been severely restricted. The invention introduces a novel technique which adds the dimension of time to the well known back-propagation neural network algorithm. In the space-time neural network disclosed herein, the synaptic weights between two artificial neurons (processing elements) are replaced with an adaptable-adjustable filter. Instead of a single synaptic weight, the invention provides a plurality of weights representing not only association, but also temporal dependencies. In this case, the synaptic weights are the coefficients to the adaptable digital filters. Novelty is believed to lie in the disclosure of a processing element and a network of the processing elements which are capable of processing temporal as well as spacial data.
In this work it was analyzed the residual performance of Portland cement concretes, when cold after heat-treated up to 600 deg C. Granite-gneiss was used in the three concrete mix proportions as the coarse aggregate, and river sand with finesses modulus of 2.7 as the fine aggregate. Ultrasonic pulse tests were performed on all the specimens and ultrasonic dynamic modulus were obtained. An artificial neural network of the backpropagation type was trained to evaluate and apply models in predicting residual properties of Portland cement concretes. The input layer for both models consists of an external layer input vector of the temperature. The hidden layer has two processing units with hyperbolic tangent sigmoid transfer functions (tansig for short), and the output layer contains one processing unit that represents the network's output (ultrasonic pulse velocity or modulus of elasticity) for each input vector. The training phase of the network converged for reasonable results after 5.000 epochs approximately, resulting in mean squared errors less than 0.02 for the normalized data. The neural network developed for modeling residual properties of Portland cement concretes was shown to be efficient in both the training phase and the test. From the results reasonable predictions could be made for the ultrasonic pulse velocity or dynamic modulus of elasticity by using temperature. (author)
Scene segmentation of natural images using texture measures and back-propagation
Sridhar, Banavar; Phatak, Anil; Chatterji, Gano
1993-01-01
Knowledge of the three-dimensional world is essential for many guidance and navigation applications. A sequence of images from an electro-optical sensor can be processed using optical flow algorithms to provide a sparse set of ranges as a function of azimuth and elevation. A natural way to enhance the range map is by interpolation. However, this should be undertaken with care since interpolation assumes continuity of range. The range is continuous in certain parts of the image and can jump at object boundaries. In such situations, the ability to detect homogeneous object regions by scene segmentation can be used to determine regions in the range map that can be enhanced by interpolation. The use of scalar features derived from the spatial gray-level dependence matrix for texture segmentation is explored. Thresholding of histograms of scalar texture features is done for several images to select scalar features which result in a meaningful segmentation of the images. Next, the selected scalar features are used with a neural net to automate the segmentation procedure. Back-propagation is used to train the feed forward neural network. The generalization of the network approach to subsequent images in the sequence is examined. It is shown that the use of multiple scalar features as input to the neural network result in a superior segmentation when compared with a single scalar feature. It is also shown that the scalar features, which are not useful individually, result in a good segmentation when used together. The methodology is applied to both indoor and outdoor images.
Automatic volcanic ash detection from MODIS observations using a back-propagation neural network
T. M. Gray
2015-12-01
Full Text Available Due to the climate effects and aviation threats of volcanic eruptions, it is important to accurately locate ash in the atmosphere. This study aims to explore the accuracy and reliability of training a neural network to identify cases of ash using observations from the Moderate Resolution Imaging Spectroradiometer (MODIS. Satellite images were obtained for the following eruptions: Kasatochi, Aleutian Islands, 2008; Okmok, Aleutian Islands, 2008; Grímsvötn, northeastern Iceland, 2011; Chaitén, southern Chile, 2008; Puyehue-Cordón Caulle, central Chile, 2011; Sangeang Api, Indonesia, 2014; and Kelut, Indonesia, 2014. The Hybrid Single Particle Lagrangian Integrated Trajectory (HYSPLIT model was used to obtain ash concentrations for the same archived eruptions. Two back-propagation neural networks were then trained using brightness temperature differences as inputs obtained via the following band combinations: 12–11, 11–8.6, 11–7.3, and 11 μm. Using the ash concentrations determined via HYSPLIT, flags were created to differentiate between ash (1 and no ash (0 and SO2-rich ash (1 and no SO2-rich ash (0 and used as output. When neural network output was compared to the test data set, 93 % of pixels containing ash were correctly identified and 7 % were missed. Nearly 100 % of pixels containing SO2-rich ash were correctly identified. The optimal thresholds, determined using Heidke skill scores, for ash retrieval and SO2-rich ash retrieval were 0.48 and 0.47, respectively. The networks show significantly less accuracy in the presence of high water vapor, liquid water, ice, or dust concentrations. Significant errors are also observed at the edge of the MODIS swath.
Camera characterization using back-propagation artificial neutral network based on Munsell system
Liu, Ye; Yu, Hongfei; Shi, Junsheng
2008-02-01
The camera output RGB signals do not directly corresponded to the tristimulus values based on the CIE standard colorimetric observer, i.e., it is a device-independent color space. For achieving accurate color information, we need to do color characterization, which can be used to derive a transformation between camera RGB values and CIE XYZ values. In this paper we set up a Back-Propagation (BP) artificial neutral network to realize the mapping from camera RGB to CIE XYZ. We used the Munsell Book of Color with total number 1267 as color samples. Each patch of the Munsell Book of Color was recorded by camera, and the RGB values could be obtained. The Munsell Book of Color were taken in a light booth and the surround was kept dark. The viewing/illuminating geometry was 0/45 using D 65 illuminate. The lighting illuminating the reference target needs to be as uniform as possible. The BP network was a 5-layer one and (3-10-10-10-3), which was selected through our experiments. 1000 training samples were selected randomly from the 1267 samples, and the rest 267 samples were as the testing samples. Experimental results show that the mean color difference between the reproduced colors and target colors is 0.5 CIELAB color-difference unit, which was smaller than the biggest acceptable color difference 2 CIELAB color-difference unit. The results satisfy some applications for the more accurate color measurements, such as medical diagnostics, cosmetics production, the color reappearance of different media, etc.
Mutasem K. Alsmadi
2011-01-01
Full Text Available Problem statement: Image recognition was a challenging problem researchers had been research into this area for so long especially in the recent years, due to distortion, noise, segmentation errors, overlap and occlusion of objects in digital images. In our study, there are many fields concern with pattern recognition, for example, fingerprint verification, face recognition, iris discrimination, chromosome shape discrimination, optical character recognition, texture discrimination and speech recognition, the subject of pattern recognition appears. A system for recognizing isolated pattern of interest may be as an approach for dealing with such application. Scientists and engineers with interests in image processing and pattern recognition have developed various approaches to deal with digital image recognition problems such as, neural network, contour matching and statistics. Approach: In this study, our aim was to recognize an isolated pattern of interest (fish in the image based robust features extraction. Where depend on color signatures that are extracted by RGB color space, color histogram and gray level co-occurrence matrix. Results: We presented a system prototype for dealing with such problem. The system started by acquiring an image containing pattern of fish, then the image segmentation was performed relying on color signature. Our system has been applied on 20 different fish families, each family has a different number of fish types and our sample consists of distinct 610 of fish images. These images are divided into two datasets: 400 training images and 210 testing images. An overall accuracy was obtained using back-propagation classifier was 84% on the test dataset used. Conclusion: We developed a classifier for fish images recognition. We efficiently have chosen an image segmentation method to fit our demands. Our classifier successfully design and implement a decision which performed efficiently without any
Lin, Bin; Lin, Gaotong; Liu, Xianyun; Ma, Jianshe; Wang, Xianchuan; Lin, Feiyan; Hu, Lufeng
2015-01-01
In order to develop pharmacokinetic model, a well-known multilayer feed-forward algorithm back-propagation artificial neural networks (BP-ANN) was applied to the pharmacokinetics of losartan in rabbit. The plasma concentrations of losartan in twelve rabbits, which were divided into two groups and given losartan 2 mg/kg by intravenous (Iv) and intragastrical (Ig) administration, were determined by LC-MS. The BP-ANN model included one input layer, hidden layers, and one output layer was constru...
QIN Zhong; SU Gao-li; YU Qiang; HU Bing-min; LI Jun
2005-01-01
In this work, datasets of water and carbon fluxes measured with eddy covariance technique above a summer maize field in the North China Plain were simulated with artificial neural networks (ANNs) to explore the fluxes responses to local environmental variables. The results showed that photosynthetically active radiation (PAR), vapor pressure deficit (VPD), air temperature (T) and leaf area index (LAI) were primary factors regulating both water vapor and carbon dioxide fluxes. Three-layer back-propagation neural networks (BP) could be applied to model fluxes exchange between cropland surface and atmosphere without using detailed physiological information or specific parameters of the plant.
Qin, Zhong; Su, Gao-Li; Yu, Qiang; Hu, Bing-Min; Li, Jun
2005-05-01
In this work, datasets of water and carbon fluxes measured with eddy covariance technique above a summer maize field in the North China Plain were simulated with artificial neural networks (ANNs) to explore the fluxes responses to local environmental variables. The results showed that photosynthetically active radiation (PAR), vapor pressure deficit (VPD), air temperature (T) and leaf area index (LAI) were primary factors regulating both water vapor and carbon dioxide fluxes. Three-layer back-propagation neural networks (BP) could be applied to model fluxes exchange between cropland surface and atmosphere without using detailed physiological information or specific parameters of the plant. PMID:15822158
Attariuas Hicham
2012-11-01
Full Text Available In recent years, there has been a strong tendency by companies to use centralized management systems like Enterprise resource planning (ERP. ERP systems offer a comprehensive and simplified process managements and extensive functional coverage. Sales management module is an important element business management of ERP. This paper describes an intelligent hybrid sales forecasting system ERP-FCBPN sales forecast based on architecture of ERP through Delphi, fuzzy clustering and Back-propagation (BP Neural Networks with adaptive learning rate (FCBPN. The proposed approach is composed of three stages: (1 Stage of data collection: Data collection will be implemented from the fields (attributes existing at the interfaces (Tables the database of the ERP. Collection of Key factors that influence sales be made using the Delphi method; (2 Stage of Data preprocessing: Winter Exponential Smoothing method will be utilized to take the trend effect into consideration. (3 Stage of learning by FCBPN: We use hybrid sales forecasting system based on Delphi, fuzzy clustering and Back-propagation (BP Neural Networks with adaptive learning rate (FCBPN. The data for this study come from an industrial company that manufactures packaging. Experimental results show that the proposed model outperforms the previous and traditional approaches. Therefore, it is a very promising solution for industrial forecasting.
Research highlights: → An ANN was built to predict the formation enthalpies of Al2X-type intermetallics. → The values predicted by the ANN agree with experiments well to typically within 10%. → The method comparison suggests that our ANN method is superior to Miedema's model. → Some trends of formation enthalpies for Al2X-type intermetallics were observed. - Abstract: A back-propagation artificial neural network (ANN) was established to predict the formation enthalpies of Al2X-type intermetallics as a function of some physical parameters. These physical parameters include the electronegativity difference, the electron density difference, the atomic size difference, and the electron-atom ratio (e/a). The values calculated by the ANN method agree with experiments well to typically within 10%, indicating that the well-trained back-propagation (BP) neural network is feasible, and can precisely predict the formation enthalpies of Al2X-type intermetallics. The method comparison based on the predicted formation enthalpies suggests that our ANN method is superior to Miedema's model. Some trends of formation enthalpies for Al2X-type intermetallics were also observed from the ANN.
Bahman O. Taha
2015-06-01
Full Text Available The reinforced concrete with fiber reinforced polymer (FRP bars (carbon, aramid, basalt and glass is used in places where a high ratio of strength to weight is required and corrosion is not acceptable. Behavior of structural members using (FRP bars is hard to be modeled using traditional methods because of the high non-linearity relationship among factors influencing the strength of structural members. Back-propagation neural network is a very effective method for modeling such complicated relationships. In this paper, back-propagation neural network is used for modeling the flexural behavior of beams reinforced with (FRP bars. 101 samples of beams reinforced with fiber bars were collected from literatures. Five important factors are taken in consideration for predicting the strength of beams. Two models of Multilayer Perceptron (MLP are created, first with single-hidden layer and the second with two-hidden layers. The two-hidden layer model showed better accuracy ratio than the single-hidden layer model. Parametric study has been done for two-hidden layer model only. Equations are derived to be used instead of the model and the importance of input factors is determined. Results showed that the neural network is successful in modeling the behavior of concrete beams reinforced with different types of (FRP bars.
Satyanarayana D
2006-01-01
Full Text Available A chemometric model for the simultaneous estimation of phenobarbitone and phenytoin sodium anticonvulsant tablets using the back-propagation neural network calibration has been presented. The use of calibration datasets constructed from the spectral data of pure components is proposed. The calibration sets were designed such that the concentrations were orthogonal and span the possible mixture space fairly evenly. Spectra of phenobarbitone and phenytoin sodium were recorded at several concentrations within their linear range and used to compute the calibration mixture between wavelengths 220 and 260 nm at an interval of 1 nm. The back-propagation neural network model was optimized using three different sets of calibration and monitoring data for the number of hidden sigmoid neurons. The calibration model was thoroughly evaluated at several concentration levels using spectra obtained for 95 synthetic binary mixtures prepared using orthogonal designs. The optimized model showed sufficient robustness even when the calibration sets were constructed from different sets of pure spectra of components. Although the components showed complete spectral overlap, the model could accurately estimate the drugs, with satisfactory precision and accuracy, in tablet dosage with no interference from excipients, as indicated by the recovery study results.
Sackey, Isaac; Da Ros, Francesco; Karl Fischer, Johannes; Richter, Thomas; Jazayerifar, Mahmoud; Peucheret, Christophe; Petermann, Klaus; Schubert, Colja
2015-01-01
dual-pump polarization-independent fiber-optic parametric amplifier and compared to digital backpropagation (DBP) compensation over up to 800-km in a dispersion-managed link. In the single-channel case, the use of the DBP algorithm outperformed the OPC with a Q-factor improvement of 0.9 dB after 800-km...
Salim Lahmiri
2012-07-01
Full Text Available In financial industry, the accurate forecasting of the stock market is a major challenge to optimize and update portfolios and also to evaluate several financial derivatives. Artificial neural networks and technical analysis are becoming widely used by industry experts to predict stock market moves. In this paper, different technical analysis measures and resilient back-propagation neural networks are used to predict the price level of five major developed international stock markets, namely the US S&P500, Japanese Nikkei, UK FTSE100, German DAX, and the French CAC40. Four categories of technical analysis measures are compared. They are indicators, oscillators, stochastics, and indexes. The out-of-sample simulation results show a strong evidence of the effectiveness of the indicators category over the oscillators, stochastics, and indexes. In addition, it is found that combining all these measures lead to an increase of the prediction error. In sum, technical analysis indicators provide valuable information to predict the S&P500, Nikkei, FTSE100, DAX, and the CAC40 price level.
Lean YU; Shouyang WANG; Kin Keung LAI
2009-01-01
The slow convergence of back-propagation neu-ral network (BPNN) has become a challenge in data-mining and knowledge discovery applications due to the drawbacks of the gradient descent (GD) optimization method, which is widely adopted in BPNN learning. To solve this problem,some standard Optimization techniques such as conjugate-gradient and Newton method have been proposed to improve the convergence rate of BP learning algorithm. This paper presents a heuristic method that adds an adaptive smooth-ing momentum term to original BP learning algorithm to speedup the convergence. In this improved BP learning al-gorithm, adaptive smoothing technique is used to adjust the momentums of weight updating formula automatically in terms of "3 σ limits theory." Using the adaptive smoothing momentum terms, the improved BP learning algorithm can make the network training and convergence process faster,and the network's generalization performance stronger than the standard BP learning algorithm can do. In order to ver-ify the effectiveness of the proposed BP learning algorithm,three typical foreign exchange rates, British pound (GBP),Euro (EUR), and Japanese yen (JPY), are chosen as the fore-casting targets for illustration purpose. Experimental results from homogeneous algorithm comparisons reveal that the proposed BP learning algorithm outperforms the other com-parable BP algorithms in performance and convergence rate.Furthermore, empirical results from heterogeneous model comparisons also show the effectiveness of the proposed BP learning algorithm.
Due to the advantages of Artificial Neural Network (ANN) for analyzing complex reaction system, the oxidation process of phenol in a pulsed discharge plasma system is simulated using an ANN model. Reaction factors including solution with pH values of 3.6, 5.4 and 9.8, and hydroxyl radicals (·OH) scavengers (Na2CO3 and n-butyl alcohol) are considered, and the changing trends of phenol degradation under various experimental conditions are simulated and predicted by the Back-Propagation (BP) neural network model. The obtained results show that the BP neural network model can effectively predict the degradation efficiency of phenol in the reaction system. According to the results, acidic solution is favourable for phenol oxidation and increase in the Na2CO3 and n-butyl alcohol addition will greatly restrain the phenol degradation. The restraining effect of scavengers on phenol degradation indicates that ·OH is one of most important active species for phenol oxidation in the pulsed discharge plasma system.
The boiler is a very important component of a thermal power plant, and its efficient operation requires continuous online information of various relevant parameters. Furnace exit gas temperature (FEGT) is one such important design/operating parameter. Knowledge of FEGT is not only useful for design of convective heating surface but also helpful for operating actions and decision making. Its online information ensures improvement in economic benefit of the power plant. Non-availability of FEGT on the operator desk greatly limits efficient operation. In this study, a novel method of estimating FEGT using neural network is presented. The training data are first generated by calculating FEGT using heat balances through various heat exchangers. Prediction accuracy and fast response are major advantages in using neural network for estimating FEGT for operator information. Two types of feed forward neural modeling networks, radial basis function and back-propagation network, were applied and compared based on their network simplicity, model building and prediction accuracy. Results are verified on practical data obtained from a 210 MW boiler of a thermal power plant
S Traore; Y M Wang; W G Chung
2014-03-01
The present study evaluates the predictive accuracy of the feed forward backpropagation artificial neural network (BP) in evapotranspiration forecasting from temperature data basis in Dédougou region located in western Burkina Faso, sub-Saharan Africa. BP accuracy is compared to the conventional Blaney–Criddle (BCR) and Reference Model developed for Burkina Faso (RMBF) by referring to the FAO56 Penman–Monteith (PM) as the standard method. Statistically, the models accuracies were evaluated with the goodness-of-fit measures of root mean square error, mean absolute error and coefficient of determination between their estimated and PM observed values. From the statistical results, BP shows similar contour trends to PM, and performs better than the conventional methods in reference evapotranspiration (ET_ref) forecasting in the region. In poor data situation, BP based only on temperature data is much more preferred than the other alternative methods for ET_ref forecasting. Furthermore, it is noted that the BP network computing technique accuracy improves significantly with the addition of wind velocity into the network input set. Therefore, in the region, wind velocity is recommended to be incorporated into the BP model for high accuracy management purpose of irrigation water, which relies on accurate values of ET_ref.
Ma, Jianshe; Cai, Jinzhang; Lin, Guanyang; Chen, Huilin; Wang, Xianqin; Wang, Xianchuan; Hu, Lufeng
2014-05-15
Corynoxeine(CX), isolated from the extract of Uncaria rhynchophylla, is a useful and prospective compound in the prevention and treatment for vascular diseases. A simple and selective liquid chromatography mass spectrometry (LC-MS) method was developed to determine the concentration of CX in rat plasma. The chromatographic separation was achieved on a Zorbax SB-C18 (2.1 mm × 150 mm, 5 μm) column with acetonitrile-0.1% formic acid in water as mobile phase. Selective ion monitoring (SIM) mode was used for quantification using target ions m/z 383 for CX and m/z 237 for the carbamazepine (IS). After the LC-MS method was validated, it was applied to a back-propagation artificial neural network (BP-ANN) pharmacokinetic model study of CX in rats. The results showed that after intravenous administration of CX, it was mainly distributed in blood and eliminated quickly, t1/2 was less than 1h. The predicted concentrations generated by BP-ANN model had a high correlation coefficient (R>0.99) with experimental values. The developed BP-ANN pharmacokinetic model can be used to predict the concentration of CX in rats. PMID:24732215
This paper is dedicated to the application of artificial neural networks in optimizing heat treatment technique of high-vanadium high-speed steel (HVHSS), including predictions of retained austenite content (A), hardness (H) and wear resistance (ε) according to quenching and tempering temperatures (T1, T2). Multilayer back-propagation (BP) networks are created and trained using comprehensive datasets tested by the authors. And very good performances of the neural networks are achieved. The prediction results show residual austenite content decreases with decreasing quenching temperature or increasing tempering temperature. The maximum value of relative wear resistance occurs at quenching of 1000-1050 deg. C and tempering of 530-560 deg. C, corresponding to the peak value of hardness and retained austenite content of about 20-40 vol%. The prediction values have sufficiently mined the basic domain knowledge of heat treatment process of HVHSS. A convenient and powerful method of optimizing heat treatment technique has been provided by the authors
Amit Kumar Ray
2003-05-01
Full Text Available Three layered feed-forward backpropagation artificial neural network architecture is designed to classify sleep-wake stages in rats. Continuous three channel polygraphic signals such as electroencephalogram, electrooculogram and electromyogram were recorded from conscious rats for eight hours during day time. Signals were also stored in computer hard disk with the help of analog to digital converter and its compatible data acquisition software. The power spectra (in dB scale of the digitized signals in three sleep-wake stages were calculated. Selected power spectrum data of all three simultaneously recorded polygraphic signals were used for training the network and to classify slow wave sleep, rapid eye movement sleep and awake stages. The ANN architecture used in present study shows a very good agreement with manual sleep stage scoring with an average of 94.83% for all the 1200 samples tested from SWS, REM and AWA stages. The high performance observed with the system based on ANN highlights the need of this computational tool into the field of sleep research.
Salim Lahmiri
2014-07-01
Full Text Available This paper presents a forecasting model that integrates the discrete wavelet transform (DWT and backpropagation neural networks (BPNN for predicting financial time series. The presented model first uses the DWT to decompose the financial time series data. Then, the obtained approximation (low-frequency and detail (high-frequency components after decomposition of the original time series are used as input variables to forecast future stock prices. Indeed, while high-frequency components can capture discontinuities, ruptures and singularities in the original data, low-frequency components characterize the coarse structure of the data, to identify the long-term trends in the original data. As a result, high-frequency components act as a complementary part of low-frequency components. The model was applied to seven datasets. For all of the datasets, accuracy measures showed that the presented model outperforms a conventional model that uses only low-frequency components. In addition, the presented model outperforms both the well-known auto-regressive moving-average (ARMA model and the random walk (RW process.
Nader Salari
Full Text Available Among numerous artificial intelligence approaches, k-Nearest Neighbor algorithms, genetic algorithms, and artificial neural networks are considered as the most common and effective methods in classification problems in numerous studies. In the present study, the results of the implementation of a novel hybrid feature selection-classification model using the above mentioned methods are presented. The purpose is benefitting from the synergies obtained from combining these technologies for the development of classification models. Such a combination creates an opportunity to invest in the strength of each algorithm, and is an approach to make up for their deficiencies. To develop proposed model, with the aim of obtaining the best array of features, first, feature ranking techniques such as the Fisher's discriminant ratio and class separability criteria were used to prioritize features. Second, the obtained results that included arrays of the top-ranked features were used as the initial population of a genetic algorithm to produce optimum arrays of features. Third, using a modified k-Nearest Neighbor method as well as an improved method of backpropagation neural networks, the classification process was advanced based on optimum arrays of the features selected by genetic algorithms. The performance of the proposed model was compared with thirteen well-known classification models based on seven datasets. Furthermore, the statistical analysis was performed using the Friedman test followed by post-hoc tests. The experimental findings indicated that the novel proposed hybrid model resulted in significantly better classification performance compared with all 13 classification methods. Finally, the performance results of the proposed model was benchmarked against the best ones reported as the state-of-the-art classifiers in terms of classification accuracy for the same data sets. The substantial findings of the comprehensive comparative study revealed that
At the beginning of the decade of the nineties, the industrial interest for TRIP steels leads to a significant increase of the investigation and application in this field. In this work, the flexibility of neural networks for the modelling of complex properties is used to tackle the problem of determining the retained austenite content in TRIP-steel. Applying a combination of two learning algorithms (backpropagation and creeping-random-search) for the neural network, a model has been created that enables the prediction of retained austenite in low-Si / low-Al multiphase steels as a function of processing parameters. (Author). 34 refs.
Kohara, K. [Nippon Telegraph and Telephone Corp., Tokyo (Japan)
1998-11-01
We proposed ways to improve pattern recognition ability by combining several small back-propagation neural networks (BPNNs) [1]. We found that modifying the desired outputs according to the similarity of the input patterns (i.e., increasing desired outputs to similar classes) increases the BPNN outputs for similar classes, thus improving the generalization ability of the modular-net architecture. We evaluated the learning technique using two subfeatures extracted from handwritten digits [1]. This paper proposes a performance-verification method and presents experimental results applying learning techniques to the proposed verification-problems: 4-class, 10-class, and 20-class classification problems using two-dimensional Gaussian distribution data. 7 refs., 7 figs., 6 tabs.
Yu, Hao; Rossi, Giammarco; Braglia, Andrea; Perrone, Guido
2016-08-10
The paper presents the development of a tool based on a back-propagation artificial neural network to assist in the accurate positioning of the lenses used to collimate the beam from semiconductor laser diodes along the so-called fast axis. After training using a Gaussian beam ray-equivalent model, the network is capable of indicating the tilt, decenter, and defocus of such lenses from the measured field distribution, so the operator can determine the errors with respect to the actual lens position and optimize the diode assembly procedure. An experimental validation using a typical configuration exploited in multi-emitter diode module assembly and fast axis collimating lenses with different focal lengths and numerical apertures is reported. PMID:27534506
Attariuas Hicham
2012-05-01
Full Text Available This paper describes new hybrid sales forecasting system based on fuzzy clustering and Back-propagation (BP Neural Networks with adaptive learning rate (FCBPN.The proposed approach is composed of three stages: (1 Winters Exponential Smoothing method will be utilized to take the trend effect into consideration; (2 utilizing Fuzzy C-Means clustering method (Used in an clusters memberships fuzzy system (CMFS, the clusters membership levels of each normalized data records will be extracted; (3 Each cluster will be fed into parallel BP networks with a learning rate adapted as the level of cluster membership of training data records. Compared to many researches which use Hard clustering, we employ fuzzy clustering which permits each data record to belong to each cluster to a certain degree, which allows the clusters to be larger which consequently increases the accuracy of the proposed forecasting system . Printed Circuit Board (PCB will be used as a case study to evaluate the precision of our proposed architecture. Experimental results show that the proposed model outperforms the previous and traditional approaches. Therefore, it is a very promising solution for industrial forecasting.
S. KARMAKAR
2014-04-01
Full Text Available The utilization of back-propagation neural network in identification of internal dynamics of chaotic motion is found appropriate. However, during its training through Rumelhart algorithm, it is found that, a high learning rate ( leads to rapid learning but the weights may oscillate, while a lower value of ` ' leads to slower learning process in weight updating formula Momentum factor ( is to accelerate the convergence of error during the training in the equation and while transfer function sigmoid . It is the most complicated and experimental task to identify optimum value of ` ' and ` ' during the training. To identify optimum value of ` ' and ` ' , firstly the network is trained with 103 epochs under different values of ` ' in the close interval and At the convergence of initial weights and minimization of error (i.e., mean square error process is found appropriate. Afterwards to find optimum value of , the network was trained again with = 0.3 (fixed and with different values of in the close interval for 103 epochs. It was observed that the convergence of initial weights and minimization of error was appropriate with = 0.3 and = 0.9. On this optimum value of and the network was trained successfully from local minima of error = 1.67029292416874E-03 at 103 epochs to global minima of error = 4.99180426869658E-04 at 15 105 epochs. At the global minima, the network has exhibited excellent performance in identification of internal dynamics of chaotic motion and in prediction of future values by past recorded data series. These essentials are presented through this research paper.
Xianzhi Song
Full Text Available Sand production and blockage are common during the drilling and production of horizontal oil and gas wells as a result of formation breakdown. The use of high-pressure rotating jets and annular helical flow is an effective way to enhance horizontal wellbore cleanout. In this paper, we propose the idea of using supercritical CO2 (SC-CO2 as washing fluid in water-sensitive formation. SC-CO2 is manifested to be effective in preventing formation damage and enhancing production rate as drilling fluid, which justifies tis potential in wellbore cleanout. In order to investigate the effectiveness of SC-CO2 helical flow cleanout, we perform the numerical study on the annular flow field, which significantly affects sand cleanout efficiency, of SC-CO2 jets in horizontal wellbore. Based on the field data, the geometry model and mathematical models were built. Then a numerical simulation of the annular helical flow field by SC-CO2 jets was accomplished. The influences of several key parameters were investigated, and SC-CO2 jets were compared to conventional water jets. The results show that flow rate, ambient temperature, jet temperature, and nozzle assemblies play the most important roles on wellbore flow field. Once the difference between ambient temperatures and jet temperatures is kept constant, the wellbore velocity distributions will not change. With increasing lateral nozzle size or decreasing rear/forward nozzle size, suspending ability of SC-CO2 flow improves obviously. A back-propagation artificial neural network (BP-ANN was successfully employed to match the operation parameters and SC-CO2 flow velocities. A comprehensive model was achieved to optimize the operation parameters according to two strategies: cost-saving strategy and local optimal strategy. This paper can help to understand the distinct characteristics of SC-CO2 flow. And it is the first time that the BP-ANN is introduced to analyze the flow field during wellbore cleanout in
Song, Xianzhi; Peng, Chi; Li, Gensheng; He, Zhenguo; Wang, Haizhu
2016-01-01
Sand production and blockage are common during the drilling and production of horizontal oil and gas wells as a result of formation breakdown. The use of high-pressure rotating jets and annular helical flow is an effective way to enhance horizontal wellbore cleanout. In this paper, we propose the idea of using supercritical CO2 (SC-CO2) as washing fluid in water-sensitive formation. SC-CO2 is manifested to be effective in preventing formation damage and enhancing production rate as drilling fluid, which justifies tis potential in wellbore cleanout. In order to investigate the effectiveness of SC-CO2 helical flow cleanout, we perform the numerical study on the annular flow field, which significantly affects sand cleanout efficiency, of SC-CO2 jets in horizontal wellbore. Based on the field data, the geometry model and mathematical models were built. Then a numerical simulation of the annular helical flow field by SC-CO2 jets was accomplished. The influences of several key parameters were investigated, and SC-CO2 jets were compared to conventional water jets. The results show that flow rate, ambient temperature, jet temperature, and nozzle assemblies play the most important roles on wellbore flow field. Once the difference between ambient temperatures and jet temperatures is kept constant, the wellbore velocity distributions will not change. With increasing lateral nozzle size or decreasing rear/forward nozzle size, suspending ability of SC-CO2 flow improves obviously. A back-propagation artificial neural network (BP-ANN) was successfully employed to match the operation parameters and SC-CO2 flow velocities. A comprehensive model was achieved to optimize the operation parameters according to two strategies: cost-saving strategy and local optimal strategy. This paper can help to understand the distinct characteristics of SC-CO2 flow. And it is the first time that the BP-ANN is introduced to analyze the flow field during wellbore cleanout in horizontal wells. PMID
Learning Multiagent Communication with Backpropagation
Sukhbaatar, Sainbayar; Szlam, Arthur; Fergus, Rob
2016-01-01
Many tasks in AI require the collaboration of multiple agents. Typically, the communication protocol between agents is manually specified and not altered during training. In this paper we explore a simple neural model, called CommNN, that uses continuous communication for fully cooperative tasks. The model consists of multiple agents and the communication between them is learned alongside their policy. We apply this model to a diverse set of tasks, demonstrating the ability of the agents to l...
Al-Abadi, Alaa M.
2014-12-01
The potential of using three different data-driven techniques namely, multilayer perceptron with backpropagation artificial neural network (MLP), M5 decision tree model, and Takagi-Sugeno (TS) inference system for mimic stage-discharge relationship at Gharraf River system, southern Iraq has been investigated and discussed in this study. The study used the available stage and discharge data for predicting discharge using different combinations of stage, antecedent stages, and antecedent discharge values. The models' results were compared using root mean squared error (RMSE) and coefficient of determination (R 2) error statistics. The results of the comparison in testing stage reveal that M5 and Takagi-Sugeno techniques have certain advantages for setting up stage-discharge than multilayer perceptron artificial neural network. Although the performance of TS inference system was very close to that for M5 model in terms of R 2, the M5 method has the lowest RMSE (8.10 m3/s). The study implies that both M5 and TS inference systems are promising tool for identifying stage-discharge relationship in the study area.
Toda-Caraballo, I.; Garcia-Mateo, C.; Capdevila, C.
2010-07-01
At the beginning of the decade of the nineties, the industrial interest for TRIP steels leads to a significant increase of the investigation and application in this field. In this work, the flexibility of neural networks for the modelling of complex properties is used to tackle the problem of determining the retained austenite content in TRIP-steel. Applying a combination of two learning algorithms (backpropagation and creeping-random-search) for the neural network, a model has been created that enables the prediction of retained austenite in low-Si / low-Al multiphase steels as a function of processing parameters. (Author). 34 refs.
范媛媛; 桑英军; 沈湘衡
2011-01-01
在基于噪声图像的无参考峰值信噪比质量评价方法中,为了得到最优的阈值参数,提出以图像块均方误差阈值threshold1、噪声检测阈值threshold2为输入因子,以Pearson相关系数和Spearman等级相关系数为输出因子,以实验值为样本建立[2 7 2]单隐层BP神经网络模型,应用BP神经网络的泛化能力实现对相关阈值参数的预测优化,为阈值参数的选择提供理论依据.实验结果表明,所建立的数学模型可靠,预测结果与试验值的偏差小,训练好的BP神经网络能够比较准确地预测不同阈值参数下的相关系数.优化后,选取threshold1=101,threshold2 =4,Pearson相关系数达到了-0.895 0,Spearman等级相关系数达到了-0.913 6,评价效果得到提高,且节省大量时间.%In no reference peak signal to noise ratio (PSNR) image quality assessment based on noisy images, in order to get optimal threshold parameters, it is proposed that taking experiment values as a sample, a [2 7 2] back-propagation (BP) neural network model is established with the mean square error (MSE) thresholdl of image block and the noise detection threshold2 as the input factors, and the Person and Spearman correlation coefficients as the output factors. The model realizes the prediction of relevant parameters by its generalization capability and offers a theoretical foundation for parameters selection. Experiments indicate that the model is reliable. The prediction results show little difference from the experimental data. The trained BP neural network can precisely predict the relevant parameters. After optimizing, thresholdl = 101 and threshold2 = 4 are selected, Pearson Correlation Coefficient and Spearman Rank Order Correlation Coefficient reaches -0. 895 0 and -0. 913 6 respectively. The assessment result improves a lot, and much time is saved.
Tumor Diagnosis Using Backpropagation Neural Network Method
Ma, Lixing; Looney, Carl; Sukuta, Sydney; Bruch, Reinhard; Afanasyeva, Natalia
1998-05-01
For characterization of skin cancer, an artificial neural network (ANN) method has been developed to diagnose normal tissue, benign tumor and melanoma. The pattern recognition is based on a three-layer neural network fuzzy learning system. In this study, the input neuron data set is the Fourier Transform infrared (FT-IR)spectrum obtained by a new Fiberoptic Evanescent Wave Fourier Transform Infrared (FEW-FTIR) spectroscopy method in the range of 1480 to 1850 cm-1. Ten input features are extracted from the absorbency values in this region. A single hidden layer of neural nodes with sigmoids activation functions clusters the feature space into small subclasses and the output nodes are separated in different nonconvex classes to permit nonlinear discrimination of disease states. The output is classified as three classes: normal tissue, benign tumor and melanoma. The results obtained from the neural network pattern recognition are shown to be consistent with traditional medical diagnosis. Input features have also been extracted from the absorbency spectra using chemical factor analysis. These abstract features or factors are also used in the classification.
Pengenalan Pola Citra Menggunakan Metode Corner Detection Dan Backpropagation
Tondang, Yenny Agustina
2016-01-01
Indonesia, a country that has many islands and culture, has a huge potential to develop tourism. Many tourism objects that can be used to increase the division of the country require a system to assist users in finding objects owned by the user. This study used corner detection methods and backpropgation (BP) to assist users in recognizing objects. Harris Corner Detection (HCD) will get the points contained in the image of the image. The results of the HCD will be studied using...
Implementation of Back-Propagation Algorithm For Renal Datamining
P.Thrimurthy
2008-04-01
Full Text Available The present medical era data mining place a important role for quick access of appropriate information. To achieve this full automation is required which means less human interference. Therefore automatic renal data mining with decision making algorithm is necessary. Renal failure contributes to major health problem. In this research work a distributed neural network has been applied to a data mining problem for classification of renal data to have for proper diagnosis of patient. A multi layer perceptron with back propagation algorithm has been used. The network was trained offline using 500 patterns each of 17 inputs. Using the weight obtained during training, fresh patterns were tested for accuracy of diagnosis.
Ocean wave parameters estimation using backpropagation neural networks
Mandal, S.; SubbaRao; Raju, D.H.
In the present study, various ocean wave parameters are estimated from theoretical Pierson-Moskowitz spectra as well as measured ocean wave spectra using back propagation neural networks (BNN). Ocean wave parameters estimation by BNN shows...
BACKPROPAGATION LEARNING ALGORITHM BASED ON LEVENBERG MARQUARDT ALGORITHM
S.Sapna
2012-10-01
Full Text Available Data Mining aims at discovering knowledge out of data and presenting it in a form that is easily compressible to humans. Data Mining represents a process developed to examine large amounts of data routinely collected. The term also refers to a collection of tools used to perform the process. One of the useful applications in the field of medicine is the incurable chronic disease diabetes. Data Mining algorithm is used for testing the accuracy in predicting diabetic status. Fuzzy Systems are been used for solving a wide range of problems in different application domain and Genetic Algorithm for designing. Fuzzy systems allows in introducing the learning and adaptation capabilities. Neural Networks are efficiently used for learning membership functions. Diabetes occurs throughout the world, but Type 2 is more common in the most developed countries. The greater increase in prevalence is however expected in Asia and Africa where most patients will likely be found by 2030. This paper is proposed on the Levenberg – Marquardt algorithm which is specifically designed to minimize sum-of-square error functions. Levernberg-Marquardt algorithm gives the best performance in the prediction of diabetes compared to any other backpropogation algorithm.
Neural Network Back-Propagation Algorithm for Sensing Hypergols
Perotti, Jose; Lewis, Mark; Medelius, Pedro; Bastin, Gary
2013-01-01
Fast, continuous detection of a wide range of hazardous substances simultaneously is needed to achieve improved safety for personnel working with hypergolic fuels and oxidizers, as well as other hazardous substances, with a requirement for such detection systems to warn personnel immediately upon the sudden advent of hazardous conditions, with a high probability of detection and a low false alarm rate. The primary purpose of this software is to read the voltage outputs from voltage dividers containing carbon nano - tube sensors as a variable resistance leg, and to recognize quickly when a leak has occurred through recognizing that a generalized pattern change in resistivity of a carbon nanotube sensor has occurred upon exposure to dangerous substances, and, further, to identify quickly just what substance is present through detailed pattern recognition of the shape of the response provided by the carbon nanotube sensor.
Unsupervised Discovery of Nonlinear Structure Using Contrastive Backpropagation
Hinton, Geoffrey; Osindero, Simon; Welling, Max; Teh, Yee-Whye
2006-01-01
We describe a way of modeling high-dimensional data vectors by using an unsupervised, nonlinear, multilayer neural network in which the activity of each neuron-like unit makes an additive contribution to a global energy score that indicates how surprised the network is by the data vector. The connection weights that determine how the activity of…
On the capacity of multilayer neural networks trained with backpropagation.
Miranda, E N
2000-08-01
The capacity of a layered neural network for learning hetero-associations is studied numerically as a function of the number M of hidden neurons. We find that there is a sharp change in the learning ability of the network as the number of hetero-associations increases. This fact allows us to define a maximum capacity C for a given architecture. It is found that C grows logarithmically with M. PMID:11052415
Spike-timing error backpropagation in theta neuron networks.
McKennoch, Sam; Voegtlin, Thomas; Bushnell, Linda
2009-01-01
The main contribution of this letter is the derivation of a steepest gradient descent learning rule for a multilayer network of theta neurons, a one-dimensional nonlinear neuron model. Central to our model is the assumption that the intrinsic neuron dynamics are sufficient to achieve consistent time coding, with no need to involve the precise shape of postsynaptic currents; this assumption departs from other related models such as SpikeProp and Tempotron learning. Our results clearly show that it is possible to perform complex computations by applying supervised learning techniques to the spike times and time response properties of nonlinear integrate and fire neurons. Networks trained with our multilayer training rule are shown to have similar generalization abilities for spike latency pattern classification as Tempotron learning. The rule is also able to train networks to perform complex regression tasks that neither SpikeProp or Tempotron learning appears to be capable of. PMID:19431278
Application of backpropagation neural networks to phonetic element classification
Bryan, S.R.
1990-01-01
A need was established in conjunction with an USAF-sponsored project to develop a speech element classifier. This classifier had to be capable of placing continuous speech into a number of phoneme-like categories, and also had to be independent of speaker identity and individual voice characteristics. The feasibility of using a neural network to perform this classification task was explored. The results of this exploration are discussed here.
Ueda, Michihito; Nishitani, Yu; Kaneko, Yukihiro; Omote, Atsushi
2014-01-01
To realize an analog artificial neural network hardware, the circuit element for synapse function is important because the number of synapse elements is much larger than that of neuron elements. One of the candidates for this synapse element is a ferroelectric memristor. This device functions as a voltage controllable variable resistor, which can be applied to a synapse weight. However, its conductance shows hysteresis characteristics and dispersion to the input voltage. Therefore, the conduc...
Comparison of Evolution Strategy and Back-Propagation for Estimating Parameters of Neural Networks
Malczyk, Roman; Gottvald, Aleš
Brno: Institute of Scientific Instruments of the Academy of Sciences of the Czech Republic, 1996. s. 48. [Optimization and Inverse Problems in Electromagnetism /4./. 19.06.1996-21.06.1996, Brno] R&D Projects: GA ČR GA102/95/0282
Yu, Yuguo; Shu, Yousheng; McCormick, David A.
2008-01-01
Neocortical action potential responses in vivo are characterized by considerable threshold variability, and thus timing and rate variability, even under seemingly identical conditions. This finding suggests that cortical ensembles are required for accurate sensorimotor integration and processing. Intracellularly, trial-to-trial variability results not only from variation in synaptic activities, but also in the transformation of these into patterns of action potentials. Through simultaneous ax...
A Method of Movie Business Prediction Using Back-propagation Neural Network
Debaditya Barman
2012-10-01
Full Text Available Film industry is the most important component of Entertainment industry. Profit and Loss both are very high for this business. Before release of a particular movie, if the Production House or distributors gets any type of prediction that how the film will do business, then it can be helpful to reduce the risk. In this paper we have proposed, back propagation neural network for prediction about the business of a movie. Note that, this method is successfully applied in the field of Stock Market Prediction, Weather Prediction and Image Processing.
Back-propagating the light of field stars to probe telescope mirrors aberrations
Soulez, Ferréol; Unser, Michael
2016-01-01
We propose a wavefront-based method to estimate the PSF over the whole field of view. This method estimate the aberrations of all the mirrors of the telescope using only field stars. In this proof of concept paper, we described the method and present some qualitative results.
The existence of the surface polaritons at the interface separating a semi-infinite uniform left-handed metamaterial and a one-dimensional photonic crystal composed of alternating layers of two kinds of single-negative materials is theoretically investigated. The dispersion characteristics of the surface polaritons are analyzed and demonstrated that in the presence of metamaterial, the surface polaritons are sensitive to light polarization, so that there exist only backward TM-polarized (or TE-polarized) kind of the surface polaritons depending on the ratio of the thicknesses of the two periodic stacking layers. The existence regions of the surface polariton modes are determined for both TM-polarized and TE-polarized surface polariton modes.
Lei Si
2014-01-01
Full Text Available Classification is an important theme in data mining. Rough sets and neural networks are the most common techniques applied in data mining problems. In order to extract useful knowledge and classify ambiguous patterns effectively, this paper presented a hybrid algorithm based on the integration of rough sets and BP neural network to construct a novel classification system. The attribution values were discretized through PSO algorithm firstly to establish a decision table. The attribution reduction algorithm and rules extraction method based on rough sets were proposed, and the flowchart of proposed approach was designed. Finally, a prototype system was developed and some simulation examples were carried out. Simulation results indicated that the proposed approach was feasible and accurate and was outperforming others.
Automatic volcanic ash detection from MODIS observations using a back-propagation neural network
T. M. Gray; Bennartz, R.
2015-01-01
Due to the climate effects and aviation threats of volcanic eruptions, it is important to accurately locate ash in the atmosphere. This study aims to explore the accuracy and reliability of training a neural network to identify cases of ash using observations from the Moderate Resolution Imaging Spectroradiometer (MODIS). Satellite images were obtained for the following eruptions: Kasatochi, Aleutian Islands, 2008; Okmok, Aleutian Islands, 2008; Grímsvötn, n...
Forest Fire Smoke Detection Using Back-Propagation Neural Network Based on MODIS Data
Xiaolian Li; Weiguo Song; Liping Lian; Xiaoge Wei
2015-01-01
Satellite remote sensing provides global observations of the Earth’s surface and provides useful information for monitoring smoke plumes emitted from forest fires. The aim of this study is to automatically separate smoke plumes from the background by analyzing the MODIS data. An identification algorithm was improved based on the spectral analysis among the smoke, cloud and underlying surface. In order to get satisfactory results, a multi-threshold method is used for extracting training sampl...
Ilin, Roman; Werbos, Paul J
2007-01-01
Cellular Simultaneous Recurrent Neural Network (SRN) has been shown to be a function approximator more powerful than the MLP. This means that the complexity of MLP would be prohibitively large for some problems while SRN could realize the desired mapping with acceptable computational constraints. The speed of training of complex recurrent networks is crucial to their successful application. Present work improves the previous results by training the network with extended Kalman filter (EKF). We implemented a generic Cellular SRN and applied it for solving two challenging problems: 2D maze navigation and a subset of the connectedness problem. The speed of convergence has been improved by several orders of magnitude in comparison with the earlier results in the case of maze navigation, and superior generalization has been demonstrated in the case of connectedness. The implications of this improvements are discussed.
Abidin, Z.
2013-01-01
Di dalam kehidupan sehari-hari, khususnya dalam komunikasi interpersonal, wajah sering digunakan untuk berekspresi. Melalui ekspresi wajah, maka dapat dipahami emosi yang sedang bergejolak pada diri individu. Ekspresi wajah merupakan salah satu karakteristik perilaku. Penggunaan sistem teknologi biometrika dengan karakteristik ekspresi wajah memungkinkan untuk mengenali mood atau emosi seseorang. Komponen dasar sistem analisis ekspresi wajah adalah deteksi wajah, ekstraksi data wajah, dan pen...
Z Abidin
2013-07-01
Full Text Available Di dalam kehidupan sehari-hari, khususnya dalam komunikasi interpersonal, wajah sering digunakan untuk berekspresi. Melalui ekspresi wajah, maka dapat dipahami emosi yang sedang bergejolak pada diri individu. Ekspresi wajah merupakan salah satu karakteristik perilaku. Penggunaan sistem teknologi biometrika dengan karakteristik ekspresi wajah memungkinkan untuk mengenali mood atau emosi seseorang. Komponen dasar sistem analisis ekspresi wajah adalah deteksi wajah, ekstraksi data wajah, dan pengenalan ekspresi wajah. Sehingga untuk membangun sebuah sistem pengenal ekspersi wajah, maka perlu dirancang tiga buah sub sistem yaitu sistem deteksi wajah, sistem pembelajaran jaringan syaraf tiruan. Prinsipnya data wajah yang telah dideteksi, diolah menggunakan fisherface, yang selanjutnya hasilnya digunakan sebagai input untuk jaringan syaraf tiruan. Bobot yang dihasilkan pada saat proses pembelajaran jaringan syaraf tiruan inilah yang akan digunakan untuk pengenalan ekspresi wajah.Â In daily life, especially in interpersonal communication, face often used for express of emotions. Facial expressions are the facial changes in response to a personâ€™s internal emotional states. A facial expression is one of the behavioral characteristics. The use of facial expression characteristics enables to recognize of personâ€™s mood. Basic components of a facial expression analysis system are face detection, face data extraction, and facial expression recognition. So that, to build a facial expression recognition system, it should be designed three subsystems, namely face detection system, learning of neural network system, and facial expression recognition system itself. In principle, face data that has been successfully detected, then it will be constructed by fisherface, and the results of it will be used as an input of neural network. Afterwards, the weights of neural network learning will be used to recognize facial expression.
Kostencka, J.; Kozacki, T.
2016-04-01
Filtered back propagation (FBPP) is a well-established reconstruction technique that is used in diffractive holographic tomography. The great advantage of the algorithm is the space-domain implementation, which enables avoiding the error-prone interpolation in the spectral domain that is an inherent part of the main counterpart of FBPP - the direct inversion tomographic reconstruction method. However, the fundamental flaw of FBPP is lack of generality, i.e. the method can be applied solely for the classical tomographic systems, where alternation of the measurement views is achieved by rotating a sample. At the same time, majority of the nowadays tomographic setups apply an alternative measurement concept, which is based on scanning of an illumination beam. The aim of this paper is to remove the mentioned limitation of the FBPP and enable its application in the systems utilizing scanning of illumination. This is achieved by introducing a new method of accounting for uneven cover of the sampled object frequencies, which applies normalization of the object spectrum with coherent transfer function of a considered tomographic system. The feasibility of the proposed, modified filtered back propagation algorithm is demonstrated with numerical simulations, which mimic tomographic measurement of a complex sample, i.e. the Shepp-Logan phantom.
Implementation of back-propagation neural networks with MatLab
Nazari, Jamshid; Ersoy, Okan K
1992-01-01
The artificial neural network back propagation algorithm is implemented in Matlab language. This implementation is compared with several other software packages. The effect of reducing the number of iterations in the performance of the algorithm iai studied. The speed of the back propagation program, mkckpmp, written in Matlab language is compared with the speed of several other back propagation programs which are written in the C language. The speed of the Matlab program mbackpmp is, also co...
The Prediction of Bankruptcy Using Backpropagation Algorithm for “IO” Model Analysis
Ciprian Dragota
2007-01-01
Full Text Available The basic question which every bank it putswhen a client or a future client whishes to take a bank loanis: “The future debtor it’s capable to refund the loan atmaturity? (Installments plus the interest“. To answer atthis question the bank makes an assessment in which assetsand liabilities are analyze. There is also assessed the creditrating, the cash flow, the securities and, very important,bankrupt risk analysis.For the last one, to calculate bankrupt risk analysis,banks use some models (knows as “Z” score. Few of themare financials methods (like Altman, Canon & Holder,Yves Colonques etc. Nevertheless, these models are beendevelop for a specific situation and for a western economywhich is functional and very articulated. For our economy,we propose a new model that is been build with the specificeconomic dates and inputs, the model we called “IO”model.Without pretending to be able to penetrate over thecomplexity of the phenomenon, this study is trying to do apractical and experimental analysis of bankruptcy usingback propagation algorithm applied to the ”IO” model.
Predicting carbonate permeabilities from wireline logs using a back-propagation neural network
This paper explores the applicability of using Neural Networks to aid in the determination of carbonate permeability from wireline logs. Resistivity, interval transit time, neutron porosity, and bulk density logs form Texaco's Stockyard Creek Oil field were used as input to a specially designed neural network to predict core permeabilities in this carbonate reservoir. Also of interest was the comparison of the neural network's results to those of standard statistical techniques. The process of developing the neural network for this problem has shown that a good understanding of the data is required when creating the training set from which the network learns. This network was trained to learn core permeabilities from raw and transformed log data using a hyperbolic tangent transfer function and a sum of squares global error function. Also, it required two hidden layers to solve this particular problem
Axon-somatic back-propagation in detailed models of spinal alpha motoneurons
Pietro eBalbi
2015-02-01
Full Text Available Antidromic action potentials following distal stimulation of motor axons occasionally fail to invade the soma of alpha motoneurons in spinal cord, due to their passing through regions of high non-uniformity.Morphologically detailed conductance-based models of cat spinal alpha motoneurons have been developed, with the aim to reproduce and clarify some aspects of the electrophysiological behavior of the antidromic axon-somatic spike propagation. Fourteen 3D morphologically detailed somata and dendrites of cat spinal alpha motoneurons have been imported from an open-access web-based database of neuronal morphologies, NeuroMorpho.org, and instantiated in neurocomputational models. An axon hillock, an axonal initial segment and a myelinated axon are added to each model.By sweeping the diameter of the axonal initial segment (AIS and the axon hillock, as well as the maximal conductances of sodium channels at the AIS and at the soma, the developed models are able to show the relationships between different geometric and electrophysiological configurations and the voltage attenuation of the antidromically travelling wave.In particular, a greater than usually admitted sodium conductance at AIS is necessary and sufficient to overcome the dramatic voltage attenuation occurring during antidromic spike propagation both at the myelinated axon-AIS and at the AIS-soma transitions.
The performance of the backpropagation algorithm with varying slope of the activation function
Some adaptations are proposed to the basic BP algorithm in order to provide an efficient method to non-linear data learning and prediction. In this paper, an adopted BP algorithm with varying slope of activation function and different learning rates is put forward. The results of experiment indicated that this algorithm can get very good performance of training. We also test the prediction performance of our adopted BP algorithm on 16 instances. We compared the test results to the ones of the BP algorithm with gradient descent momentum and an adaptive learning rate. The results indicate this adopted BP algorithm gives best performance (100%) for test example, which conclude this adopted BP algorithm produces a smoothed reconstruction that learns better to new prediction function values than the BP algorithm improved with momentum.
A parallel implementation of a library to build and train Multi Layer Perceptrons via the Back Propagation algorithm is presented. The target machine is the SIMD massively parallel supercomputer Quadrics. Performance measures are provided on three different machines with different number of processors, for two network examples. A sample source code is given
Bui, Thang D.; Hernández-Lobato, José Miguel; Li, Yingzhen; Hernández-Lobato, Daniel; Turner, Richard E
2015-01-01
Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are probabilistic and non-parametric and as such are arguably more flexible, have a greater capacity to generalise, and provide better calibrated uncertainty estimates than alternative deep models. The focus of this paper is scalable approximate Bayesian learning of these networks. The paper de...
Ilin, Roman; Kozma, Robert; Werbos, Paul J
2008-06-01
Cellular simultaneous recurrent neural network (SRN) has been shown to be a function approximator more powerful than the multilayer perceptron (MLP). This means that the complexity of MLP would be prohibitively large for some problems while SRN could realize the desired mapping with acceptable computational constraints. The speed of training of complex recurrent networks is crucial to their successful application. This work improves the previous results by training the network with extended Kalman filter (EKF). We implemented a generic cellular SRN (CSRN) and applied it for solving two challenging problems: 2-D maze navigation and a subset of the connectedness problem. The speed of convergence has been improved by several orders of magnitude in comparison with the earlier results in the case of maze navigation, and superior generalization has been demonstrated in the case of connectedness. The implications of this improvements are discussed. PMID:18541494
Soudry, Daniel; Meir, Ron
2013-01-01
Significant success has been reported recently using deep neural networks for classification. Such large networks can be computationally intensive, even after training is over. Implementing these trained networks in hardware chips with a limited precision of synaptic weights may improve their speed and energy efficiency by several orders of magnitude, thus enabling their integration into small and low-power electronic devices. With this motivation, we develop a computationally efficient learn...
Power prediction of nuclear power plant using backpropagation learning neural network
A neural network paradigms, which is a data processing system with a number of simple highly interconnected processing elements in an architecture inspired by the structure of the brain, is proposed for the application to the prediction of thermal power in Nuclear Power Plant (NPP). The Back Propagation Network (BPN) algorithm is applied to develop the models of signal processing. A number of case studies were performed with emphasis on the applicability of network in a steady state high power level. It is revealed that the BPN algorithm can precisely predict the thermal power of NPP. It is also shown that the defected signals resulting from instrumentation problem, even when the signals comprising various patterns are noisy or incomplete, can be also properly handled in the case study
New backpropagation algorithm with type-2 fuzzy weights for neural networks
Gaxiola, Fernando; Valdez, Fevrier
2016-01-01
In this book a neural network learning method with type-2 fuzzy weight adjustment is proposed. The mathematical analysis of the proposed learning method architecture and the adaptation of type-2 fuzzy weights are presented. The proposed method is based on research of recent methods that handle weight adaptation and especially fuzzy weights. The internal operation of the neuron is changed to work with two internal calculations for the activation function to obtain two results as outputs of the proposed method. Simulation results and a comparative study among monolithic neural networks, neural network with type-1 fuzzy weights and neural network with type-2 fuzzy weights are presented to illustrate the advantages of the proposed method. The proposed approach is based on recent methods that handle adaptation of weights using fuzzy logic of type-1 and type-2. The proposed approach is applied to a cases of prediction for the Mackey-Glass (for ô=17) and Dow-Jones time series, and recognition of person with iris bi...
Dai, Hengchang; MacBeth, Colin
1997-07-01
An automatic approach is developed to pick P and S arrivals from single component (1-C) recordings of local earthquake data. In this approach a back propagation neural network (BPNN) accepts a normalized segment (window of 40 samples) of absolute amplitudes from the 1-C recordings as its input pattern, calculating two output values between 0 and 1. The outputs (0,1) or (1,0) correspond to the presence of an arrival or background noise within a moving window. The two outputs form a time series. The P and S arrivals are then retrieved from this series by using a threshold and a local maximum rule. The BPNN is trained by only 10 pairs of P arrivals and background noise segments from the vertical component (V-C) recordings. It can also successfully pick seismic arrivals from the horizontal components (E-W and N-S). Its performance is different for each of the three components due to strong effects of ray path and source position on the seismic waveforms. For the data from two stations of TDP3 seismic network, the success rates are 93%, 89%, and 83% for P arrivals and 75%, 91%, and 87% for S arrivals from the V-C, E-W, and N-S recordings, respectively. The accuracy of the onset times picked from each individual 1-C recording is similar. Adding a constraint on the error to be 10 ms (one sample increment), 66%, 59% and 63% of the P arrivals and 53%, 61%, and 58% of the S arrivals are picked from the V-C, E-W and N-S recordings respectively. Its performance is lower than a similar three-component picking approach but higher than other 1-C picking methods.
de Albuquerque, Victor Hugo C.; João Manuel R. S. Tavares; Luís M. P. Durão
2008-01-01
Nowadays, drilling of carbon/epoxy laminates is extremely frequent in manufacturing and assembling processes and is normally carried through using standard drills, like twist or Brad drills. However, it is always necessary to have in mind the need to adapt properly the drilling operations and/or the drilling tools used as the risk of delamination occurrence in the laminates involved, or other kind of damages, is very high. Moreover, delamination can be critical because the mechanical properti...
3-D inversion of borehole-to-surface electrical data using a back-propagation neural network
Ho, Trong Long
2009-08-01
The "fluid-flow tomography", an advanced technique for geoelectrical survey based on the conventional mise-à-la-masse measurement, has been developed by Exploration Geophysics Laboratory at the Kyushu University. This technique is proposed to monitor fluid-flow behavior during water injection and production in a geothermal field. However data processing of this technique is very costly. In this light, this paper will discuss the solution to cost reduction by applying a neural network in the data processing. A case study in the Takigami geothermal field in Japan will be used to illustrate this. The achieved neural network in this case study is three-layered and feed-forward. The most successful learning algorithm in this network is the Resilient Propagation (RPROP). Consequently, the study advances the pragmatism of the "fluid-flow tomography" technique which can be widely used for geothermal fields. Accuracy of the solution is then verified by using root mean square (RMS) misfit error as an indicator.
Grewe, Benjamin F.; Audrey Bonnan; Andreas Frick
2010-01-01
Pyramidal neurons of layer 5A are a major neocortical output type and clearly distinguished from layer 5B pyramidal neurons with respect to morphology, in vivo firing patterns, and connectivity; yet knowledge of their dendritic properties is scant. We used a combination of whole-cell recordings and Ca2+ imaging techniques in vitro to explore the specific dendritic signalling role of physiological action potential patterns recorded in vivo in layer 5A pyramidal neurons of the whisker-related &...
Yu, S.; Wang, X.; Shi, C.; Wang, H. [Shandong Mining Institute (China). Jinan Branch
1999-04-01
Four reformatory learning algorithms are applied to enhance the learning speed and the stability of neural network. The general principles of forecasting productivity and efficiency with artificial neural network and the specific operational steps are described in details. The processing of data before and after the learning procedure, the determination of the network structure, and the appropriate reiteration times for the learning procedure are the main points of discussion. 3 refs., 3 figs., 2 tabs.
Bahadir, Elif
2016-01-01
The purpose of this study is to examine a neural network based approach to predict achievement in graduate education for Elementary Mathematics prospective teachers. With the help of this study, it can be possible to make an effective prediction regarding the students' achievement in graduate education with Artificial Neural Networks (ANN). Two…
2015-01-01
This paper proposes a model to extract feature information quickly and accurately identifying what cannot be achieved through traditional methods of remote sensing image classification. First, process the selected Landsat-8 remote sensing data, including radiometric calibration, geometric correction, optimal band combination, and image cropping. Add the processed remote sensing image to the normalized geographic auxiliary information, digital elevation model (DEM), and normalized difference v...
Khairani, Mufida
2015-01-01
Identification of characters in digital media to be one of the major concerns in the current era of technological development . Background of attempts to identify characters into digital form is not human activities release of documents or files manually in daily activities . Transformation process manually by way of input data and the information manually takes a long time , so it is considered a need for a mechanism to transform data and manual information into digital form automatically...
Qin, Zhong; Su, Gao-li; Yu, Qiang; Hu, Bing-min; Li, Jun
2005-01-01
In this work, datasets of water and carbon fluxes measured with eddy covariance technique above a summer maize field in the North China Plain were simulated with artificial neural networks (ANNs) to explore the fluxes responses to local environmental variables. The results showed that photosynthetically active radiation (PAR), vapor pressure deficit (VPD), air temperature (T) and leaf area index (LAI) were primary factors regulating both water vapor and carbon dioxide fluxes. Three-layer back...
Kobayashi, T.; Takara, H.; Sano, A.;
2013-01-01
We demonstrate 12-core fiber bidirectional long-haul transmission with sub-petabit-class capacity (2 × 344 Tb/s). Inter-core crosstalk management and multicarrier nonlinear compensation enabled the longest distance of 1500 km in SDM transmission with unidirectional capacity over 300 Tb/s....
Mandal, S.
satisfactory results. It may be worthwhile here to refer to ob- servations made by the authors on the study by Yen et al. (1996), where Kalman filtering method is employed to deter- mine the harmonic parameters. Yen et al. (1996), in their study, suggested.... Therefore, the identified input neurons almost completely explain the behavior of the process output. But the tidal levels, as rightfully explained by the authors, are deter- mined by a complete physical process involving the continu- ous changes...
舒雅琴; 曾锦光
2000-01-01
A GA-BP complex algorithm based on real number coding is proposed. The algorithm optimizes the original weights, structure and learning rules of BP network to search the optimal solution in the solution space. An example of oil/gas prediction is given.%提出了一种基于实数编码的GA－BP复合算法，该算法对BP网络初始权值、结构、学习规则进行优化，从而在解空间中搜索出最优解．文中还给出了应用该算法解决油气产能预测的实例．
Yang, Tsung-Ming; Fan, Shu-Kai; Fan, Chihhao; Hsu, Nien-Sheng
2014-08-01
The purpose of this study is to establish a turbidity forecasting model as well as an early-warning system for turbidity management using rainfall records as the input variables. The Taipei Water Source Domain was employed as the study area, and ANOVA analysis showed that the accumulative rainfall records of 1-day Ping-lin, 2-day Ping-lin, 2-day Fei-tsui, 2-day Shi-san-gu, 2-day Tai-pin and 2-day Tong-hou were the six most significant parameters for downstream turbidity development. The artificial neural network model was developed and proven capable of predicting the turbidity concentration in the investigated catchment downstream area. The observed and model-calculated turbidity data were applied to developing the turbidity early-warning system. Using a previously determined turbidity as the threshold, the rainfall criterion, above which the downstream turbidity would possibly exceed this respective threshold turbidity, for the investigated rain gauge stations was determined. An exemplary illustration demonstrated the effectiveness of the proposed turbidity early-warning system as a precautionary alarm of possible significant increase of downstream turbidity. This study is the first report of the establishment of the turbidity early-warning system. Hopefully, this system can be applied to source water turbidity forecasting during storm events and provide a useful reference for subsequent adjustment of drinking water treatment operation. PMID:24691737
Adamowski, J. F.
2008-12-01
Cyprus is in the middle of an unprecedented water crisis that has lasted several years. Four ideas that have been considered to aid in resolving the problem include imposing effective water use restrictions, implementing water demand reduction programs, optimizing water supply systems, and developing alternative water source strategies. A critical component of each of these initiatives is the accurate forecasting of short- term peak water demands. This study compared multiple linear regression and three types of artificial neural networks (ANNs) as methods for peak weekly water demand forecast modeling. Analysis was performed on six years of peak weekly water demand data and meteorological variables (maximum weekly temperature and total weekly rainfall) for two different regions (Athalassa and Public Garden) in the city of Nicosia, Cyprus. Twenty multiple linear regression models, twenty Levenberg-Marquardt ANN models, twenty Resilient Back- Propagation ANN models, and twenty Conjugate Gradient Powell-Beale ANN models were developed and their relative performance was compared. For both the Athalassa and Public Garden regions in Nicosia, the Levenberg-Marquardt ANN method was found to provide a more accurate forecast of peak weekly water demand than the other two types of ANNs and multiple linear regression. It was also found that the peak weekly water demand in Nicosia is better correlated with the rainfall occurrence rather than the amount of rainfall itself.
Baghirli, Orkhan
2015-01-01
Wind speed forecasting is critical for wind energy conversion systems since it greatly influences the issues such as scheduling of the power systems, and dynamic control of the wind turbines. Also, it plays an essential role for siting, sizing and improving the efficiency of wind power generation systems. Due to volatile and non-stationary nature of wind speed time series, wind speed forecasting has been proven to be a challenging task that requires adamant care and caution. There are several...
基于动态BP神经网络的财务危机预警算法研究%Efficient financial forecast based on dynamic back-propagation neural network
杨济亭
2013-01-01
Most of the classical methods in the investigations of financial forecast are generally based on a static pre-warning modeling by only exploring the single-period financial data, such as the signal-variable analysis, multiple-variables analysis, Logit regression analysis, which unfortunately ignores the potential influences from the historical data. In order to enhance the accuracy and stability of the financial forecasting, a promising dynamic back propagation ( BP) neural network relying on the Logit nonlinear mapping is proposed to perform financial forecasting. The historical panel data of financial companies is also fully taken into consideration in this new method, and different weights associated with different period data is used. The experimental results have demonstrated the effectiveness and the fair accuracy of the new forecasting model.%为进一步提升模型合理性和预测结果准确度,充分考虑公司财务情况历史值的影响,通过对不同时期的财务面板数据赋以不同权重,设计提出了一种基于Logit-动态BP神经网络的财务危机预警机制.实证结果显示,基于面板数据的新模型能更好地体现财务危机的发生机理,因而具备良好预警精度；在对财务危机公司及财务正常公司预警实验中,其预测性能均优于现有Logit回归分析模型和传统神经网络模型.
Rosas Ortiz, German
2000-01-01
Fault detection and diagnosis on transmission systems is an interesting area of investigation to Artificial Intelligence (AI) based systems. Neurocomputing is one of fastest growing areas of research in the fields of AI and pattern recognition. This work explores the possible suitability of pattern recognition approach of neural networks for fault detection and classification on power systems. The conventional detection techniques in modern relays are based in digital processing of signals and it need some time (around 1 cycle) to send a tripping signal, also they are likely to make incorrect decisions if the signals are noisy. It's desirable to develop a fast, accurate and robust approach that perform accurately for changing system conditions (like load variations and fault resistance). The aim of this work is to develop a novel technique based on Artificial Neural Networks (ANN), which explores the suitability of a pattern classification approach for fault detection and diagnosis. The suggested approach is based in the fact that when a fault occurs, a change in the system impedance take place and, as a consequence changes in amplitude and phase of line voltage and current signals take place. The ANN-based fault discriminator is trained to detect this changes as indicators of the instant of fault inception. This detector uses instantaneous values of these signals to make decisions. Suitability of using neural network as pattern classifiers for transmission systems fault diagnosis is described in detail a neural network design and simulation environment for real-time is presented. Results showing the performance of this approach are presented and indicate that it is fast, secure and exact enough, and it can be used in high speed fault detection and classification schemes. [Spanish] El diagnostico y la deteccion de fallas en sistemas de transmision es una area de interes en investigacion para sistemas basados en Inteligencia Artificial (IA). El calculo neuronal es una de las areas de investigacion de mas rapido crecimiento en el campo de la IA y el reconocimiento de patrones. Este trabajo explora la posible aplicabilidad de una tecnica de reconocimiento de patrones basada en redes neuronales para la deteccion y la clasificacion de fallas en un SEP. Las tecnicas convencionales de deteccion en los relevadores modernos se basan en un procesamiento digital de senales y requieren de cierto tiempo (alrededor de 1 ciclo) para enviar una senal de disparo, ademas de ser propensas a tomar decisiones incorrectas si las senales se encuentran contaminadas por ruido. Es deseable entonces desarrollar tecnicas que sean rapidas, exactas y robustas y que tengan un buen desempeno ante las condiciones cambiantes del sistema (como variaciones de carga y resistencia de falla, por ejemplo). El objetivo de este trabajo es desarrollar una tecnica novedosa basada en Redes Neuronales Atificales (RNA), la cual explora la aplicabilidad de la propuesta de reconocimiento de patrones para el diagnostico y deteccion de fallas. La tecnica sugerida se basa en el hecho de que cuando ocurre una falla, toma lugar un cambio de impedancia en el sistema y como consecuencia, cambios en la amplitud y fase de las senales de voltajes y corrientes de linea toman lugar. Se desarrolla un discriminador de fallas basado en redes neuronales que es entrenado para detectar estos cambios como indicadores del instante de ocurrencia de la falla. Este detector utiliza valores instantaneos de esas senales para tomar decisiones. Se describe a detalle la aplicabilidad de las redes neuronales como clasificadores de patrones para el diagnostico de fallas en sistemas de transmision y ademas, se presenta un diseno basado en redes neuronales y su ambiente de simulacion para la deteccion y clasificacion de fallas en tiempo real. Se presentan resultados del desempeno de esta tecnica que muestran que es rapida, segura y suficientemente exacta e indican su aplicabilidad dentro de esquemas de deteccion y clasificacion de fallas a muy alta velocidad.
吕学志; 范保新; 尹建; 王宪文
2014-01-01
在任务执行期合理、科学地确定维修任务的优先级别对于有序、高效地组织维修保障活动具有重要意义。提出了一种基于BP神经网络的维修任务优先级分类方法。详细介绍了神经网络模型的建模过程，其中重点介绍了模型设计，包括输入数据准备、输出数据准备与神经网络结构。所建立的神经网络模型通过对输入与输出的训练，可以学习准则与维修任务优先级之间的复杂关系，获得并表示决策者的偏好，有效地辅助决策者对维修任务优先级进行分类。%During mission, determining priority categories of maintenance task rationally and scientifically is valuable to effectiveness and efficiency of maintenance support. A priority sorting approach of maintenance task during mission based on BP neural networks is proposed. Modeling process of neural networks model is discussed in detail, and it focuses on model design that includes input data preparation, output data preparation and neural networks structure. Through training of input and output, established neural networks can learn complex relationship between criteria and priority of mainte-nance tasks, obtain preference of decision makers, help decision maker sort maintenance tasks according to their priority.
邓斌; 周志刚; 马泽粦; 易来龙; 张锡萍; 郭晃潮; 梅月志
2008-01-01
目的 应用BP人工神经网络模型探讨气象因素对肺结核病发病影响,同时建立肺结核病与气象因素关系的BP神经网络模型.方法 利用Matlab 6.5的Statistics Neural Network软件对气象因素与肺结核病关系的BP人工神经网络模型进行构建、训练与模拟.结果 经过数据训练得出理想网络模型,肺结核病发病回代误差均方、平均误差率和R2分别为0.00713、0.82和0.9081,说明所得人工神经网络模型效果理想.通过对自变量对输出量贡献量分析表明,平均蒸发量对肺结核发病影响最大,平均气压亦有一定影响.结论 肺结核与气象因素关系的BP人工神经网络模型效果良好,有助于进一步研究的价值.
Research on cloud and fog separation by a back-propagation (BP) network%遥感影像云雾分离的BP神经网络方法研究
陆衍
2015-01-01
The recognition and separation of cloud and heavy fog has been a particularly chalenging aspect of weather forecasting. Recently, on account of rapid socio-economic development, the harmful effects of fog have become increasingly serious, and some fog events have been classiifed as natural disasters. Thus, to prevent fog disasters, the monitoring of heavy fog and the development of early warning systems for heavy fog have become a focus of academic research. This study used an improved back propagation (BP) algorithm to build a BP neural network, using a train function to train the net and uses sim functions to simulate the net. In this way, areas of fog can be identiifed in remote sensing images. Experimental results show that the BP network can properly separate areas of fog from other meteorological features, thus producing good results in terms of prediction and early warning of conditions conducive to heavy fog.%使用改进算法构造BP神经网络，利用MATLAB中train函数训练，并用sim函数进行仿真，达到提取遥感影像中雾区的目的。图像处理结果表明，BP神经网络方法可以较好地分离影像中的雾区与其他地物。
GENETIC ALGORITHM AND NEURAL NETWORK FOR OPTICAL CHARACTER RECOGNITION
Hendy Yeremia
2013-01-01
Full Text Available Computer system has been able to recognize writing as human brain does. The method mostly used for character recognition is the backpropagation network. Backpropagation network has been known for its accuracy because it allows itself to learn and improving itself thus it can achieve higher accuracy. On the other hand, backpropagation was less to be used because of its time length needed to train the network to achieve the best result possible. In this study, backpropagation network algorithm is combined with genetic algorithm to achieve both accuracy and training swiftness for recognizing alphabets. Genetic algorithm is used to define the best initial values for the networkâs architecture and synapsesâ weight thus within a shorter period of time, the network could achieve the best accuracy. The optimized backpropagation network has better accuracy and less training time than the standard backpropagation network. The accuracy in recognizing character differ by 10, 77%, with a success rate of 90, 77% for the optimized backpropagation and 80% accuracy for the standard backpropagation network. The training time needed for backpropagation learning phase improved significantly from 03 h, 14 min and 40 sec, a standard backpropagation training time, to 02 h 18 min and 1 sec for the optimized backpropagation network.
Training Feedforward Neural Networks: An Algorithm Giving Improved Generalization.
Lee, Charles W.
1997-01-01
An algorithm is derived for supervised training in multilayer feedforward neural networks. Relative to the gradient descent backpropagation algorithm it appears to give both faster convergence and improved generalization, whilst preserving the system of backpropagating errors through the network. Copyright 1996 Elsevier Science Ltd. PMID:12662887
Incorporation of liquid-crystal light valve nonlinearities in optical multilayer neural networks.
Moerland, P D; Fiesler, E; Saxena, I
1996-09-10
Sigmoidlike activation functions, as available in analog hardware, differ in various ways from the standard sigmoidal function because they are usually asymmetric, truncated, and have a nonstandard gain. We present an adaptation of the backpropagation learning rule to compensate for these nonstandard sigmoids. This method is applied to multilayer neural networks with all-optical forward propagation and liquid-crystal light valves (LCLV) as optical thresholding devices. The results of simulations of a backpropagation neural network with five different LCLV response curves as activation functions are presented. Although LCLV's perform poorly with the standard backpropagation algorithm, it is shown that our adapted learning rule performs well with these LCLV curves. PMID:21127522
A study on the performance advancement of teat algorithm for defects in semiconductor packages
In this study, researchers classifying the artificial flaws in semiconductor packages are performed by pattern recognition technology. For this purposes, image pattern recognition package including the user made software was developed and total procedure including ultrasonic image acquisition, equalization filtration, binary process, edge detection and classifier design is treated by Backpropagation Neural Network. Specially, it is compared with various weights of Backpropagation Neural Network and it is compared with threshold level of edge detection in preprocessing method for entrance into Multi-Layer Perceptron(Backpropagation Neural network). Also, tile pattern recognition techniques is applied to the classification problem of defects in semiconductor packages as normal, crack, delamination. According to this results, it is possible to acquire the recognition rate of 100% for Backpropagation Neural Network.
Investigation Into The Effectiveness Of Long Short Term Memory Networks For Stock Price Prediction
Jia, Hengjian
2016-01-01
The effectiveness of long short term memory networks trained by backpropagation through time for stock price prediction is explored in this paper. A range of different architecture LSTM networks are constructed trained and tested.
Warping Similarity Space in Category Learning by Backprop Nets
Tijsseling, A.; Harnad, S.
1997-01-01
We report simulations with backpropagation networks trained to discriminate and then categorize a set of stimuli. The findings suggest a possible mechanism for categorical perception based on altering interstimulus similarity.
Recurrent networks for wave forecasting
Mandal, S.; Prabaharan, N.
, merchant vessel routing, nearshore construction, etc. more efficiently and safely. This paper presents an application of the Artificial Neural Network, namely Backpropagation Recurrent Neural Network (BRNN) with rprop update algorithm for wave forecasting...
Da Ros, Francesco; Sackey, I.; Jazayerifar, M.;
2015-01-01
Kerr nonlinearity compensation by optical phase conjugation is demonstrated in a WDM PDM 16-QAM system. Improved received signal quality is reported for both dispersion-compensated and dispersion-uncompensated transmission and a comparison with digital backpropagation is provided....
Mitigation of Linear and Nonlinear Impairments in Spectrally Efficient Superchannels
Porto da Silva, Edson; Larsen, Knud J.; Zibar, Darko
2015-01-01
We assess numerically the performance of single-carrier digital backpropagation and maximum-likelihood sequence detection (MLSD) for DP-QPSK superchannel transmission. It is shown that MLSD is advantageous only against inter-carrier linear crosstalk....
Neural Networks For Electrohydrodynamic Effect Modelling
Wiesław Wajs
2004-01-01
Full Text Available This paper presents currently achieved results concerning methods of electrohydrodynamiceffect used in geophysics simulated with feedforward networks trained with backpropagation algorithm, radial basis function networks and generalized regression networks.
Sumit Goyal; Gyanendra Kumar Goyal
2012-01-01
This paper presents the potential of Cascade Backpropagation algorithm based ANN models in detecting the shelf life of processed cheese stored at 30o C. Processed cheese is a dairy product made from ripened Cheddar cheese and sometimes a part of ripened cheese is replaced by fresh cheese; plus emulsifiers, extra salt, spices and food colorings. The cascade backpropagation algorithm (CBA) is the basis of a conceptual design for accelerating learning in ANNs. In this research input parameters w...
Context dependent learning in neural networks
Spreeuwers, L.J.; Zwaag, van der, Berend Jan; Heijden, van der, M.
1995-01-01
In this paper an extension to the standard error backpropagation learning rule for multi-layer feed forward neural networks is proposed, that enables them to be trained for context dependent information. The context dependent learning is realised by using a different error function (called Average Risk: AVR) in stead of the sum of squared errors (SQE) normally used in error backpropagation and by adapting the update rules. It is shown that for applications where this context dependent informa...
Dynamic recurrent neural networks
Pearlmutter, Barak A
1990-01-01
We survey learning algorithms for recurrent neural networks with hidden units and attempt to put the various techniques into a common framework. We discuss fixpoint learning algorithms, namely recurrent backpropagation and deterministic Boltzmann Machines, and non-fixpoint algorithms, namely backpropagation through time, Elman's history cutoff nets, and Jordan's output feedback architecture. Forward propagation, an online technique that uses adjoint equations, is also discussed. In many cases...
Nose Filho, Kenji; Araujo, Klayton A.M.; Maeda, Jorge L.Y.; Lotufo, Anna Diva P. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil)], Emails: kenjinose@yahoo.com.br, klayton_ama@hotmail.com, jorge-maeda@hotmail.com, annadiva@dee.feis.unesp.br
2009-07-01
This paper presents a development and implementation of a program to electrical load forecasting with data from a Brazilian electrical company, using four different architectures of neural networks of the MATLAB toolboxes: multilayer backpropagation gradient descendent with momentum, multilayer backpropagation Levenberg-Marquardt, adaptive network based fuzzy inference system and general regression neural network. The program presented a satisfactory performance, guaranteeing very good results. (author)
Macroeconomics modelling on UK GDP growth by neural computing
Li, Y.; Ng, K. C.; Häußler, A.; Chow, V; Muscatelli, A
1995-01-01
This paper presents multilayer neural networks used in UK gross domestic product estimation. These networks are trained by backpropagation and genetic algorithm based methods. Different from backpropagation guided by gradients of the performance, the genetic algorithm directly evaluates the performance of multiple sets of neural networks in parallel and then uses the analysed results to breed new networks that tend to be better suited to the problems in hand. It is shown that this guided evol...
J.Maria Mont Lorenzo
2001-01-01
The aim of this research is the use of the artificial neural networks models, specifically Multilayer Perceptrons trained by the algorithm known as Backpropagation to estimate the free housing prices. This methodology allows, through the training of the backpropagated nets, to estimate the houses prices on the basis of some variables, related to the houses, which are considered relevant (location, age, surface, quality, ...), overcoming the linear restrictions characteristic of the traditiona...
Vibration Based Damage Assessment of a Cantilever using a Neural Network
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated.......In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated....
Improving learning of neural networks for nuclear power plant transient classification
The backpropagation learning algorithm has proven to be a robust method for training feedforward multilayer neural networks to map the relationships between input/output patterns. However, as with many gradient descent optimization methods, the rate of convergence of the backpropagation algorithm decreases the closer it gets to the solution, and it requires judicious selection of the learning and momentum constants to achieve reasonable convergence and avoid oscillations about the optimum solution. In this paper, the discussion focuses on how the method of conjugate gradients can be combined with the backpropagation algorithm to improve and accelerate learning in neural networks and eliminate the process of selecting parameters. The proposed method was used to train a neural network to classify nuclear power plant transients, and it significantly expedited the learning process. 5 refs., 1 fig
Yadana Thein
2010-11-01
Full Text Available This paper contributes an effective recognition approach for Myanmar Handwritten Characters. In this article, Hybrid approach use ICR and OCR recognition through MICR (Myanmar Intelligent Character Recognition and back-propagation neural network. MICR is one kind of ICR. It composed of statistical/semantic information and final decision is made by voting system. In Hybrid approach, the features of statistical and semantic information of MICR have been used in back-propagation neural network as input nodes. So it needs a few input nodes to use. The back-propagation algorithm has been used to train the feed-forward neural network and adjustment of weights to require the desired output. The purpose of Hybrid approach to achieve the high accuracy rates and very fast recognition rate compare with other recognition systems. The experiments were carried out on 1000 words samples of different writer. Using Hybrid approach, over-all recognition accuracy of 95% was obtained.
USING NEURAL NETWORK FOR FINANCIAL APPLICATIONS ESTIMATIONS
Murat ŞEKER
2004-04-01
Full Text Available Examples of successful applications in Artificial Intelligence (AI field; With financial applications, Control, Communication, Processing Radar signals, Pattern Recognition, general DSP application, Nonlinear Systems can be given. In the financial applications, generally back propagation (Feedforwared algorithms of the Neural Network (NN uses. In this application, backpropagation algorithms applied to Multi Layer Feedforward Neural Network for the future estimations of foreign currency exchange rates data. The calculation results which was founded by using past exchange rates data "estimations that produce by Neural Network Layers and parameters, which carry out by backpropagation algorithms for different values" was compared with the real data for measuring the productivity of the method.
Linear GPR inversion for lossy soil and a planar air-soil interface
Meincke, Peter
2001-01-01
A three-dimensional inversion scheme for fixed-offset ground penetrating radar (GPR) is derived that takes into account the loss in the soil and the planar air-soil interface. The forward model of this inversion scheme is based upon the first Born approximation and the dyadic Green function for a...... two-layer medium. The forward model is inverted using the Tikhonov-regularized pseudo-inverse operator. This involves two steps: filtering and backpropagation. The filtering is carried out by numerically solving Fredholm integral equations of the first kind and the backpropagation is performed using...
How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagation
Bengio, Yoshua
2014-01-01
We propose to exploit {\\em reconstruction} as a layer-local training signal for deep learning. Reconstructions can be propagated in a form of target propagation playing a role similar to back-propagation but helping to reduce the reliance on derivatives in order to perform credit assignment across many levels of possibly strong non-linearities (which is difficult for back-propagation). A regularized auto-encoder tends produce a reconstruction that is a more likely version of its input, i.e., ...
Neural Approach for Calculating Permeability of Porous Medium
ZHANG Ji-Cheng; LIU Li; SONG Kao-Ping
2006-01-01
@@ Permeability is one of the most important properties of porous media. It is considerably difficult to calculate reservoir permeability precisely by using single well-logging response and simple formula because reservoir is of serious heterogeneity, and well-logging response curves are badly affected by many complicated factors underground. We propose a neural network method to calculate permeability of porous media. By improving the algorithm of the back-propagation neural network, convergence speed is enhanced and better results can be achieved. A four-layer back-propagation network is constructed to effectively calculate permeability from well log data.
Using Genetic Algorithms in Secured Business Intelligence Mobile Applications
Silvia TRIF
2011-01-01
Full Text Available The paper aims to assess the use of genetic algorithms for training neural networks used in secured Business Intelligence Mobile Applications. A comparison is made between classic back-propagation method and a genetic algorithm based training. The design of these algorithms is presented. A comparative study is realized for determining the better way of training neural networks, from the point of view of time and memory usage. The results show that genetic algorithms based training offer better performance and memory usage than back-propagation and they are fit to be implemented on mobile devices.
Convolutional networks and learning invariant to homogeneous multiplicative scalings
Tygert, Mark; Szlam, Arthur; Chintala, Soumith; Ranzato, Marc'Aurelio; Tian, Yuandong; Zaremba, Wojciech
2015-01-01
The conventional classification schemes -- notably multinomial logistic regression -- used in conjunction with convolutional networks (convnets) are classical in statistics, designed without consideration for the usual coupling with convnets, stochastic gradient descent, and backpropagation. In the specific application to supervised learning for convnets, a simple scale-invariant classification stage turns out to be more robust than multinomial logistic regression, appears to result in slight...
USING NEURAL NETWORK FOR FINANCIAL APPLICATIONS ESTIMATIONS
Şeker, Murat; E. Selim YILDIRIM; BERKAY, Ahmet
2004-01-01
Examples of successful applications in Artificial Intelligence (AI) field; With financial applications, Control, Communication, Processing Radar signals, Pattern Recognition, general DSP application, Nonlinear Systems can be given. In the financial applications, generally back propagation (Feedforwared) algorithms of the Neural Network (NN) uses. In this application, backpropagation algorithms applied to Multi Layer Feedforward Neural Network for the future estimations of foreign currency exc...
Suppressing Halo-chaos for Intense Ion Beamby Neural Network Adaptation Control Strategy
FANGJin-qing; LUOXiao-shu; WENGJia-qiang; ZHULun-wu
2003-01-01
Neural network has some advantages of adaptation, learn-self, self-organization and suitable for high-dimension for various applications in many fields, especially among them the feed-forward back-propagating neural network self-adaptation method is suitable for control of nonlinear systems.
Chen, Chau-Kuang
2010-01-01
Artificial Neural Network (ANN) and Support Vector Machine (SVM) approaches have been on the cutting edge of science and technology for pattern recognition and data classification. In the ANN model, classification accuracy can be achieved by using the feed-forward of inputs, back-propagation of errors, and the adjustment of connection weights. In…
Second-Order Learning Methods for a Multilayer Perceptron
First- and second-order learning methods for feed-forward multilayer neural networks are studied. Newton-type and quasi-Newton algorithms are considered and compared with commonly used back-propagation algorithm. It is shown that, although second-order algorithms require enhanced computer facilities, they provide better convergence and simplicity in usage. 13 refs., 2 figs., 2 tabs
Yorek, Nurettin; Ugulu, Ilker
2015-01-01
In this study, artificial neural networks are suggested as a model that can be "trained" to yield qualitative results out of a huge amount of categorical data. It can be said that this is a new approach applied in educational qualitative data analysis. In this direction, a cascade-forward back-propagation neural network (CFBPN) model was…
Multiobjective Tabu Search method used in chemistry
Rusu, T.; Bulacovschi, V.
The use of a combined artificial intelligence method in macromolecular chemistry design is described. This method implies a Back-Propagation (BP) Neural Network, modified for two-dimensional input data and for a system composed of a genetic algorithm extended by a Tabu Search operator used to incorporate high-level chemical knowledge: thermodynamic polymer properties.
Kv4 Potassium Channels Modulate Hippocampal EPSP-Spike Potentiation and Spatial Memory in Rats
Truchet, Bruno; Manrique, Christine; Sreng, Leam; Chaillan, Franck A.; Roman, Francois S.; Mourre, Christiane
2012-01-01
Kv4 channels regulate the backpropagation of action potentials (b-AP) and have been implicated in the modulation of long-term potentiation (LTP). Here we showed that blockade of Kv4 channels by the scorpion toxin AmmTX3 impaired reference memory in a radial maze task. In vivo, AmmTX3 intracerebroventricular (i.c.v.) infusion increased and…
Modeling Average Daily Traffic Volume using Neural Network-Wavelet Hybrid Method
Shahin Shabani
Full Text Available Forecasting traffic volume accurately and in a timely manner plays an important role to providing real-time traffic information, reducing congestion in pathways, and improving traffic safety. A combination of multi-layer back-propagation neural networks ( ...
Global Optimization Techniques for Fluid Flow and Propulsion Devices
Shyy, Wei; Papila, Nilay; Vaidyanathan, Raj; Tucker, Kevin; Griffin, Lisa; Dorney, Dan; Huber, Frank; Tran, Ken; Turner, James E. (Technical Monitor)
2001-01-01
This viewgraph presentation gives an overview of global optimization techniques for fluid flow and propulsion devices. Details are given on the need, characteristics, and techniques for global optimization. The techniques include response surface methodology (RSM), neural networks and back-propagation neural networks, design of experiments, face centered composite design (FCCD), orthogonal arrays, outlier analysis, and design optimization.
A framework for predicting three-dimensional prostate deformation in real time
Jahya, Alex; Herink, Mark; Misra, Sarthak
2013-01-01
Background Surgical simulation systems can be used to estimate soft tissue deformation during pre- and intra-operative planning. Such systems require a model that can accurately predict the deformation in real time. In this study, we present a back-propagation neural network for predicting three-dim
Tests of track segment and vertex finding with neural networks
Feed forward neural networks have been trained, using back-propagation, to find the slopes of simulated track segments in a straw chamber and to find the vertex of tracks from both simulated and real events in a more conventional drift chamber geometry. Network architectures, training, and performance are presented. 12 refs., 7 figs
Asif, Rameez
2014-01-01
We evaluated that in-line non-linear compensation schemes decrease the com- plexity of digital back-propagation and enhance the perfor mance of 40/112/224Gbit/s mixed line rate network. Both grouped and un-grouped spectral all ocation schemes are investigated....
Vehicle number plate recognition using multiple layer back propagation neural networks
tuti Asthana; Niresh Sharma, Rajdeep Singh
2011-01-01
Automatic Vehicle Number Plate Recognition is aspecial form of optical character recognition (OCR). Vehiclenumber plate recognition is a type of technology, mainlysoftware, which enables computer systems to read automaticallythe registration number of vehicles from digital pictures. Theproposed algorithm develops high quality recognition softwarefor the automatic recognition of vehicle license plates. In thisapproach Multilayer feed-forward back-propagation algorithmusing three hidden layers ...
A Monte-Carlo-Based Network Method for Source Positioning in Bioluminescence Tomography
Zhun Xu; Xiaolei Song; Xiaomeng Zhang; Jing Bai
2007-01-01
We present an approach based on the improved Levenberg Marquardt (LM) algorithm of backpropagation (BP) neural network to estimate the light source position in bioluminescent imaging. For solving the forward problem, the table-based random sampling algorithm (TBRS), a fast Monte Carlo simulation method ...
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving to be...
The transport of sediment and nutrients from land application areas is an environmental concern. New methods are needed for estimating soil and nutrient concentrations of runoff from cropland areas on which manure is applied. Artificial Neural Networks (ANN) trained with a Backpropagation (BP) algor...
A Newton-type neural network learning algorithm
First- and second-order learning methods for feed-forward multilayer networks are considered. A Newton-type algorithm is proposed and compared with the common back-propagation algorithm. It is shown that the proposed algorithm provides better learning quality. Some recommendations for their usage are given. 11 refs.; 1 fig.; 1 tab
SOLVING INVERSE KINEMATICS OF REDUNDANT MANIPULATOR BASED ON NEURAL NETWORK
无
2003-01-01
For the redundant manipulators, neural network is used to tackle the velocity inverse kinematics of robot manipulators. The neural networks utilized are multi-layered perceptions with a back-propagation training algorithm. The weight table is used to save the weights solving the inverse kinematics based on the different optimization performance criteria. Simulations verify the effectiveness of using neural network.
A brief review of feed-forward neural networks
SAZLI, Murat Hüsnü
2006-01-01
Artificial neural networks, or shortly neural networks, find applications in a very wide spectrum. In this paper, following a brief presentation of the basic aspects of feed-forward neural networks, their mostly used learning/training algorithm, the so-called back-propagation algorithm, have been described.
Jet analysis by neural networks in high energy hadron-hadron collisions
De Felice, P; Pasquariello, G; De Felice, P; Nardulli, G; Pasquariello, G
1995-01-01
We study the possibility to employ neural networks to simulate jet clustering procedures in high energy hadron-hadron collisions. We concentrate our analysis on the Fermilab Tevatron energy and on the k_\\bot algorithm. We consider both supervised multilayer feed-forward network trained by the backpropagation algorithm and unsupervised learning, where the neural network autonomously organizes the events in clusters.
JET ANALYSIS BY NEURAL NETWORKS IN HIGH ENERGY HADRON-HADRON COLLISIONS
De Felice, P.; Nardulli, G.; Pasquariello, G
1995-01-01
We study the possibility to employ neural networks to simulate jet clustering procedures in high energy hadron-hadron collisions. We concentrate our analysis on the Fermilab Tevatron energy and on the $k_\\bot$ algorithm. We consider both supervised multilayer feed-forward network trained by the backpropagation algorithm and unsupervised learning, where the neural network autonomously organizes the events in clusters.
A Plausible Memristor Implementation of Deep Learning Neural Networks
Negrov, D. V.; Karandashev, I. M.; Shakirov, V. V.; Matveyev, Yu. A.; Dunin-Barkowski, W. L.; Zenkevich, A. V.
2015-01-01
A possible method for hardware implementation of multilayer neural networks with the back-propagation learning algorithm employing memristor cross-bar matrices for weight storage is modeled. The proposed approach offers an efficient way to perform both learning and recognition operations. The solution of several arising problems, such as the representation and multiplication of signals as well as error propagation is proposed.
Use of a Neural Network for Damage Detection and Location in a Steel Member
Kirkegaard, Poul Henning; Rytter, A.
The paper explores the potential of using a Multilayer Perceptron (MLP) network trained with the Backpropagation algorithm for damage assessment of free-free cracked straight steel beam based on vibration measurements. The problem of damage assessment, i.e. detecting, locating and quantifying a...
Advances in Artificial Neural Networks - Methodological Development and Application
Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other ne...
On-line learning algorithms for locally recurrent neural networks.
Campolucci, P; Uncini, A; Piazza, F; Rao, B D
1999-01-01
This paper focuses on on-line learning procedures for locally recurrent neural networks with emphasis on multilayer perceptron (MLP) with infinite impulse response (IIR) synapses and its variations which include generalized output and activation feedback multilayer networks (MLN's). We propose a new gradient-based procedure called recursive backpropagation (RBP) whose on-line version, causal recursive backpropagation (CRBP), presents some advantages with respect to the other on-line training methods. The new CRBP algorithm includes as particular cases backpropagation (BP), temporal backpropagation (TBP), backpropagation for sequences (BPS), Back-Tsoi algorithm among others, thereby providing a unifying view on gradient calculation techniques for recurrent networks with local feedback. The only learning method that has been proposed for locally recurrent networks with no architectural restriction is the one by Back and Tsoi. The proposed algorithm has better stability and higher speed of convergence with respect to the Back-Tsoi algorithm, which is supported by the theoretical development and confirmed by simulations. The computational complexity of the CRBP is comparable with that of the Back-Tsoi algorithm, e.g., less that a factor of 1.5 for usual architectures and parameter settings. The superior performance of the new algorithm, however, easily justifies this small increase in computational burden. In addition, the general paradigms of truncated BPTT and RTRL are applied to networks with local feedback and compared with the new CRBP method. The simulations show that CRBP exhibits similar performances and the detailed analysis of complexity reveals that CRBP is much simpler and easier to implement, e.g., CRBP is local in space and in time while RTRL is not local in space. PMID:18252525
Initial Investigation of Software-Based Bone-Suppressed Imaging
Chest radiography is the most widely used imaging modality in medicine. However, the diagnostic performance of chest radiography is deteriorated by the anatomical background of the patient. So, dual energy imaging (DEI) has recently been emerged and demonstrated an improved. However, the typical DEI requires more than two projections, hence causing additional patient dose. The motion artifact is another concern in the DEI. In this study, we investigate DEI-like bone-suppressed imaging based on the post processing of a single radiograph. To obtain bone-only images, we use the artificial neural network (ANN) method with the error backpropagation-based machine learning approach. The computational load of learning process of the ANN is too heavy for a practical implementation because we use the gradient descent method for the error backpropagation. We will use a more advanced error propagation method for the learning process
A two layer perceptron with backpropagation of error is used for quantitative analysis in ICP-AES. The network was trained by emission spectra of two interfering lines of Cd and As and the concentrations of both elements were subsequently estimated from mixture spectra. The spectra of the Cd and As lines were also used to perform multiple linear regression (MLR) via the calculation of the pseudoinverse S+ of the sensitivity matrix S. In the present paper it is shown that there exist close relations between the operation of the perceptron and the MLR procedure. These are most clearly apparent in the correlation between the weights of the backpropagation network and the elements of the pseudoinverse. Using MLR, the confidence intervals over the predictions are exploited to correct for the optical device of the wavelength shift. (orig.)
FDI and Accommodation Using NN Based Techniques
Garcia, Ramon Ferreiro; de Miguel Catoira, Alberto; Sanz, Beatriz Ferreiro
Massive application of dynamic backpropagation neural networks is used on closed loop control FDI (fault detection and isolation) tasks. The process dynamics is mapped by means of a trained backpropagation NN to be applied on residual generation. Process supervision is then applied to discriminate faults on process sensors, and process plant parameters. A rule based expert system is used to implement the decision making task and the corresponding solution in terms of faults accommodation and/or reconfiguration. Results show an efficient and robust FDI system which could be used as the core of an SCADA or alternatively as a complement supervision tool operating in parallel with the SCADA when applied on a heat exchanger.
The development of intelligent expert system with SAT for semiconductor
Kim, Jae Yeol; Shim, Jae Gi; Jeong, Hyun Jo; Cho, Young Tae; Kim, Chang Hyun; Ko, Myung Soo [Chosun University, Gwangju (Korea, Republic of)
2001-05-15
In this study, the researches classifying the artificial flaws in semiconductor packages are performed using pattern recognition technology. For this purposes image pattern recognition package including the user made software was developed and total procedure including ultrasonic image acquisition, equalization filtering, binary processing, edge detection and classifier selection is treated by BP(backpropagation). Specially, it is compared IP(image processing) and SOM(self-organizing map) as preprocessing method for dimensionality reduction for entrance into multi-layer perceptron(backpropagation). Also, the pattern recognition techniques is applied to the classification problem of semiconductor flaws as crack, delamination. According to this results, it is possible to acquire the recognition rate of 83.4% about delamination, 75.7% about crack for SOM, and to acquire the recognition rate of 100% for BP.
Boundness of a Neural Network Weights Using the Notion of a Limit of a Sequence
Hazem Migdady
2014-05-01
Full Text Available feed forward neural network with backpropagation learning algorithm is considered as a black box learning classifier since there is no certain interpretation or anticipation of the behavior of a neural network weights. The weights of a neural network are considered as the learning tool of the classifier, and the learning task is performed by the repetition modification of those weights. This modification is performed using the delta rule which is mainly used in the gradient descent technique. In this article a proof is provided that helps to understand and explain the behavior of the weights in a feed forward neural network with backpropagation learning algorithm. Also, it illustrates why a feed forward neural network is not always guaranteed to converge in a global minimum. Moreover, the proof shows that the weights in the neural network are upper bounded (i.e. they do not approach infinity.
Sensitivity analysis by neural networks applied to power systems transient stability
Lotufo, Anna Diva P.; Lopes, Mara Lucia M.; Minussi, Carlos R. [Departamento de Engenharia Eletrica, UNESP, Campus de Ilha Solteira, Av. Brasil, 56, 15385-000 Ilha Solteira, SP (Brazil)
2007-05-15
This work presents a procedure for transient stability analysis and preventive control of electric power systems, which is formulated by a multilayer feedforward neural network. The neural network training is realized by using the back-propagation algorithm with fuzzy controller and adaptation of the inclination and translation parameters of the nonlinear function. These procedures provide a faster convergence and more precise results, if compared to the traditional back-propagation algorithm. The adaptation of the training rate is effectuated by using the information of the global error and global error variation. After finishing the training, the neural network is capable of estimating the security margin and the sensitivity analysis. Considering this information, it is possible to develop a method for the realization of the security correction (preventive control) for levels considered appropriate to the system, based on generation reallocation and load shedding. An application for a multimachine power system is presented to illustrate the proposed methodology. (author)
Farahnaz SADOUGHI
2014-03-01
Full Text Available Breast cancer is the most commonly diagnosed cancer and the most common cause of death in women all over the world. Use of computer technology supporting breast cancer diagnosing is now widespread and pervasive across a broad range of medical areas. Early diagnosis of this disease can greatly enhance the chances of long-term survival of breast cancer victims. Artificial Neural Networks (ANN as mainly method play important role in early diagnoses breast cancer. This paper studies Levenberg Marquardet Backpropagation (LMBP neural network and Levenberg Marquardet Backpropagation based Particle Swarm Optimization(LMBP-PSO for the diagnosis of breast cancer. The obtained results show that LMBP and LMBP based PSO system provides higher classification efficiency. But LMBP based PSO needs minimum training and testing time. It helps in developing Medical Decision System (MDS for breast cancer diagnosing. It can also be used as secondary observer in clinical decision making.
Extraction of Symbolic Rules from Artificial Neural Networks
Kamruzzaman, S M
2010-01-01
Although backpropagation ANNs generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions cannot be explained as those of decision trees. In many applications, it is desirable to extract knowledge from trained ANNs for the users to gain a better understanding of how the networks solve the problems. A new rule extraction algorithm, called rule extraction from artificial neural networks (REANN) is proposed and implemented to extract symbolic rules from ANNs. A standard three-layer feedforward ANN is the basis of the algorithm. A four-phase training algorithm is proposed for backpropagation learning. Explicitness of the extracted rules is supported by comparing them to the symbolic rules generated by other methods. Extracted rules are comparable with other methods in terms of number of rules, average number of conditions for a rule, and predictive accuracy. Extensive experimental studies on several benchmarks classification ...
Developing energy forecasting model using hybrid artificial intelligence method
Shahram Mollaiy-Berneti
2015-01-01
An important problem in demand planning for energy consumption is developing an accurate energy forecasting model. In fact, it is not possible to allocate the energy resources in an optimal manner without having accurate demand value. A new energy forecasting model was proposed based on the back-propagation (BP) type neural network and imperialist competitive algorithm. The proposed method offers the advantage of local search ability of BP technique and global search ability of imperialist competitive algorithm. Two types of empirical data regarding the energy demand (gross domestic product (GDP), population, import, export and energy demand) in Turkey from 1979 to 2005 and electricity demand (population, GDP, total revenue from exporting industrial products and electricity consumption) in Thailand from 1986 to 2010 were investigated to demonstrate the applicability and merits of the present method. The performance of the proposed model is found to be better than that of conventional back-propagation neural network with low mean absolute error.
Evolution of an artificial neural network based autonomous land vehicle controller.
Baluja, S
1996-01-01
This paper presents an evolutionary method for creating an artificial neural network based autonomous land vehicle controller. The evolved controllers perform better in unseen situations than those trained with an error backpropagation learning algorithm designed for this task. In this paper, an overview of the previous connectionist based approaches to this task is given, and the evolutionary algorithms used in this study are described in detail. Methods for reducing the high computational costs of training artificial neural networks with evolutionary algorithms are explored. Error metrics specific to the task of autonomous vehicle control are introduced; the evolutionary algorithms guided by these error metrics reveal improved performance over those guided by the standard sum-squared error metric. Finally, techniques for integrating evolutionary search and error backpropagation are presented. The evolved networks are designed to control Carnegie Mellon University's NAVLAB vehicles in road following tasks. PMID:18263046
Rozpoznávání číslic pomocí neuronové sítě
Doupovec, Zdeněk
2009-01-01
Tato práce popisuje základními pojmy a principy v oboru neuronových sítí. Blíže se pak věnuje problematice vícevrstvých perceptronových sítí, konkrétně metodě back-propagation. Jsou zde rozebrány výhody a nevýhody zmíněné metody, návrh možného systému rozpoznávání číslic pomocí back-propagation. Cílem je získat konkrétní výsledky z programu schopného rozpoznávat čísla.
A selective learning method to improve the generalization of multilayer feedforward neural networks.
Galván, I M; Isasi, P; Aler, R; Valls, J M
2001-04-01
Multilayer feedforward neural networks with backpropagation algorithm have been used successfully in many applications. However, the level of generalization is heavily dependent on the quality of the training data. That is, some of the training patterns can be redundant or irrelevant. It has been shown that with careful dynamic selection of training patterns, better generalization performance may be obtained. Nevertheless, generalization is carried out independently of the novel patterns to be approximated. In this paper, we present a learning method that automatically selects the training patterns more appropriate to the new sample to be predicted. This training method follows a lazy learning strategy, in the sense that it builds approximations centered around the novel sample. The proposed method has been applied to three different domains: two artificial approximation problems and a real time series prediction problem. Results have been compared to standard backpropagation using the complete training data set and the new method shows better generalization abilities. PMID:14632169
Learning multiple layers of representation.
Hinton, Geoffrey E
2007-10-01
To achieve its impressive performance in tasks such as speech perception or object recognition, the brain extracts multiple levels of representation from the sensory input. Backpropagation was the first computationally efficient model of how neural networks could learn multiple layers of representation, but it required labeled training data and it did not work well in deep networks. The limitations of backpropagation learning can now be overcome by using multilayer neural networks that contain top-down connections and training them to generate sensory data rather than to classify it. Learning multilayer generative models might seem difficult, but a recent discovery makes it easy to learn nonlinear distributed representations one layer at a time. PMID:17921042
Polynomial harmonic GMDH learning networks for time series modeling.
Nikolaev, Nikolay Y; Iba, Hitoshi
2003-12-01
This paper presents a constructive approach to neural network modeling of polynomial harmonic functions. This is an approach to growing higher-order networks like these build by the multilayer GMDH algorithm using activation polynomials. Two contributions for enhancement of the neural network learning are offered: (1) extending the expressive power of the network representation with another compositional scheme for combining polynomial terms and harmonics obtained analytically from the data; (2) space improving the higher-order network performance with a backpropagation algorithm for further gradient descent learning of the weights, initialized by least squares fitting during the growing phase. Empirical results show that the polynomial harmonic version phGMDH outperforms the previous GMDH, a Neurofuzzy GMDH and traditional MLP neural networks on time series modeling tasks. Applying next backpropagation training helps to achieve superior polynomial network performances. PMID:14622880
Rule Extraction using Artificial Neural Networks
Kamruzzaman, S M
2010-01-01
Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions are not as interpretable as those of decision trees. In many applications, it is desirable to extract knowledge from trained neural networks so that the users can gain a better understanding of the solution. This paper presents an efficient algorithm to extract rules from artificial neural networks. We use two-phase training algorithm for backpropagation learning. In the first phase, the number of hidden nodes of the network is determined automatically in a constructive fashion by adding nodes one after another based on the performance of the network on training data. In the second phase, the number of relevant input units of the network is determined using pruning algorithm. The ...
Initial Investigation of Software-Based Bone-Suppressed Imaging
Park, Eunpyeong; Youn, Hanbean; Kim, Ho Kyung [Pusan National University, Busan (Korea, Republic of)
2015-05-15
Chest radiography is the most widely used imaging modality in medicine. However, the diagnostic performance of chest radiography is deteriorated by the anatomical background of the patient. So, dual energy imaging (DEI) has recently been emerged and demonstrated an improved. However, the typical DEI requires more than two projections, hence causing additional patient dose. The motion artifact is another concern in the DEI. In this study, we investigate DEI-like bone-suppressed imaging based on the post processing of a single radiograph. To obtain bone-only images, we use the artificial neural network (ANN) method with the error backpropagation-based machine learning approach. The computational load of learning process of the ANN is too heavy for a practical implementation because we use the gradient descent method for the error backpropagation. We will use a more advanced error propagation method for the learning process.
The development of intelligent expert system with SAT for semiconductor
In this study, the researches classifying the artificial flaws in semiconductor packages are performed using pattern recognition technology. For this purposes image pattern recognition package including the user made software was developed and total procedure including ultrasonic image acquisition, equalization filtering, binary processing, edge detection and classifier selection is treated by BP(backpropagation). Specially, it is compared IP(image processing) and SOM(self-organizing map) as preprocessing method for dimensionality reduction for entrance into multi-layer perceptron(backpropagation). Also, the pattern recognition techniques is applied to the classification problem of semiconductor flaws as crack, delamination. According to this results, it is possible to acquire the recognition rate of 83.4% about delamination, 75.7% about crack for SOM, and to acquire the recognition rate of 100% for BP.
Tighter Lower Bounds on Mutual Information for Fiber-Optic Channels
Irukulapati, Naga V; Agrell, Erik; Johannisson, Pontus; Wymeersch, Henk
2016-01-01
In fiber-optic communications, evaluation of mutual information (MI) is still an open issue due to the unavailability of an exact and mathematically tractable channel model. Traditionally, lower bounds on MI are computed by approximating the (original) channel with an auxiliary forward channel. In this paper, lower bounds are computed using an auxiliary backward channel, which has not been previously considered in the context of fiber-optic communications. Distributions obtained through two variations of the stochastic digital backpropagation (SDBP) algorithm are used as auxiliary backward channels and these bounds are compared with bounds obtained through the conventional digital backpropagation (DBP). Through simulations, higher information rates were achieved with SDBP compared with DBP, which implies that tighter lower bound on MI can be achieved through SDBP.
Crop Classification by Forward Neural Network with Adaptive Chaotic Particle Swarm Optimization
Yudong Zhang
2011-05-01
Full Text Available This paper proposes a hybrid crop classifier for polarimetric synthetic aperture radar (SAR images. The feature sets consisted of span image, the H/A/α decomposition, and the gray-level co-occurrence matrix (GLCM based texture features. Then, the features were reduced by principle component analysis (PCA. Finally, a two-hidden-layer forward neural network (NN was constructed and trained by adaptive chaotic particle swarm optimization (ACPSO. K-fold cross validation was employed to enhance generation. The experimental results on Flevoland sites demonstrate the superiority of ACPSO to back-propagation (BP, adaptive BP (ABP, momentum BP (MBP, Particle Swarm Optimization (PSO, and Resilient back-propagation (RPROP methods. Moreover, the computation time for each pixel is only 1.08 × 10−7 s.
Handwritten Farsi Character Recognition using Artificial Neural Network
Ahangar, Reza Gharoie
2009-01-01
Neural Networks are being used for character recognition from last many years but most of the work was confined to English character recognition. Till date, a very little work has been reported for Handwritten Farsi Character recognition. In this paper, we have made an attempt to recognize handwritten Farsi characters by using a multilayer perceptron with one hidden layer. The error backpropagation algorithm has been used to train the MLP network. In addition, an analysis has been carried out to determine the number of hidden nodes to achieve high performance of backpropagation network in the recognition of handwritten Farsi characters. The system has been trained using several different forms of handwriting provided by both male and female participants of different age groups. Finally, this rigorous training results an automatic HCR system using MLP network. In this work, the experiments were carried out on two hundred fifty samples of five writers. The results showed that the MLP networks trained by the err...
MPPT control of wind generation systems based on FNN with PSO algorithm
Chih-Ming Hong, Whei-Min Lin, Chiung-Hsing Chen, Ting-Chia Ou
2011-09-01
Full Text Available This paper presents the design of an on-line training fuzzy neural network (FNN using back-propagation learning algorithm with particle swarm optimization (PSO regulating controller for the induction generator (IG. The PSO is adopted in this study to adapt the learning rates in the back-propagation process of the FNN to improve the learning capability. The proposed output maximization control is achieved without mechanical sensors such as the wind speed or position sensor, and the new control system will deliver maximum electric power with light weight, high efficiency, and high reliability. The estimation of the rotor speed is designed on the basis of the sliding mode control theory.
Liao, Pei-Hung; Hsu, Pei-Ti; Chu, William; Chu, Woei-Chyn
2015-06-01
This study applied artificial intelligence to help nurses address problems and receive instructions through information technology. Nurses make diagnoses according to professional knowledge, clinical experience, and even instinct. Without comprehensive knowledge and thinking, diagnostic accuracy can be compromised and decisions may be delayed. We used a back-propagation neural network and other tools for data mining and statistical analysis. We further compared the prediction accuracy of the previous methods with an adaptive-network-based fuzzy inference system and the back-propagation neural network, identifying differences in the questions and in nurse satisfaction levels before and after using the nursing information system. This study investigated the use of artificial intelligence to generate nursing diagnoses. The percentage of agreement between diagnoses suggested by the information system and those made by nurses was as much as 87 percent. When patients are hospitalized, we can calculate the probability of various nursing diagnoses based on certain characteristics. PMID:26021669
Indian Stock Market Prediction Using Differential Evolutionary Neural Network Model
Puspanjali Mohapatra; Alok Raj; Tapas Kumar Patra
2012-01-01
This paper presents a scheme using Differential Evolution based Functional Link Artificial Neural Network(FLANN) to predict the Indian Stock Market Indices. The Model uses Back-Propagation (BP) algorithm and Differential Evolution (DE) algorithm respectively for predicting the Stock Price Indices or one day, one week, two weeks and one month in advance.The Indian stock prices i.e. BSE (Bombay Stock Exchange), NSE,INFY etc. with few technical indicators are considered as input for the experime...
REN Hongwu; FANG Zujie
2000-01-01
A backpropagation (BP) network is applied to the inversion of spatially resolved diffuse reflectance from turbid media and then to determine its optical properties. A standard BP network may be trapped to the local minimum. A BP network with variable momentum and variable leaning rate can reduce this effect. After being trained, this network will produce reduced scattering coefficients and absorption coefficients when the spatially resolved diffuse reflectance are fed to its input.
Automatic Generation of Neural Networks
A. Fiszelew; P. Britos; G. Perichisky; R. García-Martínez
2003-01-01
This work deals with methods for finding optimal neural network architectures to learn particular problems. A genetic algorithm is used to discover suitable domain specific architectures; this evolutionary algorithm applies direct codification and uses the error from the trained network as a performance measure to guide the evolution. The network training is accomplished by the back-propagation algorithm; techniques such as training repetition, early stopping and complex regulation are employ...
Artificial Neural Networks, Symmetries and Differential Evolution
Urfalioglu, Onay; Arikan, Orhan
2010-01-01
Neuroevolution is an active and growing research field, especially in times of increasingly parallel computing architectures. Learning methods for Artificial Neural Networks (ANN) can be divided into two groups. Neuroevolution is mainly based on Monte-Carlo techniques and belongs to the group of global search methods, whereas other methods such as backpropagation belong to the group of local search methods. ANN's comprise important symmetry properties, which can influence Monte-Carlo methods....
Classification of Human Emotions from EEG Signals using Statistical Features and Neural Network
Chai Tong Yuen; Woo San San; Tan Ching Seong; Mohamed Rizon
2009-01-01
A statistical based system for human emotions classification by using electroencephalogram (EEG) is proposed in this paper. The data used in this study is acquired using EEG and the emotions are elicited from six human subjects under the effect of emotion stimuli. This paper also proposed an emotion stimulation experiment using visual stimuli. From the EEG data, a total of six statistical features are computed and back-propagation neural network is applied for the classification of human emot...
Extreme Learning Machine for land cover classification
Pal, Mahesh
2008-01-01
This paper explores the potential of extreme learning machine based supervised classification algorithm for land cover classification. In comparison to a backpropagation neural network, which requires setting of several user-defined parameters and may produce local minima, extreme learning machine require setting of one parameter and produce a unique solution. ETM+ multispectral data set (England) was used to judge the suitability of extreme learning machine for remote sensing classifications...
Manoj Tripathy
2012-01-01
This paper describes a new approach for power transformer differential protection which is based on the wave-shape recognition technique. An algorithm based on neural network principal component analysis (NNPCA) with back-propagation learning is proposed for digital differential protection of power transformer. The principal component analysis is used to preprocess the data from power system in order to eliminate redundant information and enhance hidden pattern of differential current to disc...
Image Segmentation Based on Support Vector Machine
XU Hai-xiang; ZHU Guang-xi; TIAN Jin-wen; ZHANG Xiang; PENG Fu-yuan
2005-01-01
Image segmentation is a necessary step in image analysis. Support vector machine (SVM) approach is proposed to segment images and its segmentation performance is evaluated.Experimental results show that: the effects of kernel function and model parameters on the segmentation performance are significant; SVM approach is less sensitive to noise in image segmentation; The segmentation performance of SVM approach is better than that of back-propagation multi-layer perceptron (BP-MLP) approach and fuzzy c-means (FCM) approach.
Reservoir computing for spatiotemporal signal classification without trained output weights
Prater, Ashley
2016-01-01
Reservoir computing is a recently introduced machine learning paradigm that has been shown to be well-suited for the processing of spatiotemporal data. Rather than training the network node connections and weights via backpropagation in traditional recurrent neural networks, reservoirs instead have fixed connections and weights among the `hidden layer' nodes, and traditionally only the weights to the output layer of neurons are trained using linear regression. We claim that for signal classif...
Information Theory for Analyzing Neural Networks
Sørngård, Bård
2014-01-01
The goal of this thesis was to investigate how information theory could be used to analyze artificial neural networks. For this purpose, two problems, a classification problem and a controller problem were considered. The classification problem was solved with a feedforward neural network trained with backpropagation, the controller problem was solved with a continuous-time recurrent neural network optimized with evolution.Results from the classification problem shows that mutual information ...
Neural Networks for Wordform Recognition
Eineborg, Martin; Gambäck, Björn
1994-01-01
The paper outlines a method for automatic lexical acquisition using three-layered back-propagation networks. Several experiments have been carried out where the performance of different network architectures have been compared to each other on two tasks: overall part-of-speech (noun, adjective or verb) classification and classification by a set of 13 possible output categories. The best results for the simple task were obtained by networks consisting of 204-212 input neurons...
Julio Rojas Naccha; Víctor Vásquez Villalobos
2012-01-01
The predictive ability of Artificial Neural Network (ANN) on the effect of the concentration (30, 40, 50 y 60 % w/w) and temperature (30, 40 y 50°C) of fructooligosaccharides solution, in the mass, moisture, volume and solids of osmodehydrated yacon cubes, and in the coefficients of the water means effective diffusivity with and without shrinkage was evaluated. The Feedforward type ANN with the Backpropagation training algorithms and the Levenberg-Marquardt weight adjustment was applied, usin...
Egg hatchability prediction by multiple linear regression and artificial neural networks
AC Bolzan; RAF Machado; JCZ Piaia
2008-01-01
An artificial neural network (ANN) was compared with a multiple linear regression statistical method to predict hatchability in an artificial incubation process. A feedforward neural network architecture was applied. Network trainings were made by the backpropagation algorithm based on data obtained from industrial incubations. The ANN model was chosen as it produced data that fit better the experimental data as compared to the multiple linear regression model, which used coefficients determi...
A study of diagnosis of loose part monitoring system using neural network
It is known that loose parts in the reactor coolant systems (RCS) cause serious damage into the systems. We applied the neural network algorithm to LPMS in order to estimate the mass of loose parts. We trained the impact test data of YGN3 using the backpropagation method. The input parameter for training is rising time, half period, maximum amplitude. The result showed that the neural network would be applied to LPMS