Backpropagation neural networks: pattern recognition
Studenikin, Oleg
2005-01-01
In this Master’s degree work artificial neural networks and back propagation learning algorithm for human faces and pattern recognition are analyzed. In the second part of work artificial neural networks and their architecture and structures models are analyzed. In the third part of article the backpropagation procedure and procedures theoretical learning principle are analyzed. In the fourth part different kinds of ANN methods and patterns extracting methods in recognition, learning and ...
Neural network construction via back-propagation
International Nuclear Information System (INIS)
Burwick, T.T.
1994-06-01
A method is presented that combines back-propagation with multi-layer neural network construction. Back-propagation is used not only to adjust the weights but also the signal functions. Going from one network to an equivalent one that has additional linear units, the non-linearity of these units and thus their effective presence is then introduced via back-propagation (weight-splitting). The back-propagated error causes the network to include new units in order to minimize the error function. We also show how this formalism allows to escape local minima
IMPLEMENTASI METODE BACKPROPAGATION DALAM KLASTERISASI OBJEK
Directory of Open Access Journals (Sweden)
Diaz D Santika
2007-05-01
Full Text Available Aim of the research was to prove that backpropagation method could be implemented for image recognitionwhile doing object classification. Observational method done was to do library research by reading and searching forinformation from various sources, then conduct analysis upon data, and last, design the application from analysisresults. From the evaluation that has been done, the result for accuration and speed are high enough (above 95%. Afteranalyzing evaluation result, it is concluded that backpropagation method could be implemented for object classification.
Conjugate descent formulation of backpropagation error in ...
African Journals Online (AJOL)
The feedforward neural network architecture uses backpropagation learning to determine optimal weights between dierent interconnected layers. This learning procedure uses a gradient descent technique applied to a sum-of-squares error function for the given input-output pattern. It employs an iterative procedure to ...
TAO-robust backpropagation learning algorithm.
Pernía-Espinoza, Alpha V; Ordieres-Meré, Joaquín B; Martínez-de-Pisón, Francisco J; González-Marcos, Ana
2005-03-01
In several fields, as industrial modelling, multilayer feedforward neural networks are often used as universal function approximations. These supervised neural networks are commonly trained by a traditional backpropagation learning format, which minimises the mean squared error (mse) of the training data. However, in the presence of corrupted data (outliers) this training scheme may produce wrong models. We combine the benefits of the non-linear regression model tau-estimates [introduced by Tabatabai, M. A. Argyros, I. K. Robust Estimation and testing for general nonlinear regression models. Applied Mathematics and Computation. 58 (1993) 85-101] with the backpropagation algorithm to produce the TAO-robust learning algorithm, in order to deal with the problems of modelling with outliers. The cost function of this approach has a bounded influence function given by the weighted average of two psi functions, one corresponding to a very robust estimate and the other to a highly efficient estimate. The advantages of the proposed algorithm are studied with an example.
Nonlinear Compensation with Modified Adaptive Digital Backpropagation in Flexigrid Networks
DEFF Research Database (Denmark)
Porto da Silva, Edson; Asif, Rameez; Larsen, Knud J.
2015-01-01
We present a modified version of adaptive digital backpropagation based on EVM metric, and numerically access its performance in a flexigrid WDM scenario.......We present a modified version of adaptive digital backpropagation based on EVM metric, and numerically access its performance in a flexigrid WDM scenario....
Tropical Timber Identification using Backpropagation Neural Network
Siregar, B.; Andayani, U.; Fatihah, N.; Hakim, L.; Fahmi, F.
2017-01-01
Each and every type of wood has different characteristics. Identifying the type of wood properly is important, especially for industries that need to know the type of timber specifically. However, it requires expertise in identifying the type of wood and only limited experts available. In addition, the manual identification even by experts is rather inefficient because it requires a lot of time and possibility of human errors. To overcome these problems, a digital image based method to identify the type of timber automatically is needed. In this study, backpropagation neural network is used as artificial intelligence component. Several stages were developed: a microscope image acquisition, pre-processing, feature extraction using gray level co-occurrence matrix and normalization of data extraction using decimal scaling features. The results showed that the proposed method was able to identify the timber with an accuracy of 94%.
Prediction of tides using back-propagation neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.
Prediction of tides is very much essential for human activities and to reduce the construction cost in marine environment. This paper presents an application of the artificial neural network with back-propagation procedures for accurate prediction...
Training Deep Spiking Neural Networks Using Backpropagation.
Lee, Jun Haeng; Delbruck, Tobi; Pfeiffer, Michael
2016-01-01
Deep spiking neural networks (SNNs) hold the potential for improving the latency and energy efficiency of deep neural networks through data-driven event-based computation. However, training such networks is difficult due to the non-differentiable nature of spike events. In this paper, we introduce a novel technique, which treats the membrane potentials of spiking neurons as differentiable signals, where discontinuities at spike times are considered as noise. This enables an error backpropagation mechanism for deep SNNs that follows the same principles as in conventional deep networks, but works directly on spike signals and membrane potentials. Compared with previous methods relying on indirect training and conversion, our technique has the potential to capture the statistics of spikes more precisely. We evaluate the proposed framework on artificially generated events from the original MNIST handwritten digit benchmark, and also on the N-MNIST benchmark recorded with an event-based dynamic vision sensor, in which the proposed method reduces the error rate by a factor of more than three compared to the best previous SNN, and also achieves a higher accuracy than a conventional convolutional neural network (CNN) trained and tested on the same data. We demonstrate in the context of the MNIST task that thanks to their event-driven operation, deep SNNs (both fully connected and convolutional) trained with our method achieve accuracy equivalent with conventional neural networks. In the N-MNIST example, equivalent accuracy is achieved with about five times fewer computational operations.
Analysis Resilient Algorithm on Artificial Neural Network Backpropagation
Saputra, Widodo; Tulus; Zarlis, Muhammad; Widia Sembiring, Rahmat; Hartama, Dedy
2017-12-01
Prediction required by decision makers to anticipate future planning. Artificial Neural Network (ANN) Backpropagation is one of method. This method however still has weakness, for long training time. This is a reason to improve a method to accelerate the training. One of Artificial Neural Network (ANN) Backpropagation method is a resilient method. Resilient method of changing weights and bias network with direct adaptation process of weighting based on local gradient information from every learning iteration. Predicting data result of Istanbul Stock Exchange training getting better. Mean Square Error (MSE) value is getting smaller and increasing accuracy.
Non-Linear Back-propagation: Doing Back-Propagation withoutDerivatives of the Activation Function
DEFF Research Database (Denmark)
Hertz, John; Krogh, Anders Stærmose; Lautrup, Benny
1997-01-01
The conventional linear back-propagation algorithm is replaced by a non-linear version, which avoids the necessity for calculating the derivative of the activation function. This may be exploited in hardware realizations of neural processors. In this paper we derive the non-linear back-propagatio......-propagation algorithms in the framework of recurrent back-propagation and present some numerical simulations of feed-forward networks on the NetTalk problem. A discussion of implementation in analog VLSI electronics concludes the paper.......The conventional linear back-propagation algorithm is replaced by a non-linear version, which avoids the necessity for calculating the derivative of the activation function. This may be exploited in hardware realizations of neural processors. In this paper we derive the non-linear back...
Impairment mitigation in superchannels with digital backpropagation and MLSD
DEFF Research Database (Denmark)
Porto da Silva, Edson; Larsen, Knud J.; Zibar, Darko
2015-01-01
We assess numerically the performance of single-carrier digital backpropagation (SC-DBP) and maximum-likelihood sequence detection (MLSD) for DP-QPSK and DP-16QAM superchannel transmission over dispersion uncompensated links for three different cases of spectral shaping: optical pre-filtering of ...
Backpropagation and ordered derivatives in the time scales calculus.
Seiffertt, John; Wunsch, Donald C
2010-08-01
Backpropagation is the most widely used neural network learning technique. It is based on the mathematical notion of an ordered derivative. In this paper, we present a formulation of ordered derivatives and the backpropagation training algorithm using the important emerging area of mathematics known as the time scales calculus. This calculus, with its potential for application to a wide variety of inter-disciplinary problems, is becoming a key area of mathematics. It is capable of unifying continuous and discrete analysis within one coherent theoretical framework. Using this calculus, we present here a generalization of backpropagation which is appropriate for cases beyond the specifically continuous or discrete. We develop a new multivariate chain rule of this calculus, define ordered derivatives on time scales, prove a key theorem about them, and derive the backpropagation weight update equations for a feedforward multilayer neural network architecture. By drawing together the time scales calculus and the area of neural network learning, we present the first connection of two major fields of research.
Kontrol Kecepatan Motor Induksi menggunakan Algoritma Backpropagation Neural Network
Directory of Open Access Journals (Sweden)
MUHAMMAD RUSWANDI DJALAL
2017-07-01
Full Text Available ABSTRAKBanyak strategi kontrol berbasis kecerdasan buatan telah diusulkan dalam penelitian seperti Fuzzy Logic dan Artificial Neural Network (ANN. Tujuan dari penelitian ini adalah untuk mendesain sebuah kontrol agar kecepatan motor induksi dapat diatur sesuai kebutuhan serta membandingkan kinerja motor induksi tanpa kontrol dan dengan kontrol. Dalam penelitian ini diusulkan sebuah metode artificial neural network untuk mengontrol kecepatan motor induksi tiga fasa. Kecepatan referensi motor diatur pada kecepatan 140 rad/s, 150 rad/s, dan 130 rad/s. Perubahan kecepatan diatur pada setiap interval 0.3 detik dan waktu simulasi maksimum adalah 0,9 detik. Kasus 1 tanpa kontrol, menunjukkan respon torka dan kecepatan dari motor induksi tiga fasa tanpa kontrol. Meskipun kecepatan motor induksi tiga fasa diatur berubah pada setiap 0,3 detik tidak akan mempengaruhi torka. Selain itu, motor induksi tiga fasa tanpa kontrol memiliki kinerja yang buruk dikarenakan kecepatan motor induksi tidak dapat diatur sesuai dengan kebutuhan. Kasus 2 dengan control backpropagation neural network, meskipun kecepatan motor induksi tiga fasa berubah pada setiap 0.3 detik tidak akan mempengaruhi torsi. Selain itu, kontrol backpropagation neural network memiliki kinerja yang baik dikarenakan kecepatan motor induksi dapat diatur sesuai dengan kebutuhan.Kata kunci: Backpropagation Neural Network (BPNN, NN Training, NN Testing, Motor.ABSTRACTMany artificial intelligence-based control strategies have been proposed in research such as Fuzzy Logic and Artificial Neural Network (ANN. The purpose of this research was design a control for the induction motor speed that could be adjusted as needed and compare the performance of induction motor without control and with control. In this research, it was proposed an artificial neural network method to control the speed of three-phase induction motors. The reference speed of motor was set at the rate of 140 rad / s, 150 rad / s, and 130
BACKPROPAGATION TRAINING ALGORITHM WITH ADAPTIVE PARAMETERS TO SOLVE DIGITAL PROBLEMS
Directory of Open Access Journals (Sweden)
R. Saraswathi
2011-01-01
Full Text Available An efficient technique namely Backpropagation training with adaptive parameters using Lyapunov Stability Theory for training single hidden layer feed forward network is proposed. A three-layered Feedforward neural network architecture is used to solve the selected problems. Sequential Training Mode is used to train the network. Lyapunov stability theory is employed to ensure the faster and steady state error convergence and to construct and energy surface with a single global minimum point through the adaptive adjustment of the weights and the adaptive parameter ß. To avoid local minima entrapment, an adaptive backpropagation algorithm based on Lyapunov stability theory is used. Lyapunov stability theory gives the algorithm, the efficiency of attaining a single global minimum point. The learning parameters used in this algorithm is responsible for the faster error convergence. The adaptive learning parameter used in this algorithm is chosen properly for faster error convergence. The error obtained has been asymptotically converged to zero according to Lyapunov Stability theory. The performance of the adaptive Backpropagation algorithm is measured by solving parity problem, half adder and full adder problems.
MIMO nonlinear ultrasonic tomography by propagation and backpropagation method.
Dong, Chengdong; Jin, Yuanwei
2013-03-01
This paper develops a fast ultrasonic tomographic imaging method in a multiple-input multiple-output (MIMO) configuration using the propagation and backpropagation (PBP) method. By this method, ultrasonic excitation signals from multiple sources are transmitted simultaneously to probe the objects immersed in the medium. The scattering signals are recorded by multiple receivers. Utilizing the nonlinear ultrasonic wave propagation equation and the received time domain scattered signals, the objects are to be reconstructed iteratively in three steps. First, the propagation step calculates the predicted acoustic potential data at the receivers using an initial guess. Second, the difference signal between the predicted value and the measured data is calculated. Third, the backpropagation step computes updated acoustical potential data by backpropagating the difference signal to the same medium computationally. Unlike the conventional PBP method for tomographic imaging where each source takes turns to excite the acoustical field until all the sources are used, the developed MIMO-PBP method achieves faster image reconstruction by utilizing multiple source simultaneous excitation. Furthermore, we develop an orthogonal waveform signaling method using a waveform delay scheme to reduce the impact of speckle patterns in the reconstructed images. By numerical experiments we demonstrate that the proposed MIMO-PBP tomographic imaging method results in faster convergence and achieves superior imaging quality.
Analysis of Accuracy and Epoch on Back-propagation BFGS Quasi-Newton
Silaban, Herlan; Zarlis, Muhammad; Sawaluddin
2017-12-01
Back-propagation is one of the learning algorithms on artificial neural networks that have been widely used to solve various problems, such as pattern recognition, prediction and classification. The Back-propagation architecture will affect the outcome of learning processed. BFGS Quasi-Newton is one of the functions that can be used to change the weight of back-propagation. This research tested some back-propagation architectures using classical back-propagation and back-propagation with BFGS. There are 7 architectures that have been tested on glass dataset with various numbers of neurons, 6 architectures with 1 hidden layer and 1 architecture with 2 hidden layers. BP with BFGS improves the convergence of the learning process. The average improvement convergence is 98.34%. BP with BFGS is more optimal on architectures with smaller number of neurons with decreased epoch number is 94.37% with the increase of accuracy about 0.5%.
Single-step digital backpropagation for nonlinearity mitigation
DEFF Research Database (Denmark)
Secondini, Marco; Rommel, Simon; Meloni, Gianluca
2015-01-01
Nonlinearity mitigation based on the enhanced split-step Fourier method (ESSFM) for the implementation of low-complexity digital backpropagation (DBP) is investigated and experimentally demonstrated. After reviewing the main computational aspects of DBP and of the conventional split-step Fourier...... is experimentally demonstrated by using a single-step DBP based on the ESSFM. The proposed DBP implementation requires only a single step of the ESSFM algorithm to achieve a transmission distance of 3200 km over a dispersion-unmanaged link. In comparison, a conventional DBP implementation requires 20 steps...
Forecasting the Number of Patients Diseases Using Backpropagation
Directory of Open Access Journals (Sweden)
Rachmad Aeri
2016-01-01
Full Text Available Forecasting with various types of disease is important for health centers, because it can be used to help the health center management in conducting strategic planning and decision making. Health Care Center Torjun in Indonesiahas made estimationabout the number of patients with various types of diseases, such as Acute Respiratory Infections(ISPA, RA(Rheumatoid Arthritis, diarrhea, HT(Hypertension, Skin Allergies, Conjunctivitis, Asthma, Febrile, TB(Tuberculosis. Lung, scabies, Gastritis, typus and scarlet fever with reports the number of patients with certain diseases in the coming period and prepare the necessary needs both medical services and as well as drugs for use later. In this study, Artificial Neural Network (ANN is one model that is used to identify patterns of images of people with various kinds of diseases. Backpropagation is one of the popular models of Neural Networkwhich is used for forecasting, prediction, and decision makers based on the input of data entry that has been studied in advance. The resultsis HT (0.35 %with parameters for forecasting system using Neural Network Backpropagation is the best of the trial results that shows disease HT which are obtained from the experiments. They predict the number of patients with a disease that needs to be watched for in the coming period and prepare all the needs of both medical and medication needed to handle the number of people with the disease.
LVQ and backpropagation neural networks applied to NASA SSME data
Doniere, Timothy F.; Dhawan, Atam P.
1993-01-01
Feedfoward neural networks with backpropagation learning have been used as function approximators for modeling the space shuttle main engine (SSME) sensor signals. The modeling of these sensor signals is aimed at the development of a sensor fault detection system that can be used during ground test firings. The generalization capability of a neural network based function approximator depends on the training vectors which in this application may be derived from a number of SSME ground test-firings. This yields a large number of training vectors. Large training sets can cause the time required to train the network to be very large. Also, the network may not be able to generalize for large training sets. To reduce the size of the training sets, the SSME test-firing data is reduced using the learning vector quantization (LVQ) based technique. Different compression ratios were used to obtain compressed data in training the neural network model. The performance of the neural model trained using reduced sets of training patterns is presented and compared with the performance of the model trained using complete data. The LVQ can also be used as a function approximator. The performance of the LVQ as a function approximator using reduced training sets is presented and compared with the performance of the backpropagation network.
Evolving Resilient Back-Propagation Algorithm for Energy Efficiency Problem
Directory of Open Access Journals (Sweden)
Yang Fei
2016-01-01
Full Text Available Energy efficiency is one of our most economical sources of new energy. When it comes to efficient building design, the computation of the heating load (HL and cooling load (CL is required to determine the specifications of the heating and cooling equipment. The objective of this paper is to model heating load and cooling load buildings using neural networks in order to predict HL load and CL load. Rprop with genetic algorithm was proposed to increase the global convergence capability of Rprop by modifying a corresponding weight. Comparison results show that Rprop with GA can successfully improve the global convergence capability of Rprop and achieve lower MSE than other perceptron training algorithms, such as Back-Propagation or original Rprop. In addition, the trained network has better generalization ability and stabilization performance.
PENERAPAN ALGORITMA BAYESIAN REGULARIZATION BACKPROPAGATION UNTUK MEMPREDIKSI PENYAKIT DIABETES
Directory of Open Access Journals (Sweden)
S Suwarno
2017-03-01
Full Text Available Pada tahun 2015, penderita diabetes di Indonesia sebanyak 10 juta jiwa. Banyaknya penderita diabetes ini semakin bertambah dari tahun ke tahun. Berdasarkan data International Diabetes Federation, diperkirakan pada tahun 2040 banyaknya penduduk Indonesia yang terkena penyakit diabates akan meningkat menjadi 16.2 juta jiwa penduduk. Upaya pendeteksian sejak dini penyakit diabetes perlu dilakukan. Hal ini untuk mengurangi komplikasi penyakit pada penderita pada masa yang akan datang. Neural network merupakan salah satu metode klasifikasi yang dapat digunakan untuk memprediksi penyakit diabetes. Penelitian ini bertujuan membuat sistem prediksi penyakit diabetes. Kinerja diagnostik sistem Jaringan syaraf tiruan dievaluasi menggunakan analisis Receiver Operating Characteristic (ROC untuk mengetahui tingkat accuracy, sensitivity, dan specificity. Hasil evaluasi menunjukkan klasifikasi menggunakan sistem jaringan syaraf tiruan backpropagation masuk ke dalam kriteria good classification. Artinya, hasil klasifikasi ini dapat digunakan untuk membuat sistem prediksi penyakit diabates.As 2015, an estimated 10 million people had diabetes in Indonesia. Trends suggested the rate would continue to rise year by year. According to the latest International Diabetes Federation, people living with diabetes is expected to rise to 16.2 million by 2040. Early detection of diabetes is needed to reduce number of people living with diabetes. Neural network classification is one method that can be used to predict diabetes. This research aims to make diabetes disease prediction systems. Artificial neural network diagnostic system performance was evaluated using analysis of Receiver Operating Characteristic (ROC to determine the level of accuracy, sensitivity, and specificity. The results of the evaluation showed that the classification system using backpropagation neural network is good. The results of the classification is used to make diabetes disease prediction
Rafique, Danish; Mussolin, Marco; Forzati, Marco; Mårtensson, Jonas; Chugtai, Mohsan N; Ellis, Andrew D
2011-05-09
We investigate a digital back-propagation simplification method to enable computationally-efficient digital nonlinearity compensation for a coherently-detected 112 Gb/s polarization multiplexed quadrature phase shifted keying transmission over a 1,600 km link (20 x 80 km) with no inline compensation. Through numerical simulation, we report up to 80% reduction in required back-propagation steps to perform nonlinear compensation, in comparison to the standard back-propagation algorithm. This method takes into account the correlation between adjacent symbols at a given instant using a weighted-average approach, and optimization of the position of nonlinear compensator stage to enable practical digital back-propagation. © 2011 Optical Society of America
Multithreading with separate data to improve the performance of Backpropagation method
Dhamma, Mulia; Zarlis, Muhammad; Budhiarti Nababan, Erna
2017-12-01
Backpropagation is one method of artificial neural network that can make a prediction for a new data with learning by supervised of the past data. The learning process of backpropagation method will become slow if we give too much data for backpropagation method to learn the data. Multithreading with a separate data inside of each thread are being used in order to improve the performance of backpropagtion method . Base on the research for 39 data and also 5 times experiment with separate data into 2 thread, the result showed that the average epoch become 6490 when using 2 thread and 453049 epoch when using only 1 thread. The most lowest epoch for 2 thread is 1295 and 1 thread is 356116. The process of improvement is caused by the minimum error from 2 thread that has been compared to take the weight and bias value. This process will be repeat as long as the backpropagation do learning.
Efficient Implementation of the Backpropagation Algorithm in FPGAs and Microcontrollers.
Ortega-Zamorano, Francisco; Jerez, Jose M; Urda Munoz, Daniel; Luque-Baena, Rafael M; Franco, Leonardo
2016-09-01
The well-known backpropagation learning algorithm is implemented in a field-programmable gate array (FPGA) board and a microcontroller, focusing in obtaining efficient implementations in terms of a resource usage and computational speed. The algorithm was implemented in both cases using a training/validation/testing scheme in order to avoid overfitting problems. For the case of the FPGA implementation, a new neuron representation that reduces drastically the resource usage was introduced by combining the input and first hidden layer units in a single module. Further, a time-division multiplexing scheme was implemented for carrying out product computations taking advantage of the built-in digital signal processor cores. In both implementations, the floating-point data type representation normally used in a personal computer (PC) has been changed to a more efficient one based on a fixed-point scheme, reducing system memory variable usage and leading to an increase in computation speed. The results show that the modifications proposed produced a clear increase in computation speed in comparison with the standard PC-based implementation, demonstrating the usefulness of the intrinsic parallelism of FPGAs in neurocomputational tasks and the suitability of both implementations of the algorithm for its application to the real world problems.
JARINGAN SARAF TIRUAN BACKPROPAGATION UNTUK APLIKASI PENGENALAN TANDA TANGAN
Directory of Open Access Journals (Sweden)
Fani Widiastuti
2015-04-01
Full Text Available Back propagation neural network is part of a multilayered feedforward neural network (MFN which has been developed and reliable enough to solve the problem of approximation and pattern classification. Application of artificial neural network (ANN in pattern recognition is one of the signature pattern recognition. Signature of each person are generally identical but not the same. This means that often a person's signature changes every time. This change concerns the position, size and pressure factors signature. Signature is the most widely used form of identification of a person. In general, to identify the signature is still done manually, by matching signatures at the time of the transaction with a valid signature. Therefore, we need a system that can analyze the characteristic signature making it easier to identify the person's signature. The research methodology used in the development of the system is a method Rappid Guidelines for Application Engineering (GRAPPLE, which only covers the design stage needs (Requirement Gathering, analysis (Analysis, the design (Design, and development (Development. This signature recognition process through several stages. First image through image processing stages, where the image will be used as the image of the gray / grayscaling. Once the image is converted into binary data by using thresholding. After going through the binary image processing, the data obtained will be the input value to the training process by using the backpropagation method. The results of the training will be used for the process of signature recognition. Image signatures used in this study were 80 image signatures from 10 respondents. The ratio between training data and testing data is 5:3. The test results show that the signature is able to recognize applications built with precision signature 84% of the tested signatures. Errors in the identification of signatures occur for several reasons, namely: the position of the signature
Directory of Open Access Journals (Sweden)
Yusuf Dwi Santoso
2017-06-01
Full Text Available Kepribadian merupakan gambaran tingkah laku dari individu. Penerimaan teman sebaya merupakan penilaian individu bahwa dirinya diterima, didengar, diperhatikan, dihargai, serta dapat merasa aman dan nyaman saat bersama dengan teman-teman dengan umur yang sama. Kepribadian dan penerimaan teman sebaya penting untuk diketahui agar dapat mengenal potensi diri. Tes kepribadian merupakan salah satu sarana untuk mengetahui dan mengklasifikasikan kepribadian seseorang ke tipe kepribadian tertentu. Jaringan syaraf tiruan Backpropagation dapat digunakan untuk melakukan klasifikasi sebuah pola berdasarkan permasalahan tertentu seperti halnya dalam mengklasifikasi tipe kepribadian dan penerimaan teman sebaya seseorang. Sistem klasifikasi tipe kepribadian dan penerimaan teman sebaya menggunakan jaringan syaraf tiruan Backpropagation dapat digunakan untuk mengklasifikasi tipe kepribadian dan penerimaan teman sebaya seseorang ke dalam beberapa tipe yaitu introvert diterima, introvert ditolak, ekstrovert diterima dan ekstrovert ditolak berdasarkan sejumlah set pertanyaan yang menjadi alat ukur dalam penentuan kepribadian. Sistem klasifikasi tipe kepribadian dan penerimaan teman sebaya menggunakan jaringan syaraf tiruan Backpropagation menghasilkan arsitektur Backpropagation terbaik untuk klasifikasi kepribadian dan penerimaan teman sebaya pada saat menggunakan 1 hidden layer dengan 7 neuron, 10000 epoch, nilai target error 0.01 dan laju pembelajaran 0.1. Hasil eksperimen jaringan syaraf tiruan Backpropagation pada sistem ini menghasilkan rata-rata tingkat akurasi 98.75% dan tingkat error 1.25%.
Leung, L Stan; Peloquin, Pascal
2006-01-01
Spike backpropagation has been proposed to enhance dendritic depolarization and synaptic plasticity. However, relatively little is known about the inhibitory control of spike backpropagation in vivo. In this study, the backpropagation of the antidromic spike into the dendrites of CA1 pyramidal cells was studied by extracellular recording in urethane-anesthetized rats. The population antidromic spike (pAS) in CA1 following stimulation of the alveus was recorded simultaneously with a 16-channel silicon probe and analyzed as current source density (CSD). The pAS current sink was shown to sequentially invade the soma and then the apical and basal dendrites. When the pAS was preceded sinks were reduced and delayed. Dendritic spike suppression was large after a high-intensity CA3 conditioning stimulus that evoked a population spike, small after a low-intensity CA3 conditioning stimulus, and weak after conditioning by another pAS. The late (150-400 ms latency) inhibition of the backpropagating pAS at the apical and basal dendrites was partially relieved by a GABA(B) receptor antagonist, CGP35348 or CGP56999A, given intracerebroventricularly (icv). CGP35348 icv also decreased the latency of the antidromic spike sinks at all depths. A compartment cable model of a CA1 pyramidal cell with excitable dendrites, combined with a model of extracellular potential generation, confirms that GABA(B) receptor activation delays a backpropagating spike and blocks distal dendritic spikes. GABA(B) receptor-mediated conductance increase and hyperpolarization, amplified by removing dendritic I(A) inactivation, contribute to conditioned dendritic spike suppression. In addition, the model shows that slow Na(+) channel inactivation also participates in conditioned spike suppression, which may partly explain the small dendritic spike suppression after conditioning with a weak orthodromic stimulus or another antidromic spike. Thus, both theory and experiment confirm an important role of the GABA
Modification Of Learning Rate With Lvq Model Improvement In Learning Backpropagation
Tata Hardinata, Jaya; Zarlis, Muhammad; Budhiarti Nababan, Erna; Hartama, Dedy; Sembiring, Rahmat W.
2017-12-01
One type of artificial neural network is a backpropagation, This algorithm trained with the network architecture used during the training as well as providing the correct output to insert a similar but not the same with the architecture in use at training.The selection of appropriate parameters also affects the outcome, value of learning rate is one of the parameters which influence the process of training, Learning rate affects the speed of learning process on the network architecture.If the learning rate is set too large, then the algorithm will become unstable and otherwise the algorithm will converge in a very long period of time.So this study was made to determine the value of learning rate on the backpropagation algorithm. LVQ models of learning rate is one of the models used in the determination of the value of the learning rate of the algorithm LVQ.By modifying this LVQ model to be applied to the backpropagation algorithm. From the experimental results known to modify the learning rate LVQ models were applied to the backpropagation algorithm learning process becomes faster (epoch less).
Wanto, Anjar; Zarlis, Muhammad; Sawaluddin; Hartama, Dedy
2017-12-01
Backpropagation is a good artificial neural network algorithm used to predict, one of which is to predict the rate of Consumer Price Index (CPI) based on the foodstuff sector. While conjugate gradient fletcher reeves is a suitable optimization method when juxtaposed with backpropagation method, because this method can shorten iteration without reducing the quality of training and testing result. Consumer Price Index (CPI) data that will be predicted to come from the Central Statistics Agency (BPS) Pematangsiantar. The results of this study will be expected to contribute to the government in making policies to improve economic growth. In this study, the data obtained will be processed by conducting training and testing with artificial neural network backpropagation by using parameter learning rate 0,01 and target error minimum that is 0.001-0,09. The training network is built with binary and bipolar sigmoid activation functions. After the results with backpropagation are obtained, it will then be optimized using the conjugate gradient fletcher reeves method by conducting the same training and testing based on 5 predefined network architectures. The result, the method used can increase the speed and accuracy result.
Fast Back-Propagation Learning Using Steep Activation Functions and Automatic Weight
Tai-Hoon Cho; Richard W. Conners; Philip A. Araman
1992-01-01
In this paper, several back-propagation (BP) learning speed-up algorithms that employ the Ã£gainÃ¤ parameter, i.e., steepness of the activation function, are examined. Simulations will show that increasing the gain seemingly increases the speed of convergence and that these algorithms can converge faster than the standard BP learning algorithm on some problems. However,...
An approach to the interpretation of backpropagation neural network models in QSAR studies.
Baskin, I I; Ait, A O; Halberstam, N M; Palyulin, V A; Zefirov, N S
2002-03-01
An approach to the interpretation of backpropagation neural network models for quantitative structure-activity and structure-property relationships (QSAR/QSPR) studies is proposed. The method is based on analyzing the first and second moments of distribution of the values of the first and the second partial derivatives of neural network outputs with respect to inputs calculated at data points. The use of such statistics makes it possible not only to obtain actually the same characteristics as for the case of traditional "interpretable" statistical methods, such as the linear regression analysis, but also to reveal important additional information regarding the non-linear character of QSAR/QSPR relationships. The approach is illustrated by an example of interpreting a backpropagation neural network model for predicting position of the long-wave absorption band of cyane dyes.
Ding, Weifu; Zhang, Jiangshe; Leung, Yee
2016-10-01
In this paper, we predict air pollutant concentration using a feedforward artificial neural network inspired by the mechanism of the human brain as a useful alternative to traditional statistical modeling techniques. The neural network is trained based on sparse response back-propagation in which only a small number of neurons respond to the specified stimulus simultaneously and provide a high convergence rate for the trained network, in addition to low energy consumption and greater generalization. Our method is evaluated on Hong Kong air monitoring station data and corresponding meteorological variables for which five air quality parameters were gathered at four monitoring stations in Hong Kong over 4 years (2012-2015). Our results show that our training method has more advantages in terms of the precision of the prediction, effectiveness, and generalization of traditional linear regression algorithms when compared with a feedforward artificial neural network trained using traditional back-propagation.
Directory of Open Access Journals (Sweden)
Suhendry Effendy
2010-12-01
Full Text Available This paper discusses the facial image recognition system using Discrete Wavelet Transform and back-propagation artificial neural network. Discrete Wavelet Transform processes the input image to obtain the essential features found on the face image. These features are then classified using an back-propagation artificial neural network for the input image to be identified. Testing the system using facial images in AT & T Database of Faces of 400 images comprising 40 facial images of individuals and web-camera catches as many as 100 images of 10 individuals. The accuracy of level of recognition on AT & T Database of Faces reaches 93.5%, while the accuracy of level of recognition on a web-camera capture images up to 96%. Testing is also done on image of AT & T Database of Faces with given noise. Apparently the noise in the image does not give meaningful effect on the level of recognition accuracy.
Chin Kim On; Teo Kein Yau; Rayner Alfred; Jason Teo; Patricia Anthony; Wang Cheng
2016-01-01
In this paper, we describe a research project that autonomously localizes and recognizes non-standardized Malaysian’s car plates using conventional Backpropagation algorithm (BPP) in combination with Ensemble Neural Network (ENN). We compared the results with the results obtained using simple Feed-Forward Neural Network (FFNN). This research aims to solve four main issues; (1) localization of car plates that has the same colour with the vehicle colour, (2) detection and recognition of car pla...
IMPLEMENTASI BACKPROPAGATION NEURAL NETWORK DALAM PRAKIRAAN CUACA DI DAERAH BALI SELATAN
Directory of Open Access Journals (Sweden)
I MADE DWI UDAYANA PUTRA
2016-11-01
Full Text Available Weather information has an important role in human life in various fields, such as agriculture, marine, and aviation. The accurate weather forecasts are needed in order to improve the performance of various fields. In this study, use artificial neural network method with backpropagation learning algorithm to create a model of weather forecasting in the area of ??South Bali. The aim of this study is to determine the effect of the number of neurons in the hidden layer and to determine the level of accuracy of the method of artificial neural network with backpropagation learning algorithm in weather forecast models. Weather forecast models in this study use input of the factors that influence the weather, namely air temperature, dew point, wind speed, visibility, and barometric pressure.The results of testing the network with a different number of neurons in the hidden layer of artificial neural network method with backpropagation learning algorithms show that the increase in the number of neurons in the hidden layer is not directly proportional to the value of the accuracy of the weather forecasts, the increase in the number of neurons in the hidden layer does not necessarily increase or decrease value accuracy of weather forecasts we obtain the best accuracy rate of 51.6129% on a network model with three neurons in the hidden layer.
Multifactor-influenced energy consumption forecasting using enhanced back-propagation neural network
International Nuclear Information System (INIS)
Zeng, Yu-Rong; Zeng, Yi; Choi, Beomjin; Wang, Lin
2017-01-01
Reliable energy consumption forecasting can provide effective decision-making support for planning development strategies to energy enterprises and for establishing national energy policies. Accordingly, the present study aims to apply a hybrid intelligent approach named ADE–BPNN, the back-propagation neural network (BPNN) model supported by an adaptive differential evolution algorithm, to estimate energy consumption. Most often, energy consumption is influenced by socioeconomic factors. The proposed hybrid model incorporates gross domestic product, population, import, and export data as inputs. An improved differential evolution with adaptive mutation and crossover is utilized to find appropriate global initial connection weights and thresholds to enhance the forecasting performance of the BPNN. A comparative example and two extended examples are utilized to validate the applicability and accuracy of the proposed ADE–BPNN model. Errors of the test data sets indicate that the ADE–BPNN model can effectively predict energy consumption compared with the traditional back-propagation neural network model and other popular existing models. Moreover, mean impact value based analysis is conducted for electrical energy consumption in U.S. and total energy consumption forecasting in China to quantitatively explore the relative importance of each input variable for the improvement of effective energy consumption prediction. - Highlights: • Enhanced back-propagation neural network (ADE-BPNN) for energy consumption forecasting. • ADE-BPNN outperforms the current best models for two comparative cases. • Mean impact value approach explores socio-economic factors' relative importance. • ADE-BPNN's adjusted goodness-of-fit is 99.2% for China's energy consumption forecasting.
Wutsqa, D. U.; Marwah, M.
2017-06-01
In this paper, we consider spatial operation median filter to reduce the noise in the cervical images yielded by colposcopy tool. The backpropagation neural network (BPNN) model is applied to the colposcopy images to classify cervical cancer. The classification process requires an image extraction by using a gray level co-occurrence matrix (GLCM) method to obtain image features that are used as inputs of BPNN model. The advantage of noise reduction is evaluated by comparing the performances of BPNN models with and without spatial operation median filter. The experimental result shows that the spatial operation median filter can improve the accuracy of the BPNN model for cervical cancer classification.
Digital back-propagation for nonlinearity mitigation in distributed Raman amplified links.
Saavedra, Gabriel; Semrau, Daniel; Galdino, Lidia; Killey, Robert I; Bayvel, Polina
2017-03-06
The performance of digital back-propagation (DBP) for distributed Raman amplified optical communication systems is evaluated through analytical models and numerical simulations, and is compared with conventional lumped amplifier solutions, such as EDFA. The complexity of the DBP algorithm including the characteristic signal power profile of distributed Raman amplifiers is assessed. The use of full-field DBP in distributed Raman amplified systems leads to 1.3 dB additional gain with respect to systems employing lumped amplification, at the cost of only a 25% increase in complexity.
Karanov, Boris; Xu, Tianhua; Shevchenko, Nikita A; Lavery, Domaniç; Killey, Robert I; Bayvel, Polina
2017-10-16
The optimisation of span length when designing optical communication systems is important from both performance and cost perspectives. In this paper, the optimisation of inter-amplifier spacing and the potential increase of span length at fixed information rates in optical communication systems with practically feasible nonlinearity compensation schemes have been investigated. It is found that in DP-16QAM, DP-64QAM and DP-256QAM systems with practical transceiver noise limitations, single-channel digital backpropagation can allow a 50% reduction in the number of amplifiers without sacrificing information rates compared to systems with optimal span lengths and linear compensation.
Application of artificial neural networks with backpropagation technique in the financial data
Jaiswal, Jitendra Kumar; Das, Raja
2017-11-01
The propensity of applying neural networks has been proliferated in multiple disciplines for research activities since the past recent decades because of its powerful control with regulatory parameters for pattern recognition and classification. It is also being widely applied for forecasting in the numerous divisions. Since financial data have been readily available due to the involvement of computers and computing systems in the stock market premises throughout the world, researchers have also developed numerous techniques and algorithms to analyze the data from this sector. In this paper we have applied neural network with backpropagation technique to find the data pattern from finance section and prediction for stock values as well.
Desain Sistem Pendeteksi untuk Citra Base Sub-assembly dengan Algoritma Backpropagation
Directory of Open Access Journals (Sweden)
Kasdianto Kasdianto
2017-04-01
Full Text Available Object identification technique using machine vision has been implemented in industrial of electronic manufacturers for years. This technique is commonly used for reject detection (for disqualified product based on existing standard or defect detection. This research aims to build a reject detector of sub-assembly condition which is differed by two conditions that are missing screw and wrong position screw using neural network backpropagation. The image taken using camera will be converted into grayscale before it is processed in backpropagation methods to generate a weight value. The experiment result shows that the network architecture with two layers has the most excellent accuracy level. Using learning rate of 0.5, target error 0.015%, and the number of node 1 of 100 and node 2 of 50, the successive rate for sub-assembly detection in right condition reached 99.02% while no error occurs in detecting the wrong condition of Sub-assembly (missing screw and wrong position screw.
Energy Technology Data Exchange (ETDEWEB)
Kerr, John Patrick [Iowa State Univ., Ames, IA (United States)
1992-01-01
The objective of this study was to determine the feasibility of using an Artificial Neural Network (ANN), in particular a backpropagation ANN, to improve the speed and quality of the reconstruction of three-dimensional SPECT (single photon emission computed tomography) images. In addition, since the processing elements (PE)s in each layer of an ANN are independent of each other, the speed and efficiency of the neural network architecture could be better optimized by implementing the ANN on a massively parallel computer. The specific goals of this research were: to implement a fully interconnected backpropagation neural network on a serial computer and a SIMD parallel computer, to identify any reduction in the time required to train these networks on the parallel machine versus the serial machine, to determine if these neural networks can learn to recognize SPECT data by training them on a section of an actual SPECT image, and to determine from the knowledge obtained in this research if full SPECT image reconstruction by an ANN implemented on a parallel computer is feasible both in time required to train the network, and in quality of the images reconstructed.
STUDY COMPARISON OF SVM-, K-NN- AND BACKPROPAGATION-BASED CLASSIFIER FOR IMAGE RETRIEVAL
Directory of Open Access Journals (Sweden)
Muhammad Athoillah
2015-03-01
Full Text Available Classification is a method for compiling data systematically according to the rules that have been set previously. In recent years classification method has been proven to help many peopleâ€™s work, such as image classification, medical biology, traffic light, text classification etc. There are many methods to solve classification problem. This variation method makes the researchers find it difficult to determine which method is best for a problem. This framework is aimed to compare the ability of classification methods, such as Support Vector Machine (SVM, K-Nearest Neighbor (K-NN, and Backpropagation, especially in study cases of image retrieval with five category of image dataset. The result shows that K-NN has the best average result in accuracy with 82%. It is also the fastest in average computation time with 17,99 second during retrieve session for all categories class. The Backpropagation, however, is the slowest among three of them. In average it needed 883 second for training session and 41,7 second for retrieve session.
Knowledge Mining from Clinical Datasets Using Rough Sets and Backpropagation Neural Network
Directory of Open Access Journals (Sweden)
Kindie Biredagn Nahato
2015-01-01
Full Text Available The availability of clinical datasets and knowledge mining methodologies encourages the researchers to pursue research in extracting knowledge from clinical datasets. Different data mining techniques have been used for mining rules, and mathematical models have been developed to assist the clinician in decision making. The objective of this research is to build a classifier that will predict the presence or absence of a disease by learning from the minimal set of attributes that has been extracted from the clinical dataset. In this work rough set indiscernibility relation method with backpropagation neural network (RS-BPNN is used. This work has two stages. The first stage is handling of missing values to obtain a smooth data set and selection of appropriate attributes from the clinical dataset by indiscernibility relation method. The second stage is classification using backpropagation neural network on the selected reducts of the dataset. The classifier has been tested with hepatitis, Wisconsin breast cancer, and Statlog heart disease datasets obtained from the University of California at Irvine (UCI machine learning repository. The accuracy obtained from the proposed method is 97.3%, 98.6%, and 90.4% for hepatitis, breast cancer, and heart disease, respectively. The proposed system provides an effective classification model for clinical datasets.
Witoonchart, Peerajak; Chongstitvatana, Prabhas
2017-08-01
In this study, for the first time, we show how to formulate a structured support vector machine (SSVM) as two layers in a convolutional neural network, where the top layer is a loss augmented inference layer and the bottom layer is the normal convolutional layer. We show that a deformable part model can be learned with the proposed structured SVM neural network by backpropagating the error of the deformable part model to the convolutional neural network. The forward propagation calculates the loss augmented inference and the backpropagation calculates the gradient from the loss augmented inference layer to the convolutional layer. Thus, we obtain a new type of convolutional neural network called an Structured SVM convolutional neural network, which we applied to the human pose estimation problem. This new neural network can be used as the final layers in deep learning. Our method jointly learns the structural model parameters and the appearance model parameters. We implemented our method as a new layer in the existing Caffe library. Copyright © 2017 Elsevier Ltd. All rights reserved.
Facial Expression Recognition By Using Fisherface Methode With Backpropagation Neural Network
Directory of Open Access Journals (Sweden)
Zaenal Abidin
2011-01-01
Full Text Available Abstract— In daily lives, especially in interpersonal communication, face often used for expression. Facial expressions give information about the emotional state of the person. A facial expression is one of the behavioral characteristics. The components of a basic facial expression analysis system are face detection, face data extraction, and facial expression recognition. Fisherface method with backpropagation artificial neural network approach can be used for facial expression recognition. This method consists of two-stage process, namely PCA and LDA. PCA is used to reduce the dimension, while the LDA is used for features extraction of facial expressions. The system was tested with 2 databases namely JAFFE database and MUG database. The system correctly classified the expression with accuracy of 86.85%, and false positive 25 for image type I of JAFFE, for image type II of JAFFE 89.20% and false positive 15, for type III of JAFFE 87.79%, and false positive for 16. The image of MUG are 98.09%, and false positive 5. Keywords— facial expression, fisherface method, PCA, LDA, backpropagation neural network.
Directory of Open Access Journals (Sweden)
Ikhthison Mekongga
2014-02-01
Full Text Available The need for bandwidth has been increasing recently. This is because the development of internet infrastructure is also increasing so that we need an economic and efficient provider system. This can be achieved through good planning and a proper system. The prediction of the bandwidth consumption is one of the factors that support the planning for an efficient internet service provider system. Bandwidth consumption is predicted using ANN. ANN is an information processing system which has similar characteristics as the biologic al neural network. ANN is chosen to predict the consumption of the bandwidth because ANN has good approachability to non-linearity. The variable used in ANN is the historical load data. A bandwidth consumption information system was built using neural networks with a backpropagation algorithm to make the use of bandwidth more efficient in the future both in the rental rate of the bandwidth and in the usage of the bandwidth.Keywords: Forecasting, Bandwidth, Backpropagation
A modified backpropagation algorithm for training neural networks on data with error bars
International Nuclear Information System (INIS)
Gernoth, K.A.; Clark, J.W.
1994-08-01
A method is proposed for training multilayer feedforward neural networks on data contaminated with noise. Specifically, we consider the case that the artificial neural system is required to learn a physical mapping when the available values of the target variable are subject to experimental uncertainties, but are characterized by error bars. The proposed method, based on maximum likelihood criterion for parameter estimation, involves simple modifications of the on-line backpropagation learning algorithm. These include incorporation of the error-bar assignments in a pattern-specific learning rate, together with epochal updating of a new measure of model accuracy that replaces the usual mean-square error. The extended backpropagation algorithm is successfully tested on two problems relevant to the modelling of atomic-mass systematics by neural networks. Provided the underlying mapping is reasonably smooth, neural nets trained with the new procedure are able to learn the true function to a good approximation even in the presence of high levels of Gaussian noise. (author). 26 refs, 2 figs, 5 tabs
Hsieh, Lawrence S.; Levine, Eric S.
2013-01-01
Endocannabinoids (eCBs) play a prominent role in regulating synaptic signaling throughout the brain. In layer 2/3 of the neocortex, eCB-mediated suppression of GABA release results in an enhanced excitability of pyramidal neurons (PNs). The eCB system is also involved in spike timing-dependent plasticity that is dependent on backpropagating action potentials (bAPs). Dendritic backpropagation plays an important role in many aspects of neuronal function, and can be modulated by intrinsic dendritic conductances as well as by synaptic inputs. The present studies explored a role for the eCB system in modulating backpropagation in PN dendrites. Using dendritic calcium imaging and somatic patch clamp recordings from mouse somatosensory cortical slices, we found that activation of type 1 cannabinoid receptors potentiated bAP-induced calcium transients in apical dendrites of layer 2/3 but not layer 5 PNs. This effect was mediated by suppression of GABAergic transmission, because it was prevented by a GABAA receptor antagonist and was correlated with cannabinoid suppression of inhibitory synaptic activity. Finally, we found that activity-dependent eCB release during depolarization-induced suppression of inhibition enhanced bAP-induced dendritic calcium transients. Taken together, these results point to a potentially important role for the eCB system in regulating dendritic backpropagation in layer 2/3 PNs. PMID:22693342
Werdiningsih, Indah; Zaman, Badrus; Nuqoba, Barry
2017-08-01
This paper presents classification of brain cancer using wavelet transformation and Adaptive Neighborhood Based Modified Backpropagation (ANMBP). Three stages of the processes, namely features extraction, features reduction, and classification process. Wavelet transformation is used for feature extraction and ANMBP is used for classification process. The result of features extraction is feature vectors. Features reduction used 100 energy values per feature and 10 energy values per feature. Classifications of brain cancer are normal, alzheimer, glioma, and carcinoma. Based on simulation results, 10 energy values per feature can be used to classify brain cancer correctly. The correct classification rate of proposed system is 95 %. This research demonstrated that wavelet transformation can be used for features extraction and ANMBP can be used for classification of brain cancer.
The Performance of EEG-P300 Classification using Backpropagation Neural Networks
Directory of Open Access Journals (Sweden)
Arjon Turnip
2013-12-01
Full Text Available Electroencephalogram (EEG recordings signal provide an important function of brain-computer communication, but the accuracy of their classification is very limited in unforeseeable signal variations relating to artifacts. In this paper, we propose a classification method entailing time-series EEG-P300 signals using backpropagation neural networks to predict the qualitative properties of a subject’s mental tasks by extracting useful information from the highly multivariate non-invasive recordings of brain activity. To test the improvement in the EEG-P300 classification performance (i.e., classification accuracy and transfer rate with the proposed method, comparative experiments were conducted using Bayesian Linear Discriminant Analysis (BLDA. Finally, the result of the experiment showed that the average of the classification accuracy was 97% and the maximum improvement of the average transfer rate is 42.4%, indicating the considerable potential of the using of EEG-P300 for the continuous classification of mental tasks.
Autonomous path planning solution for industrial robot manipulator using backpropagation algorithm
Directory of Open Access Journals (Sweden)
PeiJiang Yuan
2015-12-01
Full Text Available Here, we propose an autonomous path planning solution using backpropagation algorithm. The mechanism of movement used by humans in controlling their arms is analyzed and then applied to control a robot manipulator. Autonomous path planning solution is a numerical method. The model of industrial robot manipulator used in this article is a KUKA KR 210 R2700 EXTRA robot. In order to show the performance of the autonomous path planning solution, an experiment validation of path tracking is provided. Experiment validation consists of implementation of the autonomous path planning solution and the control of physical robot. The process of converging to target solution is provided. The mean absolute error of position for tool center point is also analyzed. Comparison between autonomous path planning solution and the numerical methods based on Newton–Raphson algorithm is provided to demonstrate the efficiency and accuracy of the autonomous path planning solution.
A new backpropagation learning algorithm for layered neural networks with nondifferentiable units.
Oohori, Takahumi; Naganuma, Hidenori; Watanabe, Kazuhisa
2007-05-01
We propose a digital version of the backpropagation algorithm (DBP) for three-layered neural networks with nondifferentiable binary units. This approach feeds teacher signals to both the middle and output layers, whereas with a simple perceptron, they are given only to the output layer. The additional teacher signals enable the DBP to update the coupling weights not only between the middle and output layers but also between the input and middle layers. A neural network based on DBP learning is fast and easy to implement in hardware. Simulation results for several linearly nonseparable problems such as XOR demonstrate that the DBP performs favorably when compared to the conventional approaches. Furthermore, in large-scale networks, simulation results indicate that the DBP provides high performance.
On nonlinearly-induced noise in single-channel optical links with digital backpropagation.
Beygi, Lotfollah; Irukulapati, Naga V; Agrell, Erik; Johannisson, Pontus; Karlsson, Magnus; Wymeersch, Henk; Serena, Paolo; Bononi, Alberto
2013-11-04
In this paper, we investigate the performance limits of electronic chromatic dispersion compensation (EDC) and digital backpropagation (DBP) for a single-channel non-dispersion-managed fiber-optical link. A known analytical method to derive the performance of the system with EDC is extended to derive a first-order approximation for the performance of the system with DBP. In contrast to the cubic growth of the variance of the nonlinear noise-like interference, often called nonlinear noise, with input power for EDC, a quadratic growth is observed with DBP using this approximation. Finally, we provide numerical results to verify the accuracy of the proposed approach and compare it with existing analytical models.
Izhari, F.; Dhany, H. W.; Zarlis, M.; Sutarman
2018-03-01
A good age in optimizing aspects of development is at the age of 4-6 years, namely with psychomotor development. Psychomotor is broader, more difficult to monitor but has a meaningful value for the child's life because it directly affects his behavior and deeds. Therefore, there is a problem to predict the child's ability level based on psychomotor. This analysis uses backpropagation method analysis with artificial neural network to predict the ability of the child on the psychomotor aspect by generating predictions of the child's ability on psychomotor and testing there is a mean squared error (MSE) value at the end of the training of 0.001. There are 30% of children aged 4-6 years have a good level of psychomotor ability, excellent, less good, and good enough.
Trainable hardware for dynamical computing using error backpropagation through physical media.
Hermans, Michiel; Burm, Michaël; Van Vaerenbergh, Thomas; Dambre, Joni; Bienstman, Peter
2015-03-24
Neural networks are currently implemented on digital Von Neumann machines, which do not fully leverage their intrinsic parallelism. We demonstrate how to use a novel class of reconfigurable dynamical systems for analogue information processing, mitigating this problem. Our generic hardware platform for dynamic, analogue computing consists of a reciprocal linear dynamical system with nonlinear feedback. Thanks to reciprocity, a ubiquitous property of many physical phenomena like the propagation of light and sound, the error backpropagation-a crucial step for tuning such systems towards a specific task-can happen in hardware. This can potentially speed up the optimization process significantly, offering important benefits for the scalability of neuro-inspired hardware. In this paper, we show, using one experimentally validated and one conceptual example, that such systems may provide a straightforward mechanism for constructing highly scalable, fully dynamical analogue computers.
Backpropagation architecture optimization and an application in nuclear power plant diagnostics
International Nuclear Information System (INIS)
Basu, A.; Bartlett, E.B.
1993-01-01
This paper presents a Dynamic Node Architecture (DNA) scheme to optimize the architecture of backpropagation Artificial Neural Networks (ANNs). This network scheme is used to develop an ANN based diagnostic adviser capable of identifying the operating status of a nuclear power plant. Specifically, a ''root'' network is trained to diagnose if the plant is in a normal operating condition or not. In the event of an abnormal condition, and other ''classifier'' network is trained to recognize the particular transient taking place. these networks are trained using plant instrumentation data gathered during simulations of the various transients and normal operating conditions at the Iowa Electric Light and Power Company's Duane Arnold Energy Center (DAEC) operator training simulator
Ueda, Michihito; Nishitani, Yu; Kaneko, Yukihiro; Omote, Atsushi
2014-01-01
To realize an analog artificial neural network hardware, the circuit element for synapse function is important because the number of synapse elements is much larger than that of neuron elements. One of the candidates for this synapse element is a ferroelectric memristor. This device functions as a voltage controllable variable resistor, which can be applied to a synapse weight. However, its conductance shows hysteresis characteristics and dispersion to the input voltage. Therefore, the conductance values vary according to the history of the height and the width of the applied pulse voltage. Due to the difficulty of controlling the accurate conductance, it is not easy to apply the back-propagation learning algorithm to the neural network hardware having memristor synapses. To solve this problem, we proposed and simulated a learning operation procedure as follows. Employing a weight perturbation technique, we derived the error change. When the error reduced, the next pulse voltage was updated according to the back-propagation learning algorithm. If the error increased the amplitude of the next voltage pulse was set in such way as to cause similar memristor conductance but in the opposite voltage scanning direction. By this operation, we could eliminate the hysteresis and confirmed that the simulation of the learning operation converged. We also adopted conductance dispersion numerically in the simulation. We examined the probability that the error decreased to a designated value within a predetermined loop number. The ferroelectric has the characteristics that the magnitude of polarization does not become smaller when voltages having the same polarity are applied. These characteristics greatly improved the probability even if the learning rate was small, if the magnitude of the dispersion is adequate. Because the dispersion of analog circuit elements is inevitable, this learning operation procedure is useful for analog neural network hardware.
Directory of Open Access Journals (Sweden)
Michihito Ueda
Full Text Available To realize an analog artificial neural network hardware, the circuit element for synapse function is important because the number of synapse elements is much larger than that of neuron elements. One of the candidates for this synapse element is a ferroelectric memristor. This device functions as a voltage controllable variable resistor, which can be applied to a synapse weight. However, its conductance shows hysteresis characteristics and dispersion to the input voltage. Therefore, the conductance values vary according to the history of the height and the width of the applied pulse voltage. Due to the difficulty of controlling the accurate conductance, it is not easy to apply the back-propagation learning algorithm to the neural network hardware having memristor synapses. To solve this problem, we proposed and simulated a learning operation procedure as follows. Employing a weight perturbation technique, we derived the error change. When the error reduced, the next pulse voltage was updated according to the back-propagation learning algorithm. If the error increased the amplitude of the next voltage pulse was set in such way as to cause similar memristor conductance but in the opposite voltage scanning direction. By this operation, we could eliminate the hysteresis and confirmed that the simulation of the learning operation converged. We also adopted conductance dispersion numerically in the simulation. We examined the probability that the error decreased to a designated value within a predetermined loop number. The ferroelectric has the characteristics that the magnitude of polarization does not become smaller when voltages having the same polarity are applied. These characteristics greatly improved the probability even if the learning rate was small, if the magnitude of the dispersion is adequate. Because the dispersion of analog circuit elements is inevitable, this learning operation procedure is useful for analog neural network hardware.
An intelligent switch with back-propagation neural network based hybrid power system
Perdana, R. H. Y.; Fibriana, F.
2018-03-01
The consumption of conventional energy such as fossil fuels plays the critical role in the global warming issues. The carbon dioxide, methane, nitrous oxide, etc. could lead the greenhouse effects and change the climate pattern. In fact, 77% of the electrical energy is generated from fossil fuels combustion. Therefore, it is necessary to use the renewable energy sources for reducing the conventional energy consumption regarding electricity generation. This paper presents an intelligent switch to combine both energy resources, i.e., the solar panels as the renewable energy with the conventional energy from the State Electricity Enterprise (PLN). The artificial intelligence technology with the back-propagation neural network was designed to control the flow of energy that is distributed dynamically based on renewable energy generation. By the continuous monitoring on each load and source, the dynamic pattern of the intelligent switch was better than the conventional switching method. The first experimental results for 60 W solar panels showed the standard deviation of the trial at 0.7 and standard deviation of the experiment at 0.28. The second operation for a 900 W of solar panel obtained the standard deviation of the trial at 0.05 and 0.18 for the standard deviation of the experiment. Moreover, the accuracy reached 83% using this method. By the combination of the back-propagation neural network with the observation of energy usage of the load using wireless sensor network, each load can be evenly distributed and will impact on the reduction of conventional energy usage.
Directory of Open Access Journals (Sweden)
Didi Supriyadi
2014-01-01
Full Text Available Dengue disease is a major health problem and endemic in several countries including Indonesia. Indonesia is included in the category "A" in the stratification of DHF by WHO in 2001 which indicates the high rate of treatment in hospital and deaths from dengue. The purpose of this study was to investigate the ability of artificial neural networks Backpropagation method for information of the spread of dengue fever in a region. In this study uses six input variables which are environmental factors that influence the spread of dengue fever, include average temperature - average, rainfall, number of rainy days, the population density, sea surface height, and the percentage of larvae-free number for which data is sourced from BMKG, BPS and the Public Health Service. Network architecture applied to a multilayer network that uses an input with 6 neurons, one hidden lay er and an output with the output neuron is one. From the results obtained by training the best network architecture is the number one hidden layer with the number of neurons obtained a total of 110 neurons and also the system can recognize the entire training data. The best training algorithm using a variable learning rate and momentum of 0.9 by 0.6 by the end of the training MSE 0.000999879. in the process of testing using test data obtained 17 tissue levels of approximately 88.23% accuracy. Therefore we can conclude that the network is implemented in this study when subjected to the test data other then the error rate of about 11.77%.Keywords : Artificial Neural Networks; Backpropagation; Dengue fever
A theory of local learning, the learning channel, and the optimality of backpropagation.
Baldi, Pierre; Sadowski, Peter
2016-11-01
In a physical neural system, where storage and processing are intimately intertwined, the rules for adjusting the synaptic weights can only depend on variables that are available locally, such as the activity of the pre- and post-synaptic neurons, resulting in local learning rules. A systematic framework for studying the space of local learning rules is obtained by first specifying the nature of the local variables, and then the functional form that ties them together into each learning rule. Such a framework enables also the systematic discovery of new learning rules and exploration of relationships between learning rules and group symmetries. We study polynomial local learning rules stratified by their degree and analyze their behavior and capabilities in both linear and non-linear units and networks. Stacking local learning rules in deep feedforward networks leads to deep local learning. While deep local learning can learn interesting representations, it cannot learn complex input-output functions, even when targets are available for the top layer. Learning complex input-output functions requires local deep learning where target information is communicated to the deep layers through a backward learning channel. The nature of the communicated information about the targets and the structure of the learning channel partition the space of learning algorithms. For any learning algorithm, the capacity of the learning channel can be defined as the number of bits provided about the error gradient per weight, divided by the number of required operations per weight. We estimate the capacity associated with several learning algorithms and show that backpropagation outperforms them by simultaneously maximizing the information rate and minimizing the computational cost. This result is also shown to be true for recurrent networks, by unfolding them in time. The theory clarifies the concept of Hebbian learning, establishes the power and limitations of local learning rules
Directory of Open Access Journals (Sweden)
Nugroho Nugroho
2012-01-01
Full Text Available The research on image identification has been conducted to identify the type of beef. The research is aimed to compare the performance of artificial neural network of backpropagation and general regression neural network model in identifying the type of meat. Image management is processed by counting R, G and B value in every meat image, and normalization process is then carried out by obtaining R, G, and B index value which is then converted from RGB model to HSI model to obtain the value of hue, saturation and intensity. The resulting value of image processing will be used as input parameter of training and validation programs. The performance of G RNN model is more accurate than the backpropagation with accuracy ratio by 51%.Keyword: Identification; Backpropagation; GRNN
Khuriati, Ainie; Setiabudi, Wahyu; Nur, Muhammad; Istadi, Istadi
2015-12-01
Backpropgation neural network was trained to predict of combustible fraction heating value of MSW from the physical composition. Waste-to-Energy (WtE) is a viable option for municipal solid waste (MSW) management. The influence of the heating value of municipal solid waste (MSW) is very important on the implementation of WtE systems. As MSW is heterogeneous material, direct heating value measurements are often not feasible. In this study an empirical model was developed to describe the heating value of the combustible fraction of municipal solid waste as a function of its physical composition of MSW using backpropagation neural network. Sampling process was carried out at Jatibarang landfill. The weight of each sorting sample taken from each discharged MSW vehicle load is 100 kg. The MSW physical components were grouped into paper wastes, absorbent hygiene product waste, styrofoam waste, HD plastic waste, plastic waste, rubber waste, textile waste, wood waste, yard wastes, kitchen waste, coco waste, and miscellaneous combustible waste. Network was trained by 24 datasets with 1200, 769, and 210 epochs. The results of this analysis showed that the correlation from the physical composition is better than multiple regression method .
Directory of Open Access Journals (Sweden)
Wei Li
2018-01-01
Full Text Available Nutrient removal in tidal flow constructed wetlands (TF-CW is a complex series of nonlinear multi-parameter interactions. We simulated three tidal flow systems and a continuous vertical flow system filled with synthetic wastewater and compared the influent and effluent concentrations to examine (1 nutrient removal in artificial TF-CWs, and (2 the ability of a backpropagation (BP artificial neural network to predict nutrient removal. The nutrient removal rates were higher under tidal flow when the idle/reaction time was two, and reached 90 ± 3%, 99 ± 1%, and 58 ± 13% for total nitrogen (TN, ammonium nitrogen (NH4+-N, and total phosphorus (TP, respectively. The main influences on nutrient removal for each scenario were identified by redundancy analysis and were input into the model to train and verify the pollutant effluent concentrations. Comparison of the actual and model-predicted effluent concentrations showed that the model predictions were good. The predicted and actual values were correlated and the margin of error was small. The BP neural network fitted best to TP, with an R2 of 0.90. The R2 values of TN, NH4+-N, and nitrate nitrogen (NO3−-N were 0.67, 0.73, and 0.69, respectively.
Xiao, Zhuopeng; Zhuge, Qunbi; Fu, Songnian; Zhang, Fangyuan; Qiu, Meng; Tang, Ming; Liu, Deming; Plant, David V
2017-10-30
A split digital backpropagation (DBP) scheme for digital subcarrier-multiplexing (SCM) transmissions, denoted as SSDBP, is proposed and studied in both experiments and simulations. The implementation of the SSDBP is split at the transmitter and the receiver, leveraging existing chromatic dispersion (CD) compensation blocks to reduce complexity. We experimentally demonstrate that the SSDBP, with a complexity reduction up to 50% compared to the original receiver based SCM-DBP, can achieve a nonlinear compensation Q 2 gain of 0.7-dB and 0.9-dB for 1920-km and 2880-km 34.94-GBd single channel PDM-16QAM transmissions, respectively. The maximum reach can be extended by 31.6% using 2-step SSDBP with only 27.5 complex multiplications per sample. Meanwhile, using 3-step SSDBP, the reach extension can be increased to 40.8%. The benefit of implementing part of SSDBP at the transmitter is experimentally validated with 0.1-dB Q 2 improvement at 4-dBm launch power. We also numerically investigate the impact of the digital-to-analog converter (DAC) resolution and fiber parameter uncertainties on the nonlinear compensation performance of the SSDBP.
Syahputra, M. F.; Amalia, C.; Rahmat, R. F.; Abdullah, D.; Napitupulu, D.; Setiawan, M. I.; Albra, W.; Nurdin; Andayani, U.
2018-03-01
Hypertension or high blood pressure can cause damage of blood vessels in the retina of eye called hypertensive retinopathy (HR). In the event Hypertension, it will cause swelling blood vessels and a decrese in retina performance. To detect HR in patients body, it is usually performed through physical examination of opthalmoscope which is still conducted manually by an ophthalmologist. Certainly, in such a manual manner, takes a ong time for a doctor to detetct HR on aa patient based on retina fundus iamge. To overcome ths problem, a method is needed to identify the image of retinal fundus automatically. In this research, backpropagation neural network was used as a method for retinal fundus identification. The steps performed prior to identification were pre-processing (green channel, contrast limited adapative histogram qualization (CLAHE), morphological close, background exclusion, thresholding and connected component analysis), feature extraction using zoning. The results show that the proposed method is able to identify retinal fundus with an accuracy of 95% with maximum epoch of 1500.
International Nuclear Information System (INIS)
Vasconcelos, W.L.; Shigaki, Y.; Tolentino, E.
2009-01-01
In this work it was analyzed the residual performance of Portland cement concretes, when cold after heat-treated up to 600 deg C. Granite-gneiss was used in the three concrete mix proportions as the coarse aggregate, and river sand with finesses modulus of 2.7 as the fine aggregate. Ultrasonic pulse tests were performed on all the specimens and ultrasonic dynamic modulus were obtained. An artificial neural network of the backpropagation type was trained to evaluate and apply models in predicting residual properties of Portland cement concretes. The input layer for both models consists of an external layer input vector of the temperature. The hidden layer has two processing units with hyperbolic tangent sigmoid transfer functions (tansig for short), and the output layer contains one processing unit that represents the network's output (ultrasonic pulse velocity or modulus of elasticity) for each input vector. The training phase of the network converged for reasonable results after 5.000 epochs approximately, resulting in mean squared errors less than 0.02 for the normalized data. The neural network developed for modeling residual properties of Portland cement concretes was shown to be efficient in both the training phase and the test. From the results reasonable predictions could be made for the ultrasonic pulse velocity or dynamic modulus of elasticity by using temperature. (author)
Event-Driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines.
Neftci, Emre O; Augustine, Charles; Paul, Somnath; Detorakis, Georgios
2017-01-01
An ongoing challenge in neuromorphic computing is to devise general and computationally efficient models of inference and learning which are compatible with the spatial and temporal constraints of the brain. One increasingly popular and successful approach is to take inspiration from inference and learning algorithms used in deep neural networks. However, the workhorse of deep learning, the gradient descent Gradient Back Propagation (BP) rule, often relies on the immediate availability of network-wide information stored with high-precision memory during learning, and precise operations that are difficult to realize in neuromorphic hardware. Remarkably, recent work showed that exact backpropagated gradients are not essential for learning deep representations. Building on these results, we demonstrate an event-driven random BP (eRBP) rule that uses an error-modulated synaptic plasticity for learning deep representations. Using a two-compartment Leaky Integrate & Fire (I&F) neuron, the rule requires only one addition and two comparisons for each synaptic weight, making it very suitable for implementation in digital or mixed-signal neuromorphic hardware. Our results show that using eRBP, deep representations are rapidly learned, achieving classification accuracies on permutation invariant datasets comparable to those obtained in artificial neural network simulations on GPUs, while being robust to neural and synaptic state quantizations during learning.
Event-Driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines
Neftci, Emre O.; Augustine, Charles; Paul, Somnath; Detorakis, Georgios
2017-01-01
An ongoing challenge in neuromorphic computing is to devise general and computationally efficient models of inference and learning which are compatible with the spatial and temporal constraints of the brain. One increasingly popular and successful approach is to take inspiration from inference and learning algorithms used in deep neural networks. However, the workhorse of deep learning, the gradient descent Gradient Back Propagation (BP) rule, often relies on the immediate availability of network-wide information stored with high-precision memory during learning, and precise operations that are difficult to realize in neuromorphic hardware. Remarkably, recent work showed that exact backpropagated gradients are not essential for learning deep representations. Building on these results, we demonstrate an event-driven random BP (eRBP) rule that uses an error-modulated synaptic plasticity for learning deep representations. Using a two-compartment Leaky Integrate & Fire (I&F) neuron, the rule requires only one addition and two comparisons for each synaptic weight, making it very suitable for implementation in digital or mixed-signal neuromorphic hardware. Our results show that using eRBP, deep representations are rapidly learned, achieving classification accuracies on permutation invariant datasets comparable to those obtained in artificial neural network simulations on GPUs, while being robust to neural and synaptic state quantizations during learning. PMID:28680387
A Parallel Adaboost-Backpropagation Neural Network for Massive Image Dataset Classification
Cao, Jianfang; Chen, Lichao; Wang, Min; Shi, Hao; Tian, Yun
2016-01-01
Image classification uses computers to simulate human understanding and cognition of images by automatically categorizing images. This study proposes a faster image classification approach that parallelizes the traditional Adaboost-Backpropagation (BP) neural network using the MapReduce parallel programming model. First, we construct a strong classifier by assembling the outputs of 15 BP neural networks (which are individually regarded as weak classifiers) based on the Adaboost algorithm. Second, we design Map and Reduce tasks for both the parallel Adaboost-BP neural network and the feature extraction algorithm. Finally, we establish an automated classification model by building a Hadoop cluster. We use the Pascal VOC2007 and Caltech256 datasets to train and test the classification model. The results are superior to those obtained using traditional Adaboost-BP neural network or parallel BP neural network approaches. Our approach increased the average classification accuracy rate by approximately 14.5% and 26.0% compared to the traditional Adaboost-BP neural network and parallel BP neural network, respectively. Furthermore, the proposed approach requires less computation time and scales very well as evaluated by speedup, sizeup and scaleup. The proposed approach may provide a foundation for automated large-scale image classification and demonstrates practical value. PMID:27905520
The application of backpropagation neural network method to estimate the sediment loads
Directory of Open Access Journals (Sweden)
Ari Gunawan Taufik
2017-01-01
Full Text Available Nearly all formulations of conventional sediment load estimation method were developed based on a review of laboratory data or data field. This approach is generally limited by local so it is only suitable for a particular river typology. From previous studies, the amount of sediment load tends to be non-linear with respect to the hydraulic parameters and parameter that accompanies sediment. The dominant parameter is turbulence, whereas turbulence flow velocity vector direction of x, y and z. They were affected by water bodies in 3D morphology of the cross section of the vertical and horizontal. This study is conducted to address the non-linear nature of the hydraulic parameter data and sediment parameter against sediment load data by applying the artificial neural network (ANN method. The method used is the backpropagation neural network (BPNN schema. This scheme used for projecting the sediment load from the hydraulic parameter data and sediment parameters that used in the conventional estimation of sediment load. The results showed that the BPNN model performs reasonably well on the conventional calculation, indicated by the stability of correlation coefficient (R and the mean square error (MSE.
Analisa Estimasi Penyeleksian Dosen Menggunakan Metode Backpropagation (Studi Kasus STMIK Amik Riau
Directory of Open Access Journals (Sweden)
Debi Setiawan
2016-12-01
Full Text Available Abstract- The purpose of this study was to estimate the number of lecturers who will be selected at the end of the year. Selection of lecturers is a way to determine the productivity of lecturers. In Act No. 14 of 2005, article 67, explained that an institution can undertake unilateral termination respectfully, when it ended joint working relationship between lecturers and education providers. At private colleges, the trigger of the selection of lecturers due to the productivity and the number of students. If the number of students is insufficient faculty ratio, while increasing productivity and excellent faculty, it still will do the selection of lecturers. The problem that arises is the imbalance for lecturers who have improved performance. It is necessary for analysis of estimates in the process of selecting lecturers, lecturers and institutions in order to be able to take a stand to solve this problem. Estimation using the design pattern of artificial neural networks (ANN and methods of propagation, with an error rate of 0.5%. Variables that will be used is the amount of students majoring in IT (Computer Science, MI (Management Information on campus STMIK Amik Riau, the number of Lecturer (MI and TI, and the final value of faculty productivity. These five variables will be processed on the system of selecting lecturers analysis using backpropagation method, so that the results to be obtained is the number of lecturers who will be affected by the selection of lecturers on campus STMIK Amik Riau.
Directory of Open Access Journals (Sweden)
Yi-jun Liu
2015-12-01
Full Text Available Childhood nephrotic syndrome is a chronic disease harmful to growth of children. Scientific and accurate prediction of negative conversion days for children with nephrotic syndrome offers potential benefits for treatment of patients and helps achieve better cure effect. In this study, the improved backpropagation neural network with momentum is used for prediction. Momentum speeds up convergence and maintains the generalization performance of the neural network, and therefore overcomes weaknesses of the standard backpropagation algorithm. The three-tier network structure is constructed. Eight indicators including age, lgG, lgA and lgM, etc. are selected for network inputs. The scientific computing software of MATLAB and its neural network tools are used to create model and predict. The training sample of twenty-eight cases is used to train the neural network. The test sample of six typical cases belonging to six different age groups respectively is used to test the predictive model. The low mean absolute error of predictive results is achieved at 0.83. The experimental results of the small-size sample show that the proposed approach is to some degree applicable for the prediction of negative conversion days of childhood nephrotic syndrome.
Directory of Open Access Journals (Sweden)
Bahman O. Taha
2015-06-01
Full Text Available The reinforced concrete with fiber reinforced polymer (FRP bars (carbon, aramid, basalt and glass is used in places where a high ratio of strength to weight is required and corrosion is not acceptable. Behavior of structural members using (FRP bars is hard to be modeled using traditional methods because of the high non-linearity relationship among factors influencing the strength of structural members. Back-propagation neural network is a very effective method for modeling such complicated relationships. In this paper, back-propagation neural network is used for modeling the flexural behavior of beams reinforced with (FRP bars. 101 samples of beams reinforced with fiber bars were collected from literatures. Five important factors are taken in consideration for predicting the strength of beams. Two models of Multilayer Perceptron (MLP are created, first with single-hidden layer and the second with two-hidden layers. The two-hidden layer model showed better accuracy ratio than the single-hidden layer model. Parametric study has been done for two-hidden layer model only. Equations are derived to be used instead of the model and the importance of input factors is determined. Results showed that the neural network is successful in modeling the behavior of concrete beams reinforced with different types of (FRP bars.
International Nuclear Information System (INIS)
Sun, S.P.; Yi, D.Q.; Jiang, Y.; Wu, C.P.; Zang, B.; Li, Y.
2011-01-01
Research highlights: → An ANN was built to predict the formation enthalpies of Al 2 X-type intermetallics. → The values predicted by the ANN agree with experiments well to typically within 10%. → The method comparison suggests that our ANN method is superior to Miedema's model. → Some trends of formation enthalpies for Al 2 X-type intermetallics were observed. - Abstract: A back-propagation artificial neural network (ANN) was established to predict the formation enthalpies of Al 2 X-type intermetallics as a function of some physical parameters. These physical parameters include the electronegativity difference, the electron density difference, the atomic size difference, and the electron-atom ratio (e/a). The values calculated by the ANN method agree with experiments well to typically within 10%, indicating that the well-trained back-propagation (BP) neural network is feasible, and can precisely predict the formation enthalpies of Al 2 X-type intermetallics. The method comparison based on the predicted formation enthalpies suggests that our ANN method is superior to Miedema's model. Some trends of formation enthalpies for Al 2 X-type intermetallics were also observed from the ANN.
Motta, Mario; Zhang, Shiwei
2017-11-14
We address the computation of ground-state properties of chemical systems and realistic materials within the auxiliary-field quantum Monte Carlo method. The phase constraint to control the Fermion phase problem requires the random walks in Slater determinant space to be open-ended with branching. This in turn makes it necessary to use back-propagation (BP) to compute averages and correlation functions of operators that do not commute with the Hamiltonian. Several BP schemes are investigated, and their optimization with respect to the phaseless constraint is considered. We propose a modified BP method for the computation of observables in electronic systems, discuss its numerical stability and computational complexity, and assess its performance by computing ground-state properties in several molecular systems, including small organic molecules.
Chang, C L; Liu, H C
2015-09-01
The trophic state index, and in particular, the Carlson Trophic State Index (CTSI), is critical for evaluating reservoir water quality. Despite its common use in evaluating static water quality, the reliability of the CTSI may decrease when water turbidity is high. Therefore, this study examines the reliability of the CTSI and uses the Back-Propagation Neural Network (BPNN) model to create a new trophic state index. Fuzzy theory, rather than binary logic, is implemented to classify the trophic status into its three grades. The results show that compared to the CTSI with traditional classification, the new index with fuzzy classification can improve trophic status evaluation with high water turbidity. A reliable trophic state index can correctly describe reservoir water quality and allow relevant agencies to address proper water quality management strategies for a reservoir system.
Li, Liu; Liqing, Huo; Hongru, Lu; Feng, Zhang; Chongxun, Zheng; Pokhrel, Shami; Jie, Zhang
2011-01-01
To establish an early diagnostic system for hypoxic ischemic encephalopathy (HIE) in newborns based on artificial neural networks and to determine its feasibility. Based on published research as well as preliminary studies in our laboratory, multiple noninvasive indicators with high sensitivity and specificity were selected for the early diagnosis of HIE and employed in the present study, which incorporates fuzzy logic with artificial neural networks. The analysis of the diagnostic results from the fuzzy neural network experiments with 140 cases of HIE showed a correct recognition rate of 100% in all training samples and a correct recognition rate of 95% in all the test samples, indicating a misdiagnosis rate of 5%. A preliminary model using fuzzy backpropagation neural networks based on a composite index of clinical indicators was established and its accuracy for the early diagnosis of HIE was validated. Therefore, this method provides a convenient tool for the early clinical diagnosis of HIE.
Directory of Open Access Journals (Sweden)
Lin Liu
2010-01-01
Full Text Available Cognitive radio (CR is a technology to implement opportunistic spectrum sharing to improve the spectrum utilization. However, there exists a hidden-node problem, which can be a big challenge to solve especially when the primary receiver is passive listening. We aim to provide a solution to the hidden-node problem for passive-listening receiver based on cooperation of multiple CRs. Specifically, we consider a cooperative GPS-enabled cognitive network. Once the existence of PU is detected, a localization algorithm will be employed to first estimate the path loss model for the environment based on backpropagation method and then to locate the position of PU. Finally, a disable region is identified taking into account the communication range of both the PU and the CR. The CRs within the disabled region are prohibited to transmit in order to avoid interfering with the primary receiver. Both analysis and simulation results are provided.
Xin, Meiting; Li, Bing; Yan, Xiao; Chen, Lei; Wei, Xiang
2018-02-01
A robust coarse-to-fine registration method based on the backpropagation (BP) neural network and shift window technology is proposed in this study. Specifically, there are three steps: coarse alignment between the model data and measured data, data simplification based on the BP neural network and point reservation in the contour region of point clouds, and fine registration with the reweighted iterative closest point algorithm. In the process of rough alignment, the initial rotation matrix and the translation vector between the two datasets are obtained. After performing subsequent simplification operations, the number of points can be reduced greatly. Therefore, the time and space complexity of the accurate registration can be significantly reduced. The experimental results show that the proposed method improves the computational efficiency without loss of accuracy.
Amiralizadeh, Siamak; Nguyen, An T; Rusch, Leslie A
2013-08-26
We investigate the performance of digital filter back-propagation (DFBP) using coarse parameter estimation for mitigating SOA nonlinearity in coherent communication systems. We introduce a simple, low overhead method for parameter estimation for DFBP based on error vector magnitude (EVM) as a figure of merit. The bit error rate (BER) penalty achieved with this method has negligible penalty as compared to DFBP with fine parameter estimation. We examine different bias currents for two commercial SOAs used as booster amplifiers in our experiments to find optimum operating points and experimentally validate our method. The coarse parameter DFBP efficiently compensates SOA-induced nonlinearity for both SOA types in 80 km propagation of 16-QAM signal at 22 Gbaud.
Wavefield back-propagation in high-resolution X-ray holography with a movable field of view.
Guehrs, Erik; Günther, Christian M; Pfau, Bastian; Rander, Torbjörn; Schaffert, Stefan; Schlotter, William F; Eisebitt, Stefan
2010-08-30
Mask-based Fourier transform holography is used to record images of biological objects with 2.2 nm X-ray wavelength. The holography mask and the object are decoupled from each other which allows us to move the field of view over a large area over the sample. Due to the separation of the mask and the sample on different X-ray windows, a gap between both windows in the micrometer range typically exists. Using standard Fourier transform holography, focussed images of the sample can directly be reconstructed only for gap distances within the setup's depth of field. Here, we image diatoms as function of the gap distance and demonstrate the possibility to recover focussed images via a wavefield back-propagation technique. The limitations of our approach with respect to large separations are mainly associated with deviations from flat-field illumination of the object.
Directory of Open Access Journals (Sweden)
Shojaee Safar Ali
2014-01-01
Full Text Available In this study, feasibility of a back-propagated artificial neural network to correlate the binary density of ionic liquids (ILs mixtures containing water as the common solvent has been investigated. To verify the optimized parameters of the neural network, total of 1668 data were collected and divided into two different subsets. The first subsets consisted of more than two-third (1251 data points of data bank was used to find the optimum parameters including weights and biases, number of neurons (7 neurons, transfer functions in hidden and output layer which were tansig and purelin, respectively. In addition, the correlative capability of network was examined using testing subset (417 data points not considered during the training stage. The overall obtained results revealed that the proposed network is accurate enough to correlate the binary density of the ionic liquids mixtures with average absolute relative deviation (AARD % and average relative deviation (ARD % of 1.56% and -0.04 %, respectively. Finally, the correlative capability of the proposed ANN model was compared with one of the available correlations proposed by Rodríguez and Brennecke.
Chen, Yan; Cai, Kezhou; Tu, Zehui; Nie, Wen; Ji, Tuo; Hu, Bing; Chen, Conggui; Jiang, Shaotong
2017-11-29
Benzo[a]pyrene (BaP), a potent mutagen and carcinogen, is reported to be present in processed meat products and, in particular, in smoked meat. However, few methods exist for predictive determination of the BaP content of smoked meats such as sausage. In this study, an artificial neural network (ANN) model based on the back-propagation (BP) algorithm was used to predict the BaP content of smoked sausage. The results showed that the BP network based on the Levenberg-Marquardt algorithm was the best suited for creating a nonlinear map between the input and output parameters. The optimal network structure was 3-7-1 and the learning rate was 0.6. This BP-ANN model allowed for accurate predictions, with the correlation coefficients (R) for the experimentally determined training, validation, test and global data sets being 0.94, 0.96, 0.95 and 0.95 respectively. The validation performance was 0.013, suggesting that the proposed BP-ANN may be used to predictively detect the BaP content of smoked meat products. An effective predictive model was constructed for estimation of the BaP content of smoked sausage using ANN modeling techniques, which shows potential to predict the BaP content in smoked sausage. © 2017 Society of Chemical Industry. © 2017 Society of Chemical Industry.
Spectrally shaped DP-16QAM super-channel transmission with multi-channel digital back-propagation.
Maher, Robert; Xu, Tianhua; Galdino, Lidia; Sato, Masaki; Alvarado, Alex; Shi, Kai; Savory, Seb J; Thomsen, Benn C; Killey, Robert I; Bayvel, Polina
2015-02-03
The achievable transmission capacity of conventional optical fibre communication systems is limited by nonlinear distortions due to the Kerr effect and the difficulty in modulating the optical field to effectively use the available fibre bandwidth. In order to achieve a high information spectral density (ISD), while simultaneously maintaining transmission reach, multi-channel fibre nonlinearity compensation and spectrally efficient data encoding must be utilised. In this work, we use a single coherent super-receiver to simultaneously receive a DP-16QAM super-channel, consisting of seven spectrally shaped 10GBd sub-carriers spaced at the Nyquist frequency. Effective nonlinearity mitigation is achieved using multi-channel digital back-propagation (MC-DBP) and this technique is combined with an optimised forward error correction implementation to demonstrate a record gain in transmission reach of 85%; increasing the maximum transmission distance from 3190 km to 5890 km, with an ISD of 6.60 b/s/Hz. In addition, this report outlines for the first time, the sensitivity of MC-DBP gain to linear transmission line impairments and defines a trade-off between performance and complexity.
Xu, Tianhua; Liga, Gabriele; Lavery, Domaniç; Thomsen, Benn C; Savory, Seb J; Killey, Robert I; Bayvel, Polina
2015-09-14
Superchannel transmission spaced at the symbol rate, known as Nyquist spacing, has been demonstrated for effectively maximizing the optical communication channel capacity and spectral efficiency. However, the achievable capacity and reach of transmission systems using advanced modulation formats are affected by fibre nonlinearities and equalization enhanced phase noise (EEPN). Fibre nonlinearities can be effectively compensated using digital back-propagation (DBP). However EEPN which arises from the interaction between laser phase noise and dispersion cannot be efficiently mitigated, and can significantly degrade the performance of transmission systems. Here we report the first investigation of the origin and the impact of EEPN in Nyquist-spaced superchannel system, employing electronic dispersion compensation (EDC) and multi-channel DBP (MC-DBP). Analysis was carried out in a Nyquist-spaced 9-channel 32-Gbaud DP-64QAM transmission system. Results confirm that EEPN significantly degrades the performance of all sub-channels of the superchannel system and that the distortions are more severe for the outer sub-channels, both using EDC and MC-DBP. It is also found that the origin of EEPN depends on the relative position between the carrier phase recovery module and the EDC (or MC-DBP) module. Considering EEPN, diverse coding techniques and modulation formats have to be applied for optimizing different sub-channels in superchannel systems.
Ma, Jianshe; Cai, Jinzhang; Lin, Guanyang; Chen, Huilin; Wang, Xianqin; Wang, Xianchuan; Hu, Lufeng
2014-05-15
Corynoxeine(CX), isolated from the extract of Uncaria rhynchophylla, is a useful and prospective compound in the prevention and treatment for vascular diseases. A simple and selective liquid chromatography mass spectrometry (LC-MS) method was developed to determine the concentration of CX in rat plasma. The chromatographic separation was achieved on a Zorbax SB-C18 (2.1 mm × 150 mm, 5 μm) column with acetonitrile-0.1% formic acid in water as mobile phase. Selective ion monitoring (SIM) mode was used for quantification using target ions m/z 383 for CX and m/z 237 for the carbamazepine (IS). After the LC-MS method was validated, it was applied to a back-propagation artificial neural network (BP-ANN) pharmacokinetic model study of CX in rats. The results showed that after intravenous administration of CX, it was mainly distributed in blood and eliminated quickly, t1/2 was less than 1h. The predicted concentrations generated by BP-ANN model had a high correlation coefficient (R>0.99) with experimental values. The developed BP-ANN pharmacokinetic model can be used to predict the concentration of CX in rats. Copyright © 2014 Elsevier B.V. All rights reserved.
Directory of Open Access Journals (Sweden)
Is Mardianto
2008-05-01
Full Text Available There are various ways to detect osteoporosis disease (bone loss. One of them is by observing the osteoporosisimage through rontgen picture or X-ray. Then, it is analyzed manually by Rheumatology experts. Article present the creationof a system which could detect osteoporosis disease on human, by implementing the Rheumatology principles. The main areasidentified were between wrist and hand fingers. The working system in this software included 3 important processing, whichwere process of basic image processing, pixel reduction process, pixel reduction, and artificial neural networks. Initially, thecolor of digital X-ray image (30 x 30 pixels was converted from RGB to grayscale. Then, it was threshold and its gray levelvalue was taken. These values then were normalized to an interval [0.1, 0.9], then reduced using a PCA (Principal ComponentAnalysis method. The results were used as input on the process of Backpropagation artificial neural networks to detect thedisease analysis of X-ray being inputted. It can be concluded that from the testing result, with a learning rate of 0.7 andmomentum of 0.4, this system had a success rate of 73 to 100 percent for the non-learning data testing, and 100 percent forlearning data.Keywords: osteoporosis, image processing, PCA, artificial neural networks
Directory of Open Access Journals (Sweden)
Shi Liang Zhang
2015-01-01
Full Text Available This paper proposes a model to extract feature information quickly and accurately identifying what cannot be achieved through traditional methods of remote sensing image classification. First, process the selected Landsat-8 remote sensing data, including radiometric calibration, geometric correction, optimal band combination, and image cropping. Add the processed remote sensing image to the normalized geographic auxiliary information, digital elevation model (DEM, and normalized difference vegetation index (NDVI, working together to build a neural network that consists of three levels based on the structure of back-propagation neural and extended delta bar delta (BPN-EDBD algorithm, determining the parameters of the neural network to constitute a good classification model. Then determine classification and standards via field surveys and related geographic information; select training samples BPN-EDBD for algorithm learning and training and, if necessary, revise and improve its parameters using the BPN-EDBD classification algorithm to classify the remote sensing image after pretreatment and DEM data and NDVI as input parameters and output classification results, and run accuracy assessment. Finally, compare with traditional supervised classification algorithms, while adding different auxiliary geographic information to compare classification results to study the advantages and disadvantages of BPN-EDBD classification algorithm.
Connelly, William M; Crunelli, Vincenzo; Errington, Adam C
2017-05-24
Backpropagating action potentials (bAPs) are indispensable in dendritic signaling. Conflicting Ca 2+ -imaging data and an absence of dendritic recording data means that the extent of backpropagation in thalamocortical (TC) and thalamic reticular nucleus (TRN) neurons remains unknown. Because TRN neurons signal electrically through dendrodendritic gap junctions and possibly via chemical dendritic GABAergic synapses, as well as classical axonal GABA release, this lack of knowledge is problematic. To address this issue, we made two-photon targeted patch-clamp recordings from rat TC and TRN neuron dendrites to measure bAPs directly. These recordings reveal that "tonic"' and low-threshold-spike (LTS) "burst" APs in both cell types are always recorded first at the soma before backpropagating into the dendrites while undergoing substantial distance-dependent dendritic amplitude attenuation. In TC neurons, bAP attenuation strength varies according to firing mode. During LTS bursts, somatic AP half-width increases progressively with increasing spike number, allowing late-burst spikes to propagate more efficiently into the dendritic tree compared with spikes occurring at burst onset. Tonic spikes have similar somatic half-widths to late burst spikes and undergo similar dendritic attenuation. In contrast, in TRN neurons, AP properties are unchanged between LTS bursts and tonic firing and, as a result, distance-dependent dendritic attenuation remains consistent across different firing modes. Therefore, unlike LTS-associated global electrical and calcium signals, the spatial influence of bAP signaling in TC and TRN neurons is more restricted, with potentially important behavioral-state-dependent consequences for synaptic integration and plasticity in thalamic neurons. SIGNIFICANCE STATEMENT In most neurons, action potentials (APs) initiate in the axosomatic region and propagate into the dendritic tree to provide a retrograde signal that conveys information about the level of
Xu, Jun-Fang; Xu, Jing; Li, Shi-Zhu; Jia, Tia-Wu; Huang, Xi-Bao; Zhang, Hua-Ming; Chen, Mei; Yang, Guo-Jing; Gao, Shu-Jing; Wang, Qing-Yun; Zhou, Xiao-Nong
2013-01-01
Background The transmission of schistosomiasis japonica in a local setting is still poorly understood in the lake regions of the People's Republic of China (P. R. China), and its transmission patterns are closely related to human, social and economic factors. Methodology/Principal Findings We aimed to apply the integrated approach of artificial neural network (ANN) and logistic regression model in assessment of transmission risks of Schistosoma japonicum with epidemiological data collected from 2339 villagers from 1247 households in six villages of Jiangling County, P.R. China. By using the back-propagation (BP) of the ANN model, 16 factors out of 27 factors were screened, and the top five factors ranked by the absolute value of mean impact value (MIV) were mainly related to human behavior, i.e. integration of water contact history and infection history, family with past infection, history of water contact, infection history, and infection times. The top five factors screened by the logistic regression model were mainly related to the social economics, i.e. village level, economic conditions of family, age group, education level, and infection times. The risk of human infection with S. japonicum is higher in the population who are at age 15 or younger, or with lower education, or with the higher infection rate of the village, or with poor family, and in the population with more than one time to be infected. Conclusion/Significance Both BP artificial neural network and logistic regression model established in a small scale suggested that individual behavior and socioeconomic status are the most important risk factors in the transmission of schistosomiasis japonica. It was reviewed that the young population (≤15) in higher-risk areas was the main target to be intervened for the disease transmission control. PMID:23556015
Directory of Open Access Journals (Sweden)
Nader Salari
Full Text Available Among numerous artificial intelligence approaches, k-Nearest Neighbor algorithms, genetic algorithms, and artificial neural networks are considered as the most common and effective methods in classification problems in numerous studies. In the present study, the results of the implementation of a novel hybrid feature selection-classification model using the above mentioned methods are presented. The purpose is benefitting from the synergies obtained from combining these technologies for the development of classification models. Such a combination creates an opportunity to invest in the strength of each algorithm, and is an approach to make up for their deficiencies. To develop proposed model, with the aim of obtaining the best array of features, first, feature ranking techniques such as the Fisher's discriminant ratio and class separability criteria were used to prioritize features. Second, the obtained results that included arrays of the top-ranked features were used as the initial population of a genetic algorithm to produce optimum arrays of features. Third, using a modified k-Nearest Neighbor method as well as an improved method of backpropagation neural networks, the classification process was advanced based on optimum arrays of the features selected by genetic algorithms. The performance of the proposed model was compared with thirteen well-known classification models based on seven datasets. Furthermore, the statistical analysis was performed using the Friedman test followed by post-hoc tests. The experimental findings indicated that the novel proposed hybrid model resulted in significantly better classification performance compared with all 13 classification methods. Finally, the performance results of the proposed model was benchmarked against the best ones reported as the state-of-the-art classifiers in terms of classification accuracy for the same data sets. The substantial findings of the comprehensive comparative study revealed that
Abdollahi, Yadollah; Sairi, Nor Asrina; Said, Suhana Binti Mohd; Abouzari-lotf, Ebrahim; Zakaria, Azmi; Sabri, Mohd Faizul Bin Mohd; Islam, Aminul; Alias, Yatimah
2015-11-05
It is believe that 80% industrial of carbon dioxide can be controlled by separation and storage technologies which use the blended ionic liquids absorber. Among the blended absorbers, the mixture of water, N-methyldiethanolamine (MDEA) and guanidinium trifluoromethane sulfonate (gua) has presented the superior stripping qualities. However, the blended solution has illustrated high viscosity that affects the cost of separation process. In this work, the blended fabrication was scheduled with is the process arranging, controlling and optimizing. Therefore, the blend's components and operating temperature were modeled and optimized as input effective variables to minimize its viscosity as the final output by using back-propagation artificial neural network (ANN). The modeling was carried out by four mathematical algorithms with individual experimental design to obtain the optimum topology using root mean squared error (RMSE), R-squared (R(2)) and absolute average deviation (AAD). As a result, the final model (QP-4-8-1) with minimum RMSE and AAD as well as the highest R(2) was selected to navigate the fabrication of the blended solution. Therefore, the model was applied to obtain the optimum initial level of the input variables which were included temperature 303-323 K, x[gua], 0-0.033, x[MDAE], 0.3-0.4, and x[H2O], 0.7-1.0. Moreover, the model has obtained the relative importance ordered of the variables which included x[gua]>temperature>x[MDEA]>x[H2O]. Therefore, none of the variables was negligible in the fabrication. Furthermore, the model predicted the optimum points of the variables to minimize the viscosity which was validated by further experiments. The validated results confirmed the model schedulability. Accordingly, ANN succeeds to model the initial components of the blended solutions as absorber of CO2 capture in separation technologies that is able to industries scale up. Copyright © 2015 Elsevier B.V. All rights reserved.
Salari, Nader; Shohaimi, Shamarina; Najafi, Farid; Nallappan, Meenakshii; Karishnarajah, Isthrinayagy
2014-01-01
Among numerous artificial intelligence approaches, k-Nearest Neighbor algorithms, genetic algorithms, and artificial neural networks are considered as the most common and effective methods in classification problems in numerous studies. In the present study, the results of the implementation of a novel hybrid feature selection-classification model using the above mentioned methods are presented. The purpose is benefitting from the synergies obtained from combining these technologies for the development of classification models. Such a combination creates an opportunity to invest in the strength of each algorithm, and is an approach to make up for their deficiencies. To develop proposed model, with the aim of obtaining the best array of features, first, feature ranking techniques such as the Fisher's discriminant ratio and class separability criteria were used to prioritize features. Second, the obtained results that included arrays of the top-ranked features were used as the initial population of a genetic algorithm to produce optimum arrays of features. Third, using a modified k-Nearest Neighbor method as well as an improved method of backpropagation neural networks, the classification process was advanced based on optimum arrays of the features selected by genetic algorithms. The performance of the proposed model was compared with thirteen well-known classification models based on seven datasets. Furthermore, the statistical analysis was performed using the Friedman test followed by post-hoc tests. The experimental findings indicated that the novel proposed hybrid model resulted in significantly better classification performance compared with all 13 classification methods. Finally, the performance results of the proposed model was benchmarked against the best ones reported as the state-of-the-art classifiers in terms of classification accuracy for the same data sets. The substantial findings of the comprehensive comparative study revealed that performance of the
Xu, Jun-Fang; Xu, Jing; Li, Shi-Zhu; Jia, Tia-Wu; Huang, Xi-Bao; Zhang, Hua-Ming; Chen, Mei; Yang, Guo-Jing; Gao, Shu-Jing; Wang, Qing-Yun; Zhou, Xiao-Nong
2013-01-01
The transmission of schistosomiasis japonica in a local setting is still poorly understood in the lake regions of the People's Republic of China (P. R. China), and its transmission patterns are closely related to human, social and economic factors. We aimed to apply the integrated approach of artificial neural network (ANN) and logistic regression model in assessment of transmission risks of Schistosoma japonicum with epidemiological data collected from 2339 villagers from 1247 households in six villages of Jiangling County, P.R. China. By using the back-propagation (BP) of the ANN model, 16 factors out of 27 factors were screened, and the top five factors ranked by the absolute value of mean impact value (MIV) were mainly related to human behavior, i.e. integration of water contact history and infection history, family with past infection, history of water contact, infection history, and infection times. The top five factors screened by the logistic regression model were mainly related to the social economics, i.e. village level, economic conditions of family, age group, education level, and infection times. The risk of human infection with S. japonicum is higher in the population who are at age 15 or younger, or with lower education, or with the higher infection rate of the village, or with poor family, and in the population with more than one time to be infected. Both BP artificial neural network and logistic regression model established in a small scale suggested that individual behavior and socioeconomic status are the most important risk factors in the transmission of schistosomiasis japonica. It was reviewed that the young population (≤15) in higher-risk areas was the main target to be intervened for the disease transmission control.
Li, Jian; Gu, Jun-zhong; Mao, Sheng-hua; Xiao, Wen-jia; Jin, Hui-ming; Zheng, Ya-xu; Wang, Yong-ming; Hu, Jia-yu
2013-12-01
To establish BP artificial neural network predicting model regarding the daily cases of infectious diarrhea in Shanghai. Data regarding both the incidence of infectious diarrhea from 2005 to 2008 in Shanghai and meteorological factors including temperature, relative humidity, rainfall, atmospheric pressure, duration of sunshine and wind speed within the same periods were collected and analyzed with the MatLab R2012b software. Meteorological factors that were correlated with infectious diarrhea were screened by Spearman correlation analysis. Principal component analysis (PCA) was used to remove the multi-colinearities between meteorological factors. Back-Propagation (BP) neural network was employed to establish related prediction models regarding the daily infectious diarrhea incidence, using artificial neural networks toolbox. The established models were evaluated through the fitting, predicting and forecasting processes. Data from Spearman correlation analysis indicated that the incidence of infectious diarrhea had a highly positive correlation with factors as daily maximum temperature, minimum temperature, average temperature, minimum relative humidity and average relative humidity in the previous two days (P neural network model were established under the input of 4 meteorological principal components, extracted by PCA and used for training and prediction. Then appeared to be 4.7811, 6.8921,0.7918,0.8418 and 5.8163, 7.8062,0.7202,0.8180, respectively. The rate on mean error regarding the predictive value to actual incidence in 2008 was 5.30% and the forecasting precision reached 95.63% . Temperature and air pressure showed important impact on the incidence of infectious diarrhea. The BP neural network model had the advantages of low simulation forecasting errors and high forecasting hit rate that could ideally predict and forecast the effects on the incidence of infectious diarrhea.
Galdino, Lidia; Tan, Mingming; Lavery, Domaniç; Rosa, Pawel; Maher, Robert; Phillips, Ian D; Ania Castañón, Juan D; Harper, Paul; Killey, Robert I; Thomsen, Benn C; Makovejs, Sergejs; Bayvel, Polina
2015-07-01
Transmission of a net 467-Gb/s PDM-16QAM Nyquist-spaced superchannel is reported with an intra-superchannel net spectral efficiency (SE) of 6.6 (b/s)/Hz, over 364-km SMF-28 ULL ultra-low loss optical fiber, enabled by bi-directional second-order Raman amplification and digital nonlinearity compensation. Multi-channel digital back-propagation (MC-DBP) was applied to compensate for nonlinear interference; an improvement of 2 dB in Q(2) factor was achieved when 70-GHz DBP bandwidth was applied, allowing an increase in span length of 37 km.
DEFF Research Database (Denmark)
Sackey, Isaac; Da Ros, Francesco; Karl Fischer, Johannes
2015-01-01
a dual-pump polarization-independent fiber-optic parametric amplifier and compared to digital backpropagation (DBP) compensation over up to 800-km in a dispersion-managed link. In the single-channel case, the use of the DBP algorithm outperformed the OPC with a Q-factor improvement of 0.9 dB after 800-km......We experimentally investigate Kerr nonlinearity mitigation of a 28-GBd polarization-multiplexed 16-QAM signal in a five-channel 50-GHz spaced wavelength-division multiplexing (WDM) system. Optical phase conjugation (OPC) employing the mid-link spectral inversion technique is implemented by using...
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.
=UTF-8 54 / JOURNAL OF WATERWAY, PORT, COASTAL, AND OCEAN ENGINEERING / JANUARY/FEBRUARY 2001 BACK-PROPAGATION NEURAL NETWORK IN TIDAL-LEVEL FORECASTING a Discussion by Arun Kumar 3 and Vijay K. Minocha 4 The authors have presented... and the output is not required to be defined a priori. The ANN model, due to its flexible structure, if not applied with greater caution, may overfit at the training stage and may yield poorer results during the prediction stage. The efforts of the authors...
Sheridan, Cormac; O'Farrell, Marion; Lewis, Elfed; Lyons, William B.; Flanagan, Colin; Jackman, Nick
2005-06-01
This paper reports on three methods of classifying the spectral data from an optical fibre based sensor system as used in the food industry. The first method uses a feed-forward back-propagation Artificial Neural Network; the second method involves using Kohonen Self-Organising Maps while the third method is k-Nearest Neighbour analysis. The sensor monitors the food colour online as the food cooks by examining the reflected light from both the surface and the core of the product. The combination of using Principal Component Analysis and Backpropagation Neural Networks has been successfully investigated previously. In this paper, results obtained using all three classifiers are presented and compared. The Principal Components used to train each classifier are evaluated from data that generate a "colourscale" comprising six colour classifications. This scale has been developed to allow several products of similar colour to be tested using a single network that had been trained using the colourscale. The results presented show that both the neural network and the Self-Organising Map approach perform comparably, while the k-NN method tested under-performs the other two.
Sheridan, C.; O'Farrell, M.; Lewis, E.; Lyons, W. B.; Flanagan, C.; Jackman, N.
2006-02-01
This paper reports on two methods of classifying the spectral data from an optical fibre based sensor system as used in the food industry. The first method uses a feed-forward back-propagation artificial neural network while the second method involves using Kohonen self-organizing maps. The sensor monitors the food colour online as the food cooks by examining the reflected light from both the surface and the core of the product. The combination of using principal component analysis and back-propagation neural networks has been successfully investigated previously. In this paper, results obtained using this method are compared with results obtained using a self-organizing map trained on the principal components. The principal components used to train both classifiers are ordered in a 'colourscale'—a scale developed to allow several products of similar colour to be tested using a single network that had been trained using the colourscale. The results presented show that both classifiers perform well, and that any differences that arise occur at the boundaries of the classes.
Directory of Open Access Journals (Sweden)
Aleksius Madu
2016-10-01
Full Text Available The purpose of this study is to predict the number of traffic accident victims who died in Timor Tengah Regency with Trend Projection method and Backpropagation method, and compare the two methods based on the degree of guilt and predict the number traffic accident victims in the Timor Tengah Regency for the coming year. This research was conducted in Timor Tengah Regency where data used in this study was obtained from Police Unit in Timor Tengah Regency. The data is on the number of traffic accidents in Timor Tengah Regency from 2000 – 2013, which is obtained by a quantitative analysis with Trend Projection and Backpropagation method. The results of the data analysis predicting the number of traffic accidents victims using Trend Projection method obtained the best model which is the quadratic trend model with equation Yk = 39.786 + (3.297 X + (0.13 X2. Whereas by using back propagation method, it is obtained the optimum network that consists of 2 inputs, 3 hidden screens, and 1 output. Based on the error rates obtained, Back propagation method is better than the Trend Projection method which means that the predicting accuracy with Back propagation method is the best method to predict the number of traffic accidents victims in Timor Tengah Regency. Thus obtained predicting the numbers of traffic accident victims for the next 5 years (Years 2014-2018 respectively - are 106 person, 115 person, 115 person, 119 person and 120 person. Keywords: Trend Projection, Back propagation, Predicting.
Directory of Open Access Journals (Sweden)
Harjoko Agus
2018-01-01
Full Text Available Acute Myeloid Leukemia (AML is a type of cancer which attacks white blood cells from myeloid. AML has eight subtypes, namely: M0, M1, M2, M3, M4, M5, M6, and M7. AML subtypes M1, M2 and M3 are affected by the same type of cells, myeloblast, making it needs more detailed analysis to distinguish. To overcome these obstacles, this research is applying digital image processing with Active Contour Without Edge (ACWE and Momentum Backpropagation artificial neural network for AML subtypes M1, M2 and M3 classification based on the type of the cell. Six features required as training parameters from every cell obtained by using feature extraction. The features are: cell area, perimeter, circularity, nucleus ratio, mean and standard deviation. The results show that ACWE can be used for segmenting white blood cells with 83.789% success percentage of 876 total cell objects. The whole AML slides had been identified according to the cell types predicted number through training with momentum backpropagation. Five times testing calibration with the best parameter generated averages value of 84.754% precision, 75.887% sensitivity, 95.090% specificity and 93.569% accuracy.
International Nuclear Information System (INIS)
Cen Haiyan; Bao Yidan; He Yong
2006-01-01
Visible and near-infrared reflectance (visible-NIR) spectroscopy is applied to discriminate different varieties of bayberry juices. The discrimination of visible-NIR spectra from samples is a matter of pattern recognition. By partial least squares (PLS), the spectrum is reduced to certain factors, which are then taken as the input of the backpropagation neural network (BPNN). Through training and prediction, three different varieties of bayberry juice are classified based on the output of the BPNN. In addition, a mathematical model is built and the algorithm is optimized. With proper parameters in the training set,100% accuracy is obtained by the BPNN. Thus it is concluded that the PLS analysis combined with the BPNN is an alternative for pattern recognition based on visible and NIR spectroscopy
Blanco Iturralde, David Roberto; Chávez Sánchez, Juan Daniel
2012-01-01
Al desarrollar el sistema basados en las técnicas y métodos anteriormente descritos se considero el lenguaje de programación C Sharp para la creación de la interfaz del sistema por las características que brinda en el manejo de imágenes a través de sus librerías que son apropiadas para este tipo de trabajo y Matlab para la red neuronal backpropagation y cálculos matemáticos complejos por ser un lenguaje nativo en la resolución de problemas matemáticos obteniendo así un sistema robusto y de al...
Yu, Hao; Rossi, Giammarco; Braglia, Andrea; Perrone, Guido
2016-08-10
The paper presents the development of a tool based on a back-propagation artificial neural network to assist in the accurate positioning of the lenses used to collimate the beam from semiconductor laser diodes along the so-called fast axis. After training using a Gaussian beam ray-equivalent model, the network is capable of indicating the tilt, decenter, and defocus of such lenses from the measured field distribution, so the operator can determine the errors with respect to the actual lens position and optimize the diode assembly procedure. An experimental validation using a typical configuration exploited in multi-emitter diode module assembly and fast axis collimating lenses with different focal lengths and numerical apertures is reported.
Directory of Open Access Journals (Sweden)
Zhilong Wang
2014-01-01
Full Text Available In the electricity market, the electricity price plays an inevitable role. Nevertheless, accurate price forecasting, a vital factor affecting both government regulatory agencies and public power companies, remains a huge challenge and a critical problem. Determining how to address the accurate forecasting problem becomes an even more significant task in an era in which electricity is increasingly important. Based on the chaos particle swarm optimization (CPSO, the backpropagation artificial neural network (BPANN, and the idea of bivariate division, this paper proposes a bivariate division BPANN (BD-BPANN method and the CPSO-BD-BPANN method for forecasting electricity price. The former method creatively transforms the electricity demand and price to be a new variable, named DV, which is calculated using the division principle, to forecast the day-ahead electricity by multiplying the forecasted values of the DVs and forecasted values of the demand. Next, to improve the accuracy of BD-BPANN, chaos particle swarm optimization and BD-BPANN are synthesized to form a novel model, CPSO-BD-BPANN. In this study, CPSO is utilized to optimize the initial parameters of BD-BPANN to make its output more stable than the original model. Finally, two forecasting strategies are proposed regarding different situations.
Yu, Jiong; Pan, Qiaoling; Yang, Jinfeng; Zhu, Chengxing; Jin, Linfeng; Hao, Guangshu; Shi, Xiaowei; Cao, Hongcui; Lin, Feiyan
2017-06-19
BACKGROUND The complete blood count (CBC) is the most common examination used to monitor overall health in clinical practice. Whether there is a relationship between CBC indexes and alanine transaminase (ALT) and aspartate aminotransferase (AST) has been unclear. MATERIAL AND METHODS In this study, 572 normal-weight and 346 overweight Chinese subjects were recruited. The relationship between CBC indexes with ALT and AST were analyzed by Pearson and Spearman correlations according to their sex, then we conducted colinearity diagnostics and multiple linear regression (MLR) analysis. A prediction model was developed by a back-propagation artificial neural network (BP-ANN). RESULTS ALT was related to 4 CBC indexes in the male normal-weight group and 3 CBC indexes in the female group. In the overweight group, ALT had a similar relationship with the normal group, but there was only 1 index related with AST in the normal-weight group and male overweight groups. The ALT regression models were developed in normal-weight and overweight people, which had better correlation coefficient (R>0.3). After training 1000 epochs, the BP-ANN models of ALT achieved higher correlations than MLR models in normal-weight and overweight people. CONCLUSIONS ALT is a more suitable index than AST for developing a regression model. ALT can be predicted by CBC indexes in normal-weight and overweight individuals based on a BP-ANN model, which was better than MLR analysis.
Wisesty, Untari N.; Warastri, Riris S.; Puspitasari, Shinta Y.
2018-03-01
Cancer is one of the major causes of mordibility and mortality problems in the worldwide. Therefore, the need of a system that can analyze and identify a person suffering from a cancer by using microarray data derived from the patient’s Deoxyribonucleic Acid (DNA). But on microarray data has thousands of attributes, thus making the challenges in data processing. This is often referred to as the curse of dimensionality. Therefore, in this study built a system capable of detecting a patient whether contracted cancer or not. The algorithm used is Genetic Algorithm as feature selection and Momentum Backpropagation Neural Network as a classification method, with data used from the Kent Ridge Bio-medical Dataset. Based on system testing that has been done, the system can detect Leukemia and Colon Tumor with best accuracy equal to 98.33% for colon tumor data and 100% for leukimia data. Genetic Algorithm as feature selection algorithm can improve system accuracy, which is from 64.52% to 98.33% for colon tumor data and 65.28% to 100% for leukemia data, and the use of momentum parameters can accelerate the convergence of the system in the training process of Neural Network.
Directory of Open Access Journals (Sweden)
Gang Yang
2017-09-01
Full Text Available The solubility data of compounds in supercritical fluids and the correlation between the experimental solubility data and predicted solubility data are crucial to the development of supercritical technologies. In the present work, the solubility data of silymarin (SM in both pure supercritical carbon dioxide (SCCO2 and SCCO2 with added cosolvent was measured at temperatures ranging from 308 to 338 K and pressures from 8 to 22 MPa. The experimental data were fit with three semi-empirical density-based models (Chrastil, Bartle and Mendez-Santiago and Teja models and a back-propagation artificial neural networks (BPANN model. Interaction parameters for the models were obtained and the percentage of average absolute relative deviation (AARD% in each calculation was determined. The correlation results were in good agreement with the experimental data. A comparison among the four models revealed that the experimental solubility data were more fit with the BPANN model with AARDs ranging from 1.14% to 2.15% for silymarin in pure SCCO2 and with added cosolvent. The results provide fundamental data for designing the extraction of SM or the preparation of its particle using SCCO2 techniques.
International Nuclear Information System (INIS)
Doh, Jaeh Yeok; Lee, Jong Soo; Lee, Seung Uk
2016-01-01
In this study, a Back-propagation neural network (BPN) is employed to conduct an approximation of a true stress-strain curve using the load-displacement experimental data of DP590, a high-strength material used in automobile bodies and chassis. The optimized interconnection weights are obtained with hidden layers and output layers of the BPN through intelligent learning and training of the experimental data; by using these weights, a mathematical model of the material's behavior is suggested through this feed-forward neural network. Generally, the material properties from the tensile test cannot be acquired until the fracture regions, since it is difficult to measure the cross-section area of a specimen after diffusion necking. For this reason, the plastic properties of the true stress-strain are extrapolated using the weighted-average method after diffusion necking. The accuracies of BPN-based meta-models for predicting material properties are validated in terms of the Root mean square error (RMSE). By applying the approximate material properties, the reliable finite element solution can be obtained to realize the different shapes of the finite element models. Furthermore, the sensitivity analysis of the approximate meta-model is performed using the first-order approximate derivatives of the BPN and is compared with the results of the finite difference method. In addition, we predict the tension velocity's effect on the material property through a first-order sensitivity analysis.
Energy Technology Data Exchange (ETDEWEB)
Doh, Jaeh Yeok; Lee, Jong Soo [Yonsei University, Seoul (Korea, Republic of); Lee, Seung Uk [Gyeongbuk Hybrid Technology Institute, Yeongcheon (Korea, Republic of)
2016-03-15
In this study, a Back-propagation neural network (BPN) is employed to conduct an approximation of a true stress-strain curve using the load-displacement experimental data of DP590, a high-strength material used in automobile bodies and chassis. The optimized interconnection weights are obtained with hidden layers and output layers of the BPN through intelligent learning and training of the experimental data; by using these weights, a mathematical model of the material's behavior is suggested through this feed-forward neural network. Generally, the material properties from the tensile test cannot be acquired until the fracture regions, since it is difficult to measure the cross-section area of a specimen after diffusion necking. For this reason, the plastic properties of the true stress-strain are extrapolated using the weighted-average method after diffusion necking. The accuracies of BPN-based meta-models for predicting material properties are validated in terms of the Root mean square error (RMSE). By applying the approximate material properties, the reliable finite element solution can be obtained to realize the different shapes of the finite element models. Furthermore, the sensitivity analysis of the approximate meta-model is performed using the first-order approximate derivatives of the BPN and is compared with the results of the finite difference method. In addition, we predict the tension velocity's effect on the material property through a first-order sensitivity analysis.
Song, Xianzhi; Peng, Chi; Li, Gensheng; He, Zhenguo; Wang, Haizhu
2016-01-01
Sand production and blockage are common during the drilling and production of horizontal oil and gas wells as a result of formation breakdown. The use of high-pressure rotating jets and annular helical flow is an effective way to enhance horizontal wellbore cleanout. In this paper, we propose the idea of using supercritical CO2 (SC-CO2) as washing fluid in water-sensitive formation. SC-CO2 is manifested to be effective in preventing formation damage and enhancing production rate as drilling fluid, which justifies tis potential in wellbore cleanout. In order to investigate the effectiveness of SC-CO2 helical flow cleanout, we perform the numerical study on the annular flow field, which significantly affects sand cleanout efficiency, of SC-CO2 jets in horizontal wellbore. Based on the field data, the geometry model and mathematical models were built. Then a numerical simulation of the annular helical flow field by SC-CO2 jets was accomplished. The influences of several key parameters were investigated, and SC-CO2 jets were compared to conventional water jets. The results show that flow rate, ambient temperature, jet temperature, and nozzle assemblies play the most important roles on wellbore flow field. Once the difference between ambient temperatures and jet temperatures is kept constant, the wellbore velocity distributions will not change. With increasing lateral nozzle size or decreasing rear/forward nozzle size, suspending ability of SC-CO2 flow improves obviously. A back-propagation artificial neural network (BP-ANN) was successfully employed to match the operation parameters and SC-CO2 flow velocities. A comprehensive model was achieved to optimize the operation parameters according to two strategies: cost-saving strategy and local optimal strategy. This paper can help to understand the distinct characteristics of SC-CO2 flow. And it is the first time that the BP-ANN is introduced to analyze the flow field during wellbore cleanout in horizontal wells.
Directory of Open Access Journals (Sweden)
Orlando Lastres Danguillecourt
2012-03-01
Full Text Available Este trabajo presenta los resultados preliminares de la configuración de una red neuronal artificial (ANN, de tipo alimentación hacia adelante con el método de entrenamiento de retro-propagación para pronosticar la velocidad de viento en la región del Istmo de Tehuantepec, Oaxaca, México. La base de datos utilizada abarca los años comprendidos entre Junio 2008- Noviembre 2011, y fue suministrada por una estación meteorológica ubicada en la Universidad del Istmo campus Tehuantepec. Los experimentos se realizaron utilizando las siguientes variables: velocidad del viento, presión, temperatura y fecha. Al mismo tiempo se hicieron siete pruebas combinando estas variables, comparando su error cuadrático medio (MSE y el coeficiente de correlación r, con los datos de predicción y experimentales. En esta investigación, se propone una ANN de dos capas ocultas, para un pronóstico de 48 horas.This paper presents the preliminary results of setting up an artificial neural network (ANN of the feed forward type with the backpropagation training method for forecast wind speed in the region in the Isthmus of Tehuantepec, Oaxaca, Mexico. The database used covers the years from June 2008 - November 2011, and was supplied by a meteorological station located at the Isthmus University campus Tehuantepec. The experiments were done using the following variables: wind speed, pressure, temperature and date. At the same time were done seven tests combining these variables, comparing their mean square error (MSE and coefficient correlation r, with data the predicting and experimental. In this research, is proposed a ANN of two hidden layers, for a forecast of 48 hours.
Vrettaros, John; Vouros, George; Drigas, Athanasios S.
This article studies the expediency of using neural networks technology and the development of back-propagation networks (BPN) models for modeling automated evaluation of the answers and progress of deaf students' that possess basic knowledge of the English language and computer skills, within a virtual e-learning environment. The performance of the developed neural models is evaluated with the correlation factor between the neural networks' response values and the real value data as well as the percentage measurement of the error between the neural networks' estimate values and the real value data during its training process and afterwards with unknown data that weren't used in the training process.
Energy Technology Data Exchange (ETDEWEB)
Toda-Caraballo, I.; Garcia-Mateo, C.; Capdevila, C.
2010-07-01
At the beginning of the decade of the nineties, the industrial interest for TRIP steels leads to a significant increase of the investigation and application in this field. In this work, the flexibility of neural networks for the modelling of complex properties is used to tackle the problem of determining the retained austenite content in TRIP-steel. Applying a combination of two learning algorithms (backpropagation and creeping-random-search) for the neural network, a model has been created that enables the prediction of retained austenite in low-Si / low-Al multiphase steels as a function of processing parameters. (Author). 34 refs.
Predictive accuracy of backpropagation neural network ...
Indian Academy of Sciences (India)
river basin, Chile; Global Planet. Change 47 212–220. Mohan S 1991 Intercomparison of evapotranspiration esti- mates; Hydrol. Sci. J. 36(5) 447–460. Nandagiri L and Kovoor G 2006 Performance evaluation of reference evapotranspiration equations across a range of. Indian climates; J. Irrig. Drain. Eng. 132(3) 238–249.
Predictive accuracy of backpropagation neural network ...
Indian Academy of Sciences (India)
incorporated into the BP model for high accuracy management purpose of irrigation water, which relies on accurate values of ET ref. 1. Introduction. A water balance computer simulation model appli- cation for irrigation planning in Burkina Faso required a reliable estimation of evapotranspira- tion to improve the water use ...
Conjugate descent formulation of backpropagation error in ...
African Journals Online (AJOL)
the supervised learning process is posed as an unconstrained optimization problem with the error function as objective function. In this case an optimal value of an increment in the weights is obtained by considering only up to second order derivatives of the error function. The resulting expression for the optimal weight ...
Predictive accuracy of backpropagation neural network ...
Indian Academy of Sciences (India)
, Burkina Faso, Africa. African Policy Center, United Nations Economic Commission for Africa (UNECA), Addis-Ababa, Ethiopia. Department of Civil Engineering, National Pingtung University of Science and Technology, Pingtung, Taiwan, ...
Neural Network Back-Propagation Algorithm for Sensing Hypergols
Perotti, Jose; Lewis, Mark; Medelius, Pedro; Bastin, Gary
2013-01-01
Fast, continuous detection of a wide range of hazardous substances simultaneously is needed to achieve improved safety for personnel working with hypergolic fuels and oxidizers, as well as other hazardous substances, with a requirement for such detection systems to warn personnel immediately upon the sudden advent of hazardous conditions, with a high probability of detection and a low false alarm rate. The primary purpose of this software is to read the voltage outputs from voltage dividers containing carbon nano - tube sensors as a variable resistance leg, and to recognize quickly when a leak has occurred through recognizing that a generalized pattern change in resistivity of a carbon nanotube sensor has occurred upon exposure to dangerous substances, and, further, to identify quickly just what substance is present through detailed pattern recognition of the shape of the response provided by the carbon nanotube sensor.
PENERAPAN ALGORITMA BAYESIAN REGULARIZATION BACKPROPAGATION UNTUK MEMPREDIKSI PENYAKIT DIABETES
S Suwarno; A A Abdillah
2017-01-01
Pada tahun 2015, penderita diabetes di Indonesia sebanyak 10 juta jiwa. Banyaknya penderita diabetes ini semakin bertambah dari tahun ke tahun. Berdasarkan data International Diabetes Federation, diperkirakan pada tahun 2040 banyaknya penduduk Indonesia yang terkena penyakit diabates akan meningkat menjadi 16.2 juta jiwa penduduk. Upaya pendeteksian sejak dini penyakit diabetes perlu dilakukan. Hal ini untuk mengurangi komplikasi penyakit pada penderita pada masa yang akan datang. Neural netw...
Penerapan Algoritma Bayesian Regularization Backpropagation Untuk Memprediksi Penyakit Diabetes
Suwarno, S; Abdillah, A A
2016-01-01
Pada tahun 2015, penderita diabetes di Indonesia sebanyak 10 juta jiwa. Banyaknya penderita diabetes ini semakin bertambah dari tahun ke tahun. Berdasarkan data International Diabetes Federation, diperkirakan pada tahun 2040 banyaknya penduduk Indonesia yang terkena penyakit diabates akan meningkat menjadi 16.2 juta jiwa penduduk. Upaya pendeteksian sejak dini penyakit diabetes perlu dilakukan. Hal ini untuk mengurangi komplikasi penyakit pada penderita pada masa yang akan datang. Neural netw...
Ocean wave parameters estimation using backpropagation neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; SubbaRao; Raju, D.H.
is trained the ocean wave parameters can be estimated for unknown measured spectra, whereas significant wave height and spectral peak period are required to first generate the Scott spectra and then estimate other ocean wave parameters....
Fang, Hongqing; He, Lei; Si, Hao; Liu, Peng; Xie, Xiaolei
2014-09-01
In this paper, Back-propagation(BP) algorithm has been used to train the feed forward neural network for human activity recognition in smart home environments, and inter-class distance method for feature selection of observed motion sensor events is discussed and tested. And then, the human activity recognition performances of neural network using BP algorithm have been evaluated and compared with other probabilistic algorithms: Naïve Bayes(NB) classifier and Hidden Markov Model(HMM). The results show that different feature datasets yield different activity recognition accuracy. The selection of unsuitable feature datasets increases the computational complexity and degrades the activity recognition accuracy. Furthermore, neural network using BP algorithm has relatively better human activity recognition performances than NB classifier and HMM. Copyright © 2014 ISA. Published by Elsevier Ltd. All rights reserved.
Wiryadinata, Romi; Ratnawati, Dwi Ana
2005-01-01
Motor DC dan komputer banyak digunakan dalam kehidupan sehari-sehari, baik di rumah tangga,industri maupun lingkungan pendidikan yang sangat membutuhkan ketelitian dan penggunan yang serbaotomatis. Jaringan Syaraf Tiruan merupakan salah satu kendali motor DC yang dapat disimulasikanmenggunakan neural network toolbox pada software Matlab 6.5. Dengan menggunakan metode Backpropagationdan fungsi Gradient Descent Momentum diperoleh struktur jaringan yang terbaik, terdiri dari 5 sel neuronlapisan ...
Directory of Open Access Journals (Sweden)
Z Abidin
2013-07-01
Full Text Available Di dalam kehidupan sehari-hari, khususnya dalam komunikasi interpersonal, wajah sering digunakan untuk berekspresi. Melalui ekspresi wajah, maka dapat dipahami emosi yang sedang bergejolak pada diri individu. Ekspresi wajah merupakan salah satu karakteristik perilaku. Penggunaan sistem teknologi biometrika dengan karakteristik ekspresi wajah memungkinkan untuk mengenali mood atau emosi seseorang. Komponen dasar sistem analisis ekspresi wajah adalah deteksi wajah, ekstraksi data wajah, dan pengenalan ekspresi wajah. Sehingga untuk membangun sebuah sistem pengenal ekspersi wajah, maka perlu dirancang tiga buah sub sistem yaitu sistem deteksi wajah, sistem pembelajaran jaringan syaraf tiruan. Prinsipnya data wajah yang telah dideteksi, diolah menggunakan fisherface, yang selanjutnya hasilnya digunakan sebagai input untuk jaringan syaraf tiruan. Bobot yang dihasilkan pada saat proses pembelajaran jaringan syaraf tiruan inilah yang akan digunakan untuk pengenalan ekspresi wajah.Â In daily life, especially in interpersonal communication, face often used for express of emotions. Facial expressions are the facial changes in response to a personâ€™s internal emotional states. A facial expression is one of the behavioral characteristics. The use of facial expression characteristics enables to recognize of personâ€™s mood. Basic components of a facial expression analysis system are face detection, face data extraction, and facial expression recognition. So that, to build a facial expression recognition system, it should be designed three subsystems, namely face detection system, learning of neural network system, and facial expression recognition system itself. In principle, face data that has been successfully detected, then it will be constructed by fisherface, and the results of it will be used as an input of neural network. Afterwards, the weights of neural network learning will be used to recognize facial expression.
The Prediction of Bankruptcy Using Backpropagation Algorithm for “IO” Model Analysis
Directory of Open Access Journals (Sweden)
Ciprian Dragota
2007-01-01
Full Text Available The basic question which every bank it putswhen a client or a future client whishes to take a bank loanis: “The future debtor it’s capable to refund the loan atmaturity? (Installments plus the interest“. To answer atthis question the bank makes an assessment in which assetsand liabilities are analyze. There is also assessed the creditrating, the cash flow, the securities and, very important,bankrupt risk analysis.For the last one, to calculate bankrupt risk analysis,banks use some models (knows as “Z” score. Few of themare financials methods (like Altman, Canon & Holder,Yves Colonques etc. Nevertheless, these models are beendevelop for a specific situation and for a western economywhich is functional and very articulated. For our economy,we propose a new model that is been build with the specificeconomic dates and inputs, the model we called “IO”model.Without pretending to be able to penetrate over thecomplexity of the phenomenon, this study is trying to do apractical and experimental analysis of bankruptcy usingback propagation algorithm applied to the ”IO” model.
Directory of Open Access Journals (Sweden)
Jesús Salvador Velázquez-González
2015-01-01
Full Text Available Una de las complicaciones más graves de la Diabetes Mellitus tipo 2 es la Retinopatía Diabética (RD. La RD es una enfermedad silenciosa y solo es reconocida por el portador cuándo los cambios en la retina han progresado a un nivel en el cual el tratamiento se complica, por lo que el diagnóstico oportuno y la remisión al oftalmólogo u optometrista para el manejo de esta enfermedad pueden prevenir el 98% de la pérdida visual grave. El objetivo de este trabajo es identificar de manera automática la No Retinopatía Diabética (NRD y la Retinopatía de Fondo, utilizando imágenes del fondo de ojo. Nuestros resultados muestran una efectividad del 92%, con una sensitividad y especificidad del 95%.
2011-03-01
are made of three different meats (20 Beef, 17 “ Meat ”, & 17 Poultry ). The data set containing the following features: • $/oz • $/lb protein...structure in minimal training time. Data sets used include an XOR data set, Fisher’s iris data set, and a financial industry data set, among others. v...4.2.3. Finance Industry Data Set ...................................................................................................... 38 4.2.4. Hot
Reversible Back-Propagation Imaging Algorithm for Post-Processing of Ultrasonic Array Data
Velichko, A.; Wilcox, P. D.
2009-03-01
The paper describes a method for processing data from an ultrasonic transducer array. The proposed algorithm is formulated in such a way that it is reversible, i.e. the raw data set can be recovered from the image. This is of practical significance because it allows the raw-data to be spatially filtered using the image to extract, for example, only the raw data associated with a particular reflector. The method is tested on experimental data obtained from a commercial 64-element, 5-MHZ array on an aluminium specimen that contains a number of machined slots and side-drilled holes. The raw transmitter-receiver data corresponded to each reflector is extracted and the scattering matrices of different reflectors are reconstructed. It allows the signals from 1-mm-long slot and a 1-mm-diameter hole to be clearly distinguished and the orientation and the size of the slots to be determined.
The performance of the backpropagation algorithm with varying slope of the activation function
International Nuclear Information System (INIS)
Bai Yanping; Zhang Haixia; Hao Yilong
2009-01-01
Some adaptations are proposed to the basic BP algorithm in order to provide an efficient method to non-linear data learning and prediction. In this paper, an adopted BP algorithm with varying slope of activation function and different learning rates is put forward. The results of experiment indicated that this algorithm can get very good performance of training. We also test the prediction performance of our adopted BP algorithm on 16 instances. We compared the test results to the ones of the BP algorithm with gradient descent momentum and an adaptive learning rate. The results indicate this adopted BP algorithm gives best performance (100%) for test example, which conclude this adopted BP algorithm produces a smoothed reconstruction that learns better to new prediction function values than the BP algorithm improved with momentum.
International Nuclear Information System (INIS)
Taraglio, S.; Massaioli, F.
1995-08-01
A parallel implementation of a library to build and train Multi Layer Perceptrons via the Back Propagation algorithm is presented. The target machine is the SIMD massively parallel supercomputer Quadrics. Performance measures are provided on three different machines with different number of processors, for two network examples. A sample source code is given
An Adaptive Filtering Algorithm Based on Genetic Algorithm-Backpropagation Network
Directory of Open Access Journals (Sweden)
Kai Hu
2013-01-01
Full Text Available A new image filtering algorithm is proposed. GA-BPN algorithm uses genetic algorithm (GA to decide weights in a back propagation neural network (BPN. It has better global optimal characteristics than traditional optimal algorithm. In this paper, we used GA-BPN to do image noise filter researching work. Firstly, this paper uses training samples to train GA-BPN as the noise detector. Then, we utilize the well-trained GA-BPN to recognize noise pixels in target image. And at last, an adaptive weighted average algorithm is used to recover noise pixels recognized by GA-BPN. Experiment data shows that this algorithm has better performance than other filters.
Vehicles Potholes Detection Based Blob Detection Method and Neural Network Backpropagation Model
Dewiani, Dewiani; Achmad, Andani; Parung, Rivanto
2016-01-01
In Indonesia, especially on developing area, many potholes are occurred almost on every part of the road. The situation is exacerbated on how potholes location data gathering is performed manually by field personnel of the Department of Transportation or other related services, which would require more time and cost. This study aimed to produce a prototype of detection system and potholes location automatically. The prototype is a device attached on public transport so that it can be a soluti...
Forecasting Urban Air Quality via a Back-Propagation Neural Network and a Selection Sample Rule
Directory of Open Access Journals (Sweden)
Yonghong Liu
2015-07-01
Full Text Available In this paper, based on a sample selection rule and a Back Propagation (BP neural network, a new model of forecasting daily SO2, NO2, and PM10 concentration in seven sites of Guangzhou was developed using data from January 2006 to April 2012. A meteorological similarity principle was applied in the development of the sample selection rule. The key meteorological factors influencing SO2, NO2, and PM10 daily concentrations as well as weight matrices and threshold matrices were determined. A basic model was then developed based on the improved BP neural network. Improving the basic model, identification of the factor variation consistency was added in the rule, and seven sets of sensitivity experiments in one of the seven sites were conducted to obtain the selected model. A comparison of the basic model from May 2011 to April 2012 in one site showed that the selected model for PM10 displayed better forecasting performance, with Mean Absolute Percentage Error (MAPE values decreasing by 4% and R2 values increasing from 0.53 to 0.68. Evaluations conducted at the six other sites revealed a similar performance. On the whole, the analysis showed that the models presented here could provide local authorities with reliable and precise predictions and alarms about air quality if used at an operational scale.
Axon-somatic back-propagation in detailed models of spinal alpha motoneurons
Directory of Open Access Journals (Sweden)
Pietro eBalbi
2015-02-01
Full Text Available Antidromic action potentials following distal stimulation of motor axons occasionally fail to invade the soma of alpha motoneurons in spinal cord, due to their passing through regions of high non-uniformity.Morphologically detailed conductance-based models of cat spinal alpha motoneurons have been developed, with the aim to reproduce and clarify some aspects of the electrophysiological behavior of the antidromic axon-somatic spike propagation. Fourteen 3D morphologically detailed somata and dendrites of cat spinal alpha motoneurons have been imported from an open-access web-based database of neuronal morphologies, NeuroMorpho.org, and instantiated in neurocomputational models. An axon hillock, an axonal initial segment and a myelinated axon are added to each model.By sweeping the diameter of the axonal initial segment (AIS and the axon hillock, as well as the maximal conductances of sodium channels at the AIS and at the soma, the developed models are able to show the relationships between different geometric and electrophysiological configurations and the voltage attenuation of the antidromically travelling wave.In particular, a greater than usually admitted sodium conductance at AIS is necessary and sufficient to overcome the dramatic voltage attenuation occurring during antidromic spike propagation both at the myelinated axon-AIS and at the AIS-soma transitions.
Directory of Open Access Journals (Sweden)
Lei Si
2014-01-01
Full Text Available Classification is an important theme in data mining. Rough sets and neural networks are the most common techniques applied in data mining problems. In order to extract useful knowledge and classify ambiguous patterns effectively, this paper presented a hybrid algorithm based on the integration of rough sets and BP neural network to construct a novel classification system. The attribution values were discretized through PSO algorithm firstly to establish a decision table. The attribution reduction algorithm and rules extraction method based on rough sets were proposed, and the flowchart of proposed approach was designed. Finally, a prototype system was developed and some simulation examples were carried out. Simulation results indicated that the proposed approach was feasible and accurate and was outperforming others.
Morrow, Ivor L.; van Genderen, Piet
2001-10-01
This paper presents a novel polarimetric near-field two-dimension (2D) synthetic aperture focusing technique (SAFT) suitable for ground penetrating radar (GPR) application. The imaging algorithm is intended for locating metallic and non-metallic anti-personnel (AP's) mines using an ultra-wide-band stepped frequency radar. A radar image can be formed by coherently integrating the backscattered field over the measured frequency spectrum and cross-range scan. The coherent integration is essentially a convolution of the collected data and a focusing (test) function, which only depends on the geometry of the measurement. Wavefront curvature must be taken account of when attempting to image an object within 1-2 wavelengths off an antenna(s) phase center. Applying conventional far-field SAR imaging using a direct Fourier inversion may result in images which are increasingly blurred and shifted at points more distant from the point of rotation of the focusing function. Here, a focusing function is first derived based on a conventional far-field geometrical optic propagator for a two-media problem. Then to correct for geometric distortion in the focusing function when applied in the near-field zone we introduce higher order terms to the range function. In order to verify and augment the technique described two field studies were conducted, over different frequency spectrums, the finding of which demonstrates the utility of the technique and the experimental practices.
Vairaprakash Gurusamy *1 & K.Nandhini2
2017-01-01
A Neural Network is a powerful data modeling tool that is able to capture and represent complex input/output relationships. The motivation for the development of neural network technology stemmed from the desire to develop an artificial system that could perform "intelligent" tasks similar to those performed by the human brain.Back propagation was created by generalizing the Widrow-Hoff learning rule to multiple-layer networks and nonlinear differentiable transfer functions. The term back pro...
New backpropagation algorithm with type-2 fuzzy weights for neural networks
Gaxiola, Fernando; Valdez, Fevrier
2016-01-01
In this book a neural network learning method with type-2 fuzzy weight adjustment is proposed. The mathematical analysis of the proposed learning method architecture and the adaptation of type-2 fuzzy weights are presented. The proposed method is based on research of recent methods that handle weight adaptation and especially fuzzy weights. The internal operation of the neuron is changed to work with two internal calculations for the activation function to obtain two results as outputs of the proposed method. Simulation results and a comparative study among monolithic neural networks, neural network with type-1 fuzzy weights and neural network with type-2 fuzzy weights are presented to illustrate the advantages of the proposed method. The proposed approach is based on recent methods that handle adaptation of weights using fuzzy logic of type-1 and type-2. The proposed approach is applied to a cases of prediction for the Mackey-Glass (for ô=17) and Dow-Jones time series, and recognition of person with iris bi...
Computer vision system for egg volume prediction using backpropagation neural network
Siswantoro, J.; Hilman, M. Y.; Widiasri, M.
2017-11-01
Volume is one of considered aspects in egg sorting process. A rapid and accurate volume measurement method is needed to develop an egg sorting system. Computer vision system (CVS) provides a promising solution for volume measurement problem. Artificial neural network (ANN) has been used to predict the volume of egg in several CVSs. However, volume prediction from ANN could have less accuracy due to inappropriate input features or inappropriate ANN structure. This paper proposes a CVS for predicting the volume of egg using ANN. The CVS acquired an image of egg from top view and then processed the image to extract its 1D and 2 D size features. The features were used as input for ANN in predicting the volume of egg. The experiment results show that the proposed CSV can predict the volume of egg with a good accuracy and less computation time.
Bahadir, Elif
2016-01-01
The purpose of this study is to examine a neural network based approach to predict achievement in graduate education for Elementary Mathematics prospective teachers. With the help of this study, it can be possible to make an effective prediction regarding the students' achievement in graduate education with Artificial Neural Networks (ANN). Two…
3-D inversion of borehole-to-surface electrical data using a back-propagation neural network
Ho, Trong Long
2009-08-01
The "fluid-flow tomography", an advanced technique for geoelectrical survey based on the conventional mise-à-la-masse measurement, has been developed by Exploration Geophysics Laboratory at the Kyushu University. This technique is proposed to monitor fluid-flow behavior during water injection and production in a geothermal field. However data processing of this technique is very costly. In this light, this paper will discuss the solution to cost reduction by applying a neural network in the data processing. A case study in the Takigami geothermal field in Japan will be used to illustrate this. The achieved neural network in this case study is three-layered and feed-forward. The most successful learning algorithm in this network is the Resilient Propagation (RPROP). Consequently, the study advances the pragmatism of the "fluid-flow tomography" technique which can be widely used for geothermal fields. Accuracy of the solution is then verified by using root mean square (RMS) misfit error as an indicator.
Fauziah; Wibowo, E. P.; Madenda, S.; Hustinawati
2018-03-01
Capturing and recording motion in human is mostly done with the aim for sports, health, animation films, criminality, and robotic applications. In this study combined background subtraction and back propagation neural network. This purpose to produce, find similarity movement. The acquisition process using 8 MP resolution camera MP4 format, duration 48 seconds, 30frame/rate. video extracted produced 1444 pieces and results hand motion identification process. Phase of image processing performed is segmentation process, feature extraction, identification. Segmentation using bakground subtraction, extracted feature basically used to distinguish between one object to another object. Feature extraction performed by using motion based morfology analysis based on 7 invariant moment producing four different classes motion: no object, hand down, hand-to-side and hands-up. Identification process used to recognize of hand movement using seven inputs. Testing and training with a variety of parameters tested, it appears that architecture provides the highest accuracy in one hundred hidden neural network. The architecture is used propagate the input value of the system implementation process into the user interface. The result of the identification of the type of the human movement has been clone to produce the highest acuracy of 98.5447%. The training process is done to get the best results.
DEFF Research Database (Denmark)
Kobayashi, T.; Takara, H.; Sano, A.
2013-01-01
We demonstrate 12-core fiber bidirectional long-haul transmission with sub-petabit-class capacity (2 × 344 Tb/s). Inter-core crosstalk management and multicarrier nonlinear compensation enabled the longest distance of 1500 km in SDM transmission with unidirectional capacity over 300 Tb/s....
Carrasco, Manuel; Garde, Andres; Murillo, Pilar; Serrano, Luis
2005-06-01
In this paper a novel design and implementation of a VLSI Analogue Neural Net based on Multi-Layer Perceptron (MLP) with on-chip Back Propagation (BP) learning algorithm suitable for the resolution of classification problems is described. In order to implement a general and programmable analogue architecture, the design has been carried out in a hierarchical way. In this way the net has been divided in synapsis-blocks and neuron-blocks providing an easy method for the analysis. These blocks basically consist on simple cells, which are mainly, the activation functions (NAF), derivatives (DNAF), multipliers and weight update circuits. The analogue design is based on current-mode translinear techniques using MOS transistors working in the weak inversion region in order to reduce both the voltage supply and the power consumption. Moreover, with the purpose of minimizing the noise, offset and distortion of even order, the topologies are fully-differential and balanced. The circuit, named ANNE (Analogue Neural NEt), has been prototyped and characterized as a proof of concept on CMOS AMI-0.5A technology occupying a total area of 2.7mm2. The chip includes two versions of neural nets with on-chip BP learning algorithm, which are respectively a 2-1 and a 2-2-1 implementations. The proposed nets have been experimentally tested using supply voltages from 2.5V to 1.8V, which is suitable for single cell lithium-ion battery supply applications. Experimental results of both implementations included in ANNE exhibit a good performance on solving classification problems. These results have been compared with other proposed Analogue VLSI implementations of Neural Nets published in the literature demonstrating that our proposal is very efficient in terms of occupied area and power consumption.
Kuniyil Ajith Singh, M.; Jaeger, M.; Frenz, M.; Steenbergen, Wiendelt
2017-01-01
Reflection artifacts caused by acoustic inhomogeneities constitute a major problem in epi-mode biomedical photoacoustic imaging. Photoacoustic transients from the skin and superficial optical absorbers traverse into the tissue and reflect off echogenic structures to generate reflection artifacts.
Pelicano, Christian Mark; Rapadas, Nick; Cagatan, Gerard; Magdaluyo, Eduardo
2017-12-01
Herein, the crystallite size and band gap energy of zinc oxide (ZnO) quantum dots were predicted using artificial neural network (ANN). Three input factors including reagent ratio, growth time, and growth temperature were examined with respect to crystallite size and band gap energy as response factors. The generated results from neural network model were then compared with the experimental results. Experimental crystallite size and band gap energy of ZnO quantum dots were measured from TEM images and absorbance spectra, respectively. The Levenberg-Marquardt (LM) algorithm was used as the learning algorithm for the ANN model. The performance of the ANN model was then assessed through mean square error (MSE) and regression values. Based on the results, the ANN modelling results are in good agreement with the experimental data.
Ehret, Anita; Hochstuhl, David; Gianola, Daniel; Thaller, Georg
2015-03-31
Recently, artificial neural networks (ANN) have been proposed as promising machines for marker-based genomic predictions of complex traits in animal and plant breeding. ANN are universal approximators of complex functions, that can capture cryptic relationships between SNPs (single nucleotide polymorphisms) and phenotypic values without the need of explicitly defining a genetic model. This concept is attractive for high-dimensional and noisy data, especially when the genetic architecture of the trait is unknown. However, the properties of ANN for the prediction of future outcomes of genomic selection using real data are not well characterized and, due to high computational costs, using whole-genome marker sets is difficult. We examined different non-linear network architectures, as well as several genomic covariate structures as network inputs in order to assess their ability to predict milk traits in three dairy cattle data sets using large-scale SNP data. For training, a regularized back propagation algorithm was used. The average correlation between the observed and predicted phenotypes in a 20 times 5-fold cross-validation was used to assess predictive ability. A linear network model served as benchmark. Predictive abilities of different ANN models varied markedly, whereas differences between data sets were small. Dimension reduction methods enhanced prediction performance in all data sets, while at the same time computational cost decreased. For the Holstein-Friesian bull data set, an ANN with 10 neurons in the hidden layer achieved a predictive correlation of r=0.47 for milk yield when the entire marker matrix was used. Predictive ability increased when the genomic relationship matrix (r=0.64) was used as input and was best (r=0.67) when principal component scores of the marker genotypes were used. Similar results were found for the other traits in all data sets. Artificial neural networks are powerful machines for non-linear genome-enabled predictions in animal breeding. However, to produce stable and high-quality outputs, variable selection methods are highly recommended, when the number of markers vastly exceeds sample size.
Mason, Cindi; Twomey, Janet; Wright, David; Whitman, Lawrence
2018-01-01
As the need for engineers continues to increase, a growing focus has been placed on recruiting students into the field of engineering and retaining the students who select engineering as their field of study. As a result of this concentration on student retention, numerous studies have been conducted to identify, understand, and confirm…
Energy Technology Data Exchange (ETDEWEB)
Rosas Ortiz, German
2000-01-01
Fault detection and diagnosis on transmission systems is an interesting area of investigation to Artificial Intelligence (AI) based systems. Neurocomputing is one of fastest growing areas of research in the fields of AI and pattern recognition. This work explores the possible suitability of pattern recognition approach of neural networks for fault detection and classification on power systems. The conventional detection techniques in modern relays are based in digital processing of signals and it need some time (around 1 cycle) to send a tripping signal, also they are likely to make incorrect decisions if the signals are noisy. It's desirable to develop a fast, accurate and robust approach that perform accurately for changing system conditions (like load variations and fault resistance). The aim of this work is to develop a novel technique based on Artificial Neural Networks (ANN), which explores the suitability of a pattern classification approach for fault detection and diagnosis. The suggested approach is based in the fact that when a fault occurs, a change in the system impedance take place and, as a consequence changes in amplitude and phase of line voltage and current signals take place. The ANN-based fault discriminator is trained to detect this changes as indicators of the instant of fault inception. This detector uses instantaneous values of these signals to make decisions. Suitability of using neural network as pattern classifiers for transmission systems fault diagnosis is described in detail a neural network design and simulation environment for real-time is presented. Results showing the performance of this approach are presented and indicate that it is fast, secure and exact enough, and it can be used in high speed fault detection and classification schemes. [Spanish] El diagnostico y la deteccion de fallas en sistemas de transmision es una area de interes en investigacion para sistemas basados en Inteligencia Artificial (IA). El calculo neuronal es una de las areas de investigacion de mas rapido crecimiento en el campo de la IA y el reconocimiento de patrones. Este trabajo explora la posible aplicabilidad de una tecnica de reconocimiento de patrones basada en redes neuronales para la deteccion y la clasificacion de fallas en un SEP. Las tecnicas convencionales de deteccion en los relevadores modernos se basan en un procesamiento digital de senales y requieren de cierto tiempo (alrededor de 1 ciclo) para enviar una senal de disparo, ademas de ser propensas a tomar decisiones incorrectas si las senales se encuentran contaminadas por ruido. Es deseable entonces desarrollar tecnicas que sean rapidas, exactas y robustas y que tengan un buen desempeno ante las condiciones cambiantes del sistema (como variaciones de carga y resistencia de falla, por ejemplo). El objetivo de este trabajo es desarrollar una tecnica novedosa basada en Redes Neuronales Atificales (RNA), la cual explora la aplicabilidad de la propuesta de reconocimiento de patrones para el diagnostico y deteccion de fallas. La tecnica sugerida se basa en el hecho de que cuando ocurre una falla, toma lugar un cambio de impedancia en el sistema y como consecuencia, cambios en la amplitud y fase de las senales de voltajes y corrientes de linea toman lugar. Se desarrolla un discriminador de fallas basado en redes neuronales que es entrenado para detectar estos cambios como indicadores del instante de ocurrencia de la falla. Este detector utiliza valores instantaneos de esas senales para tomar decisiones. Se describe a detalle la aplicabilidad de las redes neuronales como clasificadores de patrones para el diagnostico de fallas en sistemas de transmision y ademas, se presenta un diseno basado en redes neuronales y su ambiente de simulacion para la deteccion y clasificacion de fallas en tiempo real. Se presentan resultados del desempeno de esta tecnica que muestran que es rapida, segura y suficientemente exacta e indican su aplicabilidad dentro de esquemas de deteccion y clasificacion de fallas a muy alta velocidad.
Parameter estimation of an aeroelastic aircraft using neural networks
Indian Academy of Sciences (India)
The neurons within a network are arranged in an input layer, one or more hidden or processing layers, and an output layer. Figure 1b shows a typical backpropagation neural network. The name `backpropagation' comes from the training method employed during the learning (training) process ± backpropagation of error.
Artificial Neural Networks to Detect Risk of Type 2 Diabetes | Baha ...
African Journals Online (AJOL)
A multilayer feedforward architecture with backpropagation algorithm was designed using Neural Network Toolbox of Matlab. The network was trained using batch mode backpropagation with gradient descent and momentum. Best performed network identified during the training was 2 hidden layers of 6 and 3 neurons, ...
A eural etwork Model for Dynamics Simulation
African Journals Online (AJOL)
Nafiisah
Results 5 - 18 ... linear chain of silicon (Si) atoms. In this study, a back-propagation algorithm was employed to train a feedforward neural network. The Levenberg-Marquardt (LM) technique was chosen from the various back-propagation training algorithms available for use in this study. Keywords: Feedforward neural network ...
Program Helps Simulate Neural Networks
Villarreal, James; Mcintire, Gary
1993-01-01
Neural Network Environment on Transputer System (NNETS) computer program provides users high degree of flexibility in creating and manipulating wide variety of neural-network topologies at processing speeds not found in conventional computing environments. Supports back-propagation and back-propagation-related algorithms. Back-propagation algorithm used is implementation of Rumelhart's generalized delta rule. NNETS developed on INMOS Transputer(R). Predefines back-propagation network, Jordan network, and reinforcement network to assist users in learning and defining own networks. Also enables users to configure other neural-network paradigms from NNETS basic architecture. Small portion of software written in OCCAM(R) language.
Neural Networks For Electrohydrodynamic Effect Modelling
Directory of Open Access Journals (Sweden)
Wiesław Wajs
2004-01-01
Full Text Available This paper presents currently achieved results concerning methods of electrohydrodynamiceffect used in geophysics simulated with feedforward networks trained with backpropagation algorithm, radial basis function networks and generalized regression networks.
Neural Network Training on Human Body Core Temperature Data
National Research Council Canada - National Science Library
Sanders, Peter
1999-01-01
A multi-layer Adaptive Linear Element neural network computer program was trained with back-propagation on physiological response data from nine subjects walking on a treadmill in two simulated tropical environments...
Isolated Speech Recognition Using Artificial Neural Networks
National Research Council Canada - National Science Library
Polur, Prasad
2001-01-01
.... A small size vocabulary containing the words YES and NO is chosen. Spectral features using cepstral analysis are extracted per frame and imported to a feedforward neural network which uses a backpropagation with momentum training algorithm...
DEFF Research Database (Denmark)
Da Ros, Francesco; Sackey, I.; Jazayerifar, M.
2015-01-01
Kerr nonlinearity compensation by optical phase conjugation is demonstrated in a WDM PDM 16-QAM system. Improved received signal quality is reported for both dispersion-compensated and dispersion-uncompensated transmission and a comparison with digital backpropagation is provided....
Mitigation of Linear and Nonlinear Impairments in Spectrally Efficient Superchannels
DEFF Research Database (Denmark)
Porto da Silva, Edson; Larsen, Knud J.; Zibar, Darko
2015-01-01
We assess numerically the performance of single-carrier digital backpropagation and maximum-likelihood sequence detection (MLSD) for DP-QPSK superchannel transmission. It is shown that MLSD is advantageous only against inter-carrier linear crosstalk....
Deconvolution using a neural network
Energy Technology Data Exchange (ETDEWEB)
Lehman, S.K.
1990-11-15
Viewing one dimensional deconvolution as a matrix inversion problem, we compare a neural network backpropagation matrix inverse with LMS, and pseudo-inverse. This is a largely an exercise in understanding how our neural network code works. 1 ref.
Wave transmission prediction of multilayer floating breakwater using neural network
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Patil, S.G.; Hegde, A.V.
. Among many neural network architectures, the three layers feed forward error backpropagation neural network (BNN) is the most commonly used representing the input nodes as first layer, hidden nodes as second layer and output nodes as third layer...
Energy Technology Data Exchange (ETDEWEB)
Nose Filho, Kenji; Araujo, Klayton A.M.; Maeda, Jorge L.Y.; Lotufo, Anna Diva P. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil)], Emails: kenjinose@yahoo.com.br, klayton_ama@hotmail.com, jorge-maeda@hotmail.com, annadiva@dee.feis.unesp.br
2009-07-01
This paper presents a development and implementation of a program to electrical load forecasting with data from a Brazilian electrical company, using four different architectures of neural networks of the MATLAB toolboxes: multilayer backpropagation gradient descendent with momentum, multilayer backpropagation Levenberg-Marquardt, adaptive network based fuzzy inference system and general regression neural network. The program presented a satisfactory performance, guaranteeing very good results. (author)
Dynamic training algorithm for dynamic neural networks
International Nuclear Information System (INIS)
Tan, Y.; Van Cauwenberghe, A.; Liu, Z.
1996-01-01
The widely used backpropagation algorithm for training neural networks based on the gradient descent has a significant drawback of slow convergence. A Gauss-Newton method based recursive least squares (RLS) type algorithm with dynamic error backpropagation is presented to speed-up the learning procedure of neural networks with local recurrent terms. Finally, simulation examples concerning the applications of the RLS type algorithm to identification of nonlinear processes using a local recurrent neural network are also included in this paper
Vibration Based Damage Assessment of a Cantilever using a Neural Network
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated.......In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated....
Recognition of Roasted Coffee Bean Levels using Image Processing and Neural Network
Nasution, T. H.; Andayani, U.
2017-03-01
The coffee beans roast levels have some characteristics. However, some people cannot recognize the coffee beans roast level. In this research, we propose to design a method to recognize the coffee beans roast level of images digital by processing the image and classifying with backpropagation neural network. The steps consist of how to collect the images data with image acquisition, pre-processing, feature extraction using Gray Level Co-occurrence Matrix (GLCM) method and finally normalization of data extraction using decimal scaling features. The values of decimal scaling features become an input of classifying in backpropagation neural network. We use the method of backpropagation to recognize the coffee beans roast levels. The results showed that the proposed method is able to identify the coffee roasts beans level with an accuracy of 97.5%.
A comparison of neural network architectures for the prediction of MRR in EDM
Jena, A. R.; Das, Raja
2017-11-01
The aim of the research work is to predict the material removal rate of a work-piece in electrical discharge machining (EDM). Here, an effort has been made to predict the material removal rate through back-propagation neural network (BPN) and radial basis function neural network (RBFN) for a work-piece of AISI D2 steel. The input parameters for the architecture are discharge-current (Ip), pulse-duration (Ton), and duty-cycle (τ) taken for consideration to obtained the output for material removal rate of the work-piece. In the architecture, it has been observed that radial basis function neural network is comparatively faster than back-propagation neural network but logically back-propagation neural network results more real value. Therefore BPN may consider as a better process in this architecture for consistent prediction to save time and money for conducting experiments.
Hybrid system prediction for the stock market: The case of transitional markets
Directory of Open Access Journals (Sweden)
Ralević Nebojša
2017-01-01
Full Text Available The subject of this paper is the creation and testing of an enhanced fuzzy neural network backpropagation model for the prediction of stock market indexes, including the comparison with the traditional neural network backpropagation model. The objective of the research is to gather information concerning the possibilities of using the enhanced fuzzy neural network backpropagation model for the prediction of stock market indexes focusing on transitional markets. The methodology used involves the integration of fuzzified weights into the neural network. The research results will be beneficial both for the broader investment community and the academia, in terms of the application of the enhanced model in the investment decision-making, as well as in improving the knowledge in this subject matter.
Stability Analysis of Neural Networks-Based System Identification
Directory of Open Access Journals (Sweden)
Talel Korkobi
2008-01-01
Full Text Available This paper treats some problems related to nonlinear systems identification. A stability analysis neural network model for identifying nonlinear dynamic systems is presented. A constrained adaptive stable backpropagation updating law is presented and used in the proposed identification approach. The proposed backpropagation training algorithm is modified to obtain an adaptive learning rate guarantying convergence stability. The proposed learning rule is the backpropagation algorithm under the condition that the learning rate belongs to a specified range defining the stability domain. Satisfying such condition, unstable phenomena during the learning process are avoided. A Lyapunov analysis leads to the computation of the expression of a convenient adaptive learning rate verifying the convergence stability criteria. Finally, the elaborated training algorithm is applied in several simulations. The results confirm the effectiveness of the CSBP algorithm.
Using Genetic Algorithms in Secured Business Intelligence Mobile Applications
Directory of Open Access Journals (Sweden)
Silvia TRIF
2011-01-01
Full Text Available The paper aims to assess the use of genetic algorithms for training neural networks used in secured Business Intelligence Mobile Applications. A comparison is made between classic back-propagation method and a genetic algorithm based training. The design of these algorithms is presented. A comparative study is realized for determining the better way of training neural networks, from the point of view of time and memory usage. The results show that genetic algorithms based training offer better performance and memory usage than back-propagation and they are fit to be implemented on mobile devices.
Hindcasting cyclonic waves using neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Rao, S.; Chakravarty, N.V.
value by a weight. Then they attach a bias to this sum and pass on the result through a nonlinearity such as the “sigmoid transfer function”. This forms the input to the output layer that operates identically with the hidden layer nodes. Resulting.... In the backpropagation networks the error between the target output and the network output is calculated and this will be backpropagated using the steepest descent or gradient descent approach. The network weights and biases are adjusted by moving a small step...
Directory of Open Access Journals (Sweden)
Nguyen Ngoc Son
2016-12-01
Full Text Available This article proposes a novel advanced differential evolution method which combines the differential evolution with the modified back-propagation algorithm. This new proposed approach is applied to train an adaptive enhanced neural model for approximating the inverse model of the industrial robot arm. Experimental results demonstrate that the proposed modeling procedure using the new identification approach obtains better convergence and more precision than the traditional back-propagation method or the lonely differential evolution approach. Furthermore, the inverse model of the industrial robot arm using the adaptive enhanced neural model performs outstanding results.
Gain and exposure scheduling to compensate for photorefractive neural-network weight decay
Goldstein, Adam A.; Petrisor, Gregory C.; Jenkins, B. Keith
1995-03-01
A gain and exposure schedule that theoretically eliminates the effect of photorefractive weight decay for the general class of outer-product neural-network learning algorithms (e.g., backpropagation, Widrow-Hoff, perceptron) is presented. This schedule compensates for photorefractive diffraction-efficiency decay by iteratively increasing the spatial-light-modulator transfer function gain and decreasing the weight-update exposure time. Simulation results for the scheduling procedure, as applied to backpropagation learning for the exclusive-OR problem, show improved learning performance compared with results for networks trained without scheduling.
Multigradient for Neural Networks for Equalizers
Directory of Open Access Journals (Sweden)
Chulhee Lee
2003-06-01
Full Text Available Recently, a new training algorithm, multigradient, has been published for neural networks and it is reported that the multigradient outperforms the backpropagation when neural networks are used as a classifier. When neural networks are used as an equalizer in communications, they can be viewed as a classifier. In this paper, we apply the multigradient algorithm to train the neural networks that are used as equalizers. Experiments show that the neural networks trained using the multigradient noticeably outperforms the neural networks trained by the backpropagation.
Neural network signature verification using Haar wavelet and Fourier transforms
McCormack, Daniel K. R.; Brown, B. M.; Pedersen, John F.
1993-08-01
This paper discusses the use of neural network's for handwritten signature verification using the Fourier and Haar wavelet transforms as methods of encoding signature images. Results will be presented that discuss a neural network's ability to generalize to unseen signatures using wavelet encoded training data. These results will be discussed with reference to both Backpropagation networks and Cascade-Correlation networks. Backpropagation and Cascade- Correlation networks are used to compare and contrast the generalization ability of Haar wavelet and Fourier transform encoded signature data.
Fuzzy neural network approaches for robotic gait synthesis.
Juang, J G
2000-01-01
In this paper, a learning scheme using a fuzzy controller to generate walking gaits is developed. The learning scheme uses a fuzzy controller combined with a linearized inverse biped model. The controller provides the control signals at each control time instant. The algorithm used to train the controller is "backpropagation through time". The linearized inverse biped model provides the error signals for backpropagation through the controller at control time instants. Given prespecified constraints such as the step length, crossing clearance, and walking speed, the control scheme can generate the gait that satisfies these constraints. Simulation results are reported for a five-link biped robot.
PEAK TRACKING WITH A NEURAL NETWORK FOR SPECTRAL RECOGNITION
COENEGRACHT, PMJ; METTING, HJ; VANLOO, EM; SNOEIJER, GJ; DOORNBOS, DA
1993-01-01
A peak tracking method based on a simulated feed-forward neural network with back-propagation is presented. The network uses the normalized UV spectra and peak areas measured in one chromatogram for peak recognition. It suffices to train the network with only one set of spectra recorded in one
Experimental Study of Nonlinear Phase Noise and its Impact on WDM Systems with DP-256QAM
DEFF Research Database (Denmark)
Yankov, Metodi Plamenov; Da Ros, Francesco; Porto da Silva, Edson
2016-01-01
A probabilistic method for mitigating the phase noise component of the non-linear interference in WDM systems with Raman amplification is experimentally demonstrated. The achieved gains increase with distance and are comparable to the gains of single-channel digital back-propagation....
A transfer learning framework for traffic video using neuro-fuzzy ...
Indian Academy of Sciences (India)
P M Ashok Kumar
2017-08-04
Aug 4, 2017 ... applied for each set of temporal transaction to extract latent sequential topics. (4) ANFIS training is done with the back-propagation gradient descent method. The proposed ANFIS model framework is tested on standard dataset and performance is evaluated in terms of training performance and classification ...
Chen, Chau-Kuang
2010-01-01
Artificial Neural Network (ANN) and Support Vector Machine (SVM) approaches have been on the cutting edge of science and technology for pattern recognition and data classification. In the ANN model, classification accuracy can be achieved by using the feed-forward of inputs, back-propagation of errors, and the adjustment of connection weights. In…
Advances in Artificial Neural Networks - Methodological Development and Application
Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other ne...
Yorek, Nurettin; Ugulu, Ilker
2015-01-01
In this study, artificial neural networks are suggested as a model that can be "trained" to yield qualitative results out of a huge amount of categorical data. It can be said that this is a new approach applied in educational qualitative data analysis. In this direction, a cascade-forward back-propagation neural network (CFBPN) model was…
Artificial neural network approach for estimation of surface specific ...
Indian Academy of Sciences (India)
R. Narasimhan (Krishtel eMaging) 1461 1996 Oct 15 13:05:22
mine it from space is an active research topic. Few attempts (Jourdan and .... Multi-layer networks use a variety of learn- ing techniques, the most popular being .... a learning rate of 0.7. Thus the back-propagation formula computes the delta error from the output layer back towards the input layer, in a layer-by- layer manner.
Comparative performance of some popular artificial neural network ...
Indian Academy of Sciences (India)
merits such as self-learning, self-adapting, good robustness and capability of deal- ing with non-linear problems. .... such as the standard backpropagation, resilient, scale and self-conjugate, higher- order network functions ... This was done by monitoring the RMS error while training the ANN. The RMS error employed here ...
Spectroscopic determination of leaf water content using linear ...
African Journals Online (AJOL)
In order to detect crop water status with fast, non-destructive monitoring based on its spectral characteristics, this study measured 33 groups of peach tree leaf reflectance spectra (350 to 1075 nm). Linear regression and backpropagation artificial neural network methods were used to establish peach tree leaf water content ...
NMDA receptors induce somatodendritic secretion in hypothalamic neurones of lactating female rats
de Kock, C.P.J.; Burnashev, N.; Lodder, J.C.; Mansvelder, H.D.; Brussaard, A.B.
2004-01-01
Many neurones in the mammalian brain are known to release the content of their vesicles from somatodendritic locations. These vesicles usually contain retrograde messengers that modulate network properties. The back-propagating action potential is thought to be the principal physiological stimulus
Classifying features in CT imagery: accuracy for some single- and multiple-species classifiers
Daniel L. Schmoldt; Jing He; A. Lynn Abbott
1998-01-01
Our current approach to automatically label features in CT images of hardwood logs classifies each pixel of an image individually. These feature classifiers use a back-propagation artificial neural network (ANN) and feature vectors that include a small, local neighborhood of pixels and the distance of the target pixel to the center of the log. Initially, this type of...
Learning behavior and temporary minima of two-layer neural networks
Annema, Anne J.; Hoen, Klaas; Hoen, Klaas; Wallinga, Hans
1994-01-01
This paper presents a mathematical analysis of the occurrence of temporary minima during training of a single-output, two-layer neural network, with learning according to the back-propagation algorithm. A new vector decomposition method is introduced, which simplifies the mathematical analysis of
Second-Order Learning Methods for a Multilayer Perceptron
International Nuclear Information System (INIS)
Ivanov, V.V.; Purehvdorzh, B.; Puzynin, I.V.
1994-01-01
First- and second-order learning methods for feed-forward multilayer neural networks are studied. Newton-type and quasi-Newton algorithms are considered and compared with commonly used back-propagation algorithm. It is shown that, although second-order algorithms require enhanced computer facilities, they provide better convergence and simplicity in usage. 13 refs., 2 figs., 2 tabs
A Newton-type neural network learning algorithm
International Nuclear Information System (INIS)
Ivanov, V.V.; Puzynin, I.V.; Purehvdorzh, B.
1993-01-01
First- and second-order learning methods for feed-forward multilayer networks are considered. A Newton-type algorithm is proposed and compared with the common back-propagation algorithm. It is shown that the proposed algorithm provides better learning quality. Some recommendations for their usage are given. 11 refs.; 1 fig.; 1 tab
O'Connor, P.; Welling, M.
2016-01-01
We introduce an algorithm to do backpropagation on a spiking network. Our network is "spiking" in the sense that our neurons accumulate their activation into a potential over time, and only send out a signal (a "spike") when this potential crosses a threshold and the neuron is reset. Neurons only
Discrimination of Xihulongjing tea grade using an electronic tongue
African Journals Online (AJOL)
STORAGESEVER
2009-12-15
Dec 15, 2009 ... Available online at http://www.academicjournals.org/AJB. ISSN 1684–5315 © 2009 ... 1College of Biosystems Engineering and Food Science, Zhejiang University, 268 Kaixuan Road, Hangzhou 310029,. China. ... discriminant analysis (CDA) and back-propagation neural networks (BPNN). Results of PCA ...
Is Artificial Neural Network Suitable for Damage Level Determination of Rc- Structures?
Baltacıoğlu, A. K.; Öztürk, B.; Civalek, Ö.; Akgöz, B.
2010-01-01
In the present study, an artificial neural network (ANN) application is introduced for estimation of damage level of reinforced concrete structures. Back-propagation learning algorithm is adopted. A typical neural network architecture is proposed and some conclusions are presented. Applicability of artificial neural network (ANN) for the assessment of earthquake related damage is investigated
CSIR Research Space (South Africa)
Anele, AO
2017-11-01
Full Text Available series models (i.e., autoregressive (AR), moving average (MA), autoregressive-moving average (ARMA), and ARMA with exogenous variable (ARMAX)) introduced by Box and Jenkins (1970), feed-forward back-propagation neural network (FFBP-NN), and hybrid model...
Emergence of heterogeneity in an agent-based model
Abdullah, Wan Ahmad Tajuddin Wan
2002-01-01
We study an interacting agent model of a game-theoretical economy. The agents play a minority-subsequently-majority game and they learn, using backpropagation networks, to obtain higher payoffs. We study the relevance of heterogeneity to performance, and how heterogeneity emerges.
Model of Neurocontrol of Redundant Systems
Czech Academy of Sciences Publication Activity Database
Frolov, A. A.; Řízek, Stanislav
1995-01-01
Roč. 63, 1/3 (1995), s. 465-473 ISSN 0377-0427. [Modelling'94. Prague, 29.08.1994-02.09.1994] R&D Projects: GA ČR GA102/93/0912 Keywords : differential control * neurocontrol * back-propagation learning Impact factor: 0.373, year: 1995
Method Accelerates Training Of Some Neural Networks
Shelton, Robert O.
1992-01-01
Three-layer networks trained faster provided two conditions are satisfied: numbers of neurons in layers are such that majority of work done in synaptic connections between input and hidden layers, and number of neurons in input layer at least as great as number of training pairs of input and output vectors. Based on modified version of back-propagation method.
Back propagation and Monte Carlo algorithms for neural network computations
International Nuclear Information System (INIS)
Junczys, R.; Wit, R.
1996-01-01
Results of teaching procedures for neural network for two different algorithms are presented. The first one is based on the well known back-propagation technique, the second is an adopted version of the Monte Carlo global minimum seeking method. Combination of these two, different in nature, approaches provides promising results. (author) nature, approaches provides promising results. (author)
Tests of track segment and vertex finding with neural networks
Energy Technology Data Exchange (ETDEWEB)
Denby, B.; Lessner, E. (Fermi National Accelerator Lab., Batavia, IL (USA)); Lindsey, C.S. (Iowa State Univ. of Science and Technology, Ames, IA (USA))
1990-04-01
Feed forward neural networks have been trained, using back-propagation, to find the slopes of simulated track segments in a straw chamber and to find the vertex of tracks from both simulated and real events in a more conventional drift chamber geometry. Network architectures, training, and performance are presented. 12 refs., 7 figs.
C.P.J. de Kock (Christiaan); B. Sakmann (Bert)
2008-01-01
textabstractHigh frequency (≥ 100 Hz) bursts of action potentials (APs) generated by neocortical neurons are thought to increase information content and, through back-propagation, to influence synaptic integration and efficacy in distal dendritic compartments. It was recently shown in acute slice
Redei, L.; Fried, Miklós; Barsony, I.; Barsony, István; Wallinga, Hans
1998-01-01
It has been shown that worst-case learning, a slightly modified strategy in backpropagation network (BPN) training, results in constrained maximal error at the expense of slightly increased root mean squared error (RMSE) using BPN in spectroscopic ellipsometry (SE). Traditionally the evaluation of
Shortlist: A Connectionist Model of Continuous Speech Recognition.
Norris, Dennis
1994-01-01
The Shortlist model is presented, which incorporates the desirable properties of earlier models of back-propagation networks with recurrent connections that successfully model many aspects of human spoken word recognition. The new model is entirely bottom-up and can readily perform simulations with vocabularies of tens of thousands of words. (DR)
Use of a Neural Network for Damage Detection and Location in a Steel Member
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
The paper explores the potential of using a Multilayer Perceptron (MLP) network trained with the Backpropagation algorithm for damage assessment of free-free cracked straight steel beam based on vibration measurements. The problem of damage assessment, i.e. detecting, locating and quantifying...
Coupling the image analysis and the artificial neural networks to ...
African Journals Online (AJOL)
... from a non-destructive method (Image Analysis) which was used in order to characterize the homogeneity of powder mixture in a V-Blender as well as a Cubic Blender which are most used in the pharmaceutical industry. Keywords: ANN; Image analysis; Homogeneity; Back-propagation algorithm; multi-layer perceptron ...
Speech Recognizing for Presentation Tool Navigation Using Back Propagation Artificial Neural Network
Directory of Open Access Journals (Sweden)
Hasanah Nur
2016-01-01
Full Text Available Backpropagation Artificial Neural Network (ANN is a well known branch of Artificial Intelligence and has been proven to solve various problems of complex speech recognizing in health [1], [2], education [4] and engineering [3]. Today, many kinds of presentation tools are used by society. One popular example is MsPowerpoint. The transition process between slides in presentation tools will be more easily done through speech, the sound emitted directly by the user during the presentation. This study uses research and development to create a simulation using Backpropagation ANN for speech recognition from number one to five to navigate slides of the presentation tool. The Backpropagation ANN consists of one input layer, one hidden layer with 100 neurons and one output layer. The simulation is built by using a Neural Network Toolbox Matlab R2014a. Speech samples were taken from five different people with wav format. This research shows that the Backpropagation ANN can be used as navigation through speech with 96% accuracy rate based on the network training result. Thesimulation can produce 63% accuracy based on 100 new speech samples from various sources.
Interpretation of ECG Signal with a Multi-Layer Neural Network
Directory of Open Access Journals (Sweden)
Dumitru Ostafe
2008-01-01
Full Text Available In this article there are introduced the resultsobtained in the interpretation of the components of abiomedical signal, ECG, by using a multi-layer neuralnetwork, using the backpropagation algorithm. The neuralnetwork was simulated with the Neuroshell2.0 program. Thenew obtained network was used within the program ofautomate diagnosing of the ECG.
Spectroscopic determination of leaf water content using linear ...
African Journals Online (AJOL)
DR. NJ TONUKARI
2012-02-02
Feb 2, 2012 ... Linear regression and backpropagation artificial neural network methods were used to establish peach tree leaf water content ... Key words: Spectroscopy, crop water, linear regression, artificial neural network. INTRODUCTION .... Simple linear regression is the most basic modeling approach; because the ...
(VTEC) in the Ionosphere for GPS Observations
African Journals Online (AJOL)
Michael
2017-12-02
Dec 2, 2017 ... artificial intelligence for establishing correction models of ionospheric delay. For instance,. Habarulena et al., (2007) used backpropagation neural network to establish a VTEC model of a region comprised of various observations stations. Hu et al., (2014) proposed a hybrid VTEC prediction technique of ...
Self-organizing networks for extracting jet features
International Nuclear Information System (INIS)
Loennblad, L.; Peterson, C.; Pi, H.; Roegnvaldsson, T.
1991-01-01
Self-organizing neural networks are briefly reviewed and compared with supervised learning algorithms like back-propagation. The power of self-organization networks is in their capability of displaying typical features in a transparent manner. This is successfully demonstrated with two applications from hadronic jet physics; hadronization model discrimination and separation of b.c. and light quarks. (orig.)
Recognition of decays of charged tracks with neural network techniques
International Nuclear Information System (INIS)
Stimpfl-Abele, G.
1991-01-01
We developed neural-network learning techniques for the recognition of decays of charged tracks using a feed-forward network with error back-propagation. Two completely different methods are described in detail and their efficiencies for several NN architectures are compared with conventional methods. Excellent results are obtained. (orig.)
Spectroscopic determination of leaf water content using linear ...
African Journals Online (AJOL)
DR. NJ TONUKARI
2012-02-02
Feb 2, 2012 ... In order to detect crop water status with fast, non-destructive monitoring based on its spectral characteristics, this study measured 33 groups of peach tree leaf reflectance spectra (350 to 1075 nm). Linear regression and backpropagation artificial neural network methods were used to establish peach.
Liao, Pei-Hung; Hsu, Pei-Ti; Chu, William; Chu, Woei-Chyn
2015-06-01
This study applied artificial intelligence to help nurses address problems and receive instructions through information technology. Nurses make diagnoses according to professional knowledge, clinical experience, and even instinct. Without comprehensive knowledge and thinking, diagnostic accuracy can be compromised and decisions may be delayed. We used a back-propagation neural network and other tools for data mining and statistical analysis. We further compared the prediction accuracy of the previous methods with an adaptive-network-based fuzzy inference system and the back-propagation neural network, identifying differences in the questions and in nurse satisfaction levels before and after using the nursing information system. This study investigated the use of artificial intelligence to generate nursing diagnoses. The percentage of agreement between diagnoses suggested by the information system and those made by nurses was as much as 87 percent. When patients are hospitalized, we can calculate the probability of various nursing diagnoses based on certain characteristics. © The Author(s) 2013.
International Nuclear Information System (INIS)
Schierle, C.; Otto, M.
1992-01-01
A two layer perceptron with backpropagation of error is used for quantitative analysis in ICP-AES. The network was trained by emission spectra of two interfering lines of Cd and As and the concentrations of both elements were subsequently estimated from mixture spectra. The spectra of the Cd and As lines were also used to perform multiple linear regression (MLR) via the calculation of the pseudoinverse S + of the sensitivity matrix S. In the present paper it is shown that there exist close relations between the operation of the perceptron and the MLR procedure. These are most clearly apparent in the correlation between the weights of the backpropagation network and the elements of the pseudoinverse. Using MLR, the confidence intervals over the predictions are exploited to correct for the optical device of the wavelength shift. (orig.)
State and location dependence of action potential metabolic cost in cortical pyramidal neurons.
Hallermann, Stefan; de Kock, Christiaan P J; Stuart, Greg J; Kole, Maarten H P
2012-06-03
Action potential generation and conduction requires large quantities of energy to restore Na(+) and K(+) ion gradients. We investigated the subcellular location and voltage dependence of this metabolic cost in rat neocortical pyramidal neurons. Using Na(+)/K(+) charge overlap as a measure of action potential energy efficiency, we found that action potential initiation in the axon initial segment (AIS) and forward propagation into the axon were energetically inefficient, depending on the resting membrane potential. In contrast, action potential backpropagation into dendrites was efficient. Computer simulations predicted that, although the AIS and nodes of Ranvier had the highest metabolic cost per membrane area, action potential backpropagation into the dendrites and forward propagation into axon collaterals dominated energy consumption in cortical pyramidal neurons. Finally, we found that the high metabolic cost of action potential initiation and propagation down the axon is a trade-off between energy minimization and maximization of the conduction reliability of high-frequency action potentials.
Directory of Open Access Journals (Sweden)
Rohmatulloh 1
2007-12-01
Full Text Available This paper discussed quality improvement of black tea using fuzzy approach on quality functions deployment and the development of backpropagation neural the software NWP II plus. The research was conducted at PTPN VIII tea industry, Goalpara plantation. Result of the study showed that, parameter first priority based on customer evaluation was tea flavour. The Important process parameter of black tea based on result of fuzzy relationship matrix was the withering process. Based on the test of “trial and error” of network training process, the best network architecture for withering process monitoring [3-15-1] was obtained, that is 3 neurons in input layer, 15 neurons in hidden layer and 1 neuron in output layer. Three inputs and output consist of time, flow, temperature and moisture content. The result sugges that development of backpropagation neural network can be used for process evaluation of withering processes.
Energy Technology Data Exchange (ETDEWEB)
Lin, Whei-Min; Hong, Chih-Ming [Department of Electrical Engineering, National Sun Yat-Sen University, Kaohsiung 80424 (China)
2010-06-15
To achieve maximum power point tracking (MPPT) for wind power generation systems, the rotational speed of wind turbines should be adjusted in real time according to wind speed. In this paper, a Wilcoxon radial basis function network (WRBFN) with hill-climb searching (HCS) MPPT strategy is proposed for a permanent magnet synchronous generator (PMSG) with a variable-speed wind turbine. A high-performance online training WRBFN using a back-propagation learning algorithm with modified particle swarm optimization (MPSO) regulating controller is designed for a PMSG. The MPSO is adopted in this study to adapt to the learning rates in the back-propagation process of the WRBFN to improve the learning capability. The MPPT strategy locates the system operation points along the maximum power curves based on the dc-link voltage of the inverter, thus avoiding the generator speed detection. (author)
Evolution of an artificial neural network based autonomous land vehicle controller.
Baluja, S
1996-01-01
This paper presents an evolutionary method for creating an artificial neural network based autonomous land vehicle controller. The evolved controllers perform better in unseen situations than those trained with an error backpropagation learning algorithm designed for this task. In this paper, an overview of the previous connectionist based approaches to this task is given, and the evolutionary algorithms used in this study are described in detail. Methods for reducing the high computational costs of training artificial neural networks with evolutionary algorithms are explored. Error metrics specific to the task of autonomous vehicle control are introduced; the evolutionary algorithms guided by these error metrics reveal improved performance over those guided by the standard sum-squared error metric. Finally, techniques for integrating evolutionary search and error backpropagation are presented. The evolved networks are designed to control Carnegie Mellon University's NAVLAB vehicles in road following tasks.
Embodiment of Learning in Electro-Optical Signal Processors.
Hermans, Michiel; Antonik, Piotr; Haelterman, Marc; Massar, Serge
2016-09-16
Delay-coupled electro-optical systems have received much attention for their dynamical properties and their potential use in signal processing. In particular, it has recently been demonstrated, using the artificial intelligence algorithm known as reservoir computing, that photonic implementations of such systems solve complex tasks such as speech recognition. Here, we show how the backpropagation algorithm can be physically implemented on the same electro-optical delay-coupled architecture used for computation with only minor changes to the original design. We find that, compared to when the backpropagation algorithm is not used, the error rate of the resulting computing device, evaluated on three benchmark tasks, decreases considerably. This demonstrates that electro-optical analog computers can embody a large part of their own training process, allowing them to be applied to new, more difficult tasks.
Crop Classification by Forward Neural Network with Adaptive Chaotic Particle Swarm Optimization
Directory of Open Access Journals (Sweden)
Yudong Zhang
2011-05-01
Full Text Available This paper proposes a hybrid crop classifier for polarimetric synthetic aperture radar (SAR images. The feature sets consisted of span image, the H/A/α decomposition, and the gray-level co-occurrence matrix (GLCM based texture features. Then, the features were reduced by principle component analysis (PCA. Finally, a two-hidden-layer forward neural network (NN was constructed and trained by adaptive chaotic particle swarm optimization (ACPSO. K-fold cross validation was employed to enhance generation. The experimental results on Flevoland sites demonstrate the superiority of ACPSO to back-propagation (BP, adaptive BP (ABP, momentum BP (MBP, Particle Swarm Optimization (PSO, and Resilient back-propagation (RPROP methods. Moreover, the computation time for each pixel is only 1.08 × 10−7 s.
A Learning Method for Neural Networks Based on a Pseudoinverse Technique
Directory of Open Access Journals (Sweden)
Chinmoy Pal
1996-01-01
Full Text Available A theoretical formulation of a fast learning method based on a pseudoinverse technique is presented. The efficiency and robustness of the method are verified with the help of an Exclusive OR problem and a dynamic system identification of a linear single degree of freedom mass–spring problem. It is observed that, compared with the conventional backpropagation method, the proposed method has a better convergence rate and a higher degree of learning accuracy with a lower equivalent learning coefficient. It is also found that unlike the steepest descent method, the learning capability of which is dependent on the value of the learning coefficient ν, the proposed pseudoinverse based backpropagation algorithm is comparatively robust with respect to its equivalent variable learning coefficient. A combination of the pseudoinverse method and the steepest descent method is proposed for a faster, more accurate learning capability.
Choi, Yun Seok
2017-05-26
Full waveform inversion (FWI) using an energy-based objective function has the potential to provide long wavelength model information even without low frequency in the data. However, without the back-propagation method (adjoint-state method), its implementation is impractical for the model size of general seismic survey. We derive the gradient of the energy-based objective function using the back-propagation method to make its FWI feasible. We also raise the energy signal to the power of a small positive number to properly handle the energy signal imbalance as a function of offset. Examples demonstrate that the proposed FWI algorithm provides a convergent long wavelength structure model even without low-frequency information, which can be used as a good starting model for the subsequent conventional FWI.
Wavelet-cellular neural network architecture and learning algorithm
Bal, Abdullah; Ucan, Osman N.; Pastaci, Halit; Alam, Mohammad S.
2004-04-01
Cellular Neural Networks (CNN) provides fast parallel computational capability for image processing applications. The behavior of the CNN is defined by two template matrices. In this paper, adjustment of these template-matrix coefficients have been realized using supervised learning algorithm based on back-propagation technique and wavelet function. Back-propagation algorithm has been modified for dynamic behavior of CNN. Wavelet function is utilized to provide the activation function derivation in this learning algorithm. The supervised learning algorithm is then executed to obtain a compact CNN architecture, called as Wave-CNN. The proposed new learning algorithm and Wave-CNN architecture performance have been tested for 2D image processing applications.
FDI and Accommodation Using NN Based Techniques
Garcia, Ramon Ferreiro; de Miguel Catoira, Alberto; Sanz, Beatriz Ferreiro
Massive application of dynamic backpropagation neural networks is used on closed loop control FDI (fault detection and isolation) tasks. The process dynamics is mapped by means of a trained backpropagation NN to be applied on residual generation. Process supervision is then applied to discriminate faults on process sensors, and process plant parameters. A rule based expert system is used to implement the decision making task and the corresponding solution in terms of faults accommodation and/or reconfiguration. Results show an efficient and robust FDI system which could be used as the core of an SCADA or alternatively as a complement supervision tool operating in parallel with the SCADA when applied on a heat exchanger.
Initial Investigation of Software-Based Bone-Suppressed Imaging
International Nuclear Information System (INIS)
Park, Eunpyeong; Youn, Hanbean; Kim, Ho Kyung
2015-01-01
Chest radiography is the most widely used imaging modality in medicine. However, the diagnostic performance of chest radiography is deteriorated by the anatomical background of the patient. So, dual energy imaging (DEI) has recently been emerged and demonstrated an improved. However, the typical DEI requires more than two projections, hence causing additional patient dose. The motion artifact is another concern in the DEI. In this study, we investigate DEI-like bone-suppressed imaging based on the post processing of a single radiograph. To obtain bone-only images, we use the artificial neural network (ANN) method with the error backpropagation-based machine learning approach. The computational load of learning process of the ANN is too heavy for a practical implementation because we use the gradient descent method for the error backpropagation. We will use a more advanced error propagation method for the learning process
Pengenalan Wajah dengan Jaringan Saraf Tiruan Back Propogation
Nugroho, Fx. Henry
2009-01-01
In this paper we describe face pattern recognition with neural network. Neural network is one ofprincipal brand intellegence method of its job look like with the human being brain. Neural network also can becoupled with another science discipline to solve assorted of problem, one of them is with the image processing.Application designed with the artificial neural network back propogation and to get the its face pattern isused a Prewitt operator method.Keywords: Neural Network, backpropagation...
Neural Networks Applied to Optimal Flight Control
McKelvey, Tomas
1992-01-01
This paper presents a method for developing control laws for nonlinear systems based on an optimal control formulation. Due to the nonlinearities of the system, no analytical solution exists. The method proposed here uses the 'black box' structure of a neural network to model a feedback control law. The network is trained with the back-propagation learning method by using examples of optimal control produced with a differential dynamic programming technique. Two different optimal control prob...
Active action potential propagation but not initiation in thalamic interneuron dendrites
Casale, Amanda E.; McCormick, David A.
2012-01-01
Inhibitory interneurons of the dorsal lateral geniculate nucleus of the thalamus modulate the activity of thalamocortical cells in response to excitatory input through the release of inhibitory neurotransmitter from both axons and dendrites. The exact mechanisms by which release can occur from dendrites are, however, not well understood. Recent experiments using calcium imaging have suggested that Na/K based action potentials can evoke calcium transients in dendrites via local active conductances, making the back-propagating action potential a candidate for dendritic neurotransmitter release. In this study, we employed high temporal and spatial resolution voltage-sensitive dye imaging to assess the characteristics of dendritic voltage deflections in response to Na/K action potentials in interneurons of the mouse dorsal lateral geniculate nucleus. We found that trains or single action potentials elicited by somatic current injection or local synaptic stimulation led to action potentials that rapidly and actively back-propagated throughout the entire dendritic arbor and into the fine filiform dendritic appendages known to release GABAergic vesicles. Action potentials always appeared first in the soma or proximal dendrite in response to somatic current injection or local synaptic stimulation, and the rapid back-propagation into the dendritic arbor depended upon voltage-gated sodium and TEA-sensitive potassium channels. Our results indicate that thalamic interneuron dendrites integrate synaptic inputs that initiate action potentials, most likely in the axon initial segment, that then back-propagate with high-fidelity into the dendrites, resulting in a nearly synchronous release of GABA from both axonal and dendritic compartments. PMID:22171033
Padgett, Mary L.; Desai, Utpal; Roppel, T.A.; White, Charles R.
1993-01-01
A design procedure is suggested for neural networks which accommodates the inclusion of such knowledge-based systems techniques as fuzzy logic and pairwise comparisons. The use of these procedures in the design of applications combines qualitative and quantitative factors with empirical data to yield a model with justifiable design and parameter selection procedures. The procedure is especially relevant to areas of back-propagation neural network design which are highly responsive to the use of precisely recorded expert knowledge.
Classification of merged AVHRR and SMMR Arctic data with neural networks
Key, J.; Maslanik, J. A.; Schweiger, A. J.
1989-01-01
A forward-feed back-propagation neural network is used to classify merged AVHRR and SMMR summer Arctic data. Four surface and eight cloud classes are identified. Partial memberships of each pixel to each class are examined for spectral ambiguities. Classification results are compared to manual interpretations and to those determined by a supervised maximum likelihood procedure. Results indicate that a neural network approach offers advantages in ease of use, interpretability, and utility for indistinct and time-variant spectral classes.
Simplified Learning Scheme For Analog Neural Network
Eberhardt, Silvio P.
1991-01-01
Synaptic connections adjusted one at a time in small increments. Simplified gradient-descent learning scheme for electronic neural-network processor less efficient than better-known back-propagation scheme, but offers two advantages: easily implemented in circuitry because data-access circuitry separated from learning circuitry; and independence of data-access circuitry makes possible to implement feedforward as well as feedback networks, including those of multiple-attractor type. Important in such applications as recognition of patterns.
International Nuclear Information System (INIS)
Cadini, F.; Zio, E.; Pedroni, N.
2007-01-01
In this paper, a locally recurrent neural network (LRNN) is employed for approximating the temporal evolution of a nonlinear dynamic system model of a simplified nuclear reactor. To this aim, an infinite impulse response multi-layer perceptron (IIR-MLP) is trained according to a recursive back-propagation (RBP) algorithm. The network nodes contain internal feedback paths and their connections are realized by means of IIR synaptic filters, which provide the LRNN with the necessary system state memory
International Nuclear Information System (INIS)
Zio, Enrico; Pedroni, Nicola; Broggi, Matteo; Golea, Lucia Roxana
2009-01-01
In this paper, an infinite impulse response locally recurrent neural network (IIR-LRNN) is employed for modelling the dynamics of the Lead Bismuth Eutectic eXperimental Accelerator Driven System (LBE-XADS). The network is trained by recursive back-propagation (RBP) and its ability in estimating transients is tested under various conditions. The results demonstrate the robustness of the locally recurrent scheme in the reconstruction of complex nonlinear dynamic relationships
Application of neural networks in the ARGUS-experiment for the analysis of B- and Tau-physics
International Nuclear Information System (INIS)
Joswig, M.; Kolanoski, H.; Kublun, S.; Thurn, H.; Wegener, D.; Westerhoff, S.
1993-11-01
We present analyses of e + e - annihilation data taken with the ARGUS detector in the energy range of the Y resonances. The selection of Y(4s) decays and leptonic τ decays was studied with feed-forward multilayer networks using the backpropagation algorithm for the training. The correlated decay of τ + τ - pairs was analysed with a feed-forward network to determine a weak coupling constant. (orig.)
Training product unit neural networks with genetic algorithms
Janson, D. J.; Frenzel, J. F.; Thelen, D. C.
1991-01-01
The training of product neural networks using genetic algorithms is discussed. Two unusual neural network techniques are combined; product units are employed instead of the traditional summing units and genetic algorithms train the network rather than backpropagation. As an example, a neural netork is trained to calculate the optimum width of transistors in a CMOS switch. It is shown how local minima affect the performance of a genetic algorithm, and one method of overcoming this is presented.
Neural Networks Applied to Thermal Damage Classification in Grinding Process
Spadotto, Marcelo M.; Aguiar, Paulo Roberto de; Sousa, Carlos C. P.; Bianchi, Eduardo C.
2008-01-01
The utilization of neural network of type multi-layer perceptron using the back-propagation algorithm guaranteed very good results. Tests carried out in order to optimize the learning capacity of neural networks were of utmost importance in the training phase, where the optimum values for the number of neurons of the hidden layer, learning rate and momentum for each structure were determined. Once the architecture of the neural network was established with those optimum values, the mean squar...
A Computer-Aided Diagnosis System for Breast Cancer Combining Mammography and Proteomics
2007-05-01
processing using unsharp masking , (2) segmentation of individual calcifications using a back-propagation artificial neural network (BP-ANN) classifier...surgical biopsies are expensive, cause patient anxiety, alter cosmetic appearance, and can distort future mammograms.7 Commercial products for computer-aided... magnetic resonance imaging MRI images,22 and gene expression profiles.23 Current clinically implemented CADx programs tend to use only one informa
Baruch, Ieroham; Mariaca-Gaspar, Carlos; Barrera-Cortes, Josefina
2008-01-01
The chapter proposes a new Kalman filter closed loop topology of recurrent neural network for identification and modeling of an unknown hydrocarbon degradation process carried out in a biopile system and a rotating drum. The proposed KF RNN contained a recurrent neural plant model, a recurrent neural output plant filter and posses global and local feedbacks. The learning algorithm is a modified version of the dynamic Backpropagation one derived using the adjoint KF RNN topology by means of th...
Identification of Nonlinear Dynamic Systems Using Hammerstein-Type Neural Network
Yu, Hongshan; Peng, Jinzhu; Tang, Yandong
2014-01-01
Hammerstein model has been popularly applied to identify the nonlinear systems. In this paper, a Hammerstein-type neural network (HTNN) is derived to formulate the well-known Hammerstein model. The HTNN consists of a nonlinear static gain in cascade with a linear dynamic part. First, the Lipschitz criterion for order determination is derived. Second, the backpropagation algorithm for updating the network weights is presented, and the stability analysis is also drawn. Finally, simulation resul...
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.
and waves, so that the trained neural network needs only wind speed for which Hs is to be predicted. This procedure not only avoids the long-term wave measurement program but also simplifies the prediction system. Also on-line prediction of Hs based... lower values of the correlation coefficients than the neural network which shows that the ANN methods are more adaptive and online applicable. Rao et al (2001) using backpropagation neural network, Mandal and Prabaharan (2006) using nonlinear...
Quaternionic Multilayer Perceptron with Local Analyticity
Directory of Open Access Journals (Sweden)
Nobuyuki Matsui
2012-11-01
Full Text Available A multi-layered perceptron type neural network is presented and analyzed in this paper. All neuronal parameters such as input, output, action potential and connection weight are encoded by quaternions, which are a class of hypercomplex number system. Local analytic condition is imposed on the activation function in updating neurons’ states in order to construct learning algorithm for this network. An error back-propagation algorithm is introduced for modifying the connection weights of the network.
Wan'e, Wu; Zuoming, Zhu
2012-01-01
A practical scheme for selecting characterization parameters of boron-based fuel-rich propellant formulation was put forward; a calculation model for primary combustion characteristics of boron-based fuel-rich propellant based on backpropagation neural network was established, validated, and then was used to predict primary combustion characteristics of boron-based fuel-rich propellant. The results show that the calculation error of burning rate is less than ± 7 . 3 %; in the formulation rang...
Artificial Neural Networks for Beginners
Gershenson, Carlos
2003-01-01
The scope of this teaching package is to make a brief induction to Artificial Neural Networks (ANNs) for people who have no previous knowledge of them. We first make a brief introduction to models of networks, for then describing in general terms ANNs. As an application, we explain the backpropagation algorithm, since it is widely used and many other algorithms are derived from it. The user should know algebra and the handling of functions and vectors. Differential calculus is recommendable, ...
Superpixel Convolutional Networks using Bilateral Inceptions
Gadde, Raghudeep; Jampani, Varun; Kiefel, Martin; Kappler, Daniel; Gehler, Peter V.
2015-01-01
In this paper we propose a CNN architecture for semantic image segmentation. We introduce a new 'bilateral inception' module that can be inserted in existing CNN architectures and performs bilateral filtering, at multiple feature-scales, between superpixels in an image. The feature spaces for bilateral filtering and other parameters of the module are learned end-to-end using standard backpropagation techniques. The bilateral inception module addresses two issues that arise with general CNN se...
Intelligent system for pavement management
Ferreira Brega, Jose R.; Alba Soria, Manoel H.; Marar, Joao F.; Sementille, Antonio C.
1998-03-01
This paper describes a method for the evaluation of pavement condition through artificial neural networks using the MLP backpropagation technique. Two of the most used procedures for detecting the pavement conditions were applied: the 'overall severity index' and the 'irregularity index.' Tests with the model demonstrated that the simulation with the neural network gives better results than the procedures recommended by the highway officials. This network may also be applied for the construction of a graphic computer environment.
Directory of Open Access Journals (Sweden)
Qian Wang
2016-01-01
Full Text Available Spectroscopy is an efficient and widely used quantitative analysis method. In this paper, a spectral quantitative analysis model with combining wavelength selection and topology structure optimization is proposed. For the proposed method, backpropagation neural network is adopted for building the component prediction model, and the simultaneousness optimization of the wavelength selection and the topology structure of neural network is realized by nonlinear adaptive evolutionary programming (NAEP. The hybrid chromosome in binary scheme of NAEP has three parts. The first part represents the topology structure of neural network, the second part represents the selection of wavelengths in the spectral data, and the third part represents the parameters of mutation of NAEP. Two real flue gas datasets are used in the experiments. In order to present the effectiveness of the methods, the partial least squares with full spectrum, the partial least squares combined with genetic algorithm, the uninformative variable elimination method, the backpropagation neural network with full spectrum, the backpropagation neural network combined with genetic algorithm, and the proposed method are performed for building the component prediction model. Experimental results verify that the proposed method has the ability to predict more accurately and robustly as a practical spectral analysis tool.
Fault-tolerant nonlinear adaptive flight control using sliding mode online learning.
Krüger, Thomas; Schnetter, Philipp; Placzek, Robin; Vörsmann, Peter
2012-08-01
An expanded nonlinear model inversion flight control strategy using sliding mode online learning for neural networks is presented. The proposed control strategy is implemented for a small unmanned aircraft system (UAS). This class of aircraft is very susceptible towards nonlinearities like atmospheric turbulence, model uncertainties and of course system failures. Therefore, these systems mark a sensible testbed to evaluate fault-tolerant, adaptive flight control strategies. Within this work the concept of feedback linearization is combined with feed forward neural networks to compensate for inversion errors and other nonlinear effects. Backpropagation-based adaption laws of the network weights are used for online training. Within these adaption laws the standard gradient descent backpropagation algorithm is augmented with the concept of sliding mode control (SMC). Implemented as a learning algorithm, this nonlinear control strategy treats the neural network as a controlled system and allows a stable, dynamic calculation of the learning rates. While considering the system's stability, this robust online learning method therefore offers a higher speed of convergence, especially in the presence of external disturbances. The SMC-based flight controller is tested and compared with the standard gradient descent backpropagation algorithm in the presence of system failures. Copyright © 2012 Elsevier Ltd. All rights reserved.
Predictive analysis effectiveness in determining the epidemic disease infected area
Ibrahim, Najihah; Akhir, Nur Shazwani Md.; Hassan, Fadratul Hafinaz
2017-10-01
Epidemic disease outbreak had caused nowadays community to raise their great concern over the infectious disease controlling, preventing and handling methods to diminish the disease dissemination percentage and infected area. Backpropagation method was used for the counter measure and prediction analysis of the epidemic disease. The predictive analysis based on the backpropagation method can be determine via machine learning process that promotes the artificial intelligent in pattern recognition, statistics and features selection. This computational learning process will be integrated with data mining by measuring the score output as the classifier to the given set of input features through classification technique. The classification technique is the features selection of the disease dissemination factors that likely have strong interconnection between each other in causing infectious disease outbreaks. The predictive analysis of epidemic disease in determining the infected area was introduced in this preliminary study by using the backpropagation method in observation of other's findings. This study will classify the epidemic disease dissemination factors as the features for weight adjustment on the prediction of epidemic disease outbreaks. Through this preliminary study, the predictive analysis is proven to be effective method in determining the epidemic disease infected area by minimizing the error value through the features classification.
ODTbrain: a Python library for full-view, dense diffraction tomography.
Müller, Paul; Schürmann, Mirjam; Guck, Jochen
2015-11-04
Analyzing the three-dimensional (3D) refractive index distribution of a single cell makes it possible to describe and characterize its inner structure in a marker-free manner. A dense, full-view tomographic data set is a set of images of a cell acquired for multiple rotational positions, densely distributed from 0 to 360 degrees. The reconstruction is commonly realized by projection tomography, which is based on the inversion of the Radon transform. The reconstruction quality of projection tomography is greatly improved when first order scattering, which becomes relevant when the imaging wavelength is comparable to the characteristic object size, is taken into account. This advanced reconstruction technique is called diffraction tomography. While many implementations of projection tomography are available today, there is no publicly available implementation of diffraction tomography so far. We present a Python library that implements the backpropagation algorithm for diffraction tomography in 3D. By establishing benchmarks based on finite-difference time-domain (FDTD) simulations, we showcase the superiority of the backpropagation algorithm over the backprojection algorithm. Furthermore, we discuss how measurment parameters influence the reconstructed refractive index distribution and we also give insights into the applicability of diffraction tomography to biological cells. The present software library contains a robust implementation of the backpropagation algorithm. The algorithm is ideally suited for the application to biological cells. Furthermore, the implementation is a drop-in replacement for the classical backprojection algorithm and is made available to the large user community of the Python programming language.
Directory of Open Access Journals (Sweden)
Shovasis Kumar Biswas
2015-02-01
Full Text Available Abstract Support Vector Machine SVM and back-propagation neural network BPNN has been applied successfully in many areas for example rule extraction classification and evaluation. In this paper we studied the back-propagation algorithm for training the multilayer artificial neural network and a support vector machine for data classification and image reconstruction aspects. A model focused on SVM with Gaussian RBF kernel is utilized here for data classification. Back propagation neural network is viewed as one of the most straightforward and is most general methods used for supervised training of multilayered neural network. We compared a support vector machine SVM with a back-propagation neural network BPNN for the task of data classification and image reconstruction. We made a comparison between the performances of the multi-class classification of these two learning methods. Comparing with these two methods we can conclude that the classification accuracy of the support vector machine is better and algorithm is much faster than the MLP with back propagation algorithm.
Directory of Open Access Journals (Sweden)
Saleh Mohammed Al-Alawi
2002-06-01
Full Text Available Artificial Neural Networks (ANNs are computer software programs that mimic the human brain's ability to classify patterns or to make forecasts or decisions based on past experience. The development of this research area can be attributed to two factors, sufficient computer power to begin practical ANN-based research in the late 1970s and the development of back-propagation in 1986 that enabled ANN models to solve everyday business, scientific, and industrial problems. Since then, significant applications have been implemented in several fields of study, and many useful intelligent applications and systems have been developed. The objective of this paper is to generate awareness and to encourage applications development using artificial intelligence-based systems. Therefore, this paper provides basic ANN concepts, outlines steps used for ANN model development, and lists examples of engineering applications based on the use of the back-propagation paradigm conducted in Oman. The paper is intended to provide guidelines and necessary references and resources for novice individuals interested in conducting research in engineering or other fields of study using back-propagation artificial neural networks.
Hardware implementation of on -chip learning using re configurable FPGAS
International Nuclear Information System (INIS)
Kelash, H.M.; Sorour, H.S; Mahmoud, I.I.; Zaki, M; Haggag, S.S.
2009-01-01
The multilayer perceptron (MLP) is a neural network model that is being widely applied in the solving of diverse problems. A supervised training is necessary before the use of the neural network.A highly popular learning algorithm called back-propagation is used to train this neural network model. Once trained, the MLP can be used to solve classification problems. An interesting method to increase the performance of the model is by using hardware implementations. The hardware can do the arithmetical operations much faster than software. In this paper, a design and implementation of the sequential mode (stochastic mode) of backpropagation algorithm with on-chip learning using field programmable gate arrays (FPGA) is presented, a pipelined adaptation of the on-line back propagation algorithm (BP) is shown.The hardware implementation of forward stage, backward stage and update weight of backpropagation algorithm is also presented. This implementation is based on a SIMD parallel architecture of the forward propagation the diagnosis of the multi-purpose research reactor of Egypt accidents is used to test the proposed system
Aude, Eliana P. L.; Silveira, Julio T. C.; Silva, Fabricio A. B.; Martins, Mario F.; Serdeira, Henrique; Lopes, Emerson P.
1997-12-01
CONTROLAB is an environment which integrates intelligent systems and control algorithms aiming at applications in the area of robotics. Within CONTROLAB, two neural network architectures based on the backpropagation and the recursive models are proposed for the implementation of a robust speaker-independent word recognition system. The robustness of the system using the backpropagation network has been largely verified through use by children and adults in totally uncontrolled environments such as large public halls for the exhibition of new technology products. Experimental results with the recursive network show that it is able to overcome the backpropagation network major drawback, the frequent generation of false alarms. In addition, within CONTROLAB, the trajectory to be followed by a robot arm under self-tuning control is determined by a system which uses either VGRAPH or PFIELD algorithms to avoid obstacles detected by the computer vision system. The performance of the second algorithm is greatly improved when it is applied under the control of a rule-based system. An application in which a SCARA robot arm is commanded by voice to pick up a specific tool placed on a table among other tools and obstacles is currently running. This application is used to evaluate the performance of each sub-system within CONTROLAB.
Pengujian Model Jaringan Syaraf Tiruan Untuk Kualifikasi Calon Mahasiswa Baru Program Bidik Misi
Directory of Open Access Journals (Sweden)
Ilham Sayekti
2014-02-01
Full Text Available Testing of neural network models for qualified new students Bidik Misi program is a software program that is built by using backpropagation neural network (ANN-BP is used for the purpose of scholarship recipients qualify Bidik Misi of incoming freshmen at Semarang State Polytechnic . By using an 8 input variables such as parental occupation, parental income, parental education, number of dependents and academic values, with each variable consists of several different parameters, and 1 output variable result is rejected or accepted. Through a series of tests by combining the network parameters, in order to get the optimal results of neural networks, the best results are obtained logsig and purelin activation function. As research material used data from the 127 students who signed up as a potential recipient of a scholarship Bidik Misi. From some data, 50 data used as training data (learning, and 77 are used as test data, obtained results that a system built by the backpropagation neural network was able to qualify the scholarship recipients Bidik Misi success rate reached 99.21%. Keywords : Artificial neural network; Backpropagation; Bidik Misi; Kualifikasi
Implementation of neural network for color properties of polycarbonates
Saeed, U.; Ahmad, S.; Alsadi, J.; Ross, D.; Rizvi, G.
2014-05-01
In present paper, the applicability of artificial neural networks (ANN) is investigated for color properties of plastics. The neural networks toolbox of Matlab 6.5 is used to develop and test the ANN model on a personal computer. An optimal design is completed for 10, 12, 14,16,18 & 20 hidden neurons on single hidden layer with five different algorithms: batch gradient descent (GD), batch variable learning rate (GDX), resilient back-propagation (RP), scaled conjugate gradient (SCG), levenberg-marquardt (LM) in the feed forward back-propagation neural network model. The training data for ANN is obtained from experimental measurements. There were twenty two inputs including resins, additives & pigments while three tristimulus color values L*, a* and b* were used as output layer. Statistical analysis in terms of Root-Mean-Squared (RMS), absolute fraction of variance (R squared), as well as mean square error is used to investigate the performance of ANN. LM algorithm with fourteen neurons on hidden layer in Feed Forward Back-Propagation of ANN model has shown best result in the present study. The degree of accuracy of the ANN model in reduction of errors is proven acceptable in all statistical analysis and shown in results. However, it was concluded that ANN provides a feasible method in error reduction in specific color tristimulus values.
Directory of Open Access Journals (Sweden)
Arief Ramadhan
2012-05-01
Full Text Available Sistem Pengaturan Lampu Lalu Lintas Terdistribusi adalah sebuah sistem lampu lalu lintas yang ditujukan untuk memenuhi kebutuhan akan kinerja pengaturan lampu lalu lintas yang cerdas dengan pengambilan data secara real-time. Sistem ini dapat melakukan penjadwalan dan pengaturan jaringan banyakpersimpangan secarareal-time yang tidak bisa dilakukan oleh sistem pengaturan lampu lalu lintas konvensional. Penerapan klasifikasi di dalam sistem ini digunakan untuk meningkatkan akurasi dari pengenalan mobil. Proses klasifikasi diimplementasikan menggunakan tiga algoritma Jaringan Syaraf Tiruan, yakni Backpropagation, FLVQ, dan FLVQ-PSO. Berdasarkan hasil ujicoba, dapat ditunjukkan bahwa algoritma Backpropagationmemiliki performa akurasi yang lebih baik dibandingkan dua algoritma JST yang lainnya. Distributed Traffic Light Control System is a traffic light system intended to meet the need for setting the performance of intelligent traffic lights with real-time data capturing. The system can perform scheduling and network settings of multi-junction in real time that can not be done by a conventional traffic light settings system. Application of classification within this system is used to improve the accuracy of the car recognition. Classification process is implemented using three neural network algorithms, namely Backpropagation, FLVQ, and FLVQ-PSO. Based on the test results, it can be shown that the Backpropagation algorithm performs better accuracy than the other two algorithms.
PEMBUATAN PERANGKAT LUNAK PENGENALAN WAJAH MENGGUNAKAN PRINCIPAL COMPONENTS ANALYSIS
Directory of Open Access Journals (Sweden)
Kartika Gunadi
2001-01-01
Full Text Available Face recognition is one of many important researches, and today, many applications have implemented it. Through development of techniques like Principal Components Analysis (PCA, computers can now outperform human in many face recognition tasks, particularly those in which large database of faces must be searched. Principal Components Analysis was used to reduce facial image dimension into fewer variables, which are easier to observe and handle. Those variables then fed into artificial neural networks using backpropagation method to recognise the given facial image. The test results show that PCA can provide high face recognition accuracy. For the training faces, a correct identification of 100% could be obtained. From some of network combinations that have been tested, a best average correct identification of 91,11% could be obtained for the test faces while the worst average result is 46,67 % correct identification Abstract in Bahasa Indonesia : Pengenalan wajah manusia merupakan salah satu bidang penelitian yang penting, dan dewasa ini banyak aplikasi yang dapat menerapkannya. Melalui pengembangan suatu teknik seperti Principal Components Analysis (PCA, komputer sekarang dapat melebihi kemampuan otak manusia dalam berbagai tugas pengenalan wajah, terutama tugas-tugas yang membutuhkan pencarian pada database wajah yang besar. Principal Components Analysis digunakan untuk mereduksi dimensi gambar wajah sehingga menghasilkan variabel yang lebih sedikit yang lebih mudah untuk diobsevasi dan ditangani. Hasil yang diperoleh kemudian akan dimasukkan ke suatu jaringan saraf tiruan dengan metode Backpropagation untuk mengenali gambar wajah yang telah diinputkan ke dalam sistem. Hasil pengujian sistem menunjukkan bahwa penggunaan PCA untuk pengenalan wajah dapat memberikan tingkat akurasi yang cukup tinggi. Untuk gambar wajah yang diikutsertakankan dalam latihan, dapat diperoleh 100% identifikasi yang benar. Dari beberapa kombinasi jaringan yang
Advances in Artificial Neural Networks – Methodological Development and Application
Directory of Open Access Journals (Sweden)
Yanbo Huang
2009-08-01
Full Text Available Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other networks such as radial basis function, recurrent network, feedback network, and unsupervised Kohonen self-organizing network. These networks, especially the multilayer perceptron network with a backpropagation training algorithm, have gained recognition in research and applications in various scientific and engineering areas. In order to accelerate the training process and overcome data over-fitting, research has been conducted to improve the backpropagation algorithm. Further, artificial neural networks have been integrated with other advanced methods such as fuzzy logic and wavelet analysis, to enhance the ability of data interpretation and modeling and to avoid subjectivity in the operation of the training algorithm. In recent years, support vector machines have emerged as a set of high-performance supervised generalized linear classifiers in parallel with artificial neural networks. A review on development history of artificial neural networks is presented and the standard architectures and algorithms of artificial neural networks are described. Furthermore, advanced artificial neural networks will be introduced with support vector machines, and limitations of ANNs will be identified. The future of artificial neural network development in tandem with support vector machines will be discussed in conjunction with further applications to food science and engineering, soil and water relationship for crop management, and decision support for precision agriculture. Along with the network structures and training algorithms, the applications of artificial neural networks will be reviewed as well, especially in the fields of agricultural and biological
Denervation-induced homeostatic dendritic plasticity in morphological granule cell models
Directory of Open Access Journals (Sweden)
Hermann Cuntz
2014-03-01
Full Text Available Neuronal death and subsequent denervation of target areas are major consequences of several neurological conditions such asischemia or neurodegeneration (Alzheimer's disease. The denervation-induced axonal loss results in reorganization of the dendritic tree of denervated neurons. The dendritic reorganization has been previously studied using entorhinal cortex lesion (ECL. ECL leads to shortening and loss of dendritic segments in the denervated outer molecular layer of the dentate gyrus. However, the functional importance of these long-term dendritic alterations is not yet understood and their impact on neuronal electrical properties remains unclear. Here we analyzed what happens to the electrotonic structure and excitability of dentate granule cells after lesion-induced alterations of their dendritic morphology, assuming all other parameters remain equal. We performed comparative electrotonic analysis in anatomically and biophysically realistic compartmental models of 3D-reconstructed healthy and denervated granule cells. Using the method of morphological modeling based on optimization principles minimizing the amount of wiring and maximizing synaptic democracy, we built artificial granule cells which replicate morphological features of their real counterparts. Our results show that somatofugal and somatopetal voltage attenuation in the passive cable model are strongly reduced in denervated granule cells. In line with these predictions, the attenuation both of simulated backpropagating action potentials and forward propagating EPSPs was significantly reduced in dendrites of denervated neurons. Intriguingly, the enhancement of action potential backpropagation occurred specifically in the denervated dendritic layers. Furthermore, simulations of synaptic f-I curves revealed a homeostatic increase of excitability in denervated granule cells. In summary, our morphological and compartmental modeling indicates that unless modified by changes of
Use of Neural Networks for Damage Assessment in a Steel Mast
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1994-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorithm for detecting location and size of a damage in a civil engineering structure is investigated. The structure considered is a 20 m high steel lattice mast subjected to wind excita...... as well as full-scale tests where the mast is identified by an ARMA-model. The results show that a neural network trained with simulated data is capable for detecting location of a damage in a steel lattice mast when the network is subjected to experimental data.·...
Control of beam halo-chaos using neural network self-adaptation method
International Nuclear Information System (INIS)
Fang Jinqing; Huang Guoxian; Luo Xiaoshu
2004-11-01
Taking the advantages of neural network control method for nonlinear complex systems, control of beam halo-chaos in the periodic focusing channels (network) of high intensity accelerators is studied by feed-forward back-propagating neural network self-adaptation method. The envelope radius of high-intensity proton beam is reached to the matching beam radius by suitably selecting the control structure of neural network and the linear feedback coefficient, adjusted the right-coefficient of neural network. The beam halo-chaos is obviously suppressed and shaking size is much largely reduced after the neural network self-adaptation control is applied. (authors)
Troudet, T.; Garg, S.; Merrill, W.
1992-01-01
The design of a dynamic neurocontroller with good robustness properties is presented for a multivariable aircraft control problem. The internal dynamics of the neurocontroller are synthesized by a state estimator feedback loop. The neurocontrol is generated by a multilayer feedforward neural network which is trained through backpropagation to minimize an objective function that is a weighted sum of tracking errors, and control input commands and rates. The neurocontroller exhibits good robustness through stability margins in phase and vehicle output gains. By maintaining performance and stability in the presence of sensor failures in the error loops, the structure of the neurocontroller is also consistent with the classical approach of flight control design.
A SIMULATION OF THE PENICILLIN G PRODUCTION BIOPROCESS APPLYING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
A.J.G. da Cruz
1997-12-01
Full Text Available The production of penicillin G by Penicillium chrysogenum IFO 8644 was simulated employing a feedforward neural network with three layers. The neural network training procedure used an algorithm combining two procedures: random search and backpropagation. The results of this approach were very promising, and it was observed that the neural network was able to accurately describe the nonlinear behavior of the process. Besides, the results showed that this technique can be successfully applied to control process algorithms due to its long processing time and its flexibility in the incorporation of new data
Neural networks for function approximation in nonlinear control
Linse, Dennis J.; Stengel, Robert F.
1990-01-01
Two neural network architectures are compared with a classical spline interpolation technique for the approximation of functions useful in a nonlinear control system. A standard back-propagation feedforward neural network and a cerebellar model articulation controller (CMAC) neural network are presented, and their results are compared with a B-spline interpolation procedure that is updated using recursive least-squares parameter identification. Each method is able to accurately represent a one-dimensional test function. Tradeoffs between size requirements, speed of operation, and speed of learning indicate that neural networks may be practical for identification and adaptation in a nonlinear control environment.
Energy Technology Data Exchange (ETDEWEB)
Hong, Y.-Y.; Chen, Y.-C. [Chung Yuan University (China). Dept. of Electrical Engineering
1999-05-01
A new method is proposed for locating multiple harmonic sources in distribution systems. The proposed method first determines the proper locations for metering measurement using fuzzy clustering. Next, an artificial neural network based on the back-propagation approach is used to identify the most likely location for multiple harmonic sources. A set of systematic algorithmic steps is developed until all harmonic locations are identified. The simulation results for an 18-busbar system show that the proposed method is very efficient in locating the multiple harmonics in a distribution system. (author)
Deep learning in neural networks: an overview.
Schmidhuber, Jürgen
2015-01-01
In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarizes relevant work, much of it from the previous millennium. Shallow and Deep Learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. I review deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
Gross domestic product estimation based on electricity utilization by artificial neural network
Stevanović, Mirjana; Vujičić, Slađana; Gajić, Aleksandar M.
2018-01-01
The main goal of the paper was to estimate gross domestic product (GDP) based on electricity estimation by artificial neural network (ANN). The electricity utilization was analyzed based on different sources like renewable, coal and nuclear sources. The ANN network was trained with two training algorithms namely extreme learning method and back-propagation algorithm in order to produce the best prediction results of the GDP. According to the results it can be concluded that the ANN model with extreme learning method could produce the acceptable prediction of the GDP based on the electricity utilization.
Applying neural networks as software sensors for enzyme engineering.
Linko, S; Zhu, Y H; Linko, P
1999-04-01
The on-line control of enzyme-production processes is difficult, owing to the uncertainties typical of biological systems and to the lack of suitable on-line sensors for key process variables. For example, intelligent methods to predict the end point of fermentation could be of great economic value. Computer-assisted control based on artificial-neural-network models offers a novel solution in such situations. Well-trained feedforward-backpropagation neural networks can be used as software sensors in enzyme-process control; their performance can be affected by a number of factors.
Use of neural networks in the analysis of τ→K0sντX inclusive decays at LEP
International Nuclear Information System (INIS)
Grotti, F.; Cavallo, F.R.; Navarria, F.L.
1997-01-01
Neural networks (NNW) were used to tag the inclusive τ→K 0 S ν τ X decay at the Z 0 energy. Two feed-forward NNWs were trained with the backpropagation algorithm, to select, respectively, Z 0 →τ + τ - events and K 0 S →π + π - decays. They were used to process the data collected with the DELPHI detector at LEP in 1993. The selection efficiency and purity achieved with the NNW at each step of the analysis were compared with those obtained using linear cuts. (orig.)
Control of GMA Butt Joint Welding Based on Neural Networks
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2004-01-01
variations from 0.5 mm to 2.3 mm - scanned 10 mm in front of the electrode location. In this research, the mapping from joint geometry and reference weld quality to significant welding parameters has been based on a static multi-layer feed-forward network. The Levenberg-Marquardt algorithm, for non......-linear least square error minimization, has been used with the back-propagation algorithm for training the network, while a Bayesian regularization technique has been successfully applied for minimizing the risk of inexpedient over-training....
Pasila, Felix
2007-01-01
This paper describes an accelerated Backpropagation algorithm (BPA) that can be used to train the Takagi-Sugeno (TS) type multi-input multi-output (MIMO) neuro-fuzzy network efficiently. Also other method such as accelerated Levenberg-Marquardt algorithm (LMA) will be compared to BPA. The training algorithm is efficient in the sense that it can bring the performance index of the network, such as the sum squared error (SSE), Mean Squared Error (MSE), and also Root Mean Squared Error (RMSE), do...
Directory of Open Access Journals (Sweden)
Asad Dehghani Samani
2017-07-01
Full Text Available Application of Artificial Neural Network (ANN in modeling of combined cycle power plant (CCPP with dry cooling tower (Heller tower has been investigated in this paper. Prediction of power plant output (megawatt under different working conditions was made using multi-layer feed-forward ANN and training was performed with operational data using back-propagation. Two ANN network was constructed for the steam turbine (ST and the main cooling system(MCS. Results indicate that the ANN model is effective in predicting the power plant output with good accuracy.
Benediktsson, J. A.; Swain, P. H.; Ersoy, O. K.
1993-01-01
Application of neural networks to classification of remote sensing data is discussed. Conventional two-layer backpropagation is found to give good results in classification of remote sensing data but is not efficient in training. A more efficient variant, based on conjugate-gradient optimization, is used for classification of multisource remote sensing and geographic data and very-high-dimensional data. The conjugate-gradient neural networks give excellent performance in classification of multisource data, but do not compare as well with statistical methods in classification of very-high-dimentional data.
Design of neural networks for classification of remotely sensed imagery
Chettri, Samir R.; Cromp, Robert F.; Birmingham, Mark
1992-01-01
Classification accuracies of a backpropagation neural network are discussed and compared with a maximum likelihood classifier (MLC) with multivariate normal class models. We have found that, because of its nonparametric nature, the neural network outperforms the MLC in this area. In addition, we discuss techniques for constructing optimal neural nets on parallel hardware like the MasPar MP-1 currently at GSFC. Other important discussions are centered around training and classification times of the two methods, and sensitivity to the training data. Finally, we discuss future work in the area of classification and neural nets.
Directory of Open Access Journals (Sweden)
Ruiyi Que
2012-08-01
Full Text Available Air speed, angle of sideslip and angle of attack are fundamental aerodynamic parameters for controlling most aircraft. For small aircraft for which conventional detecting devices are too bulky and heavy to be utilized, a novel and practical methodology by which the aerodynamic parameters are inferred using a micro hot-film flow sensor array mounted on the surface of the wing is proposed. A back-propagation neural network is used to model the coupling relationship between readings of the sensor array and aerodynamic parameters. Two different sensor arrangements are tested in wind tunnel experiments and dependence of the system performance on the sensor arrangement is analyzed.
Design of an Adaptive-Neural Network Attitude Controller of a Satellite using Reaction Wheels
Directory of Open Access Journals (Sweden)
Abbas Ajorkar
2015-04-01
Full Text Available In this paper, an adaptive attitude control algorithm is developed based on neural network for a satellite using four reaction wheels in a tetrahedron configuration. Then, an attitude control based on feedback linearization control has been designed and uncertainties in the moment of inertia matrix and disturbances torque have been considered. In order to eliminate the effect of these uncertainties, a multilayer neural network with back-propagation law is designed. In this structure, the parameters of the moment of inertia matrix and external disturbances are estimated and used in feedback linearization control law. Finally, the performance of the designed attitude controller is investigated by several simulations.
On-Line Condition Monitoring System for High Level Trip Water in Steam Boiler’s Drum
Directory of Open Access Journals (Sweden)
Ismail Alnaimi Firas B.
2014-07-01
Full Text Available This paper presents a monitoring technique using Artificial Neural Networks (ANN with four different training algorithms for high level water in steam boiler’s drum. Four Back-Propagations neural networks multidimensional minimization algorithms have been utilized. Real time data were recorded from power plant located in Malaysia. The developed relevant variables were selected based on a combination of theory, experience and execution phases of the model. The Root Mean Square (RMS Error has been used to compare the results of one and two hidden layer (1HL, (2HL ANN structures
Directory of Open Access Journals (Sweden)
Oliveira-Esquerre K.P.
2002-01-01
Full Text Available This work presents a way to predict the biochemical oxygen demand (BOD of the output stream of the biological wastewater treatment plant at RIPASA S/A Celulose e Papel, one of the major pulp and paper plants in Brazil. The best prediction performance is achieved when the data are preprocessed using principal components analysis (PCA before they are fed to a backpropagated neural network. The influence of input variables is analyzed and satisfactory prediction results are obtained for an optimized situation.
Eduardo de Azevedo Botter
1996-01-01
Este trabalho visa estudar o efeito da inclusão de técnicas de chaveamento no treinamento de Redes Neurais Artificiais do tipo feedforward observando se tais técnicas de treinamento produzem Redes Neurais Artificiais mais tolerantes a perdas de unidades escondidas. Apresentamos também, um estudo comparativo dos algoritmos de treinamento Back-Propagation e Filtro de Kalman Estendido na sua forma original e com a presença da técnica de chaveamento. No final é apresentado um exemplo prático de u...
Directory of Open Access Journals (Sweden)
Devinder Kaur
2010-12-01
to compare the selective cloning technique with the conventional GA and the back-propagation algorithm. For comparative analysis, same neural network architecture is used for both the back propagation and the genetic algorithms. The selective cloning approach is based on the schema theorem. By using selective cloning, it has been shown that GA is 27.78% more efficient than the conventional GA and 83.33% more efficient than the back propagation approach. The results of selective cloning on other data sets are also discussed.
Hand based visual intent recognition algorithm for wheelchair motion
CSIR Research Space (South Africa)
Luhandjula, T
2010-05-01
Full Text Available for wheelchair motion T. Luhandjula1,2, K. Djouani1, Y. Hamam1, B.J. van Wyk1, Q. Williams2 1. French South African Technical Institute in Electronics at the Tshwane University of Technology, Pretoria, RSA 2. Meraka Institute at the Council for Scientific... shown in Fig. 5 is used. From empirical study [1] the topology of the multilayer perceptron (MLP) is chosen to consist of a two neuron input layer, a 10 neuron hidden layer and the output. The training is performed using a backpropagation algorithm...
Reconstruction of periodic signals using neural networks
Directory of Open Access Journals (Sweden)
José Danilo Rairán Antolines
2014-01-01
Full Text Available In this paper, we reconstruct a periodic signal by using two neural networks. The first network is trained to approximate the period of a signal, and the second network estimates the corresponding coefficients of the signal's Fourier expansion. The reconstruction strategy consists in minimizing the mean-square error via backpro-pagation algorithms over a single neuron with a sine transfer function. Additionally, this paper presents mathematical proof about the quality of the approximation as well as a first modification of the algorithm, which requires less data to reach the same estimation; thus making the algorithm suitable for real-time implementations.
Fault Tolerant Neural Network for ECG Signal Classification Systems
Directory of Open Access Journals (Sweden)
MERAH, M.
2011-08-01
Full Text Available The aim of this paper is to apply a new robust hardware Artificial Neural Network (ANN for ECG classification systems. This ANN includes a penalization criterion which makes the performances in terms of robustness. Specifically, in this method, the ANN weights are normalized using the auto-prune method. Simulations performed on the MIT ? BIH ECG signals, have shown that significant robustness improvements are obtained regarding potential hardware artificial neuron failures. Moreover, we show that the proposed design achieves better generalization performances, compared to the standard back-propagation algorithm.
Computationally Efficient Neural Network Intrusion Security Awareness
Energy Technology Data Exchange (ETDEWEB)
Todd Vollmer; Milos Manic
2009-08-01
An enhanced version of an algorithm to provide anomaly based intrusion detection alerts for cyber security state awareness is detailed. A unique aspect is the training of an error back-propagation neural network with intrusion detection rule features to provide a recognition basis. Network packet details are subsequently provided to the trained network to produce a classification. This leverages rule knowledge sets to produce classifications for anomaly based systems. Several test cases executed on ICMP protocol revealed a 60% identification rate of true positives. This rate matched the previous work, but 70% less memory was used and the run time was reduced to less than 1 second from 37 seconds.
International Nuclear Information System (INIS)
Cheon, Se Woo; Kim, Wan Joo; Chang, Soon Heung; Roh, Myung Sub
1991-01-01
The Back-propagation Neural Network (BPN) algorithm is applied to connectionist expert system for the identification of BWR transients. Several powerful features of neural network-based expert systems over traditional rule-based expert systems are described. The general mapping capability of the neural networks enables to identify transients easily. A number of case studies were performed with emphasis on the applicability of the neural networks to the diagnostic domain. It is revealed that the BPN algorithm can identify transients properly, even when incomplete or untrained symptoms are given. It is also shown that multiple transients are easily identified
Optimal control learning with artificial neural networks
International Nuclear Information System (INIS)
Martinez, J.M.; Parey, C.; Houkari, M.
1993-01-01
This paper shows neural networks capabilities in optimal control applications of non linear dynamic systems. Our method is issued of a classical method concerning the direct research of the optimal control using gradient techniques. We show that neural approach and backpropagation paradigm are able to solve efficiently equations relative to necessary conditions for an optimizing solution. We have taken into account the known capabilities of multi layered networks in approximation functions. And for dynamic systems, we have generalized the indirect learning of inverse model adaptive architecture that is capable to define an optimal control in relation to a temporal criterion. (orig.)
Multilayer Perceptron: Architecture Optimization and Training
Directory of Open Access Journals (Sweden)
Hassan Ramchoun
2016-09-01
Full Text Available The multilayer perceptron has a large wide of classification and regression applications in many fields: pattern recognition, voice and classification problems. But the architecture choice has a great impact on the convergence of these networks. In the present paper we introduce a new approach to optimize the network architecture, for solving the obtained model we use the genetic algorithm and we train the network with a back-propagation algorithm. The numerical results assess the effectiveness of the theoretical results shown in this paper, and the advantages of the new modeling compared to the previous model in the literature.
Chen, Wensheng; Tian, Lei; Rehman, Shakil; Zhang, Zhengyun; Lee, Heow Pueh; Barbastathis, George
2015-02-23
We use compressive in-line holography to image air bubbles in water and investigate the effect of bubble concentration on reconstruction performance by simulation. Our forward model treats bubbles as finite spheres and uses Mie scattering to compute the scattered field in a physically rigorous manner. Although no simple analytical bounds on maximum concentration can be derived within the classical compressed sensing framework due to the complexity of the forward model, the receiver operating characteristic (ROC) curves in our simulation provide an empirical concentration bound for accurate bubble detection by compressive holography at different noise levels, resulting in a maximum tolerable concentration much higher than the traditional back-propagation method.
Reconocimiento de caracteres por medio de una red neuronal artificial
Directory of Open Access Journals (Sweden)
Cesar Rivera-Ordoñez
2009-01-01
Full Text Available In this project we develop a characters recognition system implemented in a general purpose FPGA card. First, The characters classification is executed by a neural network model called feed-forward backpropagation. The Matlab toobox, NNTool used for neural networks is used to create, training and simulate this kind of Artificial Neural Network (ANN with five different patterns of training. For the implementation the ANN computer model is realizes as hardware system, which is described in a block diagram using both Matlab/ Simulink and Xilinx System Generator (XSG. Subsequently, the bitstream configuration file -necessary for the FPGA programming- is generated by XSG for implementing with Xilinx ISE foundation.
A robust neural controller for underwater robot manipulators.
Lee, M; Choi, H S
2000-01-01
This paper presents a robust control scheme using a multilayer neural network with the error backpropagation learning algorithm. The multilayer neural network acts as a compensator of the conventional sliding mode controller to improve the control performance when initial assumptions of uncertainty bounds of system parameters are not valid. The proposed controller is applied to control a robot manipulator operating under the sea which has large uncertainties such as the buoyancy, the drag force, wave effects, currents, and the added mass/moment of inertia. Computer simulation results show that the proposed control scheme gives an effective path way to cope with those unexpected large uncertainties.
Training neural networks using sequential extended Kalman filtering
Energy Technology Data Exchange (ETDEWEB)
Plumer, E.S.
1995-03-01
Recent work has demonstrated the use of the extended Kalman filter (EKF) as an alternative to gradient-descent backpropagation when training multi-layer perceptrons. The EKF approach significantly improves convergence properties but at the cost of greater storage and computational complexity. Feldkamp et al. have described a decoupled version of the EKF which preserves the training advantages of the general EKF but which reduces the storage and computational requirements. This paper reviews the general and decoupled EKF approaches and presents sequentialized versions which provide further computational savings over the batch forms. The usefulness of the sequentialized EKF algorithms is demonstrated on a pattern classification problem.
Ambient temperature modelling with soft computing techniques
Energy Technology Data Exchange (ETDEWEB)
Bertini, Ilaria; Ceravolo, Francesco; Citterio, Marco; Di Pietra, Biagio; Margiotta, Francesca; Pizzuti, Stefano; Puglisi, Giovanni [Energy, New Technology and Environment Agency (ENEA), Via Anguillarese 301, 00123 Rome (Italy); De Felice, Matteo [Energy, New Technology and Environment Agency (ENEA), Via Anguillarese 301, 00123 Rome (Italy); University of Rome ' ' Roma 3' ' , Dipartimento di Informatica e Automazione (DIA), Via della Vasca Navale 79, 00146 Rome (Italy)
2010-07-15
This paper proposes a hybrid approach based on soft computing techniques in order to estimate monthly and daily ambient temperature. Indeed, we combine the back-propagation (BP) algorithm and the simple Genetic Algorithm (GA) in order to effectively train artificial neural networks (ANN) in such a way that the BP algorithm initialises a few individuals of the GA's population. Experiments concerned monthly temperature estimation of unknown places and daily temperature estimation for thermal load computation. Results have shown remarkable improvements in accuracy compared to traditional methods. (author)
Supervised learning of probability distributions by neural networks
Baum, Eric B.; Wilczek, Frank
1988-01-01
Supervised learning algorithms for feedforward neural networks are investigated analytically. The back-propagation algorithm described by Werbos (1974), Parker (1985), and Rumelhart et al. (1986) is generalized by redefining the values of the input and output neurons as probabilities. The synaptic weights are then varied to follow gradients in the logarithm of likelihood rather than in the error. This modification is shown to provide a more rigorous theoretical basis for the algorithm and to permit more accurate predictions. A typical application involving a medical-diagnosis expert system is discussed.
International Nuclear Information System (INIS)
Ferreira, Francisco J.O.; Crispim, Verginia R.; Silva, Ademir X.
2009-01-01
The artificial neural network technique was used to identify drugs and plastic explosives, from a tomography composed by a set of six neutrongraphic projections obtained in real time. Bidimensional tomographic images of samples of drugs, explosives and other materials, when digitally processed, yield the characteristic spectra of each type of material. The information contained in those spectra was then used for ANN training, the best images being obtained when the multilayer perceptron model, the back-propagation training algorithm and the Cross-validation interruption criterion were used. ANN showed to be useful in forecasting presence of drugs and explosives hitting a rate of success above 97 %. (author)
Marcano Cedeño, Alexis Enrique
2010-01-01
El Algoritmo de Retropropagación (Algoritmo Backpropagation, ABP), es uno de los algoritmos más conocidos y utilizados para el entrenamiento de las Redes Neuronales Artificiales, RNAs. El ABP ha sido empleado con éxito en problemas de clasificación de patrones en áreas como: Medicina, Bioinformática, Telecomunicaciones, Banca, Predicciones Climatológicas, etc. Sin embargo el ABP tiene algunas limitaciones que le impiden alcanzar un nivel óptimo de eficiencia (problemas de lentitud, convergenc...
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving...... to be an effective tool for pattern recognition, the basic idea is to train a neural network with simulated values of modal parameters in order to recognize the behaviour of the damaged as well as the undamaged structure. Subjecting this trained neural network to measured modal parameters should imply information...
Rutile nanopowders for pigment production: Formation mechanism and particle size prediction
Zhang, Wu; Tang, Hongxin
2018-01-01
Formation mechanism and particle size prediction of rutile nanoparticles for pigment production were investigated. Anatase nanoparticles were observed by oriented attachment with parallel lattice fringe spaces of 0.2419 nm. Upon increasing the calcination temperature, the (1 1 0) plane of rutile was gradually observed, suggesting that the anatase (1 0 3) planes undergo internal structural rearrangement of oxygen and titanium ions into rutile phase due to ionic diffusion. Backpropagation neural network was used to predict particle size of rutile nanopowders, the prediction errors were all smaller than 2%, providing an efficient method to control particle size in pigment production.
Que, Ruiyi; Zhu, Rong
2012-01-01
Air speed, angle of sideslip and angle of attack are fundamental aerodynamic parameters for controlling most aircraft. For small aircraft for which conventional detecting devices are too bulky and heavy to be utilized, a novel and practical methodology by which the aerodynamic parameters are inferred using a micro hot-film flow sensor array mounted on the surface of the wing is proposed. A back-propagation neural network is used to model the coupling relationship between readings of the sensor array and aerodynamic parameters. Two different sensor arrangements are tested in wind tunnel experiments and dependence of the system performance on the sensor arrangement is analyzed.
Multilayered perceptron neural networks to compute energy losses in magnetic cores
International Nuclear Information System (INIS)
Kucuk, Ilker
2006-01-01
This paper presents a new approach based on multilayered perceptrons (MLPs) to compute the specific energy losses of toroidal wound cores built from 3% SiFe 0.27 mm thick M4, 0.1 and 0.08 mm thin gauge electrical steel strips. The MLP has been trained by a back-propagation and extended delta-bar-delta learning algorithm. The results obtained by using the MLP model were compared with a commonly used conventional method. The comparison has shown that the proposed model improved loss estimation with respect to the conventional method
Robust Bioinformatics Recognition with VLSI Biochip Microsystem
Lue, Jaw-Chyng L.; Fang, Wai-Chi
2006-01-01
A microsystem architecture for real-time, on-site, robust bioinformatic patterns recognition and analysis has been proposed. This system is compatible with on-chip DNA analysis means such as polymerase chain reaction (PCR)amplification. A corresponding novel artificial neural network (ANN) learning algorithm using new sigmoid-logarithmic transfer function based on error backpropagation (EBP) algorithm is invented. Our results show the trained new ANN can recognize low fluorescence patterns better than the conventional sigmoidal ANN does. A differential logarithmic imaging chip is designed for calculating logarithm of relative intensities of fluorescence signals. The single-rail logarithmic circuit and a prototype ANN chip are designed, fabricated and characterized.
An overview of the numerical and neural network accosts of ocean wave prediction
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Prabaharan, N.
Engineering, 28, 889-898. Fahlman,S.E. (1988) An empirical study of learning speed in back-propagation networks. Technical report, CMUCS- 88-161, Carnegie-Me llon Univ, Computer Science Dept, Pittsburgh, PA. Hasselmann, S and Hasselmann, K (1985...-1810. Sverdrup, HU and Munk, WH (1947) Wind, sea and swell: Theory of relation for forecasting. H.O. Publication 601, US Naval oceanographic office, Washington DC, USA. Tolman, HL and Chalikov, DV (1996) Source terms in a third-generation wind wave model. J...
Egg hatchability prediction by multiple linear regression and artificial neural networks
Directory of Open Access Journals (Sweden)
AC Bolzan
2008-06-01
Full Text Available An artificial neural network (ANN was compared with a multiple linear regression statistical method to predict hatchability in an artificial incubation process. A feedforward neural network architecture was applied. Network trainings were made by the backpropagation algorithm based on data obtained from industrial incubations. The ANN model was chosen as it produced data that fit better the experimental data as compared to the multiple linear regression model, which used coefficients determined by minimum square method. The proposed simulation results of these approaches indicate that this ANN can be used for incubation performance prediction.
Forecasting Models for Hydropower Unit Stability Using LS-SVM
Directory of Open Access Journals (Sweden)
Liangliang Qiao
2015-01-01
Full Text Available This paper discusses a least square support vector machine (LS-SVM approach for forecasting stability parameters of Francis turbine unit. To achieve training and testing data for the models, four field tests were presented, especially for the vibration in Y-direction of lower generator bearing (LGB and pressure in draft tube (DT. A heuristic method such as a neural network using Backpropagation (NNBP is introduced as a comparison model to examine the feasibility of forecasting performance. In the experimental results, LS-SVM showed superior forecasting accuracies and performances to the NNBP, which is of significant importance to better monitor the unit safety and potential faults diagnosis.
Forecasting the mortality rates of Indonesian population by using neural network
Safitri, Lutfiani; Mardiyati, Sri; Rahim, Hendrisman
2018-03-01
A model that can represent a problem is required in conducting a forecasting. One of the models that has been acknowledged by the actuary community in forecasting mortality rate is the Lee-Certer model. Lee Carter model supported by Neural Network will be used to calculate mortality forecasting in Indonesia. The type of Neural Network used is feedforward neural network aligned with backpropagation algorithm in python programming language. And the final result of this study is mortality rate in forecasting Indonesia for the next few years
Comparative Study of Classification Techniques on Breast Cancer FNA Biopsy Data
Directory of Open Access Journals (Sweden)
George Rumbe
2010-12-01
Full Text Available Accurate diagnostic detection of the cancerous cells in a patient is critical and may alter the subsequent treatment and increase the chances of survival rate. Machine learning techniques have been instrumental in disease detection and are currently being used in various classification problems due to their accurate prediction performance. Various techniques may provide different desired accuracies and it is therefore imperative to use the most suitable method which provides the best desired results. This research seeks to provide comparative analysis of Support Vector Machine, Bayesian classifier and other Artificial neural network classifiers (Backpropagation, linear programming, Learning vector quantization, and K nearest neighborhood on the Wisconsin breast cancer classification problem.
Estimation of Solar Radiation using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Slamet Suprayogi
2004-01-01
Full Text Available The solar radiation is the most important fator affeccting evapotranspiration, the mechanism of transporting the vapor from the water surface has also a great effect. The main objectives of this study were to investigate the potential of using Artificial Neural Network (ANN to predict solar radiation related to temperature. The three-layer backpropagation were developed, trained, and tested to forecast solar radiation for Ciriung sub Cachment. Result revealed that the ANN were able to well learn the events they were trained to recognize. Moreover, they were capable of effecctively generalize their training by predicting solar radiation for sets unseen cases.
Energy Technology Data Exchange (ETDEWEB)
Koenig, R.W.T.; Von Hellermann, M. [Commission of the European Communities, Abingdon (United Kingdom). JET Joint Undertaking; Svensson, J. [Royal Inst. of Tech., Stockholm (Sweden)
1994-07-01
A back-propagation neural network technique is used at JET to extract plasma parameters like ion temperature, rotation velocities or spectral line intensities from charge exchange (CX) spectra. It is shown that in the case of the C VI CX spectra, neural networks can give a good estimation (better than +-20% accuracy) for the main plasma parameters (Ti, V{sub rot}). Since the neural network approach involves no iterations or initial guesses the speed with which a spectrum is processed is so high (0.2 ms/spectrum) that real time analysis will be achieved in the near future. 4 refs., 8 figs.
International Nuclear Information System (INIS)
Yang, A.-S.; Kuo, T.-C.; Ling, P.-H.
2003-01-01
The phase transport phenomenon of the high-pressure two-phase turbulent bubbly flow involves complicated interfacial interactions of the mass, momentum, and energy transfer processes between phases, revealing that an enormous effort is required in characterizing the liquid-gas flow behavior. Nonetheless, the instantaneous information of bubbly flow properties is often desired for many industrial applications. This investigation aims to demonstrate the successful use of neural networks in the real-time determination of two-phase flow properties at elevated pressures. Three back-propagation neural networks, trained with the simulation results of a comprehensive theoretical model, are established to predict the transport characteristics (specifically the distributions of void-fraction and axial liquid-gas velocities) of upward turbulent bubbly pipe flows at pressures covering 3.5-7.0 MPa. Comparisons of the predictions with the test target vectors indicate that the averaged root-mean-squared (RMS) error for each one of three back-propagation neural networks is within 4.59%. In addition, this study appraises the effects of different network parameters, including the number of hidden nodes, the type of transfer function, the number of training pairs, the learning rate-increasing ratio, the learning rate-decreasing ratio, and the momentum value, on the training quality of neural networks.
Implementation of a multi-layer perception for a non-linear control problem
International Nuclear Information System (INIS)
Lister, J.B.; Schnurrenberger, H.; Marmillod, P.
1990-12-01
We present the practical application of a 1-hidden-layer multilayer perception (MLP) to provide a non-linear continuous multi-variable mapping with 42 inputs and 13 outputs. The problem resolved is one of extracting information from experimental signals with a bandwidth of many kilohertz. We have an exact model of the inverse mapping of this problem, but we have no explicit form of the required forward mapping. This is the typical situation in data interpretation. The MLP was trained to provide this mapping by learning on 500 input-output examples. The success of the off-line solution to this problem using an MLP led us to examine the robustness of the MLP to different noise sources. We found that the MLP is more robust than an approximate linear mapping of the same problem. 12 bits of resolution in the weights are necessary to avoid a significant loss of precision. The practical implementation of large analog weight matrices using DAS-multipliers and a simple segmented sigmoid is also presented. A General Adaptive Recipe (GAR) for improving the performance of conventional back-propagation was developed. The GAR uses an adaptive step length and both the bias terms and the initial weight seeding are determined by the network size. The GAR was found to be robust and much faster than conventional back-propagation. (author) 20 figs., 1 tab., 15 refs
Directory of Open Access Journals (Sweden)
Chung-Ta Li
2014-01-01
Full Text Available We propose a species-based hybrid of the electromagnetism-like mechanism (EM and back-propagation algorithms (SEMBP for an interval type-2 fuzzy neural system with asymmetric membership functions (AIT2FNS design. The interval type-2 asymmetric fuzzy membership functions (IT2 AFMFs and the TSK-type consequent part are adopted to implement the network structure in AIT2FNS. In addition, the type reduction procedure is integrated into an adaptive network structure to reduce computational complexity. Hence, the AIT2FNS can enhance the approximation accuracy effectively by using less fuzzy rules. The AIT2FNS is trained by the SEMBP algorithm, which contains the steps of uniform initialization, species determination, local search, total force calculation, movement, and evaluation. It combines the advantages of EM and back-propagation (BP algorithms to attain a faster convergence and a lower computational complexity. The proposed SEMBP algorithm adopts the uniform method (which evenly scatters solution agents over the feasible solution region and the species technique to improve the algorithm’s ability to find the global optimum. Finally, two illustrative examples of nonlinear systems control are presented to demonstrate the performance and the effectiveness of the proposed AIT2FNS with the SEMBP algorithm.
Liang, Zhengzhao; Gong, Bin; Tang, Chunan; Zhang, Yongbin; Ma, Tianhui
2014-01-01
The right bank high slope of the Dagangshan Hydroelectric Power Station is located in complicated geological conditions with deep fractures and unloading cracks. How to obtain the mechanical parameters and then evaluate the safety of the slope are the key problems. This paper presented a displacement back analysis for the slope using an artificial neural network model (ANN) and particle swarm optimization model (PSO). A numerical model was established to simulate the displacement increment results, acquiring training data for the artificial neural network model. The backpropagation ANN model was used to establish a mapping function between the mechanical parameters and the monitoring displacements. The PSO model was applied to initialize the weights and thresholds of the backpropagation (BP) network model and determine suitable values of the mechanical parameters. Then the elastic moduli of the rock masses were obtained according to the monitoring displacement data at different excavation stages, and the BP neural network model was proved to be valid by comparing the measured displacements, the displacements predicted by the BP neural network model, and the numerical simulation using the back-analyzed parameters. The proposed model is useful for rock mechanical parameters determination and instability investigation of rock slopes.
Laidi, Maamar; Hanini, Salah; Rezrazi, Ahmed; Yaiche, Mohamed Redha; El Hadj, Abdallah Abdallah; Chellali, Farouk
2017-04-01
In this study, a backpropagation artificial neural network (BP-ANN) model is used as an alternative approach to predict solar radiation on tilted surfaces (SRT) using a number of variables involved in physical process. These variables are namely the latitude of the site, mean temperature and relative humidity, Linke turbidity factor and Angstrom coefficient, extraterrestrial solar radiation, solar radiation data measured on horizontal surfaces (SRH), and solar zenith angle. Experimental solar radiation data from 13 stations spread all over Algeria around the year (2004) were used for training/validation and testing the artificial neural networks (ANNs), and one station was used to make the interpolation of the designed ANN. The ANN model was trained, validated, and tested using 60, 20, and 20 % of all data, respectively. The configuration 8-35-1 (8 inputs, 35 hidden, and 1 output neurons) presented an excellent agreement between the prediction and the experimental data during the test stage with determination coefficient of 0.99 and root meat squared error of 5.75 Wh/m2, considering a three-layer feedforward backpropagation neural network with Levenberg-Marquardt training algorithm, a hyperbolic tangent sigmoid and linear transfer function at the hidden and the output layer, respectively. This novel model could be used by researchers or scientists to design high-efficiency solar devices that are usually tilted at an optimum angle to increase the solar incident on the surface.
File access prediction using neural networks.
Patra, Prashanta Kumar; Sahu, Muktikanta; Mohapatra, Subasish; Samantray, Ronak Kumar
2010-06-01
One of the most vexing issues in design of a high-speed computer is the wide gap of access times between the memory and the disk. To solve this problem, static file access predictors have been used. In this paper, we propose dynamic file access predictors using neural networks to significantly improve upon the accuracy, success-per-reference, and effective-success-rate-per-reference by using neural-network-based file access predictor with proper tuning. In particular, we verified that the incorrect prediction has been reduced from 53.11% to 43.63% for the proposed neural network prediction method with a standard configuration than the recent popularity (RP) method. With manual tuning for each trace, we are able to improve upon the misprediction rate and effective-success-rate-per-reference using a standard configuration. Simulations on distributed file system (DFS) traces reveal that exact fit radial basis function (RBF) gives better prediction in high end system whereas multilayer perceptron (MLP) trained with Levenberg-Marquardt (LM) backpropagation outperforms in system having good computational capability. Probabilistic and competitive predictors are the most suitable for work stations having limited resources to deal with and the former predictor is more efficient than the latter for servers having maximum system calls. Finally, we conclude that MLP with LM backpropagation algorithm has better success rate of file prediction than those of simple perceptron, last successor, stable successor, and best k out of m predictors.
Application of neural networks to seismic active control
International Nuclear Information System (INIS)
Tang, Yu.
1995-01-01
An exploratory study on seismic active control using an artificial neural network (ANN) is presented in which a singledegree-of-freedom (SDF) structural system is controlled by a trained neural network. A feed-forward neural network and the backpropagation training method are used in the study. In backpropagation training, the learning rate is determined by ensuring the decrease of the error function at each training cycle. The training patterns for the neural net are generated randomly. Then, the trained ANN is used to compute the control force according to the control algorithm. The control strategy proposed herein is to apply the control force at every time step to destroy the build-up of the system response. The ground motions considered in the simulations are the N21E and N69W components of the Lake Hughes No. 12 record that occurred in the San Fernando Valley in California on February 9, 1971. Significant reduction of the structural response by one order of magnitude is observed. Also, it is shown that the proposed control strategy has the ability to reduce the peak that occurs during the first few cycles of the time history. These promising results assert the potential of applying ANNs to active structural control under seismic loads
International Nuclear Information System (INIS)
Hong, Chih-Ming; Chen, Chiung-Hsing; Tu, Chia-Sheng
2013-01-01
Highlights: ► This paper presents MPPT based control for optimal wind energy capture using RBFN. ► MPSO is adopted to adjust the learning rates to improve the learning capability. ► This technique can maintain the system stability and reach the desired performance. ► The EMF in the rotating reference frame is utilized in order to estimate speed. - Abstract: This paper presents maximum-power-point-tracking (MPPT) based control algorithms for optimal wind energy capture using radial basis function network (RBFN) and a proposed torque observer MPPT algorithm. The design of a high-performance on-line training RBFN using back-propagation learning algorithm with modified particle swarm optimization (MPSO) regulating controller for the sensorless control of a permanent magnet synchronous generator (PMSG). The MPSO is adopted in this study to adapt the learning rates in the back-propagation process of the RBFN to improve the learning capability. The PMSG is controlled by the loss-minimization control with MPPT below the base speed, which corresponds to low and high wind speed, and the maximum energy can be captured from the wind. Then the observed disturbance torque is feed-forward to increase the robustness of the PMSG system
Fiyadh, Seef Saadi; AlSaadi, Mohammed Abdulhakim; AlOmar, Mohamed Khalid; Fayaed, Sabah Saadi; Hama, Ako R; Bee, Sharifah; El-Shafie, Ahmed
2017-11-01
The main challenge in the lead removal simulation is the behaviour of non-linearity relationships between the process parameters. The conventional modelling technique usually deals with this problem by a linear method. The substitute modelling technique is an artificial neural network (ANN) system, and it is selected to reflect the non-linearity in the interaction among the variables in the function. Herein, synthesized deep eutectic solvents were used as a functionalized agent with carbon nanotubes as adsorbents of Pb 2+ . Different parameters were used in the adsorption study including pH (2.7 to 7), adsorbent dosage (5 to 20 mg), contact time (3 to 900 min) and Pb 2+ initial concentration (3 to 60 mg/l). The number of experimental trials to feed and train the system was 158 runs conveyed in laboratory scale. Two ANN types were designed in this work, the feed-forward back-propagation and layer recurrent; both methods are compared based on their predictive proficiency in terms of the mean square error (MSE), root mean square error, relative root mean square error, mean absolute percentage error and determination coefficient (R 2 ) based on the testing dataset. The ANN model of lead removal was subjected to accuracy determination and the results showed R 2 of 0.9956 with MSE of 1.66 × 10 -4 . The maximum relative error is 14.93% for the feed-forward back-propagation neural network model.
Method and system for training dynamic nonlinear adaptive filters which have embedded memory
Rabinowitz, Matthew (Inventor)
2002-01-01
Described herein is a method and system for training nonlinear adaptive filters (or neural networks) which have embedded memory. Such memory can arise in a multi-layer finite impulse response (FIR) architecture, or an infinite impulse response (IIR) architecture. We focus on filter architectures with separate linear dynamic components and static nonlinear components. Such filters can be structured so as to restrict their degrees of computational freedom based on a priori knowledge about the dynamic operation to be emulated. The method is detailed for an FIR architecture which consists of linear FIR filters together with nonlinear generalized single layer subnets. For the IIR case, we extend the methodology to a general nonlinear architecture which uses feedback. For these dynamic architectures, we describe how one can apply optimization techniques which make updates closer to the Newton direction than those of a steepest descent method, such as backpropagation. We detail a novel adaptive modified Gauss-Newton optimization technique, which uses an adaptive learning rate to determine both the magnitude and direction of update steps. For a wide range of adaptive filtering applications, the new training algorithm converges faster and to a smaller value of cost than both steepest-descent methods such as backpropagation-through-time, and standard quasi-Newton methods. We apply the algorithm to modeling the inverse of a nonlinear dynamic tracking system 5, as well as a nonlinear amplifier 6.
Connectionist natural language parsing with BrainC
Mueller, Adrian; Zell, Andreas
1991-08-01
A close examination of pure neural parsers shows that they either could not guarantee the correctness of their derivations or had to hard-code seriality into the structure of the net. The authors therefore decided to use a hybrid architecture, consisting of a serial parsing algorithm and a trainable net. The system fulfills the following design goals: (1) parsing of sentences without length restriction, (2) soundness and completeness for any context-free language, and (3) learning the applicability of parsing rules with a neural network to increase the efficiency of the whole system. BrainC (backtracktacking and backpropagation in C) combines the well- known shift-reduce parsing technique with backtracking with a backpropagation network to learn and represent typical structures of the trained natural language grammars. The system has been implemented as a subsystem of the Rochester Connectionist Simulator (RCS) on SUN workstations and was tested with several grammars for English and German. The design of the system and then the results are discussed.
Membership generation using multilayer neural network
Kim, Jaeseok
1992-01-01
There has been intensive research in neural network applications to pattern recognition problems. Particularly, the back-propagation network has attracted many researchers because of its outstanding performance in pattern recognition applications. In this section, we describe a new method to generate membership functions from training data using a multilayer neural network. The basic idea behind the approach is as follows. The output values of a sigmoid activation function of a neuron bear remarkable resemblance to membership values. Therefore, we can regard the sigmoid activation values as the membership values in fuzzy set theory. Thus, in order to generate class membership values, we first train a suitable multilayer network using a training algorithm such as the back-propagation algorithm. After the training procedure converges, the resulting network can be treated as a membership generation network, where the inputs are feature values and the outputs are membership values in the different classes. This method allows fairly complex membership functions to be generated because the network is highly nonlinear in general. Also, it is to be noted that the membership functions are generated from a classification point of view. For pattern recognition applications, this is highly desirable, although the membership values may not be indicative of the degree of typicality of a feature value in a particular class.
Damayanti, A.; Werdiningsih, I.
2018-03-01
The brain is the organ that coordinates all the activities that occur in our bodies. Small abnormalities in the brain will affect body activity. Tumor of the brain is a mass formed a result of cell growth not normal and unbridled in the brain. MRI is a non-invasive medical test that is useful for doctors in diagnosing and treating medical conditions. The process of classification of brain tumor can provide the right decision and correct treatment and right on the process of treatment of brain tumor. In this study, the classification process performed to determine the type of brain tumor disease, namely Alzheimer’s, Glioma, Carcinoma and normal, using energy coefficient and ANFIS. Process stages in the classification of images of MR brain are the extraction of a feature, reduction of a feature, and process of classification. The result of feature extraction is a vector approximation of each wavelet decomposition level. The feature reduction is a process of reducing the feature by using the energy coefficients of the vector approximation. The feature reduction result for energy coefficient of 100 per feature is 1 x 52 pixels. This vector will be the input on the classification using ANFIS with Fuzzy C-Means and FLVQ clustering process and LM back-propagation. Percentage of success rate of MR brain images recognition using ANFIS-FLVQ, ANFIS, and LM back-propagation was obtained at 100%.
Selective interferometric imaging of internal multiples
Zuberi, M. A H
2013-01-01
Internal multiples deteriorate the image when the imaging procedure assumes only single scattering, especially if the velocity model does not reproduce such scattering in the Green’s function. If properly imaged, internal multiples (and internally-scattered energy) can enhance the seismic image and illuminate areas otherwise neglected or poorly imaged by conventional single-scattering approaches. Conventionally, in order to image internal multiples, accurate, sharp contrasts in the velocity model are required to construct a Green’s function with all the scattered energy. As an alternative, we develop a three-step procedure, which images the first-order internal scattering using the background Green’s function (from the surface to each image point), constructed from a smooth velocity model: We first back-propagate the recorded surface data using the background Green’s function, then cross-correlate the back-propagated data with the recorded data and finally cross-correlate the result with the original background Green’s function. This procedure images the contribution of the recorded first-order internal multiples and is almost free of the single-scattering recorded energy. This image can be added to the conventional single-scattering image, obtained e.g. from Kirchhoff migration, to enhance the image. Application to synthetic data with reflectors illuminated by multiple scattering only demonstrates the effectiveness of the approach.
PREDIKSI BISNIS FOREX MENGGUNAKAN MODEL NEURAL NETWORK BERBASIS ADA BOOST MENGGUNAKAN 2047 DATA
Directory of Open Access Journals (Sweden)
Suyatno Suyatno
2016-11-01
Full Text Available Setelah melakukan penelitian dan percobaan maka didapatkan hasil penelitian pertama yang telah dilakukan dengan menggunakan Algoritma Neural Network Backpropagatioan dengan menggunakan data sebanyak 268 menunjungkan tingkat akurasi error prediksi pada waktu prediksi per 5 menit sebesar 0.758619403, bila menggunakan data sebanyak 2047 menunjukkan tingkat akurasi error prediksi sebesar 0.500161212 dan hasil penelitian kedua yang telah dilakukan menggunakan Algoritma Optimasi Adaboost pada proses trainning dan ditambah Neural Network Backpropagation pada proses learning menunjukkan tingkat akurasi error prediksi pada waktu prediksi per 5 menit menggunakan data sebanyak 268 sebesar 0.397014925, bila menggunakan data sebanyak 2047 menunjukkan tingkat akurasi error prediksi sebesar 0.099951148. Tahap awal dalam melakukan penelitian ini sampai dengan pengujian menggunakan perhitungan prediksi nilai akurasi error menggunakan rumus MSE (Mean Sequare Error dengan menggunakan algoritma optimasi adaboost untuk memberikan jawaban atas permasalahan bahwa nilai akurasi error Algoritma Neural Network Backpropagation perlu direndahkan agar akurasi prediksi meningkat dan tahap kedua dilakukan uji coba menggunakan data yang lebih banyak dibandingan dengan tahap ke satu. Berdasarkan hasil penelitian yang telah dilakukan, dapat disimpulkan bahwa Algoritma Neural Network memiliki akurasi yang lebih rendah bila dibandingkan dengan akurasi menggunakan metode optimasi adaboost pada proses trainning ditambah dengan Neural Network, ini dapat dilihat dengan rendahnya tingkat error MSE menggunakan metode adaboost + neural network dan dapat disimpukan pula bahwa dengan menggunakan jumlah data yang lebih banyak maka dapat menurunkan tingkat akurasi error MSE sehingga berhasil meningkatkan akurasi prediksi dalam bisnis forex trading. Kata kunci: forex, trading, neural network, adaboost, central capital futures.
Falat, Lukas; Marcek, Dusan; Durisova, Maria
2016-01-01
This paper deals with application of quantitative soft computing prediction models into financial area as reliable and accurate prediction models can be very helpful in management decision-making process. The authors suggest a new hybrid neural network which is a combination of the standard RBF neural network, a genetic algorithm, and a moving average. The moving average is supposed to enhance the outputs of the network using the error part of the original neural network. Authors test the suggested model on high-frequency time series data of USD/CAD and examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, they perform a comparative statistical out-of-sample analysis of the tested model with autoregressive models and the standard neural network. They also incorporate genetic algorithm as an optimizing technique for adapting parameters of ANN which is then compared with standard backpropagation and backpropagation combined with K-means clustering algorithm. Finally, the authors find out that their suggested hybrid neural network is able to produce more accurate forecasts than the standard models and can be helpful in eliminating the risk of making the bad decision in decision-making process.
Firearm Classification using Neural Networks on Ring of Firing Pin Impression Images
Directory of Open Access Journals (Sweden)
Abdul AZIZ JEMAIN
2013-07-01
Full Text Available This paper implements two layer neural networks with different feedforward backpropagation algorithms for better performance of firearm classification us-ing numerical features from the ring image. A total of 747 ring images which are extracted from centre of the firing pin impression have been captured from five different pistols of the Parabellum Vector SPI 9mm model. Then, based on finding from the previous studies, the six best geometric moments numerical fea-tures were extracted from those ring images. The elements of the dataset were further randomly divided into the training set (523 elements, testing set (112 el-ements and validation set (112 elements in accordance with the requirement of the supervised learning nature of the backpropagation neural network (BPNN. Empirical results show that a two layer BPNN with a 6-7-5 configura-tion and tansig/tansig transfer functions with ‘trainscg’ training algorithm has produced the best classification result of 98%. The classification result is an improvement compared to the previous studies as well as confirming that the ring image region contains useful information for firearm classification.
Firearm Classification using Neural Networks on Ring of Firing Pin Impression Images
Directory of Open Access Journals (Sweden)
SAADI Bin Ahmad KAMARUDDIN
2012-12-01
Full Text Available This paper implements two layer neural networks with different feedforward backpropagation algorithms for better performance of firearm classification us-ing numerical features from the ring image. A total of 747 ring images which are extracted from centre of the firing pin impression have been captured from five different pistols of the Parabellum Vector SPI 9mm model. Then, based on finding from the previous studies, the six best geometric moments numerical fea-tures were extracted from those ring images. The elements of the dataset were further randomly divided into the training set (523 elements, testing set (112 el-ements and validation set (112 elements in accordance with the requirement of the supervised learning nature of the backpropagation neural network (BPNN. Empirical results show that a two layer BPNN with a 6-7-5 configura-tion and tansig/tansig transfer functions with ‘trainscg’ training algorithm has produced the best classification result of 98%. The classification result is an improvement compared to the previous studies as well as confirming that the ring image region contains useful information for firearm classification.
Salu, Yehuda; Tilton, James
1993-01-01
The classification of multispectral image data obtained from satellites has become an important tool for generating ground cover maps. This study deals with the application of nonparametric pixel-by-pixel classification methods in the classification of pixels, based on their multispectral data. A new neural network, the Binary Diamond, is introduced, and its performance is compared with a nearest neighbor algorithm and a back-propagation network. The Binary Diamond is a multilayer, feed-forward neural network, which learns from examples in unsupervised, 'one-shot' mode. It recruits its neurons according to the actual training set, as it learns. The comparisons of the algorithms were done by using a realistic data base, consisting of approximately 90,000 Landsat 4 Thematic Mapper pixels. The Binary Diamond and the nearest neighbor performances were close, with some advantages to the Binary Diamond. The performance of the back-propagation network lagged behind. An efficient nearest neighbor algorithm, the binned nearest neighbor, is described. Ways for improving the performances, such as merging categories, and analyzing nonboundary pixels, are addressed and evaluated.
Directory of Open Access Journals (Sweden)
Bashar Tarawneh
2017-01-01
Full Text Available Standard Penetration Test (SPT and Cone Penetration Test (CPT are the most frequently used field tests to estimate soil parameters for geotechnical analysis and design. Numerous soil parameters are related to the SPT N-value. In contrast, CPT is becoming more popular for site investigation and geotechnical design. Correlation of CPT data with SPT N-value is very beneficial since most of the field parameters are related to SPT N-values. A back-propagation artificial neural network (ANN model was developed to predict the N60-value from CPT data. Data used in this study consisted of 109 CPT-SPT pairs for sand, sandy silt, and silty sand soils. The ANN model input variables are: CPT tip resistance (qc, effective vertical stress (σv′, and CPT sleeve friction (fs. A different set of SPT-CPT data was used to check the reliability of the developed ANN model. It was shown that ANN model either under-predicted the N60-value by 7–16% or over-predicted it by 7–20%. It is concluded that back-propagation neural networks is a good tool to predict N60-value from CPT data with acceptable accuracy.
Jaringan Syaraf Tiruan Perambatan Balik Untuk Pengenalan Wajah
Directory of Open Access Journals (Sweden)
Nahdi Sabuari
2016-11-01
Full Text Available This research discusses about face detection and face recognition in an image. Face detection has only two classifications, i.e face and not face. Face recognition is compatible with some classifications of a number individuals who want to be recognized. Face detection and face recognition in thi study using Haar-Like Feature method and Artificial Neural Network Backpropagation. A method Haar-Like Feature used for detection and extraction in an image, because the clasification on this method showed success at used to detect image of the face. Artificial Neural Network Backpropagation is a training algorithm that is used to do training simulated on facial image data training stored in a database. This study uses Ms. Excel 2007 as database with 10 individual sample image, every image in each individuals having three distance with every range has four defferent light intensities, so that the data training stored in the database reached 120 data training. The results shows that the face detection and face recognition which is developed can recognize a face image with an average accuracy rate reaches 80,8% for each distance.
Chettri, Samir R.; Cromp, Robert F.
1993-01-01
In this paper we discuss a neural network architecture (the Probabilistic Neural Net or the PNN) that, to the best of our knowledge, has not previously been applied to remotely sensed data. The PNN is a supervised non-parametric classification algorithm as opposed to the Gaussian maximum likelihood classifier (GMLC). The PNN works by fitting a Gaussian kernel to each training point. The width of the Gaussian is controlled by a tuning parameter called the window width. If very small widths are used, the method is equivalent to the nearest neighbor method. For large windows, the PNN behaves like the GMLC. The basic implementation of the PNN requires no training time at all. In this respect it is far better than the commonly used backpropagation neural network which can be shown to take O(N6) time for training where N is the dimensionality of the input vector. In addition the PNN can be implemented in a feed forward mode in hardware. The disadvantage of the PNN is that it requires all the training data to be stored. Some solutions to this problem are discussed in the paper. Finally, we discuss the accuracy of the PNN with respect to the GMLC and the backpropagation neural network (BPNN). The PNN is shown to be better than GMLC and not as good as the BPNN with regards to classification accuracy.
Time Reversal Migration for Passive Sources Using a Maximum Variance Imaging Condition
Wang, H.
2017-05-26
The conventional time-reversal imaging approach for micro-seismic or passive source location is based on focusing the back-propagated wavefields from each recorded trace in a source image. It suffers from strong background noise and limited acquisition aperture, which may create unexpected artifacts and cause error in the source location. To overcome such a problem, we propose a new imaging condition for microseismic imaging, which is based on comparing the amplitude variance in certain windows, and use it to suppress the artifacts as well as find the right location for passive sources. Instead of simply searching for the maximum energy point in the back-propagated wavefield, we calculate the amplitude variances over a window moving in both space and time axis to create a highly resolved passive event image. The variance operation has negligible cost compared with the forward/backward modeling operations, which reveals that the maximum variance imaging condition is efficient and effective. We test our approach numerically on a simple three-layer model and on a piece of the Marmousi model as well, both of which have shown reasonably good results.
Early tube leak detection system for steam boiler at KEV power plant
Directory of Open Access Journals (Sweden)
Ismail Firas B.
2016-01-01
Full Text Available Tube leakage in boilers has been a major contribution to trips which eventually leads to power plant shut downs. Training of network and developing artificial neural network (ANN models are essential in fault detection in critically large systems. This research focusses on the ANN modelling through training and validation of real data acquired from a sub-critical boiler unit. The artificial neural network (ANN was used to develop a compatible model and to evaluate the working properties and behaviour of boiler. The training and validation of real data has been applied using the feed-forward with back-propagation (BP. The right combination of number of neurons, number of hidden layers, training algorithms and training functions was run to achieve the best ANN model with lowest error. The ANN was trained and validated using real site data acquired from a coal fired power plant in Malaysia. The results showed that the Neural Network (NN with one hidden layers performed better than two hidden layer using feed-forward back-propagation network. The outcome from this study give us the best ANN model which eventually allows for early detection of boiler tube leakages, and forecast of a trip before the real shutdown. This will eventually reduce shutdowns in power plants.
Mofavvaz, Shirin; Sohrabi, Mahmoud Reza; Nezamzadeh-Ejhieh, Alireza
2017-07-01
In the present study, artificial neural networks (ANNs) and least squares support vector machines (LS-SVM) as intelligent methods based on absorption spectra in the range of 230-300 nm have been used for determination of antihistamine decongestant contents. In the first step, one type of network (feed-forward back-propagation) from the artificial neural network with two different training algorithms, Levenberg-Marquardt (LM) and gradient descent with momentum and adaptive learning rate back-propagation (GDX) algorithm, were employed and their performance was evaluated. The performance of the LM algorithm was better than the GDX algorithm. In the second one, the radial basis network was utilized and results compared with the previous network. In the last one, the other intelligent method named least squares support vector machine was proposed to construct the antihistamine decongestant prediction model and the results were compared with two of the aforementioned networks. The values of the statistical parameters mean square error (MSE), Regression coefficient (R2), correlation coefficient (r) and also mean recovery (%), relative standard deviation (RSD) used for selecting the best model between these methods. Moreover, the proposed methods were compared to the high- performance liquid chromatography (HPLC) as a reference method. One way analysis of variance (ANOVA) test at the 95% confidence level applied to the comparison results of suggested and reference methods that there were no significant differences between them.
International Nuclear Information System (INIS)
Bueno, Elaine Inacio; Ting, Daniel Kao Sun; Goncalves, Iraci M.P.
2005-01-01
The purpose of this paper is to develop a system to monitor the nuclear power of a reactor using Artificial Neural Networks. The database used in this work was developed using a theoretical model of IEA-R1 Research Reactor. The IEA-R1 is a pool type reactor of 5 MW, cooled and moderated by light water, and uses graphite and beryllium as reflector. To monitor the nuclear power the following variables were chosen: T3 . temperature above the reactor core, T4 . outlet core temperature, FE01 . primary loop flow rate and the nuclear power. The inputs are T3, T4 and FE01 and the output is the nuclear power. It was used several networks using the backpropagation algorithm. The conclusion is that the multiplayer perceptrons networks (MLPs), training by the backpropagation algorithm, can be used to solve this problem. The results obtained with the MLPs networks are satisfactory and the mean square error was in the order of 10 -4 during the network training and in the order of 10 -2 during the network testing. We intend to monitor the other variables of this model using the same methodology, and after this we will use the real database from the system to compare the results obtained with the model. The monitoring of the reactor variables is part of the development of a fault detection and isolation system which is underway and which is, by its turn, part of a comprehensive ageing management program. (author)
Prediction of geomagnetic storms from solar wind data with the use of a neural network
Directory of Open Access Journals (Sweden)
H. Lundstedt
Full Text Available An artificial feed-forward neural network with one hidden layer and error back-propagation learning is used to predict the geomagnetic activity index (D_{st} one hour in advance. The B_{z}-component and Σ_{Bz}, the density, and the velocity of the solar wind are used as input to the network. The network is trained on data covering a total of 8700 h, extracted from the 25-year period from 1963 to 1987, taken from the NSSDC data base. The performance of the network is examined with test data, not included in the training set, which covers 386 h and includes four different storms. Whilst the network predicts the initial and main phase well, the recovery phase is not modelled correctly, implying that a single hidden layer error back-propagation network is not enough, if the measured D_{st} is not available instantaneously. The performance of the network is independent of whether the raw parameters are used, or the electric field and square root of the dynamical pressure.
Neural networks and wavelet analysis in the computer interpretation of pulse oximetry data
Energy Technology Data Exchange (ETDEWEB)
Dowla, F.U.; Skokowski, P.G.; Leach, R.R. Jr.
1996-03-01
Pulse oximeters determine the oxygen saturation level of blood by measuring the light absorption of arterial blood. The sensor consists of red and infrared light sources and photodetectors. A method based on neural networks and wavelet analysis is developed for improved saturation estimation in the presence of sensor motion. Spectral and correlation functions of the dual channel oximetry data are used by a backpropagation neural network to characterize the type of motion. Amplitude ratios of red to infrared signals as a function of time scale are obtained from the multiresolution wavelet decomposition of the two-channel data. Motion class and amplitude ratios are then combined to obtain a short-time estimate of the oxygen saturation level. A final estimate of oxygen saturation is obtained by applying a 15 s smoothing filter on the short-time measurements based on 3.5 s windows sampled every 1.75 s. The design employs two backpropagation neural networks. The first neural network determines the motion characteristics and the second network determines the saturation estimate. Our approach utilizes waveform analysis in contrast to the standard algorithms that are based on the successful detection of peaks and troughs in the signal. The proposed algorithm is numerically efficient and has stable characteristics with a reduced false alarm rate with a small loss in detection. The method can be rapidly developed on a digital signal processing platform.
Directory of Open Access Journals (Sweden)
Lukas Falat
2016-01-01
Full Text Available This paper deals with application of quantitative soft computing prediction models into financial area as reliable and accurate prediction models can be very helpful in management decision-making process. The authors suggest a new hybrid neural network which is a combination of the standard RBF neural network, a genetic algorithm, and a moving average. The moving average is supposed to enhance the outputs of the network using the error part of the original neural network. Authors test the suggested model on high-frequency time series data of USD/CAD and examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, they perform a comparative statistical out-of-sample analysis of the tested model with autoregressive models and the standard neural network. They also incorporate genetic algorithm as an optimizing technique for adapting parameters of ANN which is then compared with standard backpropagation and backpropagation combined with K-means clustering algorithm. Finally, the authors find out that their suggested hybrid neural network is able to produce more accurate forecasts than the standard models and can be helpful in eliminating the risk of making the bad decision in decision-making process.
Development of Water Rating Curve in Shatt Al-Arab River
Directory of Open Access Journals (Sweden)
Zuhal A. Al-Hadi
2016-12-01
Full Text Available This study investigates the abilities of artificial neural networks (ANN to improve the accuracy of stream flow-water rating curve in Shatt Al-Arab River. Development of stage-discharge relationships for the daily stream flow to Shatt Al-Arab is a challenging task. In this study, the hydrological data was used as a tool for the identification of critical (information segments in a river, to covers all study area in Shatt Al-Arab over a period of seven years started from January /2009 to January/2015from water resources office in Basra Province. Data from different gauging sites were used to compare the performance of ANN trained on the whole data set. The neural network toolbox available in MATLAB was used to develop several ANN models. Five layers feed- forward network with Log-sigmoid transfer function was used. The networks were trained using Levenberg-Marquradt (LM back-propagation The Levenberg-Marquradt (LM back-propagation was found to be the best ANN model with minimum Mean Squared Error (MSE and maximum correlation coefficient (R 0.9, and MSE 1.05*10-7, respectively. The optimum neuron number in the two hidden layers of (LM was 8 neurons with R greater than 0.9, and MSE 1.05*10-7, respectively.
Earthquake-induced landslide-susceptibility mapping using an artificial neural network
Directory of Open Access Journals (Sweden)
S. Lee
2006-01-01
Full Text Available The purpose of this study was to apply and verify landslide-susceptibility analysis techniques using an artificial neural network and a Geographic Information System (GIS applied to Baguio City, Philippines. The 16 July 1990 earthquake-induced landslides were studied. Landslide locations were identified from interpretation of aerial photographs and field survey, and a spatial database was constructed from topographic maps, geology, land cover and terrain mapping units. Factors that influence landslide occurrence, such as slope, aspect, curvature and distance from drainage were calculated from the topographic database. Lithology and distance from faults were derived from the geology database. Land cover was identified from the topographic database. Terrain map units were interpreted from aerial photographs. These factors were used with an artificial neural network to analyze landslide susceptibility. Each factor weight was determined by a back-propagation exercise. Landslide-susceptibility indices were calculated using the back-propagation weights, and susceptibility maps were constructed from GIS data. The susceptibility map was compared with known landslide locations and verified. The demonstrated prediction accuracy was 93.20%.
Optimizing the De-Noise Neural Network Model for GPS Time-Series Monitoring of Structures
Directory of Open Access Journals (Sweden)
Mosbeh R. Kaloop
2015-09-01
Full Text Available The Global Positioning System (GPS is recently used widely in structures and other applications. Notwithstanding, the GPS accuracy still suffers from the errors afflicting the measurements, particularly the short-period displacement of structural components. Previously, the multi filter method is utilized to remove the displacement errors. This paper aims at using a novel application for the neural network prediction models to improve the GPS monitoring time series data. Four prediction models for the learning algorithms are applied and used with neural network solutions: back-propagation, Cascade-forward back-propagation, adaptive filter and extended Kalman filter, to estimate which model can be recommended. The noise simulation and bridge’s short-period GPS of the monitoring displacement component of one Hz sampling frequency are used to validate the four models and the previous method. The results show that the Adaptive neural networks filter is suggested for de-noising the observations, specifically for the GPS displacement components of structures. Also, this model is expected to have significant influence on the design of structures in the low frequency responses and measurements’ contents.
Detection and location of pipe damage by artificial-neural-net-processed moire error maps
Grossman, Barry G.; Gonzalez, Frank S.; Blatt, Joel H.; Cahall, Scott C.
1993-05-01
A novel automated inspection technique to recognize, locate, and quantify damage is developed. This technique is based on two already existing technologies: video moire metrology and artificial neural networks. Contour maps generated by video moire techniques provide an accurate description of surface structure that can then be automated by means of neutral networks. Artificial neural networks offer an attractive solution to the automated interpretation problem because they can generalize from the learned samples and provide an intelligent response for similar patterns having missing or noisy data. Two dimensional video moire images of pipes with dents of different depths, at several rotations, were used to train a multilayer feedforward neural network by the backpropagation algorithm. The backpropagation network is trained to recognize and classify the video moire images according to the dent's depth. Once trained, the network outputs give an indication of the probability that a dent has been found, a depth estimate, and the axial location of the center of the dent. This inspection technique has been demonstrated to be a powerful tool for the automatic location and quantification of structural damage, as illustrated using dented pipes.
Belciug, Smaranda; Gorunescu, Florin
2014-12-01
Automated medical diagnosis models are now ubiquitous, and research for developing new ones is constantly growing. They play an important role in medical decision-making, helping physicians to provide a fast and accurate diagnosis. Due to their adaptive learning and nonlinear mapping properties, the artificial neural networks are widely used to support the human decision capabilities, avoiding variability in practice and errors based on lack of experience. Among the most common learning approaches, one can mention either the classical back-propagation algorithm based on the partial derivatives of the error function with respect to the weights, or the Bayesian learning method based on posterior probability distribution of weights, given training data. This paper proposes a novel training technique gathering together the error-correction learning, the posterior probability distribution of weights given the error function, and the Goodman-Kruskal Gamma rank correlation to assembly them in a Bayesian learning strategy. This study had two main purposes; firstly, to develop anovel learning technique based on both the Bayesian paradigm and the error back-propagation, and secondly,to assess its effectiveness. The proposed model performance is compared with those obtained by traditional machine learning algorithms using real-life breast and lung cancer, diabetes, and heart attack medical databases. Overall, the statistical comparison results indicate that thenovellearning approach outperforms the conventional techniques in almost all respects. Copyright © 2014 Elsevier Inc. All rights reserved.
Novel maximum-margin training algorithms for supervised neural networks.
Ludwig, Oswaldo; Nunes, Urbano
2010-06-01
This paper proposes three novel training methods, two of them based on the backpropagation approach and a third one based on information theory for multilayer perceptron (MLP) binary classifiers. Both backpropagation methods are based on the maximal-margin (MM) principle. The first one, based on the gradient descent with adaptive learning rate algorithm (GDX) and named maximum-margin GDX (MMGDX), directly increases the margin of the MLP output-layer hyperplane. The proposed method jointly optimizes both MLP layers in a single process, backpropagating the gradient of an MM-based objective function, through the output and hidden layers, in order to create a hidden-layer space that enables a higher margin for the output-layer hyperplane, avoiding the testing of many arbitrary kernels, as occurs in case of support vector machine (SVM) training. The proposed MM-based objective function aims to stretch out the margin to its limit. An objective function based on Lp-norm is also proposed in order to take into account the idea of support vectors, however, overcoming the complexity involved in solving a constrained optimization problem, usually in SVM training. In fact, all the training methods proposed in this paper have time and space complexities O(N) while usual SVM training methods have time complexity O(N (3)) and space complexity O(N (2)) , where N is the training-data-set size. The second approach, named minimization of interclass interference (MICI), has an objective function inspired on the Fisher discriminant analysis. Such algorithm aims to create an MLP hidden output where the patterns have a desirable statistical distribution. In both training methods, the maximum area under ROC curve (AUC) is applied as stop criterion. The third approach offers a robust training framework able to take the best of each proposed training method. The main idea is to compose a neural model by using neurons extracted from three other neural networks, each one previously trained by
Directory of Open Access Journals (Sweden)
Lanyue Zhang
2016-01-01
Full Text Available Feature extraction method using Mel frequency cepstrum coefficients (MFCC based on acoustic vector sensor is researched in the paper. Signals of pressure are simulated as well as particle velocity of underwater target, and the features of underwater target using MFCC are extracted to verify the feasibility of the method. The experiment of feature extraction of two kinds of underwater targets is carried out, and these underwater targets are classified and recognized by Backpropagation (BP neural network using fusion of multi-information. Results of the research show that MFCC, first-order differential MFCC, and second-order differential MFCC features could be used as effective features to recognize those underwater targets and the recognition rate, which using the particle velocity signal is higher than that using the pressure signal, could be improved by using fusion features.
Directory of Open Access Journals (Sweden)
Dimililer Kamil
2018-01-01
Full Text Available Pests are divided into two as herbal and animal pests in agriculture, and detection and use of minimum pesticides are quite challenging task. Last three decades, researchers have been improving their studies on these manners. Therefore, effective, efficient, and as well as intelligent systems are designed and modelled. In this paper, an intelligent classification system is designed for detecting pests as herbal or animal to use of proper pesticides accordingly. The designed system suggests two main stages. Firstly, images are processed using different image processing techniques that images have specific distinguishing geometric patterns. The second stage is neural network phase for classification. A backpropagation neural network is used for training and testing with processed images. System is tested, and experiment results show efficiency and effective classification rate. Autonomy and time efficiency within the pesticide usage are also discussed.
Directory of Open Access Journals (Sweden)
Herlina ABDUL RAHIM
2010-10-01
Full Text Available Both high nutrition and good tasting are the crucial factors of good agriculture product. Therefore, nondestructive measurement and prediction of fruit internal quality are an area that both technology and market section concern about. The objectives of this study were to evaluate the use of visible and near infrared (VIS-NIR (380-1000 nm spectroscopy for soluble solid content (SSC prediction of apple; and to establish the relationship between the VIS-NIR reflectance spectra and the SSC of apples The reference SSC of apples was measured by using traditional destructive method. An artificial neural network with feedforward back-propagation (ANN-FFBP was used to build the predictive model in this study. The ANN predictive model indicated good performance of SSC prediction with mean square error (MSE of 0.1893 and a correlation coefficient (r of 0.9668.
Adaptive online state-of-charge determination based on neuro-controller and neural network
Energy Technology Data Exchange (ETDEWEB)
Shen Yanqing, E-mail: network_hawk@126.co [Department of Automation, Chongqing Industry Polytechnic College, Jiulongpo District, Chongqing 400050 (China)
2010-05-15
This paper presents a novel approach using adaptive artificial neural network based model and neuro-controller for online cell State of Charge (SOC) determination. Taking cell SOC as model's predictive control input unit, radial basis function neural network, which can adjust its structure to prediction error with recursive least square algorithm, is used to simulate battery system. Besides that, neuro-controller based on Back-Propagation Neural Network (BPNN) and modified PID controller is used to decide the control input of battery system, i.e., cell SOC. Finally this algorithm is applied for the SOC determination of lead-acid batteries, and results of lab tests on physical cells, compared with model prediction, are presented. Results show that the ANN based battery system model adaptively simulates battery system with great accuracy, and the predicted SOC simultaneously converges to the real value quickly within the error of +-1 as time goes on.
Lu, Chunhong; Zhu, Zhaomin; Gu, Xiaofeng
2014-09-01
In this paper, we develop a novel feature selection algorithm based on the genetic algorithm (GA) using a specifically devised trace-based separability criterion. According to the scores of class separability and variable separability, this criterion measures the significance of feature subset, independent of any specific classification. In addition, a mutual information matrix between variables is used as features for classification, and no prior knowledge about the cardinality of feature subset is required. Experiments are performed by using a standard lung cancer dataset. The obtained solutions are verified with three different classifiers, including the support vector machine (SVM), the back-propagation neural network (BPNN), and the K-nearest neighbor (KNN), and compared with those obtained by the whole feature set, the F-score and the correlation-based feature selection methods. The comparison results show that the proposed intelligent system has a good diagnosis performance and can be used as a promising tool for lung cancer diagnosis.
Directory of Open Access Journals (Sweden)
Sen Tian
2014-01-01
Full Text Available With the development of mine industry, tailings storage facility (TSF, as the important facility of mining, has attracted increasing attention for its safety problems. However, the problems of low accuracy and slow operation rate often occur in current TSF safety evaluation models. This paper establishes a reasonable TSF safety evaluation index system and puts forward a new TSF safety evaluation model by combining the theories for the analytic hierarchy process (AHP and improved back-propagation (BP neural network algorithm. The varying proportions of cross validation were calculated, demonstrating that this method has better evaluation performance with higher learning efficiency and faster convergence speed and avoids the oscillation in the training process in traditional BP neural network method and other primary neural network methods. The entire analysis shows the combination of the two methods increases the accuracy and reliability of the safety evaluation, and it can be well applied in the TSF safety evaluation.
The nuclear fuel rod character recognition system based on neural network technique
International Nuclear Information System (INIS)
Kim, Woong-Ki; Park, Soon-Yong; Lee, Yong-Bum; Kim, Seung-Ho; Lee, Jong-Min; Chien, Sung-Il.
1994-01-01
The nuclear fuel rods should be discriminated and managed systematically by numeric characters which are printed at the end part of each rod in the process of producing fuel assembly. The characters are used to examine manufacturing process of the fuel rods in the inspection process of irradiated fuel rod. Therefore automatic character recognition is one of the most important technologies to establish automatic manufacturing process of fuel assembly. In the developed character recognition system, mesh feature set extracted from each character written in the fuel rod is employed to train a neural network based on back-propagation algorithm as a classifier for character recognition system. Performance evaluation has been achieved on a test set which is not included in a training character set. (author)
Energy Technology Data Exchange (ETDEWEB)
Junghui Chen; Kuan-Po Wang [Chung-Yuan Christian University (China). Dept. of Chemical Engineering; Ming-Tsai Liang [I-Shou University (China). Dept. of Chemical Engineering
2005-06-01
An overlapped type of local neural network is proposed to improve accuracy of the heat transfer coefficient estimation of the supercritical carbon dioxide. The idea of this work is to use the network to estimate the heat transfer coefficient for which there is no accurate correlation model due to the complexity of the thermo-physical properties involved around the critical region. Unlike the global approximation network (e.g. backpropagation network) and the local approximation network (e.g. the radial basis function network), the proposed network allows us to match the quick changes in the near-critical local region where the rate of heat transfer is significantly increased and to construct the global smooth perspective far away from that local region. Based on the experimental data for carbon dioxide flowing inside a heated tube at the supercritical condition, the proposed network significantly outperformed some the conventional correlation method and the traditional network models. (Author)
A Novel Machine Vision System for the Inspection of Micro-Spray Nozzle
Directory of Open Access Journals (Sweden)
Kuo-Yi Huang
2015-06-01
Full Text Available In this study, we present an application of neural network and image processing techniques for detecting the defects of an internal micro-spray nozzle. The defect regions were segmented by Canny edge detection, a randomized algorithm for detecting circles and a circle inspection (CI algorithm. The gray level co-occurrence matrix (GLCM was further used to evaluate the texture features of the segmented region. These texture features (contrast, entropy, energy, color features (mean and variance of gray level and geometric features (distance variance, mean diameter and diameter ratio were used in the classification procedures. A back-propagation neural network classifier was employed to detect the defects of micro-spray nozzles. The methodology presented herein effectively works for detecting micro-spray nozzle defects to an accuracy of 90.71%.
Directory of Open Access Journals (Sweden)
Hongping Hu
2017-01-01
Full Text Available Gravitational Search Algorithm (GSA is a widely used metaheuristic algorithm. Although fewer parameters in GSA were adjusted, GSA has a slow convergence rate. In this paper, we change the constant acceleration coefficients to be the exponential function on the basis of combination of GSA and PSO (PSO-GSA and propose an improved PSO-GSA algorithm (written as I-PSO-GSA for solving two kinds of classifications: surface water quality and the moving direction of robots. I-PSO-GSA is employed to optimize weights and biases of backpropagation (BP neural network. The experimental results show that, being compared with combination of PSO and GSA (PSO-GSA, single PSO, and single GSA for optimizing the parameters of BP neural network, I-PSO-GSA outperforms PSO-GSA, PSO, and GSA and has better classification accuracy for these two actual problems.
Directory of Open Access Journals (Sweden)
Héliton Pandorfi
2016-06-01
Full Text Available ABSTRACT This study aimed to investigate the applicability of artificial neural networks (ANNs in the prediction of evapotranspiration of sweet pepper cultivated in a greenhouse. The used data encompass the second crop cycle, from September 2013 to February 2014, constituting 135 days of daily meteorological data, referring to the following variables: temperature and relative air humidity, wind speed and solar radiation (input variables, as well as evapotranspiration (output variable, determined using data obtained by load-cell weighing lysimeter. The recorded data were divided into three sets for training, testing and validation. The ANN learning model recognized the evapotranspiration patterns with acceptable accuracy, with mean square error of 0.005, in comparison to the data recorded in the lysimeter, with coefficient of determination of 0.87, demonstrating the best approximation for the 4-21-1 network architecture, with multilayers, error back-propagation learning algorithm and learning rate of 0.01.
Neo-Fuzzy Encoder and Its Adaptive Learning for Big Data Processing
Directory of Open Access Journals (Sweden)
Bodyanskiy Yevgeniy
2017-12-01
Full Text Available In the paper a two-layer encoder is proposed. The nodes of encoder under consideration are neo-fuzzy neurons, which are characterised by high speed of learning process and effective approximation properties. The proposed architecture of neo-fuzzy encoder has a two-layer bottle neck” structure and its learning algorithm is based on error backpropagation. The learning algorithm is characterised by a high rate of convergence because the output signals of encoder’s nodes (neo-fuzzy neurons are linearly dependent on the tuning parameters. The proposed learning algorithm can tune both the synaptic weights and centres of membership functions. Thus, in the paper the hybrid neo-fuzzy system-encoder is proposed that has essential advantages over conventional neurocompressors.
The Sustainable Development Assessment of Reservoir Resettlement Based on a BP Neural Network.
Huang, Li; Huang, Jian; Wang, Wei
2018-01-18
Resettlement affects not only the resettlers' production activities and life but also, directly or indirectly, the normal operation of power stations, the sustainable development of the resettlers, and regional social stability. Therefore, a scientific evaluation index system for the sustainable development of reservoir resettlement must be established that fits Chinese national conditions and not only promotes reservoir resettlement research but also improves resettlement practice. This essay builds an evaluation index system for resettlers' sustainable development based on a back-propagation (BP) neural network, which can be adopted in China, taking the resettlement necessitated by step hydropower stations along the Wujiang River cascade as an example. The assessment results show that the resettlement caused by step power stations along the Wujiang River is sustainable, and this evaluation supports the conclusion that national policies and regulations, which are undergoing constant improvement, and resettlement has increasingly improved. The results provide a reference for hydropower reservoir resettlement in developing countries.
Fei, Haiping; Zhu, Rong; Zhou, Zhaoying; Wang, Jindong
2007-08-01
Air speed, the angle of attack and the angle of sideslip are fundamental parameters in the control of flying bodies. Conventional detection techniques use sensors that may protrude outside the aircraft and be too bulky and intrusive for small unmanned air vehicles and micro air vehicles. In this paper, a novel and practical methodology by which the flight parameters are inferred from multiple hot-film flow speed sensors mounted on the surface of the wing is presented. In order to get a good mathematical relation between the readings of the sensors and the flight parameters, we use a back-propagation neural network to model the relationship. The methodology is validated by wind tunnel experiments, and the experimental results are presented.
Effect of the size of an artificial neural network used as pattern identifier
Energy Technology Data Exchange (ETDEWEB)
Reynoso V, M.R.; Vega C, J.J. [ININ, 52045 Ocoyoacac, Estado de Mexico (Mexico)
2003-07-01
A novel way to extract relevant parameters associated with the outgoing ions from nuclear reactions, obtained by digitizing the signals provided by a Bragg curve spectrometer (BCS) is presented. This allowed the implementation of a more thorough pulse-shape analysis. Due to the complexity of this task, it was required to take advantage of new and more powerful computational paradigms. This was fulfilled using a back-propagation artificial neural network (ANN) as a pattern identifier. Over training of ANNs is a common problem during the training stage. In the performance of the ANN there is a compromise between its size and the size of the training set. Here, this effect will be illustrated in relation to the problem of Bragg Curve (BC) identification. (Author)
Redes neurais aplicadas na redução de ruído impulsivo de imagens digitais
Directory of Open Access Journals (Sweden)
Pablo Luiz Braga Soares
2013-05-01
Full Text Available Um novo método para detecção e remoção de ruído impulsivo, baseado na junção combinada de duas Redes Neurais Artificiais (RNA, é proposto. O algoritmo de treinamento das RNA baseia-se na técnica da retropropagação do erro (algoritmo backpropagation. A primeira RNA é utilizada para detecção do ruído, conhecido como sal e pimenta e a segunda RNA é utilizada para remoção deste ruído. A técnica consiste na detecção do pixel ruidoso e substituição do mesmo por um valor estimado pela RNA. Os resultados obtidos são comparados com resultados da literatura para validação da técnica proposta.
Directory of Open Access Journals (Sweden)
Ovidiu TURCOANE
2014-01-01
Full Text Available This paper introduces some technologies that are fit for an architecture of digital democracy or E-democracy. It aims at proposing an architectural style emerged from tested and validated approaches, without relying on some radical innovation. Firstly, we propose an input-system-output model of E-democracy and knowledge society. This model is subject to permanent optimization following a trial and error paradigm similar to the artificial intelligence method of backpropagation. Secondly, we describe and advocate for some technologies and methodologies such as Cloud, Service-Oriented Architecture, Agile Development, Web-Oriented Architecture, Semantic Web and Linked Data. Finally, we assemble all these technologies and methodologies in an architectural style that follows several key concepts such as flexibility and adapability, citizen-oriented software development or abstract notions like participation, deliberation and inclusion.
Bidding strategy based on artificial intelligence for a competitive electric market
Energy Technology Data Exchange (ETDEWEB)
Hong, Y.-Y.; Tsai, S.-W.; Weng, M.-T. [Chung Yuan Univ., Dept. of Electrical Engineering, Chung Li (China)
2001-03-01
A bidding strategy using a fuzzy-c-mean (FCM) algorithm and the artificial neural network (ANN) was developed for competitive electric markets. The nodal price information was assumed to be released into the market. The FCM was used, first, to classify the daily load pattern into peak, medium-peak and off-peak levels and, secondly, to classify the competitive generation companies (gencos) into less-menacing, possible-menacing and menacing gencos. The back-propagation ANN was used for determining the bidding price for a genco. The FCM results aided in lessening the training data and reducing the ANN input nodes. The IEEE 30-busbar system was used for illustrating the applicability of the proposed method. (Author)
Real-time electricity pricing in a deregulated environment using artificial intelligence
Energy Technology Data Exchange (ETDEWEB)
Dondo, M.G.
1998-12-31
The challenge of implementing real-time pricing of electricity was discussed. Several electric utilities want to incorporate real-time pricing into their rate policies. Conventional programming methods are not fast enough to process and distribute information in real time. Therefore, a new method that would match the current advances in communication speeds is needed. Also, conventional programming methods do not incorporate the uncertainties that are inherent in the lives of humans. Therefore, it is necessary to incorporate this fuzziness into the model. This study showed that the elements of speed and uncertainties can be readily incorporated into the determination of spot-pricing based electricity rates. A unique computational intelligence model was designed which consists of a feedforward neural network based on back-propagation training and a fuzzy logic model. The work has been demonstrated on the IEEE test systems and the Nova Scotia Power Corporation`s system.
An enhanced radial basis function network for short-term electricity price forecasting
International Nuclear Information System (INIS)
Lin, Whei-Min; Gow, Hong-Jey; Tsai, Ming-Tang
2010-01-01
This paper proposed a price forecasting system for electric market participants to reduce the risk of price volatility. Combining the Radial Basis Function Network (RBFN) and Orthogonal Experimental Design (OED), an Enhanced Radial Basis Function Network (ERBFN) has been proposed for the solving process. The Locational Marginal Price (LMP), system load, transmission flow and temperature of the PJM system were collected and the data clusters were embedded in the Excel Database according to the year, season, workday and weekend. With the OED applied to learning rates in the ERBFN, the forecasting error can be reduced during the training process to improve both accuracy and reliability. This would mean that even the ''spikes'' could be tracked closely. The Back-propagation Neural Network (BPN), Probability Neural Network (PNN), other algorithms, and the proposed ERBFN were all developed and compared to check the performance. Simulation results demonstrated the effectiveness of the proposed ERBFN to provide quality information in a price volatile environment. (author)
Afdala, Adfal; Nuryani, Nuryani; Satrio Nugroho, Anto
2017-01-01
Atrial fibrillation (AF) is a disorder of the heart with fairly high mortality in adults. AF is a common heart arrythmia which is characterized by a missing or irregular contraction of atria. Therefore, finding a method to detect atrial fibrillation is necessary. In this article a system to detect atrial fibrillation has been proposed. Detection system utilized backpropagation artifical neural network. Data input in this method includes power spectrum density of R-peaks interval of electrocardiogram which is selected by wrapping method. This research uses parameter learning rate, momentum, epoch and hidden layer. System produces good performance with accuracy, sensitivity, and specificity of 83.55%, 86.72 % and 81.47 %, respectively.
Tseng, Y H; Hwang, J N; Sheehan, F H
1997-01-01
3D object recognition under partial object viewing is a difficult pattern recognition task. In this paper, we introduce a neural-network solution that is robust to partial viewing of objects and noise corruption. This method directly utilizes the acquired 3D data and requires no feature extraction. The object is first parametrically represented by a continuous distance transform neural network (CDTNN) trained by the surface points of the exemplar object. The CDTNN maps any 3D coordinate into a value that corresponds to the distance between the point and the nearest surface point of the object. Therefore, a mismatch between the exemplar object and an unknown object can be easily computed. When encountered with deformed objects, this mismatch information can be backpropagated through the CDTNN to iteratively determine the deformation in terms of affine transform. Application to 3D heart contour delineation and invariant recognition of 3D rigid-body objects is presented.
One-Class Classification with Extreme Learning Machine
Directory of Open Access Journals (Sweden)
Qian Leng
2015-01-01
Full Text Available One-class classification problem has been investigated thoroughly for past decades. Among one of the most effective neural network approaches for one-class classification, autoencoder has been successfully applied for many applications. However, this classifier relies on traditional learning algorithms such as backpropagation to train the network, which is quite time-consuming. To tackle the slow learning speed in autoencoder neural network, we propose a simple and efficient one-class classifier based on extreme learning machine (ELM. The essence of ELM is that the hidden layer need not be tuned and the output weights can be analytically determined, which leads to much faster learning speed. The experimental evaluation conducted on several real-world benchmarks shows that the ELM based one-class classifier can learn hundreds of times faster than autoencoder and it is competitive over a variety of one-class classification methods.
Directory of Open Access Journals (Sweden)
Fengtao Wang
2018-01-01
Full Text Available Rotating machinery vibration signals are nonstationary and nonlinear under complicated operating conditions. It is meaningful to extract optimal features from raw signal and provide accurate fault diagnosis results. In order to resolve the nonlinear problem, an enhancement deep feature extraction method based on Gaussian radial basis kernel function and autoencoder (AE is proposed. Firstly, kernel function is employed to enhance the feature learning capability, and a new AE is designed termed kernel AE (KAE. Subsequently, a deep neural network is constructed with one KAE and multiple AEs to extract inherent features layer by layer. Finally, softmax is adopted as the classifier to accurately identify different bearing faults, and error backpropagation algorithm is used to fine-tune the model parameters. Aircraft engine intershaft bearing vibration data are used to verify the method. The results confirm that the proposed method has a better feature extraction capability, requires fewer iterations, and has a higher accuracy than standard methods using a stacked AE.
An Artificial Neural Network Modeling for Force Control System of a Robotic Pruning Machine
Directory of Open Access Journals (Sweden)
Ali Hashemi
2014-06-01
Full Text Available Nowadays, there has been an increasing application of pruning robots for planted forests due to the growing concern on the efficiency and safety issues. Power consumption and working time of agricultural machines have become important issues due to the high value of energy in modern world. In this study, different multi-layer back-propagation networks were utilized for mapping the complex and highly interactive of pruning process parameters and to predict power consumption and cutting time of a force control equipped robotic pruning machine by knowing input parameters such as: rotation speed, stalk diameter, and sensitivity coefficient. Results showed significant effects of all input parameters on output parameters except rotational speed on cutting time. Therefore, for reducing the wear of cutting system, a less rotational speed in every sensitivity coefficient should be selected.
Modeling of wear behavior of Al/B{sub 4}C composites produced by powder metallurgy
Energy Technology Data Exchange (ETDEWEB)
Sahin, Ismail; Bektas, Asli [Gazi Univ., Ankara (Turkey). Dept. of Industrial Design Engineering; Guel, Ferhat; Cinci, Hanifi [Gazi Univ., Ankara (Turkey). Dept. of Materials and Metallurgy Engineering
2017-06-01
Wear characteristics of composites, Al matrix reinforced with B{sub 4}C particles percentages of 5, 10,15 and 20 produced by the powder metallurgy method were studied in this study. For this purpose, a mixture of Al and B{sub 4}C powders were pressed under 650 MPa pressure and then sintered at 635 C. The analysis of hardness, density and microstructure was performed. The produced samples were worn using a pin-on-disk abrasion device under 10, 20 and 30 N load through 500, 800 and 1200 mesh SiC abrasive papers. The obtained wear values were implemented in an artificial neural network (ANN) model having three inputs and one output using feed forward backpropagation Levenberg-Marquardt algorithm. Thus, the optimum wear conditions and hardness values were determined.
Artificial neural network based approach to transmission lines protection
International Nuclear Information System (INIS)
Joorabian, M.
1999-05-01
The aim of this paper is to present and accurate fault detection technique for high speed distance protection using artificial neural networks. The feed-forward multi-layer neural network with the use of supervised learning and the common training rule of error back-propagation is chosen for this study. Information available locally at the relay point is passed to a neural network in order for an assessment of the fault location to be made. However in practice there is a large amount of information available, and a feature extraction process is required to reduce the dimensionality of the pattern vectors, whilst retaining important information that distinguishes the fault point. The choice of features is critical to the performance of the neural networks learning and operation. A significant feature in this paper is that an artificial neural network has been designed and tested to enhance the precision of the adaptive capabilities for distance protection
Inversion of a lateral log using neural networks
International Nuclear Information System (INIS)
Garcia, G.; Whitman, W.W.
1992-01-01
In this paper a technique using neural networks is demonstrated for the inversion of a lateral log. The lateral log is simulated by a finite difference method which in turn is used as an input to a backpropagation neural network. An initial guess earth model is generated from the neural network, which is then input to a Marquardt inversion. The neural network reacts to gross and subtle data features in actual logs and produces a response inferred from the knowledge stored in the network during a training process. The neural network inversion of lateral logs is tested on synthetic and field data. Tests using field data resulted in a final earth model whose simulated lateral is in good agreement with the actual log data
Advancing Profiling Sensors with a Wireless Approach
Galvis, Alex; Russomanno, David J.
2012-01-01
The notion of a profiling sensor was first realized by a Near-Infrared (N-IR) retro-reflective prototype consisting of a vertical column of wired sparse detectors. This paper extends that prior work and presents a wireless version of a profiling sensor as a collection of sensor nodes. The sensor incorporates wireless sensing elements, a distributed data collection and aggregation scheme, and an enhanced classification technique. In this novel approach, a base station pre-processes the data collected from the sensor nodes and performs data re-alignment. A back-propagation neural network was also developed for the wireless version of the N-IR profiling sensor that classifies objects into the broad categories of human, animal or vehicle with an accuracy of approximately 94%. These enhancements improve deployment options as compared with the first generation of wired profiling sensors, possibly increasing the application scenarios for such sensors, including intelligent fence applications. PMID:23443371
Hybrid intelligent control of PMSG wind generation system using pitch angle control with RBFN
Energy Technology Data Exchange (ETDEWEB)
Lin, Whei-Min; Hong, Chih-Ming [Department of Electrical Engineering, National Sun Yat-Sen University, Kaohsiung 804 (China); Ou, Ting-Chia; Chiu, Tai-Ming [Institute of Nuclear Energy Research, Atomic Energy Council, Taoyuan 325 (China)
2011-02-15
This paper presents the design of a fuzzy sliding mode loss-minimization control for the speed of a permanent magnet synchronous generator (PMSG) and a high-performance on-line training radial basis function network (RBFN) for the turbine pitch angle control. The back-propagation learning algorithm is used to regulate the RBFN controller. The PMSG speed uses maximum power point tracking below the rated speed, which corresponds to low and high wind speed, and the maximum energy can be captured from the wind. A sliding mode controller with an integral-operation switching surface is designed, in which a fuzzy inference mechanism is utilized to estimate the upper bound of uncertainties. Furthermore, the fuzzy inference mechanism with center adaptation is investigated to estimate the optimal bound of uncertainties. (author)
A neural network regulator for turbogenerators.
Wu, Q H; Hogg, B W; Irwin, G W
1992-01-01
A neural network (NN) based regulator for nonlinear, multivariable turbogenerator control is presented. A hierarchical architecture of an NN is proposed for regulator design, consisting of two subnetworks which are used for input-output (I-O) mapping and control, respectively, based on the back-propagation (BP) algorithm. The regulator has the flexibility for accepting more sensory information to cater to multi-input, multioutput systems. Its operation does not require a reference model or inverse system model and it can produce more acceptable control signals than are obtained by using sign of plant errors during training I-O mapping of turbogenerator systems using NNs has been investigated and the regulator has been implemented on a complex turbogenerator system model. Simulation results show satisfactory control performance and illustrate the potential of the NN regulator in comparison with an existing adaptive controller.
The Sustainable Development Assessment of Reservoir Resettlement Based on a BP Neural Network
Huang, Li; Huang, Jian
2018-01-01
Resettlement affects not only the resettlers’ production activities and life but also, directly or indirectly, the normal operation of power stations, the sustainable development of the resettlers, and regional social stability. Therefore, a scientific evaluation index system for the sustainable development of reservoir resettlement must be established that fits Chinese national conditions and not only promotes reservoir resettlement research but also improves resettlement practice. This essay builds an evaluation index system for resettlers’ sustainable development based on a back-propagation (BP) neural network, which can be adopted in China, taking the resettlement necessitated by step hydropower stations along the Wujiang River cascade as an example. The assessment results show that the resettlement caused by step power stations along the Wujiang River is sustainable, and this evaluation supports the conclusion that national policies and regulations, which are undergoing constant improvement, and resettlement has increasingly improved. The results provide a reference for hydropower reservoir resettlement in developing countries. PMID:29346305
HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems.
Kim, J; Kasabov, N
1999-11-01
This paper proposes an adaptive neuro-fuzzy system, HyFIS (Hybrid neural Fuzzy Inference System), for building and optimising fuzzy models. The proposed model introduces the learning power of neural networks to fuzzy logic systems and provides linguistic meaning to the connectionist architectures. Heuristic fuzzy logic rules and input-output fuzzy membership functions can be optimally tuned from training examples by a hybrid learning scheme comprised of two phases: rule generation phase from data; and rule tuning phase using error backpropagation learning scheme for a neural fuzzy system. To illustrate the performance and applicability of the proposed neuro-fuzzy hybrid model, extensive simulation studies of nonlinear complex dynamic systems are carried out. The proposed method can be applied to an on-line incremental adaptive learning for the prediction and control of nonlinear dynamical systems. Two benchmark case studies are used to demonstrate that the proposed HyFIS system is a superior neuro-fuzzy modelling technique.
Adaptive Functional-Based Neuro-Fuzzy-PID Incremental Controller Structure
Directory of Open Access Journals (Sweden)
Ashraf Ahmed Fahmy
2014-03-01
Full Text Available This paper presents an adaptive functional-based Neuro-fuzzy-PID incremental (NFPID controller structure that can be tuned either offline or online according to required controller performance. First, differential membership functions are used to represent the fuzzy membership functions of the input-output space of the three term controller. Second, controller rules are generated based on the discrete proportional, derivative, and integral function for the fuzzy space. Finally, a fully differentiable fuzzy neural network is constructed to represent the developed controller for either offline or online controller parameter adaptation. Two different adaptation methods are used for controller tuning, offline method based on controller transient performance cost function optimization using Bees Algorithm, and online method based on tracking error minimization using back-propagation with momentum algorithm. The proposed control system was tested to show the validity of the controller structure over a fixed PID controller gains to control SCARA type robot arm.
A new Multiple ANFIS model for classification of hemiplegic gait.
Yardimci, A; Asilkan, O
2014-01-01
Neuro-fuzzy system is a combination of neural network and fuzzy system in such a way that neural network learning algorithms, is used to determine parameters of the fuzzy system. This paper describes the application of multiple adaptive neuro-fuzzy inference system (MANFIS) model which has hybrid learning algorithm for classification of hemiplegic gait acceleration (HGA) signals. Decision making was performed in two stages: feature extraction using the wavelet transforms (WT) and the ANFIS trained with the backpropagation gradient descent method in combination with the least squares method. The performance of the ANFIS model was evaluated in terms of training performance and classification accuracies and the results confirmed that the proposed ANFIS model has potential in classifying the HGA signals.
Sea ice classification using fast learning neural networks
Dawson, M. S.; Fung, A. K.; Manry, M. T.
1992-01-01
A first learning neural network approach to the classification of sea ice is presented. The fast learning (FL) neural network and a multilayer perceptron (MLP) trained with backpropagation learning (BP network) were tested on simulated data sets based on the known dominant scattering characteristics of the target class. Four classes were used in the data simulation: open water, thick lossy saline ice, thin saline ice, and multiyear ice. The BP network was unable to consistently converge to less than 25 percent error while the FL method yielded an average error of approximately 1 percent on the first iteration of training. The fast learning method presented can significantly reduce the CPU time necessary to train a neural network as well as consistently yield higher classification accuracy than BP networks.
Directory of Open Access Journals (Sweden)
Tosun Erdi
2017-01-01
Full Text Available This study was aimed at estimating the variation of several engine control parameters within the rotational speed-load map, using regression analysis and artificial neural network techniques. Duration of injection, specific fuel consumption, exhaust gas at turbine inlet, and within the catalytic converter brick were chosen as the output parameters for the models, while engine speed and brake mean effective pressure were selected as independent variables for prediction. Measurements were performed on a turbocharged direct injection spark ignition engine fueled with gasoline. A three-layer feed-forward structure and back-propagation algorithm was used for training the artificial neural network. It was concluded that this technique is capable of predicting engine parameters with better accuracy than linear and non-linear regression techniques.
Modeling of wear behavior of Al/B4C composites produced by powder metallurgy
International Nuclear Information System (INIS)
Sahin, Ismail; Bektas, Asli; Guel, Ferhat; Cinci, Hanifi
2017-01-01
Wear characteristics of composites, Al matrix reinforced with B 4 C particles percentages of 5, 10,15 and 20 produced by the powder metallurgy method were studied in this study. For this purpose, a mixture of Al and B 4 C powders were pressed under 650 MPa pressure and then sintered at 635 C. The analysis of hardness, density and microstructure was performed. The produced samples were worn using a pin-on-disk abrasion device under 10, 20 and 30 N load through 500, 800 and 1200 mesh SiC abrasive papers. The obtained wear values were implemented in an artificial neural network (ANN) model having three inputs and one output using feed forward backpropagation Levenberg-Marquardt algorithm. Thus, the optimum wear conditions and hardness values were determined.
Intelligent visual recognition and classification of cork tiles with neural networks.
Georgieva, Antoniya; Jordanov, Ivan
2009-04-01
An intelligent machine vision system is investigated and used for pattern recognition and classification of seven different types of cork tiles. The system includes image acquisition with a charge-coupled device (CCD) camera, texture feature generation (co-occurrence matrices and Laws' masks), analysis and processing of the feature vectors [linear discriminant analysis (LDA) and principal component analysis (PCA)], and cork tiles classification with feedforward neural networks (NN), employing our GLP(tau) S (genetic low-discrepancy search) hybrid global optimization method. In addition, the same NN are trained with backpropagation (BP) and the obtained results are compared with the ones from GLP(tau) S . The NN generalization abilities are discussed and assessed with respect to the NN architectures and the texture feature sets. The reported results are very encouraging with testing rate reaching up to 95%.
Bar-Cohen, Yoseph (Inventor); Sherrit, Stewart (Inventor); Herz, Jack L. (Inventor)
2014-01-01
The invention provides a novel jackhammer that utilizes ultrasonic and/or sonic vibrations as source of power. It is easy to operate and does not require extensive training, requiring substantially less physical capabilities from the user and thereby increasing the pool of potential operators. An important safety benefit is that it does not fracture resilient or compliant materials such as cable channels and conduits, tubing, plumbing, cabling and other embedded fixtures that may be encountered along the impact path. While the ultrasonic/sonic jackhammer of the invention is able to cut concrete and asphalt, it generates little back-propagated shocks or vibrations onto the mounting fixture, and can be operated from an automatic platform or robotic system. PNEUMATICS; ULTRASONICS; IMPACTORS; DRILLING; HAMMERS BRITTLE MATERIALS; DRILL BITS; PROTOTYPES; VIBRATION
Performance emulation and parameter estimation for nonlinear fibre-optic links
DEFF Research Database (Denmark)
Piels, Molly; Porto da Silva, Edson; Zibar, Darko
2016-01-01
Fibre-optic communication systems, especially when operating in the nonlinear regime, generally do not perform exactly as theory would predict. A number of methods for data-based evaluation of nonlinear fibre-optic link parameters, both for accurate performance emulation and optimization, are rev......Fibre-optic communication systems, especially when operating in the nonlinear regime, generally do not perform exactly as theory would predict. A number of methods for data-based evaluation of nonlinear fibre-optic link parameters, both for accurate performance emulation and optimization......, are reviewed. In particular, single-step nonlinear impairment based on the Gaussian mixture model, adaptive digital backpropagation, and extension to higher-dimensional spaces using Monte Carlo Markov chains are discussed....
A Novel Machine Vision System for the Inspection of Micro-Spray Nozzle.
Huang, Kuo-Yi; Ye, Yu-Ting
2015-06-29
In this study, we present an application of neural network and image processing techniques for detecting the defects of an internal micro-spray nozzle. The defect regions were segmented by Canny edge detection, a randomized algorithm for detecting circles and a circle inspection (CI) algorithm. The gray level co-occurrence matrix (GLCM) was further used to evaluate the texture features of the segmented region. These texture features (contrast, entropy, energy), color features (mean and variance of gray level) and geometric features (distance variance, mean diameter and diameter ratio) were used in the classification procedures. A back-propagation neural network classifier was employed to detect the defects of micro-spray nozzles. The methodology presented herein effectively works for detecting micro-spray nozzle defects to an accuracy of 90.71%.
Research on artificial neural network applications for nuclear power plants
International Nuclear Information System (INIS)
Chang, Soon-Heung; Cheon, Se-Woo
1992-01-01
Artificial neural networks (ANNs) are an emerging computational technology which can significantly enhance a number of applications. These consist of many interconnected processing elements that exhibit human-like performance, i.e., learning, pattern recognition and associative memory skills. Several application studies on ANNs devoted to nuclear power plants have been carried out at the Korea Advanced Institute of Science and Technology since 1989. These studies include the feasibility of using ANNs for the following tasks: (1) thermal power prediction, (2) transient identification, (3) multiple alarm processing and diagnosis, (4) core thermal margin prediction, and (5) prediction of core parameters for fuel reloading. This paper introduces the back-propagation network (BPN) model which is the most commonly used algorithm, and summarizes each of the studies briefly. (author)
Optimization of Adaboost Algorithm for Sonar Target Detection in a Multi-Stage ATR System
Lin, Tsung Han (Hank)
2011-01-01
JPL has developed a multi-stage Automated Target Recognition (ATR) system to locate objects in images. First, input images are preprocessed and sent to a Grayscale Optical Correlator (GOC) filter to identify possible regions-of-interest (ROIs). Second, feature extraction operations are performed using Texton filters and Principal Component Analysis (PCA). Finally, the features are fed to a classifier, to identify ROIs that contain the targets. Previous work used the Feed-forward Back-propagation Neural Network for classification. In this project we investigate a version of Adaboost as a classifier for comparison. The version we used is known as GentleBoost. We used the boosted decision tree as the weak classifier. We have tested our ATR system against real-world sonar images using the Adaboost approach. Results indicate an improvement in performance over a single Neural Network design.
Directory of Open Access Journals (Sweden)
Yasir Hassan Ali
2015-01-01
Full Text Available The thickness of an oil film lubricant can contribute to less gear tooth wear and surface failure. The purpose of this research is to use artificial neural network (ANN computational modelling to correlate spur gear data from acoustic emissions, lubricant temperature, and specific film thickness (λ. The approach is using an algorithm to monitor the oil film thickness and to detect which lubrication regime the gearbox is running either hydrodynamic, elastohydrodynamic, or boundary. This monitoring can aid identification of fault development. Feed-forward and recurrent Elman neural network algorithms were used to develop ANN models, which are subjected to training, testing, and validation process. The Levenberg-Marquardt back-propagation algorithm was applied to reduce errors. Log-sigmoid and Purelin were identified as suitable transfer functions for hidden and output nodes. The methods used in this paper shows accurate predictions from ANN and the feed-forward network performance is superior to the Elman neural network.
Pattern recognition of clouds and ice in polar regions
Welch, R. M.; Sengupta, S. K.; Sundar, C. A.; Kuo, K. S.; Carsey, F. D.
1990-01-01
The study is based on AVHRR imagery and results from Landsat high-spatial-resolution scenes. Among the textual features investigated are the gray level difference vector (GLDV), and sum and difference histogram (SADH) approaches as well as gray level run length, spatial-coherence, and spectral-histogram measures. The traditional stepwise discriminant analysis and neural-network analysis are used for the identification of 20 Arctic surface and cloud classes. A principal-component analysis and hybrid architecture employing a modularized competitive learning layer are utilized. It is pointed out that the cloud-classification accuracy comparable to that of back-propagation could be achieved with a training time two orders of magnitude faster.
An Artificial Neural Network for Data Forecasting Purposes
Directory of Open Access Journals (Sweden)
Catalina Lucia COCIANU
2015-01-01
Full Text Available Considering the fact that markets are generally influenced by different external factors, the stock market prediction is one of the most difficult tasks of time series analysis. The research reported in this paper aims to investigate the potential of artificial neural networks (ANN in solving the forecast task in the most general case, when the time series are non-stationary. We used a feed-forward neural architecture: the nonlinear autoregressive network with exogenous inputs. The network training function used to update the weight and bias parameters corresponds to gradient descent with adaptive learning rate variant of the backpropagation algorithm. The results obtained using this technique are compared with the ones resulted from some ARIMA models. We used the mean square error (MSE measure to evaluate the performances of these two models. The comparative analysis leads to the conclusion that the proposed model can be successfully applied to forecast the financial data.
International Nuclear Information System (INIS)
Lin, Whei-Min; Hong, Chih-Ming; Cheng, Fu-Sheng
2011-01-01
This paper presents the design of an on-line training recurrent fuzzy neural network (RFNN) controller with a high-performance model reference adaptive system (MRAS) observer for the sensorless control of a induction generator (IG). The modified particle swarm optimization (MPSO) is adopted in this study to adapt the learning rates in the back-propagation process of the RFNN to improve the learning capability. By using the proposed RFNN controller with MPSO, the IG system can work for stand-alone power application effectively. The proposed output maximization control is achieved without mechanical sensors such as the wind speed or position sensor, and the new control system will deliver maximum electric power with light weight, high efficiency, and high reliability. The estimation of the rotor speed is based on the MRAS control theory. A sensorless vector-control strategy for an IG operating in a grid-connected variable speed wind energy conversion system can be achieved.
Directory of Open Access Journals (Sweden)
Eduardo Gabriel Côrtes
2016-07-01
Full Text Available Este trabalho propõe desenvolver uma aplicação para auxiliar no entendimento do significado de palavras ambíguas da língua portuguesa, que dependem necessariamente do contexto para serem identificadas. A aplicação foi implementada na linguagem de programação JAVA, utilizando a IDE NetBeans, juntamente com a ferramenta ADReNA, que permitiu modelar e treinar a rede neural artificial backpropagation. Foram desenvolvidas duas versões da aplicação, que se diferenciam pela forma que representam a camada de entrada da rede neural artificial. Testes realizados mostraram que a forma que a rede neural é representada gera influência em seus resultados. Após a realização dos testes, a aplicação se mostrou promissora no reconhecimento de significados de palavras homônimas.
Directory of Open Access Journals (Sweden)
Yuyang Gao
2016-09-01
Full Text Available With increasing importance being attached to big data mining, analysis, and forecasting in the field of wind energy, how to select an optimization model to improve the forecasting accuracy of the wind speed time series is not only an extremely challenging problem, but also a problem of concern for economic forecasting. The artificial intelligence model is widely used in forecasting and data processing, but the individual back-propagation artificial neural network cannot always satisfy the time series forecasting needs. Thus, a hybrid forecasting approach has been proposed in this study, which consists of data preprocessing, parameter optimization and a neural network for advancing the accuracy of short-term wind speed forecasting. According to the case study, in which the data are collected from Peng Lai, a city located in China, the simulation results indicate that the hybrid forecasting method yields better predictions compared to the individual BP, which indicates that the hybrid method exhibits stronger forecasting ability.
Hybrid intelligent control of PMSG wind generation system using pitch angle control with RBFN
International Nuclear Information System (INIS)
Lin, Whei-Min; Hong, Chih-Ming; Ou, Ting-Chia; Chiu, Tai-Ming
2011-01-01
This paper presents the design of a fuzzy sliding mode loss-minimization control for the speed of a permanent magnet synchronous generator (PMSG) and a high-performance on-line training radial basis function network (RBFN) for the turbine pitch angle control. The back-propagation learning algorithm is used to regulate the RBFN controller. The PMSG speed uses maximum power point tracking below the rated speed, which corresponds to low and high wind speed, and the maximum energy can be captured from the wind. A sliding mode controller with an integral-operation switching surface is designed, in which a fuzzy inference mechanism is utilized to estimate the upper bound of uncertainties. Furthermore, the fuzzy inference mechanism with center adaptation is investigated to estimate the optimal bound of uncertainties.
Learning to train neural networks for real-world control problems
Feldkamp, Lee A.; Puskorius, G. V.; Davis, L. I., Jr.; Yuan, F.
1994-01-01
Over the past three years, our group has concentrated on the application of neural network methods to the training of controllers for real-world systems. This presentation describes our approach, surveys what we have found to be important, mentions some contributions to the field, and shows some representative results. Topics discussed include: (1) executing model studies as rehearsal for experimental studies; (2) the importance of correct derivatives; (3) effective training with second-order (DEKF) methods; (4) the efficacy of time-lagged recurrent networks; (5) liberation from the tyranny of the control cycle using asynchronous truncated backpropagation through time; and (6) multistream training for robustness. Results from model studies of automotive idle speed control serve as examples for several of these topics.
Learning and optimization with cascaded VLSI neural network building-block chips
Duong, T.; Eberhardt, S. P.; Tran, M.; Daud, T.; Thakoor, A. P.
1992-01-01
To demonstrate the versatility of the building-block approach, two neural network applications were implemented on cascaded analog VLSI chips. Weights were implemented using 7-b multiplying digital-to-analog converter (MDAC) synapse circuits, with 31 x 32 and 32 x 32 synapses per chip. A novel learning algorithm compatible with analog VLSI was applied to the two-input parity problem. The algorithm combines dynamically evolving architecture with limited gradient-descent backpropagation for efficient and versatile supervised learning. To implement the learning algorithm in hardware, synapse circuits were paralleled for additional quantization levels. The hardware-in-the-loop learning system allocated 2-5 hidden neurons for parity problems. Also, a 7 x 7 assignment problem was mapped onto a cascaded 64-neuron fully connected feedback network. In 100 randomly selected problems, the network found optimal or good solutions in most cases, with settling times in the range of 7-100 microseconds.
DEFF Research Database (Denmark)
Bhowmik, Subrata; Weber, Felix; Høgsberg, Jan Becker
2013-01-01
This paper presents a systematic design and training procedure for the feed-forward backpropagation neural network (NN) modeling of both forward and inverse behavior of a rotary magnetorheological (MR) damper based on experimental data. For the forward damper model, with damper force as output...... an optimization procedure demonstrates accurate training of the NN architecture with only current and velocity as input states. For the inverse damper model, with current as output, the absolute value of velocity and force are used as input states to avoid negative current spikes when tracking a desired damper...... force. The forward and inverse damper models are trained and validated experimentally, combining a limited number of harmonic displacement records, and constant and half-sinusoidal current records. In general the validation shows accurate results for both forward and inverse damper models, where...
Directory of Open Access Journals (Sweden)
Redi Kharisman
2014-03-01
Full Text Available Sistem navigasi banyak digunakan sebagai pengenal objek dalam radius tertentu, penunjuk arah tujuan, penunjuk posisi objek berada dan sebagainya. Adakalanya sistem navigasi juga memiliki noise atau ketidakakuratan informasi dalam implementasinya sehingga membuat interpretasi terhadap posisi objek menjadi berbeda-beda pula. Dengan menganggap quadcopter sebagai suatu objek terbang dengan warna dominan, penentuan posisi dapat dilakukan proses pencitraan dengan prinsip Stereo Vision yang menggunakan dua buah kamera. Dengan kamera, proses pencitraan dapat dilakukan dengan mengetahui setiap perubahan posisi objek melalui titik tengah objek dengan proses trackingnya. Namun kamera memiliki noise yang dapat menyebabkan perubahan data yang cukup sering dalam setiap cuplikan datanya. Metode Backpropagation Neural Network digunakan sebagai estimator yang ditujukan agar dapat mengikuti pola data sekaligus juga memberikan posisi yang lebih akurat dengan mengeliminasi noise yang terdapat dalam pola data yang terekam. Sehingga dengan menggunakan metode tersebut, maka sebagian besar noise yang terjadi, tereliminasi dan grafik pergerakan lebih tampak nyata.
Intelligent navigation and accurate positioning of an assist robot in indoor environments
Hua, Bin; Rama, Endri; Capi, Genci; Jindai, Mitsuru; Tsuri, Yosuke
2017-12-01
Intact robot's navigation and accurate positioning in indoor environments are still challenging tasks. Especially in robot applications, assisting disabled and/or elderly people in museums/art gallery environments. In this paper, we present a human-like navigation method, where the neural networks control the wheelchair robot to reach the goal location safely, by imitating the supervisor's motions, and positioning in the intended location. In a museum similar environment, the mobile robot starts navigation from various positions, and uses a low-cost camera to track the target picture, and a laser range finder to make a safe navigation. Results show that the neural controller with the Conjugate Gradient Backpropagation training algorithm gives a robust response to guide the mobile robot accurately to the goal position.
Amani, Mohammad; Amani, Pouria; Kasaeian, Alibakhsh; Mahian, Omid; Pop, Ioan; Wongwises, Somchai
2017-12-12
This research investigates the applicability of an ANN and genetic algorithms for modeling and multiobjective optimization of the thermal conductivity and viscosity of water-based spinel-type MnFe 2 O 4 nanofluid. Levenberg-Marquardt, quasi-Newton, and resilient backpropagation methods are employed to train the ANN. The support vector machine (SVM) method is also presented for comparative purposes. Experimental results demonstrate the efficacy of the developed ANN with the LM-BR training algorithm and the 3-10-10-2 structure for the prediction of the thermophysical properties of nanofluids in terms of the significantly superior accuracy compared to developing the correlation and employing SVM regression. Moreover, the genetic algorithm is implemented to determine the optimal conditions, i.e., maximum thermal conductivity and minimum nanofluid viscosity, based on the developed ANN.
Yu, Jiajia; He, Yong
Mango is a kind of popular tropical fruit, and the soluble solid content is an important in this study visible and short-wave near-infrared spectroscopy (VIS/SWNIR) technique was applied. For sake of investigating the feasibility of using VIS/SWNIR spectroscopy to measure the soluble solid content in mango, and validating the performance of selected sensitive bands, for the calibration set was formed by 135 mango samples, while the remaining 45 mango samples for the prediction set. The combination of partial least squares and backpropagation artificial neural networks (PLS-BP) was used to calculate the prediction model based on raw spectrum data. Based on PLS-BP, the determination coefficient for prediction (Rp) was 0.757 and root mean square and the process is simple and easy to operate. Compared with the Partial least squares (PLS) result, the performance of PLS-BP is better.
Application of neural networks to signal prediction in nuclear power plant
International Nuclear Information System (INIS)
Wan Joo Kim; Soon Heung Chang; Byung Ho Lee
1993-01-01
This paper describes the feasibility study of an artificial neural network for signal prediction. The purpose of signal prediction is to estimate the value of undetected next time step signal. As the prediction method, based on the idea of auto regression, a few previous signals are inputs to the artificial neural network and the signal value of next time step is estimated with the outputs of the network. The artificial neural network can be applied to the nonlinear system and answers in short time. The training algorithm is a modified backpropagation model, which can effectively reduce the training time. The target signal of the simulation is the steam generator water level, which is one of the important parameters in nuclear power plants. The simulation result shows that the predicted value follows the real trend well
Butterfly Classification by HSI and RGB Color Models Using Neural Networks
Directory of Open Access Journals (Sweden)
Jorge E. Grajales-Múnera
2013-11-01
Full Text Available This study aims the classification of Butterfly species through the implementation of Neural Networks and Image Processing. A total of 9 species of Morpho genre which has blue as a characteristic color are processed. For Butterfly segmentation we used image processing tools such as: Binarization, edge processing and mathematical morphology. For data processing RGB values are obtained for every image which are converted to HSI color model to identify blue pixels and obtain the data to the proposed Neural Networks: Back-Propagation and Perceptron. For analysis and verification of results confusion matrix are built and analyzed with the results of neural networks with the lowest error levels. We obtain error levels close to 1% in classification of some Butterfly species.
Hysteretic recurrent neural networks: a tool for modeling hysteretic materials and systems
International Nuclear Information System (INIS)
Veeramani, Arun S; Crews, John H; Buckner, Gregory D
2009-01-01
This paper introduces a novel recurrent neural network, the hysteretic recurrent neural network (HRNN), that is ideally suited to modeling hysteretic materials and systems. This network incorporates a hysteretic neuron consisting of conjoined sigmoid activation functions. Although similar hysteretic neurons have been explored previously, the HRNN is unique in its utilization of simple recurrence to 'self-select' relevant activation functions. Furthermore, training is facilitated by placing the network weights on the output side, allowing standard backpropagation of error training algorithms to be used. We present two- and three-phase versions of the HRNN for modeling hysteretic materials with distinct phases. These models are experimentally validated using data collected from shape memory alloys and ferromagnetic materials. The results demonstrate the HRNN's ability to accurately generalize hysteretic behavior with a relatively small number of neurons. Additional benefits lie in the network's ability to identify statistical information concerning the macroscopic material by analyzing the weights of the individual neurons
Robust recurrent neural network modeling for software fault detection and correction prediction
International Nuclear Information System (INIS)
Hu, Q.P.; Xie, M.; Ng, S.H.; Levitin, G.
2007-01-01
Software fault detection and correction processes are related although different, and they should be studied together. A practical approach is to apply software reliability growth models to model fault detection, and fault correction process is assumed to be a delayed process. On the other hand, the artificial neural networks model, as a data-driven approach, tries to model these two processes together with no assumptions. Specifically, feedforward backpropagation networks have shown their advantages over analytical models in fault number predictions. In this paper, the following approach is explored. First, recurrent neural networks are applied to model these two processes together. Within this framework, a systematic networks configuration approach is developed with genetic algorithm according to the prediction performance. In order to provide robust predictions, an extra factor characterizing the dispersion of prediction repetitions is incorporated into the performance function. Comparisons with feedforward neural networks and analytical models are developed with respect to a real data set
Synthesis of recurrent neural networks for dynamical system simulation.
Trischler, Adam P; D'Eleuterio, Gabriele M T
2016-08-01
We review several of the most widely used techniques for training recurrent neural networks to approximate dynamical systems, then describe a novel algorithm for this task. The algorithm is based on an earlier theoretical result that guarantees the quality of the network approximation. We show that a feedforward neural network can be trained on the vector-field representation of a given dynamical system using backpropagation, then recast it as a recurrent network that replicates the original system's dynamics. After detailing this algorithm and its relation to earlier approaches, we present numerical examples that demonstrate its capabilities. One of the distinguishing features of our approach is that both the original dynamical systems and the recurrent networks that simulate them operate in continuous time. Copyright © 2016 Elsevier Ltd. All rights reserved.
International Nuclear Information System (INIS)
Seker, Serhat; Tuerkcan, Erdinc; Ayaz, Emine; Barutcu, Burak
2003-01-01
This paper addresses to the problem of utilisation of the artificial neural networks (ANNs) for detecting anomalies as well as physical parameters of a nuclear power plant during power operation in real time. Three different types of neural network algorithms were used namely, feed-forward neural network (back-propagation, BP) and two types of recurrent neural networks (RNN). The data used in this paper were gathered from the simulation of the power operation of the Japan's High Temperature Engineering Testing Reactor (HTTR). For the wide range of power operation, 56 signals were generated by the reactor dynamic simulation code for several hours of normal power operation at different power ramps between 30 and 100% nominal power. Paper will compare the outcomes of different neural networks and presents the neural network system and the determination of physical parameters from the simulated operating data
Hayashi, Hideaki; Shima, Keisuke; Shibanoki, Taro; Kurita, Yuichi; Tsuji, Toshio
2013-01-01
This paper outlines a probabilistic neural network developed on the basis of time-series discriminant component analysis (TSDCA) that can be used to classify high-dimensional time-series patterns. TSDCA involves the compression of high-dimensional time series into a lower-dimensional space using a set of orthogonal transformations and the calculation of posterior probabilities based on a continuous-density hidden Markov model that incorporates a Gaussian mixture model expressed in the reduced-dimensional space. The analysis can be incorporated into a neural network so that parameters can be obtained appropriately as network coefficients according to backpropagation-through-time-based training algorithm. The network is considered to enable high-accuracy classification of high-dimensional time-series patterns and to reduce the computation time taken for network training. In the experiments conducted during the study, the validity of the proposed network was demonstrated for EEG signals.
Using a multi-state recurrent neural network to optimize loading patterns in BWRs
International Nuclear Information System (INIS)
Ortiz, Juan Jose; Requena, Ignacio
2004-01-01
A Multi-State Recurrent Neural Network is used to optimize Loading Patterns (LP) in BWRs. We have proposed an energy function that depends on fuel assembly positions and their nuclear cross sections to carry out optimisation. Multi-State Recurrent Neural Networks creates LPs that satisfy the Radial Power Peaking Factor and maximize the effective multiplication factor at the Beginning of the Cycle, and also satisfy the Minimum Critical Power Ratio and Maximum Linear Heat Generation Rate at the End of the Cycle, thereby maximizing the effective multiplication factor. In order to evaluate the LPs, we have used a trained back-propagation neural network to predict the parameter values, instead of using a reactor core simulator, which saved considerable computation time in the search process. We applied this method to find optimal LPs for five cycles of Laguna Verde Nuclear Power Plant (LVNPP) in Mexico
Comparison of the Signal Processing Methodologies for a Leak Detection of the LMR Steam Generator
International Nuclear Information System (INIS)
Kim, Tae-Joon; Jeong, Ji-Young; Kim, Byung-Ho
2006-01-01
The successful protection of a water/steam into a sodium leak in the LMR SG at an early phase of a leak origin depends on the fast response and sensitivity of a leak detection system. The control time for the protection of the LMR SG is several seconds. Subject of this study is to introduce the detection performance of the acoustic leak detection system discriminated by a back-propagation neural network according to a preprocessing of the FFT power spectrum analysis and the Octave band analysis, and to introduce the status of the development of the acoustic leak detection at KAERI. It was used for the acoustic signals from the injected Argon gas into water experiments at KAERI, the acoustic signals injected from the water into the sodium obtained in IPPE, and the background noise of the PFR superheater
Energy Technology Data Exchange (ETDEWEB)
Huang, Jian; Hu, Xiaoguang; Geng, Xin [School of Automation Science and Electrical Engineering, Beijing University of Aeronautics and Astronautics, Beijing, 100191 (China)
2011-02-15
Targeting the characteristics of machinery vibration signals of high voltage circuit breaker (CB), a new method based on improved empirical mode decomposition (EMD) energy entropy and multi-class support vector machine (MSVM) to diagnose fault for high voltage CB is proposed. In the fault diagnosis for the high voltage CB, the feature extraction based on improved EMD energy entropy is detailedly analyzed. A new multi-layered classification of SVM named 'one against others' algorithm approach is proposed and applied to machinery fault diagnosis of high voltage CB. The extracted features are applied to MSVM for estimating fault type. Compared with back-propagation network (BPN), the test results of MSVM demonstrate that the applying of improved EMD energy entropy to vibration signals is superior to that based on wavelet packet analysis (WPT) and hence estimating fault type on machinery condition of high voltage CB accurately and quickly. (author)
Effect of a Background Noise on the Acoustic Leak Detection Methodology for a SFR Steam Generator
International Nuclear Information System (INIS)
Kim, Tae-Joon; Jeong, Ji-Young; Kim, Jong-Man
2007-01-01
The protection of a water/steam leak into a sodium in the SFR SG at an early phase of a leak origin depends on a fast response and sensitivity of a leak detection system not to a response against the several kinds of noises. The subject in this study is to introduce a detection performance by using our developed acoustic leak detection methodology discriminated by a backpropagation neural network according to a preprocessing of the 1/6 Octave band analysis or 1/12 Octave band analysis and the x n method defined by us. It was used for the acoustic signals generated from the simulation works which are the noises of an artificial background such as a scratching, a hammering on a steel structure and so on. In a previous study, we showed that the performance of a LabVIEW tool embedded with the developed acoustic leak detection methodology detected the SWR leak signals
Directory of Open Access Journals (Sweden)
A. K. CHOWDHURY
2016-02-01
Full Text Available In this paper an evolutionary technique for synthesizing Multi-Valued Logic (MVL functions using Neural Network Deployment Algorithm (NNDA is presented. The algorithm is combined with back-propagation learning capability and neural MVL operators. This research article is done to observe the anomalistic characteristics of MVL neural operators and their role in synthesis. The advantages of NNDA-MVL algorithm is demonstrated with realization of synthesized many valued functions with lesser MVL operators. The characteristic feature set consists of MVL gate count, network link count, network propagation delay and accuracy achieved in training. In brief, this paper depicts an effort of reduced network size for synthesized MVL functions. Trained MVL operators improve the basic architecture by reducing MIN gate and interlink connection by 52.94% and 23.38% respectively.
Speech Subvocal Signal Processing using Packet Wavelet and Neuronal Network
Directory of Open Access Journals (Sweden)
Luis E. Mendoza
2013-11-01
Full Text Available This paper presents the results obtained from the recording, processing and classification of words in the Spanish language by means of the analysis of subvocal speech signals. The processed database has six words (forward, backward, right, left, start and stop. In this work, the signals were sensed with surface electrodes placed on the surface of the throat and acquired with a sampling frequency of 50 kHz. The signal conditioning consisted in: the location of area of interest using energy analysis, and filtering using Discrete Wavelet Transform. Finally, the feature extraction was made in the time-frequency domain using Wavelet Packet and statistical techniques for windowing. The classification was carried out with a backpropagation neural network whose training was performed with 70% of the database obtained. The correct classification rate was 75%±2.
Yeh, Wei-Chang
2013-04-01
A new soft computing method called the parameter-free simplified swarm optimization (SSO)-based artificial neural network (ANN), or improved SSO for short, is proposed to adjust the weights in ANNs. The method is a modification of the SSO, and seeks to overcome some of the drawbacks of SSO. In the experiments, the iSSO is compared with five other famous soft computing methods, including the backpropagation algorithm, the genetic algorithm, the particle swarm optimization (PSO) algorithm, cooperative random learning PSO, and the SSO, and its performance is tested on five famous time-series benchmark data to adjust the weights of two ANN models (multilayer perceptron and single multiplicative neuron model). The experimental results demonstrate that iSSO is robust and more efficient than the other five algorithms.
Mazurowski, Maciej A; Habas, Piotr A; Zurada, Jacek M; Lo, Joseph Y; Baker, Jay A; Tourassi, Georgia D
2008-01-01
This study investigates the effect of class imbalance in training data when developing neural network classifiers for computer-aided medical diagnosis. The investigation is performed in the presence of other characteristics that are typical among medical data, namely small training sample size, large number of features, and correlations between features. Two methods of neural network training are explored: classical backpropagation (BP) and particle swarm optimization (PSO) with clinically relevant training criteria. An experimental study is performed using simulated data and the conclusions are further validated on real clinical data for breast cancer diagnosis. The results show that classifier performance deteriorates with even modest class imbalance in the training data. Further, it is shown that BP is generally preferable over PSO for imbalanced training data especially with small data sample and large number of features. Finally, it is shown that there is no clear preference between oversampling and no compensation approach and some guidance is provided regarding a proper selection.
Power plant fault detection using artificial neural network
Thanakodi, Suresh; Nazar, Nazatul Shiema Moh; Joini, Nur Fazriana; Hidzir, Hidzrin Dayana Mohd; Awira, Mohammad Zulfikar Khairul
2018-02-01
The fault that commonly occurs in power plants is due to various factors that affect the system outage. There are many types of faults in power plants such as single line to ground fault, double line to ground fault, and line to line fault. The primary aim of this paper is to diagnose the fault in 14 buses power plants by using an Artificial Neural Network (ANN). The Multilayered Perceptron Network (MLP) that detection trained utilized the offline training methods such as Gradient Descent Backpropagation (GDBP), Levenberg-Marquardt (LM), and Bayesian Regularization (BR). The best method is used to build the Graphical User Interface (GUI). The modelling of 14 buses power plant, network training, and GUI used the MATLAB software.
Predicting breast screening attendance using machine learning techniques.
Baskaran, Vikraman; Guergachi, Aziz; Bali, Rajeev K; Naguib, Raouf N G
2011-03-01
Machine learning-based prediction has been effectively applied for many healthcare applications. Predicting breast screening attendance using machine learning (prior to the actual mammogram) is a new field. This paper presents new predictor attributes for such an algorithm. It describes a new hybrid algorithm that relies on back-propagation and radial basis function-based neural networks for prediction. The algorithm has been developed in an open source-based environment. The algorithm was tested on a 13-year dataset (1995-2008). This paper compares the algorithm and validates its accuracy and efficiency with different platforms. Nearly 80% accuracy and 88% positive predictive value and sensitivity were recorded for the algorithm. The results were encouraging; 40-50% of negative predictive value and specificity warrant further work. Preliminary results were promising and provided ample amount of reasons for testing the algorithm on a larger scale.
A Neural Network Approach for GMA Butt Joint Welding
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2003-01-01
penetration, when the gap width is varying during the welding process. The process modeling to facilitate the mapping from joint geometry and reference weld quality to significant welding parameters has been based on a multi-layer feed-forward network. The Levenberg-Marquardt algorithm for non-linear least......This paper describes the application of the neural network technology for gas metal arc welding (GMAW) control. A system has been developed for modeling and online adjustment of welding parameters, appropriate to guarantee a certain degree of quality in the field of butt joint welding with full...... squares has been used with the back-propagation algorithm for training the network, while a Bayesian regularization technique has been successfully applied for minimizing the risk of inexpedient over-training. Finally, a predictive closed-loop control strategy based on a so-called single-neuron self...
International Nuclear Information System (INIS)
Bocco, M.
2006-01-01
The objective of this work was to develop neural network models of backpropagation type to estimate solar radiation based on extraterrestrial radiation data, daily temperature range, precipitation, cloudiness and relative sunshine duration. Data from Córdoba, Argentina, were used for development and validation. The behaviour and adjustment between values observed and estimates obtained by neural networks for different combinations of input were assessed. These estimations showed root mean square error between 3.15 and 3.88 MJ m -2 d -1 . The latter corresponds to the model that calculates radiation using only precipitation and daily temperature range. In all models, results show good adjustment to seasonal solar radiation. These results allow inferring the adequate performance and pertinence of this methodology to estimate complex phenomena, such as solar radiation [pt
Mjahed, M
1999-01-01
In this work, we aim to construct a new set of variables, to recognize the number of jets produced in the e/sup +/ e/sup -/ events. These so-called morphological variables usually used in image processing and recognition problems, are comparable to the classical sphericity, aplanarity etc.. The amelioration of the recognition efficiency is obtained thanks to the use of a back-propagation neural network. The survey first done on the generated Lund Monte Carlo events could be reinforced thereafter by taking into account the simulation of the ALEPH detector. The neural network performed on this later kind of events, successfully identifies the 4 classes of events (event with 2, 3, 4 jets or with an isotropic distribution (0 jets)). (33 refs).
A Peak Price Tracking-Based Learning System for Portfolio Selection.
Lai, Zhao-Rong; Dai, Dao-Qing; Ren, Chuan-Xian; Huang, Ke-Kun
2017-06-07
We propose a novel linear learning system based on the peak price tracking (PPT) strategy for portfolio selection (PS). Recently, the topic of tracking control attracts intensive attention and some novel models are proposed based on backstepping methods, such that the system output tracks a desired trajectory. The proposed system has a similar evolution with a transform function that aggressively tracks the increasing power of different assets. As a result, the better performing assets will receive more investment. The proposed PPT objective can be formulated as a fast backpropagation algorithm, which is suitable for large-scale and time-limited applications, such as high-frequency trading. Extensive experiments on several benchmark data sets from diverse real financial markets show that PPT outperforms other state-of-the-art systems in computational time, cumulative wealth, and risk-adjusted metrics. It suggests that PPT is effective and even more robust than some defensive systems in PS.
Application of BP Neural Network Algorithm in Traditional Hydrological Model for Flood Forecasting
Directory of Open Access Journals (Sweden)
Jianjin Wang
2017-01-01
Full Text Available Flooding contributes to tremendous hazards every year; more accurate forecasting may significantly mitigate the damages and loss caused by flood disasters. Current hydrological models are either purely knowledge-based or data-driven. A combination of data-driven method (artificial neural networks in this paper and knowledge-based method (traditional hydrological model may booster simulation accuracy. In this study, we proposed a new back-propagation (BP neural network algorithm and applied it in the semi-distributed Xinanjiang (XAJ model. The improved hydrological model is capable of updating the flow forecasting error without losing the leading time. The proposed method was tested in a real case study for both single period corrections and real-time corrections. The results reveal that the proposed method could significantly increase the accuracy of flood forecasting and indicate that the global correction effect is superior to the second-order autoregressive correction method in real-time correction.
Fault Identification of Gearbox Degradation with Optimized Wavelet Neural Network
Directory of Open Access Journals (Sweden)
Hanxin Chen
2013-01-01
Full Text Available A novel intelligent method based on wavelet neural network (WNN was proposed to identify the gear crack degradation in gearbox in this paper. The wavelet packet analysis (WPA is applied to extract the fault feature of the vibration signal, which is collected by two acceleration sensors mounted on the gearbox along the vertical and horizontal direction. The back-propagation (BP algorithm is studied and applied to optimize the scale and translation parameters of the Morlet wavelet function, the weight coefficients, threshold values in WNN structure. Four different gear crack damage levels under three different loads and three various motor speeds are presented to obtain the different gear fault modes and gear crack degradation in the experimental system. The results show the feasibility and effectiveness of the proposed method by the identification and classification of the four gear modes and degradation.
Bacterial population solitary waves can defeat rings of funnels
International Nuclear Information System (INIS)
Morris, Ryan J; Phan, Trung V; Austin, Robert H; Black, Matthew; Bos, Julia A; Lin, Ke-Chih; Kevrekidis, Ioannis G
2017-01-01
We have constructed a microfabricated circular corral for bacteria made of rings of concentric funnels which channel motile bacteria outwards via non-hydrodynamic interactions with the funnel walls. Initially bacteria do move rapidly outwards to the periphery of the corral. At the edge, nano-slits allow for the transport of nutrients into the device while keeping the bacteria from escaping. After a period of time in which the bacteria increase their cell density in this perimeter region, they are then able to defeat the physical constrains of the funnels by launching back-propagating collective waves. We present the basic data and some nonlinear modeling which can explain how bacterial population waves propagate through a physical funnel, and discuss possible biological implications. (paper)
Energy Technology Data Exchange (ETDEWEB)
Yamakawa, S.; Yamaguchi, A. (Toyama National College of Maritime Technology, Toyama (Japan))
1992-12-20
The present paper proposes a new taste recognition system using optical response patterns from multi-channel optical fiber sensors having potential sensitive dye coatings. It was found that the sensors give large changes in optical absorption spectra of the dyes when they are immersed in various taste solutions. Consequently, it was shown that the sensors can be used as a taste sensor. Six dyes, which give large changes in dye absorption, were selected from twenty dyes and used for six-channel optical fiber taste sensors array. The absorption spectra change data were processed by multiple discriminant analysis and neural networks using back-propagation algorithm. From the analytical results, it was demonstrated that salty (NaCl), bitter (quinidine), sweet (sucrose), sour (HCl), and umami (sodium glutamate) substances can be recognized from each other by using the optical taste sensor system. 11 refs., 8 figs., 2 tabs.
Sheikhan, Mansour; Abbasnezhad Arabi, Mahdi; Gharavian, Davood
2015-10-01
Artificial neural networks are efficient models in pattern recognition applications, but their performance is dependent on employing suitable structure and connection weights. This study used a hybrid method for obtaining the optimal weight set and architecture of a recurrent neural emotion classifier based on gravitational search algorithm (GSA) and its binary version (BGSA), respectively. By considering the features of speech signal that were related to prosody, voice quality, and spectrum, a rich feature set was constructed. To select more efficient features, a fast feature selection method was employed. The performance of the proposed hybrid GSA-BGSA method was compared with similar hybrid methods based on particle swarm optimisation (PSO) algorithm and its binary version, PSO and discrete firefly algorithm, and hybrid of error back-propagation and genetic algorithm that were used for optimisation. Experimental tests on Berlin emotional database demonstrated the superior performance of the proposed method using a lighter network structure.
Directory of Open Access Journals (Sweden)
Dwi Astuti Aprijani
2013-03-01
Full Text Available Artificial Neural Network (ANN can be applied to recognice pattern, particularly at the stage of data classification. This study used a multilayer perceptron backpropagation ANN, an unsupervised learning algorithm, to recognize the pattern of uppercase handwriting on the answer sheet of multiple-choice exams. The application of this network involves mapping a set of input against a reference set of outputs. In this research, ANN was trained using 8000 handwritten uppercase characters (A, B, C, and D consisting of 6000 training data characters (1500 characters for each letter and 2000 testing data characters (500 characters for each letter. The result showed that for the most optimal performance, the architecture and network parameters were 10 neurons in hidden layer, learning rate of 0.1 and 3000 iteration times. The accuracies of the result using the optimal network architecture and parameters were 90.28% for training data and 87.35% for testing data.
Neural net prediction of tokamak plasma disruptions
International Nuclear Information System (INIS)
Hernandez, J.V.; Lin, Z.; Horton, W.; McCool, S.C.
1994-10-01
The computation based on neural net algorithms in predicting minor and major disruptions in TEXT tokamak discharges has been performed. Future values of the fluctuating magnetic signal are predicted based on L past values of the magnetic fluctuation signal, measured by a single Mirnov coil. The time step used (= 0.04ms) corresponds to the experimental data sampling rate. Two kinds of approaches are adopted for the task, the contiguous future prediction and the multi-timescale prediction. Results are shown for comparison. Both networks are trained through the back-propagation algorithm with inertial terms. The degree of this success indicates that the magnetic fluctuations associated with tokamak disruptions may be characterized by a relatively low-dimensional dynamical system
International Nuclear Information System (INIS)
Behloul, F.; Boudraa, A.; Janier, M.; Unterreiner, R.
1998-01-01
A self-organized Radial Basis Function Network (RBFN) is proposed for the problem of object extraction in Positron Emission Tomography Images of the heart. RBENs are supervised-learning networks. However, viewing the output of the networks as a fuzzy set, we have able to compute the error of the system using fuzziness measures. Thus, there is no need of target output for training the network. Besides the self-organizing feature of the network, our RBFN has a non linear output layer trained using the back-propagation algorithm. Two mathematical models of fuzzy measures have been considered: the index of fuzziness and fuzzy entropy. Preliminary results show that entropy measure produced a better extraction of healthy myocardium. (authors)
Classification of brain compartments and head injury lesions by neural networks applied to MRI
International Nuclear Information System (INIS)
Kischell, E.R.; Kehtarnavaz, N.; Hillman, G.R.; Levin, H.; Lilly, M.; Kent, T.A.
1995-01-01
An automatic, neural network-based approach was applied to segment normal brain compartments and lesions on MR images. Two supervised networks, backpropagation (BPN) and counterpropagation, and two unsupervised networks, Kohonen learning vector quantizer and analog adaptive resonance theory, were trained on registered T2-weighted and proton density images. The classes of interest were background, gray matter, white matter, cerebrospinal fluid, macrocystic encephalomalacia, gliosis, and 'unknown'. A comprehensive feature vector was chosen to discriminate these classes. The BPN combined with feature conditioning, multiple discriminant analysis followed by Hotelling transform, produced the most accurate and consistent classification results. Classifications of normal brain compartments were generally in agreement with expert interpretation of the images. Macrocystic encephalomalacia and gliosis were recognized and, except around the periphery, classified in agreement with the clinician's report used to train the neural network. (orig.)
Clustering-neural network models for freeway work zone capacity estimation.
Jiang, Xiaomo; Adeli, Hojjat
2004-06-01
Two neural network models, called clustering-RBFNN and clustering-BPNN models, are created for estimating the work zone capacity in a freeway work zone as a function of seventeen different factors through judicious integration of the subtractive clustering approach with the radial basis function (RBF) and the backpropagation (BP) neural network models. The clustering-RBFNN model has the attractive characteristics of training stability, accuracy, and quick convergence. The results of validation indicate that the work zone capacity can be estimated by clustering-neural network models in general with an error of less than 10%, even with limited data available to train the models. The clustering-RBFNN model is used to study several main factors affecting work zone capacity. The results of such parametric studies can assist work zone engineers and highway agencies to create effective traffic management plans (TMP) for work zones quantitatively and objectively.
Mazurek, Paweł; Czyżak, Paweł; de Waardt, Huug; Turkiewicz, Jarosław Piotr
2015-11-01
We investigate the utilization of semiconductor optical amplifiers (SOAs) and quantum-dot laser-based Raman amplifiers in high-capacity dense wavelength division multiplexed (DWDM) 1310-nm transmission systems. Performed simulations showed that in a 10×40 Gbit/s system, the utilization of a single Raman amplifier in a back-propagation scheme can extend the maximum error-free (bit error rate power budget. Moreover, lower input optical power in a system utilizing a Raman amplifier reduces the four-wave mixing interactions. The obtained results prove that Raman amplification can be successfully applied in 1310-nm high-capacity transmission systems, e.g., to extend the reach of 400G and 1T Ethernet systems.
Optimal fuel loading pattern design using artificial intelligence techniques
International Nuclear Information System (INIS)
Kim, Han Gon; Chang, Soon Heung; Lee, Byung Ho
1993-01-01
The Optimal Fuel Shuffling System (OFSS) is developed for optimal design of PWR fuel loading pattern. OFSS is a hybrid system that a rule based system, a fuzzy logic, and an artificial neural network are connected each other. The rule based system classifies loading patterns into two classes using several heuristic rules and a fuzzy rule. A fuzzy rule is introduced to achieve more effective and fast searching. Its membership function is automatically updated in accordance with the prediction results. The artificial neural network predicts core parameters for the patterns generated from the rule based system. The back-propagation network is used for fast prediction of core parameters. The artificial neural network and the fuzzy logic can be used as the tool for improvement of existing algorithm's capabilities. OFSS was demonstrated and validated for cycle 1 of Kori unit 1 PWR. (Author)
Directory of Open Access Journals (Sweden)
Hsin-Chieh Wu
2013-01-01
Full Text Available In this study, the fuzzy-neural ensemble and geometric rule fusion approach is presented to optimize the performance of job dispatching in a wafer fabrication factory with an intelligent rule. The proposed methodology is a modification of a previous study by fusing two dispatching rules and diversifying the job slacks in novel ways. To this end, the geometric mean of the neighboring distances of slacks is maximized. In addition, the fuzzy c-means (FCM and backpropagation network (BPN ensemble approach was also proposed to estimate the remaining cycle time of a job, which is an important input to the new rule. A new aggregation mechanism was also designed to enhance the robustness of the FCM-BPN ensemble approach. To validate the effectiveness of the proposed methodology, some experiments have been conducted. The experimental results did support the effectiveness of the proposed methodology.
Neural Network Burst Pressure Prediction in Composite Overwrapped Pressure Vessels
Hill, Eric v. K.; Dion, Seth-Andrew T.; Karl, Justin O.; Spivey, Nicholas S.; Walker, James L., II
2007-01-01
Acoustic emission data were collected during the hydroburst testing of eleven 15 inch diameter filament wound composite overwrapped pressure vessels. A neural network burst pressure prediction was generated from the resulting AE amplitude data. The bottles shared commonality of graphite fiber, epoxy resin, and cure time. Individual bottles varied by cure mode (rotisserie versus static oven curing), types of inflicted damage, temperature of the pressurant, and pressurization scheme. Three categorical variables were selected to represent undamaged bottles, impact damaged bottles, and bottles with lacerated hoop fibers. This categorization along with the removal of the AE data from the disbonding noise between the aluminum liner and the composite overwrap allowed the prediction of burst pressures in all three sets of bottles using a single backpropagation neural network. Here the worst case error was 3.38 percent.
Nawi, Nazri Mohd.; Khan, Abdullah; Rehman, M. Z.
2015-05-01
A nature inspired behavior metaheuristic techniques which provide derivative-free solutions to solve complex problems. One of the latest additions to the group of nature inspired optimization procedure is Cuckoo Search (CS) algorithm. Artificial Neural Network (ANN) training is an optimization task since it is desired to find optimal weight set of a neural network in training process. Traditional training algorithms have some limitation such as getting trapped in local minima and slow convergence rate. This study proposed a new technique CSLM by combining the best features of two known algorithms back-propagation (BP) and Levenberg Marquardt algorithm (LM) for improving the convergence speed of ANN training and avoiding local minima problem by training this network. Some selected benchmark classification datasets are used for simulation. The experiment result show that the proposed cuckoo search with Levenberg Marquardt algorithm has better performance than other algorithm used in this study.
Li, Xiao Wei; Cho, Sung Jin; Kim, Seok Tae
2014-03-01
Integral imaging can provide a feasible and efficient technique for multiple-image encoding system. The computational integral imaging reconstruction (CIIR) technique reconstructs a set of plane images along the output plane, whereas the resolution of the reconstructed images will degrade due to the partial occlusion of other reconstructed images. Meanwhile, CIIR is a pixel-overlapping reconstruction method, in which the superimposition causes the undesirable interference. To overcome these problems, we first utilize the block matching algorithm to eliminate the occlusion-disturbance and introduce the back-propagation neural network algorithm to compensate for the low-resolution image. In the encryption, a computational integral imaging pickup technique is employed to record the multiple-image simultaneously to form an elemental image array (EIA). The EIA is then encrypted by combining the use of maximum length cellular automata (CA) and the double random phase encoding algorithm. Some numerical simulations have been made to demonstrate the performance of this encryption algorithm.
Energy Technology Data Exchange (ETDEWEB)
Guia, Jose G.C. da; Araujo, Adevid L. de [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia Mecanica; Irmao, Marcos A. da Silva [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia de Processos; Silva, Antonio A. [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia Mecanica
2003-07-01
The condition monitoring and diagnostic of structural faults in pipelines are an important problem for the petroleum's industry, being necessary to develop supervisory systems for detection, prediction and evaluation of a fault in the pipelines to avoid environmental and financial damages. In this work, three types of Artificial Neural Networks (ANNs) are reviewed and used to detect and locate a fault in a simulated pipe. The simulated pipe was modeled through the Finite Elements Method. In Neural Networks' analysis, the first six natural frequencies of the pipe are used as networks' inputs. The used ANNs were the Multi-Layer Perceptron Network with backpropagation, the Probabilistic Neural Network and the Generalized Regression Neural Network. After the analysis, it was concluded that the ANN are a good computational tool in problems of faults detection on pipelines with a great precision. In the localization of the faults were obtained errors smaller than 5%. (author)
Putra, J. C. P.; Safrilah
2017-06-01
Artificial neural network approaches are useful to solve many complicated problems. It solves a number of problems in various areas such as engineering, medicine, business, manufacturing, etc. This paper presents an application of artificial neural network to predict a runway capacity at Juanda International Airport. An artificial neural network model of backpropagation and multi-layer perceptron is adopted to this research to learning process of runway capacity at Juanda International Airport. The results indicate that the training data is successfully recognizing the certain pattern of runway use at Juanda International Airport. Whereas, testing data indicate vice versa. Finally, it can be concluded that the approach of uniformity data and network architecture is the critical part to determine the accuracy of prediction results.
Directory of Open Access Journals (Sweden)
Erdi Tosun
2016-12-01
Full Text Available This study deals with usage of linear regression (LR and artificial neural network (ANN modeling to predict engine performance; torque and exhaust emissions; and carbon monoxide, oxides of nitrogen (CO, NOx of a naturally aspirated diesel engine fueled with standard diesel, peanut biodiesel (PME and biodiesel-alcohol (EME, MME, PME mixtures. Experimental work was conducted to obtain data to train and test the models. Backpropagation algorithm was used as a learning algorithm of ANN in the multilayered feedforward networks. Engine speed (rpm and fuel properties, cetane number (CN, lower heating value (LHV and density (ρ were used as input parameters in order to predict performance and emission parameters. It was shown that while linear regression modeling approach was deficient to predict desired parameters, more accurate results were obtained with the usage of ANN.
Optical proximity correction using a multilayer perceptron neural network
International Nuclear Information System (INIS)
Luo, Rui
2013-01-01
Optical proximity correction (OPC) is one of the resolution enhancement techniques (RETs) in optical lithography, where the mask pattern is modified to improve the output pattern fidelity. Algorithms are needed to generate the modified mask pattern automatically and efficiently. In this paper, a multilayer perceptron (MLP) neural network (NN) is used to synthesize the mask pattern. We employ the pixel-based approach in this work. The MLP takes the pixel values of the desired output wafer pattern as input, and outputs the optimal mask pixel values. The MLP is trained with the backpropagation algorithm, with a training set retrieved from the desired output pattern, and the optimal mask pattern obtained by the model-based method. After training, the MLP is able to generate the optimal mask pattern non-iteratively with good pattern fidelity. (paper)
The impact of arithmetic representation on implementing MLP-BP on FPGAs: a study.
Savich, Antony W; Moussa, Medhat; Areibi, Shawki
2007-01-01
In this paper, arithmetic representations for implementing multilayer perceptrons trained using the error backpropagation algorithm (MLP-BP) neural networks on field-programmable gate arrays (FPGAs) are examined in detail. Both floating-point (FLP) and fixed-point (FXP) formats are studied and the effect of precision of representation and FPGA area requirements are considered. A generic very high-speed integrated circuit hardware description language (VHDL) program was developed to help experiment with a large number of formats and designs. The results show that an MLP-BP network uses less clock cycles and consumes less real estate when compiled in an FXP format, compared with a larger and slower functioning compilation in an FLP format with similar data representation width, in bits, or a similar precision and range.
Representation of neutron noise data using neural networks
International Nuclear Information System (INIS)
Korsah, K.; Damiano, B.; Wood, R.T.
1992-01-01
This paper describes a neural network-based method of representing neutron noise spectra using a model developed at the Oak Ridge National Laboratory (ORNL). The backpropagation neural network learned to represent neutron noise data in terms of four descriptors, and the network response matched calculated values to within 3.5 percent. These preliminary results are encouraging, and further research is directed towards the application of neural networks in a diagnostics system for the identification of the causes of changes in structural spectral resonances. This work is part of our current investigation of advanced technologies such as expert systems and neural networks for neutron noise data reduction, analysis, and interpretation. The objective is to improve the state-of-the-art of noise analysis as a diagnostic tool for nuclear power plants and other mechanical systems
Directory of Open Access Journals (Sweden)
José Fernando Moretti
2016-01-01
Full Text Available Currently, artificial neural networks are being widely used in various fields of science and engineering. Neural networks have the ability to learn through experience and existing examples, and then generate solutions and answers to new problems, involving even the effects of non-linearity in their variables. The aim of this study is to use a feed-forward neural network with back-propagation technique, to predict the values of compressive strength and modulus of elasticity, at 28 days, of different concrete mixtures prepared and tested in the laboratory. It demonstrates the ability of the neural networks to quantify the strength and the elastic modulus of concrete specimens prepared using different mix proportions.
Directory of Open Access Journals (Sweden)
J. Prakash Maran
2013-09-01
Full Text Available In this study, a comparative approach was made between artificial neural network (ANN and response surface methodology (RSM to predict the mass transfer parameters of osmotic dehydration of papaya. The effects of process variables such as temperature, osmotic solution concentration and agitation speed on water loss, weight reduction, and solid gain during osmotic dehydration were investigated using a three-level three-factor Box-Behnken experimental design. Same design was utilized to train a feed-forward multilayered perceptron (MLP ANN with back-propagation algorithm. The predictive capabilities of the two methodologies were compared in terms of root mean square error (RMSE, mean absolute error (MAE, standard error of prediction (SEP, model predictive error (MPE, chi square statistic (χ2, and coefficient of determination (R2 based on the validation data set. The results showed that properly trained ANN model is found to be more accurate in prediction as compared to RSM model.
Efficient video-equipped fire detection approach for automatic fire alarm systems
Kang, Myeongsu; Tung, Truong Xuan; Kim, Jong-Myon
2013-01-01
This paper proposes an efficient four-stage approach that automatically detects fire using video capabilities. In the first stage, an approximate median method is used to detect video frame regions involving motion. In the second stage, a fuzzy c-means-based clustering algorithm is employed to extract candidate regions of fire from all of the movement-containing regions. In the third stage, a gray level co-occurrence matrix is used to extract texture parameters by tracking red-colored objects in the candidate regions. These texture features are, subsequently, used as inputs of a back-propagation neural network to distinguish between fire and nonfire. Experimental results indicate that the proposed four-stage approach outperforms other fire detection algorithms in terms of consistently increasing the accuracy of fire detection in both indoor and outdoor test videos.
Artificial neural networks (ANN: prediction of sensory measurements from instrumental data
Directory of Open Access Journals (Sweden)
Naiara Barbosa Carvalho
2013-12-01
Full Text Available The objective of this study was to predict by means of Artificial Neural Network (ANN, multilayer perceptrons, the texture attributes of light cheesecurds perceived by trained judges based on instrumental texture measurements. Inputs to the network were the instrumental texture measurements of light cheesecurd (imitative and fundamental parameters. Output variables were the sensory attributes consistency and spreadability. Nine light cheesecurd formulations composed of different combinations of fat and water were evaluated. The measurements obtained by the instrumental and sensory analyses of these formulations constituted the data set used for training and validation of the network. Network training was performed using a back-propagation algorithm. The network architecture selected was composed of 8-3-9-2 neurons in its layers, which quickly and accurately predicted the sensory texture attributes studied, showing a high correlation between the predicted and experimental values for the validation data set and excellent generalization ability, with a validation RMSE of 0.0506.
Energy Technology Data Exchange (ETDEWEB)
Altran, A.B.; Lotufo, A.D.P.; Minussi, C.R. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil). Dept. de Engenharia Eletrica], Emails: lealtran@yahoo.com.br, annadiva@dee.feis.unesp.br, minussi@dee.feis.unesp.br; Lopes, M.L.M. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil). Dept. de Matematica], E-mail: mara@mat.feis.unesp.br
2009-07-01
This paper presents a methodology for electrical load forecasting, using radial base functions as activation function in artificial neural networks with the training by backpropagation algorithm. This methodology is applied to short term electrical load forecasting (24 h ahead). Therefore, results are presented analyzing the use of radial base functions substituting the sigmoid function as activation function in multilayer perceptron neural networks. However, the main contribution of this paper is the proposal of a new formulation of load forecasting dedicated to the forecasting in several points of the electrical network, as well as considering several types of users (residential, commercial, industrial). It deals with the MLF (Multimodal Load Forecasting), with the same processing time as the GLF (Global Load Forecasting). (author)
Directory of Open Access Journals (Sweden)
Wu Wan'e
2012-01-01
Full Text Available A practical scheme for selecting characterization parameters of boron-based fuel-rich propellant formulation was put forward; a calculation model for primary combustion characteristics of boron-based fuel-rich propellant based on backpropagation neural network was established, validated, and then was used to predict primary combustion characteristics of boron-based fuel-rich propellant. The results show that the calculation error of burning rate is less than ±7.3%; in the formulation range (hydroxyl-terminated polybutadiene 28%–32%, ammonium perchlorate 30%–35%, magnalium alloy 4%–8%, catocene 0%–5%, and boron 30%, the variation of the calculation data is consistent with the experimental results.
Directory of Open Access Journals (Sweden)
Gang Xie
2013-01-01
Full Text Available This paper proposes a novel ensemble learning approach based on logistic regression (LR and artificial intelligence tool, that is, support vector machine (SVM and back-propagation neural networks (BPNN, for corporate financial distress forecasting in fashion and textiles supply chains. Firstly, related concepts of LR, SVM, and BPNN are introduced. Then, the forecasting results by LR are introduced into the SVM and BPNN techniques which can recognize the forecasting errors in fitness by LR. Moreover, empirical analysis of Chinese listed companies in fashion and textile sector is implemented for the comparison of the methods, and some related issues are discussed. The results suggest that the proposed novel ensemble learning approach can achieve higher forecasting performance than those of individual models.
Martín, M L; Turias, I J; González, F J; Galindo, P L; Trujillo, F J; Puntonet, C G; Gorriz, J M
2008-01-01
The region of the Bay of Algeciras is a very industrialized area where very few air pollution studies have been carried out. The main objective of this work has been the use of artificial neural networks (ANNs) as a predictive tool of high levels of ambient carbon monoxide (CO). Two approaches have been used: multilayer perceptron models (MLPs) with backpropagation learning rule and k-Nearest Neighbours (k-nn) classifiers, in order to predict future peaks of carbon monoxide. A resampling strategy with twofold cross-validation allowed the statistical comparison of the different topologies and models considered in the study. The procedure of random resampling permits an adequate and robust multiple comparisons of the tested models and allow us to select a group of best models.
International Nuclear Information System (INIS)
Wardaya, P D; Ridha, S
2014-01-01
In this paper a backpropagation neural network is utilized to perform house cluster segmentation from Google Earth data. The algorithm is subjected to identify houses in the image based on the RGB pattern within each pixel. Training data is given through cropping selection for a target that is a house cluster and a non object. The algorithm assigns 1 to a pixel belong to a class of object and 0 to a class of non object. The resulting outcome, a binary image, is then utilized to perform quantification to estimate the number of house clusters. The number of the hidden layer is varying in order to find its effect to the neural network performance and total computational time
Directory of Open Access Journals (Sweden)
Małgorzata Pawul
2016-09-01
Full Text Available Recently, a lot of attention was paid to the improvement of methods which are used to air quality forecasting. Artificial neural networks can be applied to model these problems. Their advantage is that they can solve the problem in the conditions of incomplete information, without the knowledge of the analytical relationship between the input and output data. In this paper we applied artificial neural networks to predict the PM 10 concentrations as factors determining the occurrence of smog phenomena. To create these networks we used meteorological data and concentrations of PM 10. The data were recorded in 2014 and 2015 at three measuring stations operating in Krakow under the State Environmental Monitoring. The best results were obtained by three-layer perceptron with back-propagation algorithm. The neural networks received a good fit in all cases.
Place Cells, Grid Cells, Attractors, and Remapping
Directory of Open Access Journals (Sweden)
Kathryn J. Jeffery
2011-01-01
Full Text Available Place and grid cells are thought to use a mixture of external sensory information and internal attractor dynamics to organize their activity. Attractor dynamics may explain both why neurons react coherently following sufficiently large changes to the environment (discrete attractors and how firing patterns move smoothly from one representation to the next as an animal moves through space (continuous attractors. However, some features of place cell behavior, such as the sometimes independent responsiveness of place cells to environmental change (called “remapping”, seem hard to reconcile with attractor dynamics. This paper suggests that the explanation may be found in an anatomical separation of the two attractor systems coupled with a dynamic contextual modulation of the connection matrix between the two systems, with new learning being back-propagated into the matrix. Such a scheme could explain how place cells sometimes behave coherently and sometimes independently.
Classification of brain compartments and head injury lesions by neural networks applied to MRI.
Kischell, E R; Kehtarnavaz, N; Hillman, G R; Levin, H; Lilly, M; Kent, T A
1995-10-01
An automatic, neural network-based approach was applied to segment normal brain compartments and lesions on MR images. Two supervised networks, backpropagation (BPN) and counterpropagation, and two unsupervised networks, Kohonen learning vector quantizer and analog adaptive resonance theory, were trained on registered T2-weighted and proton density images. The classes of interest were background, gray matter, white matter, cerebrospinal fluid, macrocystic encephalomalacia, gliosis, and "unknown." A comprehensive feature vector was chosen to discriminate these classes. The BPN combined with feature conditioning, multiple discriminant analysis followed by Hotelling transform, produced the most accurate and consistent classification results. Classification of normal brain compartments were generally in agreement with expert interpretation of the images. Macrocystic encephalomalacia and gliosis were recognized and, except around the periphery, classified in agreement with the clinician's report used to train the neural network.
Classification of brain compartments and head injury lesions by neural networks applied to MRI
Energy Technology Data Exchange (ETDEWEB)
Kischell, E.R. [Dept. of Electrical Engineering, Texas A and M Univ., College Station, TX (United States); Kehtarnavaz, N. [Dept. of Electrical Engineering, Texas A and M Univ., College Station, TX (United States); Hillman, G.R. [Dept. of Pharmacology, Univ. of Texas Medical Branch, Galveston, TX (United States); Levin, H. [Dept. of Neurosurgery, Univ. of Texas Medical Branch, Galveston, TX (United States); Lilly, M. [Dept. of Neurosurgery, Univ. of Texas Medical Branch, Galveston, TX (United States); Kent, T.A. [Dept. of Neurology and Psychiatry, Univ. of Texas Medical Branch, Galveston, TX (United States)
1995-10-01
An automatic, neural network-based approach was applied to segment normal brain compartments and lesions on MR images. Two supervised networks, backpropagation (BPN) and counterpropagation, and two unsupervised networks, Kohonen learning vector quantizer and analog adaptive resonance theory, were trained on registered T2-weighted and proton density images. The classes of interest were background, gray matter, white matter, cerebrospinal fluid, macrocystic encephalomalacia, gliosis, and `unknown`. A comprehensive feature vector was chosen to discriminate these classes. The BPN combined with feature conditioning, multiple discriminant analysis followed by Hotelling transform, produced the most accurate and consistent classification results. Classifications of normal brain compartments were generally in agreement with expert interpretation of the images. Macrocystic encephalomalacia and gliosis were recognized and, except around the periphery, classified in agreement with the clinician`s report used to train the neural network. (orig.)
Perancangan Sistem Prediktor Daya Pada Panel Photovoltaic di Buoy Weather Station
Directory of Open Access Journals (Sweden)
Aini Prisilia Susanti
2013-09-01
Full Text Available Buoy weather station merupakan stasiun informasi cuaca yang banyak dijumpai di pelabuhan, khususnya di Surabaya. Untuk mengoperasikannya diperlukan sumber daya listrik berupa panel photovoltaic. Efek fotolistrik pada PV mampu merubah energi cahaya menjadi energi listrik. Besarnya daya yang dihasilkan tergantung dari intensitas matahari, temperatur permukaan, dan keadaan geografis setempat. Untuk memprediksi daya keluaran per setengah jam yang dihasilkan oleh panel PV maka digunakan metode jaringan syaraf tiruan dengan algoritma backpropagation pada software Matlab. Variabel yang digunakan berupa data daya yang diperoleh dari tegangan dan arus yang dihasilkan oleh panel PV di daerah Surabaya. Data daya selama 3 hari per setengah jam tersebut dijadikan data input dan target pada Matlab. Hasil terbaik perancangan sistem prediksi daya keluaran panel PV menggunakan JST pada Matlab yaitu Mean Square Error (MSE sebesar 0,0113 dan akurasi ketepatan prediksi sebesar 99,81%.
Directory of Open Access Journals (Sweden)
Einar Sørheim
1990-10-01
Full Text Available A neural network architecture called ART2/BP is proposed. Thc goal has been to construct an artificial neural network that learns incrementally an unknown mapping, and is motivated by the instability found in back propagation (BP networks: after first learning pattern A and then pattern B, a BP network often has completely 'forgotten' pattern A. A network using both supervised and unsupervised training is proposed, consisting of a combination of ART2 and BP. ART2 is used to build and focus a supervised backpropagation network consisting of many small subnetworks each specialized on a particular domain of the input space. The ART2/BP network has the advantage of being able to dynamically expand itself in response to input patterns containing new information. Simulation results show that the ART2/BP network outperforms a classical maximum likelihood method for the estimation of a discrete dynamic and nonlinear transfer function.
Maximum solid concentrations of coal water slurries predicted by neural network models
Energy Technology Data Exchange (ETDEWEB)
Cheng, Jun; Li, Yanchang; Zhou, Junhu; Liu, Jianzhong; Cen, Kefa
2010-12-15
The nonlinear back-propagation (BP) neural network models were developed to predict the maximum solid concentration of coal water slurry (CWS) which is a substitute for oil fuel, based on physicochemical properties of 37 typical Chinese coals. The Levenberg-Marquardt algorithm was used to train five BP neural network models with different input factors. The data pretreatment method, learning rate and hidden neuron number were optimized by training models. It is found that the Hardgrove grindability index (HGI), moisture and coalification degree of parent coal are 3 indispensable factors for the prediction of CWS maximum solid concentration. Each BP neural network model gives a more accurate prediction result than the traditional polynomial regression equation. The BP neural network model with 3 input factors of HGI, moisture and oxygen/carbon ratio gives the smallest mean absolute error of 0.40%, which is much lower than that of 1.15% given by the traditional polynomial regression equation. (author)
Spatial Data Mining Toolbox for Mapping Suitability of Landfill Sites Using Neural Networks
Abujayyab, S. K. M.; Ahamad, M. S. S.; Yahya, A. S.; Aziz, H. A.
2016-09-01
Mapping the suitability of landfill sites is a complex field and is involved with multidiscipline. The purpose of this research is to create an ArcGIS spatial data mining toolbox for mapping the suitability of landfill sites at a regional scale using neural networks. The toolbox is constructed from six sub-tools to prepare, train, and process data. The employment of the toolbox is straightforward. The multilayer perceptron (MLP) neural networks structure with a backpropagation learning algorithm is used. The dataset is mined from the north states in Malaysia. A total of 14 criteria are utilized to build the training dataset. The toolbox provides a platform for decision makers to implement neural networks for mapping the suitability of landfill sites in the ArcGIS environment. The result shows the ability of the toolbox to produce suitability maps for landfill sites.
Directory of Open Access Journals (Sweden)
Mustafa Özuysal
2012-01-01
Full Text Available Passenger flow estimation of transit systems is essential for new decisions about additional facilities and feeder lines. For increasing the efficiency of an existing transit line, stations which are insufficient for trip production and attraction should be examined first. Such investigation supports decisions for feeder line projects which may seem necessary or futile according to the findings. In this study, passenger flow of a light rail transit (LRT system in Izmir, Turkey is estimated by using multiple regression and feed-forward back-propagation type of artificial neural networks (ANN. The number of alighting passengers at each station is estimated as a function of boarding passengers from other stations. It is found that ANN approach produced significantly better estimations specifically for the low passenger attractive stations. In addition, ANN is found to be more capable for the determination of trip-attractive parts of LRT lines. Keywords: light rail transit, multiple regression, artificial neural networks, public transportation
Failure forecast of Boeing 737 bleed air system using artificial neural networks
Al-Wadiee, Waheed
In this study, the failure rate of different types of bleed air control valves for the Boeing 737 aircraft is modeled. Two approaches are utilized to perform this work. In the first approach, Weibull model, in which different parameters are utilized and tested, is used. In the second one, a common type of the Artificial Neural Network (ANN) modeling is used. A Feed-forward back-propagation algorithm is implemented to train the network. Subsequently, the optimum number of neurons and layers that give the best result compared to the actual data are determined. Finally, the outputs from both models are compared against the actual data. The final results show a high level of accuracy of the ANN's predictions compared to the more traditional Weibull modeling. The developed verified model lends itself to applications that extend from scheduling replacements operations of these valves, to developing plans for inventory management in any aviation engines maintenance facility.
Using Artificial Neural Networks for ECG Signals Denoising
Directory of Open Access Journals (Sweden)
Zoltán Germán-Salló
2010-12-01
Full Text Available The authors have investigated some potential applications of artificial neural networks in electrocardiografic (ECG signal prediction. For this, the authors used an adaptive multilayer perceptron structure to predict the signal. The proposed procedure uses an artificial neural network based learning structure to estimate the (n+1th sample from n previous samples To train and adjust the network weights, the backpropagation (BP algorithm was used. In this paper, prediction of ECG signals (as time series using multi-layer feedforward neural networks will be described. The results are evaluated through approximation error which is defined as the difference between the predicted and the original signal.The prediction procedure is carried out (simulated in MATLAB environment, using signals from MIT-BIH arrhythmia database. Preliminary results are encouraging enough to extend the proposed method for other types of data signals.
Directory of Open Access Journals (Sweden)
Davide Marocco
2010-05-01
Full Text Available This paper presents a cognitive robotics model for the study of the embodied representation of action words. The present research will present how a iCub humanoid robot can learn the meaning of action words (i.e. words that represent dynamical events that happen in time by physically acting on the environment and linking the effects of its own actions with the behaviour observed on the objects before and after the action. The control system of the robot is an artificial neural network trained to manipulate an object through a Back-Propagation Through Time algorithm. We will show that in the presented model the grounding of action words relies directly to the way in which an agent interacts with the environment and manipulates it.
Molecular identity of dendritic voltage-gated sodium channels.
Lorincz, Andrea; Nusser, Zoltan
2010-05-14
Active invasion of the dendritic tree by action potentials (APs) generated in the axon is essential for associative synaptic plasticity and neuronal ensemble formation. In cortical pyramidal cells (PCs), this AP back-propagation is supported by dendritic voltage-gated Na+ (Nav) channels, whose molecular identity is unknown. Using a highly sensitive electron microscopic immunogold technique, we revealed the presence of the Nav1.6 subunit in hippocampal CA1 PC proximal and distal dendrites. Here, the subunit density is lower by a factor of 35 to 80 than that found in axon initial segments. A gradual decrease in Nav1.6 density along the proximodistal axis of the dendritic tree was also detected without any labeling in dendritic spines. Our results reveal the characteristic subcellular distribution of the Nav1.6 subunit, identifying this molecule as a key substrate enabling dendritic excitability.
Optimization of a neural network model for signal-to-background prediction in gamma-ray spectrometry
International Nuclear Information System (INIS)
Dragovic, S.; Onjia, A. . E-mail address of corresponding author: sdragovic@inep.co.yu; Dragovic, S.)
2005-01-01
The artificial neural network (ANN) model was optimized for the prediction of signal-to-background (SBR) ratio as a function of the measurement time in gamma-ray spectrometry. The network parameters: learning rate (α), momentum (μ), number of epochs (E) and number of nodes in hidden layer (N) were optimized simultaneously employing variable-size simplex method. The most accurate model with the root mean square (RMS) error of 0.073 was obtained using ANN with online backpropagation randomized (OBPR) algorithm with α = 0.27, μ 0.36, E = 14800 and N = 9. Most of the predicted and experimental SBR values for the eight radionuclides ( 226 Ra, 214 Bi, 235 U, 40 K, 232 Th, 134 Cs, 137 Cs and 7 Be), studied in this work, reasonably agreed to within 15 %, which was satisfactory accuracy. (author)
Directory of Open Access Journals (Sweden)
Kazem Barkhordari
2015-12-01
Full Text Available This research intends to develop a method based on the Artificial Neural Network (ANN to predict permanent earthquake-induced deformation of the earth dams and embankments. For this purpose, data sets of observations from 152 published case histories on the performance of the earth dams and embankments, during the past earthquakes, was used. In order to predict earthquake-induced deformation of the earth dams and embankments a Multi-Layer Perceptron (MLP analysis was used. A four-layer, feed-forward, back-propagation neural network, with a topology of 7-9-7-1 was found to be optimum. The results showed that an appropriately trained neural network could reliably predict permanent earthquake-induced deformation of the earth dams and embankments.
A Malaysian Vehicle License Plate Localization and Recognition System
Directory of Open Access Journals (Sweden)
Ganapathy Velappa
2008-02-01
Full Text Available Technological intelligence is a highly sought after commodity even in traffic-based systems. These intelligent systems do not only help in traffic monitoring but also in commuter safety, law enforcement and commercial applications. In this paper, a license plate localization and recognition system for vehicles in Malaysia is proposed. This system is developed based on digital images and can be easily applied to commercial car park systems for the use of documenting access of parking services, secure usage of parking houses and also to prevent car theft issues. The proposed license plate localization algorithm is based on a combination of morphological processes with a modified Hough Transform approach and the recognition of the license plates is achieved by the implementation of the feed-forward backpropagation artificial neural network. Experimental results show an average of 95% successful license plate localization and recognition in a total of 589 images captured from a complex outdoor environment.
Fault Diagnosis of Power System Based on Improved Genetic Optimized BP-NN
Directory of Open Access Journals (Sweden)
Yuan Pu
2015-01-01
Full Text Available BP neural network (Back-Propagation Neural Network, BP-NN is one of the most widely neural network models and is applied to fault diagnosis of power system currently. BP neural network has good self-learning and adaptive ability and generalization ability, but the operation process is easy to fall into local minima. Genetic algorithm has global optimization features, and crossover is the most important operation of the Genetic Algorithm. In this paper, we can modify the crossover of traditional Genetic Algorithm, using improved genetic algorithm optimized BP neural network training initial weights and thresholds, to avoid the problem of BP neural network fall into local minima. The results of analysis by an example, the method can efficiently diagnose network fault location, and improve fault-tolerance and grid fault diagnosis effect.
International Nuclear Information System (INIS)
Nabeshima, Kunihiko; Suzuki, Katsuo; Shinohara, Yoshikuni; Tuerkcan, E.
1995-11-01
In this paper, the anomaly detection method for nuclear power plant monitoring and its program are described by using a neural network approach, which is based on the deviation between measured signals and output signals of neural network model. The neural network used in this study has three layered auto-associative network with 12 input/output, and backpropagation algorithm is adopted for learning. Furthermore, to obtain better dynamical model of the reactor plant, a new learning technique was developed in which the learning process of the present neural network is divided into initial and adaptive learning modes. The test results at the actual nuclear reactor shows that the neural network plant monitoring system is successfull in detecting in real-time the symptom of small anomaly over a wide power range including reactor start-up, shut-down and stationary operation. (author)
International Nuclear Information System (INIS)
Nabeshima Kunihiko; Suzuki Katsuo; Nose, Shoichi; Kudo, Kazuhiko
1996-01-01
The purpose of this paper is to demonstrate a nuclear power plant monitoring system using artificial neural network (ANN). The major advantages of the monitoring system are that a multi-output process system can be modelled using measurement information without establishing any mathematical expressions. The dynamics model of reactor plant was constructed by using three layered auto-associative neural network with backpropagation learning algorithm. The basic idea of anomaly detection method is to monitor the deviation between process signals measured from actual plant and corresponding output signals from the ANN plant model. The simulator used is a self contained system designed for training. Four kinds of simulated malfunction caused by equipment failure during steady state operation were used to evaluate the capability of the neural network monitoring system. The results showed that this monitoring system detected the symptom of small anomaly earlier than the prevailing alarm system. (author). 7 refs, 7 figs, 2 tabs
Application of artificial neural network and genetic algorithm in flow and transport simulations
Morshed, Jahangir; Kaluarachchi, Jagath J.
Artificial neural network (ANN) is considered to be a powerful tool for solving groundwater problems which require a large number of flow and contaminant transport (GFCT) simulations. Often, GFCT models are nonlinear, and they are difficult to solve using traditional numerical methods to simulate specific input-output responses. In order to avoid these difficulties, ANN may be used to simulate the GFCT responses explicitly. In this manuscript, recent research related to the application of ANN in simulating GFCT responses is critically reviewed, and six research areas are identified. In order to study these areas, a one-dimensional unsaturated flow and transport scenario was developed, and ANN was used to simulate the effects of specific GFCT parameters on overall results. Using these results, ANN concepts related to architecture, sampling, training, and multiple function approximations are studied, and ANN training using back-propagation algorithm (BPA) and genetic algorithm (GA) are compared. These results are summarized, and appropriate conclusions are made.
An alternative approach for adaptive real-time control using a nonparametric neural network
Energy Technology Data Exchange (ETDEWEB)
Alves da Silva, A.P.; Nascimento, P.C.; Lambert-Torres, G.; Borges da Silva, L.E. [Escola Federal de Engenharia de Itajuba, Minas Gerais (Brazil)
1995-12-31
This paper presents a nonparametric Artificial Neural Network (ANN) model for adaptive control of nonlinear systems. The proposed ANN, Functional Polynomial Network (FPN), mixes the concept of orthogonal basis functions with the idea of polynomial networks. A combination of orthogonal functions can be used to produce a desired mapping. However, there is no way besides trial and error to choose which orthogonal functions should be selected. Polynomial nets can be used for function approximation, but, it is not easy to set the order of the activation function. The combination of the two concepts produces a very powerful ANN model due to the automatic input selection capability of the polynomial networks. The proposed FPN has been tested for speed control of a DC motor. The results have been compared with the ones provided by an indirect adaptive control scheme based on multilayer perceptrons trained by backpropagation.
Rupture evolution of the 2006 Java tsunami earthquake and the possible role of splay faults
Fan, Wenyuan; Bassett, Dan; Jiang, Junle; Shearer, Peter M.; Ji, Chen
2017-11-01
The 2006 Mw 7.8 Java earthquake was a tsunami earthquake, exhibiting frequency-dependent seismic radiation along strike. High-frequency global back-projection results suggest two distinct rupture stages. The first stage lasted ∼65 s with a rupture speed of ∼1.2 km/s, while the second stage lasted from ∼65 to 150 s with a rupture speed of ∼2.7 km/s. High-frequency radiators resolved with back-projection during the second stage spatially correlate with splay fault traces mapped from residual free-air gravity anomalies. These splay faults also colocate with a major tsunami source associated with the earthquake inferred from tsunami first-crest back-propagation simulation. These correlations suggest that the splay faults may have been reactivated during the Java earthquake, as has been proposed for other tsunamigenic earthquakes, such as the 1944 Mw 8.1 Tonankai earthquake in the Nankai Trough.
Fault Diagnosis of Rolling Bearings Based on EWT and KDEC
Directory of Open Access Journals (Sweden)
Mingtao Ge
2017-12-01
Full Text Available This study proposes a novel fault diagnosis method that is based on empirical wavelet transform (EWT and kernel density estimation classifier (KDEC, which can well diagnose fault type of the rolling element bearings. With the proposed fault diagnosis method, the vibration signal of rolling element bearing was firstly decomposed into a series of F modes by EWT, and the root mean square, kurtosis, and skewness of the F modes were computed and combined into the feature vector. According to the characteristics of kernel density estimation, a classifier based on kernel density estimation and mutual information was proposed. Then, the feature vectors were input into the KDEC for training and testing. The experimental results indicated that the proposed method can effectively identify three different operative conditions of rolling element bearings, and the accuracy rates was higher than support vector machine (SVM classifier and back-propagation (BP neural network classifier.
Deep-Learning-Based Approach for Prediction of Algal Blooms
Directory of Open Access Journals (Sweden)
Feng Zhang
2016-10-01
Full Text Available Algal blooms have recently become a critical global environmental concern which might put economic development and sustainability at risk. However, the accurate prediction of algal blooms remains a challenging scientific problem. In this study, a novel prediction approach for algal blooms based on deep learning is presented—a powerful tool to represent and predict highly dynamic and complex phenomena. The proposed approach constructs a five-layered model to extract detailed relationships between the density of phytoplankton cells and various environmental parameters. The algal blooms can be predicted by the phytoplankton density obtained from the output layer. A case study is conducted in coastal waters of East China using both our model and a traditional back-propagation neural network for comparison. The results show that the deep-learning-based model yields better generalization and greater accuracy in predicting algal blooms than a traditional shallow neural network does.
Smith, James A.
1992-01-01
The inversion of the leaf area index (LAI) canopy parameter from optical spectral reflectance measurements is obtained using a backpropagation artificial neural network trained using input-output pairs generated by a multiple scattering reflectance model. The problem of LAI estimation over sparse canopies (LAI 1000 percent for low LAI. Minimization methods applied to merit functions constructed from differences between measured reflectances and predicted reflectances using multiple-scattering models are unacceptably sensitive to a good initial guess for the desired parameter. In contrast, the neural network reported generally yields absolute percentage errors of <30 percent when weighting coefficients trained on one soil type were applied to predicted canopy reflectance at a different soil background.
The Sustainable Development Assessment of Reservoir Resettlement Based on a BP Neural Network
Directory of Open Access Journals (Sweden)
Li Huang
2018-01-01
Full Text Available Resettlement affects not only the resettlers’ production activities and life but also, directly or indirectly, the normal operation of power stations, the sustainable development of the resettlers, and regional social stability. Therefore, a scientific evaluation index system for the sustainable development of reservoir resettlement must be established that fits Chinese national conditions and not only promotes reservoir resettlement research but also improves resettlement practice. This essay builds an evaluation index system for resettlers’ sustainable development based on a back-propagation (BP neural network, which can be adopted in China, taking the resettlement necessitated by step hydropower stations along the Wujiang River cascade as an example. The assessment results show that the resettlement caused by step power stations along the Wujiang River is sustainable, and this evaluation supports the conclusion that national policies and regulations, which are undergoing constant improvement, and resettlement has increasingly improved. The results provide a reference for hydropower reservoir resettlement in developing countries.
Multiple modes of action potential initiation and propagation in mitral cell primary dendrite
DEFF Research Database (Denmark)
Chen, Wei R; Shen, Gongyu Y; Shepherd, Gordon M
2002-01-01
in the distal primary dendrite but failed to propagate to the soma. As the inhibition became weaker, a "double-spike" was often observed at the dendritic recording site, corresponding to a single action potential at the soma. Simulation demonstrated that, in the course of forward propagation of the first......-to-moderate olfactory nerve input, an action potential was initiated near the soma and then back-propagated into the primary dendrite. As olfactory nerve input increased, the initiation site suddenly shifted to the distal primary dendrite. Multi-compartmental modeling indicated that this abrupt shift of the spike...... dendritic spike, the action potential suddenly jumps from the middle of the dendrite to the axonal spike-initiation site, leaving the proximal part of primary dendrite unexcited by this initial dendritic spike. As Na(+) conductances in the proximal dendrite are not activated, they become available...
Transform preprocessing for neural networks for object recogniition and localization with sonar
Barshan, Billur; Ayrulu, Birsel
2003-04-01
We investigate the pre-processing of sonar signals prior to using neural networks for robust differentiation of commonly encountered features in indoor environments. Amplitude and time-of-flight measurement patterns acquired from a real sonar system are pre-processed using various techniques including wavelet transforms, Fourier and fractional Fourier transforms, and Kohonen's self-organizing feature map. Modular and non-modular neural network structures trained with the back-propagation and generating-shrinking algorithms are used to incorporate learning in the identification of parameter relations for target primitives. Networks trained with the generating-shrinking algorithm demonstrate better generalization and interpolation capability and faster convergence rate. The use of neural networks trained with the back-propagation algorithm, usually with fractional Fourier transform or wavelet pre-processing results in near perfect differentiation, around 85% correct range estimation and around 95% correct azimuth estimation, which would be satisfactory in a wide range of applications. Neural networks can differentiate more targets, employing only a single sensor node, with a higher correct differentiation percentage than achieved with previously reported methods employing multiple sensor nodes. The success of the neural network approach shows that the sonar signals do contain sufficient information to differentiate a considerable number of target types, but the previously reported methods are unable to resolve this identifying information. This work can find application in areas where recognition of patterns hidden in sonar signals is required. Some examples are system control based on acoustic signal detection and identification, map building, navigation, obstacle avoidance, and target-tracking applications for mobile robots and other intelligent systems.
Directory of Open Access Journals (Sweden)
Lucimar M.F. de Carvalho
2008-06-01
Full Text Available OBJECTIVE: To investigate different fuzzy arithmetical operations to support in the diagnostic of epileptic events and non epileptic events. METHOD: A neuro-fuzzy system was developed using the NEFCLASS (NEuro Fuzzy CLASSIfication architecture and an artificial neural network with backpropagation learning algorithm (ANNB. RESULTS: The study was composed by 244 patients with a bigger frequency of the feminine sex. The number of right decisions at the test phase, obtained by the NEFCLASS and ANNB was 83.60% and 90.16%, respectively. The best sensibility result was attained by NEFCLASS (84.90%; the best specificity result were attained by ANNB with 95.65%. CONCLUSION: The proposed neuro-fuzzy system combined the artificial neural network capabilities in the pattern classifications together with the fuzzy logic qualitative approach, leading to a bigger rate of system success.OBJETIVO: Investigar diferentes operações aritméticas difusas para auxíliar no diagnóstico de eventos epilépticos e eventos não-epilépticos. MÉTODO: Um sistema neuro-difuso foi desenvolvido utilizando a arquitetura NEFCLASS (NEuro Fuzzy CLASSIfication e uma rede neural artificial com o algoritmo de aprendizagem backpropagation (RNAB. RESULTADOS: A amostra estudada foi de 244 pacientes com maior freqüência no sexo feminino. O número de decisões corretas na fase de teste, obtidas através do NEFCLASS e RNAB foi de 83,60% e 90,16%, respectivamente. O melhor resultado de sensibilidade foi obtido com o NEFCLASS (84,90%; o melhor resultado de especificidade foi obtido com a RNAB (95,65%. CONCLUSÃO: O sistema neuro-difuso proposto combinou a capacidade das redes neurais artificiais na classificação de padrões juntamente com a abordagem qualitativa da logica difusa, levando a maior taxa de acertos do sistema.
Lure, Y. M. Fleming; Grody, Norman C.; Chiou, Y. S. Peter; Yeh, H. Y. Michael
1993-01-01
A data fusion system with artificial neural networks (ANN) is used for fast and accurate classification of five earth surface conditions and surface changes, based on seven SSMI multichannel microwave satellite measurements. The measurements include brightness temperatures at 19, 22, 37, and 85 GHz at both H and V polarizations (only V at 22 GHz). The seven channel measurements are processed through a convolution computation such that all measurements are located at same grid. Five surface classes including non-scattering surface, precipitation over land, over ocean, snow, and desert are identified from ground-truth observations. The system processes sensory data in three consecutive phases: (1) pre-processing to extract feature vectors and enhance separability among detected classes; (2) preliminary classification of Earth surface patterns using two separate and parallely acting classifiers: back-propagation neural network and binary decision tree classifiers; and (3) data fusion of results from preliminary classifiers to obtain the optimal performance in overall classification. Both the binary decision tree classifier and the fusion processing centers are implemented by neural network architectures. The fusion system configuration is a hierarchical neural network architecture, in which each functional neural net will handle different processing phases in a pipelined fashion. There is a total of around 13,500 samples for this analysis, of which 4 percent are used as the training set and 96 percent as the testing set. After training, this classification system is able to bring up the detection accuracy to 94 percent compared with 88 percent for back-propagation artificial neural networks and 80 percent for binary decision tree classifiers. The neural network data fusion classification is currently under progress to be integrated in an image processing system at NOAA and to be implemented in a prototype of a massively parallel and dynamically reconfigurable Modular
Non-Hebbian spike-timing-dependent plasticity in cerebellar circuits
Piochon, Claire; Kruskal, Peter; MacLean, Jason; Hansel, Christian
2013-01-01
Spike-timing-dependent plasticity (STDP) provides a cellular implementation of the Hebb postulate, which states that synapses, whose activity repeatedly drives action potential firing in target cells, are potentiated. At glutamatergic synapses onto hippocampal and neocortical pyramidal cells, synaptic activation followed by spike firing in the target cell causes long-term potentiation (LTP)—as predicted by Hebb—whereas excitatory postsynaptic potentials (EPSPs) evoked after a spike elicit long-term depression (LTD)—a phenomenon that was not specifically addressed by Hebb. In both instances the action potential in the postsynaptic target neuron is an instructive signal that is capable of supporting synaptic plasticity. STDP generally relies on the propagation of Na+ action potentials that are initiated in the axon hillhock back into the dendrite, where they cause depolarization and boost local calcium influx. However, recent studies in CA1 hippocampal pyramidal neurons have suggested that local calcium spikes might provide a more efficient trigger for LTP induction than backpropagating action potentials. Dendritic calcium spikes also play a role in an entirely different type of STDP that can be observed in cerebellar Purkinje cells. These neurons lack backpropagating Na+ spikes. Instead, plasticity at parallel fiber (PF) to Purkinje cell synapses depends on the relative timing of PF-EPSPs and activation of the glutamatergic climbing fiber (CF) input that causes dendritic calcium spikes. Thus, the instructive signal in this system is externalized. Importantly when EPSPs are elicited before CF activity, PF-LTD is induced rather than LTP. Thus, STDP in the cerebellum follows a timing rule that is opposite to its hippocampal/neocortical counterparts. Regardless, a common motif in plasticity is that LTD/LTP induction depends on the relative timing of synaptic activity and regenerative dendritic spikes which are driven by the instructive signal. PMID:23335888
Kolles, H; von Wangenheim, A; Rahmel, J; Niedermayer, I; Feiden, W
1996-08-01
To compare four data-driven approaches to automated tumor grading based on morphometric data. Apart from the statistical procedure of linear discriminant analysis, three other approaches from the field of neural computing were evaluated. The numerical basis of this study was computed tomography-guided, stereotactically obtained astrocytoma biopsies from 86 patients colored with a combination of Feulgen and immunhistochemical Ki-67 (MIB1) staining. In these biopsies the cell nuclei in four consecutive fields of vision were evaluated morphometrically and the following parameters determined: relative nuclei area, secant lengths of the minimal spanning trees and relative volume-weighted mean nuclear volumes of the proliferating nuclei. Based on the analysis of these morphometric features, the multivariate-generated HOM grading system provides the highest correct grading rates (> 90%), whereas the two widely employed qualitative histologic grading systems for astrocytomas yield correct grading rates of about 60%. For automated tumor grading all approaches yield similar grading results; however, back-propagation networks provide reliable results only following an extensive training phase, which requires the use of a supercomputer. All other neurocomputing models can be run on simple UNIX workstations (AT&T, U.S.A). In contrast to discriminant analysis, backpropagation and Kohonen networks, the newly developed neural network architecture model of self-editing nearest neighbor nets (SEN3) provides incremental learning; i.e., the training phase does not need to be restarted each time when there is further information to learn. Trained SEN3 networks can be considered ready-to-use knowledge bases and are appropriate to integrating further morphometric data in a dynamic process that enhances the diagnostic power of such a network.
Identification of lithofacies using Kohonen self-organizing maps
Chang, H.-C.; Kopaska-Merkel, D. C.; Chen, H.-C.
2002-01-01
Lithofacies identification is a primary task in reservoir characterization. Traditional techniques of lithofacies identification from core data are costly, and it is difficult to extrapolate to non-cored wells. We present a low-cost automated technique using Kohonen self-organizing maps (SOMs) to identify systematically and objectively lithofacies from well log data. SOMs are unsupervised artificial neural networks that map the input space into clusters in a topological form whose organization is related to trends in the input data. A case study used five wells located in Appleton Field, Escambia County, Alabama (Smackover Formation, limestone and dolomite, Oxfordian, Jurassic). A five-input, one-dimensional output approach is employed, assuming the lithofacies are in ascending/descending order with respect to paleoenvironmental energy levels. To consider the possible appearance of new logfacies not seen in training mode, which may potentially appear in test wells, the maximum number of outputs is set to 20 instead of four, the designated number of lithosfacies in the study area. This study found eleven major clusters. The clusters were compared to depositional lithofacies identified by manual core examination. The clusters were ordered by the SOM in a pattern consistent with environmental gradients inferred from core examination: bind/boundstone, grainstone, packstone, and wackestone. This new approach predicted lithofacies identity from well log data with 78.8% accuracy which is more accurate than using a backpropagation neural network (57.3%). The clusters produced by the SOM are ordered with respect to paleoenvironmental energy levels. This energy-related clustering provides geologists and petroleum engineers with valuable geologic information about the logfacies and their interrelationships. This advantage is not obtained in backpropagation neural networks and adaptive resonance theory neural networks. ?? 2002 Elsevier Science Ltd. All rights reserved.
Optimization of neural network architecture for classification of radar jamming FM signals
Soto, Alberto; Mendoza, Ariadna; Flores, Benjamin C.
2017-05-01
The purpose of this study is to investigate several artificial Neural Network (NN) architectures in order to design a cognitive radar system capable of optimally distinguishing linear Frequency-Modulated (FM) signals from bandlimited Additive White Gaussian Noise (AWGN). The goal is to create a theoretical framework to determine an optimal NN architecture to achieve a Probability of Detection (PD) of 95% or higher and a Probability of False Alarm (PFA) of 1.5% or lower at 5 dB Signal to Noise Ratio (SNR). Literature research reveals that the frequency-domain power spectral densities characterize a signal more efficiently than its time-domain counterparts. Therefore, the input data is preprocessed by calculating the magnitude square of the Discrete Fourier Transform of the digitally sampled bandlimited AWGN and linear FM signals to populate a matrix containing N number of samples and M number of spectra. This matrix is used as input for the NN, and the spectra are divided as follows: 70% for training, 15% for validation, and 15% for testing. The study begins by experimentally deducing the optimal number of hidden neurons (1-40 neurons), then the optimal number of hidden layers (1-5 layers), and lastly, the most efficient learning algorithm. The training algorithms examined are: Resilient Backpropagation, Scaled Conjugate Gradient, Conjugate Gradient with Powell/Beale Restarts, Polak-Ribiére Conjugate Gradient, and Variable Learning Rate Backpropagation. We determine that an architecture with ten hidden neurons (or higher), one hidden layer, and a Scaled Conjugate Gradient for training algorithm encapsulates an optimal architecture for our application.
Directory of Open Access Journals (Sweden)
Etay Hay
2011-07-01
Full Text Available The thick-tufted layer 5b pyramidal cell extends its dendritic tree to all six layers of the mammalian neocortex and serves as a major building block for the cortical column. L5b pyramidal cells have been the subject of extensive experimental and modeling studies, yet conductance-based models of these cells that faithfully reproduce both their perisomatic Na(+-spiking behavior as well as key dendritic active properties, including Ca(2+ spikes and back-propagating action potentials, are still lacking. Based on a large body of experimental recordings from both the soma and dendrites of L5b pyramidal cells in adult rats, we characterized key features of the somatic and dendritic firing and quantified their statistics. We used these features to constrain the density of a set of ion channels over the soma and dendritic surface via multi-objective optimization with an evolutionary algorithm, thus generating a set of detailed conductance-based models that faithfully replicate the back-propagating action potential activated Ca(2+ spike firing and the perisomatic firing response to current steps, as well as the experimental variability of the properties. Furthermore, we show a useful way to analyze model parameters with our sets of models, which enabled us to identify some of the mechanisms responsible for the dynamic properties of L5b pyramidal cells as well as mechanisms that are sensitive to morphological changes. This automated framework can be used to develop a database of faithful models for other neuron types. The models we present provide several experimentally-testable predictions and can serve as a powerful tool for theoretical investigations of the contribution of single-cell dynamics to network activity and its computational capabilities.
GPU-Accelerated Adjoint Algorithmic Differentiation.
Gremse, Felix; Höfter, Andreas; Razik, Lukas; Kiessling, Fabian; Naumann, Uwe
2016-03-01
Many scientific problems such as classifier training or medical image reconstruction can be expressed as minimization of differentiable real-valued cost functions and solved with iterative gradient-based methods. Adjoint algorithmic differentiation (AAD) enables automated computation of gradients of such cost functions implemented as computer programs. To backpropagate adjoint derivatives, excessive memory is potentially required to store the intermediate partial derivatives on a dedicated data structure, referred to as the "tape". Parallelization is difficult because threads need to synchronize their accesses during taping and backpropagation. This situation is aggravated for many-core architectures, such as Graphics Processing Units (GPUs), because of the large number of light-weight threads and the limited memory size in general as well as per thread. We show how these limitations can be mediated if the cost function is expressed using GPU-accelerated vector and matrix operations which are recognized as intrinsic functions by our AAD software. We compare this approach with naive and vectorized implementations for CPUs. We use four increasingly complex cost functions to evaluate the performance with respect to memory consumption and gradient computation times. Using vectorization, CPU and GPU memory consumption could be substantially reduced compared to the naive reference implementation, in some cases even by an order of complexity. The vectorization allowed usage of optimized parallel libraries during forward and reverse passes which resulted in high speedups for the vectorized CPU version compared to the naive reference implementation. The GPU version achieved an additional speedup of 7.5 ± 4.4, showing that the processing power of GPUs can be utilized for AAD using this concept. Furthermore, we show how this software can be systematically extended for more complex problems such as nonlinear absorption reconstruction for fluorescence-mediated tomography.
Directory of Open Access Journals (Sweden)
Manoj Bhasin
Full Text Available Vein graft failure occurs between 1 and 6 months after implantation due to obstructive intimal hyperplasia, related in part to implantation injury. The cell-specific and temporal response of the transcriptome to vein graft implantation injury was determined by transcriptional profiling of laser capture microdissected endothelial cells (EC and medial smooth muscle cells (SMC from canine vein grafts, 2 hours (H to 30 days (D following surgery. Our results demonstrate a robust genomic response beginning at 2 H, peaking at 12-24 H, declining by 7 D, and resolving by 30 D. Gene ontology and pathway analyses of differentially expressed genes indicated that implantation injury affects inflammatory and immune responses, apoptosis, mitosis, and extracellular matrix reorganization in both cell types. Through backpropagation an integrated network was built, starting with genes differentially expressed at 30 D, followed by adding upstream interactive genes from each prior time-point. This identified significant enrichment of IL-6, IL-8, NF-κB, dendritic cell maturation, glucocorticoid receptor, and Triggering Receptor Expressed on Myeloid Cells (TREM-1 signaling, as well as PPARα activation pathways in graft EC and SMC. Interactive network-based analyses identified IL-6, IL-8, IL-1α, and Insulin Receptor (INSR as focus hub genes within these pathways. Real-time PCR was used for the validation of two of these genes: IL-6 and IL-8, in addition to Collagen 11A1 (COL11A1, a cornerstone of the backpropagation. In conclusion, these results establish causality relationships clarifying the pathogenesis of vein graft implantation injury, and identifying novel targets for its prevention.
Learning in the machine: The symmetries of the deep learning channel.
Baldi, Pierre; Sadowski, Peter; Lu, Zhiqin
2017-11-01
In a physical neural system, learning rules must be local both in space and time. In order for learning to occur, non-local information must be communicated to the deep synapses through a communication channel, the deep learning channel. We identify several possible architectures for this learning channel (Bidirectional, Conjoined, Twin, Distinct) and six symmetry challenges: (1) symmetry of architectures; (2) symmetry of weights; (3) symmetry of neurons; (4) symmetry of derivatives; (5) symmetry of processing; and (6) symmetry of learning rules. Random backpropagation (RBP) addresses the second and third symmetry, and some of its variations, such as skipped RBP (SRBP) address the first and the fourth symmetry. Here we address the last two desirable symmetries showing through simulations that they can be achieved and that the learning channel is particularly robust to symmetry variations. Specifically, random backpropagation and its variations can be performed with the same non-linear neurons used in the main input-output forward channel, and the connections in the learning channel can be adapted using the same algorithm used in the forward channel, removing the need for any specialized hardware in the learning channel. Finally, we provide mathematical results in simple cases showing that the learning equations in the forward and backward channels converge to fixed points, for almost any initial conditions. In symmetric architectures, if the weights in both channels are small at initialization, adaptation in both channels leads to weights that are essentially symmetric during and after learning. Biological connections are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.
Algebraic and adaptive learning in neural control systems
Ferrari, Silvia
A systematic approach is developed for designing adaptive and reconfigurable nonlinear control systems that are applicable to plants modeled by ordinary differential equations. The nonlinear controller comprising a network of neural networks is taught using a two-phase learning procedure realized through novel techniques for initialization, on-line training, and adaptive critic design. A critical observation is that the gradients of the functions defined by the neural networks must equal corresponding linear gain matrices at chosen operating points. On-line training is based on a dual heuristic adaptive critic architecture that improves control for large, coupled motions by accounting for actual plant dynamics and nonlinear effects. An action network computes the optimal control law; a critic network predicts the derivative of the cost-to-go with respect to the state. Both networks are algebraically initialized based on prior knowledge of satisfactory pointwise linear controllers and continue to adapt on line during full-scale simulations of the plant. On-line training takes place sequentially over discrete periods of time and involves several numerical procedures. A backpropagating algorithm called Resilient Backpropagation is modified and successfully implemented to meet these objectives, without excessive computational expense. This adaptive controller is as conservative as the linear designs and as effective as a global nonlinear controller. The method is successfully implemented for the full-envelope control of a six-degree-of-freedom aircraft simulation. The results show that the on-line adaptation brings about improved performance with respect to the initialization phase during aircraft maneuvers that involve large-angle and coupled dynamics, and parameter variations.
GPU-accelerated adjoint algorithmic differentiation
Gremse, Felix; Höfter, Andreas; Razik, Lukas; Kiessling, Fabian; Naumann, Uwe
2016-03-01
Many scientific problems such as classifier training or medical image reconstruction can be expressed as minimization of differentiable real-valued cost functions and solved with iterative gradient-based methods. Adjoint algorithmic differentiation (AAD) enables automated computation of gradients of such cost functions implemented as computer programs. To backpropagate adjoint derivatives, excessive memory is potentially required to store the intermediate partial derivatives on a dedicated data structure, referred to as the ;tape;. Parallelization is difficult because threads need to synchronize their accesses during taping and backpropagation. This situation is aggravated for many-core architectures, such as Graphics Processing Units (GPUs), because of the large number of light-weight threads and the limited memory size in general as well as per thread. We show how these limitations can be mediated if the cost function is expressed using GPU-accelerated vector and matrix operations which are recognized as intrinsic functions by our AAD software. We compare this approach with naive and vectorized implementations for CPUs. We use four increasingly complex cost functions to evaluate the performance with respect to memory consumption and gradient computation times. Using vectorization, CPU and GPU memory consumption could be substantially reduced compared to the naive reference implementation, in some cases even by an order of complexity. The vectorization allowed usage of optimized parallel libraries during forward and reverse passes which resulted in high speedups for the vectorized CPU version compared to the naive reference implementation. The GPU version achieved an additional speedup of 7.5 ± 4.4, showing that the processing power of GPUs can be utilized for AAD using this concept. Furthermore, we show how this software can be systematically extended for more complex problems such as nonlinear absorption reconstruction for fluorescence-mediated tomography.
Directory of Open Access Journals (Sweden)
Irina Popova
2013-08-01
Full Text Available Very-low-frequency/ low-frequency (VLF/LF sub-ionospheric radiowave monitoring has been widely used in recent years to analyze earthquake preparatory processes. The connection between earthquakes with M ≥5.5 and nighttime disturbances of signal amplitude and phase has been established. Thus, it is possible to use nighttime anomalies of VLF/LF signals as earthquake precursors. Here, we propose a method for estimation of the VLF/LF signal sensitivity to seismic processes using a neural network approach. We apply the error back-propagation technique based on a three-level perceptron to predict a seismic event. The back-propagation technique involves two main stages to solve the problem; namely, network training, and recognition (the prediction itself. To train a neural network, we first create a so-called ‘training set’. The ‘teacher’ specifies the correspondence between the chosen input and the output data. In the present case, a representative database includes both the LF data received over three years of monitoring at the station in Petropavlovsk-Kamchatsky (2005-2007, and the seismicity parameters of the Kuril-Kamchatka and Japanese regions. At the first stage, the neural network established the relationship between the characteristic features of the LF signal (the mean and dispersion of a phase and an amplitude at nighttime for a few days before a seismic event and the corresponding level of correlation with a seismic event, or the absence of a seismic event. For the second stage, the trained neural network was applied to predict seismic events from the LF data using twelve time intervals in 2004, 2005, 2006 and 2007. The results of the prediction are discussed.
Experimental investigation on valveless air-breathing dual-tube pulse detonation engines
International Nuclear Information System (INIS)
Peng, Changxin; Fan, Wei; Zheng, Longxi; Wang, Zhiwu; Yuan, Cheng
2013-01-01
Two-phase dual-tube air-breathing pulse detonation engine (APDE) experiments were performed to improve the understanding of the characteristics of valveless multi-tube APDE. Two different operation patterns were studied: simultaneously and single-tube firing. The synchronicity of detonation waves was quantified. The time interval was less than 1 ms and decreased with the increasing frequency. It was found which detonation wave arrived firstly had a degree of randomness. The situation that the detonation wave in a certain tube always kept ahead never happened in the experiments. The back-propagation pressure wave in the upstream inlet was also not synchronous. Its synchronicity was a little inferior than the detonation wave's and also improved with the increasing frequency. The pressure-rise occurred twice successively in the common air inlet and prolonged the period of pressure oscillations therein. The results of single-tube firing showed that the flow field in the non-detonate chamber was not only influenced by the diffracted wave downstream from the neighboring tube but also by the upstream-propagating pressure wave. Compared with the dual-tube firing, the operation pattern of single-tube firing is beneficial to reduce the pressure disturbance in the common air inlet. -- Highlights: ► Two-phase dual-tube APDE experiments were performed. ► The synchronicity of detonation waves was quantified. ► The synchronicity of back-propagation pressure was quantified. ► The flow field under different operation patterns were studied
Directory of Open Access Journals (Sweden)
Erlandsson Anthony de Sousa
2003-12-01
Full Text Available A carne mecanicamente separada (CMS de frango é uma matéria-prima cárnea produzida através de equipamentos próprios do tipo desossadores mecânicos, utilizando partes de frango de baixo valor comercial como o dorso e o pescoço. Para determinação do teor de CMS utilizada na composição de produtos cárneos comerciais construímos uma rede neural artificial do tipo Backpropagation (BP. O objetivo deste trabalho foi treinar, testar e aplicar uma rede do tipo BP, com três camadas de neurônios, para previsão do teor de CMS a partir do teor de minerais de salsichas formuladas com diferentes teores de carne de frango mecanicamente separada. Utilizamos a composição mineral de 29 amostras de salsicha contendo diferentes teores de CMS e 22 amostras de produtos cárneos comerciais. A topologia da rede foi 5-5-1. O erro quadrático médio no conjunto de treinamento foi de 2,4% e na fase de teste foi de apenas 3,8%. No entanto, a aplicação da rede às amostras comerciais foi inadequada devido à diferença de ingredientes das salsichas usadas no treinamento e os ingredientes das amostras comerciais. A rede neural construída para determinação do teor de carne mecanicamente separada mostrou-se eficiente durante a fase de treinamento e teste da rede.Mechanically Deboned Poultry Meat (MDPM is constituted of the neck and back from chicken carcasses that are extracted in machine. An artificial neural network of the Back-Propagation type was built to determine the amount of MDPM in the composition of commercial foods. The objective of this work was to train, evaluate and apply a network of the Back-Propagation type, with three layers of neurons, in predicting the amount of MDPM in relation to the amount of minerals in the sausage. We used the mineral composition of 29 product samples that contained different amounts of MDPM and 23 commercial samples. The topology of the network was a 5-5-1. The average quadratic error in the training group was of
Kadiyala, Akhil; Kaur, Devinder; Kumar, Ashok
2013-02-01
The present study developed a novel approach to modeling indoor air quality (IAQ) of a public transportation bus by the development of hybrid genetic-algorithm-based neural networks (also known as evolutionary neural networks) with input variables optimized from using the regression trees, referred as the GART approach. This study validated the applicability of the GART modeling approach in solving complex nonlinear systems by accurately predicting the monitored contaminants of carbon dioxide (CO2), carbon monoxide (CO), nitric oxide (NO), sulfur dioxide (SO2), 0.3-0.4 microm sized particle numbers, 0.4-0.5 microm sized particle numbers, particulate matter (PM) concentrations less than 1.0 microm (PM10), and PM concentrations less than 2.5 microm (PM2.5) inside a public transportation bus operating on 20% grade biodiesel in Toledo, OH. First, the important variables affecting each monitored in-bus contaminant were determined using regression trees. Second, the analysis of variance was used as a complimentary sensitivity analysis to the regression tree results to determine a subset of statistically significant variables affecting each monitored in-bus contaminant. Finally, the identified subsets of statistically significant variables were used as inputs to develop three artificial neural network (ANN) models. The models developed were regression tree-based back-propagation network (BPN-RT), regression tree-based radial basis function network (RBFN-RT), and GART models. Performance measures were used to validate the predictive capacity of the developed IAQ models. The results from this approach were compared with the results obtained from using a theoretical approach and a generalized practicable approach to modeling IAQ that included the consideration of additional independent variables when developing the aforementioned ANN models. The hybrid GART models were able to capture majority of the variance in the monitored in-bus contaminants. The genetic
Hernández-Caraballo, Edwin A; Rivas, Francklin; de Hernández, Rita M Avila
2005-02-01
A generalized regression artificial neural network (GRANN) was developed and evaluated for modeling cadmium's nonlinear calibration curve in order to extend its upper concentration limit from 4.0 microg L-1 up to 22.0 microg L-1. This type of neural network presents important advantages over the more popular backpropagation counterpart which are worth exploiting in analytical applications, namely, (1) a smaller number of variables have to be optimized, with the subsequent reduction in "development hassle"; and, (2) shorter development times, thanks to the fact that the adjustment of the weights (the artificial synapses) is a non-iterative, one-pass process. A backpropagation artificial neural network (BPANN), a second-order polynomial, and some less frequently employed polynomial and exponential functions (e.g., Gaussian, Lorentzian, and Boltzmann), were also evaluated for comparison purposes. The quality of the fit of the various models, assessed by calculating the root mean square of the percentage deviations, was as follows: GRANN>Boltzmann>second-order polynomial>BPANN>Gauss>Lorentz. The accuracy and precision of the models were further estimated through the determination of cadmium in the certified reference material "Trace Metals in Drinking Water" (High Purity Standards, Lot No. 490915), which has a cadmium certified concentration (12.00+/-0.06 microg L-1) that lies in the nonlinear regime of the calibration curve. Only the models generated by the GRANN and BPANN accurately predicted the concentrations of a series of solutions, prepared by serial dilution of the CRM, with cadmium concentrations below and above the maximum linear calibration limit (4.0 microg L-1). Extension of the working range by using the proposed methodology represents an attractive alternative from the analytical point of view, since it results in less specimen manipulation and consequently reduced contamination risks without compromising either the accuracy or the precision of the
International Nuclear Information System (INIS)
Kim, Wan Joo
1993-02-01
In order to assist the operators at the transient states of a nuclear power plant, the automation of signal processing is needed. This study has the objective to process the signals from a nuclear power plant for the purpose of advising the operator. To meet this objective, in this study, two kinds of on-line signal processing system based on AI techniques are developed for the nuclear power plant application with on-line signals. First, an artificial neural network for signal prediction is developed for the adequate countermoves at transient states. The steam generator water level is adopted as the example and the outputs of a simulation program for the dynamics of steam generator combined with noises are used as the training patterns. For the training of the artificial neural network, the modified backpropagation algorithm is proposed for escaping quickly from local minima. The modified algorithm is different from the ordinary backpropagation algorithm in the aspect that the training rate coefficient is repeatedly adjusted randomly and taken when the training is improved. This trial has an effect to search for an adequate magnitude of a training rate coefficient. The comparison result shows that the modified algorithm enables the neural network to be trained more quickly. The simulation result shows that the outputs of the artificial neural network are not sensitive to noises. Using the artificial neural networks proposed in this thesis, the operators can predict the next status of a plant and can take actions to maintain the stability of plant. Second, the multi sensor integration system has been developed for the identification of transient states. The developed system is divided into two parts; pre-processors and a fusion part. An artificial neural network is adopted in the fusion part to include the knowledge about the identification and to make a decision of the transient state. The developed pre-processors play a role of classifying the trend types of