Fuzzy neural network with fast backpropagation learning
Wang, Zhiling; De Sario, Marco; Guerriero, Andrea; Mugnuolo, Raffaele
1995-03-01
Neural filters with multilayer backpropagation network have been proved to be able to define mostly all linear or non-linear filters. Because of the slowness of the networks' convergency, however, the applicable fields have been limited. In this paper, fuzzy logic is introduced to adjust learning rate and momentum parameter depending upon output errors and training times. This makes the convergency of the network greatly improved. Test curves are shown to prove the fast filters' performance.
Prediction of tides using back-propagation neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.
Prediction of tides is very much essential for human activities and to reduce the construction cost in marine environment. This paper presents an application of the artificial neural network with back-propagation procedures for accurate prediction...
Impact of Mutation Weights on Training Backpropagation Neural Networks
Directory of Open Access Journals (Sweden)
Lamia Abed Noor Muhammed
2014-07-01
Full Text Available Neural network is a computational approach, which based on the simulation of biology neural network. This approach is conducted by several parameters; learning rate, initialized weights, network architecture, and so on. However, this paper would be focused on one of these parameters that is weights. The aim is to shed lights on the mutation weights through training network and its effects on the results. The experiment was done using backpropagation neural network with one hidden layer. The results reveal the role of mutation in escape from the local minima and making the change
Conjugate descent formulation of backpropagation error in feedforward neural networks
Sharma NK; Kumar, S; Singh MP
2009-01-01
The feedforward neural network architecture uses backpropagation learning to determine optimal weights between different interconnected layers. This learning procedure uses a gradient descent technique applied to a sum-of-squares error function for the given input-output pattern. It employs an iterative procedure to minimise the error function for a given set of patterns, by adjusting the weights of the network. The first derivates of the error with respect to the weights identify the local e...
LVQ and backpropagation neural networks applied to NASA SSME data
Doniere, Timothy F.; Dhawan, Atam P.
1993-01-01
Feedfoward neural networks with backpropagation learning have been used as function approximators for modeling the space shuttle main engine (SSME) sensor signals. The modeling of these sensor signals is aimed at the development of a sensor fault detection system that can be used during ground test firings. The generalization capability of a neural network based function approximator depends on the training vectors which in this application may be derived from a number of SSME ground test-firings. This yields a large number of training vectors. Large training sets can cause the time required to train the network to be very large. Also, the network may not be able to generalize for large training sets. To reduce the size of the training sets, the SSME test-firing data is reduced using the learning vector quantization (LVQ) based technique. Different compression ratios were used to obtain compressed data in training the neural network model. The performance of the neural model trained using reduced sets of training patterns is presented and compared with the performance of the model trained using complete data. The LVQ can also be used as a function approximator. The performance of the LVQ as a function approximator using reduced training sets is presented and compared with the performance of the backpropagation network.
Ocean wave parameters estimation using backpropagation neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; SubbaRao; Raju, D.H.
and oceanographic data. Wave forecasting by wave models is useful in the planning and maintenance of marine activities. Just as weather conditions, the wave conditions will change from year to year, thus a proper statistical analysis requires several ARTICLE... functional relation is not clear. Deo and Naidu [6] and Deo et al. [7] have carried out applications of the NN for wave forecasting and Subba Rao et al. [8] have worked on wave propagation using backpropagation neural network (BNN). Subba Rao and Mandal [9...
Backpropagation Artificial Neural Network To Detect Hyperthermic Seizures In Rats
Directory of Open Access Journals (Sweden)
Rakesh Kumar Sinha
2003-02-01
Full Text Available A three-layered feed-forward back-propagation Artificial Neural Network was used to classify the seizure episodes in rats. Seizure patterns were induced by subjecting anesthetized rats to a Biological Oxygen Demand incubator at 45-47ºC for 30 to 60 minutes. Selected fast Fourier transform data of one second epochs of electroencephalogram were used to train and test the network for the classification of seizure and normal patterns. The results indicate that the present network with the architecture of 40-12-1 (input-hidden-output nodes agrees with manual scoring of seizure and normal patterns with a high recognition rate of 98.6%.
Backpropagation Neural Network Modeling for Fault Location in Transmission Line 150 kV
Directory of Open Access Journals (Sweden)
Azriyenni Narwan
2014-03-01
Full Text Available In this topic research was provided about the backpropagation neural network to detect fault location in transmission line 150 kV between substation to substation. The distance relay is one of the good protective device and safety devices that often used on transmission line 150 kV. The disturbances in power system are used distance relay protection equipment in the transmission line. However, it needs more increasing large load and network systems are increasing complex. The protection system use the digital control, in order to avoid the error calculation of the distance relay impedance settings and spent time will be more efficient. Then backpropagation neural network is a computational model that uses the training process that can be used to solve the problem of work limitations of distance protection relays. The backpropagation neural network does not have limitations cause of the impedance range setting. If the output gives the wrong result, so the correct of the weights can be minimized and also the response of galat, the backpropagation neural network is expected to be closer to the correct value. In the end, backpropagation neural network modeling is expected to detect the fault location and identify operational output current circuit breaker was tripped it. The tests are performance with interconnected system 150 kV of Riau Region.
Habarulema, J. B.; McKinnell, L.-A.
2012-05-01
In this work, results obtained by investigating the application of different neural network backpropagation training algorithms are presented. This was done to assess the performance accuracy of each training algorithm in total electron content (TEC) estimations using identical datasets in models development and verification processes. Investigated training algorithms are standard backpropagation (SBP), backpropagation with weight delay (BPWD), backpropagation with momentum (BPM) term, backpropagation with chunkwise weight update (BPC) and backpropagation for batch (BPB) training. These five algorithms are inbuilt functions within the Stuttgart Neural Network Simulator (SNNS) and the main objective was to find out the training algorithm that generates the minimum error between the TEC derived from Global Positioning System (GPS) observations and the modelled TEC data. Another investigated algorithm is the MatLab based Levenberg-Marquardt backpropagation (L-MBP), which achieves convergence after the least number of iterations during training. In this paper, neural network (NN) models were developed using hourly TEC data (for 8 years: 2000-2007) derived from GPS observations over a receiver station located at Sutherland (SUTH) (32.38° S, 20.81° E), South Africa. Verification of the NN models for all algorithms considered was performed on both "seen" and "unseen" data. Hourly TEC values over SUTH for 2003 formed the "seen" dataset. The "unseen" dataset consisted of hourly TEC data for 2002 and 2008 over Cape Town (CPTN) (33.95° S, 18.47° E) and SUTH, respectively. The models' verification showed that all algorithms investigated provide comparable results statistically, but differ significantly in terms of time required to achieve convergence during input-output data training/learning. This paper therefore provides a guide to neural network users for choosing appropriate algorithms based on the availability of computation capabilities used for research.
Training a Feed-Forward Neural Network with Artificial Bee Colony based Backpropagation Method
Directory of Open Access Journals (Sweden)
Sudarshan Nandy
2012-09-01
Full Text Available Back-propagation algorithm is one of the most widely used and popular techniques to optimize the feedforward neural network training. Nature inspired meta-heuristic algorithms also provide derivative-freesolution to optimize complex problem. Artificial bee colony algorithm is a nature inspired meta-heuristicalgorithm, mimicking the foraging or food source searching behaviour of bees in a bee colony and thisalgorithm is implemented in several applications for an improved optimized outcome. The proposedmethod in this paper includes an improved artificial bee colony algorithm based back-propagation neuralnetwork training method for fast and improved convergence rate of the hybrid neural network learningmethod. The result is analysed with the genetic algorithm based back-propagation method, and it isanother hybridized procedure of its kind. Analysis is performed over standard data sets, reflecting the lightof efficiency of proposed method in terms of convergence speed and rate.
Analog hardware for delta-backpropagation neural networks
Eberhardt, Silvio P. (Inventor)
1992-01-01
This is a fully parallel analog backpropagation learning processor which comprises a plurality of programmable resistive memory elements serving as synapse connections whose values can be weighted during learning with buffer amplifiers, summing circuits, and sample-and-hold circuits arranged in a plurality of neuron layers in accordance with delta-backpropagation algorithms modified so as to control weight changes due to circuit drift.
Backpropagation Neural Network Implementation for Medical Image Compression
Directory of Open Access Journals (Sweden)
Kamil Dimililer
2013-01-01
Full Text Available Medical images require compression, before transmission or storage, due to constrained bandwidth and storage capacity. An ideal image compression system must yield high-quality compressed image with high compression ratio. In this paper, Haar wavelet transform and discrete cosine transform are considered and a neural network is trained to relate the X-ray image contents to their ideal compression method and their optimum compression ratio.
Diagnosing coronary artery disease with a backpropagation neural network: Lessons learned
Energy Technology Data Exchange (ETDEWEB)
Turner, D.D. [Pacific Northwest Lab., Richland, WA (United States); Holmes, E.R. [Sacred Heart Medical Center, Spokane, WA (United States)
1995-12-31
The SPECT (single photon emitted computed tomography) procedure, while widely used for diagnosing coronary artery disease, is not a perfect technology. We have investigated using a backpropagation neural network to diagnose patients suffering from coronary artery disease that is independent from the SPECT procedure. The raw thallium-201 scintigrams produced before the SPECT tomographic reconstruction were used as input patterns for the backpropagation neural network, and the diagnoses resulting mainly from cardiac catheterization as the desired outputs for each pattern. Several preprocessing techniques were applied to the scintigrams, in an attempt to improve the information to noise ratio. After using the a procedure that extracted a subimage containing the heart from each scintigram, we used a data reduction technique, thereby encoding the scintigram in 12 values, which were the inputs to the backpropagation neural network. The network was then trained. This network per-formed superbly for patients suffering from inferolateral disease (classifying 10 out of 10 correctly), but performance was less than optimal for cases involving other coronary zones. While the scope of this project was limited to diagnosing coronary artery disease, this initial work can be extended to other medical imaging procedures, such as diagnosing breast cancer from a mammogram and evaluating lung perfusion studies.
Directory of Open Access Journals (Sweden)
Ikhthison Mekongga
2014-02-01
Full Text Available The need for bandwidth has been increasing recently. This is because the development of internet infrastructure is also increasing so that we need an economic and efficient provider system. This can be achieved through good planning and a proper system. The prediction of the bandwidth consumption is one of the factors that support the planning for an efficient internet service provider system. Bandwidth consumption is predicted using ANN. ANN is an information processing system which has similar characteristics as the biologic al neural network. ANN is chosen to predict the consumption of the bandwidth because ANN has good approachability to non-linearity. The variable used in ANN is the historical load data. A bandwidth consumption information system was built using neural networks with a backpropagation algorithm to make the use of bandwidth more efficient in the future both in the rental rate of the bandwidth and in the usage of the bandwidth.Keywords: Forecasting, Bandwidth, Backpropagation
Directory of Open Access Journals (Sweden)
Asif Ullah Khan
2011-03-01
Full Text Available Investment in stock market is one of the most popular type of investment. There are many conventional techniques being used and these include technical and fundamental analysis. The main aim of every investor is to earn maximum possible return on investments. The main issue with any approach is the proper weighting of criteria to obtain a list of stocks that are suitable for investments. This paper proposes an improved method for stock picking using self-organizing maps and genetic algorithm based backpropagation neural networks. The stock selected using self-organizing maps and genetic algorithm based backpropagation neural networks outperformed the BSE-30 Index by about 30.17% based on one and half month of stock data.
Attariuas Hicham; Bouhorma Mohammed; Sofi Anas
2012-01-01
ales forecasting is one of the most crucial issues addressed in business. Control and evaluation of future sales still seem concerned both researchers and policy makers and managers of companies. this research propose an intelligent hybrid sales forecasting system Delphi-FCBPN sales forecast based on Delphi Method, fuzzy clustering and Back-propagation (BP) Neural Networks with adaptive learning rate. The proposed model is constructed to integrate expert judgments, using Delphi method, in enh...
Assembly Quality Prediction Based on Back-propagation Artificial Neural Network
Directory of Open Access Journals (Sweden)
He Yong-yi
2013-07-01
Full Text Available Because of the severe geometrical distortion induced by the optical system and the limited kinetic accuracy of mechanical system in the vision-based mobile-phone lens’s assembly system, the nonlinear, perspective distortion errors and the kinematics errors generally exist in the assembly process of the mobile-phone lens. It is necessary to predict the assembly quality of the vision-based mobile-phone lens’s pick-and-place system so as to eliminate the immediate effect on the assembling process before extracting quantitative assembling. Comparison with current research methods, the back-propagation artificial neural network is applied to predict the assembly quality of the vision-based mobile-phone lens’s pick-and-place system. Firstly, the mobile-phone lens’s assembly quality characteristics are defined and sampled; Secondly, a back-propagation artificial neural network of the mobile-phone lens’s assembly quality prediction is presented; Finally apply some training samples obtained from the experiments to train and test this back-propagation artificial neural network. The results show that the proposed method is effective to predict the assembly quality of the vision-based mobile-phone lens’s pick-and-place system with high accuracy and high reliability.
Directory of Open Access Journals (Sweden)
Sheela Tiwari
2013-08-01
Full Text Available This paperexplores theapplicationof artificial neural networksfor online identification of a multimachinepower system.Arecurrent neural networkhas been proposedas the identifier of the two area, four machinesystemwhich is a benchmark system for studying electromechanical oscillations in multimachine powersystems. This neural identifier is trained using the static Backpropagation algorithm. The emphasis of thepaper is on investigating the performance of the variants of the Backpropagation algorithm in training theneural identifier. The paper also compares the performances of the neural identifiers trained usingvariantsof the Backpropagation algorithmover a wide range of operating conditions.The simulation resultsestablish a satisfactory performance of the trained neural identifiers in identification of the test powersystem
Application of the Backpropagation Neural Network Method in Designing Tungsten Heavy Alloy
Institute of Scientific and Technical Information of China (English)
ZHANG Zhao-hui; WANG Wei-jie; WANG Fu-chi; LI Shu-kui
2006-01-01
The model describing the dependence of the mechanical properties on the chemical composition and as deformation techniques of tungsten heavy alloy is established by the method of improved the backpropagation neural network. The mechanical properties' parameters of tungsten alloy and deformation techniques for tungsten alloy are used as the inputs. The chemical composition and deformation amount of tungsten alloy are used as the outputs. Then they are used for training the neural network. At the same time,the optimal number of the hidden neurons is obtained through the experiential equations,and the varied step learning method is adopted to ensure the stability of the training process. According to the requirements for mechanical properties,the chemical composition and the deformation condition for tungsten heavy alloy can be designed by this artificial neural network system.
Application of back-propagation neural networks to identification of seismic arrival types
Dai, Heng; MacBeth, Colin
1997-01-01
A back-propagation neural network (BPNN) approach is developed to identify P- and S-arrivals from three-component recordings of local earthquake data. The BPNN is trained by selecting trace segments of P- and S-waves and noise bursts converted into an attribute space based on the degree of polarization (DOP). After training, the network can automatically identify the type of arrival on earthquake recordings. Compared with manual analysis, a BPNN trained with nine groups of DOP segments can co...
Directory of Open Access Journals (Sweden)
Omaima N. A.
2010-01-01
Full Text Available Problem statement: The problem inherent to any digital image is the large amount of bandwidth required for transmission or storage. This has driven the research area of image compression to develop algorithms that compress images to lower data rates with better quality. Artificial neural networks are becoming attractive in image processing where high computational performance and parallel architectures are required. Approach: In this research, a three layered Backpropagation Neural Network (BPNN was designed for building image compression/decompression system. The Backpropagation neural network algorithm (BP was used for training the designed BPNN. Many techniques were used to speed up and improve this algorithm by using different BPNN architecture and different values of learning rate and momentum variables. Results: Experiments had been achieved, the results obtained, such as Compression Ratio (CR and peak signal to noise ratio (PSNR are compared with the performance of BP with different BPNN architecture and different learning parameters. The efficiency of the designed BPNN comes from reducing the chance of error occurring during the compressed image transmission through analog or digital channel. Conclusion: The performance of the designed BPNN image compression system can be increased by modifying the network itself, learning parameters and weights. Practically, we can note that the BPNN has the ability to compress untrained images but not in the same performance of the trained images.
A modified backpropagation algorithm for training neural networks on data with error bars
International Nuclear Information System (INIS)
A method is proposed for training multilayer feedforward neural networks on data contaminated with noise. Specifically, we consider the case that the artificial neural system is required to learn a physical mapping when the available values of the target variable are subject to experimental uncertainties, but are characterized by error bars. The proposed method, based on maximum likelihood criterion for parameter estimation, involves simple modifications of the on-line backpropagation learning algorithm. These include incorporation of the error-bar assignments in a pattern-specific learning rate, together with epochal updating of a new measure of model accuracy that replaces the usual mean-square error. The extended backpropagation algorithm is successfully tested on two problems relevant to the modelling of atomic-mass systematics by neural networks. Provided the underlying mapping is reasonably smooth, neural nets trained with the new procedure are able to learn the true function to a good approximation even in the presence of high levels of Gaussian noise. (author). 26 refs, 2 figs, 5 tabs
Scanner color management model based on improved back-propagation neural network
Institute of Scientific and Technical Information of China (English)
Xinwu Li
2008-01-01
Scanner color management is one of the key techniques for color reproduction in information optics.A new scanner color management model is presented based on analyzing rendering principle of scanning objects.In this model,a standard color target is taken as experimental sample.Color blocks in color shade area are used to substitute complete color space to solve the difficulties in selecting experimental color blocks.Immune genetic algorithm is used to correct back-propagation neural network(BPNN)to speed up the convergence of the model.Experimental results show that the model can improve the accuracy of scanner color management.
A new backpropagation learning algorithm for layered neural networks with nondifferentiable units.
Oohori, Takahumi; Naganuma, Hidenori; Watanabe, Kazuhisa
2007-05-01
We propose a digital version of the backpropagation algorithm (DBP) for three-layered neural networks with nondifferentiable binary units. This approach feeds teacher signals to both the middle and output layers, whereas with a simple perceptron, they are given only to the output layer. The additional teacher signals enable the DBP to update the coupling weights not only between the middle and output layers but also between the input and middle layers. A neural network based on DBP learning is fast and easy to implement in hardware. Simulation results for several linearly nonseparable problems such as XOR demonstrate that the DBP performs favorably when compared to the conventional approaches. Furthermore, in large-scale networks, simulation results indicate that the DBP provides high performance. PMID:17381272
Neural network for processing both spatial and temporal data with time based back-propagation
Villarreal, James A. (Inventor); Shelton, Robert O. (Inventor)
1993-01-01
Neural networks are computing systems modeled after the paradigm of the biological brain. For years, researchers using various forms of neural networks have attempted to model the brain's information processing and decision-making capabilities. Neural network algorithms have impressively demonstrated the capability of modeling spatial information. On the other hand, the application of parallel distributed models to the processing of temporal data has been severely restricted. The invention introduces a novel technique which adds the dimension of time to the well known back-propagation neural network algorithm. In the space-time neural network disclosed herein, the synaptic weights between two artificial neurons (processing elements) are replaced with an adaptable-adjustable filter. Instead of a single synaptic weight, the invention provides a plurality of weights representing not only association, but also temporal dependencies. In this case, the synaptic weights are the coefficients to the adaptable digital filters. Novelty is believed to lie in the disclosure of a processing element and a network of the processing elements which are capable of processing temporal as well as spacial data.
Back-Propagation Artificial Neural Networks for Water Supply Pipeline Model
Institute of Scientific and Technical Information of China (English)
朱东海; 张土乔; 毛根海
2002-01-01
Water supply pipelines are the lifelines of a city. When pipelines burst, the burst site is difficult to locate by traditional methods such as manual tools or only by watching. In this paper, the burst site was identified using back-propagation (BP) artificial neural networks (ANN). The study is based on an indoor urban water supply model experiment. The key to appling BP ANN is to optimize the ANN's topological structure and learning parameters. This paper presents the optimizing method for a 3-layer BP neural network's topological structure and its learning parameters-learning ratio and the momentum factor. The indoor water supply pipeline model experimental results show that BP ANNs can be used to locate the burst point in urban water supply systems. The topological structure and learning parameters were optimized using the experimental results.
Institute of Scientific and Technical Information of China (English)
无
2007-01-01
Back-propagation neural network was applied to predict and optimize the synthetic technology of 2-chloro-4,6-dinitroresorcinol. A model was established based on back-propagation neural network using the experimental data of homogeneous design as the training sample set and the technological parameters were optimized by it. The optimal technological parameters are as follows: the reaction time is 4h, the rewere performed and the average yield of 2-chloro-4,6-dinitroresorcinol is 96.64%, the absolute error of it with the predicted value is - 1.07 %.
Directory of Open Access Journals (Sweden)
Michihito Ueda
Full Text Available To realize an analog artificial neural network hardware, the circuit element for synapse function is important because the number of synapse elements is much larger than that of neuron elements. One of the candidates for this synapse element is a ferroelectric memristor. This device functions as a voltage controllable variable resistor, which can be applied to a synapse weight. However, its conductance shows hysteresis characteristics and dispersion to the input voltage. Therefore, the conductance values vary according to the history of the height and the width of the applied pulse voltage. Due to the difficulty of controlling the accurate conductance, it is not easy to apply the back-propagation learning algorithm to the neural network hardware having memristor synapses. To solve this problem, we proposed and simulated a learning operation procedure as follows. Employing a weight perturbation technique, we derived the error change. When the error reduced, the next pulse voltage was updated according to the back-propagation learning algorithm. If the error increased the amplitude of the next voltage pulse was set in such way as to cause similar memristor conductance but in the opposite voltage scanning direction. By this operation, we could eliminate the hysteresis and confirmed that the simulation of the learning operation converged. We also adopted conductance dispersion numerically in the simulation. We examined the probability that the error decreased to a designated value within a predetermined loop number. The ferroelectric has the characteristics that the magnitude of polarization does not become smaller when voltages having the same polarity are applied. These characteristics greatly improved the probability even if the learning rate was small, if the magnitude of the dispersion is adequate. Because the dispersion of analog circuit elements is inevitable, this learning operation procedure is useful for analog neural network hardware.
Parallelizing Backpropagation Neural Network Using MapReduce and Cascading Model.
Liu, Yang; Jing, Weizhe; Xu, Lixiong
2016-01-01
Artificial Neural Network (ANN) is a widely used algorithm in pattern recognition, classification, and prediction fields. Among a number of neural networks, backpropagation neural network (BPNN) has become the most famous one due to its remarkable function approximation ability. However, a standard BPNN frequently employs a large number of sum and sigmoid calculations, which may result in low efficiency in dealing with large volume of data. Therefore to parallelize BPNN using distributed computing technologies is an effective way to improve the algorithm performance in terms of efficiency. However, traditional parallelization may lead to accuracy loss. Although several complements have been done, it is still difficult to find out a compromise between efficiency and precision. This paper presents a parallelized BPNN based on MapReduce computing model which supplies advanced features including fault tolerance, data replication, and load balancing. And also to improve the algorithm performance in terms of precision, this paper creates a cascading model based classification approach, which helps to refine the classification results. The experimental results indicate that the presented parallelized BPNN is able to offer high efficiency whilst maintaining excellent precision in enabling large-scale machine learning. PMID:27217823
Olawoyin, Richard
2016-10-01
The backpropagation (BP) artificial neural network (ANN) is a renowned and extensively functional mathematical tool used for time-series predictions and approximations; which also define results for non-linear functions. ANNs are vital tools in the predictions of toxicant levels, such as polycyclic aromatic hydrocarbons (PAH) potentially derived from anthropogenic activities in the microenvironment. In the present work, BP ANN was used as a prediction tool to study the potential toxicity of PAH carcinogens (PAHcarc) in soils. Soil samples (16 × 4 = 64) were collected from locations in South-southern Nigeria. The concentration of PAHcarc in laboratory cultivated white melilot, Melilotus alba roots grown on treated soils was predicted using ANN model training. Results indicated the Levenberg-Marquardt back-propagation training algorithm converged in 2.5E+04 epochs at an average RMSE value of 1.06E-06. The averagedR(2) comparison between the measured and predicted outputs was 0.9994. It may be deduced from this study that, analytical processes involving environmental risk assessment as used in this study can successfully provide prompt prediction and source identification of major soil toxicants. PMID:27424056
The Performance of EEG-P300 Classification using Backpropagation Neural Networks
Directory of Open Access Journals (Sweden)
Arjon Turnip
2013-12-01
Full Text Available Electroencephalogram (EEG recordings signal provide an important function of brain-computer communication, but the accuracy of their classification is very limited in unforeseeable signal variations relating to artifacts. In this paper, we propose a classification method entailing time-series EEG-P300 signals using backpropagation neural networks to predict the qualitative properties of a subject’s mental tasks by extracting useful information from the highly multivariate non-invasive recordings of brain activity. To test the improvement in the EEG-P300 classification performance (i.e., classification accuracy and transfer rate with the proposed method, comparative experiments were conducted using Bayesian Linear Discriminant Analysis (BLDA. Finally, the result of the experiment showed that the average of the classification accuracy was 97% and the maximum improvement of the average transfer rate is 42.4%, indicating the considerable potential of the using of EEG-P300 for the continuous classification of mental tasks.
International Nuclear Information System (INIS)
In this work it was analyzed the residual performance of Portland cement concretes, when cold after heat-treated up to 600 deg C. Granite-gneiss was used in the three concrete mix proportions as the coarse aggregate, and river sand with finesses modulus of 2.7 as the fine aggregate. Ultrasonic pulse tests were performed on all the specimens and ultrasonic dynamic modulus were obtained. An artificial neural network of the backpropagation type was trained to evaluate and apply models in predicting residual properties of Portland cement concretes. The input layer for both models consists of an external layer input vector of the temperature. The hidden layer has two processing units with hyperbolic tangent sigmoid transfer functions (tansig for short), and the output layer contains one processing unit that represents the network's output (ultrasonic pulse velocity or modulus of elasticity) for each input vector. The training phase of the network converged for reasonable results after 5.000 epochs approximately, resulting in mean squared errors less than 0.02 for the normalized data. The neural network developed for modeling residual properties of Portland cement concretes was shown to be efficient in both the training phase and the test. From the results reasonable predictions could be made for the ultrasonic pulse velocity or dynamic modulus of elasticity by using temperature. (author)
Khuriati, Ainie; Setiabudi, Wahyu; Nur, Muhammad; Istadi, Istadi
2015-12-01
Backpropgation neural network was trained to predict of combustible fraction heating value of MSW from the physical composition. Waste-to-Energy (WtE) is a viable option for municipal solid waste (MSW) management. The influence of the heating value of municipal solid waste (MSW) is very important on the implementation of WtE systems. As MSW is heterogeneous material, direct heating value measurements are often not feasible. In this study an empirical model was developed to describe the heating value of the combustible fraction of municipal solid waste as a function of its physical composition of MSW using backpropagation neural network. Sampling process was carried out at Jatibarang landfill. The weight of each sorting sample taken from each discharged MSW vehicle load is 100 kg. The MSW physical components were grouped into paper wastes, absorbent hygiene product waste, styrofoam waste, HD plastic waste, plastic waste, rubber waste, textile waste, wood waste, yard wastes, kitchen waste, coco waste, and miscellaneous combustible waste. Network was trained by 24 datasets with 1200, 769, and 210 epochs. The results of this analysis showed that the correlation from the physical composition is better than multiple regression method .
Energy Technology Data Exchange (ETDEWEB)
Saini, Lalit Mohan [Department of Electrical Engineering, National Institute of Technology, Kurukshetra, Haryana 136119 (India)
2008-07-15
Up to 7 days ahead electrical peak load forecasting has been done using feed forward neural network based on Steepest descent, Bayesian regularization, Resilient and adaptive backpropagation learning methods, by incorporating the effect of eleven weather parameters and past peak load information. To avoid trapping of network into a state of local minima, the optimization of user-defined parameters viz., learning rate and error goal has been performed. The sliding window concept has been incorporated for selection of training data set. It was then reduced as per relevant selection according to the day type and season for which the forecast is made. To reduce the dimensionality of input matrix, the Principal Component Analysis method of factor extraction or correlation analysis technique has been used and their performance has been compared. The resultant data set was used for training of three-layered neural network. In order to increase the learning speed, the weights and biases were initialized according to Nguyen and Widrow method. To avoid over fitting, early stopping of training was done at the minimum validation error. (author)
Automatic volcanic ash detection from MODIS observations using a back-propagation neural network
Directory of Open Access Journals (Sweden)
T. M. Gray
2015-12-01
Full Text Available Due to the climate effects and aviation threats of volcanic eruptions, it is important to accurately locate ash in the atmosphere. This study aims to explore the accuracy and reliability of training a neural network to identify cases of ash using observations from the Moderate Resolution Imaging Spectroradiometer (MODIS. Satellite images were obtained for the following eruptions: Kasatochi, Aleutian Islands, 2008; Okmok, Aleutian Islands, 2008; Grímsvötn, northeastern Iceland, 2011; Chaitén, southern Chile, 2008; Puyehue-Cordón Caulle, central Chile, 2011; Sangeang Api, Indonesia, 2014; and Kelut, Indonesia, 2014. The Hybrid Single Particle Lagrangian Integrated Trajectory (HYSPLIT model was used to obtain ash concentrations for the same archived eruptions. Two back-propagation neural networks were then trained using brightness temperature differences as inputs obtained via the following band combinations: 12–11, 11–8.6, 11–7.3, and 11 μm. Using the ash concentrations determined via HYSPLIT, flags were created to differentiate between ash (1 and no ash (0 and SO2-rich ash (1 and no SO2-rich ash (0 and used as output. When neural network output was compared to the test data set, 93 % of pixels containing ash were correctly identified and 7 % were missed. Nearly 100 % of pixels containing SO2-rich ash were correctly identified. The optimal thresholds, determined using Heidke skill scores, for ash retrieval and SO2-rich ash retrieval were 0.48 and 0.47, respectively. The networks show significantly less accuracy in the presence of high water vapor, liquid water, ice, or dust concentrations. Significant errors are also observed at the edge of the MODIS swath.
Application of back-propagation neural networks to identification of seismic arrival types
Dai, Hengchang; MacBeth, Colin
1997-05-01
A back-propagation neural network (BPNN) approach is developed to identify P- and S-arrivals from three-component recordings of local earthquake data. The BPNN is trained by selecting trace segments of P- and S-waves and noise bursts converted into an attribute space based on the degree of polarization (DOP). After training, the network can automatically identify the type of arrival on earthquake recordings. Compared with manual analysis, a BPNN trained with nine groups of DOP segments can correctly identify 82.3% of the P-arrivals and 62.6% of the S-arrivals from one seismic station, and when trained with five groups from a training dataset selected from another seismic station, it can correctly identify 76.6% of the P-arrivals and 60.5% of S-arrivals. This approach is adaptive and needs only the onset time of arrivals as input, although its performance cannot be improved by simply adding more training datasets due to the complexity of DOP patterns. Our experience suggests that other information or another network may be necessary to improve its performance.
Institute of Scientific and Technical Information of China (English)
WU Shun-chuan(吴顺川); ZHANG You-pa(张友葩); GAO Yong-tao(高永涛)
2003-01-01
Taking the practical reinforced engineering of a reinforced soil retaining wall as an example, which located in Shandong Province and set on 104 national highway, the stress-spread behaviors of the anchor bars in the preforced proceeding were tested. According to the test data, and by use of the update backpropagation (BP) algorithm neural network(NN), the test method and it's mechanism were studied by the network, then the learning results show the mean square error(MSE) only at the 2.55% level, and the proof-testing results show the MSE at 4.38% level (the main aim is to build a NN directly from the in-situ test results (the learning phase)). Ipso-facto, the learning and adjustment abilities of the NN permit us to develop the test data, subsequently, 36 test data were acquired from the NN. By use of the provide data, as well as the failure situation and carried loading capacity of the retaining wall, finally, the choice the reasonable range interval distance of prestress cement grouting anchor bars were carried out, and the result was 2 m×2 m.
Salim Lahmiri
2014-01-01
This paper presents a forecasting model that integrates the discrete wavelet transform (DWT) and backpropagation neural networks (BPNN) for predicting financial time series. The presented model first uses the DWT to decompose the financial time series data. Then, the obtained approximation (low-frequency) and detail (high-frequency) components after decomposition of the original time series are used as input variables to forecast future stock prices. Indeed, while high-frequency components ca...
Li Honglian; Fang Hong; Tang Ju; Zhang Jun; Zhang Jing
2013-01-01
It is difficult to accurately reckon vehicle position for vehicle navigation system (VNS) during GPS outages, a novel prediction algorithm of dead reckon (DR) position error is put forward, which based on Bayesian regularization back-propagation (BRBP) neural network. DR, GPS position data are first de-noised and compared at different stationary wavelet transformation (SWT) decomposition level, and DR position error data are acquired after the SWT coefficients differences are reconstructed. A...
Institute of Scientific and Technical Information of China (English)
FENG Yerong; David H.KITZMILLER
2006-01-01
A back-propagation neural network (BPNN) was used to establish relationships between the shortrange (0-3-h) rainfall and the predictors ranging from extrapolative forecasts of radar reflectivity, satelliteestimated cloud-top temperature, lightning strike rates, and Nested Grid Model (NGM) outputs. Quantitative precipitation forecasts (QPF) and the probabilities of categorical precipitation were obtained.Results of the BPNN algorithm were compared to the results obtained from the multiple linear regression algorithm for an independent dataset from the 1999 warm season over the continental United States. A sample forecast was made over the southeastern United States. Results showed that the BPNN categorical rainfall forecasts agreed well with Stage Ⅲ observations in terms of the size and shape of the area of rainfall. The BPNN tended to over-forecast the spatial extent of heavier rainfall amounts, but the positioning of the areas with rainfall ≥25.4 mm was still generally accurate. It appeared that the BPNN and linear regression approaches produce forecasts of very similar quality, although in some respects BPNN slightly outperformed the regression.
Automatic Selection of Open Source Multimedia Softwares Using Error Back-Propagation Neural Network
Directory of Open Access Journals (Sweden)
Deepika
2015-07-01
Full Text Available Open source opens a new era to provide license of the software for the user at free of cost which is advantage over paid licensed software. In Multimedia applications there are many versions of software are available and there is a problem for the user to select compatible software for their own system. Most of the time while surfing for software a huge list of software opens in response. The selection of particular software which is pretty suitable for the system from a real big list is the biggest challenge that is faced by the users. This work has been done that focuses on the existing open source software that are widely used and to design an automatic system for selection of particular open source software according to the compatibility of users own system. In this work, error back-propagation based neural network is designed in MATLAB for automatic selection of open source software. The system provides the open source software name after taking the information from user. Regression coefficient of 0.93877 is obtained and the results shown are up to the mark and can be utilized for the fast and effective software search.
Institute of Scientific and Technical Information of China (English)
QIN Zhong; SU Gao-li; YU Qiang; HU Bing-min; LI Jun
2005-01-01
In this work, datasets of water and carbon fluxes measured with eddy covariance technique above a summer maize field in the North China Plain were simulated with artificial neural networks (ANNs) to explore the fluxes responses to local environmental variables. The results showed that photosynthetically active radiation (PAR), vapor pressure deficit (VPD), air temperature (T) and leaf area index (LAI) were primary factors regulating both water vapor and carbon dioxide fluxes. Three-layer back-propagation neural networks (BP) could be applied to model fluxes exchange between cropland surface and atmosphere without using detailed physiological information or specific parameters of the plant.
Directory of Open Access Journals (Sweden)
Yi-jun Liu
2015-12-01
Full Text Available Childhood nephrotic syndrome is a chronic disease harmful to growth of children. Scientific and accurate prediction of negative conversion days for children with nephrotic syndrome offers potential benefits for treatment of patients and helps achieve better cure effect. In this study, the improved backpropagation neural network with momentum is used for prediction. Momentum speeds up convergence and maintains the generalization performance of the neural network, and therefore overcomes weaknesses of the standard backpropagation algorithm. The three-tier network structure is constructed. Eight indicators including age, lgG, lgA and lgM, etc. are selected for network inputs. The scientific computing software of MATLAB and its neural network tools are used to create model and predict. The training sample of twenty-eight cases is used to train the neural network. The test sample of six typical cases belonging to six different age groups respectively is used to test the predictive model. The low mean absolute error of predictive results is achieved at 0.83. The experimental results of the small-size sample show that the proposed approach is to some degree applicable for the prediction of negative conversion days of childhood nephrotic syndrome.
Breathomics for Gastric Cancer Classification Using Back-propagation Neural Network.
Daniel, D Arul Pon; Thangavel, K
2016-01-01
Breathomics is the metabolomics study of exhaled air. It is a powerful emerging metabolomics research field that mainly focuses on health-related volatile organic compounds (VOCs). Since the quantity of these compounds varies with health status, breathomics assures to deliver noninvasive diagnostic tools. Thus, the main aim of breathomics is to discover patterns of VOCs related to abnormal metabolic processes occurring in the human body. Classification systems, however, are not designed for cost-sensitive classification domains. Therefore, they do not work on the gastric carcinoma (GC) domain where the benefit of correct classification of early stages is more than that of later stages, and also the cost of wrong classification is different for all pairs of predicted and actual classes. The aim of this work is to demonstrate the basic principles for the breathomics to classify the GC, for that the determination of VOCs such as acetone, carbon disulfide, 2-propanol, ethyl alcohol, and ethyl acetate in exhaled air and stomach tissue emission for the detection of GC has been analyzed. The breath of 49 GC and 30 gastric ulcer patients were collected for the study to distinguish the normal, suspected, and positive cases using back-propagation neural network (BPN) and produced the accuracy of 93%, sensitivity of 94.38%, and specificity of 89.93%. This study carries out the comparative study of the result obtained by the single- and multi-layer cascade-forward and feed-forward BPN with different activation functions. From this study, the multilayer cascade-forward outperforms the classification of GC from normal and benign cases. PMID:27563574
Directory of Open Access Journals (Sweden)
Bahman O. Taha
2015-06-01
Full Text Available The reinforced concrete with fiber reinforced polymer (FRP bars (carbon, aramid, basalt and glass is used in places where a high ratio of strength to weight is required and corrosion is not acceptable. Behavior of structural members using (FRP bars is hard to be modeled using traditional methods because of the high non-linearity relationship among factors influencing the strength of structural members. Back-propagation neural network is a very effective method for modeling such complicated relationships. In this paper, back-propagation neural network is used for modeling the flexural behavior of beams reinforced with (FRP bars. 101 samples of beams reinforced with fiber bars were collected from literatures. Five important factors are taken in consideration for predicting the strength of beams. Two models of Multilayer Perceptron (MLP are created, first with single-hidden layer and the second with two-hidden layers. The two-hidden layer model showed better accuracy ratio than the single-hidden layer model. Parametric study has been done for two-hidden layer model only. Equations are derived to be used instead of the model and the importance of input factors is determined. Results showed that the neural network is successful in modeling the behavior of concrete beams reinforced with different types of (FRP bars.
Parallel implementation of backpropagation neural networks on a heterogeneous array of transputers.
Foo, S K; Saratchandran, P; Sundararajan, N
1997-01-01
This paper analyzes parallel implementation of the backpropagation training algorithm on a heterogeneous transputer network (i.e., transputers of different speed and memory) connected in a pipelined ring topology. Training-set parallelism is employed as the parallelizing paradigm for the backpropagation algorithm. It is shown through analysis that finding the optimal allocation of the training patterns amongst the processors to minimize the time for a training epoch is a mixed integer programming problem. Using mixed integer programming optimal pattern allocations for heterogeneous processor networks having a mixture of T805-20 (20 MHz) and T805-25 (25 MHz) transputers are theoretically found for two benchmark problems. The time for an epoch corresponding to the optimal pattern allocations is then obtained experimentally for the benchmark problems from the T805-20, TS805-25 heterogeneous networks. A Monte Carlo simulation study is carried out to statistically verify the optimality of the epoch time obtained from the mixed integer programming based allocations. In this study pattern allocations are randomly generated and the corresponding time for an epoch is experimentally obtained from the heterogeneous network. The mean and standard deviation for the epoch times from the random allocations are then compared with the optimal epoch time. The results show the optimal epoch time to be always lower than the mean epoch times by more than three standard deviations (3sigma) for all the sample sizes used in the study thus giving validity to the theoretical analysis.
Directory of Open Access Journals (Sweden)
S.P.Kosbatwar
2012-03-01
Full Text Available The use of artificial neural network in applications can dramatically simplify the code and improve quality of recognition while achieving good performance. Another benefit of using neural network in application is extensibility of the system – ability to recognize more character sets than initially defined. Most of traditional systems are not extensible enough. In this paper recognition ofcharacters is possible by using neural network back propagation algorithm.
Directory of Open Access Journals (Sweden)
Li Honglian
2013-07-01
Full Text Available It is difficult to accurately reckon vehicle position for vehicle navigation system (VNS during GPS outages, a novel prediction algorithm of dead reckon (DR position error is put forward, which based on Bayesian regularization back-propagation (BRBP neural network. DR, GPS position data are first de-noised and compared at different stationary wavelet transformation (SWT decomposition level, and DR position error data are acquired after the SWT coefficients differences are reconstructed. A neural network to mimic position error property is trained with back-propagation algorithm, and the algorithm is improved for improving its generalization by Bayesian regularization theory. During GPS outages, the established prediction algorithm predictes DR position errors, and provides precise position for VNS through DR position error data updating DR position data. The simulation results show the positioning precision of the BRBP algorithm is best among the presented prediction algorithms such as simple DR and adaptive linear network, and a precise mathematical model of navigation sensors isn’t established.
Directory of Open Access Journals (Sweden)
Attariuas Hicham
2012-11-01
Full Text Available In recent years, there has been a strong tendency by companies to use centralized management systems like Enterprise resource planning (ERP. ERP systems offer a comprehensive and simplified process managements and extensive functional coverage. Sales management module is an important element business management of ERP. This paper describes an intelligent hybrid sales forecasting system ERP-FCBPN sales forecast based on architecture of ERP through Delphi, fuzzy clustering and Back-propagation (BP Neural Networks with adaptive learning rate (FCBPN. The proposed approach is composed of three stages: (1 Stage of data collection: Data collection will be implemented from the fields (attributes existing at the interfaces (Tables the database of the ERP. Collection of Key factors that influence sales be made using the Delphi method; (2 Stage of Data preprocessing: Winter Exponential Smoothing method will be utilized to take the trend effect into consideration. (3 Stage of learning by FCBPN: We use hybrid sales forecasting system based on Delphi, fuzzy clustering and Back-propagation (BP Neural Networks with adaptive learning rate (FCBPN. The data for this study come from an industrial company that manufactures packaging. Experimental results show that the proposed model outperforms the previous and traditional approaches. Therefore, it is a very promising solution for industrial forecasting.
International Nuclear Information System (INIS)
Research highlights: → An ANN was built to predict the formation enthalpies of Al2X-type intermetallics. → The values predicted by the ANN agree with experiments well to typically within 10%. → The method comparison suggests that our ANN method is superior to Miedema's model. → Some trends of formation enthalpies for Al2X-type intermetallics were observed. - Abstract: A back-propagation artificial neural network (ANN) was established to predict the formation enthalpies of Al2X-type intermetallics as a function of some physical parameters. These physical parameters include the electronegativity difference, the electron density difference, the atomic size difference, and the electron-atom ratio (e/a). The values calculated by the ANN method agree with experiments well to typically within 10%, indicating that the well-trained back-propagation (BP) neural network is feasible, and can precisely predict the formation enthalpies of Al2X-type intermetallics. The method comparison based on the predicted formation enthalpies suggests that our ANN method is superior to Miedema's model. Some trends of formation enthalpies for Al2X-type intermetallics were also observed from the ANN.
Directory of Open Access Journals (Sweden)
Satyanarayana D
2006-01-01
Full Text Available A chemometric model for the simultaneous estimation of phenobarbitone and phenytoin sodium anticonvulsant tablets using the back-propagation neural network calibration has been presented. The use of calibration datasets constructed from the spectral data of pure components is proposed. The calibration sets were designed such that the concentrations were orthogonal and span the possible mixture space fairly evenly. Spectra of phenobarbitone and phenytoin sodium were recorded at several concentrations within their linear range and used to compute the calibration mixture between wavelengths 220 and 260 nm at an interval of 1 nm. The back-propagation neural network model was optimized using three different sets of calibration and monitoring data for the number of hidden sigmoid neurons. The calibration model was thoroughly evaluated at several concentration levels using spectra obtained for 95 synthetic binary mixtures prepared using orthogonal designs. The optimized model showed sufficient robustness even when the calibration sets were constructed from different sets of pure spectra of components. Although the components showed complete spectral overlap, the model could accurately estimate the drugs, with satisfactory precision and accuracy, in tablet dosage with no interference from excipients, as indicated by the recovery study results.
Predicting carbonate permeabilities from wireline logs using a back-propagation neural network
International Nuclear Information System (INIS)
This paper explores the applicability of using Neural Networks to aid in the determination of carbonate permeability from wireline logs. Resistivity, interval transit time, neutron porosity, and bulk density logs form Texaco's Stockyard Creek Oil field were used as input to a specially designed neural network to predict core permeabilities in this carbonate reservoir. Also of interest was the comparison of the neural network's results to those of standard statistical techniques. The process of developing the neural network for this problem has shown that a good understanding of the data is required when creating the training set from which the network learns. This network was trained to learn core permeabilities from raw and transformed log data using a hyperbolic tangent transfer function and a sum of squares global error function. Also, it required two hidden layers to solve this particular problem
CONVERGENCE OF GRADIENT METHOD WITH MOMENTUM FOR BACK-PROPAGATION NEURAL NETWORKS
Institute of Scientific and Technical Information of China (English)
Wei Wu; Naimin Zhang; Zhengxue Li; Long Li; Yan Liu
2008-01-01
In this work,a gradient method with momentum for BP neural networks is considered.The momentum coefficient is chosen in an adaptive manner to accelerate and stabilize the learning procedure of the network weights.Corresponding convergence results are proved.
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.
=UTF-8 54 / JOURNAL OF WATERWAY, PORT, COASTAL, AND OCEAN ENGINEERING / JANUARY/FEBRUARY 2001 BACK-PROPAGATION NEURAL NETWORK IN TIDAL-LEVEL FORECASTING a Discussion by Arun Kumar 3 and Vijay K. Minocha 4 The authors have presented... an interesting study on the ap- plication of an artificial neural network (ANN) for forecasting tidal levels. This technique is comparable to the already pop- ular time series modeling with an added advantage in that the functional form between the input variable...
Institute of Scientific and Technical Information of China (English)
GUO Zhongyang; DAI Xiaoyan; LI Xiaodong; YE Shufeng
2013-01-01
To reduce typhoon-caused damages,numerical and empirical methods are often used to forecast typhoon storm surge.However,typhoon surge is a complex nonlinear process that is difficult to forecast accurately.We applied a principal component back-propagation neural network (PCBPNN) to predict the deviation in typhoon storm surge,in which data of the typhoon,upstream flood,and historical case studies were involved.With principal component analysis,15 input factors were reduced to five principal components,and the application of the model was improved.Observation data from Huangpu Park in Shanghai,China were used to test the feasibility of the model.The results indicate that the model is capable of predicting a 12-hour warning before a typhoon surge.
New backpropagation algorithm with type-2 fuzzy weights for neural networks
Gaxiola, Fernando; Valdez, Fevrier
2016-01-01
In this book a neural network learning method with type-2 fuzzy weight adjustment is proposed. The mathematical analysis of the proposed learning method architecture and the adaptation of type-2 fuzzy weights are presented. The proposed method is based on research of recent methods that handle weight adaptation and especially fuzzy weights. The internal operation of the neuron is changed to work with two internal calculations for the activation function to obtain two results as outputs of the proposed method. Simulation results and a comparative study among monolithic neural networks, neural network with type-1 fuzzy weights and neural network with type-2 fuzzy weights are presented to illustrate the advantages of the proposed method. The proposed approach is based on recent methods that handle adaptation of weights using fuzzy logic of type-1 and type-2. The proposed approach is applied to a cases of prediction for the Mackey-Glass (for ô=17) and Dow-Jones time series, and recognition of person with iris bi...
Directory of Open Access Journals (Sweden)
Lei Si
2014-01-01
Full Text Available Classification is an important theme in data mining. Rough sets and neural networks are the most common techniques applied in data mining problems. In order to extract useful knowledge and classify ambiguous patterns effectively, this paper presented a hybrid algorithm based on the integration of rough sets and BP neural network to construct a novel classification system. The attribution values were discretized through PSO algorithm firstly to establish a decision table. The attribution reduction algorithm and rules extraction method based on rough sets were proposed, and the flowchart of proposed approach was designed. Finally, a prototype system was developed and some simulation examples were carried out. Simulation results indicated that the proposed approach was feasible and accurate and was outperforming others.
Automatic volcanic ash detection from MODIS observations using a back-propagation neural network
T. M. Gray; Bennartz, R.
2015-01-01
Due to the climate effects and aviation threats of volcanic eruptions, it is important to accurately locate ash in the atmosphere. This study aims to explore the accuracy and reliability of training a neural network to identify cases of ash using observations from the Moderate Resolution Imaging Spectroradiometer (MODIS). Satellite images were obtained for the following eruptions: Kasatochi, Aleutian Islands, 2008; Okmok, Aleutian Islands, 2008; Grímsvötn, n...
Implementation of back-propagation neural networks with MatLab
Nazari, Jamshid; Ersoy, Okan K
1992-01-01
The artificial neural network back propagation algorithm is implemented in Matlab language. This implementation is compared with several other software packages. The effect of reducing the number of iterations in the performance of the algorithm iai studied. The speed of the back propagation program, mkckpmp, written in Matlab language is compared with the speed of several other back propagation programs which are written in the C language. The speed of the Matlab program mbackpmp is, also co...
Impact of Ethnic Group on Human Emotion Recognition Using Backpropagation Neural Network
Directory of Open Access Journals (Sweden)
Nabil M. Hewahi
2011-12-01
Full Text Available We claim that knowing the ethnic group of human would increase the accuracy of the emotion recognition. This is due to the difference between the face appearances and expressions of
various ethnic groups. To test our claim, we developed an approach based on Artificial Neural Networks (ANN using backpropgation algorithm to recognize the human emotion through facial expressions. Our approach has been tested by using MSDEF dataset, and we found that, there is a positive effect on the accuracy of the recognition of emotion if we consider the ethnic group as input factor while building the recognition model. We achieved 8% improvement rate.
Indian Academy of Sciences (India)
S Traore; Y M Wang; W G Chung
2014-03-01
The present study evaluates the predictive accuracy of the feed forward backpropagation artificial neural network (BP) in evapotranspiration forecasting from temperature data basis in Dédougou region located in western Burkina Faso, sub-Saharan Africa. BP accuracy is compared to the conventional Blaney–Criddle (BCR) and Reference Model developed for Burkina Faso (RMBF) by referring to the FAO56 Penman–Monteith (PM) as the standard method. Statistically, the models accuracies were evaluated with the goodness-of-fit measures of root mean square error, mean absolute error and coefficient of determination between their estimated and PM observed values. From the statistical results, BP shows similar contour trends to PM, and performs better than the conventional methods in reference evapotranspiration (ET_ref) forecasting in the region. In poor data situation, BP based only on temperature data is much more preferred than the other alternative methods for ET_ref forecasting. Furthermore, it is noted that the BP network computing technique accuracy improves significantly with the addition of wind velocity into the network input set. Therefore, in the region, wind velocity is recommended to be incorporated into the BP model for high accuracy management purpose of irrigation water, which relies on accurate values of ET_ref.
Directory of Open Access Journals (Sweden)
Amit Kumar Ray
2003-05-01
Full Text Available Three layered feed-forward backpropagation artificial neural network architecture is designed to classify sleep-wake stages in rats. Continuous three channel polygraphic signals such as electroencephalogram, electrooculogram and electromyogram were recorded from conscious rats for eight hours during day time. Signals were also stored in computer hard disk with the help of analog to digital converter and its compatible data acquisition software. The power spectra (in dB scale of the digitized signals in three sleep-wake stages were calculated. Selected power spectrum data of all three simultaneously recorded polygraphic signals were used for training the network and to classify slow wave sleep, rapid eye movement sleep and awake stages. The ANN architecture used in present study shows a very good agreement with manual sleep stage scoring with an average of 94.83% for all the 1200 samples tested from SWS, REM and AWA stages. The high performance observed with the system based on ANN highlights the need of this computational tool into the field of sleep research.
Directory of Open Access Journals (Sweden)
Nader Salari
Full Text Available Among numerous artificial intelligence approaches, k-Nearest Neighbor algorithms, genetic algorithms, and artificial neural networks are considered as the most common and effective methods in classification problems in numerous studies. In the present study, the results of the implementation of a novel hybrid feature selection-classification model using the above mentioned methods are presented. The purpose is benefitting from the synergies obtained from combining these technologies for the development of classification models. Such a combination creates an opportunity to invest in the strength of each algorithm, and is an approach to make up for their deficiencies. To develop proposed model, with the aim of obtaining the best array of features, first, feature ranking techniques such as the Fisher's discriminant ratio and class separability criteria were used to prioritize features. Second, the obtained results that included arrays of the top-ranked features were used as the initial population of a genetic algorithm to produce optimum arrays of features. Third, using a modified k-Nearest Neighbor method as well as an improved method of backpropagation neural networks, the classification process was advanced based on optimum arrays of the features selected by genetic algorithms. The performance of the proposed model was compared with thirteen well-known classification models based on seven datasets. Furthermore, the statistical analysis was performed using the Friedman test followed by post-hoc tests. The experimental findings indicated that the novel proposed hybrid model resulted in significantly better classification performance compared with all 13 classification methods. Finally, the performance results of the proposed model was benchmarked against the best ones reported as the state-of-the-art classifiers in terms of classification accuracy for the same data sets. The substantial findings of the comprehensive comparative study revealed that
Directory of Open Access Journals (Sweden)
Salim Lahmiri
2014-07-01
Full Text Available This paper presents a forecasting model that integrates the discrete wavelet transform (DWT and backpropagation neural networks (BPNN for predicting financial time series. The presented model first uses the DWT to decompose the financial time series data. Then, the obtained approximation (low-frequency and detail (high-frequency components after decomposition of the original time series are used as input variables to forecast future stock prices. Indeed, while high-frequency components can capture discontinuities, ruptures and singularities in the original data, low-frequency components characterize the coarse structure of the data, to identify the long-term trends in the original data. As a result, high-frequency components act as a complementary part of low-frequency components. The model was applied to seven datasets. For all of the datasets, accuracy measures showed that the presented model outperforms a conventional model that uses only low-frequency components. In addition, the presented model outperforms both the well-known auto-regressive moving-average (ARMA model and the random walk (RW process.
Gupta, Vinod Kumar; Khani, Hadi; Ahmadi-Roudi, Behzad; Mirakhorli, Shima; Fereyduni, Ehsan; Agarwal, Shilpi
2011-01-15
Quantitative structure-retention relationship (QSRR) models correlating the retention times of fatty acid methyl esters in high resolution capillary gas chromatography and their structures were developed based on non-linear and linear modeling methods. Genetic algorithm (GA) was used for the selection of the variables that resulted in the best-fitted models. Gravitational index (G2), number of cis double bond (NcDB) and number of trans double bond (NtDB) were selected among a large number of descriptors. The selected descriptors were considered as inputs for artificial neural networks (ANNs) with three different weights update functions including Levenberg-Marquardt backpropagation network (LM-ANN), BFGS (Broyden, Fletcher, Goldfarb, and Shanno) quasi-Newton backpropagation (BFG-ANN) and conjugate gradient backpropagation with Polak-Ribiére updates (CGP-ANN). Computational result indicates that the LM-ANN method has better predictive power than the other methods. The model was also tested successfully for external validation criteria. Standard error for the training set using LM-ANN was SE=0.932 with correlation coefficient R=0.996. For the prediction and validation sets, standard error was SE=0.645 and SE=0.445 and correlation coefficient was R=0.999 and R=0.999, respectively. The accuracy of 3-2-1 LM-ANN model was illustrated using leave multiple out-cross validations (LMO-CVs) and Y-randomization.
Bahadir, Elif
2016-01-01
The purpose of this study is to examine a neural network based approach to predict achievement in graduate education for Elementary Mathematics prospective teachers. With the help of this study, it can be possible to make an effective prediction regarding the students' achievement in graduate education with Artificial Neural Networks (ANN). Two…
Energy Technology Data Exchange (ETDEWEB)
Yu, S.; Wang, X.; Shi, C.; Wang, H. [Shandong Mining Institute (China). Jinan Branch
1999-04-01
Four reformatory learning algorithms are applied to enhance the learning speed and the stability of neural network. The general principles of forecasting productivity and efficiency with artificial neural network and the specific operational steps are described in details. The processing of data before and after the learning procedure, the determination of the network structure, and the appropriate reiteration times for the learning procedure are the main points of discussion. 3 refs., 3 figs., 2 tabs.
Yu, Hao; Rossi, Giammarco; Braglia, Andrea; Perrone, Guido
2016-08-10
The paper presents the development of a tool based on a back-propagation artificial neural network to assist in the accurate positioning of the lenses used to collimate the beam from semiconductor laser diodes along the so-called fast axis. After training using a Gaussian beam ray-equivalent model, the network is capable of indicating the tilt, decenter, and defocus of such lenses from the measured field distribution, so the operator can determine the errors with respect to the actual lens position and optimize the diode assembly procedure. An experimental validation using a typical configuration exploited in multi-emitter diode module assembly and fast axis collimating lenses with different focal lengths and numerical apertures is reported. PMID:27534506
Energy Technology Data Exchange (ETDEWEB)
Kohara, K. [Nippon Telegraph and Telephone Corp., Tokyo (Japan)
1998-11-01
We proposed ways to improve pattern recognition ability by combining several small back-propagation neural networks (BPNNs) [1]. We found that modifying the desired outputs according to the similarity of the input patterns (i.e., increasing desired outputs to similar classes) increases the BPNN outputs for similar classes, thus improving the generalization ability of the modular-net architecture. We evaluated the learning technique using two subfeatures extracted from handwritten digits [1]. This paper proposes a performance-verification method and presents experimental results applying learning techniques to the proposed verification-problems: 4-class, 10-class, and 20-class classification problems using two-dimensional Gaussian distribution data. 7 refs., 7 figs., 6 tabs.
Energy Technology Data Exchange (ETDEWEB)
Doh, Jaeh Yeok; Lee, Jong Soo [Yonsei University, Seoul (Korea, Republic of); Lee, Seung Uk [Gyeongbuk Hybrid Technology Institute, Yeongcheon (Korea, Republic of)
2016-03-15
In this study, a Back-propagation neural network (BPN) is employed to conduct an approximation of a true stress-strain curve using the load-displacement experimental data of DP590, a high-strength material used in automobile bodies and chassis. The optimized interconnection weights are obtained with hidden layers and output layers of the BPN through intelligent learning and training of the experimental data; by using these weights, a mathematical model of the material's behavior is suggested through this feed-forward neural network. Generally, the material properties from the tensile test cannot be acquired until the fracture regions, since it is difficult to measure the cross-section area of a specimen after diffusion necking. For this reason, the plastic properties of the true stress-strain are extrapolated using the weighted-average method after diffusion necking. The accuracies of BPN-based meta-models for predicting material properties are validated in terms of the Root mean square error (RMSE). By applying the approximate material properties, the reliable finite element solution can be obtained to realize the different shapes of the finite element models. Furthermore, the sensitivity analysis of the approximate meta-model is performed using the first-order approximate derivatives of the BPN and is compared with the results of the finite difference method. In addition, we predict the tension velocity's effect on the material property through a first-order sensitivity analysis.
Directory of Open Access Journals (Sweden)
Attariuas Hicham
2012-05-01
Full Text Available This paper describes new hybrid sales forecasting system based on fuzzy clustering and Back-propagation (BP Neural Networks with adaptive learning rate (FCBPN.The proposed approach is composed of three stages: (1 Winters Exponential Smoothing method will be utilized to take the trend effect into consideration; (2 utilizing Fuzzy C-Means clustering method (Used in an clusters memberships fuzzy system (CMFS, the clusters membership levels of each normalized data records will be extracted; (3 Each cluster will be fed into parallel BP networks with a learning rate adapted as the level of cluster membership of training data records. Compared to many researches which use Hard clustering, we employ fuzzy clustering which permits each data record to belong to each cluster to a certain degree, which allows the clusters to be larger which consequently increases the accuracy of the proposed forecasting system . Printed Circuit Board (PCB will be used as a case study to evaluate the precision of our proposed architecture. Experimental results show that the proposed model outperforms the previous and traditional approaches. Therefore, it is a very promising solution for industrial forecasting.
Institute of Scientific and Technical Information of China (English)
王菲; 曾庆军; 黄国建; 李洪瑞
2001-01-01
The development and system composition of underwater target recognition system is expounded at first, and then a novel method for training neural network target classifier by using genetic-backpropagation algorithm is proposed. The result of experiment shows that the performance of neural network target classifier based on genetic-backpropagation algorithm is better than that of neural network target classifier based on the improved backpropagation algorithm.%首先阐述了水下目标识别的研究发展和系统组成，然后提出了一种基于遗传BP算法训练神经网络目标分类器的新方法。实验结果表明采用新方法的神经网络分类器比采用改进BP算法的神经网络分类器具有更优的分类效果。
Dai, Hengchang; MacBeth, Colin
1997-07-01
An automatic approach is developed to pick P and S arrivals from single component (1-C) recordings of local earthquake data. In this approach a back propagation neural network (BPNN) accepts a normalized segment (window of 40 samples) of absolute amplitudes from the 1-C recordings as its input pattern, calculating two output values between 0 and 1. The outputs (0,1) or (1,0) correspond to the presence of an arrival or background noise within a moving window. The two outputs form a time series. The P and S arrivals are then retrieved from this series by using a threshold and a local maximum rule. The BPNN is trained by only 10 pairs of P arrivals and background noise segments from the vertical component (V-C) recordings. It can also successfully pick seismic arrivals from the horizontal components (E-W and N-S). Its performance is different for each of the three components due to strong effects of ray path and source position on the seismic waveforms. For the data from two stations of TDP3 seismic network, the success rates are 93%, 89%, and 83% for P arrivals and 75%, 91%, and 87% for S arrivals from the V-C, E-W, and N-S recordings, respectively. The accuracy of the onset times picked from each individual 1-C recording is similar. Adding a constraint on the error to be 10 ms (one sample increment), 66%, 59% and 63% of the P arrivals and 53%, 61%, and 58% of the S arrivals are picked from the V-C, E-W and N-S recordings respectively. Its performance is lower than a similar three-component picking approach but higher than other 1-C picking methods.
Song, Xianzhi; Peng, Chi; Li, Gensheng
2016-01-01
Sand production and blockage are common during the drilling and production of horizontal oil and gas wells as a result of formation breakdown. The use of high-pressure rotating jets and annular helical flow is an effective way to enhance horizontal wellbore cleanout. In this paper, we propose the idea of using supercritical CO2 (SC-CO2) as washing fluid in water-sensitive formation. SC-CO2 is manifested to be effective in preventing formation damage and enhancing production rate as drilling fluid, which justifies tis potential in wellbore cleanout. In order to investigate the effectiveness of SC-CO2 helical flow cleanout, we perform the numerical study on the annular flow field, which significantly affects sand cleanout efficiency, of SC-CO2 jets in horizontal wellbore. Based on the field data, the geometry model and mathematical models were built. Then a numerical simulation of the annular helical flow field by SC-CO2 jets was accomplished. The influences of several key parameters were investigated, and SC-CO2 jets were compared to conventional water jets. The results show that flow rate, ambient temperature, jet temperature, and nozzle assemblies play the most important roles on wellbore flow field. Once the difference between ambient temperatures and jet temperatures is kept constant, the wellbore velocity distributions will not change. With increasing lateral nozzle size or decreasing rear/forward nozzle size, suspending ability of SC-CO2 flow improves obviously. A back-propagation artificial neural network (BP-ANN) was successfully employed to match the operation parameters and SC-CO2 flow velocities. A comprehensive model was achieved to optimize the operation parameters according to two strategies: cost-saving strategy and local optimal strategy. This paper can help to understand the distinct characteristics of SC-CO2 flow. And it is the first time that the BP-ANN is introduced to analyze the flow field during wellbore cleanout in horizontal wells. PMID
Institute of Scientific and Technical Information of China (English)
瞿晓娜; 张腾宇; 王喜太
2012-01-01
背景:虽然在人体步态方面已有大量研究,但针对膝踝协调运动的研究很少.目的:用BP神经网络分析膝踝协调运动关系.方法:利用三维步态分析系统检测了30名健康志愿者以快、中、慢3种步速行走时的步态数据,进行统计分析;并通过建立BP神经网络预测数据,同时对膝踝协调的控制方法进行探讨.结果与结论:不同的人步态不同,但BP神经网络预测所得曲线与实验基本一致,证实了用BP神经网络做膝踝运动关系预测的合理性和可行性,很好的研究了膝踝协调性,给全智能膝踝协调控制假肢的研发提供了理论依据.%BACKGROUND: The study of the relationship between knee and ankle is poor although there have been a lot of researches on gait of people. OBJECTIVE: To analyze the relationship between knee and ankle based on back-propagation network. METHODS: The gaits of 30 healthy young people walking at fast, normal, and low speeds separately were detected by three-dimensional gait analysis system, and the gait data were investigated and analyzed. The data were predicted through the establishment of the back-propagation neural network and the knee-ankle coordination control method was explored. RESULTS AND CONCLUSION: Different people had different gaits, but the curve obtained by back-propagation neural network was similar with the experimental curve. The paper investigated and validated that it was viable and reasonable to forecast the kinematic relationship between the knee and ankle by back-propagation network system. The paper studied the coordination between the knee and ankle well, and provided the theory foundation for the design of the intelligent prostheses.
Institute of Scientific and Technical Information of China (English)
韩明红; 韩捷; 关惠玲
2001-01-01
The reasons for the slowness in convergence of standard backpropagation algorithm and the imperfection of conventional improved algorithms have been fully analyzed. In order to improve the convergence rate of multilayer feedforward neural networks, a new highly efficent unitary backpropagation algorithm based on the unitary-function is proposed. Numerical simulation and experimental results show that the algorithm can greatly increase the convergence rate and highly improve their imminent accurary.%分析了引起标准BP算法收敛速度慢的原因，以及传统改进方法的不足之处，探讨了解决的途径。为了提高BP算法的收敛速度，定义并引入了基量函数的概念，并将其运用到BP算法中，给出了一种高效的单位BP算法。仿真和实例结构均表明该算法能够较好地克服标准BP算法收敛速度慢的缺点，并可以达到很高的网络逼近精度。
Institute of Scientific and Technical Information of China (English)
开小明; 沈玉华; 谢安建; 郑学根
2004-01-01
提出用Levenberg-Marquardt Backpropagation Neural Network (LM-BP)网络对酸性偶氮染料进行分类,网络结构为4-6-5.优化了隐含层神经元数和网络训练次数,表明隐含层神经元数应比输出层神经元数多一个.考察了训练集样本的选择对结果的影响,测试集的样本参数大小要处于训练集样本之间.本网络把其中22种染料作为训练集,把另外18种染料作为测试集,与采用GCEDM逐次分类法比较,测试集识别率为83%.
Multigradient for Neural Networks for Equalizers
Directory of Open Access Journals (Sweden)
Chulhee Lee
2003-06-01
Full Text Available Recently, a new training algorithm, multigradient, has been published for neural networks and it is reported that the multigradient outperforms the backpropagation when neural networks are used as a classifier. When neural networks are used as an equalizer in communications, they can be viewed as a classifier. In this paper, we apply the multigradient algorithm to train the neural networks that are used as equalizers. Experiments show that the neural networks trained using the multigradient noticeably outperforms the neural networks trained by the backpropagation.
Error-backpropagation in temporally encoded networks of spiking neurons
Bohte, S.M.; La Poutré, J.A.; Kok, J.N.
2000-01-01
For a network of spiking neurons that encodes information in the timing of individual spike-times, we derive a supervised learning rule, emph{SpikeProp, akin to traditional error-backpropagation and show how to overcome the discontinuities introduced by thresholding. With this algorithm, we demonstr
Error-backpropagation in temporally encoded networks of spiking neurons
Bohte, Sander; La Poutré, Han; Kok, Joost
2000-01-01
For a network of spiking neurons that encodes information in the timing of individual spike-times, we derive a supervised learning rule, emph{SpikeProp, akin to traditional error-backpropagation and show how to overcome the discontinuities introduced by thresholding. With this algorithm, we demonstrate how networks of spiking neurons with biologically reasonable action potentials can perform complex non-linear classification in fast temporal coding just as well as rate-coded networks. We perf...
Energy Technology Data Exchange (ETDEWEB)
Toda-Caraballo, I.; Garcia-Mateo, C.; Capdevila, C.
2010-07-01
At the beginning of the decade of the nineties, the industrial interest for TRIP steels leads to a significant increase of the investigation and application in this field. In this work, the flexibility of neural networks for the modelling of complex properties is used to tackle the problem of determining the retained austenite content in TRIP-steel. Applying a combination of two learning algorithms (backpropagation and creeping-random-search) for the neural network, a model has been created that enables the prediction of retained austenite in low-Si / low-Al multiphase steels as a function of processing parameters. (Author). 34 refs.
Adamowski, J. F.
2008-12-01
Cyprus is in the middle of an unprecedented water crisis that has lasted several years. Four ideas that have been considered to aid in resolving the problem include imposing effective water use restrictions, implementing water demand reduction programs, optimizing water supply systems, and developing alternative water source strategies. A critical component of each of these initiatives is the accurate forecasting of short- term peak water demands. This study compared multiple linear regression and three types of artificial neural networks (ANNs) as methods for peak weekly water demand forecast modeling. Analysis was performed on six years of peak weekly water demand data and meteorological variables (maximum weekly temperature and total weekly rainfall) for two different regions (Athalassa and Public Garden) in the city of Nicosia, Cyprus. Twenty multiple linear regression models, twenty Levenberg-Marquardt ANN models, twenty Resilient Back- Propagation ANN models, and twenty Conjugate Gradient Powell-Beale ANN models were developed and their relative performance was compared. For both the Athalassa and Public Garden regions in Nicosia, the Levenberg-Marquardt ANN method was found to provide a more accurate forecast of peak weekly water demand than the other two types of ANNs and multiple linear regression. It was also found that the peak weekly water demand in Nicosia is better correlated with the rainfall occurrence rather than the amount of rainfall itself.
Yang, Tsung-Ming; Fan, Shu-Kai; Fan, Chihhao; Hsu, Nien-Sheng
2014-08-01
The purpose of this study is to establish a turbidity forecasting model as well as an early-warning system for turbidity management using rainfall records as the input variables. The Taipei Water Source Domain was employed as the study area, and ANOVA analysis showed that the accumulative rainfall records of 1-day Ping-lin, 2-day Ping-lin, 2-day Fei-tsui, 2-day Shi-san-gu, 2-day Tai-pin and 2-day Tong-hou were the six most significant parameters for downstream turbidity development. The artificial neural network model was developed and proven capable of predicting the turbidity concentration in the investigated catchment downstream area. The observed and model-calculated turbidity data were applied to developing the turbidity early-warning system. Using a previously determined turbidity as the threshold, the rainfall criterion, above which the downstream turbidity would possibly exceed this respective threshold turbidity, for the investigated rain gauge stations was determined. An exemplary illustration demonstrated the effectiveness of the proposed turbidity early-warning system as a precautionary alarm of possible significant increase of downstream turbidity. This study is the first report of the establishment of the turbidity early-warning system. Hopefully, this system can be applied to source water turbidity forecasting during storm events and provide a useful reference for subsequent adjustment of drinking water treatment operation. PMID:24691737
Institute of Scientific and Technical Information of China (English)
何超; 徐立新; 张宇河
1999-01-01
目的为了消除普遍存在于伺服系统中的间隙非线性的影响,提出一种利用BP神经网络进行非线性补偿的方法.方法以某武器跟踪伺服系统为例,采用一个3层BP神经网络对其间隙非线性特性进行离线辨识,然后根据辨识结果设计一个非线性补偿器.结果仿真结果表明所提出的方法能够有效消除间隙特性引起的系统自振荡(极限环),并且能够提高系统精度.结论利用BP神经网络进行间隙非线性补偿的方法能够有效解决伺服系统中间隙特性带来的影响,且易于在工程中实现.%Aim To eliminate the influences of backlash nonlinear characteristics generally existing in servo systems, a nonlinear compensation method using backpropagation neural networks(BPNN) is presented. Methods Based on some weapon tracking servo system, a three-layer BPNN was used to off-line identify the backlash characteristics, then a nonlinear compensator was designed according to the identification results. Results The simulation results show that the method can effectively get rid of the sustained oscillation(limit cycle) of the system caused by the backlash characteristics, and can improve the system accuracy. Conclusion The method is effective on sloving the problems produced by the backlash characteristics in servo systems, and it can be easily accomplished in engineering.
Institute of Scientific and Technical Information of China (English)
范媛媛; 桑英军; 沈湘衡
2011-01-01
在基于噪声图像的无参考峰值信噪比质量评价方法中,为了得到最优的阈值参数,提出以图像块均方误差阈值threshold1、噪声检测阈值threshold2为输入因子,以Pearson相关系数和Spearman等级相关系数为输出因子,以实验值为样本建立[2 7 2]单隐层BP神经网络模型,应用BP神经网络的泛化能力实现对相关阈值参数的预测优化,为阈值参数的选择提供理论依据.实验结果表明,所建立的数学模型可靠,预测结果与试验值的偏差小,训练好的BP神经网络能够比较准确地预测不同阈值参数下的相关系数.优化后,选取threshold1=101,threshold2 =4,Pearson相关系数达到了-0.895 0,Spearman等级相关系数达到了-0.913 6,评价效果得到提高,且节省大量时间.%In no reference peak signal to noise ratio (PSNR) image quality assessment based on noisy images, in order to get optimal threshold parameters, it is proposed that taking experiment values as a sample, a [2 7 2] back-propagation (BP) neural network model is established with the mean square error (MSE) thresholdl of image block and the noise detection threshold2 as the input factors, and the Person and Spearman correlation coefficients as the output factors. The model realizes the prediction of relevant parameters by its generalization capability and offers a theoretical foundation for parameters selection. Experiments indicate that the model is reliable. The prediction results show little difference from the experimental data. The trained BP neural network can precisely predict the relevant parameters. After optimizing, thresholdl = 101 and threshold2 = 4 are selected, Pearson Correlation Coefficient and Spearman Rank Order Correlation Coefficient reaches -0. 895 0 and -0. 913 6 respectively. The assessment result improves a lot, and much time is saved.
Institute of Scientific and Technical Information of China (English)
韦添尹; 蒋永荣; 刘可慧; 刘成良; 张威
2013-01-01
The back-propagation neural network (BPNN) trained with the data from the sulfate organic wastewater treatment of anaerobic baffled reactor(ABR) and a network model was buih.The better training function and times were ‘ traingda' and 1 900,respectively.Partition connection weights (PCW) was adopted to analyze the dominant factors of effluent COD and SO42-.The results showed that all of the factors (feed COD,SO42-,pH,COD/SO42-and HRT) had an influence on effluent COD and SO42-.Nevertheless,the feed pH was the dominant factor,which relative importance (RI) were 30.79％ and 23.44％,respectively.The model and simulink on restrictive factors for COD and SO42-removal were built respectively,which can be used for prediction on sulfate organic wastewater treatment.%通过厌氧折流板反应器(ABR)处理硫酸盐有机废水的实验数据对BP神经网络进行训练,建立了ABR处理硫酸盐有机废水的BPNN模型,通过测试对比,找出了较优训练函数为traingda,较优训练次数为1 900.利用分割连接权值法(PCW)对影响出水SO42-和COD的主要因素进行分析,结果显示进水COD、SO42-、pH、COD/SO42-和HRT对出水SO42-和COD均产生一定影响,其中进水pH对出水SO42-和COD的影响最大,相对重要性(RI)指数分别为30.79％和23.44％;并通过样本试验数据分别建立了对SO42-和COD去除率的限制因子仿真模型,为预测硫酸盐有机废水的厌氧处理过程提供指导.
Institute of Scientific and Technical Information of China (English)
舒雅琴; 曾锦光
2000-01-01
A GA-BP complex algorithm based on real number coding is proposed. The algorithm optimizes the original weights, structure and learning rules of BP network to search the optimal solution in the solution space. An example of oil/gas prediction is given.%提出了一种基于实数编码的GA－BP复合算法，该算法对BP网络初始权值、结构、学习规则进行优化，从而在解空间中搜索出最优解．文中还给出了应用该算法解决油气产能预测的实例．
Introduction to neural networks
International Nuclear Information System (INIS)
This lecture is a presentation of today's research in neural computation. Neural computation is inspired by knowledge from neuro-science. It draws its methods in large degree from statistical physics and its potential applications lie mainly in computer science and engineering. Neural networks models are algorithms for cognitive tasks, such as learning and optimization, which are based on concepts derived from research into the nature of the brain. The lecture first gives an historical presentation of neural networks development and interest in performing complex tasks. Then, an exhaustive overview of data management and networks computation methods is given: the supervised learning and the associative memory problem, the capacity of networks, the Perceptron networks, the functional link networks, the Madaline (Multiple Adalines) networks, the back-propagation networks, the reduced coulomb energy (RCE) networks, the unsupervised learning and the competitive learning and vector quantization. An example of application in high energy physics is given with the trigger systems and track recognition system (track parametrization, event selection and particle identification) developed for the CPLEAR experiment detectors from the LEAR at CERN. (J.S.). 56 refs., 20 figs., 1 tab., 1 appendix
Information Theory for Analyzing Neural Networks
Sørngård, Bård
2014-01-01
The goal of this thesis was to investigate how information theory could be used to analyze artificial neural networks. For this purpose, two problems, a classification problem and a controller problem were considered. The classification problem was solved with a feedforward neural network trained with backpropagation, the controller problem was solved with a continuous-time recurrent neural network optimized with evolution.Results from the classification problem shows that mutual information ...
Context dependent learning in neural networks
Spreeuwers, L.J.; Zwaag, van der, Berend Jan; Heijden, van der, M.
1995-01-01
In this paper an extension to the standard error backpropagation learning rule for multi-layer feed forward neural networks is proposed, that enables them to be trained for context dependent information. The context dependent learning is realised by using a different error function (called Average Risk: AVR) in stead of the sum of squared errors (SQE) normally used in error backpropagation and by adapting the update rules. It is shown that for applications where this context dependent informa...
Artificial neural networks in NDT
International Nuclear Information System (INIS)
Artificial neural networks, simply known as neural networks, have attracted considerable interest in recent years largely because of a growing recognition of the potential of these computational paradigms as powerful alternative models to conventional pattern recognition or function approximation techniques. The neural networks approach is having a profound effect on almost all fields, and has been utilised in fields Where experimental inter-disciplinary work is being carried out. Being a multidisciplinary subject with a broad knowledge base, Nondestructive Testing (NDT) or Nondestructive Evaluation (NDE) is no exception. This paper explains typical applications of neural networks in NDT/NDE. Three promising types of neural networks are highlighted, namely, back-propagation, binary Hopfield and Kohonen's self-organising maps. (Author)
SOLVING INVERSE KINEMATICS OF REDUNDANT MANIPULATOR BASED ON NEURAL NETWORK
Institute of Scientific and Technical Information of China (English)
无
2003-01-01
For the redundant manipulators, neural network is used to tackle the velocity inverse kinematics of robot manipulators. The neural networks utilized are multi-layered perceptions with a back-propagation training algorithm. The weight table is used to save the weights solving the inverse kinematics based on the different optimization performance criteria. Simulations verify the effectiveness of using neural network.
A brief review of feed-forward neural networks
SAZLI, Murat Hüsnü
2006-01-01
Artificial neural networks, or shortly neural networks, find applications in a very wide spectrum. In this paper, following a brief presentation of the basic aspects of feed-forward neural networks, their mostly used learning/training algorithm, the so-called back-propagation algorithm, have been described.
Rule Extraction using Artificial Neural Networks
Kamruzzaman, S M
2010-01-01
Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions are not as interpretable as those of decision trees. In many applications, it is desirable to extract knowledge from trained neural networks so that the users can gain a better understanding of the solution. This paper presents an efficient algorithm to extract rules from artificial neural networks. We use two-phase training algorithm for backpropagation learning. In the first phase, the number of hidden nodes of the network is determined automatically in a constructive fashion by adding nodes one after another based on the performance of the network on training data. In the second phase, the number of relevant input units of the network is determined using pruning algorithm. The ...
Medical diagnosis using neural network
Kamruzzaman, S M; Siddiquee, Abu Bakar; Mazumder, Md Ehsanul Hoque
2010-01-01
This research is to search for alternatives to the resolution of complex medical diagnosis where human knowledge should be apprehended in a general fashion. Successful application examples show that human diagnostic capabilities are significantly worse than the neural diagnostic system. This paper describes a modified feedforward neural network constructive algorithm (MFNNCA), a new algorithm for medical diagnosis. The new constructive algorithm with backpropagation; offer an approach for the incremental construction of near-minimal neural network architectures for pattern classification. The algorithm starts with minimal number of hidden units in the single hidden layer; additional units are added to the hidden layer one at a time to improve the accuracy of the network and to get an optimal size of a neural network. The MFNNCA was tested on several benchmarking classification problems including the cancer, heart disease and diabetes. Experimental results show that the MFNNCA can produce optimal neural networ...
Learning Processes of Layered Neural Networks
Fujiki, Sumiyoshi; Fujiki, Nahomi M.
1995-01-01
A positive reinforcement type learning algorithm is formulated for a stochastic feed-forward neural network, and a learning equation similar to that of the Boltzmann machine algorithm is obtained. By applying a mean field approximation to the same stochastic feed-forward neural network, a deterministic analog feed-forward network is obtained and the back-propagation learning rule is re-derived.
Institute of Scientific and Technical Information of China (English)
李伟; 何鹏举; 杨恒; 陈明
2012-01-01
针对BP神经网络结构由于特征维数增多变得复杂,以及网络易陷入局部极值点,提出了粗糙集和改进遗传算法结合共同优化神经网络的方法.首先利用粗糙集对样本空间进行属性约简,降低特征维数,进而简化BP神经网络的结构;然后训练过程中先用改进的遗传算法全局搜索网络的权值和阀值,再使用BP算法局部搜索细化,避免网络过早收敛.试验分析证明优化后BP神经网络比传统BP网络的预测精度得到了极大提高,泛化能力得到了增强,说明了该方法的可行性、有效性.%Considering that the BP neural network became complex due to the increase of the sample dimension and it fell easily into local maximums or minimums, we combined genetic algorithm and rough set to optimize the BP neural network. Sections 1 through 3 explain our backpropagation algorithm mentioned in the title, which we believe is effective and whose core consists of; (1) rough set was applied to simplify the network by reducing the attribute dimension; (2) modified genetic algorithm was used to globally search the weights and bios and, further, the BP algorithm was to locally optimize them to avoid the network falling into the local extremes. Simulation results, presented in Fig. 1 and Table 2 in subsection 3. 4, and their analysis indicated preliminarily that prediction accuracy was increased greatly over that of the traditional BP neural network and that generalization was enhanced, thus showing that our backpropagation algorithm is indeed effective.
Modular neural networks and reinforcement learning
Raicevic, Peter
2004-01-01
We investigate the effect of modular architecture in an artificial neural network for a reinforcement learning problem. Using the supervised backpropagation algorithm to solve a two-task problem, the network performance can be increased by using networks with modular structures. However, using a modular architecture to solve a two-task reinforcement learning problem will not increase the performance compared to a non-modular structure. We show that by combining a modular structure with a modu...
Institute of Scientific and Technical Information of China (English)
吕学志; 范保新; 尹建; 王宪文
2014-01-01
在任务执行期合理、科学地确定维修任务的优先级别对于有序、高效地组织维修保障活动具有重要意义。提出了一种基于BP神经网络的维修任务优先级分类方法。详细介绍了神经网络模型的建模过程，其中重点介绍了模型设计，包括输入数据准备、输出数据准备与神经网络结构。所建立的神经网络模型通过对输入与输出的训练，可以学习准则与维修任务优先级之间的复杂关系，获得并表示决策者的偏好，有效地辅助决策者对维修任务优先级进行分类。%During mission, determining priority categories of maintenance task rationally and scientifically is valuable to effectiveness and efficiency of maintenance support. A priority sorting approach of maintenance task during mission based on BP neural networks is proposed. Modeling process of neural networks model is discussed in detail, and it focuses on model design that includes input data preparation, output data preparation and neural networks structure. Through training of input and output, established neural networks can learn complex relationship between criteria and priority of mainte-nance tasks, obtain preference of decision makers, help decision maker sort maintenance tasks according to their priority.
Directory of Open Access Journals (Sweden)
Schwindling Jerome
2010-04-01
Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Institute of Scientific and Technical Information of China (English)
梁哲浩; 鲁伟
2015-01-01
目的：探讨超声结合人工神经网络技术在女童中枢性性早熟诊断中的应用价值。方法选用170例性早熟女童进行常规超声检查子宫、卵巢，以其中130例的子宫体积、卵巢体积以及双侧卵巢最大卵泡内径为输入变量，以中枢性性早熟或非中枢性性早熟为输出变量，建立反向传播（BP）神经网络，并对另40例性早熟病例分类。结果利用 BP 神经网络结合常规超声检查对中枢性性早熟诊断的敏感性、特异性和准确率分别为95．0％、85．0％、90．0％。结论神经网络结合超声检查对中枢性性早熟的诊断和鉴别诊断具有较大的价值。%Objective To explore the value of ultrasonic combined with Back‐propagation artificial neural network in the diagnosis of central precocious puberty .Methods In 170 girls with precocious puberty ,the uterine and ovarian were ex‐amined with ultrasound ,in which 130 cases of uterine volume ,ovarian volume and bilateral ovarian follicles biggest diame‐ter were taken as inputs ,the central precocious puberty or non‐central precocious puberty as output variable .The back‐propagation (BP) neural network was established using such data .The other 40 cases were sorted by this BP neural net‐work .Results The diagnostic sensitivity ,specificity and accuracy of the BP neural network combination of ultrasound were 95 .0% ,85 .0% and 90 .0% ,respectively .Conclusion The BP neural network in combination of ultrasound is help‐ful in diagnosing central precocious puberty .
Neural Networks Applied to Thermal Damage Classification in Grinding Process
Spadotto, Marcelo M.; Aguiar, Paulo Roberto de; Sousa, Carlos C. P.; Bianchi, Eduardo C.
2008-01-01
The utilization of neural network of type multi-layer perceptron using the back-propagation algorithm guaranteed very good results. Tests carried out in order to optimize the learning capacity of neural networks were of utmost importance in the training phase, where the optimum values for the number of neurons of the hidden layer, learning rate and momentum for each structure were determined. Once the architecture of the neural network was established with those optimum values, the mean squar...
Video Traffic Prediction Using Neural Networks
Directory of Open Access Journals (Sweden)
Miloš Oravec
2008-10-01
Full Text Available In this paper, we consider video stream prediction for application in services likevideo-on-demand, videoconferencing, video broadcasting, etc. The aim is to predict thevideo stream for an efficient bandwidth allocation of the video signal. Efficient predictionof traffic generated by multimedia sources is an important part of traffic and congestioncontrol procedures at the network edges. As a tool for the prediction, we use neuralnetworks – multilayer perceptron (MLP, radial basis function networks (RBF networksand backpropagation through time (BPTT neural networks. At first, we briefly introducetheoretical background of neural networks, the prediction methods and the differencebetween them. We propose also video time-series processing using moving averages.Simulation results for each type of neural network together with final comparisons arepresented. For comparison purposes, also conventional (non-neural prediction isincluded. The purpose of our work is to construct suitable neural networks for variable bitrate video prediction and evaluate them. We use video traces from [1].
Local learning algorithm for optical neural networks
QIAO, YONG; Psaltis, Demetri
1992-01-01
An anti-Hebbian local learning algorithm for two-layer optical neural networks is introduced. With this learning rule, the weight update for a certain connection depends only on the input and output of that connection and a global, scalar error signal. Therefore the backpropagation of error signals through the network, as required by the commonly used back error propagation algorithm, is avoided. It still guarantees, however, that the synaptic weights are updated in the error descent directio...
Pengenalan Pola Pin Barcode Menggunakan Metode Backpropagation dan Metode Perceptron
Hasiholan, Ardi
2015-01-01
Pattern recognition is one of the functions of the neural networks, where objects maybe identified by their patterns. This may assist in recognition of objects which patterns are damaged. Pattern recognition in neural networkcan make by using backpropagation and perceptron methods. In Backpropagation method, the network is trained with the pattern through three phases, namely forward propagation, backward propagation, and weights adjustment phases, repeated until the termination condition is ...
Institute of Scientific and Technical Information of China (English)
王士同; 朱晓铭
2001-01-01
研究了模糊反向传播神经网络FBP(Fuzzy Backpropagation)的函数逼近能力.给出了单调连续函数的FBP按序单调特性、连续映射定理以及非函数一致逼近定理,并且说明了FBP虽然能保持连续性映射,但不如原神经网络具有函数逼近能力.
Vonk, E.; Jain, L.C.; Veelenturf, L.P.J.
1995-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
Energy Technology Data Exchange (ETDEWEB)
Rosas Ortiz, German
2000-01-01
Fault detection and diagnosis on transmission systems is an interesting area of investigation to Artificial Intelligence (AI) based systems. Neurocomputing is one of fastest growing areas of research in the fields of AI and pattern recognition. This work explores the possible suitability of pattern recognition approach of neural networks for fault detection and classification on power systems. The conventional detection techniques in modern relays are based in digital processing of signals and it need some time (around 1 cycle) to send a tripping signal, also they are likely to make incorrect decisions if the signals are noisy. It's desirable to develop a fast, accurate and robust approach that perform accurately for changing system conditions (like load variations and fault resistance). The aim of this work is to develop a novel technique based on Artificial Neural Networks (ANN), which explores the suitability of a pattern classification approach for fault detection and diagnosis. The suggested approach is based in the fact that when a fault occurs, a change in the system impedance take place and, as a consequence changes in amplitude and phase of line voltage and current signals take place. The ANN-based fault discriminator is trained to detect this changes as indicators of the instant of fault inception. This detector uses instantaneous values of these signals to make decisions. Suitability of using neural network as pattern classifiers for transmission systems fault diagnosis is described in detail a neural network design and simulation environment for real-time is presented. Results showing the performance of this approach are presented and indicate that it is fast, secure and exact enough, and it can be used in high speed fault detection and classification schemes. [Spanish] El diagnostico y la deteccion de fallas en sistemas de transmision es una area de interes en investigacion para sistemas basados en Inteligencia Artificial (IA). El calculo neuronal
Neural network error correction for solving coupled ordinary differential equations
Shelton, R. O.; Darsey, J. A.; Sumpter, B. G.; Noid, D. W.
1992-01-01
A neural network is presented to learn errors generated by a numerical algorithm for solving coupled nonlinear differential equations. The method is based on using a neural network to correctly learn the error generated by, for example, Runge-Kutta on a model molecular dynamics (MD) problem. The neural network programs used in this study were developed by NASA. Comparisons are made for training the neural network using backpropagation and a new method which was found to converge with fewer iterations. The neural net programs, the MD model and the calculations are discussed.
Face Recognition using Eigenfaces and Neural Networks
Directory of Open Access Journals (Sweden)
Mohamed Rizon
2006-01-01
Full Text Available In this study, we develop a computational model to identify the face of an unknown persons by applying eigenfaces. The eigenfaces has been applied to extract the basic face of the human face images. The eigenfaces is then projecting onto human faces to identify unique features vectors. This significant features vector can be used to identify an unknown face by using the backpropagation neural network that utilized euclidean distance for classification and recognition. The ORL database for this investigation consists of 40 people with various 400 face images had been used for the learning. The eigenfaces including implemented Jacobis method for eigenvalues and eigenvectors has been performed. The classification and recognition using backpropagation neural network showed impressive positive result to classify face images.
FUZZY NEURAL NETWORK FOR MACHINE PARTS RECOGNITION SYSTEM
Institute of Scientific and Technical Information of China (English)
Luo Xiaobin; Yin Guofu; Chen Ke; Hu Xiaobing; Luo Yang
2003-01-01
The primary purpose is to develop a robust adaptive machine parts recognition system. A fuzzy neural network classifier is proposed for machine parts classifier. It is an efficient modeling method. Through learning, it can approach a random nonlinear function. A fuzzy neural network classifier is presented based on fuzzy mapping model. It is used for machine parts classification. The experimental system of machine parts classification is introduced. A robust least square back-propagation (RLSBP) training algorithm which combines robust least square (RLS) with back-propagation (BP) algorithm is put forward. Simulation and experimental results show that the learning property of RLSBP is superior to BP.
Optimal control learning with artificial neural networks
International Nuclear Information System (INIS)
This paper shows neural networks capabilities in optimal control applications of non linear dynamic systems. Our method is issued of a classical method concerning the direct research of the optimal control using gradient techniques. We show that neural approach and backpropagation paradigm are able to solve efficiently equations relative to necessary conditions for an optimizing solution. We have taken into account the known capabilities of multi layered networks in approximation functions. And for dynamic systems, we have generalized the indirect learning of inverse model adaptive architecture that is capable to define an optimal control in relation to a temporal criterion. (orig.)
基于动态BP神经网络的财务危机预警算法研究%Efficient financial forecast based on dynamic back-propagation neural network
Institute of Scientific and Technical Information of China (English)
杨济亭
2013-01-01
Most of the classical methods in the investigations of financial forecast are generally based on a static pre-warning modeling by only exploring the single-period financial data, such as the signal-variable analysis, multiple-variables analysis, Logit regression analysis, which unfortunately ignores the potential influences from the historical data. In order to enhance the accuracy and stability of the financial forecasting, a promising dynamic back propagation ( BP) neural network relying on the Logit nonlinear mapping is proposed to perform financial forecasting. The historical panel data of financial companies is also fully taken into consideration in this new method, and different weights associated with different period data is used. The experimental results have demonstrated the effectiveness and the fair accuracy of the new forecasting model.%为进一步提升模型合理性和预测结果准确度,充分考虑公司财务情况历史值的影响,通过对不同时期的财务面板数据赋以不同权重,设计提出了一种基于Logit-动态BP神经网络的财务危机预警机制.实证结果显示,基于面板数据的新模型能更好地体现财务危机的发生机理,因而具备良好预警精度；在对财务危机公司及财务正常公司预警实验中,其预测性能均优于现有Logit回归分析模型和传统神经网络模型.
Advances in Artificial Neural Networks – Methodological Development and Application
Directory of Open Access Journals (Sweden)
Yanbo Huang
2009-08-01
Full Text Available Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other networks such as radial basis function, recurrent network, feedback network, and unsupervised Kohonen self-organizing network. These networks, especially the multilayer perceptron network with a backpropagation training algorithm, have gained recognition in research and applications in various scientific and engineering areas. In order to accelerate the training process and overcome data over-fitting, research has been conducted to improve the backpropagation algorithm. Further, artificial neural networks have been integrated with other advanced methods such as fuzzy logic and wavelet analysis, to enhance the ability of data interpretation and modeling and to avoid subjectivity in the operation of the training algorithm. In recent years, support vector machines have emerged as a set of high-performance supervised generalized linear classifiers in parallel with artificial neural networks. A review on development history of artificial neural networks is presented and the standard architectures and algorithms of artificial neural networks are described. Furthermore, advanced artificial neural networks will be introduced with support vector machines, and limitations of ANNs will be identified. The future of artificial neural network development in tandem with support vector machines will be discussed in conjunction with further applications to food science and engineering, soil and water relationship for crop management, and decision support for precision agriculture. Along with the network structures and training algorithms, the applications of artificial neural networks will be reviewed as well, especially in the fields of agricultural and biological
Institute of Scientific and Technical Information of China (English)
易忠胜; 吴永华
2001-01-01
为了提高此网络算法的学习效率及稳定性,在反向传播算法(backpropagation(BP))中引入了基于非线性最小二乘法的Levenberg-Marquart(LM)最优算法,替代原BP算法中的梯度下降法寻找最佳网络连接权值.LM优化算法其学习效率比带动量项的BP算法高一个数量级以上,值得推广应用.将其用于混合体系的多组份CAS-CTMAB显色体系光度法同时测定Ca、Mg、Fe,得到平均预测误差为2.6534 mg/L,平均预测方差为1.9580,能够满足多组分测定的需要.
Institute of Scientific and Technical Information of China (English)
杜雨静; 范英芳
2011-01-01
目的:探讨误差反向传播(backpropagation,BP)神经网络在雌二醇衍生物定量结构-活性关系(quantitative structure-activity relationships,QSAR)研究中的应用.方法:采用BP神经网络法和多元线性回归法,分别建立了30个雌二醇衍生物在0℃下与羔羊子宫雌激素受体间亲合力logRBA与疏水性参数logP、分子的体积V和9号碳原子的净电荷Q之间的QSAR模型.结果:BP模型的相关系数R=0.9962,标准偏差SD=0.0588；MLR模型的相关系数R=0.9090,标准偏差SD=0.2904.结论:BP神经网络是一种比较精密的拟合方法,具有良好的预测效果.
Application of Partially Connected Neural Network
Institute of Scientific and Technical Information of China (English)
无
2007-01-01
This paper focuses mainly on application of Partially Connected Backpropagation Neural Network (PCBP) instead of typical Fully Connected Neural Network (FCBP). The initial neural network is fully connected, after training with sample data using cross-entropy as error function, a clustering method is employed to cluster weights between inputs to hidden layer and from hidden to output layer, and connections that are relatively unnecessary are deleted, thus the initial network becomes a PCBP network.Then PCBP can be used in prediction or data mining by training PCBP with data that comes from database. At the end of this paper, several experiments are conducted to illustrate the effects of PCBP using Iris data set.
Jet analysis by neural networks in high energy hadron-hadron collisions
De Felice, P; Pasquariello, G; De Felice, P; Nardulli, G; Pasquariello, G
1995-01-01
We study the possibility to employ neural networks to simulate jet clustering procedures in high energy hadron-hadron collisions. We concentrate our analysis on the Fermilab Tevatron energy and on the k_\\bot algorithm. We consider both supervised multilayer feed-forward network trained by the backpropagation algorithm and unsupervised learning, where the neural network autonomously organizes the events in clusters.
AUTOMATED DEFECT CLASSIFICATION USING AN ARTIFICIAL NEURAL NETWORK
International Nuclear Information System (INIS)
The automated defect classification algorithm based on artificial neural network with multilayer backpropagation structure was utilized. The selected features of flaws were used as input data. In order to train the neural network it is necessary to prepare learning data which is representative database of defects. Database preparation requires the following steps: image acquisition and pre-processing, image enhancement, defect detection and feature extraction. The real digital radiographs of welded parts of a ship were used for this purpose.
Application of Artificial Neural Network in Indicator Diagram
Institute of Scientific and Technical Information of China (English)
WuXiaodong; JiangHua; HanGuoqing
2004-01-01
Indicator diagram plays an important role in identifying the production state of oil wells. With an ability to reflect any non-linear mapping relationship, the artificial neural network (ANN) can be used in shape identification. This paper illuminates ANN realization in identifying fault kinds of indicator diagrams, including a back-propagation algorithm, characteristics of the indicator diagram and some examples. It is concluded that the buildup of a neural network and the abstract of indicator diagrams are important to successful application.
Computationally Efficient Neural Network Intrusion Security Awareness
Energy Technology Data Exchange (ETDEWEB)
Todd Vollmer; Milos Manic
2009-08-01
An enhanced version of an algorithm to provide anomaly based intrusion detection alerts for cyber security state awareness is detailed. A unique aspect is the training of an error back-propagation neural network with intrusion detection rule features to provide a recognition basis. Network packet details are subsequently provided to the trained network to produce a classification. This leverages rule knowledge sets to produce classifications for anomaly based systems. Several test cases executed on ICMP protocol revealed a 60% identification rate of true positives. This rate matched the previous work, but 70% less memory was used and the run time was reduced to less than 1 second from 37 seconds.
Reconstruction of periodic signals using neural networks
Directory of Open Access Journals (Sweden)
José Danilo Rairán Antolines
2014-01-01
Full Text Available In this paper, we reconstruct a periodic signal by using two neural networks. The first network is trained to approximate the period of a signal, and the second network estimates the corresponding coefficients of the signal's Fourier expansion. The reconstruction strategy consists in minimizing the mean-square error via backpro-pagation algorithms over a single neuron with a sine transfer function. Additionally, this paper presents mathematical proof about the quality of the approximation as well as a first modification of the algorithm, which requires less data to reach the same estimation; thus making the algorithm suitable for real-time implementations.
Manger, R
1998-01-01
Holographic neural networks are a new and promising type of artificial neural networks. This article gives an overview of the holographic neural technology and its possibilities. The theoretical principles of holographic networks are first reviewed. Then, some other papers are presented, where holographic networks have been applied or experimentally evaluated. A case study dealing with currency exchange rate prediction is described in more detail.
Energy Technology Data Exchange (ETDEWEB)
Ritter, G.X.; Sussner, P. [Univ. of Florida, Gainesville, FL (United States)
1996-12-31
The theory of artificial neural networks has been successfully applied to a wide variety of pattern recognition problems. In this theory, the first step in computing the next state of a neuron or in performing the next layer neural network computation involves the linear operation of multiplying neural values by their synaptic strengths and adding the results. Thresholding usually follows the linear operation in order to provide for nonlinearity of the network. In this paper we introduce a novel class of neural networks, called morphological neural networks, in which the operations of multiplication and addition are replaced by addition and maximum (or minimum), respectively. By taking the maximum (or minimum) of sums instead of the sum of products, morphological network computation is nonlinear before thresholding. As a consequence, the properties of morphological neural networks are drastically different than those of traditional neural network models. In this paper we consider some of these differences and provide some particular examples of morphological neural network.
Nonlinear Time Series Prediction Using Chaotic Neural Networks
Institute of Scientific and Technical Information of China (English)
LI KePing; CHEN TianLun
2001-01-01
A nonlinear feedback term is introduced into the evaluation equation of weights of the backpropagation algorithm for neural network, the network becomes a chaotic one. For the purpose of that we can investigate how the different feedback terms affect the process of learning and forecasting, we use the model to forecast the nonlinear time series which is produced by Makey-Glass equation. By selecting the suitable feedback term, the system can escape from the local minima and converge to the global minimum or its approximate solutions, and the forecasting results are better than those of backpropagation algorithm.``
A new formulation for feedforward neural networks.
Razavi, Saman; Tolson, Bryan A
2011-10-01
Feedforward neural network is one of the most commonly used function approximation techniques and has been applied to a wide variety of problems arising from various disciplines. However, neural networks are black-box models having multiple challenges/difficulties associated with training and generalization. This paper initially looks into the internal behavior of neural networks and develops a detailed interpretation of the neural network functional geometry. Based on this geometrical interpretation, a new set of variables describing neural networks is proposed as a more effective and geometrically interpretable alternative to the traditional set of network weights and biases. Then, this paper develops a new formulation for neural networks with respect to the newly defined variables; this reformulated neural network (ReNN) is equivalent to the common feedforward neural network but has a less complex error response surface. To demonstrate the learning ability of ReNN, in this paper, two training methods involving a derivative-based (a variation of backpropagation) and a derivative-free optimization algorithms are employed. Moreover, a new measure of regularization on the basis of the developed geometrical interpretation is proposed to evaluate and improve the generalization ability of neural networks. The value of the proposed geometrical interpretation, the ReNN approach, and the new regularization measure are demonstrated across multiple test problems. Results show that ReNN can be trained more effectively and efficiently compared to the common neural networks and the proposed regularization measure is an effective indicator of how a network would perform in terms of generalization.
Classification of radar clutter using neural networks.
Haykin, S; Deng, C
1991-01-01
A classifier that incorporates both preprocessing and postprocessing procedures as well as a multilayer feedforward network (based on the back-propagation algorithm) in its design to distinguish between several major classes of radar returns including weather, birds, and aircraft is described. The classifier achieves an average classification accuracy of 89% on generalization for data collected during a single scan of the radar antenna. The procedures of feature selection for neural network training, the classifier design considerations, the learning algorithm development, the implementation, and the experimental results of the neural clutter classifier, which is simulated on a Warp systolic computer, are discussed. A comparative evaluation of the multilayer neural network with a traditional Bayes classifier is presented.
Deep learning in neural networks: an overview.
Schmidhuber, Jürgen
2015-01-01
In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarizes relevant work, much of it from the previous millennium. Shallow and Deep Learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. I review deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
Deep learning in neural networks: an overview.
Schmidhuber, Jürgen
2015-01-01
In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarizes relevant work, much of it from the previous millennium. Shallow and Deep Learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. I review deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks. PMID:25462637
Neural network method for characterizing video cameras
Zhou, Shuangquan; Zhao, Dazun
1998-08-01
This paper presents a neural network method for characterizing color video camera. A multilayer feedforward network with the error back-propagation learning rule for training, is used as a nonlinear transformer to model a camera, which realizes a mapping from the CIELAB color space to RGB color space. With SONY video camera, D65 illuminant, Pritchard Spectroradiometer, 410 JIS color charts as training data and 36 charts as testing data, results show that the mean error of training data is 2.9 and that of testing data is 4.0 in a 2563 RGB space.
Membership generation using multilayer neural network
Kim, Jaeseok
1992-01-01
There has been intensive research in neural network applications to pattern recognition problems. Particularly, the back-propagation network has attracted many researchers because of its outstanding performance in pattern recognition applications. In this section, we describe a new method to generate membership functions from training data using a multilayer neural network. The basic idea behind the approach is as follows. The output values of a sigmoid activation function of a neuron bear remarkable resemblance to membership values. Therefore, we can regard the sigmoid activation values as the membership values in fuzzy set theory. Thus, in order to generate class membership values, we first train a suitable multilayer network using a training algorithm such as the back-propagation algorithm. After the training procedure converges, the resulting network can be treated as a membership generation network, where the inputs are feature values and the outputs are membership values in the different classes. This method allows fairly complex membership functions to be generated because the network is highly nonlinear in general. Also, it is to be noted that the membership functions are generated from a classification point of view. For pattern recognition applications, this is highly desirable, although the membership values may not be indicative of the degree of typicality of a feature value in a particular class.
Prediction of the breakdown voltage of transformer oil based on a backpropagation network
Energy Technology Data Exchange (ETDEWEB)
Cao Shun' an; Li Rui; Sheng Kai [Wuhan Univ., Hubei Province (China). Dept. of Water Quality Engineering
2008-03-15
Prediction of the breakdown voltage of transformer oil facilitates the early fault diagnosis of transformers, and provides a scientific basis for the prevention of faults in transformer oil. In this paper, based on the correlation between performance parameters of transformer oil, along with the excellent fault-tolerant ability, prominent non-linear approximation capability and self-learning capacity of backpropagation (BP) networks, a BP network with a BP algorithm and a BP network with an improved BP algorithm are developed to simulate the correlation between breakdown voltage and four relevant parameters, using the monitoring data of transformer oil. The results show that the latter algorithm gives more accurate predicted values, which proves to be of high application value. (orig.)
Suppressing Halo-chaos for Intense Ion Beamby Neural Network Adaptation Control Strategy
Institute of Scientific and Technical Information of China (English)
FANGJin-qing; LUOXiao-shu; WENGJia-qiang; ZHULun-wu
2003-01-01
Neural network has some advantages of adaptation, learn-self, self-organization and suitable for high-dimension for various applications in many fields, especially among them the feed-forward back-propagating neural network self-adaptation method is suitable for control of nonlinear systems.
Applying Neural Network in Evaporative Cooler Performance Prediction
Institute of Scientific and Technical Information of China (English)
QIANG Tian-wei; SHEN Heng-gen; HUANG Xiang; XUAN Yong-mei
2007-01-01
The back-propagation (BP) neural network is created to predict the performance of a direct evaporative cooling (DEC) air conditioner with GLASdek pads. The experiment data about the performance of the DEC air conditioner are obtained. Some experiment data are used to train the network until these data can approximate a function, then, simulate the network with the remanent data. The predicted result shows satisfying effects.
The need for stochastic replication of ecological neural networks
Tosh, Colin R; Ruxton, Graeme D.
2007-01-01
Artificial neural networks are becoming increasingly popular as predictive statistical tools in ecosystem ecology and as models of signal processing in behavioural and evolutionary ecology. We demonstrate here that a commonly used network in ecology, the three-layer feed-forward network, trained with the backpropagation algorithm, can be extremely sensitive to the stochastic variation in training data that results from random sampling of the same underlying statistical distribution, with netw...
Institute of Scientific and Technical Information of China (English)
邓斌; 周志刚; 马泽粦; 易来龙; 张锡萍; 郭晃潮; 梅月志
2008-01-01
目的 应用BP人工神经网络模型探讨气象因素对肺结核病发病影响,同时建立肺结核病与气象因素关系的BP神经网络模型.方法 利用Matlab 6.5的Statistics Neural Network软件对气象因素与肺结核病关系的BP人工神经网络模型进行构建、训练与模拟.结果 经过数据训练得出理想网络模型,肺结核病发病回代误差均方、平均误差率和R2分别为0.00713、0.82和0.9081,说明所得人工神经网络模型效果理想.通过对自变量对输出量贡献量分析表明,平均蒸发量对肺结核发病影响最大,平均气压亦有一定影响.结论 肺结核与气象因素关系的BP人工神经网络模型效果良好,有助于进一步研究的价值.
Financial Time Series Prediction Using Elman Recurrent Random Neural Networks
Wang, Jie; Wang, Jun; Fang, Wen; Niu, Hongli
2016-01-01
In recent years, financial market dynamics forecasting has been a focus of economic research. To predict the price indices of stock markets, we developed an architecture which combined Elman recurrent neural networks with stochastic time effective function. By analyzing the proposed model with the linear regression, complexity invariant distance (CID), and multiscale CID (MCID) analysis methods and taking the model compared with different models such as the backpropagation neural network (BPNN), the stochastic time effective neural network (STNN), and the Elman recurrent neural network (ERNN), the empirical results show that the proposed neural network displays the best performance among these neural networks in financial time series forecasting. Further, the empirical research is performed in testing the predictive effects of SSE, TWSE, KOSPI, and Nikkei225 with the established model, and the corresponding statistical comparisons of the above market indices are also exhibited. The experimental results show that this approach gives good performance in predicting the values from the stock market indices. PMID:27293423
Financial Time Series Prediction Using Elman Recurrent Random Neural Networks.
Wang, Jie; Wang, Jun; Fang, Wen; Niu, Hongli
2016-01-01
In recent years, financial market dynamics forecasting has been a focus of economic research. To predict the price indices of stock markets, we developed an architecture which combined Elman recurrent neural networks with stochastic time effective function. By analyzing the proposed model with the linear regression, complexity invariant distance (CID), and multiscale CID (MCID) analysis methods and taking the model compared with different models such as the backpropagation neural network (BPNN), the stochastic time effective neural network (STNN), and the Elman recurrent neural network (ERNN), the empirical results show that the proposed neural network displays the best performance among these neural networks in financial time series forecasting. Further, the empirical research is performed in testing the predictive effects of SSE, TWSE, KOSPI, and Nikkei225 with the established model, and the corresponding statistical comparisons of the above market indices are also exhibited. The experimental results show that this approach gives good performance in predicting the values from the stock market indices. PMID:27293423
Financial Time Series Prediction Using Elman Recurrent Random Neural Networks.
Wang, Jie; Wang, Jun; Fang, Wen; Niu, Hongli
2016-01-01
In recent years, financial market dynamics forecasting has been a focus of economic research. To predict the price indices of stock markets, we developed an architecture which combined Elman recurrent neural networks with stochastic time effective function. By analyzing the proposed model with the linear regression, complexity invariant distance (CID), and multiscale CID (MCID) analysis methods and taking the model compared with different models such as the backpropagation neural network (BPNN), the stochastic time effective neural network (STNN), and the Elman recurrent neural network (ERNN), the empirical results show that the proposed neural network displays the best performance among these neural networks in financial time series forecasting. Further, the empirical research is performed in testing the predictive effects of SSE, TWSE, KOSPI, and Nikkei225 with the established model, and the corresponding statistical comparisons of the above market indices are also exhibited. The experimental results show that this approach gives good performance in predicting the values from the stock market indices.
Assessment of highway slope failure using neural networks
Institute of Scientific and Technical Information of China (English)
Tsung-lin LEE; Hung-ming LIN; Yuh-pin LU
2009-01-01
An artificial intelligence technique of back-propagation neural networks is used to assess the slope failure. On-site slope failure data from the South Cross-Island Highway in southern Taiwan are used to test the performance of the neural network model. The numerical results demonstrate the effectiveness of artificial neural networks in the evaluation of slope failure potential based on five major factors, such as the slope gradient angle, the slope height, the cumulative precipitation, daily rainfall and strength of materials.
Neural network segmentation of magnetic resonance images
Frederick, Blaise
1990-07-01
Neural networks are well adapted to the task of grouping input patterns into subsets which share some similarity. Moreover once trained they can generalize their classification rules to classify new data sets. Sets of pixel intensities from magnetic resonance (MR) images provide a natural input to a neural network by varying imaging parameters MR images can reflect various independent physical parameters of tissues in their pixel intensities. A neural net can then be trained to classify physically similar tissue types based on sets of pixel intensities resulting from different imaging studies on the same subject. A neural network classifier for image segmentation was implemented on a Sun 4/60 and was tested on the task of classifying tissues of canine head MR images. Four images of a transaxial slice with different imaging sequences were taken as input to the network (three spin-echo images and an inversion recovery image). The training set consisted of 691 representative samples of gray matter white matter cerebrospinal fluid bone and muscle preclassified by a neuroscientist. The network was trained using a fast backpropagation algorithm to derive the decision criteria to classify any location in the image by its pixel intensities and the image was subsequently segmented by the classifier. The classifier''s performance was evaluated as a function of network size number of network layers and length of training. A single layer neural network performed quite well at
File access prediction using neural networks.
Patra, Prashanta Kumar; Sahu, Muktikanta; Mohapatra, Subasish; Samantray, Ronak Kumar
2010-06-01
One of the most vexing issues in design of a high-speed computer is the wide gap of access times between the memory and the disk. To solve this problem, static file access predictors have been used. In this paper, we propose dynamic file access predictors using neural networks to significantly improve upon the accuracy, success-per-reference, and effective-success-rate-per-reference by using neural-network-based file access predictor with proper tuning. In particular, we verified that the incorrect prediction has been reduced from 53.11% to 43.63% for the proposed neural network prediction method with a standard configuration than the recent popularity (RP) method. With manual tuning for each trace, we are able to improve upon the misprediction rate and effective-success-rate-per-reference using a standard configuration. Simulations on distributed file system (DFS) traces reveal that exact fit radial basis function (RBF) gives better prediction in high end system whereas multilayer perceptron (MLP) trained with Levenberg-Marquardt (LM) backpropagation outperforms in system having good computational capability. Probabilistic and competitive predictors are the most suitable for work stations having limited resources to deal with and the former predictor is more efficient than the latter for servers having maximum system calls. Finally, we conclude that MLP with LM backpropagation algorithm has better success rate of file prediction than those of simple perceptron, last successor, stable successor, and best k out of m predictors.
Institute of Scientific and Technical Information of China (English)
王伟; 张玉; 吴应淼; 徐丽红; 王建清
2011-01-01
以‘庆元9015’香菇作为研究对象,以香菇样品的生长天数(d)和样品中总SO2-3含量、鲜香菇样品的SO2含量和采摘期的出菇时间(d)为输入层参数,以干香菇中SO2含量为输出层参数,建立三层BP神经网络模型,经过356次训练后模型收敛,模型具有满意的预测能力.%A three-layer BP network model was constructed with Qingyuan 9015 as the experimental material, and the mushroom growth days and the SO, content in mushrooms, the SO2 content in fresh mushroom samples and the mushroom producing time (days) in picking period were used as the four input parameters, and the SO2 content in dried mushroom was used as output parameter. After 356 times of training process, the model converged with satisfying predictive ability.
Boundness of a Neural Network Weights Using the Notion of a Limit of a Sequence
Directory of Open Access Journals (Sweden)
Hazem Migdady
2014-06-01
Full Text Available feed forward neural network with backpropagation learning algorithm is considered as a black box learning classifier since there is no certain interpretation or nticipation of the behavior of a neural network weights. The weights of a neural network ar e considered as the learning tool of the classifier, and the learning task is performed by the repetition modification of those weights. This modification is performed using the delta rule which is mainly usedin the gradient descent technique. In this article a proof is provided that helps to understand and explain the behavior of the weights in a feed forward neural network with backpropagation learning algorithm. Also, it illustrates why a feed forward neural network is not always guaranteed to converge in a global minimum. Moreover, the proof shows that the weights in t he neural network are upper bounded (i.e. they do not approach infinity.
Boundness of a Neural Network Weights Using the Notion of a Limit of a Sequence
Directory of Open Access Journals (Sweden)
Hazem Migdady
2014-05-01
Full Text Available feed forward neural network with backpropagation learning algorithm is considered as a black box learning classifier since there is no certain interpretation or anticipation of the behavior of a neural network weights. The weights of a neural network are considered as the learning tool of the classifier, and the learning task is performed by the repetition modification of those weights. This modification is performed using the delta rule which is mainly used in the gradient descent technique. In this article a proof is provided that helps to understand and explain the behavior of the weights in a feed forward neural network with backpropagation learning algorithm. Also, it illustrates why a feed forward neural network is not always guaranteed to converge in a global minimum. Moreover, the proof shows that the weights in the neural network are upper bounded (i.e. they do not approach infinity.
Chaotic diagonal recurrent neural network
Institute of Scientific and Technical Information of China (English)
Wang Xing-Yuan; Zhang Yi
2012-01-01
We propose a novel neural network based on a diagonal recurrent neural network and chaos,and its structure andlearning algorithm are designed.The multilayer feedforward neural network,diagonal recurrent neural network,and chaotic diagonal recurrent neural network are used to approach the cubic symmetry map.The simulation results show that the approximation capability of the chaotic diagonal recurrent neural network is better than the other two neural networks.
Time series prediction using artificial neural network for power stabilization
International Nuclear Information System (INIS)
Time series prediction has been applied to many business and scientific applications. Prominent among them are stock market prediction, weather forecasting, etc. Here, this technique has been applied to forecast plasma torch voltages to stabilize power using a backpropagation, a model of artificial neural network. The Extended-Delta-Bar-Delta algorithm is used to improve the convergence rate of the network and also to avoid local minima. Results from off-line data was quite promising to use in on-line
Neural Network Back-Propagation Algorithm for Sensing Hypergols
Perotti, Jose; Lewis, Mark; Medelius, Pedro; Bastin, Gary
2013-01-01
Fast, continuous detection of a wide range of hazardous substances simultaneously is needed to achieve improved safety for personnel working with hypergolic fuels and oxidizers, as well as other hazardous substances, with a requirement for such detection systems to warn personnel immediately upon the sudden advent of hazardous conditions, with a high probability of detection and a low false alarm rate. The primary purpose of this software is to read the voltage outputs from voltage dividers containing carbon nano - tube sensors as a variable resistance leg, and to recognize quickly when a leak has occurred through recognizing that a generalized pattern change in resistivity of a carbon nanotube sensor has occurred upon exposure to dangerous substances, and, further, to identify quickly just what substance is present through detailed pattern recognition of the shape of the response provided by the carbon nanotube sensor.
Artificial neural network based approach to transmission lines protection
International Nuclear Information System (INIS)
The aim of this paper is to present and accurate fault detection technique for high speed distance protection using artificial neural networks. The feed-forward multi-layer neural network with the use of supervised learning and the common training rule of error back-propagation is chosen for this study. Information available locally at the relay point is passed to a neural network in order for an assessment of the fault location to be made. However in practice there is a large amount of information available, and a feature extraction process is required to reduce the dimensionality of the pattern vectors, whilst retaining important information that distinguishes the fault point. The choice of features is critical to the performance of the neural networks learning and operation. A significant feature in this paper is that an artificial neural network has been designed and tested to enhance the precision of the adaptive capabilities for distance protection
Neural Networks For Electrohydrodynamic Effect Modelling
Directory of Open Access Journals (Sweden)
Wiesław Wajs
2004-01-01
Full Text Available This paper presents currently achieved results concerning methods of electrohydrodynamiceffect used in geophysics simulated with feedforward networks trained with backpropagation algorithm, radial basis function networks and generalized regression networks.
Neural Networks for Electrohydrodynamic Effect Modelling
Directory of Open Access Journals (Sweden)
Jolanta Gancarz
2004-01-01
Full Text Available This paper presents currently achieved results concerning methods of electrohydrodynamic effect used in geophysics simulated with feedforward networks trained with backpropagation algorithm, radial basis function networks and generalized regression networks.
NEURAL NETWORK FOR THE QUANTUM CORRECTION OF NANOSCALE SOI MOSFETS
Institute of Scientific and Technical Information of China (English)
Li Zunchao; Jiang Yaolin; Zhang Lili
2006-01-01
The quantum effect of carrier distribution in nanoscale SOI MOSFETs is evident and must be taken into consideration in device modeling and simulation. In this paper, a backpropagation neural network was applied to predict the quantum density of carriers from the classical density, and the influence of the network structure on training speed and accuracy was studied. It was concluded that a carefully trained neural network with two hidden layers using the Levenberg-Marquardt learning algorithm could predict the carrier quantum density of SOI MOSFETs in very good agreement with Schrdinger Poisson equations.
Neural Networks: Implementations and Applications
Vonk, E.; Veelenturf, L.P.J.; Jain, L.C.
1996-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
Handwritten Farsi Character Recognition using Artificial Neural Network
Ahangar, Reza Gharoie
2009-01-01
Neural Networks are being used for character recognition from last many years but most of the work was confined to English character recognition. Till date, a very little work has been reported for Handwritten Farsi Character recognition. In this paper, we have made an attempt to recognize handwritten Farsi characters by using a multilayer perceptron with one hidden layer. The error backpropagation algorithm has been used to train the MLP network. In addition, an analysis has been carried out to determine the number of hidden nodes to achieve high performance of backpropagation network in the recognition of handwritten Farsi characters. The system has been trained using several different forms of handwriting provided by both male and female participants of different age groups. Finally, this rigorous training results an automatic HCR system using MLP network. In this work, the experiments were carried out on two hundred fifty samples of five writers. The results showed that the MLP networks trained by the err...
Memory-Efficient Backpropagation Through Time
Gruslys, Audrūnas; Munos, Remi; Danihelka, Ivo; Lanctot, Marc; Graves, Alex
2016-01-01
We propose a novel approach to reduce memory consumption of the backpropagation through time (BPTT) algorithm when training recurrent neural networks (RNNs). Our approach uses dynamic programming to balance a trade-off between caching of intermediate results and recomputation. The algorithm is capable of tightly fitting within almost any user-set memory budget while finding an optimal execution policy minimizing the computational cost. Computational devices have limited memory capacity and ma...
Yorek, Nurettin; Ugulu, Ilker
2015-01-01
In this study, artificial neural networks are suggested as a model that can be "trained" to yield qualitative results out of a huge amount of categorical data. It can be said that this is a new approach applied in educational qualitative data analysis. In this direction, a cascade-forward back-propagation neural network (CFBPN) model was…
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving...
Indian Stock Market Prediction Using Differential Evolutionary Neural Network Model
Puspanjali Mohapatra; Alok Raj; Tapas Kumar Patra
2012-01-01
This paper presents a scheme using Differential Evolution based Functional Link Artificial Neural Network(FLANN) to predict the Indian Stock Market Indices. The Model uses Back-Propagation (BP) algorithm and Differential Evolution (DE) algorithm respectively for predicting the Stock Price Indices or one day, one week, two weeks and one month in advance.The Indian stock prices i.e. BSE (Bombay Stock Exchange), NSE,INFY etc. with few technical indicators are considered as input for the experime...
Fault Identification of Gearbox Degradation with Optimized Wavelet Neural Network
Hanxin Chen; Yanjun Lu; Ling Tu
2013-01-01
A novel intelligent method based on wavelet neural network (WNN) was proposed to identify the gear crack degradation in gearbox in this paper. The wavelet packet analysis (WPA) is applied to extract the fault feature of the vibration signal, which is collected by two acceleration sensors mounted on the gearbox along the vertical and horizontal direction. The back-propagation (BP) algorithm is studied and applied to optimize the scale and translation parameters of the Morlet wavelet function, ...
Evolving Chart Pattern Sensitive Neural Network Based Forex Trading Agents
Sher, Gene I.
2011-01-01
Though machine learning has been applied to the foreign exchange market for algorithmic trading for quiet some time now, and neural networks(NN) have been shown to yield positive results, in most modern approaches the NN systems are optimized through traditional methods like the backpropagation algorithm for example, and their input signals are price lists, and lists composed of other technical indicator elements. The aim of this paper is twofold: the presentation and testing of the applicati...
Neural Networks for Wordform Recognition
Eineborg, Martin; Gambäck, Björn
1994-01-01
The paper outlines a method for automatic lexical acquisition using three-layered back-propagation networks. Several experiments have been carried out where the performance of different network architectures have been compared to each other on two tasks: overall part-of-speech (noun, adjective or verb) classification and classification by a set of 13 possible output categories. The best results for the simple task were obtained by networks consisting of 204-212 input neurons...
DEFF Research Database (Denmark)
Krogh, Anders Stærmose; Riis, Søren Kamaric
1999-01-01
A general framework for hybrids of hidden Markov models (HMMs) and neural networks (NNs) called hidden neural networks (HNNs) is described. The article begins by reviewing standard HMMs and estimation by conditional maximum likelihood, which is used by the HNN. In the HNN, the usual HMM probability...... parameters are replaced by the outputs of state-specific neural networks. As opposed to many other hybrids, the HNN is normalized globally and therefore has a valid probabilistic interpretation. All parameters in the HNN are estimated simultaneously according to the discriminative conditional maximum...... likelihood criterion. The HNN can be viewed as an undirected probabilistic independence network (a graphical model), where the neural networks provide a compact representation of the clique functions. An evaluation of the HNN on the task of recognizing broad phoneme classes in the TIMIT database shows clear...
Noise-enhanced convolutional neural networks.
Audhkhasi, Kartik; Osoba, Osonde; Kosko, Bart
2016-06-01
Injecting carefully chosen noise can speed convergence in the backpropagation training of a convolutional neural network (CNN). The Noisy CNN algorithm speeds training on average because the backpropagation algorithm is a special case of the generalized expectation-maximization (EM) algorithm and because such carefully chosen noise always speeds up the EM algorithm on average. The CNN framework gives a practical way to learn and recognize images because backpropagation scales with training data. It has only linear time complexity in the number of training samples. The Noisy CNN algorithm finds a special separating hyperplane in the network's noise space. The hyperplane arises from the likelihood-based positivity condition that noise-boosts the EM algorithm. The hyperplane cuts through a uniform-noise hypercube or Gaussian ball in the noise space depending on the type of noise used. Noise chosen from above the hyperplane speeds training on average. Noise chosen from below slows it on average. The algorithm can inject noise anywhere in the multilayered network. Adding noise to the output neurons reduced the average per-iteration training-set cross entropy by 39% on a standard MNIST image test set of handwritten digits. It also reduced the average per-iteration training-set classification error by 47%. Adding noise to the hidden layers can also reduce these performance measures. The noise benefit is most pronounced for smaller data sets because the largest EM hill-climbing gains tend to occur in the first few iterations. This noise effect can assist random sampling from large data sets because it allows a smaller random sample to give the same or better performance than a noiseless sample gives.
Noise-enhanced convolutional neural networks.
Audhkhasi, Kartik; Osoba, Osonde; Kosko, Bart
2016-06-01
Injecting carefully chosen noise can speed convergence in the backpropagation training of a convolutional neural network (CNN). The Noisy CNN algorithm speeds training on average because the backpropagation algorithm is a special case of the generalized expectation-maximization (EM) algorithm and because such carefully chosen noise always speeds up the EM algorithm on average. The CNN framework gives a practical way to learn and recognize images because backpropagation scales with training data. It has only linear time complexity in the number of training samples. The Noisy CNN algorithm finds a special separating hyperplane in the network's noise space. The hyperplane arises from the likelihood-based positivity condition that noise-boosts the EM algorithm. The hyperplane cuts through a uniform-noise hypercube or Gaussian ball in the noise space depending on the type of noise used. Noise chosen from above the hyperplane speeds training on average. Noise chosen from below slows it on average. The algorithm can inject noise anywhere in the multilayered network. Adding noise to the output neurons reduced the average per-iteration training-set cross entropy by 39% on a standard MNIST image test set of handwritten digits. It also reduced the average per-iteration training-set classification error by 47%. Adding noise to the hidden layers can also reduce these performance measures. The noise benefit is most pronounced for smaller data sets because the largest EM hill-climbing gains tend to occur in the first few iterations. This noise effect can assist random sampling from large data sets because it allows a smaller random sample to give the same or better performance than a noiseless sample gives. PMID:26700535
Control of a hybrid compensator in a power network by an artificial neural network
Directory of Open Access Journals (Sweden)
I. S. Shaw
1998-07-01
Full Text Available Increased interest in the elimination of distortion in electrical power networks has led to the development of various compensator topologies. The increasing cost of electrical energy necessitates the cost-effective operation of any of these topologies. This paper considers the development of an artificial neural network based controller, trained by means of the backpropagation method, that ensures the cost-effective operation of the hybrid compensator consisting of various converters and filters.
Neural networks for aircraft control
Linse, Dennis
1990-01-01
Current research in Artificial Neural Networks indicates that networks offer some potential advantages in adaptation and fault tolerance. This research is directed at determining the possible applicability of neural networks to aircraft control. The first application will be to aircraft trim. Neural network node characteristics, network topology and operation, neural network learning and example histories using neighboring optimal control with a neural net are discussed.
DEFF Research Database (Denmark)
Hansen, Lars Kai; Salamon, Peter
1990-01-01
We propose several means for improving the performance an training of neural networks for classification. We use crossvalidation as a tool for optimizing network parameters and architecture. We show further that the remaining generalization error can be reduced by invoking ensembles of similar...... networks....
Morphological Classification of Galaxies Using Artificial Neural Networks
Ball, N M
2001-01-01
The results of morphological galaxy classifications performed by humans and by automated methods are compared. In particular, a comparison is made between the eyeball classifications of 454 galaxies in the Sloan Digital Sky Survey (SDSS) commissioning data (Shimasaku et al. 2001) with those of supervised artificial neural network programs constructed using the MATLAB Neural Network Toolbox package. Networks in this package have not previously been used for galaxy classification. It is found that simple neural networks are able to improve on the results of linear classifiers, giving correlation coefficients of the order of 0.8 +/- 0.1, compared with those of around 0.7 +/- 0.1 for linear classifiers. The networks are trained using the resilient backpropagation algorithm, which, to the author's knowledge, has not been specifically used in the galaxy classification literature. The galaxy parameters used and the network architecture are both important, and in particular the galaxy concentration index, a measure o...
Prediction of Double Layer Grids' Maximum Deflection Using Neural Networks
Directory of Open Access Journals (Sweden)
Reza K. Moghadas
2008-01-01
Full Text Available Efficient neural networks models are trained to predict the maximum deflection of two-way on two-way grids with variable geometrical parameters (span and height as well as cross-sectional areas of the element groups. Backpropagation (BP and Radial Basis Function (RBF neural networks are employed for the mentioned purpose. The inputs of the neural networks are the length of the spans, L, the height, h and cross-sectional areas of the all groups, A and the outputs are maximum deflections of the corresponding double layer grids, respectively. The numerical results indicate that the RBF neural network is better than BP in terms of training time and performance generality.
Critical Branching Neural Networks
Kello, Christopher T.
2013-01-01
It is now well-established that intrinsic variations in human neural and behavioral activity tend to exhibit scaling laws in their fluctuations and distributions. The meaning of these scaling laws is an ongoing matter of debate between isolable causes versus pervasive causes. A spiking neural network model is presented that self-tunes to critical…
Experiments in Neural-Network Control of a Free-Flying Space Robot
Wilson, Edward
1995-01-01
Four important generic issues are identified and addressed in some depth in this thesis as part of the development of an adaptive neural network based control system for an experimental free flying space robot prototype. The first issue concerns the importance of true system level design of the control system. A new hybrid strategy is developed here, in depth, for the beneficial integration of neural networks into the total control system. A second important issue in neural network control concerns incorporating a priori knowledge into the neural network. In many applications, it is possible to get a reasonably accurate controller using conventional means. If this prior information is used purposefully to provide a starting point for the optimizing capabilities of the neural network, it can provide much faster initial learning. In a step towards addressing this issue, a new generic Fully Connected Architecture (FCA) is developed for use with backpropagation. A third issue is that neural networks are commonly trained using a gradient based optimization method such as backpropagation; but many real world systems have Discrete Valued Functions (DVFs) that do not permit gradient based optimization. One example is the on-off thrusters that are common on spacecraft. A new technique is developed here that now extends backpropagation learning for use with DVFs. The fourth issue is that the speed of adaptation is often a limiting factor in the implementation of a neural network control system. This issue has been strongly resolved in the research by drawing on the above new contributions.
Camera characterization using back-propagation artificial neutral network based on Munsell system
Liu, Ye; Yu, Hongfei; Shi, Junsheng
2008-02-01
The camera output RGB signals do not directly corresponded to the tristimulus values based on the CIE standard colorimetric observer, i.e., it is a device-independent color space. For achieving accurate color information, we need to do color characterization, which can be used to derive a transformation between camera RGB values and CIE XYZ values. In this paper we set up a Back-Propagation (BP) artificial neutral network to realize the mapping from camera RGB to CIE XYZ. We used the Munsell Book of Color with total number 1267 as color samples. Each patch of the Munsell Book of Color was recorded by camera, and the RGB values could be obtained. The Munsell Book of Color were taken in a light booth and the surround was kept dark. The viewing/illuminating geometry was 0/45 using D 65 illuminate. The lighting illuminating the reference target needs to be as uniform as possible. The BP network was a 5-layer one and (3-10-10-10-3), which was selected through our experiments. 1000 training samples were selected randomly from the 1267 samples, and the rest 267 samples were as the testing samples. Experimental results show that the mean color difference between the reproduced colors and target colors is 0.5 CIELAB color-difference unit, which was smaller than the biggest acceptable color difference 2 CIELAB color-difference unit. The results satisfy some applications for the more accurate color measurements, such as medical diagnostics, cosmetics production, the color reappearance of different media, etc.
Lakra, Sachin; T. V. Prasad; G. Ramakrishna
2012-01-01
The paper describes some recent developments in neural networks and discusses the applicability of neural networks in the development of a machine that mimics the human brain. The paper mentions a new architecture, the pulsed neural network that is being considered as the next generation of neural networks. The paper also explores the use of memristors in the development of a brain-like computer called the MoNETA. A new model, multi/infinite dimensional neural networks, are a recent developme...
Neural Networks in Data Mining
Priyanka Gaur
2012-01-01
The application of neural networks in the data mining is very wide. Although neural networks may have complex structure, long training time, and uneasily understandable representation of results, neural networks have high acceptance ability for noisy data and high accuracy and are preferable in data mining. In this paper the data mining based on neural networks is researched in detail, and the key technology and ways to achieve the data mining based on neural networks are also researched.
Neural networks and graph theory
Institute of Scientific and Technical Information of China (English)
许进; 保铮
2002-01-01
The relationships between artificial neural networks and graph theory are considered in detail. The applications of artificial neural networks to many difficult problems of graph theory, especially NP-complete problems, and the applications of graph theory to artificial neural networks are discussed. For example graph theory is used to study the pattern classification problem on the discrete type feedforward neural networks, and the stability analysis of feedback artificial neural networks etc.
GENETIC ALGORITHM AND NEURAL NETWORK FOR OPTICAL CHARACTER RECOGNITION
Directory of Open Access Journals (Sweden)
Hendy Yeremia
2013-01-01
Full Text Available Computer system has been able to recognize writing as human brain does. The method mostly used for character recognition is the backpropagation network. Backpropagation network has been known for its accuracy because it allows itself to learn and improving itself thus it can achieve higher accuracy. On the other hand, backpropagation was less to be used because of its time length needed to train the network to achieve the best result possible. In this study, backpropagation network algorithm is combined with genetic algorithm to achieve both accuracy and training swiftness for recognizing alphabets. Genetic algorithm is used to define the best initial values for the networkâs architecture and synapsesâ weight thus within a shorter period of time, the network could achieve the best accuracy. The optimized backpropagation network has better accuracy and less training time than the standard backpropagation network. The accuracy in recognizing character differ by 10, 77%, with a success rate of 90, 77% for the optimized backpropagation and 80% accuracy for the standard backpropagation network. The training time needed for backpropagation learning phase improved significantly from 03 h, 14 min and 40 sec, a standard backpropagation training time, to 02 h 18 min and 1 sec for the optimized backpropagation network.
Hybrid Neural Network Architecture for On-Line Learning
Chen, Yuhua; Wang, Lei
2008-01-01
Approaches to machine intelligence based on brain models have stressed the use of neural networks for generalization. Here we propose the use of a hybrid neural network architecture that uses two kind of neural networks simultaneously: (i) a surface learning agent that quickly adapt to new modes of operation; and, (ii) a deep learning agent that is very accurate within a specific regime of operation. The two networks of the hybrid architecture perform complementary functions that improve the overall performance. The performance of the hybrid architecture has been compared with that of back-propagation perceptrons and the CC and FC networks for chaotic time-series prediction, the CATS benchmark test, and smooth function approximation. It has been shown that the hybrid architecture provides a superior performance based on the RMS error criterion.
Neural networks in seismic discrimination
Energy Technology Data Exchange (ETDEWEB)
Dowla, F.U.
1995-01-01
Neural networks are powerful and elegant computational tools that can be used in the analysis of geophysical signals. At Lawrence Livermore National Laboratory, we have developed neural networks to solve problems in seismic discrimination, event classification, and seismic and hydrodynamic yield estimation. Other researchers have used neural networks for seismic phase identification. We are currently developing neural networks to estimate depths of seismic events using regional seismograms. In this paper different types of network architecture and representation techniques are discussed. We address the important problem of designing neural networks with good generalization capabilities. Examples of neural networks for treaty verification applications are also described.
Multi-agent reinforcement learning using modular neural network Q-learning algorithms
Institute of Scientific and Technical Information of China (English)
YANG Yin-xian; FANG Kai
2005-01-01
Reinforcement learning is an excellent approach which is used in artificial intelligence,automatic control, etc. However, ordinary reinforcement learning algorithm, such as Q-learning with lookup table cannot cope with extremely complex and dynamic environment due to the huge state space. To reduce the state space, modular neural network Q-learning algorithm is proposed, which combines Q-learning algorithm with neural network and module method. Forward feedback neural network, Elman neural network and radius-basis neural network are separately employed to construct such algorithm. It is revealed that Elman neural network Q-learning algorithm has the best performance under the condition that the same neural network training method, i.e. gradient descent error back-propagation algorithm is applied.
Non-Linear Back-propagation: Doing Back-Propagation withoutDerivatives of the Activation Function
DEFF Research Database (Denmark)
Hertz, John; Krogh, Anders Stærmose; Lautrup, Benny;
1997-01-01
The conventional linear back-propagation algorithm is replaced by a non-linear version, which avoids the necessity for calculating the derivative of the activation function. This may be exploited in hardware realizations of neural processors. In this paper we derive the non-linear back-propagatio......-propagation algorithms in the framework of recurrent back-propagation and present some numerical simulations of feed-forward networks on the NetTalk problem. A discussion of implementation in analog VLSI electronics concludes the paper.......The conventional linear back-propagation algorithm is replaced by a non-linear version, which avoids the necessity for calculating the derivative of the activation function. This may be exploited in hardware realizations of neural processors. In this paper we derive the non-linear back...
Extraction of Symbolic Rules from Artificial Neural Networks
Kamruzzaman, S M
2010-01-01
Although backpropagation ANNs generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions cannot be explained as those of decision trees. In many applications, it is desirable to extract knowledge from trained ANNs for the users to gain a better understanding of how the networks solve the problems. A new rule extraction algorithm, called rule extraction from artificial neural networks (REANN) is proposed and implemented to extract symbolic rules from ANNs. A standard three-layer feedforward ANN is the basis of the algorithm. A four-phase training algorithm is proposed for backpropagation learning. Explicitness of the extracted rules is supported by comparing them to the symbolic rules generated by other methods. Extracted rules are comparable with other methods in terms of number of rules, average number of conditions for a rule, and predictive accuracy. Extensive experimental studies on several benchmarks classification ...
Energy Technology Data Exchange (ETDEWEB)
Nose Filho, Kenji; Araujo, Klayton A.M.; Maeda, Jorge L.Y.; Lotufo, Anna Diva P. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil)], Emails: kenjinose@yahoo.com.br, klayton_ama@hotmail.com, jorge-maeda@hotmail.com, annadiva@dee.feis.unesp.br
2009-07-01
This paper presents a development and implementation of a program to electrical load forecasting with data from a Brazilian electrical company, using four different architectures of neural networks of the MATLAB toolboxes: multilayer backpropagation gradient descendent with momentum, multilayer backpropagation Levenberg-Marquardt, adaptive network based fuzzy inference system and general regression neural network. The program presented a satisfactory performance, guaranteeing very good results. (author)
DEFF Research Database (Denmark)
Bhowmik, Subrata; Weber, Felix; Høgsberg, Jan Becker
2013-01-01
This paper presents a systematic design and training procedure for the feed-forward backpropagation neural network (NN) modeling of both forward and inverse behavior of a rotary magnetorheological (MR) damper based on experimental data. For the forward damper model, with damper force as output...
Fabric Quality Optimization by Using Desirability Function and Neural Networks
Directory of Open Access Journals (Sweden)
Hajer Souid
2012-01-01
Full Text Available The present paper presents a new method to estimate objective reflection of Denim fabric quality by using desirability function and neural networks. The global fabric quality was defined through one index belonging to the closed interval [0, 1]. For this reason, we have created a first algorithm that is modified when the definition of fabric quality is changed. This prediction would allow fabric producer to estimate customer’s quality satisfaction level. The present approach has conferred a good evaluation and prediction of the all-encompassing denim fabric quality. In the second stage of the study, we developed a model to predict global fabric quality from fiber, yarn, weaving parameters and finishing characteristics by using neural networks. The neural network model is accomplished by using a second algorithm based on back-propagation concept. The results have shown that the neuronal networks could predict global fabric quality of the untrained fabrics with better precision
Short Term Load Forecast Using Wavelet Neural Network
Institute of Scientific and Technical Information of China (English)
Gui Min; Rong Fei; Luo An
2005-01-01
This paper presents a wavelet neural network (WNN) model combining wavelet transform and artificial neural networks for short term load forecast (STLF). Both historical load and temperature data having important impacts on load level were used in the proposed forecasting model. The model used the three-layer feed forward network trained by the error back-propagation algorithm. To enhance the forecasting accuracy by neural networks, wavelet multi-resolution analysis method was introduced to pre-process these data and reconstruct the predicted output. The proposed model has been evaluated with actual data of electricity load and temperature of Hunan Province. The simulation results show that the model is capable of providing a reasonable forecasting accuracy in STLF.
Artificial Neural Network Model for Predicting Compressive
Directory of Open Access Journals (Sweden)
Salim T. Yousif
2013-05-01
Full Text Available Compressive strength of concrete is a commonly used criterion in evaluating concrete. Although testing of the compressive strength of concrete specimens is done routinely, it is performed on the 28th day after concrete placement. Therefore, strength estimation of concrete at early time is highly desirable. This study presents the effort in applying neural network-based system identification techniques to predict the compressive strength of concrete based on concrete mix proportions, maximum aggregate size (MAS, and slump of fresh concrete. Back-propagation neural networks model is successively developed, trained, and tested using actual data sets of concrete mix proportions gathered from literature. The test of the model by un-used data within the range of input parameters shows that the maximum absolute error for model is about 20% and 88% of the output results has absolute errors less than 10%. The parametric study shows that water/cement ratio (w/c is the most significant factor affecting the output of the model. The results showed that neural networks has strong potential as a feasible tool for predicting compressive strength of concrete.
Rule Extraction:Using Neural Networks or for Neural Networks?
Institute of Scientific and Technical Information of China (English)
Zhi-Hua Zhou
2004-01-01
In the research of rule extraction from neural networks, fidelity describes how well the rules mimic the behavior of a neural network while accuracy describes how well the rules can be generalized. This paper identifies the fidelity-accuracy dilemma. It argues to distinguish rule extraction using neural networks and rule extraction for neural networks according to their different goals, where fidelity and accuracy should be excluded from the rule quality evaluation framework, respectively.
Introduction to Artificial Neural Networks
DEFF Research Database (Denmark)
Larsen, Jan
1999-01-01
The note addresses introduction to signal analysis and classification based on artificial feed-forward neural networks.......The note addresses introduction to signal analysis and classification based on artificial feed-forward neural networks....
Diagnosis method utilizing neural networks
International Nuclear Information System (INIS)
Studies have been made on the technique of neural networks, which will be used to identify a cause of a small anomalous state in the reactor coolant system of the ATR (Advance Thermal Reactor). Three phases of analyses were carried out in this study. First, simulation for 100 seconds was made to determine how the plant parameters respond after the occurence of a transient decrease in reactivity, flow rate and temperature of feed water and increase in the steam flow rate and steam pressure, which would produce a decrease of water level in a steam drum of the ATR. Next, the simulation data was analysed utilizing an autoregressive model. From this analysis, a total of 36 coherency functions up to 0.5 Hz in each transient were computed among nine important and detectable plant parameters: neutron flux, flow rate of coolant, steam or feed water, water level in the steam drum, pressure and opening area of control valve in a steam pipe, feed water temperature and electrical power. Last, learning of neural networks composed of 96 input, 4-9 hidden and 5 output layer units was done by use of the generalized delta rule, namely a back-propagation algorithm. These convergent computations were continued as far as the difference between the desired outputs, 1 for direct cause or 0 for four other ones and actual outputs reached less than 10%. (1) Coherency functions were not governed by decreasing rate of reactivity in the range of 0.41x10-2dollar/s to 1.62x10-2dollar /s or by decreasing depth of the feed water temperature in the range of 3 deg C to 10 deg C or by a change of 10% or less in the three other causes. Change in coherency functions only depended on the type of cause. (2) The direct cause from the other four ones could be discriminated with 0.94+-0.01 of output level. A maximum of 0.06 output height was found among the other four causes. (3) Calculation load which is represented as products of learning times and numbers of the hidden units did not depend on the numbers
Lambe, John; Moopen, Alexander; Thakoor, Anilkumar P.
1988-01-01
Memory based on neural network models content-addressable and fault-tolerant. System includes electronic equivalent of synaptic network; particular, matrix of programmable binary switching elements over which data distributed. Switches programmed in parallel by outputs of serial-input/parallel-output shift registers. Input and output terminals of bank of high-gain nonlinear amplifiers connected in nonlinear-feedback configuration by switches and by memory-prompting shift registers.
Artificial neural network modelling
Samarasinghe, Sandhya
2016-01-01
This book covers theoretical aspects as well as recent innovative applications of Artificial Neural networks (ANNs) in natural, environmental, biological, social, industrial and automated systems. It presents recent results of ANNs in modelling small, large and complex systems under three categories, namely, 1) Networks, Structure Optimisation, Robustness and Stochasticity 2) Advances in Modelling Biological and Environmental Systems and 3) Advances in Modelling Social and Economic Systems. The book aims at serving undergraduates, postgraduates and researchers in ANN computational modelling. .
Efficiently modeling neural networks on massively parallel computers
Farber, Robert M.
1993-01-01
Neural networks are a very useful tool for analyzing and modeling complex real world systems. Applying neural network simulations to real world problems generally involves large amounts of data and massive amounts of computation. To efficiently handle the computational requirements of large problems, we have implemented at Los Alamos a highly efficient neural network compiler for serial computers, vector computers, vector parallel computers, and fine grain SIMD computers such as the CM-2 connection machine. This paper describes the mapping used by the compiler to implement feed-forward backpropagation neural networks for a SIMD (Single Instruction Multiple Data) architecture parallel computer. Thinking Machines Corporation has benchmarked our code at 1.3 billion interconnects per second (approximately 3 gigaflops) on a 64,000 processor CM-2 connection machine (Singer 1990). This mapping is applicable to other SIMD computers and can be implemented on MIMD computers such as the CM-5 connection machine. Our mapping has virtually no communications overhead with the exception of the communications required for a global summation across the processors (which has a sub-linear runtime growth on the order of O(log(number of processors)). We can efficiently model very large neural networks which have many neurons and interconnects and our mapping can extend to arbitrarily large networks (within memory limitations) by merging the memory space of separate processors with fast adjacent processor interprocessor communications. This paper will consider the simulation of only feed forward neural network although this method is extendable to recurrent networks.
Artificial neural networks in the nuclear engineering (Part 2)
International Nuclear Information System (INIS)
The field of Artificial Neural Networks (ANN), one of the branches of Artificial Intelligence has been waking up a lot of interest in the Nuclear Engineering (NE). ANN can be used to solve problems of difficult modeling, when the data are fail or incomplete and in high complexity problems of control. The first part of this work began a discussion with feed-forward neural networks in back-propagation. In this part of the work, the Multi-synaptic neural networks is applied to control problems. Also, the self-organized maps is presented in a typical pattern classification problem: transients classification. The main purpose of the work is to show that ANN can be successfully used in NE if a carefully choice of its type is done: the application sets this choice. (author)
HIV lipodystrophy case definition using artificial neural network modelling
DEFF Research Database (Denmark)
Ioannidis, John P A; Trikalinos, Thomas A; Law, Matthew;
2003-01-01
OBJECTIVE: A case definition of HIV lipodystrophy has recently been developed from a combination of clinical, metabolic and imaging/body composition variables using logistic regression methods. We aimed to evaluate whether artificial neural networks could improve the diagnostic accuracy. METHODS......: The database of the case-control Lipodystrophy Case Definition Study was split into 504 subjects (265 with and 239 without lipodystrophy) used for training and 284 independent subjects (152 with and 132 without lipodystrophy) used for validation. Back-propagation neural networks with one or two middle layers...... were trained and validated. Results were compared against logistic regression models using the same information. RESULTS: Neural networks using clinical variables only (41 items) achieved consistently superior performance than logistic regression in terms of specificity, overall accuracy and area under...
Structural Damage Detection Using Randomized Trained Neural Networks
Haryanto, Ismoyo; Budiyono, Agus
2008-01-01
A computationally method on damage detection problems in structures was conducted using neural networks. The problem that is considered in this works consists of estimating the existence, location and extent of stiffness reduction in structure which is indicated by the changes of the structural static parameters such as deflection and strain. The neural network was trained to recognize the behaviour of static parameter of the undamaged structure as well as of the structure with various possible damage extent and location which were modelled as random states. The proposed techniques were applied to detect damage in a simply supported beam. The structure was analyzed using finite-element-method (FEM) and the damage identification was conducted by a back-propagation neural network using the change of the structural strain and displacement. The results showed that using proposed method the strain is more efficient for identification of damage than the displacement.
A Neural Network Appraoch to Fault Diagnosis in Analog Circuits
Institute of Scientific and Technical Information of China (English)
尉乃红; 杨士元; 等
1996-01-01
Thia paper presents a neural network based fault diagnosis approach for analog circuits,taking the tolerances of circuit elements into account.Specifically,a normalization rule of input information,a pseudo-fault domain border(PFDB)pattern selection method and a new output error function are proposed for training the backpropagation(BP) network to be a fault diagnoser.Experimental results demonstrate that the diagnoser performs as well as or better than any classical approaches in terms of accuracy,and provides at least an order-of-magnitude improvement in post-fault diagnostic speed.
Application of neural networks for permanent magnet synchronous motor direct torque control
Institute of Scientific and Technical Information of China (English)
Zhang Chunmei; Liu Heping; Chen Shujin; Wang Fangjun
2008-01-01
Neural networks require a lot of training to understand the model of a plant or a process. Issues such as learning speed, stability, and weight convergence remain as areas of research and comparison of many training algorithms. The application of neural networks to control interior permanent magnet synchronous motor using direct torque control (DTC) is discussed. A neural network is used to emulate the state selector of the DTC. The neural networks used are the back-propagation and radial basis function. To reduce the training patterns and increase the execution speed of the training process, the inputs of switching table are converted to digital signals, i.e., one bit represent the flux error, one bit the torque error, and three bits the region of stator flux. Computer simulations of the motor and neural-network system using the two approaches are presented and compared. Discussions about the back-propagation and radial basis function as the most promising training techniques are presented, giving its advantages and disadvantages. The system using back-propagation and radial basis function networks controller has quick parallel speed and high torque response.
Synthesis of recurrent neural networks for dynamical system simulation.
Trischler, Adam P; D'Eleuterio, Gabriele M T
2016-08-01
We review several of the most widely used techniques for training recurrent neural networks to approximate dynamical systems, then describe a novel algorithm for this task. The algorithm is based on an earlier theoretical result that guarantees the quality of the network approximation. We show that a feedforward neural network can be trained on the vector-field representation of a given dynamical system using backpropagation, then recast it as a recurrent network that replicates the original system's dynamics. After detailing this algorithm and its relation to earlier approaches, we present numerical examples that demonstrate its capabilities. One of the distinguishing features of our approach is that both the original dynamical systems and the recurrent networks that simulate them operate in continuous time.
Synthesis of recurrent neural networks for dynamical system simulation.
Trischler, Adam P; D'Eleuterio, Gabriele M T
2016-08-01
We review several of the most widely used techniques for training recurrent neural networks to approximate dynamical systems, then describe a novel algorithm for this task. The algorithm is based on an earlier theoretical result that guarantees the quality of the network approximation. We show that a feedforward neural network can be trained on the vector-field representation of a given dynamical system using backpropagation, then recast it as a recurrent network that replicates the original system's dynamics. After detailing this algorithm and its relation to earlier approaches, we present numerical examples that demonstrate its capabilities. One of the distinguishing features of our approach is that both the original dynamical systems and the recurrent networks that simulate them operate in continuous time. PMID:27182811
Neural networks for control of nuclear reactors systems
International Nuclear Information System (INIS)
A new architecture of artificial neural networks was developed with the development of new control systems for nuclear facilities and robotics. The new concepts introduced with this architecture were based in the design of task dedicated networks, in the use of multiple synaptic contacts with new transfer functions, and in the use of synaptic plasticity processes similar to that of biological organisms. These concepts take advantage of the evolutionary aspects of biological systems in their architecture, signal transmission, and memory and learning processes, given rise to a generalization capacity not obtained with classical feed-forward (F-F) neural networks. The new concepts were applied to the control of a planar two-link robotic manipulator and to the control of a natural circulation water loop. Its efficiency and generalization capacity were compared with a classic neural network in F-F, trained with the back propagation algorithm. The excellent performance obtained, mainly in the manipulator's problem, that characterizes a system of dynamic more complex, demonstrated that the use of the new task specialized network, produces much better results than the results obtained with use of generic F-F networks. The training task in the new proposed neural network was 150 times faster than the F-F neural network training with back-propagation. The results showed that the positioning errors with the new model were up to 60 times smaller than the errors found with the F-F network. (author)
Gupta, S; Gupta, Sanjay
2002-01-01
This paper initiates the study of quantum computing within the constraints of using a polylogarithmic ($O(\\log^k n), k\\geq 1$) number of qubits and a polylogarithmic number of computation steps. The current research in the literature has focussed on using a polynomial number of qubits. A new mathematical model of computation called \\emph{Quantum Neural Networks (QNNs)} is defined, building on Deutsch's model of quantum computational network. The model introduces a nonlinear and irreversible gate, similar to the speculative operator defined by Abrams and Lloyd. The precise dynamics of this operator are defined and while giving examples in which nonlinear Schr\\"{o}dinger's equations are applied, we speculate on its possible implementation. The many practical problems associated with the current model of quantum computing are alleviated in the new model. It is shown that QNNs of logarithmic size and constant depth have the same computational power as threshold circuits, which are used for modeling neural network...
Sensitivity analysis by neural networks applied to power systems transient stability
Energy Technology Data Exchange (ETDEWEB)
Lotufo, Anna Diva P.; Lopes, Mara Lucia M.; Minussi, Carlos R. [Departamento de Engenharia Eletrica, UNESP, Campus de Ilha Solteira, Av. Brasil, 56, 15385-000 Ilha Solteira, SP (Brazil)
2007-05-15
This work presents a procedure for transient stability analysis and preventive control of electric power systems, which is formulated by a multilayer feedforward neural network. The neural network training is realized by using the back-propagation algorithm with fuzzy controller and adaptation of the inclination and translation parameters of the nonlinear function. These procedures provide a faster convergence and more precise results, if compared to the traditional back-propagation algorithm. The adaptation of the training rate is effectuated by using the information of the global error and global error variation. After finishing the training, the neural network is capable of estimating the security margin and the sensitivity analysis. Considering this information, it is possible to develop a method for the realization of the security correction (preventive control) for levels considered appropriate to the system, based on generation reallocation and load shedding. An application for a multimachine power system is presented to illustrate the proposed methodology. (author)
Directory of Open Access Journals (Sweden)
Eric Sakk
2013-01-01
Full Text Available We revisit the protein secondary structure prediction problem using linear and backpropagation neural network architectures commonly applied in the literature. In this context, neural network mappings are constructed between protein training set sequences and their assigned structure classes in order to analyze the class membership of test data and associated measures of significance. We present numerical results demonstrating that classifier performance measures can vary significantly depending upon the classifier architecture and the structure class encoding technique. Furthermore, an analytic formulation is introduced in order to substantiate the observed numerical data. Finally, we analyze and discuss the ability of the neural network to accurately model fundamental attributes of protein secondary structure.
A SIMULATION OF THE PENICILLIN G PRODUCTION BIOPROCESS APPLYING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
A.J.G. da Cruz
1997-12-01
Full Text Available The production of penicillin G by Penicillium chrysogenum IFO 8644 was simulated employing a feedforward neural network with three layers. The neural network training procedure used an algorithm combining two procedures: random search and backpropagation. The results of this approach were very promising, and it was observed that the neural network was able to accurately describe the nonlinear behavior of the process. Besides, the results showed that this technique can be successfully applied to control process algorithms due to its long processing time and its flexibility in the incorporation of new data
A Worsted Yarn Virtual Production System Based on BP Neural Network
Institute of Scientific and Technical Information of China (English)
董奎勇; 于伟东
2004-01-01
Back-Propagation (BP) neural network and its modified algorithm are introduced. Two series of BP neural network models have been established to predict yarn properties and to deduce wool fiber qualities. The results from these two series of models have been compared with the measured values respectively, proving that the accuracy in both the prediction model and the deduction model is high. The experimental results and the corresponding analysis show that the BP neural network is an efficient technique for the quality prediction and has wide prospect in the application of worsted yarn production system.
Directory of Open Access Journals (Sweden)
Kapil Nahar
2012-12-01
Full Text Available An artificial neural network is an information-processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information. The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurons working in unison to solve specific problems. Ann’s, like people, learn by example.
Directory of Open Access Journals (Sweden)
Kapil Nahar
2012-12-01
Full Text Available An artificial neural network is an information-processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information.The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurons working in unison to solve specific problems.Ann’s, like people, learn by example.
Neural networks for triggering
Energy Technology Data Exchange (ETDEWEB)
Denby, B. (Fermi National Accelerator Lab., Batavia, IL (USA)); Campbell, M. (Michigan Univ., Ann Arbor, MI (USA)); Bedeschi, F. (Istituto Nazionale di Fisica Nucleare, Pisa (Italy)); Chriss, N.; Bowers, C. (Chicago Univ., IL (USA)); Nesti, F. (Scuola Normale Superiore, Pisa (Italy))
1990-01-01
Two types of neural network beauty trigger architectures, based on identification of electrons in jets and recognition of secondary vertices, have been simulated in the environment of the Fermilab CDF experiment. The efficiencies for B's and rejection of background obtained are encouraging. If hardware tests are successful, the electron identification architecture will be tested in the 1991 run of CDF. 10 refs., 5 figs., 1 tab.
F77NNS - A FORTRAN-77 NEURAL NETWORK SIMULATOR
Mitchell, P. H.
1994-01-01
F77NNS (A FORTRAN-77 Neural Network Simulator) simulates the popular back error propagation neural network. F77NNS is an ANSI-77 FORTRAN program designed to take advantage of vectorization when run on machines having this capability, but it will run on any computer with an ANSI-77 FORTRAN Compiler. Artificial neural networks are formed from hundreds or thousands of simulated neurons, connected to each other in a manner similar to biological nerve cells. Problems which involve pattern matching or system modeling readily fit the class of problems which F77NNS is designed to solve. The program's formulation trains a neural network using Rumelhart's back-propagation algorithm. Typically the nodes of a network are grouped together into clumps called layers. A network will generally have an input layer through which the various environmental stimuli are presented to the network, and an output layer for determining the network's response. The number of nodes in these two layers is usually tied to features of the problem being solved. Other layers, which form intermediate stops between the input and output layers, are called hidden layers. The back-propagation training algorithm can require massive computational resources to implement a large network such as a network capable of learning text-to-phoneme pronunciation rules as in the famous Sehnowski experiment. The Sehnowski neural network learns to pronounce 1000 common English words. The standard input data defines the specific inputs that control the type of run to be made, and input files define the NN in terms of the layers and nodes, as well as the input/output (I/O) pairs. The program has a restart capability so that a neural network can be solved in stages suitable to the user's resources and desires. F77NNS allows the user to customize the patterns of connections between layers of a network. The size of the neural network to be solved is limited only by the amount of random access memory (RAM) available to the
Mandarin Chinese Tone Recognition with an Artificial Neural Network
Institute of Scientific and Technical Information of China (English)
XU Li; ZHANG Wenle; ZHOU Ning; LEE Chaoyang; LI Yongxin; CHEN Xiuwu; ZHAO Xiaoyan
2006-01-01
Mandarin Chinese tone patterns vary in one of the four ways, i.e, (1) high level; (2) rising; (3) low falling and rising; and (4) high falling. The present study is to examine the efficacy of an artificial neural network in recognizing these tone patterns. Speech data were recorded from 12 children (3-6 years of age) and 15 adults. All subjects were native Mandarin Chinese speakers. The fundamental frequencies (FO) of each monosyllabic word of the speech data were extracted with an autocorrelation method. The pitch data(i.e., the FO contours) were the inputs to a feed-forward backpropagation artificial neural network. The number of inputs to the neural network varied from 1 to 16 and the hidden layer of the network contained neurons that varied from 1 to 16 in number. The output of the network consisted of four neurons representing the four tone patterns of Mandarin Chinese. After being trained with the Levenberg-Marquardt optimization, the neural network was able to successfully classify the tone patterns with an accuracy of about 90% correct for speech samples from both adults and children. The artificial neural network may provide an objective and effective way of assessing tone production in prelingually-deafened children who have received cochlear implants.
Introduction to neural networks; Introduction aux reseaux de neurones
Energy Technology Data Exchange (ETDEWEB)
Pavlopoulos, P. [European Organization for Nuclear Research, Geneva (Switzerland)
1996-08-01
This lecture is a presentation of today`s research in neural computation. Neural computation is inspired by knowledge from neuro-science. It draws its methods in large degree from statistical physics and its potential applications lie mainly in computer science and engineering. Neural networks models are algorithms for cognitive tasks, such as learning and optimization, which are based on concepts derived from research into the nature of the brain. The lecture first gives an historical presentation of neural networks development and interest in performing complex tasks. Then, an exhaustive overview of data management and networks computation methods is given: the supervised learning and the associative memory problem, the capacity of networks, the Perceptron networks, the functional link networks, the Madaline (Multiple Adalines) networks, the back-propagation networks, the reduced coulomb energy (RCE) networks, the unsupervised learning and the competitive learning and vector quantization. An example of application in high energy physics is given with the trigger systems and track recognition system (track parametrization, event selection and particle identification) developed for the CPLEAR experiment detectors from the LEAR at CERN. (J.S.). 56 refs., 20 figs., 1 tab., 1 appendix.
Intelligent Surveillance Robot with Obstacle Avoidance Capabilities Using Neural Network.
Budiharto, Widodo
2015-01-01
For specific purpose, vision-based surveillance robot that can be run autonomously and able to acquire images from its dynamic environment is very important, for example, in rescuing disaster victims in Indonesia. In this paper, we propose architecture for intelligent surveillance robot that is able to avoid obstacles using 3 ultrasonic distance sensors based on backpropagation neural network and a camera for face recognition. 2.4 GHz transmitter for transmitting video is used by the operator/user to direct the robot to the desired area. Results show the effectiveness of our method and we evaluate the performance of the system. PMID:26089863
Pulse frequency classification based on BP neural network
Institute of Scientific and Technical Information of China (English)
WANG Rui; WANG Xu; YANG Dan; FU Rong
2006-01-01
In Traditional Chinese Medicine (TCM), it is an important parameter of the clinic disease diagnosis to analysis the pulse frequency. This article accords to pulse eight major essentials to identify pulse type of the pulse frequency classification based on back-propagation neural networks (BPNN). The pulse frequency classification includes slow pulse, moderate pulse, rapid pulse etc. By feature parameter of the pulse frequency analysis research and establish to identify system of pulse frequency features. The pulse signal from detecting system extracts period, frequency etc feature parameter to compare with standard feature value of pulse type. The result shows that identify-rate attains 92.5% above.
Star pattern recognition method based on neural network
Institute of Scientific and Technical Information of China (English)
LI Chunyan; LI Ke; ZHANG Longyun; JIN Shengzhen; ZU Jifeng
2003-01-01
Star sensor is an avionics instrument used to provide the absolute 3-axis attitude of a spacecraft by utilizing star observations. The key function is to recognize the observed stars by comparing them with the reference catalogue. Autonomous star pattern recognition requires that similar patterns can be distinguished from each other with a small training set. Therefore, a new method based on neural network technology is proposed and a recognition system containing parallel backpropagation (BP) multi-subnets is designed. The simulation results show that the method performs much better than traditional algorithms and the proposed system can achieve both higher recognition accuracy and faster recognition speed.
Eukaryotic Promoter Recognition Using Back propagation Neural Network
Institute of Scientific and Technical Information of China (English)
XIONGQing; WANGYuan-Qiang; LIZhi-Liang
2004-01-01
A new system is developed to recognize promoter sequences from non-promoter sequences based on position weight matrix and backpropagation neural network in this paper. The system performs significantly better on the training set and the test set, the mean recognition rate is as high as 99% on the training set and 97% on the testing set. Experimental results demonstrate the effectiveness of the system to recognize the promoter sequences that have been trained and the promoter sequences that have not been seen previously.
Fault Tolerant Neural Network for ECG Signal Classification Systems
Directory of Open Access Journals (Sweden)
MERAH, M.
2011-08-01
Full Text Available The aim of this paper is to apply a new robust hardware Artificial Neural Network (ANN for ECG classification systems. This ANN includes a penalization criterion which makes the performances in terms of robustness. Specifically, in this method, the ANN weights are normalized using the auto-prune method. Simulations performed on the MIT ? BIH ECG signals, have shown that significant robustness improvements are obtained regarding potential hardware artificial neuron failures. Moreover, we show that the proposed design achieves better generalization performances, compared to the standard back-propagation algorithm.
Intelligent Surveillance Robot with Obstacle Avoidance Capabilities Using Neural Network.
Budiharto, Widodo
2015-01-01
For specific purpose, vision-based surveillance robot that can be run autonomously and able to acquire images from its dynamic environment is very important, for example, in rescuing disaster victims in Indonesia. In this paper, we propose architecture for intelligent surveillance robot that is able to avoid obstacles using 3 ultrasonic distance sensors based on backpropagation neural network and a camera for face recognition. 2.4 GHz transmitter for transmitting video is used by the operator/user to direct the robot to the desired area. Results show the effectiveness of our method and we evaluate the performance of the system.
An Artificial Neural Network for Data Forecasting Purposes
Directory of Open Access Journals (Sweden)
Catalina Lucia COCIANU
2015-01-01
Full Text Available Considering the fact that markets are generally influenced by different external factors, the stock market prediction is one of the most difficult tasks of time series analysis. The research reported in this paper aims to investigate the potential of artificial neural networks (ANN in solving the forecast task in the most general case, when the time series are non-stationary. We used a feed-forward neural architecture: the nonlinear autoregressive network with exogenous inputs. The network training function used to update the weight and bias parameters corresponds to gradient descent with adaptive learning rate variant of the backpropagation algorithm. The results obtained using this technique are compared with the ones resulted from some ARIMA models. We used the mean square error (MSE measure to evaluate the performances of these two models. The comparative analysis leads to the conclusion that the proposed model can be successfully applied to forecast the financial data.
International Nuclear Information System (INIS)
An artificial neural network has been applied for pattern recognition and used as a tool in an expert system. The purpose of this study is to examine the potential usefulness of the neural network approach in medical applications for image recognition and decision making. The authors designed multilayer feedforward neural networks with a back-propagation algorithm for our study. Using first-pass radionuclide ventriculograms, we attempted to identify the right and left ventricles of the heart and the lungs by training the neural network from patterns of time-activity curves. In a preliminary study, the neural network enabled identification of the lungs and heart chambers once the network was trained sufficiently by means of repeated entries of data from the same case
Improved Marquardt Algorithm for Training Neural Networks for Chemical Process Modeling
Institute of Scientific and Technical Information of China (English)
吴建昱; 何小荣
2002-01-01
Back-propagation (BP) artificial neural networks have been widely used to model chemical processes. BP networks are often trained using the generalized delta-rule (GDR) algorithm but application of such networks is limited because of the low convergent speed of the algorithm. This paper presents a new algorithm incorporating the Marquardt algorithm into the BP algorithm for training feedforward BP neural networks. The new algorithm was tested with several case studies and used to model the Reid vapor pressure (RVP) of stabilizer gasoline. The new algorithm has faster convergence and is much more efficient than the GDR algorithm.
Yousefi, Fakhri; Karimi, Hajir; Mohammadiyan, Somayeh
2016-11-01
This paper applies the model including back-propagation network (BPN) and principal component analysis (PCA) to estimate the effective viscosity of carbon nanotubes suspension. The effective viscosities of multiwall carbon nanotubes suspension are examined as a function of the temperature, nanoparticle volume fraction, effective length of nanoparticle and the viscosity of base fluids using artificial neural network. The obtained results by BPN-PCA model have good agreement with the experimental data.
Villarreal, James A.; Shelton, Robert O.
1992-01-01
Concept of space-time neural network affords distributed temporal memory enabling such network to model complicated dynamical systems mathematically and to recognize temporally varying spatial patterns. Digital filters replace synaptic-connection weights of conventional back-error-propagation neural network.
Directory of Open Access Journals (Sweden)
Lin Liu
2010-01-01
Full Text Available Cognitive radio (CR is a technology to implement opportunistic spectrum sharing to improve the spectrum utilization. However, there exists a hidden-node problem, which can be a big challenge to solve especially when the primary receiver is passive listening. We aim to provide a solution to the hidden-node problem for passive-listening receiver based on cooperation of multiple CRs. Specifically, we consider a cooperative GPS-enabled cognitive network. Once the existence of PU is detected, a localization algorithm will be employed to first estimate the path loss model for the environment based on backpropagation method and then to locate the position of PU. Finally, a disable region is identified taking into account the communication range of both the PU and the CR. The CRs within the disabled region are prohibited to transmit in order to avoid interfering with the primary receiver. Both analysis and simulation results are provided.
Speech Recognizing for Presentation Tool Navigation Using Back Propagation Artificial Neural Network
Directory of Open Access Journals (Sweden)
Hasanah Nur
2016-01-01
Full Text Available Backpropagation Artificial Neural Network (ANN is a well known branch of Artificial Intelligence and has been proven to solve various problems of complex speech recognizing in health [1], [2], education [4] and engineering [3]. Today, many kinds of presentation tools are used by society. One popular example is MsPowerpoint. The transition process between slides in presentation tools will be more easily done through speech, the sound emitted directly by the user during the presentation. This study uses research and development to create a simulation using Backpropagation ANN for speech recognition from number one to five to navigate slides of the presentation tool. The Backpropagation ANN consists of one input layer, one hidden layer with 100 neurons and one output layer. The simulation is built by using a Neural Network Toolbox Matlab R2014a. Speech samples were taken from five different people with wav format. This research shows that the Backpropagation ANN can be used as navigation through speech with 96% accuracy rate based on the network training result. Thesimulation can produce 63% accuracy based on 100 new speech samples from various sources.
Directory of Open Access Journals (Sweden)
J. Reyes-Reyes
2000-01-01
Full Text Available In this paper, an adaptive technique is suggested to provide the passivity property for a class of partially known SISO nonlinear systems. A simple Dynamic Neural Network (DNN, containing only two neurons and without any hidden-layers, is used to identify the unknown nonlinear system. By means of a Lyapunov-like analysis the new learning law for this DNN, guarantying both successful identification and passivation effects, is derived. Based on this adaptive DNN model, an adaptive feedback controller, serving for wide class of nonlinear systems with an a priori incomplete model description, is designed. Two typical examples illustrate the effectiveness of the suggested approach.
Chang, Hsien-Cheng
Two novel synergistic systems consisting of artificial neural networks and fuzzy inference systems are developed to determine geophysical properties by using well log data. These systems are employed to improve the determination accuracy in carbonate rocks, which are generally more complex than siliciclastic rocks. One system, consisting of a single adaptive resonance theory (ART) neural network and three fuzzy inference systems (FISs), is used to determine the permeability category. The other system, which is composed of three ART neural networks and a single FIS, is employed to determine the lithofacies. The geophysical properties studied in this research, permeability category and lithofacies, are treated as categorical data. The permeability values are transformed into a "permeability category" to account for the effects of scale differences between core analyses and well logs, and heterogeneity in the carbonate rocks. The ART neural networks dynamically cluster the input data sets into different groups. The FIS is used to incorporate geologic experts' knowledge, which is usually in linguistic forms, into systems. These synergistic systems thus provide viable alternative solutions to overcome the effects of heterogeneity, the uncertainties of carbonate rock depositional environments, and the scarcity of well log data. The results obtained in this research show promising improvements over backpropagation neural networks. For the permeability category, the prediction accuracies are 68.4% and 62.8% for the multiple-single ART neural network-FIS and a single backpropagation neural network, respectively. For lithofacies, the prediction accuracies are 87.6%, 79%, and 62.8% for the single-multiple ART neural network-FIS, a single ART neural network, and a single backpropagation neural network, respectively. The sensitivity analysis results show that the multiple-single ART neural networks-FIS and a single ART neural network possess the same matching trends in
Chen, Chau-Kuang
2010-01-01
Artificial Neural Network (ANN) and Support Vector Machine (SVM) approaches have been on the cutting edge of science and technology for pattern recognition and data classification. In the ANN model, classification accuracy can be achieved by using the feed-forward of inputs, back-propagation of errors, and the adjustment of connection weights. In…
Metzler, R; Kinzel, W; Kanter, I
2000-08-01
Several scenarios of interacting neural networks which are trained either in an identical or in a competitive way are solved analytically. In the case of identical training each perceptron receives the output of its neighbor. The symmetry of the stationary state as well as the sensitivity to the used training algorithm are investigated. Two competitive perceptrons trained on mutually exclusive learning aims and a perceptron which is trained on the opposite of its own output are examined analytically. An ensemble of competitive perceptrons is used as decision-making algorithms in a model of a closed market (El Farol Bar problem or the Minority Game. In this game, a set of agents who have to make a binary decision is considered.); each network is trained on the history of minority decisions. This ensemble of perceptrons relaxes to a stationary state whose performance can be better than random. PMID:11088736
Neural Network Burst Pressure Prediction in Composite Overwrapped Pressure Vessels
Hill, Eric v. K.; Dion, Seth-Andrew T.; Karl, Justin O.; Spivey, Nicholas S.; Walker, James L., II
2007-01-01
Acoustic emission data were collected during the hydroburst testing of eleven 15 inch diameter filament wound composite overwrapped pressure vessels. A neural network burst pressure prediction was generated from the resulting AE amplitude data. The bottles shared commonality of graphite fiber, epoxy resin, and cure time. Individual bottles varied by cure mode (rotisserie versus static oven curing), types of inflicted damage, temperature of the pressurant, and pressurization scheme. Three categorical variables were selected to represent undamaged bottles, impact damaged bottles, and bottles with lacerated hoop fibers. This categorization along with the removal of the AE data from the disbonding noise between the aluminum liner and the composite overwrap allowed the prediction of burst pressures in all three sets of bottles using a single backpropagation neural network. Here the worst case error was 3.38 percent.
Heiden, Uwe
1980-01-01
The purpose of this work is a unified and general treatment of activity in neural networks from a mathematical pOint of view. Possible applications of the theory presented are indica ted throughout the text. However, they are not explored in de tail for two reasons : first, the universal character of n- ral activity in nearly all animals requires some type of a general approach~ secondly, the mathematical perspicuity would suffer if too many experimental details and empirical peculiarities were interspersed among the mathematical investigation. A guide to many applications is supplied by the references concerning a variety of specific issues. Of course the theory does not aim at covering all individual problems. Moreover there are other approaches to neural network theory (see e.g. Poggio-Torre, 1978) based on the different lev els at which the nervous system may be viewed. The theory is a deterministic one reflecting the average be havior of neurons or neuron pools. In this respect the essay is writt...
Empirical modeling of nuclear power plants using neural networks
International Nuclear Information System (INIS)
A summary of a procedure for nonlinear identification of process dynamics encountered in nuclear power plant components is presented in this paper using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the nonlinear structure for system identification. In the overall identification process, the feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of time-dependent system nonlinearities. The standard backpropagation learning algorithm is modified and is used to train the proposed hybrid network in a supervised manner. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The nonlinear response of a representative steam generator is predicted using a neural network and is compared to the response obtained from a sophisticated physical model during both high- and low-power operation. The transient responses compare well, though further research is warranted for training and testing of recurrent neural networks during more severe operational transients and accident scenarios
Neural Networks for Optimal Control
DEFF Research Database (Denmark)
Sørensen, O.
1995-01-01
Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process.......Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process....
Neural Networks for Omni—View Road Image Understanding
Institute of Scientific and Technical Information of China (English)
朱志刚; 徐光You
1996-01-01
This paper presents a new approach to the outdoor roa scene understanding by using omni-view images and backpropagation networks.Both the road directions used for vehicle heading and th road categories used for vehicle localization are determined by the integrated system.There are three main features about the work.First,an omni-view image sensor is used to extract image samples,and the original image is preprocessed so that the inputs of the network is rotation-invariant and simple.Second,the problem of the network size,especially the number of the hidden units,is decided by the analysis of systematic experimental results.Finally,the internal representation,which reveals the properties of the neural network,is analyzed in the view point of visual signal processing.Experimental results with real scene images are encouraging.
Groundwater Level Predictions Using Artificial Neural Networks
Institute of Scientific and Technical Information of China (English)
毛晓敏; 尚松浩; 刘翔
2002-01-01
The prediction of groundwater level is important for the use and management of groundwater resources. In this paper, the artificial neural networks (ANN) were used to predict groundwater level in the Dawu Aquifer of Zibo in Eastern China. The first step was an auto-correlation analysis of the groundwater level which showed that the monthly groundwater level was time dependent. An auto-regression type ANN (ARANN) model and a regression-auto-regression type ANN (RARANN) model using back-propagation algorithm were then used to predict the groundwater level. Monthly data from June 1988 to May 1998 was used for the network training and testing. The results show that the RARANN model is more reliable than the ARANN model, especially in the testing period, which indicates that the RARANN model can describe the relationship between the groundwater fluctuation and main factors that currently influence the groundwater level. The results suggest that the model is suitable for predicting groundwater level fluctuations in this area for similar conditions in the future.
EEG source localization: a neural network approach.
Sclabassi, R J; Sonmez, M; Sun, M
2001-07-01
Functional activity in the brain is associated with the generation of currents and resultant voltages which may be observed on the scalp as the electroencephelogram. The current sources may be modeled as dipoles. The properties of the current dipole sources may be studied by solving either the forward or inverse problems. The forward problem utilizes a volume conductor model for the head, in which the potentials on the conductor surface are computed based on an assumed current dipole at an arbitrary location, orientation, and strength. In the inverse problem, on the other hand, a current dipole, or a group of dipoles, is identified based on the observed EEG. Both the forward and inverse problems are typically solved by numerical procedures, such as a boundary element method and an optimization algorithm. These approaches are highly time-consuming and unsuitable for the rapid evaluation of brain function. In this paper we present a different approach to these problems based on machine learning. We solve both problems using artificial neural networks which are trained off-line using back-propagation techniques to learn the complex source-potential relationships of head volume conduction. Once trained, these networks are able to generalize their knowledge to localize functional activity within the brain in a computationally efficient manner.
A hybrid Evolutionary Functional Link Artificial Neural Network for Data mining and Classification
Directory of Open Access Journals (Sweden)
Faissal MILI
2012-08-01
Full Text Available This paper presents a specific structure of neural network as the functional link artificial neural network (FLANN. This technique has been employed for classification tasks of data mining. In fact, there are a few studies that used this tool for solving classification problems. In this present research, we propose a hybrid FLANN (HFLANN model, where the optimization process is performed using 3 known population based techniques such as genetic algorithms, particle swarm and differential evolution. This model will be empirically compared to FLANN based back-propagation algorithm and to others classifiers as decision tree, multilayer perceptron based back-propagation algorithm, radical basic function, support vector machine, and K-nearest Neighbor. Our results proved that the proposed model outperforms the other single model. (Abstract
Using neural networks for prediction of nuclear parameters
International Nuclear Information System (INIS)
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Using neural networks for prediction of nuclear parameters
Energy Technology Data Exchange (ETDEWEB)
Pereira Filho, Leonidas; Souto, Kelling Cabral, E-mail: leonidasmilenium@hotmail.com, E-mail: kcsouto@bol.com.br [Instituto Federal de Educacao, Ciencia e Tecnologia do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ (Brazil); Machado, Marcelo Dornellas, E-mail: dornemd@eletronuclear.gov.br [Eletrobras Termonuclear S.A. (GCN.T/ELETRONUCLEAR), Rio de Janeiro, RJ (Brazil). Gerencia de Combustivel Nuclear
2013-07-01
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Tagliaferri, Roberto; Longo, Giuseppe; Milano, Leopoldo; Acernese, Fausto; Barone, Fabrizio; Ciaramella, Angelo; De Rosa, Rosario; Donalek, Ciro; Eleuteri, Antonio; Raiconi, Giancarlo; Sessa, Salvatore; Staiano, Antonino; Volpicelli, Alfredo
2003-01-01
In the last decade, the use of neural networks (NN) and of other soft computing methods has begun to spread also in the astronomical community which, due to the required accuracy of the measurements, is usually reluctant to use automatic tools to perform even the most common tasks of data reduction and data mining. The federation of heterogeneous large astronomical databases which is foreseen in the framework of the astrophysical virtual observatory and national virtual observatory projects, is, however, posing unprecedented data mining and visualization problems which will find a rather natural and user friendly answer in artificial intelligence tools based on NNs, fuzzy sets or genetic algorithms. This review is aimed to both astronomers (who often have little knowledge of the methodological background) and computer scientists (who often know little about potentially interesting applications), and therefore will be structured as follows: after giving a short introduction to the subject, we shall summarize the methodological background and focus our attention on some of the most interesting fields of application, namely: object extraction and classification, time series analysis, noise identification, and data mining. Most of the original work described in the paper has been performed in the framework of the AstroNeural collaboration (Napoli-Salerno).
Evaluation of convolutional neural networks for visual recognition.
Nebauer, C
1998-01-01
Convolutional neural networks provide an efficient method to constrain the complexity of feedforward neural networks by weight sharing and restriction to local connections. This network topology has been applied in particular to image classification when sophisticated preprocessing is to be avoided and raw images are to be classified directly. In this paper two variations of convolutional networks--neocognitron and a modification of neocognitron--are compared with classifiers based on fully connected feedforward layers (i.e., multilayer perceptron, nearest neighbor classifier, auto-encoding network) with respect to their visual recognition performance. Beside the original neocognitron a modification of the neocognitron is proposed which combines neurons from perceptron with the localized network structure of neocognitron. Instead of training convolutional networks by time-consuming error backpropagation, in this work a modular procedure is applied whereby layers are trained sequentially from the input to the output layer in order to recognize features of increasing complexity. For a quantitative experimental comparison with standard classifiers two very different recognition tasks have been chosen: handwritten digit recognition and face recognition. In the first example on handwritten digit recognition the generalization of convolutional networks is compared to fully connected networks. In several experiments the influence of variations of position, size, and orientation of digits is determined and the relation between training sample size and validation error is observed. In the second example recognition of human faces is investigated under constrained and variable conditions with respect to face orientation and illumination and the limitations of convolutional networks are discussed.
Neural Networks in Control Applications
DEFF Research Database (Denmark)
Sørensen, O.
The intention of this report is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: - Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. - Amongst numerous training algorithms, only four algorithms are examined, all...... in a recursive form (sample updating). The simplest is the Back Probagation Error Algorithm, and the most complex is the recursive Prediction Error Method using a Gauss-Newton search direction. - Over-fitting is often considered to be a serious problem when training neural networks. This problem is specifically...
Artificial Neural Network applied to lightning flashes
Gin, R. B.; Guedes, D.; Bianchi, R.
2013-05-01
The development of video cameras enabled cientists to study lightning discharges comportment with more precision. The main goal of this project is to create a system able to detect images of lightning discharges stored in videos and classify them using an Artificial Neural Network (ANN)using C Language and OpenCV libraries. The developed system, can be split in two different modules: detection module and classification module. The detection module uses OpenCV`s computer vision libraries and image processing techniques to detect if there are significant differences between frames in a sequence, indicating that something, still not classified, occurred. Whenever there is a significant difference between two consecutive frames, two main algorithms are used to analyze the frame image: brightness and shape algorithms. These algorithms detect both shape and brightness of the event, removing irrelevant events like birds, as well as detecting the relevant events exact position, allowing the system to track it over time. The classification module uses a neural network to classify the relevant events as horizontal or vertical lightning, save the event`s images and calculates his number of discharges. The Neural Network was implemented using the backpropagation algorithm, and was trained with 42 training images , containing 57 lightning events (one image can have more than one lightning). TheANN was tested with one to five hidden layers, with up to 50 neurons each. The best configuration achieved a success rate of 95%, with one layer containing 20 neurons (33 test images with 42 events were used in this phase). This configuration was implemented in the developed system to analyze 20 video files, containing 63 lightning discharges previously manually detected. Results showed that all the lightning discharges were detected, many irrelevant events were unconsidered, and the event's number of discharges was correctly computed. The neural network used in this project achieved a
Institute of Scientific and Technical Information of China (English)
黄德生; 刘延令; 金一和
2001-01-01
Objective Using BP Artificial Neural Network to study the Structure-Activity relationship between aromatics compounds and rat LD50, improved precision of toxicity prediction. Methods Firstly, Principal-Components-Analysis was adopted, then used BP ANN net-structure, and applied LM arithumetic as iteration method to train the network. Result We have discussed the relationship betwenn the structure parameter of 120 varieties of aromatics compound and rat LD50, and optimized the parameter design of the net to avoid over-fitting. I found that three-layer BP ANN which using log-sigmoid function, (i.e.) f(x)=1/1(+exp(-x)) as network transfer function got better fitting power. When the number of the hidden layer node is 13, the sum-square error is 0.36 which is far less than linear models. While the outer prediction precision of multiplayer BP ANN is higher than linear model in evidence, SSE=4.63. Conclusion We can consider that the classify power of multiplayer BP ANN is superior to linear nodels. Multilayer BP ANN can be use to predict toxicity of aromatics compounds, this method is better than traditional methods.%对结构参数采用主成分变换，再利用BP人工神经网络，采用LM算法作为迭代方法训练网络，预测检验集化合物的LD50。结果显示，BP人工神经网络可以用于定量毒性构效关系研究，含隐层的BP人工神经网络拟合能力明显优于传统方法，消除过度拟合后的多层BP网络预测能力也好于传统方法，可以用于预测。
Manoj Tripathy
2012-01-01
This paper describes a new approach for power transformer differential protection which is based on the wave-shape recognition technique. An algorithm based on neural network principal component analysis (NNPCA) with back-propagation learning is proposed for digital differential protection of power transformer. The principal component analysis is used to preprocess the data from power system in order to eliminate redundant information and enhance hidden pattern of differential current to disc...
Alternating optimization method based on nonnegative matrix factorizations for deep neural networks
Sakurai, Tetsuya; Imakura, Akira; Inoue, Yuto; Futamura, Yasunori
2016-01-01
The backpropagation algorithm for calculating gradients has been widely used in computation of weights for deep neural networks (DNNs). This method requires derivatives of objective functions and has some difficulties finding appropriate parameters such as learning rate. In this paper, we propose a novel approach for computing weight matrices of fully-connected DNNs by using two types of semi-nonnegative matrix factorizations (semi-NMFs). In this method, optimization processes are performed b...
Artificial Neural Network based Diagnostic Model For Causes of Success and Failures
Kaur, Bikrampal; Aggarwal, Himanshu
2010-01-01
In this paper an attempt has been made to identify most important human resource factors and propose a diagnostic model based on the back-propagation and connectionist model approaches of artificial neural network (ANN). The focus of the study is on the mobile -communication industry of India. The ANN based approach is particularly important because conventional approaches (such as algorithmic) to the problem solving have their inherent disadvantages. The algorithmic approach is well-suited t...
Directory of Open Access Journals (Sweden)
Lukas Falat
2016-01-01
Full Text Available This paper deals with application of quantitative soft computing prediction models into financial area as reliable and accurate prediction models can be very helpful in management decision-making process. The authors suggest a new hybrid neural network which is a combination of the standard RBF neural network, a genetic algorithm, and a moving average. The moving average is supposed to enhance the outputs of the network using the error part of the original neural network. Authors test the suggested model on high-frequency time series data of USD/CAD and examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, they perform a comparative statistical out-of-sample analysis of the tested model with autoregressive models and the standard neural network. They also incorporate genetic algorithm as an optimizing technique for adapting parameters of ANN which is then compared with standard backpropagation and backpropagation combined with K-means clustering algorithm. Finally, the authors find out that their suggested hybrid neural network is able to produce more accurate forecasts than the standard models and can be helpful in eliminating the risk of making the bad decision in decision-making process.
Falat, Lukas; Marcek, Dusan; Durisova, Maria
2016-01-01
This paper deals with application of quantitative soft computing prediction models into financial area as reliable and accurate prediction models can be very helpful in management decision-making process. The authors suggest a new hybrid neural network which is a combination of the standard RBF neural network, a genetic algorithm, and a moving average. The moving average is supposed to enhance the outputs of the network using the error part of the original neural network. Authors test the suggested model on high-frequency time series data of USD/CAD and examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, they perform a comparative statistical out-of-sample analysis of the tested model with autoregressive models and the standard neural network. They also incorporate genetic algorithm as an optimizing technique for adapting parameters of ANN which is then compared with standard backpropagation and backpropagation combined with K-means clustering algorithm. Finally, the authors find out that their suggested hybrid neural network is able to produce more accurate forecasts than the standard models and can be helpful in eliminating the risk of making the bad decision in decision-making process. PMID:26977450
Falat, Lukas; Marcek, Dusan; Durisova, Maria
2016-01-01
This paper deals with application of quantitative soft computing prediction models into financial area as reliable and accurate prediction models can be very helpful in management decision-making process. The authors suggest a new hybrid neural network which is a combination of the standard RBF neural network, a genetic algorithm, and a moving average. The moving average is supposed to enhance the outputs of the network using the error part of the original neural network. Authors test the suggested model on high-frequency time series data of USD/CAD and examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, they perform a comparative statistical out-of-sample analysis of the tested model with autoregressive models and the standard neural network. They also incorporate genetic algorithm as an optimizing technique for adapting parameters of ANN which is then compared with standard backpropagation and backpropagation combined with K-means clustering algorithm. Finally, the authors find out that their suggested hybrid neural network is able to produce more accurate forecasts than the standard models and can be helpful in eliminating the risk of making the bad decision in decision-making process.
A Neural Network Approach for GMA Butt Joint Welding
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2003-01-01
This paper describes the application of the neural network technology for gas metal arc welding (GMAW) control. A system has been developed for modeling and online adjustment of welding parameters, appropriate to guarantee a certain degree of quality in the field of butt joint welding with full...... penetration, when the gap width is varying during the welding process. The process modeling to facilitate the mapping from joint geometry and reference weld quality to significant welding parameters has been based on a multi-layer feed-forward network. The Levenberg-Marquardt algorithm for non-linear least...... squares has been used with the back-propagation algorithm for training the network, while a Bayesian regularization technique has been successfully applied for minimizing the risk of inexpedient over-training. Finally, a predictive closed-loop control strategy based on a so-called single-neuron self...
Neural Network Control of a Magnetically Suspended Rotor System
Choi, Benjamin B.
1998-01-01
Magnetic bearings offer significant advantages because they do not come into contact with other parts during operation, which can reduce maintenance. Higher speeds, no friction, no lubrication, weight reduction, precise position control, and active damping make them far superior to conventional contact bearings. However, there are technical barriers that limit the application of this technology in industry. One of them is the need for a nonlinear controller that can overcome the system nonlinearity and uncertainty inherent in magnetic bearings. At the NASA Lewis Research Center, a neural network was selected as a nonlinear controller because it generates a neural model without any detailed information regarding the internal working of the magnetic bearing system. It can be used even for systems that are too complex for an accurate system model to be derived. A feed-forward architecture with a back-propagation learning algorithm was selected because of its proven performance, accuracy, and relatively easy implementation.
A System for Predicting Subcellular Localization of Yeast Genome Using Neural Network
Thampi, Sabu M
2007-01-01
The subcellular location of a protein can provide valuable information about its function. With the rapid increase of sequenced genomic data, the need for an automated and accurate tool to predict subcellular localization becomes increasingly important. Many efforts have been made to predict protein subcellular localization. This paper aims to merge the artificial neural networks and bioinformatics to predict the location of protein in yeast genome. We introduce a new subcellular prediction method based on a backpropagation neural network. The results show that the prediction within an error limit of 5 to 10 percentage can be achieved with the system.
DEFF Research Database (Denmark)
Prato, Carlo Giacomo; Gitelman, Victoria; Bekhor, Shlomo
2011-01-01
This article provides a broad picture of fatal traffic accidents in Israel to answer an increasing need of addressing compelling problems, designing preventive measures, and targeting specific population groups with the objective of reducing the number of traffic fatalities. The analysis focuses...... on 1,793 fatal traffic accidents occurred during the period between 2003 and 2006 and applies Kohonen and feed-forward back-propagation neural networks with the objective of extracting from the data typical patterns and relevant factors. Kohonen neural networks reveal five compelling accident patterns...
Artificial neural network models for biomass gasification in fluidized bed gasifiers
DEFF Research Database (Denmark)
Puig Arnavat, Maria; Hernández, J. Alfredo; Bruno, Joan Carles;
2013-01-01
Artificial neural networks (ANNs) have been applied for modeling biomass gasification process in fluidized bed reactors. Two architectures of ANNs models are presented; one for circulating fluidized bed gasifiers (CFB) and the other for bubbling fluidized bed gasifiers (BFB). Both models determine...... bed gasifier can be successfully predicted by applying neural networks. ANNs models use in the input layer the biomass composition and few operating parameters, two neurons in the hidden layer and the backpropagation algorithm. The results obtained by these ANNs show high agreement with published...
Artificial neural network models for image understanding
Kulkarni, Arun D.; Byars, P.
1991-06-01
In this paper we introduce a new class of artificial neural network (ANN) models based on transformed domain feature extraction. Many optical and/or digital recognition systems based on transformed domain feature extraction are available in practice. Optical systems are inherently parallel in nature and are preferred for real time applications, whereas digital systems are more suitable for nonlinear operations. In our ANN models we combine advantages of both digital and optical systems. Many transformed domain feature extraction techniques have been developed during the last three decades. They include: the Fourier transform (FT), the Walsh Hadamard transform (WHT), the discrete cosine transform (DCT), etc. As an example, we have developed ANN models using the FT and WHT domain features. The models consist of two stages, the feature extraction stage and the recognition stage. We have used back-propagation and competitive learning algorithms in the recognition stage. We have used these ANN models for invariant object recognition. The models have been used successfully to recognize various types of aircraft, and also have been tested with test patterns. ANN models based on other transforms can be developed in a similar fashion.
Energy Technology Data Exchange (ETDEWEB)
Koenig, R.W.T.; Von Hellermann, M. [Commission of the European Communities, Abingdon (United Kingdom). JET Joint Undertaking; Svensson, J. [Royal Inst. of Tech., Stockholm (Sweden)
1994-07-01
A back-propagation neural network technique is used at JET to extract plasma parameters like ion temperature, rotation velocities or spectral line intensities from charge exchange (CX) spectra. It is shown that in the case of the C VI CX spectra, neural networks can give a good estimation (better than +-20% accuracy) for the main plasma parameters (Ti, V{sub rot}). Since the neural network approach involves no iterations or initial guesses the speed with which a spectrum is processed is so high (0.2 ms/spectrum) that real time analysis will be achieved in the near future. 4 refs., 8 figs.
A Constructive Algorithm for Feedforward Neural Networks for Medical Diagnostic Reasoning
Siddiquee, Abu Bakar; Kamruzzaman, S M
2010-01-01
This research is to search for alternatives to the resolution of complex medical diagnosis where human knowledge should be apprehended in a general fashion. Successful application examples show that human diagnostic capabilities are significantly worse than the neural diagnostic system. Our research describes a constructive neural network algorithm with backpropagation; offer an approach for the incremental construction of nearminimal neural network architectures for pattern classification. The algorithm starts with minimal number of hidden units in the single hidden layer; additional units are added to the hidden layer one at a time to improve the accuracy of the network and to get an optimal size of a neural network. Our algorithm was tested on several benchmarking classification problems including Cancer1, Heart, and Diabetes with good generalization ability.
Neural networks and statistical learning
Du, Ke-Lin
2014-01-01
Providing a broad but in-depth introduction to neural network and machine learning in a statistical framework, this book provides a single, comprehensive resource for study and further research. All the major popular neural network models and statistical learning approaches are covered with examples and exercises in every chapter to develop a practical working understanding of the content. Each of the twenty-five chapters includes state-of-the-art descriptions and important research results on the respective topics. The broad coverage includes the multilayer perceptron, the Hopfield network, associative memory models, clustering models and algorithms, the radial basis function network, recurrent neural networks, principal component analysis, nonnegative matrix factorization, independent component analysis, discriminant analysis, support vector machines, kernel methods, reinforcement learning, probabilistic and Bayesian networks, data fusion and ensemble learning, fuzzy sets and logic, neurofuzzy models, hardw...
Review On Applications Of Neural Network To Computer Vision
Li, Wei; Nasrabadi, Nasser M.
1989-03-01
Neural network models have many potential applications to computer vision due to their parallel structures, learnability, implicit representation of domain knowledge, fault tolerance, and ability of handling statistical data. This paper demonstrates the basic principles, typical models and their applications in this field. Variety of neural models, such as associative memory, multilayer back-propagation perceptron, self-stabilized adaptive resonance network, hierarchical structured neocognitron, high order correlator, network with gating control and other models, can be applied to visual signal recognition, reinforcement, recall, stereo vision, motion, object tracking and other vision processes. Most of the algorithms have been simulated on com-puters. Some have been implemented with special hardware. Some systems use features, such as edges and profiles, of images as the data form for input. Other systems use raw data as input signals to the networks. We will present some novel ideas contained in these approaches and provide a comparison of these methods. Some unsolved problems are mentioned, such as extracting the intrinsic properties of the input information, integrating those low level functions to a high-level cognitive system, achieving invariances and other problems. Perspectives of applications of some human vision models and neural network models are analyzed.
Neural Networks Of VLSI Components
Eberhardt, Silvio P.
1991-01-01
Concept for design of electronic neural network calls for assembly of very-large-scale integrated (VLSI) circuits of few standard types. Each VLSI chip, which contains both analog and digital circuitry, used in modular or "building-block" fashion by interconnecting it in any of variety of ways with other chips. Feedforward neural network in typical situation operates under control of host computer and receives inputs from, and sends outputs to, other equipment.
What are artificial neural networks?
DEFF Research Database (Denmark)
Krogh, Anders
2008-01-01
Artificial neural networks have been applied to problems ranging from speech recognition to prediction of protein secondary structure, classification of cancers and gene prediction. How do they work and what might they be good for? Udgivelsesdato: 2008-Feb......Artificial neural networks have been applied to problems ranging from speech recognition to prediction of protein secondary structure, classification of cancers and gene prediction. How do they work and what might they be good for? Udgivelsesdato: 2008-Feb...
Neural Networks for Fingerprint Recognition
Baldi, Pierre; Chauvin, Yves
1993-01-01
After collecting a data base of fingerprint images, we design a neural network algorithm for fingerprint recognition. When presented with a pair of fingerprint images, the algorithm outputs an estimate of the probability that the two images originate from the same finger. In one experiment, the neural network is trained using a few hundred pairs of images and its performance is subsequently tested using several thousand pairs of images originated from a subset of the database corresponding to...
Neural Networks and Photometric Redshifts
Tagliaferri, Roberto; Longo, Giuseppe; Andreon, Stefano; Capozziello, Salvatore; Donalek, Ciro; Giordano, Gerardo
2002-01-01
We present a neural network based approach to the determination of photometric redshift. The method was tested on the Sloan Digital Sky Survey Early Data Release (SDSS-EDR) reaching an accuracy comparable and, in some cases, better than SED template fitting techniques. Different neural networks architecture have been tested and the combination of a Multi Layer Perceptron with 1 hidden layer (22 neurons) operated in a Bayesian framework, with a Self Organizing Map used to estimate the accuracy...
Correlational Neural Networks.
Chandar, Sarath; Khapra, Mitesh M; Larochelle, Hugo; Ravindran, Balaraman
2016-02-01
Common representation learning (CRL), wherein different descriptions (or views) of the data are embedded in a common subspace, has been receiving a lot of attention recently. Two popular paradigms here are canonical correlation analysis (CCA)-based approaches and autoencoder (AE)-based approaches. CCA-based approaches learn a joint representation by maximizing correlation of the views when projected to the common subspace. AE-based methods learn a common representation by minimizing the error of reconstructing the two views. Each of these approaches has its own advantages and disadvantages. For example, while CCA-based approaches outperform AE-based approaches for the task of transfer learning, they are not as scalable as the latter. In this work, we propose an AE-based approach, correlational neural network (CorrNet), that explicitly maximizes correlation among the views when projected to the common subspace. Through a series of experiments, we demonstrate that the proposed CorrNet is better than AE and CCA with respect to its ability to learn correlated common representations. We employ CorrNet for several cross-language tasks and show that the representations learned using it perform better than the ones learned using other state-of-the-art approaches. PMID:26654210
DEFF Research Database (Denmark)
S. Nadimi, Esmaeil; Nyholm Jørgensen, Rasmus; Blanes-Vidal, Victoria;
2012-01-01
perceptron (MLP)-based artificial neural network (ANN). The best performance of the ANN in terms of the mean squared error (MSE) and the convergence speed was achieved when it was initialized and trained using the Nguyen–Widrow and Levenberg–Marquardt back-propagation algorithms, respectively. The success...... into their corresponding behavioral modes. However, network unreliability and high-energy consumption have limited the applicability of those systems. In this study, a 2.4-GHz ZigBee-based mobile ad hoc wireless sensor network (MANET) that is able to overcome those problems is presented. The designed MANET showed high...
Transient stability analysis of electric energy systems via a fuzzy ART-ARTMAP neural network
Energy Technology Data Exchange (ETDEWEB)
Ferreira, Wagner Peron; Silveira, Maria do Carmo G.; Lotufo, AnnaDiva P.; Minussi, Carlos. R. [Department of Electrical Engineering, Sao Paulo State University (UNESP), P.O. Box 31, 15385-000, Ilha Solteira, SP (Brazil)
2006-04-15
This work presents a methodology to analyze transient stability (first oscillation) of electric energy systems, using a neural network based on ART architecture (adaptive resonance theory), named fuzzy ART-ARTMAP neural network for real time applications. The security margin is used as a stability analysis criterion, considering three-phase short circuit faults with a transmission line outage. The neural network operation consists of two fundamental phases: the training and the analysis. The training phase needs a great quantity of processing for the realization, while the analysis phase is effectuated almost without computation effort. This is, therefore the principal purpose to use neural networks for solving complex problems that need fast solutions, as the applications in real time. The ART neural networks have as primordial characteristics the plasticity and the stability, which are essential qualities to the training execution and to an efficient analysis. The fuzzy ART-ARTMAP neural network is proposed seeking a superior performance, in terms of precision and speed, when compared to conventional ARTMAP, and much more when compared to the neural networks that use the training by backpropagation algorithm, which is a benchmark in neural network area. (author)
Robust recurrent neural network modeling for software fault detection and correction prediction
Energy Technology Data Exchange (ETDEWEB)
Hu, Q.P. [Quality and Innovation Research Centre, Department of Industrial and Systems Engineering, National University of Singapore, Singapore 119260 (Singapore)]. E-mail: g0305835@nus.edu.sg; Xie, M. [Quality and Innovation Research Centre, Department of Industrial and Systems Engineering, National University of Singapore, Singapore 119260 (Singapore)]. E-mail: mxie@nus.edu.sg; Ng, S.H. [Quality and Innovation Research Centre, Department of Industrial and Systems Engineering, National University of Singapore, Singapore 119260 (Singapore)]. E-mail: isensh@nus.edu.sg; Levitin, G. [Israel Electric Corporation, Reliability and Equipment Department, R and D Division, Aaifa 31000 (Israel)]. E-mail: levitin@iec.co.il
2007-03-15
Software fault detection and correction processes are related although different, and they should be studied together. A practical approach is to apply software reliability growth models to model fault detection, and fault correction process is assumed to be a delayed process. On the other hand, the artificial neural networks model, as a data-driven approach, tries to model these two processes together with no assumptions. Specifically, feedforward backpropagation networks have shown their advantages over analytical models in fault number predictions. In this paper, the following approach is explored. First, recurrent neural networks are applied to model these two processes together. Within this framework, a systematic networks configuration approach is developed with genetic algorithm according to the prediction performance. In order to provide robust predictions, an extra factor characterizing the dispersion of prediction repetitions is incorporated into the performance function. Comparisons with feedforward neural networks and analytical models are developed with respect to a real data set.
Predicting Model forComplex Production Process Based on Dynamic Neural Network
Institute of Scientific and Technical Information of China (English)
无
2001-01-01
Based on the comparison of several methods of time series predicting, this paper points out that it is nec-essary to use dynamic neural network in modeling of complex production process. Because self-feedback and mutu-al-feedback are adopted among nodes at the same layer in Elman network, it has stronger ability of dynamic ap-proximation, and can describe any non-linear dynamic system. After the structure and mathematical description be-ing given, dynamic back-propagation (BP) algorithm of training weights of Elman neural network is deduced. Atlast, the network is used to predict ash content of black amber in jigging production process. The results show thatthis neural network is powerful in predicting and suitable for modeling, predicting, and controling of complex pro-duction process.
Complex-Valued Neural Networks
Hirose, Akira
2012-01-01
This book is the second enlarged and revised edition of the first successful monograph on complex-valued neural networks (CVNNs) published in 2006, which lends itself to graduate and undergraduate courses in electrical engineering, informatics, control engineering, mechanics, robotics, bioengineering, and other relevant fields. In the second edition the recent trends in CVNNs research are included, resulting in e.g. almost a doubled number of references. The parametron invented in 1954 is also referred to with discussion on analogy and disparity. Also various additional arguments on the advantages of the complex-valued neural networks enhancing the difference to real-valued neural networks are given in various sections. The book is useful for those beginning their studies, for instance, in adaptive signal processing for highly functional sensing and imaging, control in unknown and changing environment, robotics inspired by human neural systems, and brain-like information processing, as well as interdisciplina...
Prediction of metal corrosion using feed-forward neural networks
International Nuclear Information System (INIS)
The reliable prediction of corrosion behavior for the effective control of corrosion is a fundamental requirement. Since real world corrosion never seems to involve quite the same conditions that have previously been tested, using corrosion literature does not provide the necessary answers. In order to provide a methodology for predicting corrosion in real and complex situations, artificial neural networks can be utilized. Feed-forward artificial neural network (FFANN) is an information-processing paradigm inspired by the way the densely interconnected, parallel structure of the human brain process information.The aim of the present work is to predict corrosion behavior in critical conditions, such as industrial applications, based on some laboratory experimental data. Electrochemical behavior of stainless steel in different conditions were studied, using polarization technique and Tafel curves. Back-propagation neural networks models were developed to predict the corrosion behavior. The trained networks result in predicted value in good comparison to the experimental data. They have generally been claimed to be successful in modeling the corrosion behavior. The results are presented in two tables. Table 1 gives corrosion behavior of stainless-steel as a function of pH and CuSO4 concentration and table 2 gives corrosion behavior of stainless - steel as a function of electrode surface area and CuSO4 concentration. (authors)
Neural networks and wavelet analysis in the computer interpretation of pulse oximetry data
Energy Technology Data Exchange (ETDEWEB)
Dowla, F.U.; Skokowski, P.G.; Leach, R.R. Jr.
1996-03-01
Pulse oximeters determine the oxygen saturation level of blood by measuring the light absorption of arterial blood. The sensor consists of red and infrared light sources and photodetectors. A method based on neural networks and wavelet analysis is developed for improved saturation estimation in the presence of sensor motion. Spectral and correlation functions of the dual channel oximetry data are used by a backpropagation neural network to characterize the type of motion. Amplitude ratios of red to infrared signals as a function of time scale are obtained from the multiresolution wavelet decomposition of the two-channel data. Motion class and amplitude ratios are then combined to obtain a short-time estimate of the oxygen saturation level. A final estimate of oxygen saturation is obtained by applying a 15 s smoothing filter on the short-time measurements based on 3.5 s windows sampled every 1.75 s. The design employs two backpropagation neural networks. The first neural network determines the motion characteristics and the second network determines the saturation estimate. Our approach utilizes waveform analysis in contrast to the standard algorithms that are based on the successful detection of peaks and troughs in the signal. The proposed algorithm is numerically efficient and has stable characteristics with a reduced false alarm rate with a small loss in detection. The method can be rapidly developed on a digital signal processing platform.
Phase Transitions of Neural Networks
Kinzel, Wolfgang
1997-01-01
The cooperative behaviour of interacting neurons and synapses is studied using models and methods from statistical physics. The competition between training error and entropy may lead to discontinuous properties of the neural network. This is demonstrated for a few examples: Perceptron, associative memory, learning from examples, generalization, multilayer networks, structure recognition, Bayesian estimate, on-line training, noise estimation and time series generation.
Directory of Open Access Journals (Sweden)
Tummala Pradeep
2011-11-01
Full Text Available This paper investigates the use of variable learning rate back-propagation algorithm and Levenberg-Marquardt back-propagation algorithm in Intrusion detection system for detecting attacks. Inthe present study, these 2 neural network (NN algorithms are compared according to their speed,accuracy and, performance using mean squared error (MSE (Closer the value of MSE to 0, higher willbe the performance. Based on the study and test results, the Levenberg-Marquardt algorithm has been found to be faster and having more accuracy and performance than variable learning rate backpropagation algorithm.
Lure, Y. M. Fleming; Grody, Norman C.; Chiou, Y. S. Peter; Yeh, H. Y. Michael
1993-01-01
A data fusion system with artificial neural networks (ANN) is used for fast and accurate classification of five earth surface conditions and surface changes, based on seven SSMI multichannel microwave satellite measurements. The measurements include brightness temperatures at 19, 22, 37, and 85 GHz at both H and V polarizations (only V at 22 GHz). The seven channel measurements are processed through a convolution computation such that all measurements are located at same grid. Five surface classes including non-scattering surface, precipitation over land, over ocean, snow, and desert are identified from ground-truth observations. The system processes sensory data in three consecutive phases: (1) pre-processing to extract feature vectors and enhance separability among detected classes; (2) preliminary classification of Earth surface patterns using two separate and parallely acting classifiers: back-propagation neural network and binary decision tree classifiers; and (3) data fusion of results from preliminary classifiers to obtain the optimal performance in overall classification. Both the binary decision tree classifier and the fusion processing centers are implemented by neural network architectures. The fusion system configuration is a hierarchical neural network architecture, in which each functional neural net will handle different processing phases in a pipelined fashion. There is a total of around 13,500 samples for this analysis, of which 4 percent are used as the training set and 96 percent as the testing set. After training, this classification system is able to bring up the detection accuracy to 94 percent compared with 88 percent for back-propagation artificial neural networks and 80 percent for binary decision tree classifiers. The neural network data fusion classification is currently under progress to be integrated in an image processing system at NOAA and to be implemented in a prototype of a massively parallel and dynamically reconfigurable Modular
Classification of E-Nose Aroma Data of Four Fruit Types by ABC-Based Neural Network.
Adak, M Fatih; Yumusak, Nejat
2016-01-01
Electronic nose technology is used in many areas, and frequently in the beverage industry for classification and quality-control purposes. In this study, four different aroma data (strawberry, lemon, cherry, and melon) were obtained using a MOSES II electronic nose for the purpose of fruit classification. To improve the performance of the classification, the training phase of the neural network with two hidden layers was optimized using artificial bee colony algorithm (ABC), which is known to be successful in exploration. Test data were given to two different neural networks, each of which were trained separately with backpropagation (BP) and ABC, and average test performances were measured as 60% for the artificial neural network trained with BP and 76.39% for the artificial neural network trained with ABC. Training and test phases were repeated 30 times to obtain these average performance measurements. This level of performance shows that the artificial neural network trained with ABC is successful in classifying aroma data.
Taufikurrahman, Mohammad
2015-01-01
Neural networks is one of method which suitable for used to predict the time series data which include volatile. This research has been finished by using software Matlab 7.10.0 (R2010a). The research used the model neural network backpropagation. The aim to predict exchange rate Rupiah to Dollar U.S in 2014 from the research, discussion and the data process. To get exchange rate Rupiah for Dollar U.S in 2014 is 12.111,09.
Robust nonlinear system identification using neural-network models.
Lu, S; Basar, T
1998-01-01
We study the problem of identification for nonlinear systems in the presence of unknown driving noise, using both feedforward multilayer neural network and radial basis function network models. Our objective is to resolve the difficulty associated with the persistency of excitation condition inherent to the standard schemes in the neural identification literature. This difficulty is circumvented here by a novel formulation and by using a new class of identification algorithms recently obtained by Didinsky et al. We show how these algorithms can be exploited to successfully identify the nonlinearity in the system using neural-network models. By embedding the original problem in one with noise-perturbed state measurements, we present a class of identifiers (under L1 and L2 cost criteria) which secure a good approximant for the system nonlinearity provided that some global optimization technique is used. In this respect, many available learning algorithms in the current neural-network literature, e.g., the backpropagation scheme and the genetic algorithms-based scheme, with slight modifications, can ensure the identification of the system nonlinearity. Subsequently, we address the same problem under a third, worst case L(infinity) criterion for an RBF modeling. We present a neural-network version of an H(infinity)-based identification algorithm from Didinsky et al and show how, along with an appropriate choice of control input to enhance excitation, under both full-state-derivative information (FSDI) and noise-perturbed full-state-information (NPFSI), it leads to satisfaction of a relevant persistency of excitation condition, and thereby to robust identification of the nonlinearity. Results from several simulation studies have been included to demonstrate the effectiveness of these algorithms.
DEFF Research Database (Denmark)
Nilsson, Torben; Bassani, Maria R.; Larsen, Thomas Ostenfeld;
1996-01-01
. palitans. However, some difficulties appeared in distinguishing the closely related species P. commune and P. palitans. Such difficulties became greater on including more isolates and limiting the analysis to five of the species. The use of back-propagation artificial neural networks, in contrast, resulted...
Learning in feed-forward neural networks by improving the performance
Gordon, Mirta B.; Pereto, Pierre; Rodriguez-Girones, Miguel
1992-06-01
Statistical mechanics is used to derive a new learning rule for a feed-forward neural network with one hidden layer. Generalization to multilayer neural networks is straightforward, and proceeds in the same way as backpropagation. We consider a neural network as a physical system, that can be in different states. There are as many possible states as patterns in the learning set. The energy of each level is proportional to the stability of the corresponding pattern. The statistical mechanics free energy of the system, which we call performance, is a maximum for the synaptic strengths that stabilize all the patterns. We propose a learning algorithm that looks for synaptic strengths that maximize the network's performance. Patterns with lower stabilities are more effective in driving the learning process because they have a higher statistical weight. Taking different temperatures for different layers improves the results.
Modeling and prediction of Turkey's electricity consumption using Artificial Neural Networks
Energy Technology Data Exchange (ETDEWEB)
Kavaklioglu, Kadir; Ozturk, Harun Kemal; Canyurt, Olcay Ersel [Pamukkale University, Mechanical Engineering Department, Denizli (Turkey); Ceylan, Halim [Pamukkale University, Civil Engineering Department, Denizli (Turkey)
2009-11-15
Artificial Neural Networks are proposed to model and predict electricity consumption of Turkey. Multi layer perceptron with backpropagation training algorithm is used as the neural network topology. Tangent-sigmoid and pure-linear transfer functions are selected in the hidden and output layer processing elements, respectively. These input-output network models are a result of relationships that exist among electricity consumption and several other socioeconomic variables. Electricity consumption is modeled as a function of economic indicators such as population, gross national product, imports and exports. It is also modeled using export-import ratio and time input only. Performance comparison among different models is made based on absolute and percentage mean square error. Electricity consumption of Turkey is predicted until 2027 using data from 1975 to 2006 along with other economic indicators. The results show that electricity consumption can be modeled using Artificial Neural Networks, and the models can be used to predict future electricity consumption. (author)
Directory of Open Access Journals (Sweden)
Małgorzata Pawul
2016-09-01
Full Text Available Recently, a lot of attention was paid to the improvement of methods which are used to air quality forecasting. Artificial neural networks can be applied to model these problems. Their advantage is that they can solve the problem in the conditions of incomplete information, without the knowledge of the analytical relationship between the input and output data. In this paper we applied artificial neural networks to predict the PM 10 concentrations as factors determining the occurrence of smog phenomena. To create these networks we used meteorological data and concentrations of PM 10. The data were recorded in 2014 and 2015 at three measuring stations operating in Krakow under the State Environmental Monitoring. The best results were obtained by three-layer perceptron with back-propagation algorithm. The neural networks received a good fit in all cases.
Modeling of methane emissions using artificial neural network approach
Directory of Open Access Journals (Sweden)
Stamenković Lidija J.
2015-01-01
Full Text Available The aim of this study was to develop a model for forecasting CH4 emissions at the national level, using Artificial Neural Networks (ANN with broadly available sustainability, economical and industrial indicators as their inputs. ANN modeling was performed using two different types of architecture; a Backpropagation Neural Network (BPNN and a General Regression Neural Network (GRNN. A conventional multiple linear regression (MLR model was also developed in order to compare model performance and assess which model provides the best results. ANN and MLR models were developed and tested using the same annual data for 20 European countries. The ANN model demonstrated very good performance, significantly better than the MLR model. It was shown that a forecast of CH4 emissions at the national level using the ANN model can be made successfully and accurately for a future period of up to two years, thereby opening the possibility to apply such a modeling technique which can be used to support the implementation of sustainable development strategies and environmental management policies. [Projekat Ministarstva nauke Republike Srbije, br. 172007
Video Compression Using Neural Network
Directory of Open Access Journals (Sweden)
Sangeeta Mishra
2012-08-01
Full Text Available Apart from the existing technology on image compression represented by series of JPEG, MPEG and H.26x standards, new technology such as neural networks and genetic algorithms are being developed to explore the future of image coding. Successful applications of neural networks to basic propagation algorithm have now become well established and other aspects of neural network involvement in this technology. In this paper different algorithms were implemented like gradient descent back propagation, gradient descent with momentum back propagation, gradient descent with adaptive learning back propagation, gradient descent with momentum and adaptive learning back propagation and Levenberg-Marquardt algorithm. The size of original video clip is 25MB and after compression it becomes 21.3MB giving the compression ratio as 85.2% and compression factor of 1.174. It was observed that the size remains same after compression but the difference is in the clarity.
Hayashi, Hideaki; Shima, Keisuke; Shibanoki, Taro; Kurita, Yuichi; Tsuji, Toshio
2013-01-01
This paper outlines a probabilistic neural network developed on the basis of time-series discriminant component analysis (TSDCA) that can be used to classify high-dimensional time-series patterns. TSDCA involves the compression of high-dimensional time series into a lower-dimensional space using a set of orthogonal transformations and the calculation of posterior probabilities based on a continuous-density hidden Markov model that incorporates a Gaussian mixture model expressed in the reduced-dimensional space. The analysis can be incorporated into a neural network so that parameters can be obtained appropriately as network coefficients according to backpropagation-through-time-based training algorithm. The network is considered to enable high-accuracy classification of high-dimensional time-series patterns and to reduce the computation time taken for network training. In the experiments conducted during the study, the validity of the proposed network was demonstrated for EEG signals.
Determining the confidence levels of sensor outputs using neural networks
International Nuclear Information System (INIS)
This paper describes an approach for determining the confidence level of a sensor output using multi-sensor arrays, sensor fusion and artificial neural networks. The authors have shown in previous work that sensor fusion and artificial neural networks can be used to learn the relationships between the outputs of an array of simulated partially selective sensors and the individual analyte concentrations in a mixture of analyses. Other researchers have shown that an array of partially selective sensors can be used to determine the individual gas concentrations in a gaseous mixture. The research reported in this paper shows that it is possible to extract confidence level information from an array of partially selective sensors using artificial neural networks. The confidence level of a sensor output is defined as a numeric value, ranging from 0% to 100%, that indicates the confidence associated with a output of a given sensor. A three layer back-propagation neural network was trained on a subset of the sensor confidence level space, and was tested for its ability to generalize, where the confidence level space is defined as all possible deviations from the correct sensor output. A learning rate of 0.1 was used and no momentum terms were used in the neural network. This research has shown that an artificial neural network can accurately estimate the confidence level of individual sensors in an array of partially selective sensors. This research has also shown that the neural network's ability to determine the confidence level is influenced by the complexity of the sensor's response and that the neural network is able to estimate the confidence levels even if more than one sensor is in error. The fundamentals behind this research could be applied to other configurations besides arrays of partially selective sensors, such as an array of sensors separated spatially. An example of such a configuration could be an array of temperature sensors in a tank that is not in
Relations Between Wavelet Network and Feedforward Neural Network
Institute of Scientific and Technical Information of China (English)
刘志刚; 何正友; 钱清泉
2002-01-01
A comparison of construction forms and base functions is made between feedforward neural network and wavelet network. The relations between them are studied from the constructions of wavelet functions or dilation functions in wavelet network by different activation functions in feedforward neural network. It is concluded that some wavelet function is equal to the linear combination of several neurons in feedforward neural network.
High-Performance Neural Networks for Visual Object Classification
Cireşan, Dan C; Masci, Jonathan; Gambardella, Luca M; Schmidhuber, Jürgen
2011-01-01
We present a fast, fully parameterizable GPU implementation of Convolutional Neural Network variants. Our feature extractors are neither carefully designed nor pre-wired, but rather learned in a supervised way. Our deep hierarchical architectures achieve the best published results on benchmarks for object classification (NORB, CIFAR10) and handwritten digit recognition (MNIST), with error rates of 2.53%, 19.51%, 0.35%, respectively. Deep nets trained by simple back-propagation perform better than more shallow ones. Learning is surprisingly rapid. NORB is completely trained within five epochs. Test error rates on MNIST drop to 2.42%, 0.97% and 0.48% after 1, 3 and 17 epochs, respectively.
Prediction of the plasma distribution using an artificial neural network
Institute of Scientific and Technical Information of China (English)
Li Wei; Chen JunFang; Wang Teng
2009-01-01
In this work, an artificial neural network (ANN) model is established using a back-propagation training algorithm in order to predict the plasma spatial distribution in an electron cyclotron resonance (ECR) - plasma-enhanced chemical vapor deposition (PECVD) plasma system. In our model, there are three layers: the input layer, the hidden layer and the output layer. The input layer is composed of five neurons: the radial position, the axial position, the gas pressure,the microwave power and the magnet coil current. The output layer is our target output neuron: the plasma density.The accuracy of our prediction is tested with the experimental data obtained by a Langmuir probe, and ANN results show a good agreement with the experimental data. It is concluded that ANN is a useful tool in dealing with some nonlinear problems of the plasma spatial distribution.
fMRI Segmentation Using Echo State Neural Network
Directory of Open Access Journals (Sweden)
D.Suganthi
2008-02-01
Full Text Available This research work proposes a new intelligent segmentation technique forfunctional Magnetic Resonance Imaging (fMRI. It has been implemented usingan Echostate Neural Network (ESN. Segmentation is an important process thathelps in identifying objects of the image. Existing segmentation methods are notable to exactly segment the complicated profile of the fMRI accurately.Segmentation of every pixel in the fMRI correctly helps in proper location oftumor. The presence of noise and artifacts poses a challenging problem in propersegmentation. The proposed ESN is an estimation method with energyminimization. The estimation property helps in better segmentation of thecomplicated profile of the fMRI. The performance of the new segmentationmethod is found to be better with higher peak signal to noise ratio (PSNR of 61when compared to the PSNR of the existing back-propagation algorithm (BPAsegmentation method which is 57.
Fault Identification of Gearbox Degradation with Optimized Wavelet Neural Network
Directory of Open Access Journals (Sweden)
Hanxin Chen
2013-01-01
Full Text Available A novel intelligent method based on wavelet neural network (WNN was proposed to identify the gear crack degradation in gearbox in this paper. The wavelet packet analysis (WPA is applied to extract the fault feature of the vibration signal, which is collected by two acceleration sensors mounted on the gearbox along the vertical and horizontal direction. The back-propagation (BP algorithm is studied and applied to optimize the scale and translation parameters of the Morlet wavelet function, the weight coefficients, threshold values in WNN structure. Four different gear crack damage levels under three different loads and three various motor speeds are presented to obtain the different gear fault modes and gear crack degradation in the experimental system. The results show the feasibility and effectiveness of the proposed method by the identification and classification of the four gear modes and degradation.
Modeling Slump of Ready Mix Concrete Using Genetically Evolved Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Vinay Chandwani
2014-01-01
Full Text Available Artificial neural networks (ANNs have been the preferred choice for modeling the complex and nonlinear material behavior where conventional mathematical approaches do not yield the desired accuracy and predictability. Despite their popularity as a universal function approximator and wide range of applications, no specific rules for deciding the architecture of neural networks catering to a specific modeling task have been formulated. The research paper presents a methodology for automated design of neural network architecture, replacing the conventional trial and error technique of finding the optimal neural network. The genetic algorithms (GA stochastic search has been harnessed for evolving the optimum number of hidden layer neurons, transfer function, learning rate, and momentum coefficient for backpropagation ANN. The methodology has been applied for modeling slump of ready mix concrete based on its design mix constituents, namely, cement, fly ash, sand, coarse aggregates, admixture, and water-binder ratio. Six different statistical performance measures have been used for evaluating the performance of the trained neural networks. The study showed that, in comparison to conventional trial and error technique of deciding the neural network architecture and training parameters, the neural network architecture evolved through GA was of reduced complexity and provided better prediction performance.
Çebi, A.; Akdoğan, E.; Celen, A.; Dalkilic, A. S.
2016-06-01
An artificial neural network (ANN) model of friction factor in smooth and microfin tubes under heating, cooling and isothermal conditions was developed in this study. Data used in ANN was taken from a vertically positioned heat exchanger experimental setup. Multi-layered feed-forward neural network with backpropagation algorithm, radial basis function networks and hybrid PSO-neural network algorithm were applied to the database. Inputs were the ratio of cross sectional flow area to hydraulic diameter, experimental condition number depending on isothermal, heating, or cooling conditions and mass flow rate while the friction factor was the output of the constructed system. It was observed that such neural network based system could effectively predict the friction factor values of the flows regardless of their tube types. A dependency analysis to determine the strongest parameter that affected the network and database was also performed and tube geometry was found to be the strongest parameter of all as a result of analysis.
Ocean wave forecasting using recurrent neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Prabaharan, N.
, merchant vessel routing, nearshore construction, etc. more efficiently and safely. This paper describes an artificial neural network, namely recurrent neural network with rprop update algorithm and is applied for wave forecasting. Measured ocean waves off...
Generalization performance of regularized neural network models
DEFF Research Database (Denmark)
Larsen, Jan; Hansen, Lars Kai
1994-01-01
Architecture optimization is a fundamental problem of neural network modeling. The optimal architecture is defined as the one which minimizes the generalization error. This paper addresses estimation of the generalization performance of regularized, complete neural network models. Regularization...
Neural Networks for Flight Control
Jorgensen, Charles C.
1996-01-01
Neural networks are being developed at NASA Ames Research Center to permit real-time adaptive control of time varying nonlinear systems, enhance the fault-tolerance of mission hardware, and permit online system reconfiguration. In general, the problem of controlling time varying nonlinear systems with unknown structures has not been solved. Adaptive neural control techniques show considerable promise and are being applied to technical challenges including automated docking of spacecraft, dynamic balancing of the space station centrifuge, online reconfiguration of damaged aircraft, and reducing cost of new air and spacecraft designs. Our experiences have shown that neural network algorithms solved certain problems that conventional control methods have been unable to effectively address. These include damage mitigation in nonlinear reconfiguration flight control, early performance estimation of new aircraft designs, compensation for damaged planetary mission hardware by using redundant manipulator capability, and space sensor platform stabilization. This presentation explored these developments in the context of neural network control theory. The discussion began with an overview of why neural control has proven attractive for NASA application domains. The more important issues in control system development were then discussed with references to significant technical advances in the literature. Examples of how these methods have been applied were given, followed by projections of emerging application needs and directions.
Neural Network Adaptations to Hardware Implementations
Moerland, Perry,; Fiesler,Emile
1997-01-01
In order to take advantage of the massive parallelism offered by artificial neural networks, hardware implementations are essential.However, most standard neural network models are not very suitable for implementation in hardware and adaptations are needed. In this section an overview is given of the various issues that are encountered when mapping an ideal neural network model onto a compact and reliable neural network hardware implementation, like quantization, handling nonuniformities and ...
Neural Network Adaptations to Hardware Implementations
Moerland, Perry,; Fiesler,Emile; Beale, R
1997-01-01
In order to take advantage of the massive parallelism offered by artificial neural networks, hardware implementations are essential. However, most standard neural network models are not very suitable for implementation in hardware and adaptations are needed. In this section an overview is given of the various issues that are encountered when mapping an ideal neural network model onto a compact and reliable neural network hardware implementation, like quantization, handling nonuniformities and...
Building a Chaotic Proved Neural Network
Bahi, Jacques M; Salomon, Michel
2011-01-01
Chaotic neural networks have received a great deal of attention these last years. In this paper we establish a precise correspondence between the so-called chaotic iterations and a particular class of artificial neural networks: global recurrent multi-layer perceptrons. We show formally that it is possible to make these iterations behave chaotically, as defined by Devaney, and thus we obtain the first neural networks proven chaotic. Several neural networks with different architectures are trained to exhibit a chaotical behavior.
A BP neural network model for sea state recognition using laser altimeter
Shi, Chun-bo; Jia, Xiao-dong; Li, Sheng; Wang, Zhen
2009-07-01
A BP neural network method for the recognition of sea state in laser altimeter is presented in this paper. Sea wave is the typical stochastic disturbance factor of laser altimeter effecting on low-altitude defense penetration of the intelligent antiship missiles, the recognition of sea state is studied in order to satisfy the practical needs of flying over the ocean. The BP neural network fed with the feature vector of laser range-measurement presents the analysis of features and outputs the estimation result of sea state. The two most distinguishing features are the mean and the variance of the sea echo, which are extracted from the distance characteristics of sea echo using general theory of statistics. The use of a feedforward network trained with the back-propagation algorithm is also investigated. The BP neural network is trained using sample data set to the neural network, and then the BP neural network trained is tested to recognize the sea state waiting for the classification. The network output shows the recognition accuracy of the model can up to 88%, and the results of tests show that the BP neural network model for the recognition of sea state is feasible and effective.
A NOVEL INTRUSION DETECTION MODE BASED ON UNDERSTANDABLE NEURAL NETWORK TREES
Institute of Scientific and Technical Information of China (English)
Xu Qinzhen; Yang Luxi; Zhao Qiangfu; He Zhenya
2006-01-01
Several data mining techniques such as Hidden Markov Model (HMM), artificial neural network,statistical techniques and expert systems are used to model network packets in the field of intrusion detection.In this paper a novel intrusion detection mode based on understandable Neural Network Tree (NNTree) is presented. NNTree is a modular neural network with the overall structure being a Decision Tree (DT), and each non-terminal node being an Expert Neural Network (ENN). One crucial advantage of using NNTrees is that they keep the non-symbolic model ENN's capability of learning in changing environments. Another potential advantage of using NNTrees is that they are actually "gray boxes" as they can be interpreted easily ifthe number of inputs for each ENN is limited. We showed through experiments that the trained NNTree achieved a simple ENN at each non-terminal node as well as a satisfying recognition rate of the network packets dataset.We also compared the performance with that of a three-layer backpropagation neural network. Experimental results indicated that the NNTree based intrusion detection model achieved better performance than the neural network based intrusion detection model.
Spatial Data Mining Toolbox for Mapping Suitability of Landfill Sites Using Neural Networks
Abujayyab, S. K. M.; Ahamad, M. S. S.; Yahya, A. S.; Aziz, H. A.
2016-09-01
Mapping the suitability of landfill sites is a complex field and is involved with multidiscipline. The purpose of this research is to create an ArcGIS spatial data mining toolbox for mapping the suitability of landfill sites at a regional scale using neural networks. The toolbox is constructed from six sub-tools to prepare, train, and process data. The employment of the toolbox is straightforward. The multilayer perceptron (MLP) neural networks structure with a backpropagation learning algorithm is used. The dataset is mined from the north states in Malaysia. A total of 14 criteria are utilized to build the training dataset. The toolbox provides a platform for decision makers to implement neural networks for mapping the suitability of landfill sites in the ArcGIS environment. The result shows the ability of the toolbox to produce suitability maps for landfill sites.
The fundamentals of fuzzy neural network and application in nuclear monitoring
International Nuclear Information System (INIS)
The authors presents a fuzzy modeling method using fuzzy neural network with the back-propagation algorithm. The new method can identify the fuzzy model of a nonlinear system automatically. Fuzzy neural network is used to generate fuzzy rules and membership functions. The feasibility and inferential statistic of the method is examined by using numerical data and XOR problem. The FNN improves accuracy and reliability, reduces design time and minimizes system cost of fuzzy design. The FNN can be used for estimation of human injury in nuclear explosions and can be simplified to a rule neural network (RNN), which is used for pole extraction of signal. Preliminary simulation show that FNN has vest vistas in nuclear monitoring
SPATIAL DATA MINING TOOLBOX FOR MAPPING SUITABILITY OF LANDFILL SITES USING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
S. K. M. Abujayyab
2016-09-01
Full Text Available Mapping the suitability of landfill sites is a complex field and is involved with multidiscipline. The purpose of this research is to create an ArcGIS spatial data mining toolbox for mapping the suitability of landfill sites at a regional scale using neural networks. The toolbox is constructed from six sub-tools to prepare, train, and process data. The employment of the toolbox is straightforward. The multilayer perceptron (MLP neural networks structure with a backpropagation learning algorithm is used. The dataset is mined from the north states in Malaysia. A total of 14 criteria are utilized to build the training dataset. The toolbox provides a platform for decision makers to implement neural networks for mapping the suitability of landfill sites in the ArcGIS environment. The result shows the ability of the toolbox to produce suitability maps for landfill sites.
Butterfly Classification by HSI and RGB Color Models Using Neural Networks
Directory of Open Access Journals (Sweden)
Jorge E. Grajales-Múnera
2013-11-01
Full Text Available This study aims the classification of Butterfly species through the implementation of Neural Networks and Image Processing. A total of 9 species of Morpho genre which has blue as a characteristic color are processed. For Butterfly segmentation we used image processing tools such as: Binarization, edge processing and mathematical morphology. For data processing RGB values are obtained for every image which are converted to HSI color model to identify blue pixels and obtain the data to the proposed Neural Networks: Back-Propagation and Perceptron. For analysis and verification of results confusion matrix are built and analyzed with the results of neural networks with the lowest error levels. We obtain error levels close to 1% in classification of some Butterfly species.
Using Artificial Neural Networks and Function Points to Estimate 4GL Software Development Effort
Directory of Open Access Journals (Sweden)
G.E. Wittig
1994-05-01
Full Text Available Hie value of neural network modelling techniques in performing complicated pattern recognition and nonlinear estimation tasks has been demonstrated across an impressive spectrum of applications. Software development is a complex environment with many interrelated factors affecting development effort and productivity. Accurate forecasting has proved difficult since many of these interrelationships are not fully understood. An attempt to capture the significant attributes of the software development environment to enable improved accuracy in forecasting of development effort is made using backpropagation artificial neural networks. The data for this study was gathered from commercial 4GL software development projects, across a large range of sizes. As is typical of software developments, the range in productivity and other development factors in the data set is also large, accentuating the estimation problem. Despite these difficulties the neural network model predictions were reasonably accurate in comparison with other published results, indicating the potential of the use of this approach.
Adaptive learning with guaranteed stability for discrete-time recurrent neural networks
Institute of Scientific and Technical Information of China (English)
无
2007-01-01
To avoid unstable learning, a stable adaptive learning algorithm was proposed for discrete-time recurrent neural networks. Unlike the dynamic gradient methods, such as the backpropagation through time and the real time recurrent learning, the weights of the recurrent neural networks were updated online in terms of Lyapunov stability theory in the proposed learning algorithm, so the learning stability was guaranteed. With the inversion of the activation function of the recurrent neural networks, the proposed learning algorithm can be easily implemented for solving varying nonlinear adaptive learning problems and fast convergence of the adaptive learning process can be achieved. Simulation experiments in pattern recognition show that only 5 iterations are needed for the storage of a 15X15 binary image pattern and only 9 iterations are needed for the perfect realization of an analog vector by an equilibrium state with the proposed learning algorithm.
Prediction of flow stress of Ti-15-3 alloy with artificial neural network
Institute of Scientific and Technical Information of China (English)
无
2001-01-01
Hot compression experiments were conducted on Ti-15-3 alloy specimens using Gleeble-1500 Thermal Simulator．These tests were focused to obtain the flow stress data under various conditions of strain，strain rate and temperature. On the basis of these data， the predicting model for the nonlinear relation between flow stress and deformation strain，strain rate and temperature for Ti-15-3 alloy was developed with a back-propagation artificial neural network method. Results show that the neural network can reproduce the flow stress in the sampled data and predict the nonsampled data well. Thus the neural network method has been verified to be used to tackle hot deformation problems of Ti-15-3 alloy.
Directory of Open Access Journals (Sweden)
Sen Tian
2014-01-01
Full Text Available With the development of mine industry, tailings storage facility (TSF, as the important facility of mining, has attracted increasing attention for its safety problems. However, the problems of low accuracy and slow operation rate often occur in current TSF safety evaluation models. This paper establishes a reasonable TSF safety evaluation index system and puts forward a new TSF safety evaluation model by combining the theories for the analytic hierarchy process (AHP and improved back-propagation (BP neural network algorithm. The varying proportions of cross validation were calculated, demonstrating that this method has better evaluation performance with higher learning efficiency and faster convergence speed and avoids the oscillation in the training process in traditional BP neural network method and other primary neural network methods. The entire analysis shows the combination of the two methods increases the accuracy and reliability of the safety evaluation, and it can be well applied in the TSF safety evaluation.
IUKF neural network modeling for FOG temperature drift
Institute of Scientific and Technical Information of China (English)
Feng Zha; Jiangning Xu; Jingshu Li; Hongyang He
2013-01-01
A novel neural network based on iterated unscented Kalman filter (IUKF) algorithm is established to model and com-pensate for the fiber optic gyro (FOG) bias drift caused by tempe-rature. In the network, FOG temperature and its gradient are set as input and the FOG bias drift is set as the expected output. A 2-5-1 network trained with IUKF algorithm is established. The IUKF algorithm is developed on the basis of the unscented Kalman filter (UKF). The weight and bias vectors of the hidden layer are set as the state of the UKF and its process and measurement equations are deduced according to the network architecture. To solve the unavoidable estimation deviation of the mean and covariance of the states in the UKF algorithm, iterative computation is introduced into the UKF after the measurement update. While the measure-ment noise R is extended into the state vectors before iteration in order to meet the statistic orthogonality of estimate and mea-surement noise. The IUKF algorithm can provide the optimized estimation for the neural network because of its state expansion and iteration. Temperature rise (-20-20◦C) and drop (70-20◦C) tests for FOG are carried out in an attemperator. The temperature drift model is built with neural network, and it is trained respec-tively with BP, UKF and IUKF algorithms. The results prove that the proposed model has higher precision compared with the back-propagation (BP) and UKF network models.
Application of artificial neural network for prediction of marine diesel engine performance
Mohd Noor, C. W.; Mamat, R.; Najafi, G.; Nik, W. B. Wan; Fadhil, M.
2015-12-01
This study deals with an artificial neural network (ANN) modelling of a marine diesel engine to predict the brake power, output torque, brake specific fuel consumption, brake thermal efficiency and volumetric efficiency. The input data for network training was gathered from engine laboratory testing running at various engine speed. The prediction model was developed based on standard back-propagation Levenberg-Marquardt training algorithm. The performance of the model was validated by comparing the prediction data sets with the measured experiment data. Results showed that the ANN model provided good agreement with the experimental data with high accuracy.
Identification of Nonlinear Dynamic Systems Using Hammerstein-Type Neural Network
Directory of Open Access Journals (Sweden)
Hongshan Yu
2014-01-01
Full Text Available Hammerstein model has been popularly applied to identify the nonlinear systems. In this paper, a Hammerstein-type neural network (HTNN is derived to formulate the well-known Hammerstein model. The HTNN consists of a nonlinear static gain in cascade with a linear dynamic part. First, the Lipschitz criterion for order determination is derived. Second, the backpropagation algorithm for updating the network weights is presented, and the stability analysis is also drawn. Finally, simulation results show that HTNN identification approach demonstrated identification performances.
Directory of Open Access Journals (Sweden)
R. Murugadoss
2014-10-01
Full Text Available Neural networks are modeled on the way the human brain. They are capable of learning and can automatically recognize by skillfully training and design complex relationships and hidden dependencies based on historical example patterns and use this information for forecasting. The main difference, and at the same time is biggest advantage of the model of neural networks over statistical techniques seen that the forecaster the exact functional structure between input and Output variables need not be specified, but this by the system with certain Learning algorithms is "learned" using a kind of threshold logic. Goal of the learning procedure is to define the training phase while those parameters of the network, with Help the network has one of those adequate for the problem behavior. Mathematically, the training phase is an iterative, converging towards a minimum error value process. They identify the processors of the network, minimize the "total error". The currently the most popular and most widely for business applications algorithm is the backpropagation algorithm. This paper opens the black box of Backpropagation networks and makes the optimization process in the network over time and locally comprehensible.
Circuit Design of On-Chip BP Learning Neural Network with Programmable Neuron Characteristics
Institute of Scientific and Technical Information of China (English)
卢纯; 石秉学; 陈卢
2000-01-01
A circuit system of on chip BP(Back-Propagation) learning neural network with pro grammable neurons has been designed,which comprises a feedforward network,an error backpropagation network and a weight updating circuit. It has the merits of simplicity,programmability, speedness,low power-consumption and high density. A novel neuron circuit with pro grammable parameters has been proposed. It generates not only the sigmoidal function but also its derivative. HSPICE simulations are done to a neuron circuit with level 47 transistor models as a standard 1.2tμm CMOS process. The results show that both functions are matched with their respec ive ideal functions very well. The non-linear partition problem is used to verify the operation of the network. The simulation result shows the superior performance of this BP neural network with on-chip learning.
Static and Transient Performance Prediction for CFB Boilers Using a Bayesian—Gaussian Neural Network
Institute of Scientific and Technical Information of China (English)
HaiwenYe; WeidouNi
1997-01-01
A bayesian-Gaussian Neural Network(BGNN)is put forward in this paper to predict the static and transient performance of Circulating Fluidized Bed(CFB) boilers.The advantages of this network over Back-Propagation Neural Networks(BPNNs),easier determination of topology,simpler and time saving in training process as well as self-organizing bility,make this network more practical in on-line performance prediction for complicatied processes,Simulation shows that this network is comparable to the BPNNs in predicting the performance of CFB boilers.Good and practical on-line performance predictions are essential for operation guide and model predictive control of CFB boilers,which are under research by the authors.
Neural Network based Consumption Forecasting
DEFF Research Database (Denmark)
Madsen, Per Printz
2016-01-01
This paper describe a Neural Network based method for consumption forecasting. This work has been financed by the The ENCOURAGE project. The aims of The ENCOURAGE project is to develop embedded intelligence and integration technologies that will directly optimize energy use in buildings and enable...
Artificial neural networks in medicine
Energy Technology Data Exchange (ETDEWEB)
Keller, P.E.
1994-07-01
This Technology Brief provides an overview of artificial neural networks (ANN). A definition and explanation of an ANN is given and situations in which an ANN is used are described. ANN applications to medicine specifically are then explored and the areas in which it is currently being used are discussed. Included are medical diagnostic aides, biochemical analysis, medical image analysis and drug development.
Medical Imaging with Neural Networks
International Nuclear Information System (INIS)
The objective of this paper is to provide an overview of the recent developments in the use of artificial neural networks in medical imaging. The areas of medical imaging that are covered include : ultrasound, magnetic resonance, nuclear medicine and radiological (including computerized tomography). (authors)
Aphasia Classification Using Neural Networks
DEFF Research Database (Denmark)
Axer, H.; Jantzen, Jan; Berks, G.;
2000-01-01
A web-based software model (http://fuzzy.iau.dtu.dk/aphasia.nsf) was developed as an example for classification of aphasia using neural networks. Two multilayer perceptrons were used to classify the type of aphasia (Broca, Wernicke, anomic, global) according to the results in some subtests...
Model Of Neural Network With Creative Dynamics
Zak, Michail; Barhen, Jacob
1993-01-01
Paper presents analysis of mathematical model of one-neuron/one-synapse neural network featuring coupled activation and learning dynamics and parametrical periodic excitation. Demonstrates self-programming, partly random behavior of suitable designed neural network; believed to be related to spontaneity and creativity of biological neural networks.
Analysis of Neural Networks through Base Functions
Zwaag, van der B.J.; Slump, C.H.; Spaanenburg, L.
2002-01-01
Problem statement. Despite their success-story, neural networks have one major disadvantage compared to other techniques: the inability to explain comprehensively how a trained neural network reaches its output; neural networks are not only (incorrectly) seen as a "magic tool" but possibly even more
Simplified LQG Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1997-01-01
A new neural network application for non-linear state control is described. One neural network is modelled to form a Kalmann predictor and trained to act as an optimal state observer for a non-linear process. Another neural network is modelled to form a state controller and trained to produce...
Crop Classification by Forward Neural Network with Adaptive Chaotic Particle Swarm Optimization
Directory of Open Access Journals (Sweden)
Yudong Zhang
2011-05-01
Full Text Available This paper proposes a hybrid crop classifier for polarimetric synthetic aperture radar (SAR images. The feature sets consisted of span image, the H/A/α decomposition, and the gray-level co-occurrence matrix (GLCM based texture features. Then, the features were reduced by principle component analysis (PCA. Finally, a two-hidden-layer forward neural network (NN was constructed and trained by adaptive chaotic particle swarm optimization (ACPSO. K-fold cross validation was employed to enhance generation. The experimental results on Flevoland sites demonstrate the superiority of ACPSO to back-propagation (BP, adaptive BP (ABP, momentum BP (MBP, Particle Swarm Optimization (PSO, and Resilient back-propagation (RPROP methods. Moreover, the computation time for each pixel is only 1.08 × 10−7 s.
Energy Technology Data Exchange (ETDEWEB)
Baptista Filho, Benedito Dias [Instituto de Pesquisas Energeticas e Nucleares (IPEN), Sao Paulo, SP (Brazil)
2002-07-01
Artificial Neural Networks (ANN) can be defined as 'parallel systems composed of layers of simple processing units highly interconnected and inspired in the human brain.' ANN can be used to solve problems of difficult modeling, when the data are fail or incomplete and in problems of control of high complexity. Several problems related with network training and generalization are to be solved to a safe utilization in nuclear plants systems. This work, divided into two parts, intends to begin a discussion on three ANN concepts: feed-forward neural networks, Self-Organized Maps (SOM), and multi-synaptic neural networks. The discussion will cover control applications, approximation of functions and pattern recognition. A few set of samples are commented. This first part focus on feed-forward neural networks with the back-propagation algorithm. (author)
Julio Rojas Naccha; Víctor Vásquez Villalobos
2012-01-01
The predictive ability of Artificial Neural Network (ANN) on the effect of the concentration (30, 40, 50 y 60 % w/w) and temperature (30, 40 y 50°C) of fructooligosaccharides solution, in the mass, moisture, volume and solids of osmodehydrated yacon cubes, and in the coefficients of the water means effective diffusivity with and without shrinkage was evaluated. The Feedforward type ANN with the Backpropagation training algorithms and the Levenberg-Marquardt weight adjustment was applied, usin...
Jianbin Hao; Banqiao Wang
2014-01-01
Based on the back-propagation algorithm of artificial neural networks (ANNs), this paper establishes an intelligent model, which is used to predict the maximum lateral displacement of composite soil-nailed wall. Some parameters, such as soil cohesive strength, soil friction angle, prestress of anchor cable, soil-nail spacing, soil-nail diameter, soil-nail length, and other factors, are considered in the model. Combined with the in situ test data of composite soil-nail wall reinforcement engi...
Neural Networks and Photometric Redshifts
Tagliaferri, R; Andreon, S; Capozziello, S; Donalek, C; Giordano, G; Tagliaferri, Roberto; Longo, Giuseppe; Andreon, Stefano; Capozziello, Salvatore; Donalek, Ciro; Giordano, Gerardo
2002-01-01
We present a neural network based approach to the determination of photometric redshift. The method was tested on the Sloan Digital Sky Survey Early Data Release (SDSS-EDR) reaching an accuracy comparable and, in some cases, better than SED template fitting techniques. Different neural networks architecture have been tested and the combination of a Multi Layer Perceptron with 1 hidden layer (22 neurons) operated in a Bayesian framework, with a Self Organizing Map used to estimate the accuracy of the results, turned out to be the most effective. In the best experiment, the implemented network reached an accuracy of 0.020 (interquartile error) in the range 0
Gap Filling of Daily Sea Levels by Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Lyubka Pashova
2013-06-01
Full Text Available In the recent years, intelligent methods as artificial neural networks are successfully applied for data analysis from different fields of the geosciences. One of the encountered practical problems is the availability of gaps in the time series that prevent their comprehensive usage for the scientific and practical purposes. The article briefly describes two types of the artificial neural network (ANN architectures - Feed-Forward Backpropagation (FFBP and recurrent Echo state network (ESN. In some cases, the ANN can be used as an alternative on the traditional methods, to fill in missing values in the time series. We have been conducted several experiments to fill the missing values of daily sea levels spanning a 5-years period using both ANN architectures. A multiple linear regression for the same purpose has been also applied. The sea level data are derived from the records of the tide gauge Burgas, which is located on the western Black Sea coast. The achieved results have shown that the performance of ANN models is better than that of the classical one and they are very promising for the real-time interpolation of missing data in the time series.
A comparison of two neural network schemes for navigation
Munro, Paul
1990-01-01
Neural networks have been applied to tasks in several areas of artificial intelligence, including vision, speech, and language. Relatively little work has been done in the area of problem solving. Two approaches to path-finding are presented, both using neural network techniques. Both techniques require a training period. Training under the back propagation (BPL) method was accomplished by presenting representations of current position, goal position pairs as input and appropriate actions as output. The Hebbian/interactive activation (HIA) method uses the Hebbian rule to associate points that are nearby. A path to a goal is found by activating a representation of the goal in the network and processing until the current position is activated above some threshold level. BPL, using back-propagation learning, failed to learn, except in a very trivial fashion, that is equivalent to table lookup techniques. HIA, performed much better, and required storage of fewer weights. In drawing a comparison, it is important to note that back propagation techniques depend critically upon the forms of representation used, and can be sensitive to parameters in the simulations; hence the BPL technique may yet yield strong results.
Institute of Scientific and Technical Information of China (English)
无
2008-01-01
Since the complexity and structural diversity of man-made compounds are considered,quantitative structure-activity relationships(QSARs)-based fast screening approaches are urgently needed for the assessment of the potential risk of endocrine disrupting chemicals(EDCs).The artificial neural networks(ANN)are capable of recognizing highly nonlinear relationships,so it will have a bright application prospect in building high-quality QSAR models.As a popular supervised training algorithm in ANN,back-propagation(BP)converges slowly and immerses in vibration frequently.In this paper,a research strategy that BP neural network was improved by conjugate gradient(CG)algorithm with a variable selection method based on genetic algorithm was applied to investigate the QSAR of EDCs.This resulted in a robust and highly predictive ANN model with R2 of 0.845 for the training set,q2 pred of 0.81 and root-mean-square error(RMSE) of 0.688 for the test set.The result shows that our method can provide a feasible and practical tool for the rapid screening of the estrogen activity of organic compounds.
SKYNET: an efficient and robust neural network training tool for machine learning in astronomy
Graff, Philip; Hobson, Michael P; Lasenby, Anthony N
2013-01-01
We present the first public release of our generic neural network training algorithm, called SKYNET. This efficient and robust machine-learning tool is able to train large and deep feed-forward neural networks, including autoencoders, for use in a wide range of supervised and unsupervised learning applications, such as regression, classification, density estimation, clustering and dimensionality reduction. SKYNET uses a powerful 'pre-training' method, to obtain a set of network parameters close to the true global maximum of the training objective function, followed by further optimisation using an automatically-regularised variant of Newton's method; the latter uses second-order derivative information to improve convergence, but without the need to evaluate or store the full Hessian matrix, by using a fast approximate method to calculate Hessian-vector products. This combination of methods allows for the training of complicated networks that are difficult to optimise using standard backpropagation techniques....
Application of BP neural networks in non-linearity correction of optical tweezers
Institute of Scientific and Technical Information of China (English)
Ziqiang WANG; Yinmei LI; Liren LOU; Henghua WEI; Zhong WANG
2008-01-01
The back-propagation (BP) neural network is proposed to correct nonlinearity and optimize the force measurement and calibration of an optical tweezer sys-tem. Considering the low convergence rate of the BP algo-rithm, the Levenberg-Marquardt (LM) algorithm is used to improve the BP network. The proposed method is experimentally studied for force calibration in a typical optical tweezer system using hydromechanics. The result shows that with the nonlinear correction using BP net-works, the range of force measurement of an optical tweezer system is enlarged by 30% and the precision is also improved compared with the polynomial fitting method. It is demonstrated that nonlinear correction by the neural network method effectively improves the per-formance of optical tweezers without adding or changing the measuring system.
Photon spectrometry utilizing neural networks
International Nuclear Information System (INIS)
Having in mind the time spent on the uneventful work of characterization of the radiation beams used in a ionizing radiation metrology laboratory, the Metrology Service of the Centro Regional de Ciencias Nucleares do Nordeste - CRCN-NE verified the applicability of artificial intelligence (artificial neural networks) to perform the spectrometry in photon fields. For this, was developed a multilayer neural network, as an application for the classification of patterns in energy, associated with a thermoluminescent dosimetric system (TLD-700 and TLD-600). A set of dosimeters was initially exposed to various well known medium energies, between 40 keV and 1.2 MeV, coinciding with the beams determined by ISO 4037 standard, for the dose of 10 mSv in the quantity Hp(10), on a chest phantom (ISO slab phantom) with the purpose of generating a set of training data for the neural network. Subsequently, a new set of dosimeters irradiated in unknown energies was presented to the network with the purpose to test the method. The methodology used in this work was suitable for application in the classification of energy beams, having obtained 100% of the classification performed. (authors)
Customer Credit Risk Assessment using Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Nasser Mohammadi
2016-03-01
Full Text Available Since the granting of banking facilities in recent years has faced problems such as customer credit risk and affects the profitability directly, customer credit risk assessment has become imperative for banks and it is used to distinguish good applicants from those who will probably default on repayments. In credit risk assessment, a score is assigned to each customer then by comparing it with the cut-off point score which distinguishes two classes of the applicants, customers are classified into two credit statuses either a good or bad applicant. Regarding good performance and their ability of classification, generalization and learning patterns, Multilayer Perceptron Neural Network model trained using various Back-Propagation (BP algorithms considered in designing an evaluation model in this study. The BP algorithms, Levenberg-Marquardt (LM, Gradient descent, Conjugate gradient, Resilient, BFGS Quasinewton, and One-step secant were utilized. Each of these six networks runs and trains for different numbers of neurons within their hidden layer. Mean squared error (MSE is used as a criterion to specify optimum number of neurons in the hidden layer. The results showed that LM algorithm converges faster to the network and achieves better performance than the other algorithms. At last, by comparing classification performance of neural network with a number of classification algorithms such as Logistic Regression and Decision Tree, the neural network model outperformed the others in customer credit risk assessment. In credit models, because the cost that Type II error rate imposes to the model is too high, therefore, Receiver Operating Characteristic curve is used to find appropriate cut-off point for a model that in addition to high Accuracy, has lower Type II error rate.
Fuzzy logic systems are equivalent to feedforward neural networks
Institute of Scientific and Technical Information of China (English)
李洪兴
2000-01-01
Fuzzy logic systems and feedforward neural networks are equivalent in essence. First, interpolation representations of fuzzy logic systems are introduced and several important conclusions are given. Then three important kinds of neural networks are defined, i.e. linear neural networks, rectangle wave neural networks and nonlinear neural networks. Then it is proved that nonlinear neural networks can be represented by rectangle wave neural networks. Based on the results mentioned above, the equivalence between fuzzy logic systems and feedforward neural networks is proved, which will be very useful for theoretical research or applications on fuzzy logic systems or neural networks by means of combining fuzzy logic systems with neural networks.
Ghosh, Arka
2011-01-01
Financial forecasting is an example of a signal processing problem which is challenging due to Small sample sizes, high noise, non-stationarity, and non-linearity,but fast forecasting of stock market price is very important for strategic business planning.Present study is aimed to develop a comparative predictive model with Feedforward Multilayer Artificial Neural Network & Recurrent Time Delay Neural Network for the Financial Timeseries Prediction.This study is developed with the help of historical stockprice dataset made available by GoogleFinance.To develop this prediction model Backpropagation method with Gradient Descent learning has been implemented.Finally the Neural Net, learned with said algorithm is found to be skillful predictor for non-stationary noisy Financial Timeseries.
Kan, P; Chen, W K; Lee, C J
1996-03-01
Hemoglobin-based artificial blood substitutes as oxygen carrier is advantageous over current plasma expander. In this study, oxygen saturation of hemoglobin solution, red blood cell suspension and artificial blood substitute under various conditions were measured by yeast-consuming-oxygen experiments instead of spectrophotometer. The empirical results were assigned into training feedforward back-propagation neural network system in order to simulate the oxygen saturation model modulated by those factors such as pH, [Cl-], [2,3-DPG], pO2 and pCO2. Consequently, this neural network is able to simulate accurately the oxygen saturation of Hb solution. The prediction of hemosome is not agreed well possible because of the resistance of transport of oxygen. However, the results showed neural net can offer a simple and convenient way in comparison with the conventional methods, especially in dealing with complex and ambiguous problem.
Neural networks for feedback feedforward nonlinear control systems.
Parisini, T; Zoppoli, R
1994-01-01
This paper deals with the problem of designing feedback feedforward control strategies to drive the state of a dynamic system (in general, nonlinear) so as to track any desired trajectory joining the points of given compact sets, while minimizing a certain cost function (in general, nonquadratic). Due to the generality of the problem, conventional methods are difficult to apply. Thus, an approximate solution is sought by constraining control strategies to take on the structure of multilayer feedforward neural networks. After discussing the approximation properties of neural control strategies, a particular neural architecture is presented, which is based on what has been called the "linear-structure preserving principle". The original functional problem is then reduced to a nonlinear programming one, and backpropagation is applied to derive the optimal values of the synaptic weights. Recursive equations to compute the gradient components are presented, which generalize the classical adjoint system equations of N-stage optimal control theory. Simulation results related to nonlinear nonquadratic problems show the effectiveness of the proposed method. PMID:18267810
Laidi, Maamar; Hanini, Salah; Rezrazi, Ahmed; Yaiche, Mohamed Redha; El Hadj, Abdallah Abdallah; Chellali, Farouk
2016-01-01
In this study, a backpropagation artificial neural network (BP-ANN) model is used as an alternative approach to predict solar radiation on tilted surfaces (SRT) using a number of variables involved in physical process. These variables are namely the latitude of the site, mean temperature and relative humidity, Linke turbidity factor and Angstrom coefficient, extraterrestrial solar radiation, solar radiation data measured on horizontal surfaces (SRH), and solar zenith angle. Experimental solar radiation data from 13 stations spread all over Algeria around the year (2004) were used for training/validation and testing the artificial neural networks (ANNs), and one station was used to make the interpolation of the designed ANN. The ANN model was trained, validated, and tested using 60, 20, and 20 % of all data, respectively. The configuration 8-35-1 (8 inputs, 35 hidden, and 1 output neurons) presented an excellent agreement between the prediction and the experimental data during the test stage with determination coefficient of 0.99 and root meat squared error of 5.75 Wh/m2, considering a three-layer feedforward backpropagation neural network with Levenberg-Marquardt training algorithm, a hyperbolic tangent sigmoid and linear transfer function at the hidden and the output layer, respectively. This novel model could be used by researchers or scientists to design high-efficiency solar devices that are usually tilted at an optimum angle to increase the solar incident on the surface.
Optimizing the De-Noise Neural Network Model for GPS Time-Series Monitoring of Structures
Directory of Open Access Journals (Sweden)
Mosbeh R. Kaloop
2015-09-01
Full Text Available The Global Positioning System (GPS is recently used widely in structures and other applications. Notwithstanding, the GPS accuracy still suffers from the errors afflicting the measurements, particularly the short-period displacement of structural components. Previously, the multi filter method is utilized to remove the displacement errors. This paper aims at using a novel application for the neural network prediction models to improve the GPS monitoring time series data. Four prediction models for the learning algorithms are applied and used with neural network solutions: back-propagation, Cascade-forward back-propagation, adaptive filter and extended Kalman filter, to estimate which model can be recommended. The noise simulation and bridge’s short-period GPS of the monitoring displacement component of one Hz sampling frequency are used to validate the four models and the previous method. The results show that the Adaptive neural networks filter is suggested for de-noising the observations, specifically for the GPS displacement components of structures. Also, this model is expected to have significant influence on the design of structures in the low frequency responses and measurements’ contents.
Neural Networks Methodology and Applications
Dreyfus, Gérard
2005-01-01
Neural networks represent a powerful data processing technique that has reached maturity and broad application. When clearly understood and appropriately used, they are a mandatory component in the toolbox of any engineer who wants make the best use of the available data, in order to build models, make predictions, mine data, recognize shapes or signals, etc. Ranging from theoretical foundations to real-life applications, this book is intended to provide engineers and researchers with clear methodologies for taking advantage of neural networks in industrial, financial or banking applications, many instances of which are presented in the book. For the benefit of readers wishing to gain deeper knowledge of the topics, the book features appendices that provide theoretical details for greater insight, and algorithmic details for efficient programming and implementation. The chapters have been written by experts ands seemlessly edited to present a coherent and comprehensive, yet not redundant, practically-oriented...
Learning with heterogeneous neural networks
Belanche Muñoz, Luis Antonio
2011-01-01
This chapter studies a class of neuron models that computes a user-defined similarity function between inputs and weights. The neuron transfer function is formed by composition of an adapted logistic function with the quasi-linear mean of the partial input-weight similarities. The neuron model is capable of dealing directly with mixtures of continuous as well as discrete quantities, among other data types and there is provision for missing values. An artificial neural network using these n...
Process Neural Networks Theory and Applications
He, Xingui
2010-01-01
"Process Neural Networks - Theory and Applications" proposes the concept and model of a process neural network for the first time, showing how it expands the mapping relationship between the input and output of traditional neural networks, and enhancing the expression capability for practical problems, with broad applicability to solving problems relating to process in practice. Some theoretical problems such as continuity, functional approximation capability, and computing capability, are strictly proved. The application methods, network construction principles, and optimization alg
The LILARTI neural network system
Energy Technology Data Exchange (ETDEWEB)
Allen, J.D. Jr.; Schell, F.M.; Dodd, C.V.
1992-10-01
The material of this Technical Memorandum is intended to provide the reader with conceptual and technical background information on the LILARTI neural network system of detail sufficient to confer an understanding of the LILARTI method as it is presently allied and to facilitate application of the method to problems beyond the scope of this document. Of particular importance in this regard are the descriptive sections and the Appendices which include operating instructions, partial listings of program output and data files, and network construction information.
Stellar Image Interpretation System Using Artificial Neural Networks:
Directory of Open Access Journals (Sweden)
A. El-Bassuny Alawy
2004-01-01
Full Text Available A supervised Artificial Neural Network (ANN based system is being developed employing the Bi-polar function for identifying stellar images in CCD frames. It is based on feed-forward artificial neural networks with error back-propagation learning. It has been coded in C language. The learning process was performed on a 341 input pattern set, while a similar set was used for testing. The present approach has been applied on a CCD frame of the open star cluster M67. The results obtained have been discussed and compared with those derived in our previous work employing the Uni-polar function and by a package known in the astronomical community (DAOPHOT-II. Full agreement was found between the present approach, that of Elnagahy et al, and the standard astronomical data for the cluster. It has been shown that the developed technique resembles that of the Uni-Polar function, possessing a simple, much faster yet reliable approach. Moreover, neither prior knowledge on, nor initial data from, the frame to be analysed is required, as it is for DAOPHOT-II.
SELECTING NEURAL NETWORK ARCHITECTURE FOR INVESTMENT PROFITABILITY PREDICTIONS
Directory of Open Access Journals (Sweden)
Marijana Zekić-Sušac
2012-07-01
Full Text Available After production and operations, finance and investments are one of the mostfrequent areas of neural network applications in business. The lack of standardizedparadigms that can determine the efficiency of certain NN architectures in a particularproblem domain is still present. The selection of NN architecture needs to take intoconsideration the type of the problem, the nature of the data in the model, as well as somestrategies based on result comparison. The paper describes previous research in that areaand suggests a forward strategy for selecting best NN algorithm and structure. Since thestrategy includes both parameter-based and variable-based testings, it can be used forselecting NN architectures as well as for extracting models. The backpropagation, radialbasis,modular, LVQ and probabilistic neural network algorithms were used on twoindependent sets: stock market and credit scoring data. The results show that neuralnetworks give better accuracy comparing to multiple regression and logistic regressionmodels. Since it is model-independant, the strategy can be used by researchers andprofessionals in other areas of application.
Hybrid digital signal processing and neural networks for automated diagnostics using NDE methods
Energy Technology Data Exchange (ETDEWEB)
Upadhyaya, B.R.; Yan, W. [Tennessee Univ., Knoxville, TN (United States). Dept. of Nuclear Engineering
1993-11-01
The primary purpose of the current research was to develop an integrated approach by combining information compression methods and artificial neural networks for the monitoring of plant components using nondestructive examination data. Specifically, data from eddy current inspection of heat exchanger tubing were utilized to evaluate this technology. The focus of the research was to develop and test various data compression methods (for eddy current data) and the performance of different neural network paradigms for defect classification and defect parameter estimation. Feedforward, fully-connected neural networks, that use the back-propagation algorithm for network training, were implemented for defect classification and defect parameter estimation using a modular network architecture. A large eddy current tube inspection database was acquired from the Metals and Ceramics Division of ORNL. These data were used to study the performance of artificial neural networks for defect type classification and for estimating defect parameters. A PC-based data preprocessing and display program was also developed as part of an expert system for data management and decision making. The results of the analysis showed that for effective (low-error) defect classification and estimation of parameters, it is necessary to identify proper feature vectors using different data representation methods. The integration of data compression and artificial neural networks for information processing was established as an effective technique for automation of diagnostics using nondestructive examination methods.
Directory of Open Access Journals (Sweden)
Golmohammadi Hassan
2013-01-01
Full Text Available A quantitative structure-property relationship (QSPR study based on partial least squares (PLS and artificial neural network (ANN was developed for the prediction of ferric iron precipitation in bioleaching process. The leaching temperature, initial pH, oxidation/reduction potential (ORP, ferrous concentration and particle size of ore were used as inputs to the network. The output of the model was ferric iron precipitation. The optimal condition of the neural network was obtained by adjusting various parameters by trial-and-error. After optimization and training of the network according to back-propagation algorithm, a 5-5-1 neural network was generated for prediction of ferric iron precipitation. The root mean square error for the neural network calculated ferric iron precipitation for training, prediction and validation set are 32.860, 40.739 and 35.890, respectively, which are smaller than those obtained by PLS model (180.972, 165.047 and 149.950, respectively. Results obtained reveal the reliability and good predictivity of neural network model for the prediction of ferric iron precipitation in bioleaching process.
Hybrid digital signal processing and neural networks for automated diagnostics using NDE methods
International Nuclear Information System (INIS)
The primary purpose of the current research was to develop an integrated approach by combining information compression methods and artificial neural networks for the monitoring of plant components using nondestructive examination data. Specifically, data from eddy current inspection of heat exchanger tubing were utilized to evaluate this technology. The focus of the research was to develop and test various data compression methods (for eddy current data) and the performance of different neural network paradigms for defect classification and defect parameter estimation. Feedforward, fully-connected neural networks, that use the back-propagation algorithm for network training, were implemented for defect classification and defect parameter estimation using a modular network architecture. A large eddy current tube inspection database was acquired from the Metals and Ceramics Division of ORNL. These data were used to study the performance of artificial neural networks for defect type classification and for estimating defect parameters. A PC-based data preprocessing and display program was also developed as part of an expert system for data management and decision making. The results of the analysis showed that for effective (low-error) defect classification and estimation of parameters, it is necessary to identify proper feature vectors using different data representation methods. The integration of data compression and artificial neural networks for information processing was established as an effective technique for automation of diagnostics using nondestructive examination methods
Practical neural network recipies in C++
Masters
2014-01-01
This text serves as a cookbook for neural network solutions to practical problems using C++. It will enable those with moderate programming experience to select a neural network model appropriate to solving a particular problem, and to produce a working program implementing that network. The book provides guidance along the entire problem-solving path, including designing the training set, preprocessing variables, training and validating the network, and evaluating its performance. Though the book is not intended as a general course in neural networks, no background in neural works is assum
Artificial Neural Network Model for Predicting Ultimate Tensile Capacity of Adhesive Anchors
Institute of Scientific and Technical Information of China (English)
XU Bo; WU Zhi-min; SONG Zhi-fei
2007-01-01
To predict the tensile capacity of adhesive anchors, a multilayered feed-forward neural network trained with the backpropagation algorithm is constructed. The ANN model have 5 inputs, including the compressive strength of concrete, tensile strength of concrete, anchor diameter, hole diameter, embedment of anchors, and ultimate load. The predictions obtained from the trained ANN show a good agreement with the experiments. Meanwhile, the predicted ultinate tensile capacity of anchors is close to the one calculated from the strength formula of the combined cone-bond failure model.
A Neural Network Based Recognition and Classification of Commonly Used Indian Non Leafy Vegetables
Directory of Open Access Journals (Sweden)
Ajit Danti
2014-09-01
Full Text Available A methodology to characterize the commonly used Indian non-leafy vegetables’ images is developed. From the captured images of Indian non-leafy vegetables, color components, namely, RGB and HSV features are extracted, analyzed and classified. A feed forward backpropagation artificial neural network (BPNN is used for the classification. The results show that it has good robustness and a very high success rate in the range of 96-100% for eight types of vegetables. The work finds usefulness in developing recognition system for super market, automatic vending, packing and grading of vegetables, food preparation and Agriculture Produce Market Committee (APMC.
ANOMALY INTRUSION DETECTION DESIGN USING HYBRID OF UNSUPERVISED AND SUPERVISED NEURAL NETWORK
Directory of Open Access Journals (Sweden)
M. Bahrololum
2009-07-01
Full Text Available This paper proposed a new approach to design the system using a hybrid of misuse and anomalydetection for training of normal and attack packets respectively. The utilized method for attack training isthe combination of unsupervised and supervised Neural Network (NN for Intrusion Detection System. Bythe unsupervised NN based on Self Organizing Map (SOM, attacks will be classified into smallercategories considering their similar features, and then unsupervised NN based on Backpropagation willbe used for clustering. By misuse approach known packets would be identified fast and unknown attackswill be able to detect by this method.
A BOD-DO coupling model for water quality simulation by artificial neural network
Institute of Scientific and Technical Information of China (English)
郭劲松; LONG; Tengrui; 等
2002-01-01
A one-dimensional BOD-DO coupling model for water quality simulation is presented,which adopts Streeter-Phelps equations and the theory of back-propagation artificial neural network.The water quality data of Yangtze River in the Chongqing region in the year of 1989 are divided into 5 groups and used in the learning and testing courses of this model.The result shows that such model is feasible for water quality simulation and is more accurate than traditional models.
Directory of Open Access Journals (Sweden)
Oliveira-Esquerre K.P.
2002-01-01
Full Text Available This work presents a way to predict the biochemical oxygen demand (BOD of the output stream of the biological wastewater treatment plant at RIPASA S/A Celulose e Papel, one of the major pulp and paper plants in Brazil. The best prediction performance is achieved when the data are preprocessed using principal components analysis (PCA before they are fed to a backpropagated neural network. The influence of input variables is analyzed and satisfactory prediction results are obtained for an optimized situation.
International Nuclear Information System (INIS)
The artificial neural network technique was used to identify drugs and plastic explosives, from a tomography composed by a set of six neutrongraphic projections obtained in real time. Bidimensional tomographic images of samples of drugs, explosives and other materials, when digitally processed, yield the characteristic spectra of each type of material. The information contained in those spectra was then used for ANN training, the best images being obtained when the multilayer perceptron model, the back-propagation training algorithm and the Cross-validation interruption criterion were used. ANN showed to be useful in forecasting presence of drugs and explosives hitting a rate of success above 97 %. (author)
Neural Network Based on Quantum Chemistry for Predicting Melting Point of Organic Compounds
Institute of Scientific and Technical Information of China (English)
Juan A. Lazzús
2009-01-01
The melting points of organic compounds were estimated using a combined method that includes a backpropagation neural network and quantitative structure property relationship (QSPR) parameters in quantum chemistry. Eleven descriptors that reflect the intermolec-ular forces and molecular symmetry were used as input variables. QSPR parameters were calculated using molecular modeling and PM3 semi-empirical molecular orbital theories. A total of 260 compounds were used to train the network, which was developed using MatLab. Then, the melting points of 73 other compounds were predicted and results were compared to experimental data from the literature. The study shows that the chosen artificial neural network and the quantitative structure property relationships method present an excellent alternative for the estimation of the melting point of an organic compound, with average absolute deviation of 5%.
Damage assessment in structure from changes in static parameter using neural networks
Indian Academy of Sciences (India)
Damodar Maity; Asish Saha
2004-06-01
Damage to structures may occur as a result of normal operations, accidents, deterioration or severe natural events such as earthquakes and storms. Most often the extent and location of damage may be determined through visual inspection. However, in some cases this may not be feasible. The basic strategy applied in this study is to train a neural network to recognize the behaviour of the undamaged structure as well as of the structure with various possible damaged states. When this trained network is subjected to the measured response, it should be able to detect any existing damage. This idea is applied on a simple cantilever beam. Strain and displacement are used as possible candidates for damage identiﬁcation by a back-propagation neural network. The superiority of strain over displacement for identiﬁcation of damage has been observed in this study.
Neural network modeling of emotion
Levine, Daniel S.
2007-03-01
This article reviews the history and development of computational neural network modeling of cognitive and behavioral processes that involve emotion. The exposition starts with models of classical conditioning dating from the early 1970s. Then it proceeds toward models of interactions between emotion and attention. Then models of emotional influences on decision making are reviewed, including some speculative (not and not yet simulated) models of the evolution of decision rules. Through the late 1980s, the neural networks developed to model emotional processes were mainly embodiments of significant functional principles motivated by psychological data. In the last two decades, network models of these processes have become much more detailed in their incorporation of known physiological properties of specific brain regions, while preserving many of the psychological principles from the earlier models. Most network models of emotional processes so far have dealt with positive and negative emotion in general, rather than specific emotions such as fear, joy, sadness, and anger. But a later section of this article reviews a few models relevant to specific emotions: one family of models of auditory fear conditioning in rats, and one model of induced pleasure enhancing creativity in humans. Then models of emotional disorders are reviewed. The article concludes with philosophical statements about the essential contributions of emotion to intelligent behavior and the importance of quantitative theories and models to the interdisciplinary enterprise of understanding the interactions of emotion, cognition, and behavior.
Prediction of geomagnetic storms from solar wind data with the use of a neural network
Directory of Open Access Journals (Sweden)
H. Lundstedt
Full Text Available An artificial feed-forward neural network with one hidden layer and error back-propagation learning is used to predict the geomagnetic activity index (D_{st} one hour in advance. The B_{z}-component and Σ_{Bz}, the density, and the velocity of the solar wind are used as input to the network. The network is trained on data covering a total of 8700 h, extracted from the 25-year period from 1963 to 1987, taken from the NSSDC data base. The performance of the network is examined with test data, not included in the training set, which covers 386 h and includes four different storms. Whilst the network predicts the initial and main phase well, the recovery phase is not modelled correctly, implying that a single hidden layer error back-propagation network is not enough, if the measured D_{st} is not available instantaneously. The performance of the network is independent of whether the raw parameters are used, or the electric field and square root of the dynamical pressure.
Schreiner, John N.
This thesis proposes a method of performing fault detection and isolation in spacecraft attitude determination and control systems. The proposed method works by deploying a trained neural network to analyze a set of residuals that are defined such that they encompass the attitude control, guidance, and attitude determination subsystems. Eight neural networks were trained using either the resilient backpropagation, Levenberg-Marquardt, or Levenberg-Marquardt with Bayesian regularization training algorithms. The results of each of the neural networks were analyzed to determine the accuracy of the networks with respect to isolating the faulty component or faulty subsystem within the ADCS. The performance of the proposed neural network-based fault detection and isolation method was compared and contrasted with other ADCS FDI methods. The results obtained via simulation showed that the best neural networks employing this method successfully detected the presence of a fault 79% of the time. The faulty subsystem was successfully isolated 75% of the time and the faulty components within the faulty subsystem were isolated 37% of the time.
Energy Technology Data Exchange (ETDEWEB)
Zio, Enrico; Pedroni, Nicola; Broggi, Matteo; Golea, Lucia Roxana [Polytechnic of Milan, Milan (Italy)
2009-12-15
In this paper, an infinite impulse response locally recurrent neural network (IIR-LRNN) is employed for modelling the dynamics of the Lead Bismuth Eutectic eXperimental Accelerator Driven System (LBE-XADS). The network is trained by recursive back-propagation (RBP) and its ability in estimating transients is tested under various conditions. The results demonstrate the robustness of the locally recurrent scheme in the reconstruction of complex nonlinear dynamic relationships
Neural networks and MIMD-multiprocessors
Vanhala, Jukka; Kaski, Kimmo
1990-01-01
Two artificial neural network models are compared. They are the Hopfield Neural Network Model and the Sparse Distributed Memory model. Distributed algorithms for both of them are designed and implemented. The run time characteristics of the algorithms are analyzed theoretically and tested in practice. The storage capacities of the networks are compared. Implementations are done using a distributed multiprocessor system.
Neural-Network Computer Transforms Coordinates
Josin, Gary M.
1990-01-01
Numerical simulation demonstrated ability of conceptual neural-network computer to generalize what it has "learned" from few examples. Ability to generalize achieved with even simple neural network (relatively few neurons) and after exposure of network to only few "training" examples. Ability to obtain fairly accurate mappings after only few training examples used to provide solutions to otherwise intractable mapping problems.
Salience-Affected Neural Networks
Remmelzwaal, Leendert A; Ellis, George F R
2010-01-01
We present a simple neural network model which combines a locally-connected feedforward structure, as is traditionally used to model inter-neuron connectivity, with a layer of undifferentiated connections which model the diffuse projections from the human limbic system to the cortex. This new layer makes it possible to model global effects such as salience, at the same time as the local network processes task-specific or local information. This simple combination network displays interactions between salience and regular processing which correspond to known effects in the developing brain, such as enhanced learning as a result of heightened affect. The cortex biases neuronal responses to affect both learning and memory, through the use of diffuse projections from the limbic system to the cortex. Standard ANNs do not model this non-local flow of information represented by the ascending systems, which are a significant feature of the structure of the brain, and although they do allow associational learning with...
Forest Fire Smoke Detection Using Back-Propagation Neural Network Based on MODIS Data
Xiaolian Li; Weiguo Song; Liping Lian; Xiaoge Wei
2015-01-01
Satellite remote sensing provides global observations of the Earth’s surface and provides useful information for monitoring smoke plumes emitted from forest fires. The aim of this study is to automatically separate smoke plumes from the background by analyzing the MODIS data. An identification algorithm was improved based on the spectral analysis among the smoke, cloud and underlying surface. In order to get satisfactory results, a multi-threshold method is used for extracting training sampl...
Fast Algorithms for Convolutional Neural Networks
Lavin, Andrew; Gray, Scott
2015-01-01
Deep convolutional neural networks take GPU days of compute time to train on large data sets. Pedestrian detection for self driving cars requires very low latency. Image recognition for mobile phones is constrained by limited processing resources. The success of convolutional neural networks in these situations is limited by how fast we can compute them. Conventional FFT based convolution is fast for large filters, but state of the art convolutional neural networks use small, 3x3 filters. We ...
Adaptive optimization and control using neural networks
Energy Technology Data Exchange (ETDEWEB)
Mead, W.C.; Brown, S.K.; Jones, R.D.; Bowling, P.S.; Barnes, C.W.
1993-10-22
Recent work has demonstrated the ability of neural-network-based controllers to optimize and control machines with complex, non-linear, relatively unknown control spaces. We present a brief overview of neural networks via a taxonomy illustrating some capabilities of different kinds of neural networks. We present some successful control examples, particularly the optimization and control of a small-angle negative ion source.
Sequential optimizing investing strategy with neural networks
Ryo Adachi; Akimichi Takemura
2010-01-01
In this paper we propose an investing strategy based on neural network models combined with ideas from game-theoretic probability of Shafer and Vovk. Our proposed strategy uses parameter values of a neural network with the best performance until the previous round (trading day) for deciding the investment in the current round. We compare performance of our proposed strategy with various strategies including a strategy based on supervised neural network models and show that our procedure is co...
Artificial neural networks in nuclear medicine
International Nuclear Information System (INIS)
An analysis of the accessible literature on the diagnostic applicability of artificial neural networks in coronary artery disease and pulmonary embolism appears to be comparative to the diagnosis of experienced doctors dealing with nuclear medicine. Differences in the employed models of artificial neural networks indicate a constant search for the most optimal parameters, which could guarantee the ultimate accuracy in neural network activity. The diagnostic potential within systems containing artificial neural networks proves this calculation tool to be an independent or/and an additional device for supporting a doctor's diagnosis of artery disease and pulmonary embolism. (author)
Fuzzy neural network theory and application
Liu, Puyin
2004-01-01
This book systematically synthesizes research achievements in the field of fuzzy neural networks in recent years. It also provides a comprehensive presentation of the developments in fuzzy neural networks, with regard to theory as well as their application to system modeling and image restoration. Special emphasis is placed on the fundamental concepts and architecture analysis of fuzzy neural networks. The book is unique in treating all kinds of fuzzy neural networks and their learning algorithms and universal approximations, and employing simulation examples which are carefully designed to he
Application of neural networks in coastal engineering
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.
neural networks, J of computer aided civil and infrastructural engineering, (UK), 13, 113-120. Deo, MC and Naidu, CS (1999) Real time wave forecasting using neural networks, Ocean Engineering, 26, 191-203. Deo, MC, Gondane, DS and Kumar, VS (2002...) An application of artificial neural networks in tide-forecasting. Ocean Engineering, 29, pp 1003-1022 MandaI,S; Subba Rao and Chackraborty, l\\TV (2002) Hindcasting cyclonic waves using neural network. International Conference SHOT 2002, lIT Kharagpur, 18...
Energy Technology Data Exchange (ETDEWEB)
Song Kexing; Xing Jiandong; Dong Qiming; Liu Ping; Tian Baohong; Cao Xianjie
2005-06-15
Internal oxidation is a commercial method for producing oxide dispersion strengthened copper (ODS Cu). In this paper, the dilute Cu-Al alloy powders containing 0.26 wt% of Al have been internally oxidized at temperatures (T) from 700 to 1000 deg. C, for holding times (t) up to 10 h. The alumina particle size has been observed and determined by electron microscopy using the two-stage preshadowed carbon replica method. By the use of backpropagation network, the non-linear relationship between internal oxidation process parameters (T,t) and alumina particle size has been established on the base of dealing with the experimental data. The results show that the well-trained backpropagation neural network can predict the alumina particle size during internal oxidation precisely and the prediction values have sufficiently mined the basic domain knowledge of internal oxidation process. Therefore, a new way of optimizing process parameters has been provided by the authors.
Neural Network for Positioning Space Station Solar Arrays
Graham, Ronald E.; Lin, Paul P.
1994-01-01
As a shuttle approaches the Space Station Freedom for a rendezvous, the shuttle's reaction control jet firings pose a risk of excessive plume impingement loads on Freedom solar arrays. The current solution to this problem, in which the arrays are locked in a feathered position prior to the approach, may be neither accurate nor robust, and is also expensive. An alternative solution is proposed here: the active control of Freedom's beta gimbals during the approach, positioning the arrays dynamically in such a way that they remain feathered relative to the shuttle jet most likely to cause an impingement load. An artificial neural network is proposed as a means of determining the gimbal angles that would drive plume angle of attack to zero. Such a network would be both accurate and robust, and could be less expensive to implement than the current solution. A network was trained via backpropagation, and results, which compare favorably to the current solution as well as to some other alternatives, are presented. Other training options are currently being evaluated.
Neural networks for nuclear spectroscopy
Energy Technology Data Exchange (ETDEWEB)
Keller, P.E.; Kangas, L.J.; Hashem, S.; Kouzes, R.T. [Pacific Northwest Lab., Richland, WA (United States)] [and others
1995-12-31
In this paper two applications of artificial neural networks (ANNs) in nuclear spectroscopy analysis are discussed. In the first application, an ANN assigns quality coefficients to alpha particle energy spectra. These spectra are used to detect plutonium contamination in the work environment. The quality coefficients represent the levels of spectral degradation caused by miscalibration and foreign matter affecting the instruments. A set of spectra was labeled with quality coefficients by an expert and used to train the ANN expert system. Our investigation shows that the expert knowledge of spectral quality can be transferred to an ANN system. The second application combines a portable gamma-ray spectrometer with an ANN. In this system the ANN is used to automatically identify, radioactive isotopes in real-time from their gamma-ray spectra. Two neural network paradigms are examined: the linear perception and the optimal linear associative memory (OLAM). A comparison of the two paradigms shows that OLAM is superior to linear perception for this application. Both networks have a linear response and are useful in determining the composition of an unknown sample when the spectrum of the unknown is a linear superposition of known spectra. One feature of this technique is that it uses the whole spectrum in the identification process instead of only the individual photo-peaks. For this reason, it is potentially more useful for processing data from lower resolution gamma-ray spectrometers. This approach has been tested with data generated by Monte Carlo simulations and with field data from sodium iodide and Germanium detectors. With the ANN approach, the intense computation takes place during the training process. Once the network is trained, normal operation consists of propagating the data through the network, which results in rapid identification of samples. This approach is useful in situations that require fast response where precise quantification is less important.
Directory of Open Access Journals (Sweden)
Rohmatulloh 1
2007-12-01
Full Text Available This paper discussed quality improvement of black tea using fuzzy approach on quality functions deployment and the development of backpropagation neural the software NWP II plus. The research was conducted at PTPN VIII tea industry, Goalpara plantation. Result of the study showed that, parameter first priority based on customer evaluation was tea flavour. The Important process parameter of black tea based on result of fuzzy relationship matrix was the withering process. Based on the test of “trial and error” of network training process, the best network architecture for withering process monitoring [3-15-1] was obtained, that is 3 neurons in input layer, 15 neurons in hidden layer and 1 neuron in output layer. Three inputs and output consist of time, flow, temperature and moisture content. The result sugges that development of backpropagation neural network can be used for process evaluation of withering processes.
Institute of Scientific and Technical Information of China (English)
LONG Jiangqi; LAN Fengchong; CHEN Jiqing; YU Ping
2009-01-01
For optimal design of mechanical clinching steel-aluminum joints, the back propagation (BP) neural network is used to research the mapping relationship between joining technique parameters including sheet thickness, sheet hardness, joint bottom diameter etc., and mechanical properties of shearing and peeling in order to investigate joining technology between various material plates in the steel-aluminum hybrid structure car body. Genetic algorithm (GA) is adopted to optimize the back-propagation neural network connection weights. The training and validating samples are made by the BTM(R) Tog-L-Loc system with different technologic parameters. The training samples' parameters and the corresponding joints' mechanical properties are supplied to the artificial neural network (ANN) for training. The validating samples' experimental data is used for checking up the prediction outputs. The calculation results show that GA can improve the model's prediction precision and generalization ability of BP neural network. The comparative analysis between the experimental data and the prediction outputs shows that ANN prediction models after training can effectively predict the mechanical properties of mechanical clinching joints and prove the feasibility and reliability of the intelligent neural networks system when used in the mechanical properties prediction of mechanical clinching joints. The prediction results can be used for a reference in the design of mechanical clinching steel-aluminum joints.
Directory of Open Access Journals (Sweden)
Yasir Hassan Ali
2015-01-01
Full Text Available The thickness of an oil film lubricant can contribute to less gear tooth wear and surface failure. The purpose of this research is to use artificial neural network (ANN computational modelling to correlate spur gear data from acoustic emissions, lubricant temperature, and specific film thickness (λ. The approach is using an algorithm to monitor the oil film thickness and to detect which lubrication regime the gearbox is running either hydrodynamic, elastohydrodynamic, or boundary. This monitoring can aid identification of fault development. Feed-forward and recurrent Elman neural network algorithms were used to develop ANN models, which are subjected to training, testing, and validation process. The Levenberg-Marquardt back-propagation algorithm was applied to reduce errors. Log-sigmoid and Purelin were identified as suitable transfer functions for hidden and output nodes. The methods used in this paper shows accurate predictions from ANN and the feed-forward network performance is superior to the Elman neural network.
Neural Network Controlled Visual Saccades
Johnson, Jeffrey D.; Grogan, Timothy A.
1989-03-01
The paper to be presented will discuss research on a computer vision system controlled by a neural network capable of learning through classical (Pavlovian) conditioning. Through the use of unconditional stimuli (reward and punishment) the system will develop scan patterns of eye saccades necessary to differentiate and recognize members of an input set. By foveating only those portions of the input image that the system has found to be necessary for recognition the drawback of computational explosion as the size of the input image grows is avoided. The model incorporates many features found in animal vision systems, and is governed by understandable and modifiable behavior patterns similar to those reported by Pavlov in his classic study. These behavioral patterns are a result of a neuronal model, used in the network, explicitly designed to reproduce this behavior.
Neural networks with discontinuous/impact activations
Akhmet, Marat
2014-01-01
This book presents as its main subject new models in mathematical neuroscience. A wide range of neural networks models with discontinuities are discussed, including impulsive differential equations, differential equations with piecewise constant arguments, and models of mixed type. These models involve discontinuities, which are natural because huge velocities and short distances are usually observed in devices modeling the networks. A discussion of the models, appropriate for the proposed applications, is also provided. This book also: Explores questions related to the biological underpinning for models of neural networks\\ Considers neural networks modeling using differential equations with impulsive and piecewise constant argument discontinuities Provides all necessary mathematical basics for application to the theory of neural networks Neural Networks with Discontinuous/Impact Activations is an ideal book for researchers and professionals in the field of engineering mathematics that have an interest in app...
Volatility Degree Forecasting of Stock Market by Stochastic Time Strength Neural Network
Directory of Open Access Journals (Sweden)
Haiyan Mo
2013-01-01
Full Text Available In view of the applications of artificial neural networks in economic and financial forecasting, a stochastic time strength function is introduced in the backpropagation neural network model to predict the fluctuations of stock price changes. In this model, stochastic time strength function gives a weight for each historical datum and makes the model have the effect of random movement, and then we investigate and forecast the behavior of volatility degrees of returns for the Chinese stock market indexes and some global market indexes. The empirical research is performed in testing the prediction effect of SSE, SZSE, HSI, DJIA, IXIC, and S&P 500 with different selected volatility degrees in the established model.
Institute of Scientific and Technical Information of China (English)
牛东晓; 刘达; 邢棉
2008-01-01
A combined model based on principal components analysis (PCA) and generalized regression neural network (GRNN) was adopted to forecast electricity price in day-ahead electricity market. PCA was applied to mine the main influence on day-ahead price, avoiding the strong correlation between the input factors that might influence electricity price, such as the load of the forecasting hour, other history loads and prices, weather and temperature; then GRNN was employed to forecast electricity price according to the main information extracted by PCA. To prove the efficiency of the combined model, a case from PJM (Pennsylvania-New Jersey-Maryland) day-ahead electricity market was evaluated. Compared to back-propagation (BP) neural network and standard GRNN, the combined method reduces the mean absolute percentage error about 3%.
Cutting force signal pattern recognition using hybrid neural network in end milling
Institute of Scientific and Technical Information of China (English)
Song-Tae SEONG; Ko-Tae JO; Young-Moon LEE
2009-01-01
Under certain cutting conditions in end milling, the signs of cutting forces change from positive to negative during a revolution of the tool. The change of force direction causes the cutting dynamics to be unstable which results in chatter vibration. Therefore, cutting force signal monitoring and classification are needed to determine the optimal cutting conditions and to improve the efficiency of cut. Artificial neural networks are powerful tools for solving highly complex and nonlinear problems. It can be divided into supervised and unsupervised learning machines based on the availability of a teacher. Hybrid neural network was introduced with both of functions of multilayer perceptron (MLP) trained with the back-propagation algorithm for monitoring and detecting abnormal state, and self organizing feature map (SOFM) for treating huge datum such as image processing and pattern recognition, for predicting and classifying cutting force signal patterns simultaneously. The validity of the results is verified with cutting experiments and simulation tests.
Directory of Open Access Journals (Sweden)
Samy S. Abu Naser
2012-04-01
Full Text Available In this paper we present a technique that employ Artificial Neural Networks and expert systems to obtain knowledge for the learner model in the Linear Programming Intelligent Tutoring System(LP-ITS to be able to determine the academic performance level of the learners in order to offer him/her the properdifficulty level of linear programming problems to solve. LP-ITS uses Feed forward Back-propagation algorithm to be trained with a group of learners data to predict their academic performance. Furthermore, LP-ITS uses an Expert System to decide the proper difficulty level that is suitable with the predicted academic performance of the learner. Several tests have been carried out to examine adherence to real time data. The accuracy of predicting the performance of the learners is very high and thus states that the Artificial Neural Network is skilled enough to make suitable predictions.
Directory of Open Access Journals (Sweden)
Samy S. Abu Naser
2012-03-01
Full Text Available In this paper we present a technique that employ Artificial Neural Networks and expert systems to obtain knowledge for the learner model in the Linear Programming Intelligent Tutoring System(LP-ITS to be able to determine the academic performance level of the learners in order to offer him/her the proper difficulty level of linear programming problems to solve. LP-ITS uses Feed forward Back-propagation algorithm to be trained with a group of learners data to predict their academic performance. Furthermore, LP-ITS uses an Expert System to decide the proper difficulty level that is suitable with the predicted academic performance of the learner. Several tests have been carried out to examine adherence to real time data. The accuracy of predicting the performance of the learners is very high and thus states that the Artificial Neural Network is skilled enough to make suitable predictions.
Two neural network algorithms for designing optimal terminal controllers with open final time
Plumer, Edward S.
1992-01-01
Multilayer neural networks, trained by the backpropagation through time algorithm (BPTT), have been used successfully as state-feedback controllers for nonlinear terminal control problems. Current BPTT techniques, however, are not able to deal systematically with open final-time situations such as minimum-time problems. Two approaches which extend BPTT to open final-time problems are presented. In the first, a neural network learns a mapping from initial-state to time-to-go. In the second, the optimal number of steps for each trial run is found using a line-search. Both methods are derived using Lagrange multiplier techniques. This theoretical framework is used to demonstrate that the derived algorithms are direct extensions of forward/backward sweep methods used in N-stage optimal control. The two algorithms are tested on a Zermelo problem and the resulting trajectories compare favorably to optimal control results.
Neural Networks for Emotion Classification
Sun, Yafei
2011-01-01
It is argued that for the computer to be able to interact with humans, it needs to have the communication skills of humans. One of these skills is the ability to understand the emotional state of the person. This thesis describes a neural network-based approach for emotion classification. We learn a classifier that can recognize six basic emotions with an average accuracy of 77% over the Cohn-Kanade database. The novelty of this work is that instead of empirically selecting the parameters of the neural network, i.e. the learning rate, activation function parameter, momentum number, the number of nodes in one layer, etc. we developed a strategy that can automatically select comparatively better combination of these parameters. We also introduce another way to perform back propagation. Instead of using the partial differential of the error function, we use optimal algorithm; namely Powell's direction set to minimize the error function. We were also interested in construction an authentic emotion databases. This...
Artificial neural networks in neurosurgery.
Azimi, Parisa; Mohammadi, Hasan Reza; Benzel, Edward C; Shahzadi, Sohrab; Azhari, Shirzad; Montazeri, Ali
2015-03-01
Artificial neural networks (ANNs) effectively analyze non-linear data sets. The aimed was A review of the relevant published articles that focused on the application of ANNs as a tool for assisting clinical decision-making in neurosurgery. A literature review of all full publications in English biomedical journals (1993-2013) was undertaken. The strategy included a combination of key words 'artificial neural networks', 'prognostic', 'brain', 'tumor tracking', 'head', 'tumor', 'spine', 'classification' and 'back pain' in the title and abstract of the manuscripts using the PubMed search engine. The major findings are summarized, with a focus on the application of ANNs for diagnostic and prognostic purposes. Finally, the future of ANNs in neurosurgery is explored. A total of 1093 citations were identified and screened. In all, 57 citations were found to be relevant. Of these, 50 articles were eligible for inclusion in this review. The synthesis of the data showed several applications of ANN in neurosurgery, including: (1) diagnosis and assessment of disease progression in low back pain, brain tumours and primary epilepsy; (2) enhancing clinically relevant information extraction from radiographic images, intracranial pressure processing, low back pain and real-time tumour tracking; (3) outcome prediction in epilepsy, brain metastases, lumbar spinal stenosis, lumbar disc herniation, childhood hydrocephalus, trauma mortality, and the occurrence of symptomatic cerebral vasospasm in patients with aneurysmal subarachnoid haemorrhage; (4) the use in the biomechanical assessments of spinal disease. ANNs can be effectively employed for diagnosis, prognosis and outcome prediction in neurosurgery.
The Laplacian spectrum of neural networks
Directory of Open Access Journals (Sweden)
Siemon ede Lange
2014-01-01
Full Text Available The brain is a complex network of neural interactions, both at the microscopic and macroscopic level. Graph theory is well suited to examine the global network architecture of these neural networks. Many popular graph metrics, however, encode average properties of individual network elements. Complementing these ‘conventional’ graph metrics, the eigenvalue spectrum of the normalized Laplacian describes a network’s structure directly at a systems level, without referring to individual nodes or connections. In this paper, the Laplacian spectra of the macroscopic anatomical neuronal networks of the macaque and cat, and the microscopic network of the Caenorhabditis elegans were examined. Consistent with conventional graph metrics, analysis of the Laplacian spectra revealed an integrative community structure in neural brain networks. Extending previous findings of overlap of network attributes across species, similarity of the Laplacian spectra across the cat, macaque and C. elegans neural networks suggests a certain level of consistency in the overall architecture of the anatomical neural networks of these species. Our results further suggest a specific network class for neural networks, distinct from conceptual small-world and scale-free models as well as several empirical networks.
Optimising the topology of complex neural networks
Jiang, Fei; Schoenauer, Marc
2007-01-01
In this paper, we study instances of complex neural networks, i.e. neural netwo rks with complex topologies. We use Self-Organizing Map neural networks whose n eighbourhood relationships are defined by a complex network, to classify handwr itten digits. We show that topology has a small impact on performance and robus tness to neuron failures, at least at long learning times. Performance may howe ver be increased (by almost 10%) by artificial evolution of the network topo logy. In our experimental conditions, the evolved networks are more random than their parents, but display a more heterogeneous degree distribution.
Optimizing neural network forecast by immune algorithm
Institute of Scientific and Technical Information of China (English)
YANG Shu-xia; LI Xiang; LI Ning; YANG Shang-dong
2006-01-01
Considering multi-factor influence, a forecasting model was built. The structure of BP neural network was designed, and immune algorithm was applied to optimize its network structure and weight. After training the data of power demand from the year 1980 to 2005 in China, a nonlinear network model was obtained on the relationship between power demand and the factors which had impacts on it, and thus the above proposed method was verified. Meanwhile, the results were compared to those of neural network optimized by genetic algorithm. The results show that this method is superior to neural network optimized by genetic algorithm and is one of the effective ways of time series forecast.
Drift chamber tracking with neural networks
International Nuclear Information System (INIS)
We discuss drift chamber tracking with a commercial log VLSI neural network chip. Voltages proportional to the drift times in a 4-layer drift chamber were presented to the Intel ETANN chip. The network was trained to provide the intercept and slope of straight tracks traversing the chamber. The outputs were recorded and later compared off line to conventional track fits. Two types of network architectures were studied. Applications of neural network tracking to high energy physics detector triggers is discussed
Drift chamber tracking with neural networks
Energy Technology Data Exchange (ETDEWEB)
Lindsey, C.S.; Denby, B.; Haggerty, H.
1992-10-01
We discuss drift chamber tracking with a commercial log VLSI neural network chip. Voltages proportional to the drift times in a 4-layer drift chamber were presented to the Intel ETANN chip. The network was trained to provide the intercept and slope of straight tracks traversing the chamber. The outputs were recorded and later compared off line to conventional track fits. Two types of network architectures were studied. Applications of neural network tracking to high energy physics detector triggers is discussed.
Molecular evolution of a peptide GPCR ligand driven by artificial neural networks.
Directory of Open Access Journals (Sweden)
Sebastian Bandholtz
Full Text Available Peptide ligands of G protein-coupled receptors constitute valuable natural lead structures for the development of highly selective drugs and high-affinity tools to probe ligand-receptor interaction. Currently, pharmacological and metabolic modification of natural peptides involves either an iterative trial-and-error process based on structure-activity relationships or screening of peptide libraries that contain many structural variants of the native molecule. Here, we present a novel neural network architecture for the improvement of metabolic stability without loss of bioactivity. In this approach the peptide sequence determines the topology of the neural network and each cell corresponds one-to-one to a single amino acid of the peptide chain. Using a training set, the learning algorithm calculated weights for each cell. The resulting network calculated the fitness function in a genetic algorithm to explore the virtual space of all possible peptides. The network training was based on gradient descent techniques which rely on the efficient calculation of the gradient by back-propagation. After three consecutive cycles of sequence design by the neural network, peptide synthesis and bioassay this new approach yielded a ligand with 70fold higher metabolic stability compared to the wild type peptide without loss of the subnanomolar activity in the biological assay. Combining specialized neural networks with an exploration of the combinatorial amino acid sequence space by genetic algorithms represents a novel rational strategy for peptide design and optimization.
Coherence resonance in bursting neural networks
Kim, June Hoan; Lee, Ho Jun; Min, Cheol Hong; Lee, Kyoung J.
2015-10-01
Synchronized neural bursts are one of the most noticeable dynamic features of neural networks, being essential for various phenomena in neuroscience, yet their complex dynamics are not well understood. With extrinsic electrical and optical manipulations on cultured neural networks, we demonstrate that the regularity (or randomness) of burst sequences is in many cases determined by a (few) low-dimensional attractor(s) working under strong neural noise. Moreover, there is an optimal level of noise strength at which the regularity of the interburst interval sequence becomes maximal—a phenomenon of coherence resonance. The experimental observations are successfully reproduced through computer simulations on a well-established neural network model, suggesting that the same phenomena may occur in many in vivo as well as in vitro neural networks.
Coherence resonance in bursting neural networks.
Kim, June Hoan; Lee, Ho Jun; Min, Cheol Hong; Lee, Kyoung J
2015-10-01
Synchronized neural bursts are one of the most noticeable dynamic features of neural networks, being essential for various phenomena in neuroscience, yet their complex dynamics are not well understood. With extrinsic electrical and optical manipulations on cultured neural networks, we demonstrate that the regularity (or randomness) of burst sequences is in many cases determined by a (few) low-dimensional attractor(s) working under strong neural noise. Moreover, there is an optimal level of noise strength at which the regularity of the interburst interval sequence becomes maximal-a phenomenon of coherence resonance. The experimental observations are successfully reproduced through computer simulations on a well-established neural network model, suggesting that the same phenomena may occur in many in vivo as well as in vitro neural networks.
Cao, Jianfang; Cui, Hongyan; Shi, Hao; Jiao, Lijuan
2016-01-01
A back-propagation (BP) neural network can solve complicated random nonlinear mapping problems; therefore, it can be applied to a wide range of problems. However, as the sample size increases, the time required to train BP neural networks becomes lengthy. Moreover, the classification accuracy decreases as well. To improve the classification accuracy and runtime efficiency of the BP neural network algorithm, we proposed a parallel design and realization method for a particle swarm optimization (PSO)-optimized BP neural network based on MapReduce on the Hadoop platform using both the PSO algorithm and a parallel design. The PSO algorithm was used to optimize the BP neural network's initial weights and thresholds and improve the accuracy of the classification algorithm. The MapReduce parallel programming model was utilized to achieve parallel processing of the BP algorithm, thereby solving the problems of hardware and communication overhead when the BP neural network addresses big data. Datasets on 5 different scales were constructed using the scene image library from the SUN Database. The classification accuracy of the parallel PSO-BP neural network algorithm is approximately 92%, and the system efficiency is approximately 0.85, which presents obvious advantages when processing big data. The algorithm proposed in this study demonstrated both higher classification accuracy and improved time efficiency, which represents a significant improvement obtained from applying parallel processing to an intelligent algorithm on big data. PMID:27304987
Cao, Jianfang; Cui, Hongyan; Shi, Hao; Jiao, Lijuan
2016-01-01
A back-propagation (BP) neural network can solve complicated random nonlinear mapping problems; therefore, it can be applied to a wide range of problems. However, as the sample size increases, the time required to train BP neural networks becomes lengthy. Moreover, the classification accuracy decreases as well. To improve the classification accuracy and runtime efficiency of the BP neural network algorithm, we proposed a parallel design and realization method for a particle swarm optimization (PSO)-optimized BP neural network based on MapReduce on the Hadoop platform using both the PSO algorithm and a parallel design. The PSO algorithm was used to optimize the BP neural network's initial weights and thresholds and improve the accuracy of the classification algorithm. The MapReduce parallel programming model was utilized to achieve parallel processing of the BP algorithm, thereby solving the problems of hardware and communication overhead when the BP neural network addresses big data. Datasets on 5 different scales were constructed using the scene image library from the SUN Database. The classification accuracy of the parallel PSO-BP neural network algorithm is approximately 92%, and the system efficiency is approximately 0.85, which presents obvious advantages when processing big data. The algorithm proposed in this study demonstrated both higher classification accuracy and improved time efficiency, which represents a significant improvement obtained from applying parallel processing to an intelligent algorithm on big data.
Radiation Behavior of Analog Neural Network Chip
Langenbacher, H.; Zee, F.; Daud, T.; Thakoor, A.
1996-01-01
A neural network experiment conducted for the Space Technology Research Vehicle (STRV-1) 1-b launched in June 1994. Identical sets of analog feed-forward neural network chips was used to study and compare the effects of space and ground radiation on the chips. Three failure mechanisms are noted.
Adaptive Neurons For Artificial Neural Networks
Tawel, Raoul
1990-01-01
Training time decreases dramatically. In improved mathematical model of neural-network processor, temperature of neurons (in addition to connection strengths, also called weights, of synapses) varied during supervised-learning phase of operation according to mathematical formalism and not heuristic rule. Evidence that biological neural networks also process information at neuronal level.
Self-organization of neural networks
Energy Technology Data Exchange (ETDEWEB)
Clark, J.W.; Winston, J.V.; Rafelski, J.
1984-05-14
The plastic development of a neural-network model operating autonomously in discrete time is described by the temporal modification of interneuronal coupling strengths according to momentary neural activity. A simple algorithm (brainwashing) is found which, applied to nets with initially quasirandom connectivity, leads to model networks with properties conducive to the simulation of memory and learning phenomena. 18 references, 2 figures.
Self-organization of neural networks
Clark, John W.; Winston, Jeffrey V.; Rafelski, Johann
1984-05-01
The plastic development of a neural-network model operating autonomously in discrete time is described by the temporal modification of interneuronal coupling strengths according to momentary neural activity. A simple algorithm (“brainwashing”) is found which, applied to nets with initially quasirandom connectivity, leads to model networks with properties conductive to the simulation of memory and learning phenomena.
Neural Networks for Non-linear Control
DEFF Research Database (Denmark)
Sørensen, O.
1994-01-01
This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process.......This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process....
Application of feedback connection artificial neural network to seismic data filtering
Djarfour, Noureddine; Baddari, Kamel; Mihoubi, Abdelhafid; Ferahtia, Jalal; 10.1016/j.crte.2008.03.003
2008-01-01
The Elman artificial neural network (ANN) (feedback connection) was used for seismic data filtering. The recurrent connection that characterizes this network offers the advantage of storing values from the previous time step to be used in the current time step. The proposed structure has the advantage of training simplicity by a back-propagation algorithm (steepest descent). Several trials were addressed on synthetic (with 10% and 50% of random and Gaussian noise) and real seismic data using respectively 10 to 30 neurons and a minimum of 60 neurons in the hidden layer. Both an iteration number up to 4000 and arrest criteria were used to obtain satisfactory performances. Application of such networks on real data shows that the filtered seismic section was efficient. Adequate cross-validation test is done to ensure the performance of network on new data sets.
Secure Key Exchange using Neural Network
Vineeta Soni
2014-01-01
Any cryptographic system is used to exchange confidential information securely over the public channel without any leakage of information to the unauthorized users. Neural networks can be used to generate a common secret key because the processes involve in Cryptographic system requires large computational power and very complex. Moreover Diffi hellman key exchange is suffered from man-in –the middle attack. For overcome this problem neural networks can be used.Two neural netwo...
Introduction to Concepts in Artificial Neural Networks
Niebur, Dagmar
1995-01-01
This introduction to artificial neural networks summarizes some basic concepts of computational neuroscience and the resulting models of artificial neurons. The terminology of biological and artificial neurons, biological and machine learning and neural processing is introduced. The concepts of supervised and unsupervised learning are explained with examples from the power system area. Finally, a taxonomy of different types of neurons and different classes of artificial neural networks is presented.
Modelling the SOFC behaviours by artificial neural network
Energy Technology Data Exchange (ETDEWEB)
Milewski, Jaroslaw; Swirski, Konrad [Institute of Heat Engineering, Warsaw University of Technology, 25 Nowowiejska Street, 00-665 Warsaw (Poland)
2009-07-15
The Artificial Neural Network (ANN) can be applied to simulate an object's behaviour without an algorithmic solution merely by utilizing available experimental data. The ANN is used for modelling singular cell behaviour. The optimal network architecture is shown and commented. The error backpropagation algorithm was used for an ANN training procedure. The ANN based SOFC model has the following input parameters: current density, temperature, fuel volume flow density (ml min{sup -1} cm{sup -2}), and oxidant volume flow density. Based on these input parameters, cell voltage is predicted by the model. Obtained results show that the ANN can be successfully used for modelling the singular solid oxide fuel cell. The self-learning process of the ANN provides an opportunity to adapt the model to new situations (e.g. certain types of impurities at inlet streams etc.). Based on the results from this study it can be concluded that, by using the ANN, an SOFC can be modelled with relatively high accuracy. In contrast to traditional models, the ANN is able to predict cell voltage without knowledge of numerous physical, chemical, and electrochemical factors. (author)
Use of artificial neural network for spatial rainfall analysis
Indian Academy of Sciences (India)
Tsangaratos Paraskevas; Rozos Dimitrios; Benardos Andreas
2014-04-01
In the present study, the precipitation data measured at 23 rain gauge stations over the Achaia County, Greece, were used to estimate the spatial distribution of the mean annual precipitation values over a specific catchment area. The objective of this work was achieved by programming an Artificial Neural Network (ANN) that uses the feed-forward back-propagation algorithm as an alternative interpolating technique. A Geographic Information System (GIS) was utilized to process the data derived by the ANN and to create a continuous surface that represented the spatial mean annual precipitation distribution.The ANN introduced an optimization procedure that was implemented during training, adjusting the hidden number of neurons and the convergence of the ANN in order to select the best network architecture. The performance of the ANN was evaluated using three standard statistical evaluation criteria applied to the study area and showed good performance. The outcomes were also compared with the results obtained from a previous study in the area of research which used a linear regression analysis for the estimation of the mean annual precipitation values giving more accurate results. The information and knowledge gained from the present study could improve the accuracy of analysis concerning hydrology and hydrogeological models, ground water studies, flood related applications and climate analysis studies.
International Conference on Artificial Neural Networks (ICANN)
Mladenov, Valeri; Kasabov, Nikola; Artificial Neural Networks : Methods and Applications in Bio-/Neuroinformatics
2015-01-01
The book reports on the latest theories on artificial neural networks, with a special emphasis on bio-neuroinformatics methods. It includes twenty-three papers selected from among the best contributions on bio-neuroinformatics-related issues, which were presented at the International Conference on Artificial Neural Networks, held in Sofia, Bulgaria, on September 10-13, 2013 (ICANN 2013). The book covers a broad range of topics concerning the theory and applications of artificial neural networks, including recurrent neural networks, super-Turing computation and reservoir computing, double-layer vector perceptrons, nonnegative matrix factorization, bio-inspired models of cell communities, Gestalt laws, embodied theory of language understanding, saccadic gaze shifts and memory formation, and new training algorithms for Deep Boltzmann Machines, as well as dynamic neural networks and kernel machines. It also reports on new approaches to reinforcement learning, optimal control of discrete time-delay systems, new al...
Energy Technology Data Exchange (ETDEWEB)
Junghui Chen; Kuan-Po Wang [Chung-Yuan Christian University (China). Dept. of Chemical Engineering; Ming-Tsai Liang [I-Shou University (China). Dept. of Chemical Engineering
2005-06-01
An overlapped type of local neural network is proposed to improve accuracy of the heat transfer coefficient estimation of the supercritical carbon dioxide. The idea of this work is to use the network to estimate the heat transfer coefficient for which there is no accurate correlation model due to the complexity of the thermo-physical properties involved around the critical region. Unlike the global approximation network (e.g. backpropagation network) and the local approximation network (e.g. the radial basis function network), the proposed network allows us to match the quick changes in the near-critical local region where the rate of heat transfer is significantly increased and to construct the global smooth perspective far away from that local region. Based on the experimental data for carbon dioxide flowing inside a heated tube at the supercritical condition, the proposed network significantly outperformed some the conventional correlation method and the traditional network models. (Author)
Earthquake-induced landslide-susceptibility mapping using an artificial neural network
Directory of Open Access Journals (Sweden)
S. Lee
2006-01-01
Full Text Available The purpose of this study was to apply and verify landslide-susceptibility analysis techniques using an artificial neural network and a Geographic Information System (GIS applied to Baguio City, Philippines. The 16 July 1990 earthquake-induced landslides were studied. Landslide locations were identified from interpretation of aerial photographs and field survey, and a spatial database was constructed from topographic maps, geology, land cover and terrain mapping units. Factors that influence landslide occurrence, such as slope, aspect, curvature and distance from drainage were calculated from the topographic database. Lithology and distance from faults were derived from the geology database. Land cover was identified from the topographic database. Terrain map units were interpreted from aerial photographs. These factors were used with an artificial neural network to analyze landslide susceptibility. Each factor weight was determined by a back-propagation exercise. Landslide-susceptibility indices were calculated using the back-propagation weights, and susceptibility maps were constructed from GIS data. The susceptibility map was compared with known landslide locations and verified. The demonstrated prediction accuracy was 93.20%.
Firearm Classification using Neural Networks on Ring of Firing Pin Impression Images
Directory of Open Access Journals (Sweden)
Abdul AZIZ JEMAIN
2013-07-01
Full Text Available This paper implements two layer neural networks with different feedforward backpropagation algorithms for better performance of firearm classification us-ing numerical features from the ring image. A total of 747 ring images which are extracted from centre of the firing pin impression have been captured from five different pistols of the Parabellum Vector SPI 9mm model. Then, based on finding from the previous studies, the six best geometric moments numerical fea-tures were extracted from those ring images. The elements of the dataset were further randomly divided into the training set (523 elements, testing set (112 el-ements and validation set (112 elements in accordance with the requirement of the supervised learning nature of the backpropagation neural network (BPNN. Empirical results show that a two layer BPNN with a 6-7-5 configura-tion and tansig/tansig transfer functions with ‘trainscg’ training algorithm has produced the best classification result of 98%. The classification result is an improvement compared to the previous studies as well as confirming that the ring image region contains useful information for firearm classification.
Energy Technology Data Exchange (ETDEWEB)
Zhu, H.; Chang, W.; Zhang, B. [China University of Mining and Technology, Beijing (China)
2007-05-15
Back-propagation (BP) neural network analysis based on the difference- source gas emission quantity prediction theory was applied to predict the quantity of gas emitted from the coal seam being mined, the neighbouring coal seam and the goaf of the working face. Three separate gas emission prediction neural network models were established for these. The prediction model of the coal seam being mined was made up of three layers and nine parameters; that of the neighbouring coal seam was made up of three layers and eight parameters; and that of the goaf of three layers and four parameters. The difference-source gas emission prediction model can greatly improve prediction accuracy. BP neural network analysis using Matlab software was applied in a coal mine. 10 refs., 2 figs., 3 tabs.
Wavelet Neural Networks for Adaptive Equalization
Institute of Scientific and Technical Information of China (English)
JIANGMinghu; DENGBeixing; GIELENGeorges; ZHANGBo
2003-01-01
A structure based on the Wavelet neural networks (WNNs) is proposed for nonlinear channel equalization in a digital communication system. The construction algorithm of the Minimum error probability (MEP) is presented and applied as a performance criterion to update the parameter matrix of wavelet networks. Our experimental results show that performance of the proposed wavelet networks based on equalizer can significantly improve the neural modeling accuracy, perform quite well in compensating the nonlinear distortion introduced by the channel, and outperform the conventional neural networks in signal to noise ratio and channel non-llnearity.
Evolving Resilient Back-Propagation Algorithm for Energy Efficiency Problem
Directory of Open Access Journals (Sweden)
Yang Fei
2016-01-01
Full Text Available Energy efficiency is one of our most economical sources of new energy. When it comes to efficient building design, the computation of the heating load (HL and cooling load (CL is required to determine the specifications of the heating and cooling equipment. The objective of this paper is to model heating load and cooling load buildings using neural networks in order to predict HL load and CL load. Rprop with genetic algorithm was proposed to increase the global convergence capability of Rprop by modifying a corresponding weight. Comparison results show that Rprop with GA can successfully improve the global convergence capability of Rprop and achieve lower MSE than other perceptron training algorithms, such as Back-Propagation or original Rprop. In addition, the trained network has better generalization ability and stabilization performance.
A Short-Term Climate Prediction Model Based on a Modular Fuzzy Neural Network
Institute of Scientific and Technical Information of China (English)
JIN Long; JIN Jian; YAO Cai
2005-01-01
In terms of the modular fuzzy neural network (MFNN) combining fuzzy c-mean (FCM) cluster and single-layer neural network, a short-term climate prediction model is developed. It is found from modeling results that the MFNN model for short-term climate prediction has advantages of simple structure, no hidden layer and stable network parameters because of the assembling of sound functions of the selfadaptive learning, association and fuzzy information processing of fuzzy mathematics and neural network methods. The case computational results of Guangxi flood season (JJA) rainfall show that the mean absolute error (MAE) and mean relative error (MRE) of the prediction during 1998-2002 are 68.8 mm and 9.78％, and in comparison with the regression method, under the conditions of the same predictors and period they are 97.8 mm and 12.28％ respectively. Furthermore, it is also found from the stability analysis of the modular model that the change of the prediction results of independent samples with training times in the stably convergent interval of the model is less than 1.3 mm. The obvious oscillation phenomenon of prediction results with training times, such as in the common back-propagation neural network (BPNN)model, does not occur, indicating a better practical application potential of the MFNN model.
Cao, Jianfang; Cui, Hongyan; Shi, Hao; Jiao, Lijuan
2016-01-01
A back-propagation (BP) neural network can solve complicated random nonlinear mapping problems; therefore, it can be applied to a wide range of problems. However, as the sample size increases, the time required to train BP neural networks becomes lengthy. Moreover, the classification accuracy decreases as well. To improve the classification accuracy and runtime efficiency of the BP neural network algorithm, we proposed a parallel design and realization method for a particle swarm optimization (PSO)-optimized BP neural network based on MapReduce on the Hadoop platform using both the PSO algorithm and a parallel design. The PSO algorithm was used to optimize the BP neural network’s initial weights and thresholds and improve the accuracy of the classification algorithm. The MapReduce parallel programming model was utilized to achieve parallel processing of the BP algorithm, thereby solving the problems of hardware and communication overhead when the BP neural network addresses big data. Datasets on 5 different scales were constructed using the scene image library from the SUN Database. The classification accuracy of the parallel PSO-BP neural network algorithm is approximately 92%, and the system efficiency is approximately 0.85, which presents obvious advantages when processing big data. The algorithm proposed in this study demonstrated both higher classification accuracy and improved time efficiency, which represents a significant improvement obtained from applying parallel processing to an intelligent algorithm on big data. PMID:27304987
Sunspot prediction using neural networks
Villarreal, James; Baffes, Paul
1990-01-01
The earliest systematic observance of sunspot activity is known to have been discovered by the Chinese in 1382 during the Ming Dynasty (1368 to 1644) when spots on the sun were noticed by looking at the sun through thick, forest fire smoke. Not until after the 18th century did sunspot levels become more than a source of wonderment and curiosity. Since 1834 reliable sunspot data has been collected by the National Oceanic and Atmospheric Administration (NOAA) and the U.S. Naval Observatory. Recently, considerable effort has been placed upon the study of the effects of sunspots on the ecosystem and the space environment. The efforts of the Artificial Intelligence Section of the Mission Planning and Analysis Division of the Johnson Space Center involving the prediction of sunspot activity using neural network technologies are described.
Subspace learning of neural networks
Cheng Lv, Jian; Zhou, Jiliu
2010-01-01
PrefaceChapter 1. Introduction1.1 Introduction1.1.1 Linear Neural Networks1.1.2 Subspace Learning1.2 Subspace Learning Algorithms1.2.1 PCA Learning Algorithms1.2.2 MCA Learning Algorithms1.2.3 ICA Learning Algorithms1.3 Methods for Convergence Analysis1.3.1 SDT Method1.3.2 DCT Method1.3.3 DDT Method1.4 Block Algorithms1.5 Simulation Data Set and Notation1.6 ConclusionsChapter 2. PCA Learning Algorithms with Constants Learning Rates2.1 Oja's PCA Learning Algorithms2.1.1 The Algorithms2.1.2 Convergence Issue2.2 Invariant Sets2.2.1 Properties of Invariant Sets2.2.2 Conditions for Invariant Sets2.
Introduction to artificial neural networks.
Grossi, Enzo; Buscema, Massimo
2007-12-01
The coupling of computer science and theoretical bases such as nonlinear dynamics and chaos theory allows the creation of 'intelligent' agents, such as artificial neural networks (ANNs), able to adapt themselves dynamically to problems of high complexity. ANNs are able to reproduce the dynamic interaction of multiple factors simultaneously, allowing the study of complexity; they can also draw conclusions on individual basis and not as average trends. These tools can offer specific advantages with respect to classical statistical techniques. This article is designed to acquaint gastroenterologists with concepts and paradigms related to ANNs. The family of ANNs, when appropriately selected and used, permits the maximization of what can be derived from available data and from complex, dynamic, and multidimensional phenomena, which are often poorly predictable in the traditional 'cause and effect' philosophy. PMID:17998827
Drift chamber tracking with neural networks
International Nuclear Information System (INIS)
With the very high event rates projected for experiments at the SSC and LHC, it is important to investigate new approaches to on line pattern recognition. The use of neural networks for pattern recognition. The use of neural networks for pattern recognition in high energy physics detectors has been an area of very active research. The authors discuss drift chamber tracking with a commercial analog VLSI neural network chip. Voltages proportional to the drift times in a 4-layer drift chamber were presented to the Intel ETANN chip. The network was trained to provide the intercept and slope of straight tracks traversing the chamber. The outputs were recorded and later compared off line to conventional track fits. Two types of network architectures were studied. Applications of neural network tracking to high energy physics detector triggers is discussed
Chang, H.-C.; Kopaska-Merkel, D. C.; Chen, H.-C.; Rocky, Durrans S.
2000-01-01
Lithofacies identification supplies qualitative information about rocks. Lithofacies represent rock textures and are important components of hydrocarbon reservoir description. Traditional techniques of lithofacies identification from core data are costly and different geologists may provide different interpretations. In this paper, we present a low-cost intelligent system consisting of three adaptive resonance theory neural networks and a rule-based expert system to consistently and objectively identify lithofacies from well-log data. The input data are altered into different forms representing different perspectives of observation of lithofacies. Each form of input is processed by a different adaptive resonance theory neural network. Among these three adaptive resonance theory neural networks, one neural network processes the raw continuous data, another processes categorial data, and the third processes fuzzy-set data. Outputs from these three networks are then combined by the expert system using fuzzy inference to determine to which facies the input data should be assigned. Rules are prioritized to emphasize the importance of firing order. This new approach combines the learning ability of neural networks, the adaptability of fuzzy logic, and the expertise of geologists to infer facies of the rocks. This approach is applied to the Appleton Field, an oil field located in Escambia County, Alabama. The hybrid intelligence system predicts lithofacies identity from log data with 87.6% accuracy. This prediction is more accurate than those of single adaptive resonance theory networks, 79.3%, 68.0% and 66.0%, using raw, fuzzy-set, and categorical data, respectively, and by an error-backpropagation neural network, 57.3%. (C) 2000 Published by Elsevier Science Ltd. All rights reserved.
Exponential Stability for Delayed Cellular Neural Networks
Institute of Scientific and Technical Information of China (English)
YANG Jin-xiang; ZHONG Shou-ming; YAN Ke-yu
2005-01-01
The exponential stability of the delayed cellular neural networks (DCNN's) is investigated. By dividing the network state variables into some parts according to the characters of the neural networks, some new sufficient conditions of exponential stability are derived via constructing a Liapunov function. It is shown that the conditions differ from previous ones. The new conditions, which are associated with some initial value, are represented by some blocks of the interconnection matrix.
A Selective Dynamic Sampling Back-Propagation Approach for Handling the Two-Class Imbalance Problem
Directory of Open Access Journals (Sweden)
Roberto Alejo
2016-07-01
Full Text Available In this work, we developed a Selective Dynamic Sampling Approach (SDSA to deal with the class imbalance problem. It is based on the idea of using only the most appropriate samples during the neural network training stage. The “average samples”are the best to train the neural network, they are neither hard, nor easy to learn, and they could improve the classifier performance. The experimental results show that the proposed method is a successful method to deal with the two-class imbalance problem. It is very competitive with respect to well-known over-sampling approaches and dynamic sampling approaches, even often outperforming the under-sampling and standard back-propagation methods. SDSA is a very simple method for automatically selecting the most appropriate samples (average samples during the training of the back-propagation, and it is very efficient. In the training stage, SDSA uses significantly fewer samples than the popular over-sampling approaches and even than the standard back-propagation trained with the original dataset.
A Neural Network Approach for GMA Butt Joint Welding
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2003-01-01
squares has been used with the back-propagation algorithm for training the network, while a Bayesian regularization technique has been successfully applied for minimizing the risk of inexpedient over-training. Finally, a predictive closed-loop control strategy based on a so-called single-neuron self...
Research of The Deeper Neural Networks
Directory of Open Access Journals (Sweden)
Xiao You Rong
2016-01-01
Full Text Available Neural networks (NNs have powerful computational abilities and could be used in a variety of applications; however, training these networks is still a difficult problem. With different network structures, many neural models have been constructed. In this report, a deeper neural networks (DNNs architecture is proposed. The training algorithm of deeper neural network insides searching the global optimal point in the actual error surface. Before the training algorithm is designed, the error surface of the deeper neural network is analyzed from simple to complicated, and the features of the error surface is obtained. Based on these characters, the initialization method and training algorithm of DNNs is designed. For the initialization, a block-uniform design method is proposed which separates the error surface into some blocks and finds the optimal block using the uniform design method. For the training algorithm, the improved gradient-descent method is proposed which adds a penalty term into the cost function of the old gradient descent method. This algorithm makes the network have a great approximating ability and keeps the network state stable. All of these improve the practicality of the neural network.
Coronary Artery Diagnosis Aided by Neural Network
Stefko, Kamil
2007-01-01
Coronary artery disease is due to atheromatous narrowing and subsequent occlusion of the coronary vessel. Application of optimised feed forward multi-layer back propagation neural network (MLBP) for detection of narrowing in coronary artery vessels is presented in this paper. The research was performed using 580 data records from traditional ECG exercise test confirmed by coronary arteriography results. Each record of training database included description of the state of a patient providing input data for the neural network. Level and slope of ST segment of a 12 lead ECG signal recorded at rest and after effort (48 floating point values) was the main component of input data for neural network was. Coronary arteriography results (verified the existence or absence of more than 50% stenosis of the particular coronary vessels) were used as a correct neural network training output pattern. More than 96% of cases were correctly recognised by especially optimised and a thoroughly verified neural network. Leave one out method was used for neural network verification so 580 data records could be used for training as well as for verification of neural network.
Neural network regulation driven by autonomous neural firings
Cho, Myoung Won
2016-07-01
Biological neurons naturally fire spontaneously due to the existence of a noisy current. Such autonomous firings may provide a driving force for network formation because synaptic connections can be modified due to neural firings. Here, we study the effect of autonomous firings on network formation. For the temporally asymmetric Hebbian learning, bidirectional connections lose their balance easily and become unidirectional ones. Defining the difference between reciprocal connections as new variables, we could express the learning dynamics as if Ising model spins interact with each other in magnetism. We present a theoretical method to estimate the interaction between the new variables in a neural system. We apply the method to some network systems and find some tendencies of autonomous neural network regulation.
Learning and optimization with cascaded VLSI neural network building-block chips
Duong, T.; Eberhardt, S. P.; Tran, M.; Daud, T.; Thakoor, A. P.
1992-01-01
To demonstrate the versatility of the building-block approach, two neural network applications were implemented on cascaded analog VLSI chips. Weights were implemented using 7-b multiplying digital-to-analog converter (MDAC) synapse circuits, with 31 x 32 and 32 x 32 synapses per chip. A novel learning algorithm compatible with analog VLSI was applied to the two-input parity problem. The algorithm combines dynamically evolving architecture with limited gradient-descent backpropagation for efficient and versatile supervised learning. To implement the learning algorithm in hardware, synapse circuits were paralleled for additional quantization levels. The hardware-in-the-loop learning system allocated 2-5 hidden neurons for parity problems. Also, a 7 x 7 assignment problem was mapped onto a cascaded 64-neuron fully connected feedback network. In 100 randomly selected problems, the network found optimal or good solutions in most cases, with settling times in the range of 7-100 microseconds.
Tool Steel Heat Treatment Optimization Using Neural Network Modeling
Podgornik, Bojan; Belič, Igor; Leskovšek, Vojteh; Godec, Matjaz
2016-08-01
Optimization of tool steel properties and corresponding heat treatment is mainly based on trial and error approach, which requires tremendous experimental work and resources. Therefore, there is a huge need for tools allowing prediction of mechanical properties of tool steels as a function of composition and heat treatment process variables. The aim of the present work was to explore the potential and possibilities of artificial neural network-based modeling to select and optimize vacuum heat treatment conditions depending on the hot work tool steel composition and required properties. In the current case training of the feedforward neural network with error backpropagation training scheme and four layers of neurons (8-20-20-2) scheme was based on the experimentally obtained tempering diagrams for ten different hot work tool steel compositions and at least two austenitizing temperatures. Results show that this type of modeling can be successfully used for detailed and multifunctional analysis of different influential parameters as well as to optimize heat treatment process of hot work tool steels depending on the composition. In terms of composition, V was found as the most beneficial alloying element increasing hardness and fracture toughness of hot work tool steel; Si, Mn, and Cr increase hardness but lead to reduced fracture toughness, while Mo has the opposite effect. Optimum concentration providing high KIc/HRC ratios would include 0.75 pct Si, 0.4 pct Mn, 5.1 pct Cr, 1.5 pct Mo, and 0.5 pct V, with the optimum heat treatment performed at lower austenitizing and intermediate tempering temperatures.
Mobility Prediction in Wireless Ad Hoc Networks using Neural Networks
Kaaniche, Heni
2010-01-01
Mobility prediction allows estimating the stability of paths in a mobile wireless Ad Hoc networks. Identifying stable paths helps to improve routing by reducing the overhead and the number of connection interruptions. In this paper, we introduce a neural network based method for mobility prediction in Ad Hoc networks. This method consists of a multi-layer and recurrent neural network using back propagation through time algorithm for training.
Neural network for sonogram gap filling
DEFF Research Database (Denmark)
Klebæk, Henrik; Jensen, Jørgen Arendt; Hansen, Lars Kai
1995-01-01
a neural network for predicting mean frequency of the velocity signal and its variance. The neural network then predicts the evolution of the mean and variance in the gaps, and the sonogram and audio signal are reconstructed from these. The technique is applied on in-vivo data from the carotid artery....... The neural network is trained on part of the data and the network is pruned by the optimal brain damage procedure in order to reduce the number of parameters in the network, and thereby reduce the risk of overfitting. The neural predictor is compared to using a linear filter for the mean and variance time......In duplex imaging both an anatomical B-mode image and a sonogram are acquired, and the time for data acquisition is divided between the two images. This gives problems when rapid B-mode image display is needed, since there is not time for measuring the velocity data. Gaps then appear...
Diagnosis of mechanical pumping system using neural networks and system parameters analysis
Energy Technology Data Exchange (ETDEWEB)
Tsai, Tai Ming; Wang, Wei Hui [National Taiwan Ocean University, Keelung (China)
2009-01-15
Normally, a mechanical pumping system is equipped to monitor some of the important input and output signals which are set to the prescribed values. This paper addressed dealing with these signals to establish the database of input- output relation by using a number of neural network models through learning algorithms. These signals encompass normal and abnormal running conditions. The abnormal running conditions were artificially generated. Meanwhile, for the purpose of setting up an on-line diagnosis network, the learning speed and accuracy of three kinds of networks, viz., the backpropagation (BPN), radial basis function (RBF) and adaptive linear (ADALINE) neural networks have been compared and assessed. The assessment criteria of the networks are compared with the correlation result matrix in terms of the neuron vectors. Both BPN and RBF are judged by the maximum vector based on the post-regression analysis, and the ADALINE is judged by the minimum vector based on the least mean square error analysis. By ignoring the neural network training time, it has been shown that if the mechanical diagnosis system is tackled off-line, the RBF method is suggested. However, for on-line diagnosis, the BPN method is recommended
NEURAL NETWORK ANALYSIS APPLICATION TO PERMEABILITY DETERMINATION OF FIBERGLASS AND CARBON PREFORMS
Institute of Scientific and Technical Information of China (English)
Hossein Golestanian; Mehrdad Poursina
2009-01-01
Preform permeability is an important process parameter in liquid injection molding of composite parts.This parameter is currently determined with time consuming and expensive experimental procedures.This paper presents the application of a back-propagation neural network to predicting fiber bed permeability of three types of reinforcement mats.Resin flow experiments were performed to simulate the injection cycle of a resin transfer molding process.The results of these experiments were used to prepare a training set for the back propagation neural network program.The reinforcements consisted of plain-weave carbon,plain-weave fiberglass,and chopped fiberglass mats.The effects of reinforcement type,porosity and injection pressure on fiber bed permeability in the preform principal directions were investigated.Therefore,in the training of the neural network reinforcement type,these process parameters were used as the input data.Fiber bed permeability values were the specified output of the program.As a result of the specified parameters,the program was able to estimate fiber bed permeability in the preform principal directions for any given processing condition.The results indicate that neural network may be used to predict preform permeability.
Model of Cholera Forecasting Using Artificial Neural Network in Chabahar City, Iran
Directory of Open Access Journals (Sweden)
Pezeshki
2016-02-01
Full Text Available Background Cholera as an endemic disease remains a health issue in Iran despite decrease in incidence. Since forecasting epidemic diseases provides appropriate preventive actions in disease spread, different forecasting methods including artificial neural networks have been developed to study parameters involved in incidence and spread of epidemic diseases such as cholera. Objectives In this study, cholera in rural area of Chabahar, Iran was investigated to achieve a proper forecasting model. Materials and Methods Data of cholera was gathered from 465 villages, of which 104 reported cholera during ten years period of study. Logistic regression modeling and correlate bivariate were used to determine risk factors and achieve possible predictive model one-hidden-layer perception neural network with backpropagation training algorithm and the sigmoid activation function was trained and tested between the two groups of infected and non-infected villages after preprocessing. For determining validity of prediction, the ROC diagram was used. The study variables included climate conditions and geographical parameters. Results After determining significant variables of cholera incidence, the described artificial neural network model was capable of forecasting cholera event among villages of test group with accuracy up to 80%. The highest accuracy was achieved when model was trained with variables that were significant in statistical analysis describing that the two methods confirm the result of each other. Conclusions Application of artificial neural networking assists forecasting cholera for adopting protective measures. For a more accurate prediction, comprehensive information is required including data on hygienic, social and demographic parameters.
An intelligent power factor corrector for power system using artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Bayindir, R.; Colak, I. [Department of Electrical Education, Faculty of Technical Education, Gazi University, Besevler, 06500 Ankara (Turkey); Sagiroglu, S. [Department of Computer Engineering, Faculty of Engineering and Architecture, Celal Bayar Bulvari, Gazi University, Maltepe, 06570 Ankara (Turkey)
2009-01-15
An intelligent power factor correction approach based on artificial neural networks (ANN) is introduced. Four learning algorithms, backpropagation (BP), delta-bar-delta (DBD), extended delta-bar-delta (EDBD) and directed random search (DRS), were used to train the ANNs. The best test results obtained from the ANN compensators trained with the four learning algorithms were first achieved. The parameters belonging to each neural compensator obtained from an off-line training were then inserted into a microcontroller for on-line usage. The results have shown that the selected intelligent compensators developed in this work might overcome the problems occurred in the literature providing accurate, simple and low-cost solution for compensation. (author)
Convolutional Neural Network for Image Recognition
Seifnashri, Sahand
2015-01-01
The aim of this project is to use machine learning techniques especially Convolutional Neural Networks for image processing. These techniques can be used for Quark-Gluon discrimination using calorimeters data, but unfortunately I didn’t manage to get the calorimeters data and I just used the Jet data fromminiaodsim(ak4 chs). The Jet data was not good enough for Convolutional Neural Network which is designed for ’image’ recognition. This report is made of twomain part, part one is mainly about implementing Convolutional Neural Network on unphysical data such as MNIST digits and CIFAR-10 dataset and part 2 is about the Jet data.
Multispectral-image fusion using neural networks
Kagel, Joseph H.; Platt, C. A.; Donaven, T. W.; Samstad, Eric A.
1990-08-01
A prototype system is being developed to demonstrate the use of neural network hardware to fuse multispectral imagery. This system consists of a neural network IC on a motherboard a circuit card assembly and a set of software routines hosted by a PC-class computer. Research in support of this consists of neural network simulations fusing 4 to 7 bands of Landsat imagery and fusing (separately) multiple bands of synthetic imagery. The simulations results and a description of the prototype system are presented. 1.
Multispectral image fusion using neural networks
Kagel, J. H.; Platt, C. A.; Donaven, T. W.; Samstad, E. A.
1990-01-01
A prototype system is being developed to demonstrate the use of neural network hardware to fuse multispectral imagery. This system consists of a neural network IC on a motherboard, a circuit card assembly, and a set of software routines hosted by a PC-class computer. Research in support of this consists of neural network simulations fusing 4 to 7 bands of Landsat imagery and fusing (separately) multiple bands of synthetic imagery. The simulations, results, and a description of the prototype system are presented.
Hidden neural networks: application to speech recognition
DEFF Research Database (Denmark)
Riis, Søren Kamaric
1998-01-01
We evaluate the hidden neural network HMM/NN hybrid on two speech recognition benchmark tasks; (1) task independent isolated word recognition on the Phonebook database, and (2) recognition of broad phoneme classes in continuous speech from the TIMIT database. It is shown how hidden neural networks...... (HNNs) with much fewer parameters than conventional HMMs and other hybrids can obtain comparable performance, and for the broad class task it is illustrated how the HNN can be applied as a purely transition based system, where acoustic context dependent transition probabilities are estimated by neural...... networks...
Neural network based temporal video segmentation.
Cao, X; Suganthan, P N
2002-01-01
The organization of video information in video databases requires automatic temporal segmentation with minimal user interaction. As neural networks are capable of learning the characteristics of various video segments and clustering them accordingly, in this paper, a neural network based technique is developed to segment the video sequence into shots automatically and with a minimum number of user-defined parameters. We propose to employ growing neural gas (GNG) networks and integrate multiple frame difference features to efficiently detect shot boundaries in the video. Experimental results are presented to illustrate the good performance of the proposed scheme on real video sequences. PMID:12370954
Estimation of Conditional Quantile using Neural Networks
DEFF Research Database (Denmark)
Kulczycki, P.; Schiøler, Henrik
1999-01-01
The problem of estimating conditional quantiles using neural networks is investigated here. A basic structure is developed using the methodology of kernel estimation, and a theory guaranteeing con-sistency on a mild set of assumptions is provided. The constructed structure constitutes a basis...... for the design of a variety of different neural networks, some of which are considered in detail. The task of estimating conditional quantiles is related to Bayes point estimation whereby a broad range of applications within engineering, economics and management can be suggested. Numerical results illustrating...... the capabilities of the elaborated neural network are also given....
Neural Network to Identify Individuals at Health Risk
Directory of Open Access Journals (Sweden)
Tanja Magoc
2011-04-01
Full Text Available The risk of diseases such as heart attack and high blood pressure could be reduced by adequate physical activity. However, even though majority of general population claims to perform some physical exercise, only a minority exercises enough to keep a healthy living style. Thus, physical inactivity has become one of the major concerns of public health in the past decade. Research shows that the highest decrease in physical activity is noticed from high school to college. Thus, it is of great importance to quickly identify college students at health risk due to physical inactivity. Research also shows that the level of physical activity of an individual is highly correlated to demographic features such as race and gender, as well as self motivation and support from family and friends. This information could be collected from each student via a 20 minute questionnaire, but the time needed to distribute and analyze each questionnaire is infeasible on a collegiate campus. Thus, we propose an automatic identifier of students at risk, so that these students could easier be targeted by collegiate campuses and physical activity promotion departments. We present in this paper preliminary results of a supervised backpropagation multilayer neural network for classifying students into at-risk or not at-risk group.
AN APPLICATION OF SPEAKER RECOGNITION USING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Murat CANER
2006-02-01
Full Text Available In this study an artificial neural network (ANN is implemented, which has been used frequently as an implementation model in recent years, to recognize speaker identification. Generally, recognition is consist of three stages that, processing of signal, obtaining attributes and comparing them. Speech samples are transformed into digital data according to voice card of PC. In the analysis of voice stage, recurrent periods and white noise of voice data are trimmed by hamming window method and voice attribute part of the digital data is obtained. For obtaining attribute of voice data LPC (linear predictive coding and DFT (discrete fourier transform methods are used. Of those 28 coefficents, that is used for speaker recognition, 16 were obtained by the analysis of DFT and 12 were obtained by the analysis of LPC. The parameters that represent speaker voice, is used for training and test of ANN. Multilayer perceptron model is used as an architecture of ANN and backpropagation algorithm is used for training method. Voices of "a" is taken from 7 different person and their attributes are found. ANN is trained with these features to find the speaker who is the owner of the sample voice. And then using the test data that is not used for training part, recognition achievement of ANN is tested. As a result, good results were obtained with low failure rate.
Artificial Neural Network-Based System for PET Volume Segmentation
Directory of Open Access Journals (Sweden)
Mhd Saeed Sharif
2010-01-01
Full Text Available Tumour detection, classification, and quantification in positron emission tomography (PET imaging at early stage of disease are important issues for clinical diagnosis, assessment of response to treatment, and radiotherapy planning. Many techniques have been proposed for segmenting medical imaging data; however, some of the approaches have poor performance, large inaccuracy, and require substantial computation time for analysing large medical volumes. Artificial intelligence (AI approaches can provide improved accuracy and save decent amount of time. Artificial neural networks (ANNs, as one of the best AI techniques, have the capability to classify and quantify precisely lesions and model the clinical evaluation for a specific problem. This paper presents a novel application of ANNs in the wavelet domain for PET volume segmentation. ANN performance evaluation using different training algorithms in both spatial and wavelet domains with a different number of neurons in the hidden layer is also presented. The best number of neurons in the hidden layer is determined according to the experimental results, which is also stated Levenberg-Marquardt backpropagation training algorithm as the best training approach for the proposed application. The proposed intelligent system results are compared with those obtained using conventional techniques including thresholding and clustering based approaches. Experimental and Monte Carlo simulated PET phantom data sets and clinical PET volumes of nonsmall cell lung cancer patients were utilised to validate the proposed algorithm which has demonstrated promising results.
Nonequilibrium landscape theory of neural networks.
Yan, Han; Zhao, Lei; Hu, Liang; Wang, Xidi; Wang, Erkang; Wang, Jin
2013-11-01
The brain map project aims to map out the neuron connections of the human brain. Even with all of the wirings mapped out, the global and physical understandings of the function and behavior are still challenging. Hopfield quantified the learning and memory process of symmetrically connected neural networks globally through equilibrium energy. The energy basins of attractions represent memories, and the memory retrieval dynamics is determined by the energy gradient. However, the realistic neural networks are asymmetrically connected, and oscillations cannot emerge from symmetric neural networks. Here, we developed a nonequilibrium landscape-flux theory for realistic asymmetrically connected neural networks. We uncovered the underlying potential landscape and the associated Lyapunov function for quantifying the global stability and function. We found the dynamics and oscillations in human brains responsible for cognitive processes and physiological rhythm regulations are determined not only by the landscape gradient but also by the flux. We found that the flux is closely related to the degrees of the asymmetric connections in neural networks and is the origin of the neural oscillations. The neural oscillation landscape shows a closed-ring attractor topology. The landscape gradient attracts the network down to the ring. The flux is responsible for coherent oscillations on the ring. We suggest the flux may provide the driving force for associations among memories. We applied our theory to rapid-eye movement sleep cycle. We identified the key regulation factors for function through global sensitivity analysis of landscape topography against wirings, which are in good agreements with experiments.
Neural Network for Estimating Conditional Distribution
DEFF Research Database (Denmark)
Schiøler, Henrik; Kulczycki, P.
Neural networks for estimating conditional distributions and their associated quantiles are investigated in this paper. A basic network structure is developed on the basis of kernel estimation theory, and consistency is proved from a mild set of assumptions. A number of applications within...... statistcs, decision theory and signal processing are suggested, and a numerical example illustrating the capabilities of the elaborated network is given...
A COMPREHENSIVE EVOLUTIONARY APPROACH FOR NEURAL NETWORK ENSEMBLES AUTOMATIC DESIGN
Bukhtoyarov, V.; Semenkin, E.
2010-01-01
A new comprehensive approach for neural network ensembles design is proposed. It consists of a method of neural networks automatic design and a method of automatic formation of an ensemble solution on the basis of separate neural networks solutions. It is demonstrated that the proposed approach is not less effective than a number of other approaches for neural network ensembles design.
A simplification of the backpropagation-through-time algorithm for optimal neurocontrol.
Bersini, H; Gorrini, V
1997-01-01
Backpropagation-through-time (BPTT) is the temporal extension of backpropagation which allows a multilayer neural network to approximate an optimal state-feedback control law provided some prior knowledge (Jacobian matrices) of the process is available. In this paper, a simplified version of the BPTT algorithm is proposed which more closely respects the principle of optimality of dynamic programming. Besides being simpler, the new algorithm is less time-consuming and allows in some cases the discovery of better control laws. A formal justification of this simplification is attempted by mixing the Lagrangian calculus underlying BPTT with Bellman-Hamilton-Jacobi equations. The improvements due to this simplification are illustrated by two optimal control problems: the rendezvous and the bioreactor. PMID:18255645
International Nuclear Information System (INIS)
Significant advances have been made in recent years to improve calibration methodology and dose calculation algorithm in the fields of TL dosimetry. This process was accelerated in the past decade particularly in the Republic of Korea by the need to meet mandatory national accreditation requirements. The objective of this study is to develop a new algorithm to replace the simplistic decision tree algorithms by the more sophisticated neural networks in hopes of achieving a higher degree of accuracy and precision in personnel dosimetry system. The original hypothesis of this work is that the spectral information of an X and γ-ray fields may be obtained by the analysis of the response of a multi-element system. In this study, a feed forward neural network using the error back-propagation method with Bayesian optimization was designed for the response unfolding procedure. The response functions of the single element to photons were calculated by application of a computational Monte-Carlo model for an energy range from 10 keV to 2 MeV with different spectral proportions. The training of the artificial neural network was based on the computation of responses of a four-element system for the back-propagation method. The validation of the proposed algorithm was investigated by unfolding the 10 computed responses for arbitrary mixed gamma fields and the spectra resulting from the unfolding procedure agree well with the original spectra. (author)
Neural networks for NOx-emission
International Nuclear Information System (INIS)
The government wants to restrict nitrogen oxide emissions. However, continuous measurement of these emissions is expensive and maintenance-sensitive. A prediction model based on the use of neural networks might be a reliable and efficient alternative
Neural Networks in Mobile Robot Motion
Directory of Open Access Journals (Sweden)
Danica Janglova
2008-11-01
Full Text Available This paper deals with a path planning and intelligent control of an autonomous robot which should move safely in partially structured environment. This environment may involve any number of obstacles of arbitrary shape and size; some of them are allowed to move. We describe our approach to solving the motion-planning problem in mobile robot control using neural networks-based technique. Our method of the construction of a collision-free path for moving robot among obstacles is based on two neural networks. The first neural network is used to determine the "free" space using ultrasound range finder data. The second neural network "finds" a safe direction for the next robot section of the path in the workspace while avoiding the nearest obstacles. Simulation examples of generated path with proposed techniques will be presented.
Neural Network Based 3D Surface Reconstruction
Directory of Open Access Journals (Sweden)
Vincy Joseph
2009-11-01
Full Text Available This paper proposes a novel neural-network-based adaptive hybrid-reflectance three-dimensional (3-D surface reconstruction model. The neural network combines the diffuse and specular components into a hybrid model. The proposed model considers the characteristics of each point and the variant albedo to prevent the reconstructed surface from being distorted. The neural network inputs are the pixel values of the two-dimensional images to be reconstructed. The normal vectors of the surface can then be obtained from the output of the neural network after supervised learning, where the illuminant direction does not have to be known in advance. Finally, the obtained normal vectors can be applied to integration method when reconstructing 3-D objects. Facial images were used for training in the proposed approach
TIME SERIES FORECASTING USING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
BOGDAN OANCEA
2013-05-01
Full Text Available Recent studies have shown the classification and prediction power of the Neural Networks. It has been demonstrated that a NN can approximate any continuous function. Neural networks have been successfully used for forecasting of financial data series. The classical methods used for time series prediction like Box-Jenkins or ARIMA assumes that there is a linear relationship between inputs and outputs. Neural Networks have the advantage that can approximate nonlinear functions. In this paper we compared the performances of different feed forward and recurrent neural networks and training algorithms for predicting the exchange rate EUR/RON and USD/RON. We used data series with daily exchange rates starting from 2005 until 2013.
Additive Feed Forward Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1999-01-01
This paper demonstrates a method to control a non-linear, multivariable, noisy process using trained neural networks. The basis for the method is a trained neural network controller acting as the inverse process model. A training method for obtaining such an inverse process model is applied....... A suitable 'shaped' (low-pass filtered) reference is used to overcome problems with excessive control action when using a controller acting as the inverse process model. The control concept is Additive Feed Forward Control, where the trained neural network controller, acting as the inverse process model......, is placed in a supplementary pure feed-forward path to an existing feedback controller. This concept benefits from the fact, that an existing, traditional designed, feedback controller can be retained without any modifications, and after training the connection of the neural network feed-forward controller...
Modelling of solar energy potential in Nigeria using an artificial neural network model
International Nuclear Information System (INIS)
In this study, an artificial neural network (ANN) based model for prediction of solar energy potential in Nigeria (lat. 4-14oN, log. 2-15oE) was developed. Standard multilayered, feed-forward, back-propagation neural networks with different architecture were designed using neural toolbox for MATLAB. Geographical and meteorological data of 195 cities in Nigeria for period of 10 years (1983-1993) from the NASA geo-satellite database were used for the training and testing the network. Meteorological and geographical data (latitude, longitude, altitude, month, mean sunshine duration, mean temperature, and relative humidity) were used as inputs to the network, while the solar radiation intensity was used as the output of the network. The results show that the correlation coefficients between the ANN predictions and actual mean monthly global solar radiation intensities for training and testing datasets were higher than 90%, thus suggesting a high reliability of the model for evaluation of solar radiation in locations where solar radiation data are not available. The predicted solar radiation values from the model were given in form of monthly maps. The monthly mean solar radiation potential in northern and southern regions ranged from 7.01-5.62 to 5.43-3.54 kW h/m2 day, respectively. A graphical user interface (GUI) was developed for the application of the model. The model can be used easily for estimation of solar radiation for preliminary design of solar applications.
SAR ATR Based on Convolutional Neural Network
Tian Zhuangzhuang; Zhan Ronghui; Hu Jiemin; Zhang Jun
2016-01-01
This study presents a new method of Synthetic Aperture Radar (SAR) image target recognition based on a convolutional neural network. First, we introduce a class separability measure into the cost function to improve this network’s ability to distinguish between categories. Then, we extract SAR image features using the improved convolutional neural network and classify these features using a support vector machine. Experimental results using moving and stationary target acquisition and recogni...
Applications of Pulse-Coupled Neural Networks
Ma, Yide; Wang, Zhaobin
2011-01-01
"Applications of Pulse-Coupled Neural Networks" explores the fields of image processing, including image filtering, image segmentation, image fusion, image coding, image retrieval, and biometric recognition, and the role of pulse-coupled neural networks in these fields. This book is intended for researchers and graduate students in artificial intelligence, pattern recognition, electronic engineering, and computer science. Prof. Yide Ma conducts research on intelligent information processing, biomedical image processing, and embedded system development at the School of Information Sci
Neural networks, D0, and the SSC
International Nuclear Information System (INIS)
We outline several exploratory studies involving neural network simulations applied to pattern recognition in high energy physics. We describe the D0 data acquisition system and a natual means by which algorithms derived from neural networks techniques may be incorporated into recently developed hardware associated with the D0 MicroVAX farm nodes. Such applications to the event filtering needed by SSC detectors look interesting. 10 refs., 11 figs
An Introduction to Convolutional Neural Networks
O'Shea, Keiron; Nash, Ryan
2015-01-01
The field of machine learning has taken a dramatic twist in recent times, with the rise of the Artificial Neural Network (ANN). These biologically inspired computational models are able to far exceed the performance of previous forms of artificial intelligence in common machine learning tasks. One of the most impressive forms of ANN architecture is that of the Convolutional Neural Network (CNN). CNNs are primarily used to solve difficult image-driven pattern recognition tasks and with their p...
Parameterizing Stellar Spectra Using Deep Neural Networks
Li, Xiangru; Pan, Ruyang
2016-01-01
This work investigates the spectrum parameterization problem using deep neural networks (DNNs). The proposed scheme consists of the following procedures: first, the configuration of a DNN is initialized using a series of autoencoder neural networks; second, the DNN is fine-tuned using a gradient descent scheme; third, stellar parameters ($T_{eff}$, log$~g$, and [Fe/H]) are estimated using the obtained DNN. This scheme was evaluated on both real spectra from SDSS/SEGUE and synthetic spectra ca...
Hindcasting cyclonic waves using neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Rao, S.; Chakravarty, N.V.
for computing extreme wave conditions or design wave statistics. As far as Indian seas are concerned recorded wave data are available for short periods for some places along the coasts. Estimation of wave parameters by numerical wave forecasting schemes.... Some applications of neural network (NN) in wave forecasting are carried out by Deo and Naidu (1999), and Prabaharan (2001). Londhe and Deo (2001) have worked on wave propagation using neural network. This paper describes about hindcasting of wave...
Density functional and neural network analysis
DEFF Research Database (Denmark)
Jalkanen, K. J.; Suhai, S.; Bohr, Henrik
1997-01-01
dichroism (VCD) intensities. The large changes due to hydration on the structures, relative stability of conformers, and in the VA and VCD spectra observed experimentally are reproduced by the DFT calculations. Furthermore a neural network was constructed for reproducing the inverse scattering data (infer...... the structural coordinates from spectroscopic data) that the DFT method could produce. Finally the neural network performances are used to monitor a sensitivity or dependence analysis of the importance of secondary structures....
Pattern Recognition Using Neural Networks
Directory of Open Access Journals (Sweden)
Santaji Ghorpade
2010-12-01
Full Text Available Face Recognition has been identified as one of the attracting research areas and it has drawn the attention of many researchers due to its varying applications such as security systems, medical systems,entertainment, etc. Face recognition is the preferred mode of identification by humans: it is natural,robust and non-intrusive. A wide variety of systems requires reliable personal recognition schemes to either confirm or determine the identity of an individual requesting their services. The purpose of such schemes is to ensure that the rendered services are accessed only by a legitimate user and no one else.Examples of such applications include secure access to buildings, computer systems, laptops, cellular phones, and ATMs. In the absence of robust personal recognition schemes, these systems are vulnerable to the wiles of an impostor.In this paper we have developed and illustrated a recognition system for human faces using a novel Kohonen self-organizing map (SOM or Self-Organizing Feature Map (SOFM based retrieval system.SOM has good feature extracting property due to its topological ordering. The Facial Analytics results for the 400 images of AT&T database reflects that the face recognition rate using one of the neural network algorithm SOM is 85.5% for 40 persons.
Deep Learning with Darwin: Evolutionary Synthesis of Deep Neural Networks
Shafiee, Mohammad Javad; Mishra, Akshaya; Wong, Alexander
2016-01-01
Taking inspiration from biological evolution, we explore the idea of "Can deep neural networks evolve naturally over successive generations into highly efficient deep neural networks?" by introducing the notion of synthesizing new highly efficient, yet powerful deep neural networks over successive generations via an evolutionary process from ancestor deep neural networks. The architectural traits of ancestor deep neural networks are encoded using synaptic probability models, which can be view...
Hopfield neural network based on ant system
Institute of Scientific and Technical Information of China (English)
洪炳镕; 金飞虎; 郭琦
2004-01-01
Hopfield neural network is a single layer feedforward neural network. Hopfield network requires some control parameters to be carefully selected, else the network is apt to converge to local minimum. An ant system is a nature inspired meta heuristic algorithm. It has been applied to several combinatorial optimization problems such as Traveling Salesman Problem, Scheduling Problems, etc. This paper will show an ant system may be used in tuning the network control parameters by a group of cooperated ants. The major advantage of this network is to adjust the network parameters automatically, avoiding a blind search for the set of control parameters.This network was tested on two TSP problems, 5 cities and 10 cities. The results have shown an obvious improvement.
Implementation of a Vision System for a Landmine Detecting Robot Using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Roger Achkar
2012-09-01
Full Text Available Landmines, specifically anti-tank mines, cluster bombs, and unexploded ordnance form a serious problem in many countries. Several landmine sweeping techniques are used for minesweeping. This paper presents the design and the implementation of the vision system of an autonomous robot for landmines localization. The proposed work develops state-of-the-art techniques in digital image processing for pre-processing captured images of the contaminated area. After enhancement, Artificial Neural Network (ANN is used in order to identify, recognize and classify the landmines’ make and model. The Back-Propagation algorithm is used for training the network. The proposed work proved to be able to identify and classify different types of landmines under various conditions (rotated landmine, partially covered landmine with a success rate of up to 90%.
Implementation of a Vision System for a Landmine Detecting Robot Using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Roger Achkar
2012-10-01
Full Text Available Landmines, specifically anti-tank mines, cluster bombs, and unexploded ordnance form a serious problemin many countries. Several landmine sweeping techniques are used for minesweeping. This paper presentsthe design and the implementation of the vision system of an autonomous robot for landmines localization.The proposed work develops state-of-the-art techniques in digital image processing for pre-processingcaptured images of the contaminated area. After enhancement, Artificial Neural Network (ANN is used inorder to identify, recognize and classify the landmines’ make and model. The Back-Propagation algorithmis used for training the network. The proposed work proved to be able to identify and classify different typesof landmines under various conditions (rotated landmine, partially covered landmine with a success rateof up to 90%.
Directory of Open Access Journals (Sweden)
Héliton Pandorfi
2016-06-01
Full Text Available ABSTRACT This study aimed to investigate the applicability of artificial neural networks (ANNs in the prediction of evapotranspiration of sweet pepper cultivated in a greenhouse. The used data encompass the second crop cycle, from September 2013 to February 2014, constituting 135 days of daily meteorological data, referring to the following variables: temperature and relative air humidity, wind speed and solar radiation (input variables, as well as evapotranspiration (output variable, determined using data obtained by load-cell weighing lysimeter. The recorded data were divided into three sets for training, testing and validation. The ANN learning model recognized the evapotranspiration patterns with acceptable accuracy, with mean square error of 0.005, in comparison to the data recorded in the lysimeter, with coefficient of determination of 0.87, demonstrating the best approximation for the 4-21-1 network architecture, with multilayers, error back-propagation learning algorithm and learning rate of 0.01.
Highly Accurate Multi-layer Perceptron Neural Network for Air Data System
Directory of Open Access Journals (Sweden)
H. S. Krishna
2009-11-01
Full Text Available The error backpropagation multi-layer perceptron algorithm is revisited. This algorithm is used to train and validate two models of three-layer neural networks that can be used to calibrate a 5-hole pressure probe. This paper addresses Occam's Razor problem as it describes the adhoc training methodology applied to improve accuracy and sensitivity. The trained outputs from 5-4-3 feed-forward network architecture with jump connection are comparable to second decimal digit (~0.05 accuracy, hitherto unreported in literature.Defence Science Journal, 2009, 59(6, pp.670-674, DOI:http://dx.doi.org/10.14429/dsj.59.1574
Learning to train neural networks for real-world control problems
Feldkamp, Lee A.; Puskorius, G. V.; Davis, L. I., Jr.; Yuan, F.
1994-01-01
Over the past three years, our group has concentrated on the application of neural network methods to the training of controllers for real-world systems. This presentation describes our approach, surveys what we have found to be important, mentions some contributions to the field, and shows some representative results. Topics discussed include: (1) executing model studies as rehearsal for experimental studies; (2) the importance of correct derivatives; (3) effective training with second-order (DEKF) methods; (4) the efficacy of time-lagged recurrent networks; (5) liberation from the tyranny of the control cycle using asynchronous truncated backpropagation through time; and (6) multistream training for robustness. Results from model studies of automotive idle speed control serve as examples for several of these topics.
Directory of Open Access Journals (Sweden)
Nandkumar Wagh
2014-01-01
Full Text Available Continuity of power supply is of utmost importance to the consumers and is only possible by coordination and reliable operation of power system components. Power transformer is such a prime equipment of the transmission and distribution system and needs to be continuously monitored for its well-being. Since ratio methods cannot provide correct diagnosis due to the borderline problems and the probability of existence of multiple faults, artificial intelligence could be the best approach. Dissolved gas analysis (DGA interpretation may provide an insight into the developing incipient faults and is adopted as the preliminary diagnosis tool. In the proposed work, a comparison of the diagnosis ability of backpropagation (BP, radial basis function (RBF neural network, and adaptive neurofuzzy inference system (ANFIS has been investigated and the diagnosis results in terms of error measure, accuracy, network training time, and number of iterations are presented.
Fastest learning in small world neural networks
Simard, D.; Nadeau, L; Kröger, H.
2004-01-01
We investigate supervised learning in neural networks. We consider a multi-layered feed-forward network with back propagation. We find that the network of small-world connectivity reduces the learning error and learning time when compared to the networks of regular or random connectivity. Our study has potential applications in the domain of data-mining, image processing, speech recognition, and pattern recognition.
Option Pricing Using Bayesian Neural Networks
Pires, Michael Maio
2007-01-01
Options have provided a field of much study because of the complexity involved in pricing them. The Black-Scholes equations were developed to price options but they are only valid for European styled options. There is added complexity when trying to price American styled options and this is why the use of neural networks has been proposed. Neural Networks are able to predict outcomes based on past data. The inputs to the networks here are stock volatility, strike price and time to maturity with the output of the network being the call option price. There are two techniques for Bayesian neural networks used. One is Automatic Relevance Determination (for Gaussian Approximation) and one is a Hybrid Monte Carlo method, both used with Multi-Layer Perceptrons.
Salu, Yehuda; Tilton, James
1993-01-01
The classification of multispectral image data obtained from satellites has become an important tool for generating ground cover maps. This study deals with the application of nonparametric pixel-by-pixel classification methods in the classification of pixels, based on their multispectral data. A new neural network, the Binary Diamond, is introduced, and its performance is compared with a nearest neighbor algorithm and a back-propagation network. The Binary Diamond is a multilayer, feed-forward neural network, which learns from examples in unsupervised, 'one-shot' mode. It recruits its neurons according to the actual training set, as it learns. The comparisons of the algorithms were done by using a realistic data base, consisting of approximately 90,000 Landsat 4 Thematic Mapper pixels. The Binary Diamond and the nearest neighbor performances were close, with some advantages to the Binary Diamond. The performance of the back-propagation network lagged behind. An efficient nearest neighbor algorithm, the binned nearest neighbor, is described. Ways for improving the performances, such as merging categories, and analyzing nonboundary pixels, are addressed and evaluated.
Artificial astrocytes improve neural network performance.
Directory of Open Access Journals (Sweden)
Ana B Porto-Pazos
Full Text Available Compelling evidence indicates the existence of bidirectional communication between astrocytes and neurons. Astrocytes, a type of glial cells classically considered to be passive supportive cells, have been recently demonstrated to be actively involved in the processing and regulation of synaptic information, suggesting that brain function arises from the activity of neuron-glia networks. However, the actual impact of astrocytes in neural network function is largely unknown and its application in artificial intelligence remains untested. We have investigated the consequences of including artificial astrocytes, which present the biologically defined properties involved in astrocyte-neuron communication, on artificial neural network performance. Using connectionist systems and evolutionary algorithms, we have compared the performance of artificial neural networks (NN and artificial neuron-glia networks (NGN to solve classification problems. We show that the degree of success of NGN is superior to NN. Analysis of performances of NN with different number of neurons or different architectures indicate that the effects of NGN cannot be accounted for an increased number of network elements, but rather they are specifically due to astrocytes. Furthermore, the relative efficacy of NGN vs. NN increases as the complexity of the network increases. These results indicate that artificial astrocytes improve neural network performance, and established the concept of Artificial Neuron-Glia Networks, which represents a novel concept in Artificial Intelligence with implications in computational science as well as in the understanding of brain function.
Neural Network course changing and track keeping controller for a submarine
International Nuclear Information System (INIS)
This paper present the performance of ANN (Artificial Neural Networks) technique for the development of controller for heading motions of submarine. AMLP (Multi-Layer Preceptron) FFNN (Feed-Forward Neural Network) is used for development of controller. Supervised type of learning is used for training of network by using back-propagation Algorithm. The training is performed by providing a nonlinear sliding mode controller as a supervisor. The development of controller is based on nonlinear decoupled heading model of a submarine without consideration of external environmental disturbances. To demonstrate the robustness of controller the performance of controller is tested in different operating conditions: course changing, track keeping and under the influence of sea currents. Simulations results show that in all cases, the heading error comes to zero, which indicates that the actual heading converges to the desired heading in finite time. The maximum error is observed 0.50 for 450 command angle, in presence of sea currents. The result demonstrates that the performance neural network controller has been robust. (author)
Neural network approaches to tracer identification as related to PIV research
International Nuclear Information System (INIS)
Neural networks have become very powerful tools in many fields of interest. This thesis examines the application of neural networks to another rapidly growing field flow visualization. Flow visualization research is used to experimentally determine how fluids behave and to verify computational results obtained analytically. A form of flow visualization, particle image velocimetry (PIV). determines the flow movement by tracking neutrally buoyant particles suspended in the fluid. PIV research has begun to improve rapidly with the advent of digital imagers, which can quickly digitize an image into arrays of grey levels. These grey level arrays are analyzed to determine the location of the tracer particles. Once the particles positions have been determined across multiple image frames, it is possible to track their movements, and hence, the flow of the fluid. This thesis explores the potential of several different neural networks to identify the positions of the tracer particles. Among these networks are Backpropagation, Kohonen (counter-propagation), and Cellular. Each of these algorithms were employed in their basic form, and training and testing were performed on a synthetic grey level array. Modifications were then made to them in attempts to improve the results
Using neural networks to assess flight deck human–automation interaction
International Nuclear Information System (INIS)
The increased complexity and interconnectivity of flight deck automation has made the prediction of human–automation interaction (HAI) difficult and has resulted in a number of accidents and incidents. There is a need to develop objective and robust methods by which the changes in HAI brought about by the introduction of new automation into the flight deck could be predicted and assessed prior to implementation and without use of extensive simulation. This paper presents a method to model a parametrization of flight deck automation known as HART and link it to HAI consequences using a backpropagation neural network approach. The transformation of the HART into a computational model suitable for modeling as a neural network is described. To test and train the network data were collected from 40 airline pilots for six HAI consequences based on one scenario family consisting of a baseline and four variants. For a binary classification of HAI consequences, the neural network successfully classified 62–78.5% depending on the consequence. The results were verified using a decision tree analysis
Neural network approaches to tracer identification as related to PIV research
Energy Technology Data Exchange (ETDEWEB)
Seeley, C.H. Jr.
1992-12-01
Neural networks have become very powerful tools in many fields of interest. This thesis examines the application of neural networks to another rapidly growing field flow visualization. Flow visualization research is used to experimentally determine how fluids behave and to verify computational results obtained analytically. A form of flow visualization, particle image velocimetry (PIV). determines the flow movement by tracking neutrally buoyant particles suspended in the fluid. PIV research has begun to improve rapidly with the advent of digital imagers, which can quickly digitize an image into arrays of grey levels. These grey level arrays are analyzed to determine the location of the tracer particles. Once the particles positions have been determined across multiple image frames, it is possible to track their movements, and hence, the flow of the fluid. This thesis explores the potential of several different neural networks to identify the positions of the tracer particles. Among these networks are Backpropagation, Kohonen (counter-propagation), and Cellular. Each of these algorithms were employed in their basic form, and training and testing were performed on a synthetic grey level array. Modifications were then made to them in attempts to improve the results.
Hermite Functional Link Neural Network for Solving the Van der Pol-Duffing Oscillator Equation.
Mall, Susmita; Chakraverty, S
2016-08-01
Hermite polynomial-based functional link artificial neural network (FLANN) is proposed here to solve the Van der Pol-Duffing oscillator equation. A single-layer hermite neural network (HeNN) model is used, where a hidden layer is replaced by expansion block of input pattern using Hermite orthogonal polynomials. A feedforward neural network model with the unsupervised error backpropagation principle is used for modifying the network parameters and minimizing the computed error function. The Van der Pol-Duffing and Duffing oscillator equations may not be solved exactly. Here, approximate solutions of these types of equations have been obtained by applying the HeNN model for the first time. Three mathematical example problems and two real-life application problems of Van der Pol-Duffing oscillator equation, extracting the features of early mechanical failure signal and weak signal detection problems, are solved using the proposed HeNN method. HeNN approximate solutions have been compared with results obtained by the well known Runge-Kutta method. Computed results are depicted in term of graphs. After training the HeNN model, we may use it as a black box to get numerical results at any arbitrary point in the domain. Thus, the proposed HeNN method is efficient. The results reveal that this method is reliable and can be applied to other nonlinear problems too.
Pattern Classification using Simplified Neural Networks
Kamruzzaman, S M
2010-01-01
In recent years, many neural network models have been proposed for pattern classification, function approximation and regression problems. This paper presents an approach for classifying patterns from simplified NNs. Although the predictive accuracy of ANNs is often higher than that of other methods or human experts, it is often said that ANNs are practically "black boxes", due to the complexity of the networks. In this paper, we have an attempted to open up these black boxes by reducing the complexity of the network. The factor makes this possible is the pruning algorithm. By eliminating redundant weights, redundant input and hidden units are identified and removed from the network. Using the pruning algorithm, we have been able to prune networks such that only a few input units, hidden units and connections left yield a simplified network. Experimental results on several benchmarks problems in neural networks show the effectiveness of the proposed approach with good generalization ability.
Weight discretization paradigm for optical neural networks
Fiesler, Emile; Choudry, Amar; Caulfield, H. John
1990-08-01
Neural networks are a primary candidate architecture for optical computing. One of the major problems in using neural networks for optical computers is that the information holders: the interconnection strengths (or weights) are normally real valued (continuous), whereas optics (light) is only capable of representing a few distinguishable intensity levels (discrete). In this paper a weight discretization paradigm is presented for back(ward error) propagation neural networks which can work with a very limited number of discretization levels. The number of interconnections in a (fully connected) neural network grows quadratically with the number of neurons of the network. Optics can handle a large number of interconnections because of the fact that light beams do not interfere with each other. A vast amount of light beams can therefore be used per unit of area. However the number of different values one can represent in a light beam is very limited. A flexible, portable (machine independent) neural network software package which is capable of weight discretization, is presented. The development of the software and some experiments have been done on personal computers. The major part of the testing, which requires a lot of computation, has been done using a CRAY X-MP/24 super computer.
Estimating Conditional Distributions by Neural Networks
DEFF Research Database (Denmark)
Kulczycki, P.; Schiøler, Henrik
1998-01-01
Neural Networks for estimating conditionaldistributions and their associated quantiles are investigated in this paper. A basic network structure is developed on the basis of kernel estimation theory, and consistency property is considered from a mild set of assumptions. A number of applications...
Comparing artificial and biological dynamical neural networks
McAulay, Alastair D.
2006-05-01
Modern computers can be made more friendly and otherwise improved by making them behave more like humans. Perhaps we can learn how to do this from biology in which human brains evolved over a long period of time. Therefore, we first explain a commonly used biological neural network (BNN) model, the Wilson-Cowan neural oscillator, that has cross-coupled excitatory (positive) and inhibitory (negative) neurons. The two types of neurons are used for frequency modulation communication between neurons which provides immunity to electromagnetic interference. We then evolve, for the first time, an artificial neural network (ANN) to perform the same task. Two dynamical feed-forward artificial neural networks use cross-coupling feedback (like that in a flip-flop) to form an ANN nonlinear dynamic neural oscillator with the same equations as the Wilson-Cowan neural oscillator. Finally we show, through simulation, that the equations perform the basic neural threshold function, switching between stable zero output and a stable oscillation, that is a stable limit cycle. Optical implementation with an injected laser diode and future research are discussed.
Design of Robust Neural Network Classifiers
DEFF Research Database (Denmark)
Larsen, Jan; Andersen, Lars Nonboe; Hintz-Madsen, Mads;
1998-01-01
This paper addresses a new framework for designing robust neural network classifiers. The network is optimized using the maximum a posteriori technique, i.e., the cost function is the sum of the log-likelihood and a regularization term (prior). In order to perform robust classification, we present...... a modified likelihood function which incorporates the potential risk of outliers in the data. This leads to the introduction of a new parameter, the outlier probability. Designing the neural classifier involves optimization of network weights as well as outlier probability and regularization parameters. We...
Electronic device aspects of neural network memories
Lambe, J.; Moopenn, A.; Thakoor, A. P.
1985-01-01
The basic issues related to the electronic implementation of the neural network model (NNM) for content addressable memories are examined. A brief introduction to the principles of the NNM is followed by an analysis of the information storage of the neural network in the form of a binary connection matrix and the recall capability of such matrix memories based on a hardware simulation study. In addition, materials and device architecture issues involved in the future realization of such networks in VLSI-compatible ultrahigh-density memories are considered. A possible space application of such devices would be in the area of large-scale information storage without mechanical devices.
Improving neural network performance on SIMD architectures
Limonova, Elena; Ilin, Dmitry; Nikolaev, Dmitry
2015-12-01
Neural network calculations for the image recognition problems can be very time consuming. In this paper we propose three methods of increasing neural network performance on SIMD architectures. The usage of SIMD extensions is a way to speed up neural network processing available for a number of modern CPUs. In our experiments, we use ARM NEON as SIMD architecture example. The first method deals with half float data type for matrix computations. The second method describes fixed-point data type for the same purpose. The third method considers vectorized activation functions implementation. For each method we set up a series of experiments for convolutional and fully connected networks designed for image recognition task.
Neural-networks-based Modelling and a Fuzzy Neural Networks Controller of MCFC
Institute of Scientific and Technical Information of China (English)
无
2002-01-01
Molten Carbonate Fuel Cells (MCFC) are produced with a highly efficient and clean power generation technology which will soon be widely utilized. The temperature characters of MCFC stack are briefly analyzed. A radial basis function (RBF) neural networks identification technology is applied to set up the temperature nonlinear model of MCFC stack, and the identification structure, algorithm and modeling training process are given in detail. A fuzzy controller of MCFC stack is designed. In order to improve its online control ability, a neural network trained by the I/O data of a fuzzy controller is designed. The neural networks can memorize and expand the inference rules of the fuzzy controller and substitute for the fuzzy controller to control MCFC stack online. A detailed design of the controller is given. The validity of MCFC stack modelling based on neural networks and the superior performance of the fuzzy neural networks controller are proved by Simulations.
Stability analysis of discrete-time BAM neural networks based on standard neural network models
Institute of Scientific and Technical Information of China (English)
ZHANG Sen-lin; LIU Mei-qin
2005-01-01
To facilitate stability analysis of discrete-time bidirectional associative memory (BAM) neural networks, they were converted into novel neural network models, termed standard neural network models (SNNMs), which interconnect linear dynamic systems and bounded static nonlinear operators. By combining a number of different Lyapunov functionals with S-procedure, some useful criteria of global asymptotic stability and global exponential stability of the equilibrium points of SNNMs were derived. These stability conditions were formulated as linear matrix inequalities (LMIs). So global stability of the discrete-time BAM neural networks could be analyzed by using the stability results of the SNNMs. Compared to the existing stability analysis methods, the proposed approach is easy to implement, less conservative, and is applicable to other recurrent neural networks.
Mónica Bocco; Gustavo Ovando; Silvina Sayago
2006-01-01
The objective of this work was to develop neural network models of backpropagation type to estimate solar radiation based on extraterrestrial radiation data, daily temperature range, precipitation, cloudiness and relative sunshine duration. Data from Córdoba, Argentina, were used for development and validation. The behaviour and adjustment between values observed and estimates obtained by neural networks for different combinations of input were assessed. These estimations showed root mean squ...
Applying neural networks in autonomous systems
Thornbrugh, Allison L.; Layne, J. D.; Wilson, James M., III
1992-03-01
Autonomous and teleautonomous operations have been defined in a variety of ways by different groups involved with remote robotic operations. For example, Conway describes architectures for producing intelligent actions in teleautonomous systems. Applying neural nets in such systems is similar to applying them in general. However, for autonomy, learning or learned behavior may become a significant system driver. Thus, artificial neural networks are being evaluated as components in fully autonomous and teleautonomous systems. Feed- forward networks may be trained to perform adaptive signal processing, pattern recognition, data fusion, and function approximation -- as in control subsystems. Certain components of particular autonomous systems become more amenable to implementation using a neural net due to a match between the net's attributes and desired attributes of the system component. Criteria have been developed for distinguishing such applications and then implementing them. The success of hardware implementation is a crucial part of this application evaluation process. Three basic applications of neural nets -- autoassociation, classification, and function approximation -- are used to exemplify this process and to highlight procedures that are followed during the requirements, design, and implementation phases. This paper assumes some familiarity with basic neural network terminology and concentrates upon the use of different neural network types while citing references that cover the underlying mathematics and related research.
Dynamic pricing by hopfield neural network
Institute of Scientific and Technical Information of China (English)
Lusajo M Minga; FENG Yu-qiang(冯玉强); LI Yi-jun(李一军); LU Yang(路杨); Kimutai Kimeli
2004-01-01
The increase in the number of shopbots users in e-commerce has triggered flexibility of sellers in their pricing strategies. Sellers see the importance of automated price setting which provides efficient services to a large number of buyers who are using shopbots. This paper studies the characteristic of decreasing energy with time in a continuous model of a Hopfield neural network that is the decreasing of errors in the network with respect to time. The characteristic shows that it is possible to use Hopfield neural network to get the main factor of dynamic pricing; the least variable cost, from production function principles. The least variable cost is obtained by reducing or increasing the input combination factors, and then making the comparison of the network output with the desired output, where the difference between the network output and desired output will be decreasing in the same manner as in the Hopfield neural network energy. Hopfield neural network will simplify the rapid change of prices in e-commerce during transaction that depends on the demand quantity for demand sensitive model of pricing.
Neutron spectrometry using artificial neural networks
International Nuclear Information System (INIS)
An artificial neural network has been designed to obtain neutron spectra from Bonner spheres spectrometer count rates. The neural network was trained using 129 neutron spectra. These include spectra from isotopic neutron sources; reference and operational spectra from accelerators and nuclear reactors, spectra based on mathematical functions as well as few energy groups and monoenergetic spectra. The spectra were transformed from lethargy to energy distribution and were re-binned to 31 energy groups using the MCNP 4C code. The re-binned spectra and the UTA4 response matrix were used to calculate the expected count rates in Bonner spheres spectrometer. These count rates were used as input and their respective spectra were used as output during the neural network training. After training, the network was tested with the Bonner spheres count rates produced by folding a set of neutron spectra with the response matrix. This set contains data used during network training as well as data not used. Training and testing was carried out using the Matlab(R) program. To verify the network unfolding performance, the original and unfolded spectra were compared using the root mean square error. The use of artificial neural networks to unfold neutron spectra in neutron spectrometry is an alternative procedure that overcomes the drawbacks associated with this ill-conditioned problem
Neutron spectrometry with artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Vega C, H.R.; Hernandez D, V.M.; Manzanares A, E.; Rodriguez, J.M.; Mercado S, G.A. [Universidad Autonoma de Zacatecas, A.P. 336, 98000 Zacatecas (Mexico); Iniguez de la Torre Bayo, M.P. [Universidad de Valladolid, Valladolid (Spain); Barquero, R. [Hospital Universitario Rio Hortega, Valladolid (Spain); Arteaga A, T. [Envases de Zacatecas, S.A. de C.V., Zacatecas (Mexico)]. e-mail: rvega@cantera.reduaz.mx
2005-07-01
An artificial neural network has been designed to obtain the neutron spectra from the Bonner spheres spectrometer's count rates. The neural network was trained using 129 neutron spectra. These include isotopic neutron sources; reference and operational spectra from accelerators and nuclear reactors, spectra from mathematical functions as well as few energy groups and monoenergetic spectra. The spectra were transformed from lethargy to energy distribution and were re-bin ned to 31 energy groups using the MCNP 4C code. Re-binned spectra and UTA4 response matrix were used to calculate the expected count rates in Bonner spheres spectrometer. These count rates were used as input and the respective spectrum was used as output during neural network training. After training the network was tested with the Bonner spheres count rates produced by a set of neutron spectra. This set contains data used during network training as well as data not used. Training and testing was carried out in the Mat lab program. To verify the network unfolding performance the original and unfolded spectra were compared using the {chi}{sup 2}-test and the total fluence ratios. The use of Artificial Neural Networks to unfold neutron spectra in neutron spectrometry is an alternative procedure that overcomes the drawbacks associated in this ill-conditioned problem. (Author)
Computer control of pH and DO in a laboratory fermenter using a neural network technique.
Mészáros, A; Andrásik, A; Mizsey, P; Fonyó, Z; Illeová, V
2004-10-01
In this contribution, the advantages of the artificial neural network approach to the identification and control of a laboratory-scale biochemical reactor are demonstrated. It is very important to be able to maintain the levels of two process variables, pH and dissolved oxygen (DO) concentration, over the course of fermentation in biosystems control. A PC-supported, fully automated, multi-task control system has been designed and built by the authors. Forward and inverse neural process models are used to identify and control both the pH and the DO concentration in a fermenter containing a Saccharomyces cerevisiae based-culture. The models are trained off-line, using a modified back-propagation algorithm based on conjugate gradients. The inverse neural controller is augmented by a new adaptive term that results in a system with robust performance. Experimental results have confirmed that the regulatory and tracking performances of the control system proposed are good. PMID:15300481
Using neural networks to describe tracer correlations
Directory of Open Access Journals (Sweden)
D. J. Lary
2004-01-01
Full Text Available Neural networks are ideally suited to describe the spatial and temporal dependence of tracer-tracer correlations. The neural network performs well even in regions where the correlations are less compact and normally a family of correlation curves would be required. For example, the CH4-N2O correlation can be well described using a neural network trained with the latitude, pressure, time of year, and methane volume mixing ratio (v.m.r.. In this study a neural network using Quickprop learning and one hidden layer with eight nodes was able to reproduce the CH4-N2O correlation with a correlation coefficient between simulated and training values of 0.9995. Such an accurate representation of tracer-tracer correlations allows more use to be made of long-term datasets to constrain chemical models. Such as the dataset from the Halogen Occultation Experiment (HALOE which has continuously observed CH4 (but not N2O from 1991 till the present. The neural network Fortran code used is available for download.
Neural network plasticity in the human brain
Rizk, Sviatlana
2013-01-01
The human brain is highly organized within networks. Functionally related neural-assemblies communicate by oscillating synchronously. Intrinsic brain activity contains information on healthy and damaged brain functioning. This thesis investigated the relationship between functional networks and behavior. Furthermore, we assessed functional network plasticity after brain damage and as a result of brain stimulation. In different groups of patients we observed reduced functional connectivity bet...
Molding the Knowledge in Modular Neural Networks
Spaanenburg, L.; Achterop, S.; Slump, C. H.; Zwaag, van der, M.B.
2002-01-01
Problem description. The learning of monolithic neural networks becomes harder with growing network size. Likewise the knowledge obtained while learning becomes harder to extract. Such disadvantages are caused by a lack of internal structure, that by its presence would reduce the degrees of freedom in evolving to a training target. A suitable internal structure with respect to modular network construction as well as to nodal discrimination is required. Details on the grouping and selection of...
Stability of Stochastic Neutral Cellular Neural Networks
Chen, Ling; Zhao, Hongyong
In this paper, we study a class of stochastic neutral cellular neural networks. By constructing a suitable Lyapunov functional and employing the nonnegative semi-martingale convergence theorem we give some sufficient conditions ensuring the almost sure exponential stability of the networks. The results obtained are helpful to design stability of networks when stochastic noise is taken into consideration. Finally, two examples are provided to show the correctness of our analysis.
Neural Approach for Calculating Permeability of Porous Medium
Institute of Scientific and Technical Information of China (English)
ZHANG Ji-Cheng; LIU Li; SONG Kao-Ping
2006-01-01
@@ Permeability is one of the most important properties of porous media. It is considerably difficult to calculate reservoir permeability precisely by using single well-logging response and simple formula because reservoir is of serious heterogeneity, and well-logging response curves are badly affected by many complicated factors underground. We propose a neural network method to calculate permeability of porous media. By improving the algorithm of the back-propagation neural network, convergence speed is enhanced and better results can be achieved. A four-layer back-propagation network is constructed to effectively calculate permeability from well log data.