Neural network construction via back-propagation
International Nuclear Information System (INIS)
Burwick, T.T.
1994-06-01
A method is presented that combines back-propagation with multi-layer neural network construction. Back-propagation is used not only to adjust the weights but also the signal functions. Going from one network to an equivalent one that has additional linear units, the non-linearity of these units and thus their effective presence is then introduced via back-propagation (weight-splitting). The back-propagated error causes the network to include new units in order to minimize the error function. We also show how this formalism allows to escape local minima
Training Deep Spiking Neural Networks Using Backpropagation.
Lee, Jun Haeng; Delbruck, Tobi; Pfeiffer, Michael
2016-01-01
Deep spiking neural networks (SNNs) hold the potential for improving the latency and energy efficiency of deep neural networks through data-driven event-based computation. However, training such networks is difficult due to the non-differentiable nature of spike events. In this paper, we introduce a novel technique, which treats the membrane potentials of spiking neurons as differentiable signals, where discontinuities at spike times are considered as noise. This enables an error backpropagation mechanism for deep SNNs that follows the same principles as in conventional deep networks, but works directly on spike signals and membrane potentials. Compared with previous methods relying on indirect training and conversion, our technique has the potential to capture the statistics of spikes more precisely. We evaluate the proposed framework on artificially generated events from the original MNIST handwritten digit benchmark, and also on the N-MNIST benchmark recorded with an event-based dynamic vision sensor, in which the proposed method reduces the error rate by a factor of more than three compared to the best previous SNN, and also achieves a higher accuracy than a conventional convolutional neural network (CNN) trained and tested on the same data. We demonstrate in the context of the MNIST task that thanks to their event-driven operation, deep SNNs (both fully connected and convolutional) trained with our method achieve accuracy equivalent with conventional neural networks. In the N-MNIST example, equivalent accuracy is achieved with about five times fewer computational operations.
Prediction of tides using back-propagation neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.
Prediction of tides is very much essential for human activities and to reduce the construction cost in marine environment. This paper presents an application of the artificial neural network with back-propagation procedures for accurate prediction...
Analysis Resilient Algorithm on Artificial Neural Network Backpropagation
Saputra, Widodo; Tulus; Zarlis, Muhammad; Widia Sembiring, Rahmat; Hartama, Dedy
2017-12-01
Prediction required by decision makers to anticipate future planning. Artificial Neural Network (ANN) Backpropagation is one of method. This method however still has weakness, for long training time. This is a reason to improve a method to accelerate the training. One of Artificial Neural Network (ANN) Backpropagation method is a resilient method. Resilient method of changing weights and bias network with direct adaptation process of weighting based on local gradient information from every learning iteration. Predicting data result of Istanbul Stock Exchange training getting better. Mean Square Error (MSE) value is getting smaller and increasing accuracy.
Kontrol Kecepatan Motor Induksi menggunakan Algoritma Backpropagation Neural Network
Directory of Open Access Journals (Sweden)
MUHAMMAD RUSWANDI DJALAL
2017-07-01
Full Text Available ABSTRAKBanyak strategi kontrol berbasis kecerdasan buatan telah diusulkan dalam penelitian seperti Fuzzy Logic dan Artificial Neural Network (ANN. Tujuan dari penelitian ini adalah untuk mendesain sebuah kontrol agar kecepatan motor induksi dapat diatur sesuai kebutuhan serta membandingkan kinerja motor induksi tanpa kontrol dan dengan kontrol. Dalam penelitian ini diusulkan sebuah metode artificial neural network untuk mengontrol kecepatan motor induksi tiga fasa. Kecepatan referensi motor diatur pada kecepatan 140 rad/s, 150 rad/s, dan 130 rad/s. Perubahan kecepatan diatur pada setiap interval 0.3 detik dan waktu simulasi maksimum adalah 0,9 detik. Kasus 1 tanpa kontrol, menunjukkan respon torka dan kecepatan dari motor induksi tiga fasa tanpa kontrol. Meskipun kecepatan motor induksi tiga fasa diatur berubah pada setiap 0,3 detik tidak akan mempengaruhi torka. Selain itu, motor induksi tiga fasa tanpa kontrol memiliki kinerja yang buruk dikarenakan kecepatan motor induksi tidak dapat diatur sesuai dengan kebutuhan. Kasus 2 dengan control backpropagation neural network, meskipun kecepatan motor induksi tiga fasa berubah pada setiap 0.3 detik tidak akan mempengaruhi torsi. Selain itu, kontrol backpropagation neural network memiliki kinerja yang baik dikarenakan kecepatan motor induksi dapat diatur sesuai dengan kebutuhan.Kata kunci: Backpropagation Neural Network (BPNN, NN Training, NN Testing, Motor.ABSTRACTMany artificial intelligence-based control strategies have been proposed in research such as Fuzzy Logic and Artificial Neural Network (ANN. The purpose of this research was design a control for the induction motor speed that could be adjusted as needed and compare the performance of induction motor without control and with control. In this research, it was proposed an artificial neural network method to control the speed of three-phase induction motors. The reference speed of motor was set at the rate of 140 rad / s, 150 rad / s, and 130
Relay Backpropagation for Effective Learning of Deep Convolutional Neural Networks
Shen, Li; Lin, Zhouchen; Huang, Qingming
2015-01-01
Learning deeper convolutional neural networks becomes a tendency in recent years. However, many empirical evidences suggest that performance improvement cannot be gained by simply stacking more layers. In this paper, we consider the issue from an information theoretical perspective, and propose a novel method Relay Backpropagation, that encourages the propagation of effective information through the network in training stage. By virtue of the method, we achieved the first place in ILSVRC 2015...
A modified backpropagation algorithm for training neural networks on data with error bars
International Nuclear Information System (INIS)
Gernoth, K.A.; Clark, J.W.
1994-08-01
A method is proposed for training multilayer feedforward neural networks on data contaminated with noise. Specifically, we consider the case that the artificial neural system is required to learn a physical mapping when the available values of the target variable are subject to experimental uncertainties, but are characterized by error bars. The proposed method, based on maximum likelihood criterion for parameter estimation, involves simple modifications of the on-line backpropagation learning algorithm. These include incorporation of the error-bar assignments in a pattern-specific learning rate, together with epochal updating of a new measure of model accuracy that replaces the usual mean-square error. The extended backpropagation algorithm is successfully tested on two problems relevant to the modelling of atomic-mass systematics by neural networks. Provided the underlying mapping is reasonably smooth, neural nets trained with the new procedure are able to learn the true function to a good approximation even in the presence of high levels of Gaussian noise. (author). 26 refs, 2 figs, 5 tabs
Conjugate descent formulation of backpropagation error in feedforward neural networks
Directory of Open Access Journals (Sweden)
NK Sharma
2009-06-01
Full Text Available The feedforward neural network architecture uses backpropagation learning to determine optimal weights between different interconnected layers. This learning procedure uses a gradient descent technique applied to a sum-of-squares error function for the given input-output pattern. It employs an iterative procedure to minimise the error function for a given set of patterns, by adjusting the weights of the network. The first derivates of the error with respect to the weights identify the local error surface in the descent direction. Hence the network exhibits a different local error surface for every different pattern presented to it, and weights are iteratively modified in order to minimise the current local error. The determination of an optimal weight vector is possible only when the total minimum error (mean of the minimum local errors for all patterns from the training set may be minimised. In this paper, we present a general mathematical formulation for the second derivative of the error function with respect to the weights (which represents a conjugate descent for arbitrary feedforward neural network topologies, and we use this derivative information to obtain the optimal weight vector. The local error is backpropagated among the units of hidden layers via the second order derivative of the error with respect to the weights of the hidden and output layers independently and also in combination. The new total minimum error point may be evaluated with the help of the current total minimum error and the current minimised local error. The weight modification processes is performed twice: once with respect to the present local error and once more with respect to the current total or mean error. We present some numerical evidence that our proposed method yields better network weights than those determined via a conventional gradient descent approach.
Klasifikasi Varietas Cabai Berdasarkan Morfologi Daun Menggunakan Backpropagation Neural Network
Directory of Open Access Journals (Sweden)
Kharis Syaban
2016-07-01
Full Text Available Compared with other methods of classifiers such as cellular and molecular biological methods, using the image of the leaves become the first choice in the classification of plants. The leaves can be characterized by shape, color, and texture; The leaves can have a color that varies depending on the season and geographical location. In addition, the same plant species also can have different leaf shapes. In this study, the morphological features of leaves used to identify varieties of pepper plants. The method used to perform feature extraction is a moment invariant and basic geometric features. For the process of recognition based on the features that have been extracted, used neural network methods with backpropagation learning algorithm. From the neural-network training, the best accuracy in classifying varieties of chili with minimum error 0.001 by providing learning rate 0.1, momentum of 0.7, and 15 neurons in the hidden layer foreach of various feature. To conduct cross-validation testing with k-fold tehcnique, obtained classification accuracy to be range of 80.75%±0.09% with k=4.
Understanding the Convolutional Neural Networks with Gradient Descent and Backpropagation
Zhou, XueFei
2018-04-01
With the development of computer technology, the applications of machine learning are more and more extensive. And machine learning is providing endless opportunities to develop new applications. One of those applications is image recognition by using Convolutional Neural Networks (CNNs). CNN is one of the most common algorithms in image recognition. It is significant to understand its theory and structure for every scholar who is interested in this field. CNN is mainly used in computer identification, especially in voice, text recognition and other aspects of the application. It utilizes hierarchical structure with different layers to accelerate computing speed. In addition, the greatest features of CNNs are the weight sharing and dimension reduction. And all of these consolidate the high effectiveness and efficiency of CNNs with idea computing speed and error rate. With the help of other learning altruisms, CNNs could be used in several scenarios for machine learning, especially for deep learning. Based on the general introduction to the background and the core solution CNN, this paper is going to focus on summarizing how Gradient Descent and Backpropagation work, and how they contribute to the high performances of CNNs. Also, some practical applications will be discussed in the following parts. The last section exhibits the conclusion and some perspectives of future work.
Habarulema, J. B.; McKinnell, L.-A.
2012-05-01
In this work, results obtained by investigating the application of different neural network backpropagation training algorithms are presented. This was done to assess the performance accuracy of each training algorithm in total electron content (TEC) estimations using identical datasets in models development and verification processes. Investigated training algorithms are standard backpropagation (SBP), backpropagation with weight delay (BPWD), backpropagation with momentum (BPM) term, backpropagation with chunkwise weight update (BPC) and backpropagation for batch (BPB) training. These five algorithms are inbuilt functions within the Stuttgart Neural Network Simulator (SNNS) and the main objective was to find out the training algorithm that generates the minimum error between the TEC derived from Global Positioning System (GPS) observations and the modelled TEC data. Another investigated algorithm is the MatLab based Levenberg-Marquardt backpropagation (L-MBP), which achieves convergence after the least number of iterations during training. In this paper, neural network (NN) models were developed using hourly TEC data (for 8 years: 2000-2007) derived from GPS observations over a receiver station located at Sutherland (SUTH) (32.38° S, 20.81° E), South Africa. Verification of the NN models for all algorithms considered was performed on both "seen" and "unseen" data. Hourly TEC values over SUTH for 2003 formed the "seen" dataset. The "unseen" dataset consisted of hourly TEC data for 2002 and 2008 over Cape Town (CPTN) (33.95° S, 18.47° E) and SUTH, respectively. The models' verification showed that all algorithms investigated provide comparable results statistically, but differ significantly in terms of time required to achieve convergence during input-output data training/learning. This paper therefore provides a guide to neural network users for choosing appropriate algorithms based on the availability of computation capabilities used for research.
The interchangeability of learning rate and gain in backpropagation neural networks
Thimm, G.; Moerland, P.; Fiesler, E.
1996-01-01
The backpropagation algorithm is widely used for training multilayer neural networks. In this publication the gain of its activation function(s) is investigated. In specific, it is proven that changing the gain of the activation function is equivalent to changing the learning rate and the weights.
Chin Kim On; Teo Kein Yau; Rayner Alfred; Jason Teo; Patricia Anthony; Wang Cheng
2016-01-01
In this paper, we describe a research project that autonomously localizes and recognizes non-standardized Malaysian’s car plates using conventional Backpropagation algorithm (BPP) in combination with Ensemble Neural Network (ENN). We compared the results with the results obtained using simple Feed-Forward Neural Network (FFNN). This research aims to solve four main issues; (1) localization of car plates that has the same colour with the vehicle colour, (2) detection and recognition of car pla...
An approach to the interpretation of backpropagation neural network models in QSAR studies.
Baskin, I I; Ait, A O; Halberstam, N M; Palyulin, V A; Zefirov, N S
2002-03-01
An approach to the interpretation of backpropagation neural network models for quantitative structure-activity and structure-property relationships (QSAR/QSPR) studies is proposed. The method is based on analyzing the first and second moments of distribution of the values of the first and the second partial derivatives of neural network outputs with respect to inputs calculated at data points. The use of such statistics makes it possible not only to obtain actually the same characteristics as for the case of traditional "interpretable" statistical methods, such as the linear regression analysis, but also to reveal important additional information regarding the non-linear character of QSAR/QSPR relationships. The approach is illustrated by an example of interpreting a backpropagation neural network model for predicting position of the long-wave absorption band of cyane dyes.
Neural net prediction of tokamak plasma disruptions
International Nuclear Information System (INIS)
Hernandez, J.V.; Lin, Z.; Horton, W.; McCool, S.C.
1994-10-01
The computation based on neural net algorithms in predicting minor and major disruptions in TEXT tokamak discharges has been performed. Future values of the fluctuating magnetic signal are predicted based on L past values of the magnetic fluctuation signal, measured by a single Mirnov coil. The time step used (= 0.04ms) corresponds to the experimental data sampling rate. Two kinds of approaches are adopted for the task, the contiguous future prediction and the multi-timescale prediction. Results are shown for comparison. Both networks are trained through the back-propagation algorithm with inertial terms. The degree of this success indicates that the magnetic fluctuations associated with tokamak disruptions may be characterized by a relatively low-dimensional dynamical system
Wanto, Anjar; Zarlis, Muhammad; Sawaluddin; Hartama, Dedy
2017-12-01
Backpropagation is a good artificial neural network algorithm used to predict, one of which is to predict the rate of Consumer Price Index (CPI) based on the foodstuff sector. While conjugate gradient fletcher reeves is a suitable optimization method when juxtaposed with backpropagation method, because this method can shorten iteration without reducing the quality of training and testing result. Consumer Price Index (CPI) data that will be predicted to come from the Central Statistics Agency (BPS) Pematangsiantar. The results of this study will be expected to contribute to the government in making policies to improve economic growth. In this study, the data obtained will be processed by conducting training and testing with artificial neural network backpropagation by using parameter learning rate 0,01 and target error minimum that is 0.001-0,09. The training network is built with binary and bipolar sigmoid activation functions. After the results with backpropagation are obtained, it will then be optimized using the conjugate gradient fletcher reeves method by conducting the same training and testing based on 5 predefined network architectures. The result, the method used can increase the speed and accuracy result.
Convergence of Batch Split-Complex Backpropagation Algorithm for Complex-Valued Neural Networks
Directory of Open Access Journals (Sweden)
Huisheng Zhang
2009-01-01
Full Text Available The batch split-complex backpropagation (BSCBP algorithm for training complex-valued neural networks is considered. For constant learning rate, it is proved that the error function of BSCBP algorithm is monotone during the training iteration process, and the gradient of the error function tends to zero. By adding a moderate condition, the weights sequence itself is also proved to be convergent. A numerical example is given to support the theoretical analysis.
IMPLEMENTASI BACKPROPAGATION NEURAL NETWORK DALAM PRAKIRAAN CUACA DI DAERAH BALI SELATAN
Directory of Open Access Journals (Sweden)
I MADE DWI UDAYANA PUTRA
2016-11-01
Full Text Available Weather information has an important role in human life in various fields, such as agriculture, marine, and aviation. The accurate weather forecasts are needed in order to improve the performance of various fields. In this study, use artificial neural network method with backpropagation learning algorithm to create a model of weather forecasting in the area of ??South Bali. The aim of this study is to determine the effect of the number of neurons in the hidden layer and to determine the level of accuracy of the method of artificial neural network with backpropagation learning algorithm in weather forecast models. Weather forecast models in this study use input of the factors that influence the weather, namely air temperature, dew point, wind speed, visibility, and barometric pressure.The results of testing the network with a different number of neurons in the hidden layer of artificial neural network method with backpropagation learning algorithms show that the increase in the number of neurons in the hidden layer is not directly proportional to the value of the accuracy of the weather forecasts, the increase in the number of neurons in the hidden layer does not necessarily increase or decrease value accuracy of weather forecasts we obtain the best accuracy rate of 51.6129% on a network model with three neurons in the hidden layer.
Ocean wave parameters estimation using backpropagation neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; SubbaRao; Raju, D.H.
: the RPROP algorithm. San Francisco: ICNN; 1993. p. 586–591. [15] Demuth H, Beale M. Neural network toolbox for use with MATLAB, user guide. USA: The Math Works Inc.; 2000 (http://www.mathworks.com). [16] Baba M, Dattatri J. Ocean wave spectra off cochin...
Witoonchart, Peerajak; Chongstitvatana, Prabhas
2017-08-01
In this study, for the first time, we show how to formulate a structured support vector machine (SSVM) as two layers in a convolutional neural network, where the top layer is a loss augmented inference layer and the bottom layer is the normal convolutional layer. We show that a deformable part model can be learned with the proposed structured SVM neural network by backpropagating the error of the deformable part model to the convolutional neural network. The forward propagation calculates the loss augmented inference and the backpropagation calculates the gradient from the loss augmented inference layer to the convolutional layer. Thus, we obtain a new type of convolutional neural network called an Structured SVM convolutional neural network, which we applied to the human pose estimation problem. This new neural network can be used as the final layers in deep learning. Our method jointly learns the structural model parameters and the appearance model parameters. We implemented our method as a new layer in the existing Caffe library. Copyright © 2017 Elsevier Ltd. All rights reserved.
Application of artificial neural networks with backpropagation technique in the financial data
Jaiswal, Jitendra Kumar; Das, Raja
2017-11-01
The propensity of applying neural networks has been proliferated in multiple disciplines for research activities since the past recent decades because of its powerful control with regulatory parameters for pattern recognition and classification. It is also being widely applied for forecasting in the numerous divisions. Since financial data have been readily available due to the involvement of computers and computing systems in the stock market premises throughout the world, researchers have also developed numerous techniques and algorithms to analyze the data from this sector. In this paper we have applied neural network with backpropagation technique to find the data pattern from finance section and prediction for stock values as well.
Chromatic characterization of a three-channel colorimeter using back-propagation neural networks
Pardo, P. J.; Pérez, A. L.; Suero, M. I.
2004-09-01
This work describes a method for the chromatic characterization of a three-channel colorimeter of recent design and construction dedicated to color vision research. The colorimeter consists of two fixed monochromators and a third monochromator interchangeable with a cathode ray tube or any other external light source. Back-propagation neural networks were used for the chromatic characterization to establish the relationship between each monochromator's input parameters and the tristimulus values of each chromatic stimulus generated. The results showed the effectiveness of this type of neural-network-based system for the chromatic characterization of the stimuli produced by any monochromator.
Energy Technology Data Exchange (ETDEWEB)
Kerr, John Patrick [Iowa State Univ., Ames, IA (United States)
1992-01-01
The objective of this study was to determine the feasibility of using an Artificial Neural Network (ANN), in particular a backpropagation ANN, to improve the speed and quality of the reconstruction of three-dimensional SPECT (single photon emission computed tomography) images. In addition, since the processing elements (PE)s in each layer of an ANN are independent of each other, the speed and efficiency of the neural network architecture could be better optimized by implementing the ANN on a massively parallel computer. The specific goals of this research were: to implement a fully interconnected backpropagation neural network on a serial computer and a SIMD parallel computer, to identify any reduction in the time required to train these networks on the parallel machine versus the serial machine, to determine if these neural networks can learn to recognize SPECT data by training them on a section of an actual SPECT image, and to determine from the knowledge obtained in this research if full SPECT image reconstruction by an ANN implemented on a parallel computer is feasible both in time required to train the network, and in quality of the images reconstructed.
Multifactor-influenced energy consumption forecasting using enhanced back-propagation neural network
International Nuclear Information System (INIS)
Zeng, Yu-Rong; Zeng, Yi; Choi, Beomjin; Wang, Lin
2017-01-01
Reliable energy consumption forecasting can provide effective decision-making support for planning development strategies to energy enterprises and for establishing national energy policies. Accordingly, the present study aims to apply a hybrid intelligent approach named ADE–BPNN, the back-propagation neural network (BPNN) model supported by an adaptive differential evolution algorithm, to estimate energy consumption. Most often, energy consumption is influenced by socioeconomic factors. The proposed hybrid model incorporates gross domestic product, population, import, and export data as inputs. An improved differential evolution with adaptive mutation and crossover is utilized to find appropriate global initial connection weights and thresholds to enhance the forecasting performance of the BPNN. A comparative example and two extended examples are utilized to validate the applicability and accuracy of the proposed ADE–BPNN model. Errors of the test data sets indicate that the ADE–BPNN model can effectively predict energy consumption compared with the traditional back-propagation neural network model and other popular existing models. Moreover, mean impact value based analysis is conducted for electrical energy consumption in U.S. and total energy consumption forecasting in China to quantitatively explore the relative importance of each input variable for the improvement of effective energy consumption prediction. - Highlights: • Enhanced back-propagation neural network (ADE-BPNN) for energy consumption forecasting. • ADE-BPNN outperforms the current best models for two comparative cases. • Mean impact value approach explores socio-economic factors' relative importance. • ADE-BPNN's adjusted goodness-of-fit is 99.2% for China's energy consumption forecasting.
Wutsqa, D. U.; Marwah, M.
2017-06-01
In this paper, we consider spatial operation median filter to reduce the noise in the cervical images yielded by colposcopy tool. The backpropagation neural network (BPNN) model is applied to the colposcopy images to classify cervical cancer. The classification process requires an image extraction by using a gray level co-occurrence matrix (GLCM) method to obtain image features that are used as inputs of BPNN model. The advantage of noise reduction is evaluated by comparing the performances of BPNN models with and without spatial operation median filter. The experimental result shows that the spatial operation median filter can improve the accuracy of the BPNN model for cervical cancer classification.
A Parallel Adaboost-Backpropagation Neural Network for Massive Image Dataset Classification
Cao, Jianfang; Chen, Lichao; Wang, Min; Shi, Hao; Tian, Yun
2016-01-01
Image classification uses computers to simulate human understanding and cognition of images by automatically categorizing images. This study proposes a faster image classification approach that parallelizes the traditional Adaboost-Backpropagation (BP) neural network using the MapReduce parallel programming model. First, we construct a strong classifier by assembling the outputs of 15 BP neural networks (which are individually regarded as weak classifiers) based on the Adaboost algorithm. Second, we design Map and Reduce tasks for both the parallel Adaboost-BP neural network and the feature extraction algorithm. Finally, we establish an automated classification model by building a Hadoop cluster. We use the Pascal VOC2007 and Caltech256 datasets to train and test the classification model. The results are superior to those obtained using traditional Adaboost-BP neural network or parallel BP neural network approaches. Our approach increased the average classification accuracy rate by approximately 14.5% and 26.0% compared to the traditional Adaboost-BP neural network and parallel BP neural network, respectively. Furthermore, the proposed approach requires less computation time and scales very well as evaluated by speedup, sizeup and scaleup. The proposed approach may provide a foundation for automated large-scale image classification and demonstrates practical value. PMID:27905520
Directory of Open Access Journals (Sweden)
Junta Zeniarja
2015-05-01
Full Text Available Pelanggan merupakan bagian penting dalam memastikan keunggulan dan kelangsungan hidup perusahaan. Oleh karena itu perlu untuk memiliki sistem manajemen untuk memastikan pelanggan tetap setia dan tidak pindah ke pesaing lain, yang dikenal sebagai manajemen churn. Prediksi churn pelanggan adalah bagian dari manajemen churn, yang memprediksi perilaku pelanggan dengan klasifikasi pelanggan setia dan mana yang cenderung pindah ke kompetitor lain. Keakuratan prediksi ini mutlak diperlukan karena tingginya tingkat migrasi pelanggan ke perusahaan pesaing. Hal ini penting karena biaya yang digunakan untuk meraih pelanggan baru jauh lebih tinggi dibandingkan dengan mempertahankan loyalitas pelanggan yang sudah ada. Meskipun banyak studi tentang prediksi churn pelanggan yang telah dilakukan, penelitian lebih lanjut masih diperlukan untuk meningkatkan akurasi prediksi. Penelitian ini akan membahas penggunaan teknik data mining Backpropagation Neural Network (BPNN in hybrid dengan Strategi Evolution (ES untuk atribut bobot. Validasi model dilakukan dengan menggunakan validasi Palang 10-Fold dan evaluasi pengukuran dilakukan dengan menggunakan matriks kebingungan dan Area bawah ROC Curve (AUC. Hasil percobaan menunjukkan bahwa hibrida BPNN dengan ES mencapai kinerja yang lebih baik daripada Basic BPNN. Kata kunci: data mining, churn, prediksi, backpropagation neural network, strategi evolusi.
Directory of Open Access Journals (Sweden)
Ikhthison Mekongga
2014-02-01
Full Text Available The need for bandwidth has been increasing recently. This is because the development of internet infrastructure is also increasing so that we need an economic and efficient provider system. This can be achieved through good planning and a proper system. The prediction of the bandwidth consumption is one of the factors that support the planning for an efficient internet service provider system. Bandwidth consumption is predicted using ANN. ANN is an information processing system which has similar characteristics as the biologic al neural network. ANN is chosen to predict the consumption of the bandwidth because ANN has good approachability to non-linearity. The variable used in ANN is the historical load data. A bandwidth consumption information system was built using neural networks with a backpropagation algorithm to make the use of bandwidth more efficient in the future both in the rental rate of the bandwidth and in the usage of the bandwidth.Keywords: Forecasting, Bandwidth, Backpropagation
Knowledge Mining from Clinical Datasets Using Rough Sets and Backpropagation Neural Network
Directory of Open Access Journals (Sweden)
Kindie Biredagn Nahato
2015-01-01
Full Text Available The availability of clinical datasets and knowledge mining methodologies encourages the researchers to pursue research in extracting knowledge from clinical datasets. Different data mining techniques have been used for mining rules, and mathematical models have been developed to assist the clinician in decision making. The objective of this research is to build a classifier that will predict the presence or absence of a disease by learning from the minimal set of attributes that has been extracted from the clinical dataset. In this work rough set indiscernibility relation method with backpropagation neural network (RS-BPNN is used. This work has two stages. The first stage is handling of missing values to obtain a smooth data set and selection of appropriate attributes from the clinical dataset by indiscernibility relation method. The second stage is classification using backpropagation neural network on the selected reducts of the dataset. The classifier has been tested with hepatitis, Wisconsin breast cancer, and Statlog heart disease datasets obtained from the University of California at Irvine (UCI machine learning repository. The accuracy obtained from the proposed method is 97.3%, 98.6%, and 90.4% for hepatitis, breast cancer, and heart disease, respectively. The proposed system provides an effective classification model for clinical datasets.
Facial Expression Recognition By Using Fisherface Methode With Backpropagation Neural Network
Directory of Open Access Journals (Sweden)
Zaenal Abidin
2011-01-01
Full Text Available Abstract— In daily lives, especially in interpersonal communication, face often used for expression. Facial expressions give information about the emotional state of the person. A facial expression is one of the behavioral characteristics. The components of a basic facial expression analysis system are face detection, face data extraction, and facial expression recognition. Fisherface method with backpropagation artificial neural network approach can be used for facial expression recognition. This method consists of two-stage process, namely PCA and LDA. PCA is used to reduce the dimension, while the LDA is used for features extraction of facial expressions. The system was tested with 2 databases namely JAFFE database and MUG database. The system correctly classified the expression with accuracy of 86.85%, and false positive 25 for image type I of JAFFE, for image type II of JAFFE 89.20% and false positive 15, for type III of JAFFE 87.79%, and false positive for 16. The image of MUG are 98.09%, and false positive 5. Keywords— facial expression, fisherface method, PCA, LDA, backpropagation neural network.
A new backpropagation learning algorithm for layered neural networks with nondifferentiable units.
Oohori, Takahumi; Naganuma, Hidenori; Watanabe, Kazuhisa
2007-05-01
We propose a digital version of the backpropagation algorithm (DBP) for three-layered neural networks with nondifferentiable binary units. This approach feeds teacher signals to both the middle and output layers, whereas with a simple perceptron, they are given only to the output layer. The additional teacher signals enable the DBP to update the coupling weights not only between the middle and output layers but also between the input and middle layers. A neural network based on DBP learning is fast and easy to implement in hardware. Simulation results for several linearly nonseparable problems such as XOR demonstrate that the DBP performs favorably when compared to the conventional approaches. Furthermore, in large-scale networks, simulation results indicate that the DBP provides high performance.
Inversion of Density Interfaces Using the Pseudo-Backpropagation Neural Network Method
Chen, Xiaohong; Du, Yukun; Liu, Zhan; Zhao, Wenju; Chen, Xiaocheng
2018-05-01
This paper presents a new pseudo-backpropagation (BP) neural network method that can invert multi-density interfaces at one time. The new method is based on the conventional forward modeling and inverse modeling theories in addition to conventional pseudo-BP neural network arithmetic. A 3D inversion model for gravity anomalies of multi-density interfaces using the pseudo-BP neural network method is constructed after analyzing the structure and function of the artificial neural network. The corresponding iterative inverse formula of the space field is presented at the same time. Based on trials of gravity anomalies and density noise, the influence of the two kinds of noise on the inverse result is discussed and the scale of noise requested for the stability of the arithmetic is analyzed. The effects of the initial model on the reduction of the ambiguity of the result and improvement of the precision of inversion are discussed. The correctness and validity of the method were verified by the 3D model of the three interfaces. 3D inversion was performed on the observed gravity anomaly data of the Okinawa trough using the program presented herein. The Tertiary basement and Moho depth were obtained from the inversion results, which also testify the adaptability of the method. This study has made a useful attempt for the inversion of gravity density interfaces.
The Performance of EEG-P300 Classification using Backpropagation Neural Networks
Directory of Open Access Journals (Sweden)
Arjon Turnip
2013-12-01
Full Text Available Electroencephalogram (EEG recordings signal provide an important function of brain-computer communication, but the accuracy of their classification is very limited in unforeseeable signal variations relating to artifacts. In this paper, we propose a classification method entailing time-series EEG-P300 signals using backpropagation neural networks to predict the qualitative properties of a subject’s mental tasks by extracting useful information from the highly multivariate non-invasive recordings of brain activity. To test the improvement in the EEG-P300 classification performance (i.e., classification accuracy and transfer rate with the proposed method, comparative experiments were conducted using Bayesian Linear Discriminant Analysis (BLDA. Finally, the result of the experiment showed that the average of the classification accuracy was 97% and the maximum improvement of the average transfer rate is 42.4%, indicating the considerable potential of the using of EEG-P300 for the continuous classification of mental tasks.
Izhari, F.; Dhany, H. W.; Zarlis, M.; Sutarman
2018-03-01
A good age in optimizing aspects of development is at the age of 4-6 years, namely with psychomotor development. Psychomotor is broader, more difficult to monitor but has a meaningful value for the child's life because it directly affects his behavior and deeds. Therefore, there is a problem to predict the child's ability level based on psychomotor. This analysis uses backpropagation method analysis with artificial neural network to predict the ability of the child on the psychomotor aspect by generating predictions of the child's ability on psychomotor and testing there is a mean squared error (MSE) value at the end of the training of 0.001. There are 30% of children aged 4-6 years have a good level of psychomotor ability, excellent, less good, and good enough.
An intelligent switch with back-propagation neural network based hybrid power system
Perdana, R. H. Y.; Fibriana, F.
2018-03-01
The consumption of conventional energy such as fossil fuels plays the critical role in the global warming issues. The carbon dioxide, methane, nitrous oxide, etc. could lead the greenhouse effects and change the climate pattern. In fact, 77% of the electrical energy is generated from fossil fuels combustion. Therefore, it is necessary to use the renewable energy sources for reducing the conventional energy consumption regarding electricity generation. This paper presents an intelligent switch to combine both energy resources, i.e., the solar panels as the renewable energy with the conventional energy from the State Electricity Enterprise (PLN). The artificial intelligence technology with the back-propagation neural network was designed to control the flow of energy that is distributed dynamically based on renewable energy generation. By the continuous monitoring on each load and source, the dynamic pattern of the intelligent switch was better than the conventional switching method. The first experimental results for 60 W solar panels showed the standard deviation of the trial at 0.7 and standard deviation of the experiment at 0.28. The second operation for a 900 W of solar panel obtained the standard deviation of the trial at 0.05 and 0.18 for the standard deviation of the experiment. Moreover, the accuracy reached 83% using this method. By the combination of the back-propagation neural network with the observation of energy usage of the load using wireless sensor network, each load can be evenly distributed and will impact on the reduction of conventional energy usage.
The application of backpropagation neural network method to estimate the sediment loads
Directory of Open Access Journals (Sweden)
Ari Gunawan Taufik
2017-01-01
Full Text Available Nearly all formulations of conventional sediment load estimation method were developed based on a review of laboratory data or data field. This approach is generally limited by local so it is only suitable for a particular river typology. From previous studies, the amount of sediment load tends to be non-linear with respect to the hydraulic parameters and parameter that accompanies sediment. The dominant parameter is turbulence, whereas turbulence flow velocity vector direction of x, y and z. They were affected by water bodies in 3D morphology of the cross section of the vertical and horizontal. This study is conducted to address the non-linear nature of the hydraulic parameter data and sediment parameter against sediment load data by applying the artificial neural network (ANN method. The method used is the backpropagation neural network (BPNN schema. This scheme used for projecting the sediment load from the hydraulic parameter data and sediment parameters that used in the conventional estimation of sediment load. The results showed that the BPNN model performs reasonably well on the conventional calculation, indicated by the stability of correlation coefficient (R and the mean square error (MSE.
International Nuclear Information System (INIS)
Vasconcelos, W.L.; Shigaki, Y.; Tolentino, E.
2009-01-01
In this work it was analyzed the residual performance of Portland cement concretes, when cold after heat-treated up to 600 deg C. Granite-gneiss was used in the three concrete mix proportions as the coarse aggregate, and river sand with finesses modulus of 2.7 as the fine aggregate. Ultrasonic pulse tests were performed on all the specimens and ultrasonic dynamic modulus were obtained. An artificial neural network of the backpropagation type was trained to evaluate and apply models in predicting residual properties of Portland cement concretes. The input layer for both models consists of an external layer input vector of the temperature. The hidden layer has two processing units with hyperbolic tangent sigmoid transfer functions (tansig for short), and the output layer contains one processing unit that represents the network's output (ultrasonic pulse velocity or modulus of elasticity) for each input vector. The training phase of the network converged for reasonable results after 5.000 epochs approximately, resulting in mean squared errors less than 0.02 for the normalized data. The neural network developed for modeling residual properties of Portland cement concretes was shown to be efficient in both the training phase and the test. From the results reasonable predictions could be made for the ultrasonic pulse velocity or dynamic modulus of elasticity by using temperature. (author)
Huang, Daizheng; Wu, Zhihui
2017-01-01
Accurately predicting the trend of outpatient visits by mathematical modeling can help policy makers manage hospitals effectively, reasonably organize schedules for human resources and finances, and appropriately distribute hospital material resources. In this study, a hybrid method based on empirical mode decomposition and back-propagation artificial neural networks optimized by particle swarm optimization is developed to forecast outpatient visits on the basis of monthly numbers. The data outpatient visits are retrieved from January 2005 to December 2013 and first obtained as the original time series. Second, the original time series is decomposed into a finite and often small number of intrinsic mode functions by the empirical mode decomposition technique. Third, a three-layer back-propagation artificial neural network is constructed to forecast each intrinsic mode functions. To improve network performance and avoid falling into a local minimum, particle swarm optimization is employed to optimize the weights and thresholds of back-propagation artificial neural networks. Finally, the superposition of forecasting results of the intrinsic mode functions is regarded as the ultimate forecasting value. Simulation indicates that the proposed method attains a better performance index than the other four methods.
Syahputra, M. F.; Amalia, C.; Rahmat, R. F.; Abdullah, D.; Napitupulu, D.; Setiawan, M. I.; Albra, W.; Nurdin; Andayani, U.
2018-03-01
Hypertension or high blood pressure can cause damage of blood vessels in the retina of eye called hypertensive retinopathy (HR). In the event Hypertension, it will cause swelling blood vessels and a decrese in retina performance. To detect HR in patients body, it is usually performed through physical examination of opthalmoscope which is still conducted manually by an ophthalmologist. Certainly, in such a manual manner, takes a ong time for a doctor to detetct HR on aa patient based on retina fundus iamge. To overcome ths problem, a method is needed to identify the image of retinal fundus automatically. In this research, backpropagation neural network was used as a method for retinal fundus identification. The steps performed prior to identification were pre-processing (green channel, contrast limited adapative histogram qualization (CLAHE), morphological close, background exclusion, thresholding and connected component analysis), feature extraction using zoning. The results show that the proposed method is able to identify retinal fundus with an accuracy of 95% with maximum epoch of 1500.
Directory of Open Access Journals (Sweden)
Nugroho Nugroho
2012-01-01
Full Text Available The research on image identification has been conducted to identify the type of beef. The research is aimed to compare the performance of artificial neural network of backpropagation and general regression neural network model in identifying the type of meat. Image management is processed by counting R, G and B value in every meat image, and normalization process is then carried out by obtaining R, G, and B index value which is then converted from RGB model to HSI model to obtain the value of hue, saturation and intensity. The resulting value of image processing will be used as input parameter of training and validation programs. The performance of G RNN model is more accurate than the backpropagation with accuracy ratio by 51%.Keyword: Identification; Backpropagation; GRNN
Directory of Open Access Journals (Sweden)
Yi-jun Liu
2015-12-01
Full Text Available Childhood nephrotic syndrome is a chronic disease harmful to growth of children. Scientific and accurate prediction of negative conversion days for children with nephrotic syndrome offers potential benefits for treatment of patients and helps achieve better cure effect. In this study, the improved backpropagation neural network with momentum is used for prediction. Momentum speeds up convergence and maintains the generalization performance of the neural network, and therefore overcomes weaknesses of the standard backpropagation algorithm. The three-tier network structure is constructed. Eight indicators including age, lgG, lgA and lgM, etc. are selected for network inputs. The scientific computing software of MATLAB and its neural network tools are used to create model and predict. The training sample of twenty-eight cases is used to train the neural network. The test sample of six typical cases belonging to six different age groups respectively is used to test the predictive model. The low mean absolute error of predictive results is achieved at 0.83. The experimental results of the small-size sample show that the proposed approach is to some degree applicable for the prediction of negative conversion days of childhood nephrotic syndrome.
Neural Net Safety Monitor Design
Larson, Richard R.
2007-01-01
The National Aeronautics and Space Administration (NASA) at the Dryden Flight Research Center (DFRC) has been conducting flight-test research using an F-15 aircraft (figure 1). This aircraft has been specially modified to interface a neural net (NN) controller as part of a single-string Airborne Research Test System (ARTS) computer with the existing quad-redundant flight control system (FCC) shown in figure 2. The NN commands are passed to FCC channels 2 and 4 and are cross channel data linked (CCDL) to the other computers as shown. Numerous types of fault-detection monitors exist in the FCC when the NN mode is engaged; these monitors would cause an automatic disengagement of the NN in the event of a triggering fault. Unfortunately, these monitors still may not prevent a possible NN hard-over command from coming through to the control laws. Therefore, an additional and unique safety monitor was designed for a single-string source that allows authority at maximum actuator rates but protects the pilot and structural loads against excessive g-limits in the case of a NN hard-over command input. This additional monitor resides in the FCCs and is executed before the control laws are computed. This presentation describes a floating limiter (FL) concept1 that was developed and successfully test-flown for this program (figure 3). The FL computes the rate of change of the NN commands that are input to the FCC from the ARTS. A window is created with upper and lower boundaries, which is constantly floating and trying to stay centered as the NN command rates are changing. The limiter works by only allowing the window to move at a much slower rate than those of the NN commands. Anywhere within the window, however, full rates are allowed. If a rate persists in one direction, it will eventually hit the boundary and be rate-limited to the floating limiter rate. When this happens, a persistent counter begins and after a limit is reached, a NN disengage command is generated. The
Directory of Open Access Journals (Sweden)
Bahman O. Taha
2015-06-01
Full Text Available The reinforced concrete with fiber reinforced polymer (FRP bars (carbon, aramid, basalt and glass is used in places where a high ratio of strength to weight is required and corrosion is not acceptable. Behavior of structural members using (FRP bars is hard to be modeled using traditional methods because of the high non-linearity relationship among factors influencing the strength of structural members. Back-propagation neural network is a very effective method for modeling such complicated relationships. In this paper, back-propagation neural network is used for modeling the flexural behavior of beams reinforced with (FRP bars. 101 samples of beams reinforced with fiber bars were collected from literatures. Five important factors are taken in consideration for predicting the strength of beams. Two models of Multilayer Perceptron (MLP are created, first with single-hidden layer and the second with two-hidden layers. The two-hidden layer model showed better accuracy ratio than the single-hidden layer model. Parametric study has been done for two-hidden layer model only. Equations are derived to be used instead of the model and the importance of input factors is determined. Results showed that the neural network is successful in modeling the behavior of concrete beams reinforced with different types of (FRP bars.
Quick fuzzy backpropagation algorithm.
Nikov, A; Stoeva, S
2001-03-01
A modification of the fuzzy backpropagation (FBP) algorithm called QuickFBP algorithm is proposed, where the computation of the net function is significantly quicker. It is proved that the FBP algorithm is of exponential time complexity, while the QuickFBP algorithm is of polynomial time complexity. Convergence conditions of the QuickFBP, resp. the FBP algorithm are defined and proved for: (1) single output neural networks in case of training patterns with different targets; and (2) multiple output neural networks in case of training patterns with equivalued target vector. They support the automation of the weights training process (quasi-unsupervised learning) establishing the target value(s) depending on the network's input values. In these cases the simulation results confirm the convergence of both algorithms. An example with a large-sized neural network illustrates the significantly greater training speed of the QuickFBP rather than the FBP algorithm. The adaptation of an interactive web system to users on the basis of the QuickFBP algorithm is presented. Since the QuickFBP algorithm ensures quasi-unsupervised learning, this implies its broad applicability in areas of adaptive and adaptable interactive systems, data mining, etc. applications.
Energy Technology Data Exchange (ETDEWEB)
Li Yingwei [Faculty of Metallurgical and Energy Engineering, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China); Key Laboratory of Unconventional Metallurgy, Ministry of Education, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China); Peng Jinhui, E-mail: jhpeng@kmust.edu.c [Faculty of Metallurgical and Energy Engineering, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China); Key Laboratory of Unconventional Metallurgy, Ministry of Education, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China); Liu Bingguo [Faculty of Metallurgical and Energy Engineering, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China); Key Laboratory of Unconventional Metallurgy, Ministry of Education, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China); Li Wei [Key Laboratory of Unconventional Metallurgy, Ministry of Education, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China); Huang Daifu [No. 272 Nuclear Industry Factory, China National Nuclear Corporation, Hengyang, Hunan Province 421002 (China); Zhang Libo [Faculty of Metallurgical and Energy Engineering, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China); Key Laboratory of Unconventional Metallurgy, Ministry of Education, Kunming University of Science and Technology, Kunming, Yunnan Province 650093 (China)
2011-05-15
Research highlights: The incremental improved Back-Propagation neural network prediction model using the Levenberg-Marquardt algorithm based on optimizing theory is put forward. The prediction model of the nonlinear system is built, which can effectively predict the experiment of microwave calcining of ammonium uranyl carbonate (AUC). AUC can accept the microwave energy and microwave heating can quickly decompose AUC. In the experiment of microwave calcining of AUC, the contents of U and U{sup 4+} increased with increasing of microwave power and irradiation time, and decreased with increasing of the material average depth. - Abstract: The incremental improved Back-Propagation (BP) neural network prediction model was put forward, which was very useful in overcoming the problems, such as long testing cycle, high testing quantity, difficulty of optimization for process parameters, many training data probably were offered by the way of increment batch and the limitation of the system memory could make the training data infeasible, which existed in the process of calcinations for ammonium uranyl carbonate (AUC) by microwave heating. The prediction model of the nonlinear system was built, which could effectively predict the experiment of microwave calcining of AUC. The predicted results indicated that the contents of U and U{sup 4+} were increased with increasing of microwave power and irradiation time, and decreased with increasing of the material average depth.
International Nuclear Information System (INIS)
Li Yingwei; Peng Jinhui; Liu Bingguo; Li Wei; Huang Daifu; Zhang Libo
2011-01-01
Research highlights: → The incremental improved Back-Propagation neural network prediction model using the Levenberg-Marquardt algorithm based on optimizing theory is put forward. → The prediction model of the nonlinear system is built, which can effectively predict the experiment of microwave calcining of ammonium uranyl carbonate (AUC). → AUC can accept the microwave energy and microwave heating can quickly decompose AUC. → In the experiment of microwave calcining of AUC, the contents of U and U 4+ increased with increasing of microwave power and irradiation time, and decreased with increasing of the material average depth. - Abstract: The incremental improved Back-Propagation (BP) neural network prediction model was put forward, which was very useful in overcoming the problems, such as long testing cycle, high testing quantity, difficulty of optimization for process parameters, many training data probably were offered by the way of increment batch and the limitation of the system memory could make the training data infeasible, which existed in the process of calcinations for ammonium uranyl carbonate (AUC) by microwave heating. The prediction model of the nonlinear system was built, which could effectively predict the experiment of microwave calcining of AUC. The predicted results indicated that the contents of U and U 4+ were increased with increasing of microwave power and irradiation time, and decreased with increasing of the material average depth.
Xin, Meiting; Li, Bing; Yan, Xiao; Chen, Lei; Wei, Xiang
2018-02-01
A robust coarse-to-fine registration method based on the backpropagation (BP) neural network and shift window technology is proposed in this study. Specifically, there are three steps: coarse alignment between the model data and measured data, data simplification based on the BP neural network and point reservation in the contour region of point clouds, and fine registration with the reweighted iterative closest point algorithm. In the process of rough alignment, the initial rotation matrix and the translation vector between the two datasets are obtained. After performing subsequent simplification operations, the number of points can be reduced greatly. Therefore, the time and space complexity of the accurate registration can be significantly reduced. The experimental results show that the proposed method improves the computational efficiency without loss of accuracy.
Antwi, Philip; Li, Jianzheng; Boadi, Portia Opoku; Meng, Jia; Shi, En; Deng, Kaiwen; Bondinuba, Francis Kwesi
2017-03-01
Three-layered feedforward backpropagation (BP) artificial neural networks (ANN) and multiple nonlinear regression (MnLR) models were developed to estimate biogas and methane yield in an upflow anaerobic sludge blanket (UASB) reactor treating potato starch processing wastewater (PSPW). Anaerobic process parameters were optimized to identify their importance on methanation. pH, total chemical oxygen demand, ammonium, alkalinity, total Kjeldahl nitrogen, total phosphorus, volatile fatty acids and hydraulic retention time selected based on principal component analysis were used as input variables, whiles biogas and methane yield were employed as target variables. Quasi-Newton method and conjugate gradient backpropagation algorithms were best among eleven training algorithms. Coefficient of determination (R 2 ) of the BP-ANN reached 98.72% and 97.93% whiles MnLR model attained 93.9% and 91.08% for biogas and methane yield, respectively. Compared with the MnLR model, BP-ANN model demonstrated significant performance, suggesting possible control of the anaerobic digestion process with the BP-ANN model. Copyright © 2016 Elsevier Ltd. All rights reserved.
Directory of Open Access Journals (Sweden)
Wijayanti Nurul Khotimah
2017-01-01
Full Text Available Sign Language recognition was used to help people with normal hearing communicate effectively with the deaf and hearing-impaired. Based on survey that conducted by Multi-Center Study in Southeast Asia, Indonesia was on the top four position in number of patients with hearing disability (4.6%. Therefore, the existence of Sign Language recognition is important. Some research has been conducted on this field. Many neural network types had been used for recognizing many kinds of sign languages. However, their performance are need to be improved. This work focuses on the ASL (Alphabet Sign Language in SIBI (Sign System of Indonesian Language which uses one hand and 26 gestures. Here, thirty four features were extracted by using Leap Motion. Further, a new method, Rule Based-Backpropagation Genetic Al-gorithm Neural Network (RB-BPGANN, was used to recognize these Sign Languages. This method is combination of Rule and Back Propagation Neural Network (BPGANN. Based on experiment this pro-posed application can recognize Sign Language up to 93.8% accuracy. It was very good to recognize large multiclass instance and can be solution of overfitting problem in Neural Network algorithm.
Modulated error diffusion CGHs for neural nets
Vermeulen, Pieter J. E.; Casasent, David P.
1990-05-01
New modulated error diffusion CGHs (computer generated holograms) for optical computing are considered. Specific attention is given to their use in optical matrix-vector, associative processor, neural net and optical interconnection architectures. We consider lensless CGH systems (many CGHs use an external Fourier transform (FT) lens), the Fresnel sampling requirements, the effects of finite CGH apertures (sample and hold inputs), dot size correction (for laser recorders), and new applications for this novel encoding method (that devotes attention to quantization noise effects).
Directory of Open Access Journals (Sweden)
Shojaee Safar Ali
2014-01-01
Full Text Available In this study, feasibility of a back-propagated artificial neural network to correlate the binary density of ionic liquids (ILs mixtures containing water as the common solvent has been investigated. To verify the optimized parameters of the neural network, total of 1668 data were collected and divided into two different subsets. The first subsets consisted of more than two-third (1251 data points of data bank was used to find the optimum parameters including weights and biases, number of neurons (7 neurons, transfer functions in hidden and output layer which were tansig and purelin, respectively. In addition, the correlative capability of network was examined using testing subset (417 data points not considered during the training stage. The overall obtained results revealed that the proposed network is accurate enough to correlate the binary density of the ionic liquids mixtures with average absolute relative deviation (AARD % and average relative deviation (ARD % of 1.56% and -0.04 %, respectively. Finally, the correlative capability of the proposed ANN model was compared with one of the available correlations proposed by Rodríguez and Brennecke.
Directory of Open Access Journals (Sweden)
Yi-Qing Wang
2015-09-01
Full Text Available Recent years have seen a surge of interest in multilayer neural networks fueled by their successful applications in numerous image processing and computer vision tasks. In this article, we describe a C++ implementation of the stochastic gradient descent to train a multilayer neural network, where a fast and accurate acceleration of tanh(· is achieved with linear interpolation. As an example of application, we present a neural network able to deliver state-of-the-art performance in image demosaicing.
Predicting carbonate permeabilities from wireline logs using a back-propagation neural network
International Nuclear Information System (INIS)
Wiener, J.M.; Moll, R.F.; Rogers, J.A.
1991-01-01
This paper explores the applicability of using Neural Networks to aid in the determination of carbonate permeability from wireline logs. Resistivity, interval transit time, neutron porosity, and bulk density logs form Texaco's Stockyard Creek Oil field were used as input to a specially designed neural network to predict core permeabilities in this carbonate reservoir. Also of interest was the comparison of the neural network's results to those of standard statistical techniques. The process of developing the neural network for this problem has shown that a good understanding of the data is required when creating the training set from which the network learns. This network was trained to learn core permeabilities from raw and transformed log data using a hyperbolic tangent transfer function and a sum of squares global error function. Also, it required two hidden layers to solve this particular problem
Vairaprakash Gurusamy *1 & K.Nandhini2
2017-01-01
A Neural Network is a powerful data modeling tool that is able to capture and represent complex input/output relationships. The motivation for the development of neural network technology stemmed from the desire to develop an artificial system that could perform "intelligent" tasks similar to those performed by the human brain.Back propagation was created by generalizing the Widrow-Hoff learning rule to multiple-layer networks and nonlinear differentiable transfer functions. The term back pro...
Yuniarto, Budi; Kurniawan, Robert
2017-03-01
PLS Path Modeling (PLS-PM) is different from covariance based SEM, where PLS-PM use an approach based on variance or component, therefore, PLS-PM is also known as a component based SEM. Multiblock Partial Least Squares (MBPLS) is a method in PLS regression which can be used in PLS Path Modeling which known as Multiblock PLS Path Modeling (MBPLS-PM). This method uses an iterative procedure in its algorithm. This research aims to modify MBPLS-PM with Back Propagation Neural Network approach. The result is MBPLS-PM algorithm can be modified using the Back Propagation Neural Network approach to replace the iterative process in backward and forward step to get the matrix t and the matrix u in the algorithm. By modifying the MBPLS-PM algorithm using Back Propagation Neural Network approach, the model parameters obtained are relatively not significantly different compared to model parameters obtained by original MBPLS-PM algorithm.
Chen, Yan; Cai, Kezhou; Tu, Zehui; Nie, Wen; Ji, Tuo; Hu, Bing; Chen, Conggui; Jiang, Shaotong
2017-11-29
Benzo[a]pyrene (BaP), a potent mutagen and carcinogen, is reported to be present in processed meat products and, in particular, in smoked meat. However, few methods exist for predictive determination of the BaP content of smoked meats such as sausage. In this study, an artificial neural network (ANN) model based on the back-propagation (BP) algorithm was used to predict the BaP content of smoked sausage. The results showed that the BP network based on the Levenberg-Marquardt algorithm was the best suited for creating a nonlinear map between the input and output parameters. The optimal network structure was 3-7-1 and the learning rate was 0.6. This BP-ANN model allowed for accurate predictions, with the correlation coefficients (R) for the experimentally determined training, validation, test and global data sets being 0.94, 0.96, 0.95 and 0.95 respectively. The validation performance was 0.013, suggesting that the proposed BP-ANN may be used to predictively detect the BaP content of smoked meat products. An effective predictive model was constructed for estimation of the BaP content of smoked sausage using ANN modeling techniques, which shows potential to predict the BaP content in smoked sausage. © 2017 Society of Chemical Industry. © 2017 Society of Chemical Industry.
Directory of Open Access Journals (Sweden)
Salim Lahmiri
2014-07-01
Full Text Available This paper presents a forecasting model that integrates the discrete wavelet transform (DWT and backpropagation neural networks (BPNN for predicting financial time series. The presented model first uses the DWT to decompose the financial time series data. Then, the obtained approximation (low-frequency and detail (high-frequency components after decomposition of the original time series are used as input variables to forecast future stock prices. Indeed, while high-frequency components can capture discontinuities, ruptures and singularities in the original data, low-frequency components characterize the coarse structure of the data, to identify the long-term trends in the original data. As a result, high-frequency components act as a complementary part of low-frequency components. The model was applied to seven datasets. For all of the datasets, accuracy measures showed that the presented model outperforms a conventional model that uses only low-frequency components. In addition, the presented model outperforms both the well-known auto-regressive moving-average (ARMA model and the random walk (RW process.
New backpropagation algorithm with type-2 fuzzy weights for neural networks
Gaxiola, Fernando; Valdez, Fevrier
2016-01-01
In this book a neural network learning method with type-2 fuzzy weight adjustment is proposed. The mathematical analysis of the proposed learning method architecture and the adaptation of type-2 fuzzy weights are presented. The proposed method is based on research of recent methods that handle weight adaptation and especially fuzzy weights. The internal operation of the neuron is changed to work with two internal calculations for the activation function to obtain two results as outputs of the proposed method. Simulation results and a comparative study among monolithic neural networks, neural network with type-1 fuzzy weights and neural network with type-2 fuzzy weights are presented to illustrate the advantages of the proposed method. The proposed approach is based on recent methods that handle adaptation of weights using fuzzy logic of type-1 and type-2. The proposed approach is applied to a cases of prediction for the Mackey-Glass (for ô=17) and Dow-Jones time series, and recognition of person with iris bi...
Xu, Jun-Fang; Xu, Jing; Li, Shi-Zhu; Jia, Tia-Wu; Huang, Xi-Bao; Zhang, Hua-Ming; Chen, Mei; Yang, Guo-Jing; Gao, Shu-Jing; Wang, Qing-Yun; Zhou, Xiao-Nong
2013-01-01
Background The transmission of schistosomiasis japonica in a local setting is still poorly understood in the lake regions of the People's Republic of China (P. R. China), and its transmission patterns are closely related to human, social and economic factors. Methodology/Principal Findings We aimed to apply the integrated approach of artificial neural network (ANN) and logistic regression model in assessment of transmission risks of Schistosoma japonicum with epidemiological data collected from 2339 villagers from 1247 households in six villages of Jiangling County, P.R. China. By using the back-propagation (BP) of the ANN model, 16 factors out of 27 factors were screened, and the top five factors ranked by the absolute value of mean impact value (MIV) were mainly related to human behavior, i.e. integration of water contact history and infection history, family with past infection, history of water contact, infection history, and infection times. The top five factors screened by the logistic regression model were mainly related to the social economics, i.e. village level, economic conditions of family, age group, education level, and infection times. The risk of human infection with S. japonicum is higher in the population who are at age 15 or younger, or with lower education, or with the higher infection rate of the village, or with poor family, and in the population with more than one time to be infected. Conclusion/Significance Both BP artificial neural network and logistic regression model established in a small scale suggested that individual behavior and socioeconomic status are the most important risk factors in the transmission of schistosomiasis japonica. It was reviewed that the young population (≤15) in higher-risk areas was the main target to be intervened for the disease transmission control. PMID:23556015
Forecasting Urban Air Quality via a Back-Propagation Neural Network and a Selection Sample Rule
Directory of Open Access Journals (Sweden)
Yonghong Liu
2015-07-01
Full Text Available In this paper, based on a sample selection rule and a Back Propagation (BP neural network, a new model of forecasting daily SO2, NO2, and PM10 concentration in seven sites of Guangzhou was developed using data from January 2006 to April 2012. A meteorological similarity principle was applied in the development of the sample selection rule. The key meteorological factors influencing SO2, NO2, and PM10 daily concentrations as well as weight matrices and threshold matrices were determined. A basic model was then developed based on the improved BP neural network. Improving the basic model, identification of the factor variation consistency was added in the rule, and seven sets of sensitivity experiments in one of the seven sites were conducted to obtain the selected model. A comparison of the basic model from May 2011 to April 2012 in one site showed that the selected model for PM10 displayed better forecasting performance, with Mean Absolute Percentage Error (MAPE values decreasing by 4% and R2 values increasing from 0.53 to 0.68. Evaluations conducted at the six other sites revealed a similar performance. On the whole, the analysis showed that the models presented here could provide local authorities with reliable and precise predictions and alarms about air quality if used at an operational scale.
Matching algorithm of missile tail flame based on back-propagation neural network
Huang, Da; Huang, Shucai; Tang, Yidong; Zhao, Wei; Cao, Wenhuan
2018-02-01
This work presents a spectral matching algorithm of missile plume detection that based on neural network. The radiation value of the characteristic spectrum of the missile tail flame is taken as the input of the network. The network's structure including the number of nodes and layers is determined according to the number of characteristic spectral bands and missile types. We can get the network weight matrixes and threshold vectors through training the network using training samples, and we can determine the performance of the network through testing the network using the test samples. A small amount of data cause the network has the advantages of simple structure and practicality. Network structure composed of weight matrix and threshold vector can complete task of spectrum matching without large database support. Network can achieve real-time requirements with a small quantity of data. Experiment results show that the algorithm has the ability to match the precise spectrum and strong robustness.
Directory of Open Access Journals (Sweden)
Song Chul-Gyu
2011-08-01
Full Text Available Abstract Background Radiological scoring methods such as colon transit time (CTT have been widely used for the assessment of bowel motility. However, these radiograph-based methods need cumbersome radiological instruments and their frequent exposure to radiation. Therefore, a non-invasive estimation algorithm of bowel motility, based on a back-propagation neural network (BPNN model of bowel sounds (BS obtained by an auscultation, was devised. Methods Twelve healthy males (age: 24.8 ± 2.7 years and 6 patients with spinal cord injury (6 males, age: 55.3 ± 7.1 years were examined. BS signals generated during the digestive process were recorded from 3 colonic segments (ascending, descending and sigmoid colon, and then, the acoustical features (jitter and shimmer of the individual BS segment were obtained. Only 6 features (J1, 3, J3, 3, S1, 2, S2, 1, S2, 2, S3, 2, which are highly correlated to the CTTs measured by the conventional method, were used as the features of the input vector for the BPNN. Results As a results, both the jitters and shimmers of the normal subjects were relatively higher than those of the patients, whereas the CTTs of the normal subjects were relatively lower than those of the patients (p k-fold cross validation, the correlation coefficient and mean average error between the CTTs measured by a conventional radiograph and the values estimated by our algorithm were 0.89 and 10.6 hours, respectively. Conclusions The jitter and shimmer of the BS signals generated during the peristalsis could be clinically useful for the discriminative parameters of bowel motility. Also, the devised algorithm showed good potential for the continuous monitoring and estimation of bowel motility, instead of conventional radiography, and thus, it could be used as a complementary tool for the non-invasive measurement of bowel motility.
Real-time applications of neural nets
International Nuclear Information System (INIS)
Spencer, J.E.
1989-05-01
Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas, e.g., improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. Such issues are considered, examples given and possibilities discussed. 21 refs., 6 figs
Accelerator diagnosis and control by Neural Nets
International Nuclear Information System (INIS)
Spencer, J.E.
1989-01-01
Neural Nets (NN) have been described as a solution looking for a problem. In the last conference, Artificial Intelligence (AI) was considered in the accelerator context. While good for local surveillance and control, its use for large complex systems (LCS) was much more restricted. By contrast, NN provide a good metaphor for LCS. It can be argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems, and therefore provide an ideal adaptive control system. Thus, where AI may be good for maintaining a 'golden orbit,' NN should be good for obtaining it via a quantitative approach to 'look and adjust' methods like operator tweaking which use pattern recognition to deal with hardware and software limitations, inaccuracies or errors as well as imprecise knowledge or understanding of effects like annealing and hysteresis. Further, insights from NN allow one to define feasibility conditions for LCS in terms of design constraints and tolerances. Hardware and software implications are discussed and several LCS of current interest are compared and contrasted. 15 refs., 5 figs
Accelerator diagnosis and control by Neural Nets
International Nuclear Information System (INIS)
Spencer, J.E.
1989-01-01
Neural Nets (NN) have been described as a solution looking for a problem. In the last conference, Artificial Intelligence (AI) was considered in the accelerator context. While good for local surveillance and control, its use for large complex systems (LCS) was much more restricted. By contrast, NN provide a good metaphore for LCS. It can be argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems and therefore provide an ideal adaptive control system. Thus, where A1 may be good for maintaining a golden orbit, NN should be good for obtaining it via a quantitative approach to look and adjust methods like operator tweaking which use pattern recognition to deal with hardware and software limitations, inaccuracies or errors as well as imprecise knowledge or understanding of effects like annealing and hysteresis. Further, insights from NN allow one to define feasibility conditions for LCS in terms of design constraints and tolerances. Hardware and software implications are discussed and several LCS of current interest are compared and contrasted. 15 refs., 5 figs
Real-time applications of neural nets
Energy Technology Data Exchange (ETDEWEB)
Spencer, J.E.
1989-05-01
Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas, e.g., improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. Such issues are considered, examples given and possibilities discussed. 21 refs., 6 figs.
Real-time applications of neural nets
International Nuclear Information System (INIS)
Spencer, J.E.
1989-01-01
Producing, accelerating and colliding very high power, low emittance beams for long periods is a formidable problem in real-time control. As energy has grown exponentially in time so has the complexity of the machines and their control systems. Similar growth rates have occurred in many areas e.g. improved integrated circuits have been paid for with comparable increases in complexity. However, in this case, reliability, capability and cost have improved due to reduced size, high production and increased integration which allow various kinds of feedback. In contrast, most large complex systems (LCS) are perceived to lack such possibilities because only one copy is made. Neural nets, as a metaphor for LCS, suggest ways to circumvent such limitations. It is argued that they are logically equivalent to multi-loop feedback/forward control of faulty systems. While complimentary to AI, they mesh nicely with characteristics desired for real-time systems. In this paper, such issues are considered, examples given and possibilities discussed
A Simple Quantum Neural Net with a Periodic Activation Function
Daskin, Ammar
2018-01-01
In this paper, we propose a simple neural net that requires only $O(nlog_2k)$ number of qubits and $O(nk)$ quantum gates: Here, $n$ is the number of input parameters, and $k$ is the number of weights applied to these parameters in the proposed neural net. We describe the network in terms of a quantum circuit, and then draw its equivalent classical neural net which involves $O(k^n)$ nodes in the hidden layer. Then, we show that the network uses a periodic activation function of cosine values o...
Sheridan, C.; O'Farrell, M.; Lewis, E.; Lyons, W. B.; Flanagan, C.; Jackman, N.
2006-02-01
This paper reports on two methods of classifying the spectral data from an optical fibre based sensor system as used in the food industry. The first method uses a feed-forward back-propagation artificial neural network while the second method involves using Kohonen self-organizing maps. The sensor monitors the food colour online as the food cooks by examining the reflected light from both the surface and the core of the product. The combination of using principal component analysis and back-propagation neural networks has been successfully investigated previously. In this paper, results obtained using this method are compared with results obtained using a self-organizing map trained on the principal components. The principal components used to train both classifiers are ordered in a 'colourscale'—a scale developed to allow several products of similar colour to be tested using a single network that had been trained using the colourscale. The results presented show that both classifiers perform well, and that any differences that arise occur at the boundaries of the classes.
Conjugate descent formulation of backpropagation error in ...
African Journals Online (AJOL)
nique of backpropagation was popularized in a paper by Rumelhart, et al. ... the training of a multilayer neural network using a gradient descent approach applied to a .... superior convergence of the conjugate descent method over a standard ...
Directory of Open Access Journals (Sweden)
Harjoko Agus
2018-01-01
Full Text Available Acute Myeloid Leukemia (AML is a type of cancer which attacks white blood cells from myeloid. AML has eight subtypes, namely: M0, M1, M2, M3, M4, M5, M6, and M7. AML subtypes M1, M2 and M3 are affected by the same type of cells, myeloblast, making it needs more detailed analysis to distinguish. To overcome these obstacles, this research is applying digital image processing with Active Contour Without Edge (ACWE and Momentum Backpropagation artificial neural network for AML subtypes M1, M2 and M3 classification based on the type of the cell. Six features required as training parameters from every cell obtained by using feature extraction. The features are: cell area, perimeter, circularity, nucleus ratio, mean and standard deviation. The results show that ACWE can be used for segmenting white blood cells with 83.789% success percentage of 876 total cell objects. The whole AML slides had been identified according to the cell types predicted number through training with momentum backpropagation. Five times testing calibration with the best parameter generated averages value of 84.754% precision, 75.887% sensitivity, 95.090% specificity and 93.569% accuracy.
22nd Italian Workshop on Neural Nets
Bassis, Simone; Esposito, Anna; Morabito, Francesco
2013-01-01
This volume collects a selection of contributions which has been presented at the 22nd Italian Workshop on Neural Networks, the yearly meeting of the Italian Society for Neural Networks (SIREN). The conference was held in Italy, Vietri sul Mare (Salerno), during May 17-19, 2012. The annual meeting of SIREN is sponsored by International Neural Network Society (INNS), European Neural Network Society (ENNS) and IEEE Computational Intelligence Society (CIS). The book – as well as the workshop- is organized in three main components, two special sessions and a group of regular sessions featuring different aspects and point of views of artificial neural networks and natural intelligence, also including applications of present compelling interest.
Yu, Hao; Rossi, Giammarco; Braglia, Andrea; Perrone, Guido
2016-08-10
The paper presents the development of a tool based on a back-propagation artificial neural network to assist in the accurate positioning of the lenses used to collimate the beam from semiconductor laser diodes along the so-called fast axis. After training using a Gaussian beam ray-equivalent model, the network is capable of indicating the tilt, decenter, and defocus of such lenses from the measured field distribution, so the operator can determine the errors with respect to the actual lens position and optimize the diode assembly procedure. An experimental validation using a typical configuration exploited in multi-emitter diode module assembly and fast axis collimating lenses with different focal lengths and numerical apertures is reported.
Musical Audio Synthesis Using Autoencoding Neural Nets
Sarroff, Andy; Casey, Michael A.
2014-01-01
With an optimal network topology and tuning of hyperpa-\\ud rameters, artificial neural networks (ANNs) may be trained\\ud to learn a mapping from low level audio features to one\\ud or more higher-level representations. Such artificial neu-\\ud ral networks are commonly used in classification and re-\\ud gression settings to perform arbitrary tasks. In this work\\ud we suggest repurposing autoencoding neural networks as\\ud musical audio synthesizers. We offer an interactive musi-\\ud cal audio synt...
Vrettaros, John; Vouros, George; Drigas, Athanasios S.
This article studies the expediency of using neural networks technology and the development of back-propagation networks (BPN) models for modeling automated evaluation of the answers and progress of deaf students' that possess basic knowledge of the English language and computer skills, within a virtual e-learning environment. The performance of the developed neural models is evaluated with the correlation factor between the neural networks' response values and the real value data as well as the percentage measurement of the error between the neural networks' estimate values and the real value data during its training process and afterwards with unknown data that weren't used in the training process.
Equivalence of Equilibrium Propagation and Recurrent Backpropagation
Scellier, Benjamin; Bengio, Yoshua
2017-01-01
Recurrent Backpropagation and Equilibrium Propagation are algorithms for fixed point recurrent neural networks which differ in their second phase. In the first phase, both algorithms converge to a fixed point which corresponds to the configuration where the prediction is made. In the second phase, Recurrent Backpropagation computes error derivatives whereas Equilibrium Propagation relaxes to another nearby fixed point. In this work we establish a close connection between these two algorithms....
International Nuclear Information System (INIS)
Doh, Jaeh Yeok; Lee, Jong Soo; Lee, Seung Uk
2016-01-01
In this study, a Back-propagation neural network (BPN) is employed to conduct an approximation of a true stress-strain curve using the load-displacement experimental data of DP590, a high-strength material used in automobile bodies and chassis. The optimized interconnection weights are obtained with hidden layers and output layers of the BPN through intelligent learning and training of the experimental data; by using these weights, a mathematical model of the material's behavior is suggested through this feed-forward neural network. Generally, the material properties from the tensile test cannot be acquired until the fracture regions, since it is difficult to measure the cross-section area of a specimen after diffusion necking. For this reason, the plastic properties of the true stress-strain are extrapolated using the weighted-average method after diffusion necking. The accuracies of BPN-based meta-models for predicting material properties are validated in terms of the Root mean square error (RMSE). By applying the approximate material properties, the reliable finite element solution can be obtained to realize the different shapes of the finite element models. Furthermore, the sensitivity analysis of the approximate meta-model is performed using the first-order approximate derivatives of the BPN and is compared with the results of the finite difference method. In addition, we predict the tension velocity's effect on the material property through a first-order sensitivity analysis.
Neural nets for massively parallel optimization
Dixon, Laurence C. W.; Mills, David
1992-07-01
To apply massively parallel processing systems to the solution of large scale optimization problems it is desirable to be able to evaluate any function f(z), z (epsilon) Rn in a parallel manner. The theorem of Cybenko, Hecht Nielsen, Hornik, Stinchcombe and White, and Funahasi shows that this can be achieved by a neural network with one hidden layer. In this paper we address the problem of the number of nodes required in the layer to achieve a given accuracy in the function and gradient values at all points within a given n dimensional interval. The type of activation function needed to obtain nonsingular Hessian matrices is described and a strategy for obtaining accurate minimal networks presented.
Bahadir, Elif
2016-01-01
The purpose of this study is to examine a neural network based approach to predict achievement in graduate education for Elementary Mathematics prospective teachers. With the help of this study, it can be possible to make an effective prediction regarding the students' achievement in graduate education with Artificial Neural Networks (ANN). Two…
Computation and control with neural nets
Energy Technology Data Exchange (ETDEWEB)
Corneliusen, A.; Terdal, P.; Knight, T.; Spencer, J.
1989-10-04
As energies have increased exponentially with time so have the size and complexity of accelerators and control systems. NN may offer the kinds of improvements in computation and control that are needed to maintain acceptable functionality. For control their associative characteristics could provide signal conversion or data translation. Because they can do any computation such as least squares, they can close feedback loops autonomously to provide intelligent control at the point of action rather than at a central location that requires transfers, conversions, hand-shaking and other costly repetitions like input protection. Both computation and control can be integrated on a single chip, printed circuit or an optical equivalent that is also inherently faster through full parallel operation. For such reasons one expects lower costs and better results. Such systems could be optimized by integrating sensor and signal processing functions. Distributed nets of such hardware could communicate and provide global monitoring and multiprocessing in various ways e.g. via token, slotted or parallel rings (or Steiner trees) for compatibility with existing systems. Problems and advantages of this approach such as an optimal, real-time Turing machine are discussed. Simple examples are simulated and hardware implemented using discrete elements that demonstrate some basic characteristics of learning and parallelism. Future microprocessors' are predicted and requested on this basis. 19 refs., 18 figs.
Computation and control with neural nets
International Nuclear Information System (INIS)
Corneliusen, A.; Terdal, P.; Knight, T.; Spencer, J.
1989-01-01
As energies have increased exponentially with time so have the size and complexity of accelerators and control systems. NN may offer the kinds of improvements in computation and control that are needed to maintain acceptable functionality. For control their associative characteristics could provide signal conversion or data translation. Because they can do any computation such as least squares, they can close feedback loops autonomously to provide intelligent control at the point of action rather than at a central location that requires transfers, conversions, hand-shaking and other costly repetitions like input protection. Both computation and control can be integrated on a single chip, printed circuit or an optical equivalent that is also inherently faster through full parallel operation. For such reasons one expects lower costs and better results. Such systems could be optimized by integrating sensor and signal processing functions. Distributed nets of such hardware could communicate and provide global monitoring and multiprocessing in various ways e.g. via token, slotted or parallel rings (or Steiner trees) for compatibility with existing systems. Problems and advantages of this approach such as an optimal, real-time Turing machine are discussed. Simple examples are simulated and hardware implemented using discrete elements that demonstrate some basic characteristics of learning and parallelism. Future 'microprocessors' are predicted and requested on this basis. 19 refs., 18 figs
Carrasco, Manuel; Garde, Andres; Murillo, Pilar; Serrano, Luis
2005-06-01
In this paper a novel design and implementation of a VLSI Analogue Neural Net based on Multi-Layer Perceptron (MLP) with on-chip Back Propagation (BP) learning algorithm suitable for the resolution of classification problems is described. In order to implement a general and programmable analogue architecture, the design has been carried out in a hierarchical way. In this way the net has been divided in synapsis-blocks and neuron-blocks providing an easy method for the analysis. These blocks basically consist on simple cells, which are mainly, the activation functions (NAF), derivatives (DNAF), multipliers and weight update circuits. The analogue design is based on current-mode translinear techniques using MOS transistors working in the weak inversion region in order to reduce both the voltage supply and the power consumption. Moreover, with the purpose of minimizing the noise, offset and distortion of even order, the topologies are fully-differential and balanced. The circuit, named ANNE (Analogue Neural NEt), has been prototyped and characterized as a proof of concept on CMOS AMI-0.5A technology occupying a total area of 2.7mm2. The chip includes two versions of neural nets with on-chip BP learning algorithm, which are respectively a 2-1 and a 2-2-1 implementations. The proposed nets have been experimentally tested using supply voltages from 2.5V to 1.8V, which is suitable for single cell lithium-ion battery supply applications. Experimental results of both implementations included in ANNE exhibit a good performance on solving classification problems. These results have been compared with other proposed Analogue VLSI implementations of Neural Nets published in the literature demonstrating that our proposal is very efficient in terms of occupied area and power consumption.
Directory of Open Access Journals (Sweden)
Zhilong Wang
2014-01-01
Full Text Available In the electricity market, the electricity price plays an inevitable role. Nevertheless, accurate price forecasting, a vital factor affecting both government regulatory agencies and public power companies, remains a huge challenge and a critical problem. Determining how to address the accurate forecasting problem becomes an even more significant task in an era in which electricity is increasingly important. Based on the chaos particle swarm optimization (CPSO, the backpropagation artificial neural network (BPANN, and the idea of bivariate division, this paper proposes a bivariate division BPANN (BD-BPANN method and the CPSO-BD-BPANN method for forecasting electricity price. The former method creatively transforms the electricity demand and price to be a new variable, named DV, which is calculated using the division principle, to forecast the day-ahead electricity by multiplying the forecasted values of the DVs and forecasted values of the demand. Next, to improve the accuracy of BD-BPANN, chaos particle swarm optimization and BD-BPANN are synthesized to form a novel model, CPSO-BD-BPANN. In this study, CPSO is utilized to optimize the initial parameters of BD-BPANN to make its output more stable than the original model. Finally, two forecasting strategies are proposed regarding different situations.
Directory of Open Access Journals (Sweden)
Gang Yang
2017-09-01
Full Text Available The solubility data of compounds in supercritical fluids and the correlation between the experimental solubility data and predicted solubility data are crucial to the development of supercritical technologies. In the present work, the solubility data of silymarin (SM in both pure supercritical carbon dioxide (SCCO2 and SCCO2 with added cosolvent was measured at temperatures ranging from 308 to 338 K and pressures from 8 to 22 MPa. The experimental data were fit with three semi-empirical density-based models (Chrastil, Bartle and Mendez-Santiago and Teja models and a back-propagation artificial neural networks (BPANN model. Interaction parameters for the models were obtained and the percentage of average absolute relative deviation (AARD% in each calculation was determined. The correlation results were in good agreement with the experimental data. A comparison among the four models revealed that the experimental solubility data were more fit with the BPANN model with AARDs ranging from 1.14% to 2.15% for silymarin in pure SCCO2 and with added cosolvent. The results provide fundamental data for designing the extraction of SM or the preparation of its particle using SCCO2 techniques.
Directory of Open Access Journals (Sweden)
Hyung-Suk Han
2012-12-01
Full Text Available The indoor noise of a ship is usually determined using the A-weighted sound pressure level. However, in order to better understand this phenomenon, evaluation parameters that more accurately reflect the human sense of hearing are required. To find the level of the satisfaction index of the noise inside a naval vessel such as “Loudness” and “Annoyance”, psycho-acoustic evaluation of various sound recordings from the naval vessel was performed in a laboratory. The objective of this paper is to develop a single index of “Loudness” and “Annoyance” for noise inside a naval vessel according to a psycho-acoustic evaluation by using psychological responses such as Noise Rating (NR, Noise Criterion (NC, Room Criterion (RC, Preferred Speech Interference Level (PSIL and loudness level. Additionally, in order to determine a single index of satisfaction for noise such as “Loudness” and “Annoyance”, with respect to a human's sense of hearing, a back-propagation neural network is applied.
Artificial neural nets application in the cotton yarn industry
Directory of Open Access Journals (Sweden)
Gilberto Clóvis Antoneli
2016-06-01
Full Text Available The competitiveness in the yarn production sector has led companies to search for solutions to attain quality yarn at a low cost. Today, the difference between them, and thus the sector, is in the raw material, meaning processed cotton and its characteristics. There are many types of cotton with different characteristics due to its production region, harvest, storage and transportation. Yarn industries work with cotton mixtures, which makes it difficult to determine the quality of the yarn produced from the characteristics of the processed fibers. This study uses data from a conventional spinning, from a raw material made of 100% cotton, and presents a solution with artificial neural nets that determine the thread quality information, using the fibers’ characteristics values and settings of some process adjustments. In this solution a neural net of the type MultiLayer Perceptron with 11 entry neurons (8 characteristics of the fiber and 3 process adjustments, 7 output neurons (yarn quality and two types of training, Back propagation and Conjugate gradient descent. The selection and organization of the production data of the yarn industry of the cocamar® indústria de fios company are described, to apply the artificial neural nets developed. In the application of neural nets to determine yarn quality, one concludes that, although the ideal precision of absolute values is lacking, the presented solution represents an excellent tool to define yarn quality variations when modifying the raw material composition. The developed system enables a simulation to define the raw material percentage mixture to be processed in the plant using the information from the stocked cotton packs, thus obtaining a mixture that maintains the stability of the entire productive process.
Fauziah; Wibowo, E. P.; Madenda, S.; Hustinawati
2018-03-01
Capturing and recording motion in human is mostly done with the aim for sports, health, animation films, criminality, and robotic applications. In this study combined background subtraction and back propagation neural network. This purpose to produce, find similarity movement. The acquisition process using 8 MP resolution camera MP4 format, duration 48 seconds, 30frame/rate. video extracted produced 1444 pieces and results hand motion identification process. Phase of image processing performed is segmentation process, feature extraction, identification. Segmentation using bakground subtraction, extracted feature basically used to distinguish between one object to another object. Feature extraction performed by using motion based morfology analysis based on 7 invariant moment producing four different classes motion: no object, hand down, hand-to-side and hands-up. Identification process used to recognize of hand movement using seven inputs. Testing and training with a variety of parameters tested, it appears that architecture provides the highest accuracy in one hundred hidden neural network. The architecture is used propagate the input value of the system implementation process into the user interface. The result of the identification of the type of the human movement has been clone to produce the highest acuracy of 98.5447%. The training process is done to get the best results.
3-D inversion of borehole-to-surface electrical data using a back-propagation neural network
Ho, Trong Long
2009-08-01
The "fluid-flow tomography", an advanced technique for geoelectrical survey based on the conventional mise-à-la-masse measurement, has been developed by Exploration Geophysics Laboratory at the Kyushu University. This technique is proposed to monitor fluid-flow behavior during water injection and production in a geothermal field. However data processing of this technique is very costly. In this light, this paper will discuss the solution to cost reduction by applying a neural network in the data processing. A case study in the Takigami geothermal field in Japan will be used to illustrate this. The achieved neural network in this case study is three-layered and feed-forward. The most successful learning algorithm in this network is the Resilient Propagation (RPROP). Consequently, the study advances the pragmatism of the "fluid-flow tomography" technique which can be widely used for geothermal fields. Accuracy of the solution is then verified by using root mean square (RMS) misfit error as an indicator.
Unfolding code for neutron spectrometry based on neural nets technology
International Nuclear Information System (INIS)
Ortiz R, J. M.; Vega C, H. R.
2012-10-01
The most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Neural Networks have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This unfolding code called Neutron Spectrometry and Dosimetry by means of Artificial Neural Networks was designed in a graphical interface under LabVIEW programming environment. The core of the code is an embedded neural network architecture, previously optimized by the R obust Design of Artificial Neural Networks Methodology . The main features of the code are: is easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a 6 Lil(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, only seven rate counts measurement with a Bonner spheres spectrometer are required for simultaneously unfold the 60 energy bins of the neutron spectrum and to calculate 15 dosimetric quantities, for radiation protection porpoises. This code generates a full report in html format with all relevant information. (Author)
Unfolding code for neutron spectrometry based on neural nets technology
Energy Technology Data Exchange (ETDEWEB)
Ortiz R, J. M.; Vega C, H. R., E-mail: morvymm@yahoo.com.mx [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica, Apdo. Postal 336, 98000 Zacatecas (Mexico)
2012-10-15
The most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Neural Networks have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This unfolding code called Neutron Spectrometry and Dosimetry by means of Artificial Neural Networks was designed in a graphical interface under LabVIEW programming environment. The core of the code is an embedded neural network architecture, previously optimized by the {sup R}obust Design of Artificial Neural Networks Methodology{sup .} The main features of the code are: is easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a {sup 6}Lil(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, only seven rate counts measurement with a Bonner spheres spectrometer are required for simultaneously unfold the 60 energy bins of the neutron spectrum and to calculate 15 dosimetric quantities, for radiation protection porpoises. This code generates a full report in html format with all relevant information. (Author)
Directory of Open Access Journals (Sweden)
Orlando Lastres Danguillecourt
2012-03-01
Full Text Available Este trabajo presenta los resultados preliminares de la configuración de una red neuronal artificial (ANN, de tipo alimentación hacia adelante con el método de entrenamiento de retro-propagación para pronosticar la velocidad de viento en la región del Istmo de Tehuantepec, Oaxaca, México. La base de datos utilizada abarca los años comprendidos entre Junio 2008- Noviembre 2011, y fue suministrada por una estación meteorológica ubicada en la Universidad del Istmo campus Tehuantepec. Los experimentos se realizaron utilizando las siguientes variables: velocidad del viento, presión, temperatura y fecha. Al mismo tiempo se hicieron siete pruebas combinando estas variables, comparando su error cuadrático medio (MSE y el coeficiente de correlación r, con los datos de predicción y experimentales. En esta investigación, se propone una ANN de dos capas ocultas, para un pronóstico de 48 horas.This paper presents the preliminary results of setting up an artificial neural network (ANN of the feed forward type with the backpropagation training method for forecast wind speed in the region in the Isthmus of Tehuantepec, Oaxaca, Mexico. The database used covers the years from June 2008 - November 2011, and was supplied by a meteorological station located at the Isthmus University campus Tehuantepec. The experiments were done using the following variables: wind speed, pressure, temperature and date. At the same time were done seven tests combining these variables, comparing their mean square error (MSE and coefficient correlation r, with data the predicting and experimental. In this research, is proposed a ANN of two hidden layers, for a forecast of 48 hours.
Wang, Zheng; Mao, Zhihua; Xia, Junshi; Du, Peijun; Shi, Liangliang; Huang, Haiqing; Wang, Tianyu; Gong, Fang; Zhu, Qiankun
2018-06-01
The cloud cover for the South China Sea and its coastal area is relatively large throughout the year, which limits the potential application of optical remote sensing. A HJ-charge-coupled device (HJ-CCD) has the advantages of wide field, high temporal resolution, and short repeat cycle. However, this instrument suffers from its use of only four relatively low-quality bands which can't adequately resolve the features of long wavelengths. The Landsat Enhanced Thematic Mapper-plus (ETM+) provides high-quality data, however, the Scan Line Corrector (SLC) stopped working and caused striping of remote sensed images, which dramatically reduced the coverage of the ETM+ data. In order to combine the advantages of the HJ-CCD and Landsat ETM+ data, we adopted a back-propagation artificial neural network (BP-ANN) to fuse these two data types for this study. The results showed that the fused output data not only have the advantage of data intactness for the HJ-CCD, but also have the advantages of the multi-spectral and high radiometric resolution of the ETM+ data. Moreover, the fused data were analyzed qualitatively, quantitatively and from a practical application point of view. Experimental studies indicated that the fused data have a full spatial distribution, multi-spectral bands, high radiometric resolution, a small difference between the observed and fused output data, and a high correlation between the observed and fused data. The excellent performance in its practical application is a further demonstration that the fused data are of high quality.
Song, Xianzhi; Peng, Chi; Li, Gensheng; He, Zhenguo; Wang, Haizhu
2016-01-01
Sand production and blockage are common during the drilling and production of horizontal oil and gas wells as a result of formation breakdown. The use of high-pressure rotating jets and annular helical flow is an effective way to enhance horizontal wellbore cleanout. In this paper, we propose the idea of using supercritical CO2 (SC-CO2) as washing fluid in water-sensitive formation. SC-CO2 is manifested to be effective in preventing formation damage and enhancing production rate as drilling fluid, which justifies tis potential in wellbore cleanout. In order to investigate the effectiveness of SC-CO2 helical flow cleanout, we perform the numerical study on the annular flow field, which significantly affects sand cleanout efficiency, of SC-CO2 jets in horizontal wellbore. Based on the field data, the geometry model and mathematical models were built. Then a numerical simulation of the annular helical flow field by SC-CO2 jets was accomplished. The influences of several key parameters were investigated, and SC-CO2 jets were compared to conventional water jets. The results show that flow rate, ambient temperature, jet temperature, and nozzle assemblies play the most important roles on wellbore flow field. Once the difference between ambient temperatures and jet temperatures is kept constant, the wellbore velocity distributions will not change. With increasing lateral nozzle size or decreasing rear/forward nozzle size, suspending ability of SC-CO2 flow improves obviously. A back-propagation artificial neural network (BP-ANN) was successfully employed to match the operation parameters and SC-CO2 flow velocities. A comprehensive model was achieved to optimize the operation parameters according to two strategies: cost-saving strategy and local optimal strategy. This paper can help to understand the distinct characteristics of SC-CO2 flow. And it is the first time that the BP-ANN is introduced to analyze the flow field during wellbore cleanout in horizontal wells.
Conjugate descent formulation of backpropagation error in ...
African Journals Online (AJOL)
The feedforward neural network architecture uses backpropagation learning to determine optimal weights between dierent interconnected layers. This learning procedure uses a gradient descent technique applied to a sum-of-squares error function for the given input-output pattern. It employs an iterative procedure to ...
Face recognition: Eigenface, elastic matching, and neural nets
International Nuclear Information System (INIS)
Zhang, J.; Lades, M.
1997-01-01
This paper is a comparative study of three recently proposed algorithms for face recognition: eigenface, autoassociation and classification neural nets, and elastic matching. After these algorithms were analyzed under a common statistical decision framework, they were evaluated experimentally on four individual data bases, each with a moderate subject size, and a combined data base with more than a hundred different subjects. Analysis and experimental results indicate that the eigenface algorithm, which is essentially a minimum distance classifier, works well when lighting variation is small. Its performance deteriorates significantly as lighting variation increases. The elastic matching algorithm, on the other hand, is insensitive to lighting, face position, and expression variations and therefore is more versatile. The performance of the autoassociation and classification nets is upper bounded by that of the eigenface but is more difficult to implement in practice
Neural net generated seismic facies map and attribute facies map
International Nuclear Information System (INIS)
Addy, S.K.; Neri, P.
1998-01-01
The usefulness of 'seismic facies maps' in the analysis of an Upper Wilcox channel system in a 3-D survey shot by CGG in 1995 in Lavaca county in south Texas was discussed. A neural net-generated seismic facies map is a quick hydrocarbon exploration tool that can be applied regionally as well as on a prospect scale. The new technology is used to classify a constant interval parallel to a horizon in a 3-D seismic volume based on the shape of the wiggle traces using a neural network technology. The tool makes it possible to interpret sedimentary features of a petroleum deposit. The same technology can be used in regional mapping by making 'attribute facies maps' in which various forms of amplitude attributes, phase attributes or frequency attributes can be used
Directory of Open Access Journals (Sweden)
Xianzhi Song
Full Text Available Sand production and blockage are common during the drilling and production of horizontal oil and gas wells as a result of formation breakdown. The use of high-pressure rotating jets and annular helical flow is an effective way to enhance horizontal wellbore cleanout. In this paper, we propose the idea of using supercritical CO2 (SC-CO2 as washing fluid in water-sensitive formation. SC-CO2 is manifested to be effective in preventing formation damage and enhancing production rate as drilling fluid, which justifies tis potential in wellbore cleanout. In order to investigate the effectiveness of SC-CO2 helical flow cleanout, we perform the numerical study on the annular flow field, which significantly affects sand cleanout efficiency, of SC-CO2 jets in horizontal wellbore. Based on the field data, the geometry model and mathematical models were built. Then a numerical simulation of the annular helical flow field by SC-CO2 jets was accomplished. The influences of several key parameters were investigated, and SC-CO2 jets were compared to conventional water jets. The results show that flow rate, ambient temperature, jet temperature, and nozzle assemblies play the most important roles on wellbore flow field. Once the difference between ambient temperatures and jet temperatures is kept constant, the wellbore velocity distributions will not change. With increasing lateral nozzle size or decreasing rear/forward nozzle size, suspending ability of SC-CO2 flow improves obviously. A back-propagation artificial neural network (BP-ANN was successfully employed to match the operation parameters and SC-CO2 flow velocities. A comprehensive model was achieved to optimize the operation parameters according to two strategies: cost-saving strategy and local optimal strategy. This paper can help to understand the distinct characteristics of SC-CO2 flow. And it is the first time that the BP-ANN is introduced to analyze the flow field during wellbore cleanout in
Neural-net disruption predictor in JT-60U
International Nuclear Information System (INIS)
Yoshino, R.
2003-01-01
The prediction of major disruptions caused by the density limit, the plasma current ramp-down with high internal inductance l i , the low density locked mode and the β-limit has been investigated in JT-60U. The concept of 'stability level', newly proposed in this paper to predict the occurrence of a major disruption, is calculated from nine input parameters every 2 ms by the neural network and the start of a major disruption is predicted when the stability level decreases to a certain level, the 'alarm level'. The neural network is trained in two steps. It is first trained with 12 disruptive and six non-disruptive shots (total of 8011 data points). Second, the target output data for 12 disruptive shots are modified and the network is trained again with additional data points generated by the operator. The 'neural-net disruption predictor' obtained has been tested for 300 disruptive shots (128 945 data points) and 1008 non-disruptive shots (982 800 data points) selected from nine years of operation (1991-1999) of JT-60U. Major disruptions except for those caused by the -limit have been predicted with a prediction success rate of 97-98% at 10 ms prior to the disruption and higher than 90% at 30 ms prior to the disruption while the false alarm rate is 2.1% for non-disruptive shots. This prediction performance has been confirmed for 120 disruptive shots (56 163 data points), caused by the density limit, as well as 1032 non-disruptive shots (1004 611 data points) in the last four years of operation (1999-2002) of JT-60U. A careful selection of the input parameters supplied to the network and the newly developed two-step training of the network have reduced the false alarm rate resulting in a considerable improvement of the prediction success rate. (author)
Neural nets for job-shop scheduling, will they do the job?
Rooda, J.E.; Willems, T.M.; Goodwin, G.C.; Evans, R.J.
1993-01-01
A neural net structure has been developed which is capable of solving deterministic jobshop scheduling problems, part of the large class of np-complete problems. The problem was translated in an integer linear-programming format which facilitated translation in an adequate neural net structure. Use
Rainfall prediction with backpropagation method
Wahyuni, E. G.; Fauzan, L. M. F.; Abriyani, F.; Muchlis, N. F.; Ulfa, M.
2018-03-01
Rainfall is an important factor in many fields, such as aviation and agriculture. Although it has been assisted by technology but the accuracy can not reach 100% and there is still the possibility of error. Though current rainfall prediction information is needed in various fields, such as agriculture and aviation fields. In the field of agriculture, to obtain abundant and quality yields, farmers are very dependent on weather conditions, especially rainfall. Rainfall is one of the factors that affect the safety of aircraft. To overcome the problems above, then it’s required a system that can accurately predict rainfall. In predicting rainfall, artificial neural network modeling is applied in this research. The method used in modeling this artificial neural network is backpropagation method. Backpropagation methods can result in better performance in repetitive exercises. This means that the weight of the ANN interconnection can approach the weight it should be. Another advantage of this method is the ability in the learning process adaptively and multilayer owned on this method there is a process of weight changes so as to minimize error (fault tolerance). Therefore, this method can guarantee good system resilience and consistently work well. The network is designed using 4 input variables, namely air temperature, air humidity, wind speed, and sunshine duration and 3 output variables ie low rainfall, medium rainfall, and high rainfall. Based on the research that has been done, the network can be used properly, as evidenced by the results of the prediction of the system precipitation is the same as the results of manual calculations.
Enhancing the top-quark signal at Fermilab Tevatron using neural nets
International Nuclear Information System (INIS)
Ametller, L.; Garrido, L.; Talavera, P.
1994-01-01
We show, in agreement with previous studies, that neural nets can be useful for top-quark analysis at the Fermilab Tevatron. The main features of t bar t and background events in a mixed sample are projected on a single output, which controls the efficiency, purity, and statistical significance of the t bar t signal. We consider a feed-forward multilayer neural net for the CDF reported top-quark mass, using six kinematical variables as inputs. Our main results are based on the exhaustive comparison of the neural net performances with those obtainable from the standard experimental analysis, by imposing different sets of linear cuts over the same variables, showing how the neural net approach improves the standard analysis results
DeepNet: An Ultrafast Neural Learning Code for Seismic Imaging
International Nuclear Information System (INIS)
Barhen, J.; Protopopescu, V.; Reister, D.
1999-01-01
A feed-forward multilayer neural net is trained to learn the correspondence between seismic data and well logs. The introduction of a virtual input layer, connected to the nominal input layer through a special nonlinear transfer function, enables ultrafast (single iteration), near-optimal training of the net using numerical algebraic techniques. A unique computer code, named DeepNet, has been developed, that has achieved, in actual field demonstrations, results unattainable to date with industry standard tools
A bat's ear view of neural nets in physics
International Nuclear Information System (INIS)
Denby, B.
1997-01-01
The use of neural networks in high energy physics has become a field of its own which now has been in existence for ten years. This paper attempts to draw some conclusions on the utility of neural networks for physics applications, and also to make some projections for the future of this line of research. (orig.)
Do neural nets learn statistical laws behind natural language?
Directory of Open Access Journals (Sweden)
Shuntaro Takahashi
Full Text Available The performance of deep learning in natural language processing has been spectacular, but the reasons for this success remain unclear because of the inherent complexity of deep learning. This paper provides empirical evidence of its effectiveness and of a limitation of neural networks for language engineering. Precisely, we demonstrate that a neural language model based on long short-term memory (LSTM effectively reproduces Zipf's law and Heaps' law, two representative statistical properties underlying natural language. We discuss the quality of reproducibility and the emergence of Zipf's law and Heaps' law as training progresses. We also point out that the neural language model has a limitation in reproducing long-range correlation, another statistical property of natural language. This understanding could provide a direction for improving the architectures of neural networks.
Larger bases and mixed analog/digital neural nets
Energy Technology Data Exchange (ETDEWEB)
Beiu, V.
1998-12-31
The paper overviews results dealing with the approximation capabilities of neural networks, and bounds on the size of threshold gate circuits. Based on an explicit numerical algorithm for Kolmogorov`s superpositions the authors show that minimum size neural networks--for implementing any Boolean function--have the identity function as the activation function. Conclusions and several comments on the required precision are ending the paper.
Analysis of Accuracy and Epoch on Back-propagation BFGS Quasi-Newton
Silaban, Herlan; Zarlis, Muhammad; Sawaluddin
2017-12-01
Back-propagation is one of the learning algorithms on artificial neural networks that have been widely used to solve various problems, such as pattern recognition, prediction and classification. The Back-propagation architecture will affect the outcome of learning processed. BFGS Quasi-Newton is one of the functions that can be used to change the weight of back-propagation. This research tested some back-propagation architectures using classical back-propagation and back-propagation with BFGS. There are 7 architectures that have been tested on glass dataset with various numbers of neurons, 6 architectures with 1 hidden layer and 1 architecture with 2 hidden layers. BP with BFGS improves the convergence of the learning process. The average improvement convergence is 98.34%. BP with BFGS is more optimal on architectures with smaller number of neurons with decreased epoch number is 94.37% with the increase of accuracy about 0.5%.
Energy Technology Data Exchange (ETDEWEB)
Djukanovic, M [Institut Nikola Tesla, Belgrade (Yugoslavia); Sobajic, D J; Pao, Yohhan [Case Western Reserve Univ., Cleveland, OH (United States)
1991-10-01
The identification of the mode of instability plays an essential role in generating principal energy boundary hypersurfaces. We present a new method for unstable machine identification based on the use of supervised learning neural-net technology, and the adaptive pattern recognition concept. It is shown that using individual energy functions as pattern features, appropriately trained neural-nets can retrieve the reliable characterization of the transient process including critical clearing time parameter, mode of instability and energy margins. Generalization capabilities of the neural-net processing allow for these assessments to be made independently of load levels. The results obtained from computer simulations are presented using the New England power system, as an example. (author).
Goal-seeking neural net for recall and recognition
Omidvar, Omid M.
1990-07-01
Neural networks have been used to mimic cognitive processes which take place in animal brains. The learning capability inherent in neural networks makes them suitable candidates for adaptive tasks such as recall and recognition. The synaptic reinforcements create a proper condition for adaptation, which results in memorization, formation of perception, and higher order information processing activities. In this research a model of a goal seeking neural network is studied and the operation of the network with regard to recall and recognition is analyzed. In these analyses recall is defined as retrieval of stored information where little or no matching is involved. On the other hand recognition is recall with matching; therefore it involves memorizing a piece of information with complete presentation. This research takes the generalized view of reinforcement in which all the signals are potential reinforcers. The neuronal response is considered to be the source of the reinforcement. This local approach to adaptation leads to the goal seeking nature of the neurons as network components. In the proposed model all the synaptic strengths are reinforced in parallel while the reinforcement among the layers is done in a distributed fashion and pipeline mode from the last layer inward. A model of complex neuron with varying threshold is developed to account for inhibitory and excitatory behavior of real neuron. A goal seeking model of a neural network is presented. This network is utilized to perform recall and recognition tasks. The performance of the model with regard to the assigned tasks is presented.
Non-Linear Back-propagation: Doing Back-Propagation withoutDerivatives of the Activation Function
DEFF Research Database (Denmark)
Hertz, John; Krogh, Anders Stærmose; Lautrup, Benny
1997-01-01
The conventional linear back-propagation algorithm is replaced by a non-linear version, which avoids the necessity for calculating the derivative of the activation function. This may be exploited in hardware realizations of neural processors. In this paper we derive the non-linear back...
Neural-net based real-time economic dispatch for thermal power plants
Energy Technology Data Exchange (ETDEWEB)
Djukanovic, M.; Milosevic, B. [Inst. Nikola Tesla, Belgrade (Yugoslavia). Dept. of Power Systems; Calovic, M. [Univ. of Belgrade (Yugoslavia). Dept. of Electrical Engineering; Sobajic, D.J. [Electric Power Research Inst., Palo Alto, CA (United States)
1996-12-01
This paper proposes the application of artificial neural networks to real-time optimal generation dispatch of thermal units. The approach can take into account the operational requirements and network losses. The proposed economic dispatch uses an artificial neural network (ANN) for generation of penalty factors, depending on the input generator powers and identified system load change. Then, a few additional iterations are performed within an iterative computation procedure for the solution of coordination equations, by using reference-bus penalty-factors derived from the Newton-Raphson load flow. A coordination technique for environmental and economic dispatch of pure thermal systems, based on the neural-net theory for simplified solution algorithms and improved man-machine interface is introduced. Numerical results on two test examples show that the proposed algorithm can efficiently and accurately develop optimal and feasible generator output trajectories, by applying neural-net forecasts of system load patterns.
Vector control of wind turbine on the basis of the fuzzy selective neural net*
Engel, E. A.; Kovalev, I. V.; Engel, N. E.
2016-04-01
An article describes vector control of wind turbine based on fuzzy selective neural net. Based on the wind turbine system’s state, the fuzzy selective neural net tracks an maximum power point under random perturbations. Numerical simulations are accomplished to clarify the applicability and advantages of the proposed vector wind turbine’s control on the basis of the fuzzy selective neuronet. The simulation results show that the proposed intelligent control of wind turbine achieves real-time control speed and competitive performance, as compared to a classical control model with PID controllers based on traditional maximum torque control strategy.
TAO-robust backpropagation learning algorithm.
Pernía-Espinoza, Alpha V; Ordieres-Meré, Joaquín B; Martínez-de-Pisón, Francisco J; González-Marcos, Ana
2005-03-01
In several fields, as industrial modelling, multilayer feedforward neural networks are often used as universal function approximations. These supervised neural networks are commonly trained by a traditional backpropagation learning format, which minimises the mean squared error (mse) of the training data. However, in the presence of corrupted data (outliers) this training scheme may produce wrong models. We combine the benefits of the non-linear regression model tau-estimates [introduced by Tabatabai, M. A. Argyros, I. K. Robust Estimation and testing for general nonlinear regression models. Applied Mathematics and Computation. 58 (1993) 85-101] with the backpropagation algorithm to produce the TAO-robust learning algorithm, in order to deal with the problems of modelling with outliers. The cost function of this approach has a bounded influence function given by the weighted average of two psi functions, one corresponding to a very robust estimate and the other to a highly efficient estimate. The advantages of the proposed algorithm are studied with an example.
Backpropagation and ordered derivatives in the time scales calculus.
Seiffertt, John; Wunsch, Donald C
2010-08-01
Backpropagation is the most widely used neural network learning technique. It is based on the mathematical notion of an ordered derivative. In this paper, we present a formulation of ordered derivatives and the backpropagation training algorithm using the important emerging area of mathematics known as the time scales calculus. This calculus, with its potential for application to a wide variety of inter-disciplinary problems, is becoming a key area of mathematics. It is capable of unifying continuous and discrete analysis within one coherent theoretical framework. Using this calculus, we present here a generalization of backpropagation which is appropriate for cases beyond the specifically continuous or discrete. We develop a new multivariate chain rule of this calculus, define ordered derivatives on time scales, prove a key theorem about them, and derive the backpropagation weight update equations for a feedforward multilayer neural network architecture. By drawing together the time scales calculus and the area of neural network learning, we present the first connection of two major fields of research.
Application of artificial neural nets to Shashlik calorimetry
International Nuclear Information System (INIS)
Bonesini, M.; Paganoni, M.; Terranova, F.
1997-01-01
Artificial neural networks (ANN) are powerful tools widely used in high-energy physics to solve track finding and particle identification problems. An entirely new class of application is related to the problem of recovering the information lost during data taking or signal transmission. Good performances can be reached by ANN when the events are described by quite regular patterns. Such a method was used for the DELPHI luminosity monitor (STIC) to recover calorimeter dead channels. A comparison with more traditional techniques is also given. (orig.)
Neural net classification of x-ray pistachio nut data
Casasent, David P.; Sipe, Michael A.; Schatzki, Thomas F.; Keagy, Pamela M.; Le, Lan Chau
1996-12-01
Classification results for agricultural products are presented using a new neural network. This neural network inherently produces higher-order decision surfaces. It achieves this with fewer hidden layer neurons than other classifiers require. This gives better generalization. It uses new techniques to select the number of hidden layer neurons and adaptive algorithms that avoid other such ad hoc parameter selection problems; it allows selection of the best classifier parameters without the need to analyze the test set results. The agriculture case study considered is the inspection and classification of pistachio nuts using x- ray imagery. Present inspection techniques cannot provide good rejection of worm damaged nuts without rejecting too many good nuts. X-ray imagery has the potential to provide 100% inspection of such agricultural products in real time. Only preliminary results are presented, but these indicate the potential to reduce major defects to 2% of the crop with 1% of good nuts rejected. Future image processing techniques that should provide better features to improve performance and allow inspection of a larger variety of nuts are noted. These techniques and variations of them have uses in a number of other agricultural product inspection problems.
Pelicano, Christian Mark; Rapadas, Nick; Cagatan, Gerard; Magdaluyo, Eduardo
2017-12-01
Herein, the crystallite size and band gap energy of zinc oxide (ZnO) quantum dots were predicted using artificial neural network (ANN). Three input factors including reagent ratio, growth time, and growth temperature were examined with respect to crystallite size and band gap energy as response factors. The generated results from neural network model were then compared with the experimental results. Experimental crystallite size and band gap energy of ZnO quantum dots were measured from TEM images and absorbance spectra, respectively. The Levenberg-Marquardt (LM) algorithm was used as the learning algorithm for the ANN model. The performance of the ANN model was then assessed through mean square error (MSE) and regression values. Based on the results, the ANN modelling results are in good agreement with the experimental data.
ChemNet: A Transferable and Generalizable Deep Neural Network for Small-Molecule Property Prediction
Energy Technology Data Exchange (ETDEWEB)
Goh, Garrett B.; Siegel, Charles M.; Vishnu, Abhinav; Hodas, Nathan O.
2017-12-08
With access to large datasets, deep neural networks through representation learning have been able to identify patterns from raw data, achieving human-level accuracy in image and speech recognition tasks. However, in chemistry, availability of large standardized and labelled datasets is scarce, and with a multitude of chemical properties of interest, chemical data is inherently small and fragmented. In this work, we explore transfer learning techniques in conjunction with the existing Chemception CNN model, to create a transferable and generalizable deep neural network for small-molecule property prediction. Our latest model, ChemNet learns in a semi-supervised manner from inexpensive labels computed from the ChEMBL database. When fine-tuned to the Tox21, HIV and FreeSolv dataset, which are 3 separate chemical tasks that ChemNet was not originally trained on, we demonstrate that ChemNet exceeds the performance of existing Chemception models, contemporary MLP models that trains on molecular fingerprints, and it matches the performance of the ConvGraph algorithm, the current state-of-the-art. Furthermore, as ChemNet has been pre-trained on a large diverse chemical database, it can be used as a universal “plug-and-play” deep neural network, which accelerates the deployment of deep neural networks for the prediction of novel small-molecule chemical properties.
A new neural net approach to robot 3D perception and visuo-motor coordination
Lee, Sukhan
1992-01-01
A novel neural network approach to robot hand-eye coordination is presented. The approach provides a true sense of visual error servoing, redundant arm configuration control for collision avoidance, and invariant visuo-motor learning under gazing control. A 3-D perception network is introduced to represent the robot internal 3-D metric space in which visual error servoing and arm configuration control are performed. The arm kinematic network performs the bidirectional association between 3-D space arm configurations and joint angles, and enforces the legitimate arm configurations. The arm kinematic net is structured by a radial-based competitive and cooperative network with hierarchical self-organizing learning. The main goal of the present work is to demonstrate that the neural net representation of the robot 3-D perception net serves as an important intermediate functional block connecting robot eyes and arms.
Energy Technology Data Exchange (ETDEWEB)
Toda-Caraballo, I.; Garcia-Mateo, C.; Capdevila, C.
2010-07-01
At the beginning of the decade of the nineties, the industrial interest for TRIP steels leads to a significant increase of the investigation and application in this field. In this work, the flexibility of neural networks for the modelling of complex properties is used to tackle the problem of determining the retained austenite content in TRIP-steel. Applying a combination of two learning algorithms (backpropagation and creeping-random-search) for the neural network, a model has been created that enables the prediction of retained austenite in low-Si / low-Al multiphase steels as a function of processing parameters. (Author). 34 refs.
Squeeze-SegNet: a new fast deep convolutional neural network for semantic segmentation
Nanfack, Geraldin; Elhassouny, Azeddine; Oulad Haj Thami, Rachid
2018-04-01
The recent researches in Deep Convolutional Neural Network have focused their attention on improving accuracy that provide significant advances. However, if they were limited to classification tasks, nowadays with contributions from Scientific Communities who are embarking in this field, they have become very useful in higher level tasks such as object detection and pixel-wise semantic segmentation. Thus, brilliant ideas in the field of semantic segmentation with deep learning have completed the state of the art of accuracy, however this architectures become very difficult to apply in embedded systems as is the case for autonomous driving. We present a new Deep fully Convolutional Neural Network for pixel-wise semantic segmentation which we call Squeeze-SegNet. The architecture is based on Encoder-Decoder style. We use a SqueezeNet-like encoder and a decoder formed by our proposed squeeze-decoder module and upsample layer using downsample indices like in SegNet and we add a deconvolution layer to provide final multi-channel feature map. On datasets like Camvid or City-states, our net gets SegNet-level accuracy with less than 10 times fewer parameters than SegNet.
Development of a neural net paradigm that predicts simulator sickness
Energy Technology Data Exchange (ETDEWEB)
Allgood, G.O.
1993-03-01
A disease exists that affects pilots and aircrew members who use Navy Operational Flight Training Systems. This malady, commonly referred to as simulator sickness and whose symptomatology closely aligns with that of motion sickness, can compromise the use of these systems because of a reduced utilization factor, negative transfer of training, and reduction in combat readiness. A report is submitted that develops an artificial neural network (ANN) and behavioral model that predicts the onset and level of simulator sickness in the pilots and aircrews who sue these systems. It is proposed that the paradigm could be implemented in real time as a biofeedback monitor to reduce the risk to users of these systems. The model captures the neurophysiological impact of use (human-machine interaction) by developing a structure that maps the associative and nonassociative behavioral patterns (learned expectations) and vestibular (otolith and semicircular canals of the inner ear) and tactile interaction, derived from system acceleration profiles, onto an abstract space that predicts simulator sickness for a given training flight.
NIRFaceNet: A Convolutional Neural Network for Near-Infrared Face Identification
Directory of Open Access Journals (Sweden)
Min Peng
2016-10-01
Full Text Available Near-infrared (NIR face recognition has attracted increasing attention because of its advantage of illumination invariance. However, traditional face recognition methods based on NIR are designed for and tested in cooperative-user applications. In this paper, we present a convolutional neural network (CNN for NIR face recognition (specifically face identification in non-cooperative-user applications. The proposed NIRFaceNet is modified from GoogLeNet, but has a more compact structure designed specifically for the Chinese Academy of Sciences Institute of Automation (CASIA NIR database and can achieve higher identification rates with less training time and less processing time. The experimental results demonstrate that NIRFaceNet has an overall advantage compared to other methods in the NIR face recognition domain when image blur and noise are present. The performance suggests that the proposed NIRFaceNet method may be more suitable for non-cooperative-user applications.
BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment.
Kawahara, Jeremy; Brown, Colin J; Miller, Steven P; Booth, Brian G; Chau, Vann; Grunau, Ruth E; Zwicker, Jill G; Hamarneh, Ghassan
2017-02-01
We propose BrainNetCNN, a convolutional neural network (CNN) framework to predict clinical neurodevelopmental outcomes from brain networks. In contrast to the spatially local convolutions done in traditional image-based CNNs, our BrainNetCNN is composed of novel edge-to-edge, edge-to-node and node-to-graph convolutional filters that leverage the topological locality of structural brain networks. We apply the BrainNetCNN framework to predict cognitive and motor developmental outcome scores from structural brain networks of infants born preterm. Diffusion tensor images (DTI) of preterm infants, acquired between 27 and 46 weeks gestational age, were used to construct a dataset of structural brain connectivity networks. We first demonstrate the predictive capabilities of BrainNetCNN on synthetic phantom networks with simulated injury patterns and added noise. BrainNetCNN outperforms a fully connected neural-network with the same number of model parameters on both phantoms with focal and diffuse injury patterns. We then apply our method to the task of joint prediction of Bayley-III cognitive and motor scores, assessed at 18 months of age, adjusted for prematurity. We show that our BrainNetCNN framework outperforms a variety of other methods on the same data. Furthermore, BrainNetCNN is able to identify an infant's postmenstrual age to within about 2 weeks. Finally, we explore the high-level features learned by BrainNetCNN by visualizing the importance of each connection in the brain with respect to predicting the outcome scores. These findings are then discussed in the context of the anatomy and function of the developing preterm infant brain. Copyright © 2016 Elsevier Inc. All rights reserved.
Neural network error correction for solving coupled ordinary differential equations
Shelton, R. O.; Darsey, J. A.; Sumpter, B. G.; Noid, D. W.
1992-01-01
A neural network is presented to learn errors generated by a numerical algorithm for solving coupled nonlinear differential equations. The method is based on using a neural network to correctly learn the error generated by, for example, Runge-Kutta on a model molecular dynamics (MD) problem. The neural network programs used in this study were developed by NASA. Comparisons are made for training the neural network using backpropagation and a new method which was found to converge with fewer iterations. The neural net programs, the MD model and the calculations are discussed.
Real-time classification of signals from three-component seismic sensors using neural nets
Bowman, B. C.; Dowla, F.
1992-05-01
Adaptive seismic data acquisition systems with capabilities of signal discrimination and event classification are important in treaty monitoring, proliferation, and earthquake early detection systems. Potential applications include monitoring underground chemical explosions, as well as other military, cultural, and natural activities where characteristics of signals change rapidly and without warning. In these applications, the ability to detect and interpret events rapidly without falling behind the influx of the data is critical. We developed a system for real-time data acquisition, analysis, learning, and classification of recorded events employing some of the latest technology in computer hardware, software, and artificial neural networks methods. The system is able to train dynamically, and updates its knowledge based on new data. The software is modular and hardware-independent; i.e., the front-end instrumentation is transparent to the analysis system. The software is designed to take advantage of the multiprocessing environment of the Unix operating system. The Unix System V shared memory and static RAM protocols for data access and the semaphore mechanism for interprocess communications were used. As the three-component sensor detects a seismic signal, it is displayed graphically on a color monitor using X11/Xlib graphics with interactive screening capabilities. For interesting events, the triaxial signal polarization is computed, a fast Fourier Transform (FFT) algorithm is applied, and the normalized power spectrum is transmitted to a backpropagation neural network for event classification. The system is currently capable of handling three data channels with a sampling rate of 500 Hz, which covers the bandwidth of most seismic events. The system has been tested in laboratory setting with artificial events generated in the vicinity of a three-component sensor.
Yang, Tsung-Ming; Fan, Shu-Kai; Fan, Chihhao; Hsu, Nien-Sheng
2014-08-01
The purpose of this study is to establish a turbidity forecasting model as well as an early-warning system for turbidity management using rainfall records as the input variables. The Taipei Water Source Domain was employed as the study area, and ANOVA analysis showed that the accumulative rainfall records of 1-day Ping-lin, 2-day Ping-lin, 2-day Fei-tsui, 2-day Shi-san-gu, 2-day Tai-pin and 2-day Tong-hou were the six most significant parameters for downstream turbidity development. The artificial neural network model was developed and proven capable of predicting the turbidity concentration in the investigated catchment downstream area. The observed and model-calculated turbidity data were applied to developing the turbidity early-warning system. Using a previously determined turbidity as the threshold, the rainfall criterion, above which the downstream turbidity would possibly exceed this respective threshold turbidity, for the investigated rain gauge stations was determined. An exemplary illustration demonstrated the effectiveness of the proposed turbidity early-warning system as a precautionary alarm of possible significant increase of downstream turbidity. This study is the first report of the establishment of the turbidity early-warning system. Hopefully, this system can be applied to source water turbidity forecasting during storm events and provide a useful reference for subsequent adjustment of drinking water treatment operation.
tf_unet: Generic convolutional neural network U-Net implementation in Tensorflow
Akeret, Joel; Chang, Chihway; Lucchi, Aurelien; Refregier, Alexandre
2016-11-01
tf_unet mitigates radio frequency interference (RFI) signals in radio data using a special type of Convolutional Neural Network, the U-Net, that enables the classification of clean signal and RFI signatures in 2D time-ordered data acquired from a radio telescope. The code is not tied to a specific segmentation and can be used, for example, to detect radio frequency interference (RFI) in radio astronomy or galaxies and stars in widefield imaging data. This U-Net implementation can outperform classical RFI mitigation algorithms.
Exemplar-based optical neural net classifier for color pattern recognition
Yu, Francis T. S.; Uang, Chii-Maw; Yang, Xiangyang
1992-10-01
We present a color exemplar-based neural network that can be used as an optimum image classifier or an associative memory. Color decomposition and composition technique is used for constructing the polychromatic interconnection weight matrix (IWM). The Hamming net algorithm is modified to relax the dynamic range requirement of the spatial light modulator and to reduce the number of iteration cycles in the winner-take-all layer. Computer simulation results demonstrated the feasibility of this approach
[A method of recognizing biology surface spectrum using cascade-connection artificial neural nets].
Shi, Wei-Jie; Yao, Yong; Zhang, Tie-Qiang; Meng, Xian-Jiang
2008-05-01
A method of recognizing the visible spectrum of micro-areas on the biological surface with cascade-connection artificial neural nets is presented in the present paper. The visible spectra of spots on apples' pericarp, ranging from 500 to 730 nm, were obtained with a fiber-probe spectrometer, and a new spectrum recognition system consisting of three-level cascade-connection neural nets was set up. The experiments show that the spectra of rotten, scar and bumped spot on an apple's pericarp can be recognized by the spectrum recognition system, and the recognition accuracy is higher than 85% even when noise level is 15%. The new recognition system overcomes the disadvantages of poor accuracy and poor anti-noise with the traditional system based on single cascade neural nets. Finally, a new method of expression of recognition results was proved. The method is based on the conception of degree of membership in fuzzing mathematics, and through it the recognition results can be expressed exactly and objectively.
Wet gas metering with the v-cone and neural nets
Energy Technology Data Exchange (ETDEWEB)
Toral, Haluk; Cai, Shiqian; Peters, Robert
2005-07-01
The paper presents analysis of extensive measurements taken at NEL, K-Lab and CEESI wet gas test loops. Differential and absolute pressure signals were sampled at high frequency across V-Cone meters. Turbulence characteristics of the flow captured in the sampled signals were characterized by pattern recognition techniques and related to the fractions and flow rates of individual phases. The sensitivity of over-reading to first and higher order features of the high frequency signals were investigated qualitatively. The sensitivities were quantified by means of the saliency test based on back propagating neural nets. A self contained wet gas meter based on neural net characterization of first and higher order features of the pressure, differential pressure and capacitance signals was proposed. Alternatively, a wet gas meter based on a neural net model of just pressure sensor inputs (based on currently available data) and liquid Froude number was shown to offer an accuracy of under 5% if the Froude number could be estimated with 25% accuracy. (author) (tk)
Deep neural nets as a method for quantitative structure-activity relationships.
Ma, Junshui; Sheridan, Robert P; Liaw, Andy; Dahl, George E; Svetnik, Vladimir
2015-02-23
Neural networks were widely used for quantitative structure-activity relationships (QSAR) in the 1990s. Because of various practical issues (e.g., slow on large problems, difficult to train, prone to overfitting, etc.), they were superseded by more robust methods like support vector machine (SVM) and random forest (RF), which arose in the early 2000s. The last 10 years has witnessed a revival of neural networks in the machine learning community thanks to new methods for preventing overfitting, more efficient training algorithms, and advancements in computer hardware. In particular, deep neural nets (DNNs), i.e. neural nets with more than one hidden layer, have found great successes in many applications, such as computer vision and natural language processing. Here we show that DNNs can routinely make better prospective predictions than RF on a set of large diverse QSAR data sets that are taken from Merck's drug discovery effort. The number of adjustable parameters needed for DNNs is fairly large, but our results show that it is not necessary to optimize them for individual data sets, and a single set of recommended parameters can achieve better performance than RF for most of the data sets we studied. The usefulness of the parameters is demonstrated on additional data sets not used in the calibration. Although training DNNs is still computationally intensive, using graphical processing units (GPUs) can make this issue manageable.
LiteNet: Lightweight Neural Network for Detecting Arrhythmias at Resource-Constrained Mobile Devices
Directory of Open Access Journals (Sweden)
Ziyang He
2018-04-01
Full Text Available By running applications and services closer to the user, edge processing provides many advantages, such as short response time and reduced network traffic. Deep-learning based algorithms provide significantly better performances than traditional algorithms in many fields but demand more resources, such as higher computational power and more memory. Hence, designing deep learning algorithms that are more suitable for resource-constrained mobile devices is vital. In this paper, we build a lightweight neural network, termed LiteNet which uses a deep learning algorithm design to diagnose arrhythmias, as an example to show how we design deep learning schemes for resource-constrained mobile devices. Compare to other deep learning models with an equivalent accuracy, LiteNet has several advantages. It requires less memory, incurs lower computational cost, and is more feasible for deployment on resource-constrained mobile devices. It can be trained faster than other neural network algorithms and requires less communication across different processing units during distributed training. It uses filters of heterogeneous size in a convolutional layer, which contributes to the generation of various feature maps. The algorithm was tested using the MIT-BIH electrocardiogram (ECG arrhythmia database; the results showed that LiteNet outperforms comparable schemes in diagnosing arrhythmias, and in its feasibility for use at the mobile devices.
He, Ziyang; Zhang, Xiaoqing; Cao, Yangjie; Liu, Zhi; Zhang, Bo; Wang, Xiaoyan
2018-04-17
By running applications and services closer to the user, edge processing provides many advantages, such as short response time and reduced network traffic. Deep-learning based algorithms provide significantly better performances than traditional algorithms in many fields but demand more resources, such as higher computational power and more memory. Hence, designing deep learning algorithms that are more suitable for resource-constrained mobile devices is vital. In this paper, we build a lightweight neural network, termed LiteNet which uses a deep learning algorithm design to diagnose arrhythmias, as an example to show how we design deep learning schemes for resource-constrained mobile devices. Compare to other deep learning models with an equivalent accuracy, LiteNet has several advantages. It requires less memory, incurs lower computational cost, and is more feasible for deployment on resource-constrained mobile devices. It can be trained faster than other neural network algorithms and requires less communication across different processing units during distributed training. It uses filters of heterogeneous size in a convolutional layer, which contributes to the generation of various feature maps. The algorithm was tested using the MIT-BIH electrocardiogram (ECG) arrhythmia database; the results showed that LiteNet outperforms comparable schemes in diagnosing arrhythmias, and in its feasibility for use at the mobile devices.
Predictive accuracy of backpropagation neural network ...
Indian Academy of Sciences (India)
incorporated into the BP model for high accuracy management purpose of irrigation water, which relies on accurate values of ET ... as seen from the recent food crisis demonstra- tion in most .... layers by using Geographical Information System.
Adaptive Learning Rule for Hardware-based Deep Neural Networks Using Electronic Synapse Devices
Lim, Suhwan; Bae, Jong-Ho; Eum, Jai-Ho; Lee, Sungtae; Kim, Chul-Heung; Kwon, Dongseok; Park, Byung-Gook; Lee, Jong-Ho
2017-01-01
In this paper, we propose a learning rule based on a back-propagation (BP) algorithm that can be applied to a hardware-based deep neural network (HW-DNN) using electronic devices that exhibit discrete and limited conductance characteristics. This adaptive learning rule, which enables forward, backward propagation, as well as weight updates in hardware, is helpful during the implementation of power-efficient and high-speed deep neural networks. In simulations using a three-layer perceptron net...
Bayesian Inference using Neural Net Likelihood Models for Protein Secondary Structure Prediction
Directory of Open Access Journals (Sweden)
Seong-Gon Kim
2011-06-01
Full Text Available Several techniques such as Neural Networks, Genetic Algorithms, Decision Trees and other statistical or heuristic methods have been used to approach the complex non-linear task of predicting Alpha-helicies, Beta-sheets and Turns of a proteins secondary structure in the past. This project introduces a new machine learning method by using an offline trained Multilayered Perceptrons (MLP as the likelihood models within a Bayesian Inference framework to predict secondary structures proteins. Varying window sizes are used to extract neighboring amino acid information and passed back and forth between the Neural Net models and the Bayesian Inference process until there is a convergence of the posterior secondary structure probability.
Neural net based determination of generator-shedding requirements in electric power systems
Energy Technology Data Exchange (ETDEWEB)
Djukanovic, M [Electrical Engineering Inst. ' Nikola Tesla' , Belgrade (Yugoslavia); Sobajic, D J; Pao, Y -H [Case Western Reserve Univ., Cleveland, OH (United States). Dept. of Electrical Engineering and Applied Physics Case Western Reserve Univ., Cleveland, OH (United States). Dept. of Computer Engineering and Science AI WARE Inc., Cleveland, OH (United States)
1992-09-01
This paper presents an application of artificial neural networks (ANN) in support of a decision-making process by power system operators directed towards the fast stabilisation of multi-machine systems. The proposed approach considers generator shedding as the most effective discrete supplementary control for improving the dynamic performance of faulted power systems and preventing instabilities. The sensitivity of the transient energy function (TEF) with respect to changes in the amount of dropped generation is used during the training phase of ANNs to assess the critical amount of generator shedding required to prevent the loss of synchronism. The learning capabilities of neural nets are used to establish complex mappings between fault information and the amount of generation to be shed, suggesting it as the control signal to the power system operator. (author)
Ethnomathematics elements in Batik Bali using backpropagation method
Lestari, Mei; Irawan, Ari; Rahayu, Wanti; Wayan Parwati, Ni
2018-05-01
Batik is one of traditional arts that has been established by the UNESCO as Indonesia’s cultural heritage. Batik has varieties and motifs, and each motifs has its own uniqueness but seems similar, that makes it difficult to identify. This study aims to develop an application that can identify typical batik Bali with etnomatematics elements on it. Etnomatematics is a study that shows relation between culture and mathematics concepts. Etnomatematics in Batik Bali is more to geometrical concept in line of strong Balinese culture element. The identification process is use backpropagation method. Steps of backpropagation methods are image processing (including scalling and tresholding image process). Next step is insert the processed image to an artificial neural network. This study resulted an accuracy of identification of batik Bali that has Etnomatematics elements on it.
International Nuclear Information System (INIS)
Clarke, L.P.; Silbiger, M.; Naylor, C.; Brown, K.
1990-01-01
This paper reports on the development of interactive methods for MR tissue classification that permit mathematically rigorous methods for three-dimensional image segmentation and automatic organ/tumor contouring, as required for surgical and RTP planning. The authors investigate a number of image-intensity based tissue- classification methods that make no implicit assumptions on the MR parameters and hence are not limited by image data set. Similarly, we have trained artificial neural net (ANN) systems for both supervised and unsupervised tissue classification
Three-dimensional neural net for learning visuomotor coordination of a robot arm.
Martinetz, T M; Ritter, H J; Schulten, K J
1990-01-01
An extension of T. Kohonen's (1982) self-organizing mapping algorithm together with an error-correction scheme based on the Widrow-Hoff learning rule is applied to develop a learning algorithm for the visuomotor coordination of a simulated robot arm. Learning occurs by a sequence of trial movements without the need for an external teacher. Using input signals from a pair of cameras, the closed robot arm system is able to reduce its positioning error to about 0.3% of the linear dimensions of its work space. This is achieved by choosing the connectivity of a three-dimensional lattice consisting of the units of the neural net.
Directory of Open Access Journals (Sweden)
H.H. Mohamad
2013-09-01
This research aims to develop a mathematical model for assessing the expected net profit of any construction company. To achieve the research objective, four steps were performed. First, the main factors affecting firms’ net profit were identified. Second, pertinent data regarding the net profit factors were collected. Third, two different net profit models were developed using the Multiple Regression (MR and the Neural Network (NN techniques. The validity of the proposed models was also investigated. Finally, the results of both MR and NN models were compared to investigate the predictive capabilities of the two models.
NETS - A NEURAL NETWORK DEVELOPMENT TOOL, VERSION 3.0 (MACHINE INDEPENDENT VERSION)
Baffes, P. T.
1994-01-01
NETS, A Tool for the Development and Evaluation of Neural Networks, provides a simulation of Neural Network algorithms plus an environment for developing such algorithms. Neural Networks are a class of systems modeled after the human brain. Artificial Neural Networks are formed from hundreds or thousands of simulated neurons, connected to each other in a manner similar to brain neurons. Problems which involve pattern matching readily fit the class of problems which NETS is designed to solve. NETS uses the back propagation learning method for all of the networks which it creates. The nodes of a network are usually grouped together into clumps called layers. Generally, a network will have an input layer through which the various environment stimuli are presented to the network, and an output layer for determining the network's response. The number of nodes in these two layers is usually tied to some features of the problem being solved. Other layers, which form intermediate stops between the input and output layers, are called hidden layers. NETS allows the user to customize the patterns of connections between layers of a network. NETS also provides features for saving the weight values of a network during the learning process, which allows for more precise control over the learning process. NETS is an interpreter. Its method of execution is the familiar "read-evaluate-print" loop found in interpreted languages such as BASIC and LISP. The user is presented with a prompt which is the simulator's way of asking for input. After a command is issued, NETS will attempt to evaluate the command, which may produce more prompts requesting specific information or an error if the command is not understood. The typical process involved when using NETS consists of translating the problem into a format which uses input/output pairs, designing a network configuration for the problem, and finally training the network with input/output pairs until an acceptable error is reached. NETS
NETS - A NEURAL NETWORK DEVELOPMENT TOOL, VERSION 3.0 (MACINTOSH VERSION)
Phillips, T. A.
1994-01-01
NETS, A Tool for the Development and Evaluation of Neural Networks, provides a simulation of Neural Network algorithms plus an environment for developing such algorithms. Neural Networks are a class of systems modeled after the human brain. Artificial Neural Networks are formed from hundreds or thousands of simulated neurons, connected to each other in a manner similar to brain neurons. Problems which involve pattern matching readily fit the class of problems which NETS is designed to solve. NETS uses the back propagation learning method for all of the networks which it creates. The nodes of a network are usually grouped together into clumps called layers. Generally, a network will have an input layer through which the various environment stimuli are presented to the network, and an output layer for determining the network's response. The number of nodes in these two layers is usually tied to some features of the problem being solved. Other layers, which form intermediate stops between the input and output layers, are called hidden layers. NETS allows the user to customize the patterns of connections between layers of a network. NETS also provides features for saving the weight values of a network during the learning process, which allows for more precise control over the learning process. NETS is an interpreter. Its method of execution is the familiar "read-evaluate-print" loop found in interpreted languages such as BASIC and LISP. The user is presented with a prompt which is the simulator's way of asking for input. After a command is issued, NETS will attempt to evaluate the command, which may produce more prompts requesting specific information or an error if the command is not understood. The typical process involved when using NETS consists of translating the problem into a format which uses input/output pairs, designing a network configuration for the problem, and finally training the network with input/output pairs until an acceptable error is reached. NETS
High-Performance Neural Networks for Visual Object Classification
Cireşan, Dan C.; Meier, Ueli; Masci, Jonathan; Gambardella, Luca M.; Schmidhuber, Jürgen
2011-01-01
We present a fast, fully parameterizable GPU implementation of Convolutional Neural Network variants. Our feature extractors are neither carefully designed nor pre-wired, but rather learned in a supervised way. Our deep hierarchical architectures achieve the best published results on benchmarks for object classification (NORB, CIFAR10) and handwritten digit recognition (MNIST), with error rates of 2.53%, 19.51%, 0.35%, respectively. Deep nets trained by simple back-propagation perform better ...
ConvNetQuake: Convolutional Neural Network for Earthquake Detection and Location
Denolle, M.; Perol, T.; Gharbi, M.
2017-12-01
Over the last decades, the volume of seismic data has increased exponentially, creating a need for efficient algorithms to reliably detect and locate earthquakes. Today's most elaborate methods scan through the plethora of continuous seismic records, searching for repeating seismic signals. In this work, we leverage the recent advances in artificial intelligence and present ConvNetQuake, a highly scalable convolutional neural network for probabilistic earthquake detection and location from single stations. We apply our technique to study two years of induced seismicity in Oklahoma (USA). We detect 20 times more earthquakes than previously cataloged by the Oklahoma Geological Survey. Our algorithm detection performances are at least one order of magnitude faster than other established methods.
DEFF Research Database (Denmark)
Maurin, Adrian Llopart; Ravn, Ole; Andersen, Nils Axel
2017-01-01
In this paper we present a new method that robustly identifies doors, cabinets and their respective handles, with special emphasis on extracting useful features from handles to be then manipulated. The novelty of this system relies on the combination of a Convolutional Neural Net (CNN), as a form...
DEFF Research Database (Denmark)
Johansen, Morten Bo; Gonzalez-Izarzugaza, Jose Maria; Brunak, Søren
2013-01-01
We have developed a sequence conservation-based artificial neural network predictor called NetDiseaseSNP which classifies nsSNPs as disease-causing or neutral. Our method uses the excellent alignment generation algorithm of SIFT to identify related sequences and a combination of 31 features...
Sriyanto, -; Sutedi, -
2010-01-01
Diabetes Melitus (DM) is dangerous disease that affect many of the various layer of work society. This disease is not easy to accurately recognized by the general society. So we need to develop a system that can identify accurately. System is built using neural networks with backpropagation methods and the function activation sigmoid. Neural network architecture using 8 input layer, 2 output layer and 5 hidden layer. The results show that this methods succesfully clasifies data diabetics and ...
Sutedi, Sutedi
2018-01-01
Diabetes Melitus (DM) is dangerous disease that affect many of the various layer of work society. This disease is not easy to accurately recognized by the general society. So we need to develop a system that can identify accurately. System is built using neural networks with backpropagation methods and the function activation sigmoid. Neural network architecture using 8 input layer, 2 output layer and 5 hidden layer. The results show that this methods succesfully clasifies data diabetics and ...
Case, E.; Ren, Y.; Shragai, T.; Erickson, D.
2017-12-01
Integrated mosquito control is expensive and resource intensive, and changing climatic factors are predicted to expand the habitable range of disease-carrying mosquitoes into new regions in the United States. Of particular concern in the northeastern United States are aedes albopictus, an aggressive, invasive species of mosquito that can transmit both native and exotic disease. Ae. albopictus prefer to live near human populations and breed in artificial containers with as little as two millimeters of standing water, exponentially increasing the difficulty of source control in suburban and urban areas. However, low-cost unmanned aerial vehicles (UAVs) can be used to photograph large regions at centimeter-resolution, and can image containers of interest in suburban neighborhoods. While proofs-of-concepts have been shown using UAVs to identify naturally occurring bodies of water, they have not been used to identify mosquito habitat in more populated areas. One of the primary challenges is that post-processing high-resolution aerial imagery is still time intensive, often labelled by hand or with programs built for satellite imagery. Artificial neural networks have been highly successful at image recognition tasks; in the past five years, convolutional neural networks (CNN) have surpassed or aided trained humans in identification of skin cancer, agricultural crops, and poverty levels from satellite imagery. MosquitoNet, a dual classifier built from the Single Shot Multibox Detector and VGG16 architectures, was trained on UAV aerial imagery taken during a larval study in Westchester County in southern New York State in July and August 2017. MosquitoNet was designed to assess the habitat risk of suburban properties by automating the identification and counting of containers like tires, toys, garbage bins, flower pots, etc. The SSD-based architecture marked small containers and other habitat indicators while the VGG16-based architecture classified the type of
Schema generation in recurrent neural nets for intercepting a moving target.
Fleischer, Andreas G
2010-06-01
The grasping of a moving object requires the development of a motor strategy to anticipate the trajectory of the target and to compute an optimal course of interception. During the performance of perception-action cycles, a preprogrammed prototypical movement trajectory, a motor schema, may highly reduce the control load. Subjects were asked to hit a target that was moving along a circular path by means of a cursor. Randomized initial target positions and velocities were detected in the periphery of the eyes, resulting in a saccade toward the target. Even when the target disappeared, the eyes followed the target's anticipated course. The Gestalt of the trajectories was dependent on target velocity. The prediction capability of the motor schema was investigated by varying the visibility range of cursor and target. Motor schemata were determined to be of limited precision, and therefore visual feedback was continuously required to intercept the moving target. To intercept a target, the motor schema caused the hand to aim ahead and to adapt to the target trajectory. The control of cursor velocity determined the point of interception. From a modeling point of view, a neural network was developed that allowed the implementation of a motor schema interacting with feedback control in an iterative manner. The neural net of the Wilson type consists of an excitation-diffusion layer allowing the generation of a moving bubble. This activation bubble runs down an eye-centered motor schema and causes a planar arm model to move toward the target. A bubble provides local integration and straightening of the trajectory during repetitive moves. The schema adapts to task demands by learning and serves as forward controller. On the basis of these model considerations the principal problem of embedding motor schemata in generalized control strategies is discussed.
Deconvolution using a neural network
Energy Technology Data Exchange (ETDEWEB)
Lehman, S.K.
1990-11-15
Viewing one dimensional deconvolution as a matrix inversion problem, we compare a neural network backpropagation matrix inverse with LMS, and pseudo-inverse. This is a largely an exercise in understanding how our neural network code works. 1 ref.
Energy Technology Data Exchange (ETDEWEB)
Djukanovic, M.; Novicevic, M.; Dobrijevic, D.; Babic, B. [Electrical Engineering Inst. Nikola Tesla, Belgrade (Yugoslavia); Sobajic, D.J. [Electric Power Research Inst., Palo Alto, CA (United States); Pao, Y.H. [Case Western Reserve Univ., Cleveland, OH (United States)]|[AI WARE, Inc., Cleveland, OH (United States)
1995-12-01
This paper presents a design technique of a new adaptive optimal controller of the low head hydropower plant using artificial neural networks (ANN). The adaptive controller is to operate in real time to improve the generating unit transients through the exciter input, the guide vane position and the runner blade position. The new design procedure is based on self-organization and the predictive estimation capabilities of neural-nets implemented through the cluster-wise segmented associative memory scheme. The developed neural-net based controller (NNC) whose control signals are adjusted using the on-line measurements, can offer better damping effects for generator oscillations over a wide range of operating conditions than conventional controllers. Digital simulations of hydropower plant equipped with low head Kaplan turbine are performed and the comparisons of conventional excitation-governor control, state-space optimal control and neural-net based control are presented. Results obtained on the non-linear mathematical model demonstrate that the effects of the NNC closely agree with those obtained using the state-space multivariable discrete-time optimal controllers.
A Restricted Boltzman Neural Net to Infer Carbon Uptake from OCO-2 Satellite Data
Halem, M.; Dorband, J. E.; Radov, A.; Barr-Dallas, M.; Gentine, P.
2015-12-01
For several decades, scientists have been using satellite observations to infer climate budgets of terrestrial carbon uptake employing inverse methods in conjunction with ecosystem models and coupled global climate models. This is an extremely important Big Data calculation today since the net annual photosynthetic carbon uptake changes annually over land and removes on average ~20% of the emissions from human contributions to atmospheric loading of CO2 from fossil fuels. Unfortunately, such calculations have large uncertainties validated with in-situ networks of measuring stations across the globe. One difficulty in using satellite data for these budget calculations is that the models need to assimilate surface fluxes of CO2 as well as soil moisture, vegatation cover and the eddy covariance of latent and sensible heat to calculate the carbon fixed in the soil while satellite spectral observations only provide near surface concentrations of CO2. In July 2014, NASA successfully launched OCO-2 which provides 3km surface measurements of CO2 over land and oceans. We have collected nearly one year of Level 2 XCO2 data from the OCO-2 satellite for 3 sites of ~200 km2 at equatorial, temperate and high latitudes. Each selected site was part of the Fluxnet or ARM system with tower stations for measuring and collecting CO2 fluxes on an hourly basis, in addition to eddy transports of the other parameters. We are also planning to acquire the 4km NDVI products from MODIS and registering the data to the 3km XCO2 footprints for the three sites. We have implemented a restricted Boltzman machine on the quantum annealing D-Wave computer, a novel deep learning neural net, to be used for training with station data to infer CO2 fluxes from collocated XCO2, MODIS vegetative land cover and MERRA reanalysis surface exchange products. We will present performance assessments of the D-Wave Boltzman machine for generating XCO2 fluxes from the OCO-2 satellite observations for the 3 sites by
EnzyNet: enzyme classification using 3D convolutional neural networks on spatial representation.
Amidi, Afshine; Amidi, Shervine; Vlachakis, Dimitrios; Megalooikonomou, Vasileios; Paragios, Nikos; Zacharaki, Evangelia I
2018-01-01
During the past decade, with the significant progress of computational power as well as ever-rising data availability, deep learning techniques became increasingly popular due to their excellent performance on computer vision problems. The size of the Protein Data Bank (PDB) has increased more than 15-fold since 1999, which enabled the expansion of models that aim at predicting enzymatic function via their amino acid composition. Amino acid sequence, however, is less conserved in nature than protein structure and therefore considered a less reliable predictor of protein function. This paper presents EnzyNet, a novel 3D convolutional neural networks classifier that predicts the Enzyme Commission number of enzymes based only on their voxel-based spatial structure. The spatial distribution of biochemical properties was also examined as complementary information. The two-layer architecture was investigated on a large dataset of 63,558 enzymes from the PDB and achieved an accuracy of 78.4% by exploiting only the binary representation of the protein shape. Code and datasets are available at https://github.com/shervinea/enzynet.
Directory of Open Access Journals (Sweden)
Hesham Mostafa
2017-09-01
Full Text Available Artificial neural networks (ANNs trained using backpropagation are powerful learning architectures that have achieved state-of-the-art performance in various benchmarks. Significant effort has been devoted to developing custom silicon devices to accelerate inference in ANNs. Accelerating the training phase, however, has attracted relatively little attention. In this paper, we describe a hardware-efficient on-line learning technique for feedforward multi-layer ANNs that is based on pipelined backpropagation. Learning is performed in parallel with inference in the forward pass, removing the need for an explicit backward pass and requiring no extra weight lookup. By using binary state variables in the feedforward network and ternary errors in truncated-error backpropagation, the need for any multiplications in the forward and backward passes is removed, and memory requirements for the pipelining are drastically reduced. Further reduction in addition operations owing to the sparsity in the forward neural and backpropagating error signal paths contributes to highly efficient hardware implementation. For proof-of-concept validation, we demonstrate on-line learning of MNIST handwritten digit classification on a Spartan 6 FPGA interfacing with an external 1Gb DDR2 DRAM, that shows small degradation in test error performance compared to an equivalently sized binary ANN trained off-line using standard back-propagation and exact errors. Our results highlight an attractive synergy between pipelined backpropagation and binary-state networks in substantially reducing computation and memory requirements, making pipelined on-line learning practical in deep networks.
Mostafa, Hesham; Pedroni, Bruno; Sheik, Sadique; Cauwenberghs, Gert
2017-01-01
Artificial neural networks (ANNs) trained using backpropagation are powerful learning architectures that have achieved state-of-the-art performance in various benchmarks. Significant effort has been devoted to developing custom silicon devices to accelerate inference in ANNs. Accelerating the training phase, however, has attracted relatively little attention. In this paper, we describe a hardware-efficient on-line learning technique for feedforward multi-layer ANNs that is based on pipelined backpropagation. Learning is performed in parallel with inference in the forward pass, removing the need for an explicit backward pass and requiring no extra weight lookup. By using binary state variables in the feedforward network and ternary errors in truncated-error backpropagation, the need for any multiplications in the forward and backward passes is removed, and memory requirements for the pipelining are drastically reduced. Further reduction in addition operations owing to the sparsity in the forward neural and backpropagating error signal paths contributes to highly efficient hardware implementation. For proof-of-concept validation, we demonstrate on-line learning of MNIST handwritten digit classification on a Spartan 6 FPGA interfacing with an external 1Gb DDR2 DRAM, that shows small degradation in test error performance compared to an equivalently sized binary ANN trained off-line using standard back-propagation and exact errors. Our results highlight an attractive synergy between pipelined backpropagation and binary-state networks in substantially reducing computation and memory requirements, making pipelined on-line learning practical in deep networks.
Modularity and Sparsity: Evolution of Neural Net Controllers in Physically Embodied Robots
Directory of Open Access Journals (Sweden)
Nicholas Livingston
2016-12-01
Full Text Available While modularity is thought to be central for the evolution of complexity and evolvability, it remains unclear how systems boot-strap themselves into modularity from random or fully integrated starting conditions. Clune et al. (2013 suggested that a positive correlation between sparsity and modularity is the prime cause of this transition. We sought to test the generality of this modularity-sparsity hypothesis by testing it for the first time in physically embodied robots. A population of ten Tadros — autonomous, surface-swimming robots propelled by a flapping tail — was used. Individuals varied only in the structure of their neural net control, a 2 x 6 x 2 network with recurrence in the hidden layer. Each of the 60 possible connections was coded in the genome, and could achieve one of three states: -1, 0, 1. Inputs were two light-dependent resistors and outputs were two motor control variables to the flapping tail, one for the frequency of the flapping and the other for the turning offset. Each Tadro was tested separately in a circular tank lit by a single overhead light source. Fitness was the amount of light gathered by a vertically oriented sensor that was disconnected from the controller net. Reproduction was asexual, with the top performer cloned and then all individuals entered into a roulette wheel selection process, with genomes mutated to create the offspring. The starting population of networks was randomly generated. Over ten generations, the population’s mean fitness increased two-fold. This evolution occurred in spite of an unintentional integer overflow problem in recurrent nodes in the hidden layer that caused outputs to oscillate. Our investigation of the oscillatory behavior showed that the mutual information of inputs and outputs was sufficient for the reactive behaviors observed. While we had predicted that both modularity and sparsity would follow the same trend as fitness, neither did so. Instead, selection gradients
Segmentation of corneal endothelium images using a U-Net-based convolutional neural network.
Fabijańska, Anna
2018-04-18
Diagnostic information regarding the health status of the corneal endothelium may be obtained by analyzing the size and the shape of the endothelial cells in specular microscopy images. Prior to the analysis, the endothelial cells need to be extracted from the image. Up to today, this has been performed manually or semi-automatically. Several approaches to automatic segmentation of endothelial cells exist; however, none of them is perfect. Therefore this paper proposes to perform cell segmentation using a U-Net-based convolutional neural network. Particularly, the network is trained to discriminate pixels located at the borders between cells. The edge probability map outputted by the network is next binarized and skeletonized in order to obtain one-pixel wide edges. The proposed solution was tested on a dataset consisting of 30 corneal endothelial images presenting cells of different sizes, achieving an AUROC level of 0.92. The resulting DICE is on average equal to 0.86, which is a good result, regarding the thickness of the compared edges. The corresponding mean absolute percentage error of cell number is at the level of 4.5% which confirms the high accuracy of the proposed approach. The resulting cell edges are well aligned to the ground truths and require a limited number of manual corrections. This also results in accurate values of the cell morphometric parameters. The corresponding errors range from 5.2% for endothelial cell density, through 6.2% for cell hexagonality to 11.93% for the coefficient of variation of the cell size. Copyright © 2018 Elsevier B.V. All rights reserved.
International Nuclear Information System (INIS)
Paegert, Martin; Stassun, Keivan G.; Burger, Dan M.
2014-01-01
We describe a new neural-net-based light curve classifier and provide it with documentation as a ready-to-use tool for the community. While optimized for identification and classification of eclipsing binary stars, the classifier is general purpose, and has been developed for speed in the context of upcoming massive surveys such as the Large Synoptic Survey Telescope. A challenge for classifiers in the context of neural-net training and massive data sets is to minimize the number of parameters required to describe each light curve. We show that a simple and fast geometric representation that encodes the overall light curve shape, together with a chi-square parameter to capture higher-order morphology information results in efficient yet robust light curve classification, especially for eclipsing binaries. Testing the classifier on the ASAS light curve database, we achieve a retrieval rate of 98% and a false-positive rate of 2% for eclipsing binaries. We achieve similarly high retrieval rates for most other periodic variable-star classes, including RR Lyrae, Mira, and delta Scuti. However, the classifier currently has difficulty discriminating between different sub-classes of eclipsing binaries, and suffers a relatively low (∼60%) retrieval rate for multi-mode delta Cepheid stars. We find that it is imperative to train the classifier's neural network with exemplars that include the full range of light curve quality to which the classifier will be expected to perform; the classifier performs well on noisy light curves only when trained with noisy exemplars. The classifier source code, ancillary programs, a trained neural net, and a guide for use, are provided.
Directory of Open Access Journals (Sweden)
Morten Bo Johansen
Full Text Available We have developed a sequence conservation-based artificial neural network predictor called NetDiseaseSNP which classifies nsSNPs as disease-causing or neutral. Our method uses the excellent alignment generation algorithm of SIFT to identify related sequences and a combination of 31 features assessing sequence conservation and the predicted surface accessibility to produce a single score which can be used to rank nsSNPs based on their potential to cause disease. NetDiseaseSNP classifies successfully disease-causing and neutral mutations. In addition, we show that NetDiseaseSNP discriminates cancer driver and passenger mutations satisfactorily. Our method outperforms other state-of-the-art methods on several disease/neutral datasets as well as on cancer driver/passenger mutation datasets and can thus be used to pinpoint and prioritize plausible disease candidates among nsSNPs for further investigation. NetDiseaseSNP is publicly available as an online tool as well as a web service: http://www.cbs.dtu.dk/services/NetDiseaseSNP.
Premature saturation in backpropagation networks: Mechanism and necessary conditions
International Nuclear Information System (INIS)
Vitela, J.E.; Reifman, J.
1997-01-01
The mechanism that gives rise to the phenomenon of premature saturation of the output units of feedforward multilayer neural networks during training with the standard backpropagation algorithm is described. The entire process of premature saturation is characterized by three distinct stages and it is concluded that the momentum term plays the leading role in the occurrence of the phenomenon. The necessary conditions for the occurrence of premature saturation are presented and a new method is proposed, based on these conditions, that eliminates the occurrence of the phenomenon. Validity of the conditions and the proposed method are illustrated through simulation results. Three case studies are presented. The first two came from a training session for classification of three component failures in a nuclear power plant. The last case, comes from a training session for classification of welded fuel elements
Evolving Resilient Back-Propagation Algorithm for Energy Efficiency Problem
Directory of Open Access Journals (Sweden)
Yang Fei
2016-01-01
Full Text Available Energy efficiency is one of our most economical sources of new energy. When it comes to efficient building design, the computation of the heating load (HL and cooling load (CL is required to determine the specifications of the heating and cooling equipment. The objective of this paper is to model heating load and cooling load buildings using neural networks in order to predict HL load and CL load. Rprop with genetic algorithm was proposed to increase the global convergence capability of Rprop by modifying a corresponding weight. Comparison results show that Rprop with GA can successfully improve the global convergence capability of Rprop and achieve lower MSE than other perceptron training algorithms, such as Back-Propagation or original Rprop. In addition, the trained network has better generalization ability and stabilization performance.
Enhanced backpropagation training algorithm for transient event identification
International Nuclear Information System (INIS)
Vitela, J.; Reifman, J.
1993-01-01
We present an enhanced backpropagation (BP) algorithm for training feedforward neural networks that avoids the undesirable premature saturation of the network output nodes and accelerates the training process even in cases where premature saturation is not present. When the standard BP algorithm is applied to train patterns of nuclear power plant (NPP) transients, the network output nodes often become prematurely saturated causing the already slow rate of convergence of the algorithm to become even slower. When premature saturation occurs, the gradient of the prediction error becomes very small, although the prediction error itself is still large, yielding negligible weight updates and hence no significant decrease in the prediction error until the eventual recovery of the output nodes from saturation. By defining the onset of premature saturation and systematically modifying the gradient of the prediction error at saturation, we developed an enhanced BP algorithm that is compared with the standard BP algorithm in training a network to identify NPP transients
Mohseni Salehi, Seyed Sadegh; Erdogmus, Deniz; Gholipour, Ali
2017-11-01
Brain extraction or whole brain segmentation is an important first step in many of the neuroimage analysis pipelines. The accuracy and the robustness of brain extraction, therefore, are crucial for the accuracy of the entire brain analysis process. The state-of-the-art brain extraction techniques rely heavily on the accuracy of alignment or registration between brain atlases and query brain anatomy, and/or make assumptions about the image geometry, and therefore have limited success when these assumptions do not hold or image registration fails. With the aim of designing an accurate, learning-based, geometry-independent, and registration-free brain extraction tool, in this paper, we present a technique based on an auto-context convolutional neural network (CNN), in which intrinsic local and global image features are learned through 2-D patches of different window sizes. We consider two different architectures: 1) a voxelwise approach based on three parallel 2-D convolutional pathways for three different directions (axial, coronal, and sagittal) that implicitly learn 3-D image information without the need for computationally expensive 3-D convolutions and 2) a fully convolutional network based on the U-net architecture. Posterior probability maps generated by the networks are used iteratively as context information along with the original image patches to learn the local shape and connectedness of the brain to extract it from non-brain tissue. The brain extraction results we have obtained from our CNNs are superior to the recently reported results in the literature on two publicly available benchmark data sets, namely, LPBA40 and OASIS, in which we obtained the Dice overlap coefficients of 97.73% and 97.62%, respectively. Significant improvement was achieved via our auto-context algorithm. Furthermore, we evaluated the performance of our algorithm in the challenging problem of extracting arbitrarily oriented fetal brains in reconstructed fetal brain magnetic
2017-01-01
Although deep learning approaches have had tremendous success in image, video and audio processing, computer vision, and speech recognition, their applications to three-dimensional (3D) biomolecular structural data sets have been hindered by the geometric and biological complexity. To address this problem we introduce the element-specific persistent homology (ESPH) method. ESPH represents 3D complex geometry by one-dimensional (1D) topological invariants and retains important biological information via a multichannel image-like representation. This representation reveals hidden structure-function relationships in biomolecules. We further integrate ESPH and deep convolutional neural networks to construct a multichannel topological neural network (TopologyNet) for the predictions of protein-ligand binding affinities and protein stability changes upon mutation. To overcome the deep learning limitations from small and noisy training sets, we propose a multi-task multichannel topological convolutional neural network (MM-TCNN). We demonstrate that TopologyNet outperforms the latest methods in the prediction of protein-ligand binding affinities, mutation induced globular protein folding free energy changes, and mutation induced membrane protein folding free energy changes. Availability: weilab.math.msu.edu/TDL/ PMID:28749969
Directory of Open Access Journals (Sweden)
Suhendry Effendy
2010-12-01
Full Text Available This paper discusses the facial image recognition system using Discrete Wavelet Transform and back-propagation artificial neural network. Discrete Wavelet Transform processes the input image to obtain the essential features found on the face image. These features are then classified using an back-propagation artificial neural network for the input image to be identified. Testing the system using facial images in AT & T Database of Faces of 400 images comprising 40 facial images of individuals and web-camera catches as many as 100 images of 10 individuals. The accuracy of level of recognition on AT & T Database of Faces reaches 93.5%, while the accuracy of level of recognition on a web-camera capture images up to 96%. Testing is also done on image of AT & T Database of Faces with given noise. Apparently the noise in the image does not give meaningful effect on the level of recognition accuracy.
Program Helps Simulate Neural Networks
Villarreal, James; Mcintire, Gary
1993-01-01
Neural Network Environment on Transputer System (NNETS) computer program provides users high degree of flexibility in creating and manipulating wide variety of neural-network topologies at processing speeds not found in conventional computing environments. Supports back-propagation and back-propagation-related algorithms. Back-propagation algorithm used is implementation of Rumelhart's generalized delta rule. NNETS developed on INMOS Transputer(R). Predefines back-propagation network, Jordan network, and reinforcement network to assist users in learning and defining own networks. Also enables users to configure other neural-network paradigms from NNETS basic architecture. Small portion of software written in OCCAM(R) language.
Generalized Net Model of the Cognitive and Neural Algorithm for Adaptive Resonance Theory 1
Directory of Open Access Journals (Sweden)
Todor Petkov
2013-12-01
Full Text Available The artificial neural networks are inspired by biological properties of human and animal brains. One of the neural networks type is called ART [4]. The abbreviation of ART stands for Adaptive Resonance Theory that has been invented by Stephen Grossberg in 1976 [5]. ART represents a family of Neural Networks. It is a cognitive and neural theory that describes how the brain autonomously learns to categorize, recognize and predict objects and events in the changing world. In this paper we introduce a GN model that represent ART1 Neural Network learning algorithm [1]. The purpose of this model is to explain when the input vector will be clustered or rejected among all nodes by the network. It can also be used for explanation and optimization of ART1 learning algorithm.
A dosimetry based on artificial neural net theory in treatment of Graves disease
International Nuclear Information System (INIS)
Yang Ping; Luo Dongyun; Lin Yongxia; Zeng Shiquan
2002-01-01
Objective: To study the feasibility of radioactive treatment of Graves disease with dosimetry of 131 I in novel method by computer. Methods: The database comprised 206 selected Graves disease cases and according to this database the nonlinear functions could be inferred consequently, then 206 Graves disease patients were divided into two groups. The group one, 109 patients, was treated with back-propagation (BP) dosimetry method. The group two was treated with traditional method. The results were analyzed. Results: Group one had an effective rate of 93.5%, cure rate of 90.8%, recurrent rate of 3.6% and early stage of hypothyroidism rate of 3.6%. Group two had an effective rate of 90.7%, cure rate of 85.5%, recurrent rate of 5.1% and early stage of hypothyroidism rate of 5.1%. Conclusion: The BP method is efficient and the results reflect that this method might increase the accuracy of the dosimetry of 131 I and reduce recurrent rate and early stage of hypothyroidism occurrence
Competition and Cooperation in Neural Nets : U.S.-Japan Joint Seminar
Arbib, Michael
1982-01-01
The human brain, wi th its hundred billion or more neurons, is both one of the most complex systems known to man and one of the most important. The last decade has seen an explosion of experimental research on the brain, but little theory of neural networks beyond the study of electrical properties of membranes and small neural circuits. Nonetheless, a number of workers in Japan, the United States and elsewhere have begun to contribute to a theory which provides techniques of mathematical analysis and computer simulation to explore properties of neural systems containing immense numbers of neurons. Recently, it has been gradually recognized that rather independent studies of the dynamics of pattern recognition, pattern format::ion, motor control, self-organization, etc. , in neural systems do in fact make use of common methods. We find that a "competition and cooperation" type of interaction plays a fundamental role in parallel information processing in the brain. The present volume brings together 23 papers ...
Pattern recognition neural-net by spatial mapping of biology visual field
Lin, Xin; Mori, Masahiko
2000-05-01
The method of spatial mapping in biology vision field is applied to artificial neural networks for pattern recognition. By the coordinate transform that is called the complex-logarithm mapping and Fourier transform, the input images are transformed into scale- rotation- and shift- invariant patterns, and then fed into a multilayer neural network for learning and recognition. The results of computer simulation and an optical experimental system are described.
Directory of Open Access Journals (Sweden)
mustamin hamid
2016-09-01
Full Text Available Abstract - This research proposed a system to identify Plasmodium falciparum on blood smear using the neural network backpropagation. Modified K-Means (MK-Means is used to separate between the object with the background image because that method was able to equalize the value of fitness at all Center cluster so there is no dead center and can also cope with the local minimum value. The extraction of the features used in this study consists of color features i.e. calculation of the mean, standard deviation, skewness, curtosis and entropy of co-occurent matrix with the purpose to get the values of all the trait value image, obtained are then used to train a neural network with the backpropagation training algorithm. Method of backpropagation networks capable of acquiring knowledge even though there is no certainty, able to perform a generalization and extraction of a specific data pattern. The image of the preparations blood smear are classified using the method of neural network Backpropagation. The test results obtained from Tropozoit with the accuracy 100%, scizon 80% and gametocytes 80%. Identification is then obtained outcomes the introduction with an average accuracy of 86,66%.
Neural nets with varying topology for high energy particle recognition. Theory and applications
International Nuclear Information System (INIS)
Perrone, A.L.; Basti, G.; Messi, R.; Paoluzi, L.; Picozza, P.
1995-01-01
In this paper we propose a strategy to solve the problem of parallel compuation based on a dynamic definition of the net topology showing its effectiveness for problems of particle track recognition in high-energy physics. In this way, we can maintain the linear architecture like in the geometric perceptron, but with a partial and dynamic connectivity so to overcome the intrinsic limiations of the geometric perceptron. Namely, the computation is truly parallel because of the partial connectivity but the net topology is always the optimal one because of its dynamic redefinition on the single input pattern. For these properties, we call this new architecture dynamic perceptron
Langella, Giuliano; Basile, Angelo; Bonfante, Antonello; Manna, Piero; Terribile, Fabio
2013-04-01
Digital soil mapping procedures are widespread used to build two-dimensional continuous maps about several pedological attributes. Our work addressed a regression kriging (RK) technique and a bootstrapped artificial neural network approach in order to evaluate and compare (i) the accuracy of prediction, (ii) the susceptibility of being included in automatic engines (e.g. to constitute web processing services), and (iii) the time cost needed for calibrating models and for making predictions. Regression kriging is maybe the most widely used geostatistical technique in the digital soil mapping literature. Here we tried to apply the EBLUP regression kriging as it is deemed to be the most statistically sound RK flavor by pedometricians. An unusual multi-parametric and nonlinear machine learning approach was accomplished, called BAGAP (Bootstrap aggregating Artificial neural networks with Genetic Algorithms and Principal component regression). BAGAP combines a selected set of weighted neural nets having specified characteristics to yield an ensemble response. The purpose of applying these two particular models is to ascertain whether and how much a more cumbersome machine learning method could be much promising in making more accurate/precise predictions. Being aware of the difficulty to handle objects based on EBLUP-RK as well as BAGAP when they are embedded in environmental applications, we explore the susceptibility of them in being wrapped within Web Processing Services. Two further kinds of aspects are faced for an exhaustive evaluation and comparison: automaticity and time of calculation with/without high performance computing leverage.
Energy Technology Data Exchange (ETDEWEB)
Rosas Ortiz, German
2000-01-01
Fault detection and diagnosis on transmission systems is an interesting area of investigation to Artificial Intelligence (AI) based systems. Neurocomputing is one of fastest growing areas of research in the fields of AI and pattern recognition. This work explores the possible suitability of pattern recognition approach of neural networks for fault detection and classification on power systems. The conventional detection techniques in modern relays are based in digital processing of signals and it need some time (around 1 cycle) to send a tripping signal, also they are likely to make incorrect decisions if the signals are noisy. It's desirable to develop a fast, accurate and robust approach that perform accurately for changing system conditions (like load variations and fault resistance). The aim of this work is to develop a novel technique based on Artificial Neural Networks (ANN), which explores the suitability of a pattern classification approach for fault detection and diagnosis. The suggested approach is based in the fact that when a fault occurs, a change in the system impedance take place and, as a consequence changes in amplitude and phase of line voltage and current signals take place. The ANN-based fault discriminator is trained to detect this changes as indicators of the instant of fault inception. This detector uses instantaneous values of these signals to make decisions. Suitability of using neural network as pattern classifiers for transmission systems fault diagnosis is described in detail a neural network design and simulation environment for real-time is presented. Results showing the performance of this approach are presented and indicate that it is fast, secure and exact enough, and it can be used in high speed fault detection and classification schemes. [Spanish] El diagnostico y la deteccion de fallas en sistemas de transmision es una area de interes en investigacion para sistemas basados en Inteligencia Artificial (IA). El calculo neuronal
A biologically inspired neural net for trajectory formation and obstacle avoidance.
Glasius, R; Komoda, A; Gielen, S C
1996-06-01
In this paper we present a biologically inspired two-layered neural network for trajectory formation and obstacle avoidance. The two topographically ordered neural maps consist of analog neurons having continuous dynamics. The first layer, the sensory map, receives sensory information and builds up an activity pattern which contains the optimal solution (i.e. shortest path without collisions) for any given set of current position, target positions and obstacle positions. Targets and obstacles are allowed to move, in which case the activity pattern in the sensory map will change accordingly. The time evolution of the neural activity in the second layer, the motor map, results in a moving cluster of activity, which can be interpreted as a population vector. Through the feedforward connections between the two layers, input of the sensory map directs the movement of the cluster along the optimal path from the current position of the cluster to the target position. The smooth trajectory is the result of the intrinsic dynamics of the network only. No supervisor is required. The output of the motor map can be used for direct control of an autonomous system in a cluttered environment or for control of the actuators of a biological limb or robot manipulator. The system is able to reach a target even in the presence of an external perturbation. Computer simulations of a point robot and a multi-joint manipulator illustrate the theory.
Johnson, J L
1994-09-10
The linking-field neural network model of Eckhorn et al. [Neural Comput. 2, 293-307 (1990)] was introduced to explain the experimentally observed synchronous activity among neural assemblies in the cat cortex induced by feature-dependent visual activity. The model produces synchronous bursts of pulses from neurons with similar activity, effectively grouping them by phase and pulse frequency. It gives a basic new function: grouping by similarity. The synchronous bursts are obtained in the limit of strong linking strengths. The linking-field model in the limit of moderate-to-weak linking characterized by few if any multiple bursts is investigated. In this limit dynamic, locally periodic traveling waves exist whose time signal encodes the geometrical structure of a two-dimensional input image. The signal can be made insensitive to translation, scale, rotation, distortion, and intensity. The waves transmit information beyond the physical interconnect distance. The model is implemented in an optical hybrid demonstration system. Results of the simulations and the optical system are presented.
Dynamic training algorithm for dynamic neural networks
International Nuclear Information System (INIS)
Tan, Y.; Van Cauwenberghe, A.; Liu, Z.
1996-01-01
The widely used backpropagation algorithm for training neural networks based on the gradient descent has a significant drawback of slow convergence. A Gauss-Newton method based recursive least squares (RLS) type algorithm with dynamic error backpropagation is presented to speed-up the learning procedure of neural networks with local recurrent terms. Finally, simulation examples concerning the applications of the RLS type algorithm to identification of nonlinear processes using a local recurrent neural network are also included in this paper
Neural-net predictor for beta limit disruptions in JT-60U
International Nuclear Information System (INIS)
Yoshino, R.
2005-01-01
Prediction of major disruptions occurring at the β -limit for tokamak plasmas with a normal magnetic shear in JT-60U was conducted using neural networks. Since no clear precursors are generally observed a few tens of milliseconds before the β -limit disruption, a sub-neural network is trained to output the value of the β N limit every 2 ms. The target β N limit is artificially set by the operator in the first step to train a network with non-disruptive shots as well as disruptive shots, and then in the second step the target limit is modified using the β N limit output from the trained network. The adjusted target greatly improves the consistency between the input data and the output. This training, the 'self-teaching method', has greatly reduced the false alarm rate triggered for non-disruptive shots. To improve the prediction performance further, the difference between the output β N limit and the measured β N , and 11 parameters, are inputted to the main neural network to calculate the 'stability level'. The occurrence of a major disruption is predicted when the stability level decreases to the 'alarm level'. Major disruptions at the β -limit have been predicted by the main network with a prediction success rate of 80% at 10 ms prior to the disruption while the false alarm rate is lower than 4% for non-disruptive shots. This 80% value is much higher than that obtained for a network trained with a fixed target β N limit set to be the maximum β N observed at the start of a major disruption, lower than 10%. A prediction success rate of 90% with a false alarm rate of 12% at 10 ms prior to the disruption has also been obtained. This 12% value is about half of that obtained for a network trained with a fixed target β N limit
Fast neural-net based fake track rejection in the LHCb reconstruction
De Cian, Michel; Seyfert, Paul; Stahl, Sascha
2017-01-01
A neural-network based algorithm to identify fake tracks in the LHCb pattern recognition is presented. This algorithm, called ghost probability, retains more than 99 % of well reconstructed tracks while reducing the number of fake tracks by 60 %. It is fast enough to fit into the CPU time budget of the software trigger farm and thus reduces the combinatorics of the decay reconstructions, as well as the number of tracks that need to be processed by the particle identification algorithms. As a result, it strongly contributes to the achievement of having the same reconstruction online and offline in the LHCb experiment in Run II of the LHC.
Development of the neural net technique for particle physics. Study of the e+e- → Z0 → γH reaction
International Nuclear Information System (INIS)
Guicheney, C.
1992-01-01
This study is concerned with the application of pattern recognition methods through neural networks to High Energy physics. Two methods, Hopfield nets and multilayer nets, are analyzed and shown to have high potential for (resp.) clusterization and classification. Hopfield nets are used for the recognition of jets occurring during the fragmentation process of the e + e - reaction. Multilayer nets are used for the whole reaction analysis. Impediments are pointed out. Associated background noise is also examined. Multilayer nets may enhance the signal to noise ratio when looking for an upper limit for the production of a Higgs boson in the expected canal, and allow for the specific study of the γ b anti b
Directory of Open Access Journals (Sweden)
A. V. Pavlov
2014-01-01
Full Text Available A mechanism of cognitive dissonance reducing is demonstrated with approach for non-monotonic fuzzy-valued logics by Fourier-holography technique implementation developing. Cognitive dissonance occurs under perceiving of new information that contradicts to the existing subjective pattern of the outside world, represented by double Fourier-transform cascade with a hologram – neural layers interconnections matrix of inner information representation and logical conclusion. The hologram implements monotonic logic according to “General Modus Ponens” rule. New information is represented by a hologram of exclusion that implements interconnections of logical conclusion and exclusion for neural layers. The latter are linked by Fourier transform that determines duality of the algebra forming operations of conjunction and disjunction. Hologram of exclusion forms conclusion that is dual to the “General Modus Ponens” conclusion. It is shown, that trained for the main rule and exclusion system can be represented by two-layered neural network with separate interconnection matrixes for direct and inverse iterations. The network energy function is involved determining the cyclic dynamics character; dissipative factor causing convergence type of the dynamics is analyzed. Both “General Modus Ponens” and exclusion holograms recording conditions on the dynamics and convergence of the system are demonstrated. The system converges to a stable status, in which logical conclusion doesn’t depend on the inner information. Such kind of dynamics, leading to tolerance forming, is typical for ordinary kind of thinking, aimed at inner pattern of outside world stability. For scientific kind of thinking, aimed at adequacy of the inner pattern of the world, a mechanism is needed to stop the net relaxation; the mechanism has to be external relative to the model of logic. Computer simulation results for the learning conditions adequate to real holograms recording are
Built-in self-repair of VLSI memories employing neural nets
Mazumder, Pinaki
1998-10-01
The decades of the Eighties and the Nineties have witnessed the spectacular growth of VLSI technology, when the chip size has increased from a few hundred devices to a staggering multi-millon transistors. This trend is expected to continue as the CMOS feature size progresses towards the nanometric dimension of 100 nm and less. SIA roadmap projects that, where as the DRAM chips will integrate over 20 billion devices in the next millennium, the future microprocessors may incorporate over 100 million transistors on a single chip. As the VLSI chip size increase, the limited accessibility of circuit components poses great difficulty for external diagnosis and replacement in the presence of faulty components. For this reason, extensive work has been done in built-in self-test techniques, but little research is known concerning built-in self-repair. Moreover, the extra hardware introduced by conventional fault-tolerance techniques is also likely to become faulty, therefore causing the circuit to be useless. This research demonstrates the feasibility of implementing electronic neural networks as intelligent hardware for memory array repair. Most importantly, we show that the neural network control possesses a robust and degradable computing capability under various fault conditions. Overall, a yield analysis performed on 64K DRAM's shows that the yield can be improved from as low as 20 percent to near 99 percent due to the self-repair design, with overhead no more than 7 percent.
Halem, M.; Radov, A.; Singh, D.
2017-12-01
Investigations of mid to high latitude atmospheric CO2 show growing amplitudes in seasonal variations over the past several decades. Recent high-resolution satellite measurements of CO2 concentration are now available for three years from the Orbiting Carbon Observatory-2. The Atmospheric Radiation Measurement (ARM) program of DOE has been making long-term CO2-flux measurements (in addition to CO2 concentration and an array of other meteorological quantities) at several towers and mobile sites located around the globe at half-hour frequencies. Recent papers have shown CO2 fluxes inferred by assimilating CO2 observations into ecosystem models are largely inconsistent with station observations. An investigation of how the biosphere has reacted to changes in atmospheric CO2 is essential to our understanding of potential climate-vegetation feedbacks. Thus, new approaches for calculating CO2-flux for assimilation into land surface models are necessary for improving the prediction of annual carbon uptake. In this study, we calculate and compare the predicted CO2 fluxes results employing a Feed Forward Backward Propagation Neural Network model on two architectures, (i) an IBM Minsky Computer node and (ii) a hybrid version of the ARC D-Wave quantum annealing computer. We compare the neural net results of predictions of CO2 flux from ARM station data for three different DOE ecosystem sites; an arid plains near Oklahoma City, a northern arctic site at Barrows AL, and a tropical rainforest site in the Amazon. Training times and predictive results for the calculating annual CO2 flux for the two architectures for each of the three sites are presented. Comparative results of predictions as measured by RMSE and MAE are discussed. Plots and correlations of observed vs predicted CO2 flux are also presented for all three sites. We show the estimated training times for quantum and classical calculations when extended to calculating global annual Carbon Uptake over land. We also
Application of neural networks to seismic active control
International Nuclear Information System (INIS)
Tang, Yu.
1995-01-01
An exploratory study on seismic active control using an artificial neural network (ANN) is presented in which a singledegree-of-freedom (SDF) structural system is controlled by a trained neural network. A feed-forward neural network and the backpropagation training method are used in the study. In backpropagation training, the learning rate is determined by ensuring the decrease of the error function at each training cycle. The training patterns for the neural net are generated randomly. Then, the trained ANN is used to compute the control force according to the control algorithm. The control strategy proposed herein is to apply the control force at every time step to destroy the build-up of the system response. The ground motions considered in the simulations are the N21E and N69W components of the Lake Hughes No. 12 record that occurred in the San Fernando Valley in California on February 9, 1971. Significant reduction of the structural response by one order of magnitude is observed. Also, it is shown that the proposed control strategy has the ability to reduce the peak that occurs during the first few cycles of the time history. These promising results assert the potential of applying ANNs to active structural control under seismic loads
Invariant visual object and face recognition: neural and computational bases, and a model, VisNet
Directory of Open Access Journals (Sweden)
Edmund T eRolls
2012-06-01
Full Text Available Neurophysiological evidence for invariant representations of objects and faces in the primate inferior temporal visual cortex is described. Then a computational approach to how invariant representations are formed in the brain is described that builds on the neurophysiology. A feature hierarchy modelin which invariant representations can be built by self-organizing learning based on the temporal and spatialstatistics of the visual input produced by objects as they transform in the world is described. VisNet can use temporal continuity in an associativesynaptic learning rule with a short term memory trace, and/or it can use spatialcontinuity in Continuous Spatial Transformation learning which does not require a temporal trace. The model of visual processing in theventral cortical stream can build representations of objects that are invariant withrespect to translation, view, size, and also lighting. The modelhas been extended to provide an account of invariant representations in the dorsal visualsystem of the global motion produced by objects such as looming, rotation, and objectbased movement. The model has been extended to incorporate top-down feedback connectionsto model the control of attention by biased competition in for example spatial and objectsearch tasks. The model has also been extended to account for how the visual system canselect single objects in complex visual scenes, and how multiple objects can berepresented in a scene. The model has also been extended to provide, with an additional layer, for the development of representations of spatial scenes of the type found in the hippocampus.
Recognition of malignant processes with neural nets from ESR spectra of serum albumin
Energy Technology Data Exchange (ETDEWEB)
Seidel, P. [Inst. of Medical Physics and Biophysics, Univ. Leipzig (Germany); Gurachevsky, A.; Muravsky, V.; Schnurr, K.; Seibt, G. [Medinnovation GmbH, Wildau (Germany); Matthes, G. [Inst. of Transfusion Medicine, Univ. Hospital Leipzig (Germany)
2005-07-01
Cancer diseases are the focus of intense research due to their frequent occurrence. It is known from the literature that serum proteins are changed in the case of malignant processes. Changes of albumin conformation, transport efficiency, and binding characteristics can be determined by electron spin resonance spectroscopy (ESR). The present study analysed the binding/dissociation function of albumin with an ESR method using 16-doxyl stearate spin probe as reporter molecule and ethanol as modifier of hydrophobic interactions. Native and frozen plasma of healthy donors (608 samples), patients with malignant diseases (423 samples), and patients with benign conditions (221 samples) were analysed. The global specificity was 91% and the sensitivity 96%. In look-back samples of 27 donors, a malignant process could be detected up to 30 months before clinical diagnosis. To recognise different entities of malignant diseases from the ESR spectra, Artificial neural networks were implemented. For 48 female donors with breast cancer, the recognition specificity was 85%. Other carcinoma entities (22 colon, 18 prostate, 12 stomach) were recognised with specificities between 75% and 84%. Should these specificity values be reproduced in larger studies, the described method could be used as a new specific tumour marker for the early detection of malignant processes. Since transmission of cancer via blood transfusion cannot be excluded as yet, the described ESR method could also be used as a quality test for plasma products. (orig.)
Data Normalization to Accelerate Training for Linear Neural Net to Predict Tropical Cyclone Tracks
Directory of Open Access Journals (Sweden)
Jian Jin
2015-01-01
Full Text Available When pure linear neural network (PLNN is used to predict tropical cyclone tracks (TCTs in South China Sea, whether the data is normalized or not greatly affects the training process. In this paper, min.-max. method and normal distribution method, instead of standard normal distribution, are applied to TCT data before modeling. We propose the experimental schemes in which, with min.-max. method, the min.-max. value pair of each variable is mapped to (−1, 1 and (0, 1; with normal distribution method, each variable’s mean and standard deviation pair is set to (0, 1 and (100, 1. We present the following results: (1 data scaled to the similar intervals have similar effects, no matter the use of min.-max. or normal distribution method; (2 mapping data to around 0 gains much faster training speed than mapping them to the intervals far away from 0 or using unnormalized raw data, although all of them can approach the same lower level after certain steps from their training error curves. This could be useful to decide data normalization method when PLNN is used individually.
HAWC Analysis of the Crab Nebula Using Neural-Net Energy Reconstruction
Marinelli, Samuel; HAWC Collaboration
2017-01-01
The HAWC (High-Altitude Water-Cherenkov) experiment is a TeV γ-ray observatory located 4100 m above sea level on the Sierra Negra mountain in Puebla, Mexico. The detector consists of 300 water-filled tanks, each instrumented with 4 photomuliplier tubes that utilize the water-Cherenkov technique to detect atmospheric air showers produced by cosmic γ rays. Construction of HAWC was completed in March, 2015. The experiment's wide field of view (2 sr) and high duty cycle (> 95 %) make it a powerful survey instrument sensitive to pulsar wind nebulae, supernova remnants, active galactic nuclei, and other γ-ray sources. The mechanisms of particle acceleration at these sources can be studied by analyzing their energy spectra. To this end, we have developed an event-by-event energy-reconstruction algorithm employing an artificial neural network to estimate energies of primary γ rays. The Crab Nebula, the brightest source of TeV photons, makes an excellent calibration source for this technique. We will present preliminary results from an analysis of the Crab energy spectrum using this new energy-reconstruction method. This work was supported by the National Science Foundation.
Recognition of malignant processes with neural nets from ESR spectra of serum albumin
International Nuclear Information System (INIS)
Seidel, P.; Gurachevsky, A.; Muravsky, V.; Schnurr, K.; Seibt, G.; Matthes, G.
2005-01-01
Cancer diseases are the focus of intense research due to their frequent occurrence. It is known from the literature that serum proteins are changed in the case of malignant processes. Changes of albumin conformation, transport efficiency, and binding characteristics can be determined by electron spin resonance spectroscopy (ESR). The present study analysed the binding/dissociation function of albumin with an ESR method using 16-doxyl stearate spin probe as reporter molecule and ethanol as modifier of hydrophobic interactions. Native and frozen plasma of healthy donors (608 samples), patients with malignant diseases (423 samples), and patients with benign conditions (221 samples) were analysed. The global specificity was 91% and the sensitivity 96%. In look-back samples of 27 donors, a malignant process could be detected up to 30 months before clinical diagnosis. To recognise different entities of malignant diseases from the ESR spectra, Artificial neural networks were implemented. For 48 female donors with breast cancer, the recognition specificity was 85%. Other carcinoma entities (22 colon, 18 prostate, 12 stomach) were recognised with specificities between 75% and 84%. Should these specificity values be reproduced in larger studies, the described method could be used as a new specific tumour marker for the early detection of malignant processes. Since transmission of cancer via blood transfusion cannot be excluded as yet, the described ESR method could also be used as a quality test for plasma products. (orig.)
Invariant Visual Object and Face Recognition: Neural and Computational Bases, and a Model, VisNet.
Rolls, Edmund T
2012-01-01
Neurophysiological evidence for invariant representations of objects and faces in the primate inferior temporal visual cortex is described. Then a computational approach to how invariant representations are formed in the brain is described that builds on the neurophysiology. A feature hierarchy model in which invariant representations can be built by self-organizing learning based on the temporal and spatial statistics of the visual input produced by objects as they transform in the world is described. VisNet can use temporal continuity in an associative synaptic learning rule with a short-term memory trace, and/or it can use spatial continuity in continuous spatial transformation learning which does not require a temporal trace. The model of visual processing in the ventral cortical stream can build representations of objects that are invariant with respect to translation, view, size, and also lighting. The model has been extended to provide an account of invariant representations in the dorsal visual system of the global motion produced by objects such as looming, rotation, and object-based movement. The model has been extended to incorporate top-down feedback connections to model the control of attention by biased competition in, for example, spatial and object search tasks. The approach has also been extended to account for how the visual system can select single objects in complex visual scenes, and how multiple objects can be represented in a scene. The approach has also been extended to provide, with an additional layer, for the development of representations of spatial scenes of the type found in the hippocampus.
Generation of daily solar irradiation by means of artificial neural net works
Energy Technology Data Exchange (ETDEWEB)
Siqueira, Adalberto N.; Tiba, Chigueru; Fraidenraich, Naum [Departamento de Energia Nuclear, da Universidade Federal de Pernambuco, Av. Prof. Luiz Freire, 1000 - CDU, CEP 50.740-540 Recife, Pernambuco (Brazil)
2010-11-15
The present study proposes the utilization of Artificial Neural Networks (ANN) as an alternative for generating synthetic series of daily solar irradiation. The sequences were generated from the use of daily temporal series of a group of meteorological variables that were measured simultaneously. The data used were measured between the years of 1998 and 2006 in two temperate climate localities of Brazil, Ilha Solteira (Sao Paulo) and Pelotas (Rio Grande do Sul). The estimates were taken for the months of January, April, July and October, through two models which are distinguished regarding the use or nonuse of measured bright sunshine hours as an input variable. An evaluation of the performance of the 56 months of solar irradiation generated by way of ANN showed that by using the measured bright sunshine hours as an input variable (model 1), the RMSE obtained were less or equal to 23.2% being that of those, although 43 of those months presented RMSE less or equal to 12.3%. In the case of the model that did not use the measured bright sunshine hours but used a daylight length (model 2), RMSE were obtained that varied from 8.5% to 37.5%, although 38 of those months presented RMSE less or equal to 20.0%. A comparison of the monthly series for all of the years, achieved by means of the Kolmogorov-Smirnov test (to a confidence level of 99%), demonstrated that of the 16 series generated by ANN model only two, obtained by model 2 for the months of April and July in Pelotas, presented significant difference in relation to the distributions of the measured series and that all mean deviations obtained were inferior to 0.39 MJ/m{sup 2}. It was also verified that the two ANN models were able to reproduce the principal statistical characteristics of the frequency distributions of the measured series such as: mean, mode, asymmetry and Kurtosis. (author)
Neural Network Back-Propagation Algorithm for Sensing Hypergols
Perotti, Jose; Lewis, Mark; Medelius, Pedro; Bastin, Gary
2013-01-01
Fast, continuous detection of a wide range of hazardous substances simultaneously is needed to achieve improved safety for personnel working with hypergolic fuels and oxidizers, as well as other hazardous substances, with a requirement for such detection systems to warn personnel immediately upon the sudden advent of hazardous conditions, with a high probability of detection and a low false alarm rate. The primary purpose of this software is to read the voltage outputs from voltage dividers containing carbon nano - tube sensors as a variable resistance leg, and to recognize quickly when a leak has occurred through recognizing that a generalized pattern change in resistivity of a carbon nanotube sensor has occurred upon exposure to dangerous substances, and, further, to identify quickly just what substance is present through detailed pattern recognition of the shape of the response provided by the carbon nanotube sensor.
van den Bergh, J.; Schutz, J.; Chirayath, V.; Li, A.
2017-12-01
NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Net's convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign.Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users' input against pre-classified coral imagery to gauge their accuracy and utilizes in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.
van den Bergh, Jarrett; Schutz, Joey; Li, Alan; Chirayath, Ved
2017-01-01
NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Nets convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign. Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users input against pre-classified coral imagery to gauge their accuracy and utilize in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.
Antenna analysis using neural networks
Smith, William T.
1992-01-01
Conventional computing schemes have long been used to analyze problems in electromagnetics (EM). The vast majority of EM applications require computationally intensive algorithms involving numerical integration and solutions to large systems of equations. The feasibility of using neural network computing algorithms for antenna analysis is investigated. The ultimate goal is to use a trained neural network algorithm to reduce the computational demands of existing reflector surface error compensation techniques. Neural networks are computational algorithms based on neurobiological systems. Neural nets consist of massively parallel interconnected nonlinear computational elements. They are often employed in pattern recognition and image processing problems. Recently, neural network analysis has been applied in the electromagnetics area for the design of frequency selective surfaces and beam forming networks. The backpropagation training algorithm was employed to simulate classical antenna array synthesis techniques. The Woodward-Lawson (W-L) and Dolph-Chebyshev (D-C) array pattern synthesis techniques were used to train the neural network. The inputs to the network were samples of the desired synthesis pattern. The outputs are the array element excitations required to synthesize the desired pattern. Once trained, the network is used to simulate the W-L or D-C techniques. Various sector patterns and cosecant-type patterns (27 total) generated using W-L synthesis were used to train the network. Desired pattern samples were then fed to the neural network. The outputs of the network were the simulated W-L excitations. A 20 element linear array was used. There were 41 input pattern samples with 40 output excitations (20 real parts, 20 imaginary). A comparison between the simulated and actual W-L techniques is shown for a triangular-shaped pattern. Dolph-Chebyshev is a different class of synthesis technique in that D-C is used for side lobe control as opposed to pattern
Equilibrium Propagation: Bridging the Gap between Energy-Based Models and Backpropagation
Directory of Open Access Journals (Sweden)
Benjamin Scellier
2017-05-01
Full Text Available We introduce Equilibrium Propagation, a learning framework for energy-based models. It involves only one kind of neural computation, performed in both the first phase (when the prediction is made and the second phase of training (after the target or prediction error is revealed. Although this algorithm computes the gradient of an objective function just like Backpropagation, it does not need a special computation or circuit for the second phase, where errors are implicitly propagated. Equilibrium Propagation shares similarities with Contrastive Hebbian Learning and Contrastive Divergence while solving the theoretical issues of both algorithms: our algorithm computes the gradient of a well-defined objective function. Because the objective function is defined in terms of local perturbations, the second phase of Equilibrium Propagation corresponds to only nudging the prediction (fixed point or stationary distribution toward a configuration that reduces prediction error. In the case of a recurrent multi-layer supervised network, the output units are slightly nudged toward their target in the second phase, and the perturbation introduced at the output layer propagates backward in the hidden layers. We show that the signal “back-propagated” during this second phase corresponds to the propagation of error derivatives and encodes the gradient of the objective function, when the synaptic update corresponds to a standard form of spike-timing dependent plasticity. This work makes it more plausible that a mechanism similar to Backpropagation could be implemented by brains, since leaky integrator neural computation performs both inference and error back-propagation in our model. The only local difference between the two phases is whether synaptic changes are allowed or not. We also show experimentally that multi-layer recurrently connected networks with 1, 2, and 3 hidden layers can be trained by Equilibrium Propagation on the permutation-invariant MNIST
Nonlinear signal processing using neural networks: Prediction and system modelling
Energy Technology Data Exchange (ETDEWEB)
Lapedes, A.; Farber, R.
1987-06-01
The backpropagation learning algorithm for neural networks is developed into a formalism for nonlinear signal processing. We illustrate the method by selecting two common topics in signal processing, prediction and system modelling, and show that nonlinear applications can be handled extremely well by using neural networks. The formalism is a natural, nonlinear extension of the linear Least Mean Squares algorithm commonly used in adaptive signal processing. Simulations are presented that document the additional performance achieved by using nonlinear neural networks. First, we demonstrate that the formalism may be used to predict points in a highly chaotic time series with orders of magnitude increase in accuracy over conventional methods including the Linear Predictive Method and the Gabor-Volterra-Weiner Polynomial Method. Deterministic chaos is thought to be involved in many physical situations including the onset of turbulence in fluids, chemical reactions and plasma physics. Secondly, we demonstrate the use of the formalism in nonlinear system modelling by providing a graphic example in which it is clear that the neural network has accurately modelled the nonlinear transfer function. It is interesting to note that the formalism provides explicit, analytic, global, approximations to the nonlinear maps underlying the various time series. Furthermore, the neural net seems to be extremely parsimonious in its requirements for data points from the time series. We show that the neural net is able to perform well because it globally approximates the relevant maps by performing a kind of generalized mode decomposition of the maps. 24 refs., 13 figs.
NeMO-Net - The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment
Li, A. S. X.; Chirayath, V.; Segal-Rosenhaimer, M.; Das, K.
2017-12-01
In the past decade, coral reefs worldwide have experienced unprecedented stresses due to climate change, ocean acidification, and anthropomorphic pressures, instigating massive bleaching and die-off of these fragile and diverse ecosystems. Furthermore, remote sensing of these shallow marine habitats is hindered by ocean wave distortion, refraction and optical attenuation, leading invariably to data products that are often of low resolution and signal-to-noise (SNR) ratio. However, recent advances in UAV and Fluid Lensing technology have allowed us to capture multispectral 3D imagery of these systems at sub-cm scales from above the water surface, giving us an unprecedented view of their growth and decay. Exploiting the fine-scaled features of these datasets, machine learning methods such as MAP, PCA, and SVM can not only accurately classify the living cover and morphology of these reef systems (below 8% error), but are also able to map the spectral space between airborne and satellite imagery, augmenting and improving the classification accuracy of previously low-resolution datasets.We are currently implementing NeMO-Net, the first open-source deep convolutional neural network (CNN) and interactive active learning and training software to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology. NeMO-Net will be built upon the QGIS platform to ingest UAV, airborne and satellite datasets from various sources and sensor capabilities, and through data-fusion determine the coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. To achieve this, we will exploit virtual data augmentation, the use of semi-supervised learning, and active learning through a tablet platform allowing for users to manually train uncertain or difficult to classify datasets. The project will make use of Python's extensive libraries for machine learning, as well as extending integration to GPU
Desain Sistem Pendeteksi untuk Citra Base Sub-assembly dengan Algoritma Backpropagation
Directory of Open Access Journals (Sweden)
Kasdianto Kasdianto
2017-04-01
Full Text Available Object identification technique using machine vision has been implemented in industrial of electronic manufacturers for years. This technique is commonly used for reject detection (for disqualified product based on existing standard or defect detection. This research aims to build a reject detector of sub-assembly condition which is differed by two conditions that are missing screw and wrong position screw using neural network backpropagation. The image taken using camera will be converted into grayscale before it is processed in backpropagation methods to generate a weight value. The experiment result shows that the network architecture with two layers has the most excellent accuracy level. Using learning rate of 0.5, target error 0.015%, and the number of node 1 of 100 and node 2 of 50, the successive rate for sub-assembly detection in right condition reached 99.02% while no error occurs in detecting the wrong condition of Sub-assembly (missing screw and wrong position screw.
Directory of Open Access Journals (Sweden)
Eric Bastos Gorgens
2009-12-01
Full Text Available Rede neural artificial consiste em um conjunto de unidades que contêm funções matemáticas, unidas por pesos. As redes são capazes de aprender, mediante modificação dos pesos sinápticos, e generalizar o aprendizado para outros arquivos desconhecidos. O projeto de redes neurais é composto por três etapas: pré-processamento, processamento e, por fim, pós-processamento dos dados. Um dos problemas clássicos que podem ser abordados por redes é a aproximação de funções. Nesse grupo, pode-se incluir a estimação do volume de árvores. Foram utilizados quatro arquiteturas diferentes, cinco pré-processamentos e duas funções de ativação. As redes que se apresentaram estatisticamente iguais aos dados observados também foram analisadas quanto ao resíduo e à distribuição dos volumes e comparadas com a estimação de volume pelo modelo de Schumacher e Hall. As redes neurais formadas por neurônios, cuja função de ativação era exponencial, apresentaram estimativas estatisticamente iguais aos dados observados. As redes treinadas com os dados normalizados pelo método da interpolação linear e equalizados tiveram melhor desempenho na estimação.The artificial neural network consists of a set of units containing mathematical functions connected by weights. Such nets are capable of learning by means of synaptic weight modification, generalizing learning for other unknown archives. The neural network project comprises three stages: pre-processing, processing and post-processing of data. One of the classical problems approached by networks is function approximation. Tree volume estimate can be included in this group. Four different architectures, five pre-processings and two activation functions were used. The nets which were statistically similar to the observed data were also analyzed in relation to residue and volume and compared to the volume estimate provided by the Schumacher and Hall equation. The neural nets formed by
International Nuclear Information System (INIS)
Haase, G.
2003-01-01
Neural nets to the plausibility check of measured values in the ''integrated measurement and information system for the surveillance of environmental radioactivity, IMIS'' is a research project supported by the Federal Minister for the Environment, Nature Conservation and Nuclear Safety. A goal of this project was the automatic recognition of implausible measured values in the data base ORACLE, which measured values from surveillance of environmental radioactivity of most diverse environmental media contained. The conversion of this project [ 1 ] was realized by institut of logic, complexity and deduction systems of the university Karlsruhe under the direction of Professor Dr. Menzel, Dr. Martin Riedmueller and Martin Lauer. (orig.)
Impairment mitigation in superchannels with digital backpropagation and MLSD
DEFF Research Database (Denmark)
Porto da Silva, Edson; Larsen, Knud J.; Zibar, Darko
2015-01-01
We assess numerically the performance of single-carrier digital backpropagation (SC-DBP) and maximum-likelihood sequence detection (MLSD) for DP-QPSK and DP-16QAM superchannel transmission over dispersion uncompensated links for three different cases of spectral shaping: optical pre-filtering of ...
Adaptive digital back-propagation for optical communication systems
Lin, C.-Y.; Napoli, A.; Spinnler, B.; Sleiffer, V.A.J.M.; Rafique, D.; Kuschnerov, M.; Bohn, M.; Schmauss, B.
2014-01-01
We propose an adaptive digital back-propagation method (A-DBP) to selfdetermine unknown fiber nonlinear coefficient gamma. Performance is experimentally verified with 10224-Gb/s POLMUX-16QAM over 656km. Optimal DBP performance, without knowledge of gamma, is obtained by A-DBP.
Error-backpropagation in temporally encoded networks of spiking neurons
S.M. Bohte (Sander); J.A. La Poutré (Han); J.N. Kok (Joost)
2000-01-01
textabstractFor a network of spiking neurons that encodes information in the timing of individual spike-times, we derive a supervised learning rule, emph{SpikeProp, akin to traditional error-backpropagation and show how to overcome the discontinuities introduced by thresholding. With this algorithm,
Single-step digital backpropagation for nonlinearity mitigation
DEFF Research Database (Denmark)
Secondini, Marco; Rommel, Simon; Meloni, Gianluca
2015-01-01
Nonlinearity mitigation based on the enhanced split-step Fourier method (ESSFM) for the implementation of low-complexity digital backpropagation (DBP) is investigated and experimentally demonstrated. After reviewing the main computational aspects of DBP and of the conventional split-step Fourier...... in the computational complexity, power consumption, and latency with respect to a simple feed-forward equalizer for bulk dispersion compensation....
Comparative performance of some popular artificial neural network ...
Indian Academy of Sciences (India)
tificial neural network domain (viz., local search algorithms, global search ... branches of astronomy for automated data analysis and other applications like ...... such as standard backpropagation, fuzzy logic, genetic algorithms, fractals etc.,.
Romano, Renan A.; Pratavieira, Sebastião.; da Silva, Ana P.; Kurachi, Cristina; Guimarães, Francisco E. G.
2017-07-01
This study clearly demonstrates that multispectral confocal microscopy images analyzed by artificial neural networks provides a powerful tool to real-time monitoring photosensitizer uptake, as well as photochemical transformations occurred.
Neural network segmentation of magnetic resonance images
International Nuclear Information System (INIS)
Frederick, B.
1990-01-01
Neural networks are well adapted to the task of grouping input patterns into subsets which share some similarity. Moreover, once trained, they can generalize their classification rules to classify new data sets. Sets of pixel intensities from magnetic resonance (MR) images provide a natural input to a neural network; by varying imaging parameters, MR images can reflect various independent physical parameters of tissues in their pixel intensities. A neural net can then be trained to classify physically similar tissue types based on sets of pixel intensities resulting from different imaging studies on the same subject. This paper reports that a neural network classifier for image segmentation was implanted on a Sun 4/60, and was tested on the task of classifying tissues of canine head MR images. Four images of a transaxial slice with different imaging sequences were taken as input to the network (three spin-echo images and an inversion recovery image). The training set consisted of 691 representative samples of gray matter, white matter, cerebrospinal fluid, bone, and muscle preclassified by a neuroscientist. The network was trained using a fast backpropagation algorithm to derive the decision criteria to classify any location in the image by its pixel intensities, and the image was subsequently segmented by the classifier
Backpropagation architecture optimization and an application in nuclear power plant diagnostics
International Nuclear Information System (INIS)
Basu, A.; Bartlett, E.B.
1993-01-01
This paper presents a Dynamic Node Architecture (DNA) scheme to optimize the architecture of backpropagation Artificial Neural Networks (ANNs). This network scheme is used to develop an ANN based diagnostic adviser capable of identifying the operating status of a nuclear power plant. Specifically, a ''root'' network is trained to diagnose if the plant is in a normal operating condition or not. In the event of an abnormal condition, and other ''classifier'' network is trained to recognize the particular transient taking place. these networks are trained using plant instrumentation data gathered during simulations of the various transients and normal operating conditions at the Iowa Electric Light and Power Company's Duane Arnold Energy Center (DAEC) operator training simulator
Backpropagation architecture optimization and an application in nuclear power plant diagnostics
International Nuclear Information System (INIS)
Basu, A.; Bartlett, E.B.
1993-01-01
This paper presents a Dynamic Node Architecture (DNA) scheme to optimize the architecture of backpropagation Artificial Neural Networks (ANNs). This network scheme is used to develop an ANN based diagnostic adviser capable of identifying the operating status of a nuclear power plant. Specifically, a root network is trained to diagnose if the plant is in a normal operating condition or not. In the event of an abnormal condition, another classifier network is trained to recognize the particular transient taking place. These networks are trained using plant instrumentation data gathered during simulations of the various transients and normal operating conditions at, the Iowa Electric Light and Power Company's Duane Arnold Energy Center (DAEC) operator training simulator
Trainable hardware for dynamical computing using error backpropagation through physical media.
Hermans, Michiel; Burm, Michaël; Van Vaerenbergh, Thomas; Dambre, Joni; Bienstman, Peter
2015-03-24
Neural networks are currently implemented on digital Von Neumann machines, which do not fully leverage their intrinsic parallelism. We demonstrate how to use a novel class of reconfigurable dynamical systems for analogue information processing, mitigating this problem. Our generic hardware platform for dynamic, analogue computing consists of a reciprocal linear dynamical system with nonlinear feedback. Thanks to reciprocity, a ubiquitous property of many physical phenomena like the propagation of light and sound, the error backpropagation-a crucial step for tuning such systems towards a specific task-can happen in hardware. This can potentially speed up the optimization process significantly, offering important benefits for the scalability of neuro-inspired hardware. In this paper, we show, using one experimentally validated and one conceptual example, that such systems may provide a straightforward mechanism for constructing highly scalable, fully dynamical analogue computers.
DEFF Research Database (Denmark)
Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl
2010-01-01
is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino......β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method...... NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which...
Directory of Open Access Journals (Sweden)
Bent Petersen
Full Text Available UNLABELLED: β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC=0.50, Qtotal=82.1%, sensitivity=75.6%, PPV=68.8% and AUC=0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17-0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. CONCLUSION: The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences.
Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl
2010-01-01
β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC = 0.50, Qtotal = 82.1%, sensitivity = 75.6%, PPV = 68.8% and AUC = 0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17 – 0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. Conclusion The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences. PMID:21152409
Petersen, Bent; Lundegaard, Claus; Petersen, Thomas Nordahl
2010-11-30
β-turns are the most common type of non-repetitive structures, and constitute on average 25% of the amino acids in proteins. The formation of β-turns plays an important role in protein folding, protein stability and molecular recognition processes. In this work we present the neural network method NetTurnP, for prediction of two-class β-turns and prediction of the individual β-turn types, by use of evolutionary information and predicted protein sequence features. It has been evaluated against a commonly used dataset BT426, and achieves a Matthews correlation coefficient of 0.50, which is the highest reported performance on a two-class prediction of β-turn and not-β-turn. Furthermore NetTurnP shows improved performance on some of the specific β-turn types. In the present work, neural network methods have been trained to predict β-turn or not and individual β-turn types from the primary amino acid sequence. The individual β-turn types I, I', II, II', VIII, VIa1, VIa2, VIba and IV have been predicted based on classifications by PROMOTIF, and the two-class prediction of β-turn or not is a superset comprised of all β-turn types. The performance is evaluated using a golden set of non-homologous sequences known as BT426. Our two-class prediction method achieves a performance of: MCC=0.50, Qtotal=82.1%, sensitivity=75.6%, PPV=68.8% and AUC=0.864. We have compared our performance to eleven other prediction methods that obtain Matthews correlation coefficients in the range of 0.17-0.47. For the type specific β-turn predictions, only type I and II can be predicted with reasonable Matthews correlation coefficients, where we obtain performance values of 0.36 and 0.31, respectively. The NetTurnP method has been implemented as a webserver, which is freely available at http://www.cbs.dtu.dk/services/NetTurnP/. NetTurnP is the only available webserver that allows submission of multiple sequences.
Artificial Neural Networks to Detect Risk of Type 2 Diabetes | Baha ...
African Journals Online (AJOL)
A multilayer feedforward architecture with backpropagation algorithm was designed using Neural Network Toolbox of Matlab. The network was trained using batch mode backpropagation with gradient descent and momentum. Best performed network identified during the training was 2 hidden layers of 6 and 3 neurons, ...
Event-Driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines.
Neftci, Emre O; Augustine, Charles; Paul, Somnath; Detorakis, Georgios
2017-01-01
An ongoing challenge in neuromorphic computing is to devise general and computationally efficient models of inference and learning which are compatible with the spatial and temporal constraints of the brain. One increasingly popular and successful approach is to take inspiration from inference and learning algorithms used in deep neural networks. However, the workhorse of deep learning, the gradient descent Gradient Back Propagation (BP) rule, often relies on the immediate availability of network-wide information stored with high-precision memory during learning, and precise operations that are difficult to realize in neuromorphic hardware. Remarkably, recent work showed that exact backpropagated gradients are not essential for learning deep representations. Building on these results, we demonstrate an event-driven random BP (eRBP) rule that uses an error-modulated synaptic plasticity for learning deep representations. Using a two-compartment Leaky Integrate & Fire (I&F) neuron, the rule requires only one addition and two comparisons for each synaptic weight, making it very suitable for implementation in digital or mixed-signal neuromorphic hardware. Our results show that using eRBP, deep representations are rapidly learned, achieving classification accuracies on permutation invariant datasets comparable to those obtained in artificial neural network simulations on GPUs, while being robust to neural and synaptic state quantizations during learning.
Event-Driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines
Directory of Open Access Journals (Sweden)
Emre O. Neftci
2017-06-01
Full Text Available An ongoing challenge in neuromorphic computing is to devise general and computationally efficient models of inference and learning which are compatible with the spatial and temporal constraints of the brain. One increasingly popular and successful approach is to take inspiration from inference and learning algorithms used in deep neural networks. However, the workhorse of deep learning, the gradient descent Gradient Back Propagation (BP rule, often relies on the immediate availability of network-wide information stored with high-precision memory during learning, and precise operations that are difficult to realize in neuromorphic hardware. Remarkably, recent work showed that exact backpropagated gradients are not essential for learning deep representations. Building on these results, we demonstrate an event-driven random BP (eRBP rule that uses an error-modulated synaptic plasticity for learning deep representations. Using a two-compartment Leaky Integrate & Fire (I&F neuron, the rule requires only one addition and two comparisons for each synaptic weight, making it very suitable for implementation in digital or mixed-signal neuromorphic hardware. Our results show that using eRBP, deep representations are rapidly learned, achieving classification accuracies on permutation invariant datasets comparable to those obtained in artificial neural network simulations on GPUs, while being robust to neural and synaptic state quantizations during learning.
Random synaptic feedback weights support error backpropagation for deep learning
Lillicrap, Timothy P.; Cownden, Daniel; Tweed, Douglas B.; Akerman, Colin J.
2016-01-01
The brain processes information through multiple layers of neurons. This deep architecture is representationally powerful, but complicates learning because it is difficult to identify the responsible neurons when a mistake is made. In machine learning, the backpropagation algorithm assigns blame by multiplying error signals with all the synaptic weights on each neuron's axon and further downstream. However, this involves a precise, symmetric backward connectivity pattern, which is thought to be impossible in the brain. Here we demonstrate that this strong architectural constraint is not required for effective error propagation. We present a surprisingly simple mechanism that assigns blame by multiplying errors by even random synaptic weights. This mechanism can transmit teaching signals across multiple layers of neurons and performs as effectively as backpropagation on a variety of tasks. Our results help reopen questions about how the brain could use error signals and dispel long-held assumptions about algorithmic constraints on learning. PMID:27824044
Chirayath, Ved
2018-01-01
We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low-resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with
Backpropagating Action Potentials Enable Detection of Extrasynaptic Glutamate by NMDA Receptors
Directory of Open Access Journals (Sweden)
Yu-Wei Wu
2012-05-01
Full Text Available Synaptic NMDA receptors (NMDARs are crucial for neural coding and plasticity. However, little is known about the adaptive function of extrasynaptic NMDARs occurring mainly on dendritic shafts. Here, we find that in CA1 pyramidal neurons, backpropagating action potentials (bAPs recruit shaft NMDARs exposed to ambient glutamate. In contrast, spine NMDARs are “protected,” under baseline conditions, from such glutamate influences by perisynaptic transporters: we detect bAP-evoked Ca2+ entry through these receptors upon local synaptic or photolytic glutamate release. During theta-burst firing, NMDAR-dependent Ca2+ entry either downregulates or upregulates an h-channel conductance (Gh of the cell depending on whether synaptic glutamate release is intact or blocked. Thus, the balance between activation of synaptic and extrasynaptic NMDARs can determine the sign of Gh plasticity. Gh plasticity in turn regulates dendritic input probed by local glutamate uncaging. These results uncover a metaplasticity mechanism potentially important for neural coding and memory formation.
International Nuclear Information System (INIS)
Jerebko, Anna K.; Summers, Ronald M.; Malley, James D.; Franaszek, Marek; Johnson, C. Daniel
2003-01-01
Detection of colonic polyps in CT colonography is problematic due to complexities of polyp shape and the surface of the normal colon. Published results indicate the feasibility of computer-aided detection of polyps but better classifiers are needed to improve specificity. In this paper we compare the classification results of two approaches: neural networks and recursive binary trees. As our starting point we collect surface geometry information from three-dimensional reconstruction of the colon, followed by a filter based on selected variables such as region density, Gaussian and average curvature and sphericity. The filter returns sites that are candidate polyps, based on earlier work using detection thresholds, to which the neural nets or the binary trees are applied. A data set of 39 polyps from 3 to 25 mm in size was used in our investigation. For both neural net and binary trees we use tenfold cross-validation to better estimate the true error rates. The backpropagation neural net with one hidden layer trained with Levenberg-Marquardt algorithm achieved the best results: sensitivity 90% and specificity 95% with 16 false positives per study
Direct adaptive control using feedforward neural networks
Cajueiro, Daniel Oliveira; Hemerly, Elder Moreira
2003-01-01
ABSTRACT: This paper proposes a new scheme for direct neural adaptive control that works efficiently employing only one neural network, used for simultaneously identifying and controlling the plant. The idea behind this structure of adaptive control is to compensate the control input obtained by a conventional feedback controller. The neural network training process is carried out by using two different techniques: backpropagation and extended Kalman filter algorithm. Additionally, the conver...
Energy Technology Data Exchange (ETDEWEB)
Setsu, N.; Murakami, K.; Ohori, T.; Watanabe, K. [Hokkaido Institute of Technology, Sapporo (Japan)
1996-01-20
For solving the traveling salesman problem (TSP) by using a continuous value outputting neural net (NN), an investigation was given on the accuracy of solution and the possibility on traveling routes by using the penalty coefficient and temperature as the parameters for energy functions. The parameter range to obtain high-quality traveling routes was shown by a numerical experiment. The experimental result revealed that, when the penalty coefficient `r` is large, the traveling route possibility tends to become higher, but the route length increases, and when the `r` is small, the traveling route possibility becomes lower, but the route length decreases, also in the continuous value outputting NN as in the two-value outputting NN. Noticing this fact, and in order to improve the traveling route possibility as well as the solution quality, a method was proposed to expand the penalty control method which was proposed previously by the authors on the two-value outputting NN, into the continuous value outputting NN. In addition, a proposal was also made on a method to derive an optimal temperature efficiently by using the golden section method. It was found that the relative error has been reduced by 48% on the average as compared with that in the conventional method in which the temperature is fixed. 6 refs., 5 figs.
Analisa Estimasi Penyeleksian Dosen Menggunakan Metode Backpropagation (Studi Kasus STMIK Amik Riau
Directory of Open Access Journals (Sweden)
Debi Setiawan
2016-12-01
Full Text Available Abstract- The purpose of this study was to estimate the number of lecturers who will be selected at the end of the year. Selection of lecturers is a way to determine the productivity of lecturers. In Act No. 14 of 2005, article 67, explained that an institution can undertake unilateral termination respectfully, when it ended joint working relationship between lecturers and education providers. At private colleges, the trigger of the selection of lecturers due to the productivity and the number of students. If the number of students is insufficient faculty ratio, while increasing productivity and excellent faculty, it still will do the selection of lecturers. The problem that arises is the imbalance for lecturers who have improved performance. It is necessary for analysis of estimates in the process of selecting lecturers, lecturers and institutions in order to be able to take a stand to solve this problem. Estimation using the design pattern of artificial neural networks (ANN and methods of propagation, with an error rate of 0.5%. Variables that will be used is the amount of students majoring in IT (Computer Science, MI (Management Information on campus STMIK Amik Riau, the number of Lecturer (MI and TI, and the final value of faculty productivity. These five variables will be processed on the system of selecting lecturers analysis using backpropagation method, so that the results to be obtained is the number of lecturers who will be affected by the selection of lecturers on campus STMIK Amik Riau.
Advances in Artificial Neural Networks - Methodological Development and Application
Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other ne...
A Novel Handwritten Letter Recognizer Using Enhanced Evolutionary Neural Network
Mahmoudi, Fariborz; Mirzashaeri, Mohsen; Shahamatnia, Ehsan; Faridnia, Saed
This paper introduces a novel design for handwritten letter recognition by employing a hybrid back-propagation neural network with an enhanced evolutionary algorithm. Feeding the neural network consists of a new approach which is invariant to translation, rotation, and scaling of input letters. Evolutionary algorithm is used for the global search of the search space and the back-propagation algorithm is used for the local search. The results have been computed by implementing this approach for recognizing 26 English capital letters in the handwritings of different people. The computational results show that the neural network reaches very satisfying results with relatively scarce input data and a promising performance improvement in convergence of the hybrid evolutionary back-propagation algorithms is exhibited.
Event-Driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines
Neftci, Emre O.; Augustine, Charles; Paul, Somnath; Detorakis, Georgios
2017-01-01
An ongoing challenge in neuromorphic computing is to devise general and computationally efficient models of inference and learning which are compatible with the spatial and temporal constraints of the brain. One increasingly popular and successful approach is to take inspiration from inference and learning algorithms used in deep neural networks. However, the workhorse of deep learning, the gradient descent Gradient Back Propagation (BP) rule, often relies on the immediate availability of net...
A comparison of neural network architectures for the prediction of MRR in EDM
Jena, A. R.; Das, Raja
2017-11-01
The aim of the research work is to predict the material removal rate of a work-piece in electrical discharge machining (EDM). Here, an effort has been made to predict the material removal rate through back-propagation neural network (BPN) and radial basis function neural network (RBFN) for a work-piece of AISI D2 steel. The input parameters for the architecture are discharge-current (Ip), pulse-duration (Ton), and duty-cycle (τ) taken for consideration to obtained the output for material removal rate of the work-piece. In the architecture, it has been observed that radial basis function neural network is comparatively faster than back-propagation neural network but logically back-propagation neural network results more real value. Therefore BPN may consider as a better process in this architecture for consistent prediction to save time and money for conducting experiments.
Deng, Lei; Jiao, Peng; Pei, Jing; Wu, Zhenzhi; Li, Guoqi
2018-04-01
Although deep neural networks (DNNs) are being a revolutionary power to open up the AI era, the notoriously huge hardware overhead has challenged their applications. Recently, several binary and ternary networks, in which the costly multiply-accumulate operations can be replaced by accumulations or even binary logic operations, make the on-chip training of DNNs quite promising. Therefore there is a pressing need to build an architecture that could subsume these networks under a unified framework that achieves both higher performance and less overhead. To this end, two fundamental issues are yet to be addressed. The first one is how to implement the back propagation when neuronal activations are discrete. The second one is how to remove the full-precision hidden weights in the training phase to break the bottlenecks of memory/computation consumption. To address the first issue, we present a multi-step neuronal activation discretization method and a derivative approximation technique that enable the implementing the back propagation algorithm on discrete DNNs. While for the second issue, we propose a discrete state transition (DST) methodology to constrain the weights in a discrete space without saving the hidden weights. Through this way, we build a unified framework that subsumes the binary or ternary networks as its special cases, and under which a heuristic algorithm is provided at the website https://github.com/AcrossV/Gated-XNOR. More particularly, we find that when both the weights and activations become ternary values, the DNNs can be reduced to sparse binary networks, termed as gated XNOR networks (GXNOR-Nets) since only the event of non-zero weight and non-zero activation enables the control gate to start the XNOR logic operations in the original binary networks. This promises the event-driven hardware design for efficient mobile intelligence. We achieve advanced performance compared with state-of-the-art algorithms. Furthermore, the computational sparsity
Learning of N-layers neural network
Directory of Open Access Journals (Sweden)
Vladimír Konečný
2005-01-01
Full Text Available In the last decade we can observe increasing number of applications based on the Artificial Intelligence that are designed to solve problems from different areas of human activity. The reason why there is so much interest in these technologies is that the classical way of solutions does not exist or these technologies are not suitable because of their robustness. They are often used in applications like Business Intelligence that enable to obtain useful information for high-quality decision-making and to increase competitive advantage.One of the most widespread tools for the Artificial Intelligence are the artificial neural networks. Their high advantage is relative simplicity and the possibility of self-learning based on set of pattern situations.For the learning phase is the most commonly used algorithm back-propagation error (BPE. The base of BPE is the method minima of error function representing the sum of squared errors on outputs of neural net, for all patterns of the learning set. However, while performing BPE and in the first usage, we can find out that it is necessary to complete the handling of the learning factor by suitable method. The stability of the learning process and the rate of convergence depend on the selected method. In the article there are derived two functions: one function for the learning process management by the relative great error function value and the second function when the value of error function approximates to global minimum.The aim of the article is to introduce the BPE algorithm in compact matrix form for multilayer neural networks, the derivation of the learning factor handling method and the presentation of the results.
International Nuclear Information System (INIS)
Chen Zengqiang; Li Xiang; Liu Zhongxin; Yuan Zhuzhi
2008-01-01
A novel neural adaptive controller is presented to effectively control multivariable nonlinear systems. The proposed neural controller has been successfully applied to the cross-direction deviation control system of a polymer film spread line, whose good performance has been verified with real-time running results
Indian Academy of Sciences (India)
In a computer system, for example, typical discrete events ... This project brought out a series of influential reports on Petri net theory in the mid and late ... Technology became a leading centre for Petri net research and from then on, Petri nets ...
DEFF Research Database (Denmark)
Prato, Carlo Giacomo; Gitelman, Victoria; Bekhor, Shlomo
2011-01-01
on 1,793 fatal traffic accidents occurred during the period between 2003 and 2006 and applies Kohonen and feed-forward back-propagation neural networks with the objective of extracting from the data typical patterns and relevant factors. Kohonen neural networks reveal five compelling accident patterns....... Feed-forward back-propagation neural networks indicate that sociodemographic characteristics of drivers and victims, accident location, and period of the day are extremely relevant factors. Accident patterns suggest that countermeasures are necessary for identified problems concerning mainly vulnerable...
Directory of Open Access Journals (Sweden)
Yusuf Dwi Santoso
2017-06-01
Full Text Available Kepribadian merupakan gambaran tingkah laku dari individu. Penerimaan teman sebaya merupakan penilaian individu bahwa dirinya diterima, didengar, diperhatikan, dihargai, serta dapat merasa aman dan nyaman saat bersama dengan teman-teman dengan umur yang sama. Kepribadian dan penerimaan teman sebaya penting untuk diketahui agar dapat mengenal potensi diri. Tes kepribadian merupakan salah satu sarana untuk mengetahui dan mengklasifikasikan kepribadian seseorang ke tipe kepribadian tertentu. Jaringan syaraf tiruan Backpropagation dapat digunakan untuk melakukan klasifikasi sebuah pola berdasarkan permasalahan tertentu seperti halnya dalam mengklasifikasi tipe kepribadian dan penerimaan teman sebaya seseorang. Sistem klasifikasi tipe kepribadian dan penerimaan teman sebaya menggunakan jaringan syaraf tiruan Backpropagation dapat digunakan untuk mengklasifikasi tipe kepribadian dan penerimaan teman sebaya seseorang ke dalam beberapa tipe yaitu introvert diterima, introvert ditolak, ekstrovert diterima dan ekstrovert ditolak berdasarkan sejumlah set pertanyaan yang menjadi alat ukur dalam penentuan kepribadian. Sistem klasifikasi tipe kepribadian dan penerimaan teman sebaya menggunakan jaringan syaraf tiruan Backpropagation menghasilkan arsitektur Backpropagation terbaik untuk klasifikasi kepribadian dan penerimaan teman sebaya pada saat menggunakan 1 hidden layer dengan 7 neuron, 10000 epoch, nilai target error 0.01 dan laju pembelajaran 0.1. Hasil eksperimen jaringan syaraf tiruan Backpropagation pada sistem ini menghasilkan rata-rata tingkat akurasi 98.75% dan tingkat error 1.25%.
A neural model for transient identification in dynamic processes with 'don't know' response
International Nuclear Information System (INIS)
Mol, Antonio C. de A.; Martinez, Aquilino S.; Schirru, Roberto
2003-01-01
This work presents an approach for neural network based transient identification which allows either dynamic identification or a 'don't know' response. The approach uses two 'jump' multilayer neural networks (NN) trained with the backpropagation algorithm. The 'jump' network is used because it is useful to dealing with very complex patterns, which is the case of the space of the state variables during some abnormal events. The first one is responsible for the dynamic identification. This NN uses, as input, a short set (in a moving time window) of recent measurements of each variable avoiding the necessity of using starting events. The other one is used to validate the instantaneous identification (from the first net) through the validation of each variable. This net is responsible for allowing the system to provide a 'don't know' response. In order to validate the method, a Nuclear Power Plant (NPP) transient identification problem comprising 15 postulated accidents, simulated for a pressurized water reactor (PWR), was proposed in the validation process it has been considered noisy data in order to evaluate the method robustness. Obtained results reveal the ability of the method in dealing with both dynamic identification of transients and correct 'don't know' response. Another important point studied in this work is that the system has shown to be independent of a trigger signal which indicates the beginning of the transient, thus making it robust in relation to this limitation
Benaouda, D.; Wadge, G.; Whitmarsh, R. B.; Rothwell, R. G.; MacLeod, C.
1999-02-01
In boreholes with partial or no core recovery, interpretations of lithology in the remainder of the hole are routinely attempted using data from downhole geophysical sensors. We present a practical neural net-based technique that greatly enhances lithological interpretation in holes with partial core recovery by using downhole data to train classifiers to give a global classification scheme for those parts of the borehole for which no core was retrieved. We describe the system and its underlying methods of data exploration, selection and classification, and present a typical example of the system in use. Although the technique is equally applicable to oil industry boreholes, we apply it here to an Ocean Drilling Program (ODP) borehole (Hole 792E, Izu-Bonin forearc, a mixture of volcaniclastic sandstones, conglomerates and claystones). The quantitative benefits of quality-control measures and different subsampling strategies are shown. Direct comparisons between a number of discriminant analysis methods and the use of neural networks with back-propagation of error are presented. The neural networks perform better than the discriminant analysis techniques both in terms of performance rates with test data sets (2-3 per cent better) and in qualitative correlation with non-depth-matched core. We illustrate with the Hole 792E data how vital it is to have a system that permits the number and membership of training classes to be changed as analysis proceeds. The initial classification for Hole 792E evolved from a five-class to a three-class and then to a four-class scheme with resultant classification performance rates for the back-propagation neural network method of 83, 84 and 93 per cent respectively.
Artificial neural networks in NDT
International Nuclear Information System (INIS)
Abdul Aziz Mohamed
2001-01-01
Artificial neural networks, simply known as neural networks, have attracted considerable interest in recent years largely because of a growing recognition of the potential of these computational paradigms as powerful alternative models to conventional pattern recognition or function approximation techniques. The neural networks approach is having a profound effect on almost all fields, and has been utilised in fields Where experimental inter-disciplinary work is being carried out. Being a multidisciplinary subject with a broad knowledge base, Nondestructive Testing (NDT) or Nondestructive Evaluation (NDE) is no exception. This paper explains typical applications of neural networks in NDT/NDE. Three promising types of neural networks are highlighted, namely, back-propagation, binary Hopfield and Kohonen's self-organising maps. (Author)
Energy Technology Data Exchange (ETDEWEB)
Nose Filho, Kenji; Araujo, Klayton A.M.; Maeda, Jorge L.Y.; Lotufo, Anna Diva P. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil)], Emails: kenjinose@yahoo.com.br, klayton_ama@hotmail.com, jorge-maeda@hotmail.com, annadiva@dee.feis.unesp.br
2009-07-01
This paper presents a development and implementation of a program to electrical load forecasting with data from a Brazilian electrical company, using four different architectures of neural networks of the MATLAB toolboxes: multilayer backpropagation gradient descendent with momentum, multilayer backpropagation Levenberg-Marquardt, adaptive network based fuzzy inference system and general regression neural network. The program presented a satisfactory performance, guaranteeing very good results. (author)
Back propagation and Monte Carlo algorithms for neural network computations
International Nuclear Information System (INIS)
Junczys, R.; Wit, R.
1996-01-01
Results of teaching procedures for neural network for two different algorithms are presented. The first one is based on the well known back-propagation technique, the second is an adopted version of the Monte Carlo global minimum seeking method. Combination of these two, different in nature, approaches provides promising results. (author) nature, approaches provides promising results. (author)
PEAK TRACKING WITH A NEURAL NETWORK FOR SPECTRAL RECOGNITION
COENEGRACHT, PMJ; METTING, HJ; VANLOO, EM; SNOEIJER, GJ; DOORNBOS, DA
1993-01-01
A peak tracking method based on a simulated feed-forward neural network with back-propagation is presented. The network uses the normalized UV spectra and peak areas measured in one chromatogram for peak recognition. It suffices to train the network with only one set of spectra recorded in one
Tests of track segment and vertex finding with neural networks
International Nuclear Information System (INIS)
Denby, B.; Lessner, E.; Lindsey, C.S.
1990-04-01
Feed forward neural networks have been trained, using back-propagation, to find the slopes of simulated track segments in a straw chamber and to find the vertex of tracks from both simulated and real events in a more conventional drift chamber geometry. Network architectures, training, and performance are presented. 12 refs., 7 figs
Recognition of decays of charged tracks with neural network techniques
International Nuclear Information System (INIS)
Stimpfl-Abele, G.
1991-01-01
We developed neural-network learning techniques for the recognition of decays of charged tracks using a feed-forward network with error back-propagation. Two completely different methods are described in detail and their efficiencies for several NN architectures are compared with conventional methods. Excellent results are obtained. (orig.)
DEFF Research Database (Denmark)
Savin, Andrej
2017-01-01
Repealing “net neutrality” in the US will have no bearing on Internet freedom or security there or anywhere else.......Repealing “net neutrality” in the US will have no bearing on Internet freedom or security there or anywhere else....
Directory of Open Access Journals (Sweden)
Jesús Salvador Velázquez-González
2015-01-01
Full Text Available Una de las complicaciones más graves de la Diabetes Mellitus tipo 2 es la Retinopatía Diabética (RD. La RD es una enfermedad silenciosa y solo es reconocida por el portador cuándo los cambios en la retina han progresado a un nivel en el cual el tratamiento se complica, por lo que el diagnóstico oportuno y la remisión al oftalmólogo u optometrista para el manejo de esta enfermedad pueden prevenir el 98% de la pérdida visual grave. El objetivo de este trabajo es identificar de manera automática la No Retinopatía Diabética (NRD y la Retinopatía de Fondo, utilizando imágenes del fondo de ojo. Nuestros resultados muestran una efectividad del 92%, con una sensitividad y especificidad del 95%.
Thompson, D. E.; Rajkumar, T.
2002-12-01
The San Francisco Bay Delta is a large hydrodynamic complex that incorporates the Sacramento and San Joaquin Estuaries, the Suisan Marsh, and the San Francisco Bay proper. Competition exists for the use of this extensive water system both from the fisheries industry, the agricultural industry, and from the marine and estuarine animal species within the Delta. As tidal fluctuations occur, more saline water pushes upstream allowing fish to migrate beyond the Suisan Marsh for breeding and habitat occupation. However, the agriculture industry does not want extensive salinity intrusion to impact water quality for human and plant consumption. The balance is regulated by pumping stations located along the estuaries and reservoirs whereby flushing of fresh water keeps the saline intrusion at bay. The pumping schedule is driven by data collected at various locations within the Bay Delta and by numerical models that predict the salinity intrusion as part of a larger model of the system. The Interagency Ecological Program (IEP) for the San Francisco Bay / Sacramento-San Joaquin Estuary collects, monitors, and archives the data, and the Department of Water Resources provides a numerical model simulation (DSM2) from which predictions are made that drive the pumping schedule. A problem with DSM2 is that the numerical simulation takes roughly 16 hours to complete a prediction. We have created a neural net, optimized with a genetic algorithm, that takes as input the archived data from multiple gauging stations and predicts stage, salinity, and flow at the Carquinez Straits (at the downstream end of the Suisan Marsh). This model seems to be robust in its predictions and operates much faster than the current numerical DSM2 model. Because the Bay-Delta is strongly tidally driven, we used both Principal Component Analysis and Fast Fourier Transforms to discover dominant features within the IEP data. We then filtered out the dominant tidal forcing to discover non-primary tidal effects
Fast Back-Propagation Learning Using Steep Activation Functions and Automatic Weight
Tai-Hoon Cho; Richard W. Conners; Philip A. Araman
1992-01-01
In this paper, several back-propagation (BP) learning speed-up algorithms that employ the Ã£gainÃ¤ parameter, i.e., steepness of the activation function, are examined. Simulations will show that increasing the gain seemingly increases the speed of convergence and that these algorithms can converge faster than the standard BP learning algorithm on some problems. However,...
Ma, Jianshe; Cai, Jinzhang; Lin, Guanyang; Chen, Huilin; Wang, Xianqin; Wang, Xianchuan; Hu, Lufeng
2014-05-15
Corynoxeine(CX), isolated from the extract of Uncaria rhynchophylla, is a useful and prospective compound in the prevention and treatment for vascular diseases. A simple and selective liquid chromatography mass spectrometry (LC-MS) method was developed to determine the concentration of CX in rat plasma. The chromatographic separation was achieved on a Zorbax SB-C18 (2.1 mm × 150 mm, 5 μm) column with acetonitrile-0.1% formic acid in water as mobile phase. Selective ion monitoring (SIM) mode was used for quantification using target ions m/z 383 for CX and m/z 237 for the carbamazepine (IS). After the LC-MS method was validated, it was applied to a back-propagation artificial neural network (BP-ANN) pharmacokinetic model study of CX in rats. The results showed that after intravenous administration of CX, it was mainly distributed in blood and eliminated quickly, t1/2 was less than 1h. The predicted concentrations generated by BP-ANN model had a high correlation coefficient (R>0.99) with experimental values. The developed BP-ANN pharmacokinetic model can be used to predict the concentration of CX in rats. Copyright © 2014 Elsevier B.V. All rights reserved.
Tracking and vertex finding with drift chambers and neural networks
International Nuclear Information System (INIS)
Lindsey, C.
1991-09-01
Finding tracks, track vertices and event vertices with neural networks from drift chamber signals is discussed. Simulated feed-forward neural networks have been trained with back-propagation to give track parameters using Monte Carlo simulated tracks in one case and actual experimental data in another. Effects on network performance of limited weight resolution, noise and drift chamber resolution are given. Possible implementations in hardware are discussed. 7 refs., 10 figs
Indian Academy of Sciences (India)
GENERAL I ARTICLE ... In Part 1 of this two-part article, we have seen im- ..... mable logic controller and VLSI arrays, office automation systems, workflow management systems, ... complex discrete event and real-time systems; and Petri nets.
Yorek, Nurettin; Ugulu, Ilker
2015-01-01
In this study, artificial neural networks are suggested as a model that can be "trained" to yield qualitative results out of a huge amount of categorical data. It can be said that this is a new approach applied in educational qualitative data analysis. In this direction, a cascade-forward back-propagation neural network (CFBPN) model was…
Turkey's net energy consumption
International Nuclear Information System (INIS)
Soezen, Adnan; Arcaklioglu, Erol; Oezkaymak, Mehmet
2005-01-01
The main goal of this study is to develop the equations for forecasting net energy consumption (NEC) using an artificial neural-network (ANN) technique in order to determine the future level of energy consumption in Turkey. In this study, two different models were used in order to train the neural network. In one of them, population, gross generation, installed capacity and years are used in the input layer of the network (Model 1). Other energy sources are used in input layer of network (Model 2). The net energy consumption is in the output layer for two models. Data from 1975 to 2003 are used for the training. Three years (1981, 1994 and 2003) are used only as test data to confirm this method. The statistical coefficients of multiple determinations (R 2 -value) for training data are equal to 0.99944 and 0.99913 for Models 1 and 2, respectively. Similarly, R 2 values for testing data are equal to 0.997386 and 0.999558 for Models 1 and 2, respectively. According to the results, the net energy consumption using the ANN technique has been predicted with acceptable accuracy. Apart from reducing the whole time required, with the ANN approach, it is possible to find solutions that make energy applications more viable and thus more attractive to potential users. It is also expected that this study will be helpful in developing highly applicable energy policies
RANTAI PASOK BERAS PADA BULOG BERBASIS NEURAL NETWORK
Directory of Open Access Journals (Sweden)
Muhammad Imam Ghozali
2016-11-01
Full Text Available Sebagai lembaga terpenting dalam menjaga ketahanan pangan di Indonesia, perusahaan umum (Perum Badan urusan Logistik (BULOG sejak didirikannya memiliki tugas memasok bahan pangan, sehingga pengetahuan dan pengalaman BULOG dalam manajemen rantai pasok pangan dan hasil pertanian lainnya seyogianya dapat diandalkan. Namun BULOG belum teruji dalam perspektif masih menghadapi berbagai permasalahan yang sangat kompleks, yang muncul mulai dari masalah pasokan gabah di level petani, proses penggilingan gabah di level industri penggilingan (miller, hingga proses distribusi beras ke level konsumen. Dengan demikian, sebagai komoditas pangan utama, permasalahan beras bukan hanya merupakan permasalahan ekonomi saja tetapi juga bersifat politis. Data mining dapat membantu dalam memprediksi suatu sistem, sehingga dapat dilakukan pada penelitian ini agar prediksi lebih tepat dan akurat. Penelitian ini teknik yang dipakai ialah neural network backpropagation, ada beberapa tahap dalam peneilitian ini yaitu tahap pengumpulan data historik, pengolahan data, model atau metode yang diusulkan, eksperimen pada model tersebut, evaluasi dan validasi hasil. Pada hasil analisa menunjukan bahwa model ini mempunyai tingkat kesalahan atau error yang kecil atau didalam backpropagation sering disebut dengan mean square erorr (MSE. Disimpulkan bahwa teknik data mining menggunakan neural network backpropagation dapat menghasilkan suatu nilai error yang minimal sehingga tepat dan akurat untuk menentukan jumlah pasokan beras pada tahun berikutnya. Kata kunci: pasok beras, supply chain, data mining, neural network backpropagation, mean square erorr.
Stability Analysis of Neural Networks-Based System Identification
Directory of Open Access Journals (Sweden)
Talel Korkobi
2008-01-01
Full Text Available This paper treats some problems related to nonlinear systems identification. A stability analysis neural network model for identifying nonlinear dynamic systems is presented. A constrained adaptive stable backpropagation updating law is presented and used in the proposed identification approach. The proposed backpropagation training algorithm is modified to obtain an adaptive learning rate guarantying convergence stability. The proposed learning rule is the backpropagation algorithm under the condition that the learning rate belongs to a specified range defining the stability domain. Satisfying such condition, unstable phenomena during the learning process are avoided. A Lyapunov analysis leads to the computation of the expression of a convenient adaptive learning rate verifying the convergence stability criteria. Finally, the elaborated training algorithm is applied in several simulations. The results confirm the effectiveness of the CSBP algorithm.
Flanders, Jon
2008-01-01
RESTful .NET is the first book that teaches Windows developers to build RESTful web services using the latest Microsoft tools. Written by Windows Communication Foundation (WFC) expert Jon Flanders, this hands-on tutorial demonstrates how you can use WCF and other components of the .NET 3.5 Framework to build, deploy and use REST-based web services in a variety of application scenarios. RESTful architecture offers a simpler approach to building web services than SOAP, SOA, and the cumbersome WS- stack. And WCF has proven to be a flexible technology for building distributed systems not necessa
International Nuclear Information System (INIS)
Bramley, A.; Clabburn, R.J.T.
1976-01-01
A method is described for producing netting composed of longitudinal and transverse threads of irradiation cross linked thermoplastic material, the threads being joined together at their crossings by moulded masses of cross linked thermoplastic material. The thread may be formed of polyethylene filaments, subjected to a radiation dose of 15 to 25 MR. The moulding can be conducted at 245 0 to 260 0 C or higher. The product is claimed to be an improved quality of netting, with bonds of increased strength between crossing threads. (U.K.)
Parallel consensual neural networks.
Benediktsson, J A; Sveinsson, J R; Ersoy, O K; Swain, P H
1997-01-01
A new type of a neural-network architecture, the parallel consensual neural network (PCNN), is introduced and applied in classification/data fusion of multisource remote sensing and geographic data. The PCNN architecture is based on statistical consensus theory and involves using stage neural networks with transformed input data. The input data are transformed several times and the different transformed data are used as if they were independent inputs. The independent inputs are first classified using the stage neural networks. The output responses from the stage networks are then weighted and combined to make a consensual decision. In this paper, optimization methods are used in order to weight the outputs from the stage networks. Two approaches are proposed to compute the data transforms for the PCNN, one for binary data and another for analog data. The analog approach uses wavelet packets. The experimental results obtained with the proposed approach show that the PCNN outperforms both a conjugate-gradient backpropagation neural network and conventional statistical methods in terms of overall classification accuracy of test data.
Directory of Open Access Journals (Sweden)
Ali Thaeer Hammid
2018-03-01
Full Text Available In developing countries, the power production is properly less than the request of power or load, and sustaining a system stability of power production is a trouble quietly. Sometimes, there is a necessary development to the correct quantity of load demand to retain a system of power production steadily. Thus, Small Hydropower Plant (SHP includes a Kaplan turbine was verified to explore its applicability. This paper concentrates on applying on Artificial Neural Networks (ANNs by approaching of Feed-Forward, Back-Propagation to make performance predictions of the hydropower plant at the Himreen lake dam-Diyala in terms of net turbine head, flow rate of water and power production that data gathered during a research over a 10 year period. The model studies the uncertainties of inputs and output operation and there's a designing to network structure and then trained by means of the entire of 3570 experimental and observed data. Furthermore, ANN offers an analyzing and diagnosing instrument effectively to model performance of the nonlinear plant. The study suggests that the ANN may predict the performance of the plant with a correlation coefficient (R between the variables of predicted and observed output that would be higher than 0.96. Keywords: Himreen Lake Dam, Small Hydropower plants, Artificial Neural Networks, Feed forward-back propagation model, Generation system's prediction
Neural networks for aircraft control
Linse, Dennis
1990-01-01
Current research in Artificial Neural Networks indicates that networks offer some potential advantages in adaptation and fault tolerance. This research is directed at determining the possible applicability of neural networks to aircraft control. The first application will be to aircraft trim. Neural network node characteristics, network topology and operation, neural network learning and example histories using neighboring optimal control with a neural net are discussed.
Indian Academy of Sciences (India)
Home; Journals; Resonance – Journal of Science Education; Volume 4; Issue 9. Petri Nets - Applications. Y Narahari. General Article Volume 4 Issue 9 September 1999 pp 44-52 ... Author Affiliations. Y Narahari1. Department of Computer Science and Automation, Indian Institute of Science, Bangalore 560 012, India.
International Development Research Centre (IDRC) Digital Library (Canada)
Describing the effect of tax incentives for import, production, and sale of nets and insecticides; and ..... So far, China is the only country where a system for the routine treatment of ...... 1993), and the trials in Ecuador and Peru (Kroeger et al.
Signal Processing and Neural Network Simulator
Tebbe, Dennis L.; Billhartz, Thomas J.; Doner, John R.; Kraft, Timothy T.
1995-04-01
The signal processing and neural network simulator (SPANNS) is a digital signal processing simulator with the capability to invoke neural networks into signal processing chains. This is a generic tool which will greatly facilitate the design and simulation of systems with embedded neural networks. The SPANNS is based on the Signal Processing WorkSystemTM (SPWTM), a commercial-off-the-shelf signal processing simulator. SPW provides a block diagram approach to constructing signal processing simulations. Neural network paradigms implemented in the SPANNS include Backpropagation, Kohonen Feature Map, Outstar, Fully Recurrent, Adaptive Resonance Theory 1, 2, & 3, and Brain State in a Box. The SPANNS was developed by integrating SAIC's Industrial Strength Neural Networks (ISNN) Software into SPW.
DEFF Research Database (Denmark)
de Souza e Silva, Adriana Araujo; Gordon, Eric
Provides an introduction to the new theory of Net Locality and the profound effect on individuals and societies when everything is located or locatable. Describes net locality as an emerging form of location awareness central to all aspects of digital media, from mobile phones, to Google Maps......, to location-based social networks and games, such as Foursquare and facebook. Warns of the threats these technologies, such as data surveillance, present to our sense of privacy, while also outlining the opportunities for pro-social developments. Provides a theory of the web in the context of the history...... of emerging technologies, from GeoCities to GPS, Wi-Fi, Wiki Me, and Google Android....
Unlearning in feed-forward multi-nets
Spaanenburg, L; Kurkova,; Steele, NC; Neruda, R; Karny, M
2001-01-01
Multi-nets promise an improved performance over monolithic neural networks by virtue of their distributed implementation. Modular neural networks are multi-nets based on an judicious assembly of functionally different parts. This can be viewed as again a monolithic network, but with more complex
Introduction to neural networks
International Nuclear Information System (INIS)
Pavlopoulos, P.
1996-01-01
This lecture is a presentation of today's research in neural computation. Neural computation is inspired by knowledge from neuro-science. It draws its methods in large degree from statistical physics and its potential applications lie mainly in computer science and engineering. Neural networks models are algorithms for cognitive tasks, such as learning and optimization, which are based on concepts derived from research into the nature of the brain. The lecture first gives an historical presentation of neural networks development and interest in performing complex tasks. Then, an exhaustive overview of data management and networks computation methods is given: the supervised learning and the associative memory problem, the capacity of networks, the Perceptron networks, the functional link networks, the Madaline (Multiple Adalines) networks, the back-propagation networks, the reduced coulomb energy (RCE) networks, the unsupervised learning and the competitive learning and vector quantization. An example of application in high energy physics is given with the trigger systems and track recognition system (track parametrization, event selection and particle identification) developed for the CPLEAR experiment detectors from the LEAR at CERN. (J.S.). 56 refs., 20 figs., 1 tab., 1 appendix
Energy Technology Data Exchange (ETDEWEB)
Labrador, I.; Carrasco, R.; Martinez, L.
1996-07-01
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs.
International Nuclear Information System (INIS)
Labrador, I.; Carrasco, R.; Martinez, L.
1996-01-01
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs
Analog design of a new neural network for optical character recognition.
Morns, I P; Dlay, S S
1999-01-01
An electronic circuit is presented for a new type of neural network, which gives a recognition rate of over 100 kHz. The network is used to classify handwritten numerals, presented as Fourier and wavelet descriptors, and has been shown to train far quicker than the popular backpropagation network while maintaining classification accuracy.
Internal measuring models in trained neural networks for parameter estimation from images
Feng, Tian-Jin; Feng, T.J.; Houkes, Z.; Korsten, Maarten J.; Spreeuwers, Lieuwe Jan
1992-01-01
The internal representations of 'learned' knowledge in neural networks are still poorly understood, even for backpropagation networks. The paper discusses a possible interpretation of learned knowledge of a network trained for parameter estimation from images. The outputs of the hidden layer are the
Learning behavior and temporary minima of two-layer neural networks
Annema, Anne J.; Hoen, Klaas; Hoen, Klaas; Wallinga, Hans
1994-01-01
This paper presents a mathematical analysis of the occurrence of temporary minima during training of a single-output, two-layer neural network, with learning according to the back-propagation algorithm. A new vector decomposition method is introduced, which simplifies the mathematical analysis of
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving...
DEFF Research Database (Denmark)
Bhowmik, Subrata; Weber, Felix; Høgsberg, Jan Becker
2013-01-01
This paper presents a systematic design and training procedure for the feed-forward backpropagation neural network (NN) modeling of both forward and inverse behavior of a rotary magnetorheological (MR) damper based on experimental data. For the forward damper model, with damper force as output...
Advances in Artificial Neural Networks – Methodological Development and Application
Directory of Open Access Journals (Sweden)
Yanbo Huang
2009-08-01
Full Text Available Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other networks such as radial basis function, recurrent network, feedback network, and unsupervised Kohonen self-organizing network. These networks, especially the multilayer perceptron network with a backpropagation training algorithm, have gained recognition in research and applications in various scientific and engineering areas. In order to accelerate the training process and overcome data over-fitting, research has been conducted to improve the backpropagation algorithm. Further, artificial neural networks have been integrated with other advanced methods such as fuzzy logic and wavelet analysis, to enhance the ability of data interpretation and modeling and to avoid subjectivity in the operation of the training algorithm. In recent years, support vector machines have emerged as a set of high-performance supervised generalized linear classifiers in parallel with artificial neural networks. A review on development history of artificial neural networks is presented and the standard architectures and algorithms of artificial neural networks are described. Furthermore, advanced artificial neural networks will be introduced with support vector machines, and limitations of ANNs will be identified. The future of artificial neural network development in tandem with support vector machines will be discussed in conjunction with further applications to food science and engineering, soil and water relationship for crop management, and decision support for precision agriculture. Along with the network structures and training algorithms, the applications of artificial neural networks will be reviewed as well, especially in the fields of agricultural and biological
Control of beam halo-chaos using neural network self-adaptation method
International Nuclear Information System (INIS)
Fang Jinqing; Huang Guoxian; Luo Xiaoshu
2004-11-01
Taking the advantages of neural network control method for nonlinear complex systems, control of beam halo-chaos in the periodic focusing channels (network) of high intensity accelerators is studied by feed-forward back-propagating neural network self-adaptation method. The envelope radius of high-intensity proton beam is reached to the matching beam radius by suitably selecting the control structure of neural network and the linear feedback coefficient, adjusted the right-coefficient of neural network. The beam halo-chaos is obviously suppressed and shaking size is much largely reduced after the neural network self-adaptation control is applied. (authors)
Wisesty, Untari N.; Warastri, Riris S.; Puspitasari, Shinta Y.
2018-03-01
Cancer is one of the major causes of mordibility and mortality problems in the worldwide. Therefore, the need of a system that can analyze and identify a person suffering from a cancer by using microarray data derived from the patient’s Deoxyribonucleic Acid (DNA). But on microarray data has thousands of attributes, thus making the challenges in data processing. This is often referred to as the curse of dimensionality. Therefore, in this study built a system capable of detecting a patient whether contracted cancer or not. The algorithm used is Genetic Algorithm as feature selection and Momentum Backpropagation Neural Network as a classification method, with data used from the Kent Ridge Bio-medical Dataset. Based on system testing that has been done, the system can detect Leukemia and Colon Tumor with best accuracy equal to 98.33% for colon tumor data and 100% for leukimia data. Genetic Algorithm as feature selection algorithm can improve system accuracy, which is from 64.52% to 98.33% for colon tumor data and 65.28% to 100% for leukemia data, and the use of momentum parameters can accelerate the convergence of the system in the training process of Neural Network.
Experiments in Neural-Network Control of a Free-Flying Space Robot
Wilson, Edward
1995-01-01
Four important generic issues are identified and addressed in some depth in this thesis as part of the development of an adaptive neural network based control system for an experimental free flying space robot prototype. The first issue concerns the importance of true system level design of the control system. A new hybrid strategy is developed here, in depth, for the beneficial integration of neural networks into the total control system. A second important issue in neural network control concerns incorporating a priori knowledge into the neural network. In many applications, it is possible to get a reasonably accurate controller using conventional means. If this prior information is used purposefully to provide a starting point for the optimizing capabilities of the neural network, it can provide much faster initial learning. In a step towards addressing this issue, a new generic Fully Connected Architecture (FCA) is developed for use with backpropagation. A third issue is that neural networks are commonly trained using a gradient based optimization method such as backpropagation; but many real world systems have Discrete Valued Functions (DVFs) that do not permit gradient based optimization. One example is the on-off thrusters that are common on spacecraft. A new technique is developed here that now extends backpropagation learning for use with DVFs. The fourth issue is that the speed of adaptation is often a limiting factor in the implementation of a neural network control system. This issue has been strongly resolved in the research by drawing on the above new contributions.
Bramhe, V. S.; Ghosh, S. K.; Garg, P. K.
2018-04-01
With rapid globalization, the extent of built-up areas is continuously increasing. Extraction of features for classifying built-up areas that are more robust and abstract is a leading research topic from past many years. Although, various studies have been carried out where spatial information along with spectral features has been utilized to enhance the accuracy of classification. Still, these feature extraction techniques require a large number of user-specific parameters and generally application specific. On the other hand, recently introduced Deep Learning (DL) techniques requires less number of parameters to represent more abstract aspects of the data without any manual effort. Since, it is difficult to acquire high-resolution datasets for applications that require large scale monitoring of areas. Therefore, in this study Sentinel-2 image has been used for built-up areas extraction. In this work, pre-trained Convolutional Neural Networks (ConvNets) i.e. Inception v3 and VGGNet are employed for transfer learning. Since these networks are trained on generic images of ImageNet dataset which are having very different characteristics from satellite images. Therefore, weights of networks are fine-tuned using data derived from Sentinel-2 images. To compare the accuracies with existing shallow networks, two state of art classifiers i.e. Gaussian Support Vector Machine (SVM) and Back-Propagation Neural Network (BP-NN) are also implemented. Both SVM and BP-NN gives 84.31 % and 82.86 % overall accuracies respectively. Inception-v3 and VGGNet gives 89.43 % of overall accuracy using fine-tuned VGGNet and 92.10 % when using Inception-v3. The results indicate high accuracy of proposed fine-tuned ConvNets on a 4-channel Sentinel-2 dataset for built-up area extraction.
Directory of Open Access Journals (Sweden)
V. S. Bramhe
2018-04-01
Full Text Available With rapid globalization, the extent of built-up areas is continuously increasing. Extraction of features for classifying built-up areas that are more robust and abstract is a leading research topic from past many years. Although, various studies have been carried out where spatial information along with spectral features has been utilized to enhance the accuracy of classification. Still, these feature extraction techniques require a large number of user-specific parameters and generally application specific. On the other hand, recently introduced Deep Learning (DL techniques requires less number of parameters to represent more abstract aspects of the data without any manual effort. Since, it is difficult to acquire high-resolution datasets for applications that require large scale monitoring of areas. Therefore, in this study Sentinel-2 image has been used for built-up areas extraction. In this work, pre-trained Convolutional Neural Networks (ConvNets i.e. Inception v3 and VGGNet are employed for transfer learning. Since these networks are trained on generic images of ImageNet dataset which are having very different characteristics from satellite images. Therefore, weights of networks are fine-tuned using data derived from Sentinel-2 images. To compare the accuracies with existing shallow networks, two state of art classifiers i.e. Gaussian Support Vector Machine (SVM and Back-Propagation Neural Network (BP-NN are also implemented. Both SVM and BP-NN gives 84.31 % and 82.86 % overall accuracies respectively. Inception-v3 and VGGNet gives 89.43 % of overall accuracy using fine-tuned VGGNet and 92.10 % when using Inception-v3. The results indicate high accuracy of proposed fine-tuned ConvNets on a 4-channel Sentinel-2 dataset for built-up area extraction.
Zhou, Wen-Liang; Yan, Ping; Wuskell, Joseph P; Loew, Leslie M; Antic, Srdjan D
2008-02-01
Basal dendrites of neocortical pyramidal neurons are relatively short and directly attached to the cell body. This allows electrical signals arising in basal dendrites to strongly influence the neuronal output. Likewise, somatic action potentials (APs) should readily propagate back into the basilar dendritic tree to influence synaptic plasticity. Two recent studies, however, determined that sodium APs are severely attenuated in basal dendrites of cortical pyramidal cells, so that they completely fail in distal dendritic segments. Here we used the latest improvements in the voltage-sensitive dye imaging technique (Zhou et al., 2007) to study AP backpropagation in basal dendrites of layer 5 pyramidal neurons of the rat prefrontal cortex. With a signal-to-noise ratio of > 15 and minimal temporal averaging (only four sweeps) we were able to sample AP waveforms from the very last segments of individual dendritic branches (dendritic tips). We found that in short- (< 150 microm) and medium (150-200 microm in length)-range basal dendrites APs backpropagated with modest changes in AP half-width or AP rise-time. The lack of substantial changes in AP shape and dynamics of rise is inconsistent with the AP-failure model. The lack of substantial amplitude boosting of the third AP in the high-frequency burst also suggests that in short- and medium-range basal dendrites backpropagating APs were not severely attenuated. Our results show that the AP-failure concept does not apply in all basal dendrites of the rat prefrontal cortex. The majority of synaptic contacts in the basilar dendritic tree actually received significant AP-associated electrical and calcium transients.
Gain and exposure scheduling to compensate for photorefractive neural-network weight decay
Goldstein, Adam A.; Petrisor, Gregory C.; Jenkins, B. Keith
1995-03-01
A gain and exposure schedule that theoretically eliminates the effect of photorefractive weight decay for the general class of outer-product neural-network learning algorithms (e.g., backpropagation, Widrow-Hoff, perceptron) is presented. This schedule compensates for photorefractive diffraction-efficiency decay by iteratively increasing the spatial-light-modulator transfer function gain and decreasing the weight-update exposure time. Simulation results for the scheduling procedure, as applied to backpropagation learning for the exclusive-OR problem, show improved learning performance compared with results for networks trained without scheduling.
Artificial neural networks for plasma spectroscopy analysis
International Nuclear Information System (INIS)
Morgan, W.L.; Larsen, J.T.; Goldstein, W.H.
1992-01-01
Artificial neural networks have been applied to a variety of signal processing and image recognition problems. Of the several common neural models the feed-forward, back-propagation network is well suited for the analysis of scientific laboratory data, which can be viewed as a pattern recognition problem. The authors present a discussion of the basic neural network concepts and illustrate its potential for analysis of experiments by applying it to the spectra of laser produced plasmas in order to obtain estimates of electron temperatures and densities. Although these are high temperature and density plasmas, the neural network technique may be of interest in the analysis of the low temperature and density plasmas characteristic of experiments and devices in gaseous electronics
Directory of Open Access Journals (Sweden)
Farahnaz SADOUGHI
2014-03-01
Full Text Available Breast cancer is the most commonly diagnosed cancer and the most common cause of death in women all over the world. Use of computer technology supporting breast cancer diagnosing is now widespread and pervasive across a broad range of medical areas. Early diagnosis of this disease can greatly enhance the chances of long-term survival of breast cancer victims. Artificial Neural Networks (ANN as mainly method play important role in early diagnoses breast cancer. This paper studies Levenberg Marquardet Backpropagation (LMBP neural network and Levenberg Marquardet Backpropagation based Particle Swarm Optimization(LMBP-PSO for the diagnosis of breast cancer. The obtained results show that LMBP and LMBP based PSO system provides higher classification efficiency. But LMBP based PSO needs minimum training and testing time. It helps in developing Medical Decision System (MDS for breast cancer diagnosing. It can also be used as secondary observer in clinical decision making.
Li, Zhong; Liu, Ming-de; Ji, Shou-xiang
2016-03-01
The Fourier Transform Infrared Spectroscopy (FTIR) is established to find the geographic origins of Chinese wolfberry quickly. In the paper, the 45 samples of Chinese wolfberry from different places of Qinghai Province are to be surveyed by FTIR. The original data matrix of FTIR is pretreated with common preprocessing and wavelet transform. Compared with common windows shifting smoothing preprocessing, standard normal variation correction and multiplicative scatter correction, wavelet transform is an effective spectrum data preprocessing method. Before establishing model through the artificial neural networks, the spectra variables are compressed by means of the wavelet transformation so as to enhance the training speed of the artificial neural networks, and at the same time the related parameters of the artificial neural networks model are also discussed in detail. The survey shows even if the infrared spectroscopy data is compressed to 1/8 of its original data, the spectral information and analytical accuracy are not deteriorated. The compressed spectra variables are used for modeling parameters of the backpropagation artificial neural network (BP-ANN) model and the geographic origins of Chinese wolfberry are used for parameters of export. Three layers of neural network model are built to predict the 10 unknown samples by using the MATLAB neural network toolbox design error back propagation network. The number of hidden layer neurons is 5, and the number of output layer neuron is 1. The transfer function of hidden layer is tansig, while the transfer function of output layer is purelin. Network training function is trainl and the learning function of weights and thresholds is learngdm. net. trainParam. epochs=1 000, while net. trainParam. goal = 0.001. The recognition rate of 100% is to be achieved. It can be concluded that the method is quite suitable for the quick discrimination of producing areas of Chinese wolfberry. The infrared spectral analysis technology
A novel approach to error function minimization for feedforward neural networks
International Nuclear Information System (INIS)
Sinkus, R.
1995-01-01
Feedforward neural networks with error backpropagation are widely applied to pattern recognition. One general problem encountered with this type of neural networks is the uncertainty, whether the minimization procedure has converged to a global minimum of the cost function. To overcome this problem a novel approach to minimize the error function is presented. It allows to monitor the approach to the global minimum and as an outcome several ambiguities related to the choice of free parameters of the minimization procedure are removed. (orig.)
Control of GMA Butt Joint Welding Based on Neural Networks
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2004-01-01
This paper presents results from an experimentally based research on Gas Metal Arc Welding (GMAW), controlled by the artificial neural network (ANN) technology. A system has been developed for modeling and online adjustment of welding parameters, appropriate to guarantee a high degree of quality......-linear least square error minimization, has been used with the back-propagation algorithm for training the network, while a Bayesian regularization technique has been successfully applied for minimizing the risk of inexpedient over-training....
STUDY COMPARISON OF SVM-, K-NN- AND BACKPROPAGATION-BASED CLASSIFIER FOR IMAGE RETRIEVAL
Directory of Open Access Journals (Sweden)
Muhammad Athoillah
2015-03-01
Full Text Available Classification is a method for compiling data systematically according to the rules that have been set previously. In recent years classification method has been proven to help many peopleâ€™s work, such as image classification, medical biology, traffic light, text classification etc. There are many methods to solve classification problem. This variation method makes the researchers find it difficult to determine which method is best for a problem. This framework is aimed to compare the ability of classification methods, such as Support Vector Machine (SVM, K-Nearest Neighbor (K-NN, and Backpropagation, especially in study cases of image retrieval with five category of image dataset. The result shows that K-NN has the best average result in accuracy with 82%. It is also the fastest in average computation time with 17,99 second during retrieve session for all categories class. The Backpropagation, however, is the slowest among three of them. In average it needed 883 second for training session and 41,7 second for retrieve session.
An adaptable Boolean net trainable to control a computing robot
International Nuclear Information System (INIS)
Lauria, F. E.; Prevete, R.; Milo, M.; Visco, S.
1999-01-01
We discuss a method to implement in a Boolean neural network a Hebbian rule so to obtain an adaptable universal control system. We start by presenting both the Boolean neural net and the Hebbian rule we have considered. Then we discuss, first, the problems arising when the latter is naively implemented in a Boolean neural net, second, the method consenting us to overcome them and the ensuing adaptable Boolean neural net paradigm. Next, we present the adaptable Boolean neural net as an intelligent control system, actually controlling a writing robot, and discuss how to train it in the execution of the elementary arithmetic operations on operands represented by numerals with an arbitrary number of digits
Chen, Chau-Kuang
2010-01-01
Artificial Neural Network (ANN) and Support Vector Machine (SVM) approaches have been on the cutting edge of science and technology for pattern recognition and data classification. In the ANN model, classification accuracy can be achieved by using the feed-forward of inputs, back-propagation of errors, and the adjustment of connection weights. In…
2016-09-15
Requirements for the Degree of Doctor of Philosophy in Operations Research Michael P. Gibb, B.S., M.S. Captain, USAF September 2016 DISTRIBUTION...Bidstrup, P. Kohl, and G. May. Modeling the properties of PECVD silicon dioxide films using optimized back-propagation neural networks. IEEE Trans
Tang, S. Y.; Lee, J. S.; Loh, S. P.; Tham, H. J.
2017-06-01
The objectives of this study were to use Artificial Neural Network (ANN) to predict colour change, shrinkage and texture of osmotically dehydrated pumpkin slices. The effects of process variables such as concentration of osmotic solution, immersion temperature and immersion time on the above mentioned physical properties were studied. The colour of the samples was measured using a colorimeter and the net colour difference changes, ΔE were determined. The texture was measured in terms of hardness by using a Texture Analyzer. As for the shrinkage, displacement of volume method was applied and percentage of shrinkage was obtained in terms of volume changes. A feed-forward backpropagation network with sigmoidal function was developed and best network configuration was chosen based on the highest correlation coefficients between the experimental values versus predicted values. As a comparison, Response Surface Methodology (RSM) statistical analysis was also employed. The performances of both RSM and ANN modelling were evaluated based on absolute average deviation (AAD), correlation of determination (R2) and root mean square error (RMSE). The results showed that ANN has higher prediction capability as compared to RSM. The relative importance of the variables on the physical properties were also determined by using connection weight approach in ANN. It was found that solution concentration showed the highest influence on all three physical properties.
International Nuclear Information System (INIS)
Cheon, Se Woo; Kim, Wan Joo; Chang, Soon Heung; Roh, Myung Sub
1991-01-01
The Back-propagation Neural Network (BPN) algorithm is applied to connectionist expert system for the identification of BWR transients. Several powerful features of neural network-based expert systems over traditional rule-based expert systems are described. The general mapping capability of the neural networks enables to identify transients easily. A number of case studies were performed with emphasis on the applicability of the neural networks to the diagnostic domain. It is revealed that the BPN algorithm can identify transients properly, even when incomplete or untrained symptoms are given. It is also shown that multiple transients are easily identified
Neural network signal understanding for instrumentation
DEFF Research Database (Denmark)
Pau, L. F.; Johansen, F. S.
1990-01-01
understanding research is surveyed, and the selected implementation and its performance in terms of correct classification rates and robustness to noise are described. Formal results on neural net training time and sensitivity to weights are given. A theory for neural control using functional link nets is given...
Computationally Efficient Neural Network Intrusion Security Awareness
Energy Technology Data Exchange (ETDEWEB)
Todd Vollmer; Milos Manic
2009-08-01
An enhanced version of an algorithm to provide anomaly based intrusion detection alerts for cyber security state awareness is detailed. A unique aspect is the training of an error back-propagation neural network with intrusion detection rule features to provide a recognition basis. Network packet details are subsequently provided to the trained network to produce a classification. This leverages rule knowledge sets to produce classifications for anomaly based systems. Several test cases executed on ICMP protocol revealed a 60% identification rate of true positives. This rate matched the previous work, but 70% less memory was used and the run time was reduced to less than 1 second from 37 seconds.
Deep learning in neural networks: an overview.
Schmidhuber, Jürgen
2015-01-01
In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarizes relevant work, much of it from the previous millennium. Shallow and Deep Learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. I review deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
Reconstruction of periodic signals using neural networks
Directory of Open Access Journals (Sweden)
José Danilo Rairán Antolines
2014-01-01
Full Text Available In this paper, we reconstruct a periodic signal by using two neural networks. The first network is trained to approximate the period of a signal, and the second network estimates the corresponding coefficients of the signal's Fourier expansion. The reconstruction strategy consists in minimizing the mean-square error via backpro-pagation algorithms over a single neuron with a sine transfer function. Additionally, this paper presents mathematical proof about the quality of the approximation as well as a first modification of the algorithm, which requires less data to reach the same estimation; thus making the algorithm suitable for real-time implementations.
File access prediction using neural networks.
Patra, Prashanta Kumar; Sahu, Muktikanta; Mohapatra, Subasish; Samantray, Ronak Kumar
2010-06-01
One of the most vexing issues in design of a high-speed computer is the wide gap of access times between the memory and the disk. To solve this problem, static file access predictors have been used. In this paper, we propose dynamic file access predictors using neural networks to significantly improve upon the accuracy, success-per-reference, and effective-success-rate-per-reference by using neural-network-based file access predictor with proper tuning. In particular, we verified that the incorrect prediction has been reduced from 53.11% to 43.63% for the proposed neural network prediction method with a standard configuration than the recent popularity (RP) method. With manual tuning for each trace, we are able to improve upon the misprediction rate and effective-success-rate-per-reference using a standard configuration. Simulations on distributed file system (DFS) traces reveal that exact fit radial basis function (RBF) gives better prediction in high end system whereas multilayer perceptron (MLP) trained with Levenberg-Marquardt (LM) backpropagation outperforms in system having good computational capability. Probabilistic and competitive predictors are the most suitable for work stations having limited resources to deal with and the former predictor is more efficient than the latter for servers having maximum system calls. Finally, we conclude that MLP with LM backpropagation algorithm has better success rate of file prediction than those of simple perceptron, last successor, stable successor, and best k out of m predictors.
Autonomous path planning solution for industrial robot manipulator using backpropagation algorithm
Directory of Open Access Journals (Sweden)
PeiJiang Yuan
2015-12-01
Full Text Available Here, we propose an autonomous path planning solution using backpropagation algorithm. The mechanism of movement used by humans in controlling their arms is analyzed and then applied to control a robot manipulator. Autonomous path planning solution is a numerical method. The model of industrial robot manipulator used in this article is a KUKA KR 210 R2700 EXTRA robot. In order to show the performance of the autonomous path planning solution, an experiment validation of path tracking is provided. Experiment validation consists of implementation of the autonomous path planning solution and the control of physical robot. The process of converging to target solution is provided. The mean absolute error of position for tool center point is also analyzed. Comparison between autonomous path planning solution and the numerical methods based on Newton–Raphson algorithm is provided to demonstrate the efficiency and accuracy of the autonomous path planning solution.
A neural model for transient identification in dynamic processes with 'don't know' response
Energy Technology Data Exchange (ETDEWEB)
Mol, Antonio C. de A. E-mail: mol@ien.gov.br; Martinez, Aquilino S. E-mail: aquilino@lmp.ufrj.br; Schirru, Roberto E-mail: schirru@lmp.ufrj.br
2003-09-01
This work presents an approach for neural network based transient identification which allows either dynamic identification or a 'don't know' response. The approach uses two 'jump' multilayer neural networks (NN) trained with the backpropagation algorithm. The 'jump' network is used because it is useful to dealing with very complex patterns, which is the case of the space of the state variables during some abnormal events. The first one is responsible for the dynamic identification. This NN uses, as input, a short set (in a moving time window) of recent measurements of each variable avoiding the necessity of using starting events. The other one is used to validate the instantaneous identification (from the first net) through the validation of each variable. This net is responsible for allowing the system to provide a 'don't know' response. In order to validate the method, a Nuclear Power Plant (NPP) transient identification problem comprising 15 postulated accidents, simulated for a pressurized water reactor (PWR), was proposed in the validation process it has been considered noisy data in order to evaluate the method robustness. Obtained results reveal the ability of the method in dealing with both dynamic identification of transients and correct 'don't know' response. Another important point studied in this work is that the system has shown to be independent of a trigger signal which indicates the beginning of the transient, thus making it robust in relation to this limitation.
The gamma model : a new neural network for temporal processing
Vries, de B.
1992-01-01
In this paper we develop the gamma neural model, a new neural net architecture for processing of temporal patterns. Time varying patterns are normally segmented into a sequence of static patterns that are successively presented to a neural net. In the approach presented here segmentation is avoided.
Applying neural networks as software sensors for enzyme engineering.
Linko, S; Zhu, Y H; Linko, P
1999-04-01
The on-line control of enzyme-production processes is difficult, owing to the uncertainties typical of biological systems and to the lack of suitable on-line sensors for key process variables. For example, intelligent methods to predict the end point of fermentation could be of great economic value. Computer-assisted control based on artificial-neural-network models offers a novel solution in such situations. Well-trained feedforward-backpropagation neural networks can be used as software sensors in enzyme-process control; their performance can be affected by a number of factors.
Neural networks for sensor validation and plant monitoring
International Nuclear Information System (INIS)
Upadhyaya, B.R.; Eryurek, E.; Mathai, G.
1990-01-01
Sensor and process monitoring in power plants require the estimation of one or more process variables. Neural network paradigms are suitable for establishing general nonlinear relationships among a set of plant variables. Multiple-input multiple-output autoassociative networks can follow changes in plant-wide behavior. The backpropagation algorithm has been applied for training feedforward networks. A new and enhanced algorithm for training neural networks (BPN) has been developed and implemented in a VAX workstation. Operational data from the Experimental Breeder Reactor-II (EBR-II) have been used to study the performance of BPN. Several results of application to the EBR-II are presented
Enhanced online convolutional neural networks for object tracking
Zhang, Dengzhuo; Gao, Yun; Zhou, Hao; Li, Tianwen
2018-04-01
In recent several years, object tracking based on convolution neural network has gained more and more attention. The initialization and update of convolution filters can directly affect the precision of object tracking effective. In this paper, a novel object tracking via an enhanced online convolution neural network without offline training is proposed, which initializes the convolution filters by a k-means++ algorithm and updates the filters by an error back-propagation. The comparative experiments of 7 trackers on 15 challenging sequences showed that our tracker can perform better than other trackers in terms of AUC and precision.
Using Neural Networks to Predict the Hardness of Aluminum Alloys
Directory of Open Access Journals (Sweden)
B. Zahran
2015-02-01
Full Text Available Aluminum alloys have gained significant industrial importance being involved in many of the light and heavy industries and especially in aerospace engineering. The mechanical properties of aluminum alloys are defined by a number of principal microstructural features. Conventional mathematical models of these properties are sometimes very complex to be analytically calculated. In this paper, a neural network model is used to predict the correlations between the hardness of aluminum alloys in relation to certain alloying elements. A backpropagation neural network is trained using a thorough dataset. The impact of certain elements is documented and an optimum structure is proposed.
Inversion of a lateral log using neural networks
International Nuclear Information System (INIS)
Garcia, G.; Whitman, W.W.
1992-01-01
In this paper a technique using neural networks is demonstrated for the inversion of a lateral log. The lateral log is simulated by a finite difference method which in turn is used as an input to a backpropagation neural network. An initial guess earth model is generated from the neural network, which is then input to a Marquardt inversion. The neural network reacts to gross and subtle data features in actual logs and produces a response inferred from the knowledge stored in the network during a training process. The neural network inversion of lateral logs is tested on synthetic and field data. Tests using field data resulted in a final earth model whose simulated lateral is in good agreement with the actual log data
Artificial neural network based approach to transmission lines protection
International Nuclear Information System (INIS)
Joorabian, M.
1999-05-01
The aim of this paper is to present and accurate fault detection technique for high speed distance protection using artificial neural networks. The feed-forward multi-layer neural network with the use of supervised learning and the common training rule of error back-propagation is chosen for this study. Information available locally at the relay point is passed to a neural network in order for an assessment of the fault location to be made. However in practice there is a large amount of information available, and a feature extraction process is required to reduce the dimensionality of the pattern vectors, whilst retaining important information that distinguishes the fault point. The choice of features is critical to the performance of the neural networks learning and operation. A significant feature in this paper is that an artificial neural network has been designed and tested to enhance the precision of the adaptive capabilities for distance protection
Handwritten Javanese Character Recognition Using Several Artificial Neural Network Methods
Directory of Open Access Journals (Sweden)
Gregorius Satia Budhi
2015-07-01
Full Text Available Javanese characters are traditional characters that are used to write the Javanese language. The Javanese language is a language used by many people on the island of Java, Indonesia. The use of Javanese characters is diminishing more and more because of the difficulty of studying the Javanese characters themselves. The Javanese character set consists of basic characters, numbers, complementary characters, and so on. In this research we have developed a system to recognize Javanese characters. Input for the system is a digital image containing several handwritten Javanese characters. Preprocessing and segmentation are performed on the input image to get each character. For each character, feature extraction is done using the ICZ-ZCZ method. The output from feature extraction will become input for an artificial neural network. We used several artificial neural networks, namely a bidirectional associative memory network, a counterpropagation network, an evolutionary network, a backpropagation network, and a backpropagation network combined with chi2. From the experimental results it can be seen that the combination of chi2 and backpropagation achieved better recognition accuracy than the other methods.
DEFF Research Database (Denmark)
Jensen, Kurt
1987-01-01
The author describes a Petri net model, called coloured Petri nets (CP-nets), by means of which it is possible to describe large systems without having to cope with unnecessary details. The author introduces CP-nets and provide a first impression of their modeling power and the suitability...
Liberty, Jesse
2009-01-01
Learning Visual Basic .NET is a complete introduction to VB.NET and object-oriented programming. By using hundreds of examples, this book demonstrates how to develop various kinds of applications--including those that work with databases--and web services. Learning Visual Basic .NET will help you build a solid foundation in .NET.
Stochastic sensitivity analysis and Langevin simulation for neural network learning
International Nuclear Information System (INIS)
Koda, Masato
1997-01-01
A comprehensive theoretical framework is proposed for the learning of a class of gradient-type neural networks with an additive Gaussian white noise process. The study is based on stochastic sensitivity analysis techniques, and formal expressions are obtained for stochastic learning laws in terms of functional derivative sensitivity coefficients. The present method, based on Langevin simulation techniques, uses only the internal states of the network and ubiquitous noise to compute the learning information inherent in the stochastic correlation between noise signals and the performance functional. In particular, the method does not require the solution of adjoint equations of the back-propagation type. Thus, the present algorithm has the potential for efficiently learning network weights with significantly fewer computations. Application to an unfolded multi-layered network is described, and the results are compared with those obtained by using a back-propagation method
Nonlinear Time Series Prediction Using Chaotic Neural Networks
Li, Ke-Ping; Chen, Tian-Lun
2001-06-01
A nonlinear feedback term is introduced into the evaluation equation of weights of the backpropagation algorithm for neural network, the network becomes a chaotic one. For the purpose of that we can investigate how the different feedback terms affect the process of learning and forecasting, we use the model to forecast the nonlinear time series which is produced by Makey-Glass equation. By selecting the suitable feedback term, the system can escape from the local minima and converge to the global minimum or its approximate solutions, and the forecasting results are better than those of backpropagation algorithm. The project supported by National Basic Research Project "Nonlinear Science" and National Natural Science Foundation of China under Grant No. 60074020
Analysis of the experimental positron lifetime spectra by neural networks
International Nuclear Information System (INIS)
Avdic, S.; Chakarova, R.; Pazsit, I.
2003-01-01
This paper deals with the analysis of experimental positron lifetime spectra in polymer materials by using various algorithms of neural networks. A method based on the use of artificial neural networks for unfolding the mean lifetime and intensity of the spectral components of simulated positron lifetime spectra was previously suggested and tested on simulated data [Pazsit et al., Applied Surface Science, 149 (1998), 97]. In this work, the applicability of the method to the analysis of experimental positron spectra has been verified in the case of spectra from polymer materials with three components. It has been demonstrated that the backpropagation neural network can determine the spectral parameters with a high accuracy and perform the decomposition of lifetimes which differ by 10% or more. The backpropagation network has not been suitable for the identification of both the parameters and the number of spectral components. Therefore, a separate artificial neural network module has been designed to solve the classification problem. Module types based on self-organizing map and learning vector quantization algorithms have been tested. The learning vector quantization algorithm was found to have better performance and reliability. A complete artificial neural network analysis tool of positron lifetime spectra has been constructed to include a spectra classification module and parameter evaluation modules for spectra with a different number of components. In this way, both flexibility and high resolution can be achieved. (author)
A SIMULATION OF THE PENICILLIN G PRODUCTION BIOPROCESS APPLYING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
A.J.G. da Cruz
1997-12-01
Full Text Available The production of penicillin G by Penicillium chrysogenum IFO 8644 was simulated employing a feedforward neural network with three layers. The neural network training procedure used an algorithm combining two procedures: random search and backpropagation. The results of this approach were very promising, and it was observed that the neural network was able to accurately describe the nonlinear behavior of the process. Besides, the results showed that this technique can be successfully applied to control process algorithms due to its long processing time and its flexibility in the incorporation of new data
Heat transfer prediction in a square porous medium using artificial neural network
Ahamad, N. Ameer; Athani, Abdulgaphur; Badruddin, Irfan Anjum
2018-05-01
Heat transfer in porous media has been investigated extensively because of its applications in various important fields. Neural network approach is applied to analyze steady two dimensional free convection flows through a porous medium fixed in a square cavity. The backpropagation neural network is trained and used to predict the heat transfer. The results are compared with available information in the literature. It is found that the heat transfer increases with increase in Rayleigh number. It is further found that the local Nusselt number decreases along the height of cavity. The neural network is found to predict the heat transfer behavior accurately for given parameters.
Application of artificial neural network for heat transfer in porous cone
Athani, Abdulgaphur; Ahamad, N. Ameer; Badruddin, Irfan Anjum
2018-05-01
Heat transfer in porous medium is one of the classical areas of research that has been active for many decades. The heat transfer in porous medium is generally studied by using numerical methods such as finite element method; finite difference method etc. that solves coupled partial differential equations by converting them into simpler forms. The current work utilizes an alternate method known as artificial neural network that mimics the learning characteristics of neurons. The heat transfer in porous medium fixed in a cone is predicted using backpropagation neural network. The artificial neural network is able to predict this behavior quite accurately.
Forecasting the mortality rates of Indonesian population by using neural network
Safitri, Lutfiani; Mardiyati, Sri; Rahim, Hendrisman
2018-03-01
A model that can represent a problem is required in conducting a forecasting. One of the models that has been acknowledged by the actuary community in forecasting mortality rate is the Lee-Certer model. Lee Carter model supported by Neural Network will be used to calculate mortality forecasting in Indonesia. The type of Neural Network used is feedforward neural network aligned with backpropagation algorithm in python programming language. And the final result of this study is mortality rate in forecasting Indonesia for the next few years
Class of backpropagation techniques for limited-angle reconstruction in microwave tomography
International Nuclear Information System (INIS)
Paladhi, P. Roy; Tayebi, A.; Udpa, L.; Udpa, S.; Sinha, A.
2015-01-01
Filtered backpropagation (FBPP) is a well-known technique used in Diffraction Tomography (DT). For accurate reconstruction using FBPP, full 360° angular coverage is necessary. However, it has been shown that using some inherent redundancies in the projection data in a tomographic setup, accurate reconstruction is still possible with 270° coverage which is called the minimal-scan angle range. This can be done by applying weighing functions (or filters) on projection data of the object to eliminate the redundancies and accurately reconstruct the image from 270° coverage. This paper demonstrates procedures to generate many general classes of these weighing filters. These are all equivalent at 270° coverage but vary in performance at lower angular coverages and in presence of noise. This paper does a comparative analysis of different filters when angular coverage is lower than minimal-scan angle of 270°. Simulation studies have been done to find optimum weight filters for sub-minimal angular coverage (<270°)
Directory of Open Access Journals (Sweden)
Anne-Kathrin Theis
2018-04-01
Full Text Available The majority of excitatory synapses are located on dendritic spines of cortical glutamatergic neurons. In spines, compartmentalized Ca2+ signals transduce electrical activity into specific long-term biochemical and structural changes. Action potentials (APs propagate back into the dendritic tree and activate voltage gated Ca2+ channels (VGCCs. For spines, this global mode of spine Ca2+ signaling is a direct biochemical feedback of suprathreshold neuronal activity. We previously demonstrated that backpropagating action potentials (bAPs result in long-term enhancement of spine VGCCs. This activity-dependent VGCC plasticity results in a large interspine variability of VGCC Ca2+ influx. Here, we investigate how spine VGCCs affect glutamatergic synaptic transmission. We combined electrophysiology, two-photon Ca2+ imaging and two-photon glutamate uncaging in acute brain slices from rats. T- and R-type VGCCs were the dominant depolarization-associated Ca2+conductances in dendritic spines of excitatory layer 2 neurons and do not affect synaptic excitatory postsynaptic potentials (EPSPs measured at the soma. Using two-photon glutamate uncaging, we compared the properties of glutamatergic synapses of single spines that express different levels of VGCCs. While VGCCs contributed to EPSP mediated Ca2+ influx, the amount of EPSP mediated Ca2+ influx is not determined by spine VGCC expression. On a longer timescale, the activation of VGCCs by bAP bursts results in downregulation of spine NMDAR function.
Evolution of an artificial neural network based autonomous land vehicle controller.
Baluja, S
1996-01-01
This paper presents an evolutionary method for creating an artificial neural network based autonomous land vehicle controller. The evolved controllers perform better in unseen situations than those trained with an error backpropagation learning algorithm designed for this task. In this paper, an overview of the previous connectionist based approaches to this task is given, and the evolutionary algorithms used in this study are described in detail. Methods for reducing the high computational costs of training artificial neural networks with evolutionary algorithms are explored. Error metrics specific to the task of autonomous vehicle control are introduced; the evolutionary algorithms guided by these error metrics reveal improved performance over those guided by the standard sum-squared error metric. Finally, techniques for integrating evolutionary search and error backpropagation are presented. The evolved networks are designed to control Carnegie Mellon University's NAVLAB vehicles in road following tasks.
Representation of neutron noise data using neural networks
International Nuclear Information System (INIS)
Korsah, K.; Damiano, B.; Wood, R.T.
1992-01-01
This paper describes a neural network-based method of representing neutron noise spectra using a model developed at the Oak Ridge National Laboratory (ORNL). The backpropagation neural network learned to represent neutron noise data in terms of four descriptors, and the network response matched calculated values to within 3.5 percent. These preliminary results are encouraging, and further research is directed towards the application of neural networks in a diagnostics system for the identification of the causes of changes in structural spectral resonances. This work is part of our current investigation of advanced technologies such as expert systems and neural networks for neutron noise data reduction, analysis, and interpretation. The objective is to improve the state-of-the-art of noise analysis as a diagnostic tool for nuclear power plants and other mechanical systems
International Nuclear Information System (INIS)
Carberry, M
1996-01-01
The paper is about the planning of nets in areas of low density like it is the case of the rural areas. The author includes economic and technological aspects, planning of nets, demands and management among others
Annotating Coloured Petri Nets
DEFF Research Database (Denmark)
Lindstrøm, Bo; Wells, Lisa Marie
2002-01-01
Coloured Petri nets (CP-nets) can be used for several fundamentally different purposes like functional analysis, performance analysis, and visualisation. To be able to use the corresponding tool extensions and libraries it is sometimes necessary to include extra auxiliary information in the CP......-net. An example of such auxiliary information is a counter which is associated with a token to be able to do performance analysis. Modifying colour sets and arc inscriptions in a CP-net to support a specific use may lead to creation of several slightly different CP-nets – only to support the different uses...... of the same basic CP-net. One solution to this problem is that the auxiliary information is not integrated into colour sets and arc inscriptions of a CP-net, but is kept separately. This makes it easy to disable this auxiliary information if a CP-net is to be used for another purpose. This paper proposes...
Control of Three-Phase Grid-Connected Microgrids Using Artificial Neural Networks
Shuhui, L.; Fu, X.; Jaithwa, I.; Alonso, E.; Fairbank, M.; Wunsch, D. C.
2015-01-01
A microgrid consists of a variety of inverter-interfaced distributed energy resources (DERs). A key issue is how to control DERs within the microgrid and how to connect them to or disconnect them from the microgrid quickly. This paper presents a strategy for controlling inverter-interfaced DERs within a microgrid using an artificial neural network, which implements a dynamic programming algorithm and is trained with a new Levenberg-Marquardt backpropagation algorithm. Compared to conventional...
Tripathy, Manoj
2012-01-01
This paper describes a new approach for power transformer differential protection which is based on the wave-shape recognition technique. An algorithm based on neural network principal component analysis (NNPCA) with back-propagation learning is proposed for digital differential protection of power transformer. The principal component analysis is used to preprocess the data from power system in order to eliminate redundant information and enhance hidden pattern of differential current to disc...
Alternating optimization method based on nonnegative matrix factorizations for deep neural networks
Sakurai, Tetsuya; Imakura, Akira; Inoue, Yuto; Futamura, Yasunori
2016-01-01
The backpropagation algorithm for calculating gradients has been widely used in computation of weights for deep neural networks (DNNs). This method requires derivatives of objective functions and has some difficulties finding appropriate parameters such as learning rate. In this paper, we propose a novel approach for computing weight matrices of fully-connected DNNs by using two types of semi-nonnegative matrix factorizations (semi-NMFs). In this method, optimization processes are performed b...
Online Signature Verification using Recurrent Neural Network and Length-normalized Path Signature
Lai, Songxuan; Jin, Lianwen; Yang, Weixin
2017-01-01
Inspired by the great success of recurrent neural networks (RNNs) in sequential modeling, we introduce a novel RNN system to improve the performance of online signature verification. The training objective is to directly minimize intra-class variations and to push the distances between skilled forgeries and genuine samples above a given threshold. By back-propagating the training signals, our RNN network produced discriminative features with desired metrics. Additionally, we propose a novel d...
International Nuclear Information System (INIS)
Cadini, F.; Zio, E.; Pedroni, N.
2007-01-01
In this paper, a locally recurrent neural network (LRNN) is employed for approximating the temporal evolution of a nonlinear dynamic system model of a simplified nuclear reactor. To this aim, an infinite impulse response multi-layer perceptron (IIR-MLP) is trained according to a recursive back-propagation (RBP) algorithm. The network nodes contain internal feedback paths and their connections are realized by means of IIR synaptic filters, which provide the LRNN with the necessary system state memory
Control of a hybrid compensator in a power network by an artificial neural network
Directory of Open Access Journals (Sweden)
I. S. Shaw
1998-07-01
Full Text Available Increased interest in the elimination of distortion in electrical power networks has led to the development of various compensator topologies. The increasing cost of electrical energy necessitates the cost-effective operation of any of these topologies. This paper considers the development of an artificial neural network based controller, trained by means of the backpropagation method, that ensures the cost-effective operation of the hybrid compensator consisting of various converters and filters.
PREDIKSI BISNIS FOREX MENGGUNAKAN MODEL NEURAL NETWORK BERBASIS ADA BOOST MENGGUNAKAN 2047 DATA
Directory of Open Access Journals (Sweden)
Suyatno Suyatno
2016-11-01
Full Text Available Setelah melakukan penelitian dan percobaan maka didapatkan hasil penelitian pertama yang telah dilakukan dengan menggunakan Algoritma Neural Network Backpropagatioan dengan menggunakan data sebanyak 268 menunjungkan tingkat akurasi error prediksi pada waktu prediksi per 5 menit sebesar 0.758619403, bila menggunakan data sebanyak 2047 menunjukkan tingkat akurasi error prediksi sebesar 0.500161212 dan hasil penelitian kedua yang telah dilakukan menggunakan Algoritma Optimasi Adaboost pada proses trainning dan ditambah Neural Network Backpropagation pada proses learning menunjukkan tingkat akurasi error prediksi pada waktu prediksi per 5 menit menggunakan data sebanyak 268 sebesar 0.397014925, bila menggunakan data sebanyak 2047 menunjukkan tingkat akurasi error prediksi sebesar 0.099951148. Tahap awal dalam melakukan penelitian ini sampai dengan pengujian menggunakan perhitungan prediksi nilai akurasi error menggunakan rumus MSE (Mean Sequare Error dengan menggunakan algoritma optimasi adaboost untuk memberikan jawaban atas permasalahan bahwa nilai akurasi error Algoritma Neural Network Backpropagation perlu direndahkan agar akurasi prediksi meningkat dan tahap kedua dilakukan uji coba menggunakan data yang lebih banyak dibandingan dengan tahap ke satu. Berdasarkan hasil penelitian yang telah dilakukan, dapat disimpulkan bahwa Algoritma Neural Network memiliki akurasi yang lebih rendah bila dibandingkan dengan akurasi menggunakan metode optimasi adaboost pada proses trainning ditambah dengan Neural Network, ini dapat dilihat dengan rendahnya tingkat error MSE menggunakan metode adaboost + neural network dan dapat disimpukan pula bahwa dengan menggunakan jumlah data yang lebih banyak maka dapat menurunkan tingkat akurasi error MSE sehingga berhasil meningkatkan akurasi prediksi dalam bisnis forex trading. Kata kunci: forex, trading, neural network, adaboost, central capital futures.
Reliability analysis of C-130 turboprop engine components using artificial neural network
Qattan, Nizar A.
In this study, we predict the failure rate of Lockheed C-130 Engine Turbine. More than thirty years of local operational field data were used for failure rate prediction and validation. The Weibull regression model and the Artificial Neural Network model including (feed-forward back-propagation, radial basis neural network, and multilayer perceptron neural network model); will be utilized to perform this study. For this purpose, the thesis will be divided into five major parts. First part deals with Weibull regression model to predict the turbine general failure rate, and the rate of failures that require overhaul maintenance. The second part will cover the Artificial Neural Network (ANN) model utilizing the feed-forward back-propagation algorithm as a learning rule. The MATLAB package will be used in order to build and design a code to simulate the given data, the inputs to the neural network are the independent variables, the output is the general failure rate of the turbine, and the failures which required overhaul maintenance. In the third part we predict the general failure rate of the turbine and the failures which require overhaul maintenance, using radial basis neural network model on MATLAB tool box. In the fourth part we compare the predictions of the feed-forward back-propagation model, with that of Weibull regression model, and radial basis neural network model. The results show that the failure rate predicted by the feed-forward back-propagation artificial neural network model is closer in agreement with radial basis neural network model compared with the actual field-data, than the failure rate predicted by the Weibull model. By the end of the study, we forecast the general failure rate of the Lockheed C-130 Engine Turbine, the failures which required overhaul maintenance and six categorical failures using multilayer perceptron neural network (MLP) model on DTREG commercial software. The results also give an insight into the reliability of the engine
Fuzzy Neuroidal Nets and Recurrent Fuzzy Computations
Czech Academy of Sciences Publication Activity Database
Wiedermann, Jiří
2001-01-01
Roč. 11, č. 6 (2001), s. 675-686 ISSN 1210-0552. [SOFSEM 2001 Workshop on Soft Computing. Piešťany, 29.11.2001-30.11.2001] R&D Projects: GA ČR GA201/00/1489; GA AV ČR KSK1019101 Institutional research plan: AV0Z1030915 Keywords : fuzzy computing * fuzzy neural nets * fuzzy Turing machines * non-uniform computational complexity Subject RIV: BA - General Mathematics
Prototype-Incorporated Emotional Neural Network.
Oyedotun, Oyebade K; Khashman, Adnan
2017-08-15
Artificial neural networks (ANNs) aim to simulate the biological neural activities. Interestingly, many ''engineering'' prospects in ANN have relied on motivations from cognition and psychology studies. So far, two important learning theories that have been subject of active research are the prototype and adaptive learning theories. The learning rules employed for ANNs can be related to adaptive learning theory, where several examples of the different classes in a task are supplied to the network for adjusting internal parameters. Conversely, the prototype-learning theory uses prototypes (representative examples); usually, one prototype per class of the different classes contained in the task. These prototypes are supplied for systematic matching with new examples so that class association can be achieved. In this paper, we propose and implement a novel neural network algorithm based on modifying the emotional neural network (EmNN) model to unify the prototype- and adaptive-learning theories. We refer to our new model as ``prototype-incorporated EmNN''. Furthermore, we apply the proposed model to two real-life challenging tasks, namely, static hand-gesture recognition and face recognition, and compare the result to those obtained using the popular back-propagation neural network (BPNN), emotional BPNN (EmNN), deep networks, an exemplar classification model, and k-nearest neighbor.
Efficient Cancer Detection Using Multiple Neural Networks.
Shell, John; Gregory, William D
2017-01-01
The inspection of live excised tissue specimens to ascertain malignancy is a challenging task in dermatopathology and generally in histopathology. We introduce a portable desktop prototype device that provides highly accurate neural network classification of malignant and benign tissue. The handheld device collects 47 impedance data samples from 1 Hz to 32 MHz via tetrapolar blackened platinum electrodes. The data analysis was implemented with six different backpropagation neural networks (BNN). A data set consisting of 180 malignant and 180 benign breast tissue data files in an approved IRB study at the Aurora Medical Center, Milwaukee, WI, USA, were utilized as a neural network input. The BNN structure consisted of a multi-tiered consensus approach autonomously selecting four of six neural networks to determine a malignant or benign classification. The BNN analysis was then compared with the histology results with consistent sensitivity of 100% and a specificity of 100%. This implementation successfully relied solely on statistical variation between the benign and malignant impedance data and intricate neural network configuration. This device and BNN implementation provides a novel approach that could be a valuable tool to augment current medical practice assessment of the health of breast, squamous, and basal cell carcinoma and other excised tissue without requisite tissue specimen expertise. It has the potential to provide clinical management personnel with a fast non-invasive accurate assessment of biopsied or sectioned excised tissue in various clinical settings.
Fang, Hongqing; He, Lei; Si, Hao; Liu, Peng; Xie, Xiaolei
2014-09-01
In this paper, Back-propagation(BP) algorithm has been used to train the feed forward neural network for human activity recognition in smart home environments, and inter-class distance method for feature selection of observed motion sensor events is discussed and tested. And then, the human activity recognition performances of neural network using BP algorithm have been evaluated and compared with other probabilistic algorithms: Naïve Bayes(NB) classifier and Hidden Markov Model(HMM). The results show that different feature datasets yield different activity recognition accuracy. The selection of unsuitable feature datasets increases the computational complexity and degrades the activity recognition accuracy. Furthermore, neural network using BP algorithm has relatively better human activity recognition performances than NB classifier and HMM. Copyright © 2014 ISA. Published by Elsevier Ltd. All rights reserved.
Energy Technology Data Exchange (ETDEWEB)
Koenig, R W.T.; Von Hellermann, M [Commission of the European Communities, Abingdon (United Kingdom). JET Joint Undertaking; Svensson, J [Royal Inst. of Tech., Stockholm (Sweden)
1994-07-01
A back-propagation neural network technique is used at JET to extract plasma parameters like ion temperature, rotation velocities or spectral line intensities from charge exchange (CX) spectra. It is shown that in the case of the C VI CX spectra, neural networks can give a good estimation (better than +-20% accuracy) for the main plasma parameters (Ti, V{sub rot}). Since the neural network approach involves no iterations or initial guesses the speed with which a spectrum is processed is so high (0.2 ms/spectrum) that real time analysis will be achieved in the near future. 4 refs., 8 figs.
International Nuclear Information System (INIS)
Koenig, R.W.T.; Von Hellermann, M.
1994-01-01
A back-propagation neural network technique is used at JET to extract plasma parameters like ion temperature, rotation velocities or spectral line intensities from charge exchange (CX) spectra. It is shown that in the case of the C VI CX spectra, neural networks can give a good estimation (better than +-20% accuracy) for the main plasma parameters (Ti, V rot ). Since the neural network approach involves no iterations or initial guesses the speed with which a spectrum is processed is so high (0.2 ms/spectrum) that real time analysis will be achieved in the near future. 4 refs., 8 figs
International Nuclear Information System (INIS)
Finkelstein, D.
1989-01-01
The quantum net unifies the basic principles of quantum theory and relativity in a quantum spacetime having no ultraviolet infinities, supporting the Dirac equation, and having the usual vacuum as a quantum condensation. A correspondence principle connects nets to Schwinger sources and further unifies the vertical structure of the theory, so that the functions of the many hierarchic levels of quantum field theory (predicate algebra, set theory, topology,hor-ellipsis, quantum dynamics) are served by one in quantum net dynamics
The DSFPN, a new neural network for optical character recognition.
Morns, L P; Dlay, S S
1999-01-01
A new type of neural network for recognition tasks is presented in this paper. The network, called the dynamic supervised forward-propagation network (DSFPN), is based on the forward only version of the counterpropagation network (CPN). The DSFPN, trains using a supervised algorithm and can grow dynamically during training, allowing subclasses in the training data to be learnt in an unsupervised manner. It is shown to train in times comparable to the CPN while giving better classification accuracies than the popular backpropagation network. Both Fourier descriptors and wavelet descriptors are used for image preprocessing and the wavelets are proven to give a far better performance.
Intelligent Surveillance Robot with Obstacle Avoidance Capabilities Using Neural Network
Directory of Open Access Journals (Sweden)
Widodo Budiharto
2015-01-01
Full Text Available For specific purpose, vision-based surveillance robot that can be run autonomously and able to acquire images from its dynamic environment is very important, for example, in rescuing disaster victims in Indonesia. In this paper, we propose architecture for intelligent surveillance robot that is able to avoid obstacles using 3 ultrasonic distance sensors based on backpropagation neural network and a camera for face recognition. 2.4 GHz transmitter for transmitting video is used by the operator/user to direct the robot to the desired area. Results show the effectiveness of our method and we evaluate the performance of the system.
Fault Tolerant Neural Network for ECG Signal Classification Systems
Directory of Open Access Journals (Sweden)
MERAH, M.
2011-08-01
Full Text Available The aim of this paper is to apply a new robust hardware Artificial Neural Network (ANN for ECG classification systems. This ANN includes a penalization criterion which makes the performances in terms of robustness. Specifically, in this method, the ANN weights are normalized using the auto-prune method. Simulations performed on the MIT ? BIH ECG signals, have shown that significant robustness improvements are obtained regarding potential hardware artificial neuron failures. Moreover, we show that the proposed design achieves better generalization performances, compared to the standard back-propagation algorithm.
Application of neural computing paradigms for signal validation
International Nuclear Information System (INIS)
Upadhyaya, B.R.; Eryurek, E.; Mathai, G.
1989-01-01
Signal validation and process monitoring problems often require the prediction of one or more process variables in a system. The feasibility of applying neural network paradigms to relate one variable with a set of other related variables is studied. The backpropagation network (BPN) is applied to develop models of signals from both a commercial power plant and the EBR-II. Modification of the BPN algorithm is studied with emphasis on the speed of network training and the accuracy of prediction. The prediction of process variables in a Westinghouse PWR is presented in this paper
Supervised learning of probability distributions by neural networks
Baum, Eric B.; Wilczek, Frank
1988-01-01
Supervised learning algorithms for feedforward neural networks are investigated analytically. The back-propagation algorithm described by Werbos (1974), Parker (1985), and Rumelhart et al. (1986) is generalized by redefining the values of the input and output neurons as probabilities. The synaptic weights are then varied to follow gradients in the logarithm of likelihood rather than in the error. This modification is shown to provide a more rigorous theoretical basis for the algorithm and to permit more accurate predictions. A typical application involving a medical-diagnosis expert system is discussed.
Estimation of Solar Radiation using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Slamet Suprayogi
2004-01-01
Full Text Available The solar radiation is the most important fator affeccting evapotranspiration, the mechanism of transporting the vapor from the water surface has also a great effect. The main objectives of this study were to investigate the potential of using Artificial Neural Network (ANN to predict solar radiation related to temperature. The three-layer backpropagation were developed, trained, and tested to forecast solar radiation for Ciriung sub Cachment. Result revealed that the ANN were able to well learn the events they were trained to recognize. Moreover, they were capable of effecctively generalize their training by predicting solar radiation for sets unseen cases.
Directory of Open Access Journals (Sweden)
Edin TERZIC
2010-03-01
Full Text Available A measurement system has been developed using a single tube capacitive sensor to accurately determine the fluid level in vehicular fuel tanks. A novel approach based on artificial neural networks based signal pre-processing and classification has been described in this article. A broad investigation on the Backpropagation neural network and some selected signal pre-processing filters, namely, Moving Mean, Moving Median, and Wavelet Filter has also been presented. An on field drive trial was conducted under normal driving conditions at various fuel volumes ranging from 5 L to 50 L to acquire training samples from the capacitive sensor. A second field trial was conducted to obtain test samples to verify the performance of the neural network. The neural network was trained and verified with 50 % of the training and test samples. The results obtained using the neural network approach having different filtration methods are compared with the results obtained using simple Moving Mean and Moving Median functions. It is demonstrated that the Backpropagation neural network with Moving Median filter produced the most accurate outcome compared with the other signal filtration methods.
Ferrara, Alex
2007-01-01
Web services are poised to become a key technology for a wide range of Internet-enabled applications, spanning everything from straight B2B systems to mobile devices and proprietary in-house software. While there are several tools and platforms that can be used for building web services, developers are finding a powerful tool in Microsoft's .NET Framework and Visual Studio .NET. Designed from scratch to support the development of web services, the .NET Framework simplifies the process--programmers find that tasks that took an hour using the SOAP Toolkit take just minutes. Programming .NET
DEFF Research Database (Denmark)
Westergaard, Michael
2006-01-01
This paper introduces the notion of game coloured Petri nets. This allows the modeler to explicitly model what parts of the model comprise the modeled system and what parts are the environment of the modeled system. We give the formal definition of game coloured Petri nets, a means of reachability...... analysis of this net class, and an application of game coloured Petri nets to automatically generate easy-to-understand visualizations of the model by exploiting the knowledge that some parts of the model are not interesting from a visualization perspective (i.e. they are part of the environment...
Artificial neural networks in the nuclear engineering (Part 2)
International Nuclear Information System (INIS)
Baptista Filho, Benedito Dias
2002-01-01
The field of Artificial Neural Networks (ANN), one of the branches of Artificial Intelligence has been waking up a lot of interest in the Nuclear Engineering (NE). ANN can be used to solve problems of difficult modeling, when the data are fail or incomplete and in high complexity problems of control. The first part of this work began a discussion with feed-forward neural networks in back-propagation. In this part of the work, the Multi-synaptic neural networks is applied to control problems. Also, the self-organized maps is presented in a typical pattern classification problem: transients classification. The main purpose of the work is to show that ANN can be successfully used in NE if a carefully choice of its type is done: the application sets this choice. (author)
HIV lipodystrophy case definition using artificial neural network modelling
DEFF Research Database (Denmark)
Ioannidis, John P A; Trikalinos, Thomas A; Law, Matthew
2003-01-01
OBJECTIVE: A case definition of HIV lipodystrophy has recently been developed from a combination of clinical, metabolic and imaging/body composition variables using logistic regression methods. We aimed to evaluate whether artificial neural networks could improve the diagnostic accuracy. METHODS......: The database of the case-control Lipodystrophy Case Definition Study was split into 504 subjects (265 with and 239 without lipodystrophy) used for training and 284 independent subjects (152 with and 132 without lipodystrophy) used for validation. Back-propagation neural networks with one or two middle layers...... were trained and validated. Results were compared against logistic regression models using the same information. RESULTS: Neural networks using clinical variables only (41 items) achieved consistently superior performance than logistic regression in terms of specificity, overall accuracy and area under...
Tutorial on neural network applications in high energy physics: A 1992 perspective
International Nuclear Information System (INIS)
Denby, B.
1992-04-01
Feed forward and recurrent neural networks are introduced and related to standard data analysis tools. Tips are given on applications of neural nets to various areas of high energy physics. A review of applications within high energy physics and a summary of neural net hardware status are given
Mason, Cindi; Twomey, Janet; Wright, David; Whitman, Lawrence
2018-01-01
As the need for engineers continues to increase, a growing focus has been placed on recruiting students into the field of engineering and retaining the students who select engineering as their field of study. As a result of this concentration on student retention, numerous studies have been conducted to identify, understand, and confirm…
Design of an Adaptive-Neural Network Attitude Controller of a Satellite using Reaction Wheels
Directory of Open Access Journals (Sweden)
Abbas Ajorkar
2015-04-01
Full Text Available In this paper, an adaptive attitude control algorithm is developed based on neural network for a satellite using four reaction wheels in a tetrahedron configuration. Then, an attitude control based on feedback linearization control has been designed and uncertainties in the moment of inertia matrix and disturbances torque have been considered. In order to eliminate the effect of these uncertainties, a multilayer neural network with back-propagation law is designed. In this structure, the parameters of the moment of inertia matrix and external disturbances are estimated and used in feedback linearization control law. Finally, the performance of the designed attitude controller is investigated by several simulations.
Neural network-based run-to-run controller using exposure and resist thickness adjustment
Geary, Shane; Barry, Ronan
2003-06-01
This paper describes the development of a run-to-run control algorithm using a feedforward neural network, trained using the backpropagation training method. The algorithm is used to predict the critical dimension of the next lot using previous lot information. It is compared to a common prediction algorithm - the exponentially weighted moving average (EWMA) and is shown to give superior prediction performance in simulations. The manufacturing implementation of the final neural network showed significantly improved process capability when compared to the case where no run-to-run control was utilised.
DEFF Research Database (Denmark)
Jensen, Kurt
1991-01-01
This paper describes how Coloured Petri Nets (CP-nets) have been developed — from being a promising theoretical model to being a full-fledged language for the design, specification, simulation, validation and implementation of large software systems (and other systems in which human beings and...
CSIR Research Space (South Africa)
Lindeque, M
2013-01-01
Full Text Available the national grid. The unfortunate situation with water is that there is no replacement technology for water. Water can be supplied from many different sources. A net zero energy development will move closer to a net zero water development by reducing...
Construction of monophase nets
International Nuclear Information System (INIS)
Suarez A, Jose Antonio
1996-01-01
The paper refers to the use of monophase loads in commercial residential urbanizations and in small industries, for this reason it is considered unnecessary the construction of three-phase nets. The author makes a historical recount of these nets in Bogota, his capacities, uses and energy savings
International Nuclear Information System (INIS)
Spears, B.
1987-01-01
The paper concerns the next generation of fusion machines which are intended to demonstrate the technical viability of fusion. In Europe, the device that will follow on from JET is known as NET - the Next European Torus. If the design programme for NET proceeds, Europe could start to build the machine in 1994. The present JET programme hopes to achieve breakeven in the early 1990's. NET hopes to reach ignition in the next century, and so lay the foundation for a demonstration reactor. A description is given of the technical specifications of the components of NET, including: the first wall, the divertors to protect the wall, the array of magnets that provide the fields containing the plasma, the superconducting magnets, and the shield of the machine. NET's research programme is briefly outlined, including the testing programme to optimise conditions in the machine to achieve ignition, and its safety work. (U.K.)
International Nuclear Information System (INIS)
Asada, N.; Eiho, S.; Doi, K.; MacMahon, H.; Montner, S.M.; Giger, M.L.
1989-01-01
An artificial neural network has been applied for pattern recognition and used as a tool in an expert system. The purpose of this study is to examine the potential usefulness of the neural network approach in medical applications for image recognition and decision making. The authors designed multilayer feedforward neural networks with a back-propagation algorithm for our study. Using first-pass radionuclide ventriculograms, we attempted to identify the right and left ventricles of the heart and the lungs by training the neural network from patterns of time-activity curves. In a preliminary study, the neural network enabled identification of the lungs and heart chambers once the network was trained sufficiently by means of repeated entries of data from the same case
Application of neural networks to multiple alarm processing and diagnosis in nuclear power plants
International Nuclear Information System (INIS)
Cheon, Se Woo; Chang Soon Heung; Chung, Hak Yeong
1992-01-01
This paper presents feasibility studies of multiple alarm processing and diagnosis using neural networks. The back-propagation neural network model is applied to the training of multiple alarm patterns for the identification of failure in a reactor coolant pump (RCP) system. The general mapping capability of the neural network enables to identify a fault easily. The case studies are performed with emphasis on the applicability of the neural network to pattern recognition problems. It is revealed that the neural network model can identify the cause of multiple alarms properly, even when untrained or sensor-failed alarm symptoms are given. It is also shown that multiple failures are easily identified using the symptoms of multiple alarms
International Nuclear Information System (INIS)
Nabeshima, Kunihiko; Suzuki, Katsuo; Shinohara, Yoshikuni; Tuerkcan, E.
1995-11-01
In this paper, the anomaly detection method for nuclear power plant monitoring and its program are described by using a neural network approach, which is based on the deviation between measured signals and output signals of neural network model. The neural network used in this study has three layered auto-associative network with 12 input/output, and backpropagation algorithm is adopted for learning. Furthermore, to obtain better dynamical model of the reactor plant, a new learning technique was developed in which the learning process of the present neural network is divided into initial and adaptive learning modes. The test results at the actual nuclear reactor shows that the neural network plant monitoring system is successfull in detecting in real-time the symptom of small anomaly over a wide power range including reactor start-up, shut-down and stationary operation. (author)
Wan'e, Wu; Zuoming, Zhu
2012-01-01
A practical scheme for selecting characterization parameters of boron-based fuel-rich propellant formulation was put forward; a calculation model for primary combustion characteristics of boron-based fuel-rich propellant based on backpropagation neural network was established, validated, and then was used to predict primary combustion characteristics of boron-based fuel-rich propellant. The results show that the calculation error of burning rate is less than ± 7 . 3 %; in the formulation rang...
Wiryadinata, Romi; Ratnawati, Dwi Ana
2005-01-01
Motor DC dan komputer banyak digunakan dalam kehidupan sehari-sehari, baik di rumah tangga,industri maupun lingkungan pendidikan yang sangat membutuhkan ketelitian dan penggunan yang serbaotomatis. Jaringan Syaraf Tiruan merupakan salah satu kendali motor DC yang dapat disimulasikanmenggunakan neural network toolbox pada software Matlab 6.5. Dengan menggunakan metode Backpropagationdan fungsi Gradient Descent Momentum diperoleh struktur jaringan yang terbaik, terdiri dari 5 sel neuronlapisan ...
IMPLEMENTATION OF NEURAL - CRYPTOGRAPHIC SYSTEM USING FPGA
Directory of Open Access Journals (Sweden)
KARAM M. Z. OTHMAN
2011-08-01
Full Text Available Modern cryptography techniques are virtually unbreakable. As the Internet and other forms of electronic communication become more prevalent, electronic security is becoming increasingly important. Cryptography is used to protect e-mail messages, credit card information, and corporate data. The design of the cryptography system is a conventional cryptography that uses one key for encryption and decryption process. The chosen cryptography algorithm is stream cipher algorithm that encrypt one bit at a time. The central problem in the stream-cipher cryptography is the difficulty of generating a long unpredictable sequence of binary signals from short and random key. Pseudo random number generators (PRNG have been widely used to construct this key sequence. The pseudo random number generator was designed using the Artificial Neural Networks (ANN. The Artificial Neural Networks (ANN providing the required nonlinearity properties that increases the randomness statistical properties of the pseudo random generator. The learning algorithm of this neural network is backpropagation learning algorithm. The learning process was done by software program in Matlab (software implementation to get the efficient weights. Then, the learned neural network was implemented using field programmable gate array (FPGA.
Vibration monitoring with artificial neural networks
International Nuclear Information System (INIS)
Alguindigue, I.
1991-01-01
Vibration monitoring of components in nuclear power plants has been used for a number of years. This technique involves the analysis of vibration data coming from vital components of the plant to detect features which reflect the operational state of machinery. The analysis leads to the identification of potential failures and their causes, and makes it possible to perform efficient preventive maintenance. Earlydetection is important because it can decrease the probability of catastrophic failures, reduce forced outgage, maximize utilization of available assets, increase the life of the plant, and reduce maintenance costs. This paper documents our work on the design of a vibration monitoring methodology based on neural network technology. This technology provides an attractive complement to traditional vibration analysis because of the potential of neural network to operate in real-time mode and to handle data which may be distorted or noisy. Our efforts have been concentrated on the analysis and classification of vibration signatures collected from operating machinery. Two neural networks algorithms were used in our project: the Recirculation algorithm for data compression and the Backpropagation algorithm to perform the actual classification of the patterns. Although this project is in the early stages of development it indicates that neural networks may provide a viable methodology for monitoring and diagnostics of vibrating components. Our results to date are very encouraging
Global reinforcement training of CrossNets
Ma, Xiaolong
2007-10-01
Hybrid "CMOL" integrated circuits, incorporating advanced CMOS devices for neural cell bodies, nanowires as axons and dendrites, and latching switches as synapses, may be used for the hardware implementation of extremely dense (107 cells and 1012 synapses per cm2) neuromorphic networks, operating up to 10 6 times faster than their biological prototypes. We are exploring several "Cross- Net" architectures that accommodate the limitations imposed by CMOL hardware and should allow effective training of the networks without a direct external access to individual synapses. Our studies have show that CrossNets based on simple (two-terminal) crosspoint devices can work well in at least two modes: as Hop-field networks for associative memory and multilayer perceptrons for classification tasks. For more intelligent tasks (such as robot motion control or complex games), which do not have "examples" for supervised learning, more advanced training methods such as the global reinforcement learning are necessary. For application of global reinforcement training algorithms to CrossNets, we have extended Williams's REINFORCE learning principle to a more general framework and derived several learning rules that are more suitable for CrossNet hardware implementation. The results of numerical experiments have shown that these new learning rules can work well for both classification tasks and reinforcement tasks such as the cartpole balancing control problem. Some limitations imposed by the CMOL hardware need to be carefully addressed for the the successful application of in situ reinforcement training to CrossNets.
The principles of artificial neural network information processing
International Nuclear Information System (INIS)
Dai, Ru-Wei
1993-01-01
In this article, the basic structure of an artificial neuron is first introduced. In addition, principles of artificial neural network as well as several important artificial neural models such as perception, back propagation model, Hopfield net, and ART model are briefly discussed and analyzed. Finally the application of artificial neural network for Chinese character recognition is also given. (author)
The principles of artificial neural network information processing
International Nuclear Information System (INIS)
Dai, Ru-Wei
1993-01-01
In this article, the basic structure of an artificial neuron is first introduced. In addition, principles of artificial neural network as well as several important artificial neural models such as Perceptron, Back propagation model, Hopfield net, and ART model are briefly discussed and analyzed. Finally, the application of artificial neural network for Chinese Character Recognition is also given. (author)
International Nuclear Information System (INIS)
Seker, Serhat; Tuerkcan, Erdinc; Ayaz, Emine; Barutcu, Burak
2003-01-01
This paper addresses to the problem of utilisation of the artificial neural networks (ANNs) for detecting anomalies as well as physical parameters of a nuclear power plant during power operation in real time. Three different types of neural network algorithms were used namely, feed-forward neural network (back-propagation, BP) and two types of recurrent neural networks (RNN). The data used in this paper were gathered from the simulation of the power operation of the Japan's High Temperature Engineering Testing Reactor (HTTR). For the wide range of power operation, 56 signals were generated by the reactor dynamic simulation code for several hours of normal power operation at different power ramps between 30 and 100% nominal power. Paper will compare the outcomes of different neural networks and presents the neural network system and the determination of physical parameters from the simulated operating data
DEFF Research Database (Denmark)
Marszal, Anna Joanna; Bourrelle, Julien S.; Gustavsen, Arild
2010-01-01
and identify possible renewable energy supply options which may be considered in calculations. Finally, the gap between the methodology proposed by each organisation and their respective national building code is assessed; providing an overview of the possible changes building codes will need to undergo......The international cooperation project IEA SHC Task 40 / ECBCS Annex 52 “Towards Net Zero Energy Solar Buildings”, attempts to develop a common understanding and to set up the basis for an international definition framework of Net Zero Energy Buildings (Net ZEBs). The understanding of such buildings...
Energy Technology Data Exchange (ETDEWEB)
2016-09-01
The technology necessary to build net zero energy buildings (NZEBs) is ready and available today, however, building to net zero energy performance levels can be challenging. Energy efficiency measures, onsite energy generation resources, load matching and grid interaction, climatic factors, and local policies vary from location to location and require unique methods of constructing NZEBs. It is recommended that Components start looking into how to construct and operate NZEBs now as there is a learning curve to net zero construction and FY 2020 is just around the corner.
Ritchie, Stephen D
2011-01-01
Pro .NET Best Practices is a practical reference to the best practices that you can apply to your .NET projects today. You will learn standards, techniques, and conventions that are sharply focused, realistic and helpful for achieving results, steering clear of unproven, idealistic, and impractical recommendations. Pro .NET Best Practices covers a broad range of practices and principles that development experts agree are the right ways to develop software, which includes continuous integration, automated testing, automated deployment, and code analysis. Whether the solution is from a free and
Crop Classification by Forward Neural Network with Adaptive Chaotic Particle Swarm Optimization
Directory of Open Access Journals (Sweden)
Yudong Zhang
2011-05-01
Full Text Available This paper proposes a hybrid crop classifier for polarimetric synthetic aperture radar (SAR images. The feature sets consisted of span image, the H/A/α decomposition, and the gray-level co-occurrence matrix (GLCM based texture features. Then, the features were reduced by principle component analysis (PCA. Finally, a two-hidden-layer forward neural network (NN was constructed and trained by adaptive chaotic particle swarm optimization (ACPSO. K-fold cross validation was employed to enhance generation. The experimental results on Flevoland sites demonstrate the superiority of ACPSO to back-propagation (BP, adaptive BP (ABP, momentum BP (MBP, Particle Swarm Optimization (PSO, and Resilient back-propagation (RPROP methods. Moreover, the computation time for each pixel is only 1.08 × 10−7 s.
Falat, Lukas; Marcek, Dusan; Durisova, Maria
2016-01-01
This paper deals with application of quantitative soft computing prediction models into financial area as reliable and accurate prediction models can be very helpful in management decision-making process. The authors suggest a new hybrid neural network which is a combination of the standard RBF neural network, a genetic algorithm, and a moving average. The moving average is supposed to enhance the outputs of the network using the error part of the original neural network. Authors test the suggested model on high-frequency time series data of USD/CAD and examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, they perform a comparative statistical out-of-sample analysis of the tested model with autoregressive models and the standard neural network. They also incorporate genetic algorithm as an optimizing technique for adapting parameters of ANN which is then compared with standard backpropagation and backpropagation combined with K-means clustering algorithm. Finally, the authors find out that their suggested hybrid neural network is able to produce more accurate forecasts than the standard models and can be helpful in eliminating the risk of making the bad decision in decision-making process.
Directory of Open Access Journals (Sweden)
Lukas Falat
2016-01-01
Full Text Available This paper deals with application of quantitative soft computing prediction models into financial area as reliable and accurate prediction models can be very helpful in management decision-making process. The authors suggest a new hybrid neural network which is a combination of the standard RBF neural network, a genetic algorithm, and a moving average. The moving average is supposed to enhance the outputs of the network using the error part of the original neural network. Authors test the suggested model on high-frequency time series data of USD/CAD and examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, they perform a comparative statistical out-of-sample analysis of the tested model with autoregressive models and the standard neural network. They also incorporate genetic algorithm as an optimizing technique for adapting parameters of ANN which is then compared with standard backpropagation and backpropagation combined with K-means clustering algorithm. Finally, the authors find out that their suggested hybrid neural network is able to produce more accurate forecasts than the standard models and can be helpful in eliminating the risk of making the bad decision in decision-making process.
Marcek, Dusan; Durisova, Maria
2016-01-01
This paper deals with application of quantitative soft computing prediction models into financial area as reliable and accurate prediction models can be very helpful in management decision-making process. The authors suggest a new hybrid neural network which is a combination of the standard RBF neural network, a genetic algorithm, and a moving average. The moving average is supposed to enhance the outputs of the network using the error part of the original neural network. Authors test the suggested model on high-frequency time series data of USD/CAD and examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, they perform a comparative statistical out-of-sample analysis of the tested model with autoregressive models and the standard neural network. They also incorporate genetic algorithm as an optimizing technique for adapting parameters of ANN which is then compared with standard backpropagation and backpropagation combined with K-means clustering algorithm. Finally, the authors find out that their suggested hybrid neural network is able to produce more accurate forecasts than the standard models and can be helpful in eliminating the risk of making the bad decision in decision-making process. PMID:26977450
U.S. Department of Health & Human Services — The PhysioNet Resource is intended to stimulate current research and new investigations in the study of complex biomedical and physiologic signals. It offers free...
DEFF Research Database (Denmark)
Horn, Heiko; Lawrence, Michael S; Chouinard, Candace R
2018-01-01
Methods that integrate molecular network information and tumor genome data could complement gene-based statistical tests to identify likely new cancer genes; but such approaches are challenging to validate at scale, and their predictive value remains unclear. We developed a robust statistic (Net......Sig) that integrates protein interaction networks with data from 4,742 tumor exomes. NetSig can accurately classify known driver genes in 60% of tested tumor types and predicts 62 new driver candidates. Using a quantitative experimental framework to determine in vivo tumorigenic potential in mice, we found that Net......Sig candidates induce tumors at rates that are comparable to those of known oncogenes and are ten-fold higher than those of random genes. By reanalyzing nine tumor-inducing NetSig candidates in 242 patients with oncogene-negative lung adenocarcinomas, we find that two (AKT2 and TFDP2) are significantly amplified...
International Nuclear Information System (INIS)
Chazalon, M.; Daenner, W.; Libin, B.
1989-01-01
The testing stages in NET for the performance assessment of the various breeding blanket concepts developed at the present time in Europe for DEMO (LiPb and ceramic blankets) and the requirements upon NET to perform these tests are reviewed. Typical locations available in NET for blanket testing are the central outboard segments and the horizontal ports of in-vessel sectors. These test positions will be connectable with external test loops. The number of test loops (helium, water, liquid metal) will be such that each major class of blankets can be tested in NET. The test positions, the boundary conditions and the external test loops are identified and the requirements for test blankets are summarized (author). 6
Liberty, Jesse
2009-01-01
Bestselling author Jesse Liberty and industry expert Alex Horovitz uncover the common threads that unite the .NET 3.5 technologies, so you can benefit from the best practices and architectural patterns baked into the new Microsoft frameworks. The book offers a Grand Tour" of .NET 3.5 that describes how the principal technologies can be used together, with Ajax, to build modern n-tier and service-oriented applications. "
Finance Division
2001-01-01
On 15 June 2001 the Council approved the correction of the discrepancy identified in the net salary adjustment implemented on 1st January 2001 by retroactively increasing the scale of basic salaries to achieve the 2.8% average net salary adjustment approved in December 2000. We should like to inform you that the corresponding adjustment will be made to your July salary. Full details of the retroactive adjustments will consequently be shown on your pay slip.
Reconstruction of neutron spectra through neural networks
International Nuclear Information System (INIS)
Vega C, H.R.; Hernandez D, V.M.; Manzanares A, E.
2003-01-01
A neural network has been used to reconstruct the neutron spectra starting from the counting rates of the detectors of the Bonner sphere spectrophotometric system. A group of 56 neutron spectra was selected to calculate the counting rates that would produce in a Bonner sphere system, with these data and the spectra it was trained the neural network. To prove the performance of the net, 12 spectra were used, 6 were taken of the group used for the training, 3 were obtained of mathematical functions and those other 3 correspond to real spectra. When comparing the original spectra of those reconstructed by the net we find that our net has a poor performance when reconstructing monoenergetic spectra, this attributes it to those characteristic of the spectra used for the training of the neural network, however for the other groups of spectra the results of the net are appropriate with the prospective ones. (Author)
Directory of Open Access Journals (Sweden)
Z Abidin
2013-07-01
Full Text Available Di dalam kehidupan sehari-hari, khususnya dalam komunikasi interpersonal, wajah sering digunakan untuk berekspresi. Melalui ekspresi wajah, maka dapat dipahami emosi yang sedang bergejolak pada diri individu. Ekspresi wajah merupakan salah satu karakteristik perilaku. Penggunaan sistem teknologi biometrika dengan karakteristik ekspresi wajah memungkinkan untuk mengenali mood atau emosi seseorang. Komponen dasar sistem analisis ekspresi wajah adalah deteksi wajah, ekstraksi data wajah, dan pengenalan ekspresi wajah. Sehingga untuk membangun sebuah sistem pengenal ekspersi wajah, maka perlu dirancang tiga buah sub sistem yaitu sistem deteksi wajah, sistem pembelajaran jaringan syaraf tiruan. Prinsipnya data wajah yang telah dideteksi, diolah menggunakan fisherface, yang selanjutnya hasilnya digunakan sebagai input untuk jaringan syaraf tiruan. Bobot yang dihasilkan pada saat proses pembelajaran jaringan syaraf tiruan inilah yang akan digunakan untuk pengenalan ekspresi wajah.Â In daily life, especially in interpersonal communication, face often used for express of emotions. Facial expressions are the facial changes in response to a personâ€™s internal emotional states. A facial expression is one of the behavioral characteristics. The use of facial expression characteristics enables to recognize of personâ€™s mood. Basic components of a facial expression analysis system are face detection, face data extraction, and facial expression recognition. So that, to build a facial expression recognition system, it should be designed three subsystems, namely face detection system, learning of neural network system, and facial expression recognition system itself. In principle, face data that has been successfully detected, then it will be constructed by fisherface, and the results of it will be used as an input of neural network. Afterwards, the weights of neural network learning will be used to recognize facial expression.
DEFF Research Database (Denmark)
Porto da Silva, Edson; Yankov, Metodi Plamenov; Da Ros, Francesco
2016-01-01
Gains in achievable information rates from probabilistic shaping and digital backpropagation are compared for WDM transmission of 5 × 10 GBd DP-256QAM/1024QAM up to 1700 km of reach. The combination of both techniques its shown to provide gains of up to ∼0.5 bits/QAM symbol...
Motta, Mario; Zhang, Shiwei
2017-11-14
We address the computation of ground-state properties of chemical systems and realistic materials within the auxiliary-field quantum Monte Carlo method. The phase constraint to control the Fermion phase problem requires the random walks in Slater determinant space to be open-ended with branching. This in turn makes it necessary to use back-propagation (BP) to compute averages and correlation functions of operators that do not commute with the Hamiltonian. Several BP schemes are investigated, and their optimization with respect to the phaseless constraint is considered. We propose a modified BP method for the computation of observables in electronic systems, discuss its numerical stability and computational complexity, and assess its performance by computing ground-state properties in several molecular systems, including small organic molecules.
Wavefield back-propagation in high-resolution X-ray holography with a movable field of view.
Guehrs, Erik; Günther, Christian M; Pfau, Bastian; Rander, Torbjörn; Schaffert, Stefan; Schlotter, William F; Eisebitt, Stefan
2010-08-30
Mask-based Fourier transform holography is used to record images of biological objects with 2.2 nm X-ray wavelength. The holography mask and the object are decoupled from each other which allows us to move the field of view over a large area over the sample. Due to the separation of the mask and the sample on different X-ray windows, a gap between both windows in the micrometer range typically exists. Using standard Fourier transform holography, focussed images of the sample can directly be reconstructed only for gap distances within the setup's depth of field. Here, we image diatoms as function of the gap distance and demonstrate the possibility to recover focussed images via a wavefield back-propagation technique. The limitations of our approach with respect to large separations are mainly associated with deviations from flat-field illumination of the object.
Maximum solid concentrations of coal water slurries predicted by neural network models
Energy Technology Data Exchange (ETDEWEB)
Cheng, Jun; Li, Yanchang; Zhou, Junhu; Liu, Jianzhong; Cen, Kefa
2010-12-15
The nonlinear back-propagation (BP) neural network models were developed to predict the maximum solid concentration of coal water slurry (CWS) which is a substitute for oil fuel, based on physicochemical properties of 37 typical Chinese coals. The Levenberg-Marquardt algorithm was used to train five BP neural network models with different input factors. The data pretreatment method, learning rate and hidden neuron number were optimized by training models. It is found that the Hardgrove grindability index (HGI), moisture and coalification degree of parent coal are 3 indispensable factors for the prediction of CWS maximum solid concentration. Each BP neural network model gives a more accurate prediction result than the traditional polynomial regression equation. The BP neural network model with 3 input factors of HGI, moisture and oxygen/carbon ratio gives the smallest mean absolute error of 0.40%, which is much lower than that of 1.15% given by the traditional polynomial regression equation. (author)
An evaluation of neural networks for identification of system parameters in reactor noise signals
International Nuclear Information System (INIS)
Miller, L.F.
1991-01-01
Several backpropagation neural networks for identifying fundamental mode eigenvalues were evaluated. The networks were trained and tested on analytical data and on results from other numerical methods. They were then used to predict first mode break frequencies for noise data from several sources. These predictions were, in turn, compared with analytical values and with results from alternative methods. Comparisons of results for some data sets suggest that the accuracy of predictions from neural networks are essentially equivalent to results from conventional methods while other evaluations indicate that either method may be superior. Experience gained from these numerical experiments provide insight for improving the performance of neural networks relative to other methods for identifying parameters associated with experimental data. Neural networks may also be used in support of conventional algorithms by providing starting points for nonlinear minimization algorithms
An Adaptive Filtering Algorithm Based on Genetic Algorithm-Backpropagation Network
Directory of Open Access Journals (Sweden)
Kai Hu
2013-01-01
Full Text Available A new image filtering algorithm is proposed. GA-BPN algorithm uses genetic algorithm (GA to decide weights in a back propagation neural network (BPN. It has better global optimal characteristics than traditional optimal algorithm. In this paper, we used GA-BPN to do image noise filter researching work. Firstly, this paper uses training samples to train GA-BPN as the noise detector. Then, we utilize the well-trained GA-BPN to recognize noise pixels in target image. And at last, an adaptive weighted average algorithm is used to recover noise pixels recognized by GA-BPN. Experiment data shows that this algorithm has better performance than other filters.
Synthesis of recurrent neural networks for dynamical system simulation.
Trischler, Adam P; D'Eleuterio, Gabriele M T
2016-08-01
We review several of the most widely used techniques for training recurrent neural networks to approximate dynamical systems, then describe a novel algorithm for this task. The algorithm is based on an earlier theoretical result that guarantees the quality of the network approximation. We show that a feedforward neural network can be trained on the vector-field representation of a given dynamical system using backpropagation, then recast it as a recurrent network that replicates the original system's dynamics. After detailing this algorithm and its relation to earlier approaches, we present numerical examples that demonstrate its capabilities. One of the distinguishing features of our approach is that both the original dynamical systems and the recurrent networks that simulate them operate in continuous time. Copyright © 2016 Elsevier Ltd. All rights reserved.
An Artificial Neural Network for Data Forecasting Purposes
Directory of Open Access Journals (Sweden)
Catalina Lucia COCIANU
2015-01-01
Full Text Available Considering the fact that markets are generally influenced by different external factors, the stock market prediction is one of the most difficult tasks of time series analysis. The research reported in this paper aims to investigate the potential of artificial neural networks (ANN in solving the forecast task in the most general case, when the time series are non-stationary. We used a feed-forward neural architecture: the nonlinear autoregressive network with exogenous inputs. The network training function used to update the weight and bias parameters corresponds to gradient descent with adaptive learning rate variant of the backpropagation algorithm. The results obtained using this technique are compared with the ones resulted from some ARIMA models. We used the mean square error (MSE measure to evaluate the performances of these two models. The comparative analysis leads to the conclusion that the proposed model can be successfully applied to forecast the financial data.
Neural PID Control Strategy for Networked Process Control
Directory of Open Access Journals (Sweden)
Jianhua Zhang
2013-01-01
Full Text Available A new method with a two-layer hierarchy is presented based on a neural proportional-integral-derivative (PID iterative learning method over the communication network for the closed-loop automatic tuning of a PID controller. It can enhance the performance of the well-known simple PID feedback control loop in the local field when real networked process control applied to systems with uncertain factors, such as external disturbance or randomly delayed measurements. The proposed PID iterative learning method is implemented by backpropagation neural networks whose weights are updated via minimizing tracking error entropy of closed-loop systems. The convergence in the mean square sense is analysed for closed-loop networked control systems. To demonstrate the potential applications of the proposed strategies, a pressure-tank experiment is provided to show the usefulness and effectiveness of the proposed design method in network process control systems.
Estimation of scattered photons using a neural network in SPECT
International Nuclear Information System (INIS)
Hasegawa, Wataru; Ogawa, Koichi
1994-01-01
In single photon emission CT (SPECT), measured projection data involve scattered photons. This causes degradation of spatial resolution and contrast in reconstructed images. The purpose of this study is to estimate the scattered photons, and eliminate them from measured data. To estimate the scattered photons, we used an artificial neural network which consists of five input units, five hidden units, and two output units. The inputs of the network are the ratios of the counts acquired by five narrow energy windows and their sum. The outputs are the ratios of the count of scattered photons and that of primary photons to the total count. The neural network was trained with a back-propagation algorithm using count data obtained by a Monte Carlo simulation. The results of simulation showed improvement of contrast and spatial resolution in reconstructed images. (author)
Neural network classification of quark and gluon jets
International Nuclear Information System (INIS)
Graham, M.A.; Jones, L.M.; Herbin, S.
1995-01-01
We demonstrate that there are characteristics common to quark jets and to gluon jets regardless of the interaction that produced them. The classification technique we use depends on the mass of the jet as well as the center-of-mass energy of the hard subprocess that produces the jet. In addition, we present the quark-gluon separability results of an artificial neural network trained on three-jet e + e - events at the Z 0 mass, using a back-propagation algorithm. The inputs to the network are the longitudinal momenta of the leading hadrons in the jet. We tested the network with quark and gluon jets from both e + e - →3 jets and bar pp→2 jets. Finally, we compare the performance of the artificial neural network with the results of making well chosen physical cuts
Benediktsson, J. A.; Swain, P. H.; Ersoy, O. K.
1993-01-01
Application of neural networks to classification of remote sensing data is discussed. Conventional two-layer backpropagation is found to give good results in classification of remote sensing data but is not efficient in training. A more efficient variant, based on conjugate-gradient optimization, is used for classification of multisource remote sensing and geographic data and very-high-dimensional data. The conjugate-gradient neural networks give excellent performance in classification of multisource data, but do not compare as well with statistical methods in classification of very-high-dimentional data.
Kwon, Chung-Jin; Kim, Sung-Joong; Han, Woo-Young; Min, Won-Kyoung
2005-12-01
The rotor position and speed estimation of permanent-magnet synchronous motor(PMSM) was dealt with. By measuring the phase voltages and currents of the PMSM drive, two diagonally recurrent neural network(DRNN) based observers, a neural current observer and a neural velocity observer were developed. DRNN which has self-feedback of the hidden neurons ensures that the outputs of DRNN contain the whole past information of the system even if the inputs of DRNN are only the present states and inputs of the system. Thus the structure of DRNN may be simpler than that of feedforward and fully recurrent neural networks. If the backpropagation method was used for the training of the DRNN the problem of slow convergence arise. In order to reduce this problem, recursive prediction error(RPE) based learning method for the DRNN was presented. The simulation results show that the proposed approach gives a good estimation of rotor speed and position, and RPE based training has requires a shorter computation time compared to backpropagation based training.
Neural networks and wavelet analysis in the computer interpretation of pulse oximetry data
Energy Technology Data Exchange (ETDEWEB)
Dowla, F.U.; Skokowski, P.G.; Leach, R.R. Jr.
1996-03-01
Pulse oximeters determine the oxygen saturation level of blood by measuring the light absorption of arterial blood. The sensor consists of red and infrared light sources and photodetectors. A method based on neural networks and wavelet analysis is developed for improved saturation estimation in the presence of sensor motion. Spectral and correlation functions of the dual channel oximetry data are used by a backpropagation neural network to characterize the type of motion. Amplitude ratios of red to infrared signals as a function of time scale are obtained from the multiresolution wavelet decomposition of the two-channel data. Motion class and amplitude ratios are then combined to obtain a short-time estimate of the oxygen saturation level. A final estimate of oxygen saturation is obtained by applying a 15 s smoothing filter on the short-time measurements based on 3.5 s windows sampled every 1.75 s. The design employs two backpropagation neural networks. The first neural network determines the motion characteristics and the second network determines the saturation estimate. Our approach utilizes waveform analysis in contrast to the standard algorithms that are based on the successful detection of peaks and troughs in the signal. The proposed algorithm is numerically efficient and has stable characteristics with a reduced false alarm rate with a small loss in detection. The method can be rapidly developed on a digital signal processing platform.
Wingender, E
2011-01-01
It was suggested some years ago that Petri nets might be well suited to modeling metabolic networks, overcoming some of the limitations encountered by the use of systems employing ODEs (ordinary differential equations). Much work has been done since then which confirms this and demonstrates the usefulness of this concept for systems biology. Petri net technology is not only intuitively understood by scientists trained in the life sciences, it also has a robust mathematical foundation and provides the required degree of flexibility. As a result it appears to be a very promising approach to mode
Reconfiguration of distribution nets
International Nuclear Information System (INIS)
Latorre Bayona, Gerardo; Angarita Marquez, Jorge Luis
2000-01-01
Starting of the location of the reconfiguration problem inside the context of the operation of distribution nets, of the quality indicators definition and of the presentation of the alternatives more used for reduction of technical losses, they are related diverse reconfiguration methodologies proposed in the technical literature, pointing out their three principals limitations; also are presents the results of lost obtained starting from simulation works carried out in distribution circuits of the ESSA ESP, which permitting to postulate the reconfiguration of nets like an excellent alternative to reduce technical losses
International Nuclear Information System (INIS)
Farfaletti-Casali, F.; Mitchell, N.; Salpietro, E.; Buzzi, U.; Gritzmann, P.
1985-01-01
The NET system integration procedure is the process by which the requirements of the various Tokamak machine design areas are brought together to form a compatible machine layout. Each design area produces requirements which generally allow components to be built at minimum cost and operate with minimum technical risk, and the final machine assembly should be achieved with minimum departure from these optimum designs. This is carried out in NET by allowing flexibility in the maintenance and access methods to the machine internal components which must be regularly replaced by remote handling, in segmentation of these internal components and in the number of toroidal field coils
Neural network application to diesel generator diagnostics
International Nuclear Information System (INIS)
Logan, K.P.
1990-01-01
Diagnostic problems typically begin with the observation of some system behavior which is recognized as a deviation from the expected. The fundamental underlying process is one involving pattern matching cf observed symptoms to a set of compiled symptoms belonging to a fault-symptom mapping. Pattern recognition is often relied upon for initial fault detection and diagnosis. Parallel distributed processing (PDP) models employing neural network paradigms are known to be good pattern recognition devices. This paper describes the application of neural network processing techniques to the malfunction diagnosis of subsystems within a typical diesel generator configuration. Neural network models employing backpropagation learning were developed to correctly recognize fault conditions from the input diagnostic symptom patterns pertaining to various engine subsystems. The resulting network models proved to be excellent pattern recognizers for malfunction examples within the training set. The motivation for employing network models in lieu of a rule-based expert system, however, is related to the network's potential for generalizing malfunctions outside of the training set, as in the case of noisy or partial symptom patterns
Handwritten Digits Recognition Using Neural Computing
Directory of Open Access Journals (Sweden)
Călin Enăchescu
2009-12-01
Full Text Available In this paper we present a method for the recognition of handwritten digits and a practical implementation of this method for real-time recognition. A theoretical framework for the neural networks used to classify the handwritten digits is also presented.The classiﬁcation task is performed using a Convolutional Neural Network (CNN. CNN is a special type of multy-layer neural network, being trained with an optimized version of the back-propagation learning algorithm.CNN is designed to recognize visual patterns directly from pixel images with minimal preprocessing, being capable to recognize patterns with extreme variability (such as handwritten characters, and with robustness to distortions and simple geometric transformations.The main contributions of this paper are related to theoriginal methods for increasing the efﬁciency of the learning algorithm by preprocessing the images before the learning process and a method for increasing the precision and performance for real-time applications, by removing the non useful information from the background.By combining these strategies we have obtained an accuracy of 96.76%, using as training set the NIST (National Institute of Standards and Technology database.
Artificial Neural Network Model for Predicting Compressive
Directory of Open Access Journals (Sweden)
Salim T. Yousif
2013-05-01
Full Text Available Compressive strength of concrete is a commonly used criterion in evaluating concrete. Although testing of the compressive strength of concrete specimens is done routinely, it is performed on the 28th day after concrete placement. Therefore, strength estimation of concrete at early time is highly desirable. This study presents the effort in applying neural network-based system identification techniques to predict the compressive strength of concrete based on concrete mix proportions, maximum aggregate size (MAS, and slump of fresh concrete. Back-propagation neural networks model is successively developed, trained, and tested using actual data sets of concrete mix proportions gathered from literature. The test of the model by un-used data within the range of input parameters shows that the maximum absolute error for model is about 20% and 88% of the output results has absolute errors less than 10%. The parametric study shows that water/cement ratio (w/c is the most significant factor affecting the output of the model. The results showed that neural networks has strong potential as a feasible tool for predicting compressive strength of concrete.
Classification of E-Nose Aroma Data of Four Fruit Types by ABC-Based Neural Network.
Adak, M Fatih; Yumusak, Nejat
2016-02-27
Electronic nose technology is used in many areas, and frequently in the beverage industry for classification and quality-control purposes. In this study, four different aroma data (strawberry, lemon, cherry, and melon) were obtained using a MOSES II electronic nose for the purpose of fruit classification. To improve the performance of the classification, the training phase of the neural network with two hidden layers was optimized using artificial bee colony algorithm (ABC), which is known to be successful in exploration. Test data were given to two different neural networks, each of which were trained separately with backpropagation (BP) and ABC, and average test performances were measured as 60% for the artificial neural network trained with BP and 76.39% for the artificial neural network trained with ABC. Training and test phases were repeated 30 times to obtain these average performance measurements. This level of performance shows that the artificial neural network trained with ABC is successful in classifying aroma data.
International Nuclear Information System (INIS)
Zio, Enrico; Pedroni, Nicola; Broggi, Matteo; Golea, Lucia Roxana
2009-01-01
In this paper, an infinite impulse response locally recurrent neural network (IIR-LRNN) is employed for modelling the dynamics of the Lead Bismuth Eutectic eXperimental Accelerator Driven System (LBE-XADS). The network is trained by recursive back-propagation (RBP) and its ability in estimating transients is tested under various conditions. The results demonstrate the robustness of the locally recurrent scheme in the reconstruction of complex nonlinear dynamic relationships
Jensen, Kurt
2009-01-01
Coloured Petri Nets (CPN) is a graphical language for modelling and validating concurrent and distributed systems, and other systems in which concurrency plays a major role. This book introduces the constructs of the CPN modelling language and presents the related analysis methods. It provides a comprehensive road map for the practical use of CPN.
DEFF Research Database (Denmark)
Ilsøe, Anna
2012-01-01
Does regulation of working hours at national and sector level impose straitjackets, or offer safety nets to employees seeking working time flexibility? This article compares legislation and collective agreements in the metal industries of Denmark, Germany and the USA. The industry has historically...
International Nuclear Information System (INIS)
Jimenez Sanchez, Raul
1999-01-01
The paper gives a generic idea of the solutions that the neuronal nets contribute to the robotics. The advantages and the inconveniences are exposed that have regarding the conventional techniques. It also describe the more excellent applications as the pursuit of trajectories, the positioning based on images, the force control or of the mobile robots management, among others
DEFF Research Database (Denmark)
2012-01-01
, that in turn enables general practitioners and clinical staff to view observations. Use the menus above to explore the site's information resources. To get started, follow the short Hello, World! tutorial. The Net4Care project is funded by The Central Denmark Region and EU via Caretech Innovation....
DEFF Research Database (Denmark)
Jensen, Kurt; Kristensen, Lars Michael
Coloured Petri Nets (CPN) is a graphical language for modelling and validating concurrent and distributed systems, and other systems in which concurrency plays a major role. The development of such systems is particularly challenging because of inherent intricacies like possible nondeterminism an...
Shor, Mikhael
2003-01-01
States making game theory relevant and accessible to students is challenging. Describes the primary goal of GameTheory.net is to provide interactive teaching tools. Indicates the site strives to unite educators from economics, political and computer science, and ecology by providing a repository of lecture notes and tests for courses using…
DEFF Research Database (Denmark)
Misirli, Goksel; Hallinan, Jennifer; Röttger, Richard
2014-01-01
As high-throughput technologies become cheaper and easier to use, raw sequence data and corresponding annotations for many organisms are becoming available. However, sequence data alone is not sufficient to explain the biological behaviour of organisms, which arises largely from complex molecular...... the associated BacillusRegNet website (http://bacillus.ncl.ac.uk)....
DEFF Research Database (Denmark)
Grimshaw, Mark Nicholas; Yong, Louisa; Dobie, Ian
1999-01-01
of an existing Internet radio station; Boom Booom Net Radio. Whilst necessity dictates some use of technology-related terminology, wherever possible we have endeavoured to keep such jargon to a minimum and to either explain it in the text or to provide further explanation in the appended glossary....
Novel maximum-margin training algorithms for supervised neural networks.
Ludwig, Oswaldo; Nunes, Urbano
2010-06-01
This paper proposes three novel training methods, two of them based on the backpropagation approach and a third one based on information theory for multilayer perceptron (MLP) binary classifiers. Both backpropagation methods are based on the maximal-margin (MM) principle. The first one, based on the gradient descent with adaptive learning rate algorithm (GDX) and named maximum-margin GDX (MMGDX), directly increases the margin of the MLP output-layer hyperplane. The proposed method jointly optimizes both MLP layers in a single process, backpropagating the gradient of an MM-based objective function, through the output and hidden layers, in order to create a hidden-layer space that enables a higher margin for the output-layer hyperplane, avoiding the testing of many arbitrary kernels, as occurs in case of support vector machine (SVM) training. The proposed MM-based objective function aims to stretch out the margin to its limit. An objective function based on Lp-norm is also proposed in order to take into account the idea of support vectors, however, overcoming the complexity involved in solving a constrained optimization problem, usually in SVM training. In fact, all the training methods proposed in this paper have time and space complexities O(N) while usual SVM training methods have time complexity O(N (3)) and space complexity O(N (2)) , where N is the training-data-set size. The second approach, named minimization of interclass interference (MICI), has an objective function inspired on the Fisher discriminant analysis. Such algorithm aims to create an MLP hidden output where the patterns have a desirable statistical distribution. In both training methods, the maximum area under ROC curve (AUC) is applied as stop criterion. The third approach offers a robust training framework able to take the best of each proposed training method. The main idea is to compose a neural model by using neurons extracted from three other neural networks, each one previously trained by
Kondo, Shuhei; Shibata, Tadashi; Ohmi, Tadahiro
1995-02-01
We have investigated the learning performance of the hardware backpropagation (HBP) algorithm, a hardware-oriented learning algorithm developed for the self-learning architecture of neural networks constructed using neuron MOS (metal-oxide-semiconductor) transistors. The solution to finding a mirror symmetry axis in a 4×4 binary pixel array was tested by computer simulation based on the HBP algorithm. Despite the inherent restrictions imposed on the hardware-learning algorithm, HBP exhibits equivalent learning performance to that of the original backpropagation (BP) algorithm when all the pertinent parameters are optimized. Very importantly, we have found that HBP has a superior generalization capability over BP; namely, HBP exhibits higher performance in solving problems that the network has not yet learnt.
International Nuclear Information System (INIS)
Denby, Bruce; Lindsey, Clark; Lyons, Louis
1992-01-01
The 1980s saw a tremendous renewal of interest in 'neural' information processing systems, or 'artificial neural networks', among computer scientists and computational biologists studying cognition. Since then, the growth of interest in neural networks in high energy physics, fueled by the need for new information processing technologies for the next generation of high energy proton colliders, can only be described as explosive
DEFF Research Database (Denmark)
Jordan, Ulrike; Vajen, Klaus; Bales, Chris
2014-01-01
-accompanying Master courses, placements of internships, and PhD scholarship projects. A new scholarship project, “SHINE”, was launched in autumn 2013 in the frame work of the Marie Curie program of the European Union (Initial Training Network, ITN). 13 PhD-scholarships on solar district heating, solar heat......SolNet, founded in 2006, is the first coordinated International PhD education program on Solar Thermal Engineering. The SolNet network is coordinated by the Institute of Thermal Engineering at Kassel University, Germany. The network offers PhD courses on solar heating and cooling, conference...... for industrial processes, as well as sorption stores and materials started in December 2013. Additionally, the project comprises a training program with five PhD courses and several workshops on solar thermal engineering that will be open also for other PhD students working in the field. The research projects...
Markers of neural degeneration and regeneration in Down ...
African Journals Online (AJOL)
Iman Ehsan Abdel-Meguid
2012-11-02
Nov 2, 2012 ... The Egyptian Journal of Medical Human Genetics www.ejmhg.eg.net ... stem cells (TCSCs), including neural TCSCs and endothelial. TCSCs [10,11]. ..... directs human embryonic stem cell proliferation and differentia- tion into.
Temporal neural networks and transient analysis of complex engineering systems
Uluyol, Onder
A theory is introduced for a multi-layered Local Output Gamma Feedback (LOGF) neural network within the paradigm of Locally-Recurrent Globally-Feedforward neural networks. It is developed for the identification, prediction, and control tasks of spatio-temporal systems and allows for the presentation of different time scales through incorporation of a gamma memory. It is initially applied to the tasks of sunspot and Mackey-Glass series prediction as benchmarks, then it is extended to the task of power level control of a nuclear reactor at different fuel cycle conditions. The developed LOGF neuron model can also be viewed as a Transformed Input and State (TIS) Gamma memory for neural network architectures for temporal processing. The novel LOGF neuron model extends the static neuron model by incorporating into it a short-term memory structure in the form of a digital gamma filter. A feedforward neural network made up of LOGF neurons can thus be used to model dynamic systems. A learning algorithm based upon the Backpropagation-Through-Time (BTT) approach is derived. It is applicable for training a general L-layer LOGF neural network. The spatial and temporal weights and parameters of the network are iteratively optimized for a given problem using the derived learning algorithm.
Iris double recognition based on modified evolutionary neural network
Liu, Shuai; Liu, Yuan-Ning; Zhu, Xiao-Dong; Huo, Guang; Liu, Wen-Tao; Feng, Jia-Kai
2017-11-01
Aiming at multicategory iris recognition under illumination and noise interference, this paper proposes a method of iris double recognition based on a modified evolutionary neural network. An equalization histogram and Laplace of Gaussian operator are used to process the iris to suppress illumination and noise interference and Haar wavelet to convert the iris feature to binary feature encoding. Calculate the Hamming distance for the test iris and template iris , and compare with classification threshold, determine the type of iris. If the iris cannot be identified as a different type, there needs to be a secondary recognition. The connection weights in back-propagation (BP) neural network use modified evolutionary neural network to adaptively train. The modified neural network is composed of particle swarm optimization with mutation operator and BP neural network. According to different iris libraries in different circumstances of experimental results, under illumination and noise interference, the correct recognition rate of this algorithm is higher, the ROC curve is closer to the coordinate axis, the training and recognition time is shorter, and the stability and the robustness are better.
Using function approximation to determine neural network accuracy
International Nuclear Information System (INIS)
Wichman, R.F.; Alexander, J.
2013-01-01
Many, if not most, control processes demonstrate nonlinear behavior in some portion of their operating range and the ability of neural networks to model non-linear dynamics makes them very appealing for control. Control of high reliability safety systems, and autonomous control in process or robotic applications, however, require accurate and consistent control and neural networks are only approximators of various functions so their degree of approximation becomes important. In this paper, the factors affecting the ability of a feed-forward back-propagation neural network to accurately approximate a non-linear function are explored. Compared to pattern recognition using a neural network for function approximation provides an easy and accurate method for determining the network's accuracy. In contrast to other techniques, we show that errors arising in function approximation or curve fitting are caused by the neural network itself rather than scatter in the data. A method is proposed that provides improvements in the accuracy achieved during training and resulting ability of the network to generalize after training. Binary input vectors provided a more accurate model than with scalar inputs and retraining using a small number of the outlier x,y pairs improved generalization. (author)
Universal approximation in p-mean by neural networks
Burton, R.M; Dehling, H.G
A feedforward neural net with d input neurons and with a single hidden layer of n neurons is given by [GRAPHICS] where a(j), theta(j), w(ji) is an element of R. In this paper we study the approximation of arbitrary functions f: R-d --> R by a neural net in an L-p(mu) norm for some finite measure mu
Use of Neural Networks for Damage Assessment in a Steel Mast
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1994-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorithm for detecting location and size of a damage in a civil engineering structure is investigated. The structure considered is a 20 m high steel lattice mast subjected to wind excita...... as well as full-scale tests where the mast is identified by an ARMA-model. The results show that a neural network trained with simulated data is capable for detecting location of a damage in a steel lattice mast when the network is subjected to experimental data.·...
Directory of Open Access Journals (Sweden)
Oliveira-Esquerre K.P.
2002-01-01
Full Text Available This work presents a way to predict the biochemical oxygen demand (BOD of the output stream of the biological wastewater treatment plant at RIPASA S/A Celulose e Papel, one of the major pulp and paper plants in Brazil. The best prediction performance is achieved when the data are preprocessed using principal components analysis (PCA before they are fed to a backpropagated neural network. The influence of input variables is analyzed and satisfactory prediction results are obtained for an optimized situation.
Gross domestic product estimation based on electricity utilization by artificial neural network
Stevanović, Mirjana; Vujičić, Slađana; Gajić, Aleksandar M.
2018-01-01
The main goal of the paper was to estimate gross domestic product (GDP) based on electricity estimation by artificial neural network (ANN). The electricity utilization was analyzed based on different sources like renewable, coal and nuclear sources. The ANN network was trained with two training algorithms namely extreme learning method and back-propagation algorithm in order to produce the best prediction results of the GDP. According to the results it can be concluded that the ANN model with extreme learning method could produce the acceptable prediction of the GDP based on the electricity utilization.
A neural method for determining electromagnetic shower positions in laterally segmented calorimeters
International Nuclear Information System (INIS)
Roy, A.; Ray, A.; Mitra, T.; Roy, A.
1995-01-01
A method based on a neural network technique is proposed to calculate the coordinates of an incident photon striking a laterally segmented calorimeter and depositing shower energies in different segments. The technique uses a multilayer perceptron trained by back-propagation implemented through standard gradient descent followed by conjugate gradient algorithms and has been demonstrated with GEANT simulations of a BAF2 detector array. The position resolution results obtained by using this method are found to be substantially better than the first moment method with logarithmic weighting. (orig.)
Using neural networks with jet shapes to identify b jets in e+e- interactions
International Nuclear Information System (INIS)
Bellantoni, L.; Conway, J.S.; Jacobsen, J.E.; Pan, Y.B.; Wu Saulan
1991-01-01
A feed-forward neural network trained using backpropagation was used to discriminate between b and light quark jets in e + e - → Z 0 → qanti q events. The information presented to the network consisted of 25 jet shape variables. The network successfully identified b jets in two- and three-jet events modeled using a detector simulation. The jet identification efficiency for two-jet events was 61% and the probability to call a light quark jet a b jet equal to 20%. (orig.)
Neural Network Compensation for Frequency Cross-Talk in Laser Interferometry
Lee, Wooram; Heo, Gunhaeng; You, Kwanho
The heterodyne laser interferometer acts as an ultra-precise measurement apparatus in semiconductor manufacture. However the periodical nonlinearity property caused from frequency cross-talk is an obstacle to improve the high measurement accuracy in nanometer scale. In order to minimize the nonlinearity error of the heterodyne interferometer, we propose a frequency cross-talk compensation algorithm using an artificial intelligence method. The feedforward neural network trained by back-propagation compensates the nonlinearity error and regulates to minimize the difference with the reference signal. With some experimental results, the improved accuracy is proved through comparison with the position value from a capacitive displacement sensor.
International Nuclear Information System (INIS)
Ferreira, Francisco J.O.; Crispim, Verginia R.; Silva, Ademir X.
2009-01-01
The artificial neural network technique was used to identify drugs and plastic explosives, from a tomography composed by a set of six neutrongraphic projections obtained in real time. Bidimensional tomographic images of samples of drugs, explosives and other materials, when digitally processed, yield the characteristic spectra of each type of material. The information contained in those spectra was then used for ANN training, the best images being obtained when the multilayer perceptron model, the back-propagation training algorithm and the Cross-validation interruption criterion were used. ANN showed to be useful in forecasting presence of drugs and explosives hitting a rate of success above 97 %. (author)
Laidi, Maamar; Hanini, Salah; Rezrazi, Ahmed; Yaiche, Mohamed Redha; El Hadj, Abdallah Abdallah; Chellali, Farouk
2017-04-01
In this study, a backpropagation artificial neural network (BP-ANN) model is used as an alternative approach to predict solar radiation on tilted surfaces (SRT) using a number of variables involved in physical process. These variables are namely the latitude of the site, mean temperature and relative humidity, Linke turbidity factor and Angstrom coefficient, extraterrestrial solar radiation, solar radiation data measured on horizontal surfaces (SRH), and solar zenith angle. Experimental solar radiation data from 13 stations spread all over Algeria around the year (2004) were used for training/validation and testing the artificial neural networks (ANNs), and one station was used to make the interpolation of the designed ANN. The ANN model was trained, validated, and tested using 60, 20, and 20 % of all data, respectively. The configuration 8-35-1 (8 inputs, 35 hidden, and 1 output neurons) presented an excellent agreement between the prediction and the experimental data during the test stage with determination coefficient of 0.99 and root meat squared error of 5.75 Wh/m2, considering a three-layer feedforward backpropagation neural network with Levenberg-Marquardt training algorithm, a hyperbolic tangent sigmoid and linear transfer function at the hidden and the output layer, respectively. This novel model could be used by researchers or scientists to design high-efficiency solar devices that are usually tilted at an optimum angle to increase the solar incident on the surface.
Optimizing the De-Noise Neural Network Model for GPS Time-Series Monitoring of Structures
Directory of Open Access Journals (Sweden)
Mosbeh R. Kaloop
2015-09-01
Full Text Available The Global Positioning System (GPS is recently used widely in structures and other applications. Notwithstanding, the GPS accuracy still suffers from the errors afflicting the measurements, particularly the short-period displacement of structural components. Previously, the multi filter method is utilized to remove the displacement errors. This paper aims at using a novel application for the neural network prediction models to improve the GPS monitoring time series data. Four prediction models for the learning algorithms are applied and used with neural network solutions: back-propagation, Cascade-forward back-propagation, adaptive filter and extended Kalman filter, to estimate which model can be recommended. The noise simulation and bridge’s short-period GPS of the monitoring displacement component of one Hz sampling frequency are used to validate the four models and the previous method. The results show that the Adaptive neural networks filter is suggested for de-noising the observations, specifically for the GPS displacement components of structures. Also, this model is expected to have significant influence on the design of structures in the low frequency responses and measurements’ contents.
Net one, net two: the primary care network income statement.
Halley, M D; Little, A W
1999-10-01
Although hospital-owned primary care practices have been unprofitable for most hospitals, some hospitals are achieving competitive advantage and sustainable practice operations. A key to the success of some has been a net income reporting tool that separates practice operating expenses from the costs of creating and operating a network of practices to help healthcare organization managers, physicians, and staff to identify opportunities to improve the network's financial performance. This "Net One, Net Two" reporting allows operations leadership to be held accountable for Net One expenses and strategic leadership to be held accountable for Net Two expenses.
Proof Nets for Lambek Calculus
Roorda, Dirk
1992-01-01
The proof nets of linear logic are adapted to the non-commutative Lambek calculus. A different criterion for soundness of proof nets is given, which gives rise to new algorithms for proof search. The order sensitiveness of the Lambek calculus is reflected by the planarity condition on proof nets;
Net metering: zero electricity bill
International Nuclear Information System (INIS)
Mangi, A.; Khan, Z.
2011-01-01
Worldwide move towards renewable energy sources, environmental concerns and decentralization of the power sector have made net metering an attractive option for power generation at small scale. This paper discusses the net metering, economical issues of renewable sources in Pakistan, technical aspects, installation suitability according to varying terrain, existing utility rules and formulation of legislation for net metering making it economically attractive. (author)
THE NET ADVANCE OF PHYSICS Review Articles and Tutorials in an EncyclopÃ¦dic Format Established 1995 [Link to MIT] Computer support for The Net Advance of Physics is furnished by The Massachusetts Newest Additions SPECIAL FEATURES: Net Advance RETRO: Nineteenth Century Physics History of Science
Directory of Open Access Journals (Sweden)
Małgorzata Pawul
2016-09-01
Full Text Available Recently, a lot of attention was paid to the improvement of methods which are used to air quality forecasting. Artificial neural networks can be applied to model these problems. Their advantage is that they can solve the problem in the conditions of incomplete information, without the knowledge of the analytical relationship between the input and output data. In this paper we applied artificial neural networks to predict the PM 10 concentrations as factors determining the occurrence of smog phenomena. To create these networks we used meteorological data and concentrations of PM 10. The data were recorded in 2014 and 2015 at three measuring stations operating in Krakow under the State Environmental Monitoring. The best results were obtained by three-layer perceptron with back-propagation algorithm. The neural networks received a good fit in all cases.
Butterfly Classification by HSI and RGB Color Models Using Neural Networks
Directory of Open Access Journals (Sweden)
Jorge E. Grajales-Múnera
2013-11-01
Full Text Available This study aims the classification of Butterfly species through the implementation of Neural Networks and Image Processing. A total of 9 species of Morpho genre which has blue as a characteristic color are processed. For Butterfly segmentation we used image processing tools such as: Binarization, edge processing and mathematical morphology. For data processing RGB values are obtained for every image which are converted to HSI color model to identify blue pixels and obtain the data to the proposed Neural Networks: Back-Propagation and Perceptron. For analysis and verification of results confusion matrix are built and analyzed with the results of neural networks with the lowest error levels. We obtain error levels close to 1% in classification of some Butterfly species.
Adaptive online state-of-charge determination based on neuro-controller and neural network
Energy Technology Data Exchange (ETDEWEB)
Shen Yanqing, E-mail: network_hawk@126.co [Department of Automation, Chongqing Industry Polytechnic College, Jiulongpo District, Chongqing 400050 (China)
2010-05-15
This paper presents a novel approach using adaptive artificial neural network based model and neuro-controller for online cell State of Charge (SOC) determination. Taking cell SOC as model's predictive control input unit, radial basis function neural network, which can adjust its structure to prediction error with recursive least square algorithm, is used to simulate battery system. Besides that, neuro-controller based on Back-Propagation Neural Network (BPNN) and modified PID controller is used to decide the control input of battery system, i.e., cell SOC. Finally this algorithm is applied for the SOC determination of lead-acid batteries, and results of lab tests on physical cells, compared with model prediction, are presented. Results show that the ANN based battery system model adaptively simulates battery system with great accuracy, and the predicted SOC simultaneously converges to the real value quickly within the error of +-1 as time goes on.
The fundamentals of fuzzy neural network and application in nuclear monitoring
International Nuclear Information System (INIS)
Feng Diqing; Lei Ming
1995-01-01
The authors presents a fuzzy modeling method using fuzzy neural network with the back-propagation algorithm. The new method can identify the fuzzy model of a nonlinear system automatically. Fuzzy neural network is used to generate fuzzy rules and membership functions. The feasibility and inferential statistic of the method is examined by using numerical data and XOR problem. The FNN improves accuracy and reliability, reduces design time and minimizes system cost of fuzzy design. The FNN can be used for estimation of human injury in nuclear explosions and can be simplified to a rule neural network (RNN), which is used for pole extraction of signal. Preliminary simulation show that FNN has vest vistas in nuclear monitoring
Modeling and prediction of Turkey's electricity consumption using Artificial Neural Networks
International Nuclear Information System (INIS)
Kavaklioglu, Kadir; Ozturk, Harun Kemal; Canyurt, Olcay Ersel; Ceylan, Halim
2009-01-01
Artificial Neural Networks are proposed to model and predict electricity consumption of Turkey. Multi layer perceptron with backpropagation training algorithm is used as the neural network topology. Tangent-sigmoid and pure-linear transfer functions are selected in the hidden and output layer processing elements, respectively. These input-output network models are a result of relationships that exist among electricity consumption and several other socioeconomic variables. Electricity consumption is modeled as a function of economic indicators such as population, gross national product, imports and exports. It is also modeled using export-import ratio and time input only. Performance comparison among different models is made based on absolute and percentage mean square error. Electricity consumption of Turkey is predicted until 2027 using data from 1975 to 2006 along with other economic indicators. The results show that electricity consumption can be modeled using Artificial Neural Networks, and the models can be used to predict future electricity consumption. (author)
Directory of Open Access Journals (Sweden)
Sen Tian
2014-01-01
Full Text Available With the development of mine industry, tailings storage facility (TSF, as the important facility of mining, has attracted increasing attention for its safety problems. However, the problems of low accuracy and slow operation rate often occur in current TSF safety evaluation models. This paper establishes a reasonable TSF safety evaluation index system and puts forward a new TSF safety evaluation model by combining the theories for the analytic hierarchy process (AHP and improved back-propagation (BP neural network algorithm. The varying proportions of cross validation were calculated, demonstrating that this method has better evaluation performance with higher learning efficiency and faster convergence speed and avoids the oscillation in the training process in traditional BP neural network method and other primary neural network methods. The entire analysis shows the combination of the two methods increases the accuracy and reliability of the safety evaluation, and it can be well applied in the TSF safety evaluation.
SPATIAL DATA MINING TOOLBOX FOR MAPPING SUITABILITY OF LANDFILL SITES USING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
S. K. M. Abujayyab
2016-09-01
Full Text Available Mapping the suitability of landfill sites is a complex field and is involved with multidiscipline. The purpose of this research is to create an ArcGIS spatial data mining toolbox for mapping the suitability of landfill sites at a regional scale using neural networks. The toolbox is constructed from six sub-tools to prepare, train, and process data. The employment of the toolbox is straightforward. The multilayer perceptron (MLP neural networks structure with a backpropagation learning algorithm is used. The dataset is mined from the north states in Malaysia. A total of 14 criteria are utilized to build the training dataset. The toolbox provides a platform for decision makers to implement neural networks for mapping the suitability of landfill sites in the ArcGIS environment. The result shows the ability of the toolbox to produce suitability maps for landfill sites.
Using a multi-state recurrent neural network to optimize loading patterns in BWRs
International Nuclear Information System (INIS)
Ortiz, Juan Jose; Requena, Ignacio
2004-01-01
A Multi-State Recurrent Neural Network is used to optimize Loading Patterns (LP) in BWRs. We have proposed an energy function that depends on fuel assembly positions and their nuclear cross sections to carry out optimisation. Multi-State Recurrent Neural Networks creates LPs that satisfy the Radial Power Peaking Factor and maximize the effective multiplication factor at the Beginning of the Cycle, and also satisfy the Minimum Critical Power Ratio and Maximum Linear Heat Generation Rate at the End of the Cycle, thereby maximizing the effective multiplication factor. In order to evaluate the LPs, we have used a trained back-propagation neural network to predict the parameter values, instead of using a reactor core simulator, which saved considerable computation time in the search process. We applied this method to find optimal LPs for five cycles of Laguna Verde Nuclear Power Plant (LVNPP) in Mexico
Application of neural networks to signal prediction in nuclear power plant
International Nuclear Information System (INIS)
Wan Joo Kim; Soon Heung Chang; Byung Ho Lee
1993-01-01
This paper describes the feasibility study of an artificial neural network for signal prediction. The purpose of signal prediction is to estimate the value of undetected next time step signal. As the prediction method, based on the idea of auto regression, a few previous signals are inputs to the artificial neural network and the signal value of next time step is estimated with the outputs of the network. The artificial neural network can be applied to the nonlinear system and answers in short time. The training algorithm is a modified backpropagation model, which can effectively reduce the training time. The target signal of the simulation is the steam generator water level, which is one of the important parameters in nuclear power plants. The simulation result shows that the predicted value follows the real trend well
Putra, J. C. P.; Safrilah
2017-06-01
Artificial neural network approaches are useful to solve many complicated problems. It solves a number of problems in various areas such as engineering, medicine, business, manufacturing, etc. This paper presents an application of artificial neural network to predict a runway capacity at Juanda International Airport. An artificial neural network model of backpropagation and multi-layer perceptron is adopted to this research to learning process of runway capacity at Juanda International Airport. The results indicate that the training data is successfully recognizing the certain pattern of runway use at Juanda International Airport. Whereas, testing data indicate vice versa. Finally, it can be concluded that the approach of uniformity data and network architecture is the critical part to determine the accuracy of prediction results.
Robust recurrent neural network modeling for software fault detection and correction prediction
International Nuclear Information System (INIS)
Hu, Q.P.; Xie, M.; Ng, S.H.; Levitin, G.
2007-01-01
Software fault detection and correction processes are related although different, and they should be studied together. A practical approach is to apply software reliability growth models to model fault detection, and fault correction process is assumed to be a delayed process. On the other hand, the artificial neural networks model, as a data-driven approach, tries to model these two processes together with no assumptions. Specifically, feedforward backpropagation networks have shown their advantages over analytical models in fault number predictions. In this paper, the following approach is explored. First, recurrent neural networks are applied to model these two processes together. Within this framework, a systematic networks configuration approach is developed with genetic algorithm according to the prediction performance. In order to provide robust predictions, an extra factor characterizing the dispersion of prediction repetitions is incorporated into the performance function. Comparisons with feedforward neural networks and analytical models are developed with respect to a real data set
Horizontal ichthyoplankton tow-net system with unobstructed net opening
Nester, Robert T.
1987-01-01
The larval fish sampler described here consists of a modified bridle, frame, and net system with an obstruction-free net opening and is small enough for use on boats 10 m or less in length. The tow net features a square net frame attached to a 0.5-m-diameter cylinder-on-cone plankton net with a bridle designed to eliminate all obstructions forward of the net opening, significantly reducing currents and vibrations in the water directly preceding the net. This system was effective in collecting larvae representing more than 25 species of fish at sampling depths ranging from surface to 10 m and could easily be used at greater depths.
Connelly, William M; Crunelli, Vincenzo; Errington, Adam C
2017-05-24
Backpropagating action potentials (bAPs) are indispensable in dendritic signaling. Conflicting Ca 2+ -imaging data and an absence of dendritic recording data means that the extent of backpropagation in thalamocortical (TC) and thalamic reticular nucleus (TRN) neurons remains unknown. Because TRN neurons signal electrically through dendrodendritic gap junctions and possibly via chemical dendritic GABAergic synapses, as well as classical axonal GABA release, this lack of knowledge is problematic. To address this issue, we made two-photon targeted patch-clamp recordings from rat TC and TRN neuron dendrites to measure bAPs directly. These recordings reveal that "tonic"' and low-threshold-spike (LTS) "burst" APs in both cell types are always recorded first at the soma before backpropagating into the dendrites while undergoing substantial distance-dependent dendritic amplitude attenuation. In TC neurons, bAP attenuation strength varies according to firing mode. During LTS bursts, somatic AP half-width increases progressively with increasing spike number, allowing late-burst spikes to propagate more efficiently into the dendritic tree compared with spikes occurring at burst onset. Tonic spikes have similar somatic half-widths to late burst spikes and undergo similar dendritic attenuation. In contrast, in TRN neurons, AP properties are unchanged between LTS bursts and tonic firing and, as a result, distance-dependent dendritic attenuation remains consistent across different firing modes. Therefore, unlike LTS-associated global electrical and calcium signals, the spatial influence of bAP signaling in TC and TRN neurons is more restricted, with potentially important behavioral-state-dependent consequences for synaptic integration and plasticity in thalamic neurons. SIGNIFICANCE STATEMENT In most neurons, action potentials (APs) initiate in the axosomatic region and propagate into the dendritic tree to provide a retrograde signal that conveys information about the level of
Çebi, A.; Akdoğan, E.; Celen, A.; Dalkilic, A. S.
2017-02-01
An artificial neural network (ANN) model of friction factor in smooth and microfin tubes under heating, cooling and isothermal conditions was developed in this study. Data used in ANN was taken from a vertically positioned heat exchanger experimental setup. Multi-layered feed-forward neural network with backpropagation algorithm, radial basis function networks and hybrid PSO-neural network algorithm were applied to the database. Inputs were the ratio of cross sectional flow area to hydraulic diameter, experimental condition number depending on isothermal, heating, or cooling conditions and mass flow rate while the friction factor was the output of the constructed system. It was observed that such neural network based system could effectively predict the friction factor values of the flows regardless of their tube types. A dependency analysis to determine the strongest parameter that affected the network and database was also performed and tube geometry was found to be the strongest parameter of all as a result of analysis.
Directory of Open Access Journals (Sweden)
Vladimir Lipunov
2010-01-01
Full Text Available The main goal of the MASTER-Net project is to produce a unique fast sky survey with all sky observed over a single night down to a limiting magnitude of 19-20. Such a survey will make it possible to address a number of fundamental problems: search for dark energy via the discovery and photometry of supernovae (including SNIa, search for exoplanets, microlensing effects, discovery of minor bodies in the Solar System, and space-junk monitoring. All MASTER telescopes can be guided by alerts, and we plan to observe prompt optical emission from gamma-ray bursts synchronously in several filters and in several polarization planes.
Determining the confidence levels of sensor outputs using neural networks
Energy Technology Data Exchange (ETDEWEB)
Broten, G S; Wood, H C [Saskatchewan Univ., Saskatoon, SK (Canada). Dept. of Electrical Engineering
1996-12-31
This paper describes an approach for determining the confidence level of a sensor output using multi-sensor arrays, sensor fusion and artificial neural networks. The authors have shown in previous work that sensor fusion and artificial neural networks can be used to learn the relationships between the outputs of an array of simulated partially selective sensors and the individual analyte concentrations in a mixture of analyses. Other researchers have shown that an array of partially selective sensors can be used to determine the individual gas concentrations in a gaseous mixture. The research reported in this paper shows that it is possible to extract confidence level information from an array of partially selective sensors using artificial neural networks. The confidence level of a sensor output is defined as a numeric value, ranging from 0% to 100%, that indicates the confidence associated with a output of a given sensor. A three layer back-propagation neural network was trained on a subset of the sensor confidence level space, and was tested for its ability to generalize, where the confidence level space is defined as all possible deviations from the correct sensor output. A learning rate of 0.1 was used and no momentum terms were used in the neural network. This research has shown that an artificial neural network can accurately estimate the confidence level of individual sensors in an array of partially selective sensors. This research has also shown that the neural network`s ability to determine the confidence level is influenced by the complexity of the sensor`s response and that the neural network is able to estimate the confidence levels even if more than one sensor is in error. The fundamentals behind this research could be applied to other configurations besides arrays of partially selective sensors, such as an array of sensors separated spatially. An example of such a configuration could be an array of temperature sensors in a tank that is not in
Limitations of shallow nets approximation.
Lin, Shao-Bo
2017-10-01
In this paper, we aim at analyzing the approximation abilities of shallow networks in reproducing kernel Hilbert spaces (RKHSs). We prove that there is a probability measure such that the achievable lower bound for approximating by shallow nets can be realized for all functions in balls of reproducing kernel Hilbert space with high probability, which is different with the classical minimax approximation error estimates. This result together with the existing approximation results for deep nets shows the limitations for shallow nets and provides a theoretical explanation on why deep nets perform better than shallow nets. Copyright © 2017 Elsevier Ltd. All rights reserved.
International Nuclear Information System (INIS)
Yang, A.-S.; Kuo, T.-C.; Ling, P.-H.
2003-01-01
The phase transport phenomenon of the high-pressure two-phase turbulent bubbly flow involves complicated interfacial interactions of the mass, momentum, and energy transfer processes between phases, revealing that an enormous effort is required in characterizing the liquid-gas flow behavior. Nonetheless, the instantaneous information of bubbly flow properties is often desired for many industrial applications. This investigation aims to demonstrate the successful use of neural networks in the real-time determination of two-phase flow properties at elevated pressures. Three back-propagation neural networks, trained with the simulation results of a comprehensive theoretical model, are established to predict the transport characteristics (specifically the distributions of void-fraction and axial liquid-gas velocities) of upward turbulent bubbly pipe flows at pressures covering 3.5-7.0 MPa. Comparisons of the predictions with the test target vectors indicate that the averaged root-mean-squared (RMS) error for each one of three back-propagation neural networks is within 4.59%. In addition, this study appraises the effects of different network parameters, including the number of hidden nodes, the type of transfer function, the number of training pairs, the learning rate-increasing ratio, the learning rate-decreasing ratio, and the momentum value, on the training quality of neural networks.
Shielding calculations for NET
International Nuclear Information System (INIS)
Verschuur, K.A.; Hogenbirk, A.
1991-05-01
In the European Fusion Technology Programme there is only a small activity on research and development for fusion neutronics. Never-the-less, looking further than blanket design now, as ECN is getting involved in design of radiation shields for the coils and biological shields, it becomes apparent that fusion neutronics as a whole still needs substantial development. Existing exact codes for calculation of complex geometries like MCNP and DORT/TORT are put over the limits of their numerical capabilities, whilst approximate codes for complex geometries like FURNACE and MERCURE4 are put over the limits of their modelling capabilities. The main objective of this study is just to find out how far we can get with existing codes in obtaining reliable values for the radiation levels inside and outside the cryostat/shield during operation and after shut-down. Starting with a 1D torus model for preliminary parametric studies, more dimensional approximation of the torus or parts of it including the main heterogeneities should follow. Regular contacts with the NET-Team are kept, to be aware of main changes in NET design that might affect our calculation models. Work on the contract started 1 July 1990. The technical description of the contract is given. (author). 14 refs.; 4 figs.; 1 tab
Neural Network Approach to Locating Cryptography in Object Code
Energy Technology Data Exchange (ETDEWEB)
Jason L. Wright; Milos Manic
2009-09-01
Finding and identifying cryptography is a growing concern in the malware analysis community. In this paper, artificial neural networks are used to classify functional blocks from a disassembled program as being either cryptography related or not. The resulting system, referred to as NNLC (Neural Net for Locating Cryptography) is presented and results of applying this system to various libraries are described.
Vector neural net identifying many strongly distorted and correlated patterns
Kryzhanovsky, Boris V.; Mikaelian, Andrei L.; Fonarev, Anatoly B.
2005-01-01
We suggest an effective and simple algorithm providing a polynomial storage capacity of a network of the form M ~ N2s+1, where N is the dimension of the stored binary patterns. In this problem the value of the free parameter s is restricted by the inequalities N >> slnN >= 1. The algorithm allows us to identify a large number of highly distorted similar patterns. The negative influence of correlations of the patterns is suppressed by choosing a sufficiently large value of the parameter s. We show the efficiency of the algorithm by the example of a perceptron identifier, but it also can be used to increase the storage capacity of full connected systems of associative memory.
Intelligent control aspects of fuzzy logic and neural nets
Harris, C J; Brown, M
1993-01-01
With increasing demands for high precision autonomous control over wide operating envelopes, conventional control engineering approaches are unable to adequately deal with system complexity, nonlinearities, spatial and temporal parameter variations, and with uncertainty. Intelligent Control or self-organising/learning control is a new emerging discipline that is designed to deal with problems. Rather than being model based, it is experiential based. Intelligent Control is the amalgam of the disciplines of Artificial Intelligence, Systems Theory and Operations Research. It uses most recent expe
An Automation Framework for Neural Nets that Learn
Kilmer, W. L.; Arbib, M. A.
1973-01-01
A discussion of several types of formal neurons, many of whose functions are modifiable by their own input stimuli. The language of finite automata is used to mathematicize the problem of adaptation sufficiently to remove some ambiguities of Brindley's approach. (Author)
Speech Recognition Using Neural Nets and Dynamic Time Warping
1988-12-01
flost tmap [~J20J0[16J; mnt r, Ci: double diet ; double minimum =99M9.9; for (r =0; r < fysize ; ri-i-){ for (c =0; c f xeize ; c+ +){ diet 6 .0; for...i)[1] = (location[iflO] 0); Lmindist (I map, inp, close) double inp[16J; mrt close [2] float tmap [20(201[161 double diet ; double minimum 9.99e31
Statistical interpretation of WEBNET seismograms by artificial neural nets
Czech Academy of Sciences Publication Activity Database
Plešinger, Axel; Růžek, Bohuslav; Boušková, Alena
2000-01-01
Roč. 44, č. 2 (2000), s. 251-271 ISSN 0039-3169 R&D Projects: GA AV ČR IAA312104; GA ČR GA205/99/0907 Institutional research plan: CEZ:AV0Z3012916 Subject RIV: DC - Siesmology, Volcanology, Earth Structure Impact factor: 0.761, year: 2000
The equivalency between logic Petri workflow nets and workflow nets.
Wang, Jing; Yu, ShuXia; Du, YuYue
2015-01-01
Logic Petri nets (LPNs) can describe and analyze batch processing functions and passing value indeterminacy in cooperative systems. Logic Petri workflow nets (LPWNs) are proposed based on LPNs in this paper. Process mining is regarded as an important bridge between modeling and analysis of data mining and business process. Workflow nets (WF-nets) are the extension to Petri nets (PNs), and have successfully been used to process mining. Some shortcomings cannot be avoided in process mining, such as duplicate tasks, invisible tasks, and the noise of logs. The online shop in electronic commerce in this paper is modeled to prove the equivalence between LPWNs and WF-nets, and advantages of LPWNs are presented.
The Equivalency between Logic Petri Workflow Nets and Workflow Nets
Wang, Jing; Yu, ShuXia; Du, YuYue
2015-01-01
Logic Petri nets (LPNs) can describe and analyze batch processing functions and passing value indeterminacy in cooperative systems. Logic Petri workflow nets (LPWNs) are proposed based on LPNs in this paper. Process mining is regarded as an important bridge between modeling and analysis of data mining and business process. Workflow nets (WF-nets) are the extension to Petri nets (PNs), and have successfully been used to process mining. Some shortcomings cannot be avoided in process mining, such as duplicate tasks, invisible tasks, and the noise of logs. The online shop in electronic commerce in this paper is modeled to prove the equivalence between LPWNs and WF-nets, and advantages of LPWNs are presented. PMID:25821845
DEFF Research Database (Denmark)
Andersen, Christian Ulrik; Lindstrøm, Hanne
2006-01-01
The seminar Art|Net|Work deals with two important changes in our culture. On one side, the network has become essential in the latest technological development. The Internet has entered a new phase, Web 2.0, including the occurrence of as ‘Wiki’s’, ‘Peer-2-Peer’ distribution, user controlled...... on the ‘network’ itself as a phenomenon and are often using technological networks as a mean of production and distribution. This changes the artistic practice and the distribution channels of art works – and the traditional notions of ‘work’, ‘origin’ and ‘rights’ are increasingly perceived as limiting...... the praxis of the artist. We see different kinds of interventions and activism (including ‘hacktivism’) using the network as a way of questioning the invisible rules that govern public and semi-public spaces. Who ‘owns’ them? What kind of social relationships do they generate? On what principle...
DEFF Research Database (Denmark)
Christensen, Henrik Bærbak; Hansen, Klaus Marius
2012-01-01
, health centers are getting larger and more distributed, and the number of healthcare professionals does not follow the trend in chronic diseases. All of this leads to a need for telemedical and mobile health applications. In a Danish context, these applications are often developed through local...... (innovative) initiatives with little regards for national and global (standardization) initiatives. A reason for this discrepancy is that the software architecture for national (and global) systems and standards are hard to understand, hard to develop systems based on, and hard to deploy. To counter this, we...... propose a software ecosystem approach for telemedicine applications, providing a framework, Net4Care, encapsulating national/global design decisions with respect to standardization while allowing for local innovation. This paper presents an analysis of existing systems, of requirements for a software...
Using neural networks for prediction of nuclear parameters
Energy Technology Data Exchange (ETDEWEB)
Pereira Filho, Leonidas; Souto, Kelling Cabral, E-mail: leonidasmilenium@hotmail.com, E-mail: kcsouto@bol.com.br [Instituto Federal de Educacao, Ciencia e Tecnologia do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ (Brazil); Machado, Marcelo Dornellas, E-mail: dornemd@eletronuclear.gov.br [Eletrobras Termonuclear S.A. (GCN.T/ELETRONUCLEAR), Rio de Janeiro, RJ (Brazil). Gerencia de Combustivel Nuclear
2013-07-01
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Using neural networks for prediction of nuclear parameters
International Nuclear Information System (INIS)
Pereira Filho, Leonidas; Souto, Kelling Cabral; Machado, Marcelo Dornellas
2013-01-01
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Empirical modeling of nuclear power plants using neural networks
International Nuclear Information System (INIS)
Parlos, A.G.; Atiya, A.; Chong, K.T.
1991-01-01
A summary of a procedure for nonlinear identification of process dynamics encountered in nuclear power plant components is presented in this paper using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the nonlinear structure for system identification. In the overall identification process, the feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of time-dependent system nonlinearities. The standard backpropagation learning algorithm is modified and is used to train the proposed hybrid network in a supervised manner. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The nonlinear response of a representative steam generator is predicted using a neural network and is compared to the response obtained from a sophisticated physical model during both high- and low-power operation. The transient responses compare well, though further research is warranted for training and testing of recurrent neural networks during more severe operational transients and accident scenarios
Vibration monitoring of EDF rotating machinery using artificial neural networks
International Nuclear Information System (INIS)
Alguindigue, I.E.; Loskiewicz-Buczak, A.; Uhrig, R.E.; Hamon, L.; Lefevre, F.
1991-01-01
Vibration monitoring of components in nuclear power plants has been used for a number of years. This technique involves the analysis of vibration data coming from vital components of the plant to detect features which reflect the operational state of machinery. The analysis leads to the identification of potential failures and their causes, and makes it possible to perform efficient preventive maintenance. Earlydetection is important because it can decrease the probability of catastrophic failures, reduce forced outgage, maximize utilization of available assets, increase the life of the plant, and reduce maintenance costs. This paper documents our work on the design of a vibration monitoring methodology based on neural network technology. This technology provides an attractive complement to traditional vibration analysis because of the potential of neural networks to operate in real-time mode and to handle data which may be distorted or noisy. Our efforts have been concentrated on the analysis and classification of vibration signatures collected by Electricite de France (EDF). Two neural networks algorithms were used in our project: the Recirculation algorithm and the Backpropagation algorithm. Although this project is in the early stages of development it indicates that neural networks may provide a viable methodology for monitoring and diagnostics of vibrating components. Our results are very encouraging
International Nuclear Information System (INIS)
Smith, Patrick I.
2003-01-01
Physicists use large detectors to measure particles created in high-energy collisions at particle accelerators. These detectors typically produce signals indicating either where ionization occurs along the path of the particle, or where energy is deposited by the particle. The data produced by these signals is fed into pattern recognition programs to try to identify what particles were produced, and to measure the energy and direction of these particles. Ideally, there are many techniques used in this pattern recognition software. One technique, neural networks, is particularly suitable for identifying what type of particle caused by a set of energy deposits. Neural networks can derive meaning from complicated or imprecise data, extract patterns, and detect trends that are too complex to be noticed by either humans or other computer related processes. To assist in the advancement of this technology, Physicists use a tool kit to experiment with several neural network techniques. The goal of this research is interface a neural network tool kit into Java Analysis Studio (JAS3), an application that allows data to be analyzed from any experiment. As the final result, a physicist will have the ability to train, test, and implement a neural network with the desired output while using JAS3 to analyze the results or output. Before an implementation of a neural network can take place, a firm understanding of what a neural network is and how it works is beneficial. A neural network is an artificial representation of the human brain that tries to simulate the learning process [5]. It is also important to think of the word artificial in that definition as computer programs that use calculations during the learning process. In short, a neural network learns by representative examples. Perhaps the easiest way to describe the way neural networks learn is to explain how the human brain functions. The human brain contains billions of neural cells that are responsible for processing
Evolvable synthetic neural system
Curtis, Steven A. (Inventor)
2009-01-01
An evolvable synthetic neural system includes an evolvable neural interface operably coupled to at least one neural basis function. Each neural basis function includes an evolvable neural interface operably coupled to a heuristic neural system to perform high-level functions and an autonomic neural system to perform low-level functions. In some embodiments, the evolvable synthetic neural system is operably coupled to one or more evolvable synthetic neural systems in a hierarchy.
DEFF Research Database (Denmark)
various journals and collections. As a result, much of this knowledge is not readily available to people who may be interested in using high-level nets. Within the Petri net community this problem has been discussed many times, and as an outcome this book has been compiled. The book contains reprints...... of some of the most important papers on the application and theory of high-level Petri nets. In this way it makes the relevant literature more available. It is our hope that the book will be a useful source of information and that, e.g., it can be used in the organization of Petri net courses. To make......High-level Petri nets are now widely used in both theoretical analysis and practical modelling of concurrent systems. The main reason for the success of this class of net models is that they make it possible to obtain much more succinct and manageable descriptions than can be obtained by means...
Research on artificial neural network applications for nuclear power plants
International Nuclear Information System (INIS)
Chang, Soon-Heung; Cheon, Se-Woo
1992-01-01
Artificial neural networks (ANNs) are an emerging computational technology which can significantly enhance a number of applications. These consist of many interconnected processing elements that exhibit human-like performance, i.e., learning, pattern recognition and associative memory skills. Several application studies on ANNs devoted to nuclear power plants have been carried out at the Korea Advanced Institute of Science and Technology since 1989. These studies include the feasibility of using ANNs for the following tasks: (1) thermal power prediction, (2) transient identification, (3) multiple alarm processing and diagnosis, (4) core thermal margin prediction, and (5) prediction of core parameters for fuel reloading. This paper introduces the back-propagation network (BPN) model which is the most commonly used algorithm, and summarizes each of the studies briefly. (author)
Power plant fault detection using artificial neural network
Thanakodi, Suresh; Nazar, Nazatul Shiema Moh; Joini, Nur Fazriana; Hidzir, Hidzrin Dayana Mohd; Awira, Mohammad Zulfikar Khairul
2018-02-01
The fault that commonly occurs in power plants is due to various factors that affect the system outage. There are many types of faults in power plants such as single line to ground fault, double line to ground fault, and line to line fault. The primary aim of this paper is to diagnose the fault in 14 buses power plants by using an Artificial Neural Network (ANN). The Multilayered Perceptron Network (MLP) that detection trained utilized the offline training methods such as Gradient Descent Backpropagation (GDBP), Levenberg-Marquardt (LM), and Bayesian Regularization (BR). The best method is used to build the Graphical User Interface (GUI). The modelling of 14 buses power plant, network training, and GUI used the MATLAB software.
Towards semen quality assessment using neural networks
DEFF Research Database (Denmark)
Linneberg, Christian; Salamon, P.; Svarer, C.
1994-01-01
The paper presents the methodology and results from a neural net based classification of human sperm head morphology. The methodology uses a preprocessing scheme in which invariant Fourier descriptors are lumped into “energy” bands. The resulting networks are pruned using optimal brain damage. Pe...
WATER DEMAND PREDICTION USING ARTIFICIAL NEURAL ...
African Journals Online (AJOL)
This paper presents Hourly water demand prediction at the demand nodes of a water distribution network using NeuNet Pro 2.3 neural network software and the monitoring and control of water distribution using supervisory control. The case study is the Laminga Water Treatment Plant and its water distribution network, Jos.
Net neutrality and audiovisual services
van Eijk, N.; Nikoltchev, S.
2011-01-01
Net neutrality is high on the European agenda. New regulations for the communication sector provide a legal framework for net neutrality and need to be implemented on both a European and a national level. The key element is not just about blocking or slowing down traffic across communication networks: the control over the distribution of audiovisual services constitutes a vital part of the problem. In this contribution, the phenomenon of net neutrality is described first. Next, the European a...
1993-01-01
This is the Final Technical Report for the NetView Technical Research task. This report is prepared in accordance with Contract Data Requirements List (CDRL) item A002. NetView assistance was provided and details are presented under the following headings: NetView Management Systems (NMS) project tasks; WBAFB IBM 3090; WPAFB AMDAHL; WPAFB IBM 3084; Hill AFB; McClellan AFB AMDAHL; McClellan AFB IBM 3090; and Warner-Robins AFB.
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.
relevance to the practicing engineer. Such a scheme of updating parameters (connection weights in the case of neu- ral network) is not employed in the suggested ANN model; thus, the ANN model, where the parameters are estimated from only one-day data... term hourly tidal records. However, there are a number of points to be clarified in order to better understand the paper. This discussion focuses on the following four areas: (1) terminology used in the paper; (2) practical utility; (3) reliability...
Han, Hyung-Suk
2012-01-01
The indoor noise of a ship is usually determined using the A-weighted sound pressure level. However, in order to better understand this phenomenon, evaluation parameters that more accurately reflect the human sense of hearing are required. To find the level of the satisfaction index of the noise inside a naval vessel such as “Loudness” and “Annoyance”, psycho-acoustic evaluation of various sound recordings from the naval vessel was performed in a laboratory. The objective of this paper is to ...
Initial CAD investigations for NET
International Nuclear Information System (INIS)
Katz, F.; Leinemann, K.; Ludwig, A.; Marek, U.; Olbrich, W.; Schlechtendahl, E.G.
1985-11-01
This report summarizes the work done under contract no. 164/84-7/FU-D-/NET between the Commission of the European Communities and KfK during the period from June 1, 1984, through May 31, 1985. The following topics are covered in this report: Initial modelling of NET version NET2A, CAD system extension for remote handling studies, analysis of the CAD information structure, work related to the transfer of CAD information between KfK and the NET team. (orig.) [de
Understanding Net Zero Energy Buildings
DEFF Research Database (Denmark)
Salom, Jaume; Widén, Joakim; Candanedo, José
2011-01-01
Although several alternative definitions exist, a Net-Zero Energy Building (Net ZEB) can be succinctly described as a grid-connected building that generates as much energy as it uses over a year. The “net-zero” balance is attained by applying energy conservation and efficiency measures...... and by incorporating renewable energy systems. While based on annual balances, a complete description of a Net ZEB requires examining the system at smaller time-scales. This assessment should address: (a) the relationship between power generation and building loads and (b) the resulting interaction with the power grid...
Algebraic and adaptive learning in neural control systems
Ferrari, Silvia
A systematic approach is developed for designing adaptive and reconfigurable nonlinear control systems that are applicable to plants modeled by ordinary differential equations. The nonlinear controller comprising a network of neural networks is taught using a two-phase learning procedure realized through novel techniques for initialization, on-line training, and adaptive critic design. A critical observation is that the gradients of the functions defined by the neural networks must equal corresponding linear gain matrices at chosen operating points. On-line training is based on a dual heuristic adaptive critic architecture that improves control for large, coupled motions by accounting for actual plant dynamics and nonlinear effects. An action network computes the optimal control law; a critic network predicts the derivative of the cost-to-go with respect to the state. Both networks are algebraically initialized based on prior knowledge of satisfactory pointwise linear controllers and continue to adapt on line during full-scale simulations of the plant. On-line training takes place sequentially over discrete periods of time and involves several numerical procedures. A backpropagating algorithm called Resilient Backpropagation is modified and successfully implemented to meet these objectives, without excessive computational expense. This adaptive controller is as conservative as the linear designs and as effective as a global nonlinear controller. The method is successfully implemented for the full-envelope control of a six-degree-of-freedom aircraft simulation. The results show that the on-line adaptation brings about improved performance with respect to the initialization phase during aircraft maneuvers that involve large-angle and coupled dynamics, and parameter variations.
Rare, but challenging tumors: NET
International Nuclear Information System (INIS)
Ivanova, D.; Balev, B.
2013-01-01
Full text: Introduction: Gastroenteropancreatic Neuroendocrine Tumors (GEP - NET) are a heterogeneous group of tumors with different locations and many different clinical, histological, and imaging performance. In a part of them a secretion of various organic substances is present. The morbidity of GEP - NET in the EU is growing, and this leads to increase the attention to them. What you will learn: Imaging methods used for localization and staging of GEP - NET, characteristics of the study’s protocols; Classification of GEP - NET; Demonstration of typical and atypical imaging features of GEP - NET in patients registered at the NET Center at University Hospital ‘St. Marina’, Varna; Features of metastatic NET, The role of imaging in the evaluation of treatment response and follow-up of the patients. Discussion: The image semiotics analysis is based on 19 cases of GEP - NET registered NET Center at University Hospital ‘St. Marina’. The main imaging method is multidetector CT (MDCT), and magnetic resonance imaging (MRI ) has advantages in the evaluation of liver lesions and the local prevalence of anorectal tumors. In patients with advanced disease and liver lesions the assessment of skeletal involvement (MRI/ nuclear medical method) is mandatory. The majority of GEP - NET have not any specific imaging findings. Therefore it is extremely important proper planning and conducting of the study (MDCT and MR enterography; accurate assessment phase of scanning, positive and negative contrast). Conclusion: GEP - NET is a major diagnostic challenge due to the absence of typical imaging characteristics and often an overlap with those of the tumors of different origin can be observed. Therefore, a good knowledge of clinical and imaging changes occurring at different locations is needed. MDCT is the basis for the diagnosis, staging and follow-up of these neoplasms
Directory of Open Access Journals (Sweden)
Hing Wah LEE
2009-03-01
Full Text Available In this study, a general purpose Artificial Neural Network (ANN model based on the feed-forward back-propagation (FFBP algorithm has been used to predict the deflections of a micromachined structures actuated electrostatically under different loadings and geometrical parameters. A limited range of simulation results obtained via CoventorWare™ numerical software will be used initially to train the neural network via back-propagation algorithm. The micromachined structures considered in the analyses are diaphragm, fixed-fixed beams and cantilevers. ANN simulation results are compared with results obtained via CoventorWare™ simulations and existing analytical work for validation purpose. The proposed ANN model accurately predicts the deflections of the micromachined structures with great reduction of simulation efforts, establishing the method superiority. This method can be extended for applications in other sensors particularly for modeling sensors applying electrostatic actuation which are difficult in nature due to the inherent non-linearity of the electro-mechanical coupling response.
Khellal, Atmane; Ma, Hongbin; Fei, Qing
2018-05-09
The success of Deep Learning models, notably convolutional neural networks (CNNs), makes them the favorable solution for object recognition systems in both visible and infrared domains. However, the lack of training data in the case of maritime ships research leads to poor performance due to the problem of overfitting. In addition, the back-propagation algorithm used to train CNN is very slow and requires tuning many hyperparameters. To overcome these weaknesses, we introduce a new approach fully based on Extreme Learning Machine (ELM) to learn useful CNN features and perform a fast and accurate classification, which is suitable for infrared-based recognition systems. The proposed approach combines an ELM based learning algorithm to train CNN for discriminative features extraction and an ELM based ensemble for classification. The experimental results on VAIS dataset, which is the largest dataset of maritime ships, confirm that the proposed approach outperforms the state-of-the-art models in term of generalization performance and training speed. For instance, the proposed model is up to 950 times faster than the traditional back-propagation based training of convolutional neural networks, primarily for low-level features extraction.
Earthquake-induced landslide-susceptibility mapping using an artificial neural network
Directory of Open Access Journals (Sweden)
S. Lee
2006-01-01
Full Text Available The purpose of this study was to apply and verify landslide-susceptibility analysis techniques using an artificial neural network and a Geographic Information System (GIS applied to Baguio City, Philippines. The 16 July 1990 earthquake-induced landslides were studied. Landslide locations were identified from interpretation of aerial photographs and field survey, and a spatial database was constructed from topographic maps, geology, land cover and terrain mapping units. Factors that influence landslide occurrence, such as slope, aspect, curvature and distance from drainage were calculated from the topographic database. Lithology and distance from faults were derived from the geology database. Land cover was identified from the topographic database. Terrain map units were interpreted from aerial photographs. These factors were used with an artificial neural network to analyze landslide susceptibility. Each factor weight was determined by a back-propagation exercise. Landslide-susceptibility indices were calculated using the back-propagation weights, and susceptibility maps were constructed from GIS data. The susceptibility map was compared with known landslide locations and verified. The demonstrated prediction accuracy was 93.20%.
DEFF Research Database (Denmark)
Engberg, Uffe Henrik; Winskel, Glynn
This article shows how individual Petri nets form models of Girard's intuitionistic linear logic. It explores questions of expressiveness and completeness of linear logic with respect to this interpretation. An aim is to use Petri nets to give an understanding of linear logic and give some apprai...
Net neutrality and audiovisual services
van Eijk, N.; Nikoltchev, S.
2011-01-01
Net neutrality is high on the European agenda. New regulations for the communication sector provide a legal framework for net neutrality and need to be implemented on both a European and a national level. The key element is not just about blocking or slowing down traffic across communication
Directory of Open Access Journals (Sweden)
Ruiyi Que
2012-08-01
Full Text Available Air speed, angle of sideslip and angle of attack are fundamental aerodynamic parameters for controlling most aircraft. For small aircraft for which conventional detecting devices are too bulky and heavy to be utilized, a novel and practical methodology by which the aerodynamic parameters are inferred using a micro hot-film flow sensor array mounted on the surface of the wing is proposed. A back-propagation neural network is used to model the coupling relationship between readings of the sensor array and aerodynamic parameters. Two different sensor arrangements are tested in wind tunnel experiments and dependence of the system performance on the sensor arrangement is analyzed.
Properties of porous netted materials
International Nuclear Information System (INIS)
Daragan, V.D.; Drozdov, B.G.; Kotov, A.Yu.; Mel'nikov, G.N.; Pustogarov, A.V.
1987-01-01
Hydraulic and strength characteristics, efficient heat conduction and inner heat exchange coefficient are experimentally studied for porous netted materials on the base of the brass nets as dependent on porosity, cell size and method of net laying. Results of the studies are presented. It is shown that due to anisotropy of the material properties the hydraulic resistance in the direction parallel to the nets plane is 1.3-1.6 times higher than in the perpendicular one. Values of the effective heat conduction in the direction perpendicular to the nets plane at Π>0.45 agree with the data from literature, at Π<0.45 a deviation from the calculated values is marked in the direction of the heat conduction decrease
International Nuclear Information System (INIS)
Leinemann, K.
1990-10-01
The goal of this NET study was to define the functionality of a remote handling workstation and its hardware and software architecture. The remote handling workstation has to fulfill two basic functions: (1) to provide the man-machine interface (MMI), that means the interface to the control system of the maintenance equipment and to the working environment (telepresence) and (2) to provide high level (task level) supporting functions (software tools) during the maintenance work and in the preparation phase. Concerning the man-machine interface, an important module of the remote handling workstation besides the standard components of man-machine interfacing is a module for graphical scene presentation supplementing viewing by TV. The technique of integrated viewing is well known from JET BOOM and TARM control using the GBsim and KISMET software. For integration of equipment dependent MMI functions the remote handling workstation provides a special software module interface. Task level support of the operator is based on (1) spatial (geometric/kinematic) models, (2) remote handling procedure models, and (3) functional models of the equipment. These models and the related simulation modules are used for planning, programming, execution monitoring, and training. The workstation provides an intelligent handbook guiding the operator through planned procedures illustrated by animated graphical sequences. For unplanned situations decision aids are available. A central point of the architectural design was to guarantee a high flexibility with respect to hardware and software. Therefore the remote handling workstation is designed as an open system based on widely accepted standards allowing the stepwise integration of the various modules starting with the basic MMI and the spatial simulation as standard components. (orig./HP) [de
Directory of Open Access Journals (Sweden)
Yasir Hassan Ali
2015-01-01
Full Text Available The thickness of an oil film lubricant can contribute to less gear tooth wear and surface failure. The purpose of this research is to use artificial neural network (ANN computational modelling to correlate spur gear data from acoustic emissions, lubricant temperature, and specific film thickness (λ. The approach is using an algorithm to monitor the oil film thickness and to detect which lubrication regime the gearbox is running either hydrodynamic, elastohydrodynamic, or boundary. This monitoring can aid identification of fault development. Feed-forward and recurrent Elman neural network algorithms were used to develop ANN models, which are subjected to training, testing, and validation process. The Levenberg-Marquardt back-propagation algorithm was applied to reduce errors. Log-sigmoid and Purelin were identified as suitable transfer functions for hidden and output nodes. The methods used in this paper shows accurate predictions from ANN and the feed-forward network performance is superior to the Elman neural network.
Directory of Open Access Journals (Sweden)
A. K. CHOWDHURY
2016-02-01
Full Text Available In this paper an evolutionary technique for synthesizing Multi-Valued Logic (MVL functions using Neural Network Deployment Algorithm (NNDA is presented. The algorithm is combined with back-propagation learning capability and neural MVL operators. This research article is done to observe the anomalistic characteristics of MVL neural operators and their role in synthesis. The advantages of NNDA-MVL algorithm is demonstrated with realization of synthesized many valued functions with lesser MVL operators. The characteristic feature set consists of MVL gate count, network link count, network propagation delay and accuracy achieved in training. In brief, this paper depicts an effort of reduced network size for synthesized MVL functions. Trained MVL operators improve the basic architecture by reducing MIN gate and interlink connection by 52.94% and 23.38% respectively.
Diagnosis method utilizing neural networks
International Nuclear Information System (INIS)
Watanabe, K.; Tamayama, K.
1990-01-01
Studies have been made on the technique of neural networks, which will be used to identify a cause of a small anomalous state in the reactor coolant system of the ATR (Advance Thermal Reactor). Three phases of analyses were carried out in this study. First, simulation for 100 seconds was made to determine how the plant parameters respond after the occurence of a transient decrease in reactivity, flow rate and temperature of feed water and increase in the steam flow rate and steam pressure, which would produce a decrease of water level in a steam drum of the ATR. Next, the simulation data was analysed utilizing an autoregressive model. From this analysis, a total of 36 coherency functions up to 0.5 Hz in each transient were computed among nine important and detectable plant parameters: neutron flux, flow rate of coolant, steam or feed water, water level in the steam drum, pressure and opening area of control valve in a steam pipe, feed water temperature and electrical power. Last, learning of neural networks composed of 96 input, 4-9 hidden and 5 output layer units was done by use of the generalized delta rule, namely a back-propagation algorithm. These convergent computations were continued as far as the difference between the desired outputs, 1 for direct cause or 0 for four other ones and actual outputs reached less than 10%. (1) Coherency functions were not governed by decreasing rate of reactivity in the range of 0.41x10 -2 dollar/s to 1.62x10 -2 dollar /s or by decreasing depth of the feed water temperature in the range of 3 deg C to 10 deg C or by a change of 10% or less in the three other causes. Change in coherency functions only depended on the type of cause. (2) The direct cause from the other four ones could be discriminated with 0.94+-0.01 of output level. A maximum of 0.06 output height was found among the other four causes. (3) Calculation load which is represented as products of learning times and numbers of the hidden units did not depend on the
Directory of Open Access Journals (Sweden)
Aleksius Madu
2016-10-01
Full Text Available The purpose of this study is to predict the number of traffic accident victims who died in Timor Tengah Regency with Trend Projection method and Backpropagation method, and compare the two methods based on the degree of guilt and predict the number traffic accident victims in the Timor Tengah Regency for the coming year. This research was conducted in Timor Tengah Regency where data used in this study was obtained from Police Unit in Timor Tengah Regency. The data is on the number of traffic accidents in Timor Tengah Regency from 2000 – 2013, which is obtained by a quantitative analysis with Trend Projection and Backpropagation method. The results of the data analysis predicting the number of traffic accidents victims using Trend Projection method obtained the best model which is the quadratic trend model with equation Yk = 39.786 + (3.297 X + (0.13 X2. Whereas by using back propagation method, it is obtained the optimum network that consists of 2 inputs, 3 hidden screens, and 1 output. Based on the error rates obtained, Back propagation method is better than the Trend Projection method which means that the predicting accuracy with Back propagation method is the best method to predict the number of traffic accidents victims in Timor Tengah Regency. Thus obtained predicting the numbers of traffic accident victims for the next 5 years (Years 2014-2018 respectively - are 106 person, 115 person, 115 person, 119 person and 120 person. Keywords: Trend Projection, Back propagation, Predicting.
Neural Network Prediction of Disruptions Caused by Locked Modes on J-TEXT Tokamak
International Nuclear Information System (INIS)
Ding Yonghua; Jin Xuesong; Chen Zhenzhen; Zhuang Ge
2013-01-01
Prediction of disruptions caused by locked modes using the Back-Propagation (BP) neural network is completed on J-TEXT tokamak. The network, which is based on the BP neural network, uses Mirnov coils and locked mode coils signals as input data, and outputs a signal including information of prediction of locked mode. The rate of successful prediction of locked modes is more than 90%. For intrinsic locked mode disruptions, the network can give a prewarning signal about 1 ms ahead of the locking-time. For the disruption caused by resonant magnetic perturbation (RMPs) locked modes, the network can give a prewarning signal about 10 ms ahead of the locking-time
International Nuclear Information System (INIS)
Reifman, J.; Vitela, E.J.; Lee, J.C.
1993-01-01
Two complementary methods, statistical feature selection and nonlinear optimization through conjugate gradients, are used to expedite feedforward neural network training. Statistical feature selection techniques in the form of linear correlation coefficients and information-theoretic entropy are used to eliminate redundant and non-informative plant parameters to reduce the size of the network. The method of conjugate gradients is used to accelerate the network training convergence and to systematically calculate the Teaming and momentum constants at each iteration. The proposed techniques are compared with the backpropagation algorithm using the entire set of plant parameters in the training of neural networks to identify transients simulated with the Midland Nuclear Power Plant Unit 2 simulator. By using 25% of the plant parameters and the conjugate gradients, a 30-fold reduction in CPU time was obtained without degrading the diagnostic ability of the network
Classification of brain compartments and head injury lesions by neural networks applied to MRI
International Nuclear Information System (INIS)
Kischell, E.R.; Kehtarnavaz, N.; Hillman, G.R.; Levin, H.; Lilly, M.; Kent, T.A.
1995-01-01
An automatic, neural network-based approach was applied to segment normal brain compartments and lesions on MR images. Two supervised networks, backpropagation (BPN) and counterpropagation, and two unsupervised networks, Kohonen learning vector quantizer and analog adaptive resonance theory, were trained on registered T2-weighted and proton density images. The classes of interest were background, gray matter, white matter, cerebrospinal fluid, macrocystic encephalomalacia, gliosis, and 'unknown'. A comprehensive feature vector was chosen to discriminate these classes. The BPN combined with feature conditioning, multiple discriminant analysis followed by Hotelling transform, produced the most accurate and consistent classification results. Classifications of normal brain compartments were generally in agreement with expert interpretation of the images. Macrocystic encephalomalacia and gliosis were recognized and, except around the periphery, classified in agreement with the clinician's report used to train the neural network. (orig.)
Hysteretic recurrent neural networks: a tool for modeling hysteretic materials and systems
International Nuclear Information System (INIS)
Veeramani, Arun S; Crews, John H; Buckner, Gregory D
2009-01-01
This paper introduces a novel recurrent neural network, the hysteretic recurrent neural network (HRNN), that is ideally suited to modeling hysteretic materials and systems. This network incorporates a hysteretic neuron consisting of conjoined sigmoid activation functions. Although similar hysteretic neurons have been explored previously, the HRNN is unique in its utilization of simple recurrence to 'self-select' relevant activation functions. Furthermore, training is facilitated by placing the network weights on the output side, allowing standard backpropagation of error training algorithms to be used. We present two- and three-phase versions of the HRNN for modeling hysteretic materials with distinct phases. These models are experimentally validated using data collected from shape memory alloys and ferromagnetic materials. The results demonstrate the HRNN's ability to accurately generalize hysteretic behavior with a relatively small number of neurons. Additional benefits lie in the network's ability to identify statistical information concerning the macroscopic material by analyzing the weights of the individual neurons
Hayashi, Hideaki; Shima, Keisuke; Shibanoki, Taro; Kurita, Yuichi; Tsuji, Toshio
2013-01-01
This paper outlines a probabilistic neural network developed on the basis of time-series discriminant component analysis (TSDCA) that can be used to classify high-dimensional time-series patterns. TSDCA involves the compression of high-dimensional time series into a lower-dimensional space using a set of orthogonal transformations and the calculation of posterior probabilities based on a continuous-density hidden Markov model that incorporates a Gaussian mixture model expressed in the reduced-dimensional space. The analysis can be incorporated into a neural network so that parameters can be obtained appropriately as network coefficients according to backpropagation-through-time-based training algorithm. The network is considered to enable high-accuracy classification of high-dimensional time-series patterns and to reduce the computation time taken for network training. In the experiments conducted during the study, the validity of the proposed network was demonstrated for EEG signals.
Smith, James A.
1992-01-01
The inversion of the leaf area index (LAI) canopy parameter from optical spectral reflectance measurements is obtained using a backpropagation artificial neural network trained using input-output pairs generated by a multiple scattering reflectance model. The problem of LAI estimation over sparse canopies (LAI 1000 percent for low LAI. Minimization methods applied to merit functions constructed from differences between measured reflectances and predicted reflectances using multiple-scattering models are unacceptably sensitive to a good initial guess for the desired parameter. In contrast, the neural network reported generally yields absolute percentage errors of <30 percent when weighting coefficients trained on one soil type were applied to predicted canopy reflectance at a different soil background.