Modular, Multilayer Perceptron
Cheng, Li-Jen; Liu, Tsuen-Hsi
1991-01-01
Combination of proposed modular, multilayer perceptron and algorithm for its operation recognizes new objects after relatively brief retraining sessions. (Perceptron is multilayer, feedforward artificial neural network fully connected and trained via back-propagation learning algorithm.) Knowledge pertaining to each object to be recognized resides in subnetwork of full network, therefore not necessary to retrain full network to recognize each new object.
Prediction of Parametric Roll Resonance by Multilayer Perceptron Neural Network
DEFF Research Database (Denmark)
Míguez González, M; López Peña, F.
2011-01-01
Parametric roll resonance is a ship stability related phenomenon that generates sudden large amplitude oscillations up to 30-40 degrees of roll. This can cause severe damage, and it can put the crew in serious danger. The need for a parametric rolling real time prediction system has been acknowledged in the last few years. This work proposes a prediction system based on a multilayer perceptron (MP) neural network. The training and testing of the MP network is accomplished by feeding it with simulated data of a three degrees-of-freedom nonlinear model of a fishing vessel. The neural network is shown to be capable of forecasting the ship’s roll motion in realistic scenarios.
Inversion of Self Potential Anomalies with Multilayer Perceptron Neural Networks
Kaftan, Ilknur; S?nd?rg?, Petek; Akdemir, Özer
2014-08-01
This study investigates the inverse solution on a buried and polarized sphere-shaped body using the self-potential method via multilayer perceptron neural networks (MLPNN). The polarization angle ( ?), depth to the centre of sphere ( h), electrical dipole moment ( K) and the zero distance from the origin ( x 0) were estimated. For testing the success of the MLPNN for sphere model, parameters were also estimated by the traditional Damped Least Squares (Levenberg-Marquardt) inversion technique (DLS). The MLPNN was first tested on a synthetic example. The performance of method was also tested for two S/N ratios (5 % and 10 %) by adding noise to the same synthetic data, the estimated model parameters with MLPNN and DLS method are satisfactory. The MLPNN also applied for the field data example in ?zmir, Urla district, Turkey, with two cross-section data evaluated by MLPNN and DLS, and the two methods showed good agreement.
Optical proximity correction using a multilayer perceptron neural network
International Nuclear Information System (INIS)
Optical proximity correction (OPC) is one of the resolution enhancement techniques (RETs) in optical lithography, where the mask pattern is modified to improve the output pattern fidelity. Algorithms are needed to generate the modified mask pattern automatically and efficiently. In this paper, a multilayer perceptron (MLP) neural network (NN) is used to synthesize the mask pattern. We employ the pixel-based approach in this work. The MLP takes the pixel values of the desired output wafer pattern as input, and outputs the optimal mask pixel values. The MLP is trained with the backpropagation algorithm, with a training set retrieved from the desired output pattern, and the optimal mask pattern obtained by the model-based method. After training, the MLP is able to generate the optimal mask pattern non-iteratively with good pattern fidelity. (paper)
Charniya, Nadir N.
2013-01-01
The Multi-layer Perceptron Neural Networks (MLP NN) are well known for their simplicity, ease of training for small-scale problems, and suitability for online implementation. This paper presents the methodology and challenges in the design of near-optimal MLP NN based classifier with maximize classification accuracy under the constraints of minimum network dimension for implementation intelligent sensors.
Classification of fused face images using multilayer perceptron neural network
Bhattacharjee, Debotosh; Nasipuri, Mita; Basu, Dipak Kumar; Kundu, Mahantapas
2010-01-01
This paper presents a concept of image pixel fusion of visual and thermal faces, which can significantly improve the overall performance of a face recognition system. Several factors affect face recognition performance including pose variations, facial expression changes, occlusions, and most importantly illumination changes. So, image pixel fusion of thermal and visual images is a solution to overcome the drawbacks present in the individual thermal and visual face images. Fused images are projected into eigenspace and finally classified using a multi-layer perceptron. In the experiments we have used Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database benchmark thermal and visual face images. Experimental results show that the proposed approach significantly improves the verification and identification performance and the success rate is 95.07%. The main objective of employing fusion is to produce a fused image that provides the most detailed and reliable information. Fusion of multip...
DEFF Research Database (Denmark)
Proud, Simon Richard
2015-01-01
A multilayer perceptron neural network cloud mask for Meteosat Second Generation SEVIRI (Spinning Enhanced Visible and Infrared Imager) images is introduced and evaluated. The model is trained for cloud detection on MSG SEVIRI daytime data. It consists of a multi-layer perceptron with one hidden sigmoid layer, trained with the error back-propagation algorithm. The model is fed by six bands of MSG data (0.6, 0.8, 1.6, 3.9, 6.2 and 10.8 ?m) with 10 hidden nodes. The multiple-layer perceptrons lead to a cloud detection accuracy of 88.96%, when trained to map two predefined values that classify cloud and clear sky. The network was further evaluated using sixty MSG images taken at different dates. The network detected not only bright thick clouds but also thin or less bright clouds. The analysis demonstrated the feasibility of using machine learning models of cloud detection in MSG SEVIRI imagery.
Directory of Open Access Journals (Sweden)
Flávio Clésio Silva de Souza
2014-06-01
Full Text Available The purpose of the present research is to apply a Multilayer Perceptron (MLP neural network technique to create classification models from a portfolio of Non-Performing Loans (NPLs to classify this type of credit derivative. These credit derivatives are characterized as the amount of loans that were not paid and are already overdue more than 90 days. Since these titles are, because of legislative motives, moved by losses, Credit Rights Investment Funds (FDIC performs the purchase of these debts and the recovery of the credits. Using the Multilayer Perceptron (MLP architecture of Artificial Neural Network (ANN, classification models regarding the posterior recovery of these debts were created. To evaluate the performance of the models, evaluation metrics of classification relating to the neural networks with different architectures were presented. The results of the classifications were satisfactory, given the classification models were successful in the presented economics costs structure.
Multilayer perceptron for nonlinear programming
International Nuclear Information System (INIS)
A new method for solving nonlinear programming problems within the framework of a multilayer neural network perceptron is proposed. The method employs the Penalty Function method to transform a constrained optimization problem into a sequence of unconstrained optimization problems and then solves the sequence of unconstrained optimizations of the transformed problem by training a series of multilayer perceptrons. The neural network formulation is represented in such a way that the multilayer perceptron prediction error to be minimized mimics the objective function of the unconstrained problem, and therefore, the minimization of the objective function for each unconstrained optimization is attained by training a single perceptron. The multilayer perceptron allows for the transformation of problems with two-sided bounding constraints on the decision variables x, e.g., a?xn?b, into equivalent optimization problems in which these constraints do not explicitly appear. Hence, when these are the only constraints in the problem, the transformed problem is constraint free (i.e., the transformed objective function contains no penalty terms) and is solved by training a multilayer perceptron only once. In addition, we present a new Penalty Function method for solving nonlinear programming problems that is parameter free and guarantees that feasible solutions are obtained when the optimal solution is on the boundary of the feasible region. Simulation results, includble region. Simulation results, including an example from operations research, illustrate the proposed methods.
International Nuclear Information System (INIS)
This paper deals with the controversial topic of the selection of the parameters of a genetic algorithm, in this case hierarchical, used for training of multilayer perceptron neural networks for the binary classification. The parameters to select are the crossover and mutation probabilities of the control and parametric genes and the permanency percent. The results can be considered as a guide for using this kind of algorithm.
Mohammad Fathian; Kia, Arash N.
2012-01-01
In this paper, the problem of predicting the exchange rate time series in the foreign exchange rate market is going to be solved using a time-delayed multilayer perceptron neural network with gold price as external factor. The input for the learning phase of the artificial neural network are the exchange rate data of the last five days plus the gold price in two different currencies of the exchange rate as the external factor for helping the artificial neural network improving its forecast ac...
Multidimensional scaling using multilayer perceptron
Tuovinen, Tommi
2013-01-01
The objective of this thesis is to introduce the reader to the concepts of neural network and multidimensional scaling and to demonstrate how these two can be used together. The thesis introduces a construction in which a multilayer perceptron is trained by means of multidimensional scaling in order to perform dimensionality reduction. The algorithm is tested in four different test experiments.
Apply Multi-Layer Perceptrons Neural Network for Off-Line Signature Verification and Recognition
Directory of Open Access Journals (Sweden)
Suhail Odeh
2011-11-01
Full Text Available This paper discusses the applying of Multi-layer perceptrons for signature verification and recognition using a new approach enables the user to recognize whether a signature is original or a fraud. The approach starts by scanning images into the computer, then modifying their quality through image enhancement and noise reduction, followed by feature extraction and neural network training, and finally verifies the authenticity of the signature. The paper discusses the different stages of the process including: image pre-processing, feature extraction and pattern recognition through neural networks.
Evolutionary Learning of Multi-Layer Perceptron Neural Networks.
Czech Academy of Sciences Publication Activity Database
Neruda, Roman; Slušný, Stanislav
Košice : Prírodovedecká fakulta, Univerzita P. J. Šafárika, 2006 - (Vojtáš, P.), s. 125-130 ISBN 80-969184-4-3. [ITAT 2006. Workshop on Theory and Practice of Information Theory . Bystrá dolina (SK), 26.09.2006-01.10.2006] R&D Projects: GA AV ?R 1ET100300419 Institutional research plan: CEZ:AV0Z10300504 Keywords : perceptron networks * learning * evolutionary algorithms Subject RIV: IN - Informatics, Computer Science
ECG biometric using multilayer perceptron and radial basis function neural networks.
Mai, Vu; Khalil, Ibrahim; Meli, Christopher
2011-01-01
This paper proposes a new method to identify people using Electrocardiogram (ECG), particularly the QRS complex which has been proven to be stable against heart rate variability and convenient to be used alone as a biometric feature. 324 QRS complexes are extracted from ECGs of 18 subjects in Physionet's MIT-BIH Normal Sinus Rhythm Database (NSRDB). Multilayer Perceptron (MLP) and Radial Basis Function (RBF) neural networks are used to classify those QRS complexes. If the training data are chosen carefully to cover a wide range of input values (i.e. QRS complexes), then the classification accuracy rates can reach above 98% using MLP and 97% using RBF. PMID:22254909
An Analog Multilayer Perceptron Neural Network for a Portable Electronic Nose
Chih-Heng Pan; Hung-Yi Hsieh; Kea-Tiong Tang
2012-01-01
This study examines an analog circuit comprising a multilayer perceptron neural network (MLPNN). This study proposes a low-power and small-area analog MLP circuit to implement in an E-nose as a classifier, such that the E-nose would be relatively small, power-efficient, and portable. The analog MLP circuit had only four input neurons, four hidden neurons, and one output neuron. The circuit was designed and fabricated using a 0.18 ?m standard CMOS process with a 1.8 V supply. The powe...
Directory of Open Access Journals (Sweden)
Alireza Taravat
2015-02-01
Full Text Available A multilayer perceptron neural network cloud mask for Meteosat Second Generation SEVIRI (Spinning Enhanced Visible and Infrared Imager images is introduced and evaluated. The model is trained for cloud detection on MSG SEVIRI daytime data. It consists of a multi-layer perceptron with one hidden sigmoid layer, trained with the error back-propagation algorithm. The model is fed by six bands of MSG data (0.6, 0.8, 1.6, 3.9, 6.2 and 10.8 ?m with 10 hidden nodes. The multiple-layer perceptrons lead to a cloud detection accuracy of 88.96%, when trained to map two predefined values that classify cloud and clear sky. The network was further evaluated using sixty MSG images taken at different dates. The network detected not only bright thick clouds but also thin or less bright clouds. The analysis demonstrated the feasibility of using machine learning models of cloud detection in MSG SEVIRI imagery.
Classification of fuels using multilayer perceptron neural networks
International Nuclear Information System (INIS)
Electrical impedance data obtained with an array of conducting polymer chemical sensors was used by a neural network (ANN) to classify fuel adulteration. Real samples were classified with accuracy greater than 90% in two groups: approved and adulterated.
Directory of Open Access Journals (Sweden)
Mohammad Fathian
2012-04-01
Full Text Available In this paper, the problem of predicting the exchange rate time series in the foreign exchange rate market is going to be solved using a time-delayed multilayer perceptron neural network with gold price as external factor. The input for the learning phase of the artificial neural network are the exchange rate data of the last five days plus the gold price in two different currencies of the exchange rate as the external factor for helping the artificial neural network improving its forecast accuracy. The five-day delay has been chosen because of the weekly cyclic behavior of the exchange rate time series with the consideration of two holidays in a week. The result of forecasts are then compared with using the multilayer peceptron neural network without gold price external factor by two most important evaluation techniques in the literature of exchange rate prediction. For the experimental analysis phase, the data of three important exchange rates of EUR/USD, GBP/USD, and USD/JPY are used.
LALIT KUMAR BEHERA; MAYA NAYAK; SAREETA MOHANTY
2011-01-01
This paper presents discrete wavelet transform and the S-transform based neural classifier scheme used for time series data mining of power quality events occurring due to power signal disturbances. The DWT and the S –transform are used for feature extraction and then the extracted features are classified with neural classifiers such as multilayered perceptron network (MLP) for pattern classification, data mining and subsequent knowledge discovery.
Kalamatianos, Dimitrios; Liatsis, Panos; Wellstead, Peter E
2006-01-01
Near-infrared (NIR) spectroscopy is being applied to the solution of problems in many areas of biomedical and pharmaceutical research. In this paper we investigate the use of NIR spectroscopy as an analytical tool to quantify concentrations of urea, creatinine, glucose and oxyhemoglobin (HbO2). Measurements have been made in vitro with a portable spectrometer developed in our labs that consists of a two beam interferometer operating in the range of 800-2300 nm. For the data analysis a pattern recognition philosophy was used with a preprocessing stage and a multi-layer perceptron (MLP) neural network for the measurement stage. Results show that the interferogram signatures of the above compounds are sufficiently strong in that spectral range. Measurements of three different concentrations were possible with mean squared error (MSE) of the order of 10(-6). PMID:17947035
Highly Accurate Multi-layer Perceptron Neural Network for Air Data System
Directory of Open Access Journals (Sweden)
H. S. Krishna
2009-11-01
Full Text Available The error backpropagation multi-layer perceptron algorithm is revisited. This algorithm is used to train and validate two models of three-layer neural networks that can be used to calibrate a 5-hole pressure probe. This paper addresses Occam's Razor problem as it describes the adhoc training methodology applied to improve accuracy and sensitivity. The trained outputs from 5-4-3 feed-forward network architecture with jump connection are comparable to second decimal digit (~0.05 accuracy, hitherto unreported in literature.Defence Science Journal, 2009, 59(6, pp.670-674, DOI:http://dx.doi.org/10.14429/dsj.59.1574
An Analog Multilayer Perceptron Neural Network for a Portable Electronic Nose
Directory of Open Access Journals (Sweden)
Chih-Heng Pan
2012-12-01
Full Text Available This study examines an analog circuit comprising a multilayer perceptron neural network (MLPNN. This study proposes a low-power and small-area analog MLP circuit to implement in an E-nose as a classifier, such that the E-nose would be relatively small, power-efficient, and portable. The analog MLP circuit had only four input neurons, four hidden neurons, and one output neuron. The circuit was designed and fabricated using a 0.18 ?m standard CMOS process with a 1.8 V supply. The power consumption was 0.553 mW, and the area was approximately 1.36 × 1.36 mm2. The chip measurements showed that this MLPNN successfully identified the fruit odors of bananas, lemons, and lychees with 91.7% accuracy.
Geomagnetic Dst index forecast using a multilayer perceptrons artificial neural network
International Nuclear Information System (INIS)
Complete text of publication follows. The best known manifestations of the impact of solar wind on the magnetosphere are the geomagnetic storms. The prediction of geomagnetic field behavior allows the alert of geomagnetic storms occurrence, as those phenomena can cause many damages in the planet. The Artificial Intelligence tools have been applied in many multidisciplinary studies, covering several areas of knowledge, as a choice of approach to the solution of problems with characteristics like non-linearity, imprecision, and other features that can not be easily solved with conventional computational models. Techniques such as Artificial Neural Networks, Expert Systems and Decision Trees have been used in the Space Weather studies to perform tasks such as forecasting geomagnetic storms and the investigation of rules and parameters related on its occurrence. The main focus of this work is on forecasting the geomagnetic field behavior, represented this time by the Dst index, using for that task, mainly, the interplanetary magnetic field components and solar wind data. The tool chosen here to solve the non-linear problem was a Multi-layer Perceptrons Artificial Neural Network, trained with the backpropagation algorithm. Unlike what was done in other studies, we chose to predict calm and disturbed periods like, for example, a full month of data, for application in a real time forecasting system. It was possible to predict the geomagnetic Dst index one or two hours beforemagnetic Dst index one or two hours before with great percentage efficiency.
An Automated MR Image Segmentation System Using Multi-layer Perceptron Neural Network
Amiri, S; Movahedi, M M; Kazemi, K; Parsaei, H
2013-01-01
Background: Brain tissue segmentation for delineation of 3D anatomical structures from magnetic resonance (MR) images can be used for neuro-degenerative disorders, characterizing morphological differences between subjects based on volumetric analysis of gray matter (GM), white matter (WM) and cerebrospinal fluid (CSF), but only if the obtained segmentation results are correct. Due to image artifacts such as noise, low contrast and intensity non-uniformity, there are some classification errors in the results of image segmentation. Objective: An automated algorithm based on multi-layer perceptron neural networks (MLPNN) is presented for segmenting MR images. The system is to identify two tissues of WM and GM in human brain 2D structural MR images. A given 2D image is processed to enhance image intensity and to remove extra cerebral tissue. Thereafter, each pixel of the image under study is represented using 13 features (8 statistical and 5 non- statistical features) and is classified using a MLPNN into one of the three classes WM and GM or unknown. Results: The developed MR image segmentation algorithm was evaluated using 20 real images. Training using only one image, the system showed robust performance when tested using the remaining 19 images. The average Jaccard similarity index and Dice similarity metric for the GM and WM tissues were estimated to be 75.7 %, 86.0% for GM, and 67.8% and 80.7%for WM, respectively. Conclusion: The obtained performances are encouraging and show that the presented method may assist with segmentation of 2D MR images especially where categorizing WM and GM is of interest. PMID:25505757
Cross Validation Evaluation for Breast Cancer Prediction Using Multilayer Perceptron Neural Networks
Directory of Open Access Journals (Sweden)
Shirin A. Mojarad
2011-01-01
Full Text Available Problem statement: The presence of metastasis in the regional lymph nodes is the most important factor in predicting prognosis in breast cancer. Many biomarkers have been identified that appear to relate to the aggressive behaviour of cancer. However, the nonlinear relation of these markers to nodal status and also the existence of complex interaction between markers have prohibited an accurate prognosis. Approach: The aim of this study is to investigate the effectiveness of a Multilayer Perceptron (MLP for predicting breast cancer progression using a set of four biomarkers of breast tumors. The biomarkers include DNA ploidy, cell cycle distribution (G0G1/G2M, steroid receptors (ER/PR and S-Phase Fraction (SPF. A further objective of the study is to explore the predictive potential of these markers in defining the state of nodal involvement in breast cancer. Two methods of outcome evaluation viz. stratified and simple k-fold Cross Validation (CV are studied in order to assess their accuracy and reliability for neural network validation. Criteria such as output accuracy, sensitivity and specificity are used for selecting the best validation technique besides evaluating the network outcome for different combinations of markers. Results: The results show that stratified 2-fold CV is more accurate and reliable compared to simple k-fold CV as it obtains a higher accuracy and specificity and also provides a more stable network validation in terms of sensitivity. Best prediction results are obtained by using an individual marker-SPF which obtains an accuracy of 65%. Conclusion/Recommendations: Our findings suggest that MLP-based analysis provides an accurate and reliable platform for breast cancer prediction given that an appropriate design and validation method is employed.
Multilayered perceptron neural networks to compute energy losses in magnetic cores
Energy Technology Data Exchange (ETDEWEB)
Kucuk, Ilker [Physics Department, Faculty of Arts and Sciences, Uludag University, Gorukle Campus 16059, Bursa (Turkey)]. E-mail: ikucuk@uludag.edu.tr
2006-12-15
This paper presents a new approach based on multilayered perceptrons (MLPs) to compute the specific energy losses of toroidal wound cores built from 3% SiFe 0.27 mm thick M4, 0.1 and 0.08 mm thin gauge electrical steel strips. The MLP has been trained by a back-propagation and extended delta-bar-delta learning algorithm. The results obtained by using the MLP model were compared with a commonly used conventional method. The comparison has shown that the proposed model improved loss estimation with respect to the conventional method.
Multilayered perceptron neural networks to compute energy losses in magnetic cores
International Nuclear Information System (INIS)
This paper presents a new approach based on multilayered perceptrons (MLPs) to compute the specific energy losses of toroidal wound cores built from 3% SiFe 0.27 mm thick M4, 0.1 and 0.08 mm thin gauge electrical steel strips. The MLP has been trained by a back-propagation and extended delta-bar-delta learning algorithm. The results obtained by using the MLP model were compared with a commonly used conventional method. The comparison has shown that the proposed model improved loss estimation with respect to the conventional method
Quaternionic Multilayer Perceptron with Local Analyticity
Directory of Open Access Journals (Sweden)
Nobuyuki Matsui
2012-11-01
Full Text Available A multi-layered perceptron type neural network is presented and analyzed in this paper. All neuronal parameters such as input, output, action potential and connection weight are encoded by quaternions, which are a class of hypercomplex number system. Local analytic condition is imposed on the activation function in updating neurons’ states in order to construct learning algorithm for this network. An error back-propagation algorithm is introduced for modifying the connection weights of the network.
Quaternionic Multilayer Perceptron with Local Analyticity
Nobuyuki Matsui; Haruhiko Nishimura; Teijiro Isokawa
2012-01-01
A multi-layered perceptron type neural network is presented and analyzed in this paper. All neuronal parameters such as input, output, action potential and connection weight are encoded by quaternions, which are a class of hypercomplex number system. Local analytic condition is imposed on the activation function in updating neurons’ states in order to construct learning algorithm for this network. An error back-propagation algorithm is introduced for modifying the connection weights...
Fourier-Lapped Multilayer Perceptron Method for Speech Quality Assessment
Amauri Lopes; Marcos Travassos Romano, Jo O.; Jayme Garcia Arnal Barbedo; Vidal Ribeiro, Mois S.
2005-01-01
The paper introduces a new objective method for speech quality assessment called Fourier-lapped multilayer perceptron (FLMLP). This method uses an overcomplete transform based on the discrete Fourier transform (DFT) and modulated lapped transform (MLT). This transform generates the DFT and the MLT speech spectral domains from which several relevant perceptual parameters are extracted. The proposed method also employs a multilayer perceptron neural network trained by a modified version of the...
International Nuclear Information System (INIS)
Critical heat flux (CHF) is an important parameter for the design of nuclear reactors. Although many experimental and theoretical researches have been performed, there is not a single correlation to predict CHF because it is influenced by many parameters. These parameters are based on fixed inlet, local and fixed outlet conditions. Artificial neural networks (ANNs) have been applied to a wide variety of different areas such as prediction, approximation, modeling and classification. In this study, two types of neural networks, radial basis function (RBF) and multilayer perceptron (MLP), are trained with the experimental CHF data and their performances are compared. RBF predicts CHF with root mean square (RMS) errors of 0.24%, 7.9%, 0.16% and MLP predicts CHF with RMS errors of 1.29%, 8.31% and 2.71%, in fixed inlet conditions, local conditions and fixed outlet conditions, respectively. The results show that neural networks with RBF structure have superior performance in CHF data prediction over MLP neural networks. The parametric trends of CHF obtained by the trained ANNs are also evaluated and results reported
Directory of Open Access Journals (Sweden)
Alireza Taravat
2014-12-01
Full Text Available Oil spills represent a major threat to ocean ecosystems and their environmental status. Previous studies have shown that Synthetic Aperture Radar (SAR, as its recording is independent of clouds and weather, can be effectively used for the detection and classification of oil spills. Dark formation detection is the first and critical stage in oil-spill detection procedures. In this paper, a novel approach for automated dark-spot detection in SAR imagery is presented. A new approach from the combination of adaptive Weibull Multiplicative Model (WMM and MultiLayer Perceptron (MLP neural networks is proposed to differentiate between dark spots and the background. The results have been compared with the results of a model combining non-adaptive WMM and pulse coupled neural networks. The presented approach overcomes the non-adaptive WMM filter setting parameters by developing an adaptive WMM model which is a step ahead towards a full automatic dark spot detection. The proposed approach was tested on 60 ENVISAT and ERS2 images which contained dark spots. For the overall dataset, an average accuracy of 94.65% was obtained. Our experimental results demonstrate that the proposed approach is very robust and effective where the non-adaptive WMM & pulse coupled neural network (PCNN model generates poor accuracies.
Taravat, Alireza; Oppelt, Natascha
2014-01-01
Oil spills represent a major threat to ocean ecosystems and their environmental status. Previous studies have shown that Synthetic Aperture Radar (SAR), as its recording is independent of clouds and weather, can be effectively used for the detection and classification of oil spills. Dark formation detection is the first and critical stage in oil-spill detection procedures. In this paper, a novel approach for automated dark-spot detection in SAR imagery is presented. A new approach from the combination of adaptive Weibull Multiplicative Model (WMM) and MultiLayer Perceptron (MLP) neural networks is proposed to differentiate between dark spots and the background. The results have been compared with the results of a model combining non-adaptive WMM and pulse coupled neural networks. The presented approach overcomes the non-adaptive WMM filter setting parameters by developing an adaptive WMM model which is a step ahead towards a full automatic dark spot detection. The proposed approach was tested on 60 ENVISAT and ERS2 images which contained dark spots. For the overall dataset, an average accuracy of 94.65% was obtained. Our experimental results demonstrate that the proposed approach is very robust and effective where the non-adaptive WMM & pulse coupled neural network (PCNN) model generates poor accuracies. PMID:25474376
Directory of Open Access Journals (Sweden)
A. Piotrowski
2007-12-01
Full Text Available The prediction of temporal concentration profiles of a transported pollutant in a river is still a subject of ongoing research efforts worldwide. The present paper is aimed at studying the possibility of using Multi-Layer Perceptron Neural Networks to evaluate the whole concentration versus time profile at several cross-sections of a river under various flow conditions, using as little information about the river system as possible. In contrast with the earlier neural networks based work on longitudinal dispersion coefficients, this new approach relies more heavily on measurements of concentration collected during tracer tests over a range of flow conditions, but fewer hydraulic and morphological data are needed. The study is based upon 26 tracer experiments performed in a small river in Edinburgh, UK (Murray Burn at various flow rates in a 540 m long reach. The only data used in this study were concentration measurements collected at 4 cross-sections, distances between the cross-sections and the injection site, time, as well as flow rate and water velocity, obtained according to the data measured at the 1st and 2nd cross-sections.
The four main features of concentration versus time profiles at a particular cross-section, namely the peak concentration, the arrival time of the peak at the cross-section, and the shapes of the rising and falling limbs of the profile are modeled, and for each of them a separately designed neural network was used. There was also a variant investigated in which the conservation of the injected mass was assured by adjusting the predicted peak concentration. The neural network methods were compared with the unit peak attenuation curve concept.
In general the neural networks predicted the main features of the concentration profiles satisfactorily. The predicted peak concentrations were generally better than those obtained using the unit peak attenuation method, and the method with mass-conservation assured generally performed better than the method that did not account for mass-conservation. Predictions of peak travel time were also better using the neural networks than the unit peak attenuation method. Including more data into the neural network training set clearly improved the prediction of the shapes of the concentration profiles. Similar improvements in peak concentration were less significant and the travel time prediction appeared to be largely unaffected.
Directory of Open Access Journals (Sweden)
A. Piotrowski
2007-08-01
Full Text Available The prediction of temporal concentration profiles of a transported pollutant in a river is still a subject of ongoing research efforts worldwide. The present paper is aimed at studying the possibility of using Multi-Layer Perceptron Neural Networks to evaluate the whole concentration versus time profile at several cross-sections of a river under various flow conditions, using as little information about the river system as possible. In contrast with the earlier neural networks based work on longitudinal dispersion coefficients, this new approach relies more heavily on measurements of concentration collected during tracer tests over a range of flow conditions, but fewer hydraulic and morphological data are needed. The study is based upon 26 tracer experiments performed in a small river in Edinburgh, UK (Murray Burn at various flow rates in a 540 m long reach. The only data used in this study were concentration measurements collected at 4 cross-sections, distances between the cross-sections and the injection site, time, as well as flow rate and water velocity, obtained according to the data measured at the 1st and 2nd cross-sections.
The four main features of concentration versus time profiles at a particular cross-section, namely the peak concentration, the arrival time of the peak at the cross-section, and the shapes of the rising and falling limbs of the profile are modeled, and for each of them a separately designed neural network was used. There was also a variant investigated in which the conservation of the injected mass was assured by adjusting the predicted peak concentration. The neural network methods were compared with the unit peak attenuation curve concept.
In general the neural networks predicted the main features of the concentration profiles satisfactorily. The predicted peak concentrations were generally better than those obtained using the unit peak attenuation method, and the method with mass-conservation assured generally performed better than the method that did not account for mass-conservation. Predictions of peak travel time were also better using the neural networks than the unit peak attenuation method. Including more data into the neural network training set clearly improved the prediction of the shapes of the concentration profiles. Similar improvements in peak concentration were less significant and the travel time prediction appeared to be largely unaffected.
Wind speed estimation using multilayer perceptron
International Nuclear Information System (INIS)
Highlights: • We present a method for determining the average wind speed using neural networks. • We use data from that site in the short term and data from other nearby stations. • The inputs used in the ANN were wind speed and direction data from a station. • The method allows knowing the wind speed without topographical data. - Abstract: Wind speed knowledge is prerequisite in the siting of wind turbines. In consequence the wind energy use requires meticulous and specified knowledge of the wind characteristics at a location. This paper presents a method for determining the annual average wind speed at a complex terrain site by using neural networks, when only short term data are available for that site. This information is useful for preliminary calculations of the wind resource at a remote area having only a short time period of wind measurements measurement in a site. Artificial neural networks are useful for implementing non-linear process variables over time, and therefore are a useful tool for estimating the wind speed. The neural network used is multilayer perceptron with three layers and the supervised learning algorithm used is backpropagation. The inputs used in the neural network were wind speed and direction data from a single station, and the training patterns used correspond to sixty days data. The results obtained by simulating the annual average wind speed at the selected site based on data from nearby stations with correlation coefficients above 0.5 were satisfactory, compared with actual values. Reliable estimations were obtained, with errors below 6%
Multilayer perceptron, fuzzy sets, and classification
Pal, Sankar K.; Mitra, Sushmita
1992-01-01
A fuzzy neural network model based on the multilayer perceptron, using the back-propagation algorithm, and capable of fuzzy classification of patterns is described. The input vector consists of membership values to linguistic properties while the output vector is defined in terms of fuzzy class membership values. This allows efficient modeling of fuzzy or uncertain patterns with appropriate weights being assigned to the backpropagated errors depending upon the membership values at the corresponding outputs. During training, the learning rate is gradually decreased in discrete steps until the network converges to a minimum error solution. The effectiveness of the algorithm is demonstrated on a speech recognition problem. The results are compared with those of the conventional MLP, the Bayes classifier, and the other related models.
Auto-kernel using multilayer perceptron
Directory of Open Access Journals (Sweden)
Wei-Chen Cheng
2012-06-01
Full Text Available This work presents a constructive method to train the multilayer perceptron layer after layer successively and to accomplish the kernel used in the support vector machine. Data in different classes will be trained to map to distant points in each layer. This will ease the mapping of the next layer. A perfect mapping kernel can be accomplished successively. Those distant mapped points can be discriminated easily by a single perceptron.
Auto-kernel using multilayer perceptron
Wei-Chen Cheng
2012-01-01
This work presents a constructive method to train the multilayer perceptron layer after layer successively and to accomplish the kernel used in the support vector machine. Data in different classes will be trained to map to distant points in each layer. This will ease the mapping of the next layer. A perfect mapping kernel can be accomplished successively. Those distant mapped points can be discriminated easily by a single perceptron.
Algorithm for Training a Recurrent Multilayer Perceptron
Parlos, Alexander G.; Rais, Omar T.; Menon, Sunil K.; Atiya, Amir F.
2004-01-01
An improved algorithm has been devised for training a recurrent multilayer perceptron (RMLP) for optimal performance in predicting the behavior of a complex, dynamic, and noisy system multiple time steps into the future. [An RMLP is a computational neural network with self-feedback and cross-talk (both delayed by one time step) among neurons in hidden layers]. Like other neural-network-training algorithms, this algorithm adjusts network biases and synaptic-connection weights according to a gradient-descent rule. The distinguishing feature of this algorithm is a combination of global feedback (the use of predictions as well as the current output value in computing the gradient at each time step) and recursiveness. The recursive aspect of the algorithm lies in the inclusion of the gradient of predictions at each time step with respect to the predictions at the preceding time step; this recursion enables the RMLP to learn the dynamics. It has been conjectured that carrying the recursion to even earlier time steps would enable the RMLP to represent a noisier, more complex system.
Conventional modeling of the multilayer perceptron using polynomial basis functions
Chen, Mu-Song; Manry, Michael T.
1993-01-01
A technique for modeling the multilayer perceptron (MLP) neural network, in which input and hidden units are represented by polynomial basis functions (PBFs), is presented. The MLP output is expressed as a linear combination of the PBFs and can therefore be expressed as a polynomial function of its inputs. Thus, the MLP is isomorphic to conventional polynomial discriminant classifiers or Volterra filters. The modeling technique was successfully applied to several trained MLP networks.
DEFF Research Database (Denmark)
Kucuk, Nil; Manohara, S.R.
2013-01-01
In this work, multilayered perceptron neural networks (MLPNNs) were presented for the computation of the gamma-ray energy absorption buildup factors (BA) of seven thermoluminescent dosimetric (TLD) materials [LiF, BeO, Na2B4O7, CaSO4, Li2B4O7, KMgF3, Ca3(PO4)2] in the energy region 0.015–15MeV, and for penetration depths up to 10 mfp (mean-free-path). The MLPNNs have been trained by a Levenberg–Marquardt learning algorithm. The developed model is in 99% agreement with the ANSI/ANS-6.4.3 standard data set. Furthermore, the model is fast and does not require tremendous computational efforts. The estimated BA data for TLD materials have been given with penetration depth and incident photon energy as comparative to the results of the interpolation method using the Geometrical Progression (G-P) fitting formula.
A Parallel Framework for Multilayer Perceptron for Human Face Recognition
Bhowmik, M K; Nasipuri, M; Basu, D K; Kundu, M
2010-01-01
Artificial neural networks have already shown their success in face recognition and similar complex pattern recognition tasks. However, a major disadvantage of the technique is that it is extremely slow during training for larger classes and hence not suitable for real-time complex problems such as pattern recognition. This is an attempt to develop a parallel framework for the training algorithm of a perceptron. In this paper, two general architectures for a Multilayer Perceptron (MLP) have been demonstrated. The first architecture is All-Class-in-One-Network (ACON) where all the classes are placed in a single network and the second one is One-Class-in-One-Network (OCON) where an individual single network is responsible for each and every class. Capabilities of these two architectures were compared and verified in solving human face recognition, which is a complex pattern recognition task where several factors affect the recognition performance like pose variations, facial expression changes, occlusions, and ...
A Choice of Input Variables for a Multilayer Perceptron
International Nuclear Information System (INIS)
In the paper some aspects of multilayer perceptron (MLP) application to the problem of classifying the events presented by empirical samples of a finite volume are considered. The results of the MLP learning for various forms of the input data are analyzed and the reasons leading to the effect of an instantaneous learning of the MLP and rise of the neural network are investigated for the case when the input data are presented in a form of variational series. The problem of hidden layer neuron reduction without raising the recognition error is discussed. (author). 13 refs., 6 figs., 1 tab
Learning of Multilayer Perceptrons with Piecewise-Linear Activation Functions.
Czech Academy of Sciences Publication Activity Database
Kozub, P.; Hole?a, Martin
Praha : Matfyzpress, 2008 - (Obdržálek, D.; Štanclová, J.; Plátek, M.), s. 27-46 ISBN 978-80-7378-076-0. [MIS 2008. Malý informatický seminá? /25./. Josef?v d?l (CZ), 12.01.2008-19.01.2008] R&D Projects: GA ?R GA201/08/0802; GA ?R GA201/08/1744 Institutional research plan: CEZ:AV0Z10300504 Keywords : artificial neural networks * multilayer perceptrons * activation functions * function approximation * constrained optimization Subject RIV: IN - Informatics, Computer Science
International Nuclear Information System (INIS)
In this work, multilayered perceptron neural networks (MLPNNs) were presented for the computation of the gamma-ray energy absorption buildup factors (BA) of seven thermoluminescent dosimetric (TLD) materials [LiF, BeO, Na2B4O7, CaSO4, Li2B4O7, KMgF3, Ca3(PO4)2] in the energy region 0.015–15 MeV, and for penetration depths up to 10 mfp (mean-free-path). The MLPNNs have been trained by a Levenberg–Marquardt learning algorithm. The developed model is in 99% agreement with the ANSI/ANS-6.4.3 standard data set. Furthermore, the model is fast and does not require tremendous computational efforts. The estimated BA data for TLD materials have been given with penetration depth and incident photon energy as comparative to the results of the interpolation method using the Geometrical Progression (G-P) fitting formula. - Highlights: ? Gamma-ray energy absorption buildup factors estimation in TLD materials. ? The ANN approach can be alternative to G-P fitting method for BA calculations. ? The applied model is not time-consuming and easily predicted
Çaylak, Ça?r?; Kaftan, ?lknur
2014-12-01
This study proposes the use of multi-layer perceptron neural networks (MLPNN) to invert dispersion curves obtained via multi-channel analysis of surface waves (MASW) for shear S-wave velocity profile. The dispersion curve used in inversion includes the fundamental-mode dispersion data. In order to investigate the applicability and performance of the proposed MLPNN algorithm, test studies were performed using both synthetic and field examples. Gaussian random noise with a standard deviation of 4 and 8% was added to the noise-free test data to make the synthetic test more realistic. The model parameters, such as S-wave velocities and thicknesses of the synthetic layered-earth model, were obtained for different S/N ratios and noise-free data. The field survey was performed over the natural gas pipeline, located in the Germencik district of Ayd?n city, western Turkey. The results show that depth, velocity, and location of the embedded natural gas pipe are successfully estimated with reasonably good approximation.
Scientific Electronic Library Online (English)
Héctor, Tabares; John, Branch; Jaime, Valencia.
2006-09-01
Full Text Available En este trabajo se aplica un método constructivo aproximado para encontrar arquitecturas de redes neuronales artificiales (RNA) de tipo perceptrón multicapa (PMC). El método se complementa con la técnica de la búsqueda forzada de mejores mínimos locales. El entrenamiento de la red se lleva a cabo a [...] través del algoritmo gradiente descendente básico (GDB); se aplican técnicas como la repetición del entrenamiento y la detención temprana (validación cruzada), para mejorar los resultados. El criterio de evaluación se basa en las habilidades de aprendizaje y de generalización de las arquitecturas generadas específicas de un dominio. Se presentan resultados experimentales con los cuales se demuestra la efectividad del método propuesto y comparan con las arquitecturas halladas por otros métodos. Abstract in english This paper deals with an approximate constructive method to find architectures of artificial neuronal network (ANN) of the type MultiLayer Percetron (MLP) which solves a particular problem. This method is supplemented with the technique of the Forced search of better local minima. The training of th [...] e net uses an algorithm basic descending gradient (BDG). Techniques such as repetition of the training and the early stopping (cross validation) are used to improve the results. The evaluation approach is based not only on the learning abilities but also on the generalization of the specific generated architectures of a domain. Experimental results are presented in order to prove the effectiveness of the proposed method. These are compared with architectures found by other methods.
Scientific Electronic Library Online (English)
Rodrigo Martins da, Silva; Luiza de Macedo, Mourelle; Nadia, Nedjah.
2011-12-01
Full Text Available Em termos computacionais, uma rede neural artificial (RNA) pode ser implementada em software ou em hardware, ou ainda de maneira híbrida, combinando ambos os recursos. O presente trabalho propõe uma arquitetura de hardware para a computação de uma rede neural do tipo perceptron com múltiplas camadas [...] (MLP). Soluções em hardware tendem a ser mais eficientes do que soluções em software. O projeto em questão, além de explorar fortemente o paralelismo das redes neurais, permite alterações do número de entradas, número de camadas e de neurônios por camada, de modo que diversas aplicações de RNAs possam ser executadas no hardware proposto. Visando a uma redução de tempo do processamento aritmético, um número real é aproximado por uma fração de inteiros. Dessa forma, as operações aritméticas limitam-se a operações inteiras, executadas por circuitos combinacionais. Uma simples máquina de estados é demandada para controlar somas e produtos de frações. A função de ativação usada neste projeto é a sigmóide. Essa função é aproximada mediante o uso de polinômios, cujas operações são regidas por somas e produtos. Um teorema é introduzido e provado, permitindo a fundamentação da estratégia de cálculo da função de ativação. Dessa forma, reaproveita-se o circuito aritmético da soma ponderada para também computar a sigmóide. Essa re-utilização dos recursos levou a uma redução drástica de área total de circuito. Após modelagem e simulação para validação do bom funcionamento, a arquitetura proposta foi sintetizada utilizando recursos reconfiguráveis, do tipo FPGA. Os resultados são promissores. Abstract in english There are several neural network implementations using either software, hardware-based or a hardware/software co-design. This work proposes a hardware architecture to implement an artificial neural network (ANN), whose topology is the multilayer perceptron (MLP). In this paper, we explore the parall [...] elism of neural networks and allow on-thefly changes of the number of inputs, number of layers and number of neurons per layer of the net. This reconfigurability characteristic permits that any application of ANNs may be implemented using the proposed hardware. In order to reduce the processing time that is spent in arithmetic computation, a real number is represented using a fraction of integers. In this way, the arithmetics is limited to integer operations, performed by fast combinational circuits. A simple state machine is required to control sums and products of fractions. Sigmoid is used as the activation function in the proposed implementation. It is approximated by polynomials, whose underlying computation requires only sums and products. A theorem is introduced and proven so as to cover the arithmetic strategy of the computation of the activation function. Thus, the arithmetic circuitry used to implement the neuron weighted sum is reused for computing the sigmoid. this resource sharing decreased drastically the total area of the system. After modeling and simulation for functionality validation, the proposed architecture synthesized using reconfigurable hardware. The results are promising.
Online learning dynamics of multilayer perceptrons with unidentifiable parameters
International Nuclear Information System (INIS)
In the over-realizable learning scenario of multilayer perceptrons, in which the student network has a larger number of hidden units than the true or optimal network, some of the weight parameters are unidentifiable. In this case, the teacher network consists of a union of optimal subspaces included in the parameter space. The optimal subspaces, which lead to singularities, are known to affect the estimation performance of neural networks. Using statistical mechanics, we investigate the online learning dynamics of two-layer neural networks in the over-realizable scenario with unidentifiable parameters. We show that the convergence speed strongly depends on the initial parameter conditions. We also show that there is a quasi-plateau around the optimal subspace, which differs from the well-known plateaus caused by permutation symmetry. In addition, we discuss the property of the final learning state, relating this to the singular structures
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
Pedroni, N.; Zio, E.; Cadini, F.
2008-01-01
Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP) for nuclear dynamics are considered in comparison to static mo...
Efficient Estimation of Multidimensional Regression Model with Multilayer Perceptron
Rynkiewicz, Joseph
2008-01-01
This work concerns estimation of multidimensional nonlinear regression models using multilayer perceptron (MLP). The main problem with such model is that we have to know the covariance matrix of the noise to get optimal estimator. however we show that, if we choose as cost function the logarithm of the determinant of the empirical error covariance matrix, we get an asymptotically optimal estimator.
Multilayer perceptron in damage detection of bridge structures
Pandey, P. C.; Barai, S. V.
1995-02-01
Recent developments in artificial neural networks (ANN) have opened up new possibilities in the domain of structural engineering. For inverse problems like structural identification of large civil engineerlng structures such as bridges and buildings where the in situ measured data are expected to be imprecise and often incomplete, the ANN holds greater promise. The detection of structural damage and identification of damaged element in a large complex structure is a challenging task indeed. This paper presents an application of multilayer perceptron in the damage detection of steel bridge structures. The ssues relating to the design of network and learning paradigm are addressed and network architectures have been developed with reference to trussed bridge structures. The training patterns are generated for multiple damaged zones in a structure and performance of the networks with one and two hidden layers are examined. It has been observed that the performance of the network with two hidden layers was better than that of a single-layer architecture in general. The engineering importance of the whole exercise is demonstrated from the fact that measured input at only a few locations in the structure is needed in the identification process using the ANN.
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
Directory of Open Access Journals (Sweden)
N. Pedroni
2008-03-01
Full Text Available Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP for nuclear dynamics are considered in comparison to static modeling by a finite impulse response multilayer perceptron (FIR-MLP and a conventional static MLP. The comparison is made with respect to the nonlinear dynamics of a nuclear reactor as investigated by IIR-MLP in a previous paper. The superior performance of the locally recurrent scheme is demonstrated.
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
International Nuclear Information System (INIS)
Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP) for nuclear dynamics are considered in comparison to static modeling by a finite impulse response multilayer perceptron (FIR-MLP) and a conventional static MLP. The comparison is made with respect to the nonlinear dynamics of a nuclear reactor as investigated by IIR-MLP in a previous paper. The superior performance of the locally recurrent scheme is demonstrated
Asymptotic law of likelihood ratio for multilayer perceptron models.
Rynkiewicz, Joseph
2010-01-01
We consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The data are assumed to be generated by a true MLP model and the estimation of the parameters of the MLP is done by maximizing the likelihood of the model. When the number of hidden units of the true model is known, the asymptotic distribution of the maximum likelihood estimator (MLE) and the likelihood ratio (LR) statistic is easy to compute and converge to a $\\c...
Sartori, Michael A.; Passino, Kevin M.; Antsaklis, Panos J.
1992-01-01
In rule-based AI planning, expert, and learning systems, it is often the case that the left-hand-sides of the rules must be repeatedly compared to the contents of some 'working memory'. The traditional approach to solve such a 'match phase problem' for production systems is to use the Rete Match Algorithm. Here, a new technique using a multilayer perceptron, a particular artificial neural network model, is presented to solve the match phase problem for rule-based AI systems. A syntax for premise formulas (i.e., the left-hand-sides of the rules) is defined, and working memory is specified. From this, it is shown how to construct a multilayer perceptron that finds all of the rules which can be executed for the current situation in working memory. The complexity of the constructed multilayer perceptron is derived in terms of the maximum number of nodes and the required number of layers. A method for reducing the number of layers to at most three is also presented.
Madyastha, Raghavendra K.; Aazhang, Behnaam; Henson, Troy F.; Huxhold, Wendy L.
1992-01-01
This paper addresses the issue of applying a globally convergent optimization algorithm to the training of multilayer perceptrons, a class of Artificial Neural Networks. The multilayer perceptrons are trained towards the solution of two highly nonlinear problems: (1) signal detection in a multi-user communication network, and (2) solving the inverse kinematics for a robotic manipulator. The research is motivated by the fact that a multilayer perceptron is theoretically capable of approximating any nonlinear function to within a specified accuracy. The algorithm that has been employed in this study combines the merits of two well known optimization algorithms, the Conjugate Gradients and the Trust Regions Algorithms. The performance is compared to a widely used algorithm, the Backpropagation Algorithm, that is basically a gradient-based algorithm, and hence, slow in converging. The performances of the two algorithms are compared with the convergence rate. Furthermore, in the case of the signal detection problem, performances are also benchmarked by the decision boundaries drawn as well as the probability of error obtained in either case.
Scientific Electronic Library Online (English)
José C, Cúrvelo Santana; Sidnei A, de Araújo; Joana P, M. Biazus; Roberto R, de Souza.
2015-04-01
Full Text Available En este trabajo se propone utilizar una Red Neuronal Artificial (RNA) Perceptrón Multicapa (PMC) para simular la variación de la concentración de proteína de acuerdo con el tiempo y también para determinar la hora final del procedimiento, además de los parámetros óptimos del proceso de biodegradació [...] n de las proteínas de un efluente de matadero. Para eso, han sido utilizadas las papaínas, presentes en el látex de la papaya (Carica papaya) con el objetivo de disminuir la concentración de proteínas de un efluente de matadero a pH (5 y 7) con una temperatura de (25 y 30° C) controlada. Los resultados mostraron que las papaínas redujeron de 82% a 91% la concentración de proteína en 30 y 40 h de proceso. Las simulaciones con la RNA apuntaron que las condiciones perfectas fueron obtenidas a pH 5, con 30 °C y en 35 h, en el cual se ha alcanzado una reducción de 91% de la concentración de proteínas. Abstract in english In this paper, the use of a multilayer perceptron (MLP) artificial neural network (ANN) is proposed to simulate the variation of protein concentration according to the time and also to determine the end and optimal conditions of the biodegradation process of wastewater from meat industry. To reduce [...] the protein concentration, papains from Carica papaya latex have been used at controlled condition of pH (5 and 7) and temperature (25 and 30 °C). Results showed that a reduction of 82 to 91% of protein concentration by the action of papains for 30 to 40 h of process time. Simulations showed that the best condition of the process occurred at pH 5, 30 °C and 35 h, in which a maximum biodegradation of 91% was obtained.
Second-Order Learning Methods for a Multilayer Perceptron
International Nuclear Information System (INIS)
First- and second-order learning methods for feed-forward multilayer neural networks are studied. Newton-type and quasi-Newton algorithms are considered and compared with commonly used back-propagation algorithm. It is shown that, although second-order algorithms require enhanced computer facilities, they provide better convergence and simplicity in usage. 13 refs., 2 figs., 2 tabs
Dynamics of a multi-layered perceptron model : a rigorous result
Patrick, A. E.; Zagrebnov, V. A.
1990-01-01
We derive exactly and rigorously the system of dynamical equations for a multi-layered perceptron proposed by Domany, Meir and Kinzel (DMK-model). They describes both the main and the residual overlaps evolution.
Sarkar, Arindam; Mandal, J. K.
2012-01-01
In this paper, a multilayer perceptron guided key generation for encryption/decryption (MLPKG) has been proposed through recursive replacement using mutated character code generation for wireless communication of data/information. Multilayer perceptron transmitting systems at both ends accept an identical input vector, generate an output bit and the network are trained based on the output bit which is used to form a protected variable length secret-key. For each session, dif...
Classification of Log-Polar-Visual Eigenfaces using Multilayer Perceptron
Bhowmik, Mrinal Kanti; Nasipuri, Mita; Kundu, Mahantapas; Basu, Dipak Kumar
2010-01-01
In this paper we present a simple novel approach to tackle the challenges of scaling and rotation of face images in face recognition. The proposed approach registers the training and testing visual face images by log-polar transformation, which is capable to handle complicacies introduced by scaling and rotation. Log-polar images are projected into eigenspace and finally classified using an improved multi-layer perceptron. In the experiments we have used ORL face database and Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database for visual face images. Experimental results show that the proposed approach significantly improves the recognition performances from visual to log-polar-visual face images. In case of ORL face database, recognition rate for visual face images is 89.5% and that is increased to 97.5% for log-polar-visual face images whereas for OTCBVS face database recognition rate for visual images is 87.84% and 96.36% for log-polar-visual face images.
Asymptotic law of likelihood ratio for multilayer perceptron models
Rynkiewicz, Joseph
2010-01-01
We consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The data are assumed to be generated by a true MLP model and the estimation of the parameters of the MLP is done by maximizing the likelihood of the model. When the number of hidden units of the true model is known, the asymptotic distribution of the maximum likelihood estimator (MLE) and the likelihood ratio (LR) statistic is easy to compute and converge to a $\\chi^2$ law. However, if the number of hidden unit is over-estimated the Fischer information matrix of the model is singular and the asymptotic behavior of the MLE is unknown. This paper deals with this case, and gives the exact asymptotic law of the LR statistics. Namely, if the parameters of the MLP lie in a suitable compact set, we show that the LR statistics is the supremum of the square of a Gaussian process indexed by a class of limit score functions.
FORECASTING ON FOREX MARKET WITH RBF AND PERCEPTRON NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
ALEXANDRA KOTTILOVÁ
2012-01-01
Full Text Available This work deals with an alternative approach in financial modelling -artificial neural networks approach. The aim of this paper is to show that this type oftime series modelling is an excellent alternative to classical econometric modelling. Atfirst, neural networks using methods of supervised machine learning are discussed.After explaining theoretical basis of ANN, these models are then applied to specificexchange rate (AUD/USD. Finally, the comparison between statistical models andRBF and perceptron neural networks is made to illustrate the sense of using ANNmodels
Mozumder, Chitrini; Tripathi, Nitin K.
2014-10-01
In recent decades, the world has experienced unprecedented urban growth which endangers the green environment in and around urban areas. In this work, an artificial neural network (ANN) based model is developed to predict future impacts of urban and agricultural expansion on the uplands of Deepor Beel, a Ramsar wetland in the city area of Guwahati, Assam, India, by 2025 and 2035 respectively. Simulations were carried out for three different transition rates as determined from the changes during 2001-2011, namely simple extrapolation, Markov Chain (MC), and system dynamic (SD) modelling, using projected population growth, which were further investigated based on three different zoning policies. The first zoning policy employed no restriction while the second conversion restriction zoning policy restricted urban-agricultural expansion in the Guwahati Municipal Development Authority (GMDA) proposed green belt, extending to a third zoning policy providing wetland restoration in the proposed green belt. The prediction maps were found to be greatly influenced by the transition rates and the allowed transitions from one class to another within each sub-model. The model outputs were compared with GMDA land demand as proposed for 2025 whereby the land demand as produced by MC was found to best match the projected demand. Regarding the conservation of Deepor Beel, the Landscape Development Intensity (LDI) Index revealed that wetland restoration zoning policies may reduce the impact of urban growth on a local scale, but none of the zoning policies was found to minimize the impact on a broader base. The results from this study may assist the planning and reviewing of land use allocation within Guwahati city to secure ecological sustainability of the wetlands.
Multi-objective turbomachinery optimization using a gradient-enhanced multi-layer perceptron
Duta, Mc; Duta, Md
2009-01-01
Response surface models (RSMs) have found widespread use to reduce the overall computational cost of turbomachinery blading design optimization. Recent developments have seen the successful use of gradient information alongside sampled response values in building accurate response surfaces. This paper describes the use of gradients to enhance the performance of the RSM provided by a multi-layer perceptron. Gradient information is included in the perceptron by modifying the error function such...
An application of the multilayer perceptron: Solar radiation maps in Spain
Energy Technology Data Exchange (ETDEWEB)
Hontoria, L.; Aguilera, J. [Grupo Investigacion y Desarrollo en Energia Solar y Automatica, Dpto. de Ingenieria Electronica, de Telecomunicaciones y Automatica, Escuela Politecnica Superior de Jaen, Campus de las Lagunillas, Universidad de Jaen, 23071 Jaen (Spain); Zufiria, P. [Grupo de Redes Neuronales, Dpto. de Matematica Aplicada a las Tecnologias de la Informacion, ETSI Telecomunicaciones, UPM Ciudad Universitaria s/n, 28040 Madrid (Spain)
2005-11-01
In this work an application of a methodology to obtain solar radiation maps is presented. This methodology is based on a neural network system [Lippmann, R.P., 1987. An introduction to computing with neural nets. IEEE ASSP Magazine, 4-22] called Multi-Layer Perceptron (MLP) [Haykin, S., 1994. Neural Networks. A Comprehensive Foundation. Macmillan Publishing Company; Hornik, K., Stinchcombe, M., White, H., 1989. Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359-366]. To obtain a solar radiation map it is necessary to know the solar radiation of many points spread wide across the zone of the map where it is going to be drawn. For most of the locations all over the world the records of these data (solar radiation in whatever scale, daily or hourly values) are non-existent. Only very few locations have the privilege of having good meteorological stations where records of solar radiation have being registered. But even in those locations with historical records of solar data, the quality of these solar series is not as good as it should be for most purposes. In addition, to draw solar radiation maps the number of points on the maps (real sites) that it is necessary to work with makes this problem difficult to solve. Nevertheless, with the application of the methodology proposed in this paper, this problem has been solved and solar radiation maps have been obtained for a small region of Spain: Jaen province, a southern province of Spain between parallels 38{sup o}25' N and 37{sup o}25' N, and meridians 4{sup o}10' W and 2{sup o}10' W, and for a larger region: Andalucia, the most southern region of Spain situated between parallels 38{sup o}40' N and 36{sup o}00' N, and meridians 7{sup o}30' W and 1{sup o}40' W. (author)
International Nuclear Information System (INIS)
The problem of pion-electron identification based on their energy losses in the TRD is considered in the frame of the CBM experiment. For particles identification an artificial neural network (ANN) was used, a multilayer perceptron realized in JETNET and ROOT packages. It is demonstrated that, in order to get correct and comparable results, it is important to define the network structure correctly. The recommendations for such a selection are given. In order to achieve an acceptable level of pions suppression, the energy losses need to be transformed to more 'effective' variables. The dependency of ANN output threshold for a fixed portion of electron loss on the particle momentum is presented
Tfwala, Samkele S; Wang, Yu-Min; Lin, Yu-Chieh
2013-01-01
Hydrological data are often missing due to natural disasters, improper operation, limited equipment life, and other factors, which limit hydrological analysis. Therefore, missing data recovery is an essential process in hydrology. This paper investigates the accuracy of artificial neural networks (ANN) in estimating missing flow records. The purpose is to develop and apply neural networks models to estimate missing flow records in a station when data from adjacent stations is available. Multilayer perceptron neural networks model (MLP) and coactive neurofuzzy inference system model (CANFISM) are used to estimate daily flow records for Li-Lin station using daily flow data for the period 1997 to 2009 from three adjacent stations (Nan-Feng, Lao-Nung and San-Lin) in southern Taiwan. The performance of MLP is slightly better than CANFISM, having R (2) of 0.98 and 0.97, respectively. We conclude that accurate estimations of missing flow records under the complex hydrological conditions of Taiwan could be attained by intelligent methods such as MLP and CANFISM. PMID:24453876
Face Recognition through Multilayer Perceptron (MLP and Learning Vector Quantization (LVQ
Directory of Open Access Journals (Sweden)
Dr. Ikvinderpal Singh
2012-12-01
Full Text Available Face recognition is challenging problems and there is still a lot of work that needs to be done in this area. Over the past ten years, face recognition has received substantial attention from researchers in biometrics, pattern recognition, computer vision, and cognitive psychology communities. This common interest in facial recognition technology among researchers working in diverse fields is motivated both by the remarkable ability to recognize people and by the increased attention being devoted to security applications. Applications of face recognition can be found in security, tracking, multimedia, and entertainment domains.This paper presents a face recognition system using artificial neural network. Here, we have designed a neural network with some own set network parameters. The results presented here have been obtained using two basic methods: multilayer perceptron (MLP, and learning vector quantization (LVQ. In both cases, two kinds of data have been fed to the classifiers: reduced resolution images (gray level or segmented, and feature vectors. The experimental results also show that, for the approaches considered here, analyzing gray level images produced better results than analyzing geometrical features, either because of the errors introduced during their extraction or because the original images have a richer information content. Furthermore, training times were much shorter for LVQ than for MLP. On the other hand, MLP achieved lower error rates when dealing with geometrical features.
Using multilayer perceptron and a satellite image for the estimation of soil salinity
International Nuclear Information System (INIS)
Applying the model of the Perceptron multilayer with momentum of an artificial neural network particularly and a multispectral image of high resolution spatial and radiometric, for the first time estimated the salinity of the soil cultivated with sugar cane. The study area is the UBPC 'Lazaro Romero' of the sugar company 'Hector Molina' of the locality San Nicolas de Bari, Havana province, located at 22° 44' North latitude and 81 ° 56' longitude West. The experiments were made in the framework of the El-479 project funded by the Inter universities Council of Flanders, Belgium. 36 samples geo referenced of soils were taken at 3 depths in each of the 4 sugar cane selected blocks, which determined the electrical conductivity of the saturation extract; half of that amount of data was used for the training of the network and the other half for control in a computer program of the artificial neural network created to that effect, together with the reflectance of vegetation indexes for the image, which were maps of electrical conductivity of each block and bands. They were compared with those obtained by simple linear regression between the normalized difference vegetation index and electrical conductivity, Ndv with the approach of the neuronal network, the correlation coefficient was 0.78 to 0.83, while the linear regression was between 0.65 to 0.75
International Nuclear Information System (INIS)
In the thesis the results of verification of multilayer perceptron (MLP) {20–41–1} application with sigmoid activation function for prediction of lateral radionuclide migration are presented. The calculated values of Cs 137 and Sr 90 volumetric activity are close to experimental measurement limits, indicating the possibility of MLP application for the solving problem. (authors)
Estimate of significant wave height from non-coherent marine radar images by multilayer perceptrons
Vicen-Bueno, Raúl; Lido-Muela, Cristina; Nieto-Borge, José Carlos
2012-12-01
One of the most relevant parameters to characterize the severity of ocean waves is the significant wave height ( H s ). The estimate of H s from remotely sensed data acquired by non-coherent X-band marine radars is a problem not completely solved nowadays. A method commonly used in the literature (standard method) uses the square root of the signal-to-noise ratio (SNR) to linearly estimate H s . This method has been widely used during the last decade, but it presents some limitations, especially when swell-dominated sea states are present. To overcome these limitations, a new non-linear method incorporating additional sea state information is proposed in this article. This method is based on artificial neural networks (ANNs), specifically on multilayer perceptrons (MLPs). The information incorporated in the proposed MLP-based method is given by the wave monitoring system (WaMoS II) and concerns not only to the square root of the SNR, as in the standard method, but also to the peak wave length and mean wave period. Results for two different platforms (Ekofisk and FINO 1) placed in different locations of the North Sea are presented to analyze whether the proposed method works regardless of the sea states observed in each location or not. The obtained results empirically demonstrate how the proposed non-linear solution outperforms the standard method regardless of the environmental conditions (platform), maintaining real-time properties.
Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis
Rossi, Fabrice; Conan-guez, Brieuc
2004-01-01
This paper is an improved version of \\cit in which we study a natural extension of Multi-Layer Perceptrons (MLP) to functional inputs. We show that fundamental results for classical MLP can be extended to functional MLP. We obtain universal approximation results that show the expressive power of functional MLP is comparable to that of numerical MLP. We obtain consistency results which imply that the estimation of optimal parameters for functional MLP is statistically well defined. We finally ...
Experts Fusion and Multilayer Perceptron Based on Belief Learning for Sonar Image Classification
Martin, Arnaud; Osswald, Christophe
2008-01-01
The sonar images provide a rapid view of the seabed in order to characterize it. However, in such as uncertain environment, real seabed is unknown and the only information we can obtain, is the interpretation of different human experts, sometimes in conflict. In this paper, we propose to manage this conflict in order to provide a robust reality for the learning step of classification algorithms. The classification is conducted by a multilayer perceptron, taking into account ...
A New Approach to Predicting Bankruptcy: Combining DEA and Multi-Layer Perceptron
Ayan Mukhopadhyay; Suman Tiwari; Ankit Narsaria; Bhaskar Roy Karmaker
2012-01-01
The question of financial health and sustenance of a firm is so intriguing that it has spanned numerous studies. For investors,stakeholders and lenders, assessing the risk associated with an enterprise is vital. Several tools have been formulated to deal with predicting the solvency of a firm. This paper attempts to combine Data Envelopment Analysis and Multi-Layer Perceptron (MLP) to suggest a new method for prediction of bankruptcy that not only focusses on historical financial data of firm...
Directory of Open Access Journals (Sweden)
Hadi Memarian
2012-10-01
Full Text Available Prediction of highly non-linear behavior of suspended sediment flow in rivers has prime importance in environmental studies and watershed management. In this study, the predictive performance of two Artificial Neural Networks (ANNs, namely Radial Basis Function (RBF and Multi-Layer Perceptron (MLP were compared. Time series data of daily suspended sediment discharge and water discharge at the Langat River, Malaysia were used for training and testing the networks. Mean Square Error (MSE, Normalized Mean Square Error (NMSE and correlation coefficient (r were used for performance evaluation of the models. Using the testing data set, both models produced a similar level of robustness in sediment load simulation. The MLP network model showed a slightly better output than the RBF network model in predicting suspended sediment discharge, especially in the training process. However, both ANNs showed a weak robustness in estimating large magnitudes of sediment load.
30 years of adaptive neural networks - Perceptron, Madaline, and backpropagation
Widrow, Bernard; Lehr, Michael A.
1990-01-01
Fundamental developments in feedforward artificial neural networks from the past thirty years are reviewed. The history, origination, operating characteristics, and basic theory of several supervised neural-network training algorithms (including the perceptron rule, the least-mean-square algorithm, three Madaline rules, and the backpropagation technique) are described. The concept underlying these iterative adaptation algorithms is the minimal disturbance principle, which suggests that during training it is advisable to inject new information into a network in a manner that disturbs stored information to the smallest extent possible. The two principal kinds of online rules that have developed for altering the weights of a network are examined for both single-threshold elements and multielement networks. They are error-correction rules, which alter the weights of a network to correct error in the output response to the present input pattern, and gradient rules, which alter the weights of a network during each pattern presentation by gradient descent with the objective of reducing mean-square error (averaged over all training patterns).
Hybrid Evolutionary Algorithm for Multilayer Perceptron Networks with Competetive Performance.
Czech Academy of Sciences Publication Activity Database
Neruda, Roman
Los Alamitos : IEEE, 2007, s. 1620-1627. ISBN 978-1-4244-1339-3. [CEC 2007. Congress on Evolutionary Computation. Singapore (SG), 25.09.2007-28.09.2007] R&D Projects: GA AV ?R 1ET100300419 Institutional research plan: CEZ:AV0Z10300504 Keywords : hybrid algorithm s * evolutionary learning * neural networks Subject RIV: IN - Informatics, Computer Science
Directory of Open Access Journals (Sweden)
Saleh Salimi
2013-10-01
Full Text Available In order to perceive of rainfall- runoff process, essential prediction for water surface source management has special importance. Thereby in this paper, Tang-e Karzin hydrometric station which is located in sub-domain of salman-farsi dam had been considered. By utilizing of weekly statistical discharge information related to past 36 years, multilayer perceptron neural network model was used to predict the average weekly discharge of Tang-e Karzin station through the discharge information of its two upside stations. In order to optimize the weights and biases of the MLP network, we tried to use Artificial Bee Colony (ABC algorithm within training phase of the ANN network. The results indicated that by changing of different parameters of hidden layer of perceptron model, ABC can well optimize ANN’s weights and biases. Among five activation function Log-sigmoid was performed better than others with 9 neurons in hidden layer
Stability of multilayered neural networks
International Nuclear Information System (INIS)
Stability of multilayered neural networks against synaptic changes has been studied numerically. The average maximum change goes to zero as the number N of input neurons is much greater than one. If a fixed fraction of output errors is allowed, then the synapses may be changed within some limits even for large N. (Author)
Classification of Parking Spots Using Multilayer Perceptron Networks
Directory of Open Access Journals (Sweden)
FALCAO, H. S.
2013-12-01
Full Text Available This project intends to develop a prototype for the identification of free spots in open air parking area where there is a good aerial view without obstacles, allowing for the identification of occupied and free spots. We used image processing techniques and pattern recognition using Artificial Neural Networks (ANN. In order to help implement the prototype, we used Matlab. In order to simulate the parking area, we created a model so that we could acquire the images using a webcam, process them, train the neural network, classify the spots and finally, show the results. The results show that it is viable to apply pattern recognition through image capture to classify parking spots
Multilayer Perceptron with Functional Inputs: an Inverse Regression Approach
Ferre?, Louis; Villa, Nathalie
2006-01-01
Abstract. Functional data analysis is a growing research field as more and more practical applications involve functional data. In this paper, we focus on the problem of regression and classification with functional predictors: the model suggested combines an efficient dimension reduction procedure [functional sliced inverse regression, first introduced by Ferré & Yao (Statistics, 37, 2003, 475)], for which we give a regularized version, with the accuracy of a neural network. Some consistenc...
FPGA Implementation of Multilayer Perceptron for Modeling of Photovoltaic panel
International Nuclear Information System (INIS)
The Number of electronic applications using artificial neural network-based solutions has increased considerably in the last few years. However, their applications in photovoltaic systems are very limited. This paper introduces the preliminary result of the modeling and simulation of photovoltaic panel based on neural network and VHDL-language. In fact, an experimental database of meteorological data (irradiation, temperature) and output electrical generation signals of the PV-panel (current and voltage) has been used in this study. The inputs of the ANN-PV-panel are the daily total irradiation and mean average temperature while the outputs are the current and voltage generated from the panel. Firstly, a dataset of 4x364 have been used for training the network. Subsequently, the neural network (MLP) corresponding to PV-panel is simulated using VHDL language based on the saved weights and bias of the network. Simulation results of the trained MLP-PV panel based on Matlab and VHDL are presented. The proposed PV-panel model based ANN and VHDL permit to evaluate the performance PV-panel using only the environmental factors and involves less computational efforts, and it can be used for predicting the output electrical energy from the PV-panel
International Nuclear Information System (INIS)
Highlights: • Multilayer perceptrons are used to simulate the I–V curve of thin-film PV modules. • APE from the spectral irradiance was added as an input variable to the network. • A self-organised map is used to select the curves used for training the network. • Curve error and maximum power error decrease when using this technique. • This method could provide accurate estimation of the output of a PV plant. - Abstract: In this paper, we propose the use of a methodology to characterise the electrical parameters of several thin-film photovoltaic module technologies. This methodology allows us to use not only solar irradiance and module temperature as classical models do, but also spectral distribution of solar radiation. The methodology is based on the use of neural network models. From all measured I–V curves of a module, a previous selection of them has been used in order to train the neural network model. This selection is performed using a Kohonen self-organising map fed with spectral data. This spectral information has been added as an input to the neural network itself. The results show that the incorporation of spectral measurements to simulate thin-film modules improves significantly both the fitting of the predicted I–V curve to the measured one and the peak power point estimation
Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
Mimura, Kazushi; Okada, Masato
2011-01-01
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limitation, while the theoretical results seems a bit promising. Instead, it reveals it might have a rich and complex structure of the solution space via the BP-based algorithms.
Classification of Polar-Thermal Eigenfaces using Multilayer Perceptron for Human Face Recognition
Bhowmik, Mrinal Kanti; Nasipuri, Mita; Basu, Dipak Kumar; Kundu, Mahantapas
2010-01-01
This paper presents a novel approach to handle the challenges of face recognition. In this work thermal face images are considered, which minimizes the affect of illumination changes and occlusion due to moustache, beards, adornments etc. The proposed approach registers the training and testing thermal face images in polar coordinate, which is capable to handle complicacies introduced by scaling and rotation. Polar images are projected into eigenspace and finally classified using a multi-layer perceptron. In the experiments we have used Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database benchmark thermal face images. Experimental results show that the proposed approach significantly improves the verification and identification performance and the success rate is 97.05%.
A New Approach to Predicting Bankruptcy: Combining DEA and Multi-Layer Perceptron
Directory of Open Access Journals (Sweden)
Ayan Mukhopadhyay
2012-07-01
Full Text Available The question of financial health and sustenance of a firm is so intriguing that it has spanned numerous studies. For investors,stakeholders and lenders, assessing the risk associated with an enterprise is vital. Several tools have been formulated to deal with predicting the solvency of a firm. This paper attempts to combine Data Envelopment Analysis and Multi-Layer Perceptron (MLP to suggest a new method for prediction of bankruptcy that not only focusses on historical financial data of firms that filed for bankruptcy like other past studies but also takes into account the data of those firms that were likely to do so. This method thus identifies firms that have a high chance of facing bankruptcy along with those that have filed for bankruptcy. The performance of this procedure is compared with MLP. The suggested method outperforms MLP in prediction of bankruptcy.
Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method
International Nuclear Information System (INIS)
A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its ''black box'' aspect, many researchers refuse to use it. Moreover, the optimization (often based on the exhaustive approach where ''all'' configurations are tested) and learning phases of this artificial intelligence tool (often based on the Levenberg-Marquardt algorithm; LMA) are weaknesses of this approach (exhaustively and local minima). These two tasks must be repeated depending on the knowledge of each new problem studied, making the process, long, laborious and not systematically robust. In this paper a pruning process is proposed. This method allows, during the training phase, to carry out an inputs selecting method activating (or not) inter-nodes connections in order to verify if forecasting is improved. We propose to use iteratively the popular damped least-squares method to activate inputs and neurons. A first pass is applied to 10% of the learning sample to determine weights significantly different from 0 and delete other. Then a classical batch process based on LMA is used with the new MLP. The validation is done using 25 measured meteorological TS and cross-comparing the prediction results of the classical LMA and the 2-stage LMA
Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method
Voyant, Cyril; Tamas, Wani; Paoli, Christophe; Balu, Aurélia; Muselli, Marc; Nivet, Marie-Laure; Notton, Gilles
2014-03-01
A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the exhaustive approach where "all" configurations are tested) and learning phases of this artificial intelligence tool (often based on the Levenberg-Marquardt algorithm; LMA) are weaknesses of this approach (exhaustively and local minima). These two tasks must be repeated depending on the knowledge of each new problem studied, making the process, long, laborious and not systematically robust. In this paper a pruning process is proposed. This method allows, during the training phase, to carry out an inputs selecting method activating (or not) inter-nodes connections in order to verify if forecasting is improved. We propose to use iteratively the popular damped least-squares method to activate inputs and neurons. A first pass is applied to 10% of the learning sample to determine weights significantly different from 0 and delete other. Then a classical batch process based on LMA is used with the new MLP. The validation is done using 25 measured meteorological TS and cross-comparing the prediction results of the classical LMA and the 2-stage LMA.
Leaf Recognition Algorithm Using MLP Neural Network Based Image Processing
Ekshinge Sandip Sambhaji*1,; Andore, D. B.
2014-01-01
In this paper, we employ Multilayer Perceptron with image and data processing techniques and neuralIn this paper, we employ Multilayer Perceptron with image and data processing techniques and neuralIn this paper, we employ Multilayer Perceptron with image and data processing techniques and neuralnetwork to implement a general purpose automated leaf recognition. Sampling leaves and photoing them are low cost and convenient. One can easily transfer the leaf image to a computer and a computer ca...
Burger, Harold Christopher; Schuler, Christian J.; Harmeling, Stefan
2012-01-01
Image denoising can be described as the problem of mapping from a noisy image to a noise-free image. In another paper, we show that multi-layer perceptrons can achieve outstanding image denoising performance for various types of noise (additive white Gaussian noise, mixed Poisson-Gaussian noise, JPEG artifacts, salt-and-pepper noise and noise resembling stripes). In this work we discuss in detail which trade-offs have to be considered during the training procedure. We will s...
Sanong Amaroek; Nipon Theera-Umpon; Kittichai Wantanajittikul; Sansanee Auephanwiriyakul
2010-01-01
Problem statement: Estimation of moisture contents of dried food products from their dielectric constants was an important step in moisture measurement systems. The regression models that provide good prediction performance are desirable. Approach: The Multilayer Perceptrons (MLP) and Support Vector Regression (SVR) were applied in this research to predict the moisture contents of dried longan arils from their dielectric constants. The data set was collected from 1500 samp...
Becerra, Roberto; Joya, Gonzalo; Garci?a, Rodolfo; Vela?zque, Luis; Rodri?guez, Roberto; Pino, Carmen
2013-01-01
In this paper, we compare the performance of two different methods for the task of electrooculogram saccadic points classification in Patients with Ataxia SCA2: Multilayer Perceptrons (MLP) and Random Forest. First we segment the recordings of 6 subjects into ranges of saccadic and non-saccadic points as the basis of supervised learning. Then, we randomly select a set of cases based on the velocity profile near each selected point for training and validation purposes using percent split schem...
Multilayer neural networks a generalized net perspective
Krawczak, Maciej
2013-01-01
The primary purpose of this book is to show that a multilayer neural network can be considered as a multistage system, and then that the learning of this class of neural networks can be treated as a special sort of the optimal control problem. In this way, the optimal control problem methodology, like dynamic programming, with modifications, can yield a new class of learning algorithms for multilayer neural networks. Another purpose of this book is to show that the generalized net theory can be successfully used as a new description of multilayer neural networks. Several generalized net descriptions of neural networks functioning processes are considered, namely: the simulation process of networks, a system of neural networks and the learning algorithms developed in this book. The generalized net approach to modelling of real systems may be used successfully for the description of a variety of technological and intellectual problems, it can be used not only for representing the parallel functioning of homogen...
Directory of Open Access Journals (Sweden)
Alejandro J. Orozco-Naranjo
2013-11-01
Full Text Available This paper presents the results obtained by developing a methodology to detect 5 types of heartbeats (Normal (N, Right bundle branch block (RBBB, Left bundle branch block (LBBB, Premature atrial contraction (APC and Premature ventricular contraction (PVC, using Wavelet transform packets with non-adaptative mode applied on features extraction from heartbeats. It was used the Shannon function to calculate the entropy and It was added an identification nodes stage per every type of cardiac signal in the Wavelet tree. The using of Wavelet packets transform allows the access to information which results of decomposition of low and high frecuency, giving providing a more integral analysis than achieved by the discrete Wavelet transform. Three families of mother Wavelet were evaluated on transformation: Daubechies, Symlet and Reverse Biorthogonal, which were results from a previous research in that were identified the mother Wavelet that had higher entropy with the cardiac signals. With non-adaptive mode, the computational cost is reduced when Wavelet packets are used; this cost represents the most marked disadvantage from the transform. To classify the heartbeats were used Support Vector Machines and Multilayer Perceptron. The best classification error was achieved employing Support Vector Machine and a radial basis function; it was 2.57 %.
FORECASTING ON FOREX MARKET WITH RBF AND PERCEPTRON NEURAL NETWORKS
ALEXANDRA KOTTILOVÁ; LUKÁŠ FALÁT
2012-01-01
This work deals with an alternative approach in financial modelling -artificial neural networks approach. The aim of this paper is to show that this type oftime series modelling is an excellent alternative to classical econometric modelling. Atfirst, neural networks using methods of supervised machine learning are discussed.After explaining theoretical basis of ANN, these models are then applied to specificexchange rate (AUD/USD). Finally, the comparison between statistical models andRBF and ...
Fast accurate MEG source localization using a multilayer perceptron trained with real brain noise
International Nuclear Information System (INIS)
Iterative gradient methods such as Levenberg-Marquardt (LM) are in widespread use for source localization from electroencephalographic (EEG) and magnetoencephalographic (MEG) signals. Unfortunately, LM depends sensitively on the initial guess, necessitating repeated runs. This, combined with LM's high per-step cost, makes its computational burden quite high. To reduce this burden, we trained a multilayer perceptron (MLP) as a real-time localizer. We used an analytical model of quasistatic electromagnetic propagation through a spherical head to map randomly chosen dipoles to sensor activities according to the sensor geometry of a 4D Neuroimaging Neuromag-122 MEG system, and trained a MLP to invert this mapping in the absence of noise or in the presence of various sorts of noise such as white Gaussian noise, correlated noise, or real brain noise. A MLP structure was chosen to trade off computation and accuracy. This MLP was trained four times, with each type of noise. We measured the effects of initial guesses on LM performance, which motivated a hybrid MLP-start-LM method, in which the trained MLP initializes LM. We also compared the localization performance of LM, MLPs, and hybrid MLP-start-LMs for realistic brain signals. Trained MLPs are much faster than other methods, while the hybrid MLP-start-LMs are faster and more accurate than fixed-4-start-LM. In particular, the hybrid MLP-start-LM initialized by a MLP trained with the real brain noise dataset is 60 times fase real brain noise dataset is 60 times faster and is comparable in accuracy to random-20-start-LM, and this hybrid system (localization error: 0.28 cm, computation time: 36 ms) shows almost as good performance as optimal-1-start-LM (localization error: 0.23 cm, computation time: 22 ms), which initializes LM with the correct dipole location. MLPs trained with noise perform better than the MLP trained without noise, and the MLP trained with real brain noise is almost as good an initial guesser for LM as the correct dipole location. (author) )
An Optical Thresholding Perceptron
Saxena, Indu; Moerland, Perry; Fiesler, Emile; Pourzand, A. R.; Collings, N.
1997-01-01
An implementation of an optical perceptron with a soft optical threshold trained with an adapted BP algorithm is described as a precursor to an optical multilayer perceptron (MLP). It has 64 inputs and ten outputs. The soft threshold is implemented by a liquid crystal light valve. Experimental results on perceptron recall are also reported. The effect of a modified grey-scale to weight mapping for weight levels implemented by LCTVs is evaluated based on the results of handwritten digit recogn...
Bachtiar, Luqman R; Unsworth, Charles P; Newcomb, Richard D
2014-08-01
Current electronic noses, or e-noses, that employ insect odorant receptors (Ors) as their sensory front end are potentially limited by the fact that the Ors come from a single species. In addition, a realistic e-nose also demands low numbers of Ors at its sensory front end due to the difficulties of receptor/sensor integration and functionalisation. In this work, we report the first investigations of a `Super E-Nose' that incorporates Ors from both the model organism Drosophila melanogaster fruit fly (DmOr) and the mosquito, Anopheles gambiae (AgOr). Furthermore, we report how an Artificial Neural Network (ANN), in the form of a hybrid double hidden layer Multi-Layer Perceptron (MLP), can be used to determine the optimal Ors that provide the best prediction performance in the classification of unknown odorants into their respective chemical class. Our findings demonstrate how 3-Or arrays consisting of DmOr only, AgOr only, or cross-species DmOr-AgOr combinations correctly classified all unknown odorants of the validation set. In addition, we report that all 3-Or combinations perform equally well as the complete 74 DmOr-AgOr array. Thus, the results of this work support further investigation into cross-species `Super E-noses' coupled with hybrid MLPs for the classification of unknown odorants. PMID:25570118
Bachtiar, Luqman R; Unsworth, Charles P; Newcomb, Richard D
2015-01-01
The model organism, Drosophila melanogaster, and the mosquito Anopheles gambiae use 60 and 79 odorant receptors, respectively, to sense their olfactory world. However, a commercial "electronic nose" in the form of an insect olfactory biosensor demands very low numbers of receptors at its front end of detection due to the difficulties of receptor/sensor integration and functionalization. In this letter, we demonstrate how computation via artificial neural networks (ANNs), in the form of multilayer perceptrons (MLPs), can be successfully incorporated as the signal processing back end of the biosensor to drastically reduce the number of receptors to three while still retaining 100% performance of odorant detection to that of a full complement of receptors. In addition, we provide a detailed performance comparison between D. melanogaster and A. gambiae odorant receptors and demonstrate that A. gambiae receptors provide superior olfaction detection performance over D. melanogaster for very low receptor numbers. The results from this study present the possibility of using the computation of MLPs to discover ideal biological olfactory receptors for an olfactory biosensor device to provide maximum classification performance of unknown odorants. PMID:25380337
Burger, Harold Christopher; Schuler, Christian J.; Harmeling, Stefan
2012-01-01
Image denoising can be described as the problem of mapping from a noisy image to a noise-free image. The best currently available denoising methods approximate this mapping with cleverly engineered algorithms. In this work we attempt to learn this mapping directly with plain multi layer perceptrons (MLP) applied to image patches. We will show that by training on large image databases we are able to outperform the current state-of-the-art image denoising methods. In addition,...
Introduction to Perceptron Networks
DEFF Research Database (Denmark)
Jantzen, Jan
1998-01-01
When it is time-consuming or expensive to model a plant using the basic laws of physics, a neural network approach can be an alternative. From a control engineer's viewpoint a two-layer perceptron network is sufficient. It is indicated how to model a dynamic plant using a perceptron network.
Evolutionary Feature Selection for Spiking Neural Network Pattern Classifiers
Valko, Michal; Cavalheiro, Nuno; Castelani, Marco
2005-01-01
This paper presents an application of the biologically realistic JASTAP neural network model to classification tasks. The JASTAP neural network model is presented as an alternative to the basic multi-layer perceptron model. An evolutionary procedure previously applied to the simultaneous solution of feature selection and neural network training on standard multi-layer perceptrons is extended with JASTAP model. Preliminary results on IRIS standard data set give evidence that this extension all...
Berrar, Daniel; Dubitzky, Werner
2006-01-01
This paper presents a novel type of artificial neural network, called neural plasma, which is tailored for classification tasks involving few observations with a large number of variables. Neural plasma learns to adapt its classification confidence by generating artificial training data as a function of its confidence in previous decisions. In contrast to multilayer perceptrons and similar techniques, which are inspired by topological and operational aspects of biological neural networks, neu...
Self-Organizing Multilayered Neural Networks of Optimal Complexity
Schetinin, V
2005-01-01
The principles of self-organizing the neural networks of optimal complexity is considered under the unrepresentative learning set. The method of self-organizing the multi-layered neural networks is offered and used to train the logical neural networks which were applied to the medical diagnostics.
Tfwala, Samkele S.; Yu-Min Wang; Yu-Chieh Lin
2013-01-01
Hydrological data are often missing due to natural disasters, improper operation, limited equipment life, and other factors, which limit hydrological analysis. Therefore, missing data recovery is an essential process in hydrology. This paper investigates the accuracy of artificial neural networks (ANN) in estimating missing flow records. The purpose is to develop and apply neural networks models to estimate missing flow records in a station when data from adjacent stations is available. Multi...
Advances in Artificial Neural Networks – Methodological Development and Application
Yanbo Huang
2009-01-01
Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other networks such as radial basis function, recurrent network, feedback network, and unsupervised Kohonen self-organizing network. These networks, especially the multilayer perceptron network with a back...
Evolutionary Learning Algorithm for Multi-layer Morphological Neural Networks
He Chunmei
2013-01-01
Morphological Neural Network (MNN) is a novel and important neural network and it has many applications such as image processing and pattern recognition. It makes sense to research the learning algorithm of MNN and its application. A method based on genetic algorithm is presented to train and implement multi-layer morphological neural network in this study. The algorithm calculates the weights and biases of morphological neural network and the genetic algorithm automatically acquire the learn...
Hybrid Optimized Back propagation Learning Algorithm For Multi-layer Perceptron
Chakraborty, Mriganka; Ghosh, Arka
2012-01-01
Standard neural network based on general back propagation learning using delta method or gradient descent method has some great faults like poor optimization of error-weight objective function, low learning rate, instability .This paper introduces a hybrid supervised back propagation learning algorithm which uses trust-region method of unconstrained optimization of the error objective function by using quasi-newton method .This optimization leads to more accurate weight upda...
Multilayer Perceptron for Robust Nonlinear Interval Regression Analysis Using Genetic Algorithms
Yi-Chung Hu
2014-01-01
On the basis of fuzzy regression, computational models in intelligence such as neural networks have the capability to be applied to nonlinear interval regression analysis for dealing with uncertain and imprecise data. When training data are not contaminated by outliers, computational models perform well by including almost all given training data in the data interval. Nevertheless, since training data are often corrupted by outliers, robust learning algorithms employed to resist outliers for ...
Directory of Open Access Journals (Sweden)
Sanong Amaroek
2010-01-01
Full Text Available Problem statement: Estimation of moisture contents of dried food products from their dielectric constants was an important step in moisture measurement systems. The regression models that provide good prediction performance are desirable. Approach: The Multilayer Perceptrons (MLP and Support Vector Regression (SVR were applied in this research to predict the moisture contents of dried longan arils from their dielectric constants. The data set was collected from 1500 samples of dried longan aril with five different moisture contents of 10, 14, 18, 22 and 25% Wet basis (Wb. Dielectric constant of dried longan aril was measured by using our previously proposed electrical capacitance-based system. The results from the MLP and SVR models were compared to that from the linear regression and polynomial regression models. To take into account the generalization of the models, the four-fold cross validation was applied. Results: For the training sets, the average mean absolute errors over three bulk densities of 1.30, 1.45 and 1.60 g cm-3 were 1.7578, 0.6157, 0.3812, 0.3113, 0.0103 and 0.0044% Wb for the linear regression, second-, third-, fourth-order polynomial regression, MLP and SVR models, respectively. For the validation sets, the average mean absolute errors over the three bulk densities were 1.7616, 0.6192, 0.3844, 0.3146, 0.0126 and 0.0093% Wb for the linear regression, 2nd, 3rd and 4th-order polynomial regression, MLP and SVR models, respectively. Conclusion: The regression models based on MLP and SVR yielded better performances than the models based on linear regression and polynomial regression on both training and validation sets. The models based on MLP and SVR also provided robustness to the variation of bulk density. Not only for dried longan aril, the proposed models can also be adapted and applied to other materials or dried food products.
Electron/pion identification in the CBM TRD using a multilayer perceptron
International Nuclear Information System (INIS)
The problem of electron/pion identification in the CBM experiment based on the measurements of energy losses and transition radiation in the TRD detector is discussed. A possibility to solve such a problem by applying an artificial neural network (ANN) is considered. As input information for the network we used both the samples of energy losses of pions or electrons in the TRD absorbers and the 'clever' variable obtained on the basis of the original data. We show that usage of this new variable permits one to reach a reliable level of particle recognition no longer than after 10-20 training epochs; there are practically no fluctuations against the trend, and the needed level of pions suppression is obtained under the condition of a minimal loss of electrons
The design and analysis of effective and efficient neural networks and their applications
Energy Technology Data Exchange (ETDEWEB)
Makovoz, W.V.
1989-01-01
A complicated design issue of efficient Multilayer neural networks is addressed, and the perception and similar neural networks are examined. It shows that a three-layer perceptron neural network with specially designed learning algorithms provides an efficient framework to solve an exclusive OR problem using only n {minus} 1 processing elements in the second layer. Two efficient rapidly converging algorithms for any symmetric Boolean function were developed using only n {minus} 1 processing elements in the perceptron neural network and int(n/2) processing elements in the Adaline and perceptron neural network with the stepfunction transfer function. Similar results were obtained for the quasi-symmetric Boolean functions using a linear number of processing elements in perceptron neural networks, Adaline's, and perceptron neural networks with the stepfunction transfer functions. Generalized Boolean functions are discussed and two rapidly converging algorithms are shown for perceptron neural networks, Adaline's, and perceptron neural network with stepfunction transfer function. Many other interesting perceptron neural networks are discussed in the dissertation. Perceptron neural networks are applied to find the largest value of the n inputs. A new perceptron neural network is designed to find the largest value of the n inputs with the minimum number of inputs and the minimum number of layers. New perceptron neural networks are developed to sort n inputs. New, effective and efficient back-propagation Neural networks are designed to sort n inputs. The Sigmoid transfer function was discussed and a generalized Sigmoid function to improve Neural network performance was developed. A modified back-propagation learning algorithm was developed that builds any n input symmetric Boolean function using only int(n/2) processing elements in the second layer.
Kallin Westin, Lena
2004-01-01
Reliable results are crucial when working with medical decision support systems. A decision support system should be reliable but also be interpretable, i.e. able to show how it has inferred its conclusions. In this thesis, the preprocessing perceptron is presented as a simple but effective and efficient analysis method to consider when creating medical decision support systems. The preprocessing perceptron has the simplicity of a perceptron combined with a performance comparable to the multi...
Scientific Electronic Library Online (English)
Yuleidys, Mejías César; Ramón, Carrasco Velar; Isbel, Ochoa Izquierdo; Edel, Moreno Lemus.
2013-12-01
Full Text Available El perceptrón multicapa (PMC) figura dentro de los tipos de redes neuronales artificiales (RNA) con resultados útiles en los estudios de relación estructura-actividad. Dado que los volúmenes de datos en proyectos de Bioinformática son eventualmente grandes, se propuso evaluar algoritmos para acortar [...] el tiempo de entrenamiento de la red sin afectar su eficiencia. Se desarrolló un algoritmo para el entrenamiento local y distribuido del PMC con la posibilidad de variar las funciones de transferencias para lo cual se utilizaron el Weka y la Plataforma de Tareas Distribuidas Tarenal para distribuir el entrenamiento del perceptrón multicapa. Se demostró que en dependencia de la muestra de entrenamiento, la variación de las funciones de transferencia pueden reportar resultados mucho más eficientes que los obtenidos con la clásica función Sigmoidal, con incremento de la g-media entre el 4.5 y el 17 %. Se encontró además que en los entrenamientos distribuidos es posible alcanzar eventualmente mejores resultados que los logrados en ambiente local. Abstract in english The multilayer perceptron (PMC) ranks among the types of artificial neural networks (ANN), which has provided better results in studies of structure-activity relationship. As the data volumes in Bioinformatics' projects are eventually big, it was proposed to evaluate algorithms to shorten the traini [...] ng time of the network without affecting its efficiency. There were evaluated different tools that work with ANN and were selected Weka algorithm for extracting the network and the Platform for Distributed Task Tarenal to distribute the training of multilayer perceptron. Finally, it was developed a training algorithm for local and distributed the MLP with the possibility of varying transfer functions. It was shown that depending on the training sample, the change of transfer functions can yield results much more efficient than those obtained with the classic sigmoid function with increased g-media between 4.5 and 17 %. Moreover, it was found that with distributed training can be achieved eventually, better results than those achieved in the local environment.
Directory of Open Access Journals (Sweden)
Emin AVCI
2007-06-01
Full Text Available Especially for the last decade, the neural network models have been applied to solve financial problems like portfolio construction and stock market forecasting. Among the alternative neural network models, the multilayer perceptron models are expected to be effective and widely applied in financial forecasting. This study examines the forecasting power multilayer perceptron models for daily and sessional returns of ISE-100 index. The findings imply that the multilayer perceptron models presented promising performance in forecasting the ISE-100 index returns. However, further emphasis should be placed on different input variables and model architectures in order to improve the forecasting performances.
The Normalized Radial Basis Function Neural Network and its Relation to the Perceptron
Grabec, I.
2007-01-01
The normalized radial basis function neural network emerges in the statistical modeling of natural laws that relate components of multivariate data. The modeling is based on the kernel estimator of the joint probability density function pertaining to given data. From this function a governing law is extracted by the conditional average estimator. The corresponding nonparametric regression represents a normalized radial basis function neural network and can be related with th...
Directory of Open Access Journals (Sweden)
Schwindling Jerome
2010-04-01
Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Building a Chaotic Proved Neural Network
Bahi, Jacques M; Salomon, Michel
2011-01-01
Chaotic neural networks have received a great deal of attention these last years. In this paper we establish a precise correspondence between the so-called chaotic iterations and a particular class of artificial neural networks: global recurrent multi-layer perceptrons. We show formally that it is possible to make these iterations behave chaotically, as defined by Devaney, and thus we obtain the first neural networks proven chaotic. Several neural networks with different architectures are trained to exhibit a chaotical behavior.
Building a Chaotic Proved Neural Network
Bahi, Jacques M.; Guyeux, Christophe; Salomon, Michel
2011-01-01
Chaotic neural networks have received a great deal of attention these last years. In this paper we establish a precise correspondence between the so-called chaotic iterations and a particular class of artificial neural networks: global recurrent multi-layer perceptrons. We show formally that it is possible to make these iterations behave chaotically, as defined by Devaney, and thus we obtain the first neural networks proven chaotic. Several neural networks with different arc...
Polyhedrons and Perceptrons Are Functionally Equivalent
Crespin, Daniel
2013-01-01
Mathematical definitions of polyhedrons and perceptron networks are discussed. The formalization of polyhedrons is done in a rather traditional way. For networks, previously proposed systems are developed. Perceptron networks in disjunctive normal form (DNF) and conjunctive normal forms (CNF) are introduced. The main theme is that single output perceptron neural networks and characteristic functions of polyhedrons are one and the same class of functions. A rigorous formulati...
Phase Transitions of Neural Networks
Kinzel, Wolfgang
1997-01-01
The cooperative behaviour of interacting neurons and synapses is studied using models and methods from statistical physics. The competition between training error and entropy may lead to discontinuous properties of the neural network. This is demonstrated for a few examples: Perceptron, associative memory, learning from examples, generalization, multilayer networks, structure recognition, Bayesian estimate, on-line training, noise estimation and time series generation.
Advances in Artificial Neural Networks - Methodological Development and Application
Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other ne...
Artificial neural networks in predicting current in electric arc furnaces
Panoiu, M.; Panoiu, C.; Iordan, A.; Ghiormez, L.
2014-03-01
The paper presents a study of the possibility of using artificial neural networks for the prediction of the current and the voltage of Electric Arc Furnaces. Multi-layer perceptron and radial based functions Artificial Neural Networks implemented in Matlab were used. The study is based on measured data items from an Electric Arc Furnace in an industrial plant in Romania.
An Automated MR Image Segmentation System Using Multi-layer Perceptron Neural Network
Amiri, S; Movahedi, M M; Kazemi, K.; H. Parsaei+
2013-01-01
Background: Brain tissue segmentation for delineation of 3D anatomical structures from magnetic resonance (MR) images can be used for neuro-degenerative disorders, characterizing morphological differences between subjects based on volumetric analysis of gray matter (GM), white matter (WM) and cerebrospinal fluid (CSF), but only if the obtained segmentation results are correct. Due to image artifacts such as noise, low contrast and intensity non-uniformity, there are some classification errors...
Application of artificial neural networks (multilayer perceptron) in reactor safety research
International Nuclear Information System (INIS)
One of the key areas of reactor safety research are studies of reliable and safe heat removal from the reactor core and the containment, respectively, of light water reactors. Leakage accidents could carry insulating material into the containment or the building sump of the containment and the associated post-decay heat removal systems. This could obstruct systems functions. In the study titled ''Knowledge-based Modeling of Transport Processes in BWR Coolant Flows Carrying Particle Loads after Loss-of-Coolant Accidents,'' a tool is being created for engineering application which allows the deposition and retention of insulating material in the sump of the reactor containment to be estimated. Potential plant conditions in accidents can be assessed in this way. The study serves the purpose of modeling by means of data-based and knowledge-based methods. In this way, the results of experimental investigations (such as differential pressure tests of retention systems) can be used for modeling purposes. (orig.)
The use of artificial neural networks for residential buildings conceptual cost estimation
Juszczyk, Micha?
2013-10-01
Accurate cost estimation in the early phase of the building's design process is of key importance for a project's success. Both underestimation and overestimation may lead to projects failure in terms of costs. The paper presents synthetically some research results on the use of neural networks for conceptual cost estimation of residential buildings. In the course of the research the author focused on regression models binding together the basic information about residential buildings available in the early stage of design and construction cost. Application of different neural networks types was analysed (multilayer perceptron, multilayer perceptron with data compression based on principal component analysis and radial basis function networks). Due to the research results, multilayer perceptron networks proved to be the best neural network type for the problem solution. The research results indicate that a neural approach may be an interesting alternative for the traditional methods of conceptual cost estimation in construction projects.
A neural-network method for the analysis of multilayered shielded microwave circuits
Pascual Garci?a, Juan; Quesada Pereira, Fernando Daniel; Can?ete Rebenaque, David; Go?mez Tornero, Jose? Luis; A?lvarez Melco?n, Alejandro
2006-01-01
In this paper, a neural-network-based method for the analysis of practical multilayered shielded microwave circuits is presented. Using this idea, a radial basis function neural network (RBFNN) is trained to approximate the space-domain multilayered media boxed Green’s functions used in the integral-equation (IE) method. Once the RBFNN has been trained, the outputs of the neural network (NN) replace the exact Green’s functions, during the numerical solution of the IE....
Neural Network Control of Asymmetrical Multilevel Converters
Wira, Patrice; Meroufel, Abdelkader; Taleb, Rachid
2009-01-01
This paper proposes a neural implementation of a harmonic eliminationstrategy (HES) to control a Uniform Step Asymmetrical Multilevel Inverter(USAMI). The mapping between the modulation rate and the requiredswitching angles is learned and approximated with a Multi-Layer Perceptron(MLP) neural network. After learning, appropriate switching angles can bedetermined with the neural network leading to a low-computational-costneural controller which is well suited for real-time applications. Thiste...
Energy Technology Data Exchange (ETDEWEB)
Oku, Makito, E-mail: oku@sat.t.u-tokyo.ac.j [Department of Mathematical Informatics, Graduate School of Information Science and Technology, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 (Japan); Aihara, Kazuyuki [Institute of Industrial Science, University of Tokyo, 4-6-1 Komaba, Meguro-ku, Tokyo 153-8505 (Japan); Department of Mathematical Informatics, Graduate School of Information Science and Technology, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 (Japan)
2010-11-01
A modularly-structured neural network model is considered. Each module, which we call a 'cell', consists of two parts: a Hopfield neural network model and a multilayered perceptron. An array of such cells is used to simulate the Rule 110 cellular automaton with high accuracy even when all the units of neural networks are replaced by stochastic binary ones. We also find that noise not only degrades but also facilitates computation if the outputs of multilayered perceptrons are below the threshold required to update the states of the cells, which is a stochastic resonance in computation.
Schroeder, M.; Kinzel, W.
1997-01-01
An artificial neural network can be used to generate a series of numbers. A boolean perceptron generates bit sequences with a periodic structure. The corresponding spectrum of cycle lengths is investigated analytically and numerically; it has similarities with properties of rational numbers.
Artificial Neural Network to predict mean monthly total ozone in Arosa, Switzerland
Chattopadhyay, Surajit; Bandyopadhyay, Goutami
2006-01-01
Present study deals with the mean monthly total ozone time series over Arosa, Switzerland. The study period is 1932-1971. First of all, the total ozone time series has been identified as a complex system and then Artificial Neural Networks models in the form of Multilayer Perceptron with back propagation learning have been developed. The models are Single-hidden-layer and Two-hidden-layer Perceptrons with sigmoid activation function. After sequential learning with learning r...
Multi-modular neural networks for the classification of e+e- hadronic events
International Nuclear Information System (INIS)
Some multi-modular neural network methods of classifying e+e- hadronic events are presented. We compare the performances of the following neural networks: MLP (multilayer perceptron), MLP and LVQ (learning vector quantization) trained sequentially, and MLP and RBF (radial basis function) trained sequentially. We introduce a MLP-RBF cooperative neural network. Our last study is a multi-MLP neural network. (orig.)
Discrete Orthogonal Transforms and Neural Networks for Image Interpolation
Directory of Open Access Journals (Sweden)
J. Polec
1999-09-01
Full Text Available In this contribution we present transform and neural network approaches to the interpolation of images. From transform point of view, the principles from [1] are modified for 1st and 2nd order interpolation. We present several new interpolation discrete orthogonal transforms. From neural network point of view, we present interpolation possibilities of multilayer perceptrons. We use various configurations of neural networks for 1st and 2nd order interpolation. The results are compared by means of tables.
A neural network based seafloor classification using acoustic backscatter
Digital Repository Service at National Institute of Oceanography (India)
Chakraborty, B.
2002-01-01
This paper presents a study results of the Artificial Neural Network (ANN) architectures [Self-Organizing Map (SOM) and Multi-Layer Perceptron (MLP)] using single beam echosounding data. The single beam echosounder, operable at 12 kHz, has been used...
Artificial Neural Networks in Catalyst Development. Chapter 10.
Czech Academy of Sciences Publication Activity Database
Hole?a, Martin; Baerns, M.
New Jersey : John Wiley and Sons, 2003 - (Cawse, J.), s. 163-202 ISBN 0-471-20343-2 Source of funding: V - iné verejné zdroje Keywords : artificial neural networks * multilayer perceptrons * nonlinear dependency * approximation * network training * knowledge extraction Subject RIV: IN - Informatics, Computer Science
Directory of Open Access Journals (Sweden)
Haydeé Elena Musso
2013-01-01
Full Text Available En este trabajo se realizó un estudio estadístico de variables físico químicas asociadas al fenómeno de contaminación ambiental, en particular concentración media mensual de SO2 , medidas en la ciudad Salta Capital, Argentina, simultáneamente a concentraciones de NO2 y O3 . Las series bajo estudio presentaban comportamientos dinámicos no lineales, datos atípicos y cambios estructurales, lo que hizo imposible modelarlas con tipologías econométricas tradiciones (AR, MA, ARMA, ARIMA, entre otras. Una solución eficiente que se encontró, hace uso de la teoría de los perceptrones multicapa. Mediante el modelo estructural de series de tiempo, esta solución se presenta como un proceso matemático iterativo que permite obtener un modelado final el cual tiene una muy alta confiabilidad (95%, para realizar pronoósticos a futuro sobre el comportamiento de la variable estudiada.In this paper a statistical study of phisical-chemistry variables connected with enviroment pollution, specifically SO2 monthly average concentration, measured in Salta Capital city, Argentina, together with NO2 and O3 concentrations, was made. Time series under study shown non linear dinamic behaviour, outliers and structural changes. Due to these it was impossible to use typical econometric typologies (AR, MA, ARMA, ARIMA, among others. An effective solution which uses multistep perceptrons theory was found. By using structural time series modelling, this solution is presented by an iterative mathematical process that allows us to obtain a final model with a high confidence level (95% in order to do the forecasting step on the studied variable.
Scientific Electronic Library Online (English)
Haydeé Elena, Musso; Orlando José, Ávila Blas.
2013-01-01
Full Text Available En este trabajo se realizó un estudio estadístico de variables físico químicas asociadas al fenómeno de contaminación ambiental, en particular concentración media mensual de SO2 , medidas en la ciudad Salta Capital, Argentina, simultáneamente a concentraciones de NO2 y O3 . Las series bajo estudio p [...] resentaban comportamientos dinámicos no lineales, datos atípicos y cambios estructurales, lo que hizo imposible modelarlas con tipologías econométricas tradiciones (AR, MA, ARMA, ARIMA, entre otras). Una solución eficiente que se encontró, hace uso de la teoría de los perceptrones multicapa. Mediante el modelo estructural de series de tiempo, esta solución se presenta como un proceso matemático iterativo que permite obtener un modelado final el cual tiene una muy alta confiabilidad (95%), para realizar pronoósticos a futuro sobre el comportamiento de la variable estudiada. Abstract in english In this paper a statistical study of phisical-chemistry variables connected with enviroment pollution, specifically SO2 monthly average concentration, measured in Salta Capital city, Argentina, together with NO2 and O3 concentrations, was made. Time series under study shown non linear dinamic behavi [...] our, outliers and structural changes. Due to these it was impossible to use typical econometric typologies (AR, MA, ARMA, ARIMA, among others). An effective solution which uses multistep perceptrons theory was found. By using structural time series modelling, this solution is presented by an iterative mathematical process that allows us to obtain a final model with a high confidence level (95%) in order to do the forecasting step on the studied variable.
OMER MAHMOUD; FARHAT ANWAR; Salami, Momoh Jimoh E.
2007-01-01
One of the essential factors that affect the performance of Artificial Neural Networks is the learning algorithm. The performance of Multilayer Feed Forward Artificial Neural Network performance in image compression using different learning algorithms is examined in this paper. Based on Gradient Descent, Conjugate Gradient, Quasi-Newton techniques three different error back propagation algorithms have been developed for use in training two types of neural networks, a single hidden layer netwo...
Scientific Electronic Library Online (English)
Carlos A., de Luna-Ortega; Miguel, Mora-González; Julio C., Martínez-Romo; Francisco J., Luna-Rosas; Jesús, Muñoz-Maciel.
Full Text Available En el presente artículo se da a conocer una alternativa algorítimica a los sistemas actuales de reconocimiento automático del habla (ASR), mediante una propuesta en la forma de realizar la caracterización de las palabras basada en una aproximación que usa la extracción de coeficientes de la codifica [...] ción de predicción lineal (LPC) y la correlación cruzada. La implementación consiste en extraer las características fonéticas mediante los coeficientes LPC, después se forman vectores de patrones de la pronunciación conformados por el promedio de los coeficientes LPC de las muestras de las palabras obteniendo un vector característico de cada pronunciación mediante la autocorrelación de las secuencias de coeficientes LPC; estos vectores se utilizan para entrenar un clasificador de tipo perceptrón multicapa (MLP). Se realizaron pruebas de desempeño previo entrenamiento con los diferentes patrones de las palabras a reconocer. Se utilizó la fonética de los dígitos del cero al nueve como vocabulario objetivo, debido a su amplia aplicación, y para estimar el desempeño de este método se utilizaron dos corpus de pronunciaciones: el corpus UPA, que contempla en su base de datos la pronuncación de la región occidente de México, y el corpus Tlatoa, que hace lo propio para la región centro de México. Las señales en ambos corpus fueron adquiridas en el lenguaje español, y a una frecuencia de muestreo de 8kHz. Los porcentajes de reconocimiento obtenidos fueron del 96.7 y 93.3% para las modalidades de mono-locutor para el corpus UPA y múltiple-locutor para el corpus Tlatoa, respectivamente. Asimismo, se realizó una comparación contra dos métodos clásicos del reconocimiento de voz y del habla, Dynamic Time Warping (DTW) y Hidden Markov Models (HMM). Abstract in english It this paper we present an algorithmic alternative to the current Automatic Speech Recognition (ASR) systems by proposing a way to characterize words based on approximations that use an extracted coefficient from Linear Predictive Coding (LPC). The method consists in extracting phonetic characteris [...] tics through the use of LPC coefficients, after which pattern vectors are formed from the LPC coefficient averages taken from the word sampling, thus creating a unique vector for each pronunciation through the auto correlation of the LPC coefficient sequences. These vectors are used to train a Multilayer Perceptron (MLP) classifier. After training performance trials were executed. The sounds from the digits zero through nine where used as a target vocabulary, given its general use, and to estimate the performance of this method two corpus where used: the UPA corpus, which in its vocabulary uses a pronunciation familiar to the western part of Mexico, and the Tlatoa corpus, who's vocabulary presents a pronunciation typical of the central region of Mexico. The signals from both corpus where sampled in the Spanish language, and at a sampling frequency of 8kHz. The recognition rate for the mono-speaker from the UPA corpus and the multiple-speaker from the Tlatoa corpus were 96.7% and 93.3% respectively. Additionally, there where comparisons done against two classic methods used for speech recognition, Dynamic Time Warping (DTW) and Hidden Markov Models (HMM).
Pelossof, Raphael; Ying, Zhiliang
2010-01-01
We propose a focus of attention mechanism to speed up the Perceptron algorithm. Focus of attention speeds up the Perceptron algorithm by lowering the number of features evaluated throughout training and prediction. Whereas the traditional Perceptron evaluates all the features of each example, the Attentive Perceptron evaluates less features for easy to classify examples, thereby achieving significant speedups and small losses in prediction accuracy. Focus of attention allows...
Fuzzy neural network for invariant optical pattern recognition
Wen, Zhiqing; Yeh, Pochi; Yang, Xiangyang
1996-08-01
A novel fuzzy neural network (FNN) model for invariant pattern recognition is presented that combines fuzzy set reasoning and artificial neural network techniques. The presented FNN consists of three blocks: fuzzifier, fuzzy perceptron, and defuzzifier. It fuzzifies the input patterns and trains the interconnection weights according to membership functions instead of traditional binary values. The proposed FNN has been applied to 2D binary-image pattern recognition under shift and some other types of distortions. In comparison with the classical multilayer perceptron, the FNN possesses a higher recognition rate and is more robust to input distortions.
International Nuclear Information System (INIS)
A nonlinear multivariable empirical model is developed for a U-tube steam generator using the recurrent multilayer perceptron network as the underlying model structure. The recurrent multilayer perceptron is a dynamic neural network, very effective in the input-output modeling of complex process systems. A dynamic gradient descent learning algorithm is used to train the recurrent multilayer perceptron, resulting in an order of magnitude improvement in convergence speed over static learning algorithms. In developing the U-tube steam generator empirical model, the effects of actuator, process,and sensor noise on the training and testing sets are investigated. Learning and prediction both appear very effective, despite the presence of training and testing set noise, respectively. The recurrent multilayer perceptron appears to learn the deterministic part of a stochastic training set, and it predicts approximately a moving average response. Extensive model validation studies indicate that the empirical model can substantially generalize (extrapolate), though online learning becomes necessary for tracking transients significantly different than the ones included in the training set and slowly varying U-tube steam generator dynamics. In view of the satisfactory modeling accuracy and the associated short development time, neural networks based empirical models in some cases appear to provide a serious alternative to first principles models. Caution, however, must be exercisemodels. Caution, however, must be exercised because extensive on-line validation of these models is still warranted
A neural network approach to audio-assisted movie dialogue detection
Kotti, I.; Zafeiriou, S.; Pitas, I.
2010-01-01
A novel framework for audio-assisted dialogue detection based on indicator functions and neural networks is investigated. An indicator function defines that an actor is present at a particular time instant. The cross-correlation function of a pair of indicator functions and the magnitude of the corresponding cross-power spectral density are fed as input to neural networks for dialogue detection. Several types of artificial neural networks, including multilayer perceptrons (MLPs), voted percep...
ESTIMATION OF INPUT IMPEDANCE OF MICROSTRIP PATCH ANTENNA USING FUZZY NEURAL NETWORK
VANDANA VIKAS THAKARE; PRAMOD KUMAR SINGHAL
2010-01-01
The paper presents the use of fuzzy neural network (FNN) as a fast and better technique for the determination of input impedance of coaxial feed rectangular microstrip antenna. The fuzzy parameter ensures better performance as compared to three layer multilayered perceptron feed forward back propagation artificial neural network (MLPFFBP ANN) and radial basis function artificial neural network (RBF ANN) in the determination of input impedance of the coaxial feed microstrip antenna.
ESTIMATION OF INPUT IMPEDANCE OF MICROSTRIP PATCH ANTENNA USING FUZZY NEURAL NETWORK
Directory of Open Access Journals (Sweden)
VANDANA VIKAS THAKARE
2010-10-01
Full Text Available The paper presents the use of fuzzy neural network (FNN as a fast and better technique for the determination of input impedance of coaxial feed rectangular microstrip antenna. The fuzzy parameter ensures better performance as compared to three layer multilayered perceptron feed forward back propagation artificial neural network (MLPFFBP ANN and radial basis function artificial neural network (RBF ANN in the determination of input impedance of the coaxial feed microstrip antenna.
Pelossof, Raphael
2010-01-01
We propose a focus of attention mechanism to speed up the Perceptron algorithm. Focus of attention speeds up the Perceptron algorithm by lowering the number of features evaluated throughout training and prediction. Whereas the traditional Perceptron evaluates all the features of each example, the Attentive Perceptron evaluates less features for easy to classify examples, thereby achieving significant speedups and small losses in prediction accuracy. Focus of attention allows the Attentive Perceptron to stop the evaluation of features at any interim point and filter the example. This creates an attentive filter which concentrates computation at examples that are hard to classify, and quickly filters examples that are easy to classify.
Neural Network Revisited: Perception on Modified Poincare Map of Financial Time Series Data
Situngkir, H; Situngkir, Hokky; Surya, Yohanes
2004-01-01
Artificial Neural Network Model for prediction of time-series data is revisited on analysis of the Indonesian stock-exchange data. We introduce the use of Multi-Layer Perceptron to percept the modified Poincare-map of the given financial time-series data. The modified Poincare-map is believed to become the pattern of the data that transforms the data in time-t versus the data in time-t+1 graphically. We built the Multi-Layer Perceptron to percept and demonstrate predicting the data on specific stock-exchange in Indonesia.
Neural Network Revisited: Perception on Modified Poincare Map of Financial Time Series Data
Situngkir, Hokky; Surya, Yohanes
2004-01-01
Artificial Neural Network Model for prediction of time-series data is revisited on analysis of the Indonesian stock-exchange data. We introduce the use of Multi-Layer Perceptron to percept the modified Poincare-map of the given financial time-series data. The modified Poincare-map is believed to become the pattern of the data that transforms the data in time-t versus the data in time-t+1 graphically. We built the Multi-Layer Perceptron to percept and demonstrate predicting t...
Neural Network Based Lna Design for Mobile Satellite Receiver
Abhijeet Upadhya; Chopra, Prof P. K.
2014-01-01
Paper presents a Neural Network Modelling approach to microwave LNA design. To acknowledge the specifications of the amplifier, Mobile Satellite Systems are analyzed. Scattering parameters of the LNA in the frequency range 0.5 to 18 GHz are calculated using a Multilayer Perceptron Artificial Neural Network model and corresponding smith charts and polar charts are plotted as output to the model. From these plots, the microwave scattering parameter description of the LNA are obtained. Model is ...
A multivariate neural network approach to tourism demand forecasting
Claveria, Oscar; Monte Moreno, Enrique; Torra, Salvador
2013-01-01
This study compares the performance of different Artificial Neural Networks models for tourist demand forecasting in a multiple-output framework. We test the forecasting accuracy of three different types of architectures: a multi-layer perceptron network, a radial basis function network and an Elman neural network. We use official statistical data of inbound international tourism demand to Catalonia (Spain) from 2001 to 2012. By means of cointegration analysis we find that growth rates of tou...
Handwritten Digit Recognition with Binary Optical Perceptron
Saxena, Indu; Moerland, Perry; Fiesler, Emile; Pourzand, A. R.
1997-01-01
Binary weights are favored in electronic and optical hardware implementations of neural networks as they lead to improved system speeds. Optical neural networks based on fast ferroelectric liquid crystal binary level devices can benefit from the many orders of magnitudes improved liquid crystal response times. An optimized learning algorithm for all-positive perceptrons is simulated on a limited data set of hand-written digits and the resultant network implemented optically. First, gray-scale...
Fast cosmological parameter estimation using neural networks
Auld, T.; Bridges, M.; Hobson, M. P.; Gull, S. F.
2006-01-01
We present a method for accelerating the calculation of CMB power spectra, matter power spectra and likelihood functions for use in cosmological parameter estimation. The algorithm, called CosmoNet, is based on training a multilayer perceptron neural network and shares all the advantages of the recently released Pico algorithm of Fendt & Wandelt, but has several additional benefits in terms of simplicity, computational speed, memory requirements and ease of training. We demo...
Mohri, Mehryar; Rostamizadeh, Afshin
2013-01-01
We present a brief survey of existing mistake bounds and introduce novel bounds for the Perceptron or the kernel Perceptron algorithm. Our novel bounds generalize beyond standard margin-loss type bounds, allow for any convex and Lipschitz loss function, and admit a very simple proof.
Wave transmission prediction of multilayer floating breakwater using neural network
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Patil, S.G.; Hegde, A.V.
2009-01-01
Artificial neural network (ANN) is an information-processing paradigm that is inspired by the way of biological nervous system, such as brain process information. ANN is composed of large number of highly connected processing element (neurons) working...
Czech Academy of Sciences Publication Activity Database
Hole?a, Martin; Baerns, M.
2003-01-01
Ro?. 81, - (2003), s. 485-494. ISSN 0920-5861 Grant ostatní: BMBF(DE) FKZ 03C3013 Institutional research plan: CEZ:AV0Z1030915 Keywords : artificial neural networks * multilayer perceptron * dependency * approximation * network training * overtraining * knowledge extraction * logical rules * oxidative dehydrogenation of propane Subject RIV: BA - General Mathematics Impact factor: 2.627, year: 2003
A fast identification of insufficiency of nutrients using spectral features would be a useful instrument in farming and in other nutrient demanding agricultural systems such as those proposed for long period space missions. A Multilayer Perceptron (MLP) neural network and backpropagation algorithm w...
Generalization ability of a perceptron with non-monotonic transfer function
Inoue, Jun-ichi; Nishimori, Hidetoshi; Kabashima, Yoshiyuki
1997-01-01
We investigate the generalization ability of a perceptron with non-monotonic transfer function of a reversed-wedge type in on-line mode. This network is identical to a parity machine, a multilayer network. We consider several learning algorithms. By the perceptron algorithm the generalization error is shown to decrease by the ${\\alpha}^{-1/3}$-law similarly to the case of a simple perceptron in a restricted range of the parameter $a$ characterizing the non-monotonic transfer...
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
Kirkegaard, Poul Henning; Rytter, A.
2005-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving to be an effective tool for pattern recognition, the basic idea is to train a neural network with simulated values of modal parameters in order to recognize the behaviour of the damaged as well as the un...
Cerqueira, Eduardo O.; Andrade, Joa?o C.; Poppi, Ronei J.; Cesar Mello
2001-01-01
Neural Networks are a set of mathematical methods and computer programs designed to simulate the information process and the knowledge acquisition of the human brain. In last years its application in chemistry is increasing significantly, due the special characteristics for model complex systems. The basic principles of two types of neural networks, the multi-layer perceptrons and radial basis functions, are introduced, as well as, a pruning approach to architecture optimization. Two analytic...
Mingo López, Fernando de; Muriel Fernández, Miguel Ángel; Gómez Blas, Nuria; Triviño G., Daniel
2012-01-01
This paper presents some ideas about a new neural network architecture that can be compared to a Taylor analysis when dealing with patterns. Such architecture is based on lineal activation functions with an axo-axonic architecture. A biological axo-axonic connection between two neurons is defined as the weight in a connection in given by the output of another third neuron. This idea can be implemented in the so called Enhanced Neural Networks in which two Multilayer Perceptrons are used; the ...
Artificial Neural Network Employed To Design Annular Ring Microstrip Antenna
Directory of Open Access Journals (Sweden)
Anil Kumar
2012-04-01
Full Text Available Neural network computational modules have recently gained as an unconventional and useful tool for RF and microwave modeling and design. Neural network is trained to learn the behavior of Annular Ring Microstrip Antenna’s equivalent circuit parameters. A trained neural network is used for designing fast and less error answers to the task that has to be learned. In this paper, structure of Annular Ring Microstrip Antenna (ARMSA is studied and sets of datum are collected for the training of the Multilayer Perceptron (MLP Neural Network.
Intelligent edge enhancement using multilayer neural network based on multi-valued neurons
Aizenberg, Igor; Alexander, Shane; Jackson, Jacob; Neal, Thomas; Wilson, Jeffrey; Kendrick, Kristi
2011-03-01
In this paper, we solve the edge enhancement problem using an intelligent approach. We use a multilayer neural network based on multi-valued neurons (MLMVN) as an intelligent edge enhancer. The problem of neural edge enhancement using a classical multilayer feedforward neural network (MLF) was already considered by some authors. Since MLMVN significantly outperforms MLF in terms of learning speed, number of parameters employed, and generalization capability, it is very attractive to apply it for solving the edge enhancement problem. The main result which is presented in the paper, is the proven ability of MLMVN to enhance edges corresponding to a certain edge detection operator. Moreover, it is possible to enhance edges on noisy images ignoring a noisy texture. It is shown that to learn any edge detection operator using MLMVN, only a single image is required for learning purposes. The most important conclusion is that a neural network can learn different edge detection operators from a single example and then process those images that did not participate in the learning process detecting edges specifically corresponding to the learned operator with a high accuracy.
Directory of Open Access Journals (Sweden)
OMER MAHMOUD
2007-08-01
Full Text Available One of the essential factors that affect the performance of Artificial Neural Networks is the learning algorithm. The performance of Multilayer Feed Forward Artificial Neural Network performance in image compression using different learning algorithms is examined in this paper. Based on Gradient Descent, Conjugate Gradient, Quasi-Newton techniques three different error back propagation algorithms have been developed for use in training two types of neural networks, a single hidden layer network and three hidden layers network. The essence of this study is to investigate the most efficient and effective training methods for use in image compression and its subsequent applications. The obtained results show that the Quasi-Newton based algorithm has better performance as compared to the other two algorithms.
Modeling of an industrial drying process by artificial neural networks
Scientific Electronic Library Online (English)
E., Assidjo; B., Yao; K., Kisselmina; D., Amané.
2008-09-01
Full Text Available A suitable method is needed to solve the nonquality problem in the grated coconut industry due to the poor control of product humidity during the process. In this study the possibility of using an artificial neural network (ANN), precisely a Multilayer Perceptron, for modeling the drying step of the [...] production of grated coconut process is highlighted. Drying must confer to the product a final moisture of 3%. Unfortunately, under industrial conditions, this moisture varies from 1.9 to 4.8 %. In order to control this parameter and consequently reduce the proportion of the product that does not meet the humidity specification, a 9-4-1 neural network architecture was established using data gathered from an industrial plant. This Multilayer Perceptron can satisfactorily model the process with less bias, ranging from -0.35 to 0.34%, and can reduce the rate of rejected products from 92% to 3% during the first cycle of drying.
Neurale Netværk anvendt indenfor Proceskontrol. Neural Network for Process Control
DEFF Research Database (Denmark)
Madsen, Per Printz
1993-01-01
Dette projekt omhandler anvendelsen af neurale netværksmodeller til proceskontrol. Neurale netværksmodeller er simple modeller af de processer, der forløber i det biologiske neurale netværk. Det biologiske neurale netværk er det netværk af nerveceller, der tilsammen danner centralnervesystemet hos mennesket (hjernen). Som bekendt er vi som mennesker i stand til at løse meget krævende styrings- og reguleringsopgaver, som fx. At holde balancen og gå samtidigt, at cykle ect. Disse styrings- og reguleringsopgaver er alle karakteriseret ved, at der samtidig skal udnyttes en mængde forskellige og svært beskrivelige inputsignaler. Det biologiske neurale netværk dvs. hjernen er således gennem indlæring i stand til at læse, hvorledes der skal stryes og reguleres på baggrund af disse inputsignaler, så det ønskede resultat opnås. Det er derfor nærliggende at undersøge, hvorvidt neurale netværk er anvendelige indenfor proceskontrol i almindelighed. Med anvendelser til proceskontrol menes der her anvendeler til prediction, simulering og regulering af dynamiske systemer. For at teste, hvorvidt neurale netværk er anvendelig til prediction og simulering, er der anvendt en tre-trinsoverheder simulator til at generere indlærings- og testdata. Af de tre valgte netværkstyper er der kun Multi-Layer Perceptron nette, der e ranvendeligt til prediction og simulering af dynamiske systemer ud fra de opstillede koncepter og metoder. I sidste kapitel, omhandlende regulering, er der således også anvendt Multi-Layer Perceptron net. Der er opstillet koncepter/metoder til såvel feedforward regulering som feedback regulering. Multi-Layer Perceptronen er i stand til at regulere et ulineært, multivariabelt og dynamisk system, således at der opnås følgende: 1. Systemet lineariseres således, at der opnås ensartet steprespons i hele arbejdsområdet. 2. Systemet afkobles således, at det er muligt at styre hvert enkelt output uafhængigt af hinanden. 3. Alle målelige forstyrrelser udkompenseres. 4. Det er muligt, at kombinere den neurale regulator med eteksisterende feedback reguleringssystem.
A Comparative Study of RBF and MLP Neural Model for Seven Element Dynamic Phased Array Smart Antenna
Directory of Open Access Journals (Sweden)
Rahul Shrivastava
2013-05-01
Full Text Available In this paper we present the neural Modelling techniques for dynamic phased array smart antenna. Neural networks are mathematical and computation models that are used to optimize the smart antenna system, which are very much suitable for real time applications. Here we are optimizing the seven element dynamic phased array smart antenna using Radial basis function neural network (RBFNN and Multilayer Perceptron neural network (MLPNN. The beam ship prediction of seven element DPA is done up to 60 deg scan angle and results of RBF and MLP are compared to find out the better neural network approach for smart antenna optimization.
AN EFFICIENT NEURAL NETWORK FOR RECOGNIZING GESTURAL HINDI DIGITS
Nidal Fawzi Shilbayeh; Mohammad Mahmmoud Alwakeel; Maisa Mohy Naser
2013-01-01
Handwritten Hindi digit recognition plays an important role in eastern Arab countries especially in the courtesy amounts of Arab bank checks, recognizing numbers in car plates, or in postal code for mail sorting. In our study, we proposed an efficient Hindi Digit Recognition System drawn by the mouse and developed using Multilayer Perceptron Neural Network (MLP) with backpropagation. The system has been designed, implemented and tested successfully. Analysis has been carried out to determine ...
Simulating a perceptron on a quantum computer
Schuld, Maria; Sinayskiy, Ilya; Petruccione, Francesco
2014-01-01
Perceptrons are the basic computational unit of artificial neural networks, as they model the activation mechanism of an output neuron due to incoming signals from its neighbours. As linear classifiers, they play an important role in the foundations of machine learning. In the context of the emerging field of quantum machine learning, several attempts have been made to develop a corresponding unit using quantum information theory. Based on the quantum phase estimation algori...
Storage capacity of a Potts-perceptron
Nadal, Jean-pierre; Rau, Albrecht
1991-01-01
We consider the properties of “Potts” neural networks where each neuron can be in Q different states. For a “Potts-perceptron” with N Q-states input neurons and one Q' states output neutron, we compute the maximal storage capacity for unbiased patterns. In the large N limit the maximal number of patterns that can be stored is found to be proportional to N(Q-1)f(Q'), where f(Q') is of order 1.
Artificial Neural Network to predict mean monthly total ozone in Arosa, Switzerland
Chattopadhyay, S; Chattopadhyay, Surajit; Bandyopadhyay, Goutami
2006-01-01
Present study deals with the mean monthly total ozone time series over Arosa, Switzerland. The study period is 1932-1971. First of all, the total ozone time series has been identified as a complex system and then Artificial Neural Networks models in the form of Multilayer Perceptron with back propagation learning have been developed. The models are Single-hidden-layer and Two-hidden-layer Perceptrons with sigmoid activation function. After sequential learning with learning rate 0.9 the peak total ozone period (February-May) concentrations of mean monthly total ozone have been predicted by the two neural net models. After training and validation, both of the models are found skillful. But, Two-hidden-layer Perceptron is found to be more adroit in predicting the mean monthly total ozone concentrations over the aforesaid period.
Mónica Bocco; Enrique Willington; Mónica Arias
2010-01-01
The incident solar radiation on soil is an important variable used in agricultural applications; it is also relevant in hydrology, meteorology and soil physics, among others. To estimate this variable, empirical models have been developed using several parameters and, recently, prognostic and prediction models based on artificial intelligence techniques such as neural networks. The aim of this work was to develop linear models and neural networks, multilayer perceptron, to estimate daily glob...
Scientific Electronic Library Online (English)
Alejandro J., Orozco-Naranjo; Pablo A., Muñoz-Gutiérrez.
2013-12-30
Full Text Available Este artículo presenta los resultados obtenidos al desarrollar una metodología para la detección de 5 tipos de latidos cardiacos (Normal (N), Bloqueo de Rama Derecha (RBBB), Bloqueo de Rama Izquierda (LBBB), Contracción Auricular Prematura (APC) y Contracción Ventricular Prematura (PVC)) utilizando [...] la transformada por paquetes Wavelet de manera no adaptativa en la extracción de características de las señales cardiacas, empleando la función Shanon para cálculo de la entropía y adicionando una fase de identificación de nodos por cada tipo de señal cardiaca en el árbol Wavelet. La utilización de la transformada por paquetes Wavelet permite acceder a información obtenida de la descomposición tanto de baja como de alta frecuencia proporcionando un análisis más integral que el logrado con la transformada Wavelet discreta. Se evaluaron Wavelets madre de las familias Daubechies, Symlet 5 y Biortogonal inversa; que fueron resultado de una investigación previa en que se identificaron las Wavelet madre que mayor entropía presentaban con las señales cardiacas. Con la modalidad no adaptativa se reduce el costo computacional al utilizar los paquetes Wavelet, coste que representa la mayor desventaja de esta transformada, dando validez a la investigación realizada. Para la clasificación de los patrones cardiacos se emplearon las máquinas de soporte vectorial y el perceptrón multicapa. Con las máquinas de soporte vectorial empleando kernel de función de base radial, se logró un error de clasificación del 2,57 %. Abstract in english This paper presents the results obtained by developing a methodology to detect 5 types of heartbeats (Normal (N), Right bundle branch block (RBBB), Left bundle branch block (LBBB), Premature atrial contraction (APC) and Premature ventricular contraction (PVC)), using Wavelet transform packets with n [...] on-adaptative mode applied on features extraction from heartbeats. It was used the Shannon function to calculate the entropy and It was added an identification nodes stage per every type of cardiac signal in the Wavelet tree. The using of Wavelet packets transform allows the access to information which results of decomposition of low and high frecuency, giving providing a more integral analysis than achieved by the discrete Wavelet transform. Three families of mother Wavelet were evaluated on transformation: Daubechies, Symlet and Reverse Biorthogonal, which were results from a previous research in that were identified the mother Wavelet that had higher entropy with the cardiac signals. With non-adaptive mode, the computational cost is reduced when Wavelet packets are used; this cost represents the most marked disadvantage from the transform. To classify the heartbeats were used Support Vector Machines and Multilayer Perceptron. The best classification error was achieved employing Support Vector Machine and a radial basis function; it was 2.57 %.
Directory of Open Access Journals (Sweden)
Eduardo O. de Cerqueira
2001-12-01
Full Text Available Neural Networks are a set of mathematical methods and computer programs designed to simulate the information process and the knowledge acquisition of the human brain. In last years its application in chemistry is increasing significantly, due the special characteristics for model complex systems. The basic principles of two types of neural networks, the multi-layer perceptrons and radial basis functions, are introduced, as well as, a pruning approach to architecture optimization. Two analytical applications based on near infrared spectroscopy are presented, the first one for determination of nitrogen content in wheat leaves using multi-layer perceptrons networks and second one for determination of BRIX in sugar cane juices using radial basis functions networks.
Scientific Electronic Library Online (English)
Eduardo O. de, Cerqueira; João C. de, Andrade; Ronei J., Poppi; Cesar, Mello.
2001-12-01
Full Text Available [...] Abstract in english Neural Networks are a set of mathematical methods and computer programs designed to simulate the information process and the knowledge acquisition of the human brain. In last years its application in chemistry is increasing significantly, due the special characteristics for model complex systems. Th [...] e basic principles of two types of neural networks, the multi-layer perceptrons and radial basis functions, are introduced, as well as, a pruning approach to architecture optimization. Two analytical applications based on near infrared spectroscopy are presented, the first one for determination of nitrogen content in wheat leaves using multi-layer perceptrons networks and second one for determination of BRIX in sugar cane juices using radial basis functions networks.
Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI
International Nuclear Information System (INIS)
In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.
International Nuclear Information System (INIS)
In this paper, an automatic system is presented for word recognition using real Turkish word signals. This paper especially deals with combination of the feature extraction and classification from real Turkish word signals. A Discrete Wavelet Neural Network (DWNN) model is used, which consists of two layers: discrete wavelet layer and multi-layer perceptron. The discrete wavelet layer is used for adaptive feature extraction in the time-frequency domain and is composed of Discrete Wavelet Transform (DWT) and wavelet entropy. The multi-layer perceptron used for classification is a feed-forward neural network. The performance of the used system is evaluated by using noisy Turkish word signals. Test results showing the effectiveness of the proposed automatic system are presented in this paper. The rate of correct recognition is about 92.5% for the sample speech signals. (author)
Viscosity Calculation at Moderate Pressure for Nonpolar Gases via Neural Network
Bouzidi, A.; Hanini, S.; Souahi, F.; Mohammedi, B.; Touiza, M.
2007-01-01
A new method, based on Artificial Neural Networks (ANN) of Multi-Layer Perceptron (MLP) type, has been developed to estimate the viscosity at moderate pressure for pure nonpolar gases over a wide range of temperatures. An ANN was trained, using four physicochemical properties: Molecular weight (M), boiling point (Tb), critical Temperature (Tc) and critical Pressure (Pc) combined with absolute Temperature (T) as its inputs, to correlate and predict viscosity. A group of 52 nonpolar gases were ...
A Hybrid Model based on Neural Network and Hybrid Genetic Algorithm for Automotive Price Forecasting
Reza Peyghami, M.; Khanduzi, R.
2011-01-01
In this paper, we introduce a new intelligent combination method based on Multilayer Perceptron Neural Network (MLP?NN) and Hybrid Genetic Algorithm (HGA) for automotive price forecasting. The combination of MLPNN and HGA lead us to accelerate convergence to the optimal weights and improve the forecasting performance. In this structure, the Levenberg? Marquardt (LM) algorithm is employed for training of the network, and the hybridization of Genetic Algorithm (GA) with some local search op...
{\\sc CosmoNet}: fast cosmological parameter estimation in non-flat models using neural networks
Auld, T.; Bridges, M.; Hobson, M. P.
2007-01-01
We present a further development of a method for accelerating the calculation of CMB power spectra, matter power spectra and likelihood functions for use in cosmological Bayesian inference. The algorithm, called {\\sc CosmoNet}, is based on training a multilayer perceptron neural network. We compute CMB power spectra (up to $\\ell=2000$) and matter transfer functions over a hypercube in parameter space encompassing the $4\\sigma$ confidence region of a selection of CMB (WMAP + ...
Video Traffic Prediction Using Neural Networks
Directory of Open Access Journals (Sweden)
Miloš Oravec
2008-10-01
Full Text Available In this paper, we consider video stream prediction for application in services likevideo-on-demand, videoconferencing, video broadcasting, etc. The aim is to predict thevideo stream for an efficient bandwidth allocation of the video signal. Efficient predictionof traffic generated by multimedia sources is an important part of traffic and congestioncontrol procedures at the network edges. As a tool for the prediction, we use neuralnetworks – multilayer perceptron (MLP, radial basis function networks (RBF networksand backpropagation through time (BPTT neural networks. At first, we briefly introducetheoretical background of neural networks, the prediction methods and the differencebetween them. We propose also video time-series processing using moving averages.Simulation results for each type of neural network together with final comparisons arepresented. For comparison purposes, also conventional (non-neural prediction isincluded. The purpose of our work is to construct suitable neural networks for variable bitrate video prediction and evaluate them. We use video traces from [1].
The Perceptron with Dynamic Margin
Panagiotakopoulos, Constantinos; Tsampouka, Petroula
2011-01-01
The classical perceptron rule provides a varying upper bound on the maximum margin, namely the length of the current weight vector divided by the total number of updates up to that time. Requiring that the perceptron updates its internal state whenever the normalized margin of a pattern is found not to exceed a certain fraction of this dynamic upper bound we construct a new approximate maximum margin classifier called the perceptron with dynamic margin (PDM). We demonstrate ...
Intelligent detection of impulse noise using multilayer neural network with multi-valued neurons
Aizenberg, Igor; Wallace, Glen
2012-03-01
In this paper, we solve the impulse noise detection problem using an intelligent approach. We use a multilayer neural network based on multi-valued neurons (MLMVN) as an intelligent impulse noise detector. MLMVN was already used for point spread function identification and intelligent edge enhancement. So it is very attractive to apply it for solving another image processing problem. The main result, which is presented in the paper, is the proven ability of MLMVN to detect impulse noise on different images after a learning session with the data taken just from a single noisy image. Hence MLMVN can be used as a robust impulse detector. It is especially efficient for salt and pepper noise detection and outperforms all competitive techniques. It also shows comparable results in detection of random impulse noise. Moreover, for random impulse noise detection, MLMVN with the output neuron with a periodic activation function is used for the first time.
Dong, Zhekang; Duan, Shukai; Hu, Xiaofang; Wang, Lidan; Li, Hai
2014-01-01
In this paper, we present an implementation scheme of memristor-based multilayer feedforward small-world neural network (MFSNN) inspirited by the lack of the hardware realization of the MFSNN on account of the need of a large number of electronic neurons and synapses. More specially, a mathematical closed-form charge-governed memristor model is presented with derivation procedures and the corresponding Simulink model is presented, which is an essential block for realizing the memristive synapse and the activation function in electronic neurons. Furthermore, we investigate a more intelligent memristive PID controller by incorporating the proposed MFSNN into intelligent PID control based on the advantages of the memristive MFSNN on computation speed and accuracy. Finally, numerical simulations have demonstrated the effectiveness of the proposed scheme. PMID:25202723
Scientific Electronic Library Online (English)
F., Dall Cortivo; E. S., Chalhoub; H. F., Campos Velho.
2012-12-01
Full Text Available Estimativa do perfil de concentração de clorofila, em águas naturais, a partir da radiação emergente na superfície de um corpo d'agua, com o uso de rede neural artificial do tipo Perceptron de Múltiplas Camadas. A concentração de clorofila está relacionada com os coeficientes de absorção e espalhame [...] nto via modelos bio-ópticos. O treinamento da rede é formulado como um problema de otimização, no qual a atualização das variáveis livres da rede (pesos, viés e parâmetros de cada função de ativação) é feita através do método quasi-Newton. Abstract in english In this work the average profile of chlorophyll concentration is estimated from the emitted radiation at the surface of natural waters. This is performed through the use an Artificial Neural Network of Multilayer Perceptron type to act as the inverse operator. Bio-optical models are used to correlat [...] e the chlorophyll concentration with the absorption and scattering coefficients. The network training is formulated as an optimization problem, in which the update of the free variables of network (weights, viéses and each slope of the activation functions) is performed through the quasi-Newton method.
Liew, C. K.; Veidt, M.
2007-03-01
Neural network pattern recognition is an advanced regression technique that can be applied to identify guided wave response signals for quantifying damages in structures. This paper describes a procedure to optimize the design of a multi-layer perceptron backpropagation neural network with signals preprocessed by the wavelet transform. The performance can be further improved using a weight-range selection technique in a series network since there is increased sensitivity of the neural network to experimental damage patterns if the training range is reduced. Damage identification in beams with longitudinal guided waves is used in this study.
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1994-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving to be an effective tool for pattern recognition, the basic idea is to train a neural network with simulated values of modal parameters in order to recognize the behaviour of the damaged as well as the undamaged structure. Subjecting this trained neural network to measured modal parameters should imply information about damage states and locations.
Fault characterization of a multilayered perceptron network
Tan, Chang H.; Iyer, Ravishankar K.
1990-01-01
The results of a set of simulation experiments conducted to quantify the effects of faults in a classification network implemented as a three-layered perception model are reported. The percentage of vectors misclassified by the classification network, the time taken for the network to stabilize, and the output values are measured. The results show that both transient and permanent faults have a significant impact on the performance of the network. Transient faults are also found to cause the network to be increasingly unstable as the duration of a transient is increased. The average percentage of the vectors misclassified is about 25 percent; after relearning, this is reduced to 10 percent. The impact of link faults is relatively insignificant in comparison with node faults (1 percent versus 19 percent misclassified after relearning). A study of the impact of hardware redundancy shows a linear increase in misclassifications with increasing hardware size.
Neural network tomography: network replication from output surface geometry.
Minnett, Rupert C J; Smith, Andrew T; Lennon, William C; Hecht-Nielsen, Robert
2011-06-01
Multilayer perceptron networks whose outputs consist of affine combinations of hidden units using the tanh activation function are universal function approximators and are used for regression, typically by reducing the MSE with backpropagation. We present a neural network weight learning algorithm that directly positions the hidden units within input space by numerically analyzing the curvature of the output surface. Our results show that under some sampling requirements, this method can reliably recover the parameters of a neural network used to generate a data set. PMID:21377326
Boulbaba Ben Ammar
2013-01-01
This paper gives the definition of Transparent Neural Network “TNN” for the simulation of the global-local vision and its application to the segmentation of administrative document image. We have developed and have adapted a recognition method which models the contextual effects reported from studies in experimental psychology. Then, we evaluated and tested the TNN and the multi-layer perceptron “MLP”,which showed its effectiveness in the field of the recognition, in order to show tha...
Ammar, Boulbaba Ben
2013-01-01
This paper gives the definition of Transparent Neural Network "TNN" for the simulation of the globallocal vision and its application to the segmentation of administrative document image. We have developed and have adapted a recognition method which models the contextual effects reported from studies in experimental psychology. Then, we evaluated and tested the TNN and the multi-layer perceptron "MLP", which showed its effectiveness in the field of the recognition, in order t...
Tierra, Alfonso; Romero, Ricardo
2014-12-01
Prior any satellite technology developments, the geodetic networks of a country were realized from a topocentric datum, and hence the respective cartography was performed. With availability of Global Navigation Satellite Systems-GNSS, cartography needs to be updated and referenced to a geocentric datum to be compatible with this technology. Cartography in Ecuador has been performed using the PSAD56 (Provisional South American Datum 1956) systems, nevertheless it's necessary to have inside the system SIRGAS (SIstema de Referencia Geocéntrico para las AmericaS). This transformation between PSAD56 to SIRGAS use seven transformation parameters calculated with the method Helmert. These parameters, in case of Ecuador are compatible for scales of 1:25 000 or less, that does not satisfy the requirements on applications for major scales. In this study, the technique of neural networks is demonstrated as an alternative for improving the processing of UTM planes coordinates E, N (East, North) from PSAD56 to SIRGAS. Therefore, from the coordinates E, N, of the two systems, four transformation parameters were calculated (two of translation, one of rotation, and one scale difference) using the technique bidimensional transformation. Additionally, the same coordinates were used to training Multilayer Artificial Neural Network -MANN, in which the inputs are the coordinates E, N in PSAD56 and output are the coordinates E, N in SIRGAS. Both the two-dimensional transformation and ANN were used as control points to determine the differences between the mentioned methods. The results imply that, the coordinates transformation obtained with the artificial neural network multilayer trained have been improving the results that the bidimensional transformation, and compatible to scales 1:5000. Dost?p do nowoczesnych technologii, w tym GNSS umo?liwi?y dok?adniejsze zdefi niowanie systemów odniesie? przestrzennych wykorzystywanych m.in. w defi niowaniu krajowych uk?adów odniesie? i uk?adów wspó?rz?dnych. W Ekwadorze wykorzystywany jest system PSAD56 (Provisional South American Datum 1956), ale w ostatnim czasie zasz?a konieczno?? zdefi niowania wewn?trznego(krajowego) systemu SIRGAS (SIstema de Referencia Geocéntrico para las AmericaS). Do transformacji pomi?dzy oboma systemami powszechnie wykorzystuje si? metod? Helmerta, stosuj?c uk?ad siedmioparametrowy. Transformacja taka pozwala na zachowanie dok?adno?ci wystarczaj?cej do opracowania map topografi cznych w skalach 1:25 000 lub mniejszych. W artykule do transformacji zastosowano sieci neuronowe, co umo?liwi?o podniesienie dok?adno?ci do skali 1:5 000
Neural networks and statistical learning
Du, Ke-Lin
2014-01-01
Providing a broad but in-depth introduction to neural network and machine learning in a statistical framework, this book provides a single, comprehensive resource for study and further research. All the major popular neural network models and statistical learning approaches are covered with examples and exercises in every chapter to develop a practical working understanding of the content. Each of the twenty-five chapters includes state-of-the-art descriptions and important research results on the respective topics. The broad coverage includes the multilayer perceptron, the Hopfield network, associative memory models, clustering models and algorithms, the radial basis function network, recurrent neural networks, principal component analysis, nonnegative matrix factorization, independent component analysis, discriminant analysis, support vector machines, kernel methods, reinforcement learning, probabilistic and Bayesian networks, data fusion and ensemble learning, fuzzy sets and logic, neurofuzzy models, hardw...
A design philosophy for multi-layer neural networks with applications to robot control
Vadiee, Nader; Jamshidi, MO
1989-01-01
A system is proposed which receives input information from many sensors that may have diverse scaling, dimension, and data representations. The proposed system tolerates sensory information with faults. The proposed self-adaptive processing technique has great promise in integrating the techniques of artificial intelligence and neural networks in an attempt to build a more intelligent computing environment. The proposed architecture can provide a detailed decision tree based on the input information, information stored in a long-term memory, and the adapted rule-based knowledge. A mathematical model for analysis will be obtained to validate the cited hypotheses. An extensive software program will be developed to simulate a typical example of pattern recognition problem. It is shown that the proposed model displays attention, expectation, spatio-temporal, and predictory behavior which are specific to the human brain. The anticipated results of this research project are: (1) creation of a new dynamic neural network structure, and (2) applications to and comparison with conventional multi-layer neural network structures. The anticipated benefits from this research are vast. The model can be used in a neuro-computer architecture as a building block which can perform complicated, nonlinear, time-varying mapping from a multitude of input excitory classes to an output or decision environment. It can be used for coordinating different sensory inputs and past experience of a dynamic system and actuating signals. The commercial applications of this project can be the creation of a special-purpose neuro-computer hardware which can be used in spatio-temporal pattern recognitions in such areas as air defense systems, e.g., target tracking, and recognition. Potential robotics-related applications are trajectory planning, inverse dynamics computations, hierarchical control, task-oriented control, and collision avoidance.
Design and FPGA-implementation of multilayer neural networks with on-chip learning
International Nuclear Information System (INIS)
Artificial Neural Networks (ANN) is used in many applications in the industry because of their parallel structure, high speed, and their ability to give easy solution to complicated problems. For example identifying the orange and apple in the sorting machine with neural network is easier than using image processing techniques to do the same thing. There are different software for designing, training, and testing the ANN, but in order to use the ANN in the industry, it should be implemented on hardware outside the computer. Neural networks are artificial systems inspired on the brain's cognitive behavior, which can learn tasks with some degree of complexity, such as signal processing, diagnosis, robotics, image processing, and pattern recognition. Many applications demand a high computing power and the traditional software implementation are not sufficient.This thesis presents design and FPGA implementation of Multilayer Neural Networks with On-chip learning in re-configurable hardware. Hardware implementation of neural network algorithm is very interesting due their high performance and they can easily be made parallel. The architecture proposed herein takes advantage of distinct data paths for the forward and backward propagation stages and a pipelined adaptation of the on- line backpropagation algorithm to significantly improve the performance of the learning phase. The architecture is easily scalable and able to cope with arbitrary network sizes with the same hardarbitrary network sizes with the same hardware. The implementation is targeted diagnosis of the Research Reactor accidents to avoid the risk of occurrence of a nuclear accident. The proposed designed circuits are implemented using Xilinx FPGA Chip XC40150xv and occupied 73% of Chip CLBs. It achieved 10.8 ?s to take decision in the forward propagation compared with current software implemented of RPS which take 24 ms. The results show that the proposed architecture leads to significant speed up comparing to high end software solutions. On-chip learning allows on line reconstruction of ANN. Re-configure ability and parallel structure of FPGA makes it possible to accomplish this task.
Structured neural networks for pattern recognition.
Murino, V
1998-01-01
This paper proposes a novel approach for the design of structures of neural networks for pattern recognition. The basic idea lies in subdividing the whole classification problem in smaller and simpler problems at different levels, each managed by appropriate components of a complex neural architecture. Three neural structures are presented and applied in a surveillance system aimed at monitoring a railway waiting room classifying potential dangerous situations. Each architecture is composed by nodes, which are actual multilayer perceptrons trained to discriminate between subsets of classes until a complete separation among the classes is achieved. This approach showed better performances with respect to a classical statistical classification procedures and to a single neural network. PMID:18255974
Comparative study of different wavelet based neural network models for rainfall-runoff modeling
Shoaib, Muhammad; Shamseldin, Asaad Y.; Melville, Bruce W.
2014-07-01
The use of wavelet transformation in rainfall-runoff modeling has become popular because of its ability to simultaneously deal with both the spectral and the temporal information contained within time series data. The selection of an appropriate wavelet function plays a crucial role for successful implementation of the wavelet based rainfall-runoff artificial neural network models as it can lead to further enhancement in the model performance. The present study is therefore conducted to evaluate the effects of 23 mother wavelet functions on the performance of the hybrid wavelet based artificial neural network rainfall-runoff models. The hybrid Multilayer Perceptron Neural Network (MLPNN) and the Radial Basis Function Neural Network (RBFNN) models are developed in this study using both the continuous wavelet and the discrete wavelet transformation types. The performances of the 92 developed wavelet based neural network models with all the 23 mother wavelet functions are compared with the neural network models developed without wavelet transformations. It is found that among all the models tested, the discrete wavelet transform multilayer perceptron neural network (DWTMLPNN) and the discrete wavelet transform radial basis function (DWTRBFNN) models at decomposition level nine with the db8 wavelet function has the best performance. The result also shows that the pre-processing of input rainfall data by the wavelet transformation can significantly increases performance of the MLPNN and the RBFNN rainfall-runoff models.
A Novel Technique to Image Annotation using Neural Network
Directory of Open Access Journals (Sweden)
Pankaj Savita
2013-03-01
Full Text Available : Automatic annotation of digital pictures is a key technology for managing and retrieving images from large image collection. Traditional image semantics extraction and representation schemes were commonly divided into two categories, namely visual features and text annotations. However, visual feature scheme are difficult to extract and are often semantically inconsistent. On the other hand, the image semantics can be well represented by text annotations. It is also easier to retrieve images according to their annotations. Traditional image annotation techniques are time-consuming and requiring lots of human effort. In this paper we propose Neural Network based a novel approach to the problem of image annotation. These approaches are applied to the Image data set. Our main work is focused on the image annotation by using multilayer perceptron, which exhibits a clear-cut idea on application of multilayer perceptron with special features. MLP Algorithm helps us to discover the concealed relations between image data and annotation data, and annotate image according to such relations. By using this algorithm we can save more memory space, and in case of web applications, transferring of images and download should be fast. This paper reviews 50 image annotation systems using supervised machine learning Techniques to annotate images for image retrieval. Results obtained show that the multi layer perceptron Neural Network classifier outperforms conventional DST Technique.
Tomas Ayala-Silva; Caula A. Beyl; Heath, Robert R.
2006-01-01
A fast identification of insufficiency of nutrients using spectral features would be a useful instrument in farming and in other nutrient demanding agricultural systems such as those proposed for long period space missions. A Multilayer Perceptron (MLP) neural network and backpropagation algorithm was used to differentiate between normal leaves of wheat (Triticum aestivum L.) and those deficient in nitrogen, phosphorus, (K) and (Ca) using hyperspectral data. The network consisted of three lay...
Tsai, Chia-cheng; Lu, Mi-cheng; Wei, Chih-chiang
2012-01-01
To solve the complicated problem of water-stage predictions under the interaction of upstream flows and tidal effects during typhoon attacks, this article presents a novel approach to river-stage predictions. The proposed CART-ANN model combines both the decision trees (classification and regression trees [CART]) and the artificial neural network (ANN) techniques, which comprise the multilayer perceptron (MLP) and radial basis function (RBFNN). The combined CART-ANN model involves a two-step ...
Directory of Open Access Journals (Sweden)
Manjula Devi Ramasamy
2014-01-01
Full Text Available Multilayer Feed Forward Neural Network (MFNN has been successfully administered architectures for solving a wide range of supervised pattern recognition tasks. The most problematic task of MFNN is training phase which consumes very long training time on very huge training datasets. An enhanced linear adaptive skipping training algorithm for MFNN called Half of Threshold (HOT is proposed in this research paper. The core idea of this study is to reduce the training time through random presentation of training input samples without affecting the network’s accuracy. The random presentation is done by partitioning the training dataset into two distinct classes, classified and misclassified class, based on the comparison result of the calculated error measure with half of threshold value. Only the input samples in the misclassified class are presented to the next epoch for training, whereas the correctly classified class is skipped linearly which dynamically reducing the number of input samples exhibited at every single epoch without affecting the network’s accuracy. Thus decreasing the size of the training dataset linearly can reduce the total training time, thereby speeding up the training process. This HOT algorithm can be implemented with any training algorithm used for supervised pattern classification and its implementation is very simple and easy. Simulation study results proved that HOT training algorithm achieves faster training than the other standard training algorithm.
Nishimura, Masatoshi; Van der Spiegel, Jan
1995-03-01
A method for optical pattern recognition which is based on the human visual system and is suitable for hardware implementation is presented. The system is composed of two stages. The first stage detects local features such as line orientation, linestops, corners, and intersections to create a feature map, which represents the number of these features and hence is invariant to position, size, and slight deformation of an input pattern. The next stage is a multilayered neural network that classifies an input pattern to one of predefined categories using the feature map. We have found a method of detecting these features in analog hardware which would considerably speed up the process of pattern recognition. The decomposition of an input pattern into lines with different orientations is done by an array of two-dimensional orientation sensors. We have built an orientation sensor which is invariant to the position, size, and contrast of an input pattern. The generation of the feature map is currently being done in software which receives its inputs from the line orientation sensor. Linestops, corners and intersections are detected after a series of convolution and thresholding operations for each orientation. The convolution operation can be mapped into hardware using a resistive grid technique. The simulation with an example of character recognition showed that the proper selection of convolution kernels and thresholds can detect local features described above and demonstrated the feasibility of a full hardware implementation of a feature detector.
The Perceptron with Dynamic Margin
Panagiotakopoulos, Constantinos
2011-01-01
The classical perceptron rule provides a varying upper bound on the maximum margin, namely the length of the current weight vector divided by the total number of updates up to that time. Requiring that the perceptron updates its internal state whenever the normalized margin of a pattern is found not to exceed a certain fraction of this dynamic upper bound we construct a new approximate maximum margin classifier called the perceptron with dynamic margin (PDM). We demonstrate that PDM converges in a finite number of steps and derive an upper bound on them. We also compare experimentally PDM with other perceptron-like algorithms and support vector machines on hard margin tasks involving linear kernels which are equivalent to 2-norm soft margin.
Finite Size Scaling of Perceptron
Korutcheva, Elka; Tonchev, N.
2000-01-01
We study the first-order transition in the model of a simple perceptron with continuous weights and large, bit finite value of the inputs. Making the analogy with the usual finite-size physical systems, we calculate the shift and the rounding exponents near the transition point. In the case of a general perceptron with larger variety of inputs, the analysis only gives bounds for the exponents.
Thomas, Philippe; Thomas, Andre?
2008-01-01
Simulation is often used to evaluate the relevance of a Directing Program of Production (PDP) or to evaluate its impact on detailed sc\\'enarii of scheduling. Within this framework, we propose to reduce the complexity of a model of simulation by exploiting a multilayer perceptron. A main phase of the modeling of one system using a multilayer perceptron remains the determination of the structure of the network. We propose to compare and use various pruning algorithms in order ...
A Novel Single Neuron Perceptron with Universal Approximation and XOR Computation Properties
Ehsan Lotfi; -r Akbarzadeh-t, M.
2014-01-01
We propose a biologically motivated brain-inspired single neuron perceptron (SNP) with universal approximation and XOR computation properties. This computational model extends the input pattern and is based on the excitatory and inhibitory learning rules inspired from neural connections in the human brain's nervous system. The resulting architecture of SNP can be trained by supervised excitatory and inhibitory online learning rules. The main features of proposed single layer perceptron are un...
Extraction of Logical Rules from Data by Means of Piecewise-Linear Neural Networks.
Czech Academy of Sciences Publication Activity Database
Hole?a, Martin
Berlin : Springer, 2002 - (Lange, S.; Satoh, K.; Smith, C.), s. 193-205 ISBN 3-540-00188-3. ISSN 0302-9743. - (Lecture Notes in Computer Science.. 2534). [International Conference on Algorithmic Learning Theory /13./, International Conference on Discovery Science /5./. Lübeck (DE), 24.11.2002-26.11.2002] R&D Projects: GA ?R GA201/00/1489; GA AV ?R IAB2030007 Institutional research plan: AV0Z1030915 Keywords : data mining * knowledge discovery * artificial neural networks * multilayer perceptrons * rule extraction * piecewise-linear neural networks Subject RIV: BA - General Mathematics
Perceptron-like computation based on biologically-inspired neurons with heterosynaptic mechanisms
Kaluza, Pablo; Urdapilleta, Eugenio
2014-10-01
Perceptrons are one of the fundamental paradigms in artificial neural networks and a key processing scheme in supervised classification tasks. However, the algorithm they provide is given in terms of unrealistically simple processing units and connections and therefore, its implementation in real neural networks is hard to be fulfilled. In this work, we present a neural circuit able to perform perceptron's computation based on realistic models of neurons and synapses. The model uses Wang-Buzsáki neurons with coupling provided by axodendritic and axoaxonic synapses (heterosynapsis). The main characteristics of the feedforward perceptron operation are conserved, which allows to combine both approaches: whereas the classical artificial system can be used to learn a particular problem, its solution can be directly implemented in this neural circuit. As a result, we propose a biologically-inspired system able to work appropriately in a wide range of frequencies and system parameters, while keeping robust to noise and error.
Using neural networks for prediction of nuclear parameters
Energy Technology Data Exchange (ETDEWEB)
Pereira Filho, Leonidas; Souto, Kelling Cabral, E-mail: leonidasmilenium@hotmail.com, E-mail: kcsouto@bol.com.br [Instituto Federal de Educacao, Ciencia e Tecnologia do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ (Brazil); Machado, Marcelo Dornellas, E-mail: dornemd@eletronuclear.gov.br [Eletrobras Termonuclear S.A. (GCN.T/ELETRONUCLEAR), Rio de Janeiro, RJ (Brazil). Gerencia de Combustivel Nuclear
2013-07-01
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Using neural networks for prediction of nuclear parameters
International Nuclear Information System (INIS)
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Empirical modeling of nuclear power plants using neural networks
International Nuclear Information System (INIS)
A summary of a procedure for nonlinear identification of process dynamics encountered in nuclear power plant components is presented in this paper using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the nonlinear structure for system identification. In the overall identification process, the feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of time-dependent system nonlinearities. The standard backpropagation learning algorithm is modified and is used to train the proposed hybrid network in a supervised manner. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The nonlinear response of a representative steam generator is predicted using a neural network and is compared to the response obtained from a sophisticated physical model during both high- and low-power operation. The transient responses compare well, though further research is warranted for training and testing of recurrent neural networks during more severe operational transients and accident scenarios
Advances in Artificial Neural Networks – Methodological Development and Application
Directory of Open Access Journals (Sweden)
Yanbo Huang
2009-08-01
Full Text Available Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other networks such as radial basis function, recurrent network, feedback network, and unsupervised Kohonen self-organizing network. These networks, especially the multilayer perceptron network with a backpropagation training algorithm, have gained recognition in research and applications in various scientific and engineering areas. In order to accelerate the training process and overcome data over-fitting, research has been conducted to improve the backpropagation algorithm. Further, artificial neural networks have been integrated with other advanced methods such as fuzzy logic and wavelet analysis, to enhance the ability of data interpretation and modeling and to avoid subjectivity in the operation of the training algorithm. In recent years, support vector machines have emerged as a set of high-performance supervised generalized linear classifiers in parallel with artificial neural networks. A review on development history of artificial neural networks is presented and the standard architectures and algorithms of artificial neural networks are described. Furthermore, advanced artificial neural networks will be introduced with support vector machines, and limitations of ANNs will be identified. The future of artificial neural network development in tandem with support vector machines will be discussed in conjunction with further applications to food science and engineering, soil and water relationship for crop management, and decision support for precision agriculture. Along with the network structures and training algorithms, the applications of artificial neural networks will be reviewed as well, especially in the fields of agricultural and biological engineering.
Higher-order probabilistic perceptrons as Bayesian inference engines
International Nuclear Information System (INIS)
This letter makes explicit a structural connection between the Bayes optimal classifier operating on K binary input variables and corresponding two-layer perceptron having normalized output activities and couplings from input to output units of all orders up to K. Given a large and unbiased training set and an effective learning algorithm, such a neural network should be able to learn the statistics of the classification problem and match the a posteriori probabilities given by the Bayes optimal classifier. (author). 18 refs
APPLICATION OF NEURAL NETWORK ALGORITHMS FOR BPM LINEARIZATION
Energy Technology Data Exchange (ETDEWEB)
Musson, John C. [JLAB; Seaton, Chad [JLAB; Spata, Mike F. [JLAB; Yan, Jianxun [JLAB
2012-11-01
Stripline BPM sensors contain inherent non-linearities, as a result of field distortions from the pickup elements. Many methods have been devised to facilitate corrections, often employing polynomial fitting. The cost of computation makes real-time correction difficult, particulalry when integer math is utilized. The application of neural-network technology, particularly the multi-layer perceptron algorithm, is proposed as an efficient alternative for electrode linearization. A process of supervised learning is initially used to determine the weighting coefficients, which are subsequently applied to the incoming electrode data. A non-linear layer, known as an ?activation layer,? is responsible for the removal of saturation effects. Implementation of a perceptron in an FPGA-based software-defined radio (SDR) is presented, along with performance comparisons. In addition, efficient calculation of the sigmoidal activation function via the CORDIC algorithm is presented.
Aphasia Classification Using Neural Networks
DEFF Research Database (Denmark)
Axer, H.; Jantzen, Jan
2000-01-01
A web-based software model (http://fuzzy.iau.dtu.dk/aphasia.nsf) was developed as an example for classification of aphasia using neural networks. Two multilayer perceptrons were used to classify the type of aphasia (Broca, Wernicke, anomic, global) according to the results in some subtests of the Aachen Aphasia Test (AAT). First a coarse classification was achieved by using an assessment of spontaneous speech of the patient. This classifier produced correct results in 87% of the test cases. For a second test, data analysis tools were used to select four features out of the 30 available test features to yield a more accurate diagnosis. This second classifier produced correct results in 92% of the test cases. This test requires four AAT scores as input for the multilayer perceptron. In practice, the second test requires hours of work on behalf of the clinician, whereas the first test can be done in about half an hour in a free interview. The results of the classifiers were analyzed regarding their accuracy dependent on the diagnosis.
Terrain Mapping and Classification in Outdoor Environments Using Neural Networks
Directory of Open Access Journals (Sweden)
Alberto Yukinobu Hata
2009-12-01
Full Text Available This paper describes a three-dimensional terrain mapping and classification technique to allow the operation of mobile robots in outdoor environments using laser range finders. We propose the use of a multi-layer perceptron neural network to classify the terrain into navigable, partially navigable, and non-navigable. The maps generated by our approach can be used for path planning, navigation, and local obstacle avoidance. Experimental tests using an outdoor robot and a laser sensor demonstrate the accuracy of the presented methods.
Prediction of total resistance coefficients using neural networks
Ortigosa Barragán, Inma; Revilla López, Guillermo; García Espinosa, Julio
2009-01-01
The Holtrop & Mennen method is widely used at the initial design stage of ships for estimating the resistance of the ship (Holtrop and Mennen, 1982). The Holtrop & Mennen method provide a prediction of the total resistance’s components. In this work we present a neural network model which performs the same task as the Holtrop & Mennem’s method, for two of the total resistance’s components. A multilayer perceptron has been therefore trained to learn the relationship between the input (length-d...
NEURAL NETWORK SYSTEM FOR DIAGNOSTICS OF AVIATION DESIGNATION PRODUCTS
Directory of Open Access Journals (Sweden)
?. ????????
2011-02-01
Full Text Available In the article for solving the classification problem of the technical state of the object, proposed to use a hybrid neural network with a Kohonen layer and multilayer perceptron. The information-measuring system can be used for standardless diagnostics, cluster analysis and to classify the products which made from composite materials. The advantage of this architecture is flexibility, high performance, ability to use different methods for collecting diagnostic information about unit under test, high reliability of information processing
AN FUZZY NEURAL APPROACH FOR MEDICAL IMAGE RETRIEVAL
Directory of Open Access Journals (Sweden)
C. Sriramakrishnan
2012-01-01
Full Text Available Image retrieval based on a query image is necessary for effective and efficient use the information that is stored in medical image databases. Medical Image Retrieval is difficult as not only the localization and directionality of human visual system is to be considered but also the pathological condition. Image identification and segmentation for feature extraction pose a challenge to image retrieval process. Challenges posed include large number of images to be processed for the image retrieval and identifying the region of interest automatically to optimize the search. In this study, we propose a novel image segmentation algorithm Fuzzy Edge Detection and Segmentation (FEDS. The proposed FEDS algorithm is tested on medical images and for classification of images, a bell fuzzy multilayer perceptron is proposed. The proposed neural network Bell Fuzzy Multi Layer Perceptron (BF-MLP Neural network is constructed by introducing a fuzzy logic in hidden layer with the sugeno model and bell function. The proposed neural network consists of two layers with the first layer being a tanh activation function and the second layer containing the bell fuzzy activation function. The proposed FEDS method was implemented using Matlab and Modelsim. A total of 44 images were considered with three class labels. The edge obtained for which segmentation is done using the proposed segmentation algorithm. The proposed BF-MLP neural network algorithm was implemented using Visual Studio and the classification accuracy compared with MLP Neural Network with sigmoid activation function. In this study, a fuzzy segmentation algorithm and a fuzzy classification algorithm is proposed to improve the medical image retrieval accuracy. The proposed segmentation algorithm, Fuzzy Edge Detection and Segmentation (FEDS, was implemented using Matlab and features were extracted using Fast Hartley Transform (FHT. The extracted features were used to train the proposed neural network, Bell Fuzzy Multi Layer Perceptron Neural Network (BF-MLP. 44 images with 3 class labels were used to test the algorithm and classification accuracy of 93.2% was obtained.
Energy Technology Data Exchange (ETDEWEB)
Furini, M.A.; Araujo, P.B. de; Pereira, A.L.S. [Universidade Estadual Paulista (FEIS/UNESP), Ilha Solteira, SP (Brazil). Fac. de Engenharia. Dept. Engenharia Eletrica], Emails: mafurini@aluno.feis.unesp.br, percival@dee.feis.unesp.br, andspa@gmail.com
2009-07-01
This paper aims at analyzing the main operation and design of operationally robust controllers in order to damp the electromechanics oscillations type inter area. For this we used an intelligent control technique based on artificial neural networks, where a multilayer perceptron it was implemented. We used a symmetrical test system of four generators, ten bars and nine transmission lines to verify the performance of the power system stabilizers and power oscillation damping (POD) for the FACTS devices, unified power flow controller (UPFC), designed for neural networks. The results show the superiority in the operation and control of oscillations in power systems using UPFC equipped with the POD.
Energy Technology Data Exchange (ETDEWEB)
Bordieu, Ch.; Rebiere, D. [Bordeaux-1 Univ., Lab. IXL, UMR CNRS 5818, 33 (France); Pistre, J.; Planata, R. [Centre d' Etudes du Bouchet, 91 - Vert-le-Petit (France)
1999-07-01
The association of artificial neural networks (multilayer perceptrons) with a real time pattern recognition technique (shifting windows) allowed the development of systems for the detection and the quantification of gases. Shifting window technique is presented and offers an interesting way to improve the detection response time. The partial detector characterization with regard to its parameters was realized. Applications dealing with the detection of gas compounds using surface acoustic sensors permit to show the shifting window technique feasibility. (author)
Real-time EFIT data reconstruction based on neural network in KSTAR
Kwak, Sehyun; Jeon, Youngmu; Ghim, Young-Chul
2014-10-01
Real-time EFIT data can be obtained using a neural network method. A non-linear mapping between diagnostic signals and shaping parameters of plasma equilibrium can be established by the neural network, particularly with the multilayer perceptron. The neural network is utilized to attain real-time EFIT data for Korea Superconducting Tokamak for Advanced Research (KSTAR). We collect and process existing datasets of measured data and EFIT data to train and test the neural network. Parameter scans such as the numbers of hidden layers and hidden units were performed in order to find the optimal condition. EFIT data from the neural network was compared with both offline EFIT and real-time EFIT data. Finally, we discuss advantages of using neutral network reconstructed EFIT data for real time plasma control.
Nonlinear identification of process dynamics using neural networks
International Nuclear Information System (INIS)
In this paper the nonlinear identification of process dynamics encountered in nuclear power plant components is addressed, in an input-output sense, using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the model structure to be identified. The feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of temporal variations in the system nonlinearities. The standard backpropagation learning algorithm is modified, and it is used for the supervised training of the proposed hybrid network. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The response of representative steam generator is predicted using a neural network, and it is compared to the response obtained from a sophisticated computer model based on first principles. The transient responses compare well, although further research is warranted to determine the predictive capabilities of these networks during more severe operational transients and accident scenarios
Hierarchical Neural Network Structures for Phoneme Recognition
Vasquez, Daniel; Minker, Wolfgang
2013-01-01
In this book, hierarchical structures based on neural networks are investigated for automatic speech recognition. These structures are evaluated on the phoneme recognition task where a Hybrid Hidden Markov Model/Artificial Neural Network paradigm is used. The baseline hierarchical scheme consists of two levels each which is based on a Multilayered Perceptron. Additionally, the output of the first level serves as a second level input. The computational speed of the phoneme recognizer can be substantially increased by removing redundant information still contained at the first level output. Several techniques based on temporal and phonetic criteria have been investigated to remove this redundant information. The computational time could be reduced by 57% whilst keeping the system accuracy comparable to the baseline hierarchical approach.
Determination of osteoporosis risk using by neural networks method
Directory of Open Access Journals (Sweden)
Veysi Akpolat
2009-06-01
Full Text Available Artificial neural networks (ANNs have become modeling tools that have found extensive acceptance and they have frequently used in applications in many disciplines for solving complex problems. Different ANN structures are valuable models, which are used in the medical field for the development of decision support systems. In this paper, the learning and classification processes are used for determining the level of bone-density (safe / risk of osteoporosis in woman. In this study, three different structured neural networks were used for classifying of osteoporosis and the most efficient structure was determined. The training network structures were Multilayer perceptron neural network (MLP, Linear Vector Quantization (LVQ and Self Organizing Map (SOM. Performance indicators and statistical measures were used for evaluating the structures and the results demonstrated that the MLP was the most efficient structure for classifying of osteoporosis.
Neural networks for predicting breeding values and genetic gains
Scientific Electronic Library Online (English)
Gabi Nunes, Silva; Rafael Simões, Tomaz; Isabela de Castro, Sant' Anna; Moysés, Nascimento; Leonardo Lopes, Bhering; Cosme Damião, Cruz.
2014-12-01
Full Text Available Analysis using Artificial Neural Networks has been described as an approach in the decision-making process that, although incipient, has been reported as presenting high potential for use in animal and plant breeding. In this study, we introduce the procedure of using the expanded data set for train [...] ing the network. Wealso proposed using statistical parameters to estimate the breeding value of genotypes in simulated scenarios, in addition to the mean phenotypic value in a feed-forward back propagation multilayer perceptron network. After evaluating artificial neural network configurations, our results showed its superiority to estimates based on linear models, as well as its applicability in the genetic value prediction process. The results further indicated the good generalization performance of the neural network model in several additional validation experiments.
A Reinforcement Learning Algorithm Using Multi-Layer Artificial Neural Networks for Semi-Markov Decision Problems
Directory of Open Access Journals (Sweden)
Mustafa Ahmet Beyaz?t Ocaktan
2013-06-01
Full Text Available Real life problems are generally large-scale and difficult to model. Therefore, these problems can't be mostly solved by classical optimisation methods. This paper presents a reinforcement learning algorithm using a multi-layer artificial neural network to find an approximate solution for large-scale semi Markov decision problems. Performance of the developed algorithm is measured and compared to the classical reinforcement algorithm on a small-scale numerical example. According to results of numerical examples, a number of hidden layer are the key success factors, and average cost of the solution generated by the developed algorithm is approximately equal to that generated by the classical reinforcement algorithm.
Fernández-Delgado, Manuel; Cernadas, Eva; Barro, Senén; Ribeiro, Jorge; Neves, José
2014-02-01
The Direct Kernel Perceptron (DKP) (Fernández-Delgado et al., 2010) is a very simple and fast kernel-based classifier, related to the Support Vector Machine (SVM) and to the Extreme Learning Machine (ELM) (Huang, Wang, & Lan, 2011), whose ?-coefficients are calculated directly, without any iterative training, using an analytical closed-form expression which involves only the training patterns. The DKP, which is inspired by the Direct Parallel Perceptron, (Auer et al., 2008), uses a Gaussian kernel and a linear classifier (perceptron). The weight vector of this classifier in the feature space minimizes an error measure which combines the training error and the hyperplane margin, without any tunable regularization parameter. This weight vector can be translated, using a variable change, to the ?-coefficients, and both are determined without iterative calculations. We calculate solutions using several error functions, achieving the best trade-off between accuracy and efficiency with the linear function. These solutions for the ? coefficients can be considered alternatives to the ELM with a new physical meaning in terms of error and margin: in fact, the linear and quadratic DKP are special cases of the two-class ELM when the regularization parameter C takes the values C=0 and C=?. The linear DKP is extremely efficient and much faster (over a vast collection of 42 benchmark and real-life data sets) than 12 very popular and accurate classifiers including SVM, Multi-Layer Perceptron, Adaboost, Random Forest and Bagging of RPART decision trees, Linear Discriminant Analysis, K-Nearest Neighbors, ELM, Probabilistic Neural Networks, Radial Basis Function neural networks and Generalized ART. Besides, despite its simplicity and extreme efficiency, DKP achieves higher accuracies than 7 out of 12 classifiers, exhibiting small differences with respect to the best ones (SVM, ELM, Adaboost and Random Forest), which are much slower. Thus, the DKP provides an easy and fast way to achieve classification accuracies which are not too far from the best one for a given problem. The C and Matlab code of DKP are freely available. PMID:24287336
Interpretation of ECG Signal with a Multi-Layer Neural Network
Dumitru Ostafe
2008-01-01
In this article there are introduced the resultsobtained in the interpretation of the components of abiomedical signal, ECG, by using a multi-layer neuralnetwork, using the backpropagation algorithm. The neuralnetwork was simulated with the Neuroshell2.0 program. Thenew obtained network was used within the program ofautomate diagnosing of the ECG.
Neural networks: a biased overview
International Nuclear Information System (INIS)
An overview of recent activity in the field of neural networks is presented. The long-range aim of this research is to understand how the brain works. First some of the problems are stated and terminology defined; then an attempt is made to explain why physicists are drawn to the field, and their main potential contribution. In particular, in recent years some interesting models have been introduced by physicists. A small subset of these models is described, with particular emphasis on those that are analytically soluble. Finally a brief review of the history and recent developments of single- and multilayer perceptrons is given, bringing the situation up to date regarding the central immediate problem of the field: search for a learning algorithm that has an associated convergence theorem
Foreground removal from WMAP 5yr temperature maps using an MLP neural network
Nielsen, H U Nørgaard -
2010-01-01
One of the main obstacles for extracting the cosmic microwave background (CMB) signal from observations in the mm/sub-mm range is the foreground contamination by emission from Galactic component: mainly synchrotron, free-free, and thermal dust emission. The statistical nature of the intrinsic CMB signal makes it essential to minimize the systematic errors in the CMB temperature determinations. The feasibility of using simple neural networks to extract the CMB signal from detailed simulated data has already been demonstrated. Here, simple neural networks are applied to the WMAP 5yr temperature data without using any auxiliary data. A simple \\emph{multilayer perceptron} neural network with two hidden layers provides temperature estimates over more than 75 per cent of the sky with random errors significantly below those previously extracted from these data. Also, the systematic errors, i.e.\\ errors correlated with the Galactic foregrounds, are very small. With these results the neural network method is well prep...
A Study on Modeling of MIMO Channel by Using Different Neural Network Structures
Directory of Open Access Journals (Sweden)
N. Prabhakar
2012-11-01
Full Text Available Recognition of Radio Channel (channelParameters is one of Main Challenges in SignalTransformation, and has important role in cognitive radioapproach. Goal of this paper is “Channel modeling” to estimatecoefficients of transmission functions affected on data beingtransformed in the channel. We use Multilayer perceptron(MLPNeural Network with Back-propagation learning algorithm,block-structured Neural Network with Least Squares(LSmethod(cost function and a multilayer neural network withmultiple back-propagation(MBP learning algorithm for errorestimation. These networks will be trained with received signalsto be compatible with channel, then give us an estimation of thesecoefficients. Simulation will show that this MBP method is betterthan the other two method in error estimation. It has goodperformance and also consume less execution time. Then, we willuse this network for estimating coefficients of non-lineartransmission functions of actual radio channel.
How to guess the inter magnetic bubble potential by using a simple perceptron ?
Padovani, S.
2004-01-01
It is shown that magnetic bubble films behaviour can be described by using a 2D super-Ising hamiltonian. Calculated hysteresis curves and magnetic domain patterns are successfully compared with experimental results taken in literature. The reciprocal problem of finding paramaters of the super-Ising model to reproduce computed or experimental magnetic domain pictures is solved by using a perceptron neural network.
Neural networks in front-end processing and control
International Nuclear Information System (INIS)
Research into neural networks has gained a large following in recent years. In spite of the long term timescale of this Artificial Intelligence research, the tools which the community is developing can already find useful applications to real practical problems in experimental research. One of the main advantages of the parallel algorithms being developed in AI is the structural simplicity of the required hardware implementation, and the simple nature of the calculations involved. This makes these techniques ideal for problems in which both speed and data volume reduction are important, the case for most front-end processing tasks. In this paper we illustrate the use of a particular neural network known as the Multi-Layer Perceptron as a method for solving several different tasks, all drawn from the field of Tokamak research. We also briefly discuss the use of the Multi-Layer Perceptron as a non-linear controller in a feedback loop. We outline the type of problem which can be usefully addressed by these techniques, even before the large-scale parallel processing hardware currently under development becomes cheaply available. We also present some of the difficulties encountered in applying these networks. (author) 13 figs., 9 refs
Neural networks in front-end processing and control
International Nuclear Information System (INIS)
Research into neural networks has gained a large following in recent years. In spite of the long term timescale of this Artificial Intelligence research, the tools which the community is developing can already find useful applications to real practical problems in experimental research. One of the main advantages of the parallel algorithms being developed in AI is the structural simplicity of the required hardware implementation, and the simple nature of the calculations involved. This makes these techniques ideal for problems in which both speed and data volume reduction are important, the case for most front-end processing tasks. In this paper the authors illustrate the use of a particular neural network known as the Multi-Layer Perceptron as a method for solving several different tasks, all drawn from the field of Tokamak research. The authors also briefly discuss the use of the Multi-Layer Perceptron as a non-linear controller in a feedback loop. The authors outline the type of problem which can be usefully addressed by these techniques, even before the large-scale parallel processing hardware currently under development becomes cheaply available. The authors also present some of the difficulties encountered in applying these networks
EEG signal classification based on artificial neural networks and amplitude spectra features
Chojnowski, K.; FrÄ czek, J.
BCI (called Brain-Computer Interface) is an interface that allows direct communication between human brain and an external device. It bases on EEG signal collection, processing and classification. In this paper a complete BCI system is presented which classifies EEG signal using artificial neural networks. For this purpose we used a multi-layered perceptron architecture trained with the RProp algorithm. Furthermore a simple multi-threaded method for automatic network structure optimizing was shown. We presented the results of our system in the opening and closing eyes recognition task. We also showed how our system could be used for controlling devices basing on imaginary hand movements.
Alternative Sensor System and MLP Neural Network for Vehicle Pedal Activity Estimation
Directory of Open Access Journals (Sweden)
Ahmed M. Wefky
2010-04-01
Full Text Available It is accepted that the activity of the vehicle pedals (i.e., throttle, brake, clutch reflects the driver’s behavior, which is at least partially related to the fuel consumption and vehicle pollutant emissions. This paper presents a solution to estimate the driver activity regardless of the type, model, and year of fabrication of the vehicle. The solution is based on an alternative sensor system (regime engine, vehicle speed, frontal inclination and linear acceleration that reflects the activity of the pedals in an indirect way, to estimate that activity by means of a multilayer perceptron neural network with a single hidden layer.
Noise reduction technique for images using radial basis function neural networks
International Nuclear Information System (INIS)
This paper presents a NN (Neural Network) based model for reducing the noise from images. This is a RBF (Radial Basis Function) network which is used to reduce the effect of noise and blurring from the captured images. The proposed network calculates the mean MSE (Mean Square Error) and PSNR (Peak Signal to Noise Ratio) of the noisy images. The proposed network has also been successfully applied to medical images. The performance of the trained RBF network has been compared with the MLP (Multilayer Perceptron) Network and it has been demonstrated that the performance of the RBF network is better than the MLP network. (author)
Energy Technology Data Exchange (ETDEWEB)
Ohlsson, M.B.O.; Roegnvaldsson, T.S.; Peterson, C.O.; Pi, H.; Soederberg, B.P.W. [Lund Univ. (Sweden). Dept. of Theoretical Physics
1994-12-31
A feed-forward artificial neural network (ANN) procedure has been devised for predicting utility loads; the resulting predictions are presented for two test problems given by ``The Great Energy Predictor Shootout-The First Building Data Analysis and Prediction Competition`` (Kreider and Haberl 1994). Key ingredients in this approach are the multilayer perceptron and a method ({delta}-test) for determining relevant inputs. These methods are briefly reviewed, together with comments on alternative schemes such as fitting to polynomials and the use of recurrent networks.
Pattern recognition in high energy physics with artificial neural networks - JETNET 2. 0
Energy Technology Data Exchange (ETDEWEB)
Loennblad, L.; Peterson, C.; Roegnvaldsson, T. (Dept. of Theoretical Physics, Univ. Lund (Sweden))
1992-05-01
A F77 package of adaptive artificial neural network algorithms, JETNET 2.0, is presented. Its primary target is the high energy physics community, but it is general enough to be used in any pattern-recognition application area. The basic ingredients are the multilayer perceptron back-propagation algorithm and the topological self-organizing map. The package consists of a set of subroutines, which can either be used with standard options or be easily modified to host alternative architectures and procedures. (orig.).
Pattern recognition in high energy physics with artificial neural networks - JETNET 2.0
International Nuclear Information System (INIS)
A F77 package of adaptive artificial neural network algorithms, JETNET 2.0, is presented. Its primary target is the high energy physics community, but it is general enough to be used in any pattern-recognition application area. The basic ingredients are the multilayer perceptron back-propagation algorithm and the topological self-organizing map. The package consists of a set of subroutines, which can either be used with standard options or be easily modified to host alternative architectures and procedures. (orig.)
Fast non-linear extraction of plasma equilibrium parameters using a neural network mapping
International Nuclear Information System (INIS)
The shaping of non-circular plasmas requires a non-linear mapping between the measured diagnostic signals and selected equilibrium parameters. The particular configuration of Neural Network known as the multi-layer perceptron provides a powerful and general technique for formulating an arbitrary continuous non-linear multi-dimensional mapping. This technique has been successfully applied to the extraction of equilibrium parameters from measurements of single-null diverted plasmas in the DIII-D tokamak; the results are compared with a purely linear mapping. The method is promising, and hardware implementation is straightforward. (author) 15 refs., 7 figs
International Nuclear Information System (INIS)
The artificial neural network technique was used to identify drugs and plastic explosives, from a tomography composed by a set of six neutrongraphic projections obtained in real time. Bidimensional tomographic images of samples of drugs, explosives and other materials, when digitally processed, yield the characteristic spectra of each type of material. The information contained in those spectra was then used for ANN training, the best images being obtained when the multilayer perceptron model, the back-propagation training algorithm and the Cross-validation interruption criterion were used. ANN showed to be useful in forecasting presence of drugs and explosives hitting a rate of success above 97 %. (author)
Forecasting of preprocessed daily solar radiation time series using neural networks
Paoli, Christophe; Voyant, Cyril; Muselli, Marc; Nivet, Marie Laure
2010-01-01
In this paper, we present an application of Artificial Neural Networks (ANNs) in the renewable energy domain. We particularly look at the Multi-Layer Perceptron (MLP) network which has been the most used of ANNs architectures both in the renewable energy domain and in the time series forecasting. We have used a MLP and an ad-hoc time series preprocessing to develop a methodology for the daily prediction of global solar radiation on a horizontal surface. First results are promising with nRMSE ...
Time Series Data Mining in Rainfall Forecasting Using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Prince Gupta, S.K.Pandey
2014-01-01
Full Text Available Rainfall is very important parameter in hydrological model. Many techniques and models have been developed for rainfall time series prediction. In this study an artificial neural network (ANN based model was developed for rainfall time series forecasting. Proposed model used Multilayer perceptron (MLP network with back propagation algorithm for training. Discharge and rainfall data are took as input parameter for ANN model to predict rainfall time series. Data preprocessing and model’s sensitivity analysis were executed. Collected data is divided in three sets for optimal neural network training. The first set is the training set, used for calculate the gradient and updating the network weights and biases. The second set is the validation set. The error on the validation set is follow during the training process. The third set is test set. It is used to compare different models. Different topologies of Neural Networks were created with change in hidden layer, number of processing element and activation function. (MAE, Mean Squared error (MSE and correlation coefficient (CC are used to evaluate the model performance. On the basis of these evaluation parameter results, it is found that multilayer perceptron (MLP network predict more accurate than other traditional models.
Automatic Target Classification in SAR Images by Multilayer Back Propagation Neural Network
Directory of Open Access Journals (Sweden)
P. Vasuki
2012-12-01
Full Text Available In this study, a novel descriptive feature extraction method of Discrete Fourier transform and neural network classifier for classification of Synthetic Aperture Radar (SAR images is proposed. The classification process has the following stages (1 Image Segmentation using statistical Region Merging (SRM (2 Polar transform and Feature extraction using Discrete Fourier Transform (3 Neural Network classification using back propagation. The algorithm has been applied for the three classes of military manmade objects (metal objects in SAR imagery is using MSTAR public release database. Experimental results are presente.
Scientific Electronic Library Online (English)
Olívio F., Galão; Dionísio, Borsato; Jurandir P., Pinto; Jesuí V., Visentainer; Mercedes Concórdia, Carrão-Panizzi.
2011-01-01
Full Text Available Vinte variedades de soja (Glycine max), quatorze convencionais e seis variedades transgênicas (RR) foram analisadas quanto ao teor de proteína, ácido fítico, teor de óleo, fitosteróis, cinzas, minerais e ácidos graxos que foram tabelados e apresentados à rede neural do tipo perceptron de múltiplas c [...] amadas para a classificação e identificação quanto a região de plantio e quanto a variedade convencional ou transgênica. A rede neural utilizada classificou e testou corretamente 100% das amostras cultivadas por região. Para o banco de dados contendo informações sobre sojas transgênicas e convencionais foi obtido um desempenho de 94,43% no treinamento da rede, 83,30% no teste e 100% na validação. Abstract in english Twenty soybean (Glycine max) varieties, 14 conventional and 6 transgenic varieties were analyzed for protein content, phytic acid, oil content, phytosterols, ash, minerals and fatty acids. The data were tabled and presented to the multilayer perceptron neural network for classification and identific [...] ation of their planting region and whether they were a conventional or transgenic. The neural network used correctly classified and tested 100% of the samples cultivated per region. For the data bank containing information on transgenic and conventional soybean, a performance of 94.43% was obtained in the training of the neural network, 83.30% in the test and 100% in the validation.
Tissue-compliant neural implants from microfabricated carbon nanotube multilayer composite.
Zhang, Huanan; Patel, Paras R; Xie, Zhixing; Swanson, Scott D; Wang, Xueding; Kotov, Nicholas A
2013-09-24
Current neural prosthetic devices (NPDs) induce chronic inflammation due to complex mechanical and biological reactions related, in part, to staggering discrepancies of mechanical properties with neural tissue. Relatively large size of the implants and traumas to blood-brain barrier contribute to inflammation reactions, as well. Mitigation of these problems and the realization of long-term brain interface require a new generation of NPDs fabricated from flexible materials compliant with the brain tissue. However, such materials will need to display hard-to-combine mechanical and electrical properties which are not available in the toolbox of classical neurotechnology. Moreover, these new materials will concomitantly demand different methods of (a) device micromanufacturing and (b) surgical implantation in brains because currently used processes take advantage of high stiffness of the devices. Carbon nanotubes (CNTs) serve as a promising foundation for such materials because of their record mechanical and electrical properties, but CNT-based tissue-compliant devices have not been realized yet. In this study, we formalize the mechanical requirements to tissue-compliant implants based on critical rupture strength of brain tissue and demonstrate that miniature CNT-based devices can satisfy these requirements. We fabricated them using MEMS-like technology and miniaturized them so that at least two dimensions of the electrodes would be comparable to brain tissue cells. The nanocomposite-based flexible neural electrodes were implanted into the rat motor cortex using a surgical procedure specifically designed for soft tissue-compliant implants. The post-surgery implant localization in the motor cortex was successfully visualized with magnetic resonance and photoacoustic imaging. In vivo functionality was demonstrated by successful registration of the low-frequency neural recording in the live brain of anesthetized rats. Investigation of inflammation processes around these electrodes will be required to establish their prospects as long-term neural electrodes. PMID:23930825
Practical Application of Neural Networks in State Space Control
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon
1999-01-01
In the present thesis we address some problems in discrete-time state space control of nonlinear dynamical systems and attempt to solve them using generic nonlinear models based on artificial neural networks. The main aim of the work is to examine how well such control algorithms perform when applied to a realistic process. The thesis therefore strives to provide a thorough treatment of two classes of neural network-based controllers, and to make a rigorous comparison between them and a classical linear controller. Thus, the thesis starts out with a short review of some relevant system theoretic notions followed by a detailed description of the topology, neuron functions and learning rules of the two types of neural networks treated in the thesis, the multilayer perceptron and the neurofuzzy networks. In both cases, a Least Squares second-order gradient method is used to train the networks, although some modifications are needed for the method to apply to the multilayer perceptron network. In connection with the multilayer perceptron networks it is also pointed out how instantaneous, sample-by-sample linearized state space models can be extracted from a trained network, thus opening up for application of linear theory at each sample instant. The case study addressed in this work is an attemporator for a high-temperature steam circuit situated in a Danish powerplant, I/S Vestkraft unit 3. The attemporator is fitted with a nonlinear and nonconstant valve, so nonlinear and adaptive control is desired to control the steam temperature tightly. A second-order nonlinear model of the attemporator based on system identification with a multilayer perceptron network is found from data collected from the actual process. It is shown to be a highly satisfying prediction and simulation model of the process. With this model in place, we turn to the control concepts. A pole placement controller based on the sample-by-sample linearizations extracted from a multilayer perceptron state observer is first derived, and it is shown how to make the control concept adaptive by continuing the training online. Then the controller is shown to work on a simulation example. We also address the potential problem of too rapidly fluctuating parameters by including regularization in the learning rule. Next we develop a direct adaptive certainty-equivalence controller based on neurofuzzy models. The control loop is proven to be stable under certain assumptions, and we address the question of how many basis functions are necessary. It is shown that basis functions with compact supports, whose supports are not entered by a system trajectory, do not need parameter updates. Therefore, a system with bounded trajectories can be controlled by a finite-dimensional model. We also introduce a modification to the algorithm which-if an upper bound on the nonlinearity growth is known-enables us to remove a sector-boundedness assumption on the nonlinearity. Finally the control concepts are applied to the nonlinear simulation model discussed above, and it is seen that the neural network -based control concepts outperform a classical linear controller.
Thomas, Philippe
2008-01-01
Simulation is often used to evaluate the relevance of a Directing Program of Production (PDP) or to evaluate its impact on detailed sc\\'enarii of scheduling. Within this framework, we propose to reduce the complexity of a model of simulation by exploiting a multilayer perceptron. A main phase of the modeling of one system using a multilayer perceptron remains the determination of the structure of the network. We propose to compare and use various pruning algorithms in order to determine the optimal structure of the network used to reduce the complexity of the model of simulation of our case of application: a sawmill.
PREDICTION OF BOD AND COD OF A REFINERY WASTEWATER USING MULTILAYER ARTIFICIAL NEURAL NETWORKS
Eldon Raj Rene; Saidutta, M. B.
2008-01-01
In the recent past, artificial neural networks (ANNs) have shown the ability to learn and capture non-linear static or dynamic behaviour among variables based on the given set of data. Since the knowledge of internal procedure is not necessary, the modelling can take place with minimum previous knowledge about the process through proper training of the network. In the present study, 12 ANN based models were proposed to predict the Biochemical Oxygen Demand (BOD5) and Chemical Oxygen Demand (C...
An Approach to Neural Network Based Pattern Classifier for Printed Bengali Characters
Directory of Open Access Journals (Sweden)
sabyasachi samanta
2011-04-01
Full Text Available In this paper, we have designed a Neural Network based pattern classifier for recognizing Bengali printed characters. Here view-based approach is used for extracting features from individual characters and a neural network based classifier is built to analyze the performance of the view-based approach in various experimental setups. Different Bengali character samples have been taken and whole image of individual character is considered for view based analysis. The characteristic points are extracted from the characters using left-right view based approach. These points are then used to form a feature vector which represents the given character. Multi-Layer Perceptrons Neural network has been used and it was trained by back propagation algorithm to create this recognition engine. Internal shape of each character has been considered to generate the feature vector for individual images.
Inversion of rocket-borne photometer measurements by an artificial neural network technique
International Nuclear Information System (INIS)
Complete text of publication follows. The inverse problem to retrieve useful airglow volume emission rate profiles from rocket-borne photometer measurements has been solved by adopting the well-characterized spectral photometric methods. An alternative recovery method based on artificial neural network (ANN) is presented. In this work, a multilayer perceptron neural network was trained with a range of cases from the empirical and experimental volume emission rate profiles. A numerical experiment was also carried out with synthetic experimental data considering a noise level of 5%. Integrated emission profiles measured by a Brazilian sounding rocket experiment launched from an Equatorial station were taken as the input data. From the results obtained it may be concluded that the ANN technique is a convenient tool to recover volume emission rate profiles. The advantages of using neural network based systems are related to their intrinsic features of parallelism, after trained, the networks are much faster than traditional inversion approaches.
Directory of Open Access Journals (Sweden)
Ahmed M.A. Haidar
2008-01-01
Full Text Available Vulnerability assessment in power systems is important so as to determine how vulnerable a power system in case of any unforeseen catastrophic events. This paper presents the application of Radial Basis Function Neural Network (RBFNN for vulnerability assessment of power system incorporating a new proposed feature extraction method named as the Neural Network Weight Extraction (NNWE for dimensionality reduction of input data. The performance of the RBFNN is compared with the Multi Layer Perceptron Neural Network (MLPNN so as to evaluate the effectiveness of the RBFNN in assessing the vulnerability of a power system based on the indices, power system loss and possible loss of load. In this study, vulnerability analysis simulations were carried out on the IEEE 300 bus test system using the Power System Analysis Toolbox and the development of neural network models were implemented in MATLAB version 7. Test results prove that the RBFNN give better vulnerability assessment performance than the multilayer perceptron neural network in terms of accuracy and training time. The proposed feature extraction method decreases the training time drastically from hours to less than seconds, this bound to influence the vulnerability classification and increase the speed of convergence. It is also concluded that the reduction in error is achieved by using PSL as an output variable of ANN, in all the cases the error of RBFNN output by PSL is less than 4.87% which is well within tolerable limits.
Implementation of multi-layer feed forward neural network on PIC16F877 microcontroller
International Nuclear Information System (INIS)
Artificial Neural Network (ANN) is an electronic model based on the neural structure of the brain. Similar to human brain, ANN consists of interconnected simple processing units or neurons that process input to generate output signals. ANN operation is divided into 2 categories; training mode and service mode. This project aims to implement ANN on PIC micro-controller that enable on-chip or stand alone training and service mode. The input can varies from sensors or switches, while the output can be used to control valves, motors, light source and a lot more. As partial development of the project, this paper reports the current status and results of the implemented ANN. The hardware fraction of this project incorporates Microchip PIC16F877A microcontrollers along with uM-FPU math co-processor. uM-FPU is a 32-bit floating point co-processor utilized to execute complex calculation requires by the sigmoid activation function for neuron. ANN algorithm is converted to software program written in assembly language. The implemented ANN structure is three layer with one hidden layer, and five neurons with two hidden neurons. To prove the operability and functionality, the network is trained to solve three common logic gate operations; AND, OR, and XOR. This paper concludes that the ANN had been successfully implemented on PIC16F877a and uM-FPU math co-processor hardware that works accordingly on both training and service mode. (Author)
Robust chaos generation by a perceptron
Priel, A.; Kanter, I.
2000-01-01
The properties of time series generated by a perceptron with monotonic and non-monotonic transfer function, where the next input vector is determined from past output values, are examined. Analysis of the parameter space reveals the following main finding: a perceptron with a monotonic function can produce fragile chaos only whereas a non-monotonic function can generate robust chaos as well. For non-monotonic functions, the dimension of the attractor can be controlled monoto...
The Margitron: A Generalised Perceptron with Margin
Panagiotakopoulos, Constantinos; Tsampouka, Petroula
2008-01-01
We identify the classical Perceptron algorithm with margin as a member of a broader family of large margin classifiers which we collectively call the Margitron. The Margitron, (despite its) sharing the same update rule with the Perceptron, is shown in an incremental setting to converge in a finite number of updates to solutions possessing any desirable fraction of the maximum margin. Experiments comparing the Margitron with decomposition SVMs on tasks involving linear kernel...
Directory of Open Access Journals (Sweden)
Mustafa Y?ld?z
2012-08-01
Full Text Available Introduction: We aimed to develop a classification method to discriminate ventricular septal defect and atrial septal defect by using severalhemodynamic parameters.Patients and Methods: Forty three patients (30 atrial septal defect, 13 ventricular septal defect; 26 female, 17 male with documentedhemodynamic parameters via cardiac catheterization are included to study. Such parameters as blood pressure values of different areas,gender, age and Qp/Qs ratios are used for classification. Parameters, we used in classification are determined by divergence analysismethod. Those parameters are; i pulmonary artery diastolic pressure, ii Qp/Qs ratio, iii right atrium pressure, iv age, v pulmonary arterysystolic pressure, vi left ventricular sistolic pressure, vii aorta mean pressure, viii left ventricular diastolic pressure, ix aorta diastolicpressure, x aorta systolic pressure. Those parameters detected from our study population, are uploaded to multi-layered artificial neuralnetwork and the network was trained by genetic algorithm.Results: Trained cluster consists of 14 factors (7 atrial septal defect and 7 ventricular septal defect. Overall success ratio is 79.2%, andwith a proper instruction of artificial neural network this ratio increases up to 89%.Conclusion: Parameters, belonging to artificial neural network, which are needed to be detected by the investigator in classical methods,can easily be detected with the help of genetic algorithms. During the instruction of artificial neural network by genetic algorithms, boththe topology of network and factors of network can be determined. During the test stage, elements, not included in instruction cluster, areassumed as in test cluster, and as a result of this study, we observed that multi-layered artificial neural network can be instructed properly,and neural network is a successful method for aimed classification.
PREDICTION OF BOD AND COD OF A REFINERY WASTEWATER USING MULTILAYER ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Eldon Raj Rene
2008-06-01
Full Text Available In the recent past, artificial neural networks (ANNs have shown the ability to learn and capture non-linear static or dynamic behaviour among variables based on the given set of data. Since the knowledge of internal procedure is not necessary, the modelling can take place with minimum previous knowledge about the process through proper training of the network. In the present study, 12 ANN based models were proposed to predict the Biochemical Oxygen Demand (BOD5 and Chemical Oxygen Demand (COD concentrations of wastewater generated from the effluent treatment plant of a petrochemical industry. By employing the standard back error propagation (BEP algorithm, the network was trained with 103 data points for water quality indices such as Total Suspended Solids (TSS, Total Dissolved Solids (TDS, Phenol concentration, Ammoniacal Nitrogen (AMN, Total Organic Carbon (TOC and Kjeldahl’s Nitrogen (KJN to predict BOD and COD. After appropriate training, the network was tested with a separate test data and the best model was chosen based on the sum square error (training and percentage average relative error (% ARE for testing. The results from this study reveal that ANNs can be accurate and efficacious in predicting unknown concentrations of water quality parameters through its versatile training process.
Generalization and capacity of extensively large two-layered perceptrons
International Nuclear Information System (INIS)
The generalization ability and storage capacity of a treelike two-layered neural network with a number of hidden units scaling as the input dimension is examined. The mapping from the input to the hidden layer is via Boolean functions; the mapping from the hidden layer to the output is done by a perceptron. The analysis is within the replica framework where an order parameter characterizing the overlap between two networks in the combined space of Boolean functions and hidden-to-output couplings is introduced. The maximal capacity of such networks is found to scale linearly with the logarithm of the number of Boolean functions per hidden unit. The generalization process exhibits a first-order phase transition from poor to perfect learning for the case of discrete hidden-to-output couplings. The critical number of examples per input dimension, ?c, at which the transition occurs, again scales linearly with the logarithm of the number of Boolean functions. In the case of continuous hidden-to-output couplings, the generalization error decreases according to the same power law as for the perceptron, with the prefactor being different
Recursive least-squares learning algorithms for neural networks
Lewis, Paul S.; Hwang, Jenq N.
1990-11-01
This paper presents the development of a pair of recursive least squares (ItLS) algorithms for online training of multilayer perceptrons which are a class of feedforward artificial neural networks. These algorithms incorporate second order information about the training error surface in order to achieve faster learning rates than are possible using first order gradient descent algorithms such as the generalized delta rule. A least squares formulation is derived from a linearization of the training error function. Individual training pattern errors are linearized about the network parameters that were in effect when the pattern was presented. This permits the recursive solution of the least squares approximation either via conventional RLS recursions or by recursive QR decomposition-based techniques. The computational complexity of the update is 0(N2) where N is the number of network parameters. This is due to the estimation of the N x N inverse Hessian matrix. Less computationally intensive approximations of the ilLS algorithms can be easily derived by using only block diagonal elements of this matrix thereby partitioning the learning into independent sets. A simulation example is presented in which a neural network is trained to approximate a two dimensional Gaussian bump. In this example RLS training required an order of magnitude fewer iterations on average (527) than did training with the generalized delta rule (6 1 BACKGROUND Artificial neural networks (ANNs) offer an interesting and potentially useful paradigm for signal processing and pattern recognition. The majority of ANN applications employ the feed-forward multilayer perceptron (MLP) network architecture in which network parameters are " trained" by a supervised learning algorithm employing the generalized delta rule (GDIt) [1 2]. The GDR algorithm approximates a fixed step steepest descent algorithm using derivatives computed by error backpropagatiori. The GDII algorithm is sometimes referred to as the backpropagation algorithm. However in this paper we will use the term backpropagation to refer only to the process of computing error derivatives. While multilayer perceptrons provide a very powerful nonlinear modeling capability GDR training can be very slow and inefficient. In linear adaptive filtering the analog of the GDR algorithm is the leastmean- squares (LMS) algorithm. Steepest descent-based algorithms such as GDR or LMS are first order because they use only first derivative or gradient information about the training error to be minimized. To speed up the training process second order algorithms may be employed that take advantage of second derivative or Hessian matrix information. Second order information can be incorporated into MLP training in different ways. In many applications especially in the area of pattern recognition the training set is finite. In these cases block learning can be applied using standard nonlinear optimization techniques [3 4 5].
Financial time series prediction using spiking neural networks.
Reid, David; Hussain, Abir Jaafar; Tawfik, Hissam
2014-01-01
In this paper a novel application of a particular type of spiking neural network, a Polychronous Spiking Network, was used for financial time series prediction. It is argued that the inherent temporal capabilities of this type of network are suited to non-stationary data such as this. The performance of the spiking neural network was benchmarked against three systems: two "traditional", rate-encoded, neural networks; a Multi-Layer Perceptron neural network and a Dynamic Ridge Polynomial neural network, and a standard Linear Predictor Coefficients model. For this comparison three non-stationary and noisy time series were used: IBM stock data; US/Euro exchange rate data, and the price of Brent crude oil. The experiments demonstrated favourable prediction results for the Spiking Neural Network in terms of Annualised Return and prediction error for 5-Step ahead predictions. These results were also supported by other relevant metrics such as Maximum Drawdown and Signal-To-Noise ratio. This work demonstrated the applicability of the Polychronous Spiking Network to financial data forecasting and this in turn indicates the potential of using such networks over traditional systems in difficult to manage non-stationary environments. PMID:25170618
Neural network classifier of attacks in IP telephony
Safarik, Jakub; Voznak, Miroslav; Mehic, Miralem; Partila, Pavol; Mikulec, Martin
2014-05-01
Various types of monitoring mechanism allow us to detect and monitor behavior of attackers in VoIP networks. Analysis of detected malicious traffic is crucial for further investigation and hardening the network. This analysis is typically based on statistical methods and the article brings a solution based on neural network. The proposed algorithm is used as a classifier of attacks in a distributed monitoring network of independent honeypot probes. Information about attacks on these honeypots is collected on a centralized server and then classified. This classification is based on different mechanisms. One of them is based on the multilayer perceptron neural network. The article describes inner structure of used neural network and also information about implementation of this network. The learning set for this neural network is based on real attack data collected from IP telephony honeypot called Dionaea. We prepare the learning set from real attack data after collecting, cleaning and aggregation of this information. After proper learning is the neural network capable to classify 6 types of most commonly used VoIP attacks. Using neural network classifier brings more accurate attack classification in a distributed system of honeypots. With this approach is possible to detect malicious behavior in a different part of networks, which are logically or geographically divided and use the information from one network to harden security in other networks. Centralized server for distributed set of nodes serves not only as a collector and classifier of attack data, but also as a mechanism for generating a precaution steps against attacks.
Scientific Electronic Library Online (English)
Dionísio, Borsato; Ivanira, Moreira; Marcelo Medre, Nobrega; Mariete Barbosa, Moreira; Gabriel Henrique, Dias; Rui Sérgio dos Santos Ferreira da, Silva; Evandro, Bona.
2328-23-01
Full Text Available [...] Abstract in english The multilayer perceptron network was used to classify the gasoline. The main parameters used in the classification were established by the Ordinance nº 309 of the Agência Nacional do Petróleo, but without informing the network the legal limits of these parameters. The network used had 10 neurons in [...] a single hidden layer, learning rate of 0.04 and 250 training epochs. The application of artificial neural network served classify 100% of the commercialized gas in the region of Londrina-PR and to identify the tampered gasoline even those suspected of tampering.
Neural network controller for Active Demand-Side Management with PV energy in the residential sector
International Nuclear Information System (INIS)
Highlights: ? We have developed a neural controller for Active Demand-Side Management. ? The controller consists of Multilayer Perceptrons evolved with a genetic algorithm. ? The architecture of the controller is distributed and modular. ? The simulations show that the electrical local behavior improves. ? Active Demand-Side Management helps users to control his energy behaviour. -- Abstract: In this paper, we describe the development of a control system for Demand-Side Management in the residential sector with Distributed Generation. The electrical system under study incorporates local PV energy generation, an electricity storage system, connection to the grid and a home automation system. The distributed control system is composed of two modules: a scheduler and a coordinator, both implemented with neural networks. The control system enhances the local energy performance, scheduling the tasks demanded by the user and maximizing the use of local generation.
Radar Signal Detection In Non-Gaussian Noise Using RBF Neural Network
Directory of Open Access Journals (Sweden)
D. G. Khairnar
2008-01-01
Full Text Available In this paper, we suggest a neural network signal detector using radial basis function (RBF network. We employ this RBF Neural detector to detect the presence or absence of a known signal corrupted by different Gaussian, non-Gaussian and impulsive noise components. In case of non-Gaussian noise, experimental results show that RBF network signal detector has significant improvement in performance characteristics. Detection capability is better than to those obtained with multilayer perceptrons (BP and optimum matched filter (MF detector. This signal detector is also tested on the simulated signals impacted by impulsive noise produced by atmospheric events and short lived echoes from meteor trains. Tested Results show, improved detection capability to impulsive noise compare to BP signal detector. It also show better performance as a function of signal-tonoise ratio compared to BP and MF.
Neural network model for a reactor subsystem using real time data
International Nuclear Information System (INIS)
Modern nuclear power plant is a very complex arrangement of machinery consisting of huge number of control and support systems. In real time it is possible to implement intelligent systems in the form of neural network, data mining, expert system etc. for modeling the power plant. This paper describes the development of an artificial neural network model for intermediate heat exchanger subsystem of fast breeder test reactor. Multilayer perceptron network using back propagation algorithm is implemented for training the safety critical, safety related real time data. It takes in to account the weight correction method. The results indicate a very good convergence of the algorithm. The model can be used as an operator support system for predictive measures of various parameters of the reactor subsystems. (author)
Prediction of Force Measurements of a Microbend Sensor Based on an Artificial Neural Network
Directory of Open Access Journals (Sweden)
Kemal Fidanboylu
2009-09-01
Full Text Available Artificial neural network (ANN based prediction of the response of a microbend fiber optic sensor is presented. To the best of our knowledge no similar work has been previously reported in the literature. Parallel corrugated plates with three deformation cycles, 6 mm thickness of the spacer material and 16 mm mechanical periodicity between deformations were used in the microbend sensor. Multilayer Perceptron (MLP with different training algorithms, Radial Basis Function (RBF network and General Regression Neural Network (GRNN are used as ANN models in this work. All of these models can predict the sensor responses with considerable errors. RBF has the best performance with the smallest mean square error (MSE values of training and test results. Among the MLP algorithms and GRNN the Levenberg-Marquardt algorithm has good results. These models successfully predict the sensor responses, hence ANNs can be used as useful tool in the design of more robust fiber optic sensors.
Prediction of slope stability using artificial neural network (case study: Noabad, Mazandaran, Iran)
International Nuclear Information System (INIS)
Investigations of failures of soil masses are subjects touching both geology and engineering. These investigations call the joint efforts of engineering geologists and geotechnical engineers. Geotechnical engineers have to pay particular attention to geology, ground water, and shear strength of soils in assessing slope stability. Artificial neural networks (ANNs) are very sophisticated modeling techniques, capable of modeling extremely complex functions. In particular, neural networks are nonlinear. In this research, with respect to the above advantages, ANN systems consisting of multilayer perceptron networks are developed to predict slope stability in a specified location, based on the available site investigation data from Noabad, Mazandaran, Iran. Several important parameters, including total stress, effective stress, angle of slope, coefficient of cohesion, internal friction angle, and horizontal coefficient of earthquake, were used as the input parameters, while the slope stability was the output parameter. The results are compared with the classical methods of limit equilibrium to check the ANN model's validity. (author)
Directory of Open Access Journals (Sweden)
Nor A.M. Isa
2007-01-01
Full Text Available Thirteen cytology of fine needle aspiration image (i.e. cellularity, background information, cohesiveness, significant stromal component, clump thickness, nuclear membrane, bare nuclei, normal nuclei, mitosis, nucleus stain, uniformity of cell, fragility and number of cells in cluster are evaluated their possibility to be used as input data for artificial neural network in order to classify the breast pre-cancerous cases into four stages, namely malignant, fibroadenoma, fibrocystic disease, and other benign diseases. A total of 1300 reported breast pre-cancerous cases which was collected from Penang General Hospital and Hospital Universiti Sains Malaysia, Kelantan, Malaysia was used to train and test the artificial neural networks. The diagnosis system which was developed using the Hybrid Multilayered Perceptron and trained using Modified Recursive Prediction Error produced excellent diagnosis performance with 100% accuracy, 100% sensitivity and 100% specificity.
Foreground removal from Planck Sky Model temperature maps using a MLP neural network
DEFF Research Database (Denmark)
NØrgaard-Nielsen, Hans Ulrik; Hebert, K.
2009-01-01
Unfortunately, the Cosmic Microwave Background (CMB) radiation is contaminated by emission originating in the Milky Way (synchrotron, free-free and dust emission). Since the cosmological information is statistically in nature, it is essential to remove this foreground emission and leave the CMB with no systematic errors. To demonstrate the feasibility of a simple multilayer perceptron (MLP) neural network for extracting the CMB temperature signal, we have analyzed a specific data set, namely the Planck Sky Model maps, developed for evaluation of different component separation methods before including them in the Planck data analysis pipeline. It is found that a MLP neural network can provide a CMB map of about 80% of the sky to a very high degree uncorrelated with the foreground components. Also the derived power spectrum shows little evidence for systematic errors.
DEFF Research Database (Denmark)
Farrokhzad, F.; Barari, Amin
2011-01-01
The purpose of this study was to create an empirical model for assessing the landslide risk potential at Savadkouh Azad University, which is located in the rural surroundings of Savadkouh, about 5 km from the city of Pol-Sefid in northern Iran. The soil longitudinal profile of the city of Babol, located 25 km from the Caspian Sea, also was predicted with an artificial neural network (ANN). A multilayer perceptron neural network model was applied to the landslide area and was used to analyze specific elements in the study area that contributed to previous landsliding events. The ANN models were trained with geotechnical data obtained from an investigation of the study area. The quality of the modeling was improved further by the application of some controlling techniques involved in ANN. The observed >90% overall accuracy produced by the ANN technique in both cases is promising for future studies in landslide susceptibility zonation.
A Comparison between Neural Networks and Wavelet Networks in Nonlinear System Identification
Directory of Open Access Journals (Sweden)
S. Ehsan Razavi
2012-01-01
Full Text Available In this study, identification of a nonlinear function will be presented by neural network and wavelet network methods. Behavior of a nonlinear system can be identified by intelligent methods. Two groups of the most common and at the same time the most effective of neural networks methods are multilayer perceptron and radial basis function that will be used for nonlinear system identification. The selected structure is series - parallel method that after network training by a series of training random data, the output is estimated and the nonlinear function is compared to a sinusoidal input. Then, wavelet network is used for identification and we will use Orthogonal Least Squares (OLS method for wavelet selection to reduce the volume of calculations and increase the convergence speed.
Neural Network on Photodegradation of Octylphenol using Natural and Artificial UV Radiation
Directory of Open Access Journals (Sweden)
Lorentz JÄNTSCHI
2011-09-01
Full Text Available The present paper comes up with an experimental design meant to point out the factors interferingin octylphenol’s degradation in surface waters under solar radiation, underlining each factor’sinfluence on the process observable (concentration of p-octylphenol. Multiple linear regressionanalysis and artificial neural network (Multi-Layer Perceptron type were applied in order to obtaina mathematical model capable to explain the action of UV-light upon synthetic solutions of OP inultra-pure water (MilliQ type. Neural network proves to be the most efficient method in predictingthe evolution of OP concentration during photodegradation process. Thus, determination in neuralnetwork’s case has almost double value versus the regression analysis.
Genetic Learning of Perceptron Networks.
Czech Academy of Sciences Publication Activity Database
Slušný, Stanislav
Praha : Ústav informatiky AV ?R & MATFYZPRESS, 2006 - (Hakl, F.), s. 156-163 ISBN 80-86732-87-8. [Doktorandský den '06. Monínec (CZ), 20.09.2006-22.10.2006] Institutional research plan: CEZ:AV0Z10300504 Keywords : genetic algorithms * neural networks Subject RIV: JC - Computer Hardware ; Software
Perceptron beyond the limit of capacity
Del Giudice, P.; Franz, S.; Virasoro, M. A.
1989-01-01
An input-output map in which the patterns are divided into classes is considered for the perceptron. The statistical mechanical analysis with a finite number of classes turns out to give the same results as the case of only one class of patterns ; the limit of capacity and the relevant order parameters are calculated in a mean field approach. The analysis is then extended to the Derrida Gardner canonical ensemble in which the perceptron can be studied beyond the limit of capacity. We complete...
Artificial neural network application for predicting soil distribution coefficient of nickel
International Nuclear Information System (INIS)
The distribution (or partition) coefficient (Kd) is an applicable parameter for modeling contaminant and radionuclide transport as well as risk analysis. Selection of this parameter may cause significant error in predicting the impacts of contaminant migration or site-remediation options. In this regards, various models were presented to predict Kd values for different contaminants specially heavy metals and radionuclides. In this study, artificial neural network (ANN) is used to present simplified model for predicting Kd of nickel. The main objective is to develop a more accurate model with a minimal number of parameters, which can be determined experimentally or select by review of different studies. In addition, the effects of training as well as the type of the network are considered. The Kd values of Ni is strongly dependent on pH of the soil and mathematical relationships were presented between pH and Kd of nickel recently. In this study, the same database of these presented models was used to verify that neural network may be more useful tools for predicting of Kd. Two different types of ANN, multilayer perceptron and redial basis function, were used to investigate the effect of the network geometry on the results. In addition, each network was trained by 80 and 90% of the data and tested for 20 and 10% of the rest data. Then the results of the networks compared with the results of the mathematicompared with the results of the mathematical models. Although the networks trained by 80 and 90% of the data the results show that all the networks predict with higher accuracy relative to mathematical models which were derived by 100% of data. More training of a network increases the accuracy of the network. Multilayer perceptron network used in this study predicts better than redial basis function network. - Highlights: ? Simplified models for predicting Kd of nickel presented using artificial neural networks. ? Multilayer perceptron and redial basis function used to predict Kd of nickel in soil. ? The neural networks predict with higher accuracy relative to mathematical models.
View-invariant action recognition based on artificial neural networks.
Iosifidis, Alexandros; Tefas, Anastasios; Pitas, Ioannis
2012-03-01
In this paper, a novel view invariant action recognition method based on neural network representation and recognition is proposed. The novel representation of action videos is based on learning spatially related human body posture prototypes using self organizing maps. Fuzzy distances from human body posture prototypes are used to produce a time invariant action representation. Multilayer perceptrons are used for action classification. The algorithm is trained using data from a multi-camera setup. An arbitrary number of cameras can be used in order to recognize actions using a Bayesian framework. The proposed method can also be applied to videos depicting interactions between humans, without any modification. The use of information captured from different viewing angles leads to high classification performance. The proposed method is the first one that has been tested in challenging experimental setups, a fact that denotes its effectiveness to deal with most of the open issues in action recognition. PMID:24808548
Recognition of Japanese finger spelling gestures using neural networks.
Machacon, H T C; Shiga, S
2010-05-01
Effective communication with the hearing and speech impaired often requires at least a basic working knowledge of sign language gestures, without which a memo pad and pen, or a mobile phone's notepad is indispensable. The aim of this study was to build a neural network that could be used to recognize static finger-hand gestures of the yubimoji, the Japanese sign language syllabary. To build the network, signal inputs from a data glove interface were taken for each of the static yubimoji gestures. The network was trained and tested 10 times using a multilayer perceptron model. Overall, only 18 of the 41 static gestures were successfully recognized. One of the reasons was attributed to the inability of the data glove to measure gesture directions particularly for yubimoji gestures with similar finger configurations. Future work will focus on these problems as well as the inclusion of dynamic yubimoji gestures. PMID:20143958
Neural Network Aided Glitch-Burst Discrimination and Glitch Classification
Rampone, Salvatore; Troiano, Luigi; Pinto, Innocenzo M
2014-01-01
We investigate the potential of neural-network based classifiers for discriminating gravitational wave bursts (GWBs) of a given canonical family (e.g. core-collapse supernova waveforms) from typical transient instrumental artifacts (glitches), in the data of a single detector. The further classification of glitches into typical sets is explored.In order to provide a proof of concept,we use the core-collapse supernova waveform catalog produced by H. Dimmelmeier and co-Workers, and the data base of glitches observed in laser interferometer gravitational wave observatory (LIGO) data maintained by P. Saulson and co-Workers to construct datasets of (windowed) transient waveforms (glitches and bursts) in additive (Gaussian and compound-Gaussian) noise with different signal-tonoise ratios (SNR). Principal component analysis (PCA) is next implemented for reducing data dimensionality, yielding results consistent with, and extending those in the literature. Then, a multilayer perceptron is trained by a backpropagation ...
Hybrid Learning Algorithm in Neural Network System for Enzyme Classification
Directory of Open Access Journals (Sweden)
Mohd Haniff Osman
2010-07-01
Full Text Available Nucleic acid and protein sequences store a wealth of informationwhich ultimately determines their functions and characteristics.Protein sequences classification deals with the assignment ofsequences to known categories based on homology detectionproperties. In this paper, we developed a hybrid learning algorithm inneural network system called Neural Network Enzyme Classification(NNEC to classify an enzyme found in Protein Data Bank (PDB to agiven family of enzymes. NNEC was developed based on MultilayerPerceptron with hybrid learning algorithm combining the geneticalgorithm (GA and Backpropagation (BP, where one of them acts asan operator in the other. Here, BP is used as a mutation-like-operatorof the general GA search template. The proposed hybrid model wastested with different topologies of network architecture, especially indetermining the number of hidden nodes. The precision results arequite promising in classifying the enzyme accordingly.
Best Approximation by Heaviside Perceptron Networks.
Czech Academy of Sciences Publication Activity Database
Kainen, P.C.; K?rková, V?ra; Vogt, A.
2000-01-01
Ro?. 13, ?. 7 (2000), s. 695-697. ISSN 0893-6080 R&D Projects: GA ?R GA201/96/0917; GA AV ?R IAA2030602 Institutional research plan: AV0Z1030915 Keywords : one-hidden-layer networks * heaviside perceptrons * best approximation * metric projection * continuous selection * approximatively compact Subject RIV: BA - General Mathematics Impact factor: 1.221, year: 2000
A diluted version of the perceptron model
Marquez-Carreras, D; Tindel, S; Marquez-Carreras, David; Rovira, Carles; Tindel, Samy
2006-01-01
This note is concerned with a diluted version of the perceptron model. We establish a replica symmetric formula at high temperature, which is achieved by studying the asymptotic behavior of a given spin magnetization. Our main task will be to identify the order parameter of the system.
Minimization of Error Functionals over Perceptron Networks.
Czech Academy of Sciences Publication Activity Database
K?rková, V?ra
2008-01-01
Ro?. 20, ?. 1 (2008), s. 252-270. ISSN 0899-7667 R&D Projects: GA ?R GA201/05/0557 Institutional research plan: CEZ:AV0Z10300504 Keywords : model complexity of perceptron networks * minimization of error functionals Subject RIV: BA - General Mathematics Impact factor: 2.378, year: 2008
Neural Network Control of Asymmetrical Multilevel Converters
Directory of Open Access Journals (Sweden)
Patrice WIRA
2009-12-01
Full Text Available This paper proposes a neural implementation of a harmonic eliminationstrategy (HES to control a Uniform Step Asymmetrical Multilevel Inverter(USAMI. The mapping between the modulation rate and the requiredswitching angles is learned and approximated with a Multi-Layer Perceptron(MLP neural network. After learning, appropriate switching angles can bedetermined with the neural network leading to a low-computational-costneural controller which is well suited for real-time applications. Thistechnique can be applied to multilevel inverters with any number of levels. Asan example, a nine-level inverter and an eleven-level inverter are consideredand the optimum switching angles are calculated on-line. Comparisons to thewell-known sinusoidal pulse-width modulation (SPWM have been carriedout in order to evaluate the performance of the proposed approach. Simulationresults demonstrate the technical advantages of the proposed neuralimplementation over the conventional method (SPWM in eliminatingharmonics while controlling a nine-level and eleven-level USAMI. Thisneural approach is applied for the supply of an asynchronous machine andresults show that it ensures a highest quality torque by efficiently cancelingthe harmonics generated by the inverters.
Shale Gas reservoirs characterization using neural network
Ouadfeul, Sid-Ali; Aliouane, Leila
2014-05-01
In this paper, a tentative of shale gas reservoirs characterization enhancement from well-logs data using neural network is established. The goal is to predict the Total Organic carbon (TOC) in boreholes where the TOC core rock or TOC well-log measurement does not exist. The Multilayer perceptron (MLP) neural network with three layers is established. The MLP input layer is constituted with five neurons corresponding to the Bulk density, Neutron porosity, sonic P wave slowness and photoelectric absorption coefficient. The hidden layer is forms with nine neurons and the output layer is formed with one neuron corresponding to the TOC log. Application to two boreholes located in Barnett shale formation where a well A is used as a pilot and a well B is used for propagation shows clearly the efficiency of the neural network method to improve the shale gas reservoirs characterization. The established formalism plays a high important role in the shale gas plays economy and long term gas energy production.
Vibration Based Damage Assessment of a Cantilever using a Neural Network
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1993-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated.
Chattopadhyay, S
2006-01-01
In the present research, possibility of predicting average summer-monsoon rainfall over India has been analyzed through Artificial Neural Network models. In formulating the Artificial Neural Network based predictive model, three layered networks have been constructed with sigmoid non-linearity. The models under study are different in the number of hidden neurons. After a thorough training and test procedure, neural net with three nodes in the hidden layer is found to be the best predictive model.
Energy Technology Data Exchange (ETDEWEB)
Altran, A.B.; Lotufo, A.D.P.; Minussi, C.R. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil). Dept. de Engenharia Eletrica], Emails: lealtran@yahoo.com.br, annadiva@dee.feis.unesp.br, minussi@dee.feis.unesp.br; Lopes, M.L.M. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil). Dept. de Matematica], E-mail: mara@mat.feis.unesp.br
2009-07-01
This paper presents a methodology for electrical load forecasting, using radial base functions as activation function in artificial neural networks with the training by backpropagation algorithm. This methodology is applied to short term electrical load forecasting (24 h ahead). Therefore, results are presented analyzing the use of radial base functions substituting the sigmoid function as activation function in multilayer perceptron neural networks. However, the main contribution of this paper is the proposal of a new formulation of load forecasting dedicated to the forecasting in several points of the electrical network, as well as considering several types of users (residential, commercial, industrial). It deals with the MLF (Multimodal Load Forecasting), with the same processing time as the GLF (Global Load Forecasting). (author)
Scientific Electronic Library Online (English)
Gustavo A., García; Octavio, Salcedo.
2010-06-01
Full Text Available El presente artículo describe la implementación de un sistema de predicción de fallos en redes LAN (fallos de timeout y rechazo en las conexiones), utilizando redes neuronales artificiales Perceptrón Multicapa. Se describe como se implementó el sistema, las pruebas realizadas para la selección de lo [...] s parámetros propios de la red neuronal, como del algoritmo de entrenamiento y los resultados de evaluación obtenidos. Abstract in english The paper presents the implementation of a system for predicting failures in LAN (timeout failure and rejection of connections), using neural networks (multilayer perceptron). It describes the implementation of the system, experiments conducted for the selection of specific parameters of the neural [...] network, training algorithm and evaluation results.
Intelligent control of HVAC systems. Part II: perceptron performance analysis
Directory of Open Access Journals (Sweden)
Ioan URSU
2013-09-01
Full Text Available This is the second part of a paper on intelligent type control of Heating, Ventilating, and Air-Conditioning (HVAC systems. The whole study proposes a unified approach in the design of intelligent control for such systems, to ensure high energy efficiency and air quality improving. In the first part of the study it is considered as benchmark system a single thermal space HVAC system, for which it is assigned a mathematical model of the controlled system and a mathematical model(algorithm of intelligent control synthesis. The conception of the intelligent control is of switching type, between a simple neural network, a perceptron, which aims to decrease (optimize a cost index,and a fuzzy logic component, having supervisory antisaturating role for neuro-control. Based on numerical simulations, this Part II focuses on the analysis of system operation in the presence only ofthe neural control component. Working of the entire neuro-fuzzy system will be reported in a third part of the study.
Mathematically Reduced Chemical Reaction Mechanism Using Neural Networks
Energy Technology Data Exchange (ETDEWEB)
Ziaul Huque
2007-08-31
This is the final technical report for the project titled 'Mathematically Reduced Chemical Reaction Mechanism Using Neural Networks'. The aim of the project was to develop an efficient chemistry model for combustion simulations. The reduced chemistry model was developed mathematically without the need of having extensive knowledge of the chemistry involved. To aid in the development of the model, Neural Networks (NN) was used via a new network topology known as Non-linear Principal Components Analysis (NPCA). A commonly used Multilayer Perceptron Neural Network (MLP-NN) was modified to implement NPCA-NN. The training rate of NPCA-NN was improved with the GEneralized Regression Neural Network (GRNN) based on kernel smoothing techniques. Kernel smoothing provides a simple way of finding structure in data set without the imposition of a parametric model. The trajectory data of the reaction mechanism was generated based on the optimization techniques of genetic algorithm (GA). The NPCA-NN algorithm was then used for the reduction of Dimethyl Ether (DME) mechanism. DME is a recently discovered fuel made from natural gas, (and other feedstock such as coal, biomass, and urban wastes) which can be used in compression ignition engines as a substitute for diesel. An in-house two-dimensional Computational Fluid Dynamics (CFD) code was developed based on Meshfree technique and time marching solution algorithm. The project also provided valuable research experience to two graduate students.
Applying Neural Network Architecture for Inverse Kinematics Problem in Robotics
Directory of Open Access Journals (Sweden)
Shadi Khawandi
2010-03-01
Full Text Available One of the most important problems in robot kinematics and control is, finding the solution of Inverse Kinematics. Inverse kinematics computation has been one of the main problems in robotics research. As the Complexity of robot increases, obtaining the inverse kinematics is difficult and computationally expensive. Traditional methods such as geometric, iterative and algebraic are inadequate if the joint structure of the manipulator is more complex. As alternative approaches, neural networks and optimal search methods have been widely used for inverse kinematics modeling and control in robotics This paper proposes neural network architecture that consists of 6 sub-neural networks to solve the inverse kinematics problem for robotics manipulators with 2 or higher degrees of freedom. The neural networks utilized are multi-layered perceptron (MLP with a back-propagation training algorithm. This approach will reduce the complexity of the algorithm and calculation (matrix inversion faced when using the Inverse Geometric Models implementation (IGM in robotics. The obtained results are presented and analyzed in order to prove the efficiency of the proposed approach.
Landscape statistics of the binary perceptron
Fontanari, J. F.; Ko?berle, R.
1990-01-01
The landscape of the binary perceptron is studied by Simulated Annealing, exhaustive search and performing random walks on the landscape. We find that the number of local minima increases exponentially with the number of bonds, becoming deeper in the vicinity of a global minimum, but more and more shallow as we move away from it. The random walker detects a simple dependence on the size of the mapping, the architecture introducing a nontrivial dependence on the number of steps.
Storage of correlated patterns in a perceptron
Lopez, B.; Schroeder, M.; Opper, M.
1995-01-01
We calculate the storage capacity of a perceptron for correlated gaussian patterns. We find that the storage capacity $\\alpha_c$ can be less than 2 if similar patterns are mapped onto different outputs and vice versa. As long as the patterns are in general position we obtain, in contrast to previous works, that $\\alpha_c \\geq 1$ in agreement with Cover's theorem. Numerical simulations confirm the results.
Multifractal analysis of perceptron learning with errors
Weigt, M.
1997-01-01
Random input patterns induce a partition of the coupling space of a perceptron into cells labeled by their output sequences. Learning some data with a maximal error rate leads to clusters of neighboring cells. By analyzing the internal structure of these clusters with the formalism of multifractals, we can handle different storage and generalization tasks for lazy students and absent-minded teachers within one unified approach. The results also allow some conclusions on the ...
Dynamic Baysesian state-space model with a neural network for an online river flow prediction
Ham, Jonghwa; Hong, Yoon-Seok
2013-04-01
The usefulness of artificial neural networks in complex hydrological modeling has been demonstrated by successful applications. Several different types of neural network have been used for the hydrological modeling task but the multi-layer perceptron (MLP) neural network (also known as the feed-forward neural network) has enjoyed a predominant position because of its simplicity and its ability to provide good approximations. In many hydrological applications of MLP neural networks, the gradient descent-based batch learning algorithm such as back-propagation, quasi-Newton, Levenburg-Marquardt, and conjugate gradient algorithms has been used to optimize the cost function (usually by minimizing the error function in the prediction) by updating the parameters and structure in a neural network defined using a set of input-output training examples. Hydrological systems are highly with time-varying inputs and outputs, and are characterized by data that arrive sequentially. The gradient descent-based batch learning approaches that are implemented in MLP neural networks have significant disadvantages for online dynamic hydrological modeling because they could not update the model structure and parameter when a new set of hydrological measurement data becomes available. In addition, a large amount of training data is always required off-line with a long model training time. In this work, a dynamic nonlinear Bayesian state-space model with a multi-layer perceptron (MLP) neural network via a sequential Monte Carlo (SMC) learning algorithm is proposed for an online dynamic hydrological modeling. This proposed new method of modeling is herein known as MLP-SMC. The sequential Monte Carlo learning algorithm in the MLP-SMC is designed to evolve and adapt the weight of a MLP neural network sequentially in time on the arrival of each new item of hydrological data. The weight of a MLP neural network is treated as the unknown dynamic state variable in the dynamic Bayesian state-space model formulation. The nonlinear Monte Carlo filtering algorithm is based on recursively constructing the posterior probability density (distribution) of the state variable of neural network's weight, with respect to measured data (in our case, river flow), through a random trajectory of the state by entities called 'particles' in the dynamic state-space model formulation. A weight, which is the probability of the trajectory of the state, is assigned to each particle by a Bayesian correction term based on measurement. The algorithms differ in the way that the swarm of particles evolves and adapts to incoming online measurement data. In order to demonstrate the efficiency and usefulness of the proposed MLP-SMC, a practical application of hydrological modeling is carried out to predict the river flow sequentially in advance on the arrival of each new item of river flow data at intervals of 10 minutes. The performance of the proposed MLP-SMC is compared with the performance of a multi-layer perceptron (MLP) model trained using the back-propagation learning algorithm (MLP-BP) in which a batch off-line learning algorithm is implemented. The results show that the proposed MLP-SMC shows superiority in terms of model accuracy and computational cost compared with MLP-BP. The sequential Monte Carlo learning algorithm implemented in MLP-SMC is shown to have less sensitivity to noisy and sparsely distributed data compared to the batch off-line learning algorithm used in MLP-BP.
On-line learning through simple perceptron with a margin
Hara, Kazuyuki; Okada, Masato
2003-01-01
We analyze a learning method that uses a margin $\\kappa$ {\\it a la} Gardner for simple perceptron learning. This method corresponds to the perceptron learning when $\\kappa=0$, and to the Hebbian learning when $\\kappa \\to \\infty$. Nevertheless, we found that the generalization ability of the method was superior to that of the perceptron and the Hebbian methods at an early stage of learning. We analyzed the asymptotic property of the learning curve of this method through compu...
Al-Abadi, Alaa M.
2014-12-01
The potential of using three different data-driven techniques namely, multilayer perceptron with backpropagation artificial neural network (MLP), M5 decision tree model, and Takagi-Sugeno (TS) inference system for mimic stage-discharge relationship at Gharraf River system, southern Iraq has been investigated and discussed in this study. The study used the available stage and discharge data for predicting discharge using different combinations of stage, antecedent stages, and antecedent discharge values. The models' results were compared using root mean squared error (RMSE) and coefficient of determination (R 2) error statistics. The results of the comparison in testing stage reveal that M5 and Takagi-Sugeno techniques have certain advantages for setting up stage-discharge than multilayer perceptron artificial neural network. Although the performance of TS inference system was very close to that for M5 model in terms of R 2, the M5 method has the lowest RMSE (8.10 m3/s). The study implies that both M5 and TS inference systems are promising tool for identifying stage-discharge relationship in the study area.
Directory of Open Access Journals (Sweden)
J. C. Ochoa-Rivera
2002-01-01
Full Text Available A model for multivariate streamflow generation is presented, based on a multilayer feedforward neural network. The structure of the model results from two components, the neural network (NN deterministic component and a random component which is assumed to be normally distributed. It is from this second component that the model achieves the ability to incorporate effectively the uncertainty associated with hydrological processes, making it valuable as a practical tool for synthetic generation of streamflow series. The NN topology and the corresponding analytical explicit formulation of the model are described in detail. The model is calibrated with a series of monthly inflows to two reservoir sites located in the Tagus River basin (Spain, while validation is performed through estimation of a set of statistics that is relevant for water resources systems planning and management. Among others, drought and storage statistics are computed and compared for both the synthetic and historical series. The performance of the NN-based model was compared to that of a standard autoregressive AR(2 model. Results show that NN represents a promising modelling alternative for simulation purposes, with interesting potential in the context of water resources systems management and optimisation. Keywords: neural networks, perceptron multilayer, error backpropagation, hydrological scenario generation, multivariate time-series..
Perceptrons with Hebbian Learning Based on Wave Ensembles in Spatially Patterned Potentials
Espinosa-Ortega, T.; Liew, T. C. H.
2015-03-01
A general scheme to realize a perceptron for hardware neural networks is presented, where multiple interconnections are achieved by a superposition of Schrödinger waves. Spatially patterned potentials process information by coupling different points of reciprocal space. The necessary potential shape is obtained from the Hebbian learning rule, either through exact calculation or construction from a superposition of known optical inputs. This allows implementation in a wide range of compact optical systems, including (1) any nonlinear optical system, (2) optical systems patterned by optical lithography, and (3) exciton-polariton systems with phonon or nuclear spin interactions.
Multimodal pattern recognition by modular neural network
Yang, Shulin; Chang, Kuo-Chu
1998-02-01
Multilayer perceptrons (MLPs) have been widely applied to pattern recognition. It is found that when the data has a multimodal distribution, a standard MLP is hard to train and a valid neural network classifier is difficult to obtain. We propose a two-phase learning modular (TLM) neural network architecture to tackle this problem. The basic idea is to transform the multimodal distribution into a known and more learnable distribution and then use a standard MLP to classify the new data. The transformation is accomplished by decomposing the input feature space into several subspaces and training several MLPs with samples in the subsets. We verified this idea with a two-class classification example and applied the TLM to the inverse synthetic aperture radar automatic target recognition, and compared its performance with that of the MLP. Experiments show that the MLP is difficult to train. Its performance depends strongly on the number of training samples as well as the architecture parameters. On the other hand, the TLM is much easier to train and yields better performance. In addition, the TLM's performance is more robust.
Hong, Yoon-Seok Timothy
2012-10-01
SummaryThis paper proposes a dynamic nonlinear state-space model with a neural network that uses a sequential learning algorithm capable of online simulation, in which the model predicts and adapts to the arrival of each new item of hydrological data in a sequential manner (as opposed to a 'batch'), thereby enabling online real-time hydrological modeling. The improved sequential extended Kalman filtering (EKF) learning algorithm is developed to train multi-layer perceptron (MLP) neural networks, and is known as the MLP-EKF method with updating of noise covariance (MLP-EKFQ). It is herein proposed to allow the evolution of the weight of a neural network sequentially in time while also computing the noise covariance matrices of the EKF algorithm automatically by maximizing the evidence density function with respect to the noise covariance matrices. The proposed MLP-EKFQ was used to develop an online real-time warning system to predict river temperatures affected by the discharge of cooling water 1 km downstream of a thermal power station, from real-time to 2 h ahead, sequentially on the arrival of each new item of hydrological, meteorological, and power station operational data at 10 min intervals. It is demonstrated that the proposed MLP-EKFQ is superior in terms of both model performance and computational efficiency to those models that adopt a batch learning algorithm such as a multi-layer perceptron (MLP) system trained using the back-prorogation learning algorithm (MLP-BP), or an adaptive neural-fuzzy inference system (ANFIS). Due to its computational efficiency, its online simulation capability, and the high levels of accuracy achieved by the proposed MLP-EKFQ method, there is a great deal of potential for its use as an online dynamic hydrological modeling tool that may be suitable for a variety of complex dynamic and/or real-time tasks.
Unfolding the neutron spectrum of a NE213 scintillator using artificial neural networks
International Nuclear Information System (INIS)
Artificial neural networks technology has been applied to unfold the neutron spectra from the pulse height distribution measured with NE213 liquid scintillator. Here, both the single and multi-layer perceptron neural network models have been implemented to unfold the neutron spectrum from an Am-Be neutron source. The activation function and the connectivity of the neurons have been investigated and the results have been analyzed in terms of the network's performance. The simulation results show that the neural network that utilizes the Satlins transfer function has the best performance. In addition, omitting the bias connection of the neurons improve the performance of the network. Also, the SCINFUL code is used for generating the response functions in the training phase of the process. Finally, the results of the neural network simulation have been compared with those of the FORIST unfolding code for both 241Am-Be and 252Cf neutron sources. The results of neural network are in good agreement with FORIST code.
Unfolding the neutron spectrum of a NE213 scintillator using artificial neural networks.
Sharghi Ido, A; Bonyadi, M R; Etaati, G R; Shahriari, M
2009-10-01
Artificial neural networks technology has been applied to unfold the neutron spectra from the pulse height distribution measured with NE213 liquid scintillator. Here, both the single and multi-layer perceptron neural network models have been implemented to unfold the neutron spectrum from an Am-Be neutron source. The activation function and the connectivity of the neurons have been investigated and the results have been analyzed in terms of the network's performance. The simulation results show that the neural network that utilizes the Satlins transfer function has the best performance. In addition, omitting the bias connection of the neurons improve the performance of the network. Also, the SCINFUL code is used for generating the response functions in the training phase of the process. Finally, the results of the neural network simulation have been compared with those of the FORIST unfolding code for both (241)Am-Be and (252)Cf neutron sources. The results of neural network are in good agreement with FORIST code. PMID:19586776
Evaluation of Neural Networks Performance in Active Cancellation of Acoustic Noise
Directory of Open Access Journals (Sweden)
Mehrshad Salmasi,
2014-12-01
Full Text Available Active Noise Control (ANC works on the principle of destructive interference between the primary disturbance field heard as undesired noise and the secondary field which is generated from control actuators. In the simplest system, the disturbance field can be a simple sine wave, and the secondary field is the same sine wave but 180 degrees out of phase. This research presents an investigation on the use of different types of neural networks in active noise control. Performance of the multilayer perceptron (MLP, Elman and generalized regression neural networks (GRNN in active cancellation of acoustic noise signals is investigated and compared in this paper. Acoustic noise signals are selected from a Signal Processing Information Base (SPIB database. In order to compare the networks appropriately, similar structures and similar training and test samples are deduced for neural networks. The simulation results show that MLP, GRNN, and Elman neural networks present proper performance in active cancellation of acoustic noise. It is concluded that Elman and MLP neural networks have better performance than GRNN in noise attenuation. It is demonstrated that designed ANC system achieve good noise reduction in low frequencies.
Digital Hardware Implementation of a Neural System Used for Nonlinear Adaptive Prediction
Directory of Open Access Journals (Sweden)
HassÃ¨ne Faiedh
2006-01-01
Full Text Available Neural networks have been widely used for many applications in digital communications. They are able to give solutions to complex problems due to their nonlinear processing and their learning and generalization. Neural networks are one of the key technologies for the communication domain and accordingly a special effort may be expected to be paid to real time hardware implementation issues. In this study, it is proposed a digital hardware implementation of a neural system based on a multilayer perceptron (MLP. The neural system is used for the nonlinear adaptive prediction of nonstationary signals such as speech signals. The implemented architecture of the MLP is generated using a generic elementary neuron (EN. The polynomial approximation method is used to implement the sigmoidal activation function. The back-propagation algorithm is used to implant the prediction task. The circuit implementation architecture is detailed, for achieving real-time prediction for speech signals. The designed ASIC circuit includes a neural network block, an on-chip learning block and a memory used for storing the synaptic weights for updating.
A new source difference artificial neural network for enhanced positioning accuracy
International Nuclear Information System (INIS)
Integrated inertial navigation system (INS) and global positioning system (GPS) units provide reliable navigation solution compared to standalone INS or GPS. Traditional Kalman filter-based INS/GPS integration schemes have several inadequacies related to sensor error model and immunity to noise. Alternatively, multi-layer perceptron (MLP) neural networks with three layers have been implemented to improve the position accuracy of the integrated system. However, MLP neural networks show poor accuracy for low-cost INS because of the large inherent sensor errors. For the first time the paper demonstrates the use of knowledge-based source difference artificial neural network (SDANN) to improve navigation performance of low-cost sensor, with or without external aiding sources. Unlike the conventional MLP or artificial neural networks (ANN), the structure of SDANN consists of two MLP neural networks called the coarse model and the difference model. The coarse model learns the input–output data relationship whereas the difference model adds knowledge to the system and fine-tunes the coarse model output by learning the associated training or estimation error. Our proposed SDANN model illustrated a significant improvement in navigation accuracy of up to 81% over conventional MLP. The results demonstrate that the proposed SDANN method is effective for GPS/INS integration schemes using low-cost inertial sensors, with and without GPS
Evaluation of pan evaporation modeling with two different neural networks and weather station data
Kim, Sungwon; Singh, Vijay P.; Seo, Youngmin
2014-07-01
This study evaluates neural networks models for estimating daily pan evaporation for inland and coastal stations in Republic of Korea. A multilayer perceptron neural networks model (MLP-NNM) and a cascade correlation neural networks model (CCNNM) are developed for local implementation. Five-input models (MLP 5 and CCNNM 5) are generally found to be the best for local implementation. The optimal neural networks models, including MLP 4, MLP 5, CCNNM 4, and CCNNM 5, perform well for homogeneous (cross-stations 1 and 2) and nonhomogeneous (cross-stations 3 and 4) weather stations. Statistical results of CCNNM are better than those of MLP-NNM during the test period for homogeneous and nonhomogeneous weather stations except for MLP 4 being better in BUS-DAE and POH-DAE, and MLP 5 being better in POH-DAE. Applying the conventional models for the test period, it is found that neural networks models perform better than the conventional models for local, homogeneous, and nonhomogeneous weather stations.
Optimal Capacity of the Blume-Emery-Griffiths perceptron
Bolle, D.; Castillo, I. Perez; Shim, G. M.
2002-01-01
A Blume-Emery-Griffiths perceptron model is introduced and its optimal capacity is calculated within the replica-symmetric Gardner approach, as a function of the pattern activity and the imbedding stability parameter. The stability of the replica-symmetric approximation is studied via the analogue of the Almeida-Thouless line. A comparison is made with other three-state perceptrons.
A Review of Artificial Neural Networks: How Well Do They Perform in Forecasting Time Series?
Directory of Open Access Journals (Sweden)
Elsy Gómez-Ramos
2013-12-01
Full Text Available At the beginning of the 90’s, Artificial Neural Networks (ANNs started their applications in finance. The ANNs are data-drive, self-adaptive and non-linear methods that do not require specific assumptions about the underlying model. In general, there are five groups of networks used as forecasting tools: 1 Feedforward Networks, like the Multilayer Perceptron (MLP, 2 Recurrent Networks, 3 Polynomial Networks, 4 Modular Networks, and 5 Support Vector Machine. This paper carries out a review of the specialized literature on ANNs and makes a comparative analysis according to their performance in forecasting stock indices and exchange rates. The objective is to assess the performance when applying different types of networks in relation to MLP. It is shown that the MLP is the best network in forecasting time series. However, it is shown that the MLP has important delimitations in several respects: network architecture, basic functions and initialization weights.
Scott, D J; Kilner, J A; Rossiny, J C H; McAlford, N N
2007-01-01
We describe the development of artificial neural networks (ANN) for the prediction of the properties of ceramic materials. The ceramics studied here include polycrystalline, inorganic, non-metallic materials and are investigated on the basis of their dielectric and ionic properties. Dielectric materials are of interest in telecommunication applications where they are used in tuning and filtering equipment. Ionic and mixed conductors are the subjects of a concerted effort in the search for new materials that can be incorporated into efficient, clean electrochemical devices of interest in energy production and greenhouse gas reduction applications. Multi-layer perceptron ANNs are trained using the back-propagation algorithm and utilise data obtained from the literature to learn composition-property relationships between the inputs and outputs of the system. The trained networks use compositional information to predict the relative permittivity and oxygen diffusion properties of ceramic materials. The results sh...
Evaluation of Starting Current of Induction Motors Using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Iman Sadeghkhani
2014-07-01
Full Text Available Induction motors (IMs are widely used in industry including it be an electrical or not. However during starting period, their starting currents are so large that can damage equipment. Therefore, this current should be estimated accurately to prevent hazards caused by it. In this paper, the artificial neural network (ANN as an intelligent tool is used to evaluate starting current peak of IMs. Both Multilayer Perceptron (MLP and Radial Basis Function (RBF structures have been analyzed. Six learning algorithms, backpropagation (BP, delta-bar-delta (DBD, extended delta-bar-delta (EDBD, directed random search (DRS, quick propagation (QP, and levenberg marquardt (LM were used to train the MLP. The simulation results using MATLAB show that most developed ANNs can estimate the starting current peak of IMs with good accuracy. However, it is proven that LM and EDBD algorithms present better performance for starting current evaluation based on average of relative and absolute errors.
Directory of Open Access Journals (Sweden)
J. Pavlovicova
2007-04-01
Full Text Available In this contribution, human face as biometric is considered. Original method of feature extraction from image data is introduced using MLP (multilayer perceptron and PCA (principal component analysis. This method is used in human face recognition system and results are compared to face recognition system using PCA directly, to a system with direct classification of input images by MLP and RBF (radial basis function networks, and to a system using MLP as a feature extractor and MLP and RBF networks in the role of classifier. Also a two-stage method for face recognition is presented, in which Kohonen self-organizing map is used as a feature extractor. MLP and RBF network are used as classifiers. In order to obtain deeper insight into presented methods, also visualizations of internal representation of input data obtained by neural networks are presented.
A new approach for sizing stand alone photovoltaic systems based in neural networks
Energy Technology Data Exchange (ETDEWEB)
Hontoria, L.; Aguilera, J. [Universidad de Jaen, Dept. de Electronica, Jaen (Spain); Zufiria, P. [UPM Ciudad Universitaria, Dept. de Matematica Aplicada a las Tecnologias de la Informacion, Madrid (Spain)
2005-02-01
Several methods for sizing stand alone photovoltaic (pv) systems has been developed. The more simplistic are called intuitive methods. They are a useful tool for a first approach in sizing stand alone photovoltaic systems. Nevertheless they are very inaccurate. Analytical methods use equations to describe the pv system size as a function of reliability. These ones are more accurate than the previous ones but they are also not accurate enough for sizing of high reliability. In a third group there are methods which use system simulations. These ones are called numerical methods. Many of the analytical methods employ the concept of reliability of the system or the complementary term: loss of load probability (LOLP). In this paper an improvement for obtaining LOLP curves based on the neural network called Multilayer Perceptron (MLP) is presented. A unique MLP for many locations of Spain has been trained and after the training, the MLP is able to generate LOLP curves for any value and location. (Author)
Prediction of Atmospheric Pressure at Ground Level using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Angshuman Ray
2013-01-01
Full Text Available Prediction of Atmospheric Pressure is one important and challenging task that needs lot of attention and study for analyzing atmospheric conditions. Advent of digital computers and development of data driven artificial intelligence approaches like Artificial Neural Networks (ANN have helped in numerical prediction of pressure. However, very few works have been done till now in this area. The present study developed an ANN model based on the past observations of several meteorological parameters like temperature, humidity, air pressure and vapour pressure as an input for training the model. The novel architecture of the proposed model contains several multilayer perceptron network (MLP to realize better performance. The model is enriched by analysis of alternative hybrid model of k-means clustering and MLP. The improvement of the performance in the prediction accuracy has been demonstrated by the automatic selection of the appropriate cluster
Cintra, Rosangela S
2014-01-01
This paper presents an approach for employing artificial neural networks (NN) to emulate an ensemble Kalman filter (EnKF) as a method of data assimilation. The assimilation methods are tested in the Simplified Parameterizations PrimitivE-Equation Dynamics (SPEEDY) model, an atmospheric general circulation model (AGCM), using synthetic observational data simulating localization of balloon soundings. For the data assimilation scheme, the supervised NN, the multilayer perceptrons (MLP-NN), is applied. The MLP-NN are able to emulate the analysis from the local ensemble transform Kalman filter (LETKF). After the training process, the method using the MLP-NN is seen as a function of data assimilation. The NN were trained with data from first three months of 1982, 1983, and 1984. A hind-casting experiment for the 1985 data assimilation cycle using MLP-NN were performed with synthetic observations for January 1985. The numerical results demonstrate the effectiveness of the NN technique for atmospheric data assimilati...
Directory of Open Access Journals (Sweden)
Ali Abroudi
2013-04-01
Full Text Available This paper presents a hybrid approach with two phases for improving the performance of training artificial neural networks (ANNs by selection of the most important instances for training, and then reduction the dimensionality of features. The ANNs which are applied in this paper for validation, are included Multi-Layer Perceptron (MLP and Neuro-Fuzzy Network (NFN. In the first phase, the Modified Fast Condensed Nearest Neighbor (MFCNN algorithm is used to construct the subset with instances very close to the decision boundary. It leads to achieve the instances more useful for training the network. And in the second phase, an Ant-based approach to the supervised reduction of feature dimensionality is introduced, aims to reduce the complexity, and improve the accuracy of learning the ANN. The main purpose of this method is to enhance the classification performance by improving the quality of the training set. Experimental results illustrated the efficiency of the proposed approach.
Viscosity Calculation at Moderate Pressure for Nonpolar Gases via Neural Network
Directory of Open Access Journals (Sweden)
A. Bouzidi
2007-01-01
Full Text Available A new method, based on Artificial Neural Networks (ANN of Multi-Layer Perceptron (MLP type, has been developed to estimate the viscosity at moderate pressure for pure nonpolar gases over a wide range of temperatures. An ANN was trained, using four physicochemical properties: Molecular weight (M, boiling point (Tb, critical Temperature (Tc and critical Pressure (Pc combined with absolute Temperature (T as its inputs, to correlate and predict viscosity. A group of 52 nonpolar gases were used to train and test the performance of the ANN. The viscosity and input data for each individual gas was compiled on average at fifty different temperatures, ranging from the boiling points for each of the chosen gases to 1100 K. The maximum absolute error in viscosity, predicted by the ANN, was approximately 15%.
Vibrational analysis of carbon nanotubes using molecular mechanics and artificial neural network
Fakhrabadi, Mir Masoud Seyyed; Samadzadeh, Mostafa; Rastgoo, Abbas; Yazdi, Mohammadreza Haeri; Mashhadi, Mahmoud Mousavi
2011-12-01
This paper presents the molecular mechanics based finite element modeling of carbon nanotubes (CNTs) and their applications as mass sensors. The beam element with elastic behavior is considered as the bond between the carbon atoms and its properties are obtained using equating continuum and molecular characteristics. The first five natural frequencies of CNTs in cantilever and doubly clamped boundary conditions (BCs) and their corresponding mode shapes are studied in detail. Furthermore, a multilayer perceptron neural network is used to predict the fundamental vibration frequencies of the CNTs with different diameters and lengths. In addition, variations of the natural frequencies of the CNTs with distorted cross sections are investigated. Moreover, the effects of some attached masses with various values on the first three natural frequencies of a considered CNT are studied here.
Finite size scaling of the bayesian perceptron
Buhot, A; Gordon, M B
1997-01-01
We study numerically the properties of the bayesian perceptron through a gradient descent on the optimal cost function. The theoretical distribution of stabilities is deduced. It predicts that the optimal generalizer lies close to the boundary of the space of (error-free) solutions. The numerical simulations are in good agreement with the theoretical distribution. The extrapolation of the generalization error to infinite input space size agrees with the theoretical results. Finite size corrections are negative and exhibit two different scaling regimes, depending on the training set size. The variance of the generalization error vanishes for $N \\rightarrow \\infty$ confirming the property of self-averaging.
Representations of Boolean Functions by Perceptron Networks.
Czech Academy of Sciences Publication Activity Database
K?rková, V?ra
Prague : Institute of Computer Science AS CR, 2014 - (K?rková, V.; Bajer, L.; Peška, L.; Vojtáš, R.; Hole?a, M.; Nehéz, M.), s. 68-70 ISBN 978-80-87136-19-5. [ITAT 2014. European Conference on Information Technologies - Applications and Theory /14./. Demänovská dolina (SK), 25.09.2014-29.09.2014] R&D Projects: GA MŠk(CZ) LD13002 Institutional support: RVO:67985807 Keywords : perceptron network s * model complexity * Boolean functions Subject RIV: IN - Informatics, Computer Science
Finite size scaling of the Bayesian perceptron
Buhot, Arnaud; Torres Moreno, Juan-Manuel; Gordon, Mirta B.
1997-06-01
We study numerically the properties of the Bayesian perceptron through a gradient descent on the optimal cost function. The theoretical distribution of stabilities is deduced. It predicts that the optimal generalizer lies close to the boundary of the space of (error-free) solutions. The numerical simulations are in good agreement with the theoretical distribution. The extrapolation of the generalization error to infinite input space size agrees with the theoretical results. Finite size corrections are negative and exhibit two different scaling regimes, depending on the training set size. The variance of the generalization error vanishes for N-->? confirming the property of self-averaging.
Stochastic resonance in an intracellular genetic perceptron
Bates, Russell; Blyuss, Oleg; Zaikin, Alexey
2014-03-01
Intracellular genetic networks are more intelligent than was first assumed due to their ability to learn. One of the manifestations of this intelligence is the ability to learn associations of two stimuli within gene-regulating circuitry: Hebbian-type learning within the cellular life. However, gene expression is an intrinsically noisy process; hence, we investigate the effect of intrinsic and extrinsic noise on this kind of intracellular intelligence. We report a stochastic resonance in an intracellular associative genetic perceptron, a noise-induced phenomenon, which manifests itself in noise-induced increase of response in efficiency after the learning event under the conditions of optimal stochasticity.
The principles of artificial neural network information processing
International Nuclear Information System (INIS)
In this article, the basic structure of an artificial neuron is first introduced. In addition, principles of artificial neural network as well as several important artificial neural models such as Perceptron, Back propagation model, Hopfield net, and ART model are briefly discussed and analyzed. Finally, the application of artificial neural network for Chinese Character Recognition is also given. (author)
Artificial Neural Network Approach in Radar Target Classification
Directory of Open Access Journals (Sweden)
N. K. Ibrahim
2009-01-01
Full Text Available Problem statement: This study unveils the potential and utilization of Neural Network (NN in radar applications for target classification. The radar system under test is a special of it kinds and known as Forward Scattering Radar (FSR. In this study the target is a ground vehicle which is represented by typical public road transport. The features from raw radar signal were extracted manually prior to classification process using Neural Network (NN. Features given to the proposed network model are identified through radar theoretical analysis. Multi-Layer Perceptron (MLP back-propagation neural network trained with three back-propagation algorithm was implemented and analyzed. In NN classifier, the unknown target is sent to the network trained by the known targets to attain the accurate output. Approach: Two types of classifications were analyzed. The first one is to classify the exact type of vehicle, four vehicle types were selected. The second objective is to grouped vehicle into their categories. The proposed NN architecture is compared to the K Nearest Neighbor classifier and the performance is evaluated. Results: Based on the results, the proposed NN provides a higher percentage of successful classification than the KNN classifier. Conclusion/Recommendation: The result presented here show that NN can be effectively employed in radar classification applications.
Neural Network Based Lna Design for Mobile Satellite Receiver
Directory of Open Access Journals (Sweden)
Abhijeet Upadhya
2014-08-01
Full Text Available Paper presents a Neural Network Modelling approach to microwave LNA design. To acknowledge the specifications of the amplifier, Mobile Satellite Systems are analyzed. Scattering parameters of the LNA in the frequency range 0.5 to 18 GHz are calculated using a Multilayer Perceptron Artificial Neural Network model and corresponding smith charts and polar charts are plotted as output to the model. From these plots, the microwave scattering parameter description of the LNA are obtained. Model is efficiently trained using Agilent ATF 331M4 InGaAs/InP Low Noise pHEMT amplifier datasheet and the neural model’s output seem to follow the various device characteristic curves with high regression. Next, Maximum Allowable Gain and Noise figure of the device are modelled and plotted for the same frequency range. Finally, the optimized model is utilized as an interpolator and the resolution of the amplifying capability with noise characteristics are obtained for the L Band of MSS operation.
Scientific Electronic Library Online (English)
Mayra Luiza Marques da Silva, Binoti; Helio Garcia, Leite; Daniel Henrique Breda, Binoti; José Marinaldo, Gleriani.
2015-03-01
Full Text Available Objetivou-se, neste estudo, treinar, aplicar e avaliar a eficiência de redes neurais artificiais (RNA) para realizar a prognose da produção de povoamentos equiâneos de clones de eucalipto. Os dados utilizados foram provenientes de povoamentos localizados no sul da Bahia, totalizando cerca de 2.000 h [...] ectares de floresta. Foram utilizadas variáveis numéricas, como: idade, área basal, volume e variáveis categóricas, como classe de solo, textura, tipos de espaçamento, relevo, projeto e clone. Os dados foram divididos aleatoriamente em dois grupos: treinamento (80%) e generalização (20%). Foram treinadas redes de três tipos: perceptron, perceptron de múltiplas camadas e redes de função de base radial. As RNA que apresentaram os melhores desempenhos no treinamento e generalização foram selecionadas para realizar a prognose com dados, a partir do primeiro inventário florestal. Conclui-se que as RNA apresentaram resultados satisfatórios, comprovando o potencial e aplicabilidade da técnica na solução dos problemas de mensuração e manejo florestal. Abstract in english The objective of this study was to train, implement and evaluate the efficiency of artificial neural networks (ANN) to perform production prognosis of even-aged stands of eucalyptus clones. The data used were from plantations located in southern Bahia, totaling about 2,000 acres of forest. Numeric v [...] ariables, such as age, basal area, volume and categorical variables, such as soil class texture, spacing, land relief, project and clone were used. The data were randomly divided into two groups: training (80%) and generalization (20%). Three types of networks were trained: perceptron, multilayer perceptron networks and radial basis function. The RNA that showed the best performance in training and generalization were selected to perform the prognosis with data from the first forest inventory. We conclude that the RNA had satisfactory results, showing the potential and applicability of the technique in solving measurement and forest management problems.
Experimental characterization of the perceptron laser rangefinder
Kweon, I. S.; Hoffman, Regis; Krotkov, Eric
1991-01-01
In this report, we characterize experimentally a scanning laser rangefinder that employs active sensing to acquire three-dimensional images. We present experimental techniques applicable to a wide variety of laser scanners, and document the results of applying them to a device manufactured by Perceptron. Nominally, the sensor acquires data over a 60 deg x 60 deg field of view in 256 x 256 pixel images at 2 Hz. It digitizes both range and reflectance pixels to 12 bits, providing a maximum range of 40 m and a depth resolution of 1 cm. We present methods and results from experiments to measure geometric parameters including the field of view, angular scanning increments, and minimum sensing distance. We characterize qualitatively problems caused by implementation flaws, including internal reflections and range drift over time, and problems caused by inherent limitations of the rangefinding technology, including sensitivity to ambient light and surface material. We characterize statistically the precision and accuracy of the range measurements. We conclude that the performance of the Perceptron scanner does not compare favorably with the nominal performance, that scanner modifications are required, and that further experimentation must be conducted.
Chaotic diagonal recurrent neural network
International Nuclear Information System (INIS)
We propose a novel neural network based on a diagonal recurrent neural network and chaos, and its structure and learning algorithm are designed. The multilayer feedforward neural network, diagonal recurrent neural network, and chaotic diagonal recurrent neural network are used to approach the cubic symmetry map. The simulation results show that the approximation capability of the chaotic diagonal recurrent neural network is better than the other two neural networks. (interdisciplinary physics and related areas of science and technology)
Directory of Open Access Journals (Sweden)
G. Sánchez
2004-01-01
Full Text Available Este artículo propone una red neuronal de tipo perceptron multicapas (MLP que optimiza tanto su matriz de pesos como el número de neuronas ocultas. Inicialmente el sistema propuesto usa un número reducido de neuronas ocultas, optimizándose la matriz de pesos mediante un algoritmo de perturbación simultánea. Una vez que la red converge se analiza su funcionamiento y si este no es el esperado se agrega una neurona oculta. Este proceso se repite hasta obtener el funcionamiento deseado. Los resultados obtenidos muestran que el sistema propuesto presenta un funcionamiento muy similar al de un MLP convencional, cuando éste tiene un número óptimo de nodos en la capa oculta y disminuye la complejidad computacional durante la etapa de entrenamiento.This paper proposes a multilayer perceptron neural network (MLP which optimizes both the matrix weights and the numbers of hidden neurons. Initially, the proposed system uses a reduced number of hidden neurons, optimizing the matrix weights by using a simultaneous perturbation algorithm. Once the network converges, its function is analyzed and if this is not as expected, a hidden neuron is added. This process is repeated until achieving the desired functioning. The results obtained show that the proposed system functions similarly to that of a conventional MLP when this has an optimal number of nodes in the hidden layer, decreasing the computational complexity during the training step.
Scientific Electronic Library Online (English)
G., Sánchez; H., Pérez; M., Nakano.
Full Text Available Este artículo propone una red neuronal de tipo perceptron multicapas (MLP) que optimiza tanto su matriz de pesos como el número de neuronas ocultas. Inicialmente el sistema propuesto usa un número reducido de neuronas ocultas, optimizándose la matriz de pesos mediante un algoritmo de perturbación si [...] multánea. Una vez que la red converge se analiza su funcionamiento y si este no es el esperado se agrega una neurona oculta. Este proceso se repite hasta obtener el funcionamiento deseado. Los resultados obtenidos muestran que el sistema propuesto presenta un funcionamiento muy similar al de un MLP convencional, cuando éste tiene un número óptimo de nodos en la capa oculta y disminuye la complejidad computacional durante la etapa de entrenamiento. Abstract in english This paper proposes a multilayer perceptron neural network (MLP) which optimizes both the matrix weights and the numbers of hidden neurons. Initially, the proposed system uses a reduced number of hidden neurons, optimizing the matrix weights by using a simultaneous perturbation algorithm. Once the n [...] etwork converges, its function is analyzed and if this is not as expected, a hidden neuron is added. This process is repeated until achieving the desired functioning. The results obtained show that the proposed system functions similarly to that of a conventional MLP when this has an optimal number of nodes in the hidden layer, decreasing the computational complexity during the training step.
Vassiliadis, V S
2006-01-01
A novel algorithm for tunable compression to within the precision of reproduction targets, or storage, is proposed. The new algorithm is termed the `Perceptron Algorithm', which utilises simple existing concepts in a novel way, has multiple immediate commercial application aspects as well as it opens up a multitude of fronts in computational science and technology. The aims of this paper are to present the concepts underlying the algorithm, observations by its application to some example cases, and the identification of a multitude of potential areas of applications such as: image compression by orders of magnitude, signal compression including sound as well, image analysis in a multilayered detailed analysis, pattern recognition and matching and rapid database searching (e.g. face recognition), motion analysis, biomedical applications e.g. in MRI and CAT scan image analysis and compression, as well as hints on the link of these ideas to the way how biological memory might work leading to new points of view i...
Offline analysis of HEP events by ''dynamic perceptron'' neural network
International Nuclear Information System (INIS)
In this paper we start from a critical analysis of the fundamental problems of the parallel calculus in linear structures and of their extension to the partial solutions obtained with non-linear architectures. Then, we present shortly a new dynamic architecture able to solve the limitations of the previous architectures through an automatic re-definition of the topology. This architecture is applied to real-time recognition of particle tracks in high-energy accelerators. (orig.)
Directory of Open Access Journals (Sweden)
Boulbaba Ben Ammar
2013-09-01
Full Text Available This paper gives the definition of Transparent Neural Network “TNN” for the simulation of the global-local vision and its application to the segmentation of administrative document image. We have developed and have adapted a recognition method which models the contextual effects reported from studies in experimental psychology. Then, we evaluated and tested the TNN and the multi-layer perceptron “MLP”,which showed its effectiveness in the field of the recognition, in order to show that the TNN is clearer for the user and more powerful on the level of the recognition. Indeed, the TNN is the only system which makes it possible to recognize the document and its structure
Learning from correlated patterns by simple perceptrons
International Nuclear Information System (INIS)
Learning behavior of simple perceptrons is analyzed for a teacher-student scenario in which output labels are provided by a teacher network for a set of possibly correlated input patterns, and such that the teacher and student networks are of the same type. Our main concern is the effect of statistical correlations among the input patterns on learning performance. For this purpose, we extend to the teacher-student scenario a methodology for analyzing randomly labeled patterns recently developed in Shinzato and Kabashima 2008 J. Phys. A: Math. Theor. 41 324013. This methodology is used for analyzing situations in which orthogonality of the input patterns is enhanced in order to optimize the learning performance
Zaqoot, Hossam Adel; Ansari, Abdul Khalique; Unar, Mukhtiar Ali; Khan, Shaukat Hyat
2009-01-01
Artificial Neural Networks (ANNs) are flexible tools which are being used increasingly to predict and forecast water resources variables. The human activities in areas surrounding enclosed and semi-enclosed seas such as the Mediterranean Sea always produce in the long term a strong environmental impact in the form of coastal and marine degradation. The presence of dissolved oxygen is essential for the survival of most organisms in the water bodies. This paper is concerned with the use of ANNs - Multilayer Perceptron (MLP) and Radial Basis Function neural networks for predicting the next fortnight's dissolved oxygen concentrations in the Mediterranean Sea water along Gaza. MLP and Radial Basis Function (RBF) neural networks are trained and developed with reference to five important oceanographic variables including water temperature, wind velocity, turbidity, pH and conductivity. These variables are considered as inputs of the network. The data sets used in this study consist of four years and collected from nine locations along Gaza coast. The network performance has been tested with different data sets and the results show satisfactory performance. Prediction results prove that neural network approach has good adaptability and extensive applicability for modelling the dissolved oxygen in the Mediterranean Sea along Gaza. We hope that the established model will help in assisting the local authorities in developing plans and policies to reduce the pollution along Gaza coastal waters to acceptable levels. PMID:19955628
Foreground removal from WMAP 5 yr temperature maps using an MLP neural network
DEFF Research Database (Denmark)
NØrgaard-Nielsen, Hans Ulrik
2010-01-01
Aims. One of the main obstacles for extracting the cosmic microwave background (CMB) signal from observations in the mm/sub-mm range is the foreground contamination by emission from Galactic component: mainly synchrotron, free-free, and thermal dust emission. The statistical nature of the intrinsic CMB signal makes it essential to minimize the systematic errors in the CMB temperature determinations. Methods. The feasibility of using simple neural networks to extract the CMB signal from detailed simulated data has already been demonstrated. Here, simple neural networks are applied to the WMAP 5 yr temperature data without using any auxiliary data. Results. A simple multilayer perceptron neural network with two hidden layers provides temperature estimates over more than 75 per cent of the sky with random errors significantly below those previously extracted from these data. Also, the systematic errors, i.e. errors correlated with the Galactic foregrounds, are very small. Conclusions. With these results the neural network method is well prepared for dealing with the high-quality CMB data from the ESA Planck Surveyor satellite. © ESO, 2010.
Power prediction in mobile communication systems using an optimal neural-network structure.
Gao, X M; Gao, X Z; Tanskanen, J A; Ovaska, S J
1997-01-01
Presents a novel neural-network-based predictor for received power level prediction in direct sequence code division multiple access (DS/CDMA) systems. The predictor consists of an adaptive linear element (Adaline) followed by a multilayer perceptron (MLP). An important but difficult problem in designing such a cascade predictor is to determine the complexity of the networks. We solve this problem by using the predictive minimum description length (PMDL) principle to select the optimal numbers of input and hidden nodes. This approach results in a predictor with both good noise attenuation and excellent generalization capability. The optimized neural networks are used for predictive filtering of very noisy Rayleigh fading signals with 1.8 GHz carrier frequency. Our results show that the optimal neural predictor can provide smoothed in-phase and quadrature signals with signal-to-noise ratio (SNR) gains of about 12 and 7 dB at the urban mobile speeds of 5 and 50 km/h, respectively. The corresponding power signal SNR gains are about 11 and 5 dB. Therefore, the neural predictor is well suitable for power control applications where ldquodelaylessrdquo noise attenuation and efficient reduction of fast fading are required. PMID:18255746
Application of Artificial Neural Networks for Efficient High-Resolution 2D DOA Estimation
Directory of Open Access Journals (Sweden)
M. Agatonovi?
2012-12-01
Full Text Available A novel method to provide high-resolution Two-Dimensional Direction of Arrival (2D DOA estimation employing Artificial Neural Networks (ANNs is presented in this paper. The observed space is divided into azimuth and elevation sectors. Multilayer Perceptron (MLP neural networks are employed to detect the presence of a source in a sector while Radial Basis Function (RBF neural networks are utilized for DOA estimation. It is shown that a number of appropriately trained neural networks can be successfully used for the high-resolution DOA estimation of narrowband sources in both azimuth and elevation. The training time of each smaller network is significantly re¬duced as different training sets are used for networks in detection and estimation stage. By avoiding the spectral search, the proposed method is suitable for real-time ap¬plications as it provides DOA estimates in a matter of seconds. At the same time, it demonstrates the accuracy comparable to that of the super-resolution 2D MUSIC algorithm.
Use of Neural Networks for Damage Assessment in a Steel Mast
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1995-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorithm for detecting location and size of a damage in a civil engineering structure is investigated. The structure considered is a 20 m high steel lattice mast subjected to wind excitation. The basic idea is to train a neural network with simulated patterns of the relative changes in natural frequencies and corresponding sizes and locations of damages in order to recognize the behaviour of the damaged as well as the undamaged structure. Subjecting this trained neural network to measured values should imply information about damages states and locations. The training data are obtained by an FEM of the mast. Different damage scenarios are established by simulating a damage in one of the eight lower diagonals. The eight lower diagonals are cut and provided with bolted joints. Each bolted joint consists of 4 slice plates giving the possibilities of simulating a 1/4, 1/2, 3/4 and full reduction of the area of a diagonal. A damage is simulated by removing one or more splice plates in these bolted joints. The utility of the neural network approach is demonstrated by a simulation study as well as full-scale tests where the mast is identified by an ARMA-model. The results show that a neural network trained with simulated data is capable for detecting location of a damage in a steel lattice mast when the network is subjected to experimental data.·
Neural Networks and Photometric Redshifts
Tagliaferri, Roberto; Longo, Giuseppe; Andreon, Stefano; Capozziello, Salvatore; Donalek, Ciro; Giordano, Gerardo
2002-01-01
We present a neural network based approach to the determination of photometric redshift. The method was tested on the Sloan Digital Sky Survey Early Data Release (SDSS-EDR) reaching an accuracy comparable and, in some cases, better than SED template fitting techniques. Different neural networks architecture have been tested and the combination of a Multi Layer Perceptron with 1 hidden layer (22 neurons) operated in a Bayesian framework, with a Self Organizing Map used to est...
A Simple Perceptron that Learns Non-Monotonic Rules
Inoue, Jun-ichi; Nishimori, Hidetoshi; Kabashima, Yoshiyuki
1997-01-01
We investigate the generalization ability of a simple perceptron trained in the off-line and on-line supervised modes. Examples are extracted from the teacher who is a non-monotonic perceptron. For this system, difficulties of training can be controlled continuously by changing a parameter of the teacher. We train the student by several learning strategies in order to obtain the theoretical lower bounds of generalization errors under various conditions. Asymptotic behavior o...
Stability of the replica symmetric solution in diluted perceptron learning
Lage-castellanos, Alejandro; Pagnani, Andrea; Angulo, Gretel Quintero
2012-01-01
We study the role played by the dilution in the average behavior of a perceptron model with continuous coupling with the replica method. We analyze the stability of the replica symmetric solution as a function of the dilution field for the generalization and memorization problems. Thanks to a Gardner like stability analysis we show that at any fixed ratio $\\alpha$ between the number of patterns M and the dimension N of the perceptron ($\\alpha=M/N$), there exists a critical d...
The Projectron: a Bounded Kernel-Based Perceptron
Orabona, Francesco; Keshet, Joseph; Caputo, Barbara
2008-01-01
We present a discriminative online algorithm with a bounded memory growth, which is based on the kernel-based Perceptron. Generally, the required memory of the kernel-based Perceptron for storing the online hypothesis is not bounded. Previous work has been focused on discarding part of the instances in order to keep the memory bounded. In the proposed algorithm the instances are not discarded, but projected onto the space spanned by the previous online hypothesis. We derive a relative mistake...
An Efficient Rescaled Perceptron Algorithm for Conic Systems
Vempala, Santosh; Belloni, Alexandre; Freund, Robert Michael
2009-01-01
The classical perceptron algorithm is an elementary row-action/relaxation algorithm for solving a homogeneous linear inequality system Ax > 0. A natural condition measure associated with this algorithm is the Euclidean width {tau} of the cone of feasible solutions, and the iteration complexity of the perceptron algorithm is bounded by 1/{tau}2 [see Rosenblatt, F. 1962. Principles of Neurodynamics. Spartan Books, Washington, DC]. Dunagan and Vempala [Dunagan, J., S. Vempala. 2007. A simple pol...
Prediction of the local power factor in BWR fuel cells by means of a multilayer neural network
International Nuclear Information System (INIS)
To the beginning of a new operation cycle in a BWR reactor the reactivity of this it increases by means of the introduction of fresh fuel, the one denominated reload fuel. The problem of the definition of the characteristics of this reload fuel represents a combinatory optimization problem that requires significantly a great quantity of CPU time for their determination. This situation has motivated to study the possibility to substitute the Helios code, the one which is used to generate the new cells of the reload fuel parameters, by an artificial neuronal network, with the purpose of predicting the parameters of the fuel reload cell of a BWR reactor. In this work the results of the one training of a multilayer neuronal net that can predict the local power factor (LPPF) in such fuel cells are presented. The prediction of the LPPF is carried out in those condition of beginning of the life of the cell (0.0 MWD/T, to 40% of holes in the one moderator, temperature of 793 K in the fuel and a moderator temperature of 560 K. The cells considered in the present study consist of an arrangement of 10x10 bars, of those which 92 contains U235, some of these bars also contain a concentration of Gd2O3 and 8 of them contain only water. The axial location inside the one assembles of recharge of these cells it is exactly up of the cells that contain natural uranium in the base of the reactor core. The training of the neuronal net is carried out by meanof the neuronal net is carried out by means of a retro-propagation algorithm that uses a space of training formed starting from previous evaluations of cells by means of the Helios code. They are also presented the results of the application of the neuronal net found for the prediction of the LPPF of some cells used in the real operation of the Unit One of the Laguna Verde Nuclear Power station. (Author)
Jordan recurrent neural network versus IHACRES in modelling daily streamflows
Carcano, Elena Carla; Bartolini, Paolo; Muselli, Marco; Piroddi, Luigi
2008-12-01
SummaryA study of possible scenarios for modelling streamflow data from daily time series, using artificial neural networks (ANNs), is presented. Particular emphasis is devoted to the reconstruction of drought periods where water resource management and control are most critical. This paper considers two connectionist models: a feedforward multilayer perceptron (MLP) and a Jordan recurrent neural network (JNN), comparing network performance on real world data from two small catchments (192 and 69 km 2 in size) with irregular and torrential regimes. Several network configurations are tested to ensure a good combination of input features (rainfall and previous streamflow data) that capture the variability of the physical processes at work. Tapped delayed line (TDL) and memory effect techniques are introduced to recognize and reproduce temporal dependence. Results show a poor agreement when using TDL only, but a remarkable improvement can be obtained with JNN and its memory effect procedures, which are able to reproduce the system memory over a catchment in a more effective way. Furthermore, the IHACRES conceptual model, which relies on both rainfall and temperature input data, is introduced for comparative study. The results suggest that when good input data is unavailable, metric models perform better than conceptual ones and, in general, it is difficult to justify substantial conceptualization of complex processes.
An artificial neural network based matching metric for iris identification
Broussard, Randy P.; Kennell, Lauren R.; Ives, Robert W.; Rakvic, Ryan N.
2008-02-01
The iris is currently believed to be the most accurate biometric for human identification. The majority of fielded iris identification systems are based on the highly accurate wavelet-based Daugman algorithm. Another promising recognition algorithm by Ives et al uses Directional Energy features to create the iris template. Both algorithms use Hamming distance to compare a new template to a stored database. Hamming distance is an extremely fast computation, but weights all regions of the iris equally. Work from multiple authors has shown that different regions of the iris contain varying levels of discriminatory information. This research evaluates four post-processing similarity metrics for accuracy impacts on the Directional Energy and wavelets based algorithms. Each metric builds on the Hamming distance method in an attempt to use the template information in a more salient manner. A similarity metric extracted from the output stage of a feed-forward multi-layer perceptron artificial neural network demonstrated the most promise. Accuracy tables and ROC curves of tests performed on the publicly available Chinese Academy of Sciences Institute of Automation database show that the neural network based distance achieves greater accuracy than Hamming distance at every operating point, while adding less than one percent computational overhead.
Machine and component residual life estimation through the application of neural networks
International Nuclear Information System (INIS)
This paper concerns the use of neural networks for predicting the residual life of machines and components. In addition, the advantage of using condition-monitoring data to enhance the predictive capability of these neural networks was also investigated. A number of neural network variations were trained and tested with the data of two different reliability-related datasets. The first dataset represents the renewal case where the failed unit is repaired and restored to a good-as-new condition. Data were collected in the laboratory by subjecting a series of similar test pieces to fatigue loading with a hydraulic actuator. The average prediction error of the various neural networks being compared varied from 431 to 841 s on this dataset, where test pieces had a characteristic life of 8971 s. The second dataset were collected from a group of pumps used to circulate a water and magnetite solution within a plant. The data therefore originated from a repaired system affected by reliability degradation. When optimized, the multi-layer perceptron neural networks trained with the Levenberg-Marquardt algorithm and the general regression neural network produced a sum-of-squares error within 11.1% of each other for the renewal dataset. The small number of inputs and poorly mapped input space on the second dataset meant that much larger errors were recorded on some of the test data. The potential for using neural networks for residual life prediction and the advantage of incorpora prediction and the advantage of incorporating condition-based data into the model was nevertheless proven for both examples
Tarazona, José L; Guerrero, Jáder; Cabanzo, Rafael; Mejía-Ospino, E
2012-03-01
A predictive model to determine the concentration of nickel and vanadium in vacuum residues of Colombian crude oils using laser-induced breakdown spectroscopy (LIBS) and artificial neural networks (ANNs) with nodes distributed in multiple layers (multilayer perceptron) is presented. ANN inputs are intensity values in the vicinity of the emission lines 300.248, 301.200 and 305.081 nm of the Ni(I), and 309.310, 310.229, and 311.070 nm of the V(II). The effects of varying number of nodes and the initial weights and biases in the ANNs were systematically explored. Average relative error of calibration/prediction (REC/REP) and average relative standard deviation (RSD) metrics were used to evaluate the performance of the ANN in the prediction of concentrations of two elements studied here. PMID:22410907
Witte, H; Doering, A; Galicki, M; Dörschel, J; Krajca, V; Eiselt, M
1995-01-01
The main goal of this study is to demonstrate the possibility of training the Neural Network (multilayer perceptron) classifier and preprocessing units simultaneously, i.e., that properties of preprocessing are chosen automatically during the training phase. In the first realization step, adaptive recursive estimation of the power within a frequency band was used as a preprocessing unit. To improve the efficiency of special units, the power and momentary frequency estimation was replaced by methods that are based on adaptive Hilbert transformers. The strategy was developed to obtain optimized recognition units that can be efficiently integrated into strategies for monitoring the cerebral status of neonates. Therefore, applications (e.g., in neonatal EEG pattern recognition) will be shown. Additionally, a method of minimizing the error function was used, where this minimization is based on optimizing the network structure. The results of structure optimization in the field of EEG pattern recognition in epileptic patients can be demonstrated. PMID:8591340
Torrecilla, José S; García, Julián; Rojo, Ester; Rodríguez, Francisco
2009-05-15
Multiple linear regression (MLR), radial basis network (RB), and multilayer perceptron (MLP) neural network (NN) models have been explored for the estimation of toxicity of ammonium, imidazolium, morpholinium, phosphonium, piperidinium, pyridinium, pyrrolidinium and quinolinium ionic liquid salts in the Leukemia Rat Cell Line (IPC-81) and Acetylcholinesterase (AChE) using only their empirical formulas (elemental composition) and molecular weights. The toxicity values were estimated by means of decadic logarithms of the half maximal effective concentration (EC(50)) in microM (log(10)EC(50)). The model's performances were analyzed by statistical parameters, analysis of residuals and central tendency and statistical dispersion tests. The MLP model estimates the log(10)EC(50) in IPC-81 and AchE with a mean prediction error less than 2.2 and 3.8%, respectively. PMID:18805639
Directory of Open Access Journals (Sweden)
Bednyakov Dmitriy Andreevich
2012-11-01
Full Text Available The article is devoted to the simulation of the influence of environmental osmotic pressure on the changes of the level of ?-amylase activity of mucous tunic of the intestine of Russian sturgeon (Acipenser güldenstädtii Brandt. For the solving of this problem the apparatus of neural networks is used. The designed model can be classified as multilayer perceptrone and has rather transparent structure. The conformities of this influence are examined and the model with high approximating and generalizing properties is created. The conclusion about high availability of application of the approach in the studies of adaptations of the digestive system of aquatic organisms to the influence of environmental factors with some qualifications about used rate of exactness of the simulation is made.
Directory of Open Access Journals (Sweden)
Satish Kumar
2012-09-01
Full Text Available In this study, a method of artificial neural network applied for the solution of inverse kinematics of 2-link serial chain manipulator. The method is multilayer perceptrons neural network has applied. This unsupervised method learns the functional relationship between input (Cartesian space and output (joint space based on a localized adaptation of the mapping, by using the manipulator itself under joint control and adapting the solution based on a comparison between the resulting locations of the manipulator's end effectors in Cartesian space with the desired location. Even when a manipulator is not available; the approach is still valid if the forward kinematic equations are used as a model of the manipulator. The forward kinematic equations always have a unique solution, and the resulting Neural net can be used as a starting point for further refinement when the manipulator does become available. Artificial neural network especially MLP are used to learn the forward and the inverse kinematic equations of two degrees freedom robot arm. A set of some data sets were first generated as per the formula equation for this the input parameter X and Y coordinates in inches. Using these data sets was basis for the training and evaluation or testing the MLP model. Out of the sets data points, maximum were used as training data and some were used for testing for MLP. Backpropagation algorithm was used for training the network and for updating the desired weights. In this work epoch based training method was applied.
Selection of input parameters to model direct solar irradiance by using artificial neural networks
International Nuclear Information System (INIS)
A very important factor in the assessment of solar energy resources is the availability of direct irradiance data of high quality. However, this component of solar radiation is seldom measured and thus must be estimated from data of global solar irradiance, which is registered in most radiometric stations. In recent years, artificial neural networks (ANN) have shown to be a powerful tool for mapping complex and non-linear relationships. In this work, the Bayesian framework for ANN, named as automatic relevance determination method (ARD), was employed to obtain the relative relevance of a large set of atmospheric and radiometric variables used for estimating hourly direct solar irradiance. In addition, we analysed the viability of this novel technique applied to select the optimum input parameters to the neural network. For that, a multi-layer feedforward perceptron is trained on these data. The results reflect the relative importance of the inputs selected. Clearness index and relative air mass were found to be the more relevant input variables to the neural network, as it was expected, proving the reliability of the ARD method. Moreover, we show that this novel methodology can be used in unfavourable conditions, in terms of limited amount of available data, performing successful results
Identification and control of plasma vertical position using neural network in Damavand tokamak
Energy Technology Data Exchange (ETDEWEB)
Rasouli, H. [School of Plasma Physics and Nuclear Fusion, Institute of Nuclear Science and Technology, AEOI, P.O. Box 14155-1339, Tehran (Iran, Islamic Republic of); Advanced Process Automation and Control (APAC) Research Group, Faculty of Electrical Engineering, K.N. Toosi University of Technology, P.O. Box 16315-1355, Tehran (Iran, Islamic Republic of); Rasouli, C.; Koohi, A. [School of Plasma Physics and Nuclear Fusion, Institute of Nuclear Science and Technology, AEOI, P.O. Box 14155-1339, Tehran (Iran, Islamic Republic of)
2013-02-15
In this work, a nonlinear model is introduced to determine the vertical position of the plasma column in Damavand tokamak. Using this model as a simulator, a nonlinear neural network controller has been designed. In the first stage, the electronic drive and sensory circuits of Damavand tokamak are modified. These circuits can control the vertical position of the plasma column inside the vacuum vessel. Since the vertical position of plasma is an unstable parameter, a direct closed loop system identification algorithm is performed. In the second stage, a nonlinear model is identified for plasma vertical position, based on the multilayer perceptron (MLP) neural network (NN) structure. Estimation of simulator parameters has been performed by back-propagation error algorithm using Levenberg-Marquardt gradient descent optimization technique. The model is verified through simulation of the whole closed loop system using both simulator and actual plant in similar conditions. As the final stage, a MLP neural network controller is designed for simulator model. In the last step, online training is performed to tune the controller parameters. Simulation results justify using of the NN controller for the actual plant.
Velan, Vetri; Diallo, Ahmed; Leblanc, Benoit
2014-10-01
Neural networking analysis is implemented on NSTX Thomson scattering measurements in order to provide fast, real-time control of temperature and density profiles. Raw voltages from an array of 30 radially-variant polychrometers are transformed into Te and Ne measurements by using a multi-layer perceptron approach. The neural net, designed with the Torch7 package, is trained on Thomson Scattering data taken between 2008 and 2011, and tested on different data taken during the same period. The net can be modified by changing the number of hidden layers, the optimization procedure used, the size of each epoch, or the batch size (in the case of batch optimization methods); different permutations of these are tested to optimize accuracy and computation time. If the analysis succeeds, the next step is to use it on 2012 data, which contains an array of 42 polychrometers, to predict temperatures and densities and compare them to actual calculations. Furthermore, the analysis's success will motivate inclusion of the neural net into the NSTX-Upgrade, so that electron temperatures and densities can be extracted in real time. This work was done as part of the National Undergraduate Fellowship, sponsored by the US Department of Energy.
Modeling soil temperatures at different depths by using three different neural computing techniques
Kisi, Ozgur; Tombul, Mustafa; Kermani, Mohammad Zounemat
2014-08-01
This study compares the accuracy of three different neural computing techniques, multi-layer perceptron (MLP), radial basis neural networks (RBNN), and generalized regression neural networks (GRNN), in modeling soil temperatures (ST) at different depths. Climatic data of air temperature, wind speed, solar radiation, and relative humidity from Mersin Station, Turkey, were used as inputs to the models to estimate monthly ST values. In the first part of the study, the effect of each climatic variable on ST was investigated by using GRNN models. Air temperature was found to be the most effective variable in modeling monthly ST. In the second part of the study, the accuracy of GRNN models was compared with MLP, RBNN, and multiple linear regression (MLR) models. RBNN models were found to be better than the GRNN, MLP, and MLR models in estimating monthly ST at the depths of 5 and 10 cm while the MLR and GRNN models gave the best accuracy in the case of 50- and 100-cm depths, respectively. In the third part of the study, the effect of periodicity on the training, validation, and test accuracy of the applied models was investigated. The results indicated that the adding periodicity component significantly increase models' accuracies in estimating monthly ST at different depths. Root mean square errors of the GRNN, MLP, RBNN, and MLR models were decreased by 19, 15, 19, and 15 % using periodicity in estimating monthly ST at 5-cm depth.
Directory of Open Access Journals (Sweden)
Epping W. J. M.
2006-11-01
Full Text Available Neural networks with the multi-layered perceptron architecture were trained on an autoassociation task to compress 2D seismic data. Networks with linear transfer functions outperformed nonlinear neural nets with single or multiple hidden layers. This indicates that the correlational structure of the seismic data is predominantly linear. A compression factor of 5 to 7 can be achieved if a reconstruction error of 10% is allowed. The performance on new test data was similar to that achieved with the training data. The hidden units developed feature-detecting properties that resemble oriented line, edge and more complex feature detectors. The feature detectors of linear neural nets are near-orthogonal rotations of the principal eigenvectors of the Karhunen-Loève transformation. Des réseaux neuronaux à architecture de perceptron multicouches ont été expérimentés en auto-association pour permettre la compression de données sismiques bidimensionnelles. Les réseaux neuronaux à fonctions de transfert linéaires s'avèrent plus performants que les réseaux neuronaux non linéaires, à une ou plusieurs couches cachées. Ceci indique que la structure corrélative des données sismiques est à prédominance linéaire. Un facteur de compression de 5 à 7 peut être obtenu si une erreur de reconstruction de 10 % est admise. La performance sur les données de test est très proche de celle obtenue sur les données d'apprentissage. Les unités cachées développent des propriétés de détection de caractéristiques ressemblant à des détecteurs de lignes orientées, de bords et de figures plus complexes. Les détecteurs de caractéristique des réseaux neuronaux linéaires sont des rotations quasi orthogonales des vecteurs propres principaux de la transformation de Karhunen-Loève.
Neural network based method for conversion of solar radiation data
International Nuclear Information System (INIS)
Highlights: ? Generalized regression neural network is used to predict the solar radiation on tilted surfaces. ? The above network, amongst many such as multilayer perceptron, is the most successful one. ? The present neural network returns a relative mean absolute error value of 9.1%. ? The present model leads to a mean absolute error value of estimate of 14.9 Wh/m2. - Abstract: The receiving ends of the solar energy conversion systems that generate heat or electricity from radiation is usually tilted at an optimum angle to increase the solar incident on the surface. Solar irradiation data measured on horizontal surfaces is readily available for many locations where such solar energy conversion systems are installed. Various equations have been developed to convert solar irradiation data measured on horizontal surface to that on tilted one. These equations constitute the conventional approach. In this article, an alternative approach, generalized regression type of neural network, is used to predict the solar irradiation on tilted surfaces, using the minimum number of variables involved in the physical process, namely the global solar irradiation on horizontal surface, declination and hour angles. Artificial neural networks have been successfully used in recent years for optimization, prediction and modeling in energy systems as alternative to conventional modeling approaches. To show the merit of the presently developed neural network, the solar irradiation data predicted from the novel model was compared to that from the conventional approach (isotropic and anisotropic models), with strict reference to the irradiation data measured in the same location. The present neural network model was found to provide closer solar irradiation values to the measured than the conventional approach, with a mean absolute error value of 14.9 Wh/m2. The other statistical values of coefficient of determination and relative mean absolute error also indicate the advantage of the neural network approach over the conventional one. In terms of the coefficient of determination, the neural network model results in a value of 0.987 whereas the isotropic and anisotropic approaches result in values of 0.959 and 0.966, respectively. On the other hand, the isotropic and anisotropic approaches give relative mean absolute error values of 11.4% and 11.5%, respectively, while that of the neural network model is 9.1%
Tagging b quark events in ALEPH with neural networks
International Nuclear Information System (INIS)
Comparison of different methods to tag b quark events are presented: multilayered perceptron (MLP), Learning Vector Quantization (LVQ), discriminant analysis, combination of any two of the above methods. The sample events come from the ALEPH Monte Carlo and data, from the 1990 ALEPH runs. (authors) 12 refs., 16 figs., 5 tabs
?/?0 separation in shower maximum detector using neural network algorithm
International Nuclear Information System (INIS)
Procedure of gamma/pion neutral separation based on a multilayered perceptron algorithm are presented. Recognition capacities of these procedures and one of the CDF separation methods have been examined. The procedure were tested with the simulated data from one EMC+SMD tower of the STAR experiment. 10 refs., 1 tab., 9 figs
Data acquisition in modeling using neural networks and decision trees
Directory of Open Access Journals (Sweden)
R. Sika
2011-04-01
Full Text Available The paper presents a comparison of selected models from area of artificial neural networks and decision trees in relation with actualconditions of foundry processes. The work contains short descriptions of used algorithms, their destination and method of data preparation,which is a domain of work of Data Mining systems. First part concerns data acquisition realized in selected iron foundry, indicating problems to solve in aspect of casting process modeling. Second part is a comparison of selected algorithms: a decision tree and artificial neural network, that is CART (Classification And Regression Trees and BP (Backpropagation in MLP (Multilayer Perceptron networks algorithms.Aim of the paper is to show an aspect of selecting data for modeling, cleaning it and reducing, for example due to too strong correlationbetween some of recorded process parameters. Also, it has been shown what results can be obtained using two different approaches:first when modeling using available commercial software, for example Statistica, second when modeling step by step using Excel spreadsheetbasing on the same algorithm, like BP-MLP. Discrepancy of results obtained from these two approaches originates from a priorimade assumptions. Mentioned earlier Statistica universal software package, when used without awareness of relations of technologicalparameters, i.e. without user having experience in foundry and without scheduling ranks of particular parameters basing on acquisition, can not give credible basis to predict the quality of the castings. Also, a decisive influence of data acquisition method has been clearly indicated, the acquisition should be conducted according to repetitive measurement and control procedures. This paper is based on about 250 records of actual data, for one assortment for 6 month period, where only 12 data sets were complete (including two that were used for validation of neural network and useful for creating a model. It is definitely too small portion in case of artificial neural networks, but it shows a scale of danger of unprofessional data acquisition.
Parameter Genetic Learning of Perceptron Networks.
Czech Academy of Sciences Publication Activity Database
Neruda, Roman; Slušný, Stanislav
2006-01-01
Ro?. 5, ?. 10 (2006), s. 2285-2290. ISSN 1109-2777 R&D Projects: GA ?R GA201/05/0557 Institutional research plan: CEZ:AV0Z10300504 Keywords : neural networks * genetic algorithms * learning * hybrid methods Subject RIV: IN - Informatics, Computer Science
Stability of the replica symmetric solution in diluted perceptron learning
International Nuclear Information System (INIS)
We study the role played by dilution in the average behavior of a perceptron model with continuous coupling with the replica method. We analyze the stability of the replica symmetric solution as a function of the dilution field for the generalization and memorization problems. Thanks to a Gardner-like stability analysis we show that at any fixed ratio ? between the number of patterns M and the dimension N of the perceptron (? = M/N), there exists a critical dilution field hc above which the replica symmetric ansatz becomes unstable. (letter)
Some Properties of the Assembly Neural Networks.
Czech Academy of Sciences Publication Activity Database
Húsek, Dušan; Goltsev, A.
2002-01-01
Ro?. 12, ?. 1 (2002), s. 15-32. ISSN 1210-0552 R&D Projects: GA MŠk LN00B096 Keywords : neuron * neural assembly * neuural column subnetwork * generalization * recognition * perceptron * the nearest-neighbor method Subject RIV: BA - General Mathematics
An Integral Formula for Heaviside Neural Networks.
Czech Academy of Sciences Publication Activity Database
Kainen, P.C.; K?rková, V?ra; Vogt, A.
2000-01-01
Ro?. 10, ?. 3 (2000), s. 313-319. ISSN 1210-0552. [Neural Network World 2000. Prague, 09.07.2000-12.07.2000] R&D Projects: GA ?R GA201/99/0092 Institutional research plan: AV0Z1030915 Keywords : feedforward neural network * one-hidden-layer network * Heaviside function * plane wave * integral formula * numerical quadrature * Laplacian * Green's function * perceptron Subject RIV: BA - General Mathematics
Neural network-based movie dialogue detection
Kotti, M.; Benetos, E; Kotropoulos, C.
2010-01-01
A novel framework for dialogue detection in movies, using indicator functions, is investigated. An indicator function determines if an actor is present at a particular time instant. The cross-correlation function of a pair of indicator functions and its related cross-power spectral density are applied as inputs to neural networks. Several types of neural networks are employed to test the feasibility of the proposed framework, such as perceptrons, radial-basis function networks, and support ve...
Crash Introduction to Artificial Neural Networks
Galkin, Ivan
The Crash Introduction to Artificial Neural Networks is not a comprehensive resource, but it provides a good overview of many aspects of the topic. Beginning with a discussion of biological processes in the brain, the site describes the function of neurons and how they are interconnected. Some historical events are mentioned, leading to the development of an artificial neural network. The famous perceptron configuration is the basis of subsequent discussions of training algorithms, prediction and classification functions, and data processing.
Training a perceptron by a bit sequence: Storage capacity
Schroeder, M.; Kinzel, W.; Kanter, I.
1996-01-01
A perceptron is trained by a random bit sequence. In comparison to the corresponding classification problem, the storage capacity decreases to alpha_c=1.70\\pm 0.02 due to correlations between input and output bits. The numerical results are supported by a signal to noise analysis of Hebbian weights.
Breaking a chaotic image encryption algorithm based on perceptron model
Zhang, Yu; Li, Chengqing; Li, Qin; Zhang, Dan; Shu, Shi
2011-01-01
Recently, a chaotic image encryption algorithm based on perceptron model was proposed. The present paper analyzes security of the algorithm and finds that the equivalent secret key can be reconstructed with only one pair of known-plaintext/ciphertext, which is supported by both mathematical proof and experiment results. In addition, some other security defects are also reported.
Directory of Open Access Journals (Sweden)
R. Rezae Arshad
2012-07-01
Full Text Available Direct measurement of soil hydraulic characteristics is costly and time-consuming. Also, the method is partly unreliable due to soil heterogeneity and laboratory errors. Instead, soil hydraulic characteristics can be predicted using readily available data such as soil texture and bulk density using pedotransfer functions (PTFs. Artificial neural networks (ANNs and statistical regression are two methods which are used to develop PTFs. In this study, the multi-layer perceptron (MLP neural network and backward and stepwise regression models were used to estimate saturated hydraulic conductivity using some soil characteristics including the percentage of particle size distribution, porosity, and bulk density. Data of 125 soil profiles were collected from the reports of basic soil science and land reclamation studies conducted by Khuzestan Water and Power Organization. The results showed that MLP neural network having Bayesian training algorithm with the greater coefficient of determination (R2=0.65 and the lower error (RMSE =0.04 had better performance than multiple linear regression model in predicting saturated hydraulic conductivity.
Amani, Tahat; Jordi, Marti; Ali, Khwaldeh; Kaher, Tahat
2014-04-01
In computational physics proton transfer phenomena could be viewed as pattern classification problems based on a set of input features allowing classification of the proton motion into two categories: transfer ‘occurred’ and transfer ‘not occurred’. The goal of this paper is to evaluate the use of artificial neural networks in the classification of proton transfer events, based on the feed-forward back propagation neural network, used as a classifier to distinguish between the two transfer cases. In this paper, we use a new developed data mining and pattern recognition tool for automating, controlling, and drawing charts of the output data of an Empirical Valence Bond existing code. The study analyzes the need for pattern recognition in aqueous proton transfer processes and how the learning approach in error back propagation (multilayer perceptron algorithms) could be satisfactorily employed in the present case. We present a tool for pattern recognition and validate the code including a real physical case study. The results of applying the artificial neural networks methodology to crowd patterns based upon selected physical properties (e.g., temperature, density) show the abilities of the network to learn proton transfer patterns corresponding to properties of the aqueous environments, which is in turn proved to be fully compatible with previous proton transfer studies.
Comments on "Quantum M-P Neural Network"
da Silva, Adenilton J.; de Oliveira, Wilson R.; Ludermir, Teresa B.
2015-06-01
In a paper on quantum neural networks, Zhou and Ding (Int. J. Theor. Phys. 46(12):3209-3215 ([2007])) proposed a new model of quantum perceptron denoted quantum M-P neural network and showed its functionality by an example. In this letter, we show that the proposed learning algorithm does not follow an unitary evolution and the proposed neuron can be efficiently simulated by a classical single layer neural network.
Scientific Electronic Library Online (English)
Francisco Javier, Cuevas de la Rosa; Manuel, Servin Guirado.
2004-06-01
Full Text Available En este trabajo se presenta la aplicación de redes neuronales (RNs) en la reconstrucción tridimensional de objetos y su utilización en tareas de calibración en sistemas de proyección de luz estructurada. En una primer propuesta, se establece una red neuronal que utiliza funciones de base radial (RNF [...] BR) útil para calibrar un sistema de proyección de franjas. En este caso la RNFBR es modelada para ajustar la información de fase, obtenida de los imágenes de franjas a mediciones físicas reales. Se propone una segunda técnica que utiliza una red neuronal multicapas de perceptrones (RNMP) para la recuperación de fase y profundidad a partir de los patrones de franjas. En esta técnica se utiliza una ventana de análisis conteniendo subimágenes de los patrones de franjas. Esta subimagen es utilizada como entrada de la RNMP, obteniendo como salida las mediciones de los gradientes de fase o profundidad. Se presentan experimentos que aplican las técnicas propuestas para medir un objeto real. Abstract in english In this work the application of neural networks (NNs) in tridimensional object depth recovery and structured light projection system calibration tasks is presented. In a first approach, a NN using radial basis functions (RBFNN) is proposed to carry out fringe projection system calibration. In this c [...] ase the RBFNN is modeled to fit the phase information (obtained from fringe images) to the real physical measurements. In a second approach, a Multilayer Perceptron Neural Network (MPNN) is applied to phase and depth recovery from the fringe patterns. A scanning window is used as the MPNN input and the phase or depth gradient measurements is obtained at the MPNN output. Experiments considering real object depth measurement are presented.
Neural network diagnostic system for dengue patients risk classification.
Faisal, Tarig; Taib, Mohd Nasir; Ibrahim, Fatimah
2012-04-01
With the dramatic increase of the worldwide threat of dengue disease, it has been very crucial to correctly diagnose the dengue patients in order to decrease the disease severity. However, it has been a great challenge for the physicians to identify the level of risk in dengue patients due to overlapping of the medical classification criteria. Therefore, this study aims to construct a noninvasive diagnostic system to assist the physicians for classifying the risk in dengue patients. Systematic producers have been followed to develop the system. Firstly, the assessment of the significant predictors associated with the level of risk in dengue patients was carried out utilizing the statistical analyses technique. Secondly, Multilayer perceptron neural network models trained via Levenberg-Marquardt and Scaled Conjugate Gradient algorithms was employed for constructing the diagnostic system. Finally, precise tuning for the models' parameters was conducted in order to achieve the optimal performance. As a result, 9 noninvasive predictors were found to be significantly associated with the level of risk in dengue patients. By employing those predictors, 75% prediction accuracy has been achieved for classifying the risk in dengue patients using Scaled Conjugate Gradient algorithm while 70.7% prediction accuracy were achieved by using Levenberg-Marquardt algorithm. PMID:20703665
Energy demand estimation of South Korea using artificial neural network
International Nuclear Information System (INIS)
Because South Korea's industries depend heavily on imported energy sources (fifth largest importer of oil and second largest importer of liquefied natural gas in the world), the accurate estimating of its energy demand is critical in energy policy-making. This research proposes an artificial neural network model (a structure with feed-forward multilayer perceptron, error back-propagation algorithm, momentum process, and scaled data) to efficiently estimate the energy demand for South Korea. The model has four independent variables, such as gross domestic product (GDP), population, import, and export amounts. The data are obtained from diverse local and international sources. The proposed model better estimated energy demand than a linear regression model (a structure with multiple linear variables and least square method) or an exponential model (a structure with mixed integer variables, branch and bound method, and Broyden-Fletcher-Goldfarb-Shanno (BFGS) method) in terms of root mean squared error (RMSE). The model also forecasted better than the other two models in terms of RMSE without any over-fitting problem. Further testing with four scenarios based upon reliable source data showed unanticipated results. Instead of growing permanently, the energy demands peaked at certain points, and then decreased gradually. This trend is quite different from the results by regression or exponential model.
AN APPLICATION OF SPEAKER RECOGNITION USING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Murat CANER
2006-02-01
Full Text Available In this study an artificial neural network (ANN is implemented, which has been used frequently as an implementation model in recent years, to recognize speaker identification. Generally, recognition is consist of three stages that, processing of signal, obtaining attributes and comparing them. Speech samples are transformed into digital data according to voice card of PC. In the analysis of voice stage, recurrent periods and white noise of voice data are trimmed by hamming window method and voice attribute part of the digital data is obtained. For obtaining attribute of voice data LPC (linear predictive coding and DFT (discrete fourier transform methods are used. Of those 28 coefficents, that is used for speaker recognition, 16 were obtained by the analysis of DFT and 12 were obtained by the analysis of LPC. The parameters that represent speaker voice, is used for training and test of ANN. Multilayer perceptron model is used as an architecture of ANN and backpropagation algorithm is used for training method. Voices of "a" is taken from 7 different person and their attributes are found. ANN is trained with these features to find the speaker who is the owner of the sample voice. And then using the test data that is not used for training part, recognition achievement of ANN is tested. As a result, good results were obtained with low failure rate.
Monthly monsoon rainfall forecasting using artificial neural networks
Ganti, Ravikumar
2014-10-01
Indian agriculture sector heavily depends on monsoon rainfall for successful harvesting. In the past, prediction of rainfall was mainly performed using regression models, which provide reasonable accuracy in the modelling and forecasting of complex physical systems. Recently, Artificial Neural Networks (ANNs) have been proposed as efficient tools for modelling and forecasting. A feed-forward multi-layer perceptron type of ANN architecture trained using the popular back-propagation algorithm was employed in this study. Other techniques investigated for modeling monthly monsoon rainfall include linear and non-linear regression models for comparison purposes. The data employed in this study include monthly rainfall and monthly average of the daily maximum temperature in the North Central region in India. Specifically, four regression models and two ANN model's were developed. The performance of various models was evaluated using a wide variety of standard statistical parameters and scatter plots. The results obtained in this study for forecasting monsoon rainfalls using ANNs have been encouraging. India's economy and agricultural activities can be effectively managed with the help of the availability of the accurate monsoon rainfall forecasts.
Retinal vessel extraction using Lattice Neural Networks with Dendritic Processing.
Vega, Roberto; Sanchez-Ante, Gildardo; Falcon-Morales, Luis E; Sossa, Humberto; Guevara, Elizabeth
2015-03-01
Retinal images can be used to detect and follow up several important chronic diseases. The classification of retinal images requires an experienced ophthalmologist. This has been a bottleneck to implement routine screenings performed by general physicians. It has been proposed to create automated systems that can perform such task with little intervention from humans, with partial success. In this work, we report advances in such endeavor, by using a Lattice Neural Network with Dendritic Processing (LNNDP). We report results using several metrics, and compare against well known methods such as Support Vector Machines (SVM) and Multilayer Perceptrons (MLP). Our proposal shows better performance than other approaches reported in the literature. An additional advantage is that unlike those other tools, LNNDP requires no parameters, and it automatically constructs its structure to solve a particular problem. The proposed methodology requires four steps: (1) Pre-processing, (2) Feature computation, (3) Classification and (4) Post-processing. The Hotelling T(2) control chart was used to reduce the dimensionality of the feature vector, from 7 that were used before to 5 in this work. The experiments were run on images of DRIVE and STARE databases. The results show that on average, F1-Score is better in LNNDP, compared with SVM and MLP implementations. Same improvement is observed for MCC and the accuracy. PMID:25589415
Presenting an Appropriate Neural Network for Optimal Mix Design of Roller Compacted Concrete Dams
Directory of Open Access Journals (Sweden)
Taha Mehmannavaz
2014-03-01
Full Text Available In general, one of the main targets to achieve the optimal mix design of concrete dams is to reduce the amount of cement, heat of hydration, increasing the size of aggregate (coarse and reduced the permeability. Thus, one of the methods which is used in construction of concrete and soil dams as a suitable replacement is construction of dams in roller compacted concrete method. Spending fewer budgets, using road building machinery, short time of construction and continuation of construction all are the specifications of this construction method, which have caused priority of these two methods and finally this method has been known as a suitable replacement for constructing dams in different parts of the world. On the other hand, expansion of the materials used in this type of concrete, complexity of its mix design, effect of different parameters on its mix design and also finding relations between different parameters of its mix design have necessitated the presentation of a model for roller compacted concretemix design. Artificial neural networks are one of the modeling methods which have shown very high power for adjustment to engineering problems. A kind of these networks, called Multi-Layer Perceptron (MLP neural networks, was used as the main core of modeling in this study along with error-back propagation training algorithm, which is mostly applied in modeling mapping behaviors.
Predicting neutron diffusion eigenvalues with a query-based adaptive neural architecture.
Lysenko, M G; Wong, H I; Maldonado, G I
1999-01-01
A query-based approach for adaptively retraining and restructuring a two-hidden-layer artificial neural network (ANN) has been developed for the speedy prediction of the fundamental mode eigenvalue of the neutron diffusion equation, a standard nuclear reactor core design calculation which normally requires the iterative solution of a large-scale system of nonlinear partial differential equations (PDE's). The approach developed focuses primarily upon the adaptive selection of training and cross-validation data and on artificial neural-network (ANN) architecture adjustments, with the objective of improving the accuracy and generalization properties of ANN-based neutron diffusion eigenvalue predictions. For illustration, the performance of a "bare bones" feedforward multilayer perceptron (MLP) is upgraded through a variety of techniques; namely, nonrandom initial training set selection, adjoint function input weighting, teacher-student membership and equivalence queries for generation of appropriate training data, and a dynamic node architecture (DNA) implementation. The global methodology is flexible in that it can "wrap around" any specific training algorithm selected for the static calculations (i.e., training iterations with a fixed training set and architecture). Finally, the improvements obtained are carefully contrasted against past works reported in the literature. PMID:18252578
Artificial neural networks for simulating wind effects on sprinkler distribution patterns
Energy Technology Data Exchange (ETDEWEB)
Sayyadi, H.; Sadraddini, A. A.; Farsadi Zadeh, D.; Montero, J.
2012-07-01
A new approach based on Artificial Neural Networks (ANNs) is presented to simulate the effects of wind on the distribution pattern of a single sprinkler under a center pivot or block irrigation system. Field experiments were performed under various wind conditions (speed and direction). An experimental data from different distribution patterns using a Nelson R3000 Rotator sprinkler have been split into three and used for model training, validation and testing. Parameters affecting the distribution pattern were defined. To find an optimal structure, various networks with different architectures have been trained using an Early Stopping method. The selected structure produced R2 0.929 and RMSE = 6.69 mL for the test subset, consisting of a Multi-Layer Perceptron (MLP) neural network with a backpropagation training algorithm; two hidden layers (twenty neurons in the first hidden layer and six neurons in the second hidden layer) and a tangent-sigmoid transfer function. This optimal network was implemented in MATLAB to develop a model termed ISSP (Intelligent Simulator of Sprinkler Pattern). ISSP uses wind speed and direction as input variables and is able to simulate the distorted distribution pattern from a R3000 Rotator sprinkler with reasonable accuracy (R{sup 2} > 0.935). Results of model evaluation confirm the accuracy and robustness of ANNs for simulation of a single sprinkler distribution pattern under real field conditions. (Author) 41 refs.
Creep Crack Growth Modeling of Low Alloy Steel using Artificial Neural Network
Directory of Open Access Journals (Sweden)
F. Djavanroodi
2013-07-01
Full Text Available Prediction of crack growth under creep condition is prime requirement in order to avoid costly and time-consuming creep crack growth tests. To predict, in a reliable way, the growth of a major crack in a structural components operating at high temperatures, requires a fracture mechanics based approach. In this Study a novel technique, which uses Finite Element Method (FEM together with Artificial Neural Networks (ANN has been developed to predict the fracture mechanics parameter (C* in a 1%Cr1%MoV low alloy rotor steel under wide range of loading and temperatures. After confirming the validity of the FEM model with experimental data, a collection of numerical and experimental data has been used for training the various neural networks models. Three networks have been used to simulate the process, the perceptron multilayer network with tangent transfer function that uses 9 neurons in the hidden layer, gives the best results. Finally, for validation three case studies at 538°C, 550°C and 594°C temperatures are employed. The proposed model has proved that a combinations of ANN and FEM simulation performs well in estimation of C* and it is a powerful designing tool for creep crack growth characterization.
Foreground removal from CMB temperature maps using an MLP neural network
DEFF Research Database (Denmark)
NØrgaard-Nielsen, Hans Ulrik; JØrgensen, H.E.
2008-01-01
One of the main obstacles for extracting the Cosmic Microwave Background (CMB) signal from observations in the mm-submm range is the foreground contamination by emission from Galactic components: mainly synchrotron, free-free and thermal dust emission. Due to the statistical nature of the intrinsic CMB signal it is essential to minimize the systematic errors in the CMB temperature determinations. Following the available knowledge of the spectral behavior of the Galactic foregrounds simple power law-like spectra have been assumed. The feasibility of using a simple neural network for extracting the CMB temperature signal from the combined signal CMB and the foregrounds has been investigated. As a specific example, we have analysed simulated data, as expected from the ESA Planck CMB mission. A simple multilayer perceptron neural network with 2 hidden layers can provide temperature estimates over more than 80 per cent of the sky that are to a high degree uncorrelated with the foreground signals. A single network will be able to cover the dynamic range of the Planck noise level over the entire sky.
International Nuclear Information System (INIS)
A nuclear power plant's (NPP's) status is usually monitored by a human operator. Any classifier system used to enhance the operator's capability to diagnose a safety-critical system like an NPP should classify a novel transient as ''don't-know'' if it is not contained within its accumulated knowledge base. In particular, the classifier needs some kind of proximity measure between the new data and its training set. Artificial neural networks have been proposed as NPP classifiers, the most popular ones being the multilayered perceptron (MLP) type. However, MLPs do not have a proximity measure, while learning vector quantization, probabilistic neural networks (PNNs), and some others do. This proximity measure may also serve as an explanation to the classifier's decision in the way that case-based-reasoning expert systems do. The capability of a PNN network as a classifier is demonstrated using simulator data for the three-loop 436-MW(electric) Westinghouse San Onofre unit 1 pressurized water reactor. A transient's classification history is used in an ''evidence accumulation'' technique to enhance a classifier's accuracy as well as its consistency
On-line control of the COMPASS-D tokamak using a neural network
International Nuclear Information System (INIS)
Multi-layer perceptron (MLP) networks are particularly appropriate for performing rapid non-linear mapping. In the application discussed in this Paper the position and shape of the plasma within the experimental fusion research tokamak COMPASS-D at UKAEA's Culham Laboratory is determined from a series of magnetic sensors placed around the vacuum vessel, close to the plasma boundary. By using a real-time analogue neural network it is possible to achieve control within a sub-millisecond time-scale. In this application the neural network is needed to solve an inverse problem. Numerical codes exist that are able to calculate the signals expected on the magnetic sensors for a given plasma position and profile. The problem is well defined from the solution of the Grad-Shafranov equation. However, no easy analytical formalism exists to reverse the problem - to calculate the plasma parameters given the magnetic signals. It is this mapping, from the set of magnetic diagnostic input signals to the parameters of the plasma, that an MLP network can be trained to solve. The training data are some 2000 example plasma equilibria, covering the likely possible configurations of the plasma, solved by numerical methods. The desired aim, to control the plasma boundary position to within a few millimetres, has now been achieved. (author)
Valous, Nektarios A; Mendoza, Fernando; Sun, Da-Wen; Allen, Paul
2010-03-01
The quaternionic singular value decomposition is a technique to decompose a quaternion matrix (representation of a colour image) into quaternion singular vector and singular value component matrices exposing useful properties. The objective of this study was to use a small portion of uncorrelated singular values, as robust features for the classification of sliced pork ham images, using a supervised artificial neural network classifier. Images were acquired from four qualities of sliced cooked pork ham typically consumed in Ireland (90 slices per quality), having similar appearances. Mahalanobis distances and Pearson product moment correlations were used for feature selection. Six highly discriminating features were used as input to train the neural network. An adaptive feedforward multilayer perceptron classifier was employed to obtain a suitable mapping from the input dataset. The overall correct classification performance for the training, validation and test set were 90.3%, 94.4%, and 86.1%, respectively. The results confirm that the classification performance was satisfactory. Extracting the most informative features led to the recognition of a set of different but visually quite similar textural patterns based on quaternionic singular values. PMID:20374805
International Nuclear Information System (INIS)
An artificial neural network model was developed for modeling of the effects of mechanical alloying parameters including milling time, milling speed and ball to powder weight ratio on the characteristics of Al-8 vol%SiC nanocomposite powders. The crystallite size and lattice strain of the aluminum matrix were considered for modeling. This nanostructured nanocomposite powder was synthesized by utilizing planetary high energy ball mill and the required data for training were collected from the experimental results. The characteristics of the particles were determined by X-ray diffraction, scanning and transmission electron microscopy. Two types of neural network architecture, i.e. multi-layer perceptron (MLP) and radial basis function (RBF), were used. The steepest descent along with variable learning rate back-propagation algorithm known as a heuristic technique was utilized for training the MLP network. It was found that MLP network yields better results compared to RBF network, giving an acceptable mapping between the network responses and the target data with a high correlation coefficients. The response surfaces between the response variables, i.e. crystallite size, lattice strain of the aluminum matrix and the processing parameters are presented. The procedure modeling can be used for optimization of the MA process for synthesizing of nanostructured metal matrix nanocomposites
International Nuclear Information System (INIS)
Numerical simulation of natural circulation boiling water reactor is important in order to study its performance for different designs and under various off-design conditions. Numerical simulations can be performed by using thermal-hydraulic codes. Very fast numerical simulations, useful for extensive parametric studies and for solving design optimization problems, can be achieved by using an artificial neural network (ANN) model of the system. In the present work, numerical simulations of natural circulation boiling water reactor have been performed with RELAP5 code for different values of design parameters and operational conditions. Parametric trends observed have been discussed. The data obtained from these simulations have been used to train artificial neural networks, which in turn have been used for further parametric studies and design optimization. The ANN models showed error within ±5% for all the simulated data. Two most popular methods, multilayer perceptron (MLP) and radial basis function (RBF) networks, have been used for the training of ANN model. Sequential quadratic programming (SQP) has been used for optimization
Scientific Electronic Library Online (English)
JUAN DAVID, VELÁSQUEZ HENAO; SANTIAGO FERNANDO, MONTOYA MORENO.
2005-11-01
Full Text Available Un nuevo modelo híbrido es propuesto para pronosticar el índice colombiano de precios al consumidor. Este es basado en una descomposición estructural de la serie temporal con el objetivo de remover cualquier patrón fácilmente detectable en los datos, y en el uso de un perceptron multicapa para model [...] ar las relaciones ocultas en la serie de tiempo. Los resultados superan las aproximaciones clásicas basadas en la aproximación de Box y Jenkins, y los modelos convencionales de Redes Neuronales, e incentivan el estudio de este tipo de aproximación híbrida para modelar otras series temporales. Abstract in english A new hybrid model is proposed to forecasting the Colombian Consumer Price Index. It’s based on the structural decomposition of the original time series with the aim of remove any easily detected pattern in the data, and in the use of multilayer perceptron to model hidden relationships in the studie [...] d time series. The results overcome classical approaches based on Box-Jenkins methodology and conventional neural networks methodology, and encourage the study of this hybrid approach to modelling other time series.
Scientific Electronic Library Online (English)
Juan David, Velásquez Henao; Mario Alberto, Aldana Dumar.
2007-12-01
Full Text Available En este artículo, se modela el precio promedio mensual del café colombiano en la Bolsa de Nueva York, usando varios modelos alternativos. El modelo final seleccionado está compuesto por una componente lineal autorregresiva más una red neuronal artificial tipo perceptron multicapa con dos neuronas en [...] la capa oculta, que permite representar la dinámica que sigue el valor esperado de la serie de precios; mientras que la dinámica de los residuales es especificada usando un proceso heterocedástico condicional autoregresivo de primer orden. Los residuales normalizados del modelo son incorrelacionados y homocedásticos, y siguen aproximadamente una distribución normal. Los resultados indican que el precio actual depende de los precios ocurridos en los últimos cuatro meses. Abstract in english In this paper, the monthly average price of the Colombian coffee in the New York Stock Exchange, is modelling by means of several alternative models. The preferred model is composed by a lineal autoregressive component plus a multilayer perceptron neural network with two neurons in the hidden layer, [...] that allow us to representing the dynamic following by the expected value of the price time series; while, the dynamic of the residuals is specified by an autoregressive conditional heterocedastic model of first order. The normalized residuals of the preferred model are uncorrelated, homocedastic and are distributed following a normal distribution. The results indicate that the current price depend of the prices in the previous four months.
Parinet, Julien; Julien, Maxime; Nun, Pierrick; Robins, Richard J; Remaud, Gerald; Höhener, Patrick
2015-09-01
We aim at predicting the effect of structure and isotopic substitutions on the equilibrium vapour pressure isotope effect of various organic compounds (alcohols, acids, alkanes, alkenes and aromatics) at intermediate temperatures. We attempt to explore quantitative structure property relationships by using artificial neural networks (ANN); the multi-layer perceptron (MLP) and compare the performances of it with multi-linear regression (MLR). These approaches are based on the relationship between the molecular structure (organic chain, polar functions, type of functions, type of isotope involved) of the organic compounds, and their equilibrium vapour pressure. A data set of 130 equilibrium vapour pressure isotope effects was used: 112 were used in the training set and the remaining 18 were used for the test/validation dataset. Two sets of descriptors were tested, a set with all the descriptors: number of(12)C, (13)C, (16)O, (18)O, (1)H, (2)H, OH functions, OD functions, CO functions, Connolly Solvent Accessible Surface Area (CSA) and temperature and a reduced set of descriptors. The dependent variable (the output) is the natural logarithm of the ratios of vapour pressures (ln R), expressed as light/heavy as in classical literature. Since the database is rather small, the leave-one-out procedure was used to validate both models. Considering higher determination coefficients and lower error values, it is concluded that the multi-layer perceptron provided better results compared to multi-linear regression. The stepwise regression procedure is a useful tool to reduce the number of descriptors. To our knowledge, a Quantitative Structure Property Relationship (QSPR) approach for isotopic studies is novel. PMID:25559176
Directory of Open Access Journals (Sweden)
Luciana C. Bucene
2004-12-01
Full Text Available Objetivando classificar terras para irrigação, faz-se necessário analisar e determinar alguns parâmetros, entre eles a produtividade do solo. A classificação de produtividade (comumente chamada fertilidade aparente é delimitada em cinco classes: muito alta, alta, média, baixa e muito baixa, e em cada classe é preciso avaliar certos atributos do solo, como pH, CTC (capacidade de troca de cátions, V% (índice de saturação por bases, P (fósforo, Mg (magnésio e K (potássio. Neste trabalho, objetivou-se identificar a produtividade na qual atributos do solo, da parte inicial da microbacia hidrográfica do Rio Pardo, localizada em Pardinho, SP, foram analisados e classificados nas classes que a delimitam, através de Redes Neurais Artificiais (RNAs utilizandose Perceptron Múltiplas Camadas (Multilayers Perceptrons - MLP com o algoritmo de treinamento "backpropagation"- classificador de padrões, obtendo-se um número ótimo de camadas intermediárias e de neurônios; resultando na classificação de produtividade, a situação ótima da rede obteve 78% dos resultados iguais aos desejados, com duas camadas de neurônios, uma das quais intermediária, com 5 neurônios, e uma camada de saída.Productivity data (commonly known as apparent fertility of the initial part of the river Pardo-SP watershed was analyzed and classified with Artificial Neural Networks (ANNs, in order to classify lands for irrigation. Soil attributes as pH, CEC (cation exchange capacity, V% (base saturation index, P (phosphorus, Mg (magnesium and K (potassium were defined in five classes: very high, high, medium, low and very low. Apparent fertility classification taking into account the five classes was performed by using Multiple Layers Perceptron (MLP. Backpropagation algorithm was performed with the training set. One hidden layer with 5 neurons was the situation that best performed.
Scientific Electronic Library Online (English)
Luciana C., Bucene; Luiz H. A., Rodrigues.
2004-12-01
Full Text Available Objetivando classificar terras para irrigação, faz-se necessário analisar e determinar alguns parâmetros, entre eles a produtividade do solo. A classificação de produtividade (comumente chamada fertilidade aparente) é delimitada em cinco classes: muito alta, alta, média, baixa e muito baixa, e em ca [...] da classe é preciso avaliar certos atributos do solo, como pH, CTC (capacidade de troca de cátions), V% (índice de saturação por bases), P (fósforo), Mg (magnésio) e K (potássio). Neste trabalho, objetivou-se identificar a produtividade na qual atributos do solo, da parte inicial da microbacia hidrográfica do Rio Pardo, localizada em Pardinho, SP, foram analisados e classificados nas classes que a delimitam, através de Redes Neurais Artificiais (RNAs) utilizandose Perceptron Múltiplas Camadas (Multilayers Perceptrons - MLP) com o algoritmo de treinamento "backpropagation"- classificador de padrões, obtendo-se um número ótimo de camadas intermediárias e de neurônios; resultando na classificação de produtividade, a situação ótima da rede obteve 78% dos resultados iguais aos desejados, com duas camadas de neurônios, uma das quais intermediária, com 5 neurônios, e uma camada de saída. Abstract in english Productivity data (commonly known as apparent fertility) of the initial part of the river Pardo-SP watershed was analyzed and classified with Artificial Neural Networks (ANNs), in order to classify lands for irrigation. Soil attributes as pH, CEC (cation exchange capacity), V% (base saturation index [...] ), P (phosphorus), Mg (magnesium) and K (potassium) were defined in five classes: very high, high, medium, low and very low. Apparent fertility classification taking into account the five classes was performed by using Multiple Layers Perceptron (MLP). Backpropagation algorithm was performed with the training set. One hidden layer with 5 neurons was the situation that best performed.
The Role of Weight Shrinking in Large Margin Perceptron Learning
Panagiotakopoulos, Constantinos
2012-01-01
We introduce into the classical perceptron algorithm with margin a mechanism that shrinks the current weight vector as a first step of the update. If the shrinking factor is constant the resulting algorithm may be regarded as a margin-error-driven version of NORMA with constant learning rate. In this case we show that the allowed strength of shrinking depends on the value of the maximum margin. We also consider variable shrinking factors for which there is no such dependence. In both cases we obtain new generalizations of the perceptron with margin able to provably attain in a finite number of steps any desirable approximation of the maximal margin hyperplane. The new approximate maximum margin classifiers appear experimentally to be very competitive in 2-norm soft margin tasks involving linear kernels.
A Coherent Perceptron for All-Optical Learning
Tezak, Nikolas; Mabuchi, Hideo
2015-01-01
We present nonlinear photonic circuit models for constructing programmable linear transformations and use these to realize a coherent Perceptron, i.e., an all-optical linear classifier capable of learning the classification boundary iteratively from training data through a coherent feedback rule. Through extensive semi-classical stochastic simulations we demonstrate that the device nearly attains the theoretical error bound for a model classification problem.
PENGENALAN CITRA OBJEK SEDERHANA DENGAN JARINGAN SARAF TIRUAN METODE PERCEPTRON
Ardi Pujiyanta
2012-01-01
Konsep bangunan dan benda-benda yang ada di sekeliling didasarkan dan dipengaruhi oleh konsep objek sederhana atau sering disebut geometri ruang tiga dimensi, yaitu memiliki panjang, lebar dan tinggi. Namun, dalam rancangan dan penggambarannya menggunakan gambar berdimensi dua saja. Sehingga pada konsep penggambarannya membutuhkan visualisasi yang lebih detail. Diharapkan jaringan syaraf tiruan metode perceptron dapat mengenali gambar yang sesuai dengan bentuk aslinya. Pada penelitian ini met...
A fast method for calculating the perceptron with maximal stability
Ruja?n, Pa?l
1993-01-01
For the class of linearly separable two class (boolean) functions the Perceptron with maximal stability defines in the space of all possible input configurations the direction along which the gap between the two classes is maximal. This solution has several advantages: it is unique, it is robust, and has the best generalization probability among all known linear discriminants. present here an active set approach to the dual problem, finding the minimal connector between two disjoint convex hu...
Perceptron capacity revisited: classification ability for correlated patterns
Shinzato, Takashi; Kabashima, Yoshiyuki
2007-01-01
In this paper, we address the problem of how many randomly labeled patterns can be correctly classified by a single-layer perceptron when the patterns are correlated with each other. In order to solve this problem, two analytical schemes are developed based on the replica method and Thouless-Anderson-Palmer (TAP) approach by utilizing an integral formula concerning random rectangular matrices. The validity and relevance of the developed methodologies are shown for one known ...
Asymptotic behavior of the magnetization for the perceptron model
Marquez-carreras, David; Rovira, Carles; Tindel, Samy
2005-01-01
In this paper, we show that, in case of a perceptron model for which the number of outputs is a small proportion of the size of the system, the limiting behavior of the magnetization of a given spin, namely the random variable $\\langle\\si_k\\rangle$, can be identified. In fact, we prove a $L^2$ convergence for a collection of those random variables.
The Role of Weight Shrinking in Large Margin Perceptron Learning
Panagiotakopoulos, Constantinos; Tsampouka, Petroula
2012-01-01
We introduce into the classical perceptron algorithm with margin a mechanism that shrinks the current weight vector as a first step of the update. If the shrinking factor is constant the resulting algorithm may be regarded as a margin-error-driven version of NORMA with constant learning rate. In this case we show that the allowed strength of shrinking depends on the value of the maximum margin. We also consider variable shrinking factors for which there is no such dependence...
Directory of Open Access Journals (Sweden)
Chennai Salim
2011-09-01
Full Text Available The increased use of nonlinear devices in the industry has resulted in the direct increase of harmonic distortion in power systems during these last years. Active filter systems are proposed to mitigate current harmonics generated by nonlinear loads. The conventional scheme based on a two-level voltage source inverter controlled by a hysteresis controller has several disadvantages and cannot be used for medium or high-power applications. To overcome these drawbacks and improve the APF performance, there’s a great tendency to use multilevel inverters controlled by intelligent controllers. Three level (NPC inverter is one of the most widely used topologies in various industrial applications such as machine drives and power factor compensators. On the other hand, artificial neural networks are under study and investigation in other power electronics applications. In order to gain the advantages of the three-level inverter and artificial neural networks and to reduce the complexity of classical control schemes, a new active power filter configuration controlled by two MLPNN (Multi-Layer Perceptron Neural Network is proposed in this paper. The first ANN is used to replace the PWM current controller, and the second one to maintain a constant dc link voltage across the capacitors and compensate the inverter power losses. The performance of the global system, including power and control circuits is evaluated by Matlab-Simulink and SimPowerSystem Toolbox simulation. The obtained results confirm the effectiveness of the proposed control scheme.
Use of the 'Perceptron' algorithm to distinguish translational initiation sites in E. coli.
Stormo, G. D.; Schneider, T. D.; Gold, L.; Ehrenfeucht, A.
1982-01-01
We have used a "Perceptron" algorithm to find a weighting function which distinguishes E. coli translational initiation sites from all other sites in a library of over 78,000 nucleotides of mRNA sequence. The "Perceptron" examined sequences as linear representations. The "Perceptron" is more successful at finding gene beginnings than our previous searches using "rules" (see previous paper). We note that the weighting function can find translational initiation sites within sequences that were ...
Middleton, Ian; Damper, Robert I
2004-01-01
Segmentation of medical images is very important for clinical research and diagnosis, leading to a requirement for robust automatic methods. This paper reports on the combined use of a neural network (a multilayer perceptron, MLP) and active contour model ('snake') to segment structures in magnetic resonance (MR) images. The perceptron is trained to produce a binary classification of each pixel as either a boundary or a non-boundary point. Subsequently, the resulting binary (edge-point) image forms the external energy function for a snake, used to link the candidate boundary points into a continuous, closed contour. We report here on the segmentation of the lungs from multiple MR slices of the torso; lung-specific constraints have been avoided to keep the technique as general as possible. In initial investigations, the inputs to the MLP were limited to normalised intensity values of the pixels from an (7 x 7) window scanned across the image. The use of spatial coordinates as additional inputs to the MLP is then shown to provide an improvement in segmentation performance as quantified using the effectiveness measure (a weighted product of precision and recall). Training sets were first developed using a lengthy iterative process. Thereafter, a novel cost function based on effectiveness is proposed for training that allows us to achieve dramatic improvements in segmentation performance, as well as faster, non-iterative selection of training examples. The classifications produced using this cost function were sufficiently good that the binary image produced by the MLP could be post-processed using an active contour model to provide an accurate segmentation of the lungs from the multiple slices in almost all cases, including unseen slices and subjects. PMID:14644600
Robustness of a Neural Network Model for Power Peak Factor Estimation in Protection Systems
International Nuclear Information System (INIS)
This work presents results of robustness verification of artificial neural network correlations that improve the real time prediction of the power peak factor for reactor protection systems. The input variables considered in the correlation are those available in the reactor protection systems, namely, the axial power differences obtained from measured ex-core detectors, and the position of control rods. The correlations, based on radial basis function (RBF) and multilayer perceptron (MLP) neural networks, estimate the power peak factor, without faulty signals, with average errors between 0.13%, 0.19% and 0.15%, and maximum relative error of 2.35%. The robustness verification was performed for three different neural network correlations. The results show that they are robust against signal degradation, producing results with faulty signals with a maximum error of 6.90%. The average error associated to faulty signals for the MLP network is about half of that of the RBF network, and the maximum error is about 1% smaller. These results demonstrate that MLP neural network correlation is more robust than the RBF neural network correlation. The results also show that the input variables present redundant information. The axial power difference signals compensate the faulty signal for the position of a given control rod, and improves the results by about 10%. The results show that the errors in the power peak factor estimation by these neural network correlations, even in fase neural network correlations, even in faulty conditions, are smaller than the current PWR schemes which may have uncertainties as high as 8%. Considering the maximum relative error of 2.35%, these neural network correlations would allow decreasing the power peak factor safety margin by about 5%. Such a reduction could be used for operating the reactor with a higher power level or with more flexibility. The neural network correlation has to meet requirements of high integrity software that performs safety grade actions. It is shown that the correlation is a very simple algorithm that can be easily codified in software. Due to its simplicity, it facilitates the necessary process of validation and verification. (authors)
Wang, L.; Shin, R. T.; Kong, J. A.; Yueh, S. H.
1993-01-01
This paper investigates the potential application of neural network to inversion of soil moisture using polarimetric remote sensing data. The neural network used for the inversion of soil parameters is multi-layer perceptron trained with the back-propagation algorithm. The training data include the polarimetric backscattering coefficients obtained from theoretical surface scattering models together with an assumed nominal range of soil parameters which are comprised of the soil permittivity and surface roughness parameters. Soil permittivity is calculated from the soil moisture and the assumed soil texture based on an empirical formula at C-, L-, and P-bands. The rough surface parameters for the soil surface, which is described by the Gaussian random process, are the root-mean-square (rms) height and correlation length. For the rough surface scattering, small perturbation method is used for the L-band frequency, and Kirchhoff approximation is used for the C-band frequency to obtain the corresponding backscattering coefficients. During the training, the backscattering coefficients are the inputs to the neural net and the output from the net are compared with the desired soil parameters to adjust the interconnecting weights. The process is repeated for each input-output data entry and then for the entire training data until convergence is reached. After training, the backscattering coefficients are applied to the trained neural net to retrieve the soil parameters which are compared with the desired soil parameters to verify the effectiveness of this technique. Several cases are examined. First, for simplicity, the correlation length and rms height of the soil surface are fixed while soil moisture is varied. Soil moisture obtained using the neural networks with either L-band or C-band backscattering coefficients for the HH and VV polarizations as inputs is in good agreement with the desired soil moisture. The neural net output matches the desired output for the soil moisture range of 16 to 60 percent for the C-band case. The next case investigated is to vary both soil moisture and rms height while keeping the correlation length fixed. For this case, C-band backscattering coefficients are not sufficient for retrieving two parameters because the Kirchhoff approximation gives the same HH and VV backscattering coefficients. Therefore, the backscattering coefficients at two different frequency bands are necessary to find both the soil moisture and rms height. Finally, the neural nets are also applied to simultaneously invert soil moisture, rms height, and correlation length. Overall, the soil moisture retrieved from the neural network agrees very well with the desired soil moisture. This suggests that the neural network shows potential for retrieval of soil parameters from remote sensing data.
On improvements of neural network accuracy with fixed number of active neurons
Sokolova, Natalia; Nikolaev, Dmitry P.; Polevoy, Dmitry
2015-02-01
In this paper an improvement possibility of multilayer perceptron based classifiers with using composite classifier scheme with predictor function was exploited. Recognition of embossed number characters on plastic cards in the image taken by mobile camera was used as a model problem.
Use of a Neural Network for Damage Detection and Location in a Steel Member
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1992-01-01
The paper explores the potential of using a Multilayer Perceptron (MLP) network trained with the Backpropagation algorithm for damage assessment of free-free cracked straight steel beam based on vibration measurements. The problem of damage assessment, i.e. detecting, locating and quantifying a damage, is essentially a pattern recognition problem.
Scientific Electronic Library Online (English)
Jesús D., Villalba; Ivan D., Gómez; José E., Laier.
2012-06-01
Full Text Available En este trabajo se presenta una red neuronal perceptron multicapa combinada con el método Nelder-Mead Simplex para detectar daño en vigas. Los parámetros de entrada a la red se basan en frecuencias naturales y flexibilidad modal. Se considera que solo una cantidad específica de modos fueron identifi [...] cados y que se dispone de mediciones en grados de libertad verticales. La confiabilidad de la metodología propuesta se evalúa a partir de escenarios de daño aleatorios y de la definición de 3 tipos de error que la red puede cometer durante el proceso de detección del daño. Los resultados muestran que la metodología puede determinar confiablemente los escenarios de daño buscados. Sin embargo, su aplicación a vigas de gran tamaño puede verse limitada por el elevado costo computacional asociado al entrenamiento de la red. Abstract in english In this paper is presented a multilayer perceptron neural network combined with the Nelder-Mead Simplex method to detect damage in multiple support beams. The input parameters are based on natural frequencies and modal flexibility. It was considered that only a number of modes were available and tha [...] t only vertical degrees of freedom were measured. The reliability of the proposed methodology is assessed from the generation of random damages scenarios and the definition of three types of errors, which can be found during the damage identification process. Results show that the methodology can reliably determine the damage scenarios. However, its application to large beams may be limited by the high computational cost of training the neural network.
Directory of Open Access Journals (Sweden)
Edia E.O.
2010-10-01
Full Text Available Despite their importance in stream management, the aquatic insect assemblages are still little known in West Africa. This is particularly true in South-Eastern Ivory Coast, where aquatic insect assemblages were hardly studied. We therefore aimed at characterising aquatic insect assemblages on four coastal rivers in South-Eastern Ivory Coast. Patterning aquatic insect assemblages was achieved using a Self-Organizing Map (SOM, an unsupervised Artificial Neural Networks (ANN method. This method was applied to pattern the samples based on the richness of five major orders of aquatic insects (Diptera, Ephemeroptera, Coleoptera, Trichoptera and Odonata. This permitted to identify three clusters that were mainly related to the local environmental status of sampling sites. Then, we used the environmental characteristics of the sites to predict, using a multilayer perceptron neural network (MLP, trained by BackPropagation algorithm (BP, a supervised ANN, the richness of the five insect orders. The BP showed high predictability (0.90 for both Diptera and Trichoptera, 0.84 for both Coleoptera and Odonata, 0.69 for Ephemeroptera. The most contributing variables in predicting the five insect order richness were pH, conductivity, total dissolved solids, water temperature, percentage of rock and the canopy. This underlines the crucial influence of both instream characteristics and riparian context.
Braga, C C
2001-01-01
A neural network structure has been used for unfolding neutron spectra measured by means of a Bonner Sphere Spectrometer set and a foil activation set using several neutron induced reactions. The present work used the SNNS (Stuttgart Neural Network Simulator) as the interface for designing, training and validation of the Multilayer Perceptron network. The back-propagation algorithm was applied. The Bonner Sphere set chosen has been calibrated at the National Physical Laboratory, United Kingdom, and uses gold activation foils as thermal neutron detectors. The neutron energy covered by the response functions goes from 0.0001 eV to 14 MeV. The foil activation set chosen has been irradiated at the IEA-R1 research reactor and measured at the Nuclear Metrology Laboratory of IPEN-CNEN/SP. Two types of neutron spectra were numerically investigated: monoenergetic and continuous The unfolded spectra were compared to a conventional method using code SAND-II as part of the neutron dosimetry system SAIPS. Good results wer...
Scientific Electronic Library Online (English)
Sandra P, Mateus; Natalia, González; John W, Branch.
Full Text Available En este trabajo se presenta la creación de dos Entornos Virtuales Inteligentes (EVI) con Redes Neuronales Artificiales (RNA). En un EVI se realiza el diagnóstico de problemas visuales como astigmatismo, miopía e hipermetropía. El otro se enfoca, en la percepción y el razonamiento de señales de adver [...] tencia en un entorno laboral. En el desarrollo del trabajo, se hace primero una caracterización de las Redes Neuronales Artificiales y luego se hace una simulación de ellas; de acuerdo a los resultados obtenidos, se selecciona una arquitectura de red (Perceptrón Multicapa) y ésa es la que se implementa en los EVI. Finalmente se abordan las limitantes del tiempo en el aprendizaje de la RNA y en el costo computacional aplicados a los EVI. Abstract in english In this paper, the creation and application of two Intelligent Virtual Environments (IVE) with Artificial Neural Networks (ANN) are presented. In one EVI, the diagnosis of vision problems like astigmatism, myopia and hyperopia is studied. The other one focuses to the perception and reasoning of warn [...] ing signals in a work environment. For the development of this paper, the characterization of Artificial Neural Networks is done, followed by the simulation; according to the results one network architecture is selected (Multilayer Perceptron) and then implemented in the IVE. Finally the time constraints in ANN learning and in computational cost applied to IVE are discussed.
Maran, J Prakash; Priya, B
2015-03-01
The present study is to evaluate and compare the prediction and simulating efficiencies of response surface methodology (RSM) and artificial neural network (ANN) based models on fatty acid methyl esters (FAME) yield achieved from muskmelon oil (MMO) under ultrasonication by two step in situ process. In first in situ process, free fatty acid content of MMO was reduced from 6.43% to 0.91% using H2SO4 as acid catalyst and organic phase in the first step was subjected to second reaction by adding KOH in methanol as basic catalyst. The influence of process variables (methanol to oil molar ratio, catalyst concentration, reaction temperature and reaction time) on conversion of FAME (second step) was investigated by central composite rotatable design (CCRD) of RSM and Multi-Layer Perceptron (MLP) neural network with the topology of 4-7-1. Both (RSM and ANN) were statistically compared by the coefficient of determination, root mean square error and absolute average deviation, based on the validation data set. The coefficient of determination (R(2)) calculated from the validation data for RSM and ANN models were 0.869 and 0.991 respectively. While both models showed good predictions in this study. But, the ANN model was more precise compared to the RSM model and it showed that, ANN is to be a powerful tool for modeling and optimizing FAME production. PMID:25457517
International Nuclear Information System (INIS)
In this research, feed forward ANN (Artificial Neural Network) model is developed and validated for predicting the pH at 10 different locations of the distribution system of drinking water of Hyderabad city. The developed model is MLP (Multilayer Perceptron) with back propagation algorithm. The data for the training and testing of the model are collected through an experimental analysis on weekly basis in a routine examination for maintaining the quality of drinking water in the city. 17 parameters are taken into consideration including pH. These all parameters are taken as input variables for the model and then pH is predicted for 03 phases;raw water of river Indus,treated water in the treatment plants and then treated water in the distribution system of drinking water. The training and testing results of this model reveal that MLP neural networks are exceedingly extrapolative for predicting the pH of river water, untreated and treated water at all locations of the distribution system of drinking water of Hyderabad city. The optimum input and output weights are generated with minimum MSE (Mean Square Error) < 5%. Experimental, predicted and tested values of pH are plotted and the effectiveness of the model is determined by calculating the coefficient of correlation (R2=0.999) of trained and tested results. (author)
Rai, H. M.; Trivedi, A.; Chatterjee, K.; Shukla, S.
2014-01-01
This paper employed the Daubechies wavelet transform (WT) for R-peak detection and radial basis function neural network (RBFNN) to classify the electrocardiogram (ECG) signals. Five types of ECG beats: normal beat, paced beat, left bundle branch block (LBBB) beat, right bundle branch block (RBBB) beat and premature ventricular contraction (PVC) were classified. 500 QRS complexes were arbitrarily extracted from 26 records in Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) arrhythmia database, which are available on Physionet website. Each and every QRS complex was represented by 21 points from p1 to p21 and these QRS complexes of each record were categorized according to types of beats. The system performance was computed using four types of parameter evaluation metrics: sensitivity, positive predictivity, specificity and classification error rate. The experimental result shows that the average values of sensitivity, positive predictivity, specificity and classification error rate are 99.8%, 99.60%, 99.90% and 0.12%, respectively with RBFNN classifier. The overall accuracy achieved for back propagation neural network (BPNN), multilayered perceptron (MLP), support vector machine (SVM) and RBFNN classifiers are 97.2%, 98.8%, 99% and 99.6%, respectively. The accuracy levels and processing time of RBFNN is higher than or comparable with BPNN, MLP and SVM classifiers.
Committee neural network model for rock permeability prediction
Bagheripour, Parisa
2014-05-01
Quantitative formulation between conventional well log data and rock permeability, undoubtedly the most critical parameter of hydrocarbon reservoir, could be a potent tool for solving problems associated with almost all tasks involved in petroleum engineering. The present study proposes a novel approach in charge of the quest for high-accuracy method of permeability prediction. At the first stage, overlapping of conventional well log data (inputs) was eliminated by means of principal component analysis (PCA). Subsequently, rock permeability was predicted from extracted PCs using multi-layer perceptron (MLP), radial basis function (RBF), and generalized regression neural network (GRNN). Eventually, a committee neural network (CNN) was constructed by virtue of genetic algorithm (GA) to enhance the precision of ultimate permeability prediction. The values of rock permeability, derived from the MPL, RBF, and GRNN models, were used as inputs of CNN. The proposed CNN combines results of different ANNs to reap beneficial advantages of all models and consequently producing more accurate estimations. The GA, embedded in the structure of the CNN assigns a weight factor to each ANN which shows relative involvement of each ANN in overall prediction of rock permeability from PCs of conventional well logs. The proposed methodology was applied in Kangan and Dalan Formations, which are the major carbonate reservoir rocks of South Pars Gas Field-Iran. A group of 350 data points was used to establish the CNN model, and a group of 245 data points was employed to assess the reliability of constructed CNN model. Results showed that the CNN method performed better than individual intelligent systems performing alone.
A COLLECTIVE APPROACH TOWARDS ENERGY-BASED STRUCTURE FOR AUTONOMOUS LEARNING
Ananya Pothula; Ch.Navya Deepthi; Suresh, P.
2013-01-01
The technique of image denoising proceeds a noisy image as input and yields an image where the noise has been condensed. Neural networks have already been used to denoise images. It is probable to attain state-of-the-art denoising presentation with a simple multilayer perceptron. Multilayer perceptrons can be assumed of as widespread function approximators and are more commanding. A multi-layer perceptron is a nonlinear function that maps vector-valued input by means of numerous hidden laye...
Chaudhuri, Sutapa; Das, Debanjana; Sarkar, Ishita; Goswami, Sayantika
2015-04-01
In order to meet the non-stationary characteristics of Magnetotelluric (MT) data series, a new method, which is called EMD-Teager, was proposed based on empirical mode decomposition (EMD) and Teager operator for the first time. With the EMD-Teager method, the amplitude of data series is expressed as a function of frequency and time, and then margin spectrum are calculated statistically from the time-frequency spectrum. This paper focuses on two aspects which are facilitated by applying the EMD-Teager. The first aspect is the time-frequency characteristics analysis of MT signal and using the time-frequency spectrum to do pretreatment for MT signal through piece-wise stationary analysis and MT data subsets selection; the other concerns the calculation of the Teager margin spectrum from the time-frequency spectrum. The conclusion reached through discussion of the first aspect is that EMD-Teager has a strong ability to describe the time-frequency characteristic of MT signal. Using the Teager spectrum, the better data section can be selected and the reliability of geological data is improved greatly. The conclusion draws from the second aspect is that Teager marginal spectrum, which is coming from the integral of Teager time-frequency spectrum along the time axis, overcomes the drawbacks of Fourier methods and minimizes the estimation bias brought about by the non-stationarity feature of MT signal. Therefore, EMD-Teager method is effective in analyzing the time-frequency characteristics and marginal spectrum estimation of MT signals, and it will have a wide application in processing of MT data.
Multilayer perceptron for simulation models reduction: application to a sawmill workshop
Thomas, Philippe; Thomas, Andre?
2011-01-01
Simulation is often used to evaluate supply chain or workshop management. This simulation task needs models, which are difficult to construct. The aim of this work is to reduce the complexity of a simulation model design. The proposed approach combines discrete and continuous approaches in order to construct speeder and simpler reduced model. The simulation model focuses on bottlenecks with a discrete approach according to the theory of constraints. The remaining of the workshop must be taken...
Energy Technology Data Exchange (ETDEWEB)
Andrade, Andre J.N. [Para Univ., Belem, PA (Brazil); Luthi, Stefan M. [Schlumberger Wireline Service, Montrouge (France)
1997-07-01
The analysis of openhole wireline logs is of great importance for the subsurface mapping of geological layers and the identification and quantification of hydrocarbon and mineral deposits. An important aspects to construct a geological model of the reservoir is the well-to-well log correlation, which can be a tedious and time-consuming task for the geologist. Automating this procedure is complicated but potentially rewarding because it may save the production geologist and log analyst substantial amount of time. Artificial neural networks have been shown to handle this task efficiently including in cases where sequential algorithms have problems. We show in this paper that a neural networks can be used to perform the well-to-well log correlation to provide first approximation od the geological model of the reservoir. This procedure is shown on actual field data. (author)
Representations of highly-varying functions by perceptron networks.
Czech Academy of Sciences Publication Activity Database
K?rková, V?ra
North Charleston : CreateSpace Independent Publishing Platform, 2013 - (Vina?, T.; Hole?a, M.; Lexa, M.; Peška, L.; Vojtáš, P.), s. 73-76 ISBN 978-1-4909-5208-6. [ITAT 2013. Conference on Theory and Practice of Information Technologies. Donovaly (SK), 11.09.2013-15.09.2013] R&D Projects: GA ?R GAP202/11/1368 Institutional support: RVO:67985807 Keywords : one-hidden-layer networks * perceptron s * Boolean functions * network complexity Subject RIV: IN - Informatics, Computer Science
Perceptron capacity revisited: classification ability for correlated patterns
International Nuclear Information System (INIS)
In this paper, we address the problem of how many randomly labeled patterns can be correctly classified by a single-layer perceptron when the patterns are correlated with each other. In order to solve this problem, two analytical schemes are developed based on the replica method and the Thouless-Anderson-Palmer (TAP) approach by utilizing an integral formula concerning random rectangular matrices. The validity and relevance of the developed methodologies are shown for one known result and two example problems. A message-passing algorithm to perform the TAP scheme is also presented
Modular Weightless Neural Network Architecture for Intelligent Navigation
Dayang Norhayati Abang Jawawi; Siti Zaiton Mohd. Hashim; Siti Nurmaini
2009-01-01
The standard multi layer perceptron neural network (MLPNN)type has various drawbacks, one of which is training requiresrepeated presentation of training data, which often results in verylong learning time. An alternative type of network, almost unique, isthe Weightless Neural Network (WNNs) this is also called n-tuplenetworks or RAM based networks. In contrast to the weighted neuralmodels, there are several one-shot learning algorithms for WNNswhere training takes only one epoch. This paper d...
Scientific Electronic Library Online (English)
Rodrigo Mikosz, Gonçalves; Leandro dos Santos, Coelho; Claudia Pereira, Krueger; Bernhard, Heck.
2010-09-01
Full Text Available Estudar modelagens através de dados geodésicos temporais com a possibilidade de predizer a posição de linha de costa é uma tarefa importante e pode auxiliar significativamente na gestão costeira. A área de estudo neste trabalho se refere ao município de Matinhos no estado do Paraná, Brasil. As linha [...] s de costa temporais utilizadas para testar a modelagem preditiva são provenientes respectivamente da fotogrametria analógica para anos 1954, 1963, 1980, 1991 e 1997 e de levantamentos geodésicos utilizando GPS (Global Position System) para 2001, 2002, 2005 e 2008 (como controle). Dois testes com as redes neurais artificiais foram organizados mudando alguns parâmetros como: arquitetura, número de neurônios nas camadas ocultas e algoritmos de treinamentos. Quando comparados o valor dos resíduos entre a predição e a linha de costa de controle, os melhores resultados estatísticos indicam que o MAPE (mean absolute percentage error) são 0,28% utilizando a rede neural parcialmente recorrente de Elman com o algoritmo de treinamento quase-Newton e 0,46% para o caso da rede neural perceptron multicamadas com o algoritmo de treinamento utilizando o método Bayesiano com regularização. Abstract in english The study of models using geodetic temporal data which can possibly predict the shoreline position is an important task and can significantly contribute to coastal management. The studied area is located at municipality of Matinhos in the Paraná State, Brazil. The temporal shoreline used to test the [...] prediction model is respectively from analog photogrammetric data, related to the years 1954, 1963, 1980, 1991 and 1997, and GPS (Global Position System) geodetic surveys for 2001, 2002, 2005 and 2008 (as control). Two different tests with artificial neural network were organized setting the parameters like: architecture, number of neuron in hidden layers and the training algorithms. Comparing the residuals between the prediction to the shoreline of control, the best statistical results show the MAPE (Mean Absolute Percentage Error) is 0,28% using the Elman partially recurrent network with quasi-Newton training function and 0,46% using the neural network multilayer perceptron with Bayesian regulation training function.
Scientific Electronic Library Online (English)
Teodorico, Alves Sobrinho; Dulce Buchala Bicca, Rodrigues; Paulo Tarso Sanches de, Oliveira; Lais Cristina Soares, Rebucci; Caroline Alvarenga, Pertussatti.
2011-06-01
Full Text Available A estimativa da evapotranspiração por métodos indiretos propicia, de modo facilitado, a geração de dados para o planejamento de sistemas de irrigação e aplicação de modelos meteorológicos e hidrológicos, ambos, úteis na gestão de bacias hidrográficas. O objetivo deste trabalho foi elaborar uma Rede [...] Neural Artificial (RNA) para estimar a evapotranspiração de referência (Eto) em função de dados diários de temperatura do ar. A RNA, do tipo FeedForward Multilayer Perceptron, foi treinada tomando-se por referência a Eto diária obtida pelo método de Penman-Monteith. Nas camadas intermediárias e de saída foram utilizadas funções de ativação do tipo tan-sigmóide e lineares, respectivamente. Os valores de Eto gerados pela RNA foram comparados com os obtidos pelos métodos de Blanney-Criddle e Hargreaves considerando meses referentes às quatro estações do ano. Em relação aos outros métodos analisados, os resultados obtidos a partir da RNA foram mais próximos ao método padrão Penman-Monteith. Assim, o desempenho da RNA desenvolvida foi satisfatório, podendo-se considerá-la como integrante do conjunto de métodos indiretos para estimativa da evapotranspiração, além de representar uma diminuição dos custos de aquisição de dados para estimativa desta variável. Abstract in english The estimation of evapotranspiration by indirect methods provides synthetic data for planning irrigation systems and application on meteorological and hydrological models, both useful in watershed management. The objective of this study was to develop an Artificial Neural Network (ANN) to estimate t [...] he reference evapotranspiration (Eto) based on daily air temperature data. The ANN model of Feedforward Multilayer Perceptron type, was trained using as a reference the daily Eto obtained by the Penman-Monteith method. In the intermediate and output layers were used activation functions like tan-sigmoid and linear, respectively. Eto values generated by ANN were compared with those obtained by the methods of Blanney-Criddle and Hargreaves considering the months of the four seasons. Comparing to the other analyzed methods, the results obtained from the ANN were closer to the standard Penman-Monteith method. Thus, the performance of the developed ANN was satisfactory, and the ANN model can be considered as one indirect method for estimating evapotranspiration and allows a cost reduction on data acquisition to estimate this variable.
Techniques for Learning Binary Stochastic Feedforward Neural Networks
Raiko, Tapani; Berglund, Mathias; Alain, Guillaume; Dinh, Laurent
2014-01-01
Stochastic binary hidden units in a multi-layer perceptron (MLP) network give at least three potential benefits when compared to deterministic MLP networks. (1) They allow to learn one-to-many type of mappings. (2) They can be used in structured prediction problems, where modeling the internal structure of the output is important. (3) Stochasticity has been shown to be an excellent regularizer, which makes generalization performance potentially better in general. However, tr...
Nahid Ardalani
2011-01-01
This article describes linear and nonlinear Artificial Neural Network(ANN)-based predictors as Autoregressive Moving Average models with Auxiliary input (ARMAX) process for Signal to Interference plus Noise Ratio (SINR) prediction in Direct Sequence Code Division Multiple Access (DS/CDMA) systems. The Multi Layer Perceptron (MLP) neural network with nonlinear function is used as nonlinear neural network and Adaptive Linear (Adaline) predictor is used as linear predictor. The problem of comple...
Lu, W Z; Wang, W J; Wang, X K; Xu, Z B; Leung, A Y T
2003-09-01
As the health impact of air pollutants existing in ambient addresses much attention in recent years, forecasting of air pollutant parameters becomes an important and popular topic in environmental science. Airborne pollution is a serious, and will be a major problem in Hong Kong within the next few years. In Hong Kong, Respirable Suspended Particulate (RSP) and Nitrogen Oxides NOx and NO2 are major air pollutants due to the dominant diesel fuel usage by public transportation and heavy vehicles. Hence, the investigation and prediction of the influence and the tendency of these pollutants are of significance to public and the city image. The multi-layer perceptron (MLP) neural network is regarded as a reliable and cost-effective method to achieve such tasks. The works presented here involve developing an improved neural network model, which combines the principal component analysis (PCA) technique and the radial basis function (RBF) network, and forecasting the pollutant levels and tendencies based in the recorded data. In the study, the PCA is firstly used to reduce and orthogonalize the original input variables (data), these treated variables are then used as new input vectors in RBF neural network model established for forecasting the pollutant tendencies. Comparing with the general neural network models, the proposed model possesses simpler network architecture, faster training speed, and more satisfactory predicting performance. This improved model is evaluated by using hourly time series of RSP, NOx and NO2 concentrations collected at Mong Kok Roadside Gaseous Monitory Station in Hong Kong during the year 2000. By comparing the predicted RSP. NOx and NO2 concentrations with the actual data of these pollutants recorded at the monitory station, the effectiveness of the proposed model has been proven. Therefore, in authors' opinion, the model presented in the paper is a potential tool in forecasting air quality parameters and has advantages over the traditional neural network methods. PMID:12952354
Entropy landscape of solutions in the binary perceptron problem
International Nuclear Information System (INIS)
The statistical picture of the solution space for a binary perceptron is studied. The binary perceptron learns a random classification of input random patterns by a set of binary synaptic weights. The learning of this network is difficult especially when the pattern (constraint) density is close to the capacity, which is supposed to be intimately related to the structure of the solution space. The geometrical organization is elucidated by the entropy landscape from a reference configuration and of solution-pairs separated by a given Hamming distance in the solution space. We evaluate the entropy at the annealed level as well as replica symmetric level and the mean field result is confirmed by the numerical simulations on single instances using the proposed message passing algorithms. From the first landscape (a random configuration as a reference), we see clearly how the solution space shrinks as more constraints are added. From the second landscape of solution-pairs, we deduce the coexistence of clustering and freezing in the solution space. (paper)
Using Probabilistic Neural Networks for Handwritten Digit Recognition
Abdelkader Benyettou; Abdelhadi Lotfi
2011-01-01
Artificial neural networks are well known in the field of pattern recognition and machine learning. Multi-layer neural networks are usually used as universal neural classifiers even though probabilistic neural networks represent a special type of artificial neural networks and have been designed to be used mainly in classification problems. In this article a study has been conducted to train a probabilistic neural network to recognize handwritten digits taken from the MINST database for handw...
Optimization of bending sequence in roll forming using neural network and genetic algorithm
Energy Technology Data Exchange (ETDEWEB)
Park, Hong Seok; Anh, Tran Viet [University of Ulsan, Ulsan (Korea, Republic of)
2011-08-15
In the roll forming process, the bending sequence plays a major role in the product quality. The optimal bending sequence results in the smallest number of passes and the flawless process. This paper presents a new optimization procedure of bending sequence in a roll forming process. The multilayer perceptron is used to build the neural network (NN), which models the variation of longitudinal strain in process while the genetic algorithm (GA) is employed to optimize the bending sequence. The data used for training the network is automatically obtained by the integration between CAD and CAE. The values of peak longitudinal strains are maximized while the number of passes is reduced to the smallest and the constraint conditions being set on the maximal longitudinal strain to avoid buckling. The overbending at final pass after spring back is also considered in this paper. Two roll forming processes are optimized in order to prove applicability and efficiency of the optimization procedure. This method maintains the longitudinal strain less than the buckling limit, whereas reducing the number of passes to the smallest. Thus, the advantages of the proposed method show the high applicability in designing and optimizing the bending sequence in the roll forming process.
International Nuclear Information System (INIS)
A new analysis technique, called multi-level interval estimation method, is developed for locating damage in structures. In this method, the artificial neural networks (ANN) analysis method is combined with the statistics theory to estimate the range of damage location. The ANN is multilayer perceptron trained by back-propagation. Natural frequencies and modal shape at a few selected points are used as input to identify the location and severity of damage. Considering the large-scale structures which have lots of elements, multi-level interval estimation method is developed to reduce the estimation range of damage location step-by-step. Every step, estimation range of damage location is obtained from the output of ANN by using the method of interval estimation. The next ANN training cases are selected from the estimation range after linear transform, and the output of new ANN estimation range of damage location will gained a reduced estimation range. Two numerical example analyses on 10-bar truss and 100-bar truss are presented to demonstrate the effectiveness of the proposed method.
A Hybrid Model based on Neural Network and Hybrid Genetic Algorithm for Automotive Price Forecasting
Directory of Open Access Journals (Sweden)
M. Reza Peyghami
2011-06-01
Full Text Available In this paper, we introduce a new intelligent combination method based on Multilayer Perceptron Neural Network (MLP?NN and Hybrid Genetic Algorithm (HGA for automotive price forecasting. The combination of MLPNN and HGA lead us to accelerate convergence to the optimal weights and improve the forecasting performance. In this structure, the Levenberg? Marquardt (LM algorithm is employed for training of the network, and the hybridization of Genetic Algorithm (GA with some local search optimization techniques such as steepest descent (SD method and quasi?Newton methods with DFP and BFGS formula is used to perform HGA. We apply our new hybrid model to forecast the automotive prices in Iran Khodro Company which is the biggest automotive manufacturing in IRAN. Simulation results show the enough reduction in the processing iterations and forecasting error which is mean square error. The results are well promising compared to the cases when we apply MLP?NN or hybridization of MLP?NN and GA, individually.
Directory of Open Access Journals (Sweden)
Gholamreza Asadollahfardi
2013-08-01
Full Text Available Considering the significance of the Sodium Adsorption Ratio (SAR for growing plants, its prediction is essential for water quality management for irrigation. The SAR prediction in Chelghazy River in Kurdistan, northwest of Iran, using an Artificial Neural Network (ANN was studied. The study applied the Multilayer Perceptron (MLP of the ANN to average monthly data, which was collected by the water authority of the Kurdistan province for the period of 1998-2009. The input parameters of the MLP network was pH, discharge, sulfate, sodium, calcium, chloride, magnesium and bicarbonate, and output was predictive of the SAR. The results showed a correlation coefficient 0.976 between actual and predicted SAR, which means the accuracy of the model is acceptable. The model uses the input parameters to predict the SAR at the same month. The sensitivity analysis indicated the prediction of the SAR was affected by merely pH and calcium. As a whole, the MLP of the ANN may be applicable for prediction of the SAR which is necessary parameter ration for agriculture.
Prediction of Natural Frequency of Laminated Composite Plates Using Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Surisetty Sreenivasulu
2012-06-01
Full Text Available The paper is focused on the application of artificial neural networks (ANN in predicting the natural frequency of laminated composite plates under clamped boundary condition. For training and testing of the ANN model, a number of finite element analyses have been carried out using D-optimal design in the design of experiments (DOE by varying the fibre orientations, –45?, 0?, 45? and 90?. The composite plate is modeled using linear layered structural shell element. The natural frequencies were found by analyses which were done by finite element (FE analysis software. The ANN model has been developed using multilayer perceptron (MLP back propagation algorithm. The adequacy of the developed model is verified by coefficient of determination (R. It was found that the R2 (R: coefficient of determination values are 1 and 0.998 for train and test data respectively. The results showed that, the training algorithm of back propagation was sufficient enough in predicting the natural frequency of laminated composite plates. To judge the ability and efficiency of the developed ANN model, absolute relative error has been used. The results predicted by ANN are in very good agreement with the finite element (FE results. Consequently, the D-optimal design and ANN are shown to be effective in predicting the natural frequency of laminated composite plates.
International Nuclear Information System (INIS)
This paper presents an artificial neural network (ANN) approach for annual electricity consumption in high energy consumption industrial sectors. Chemicals, basic metals and non-metal minerals industries are defined as high energy consuming industries. It is claimed that, due to high fluctuations of energy consumption in high energy consumption industries, conventional regression models do not forecast energy consumption correctly and precisely. Although ANNs have been typically used to forecast short term consumptions, this paper shows that it is a more precise approach to forecast annual consumption in such industries. Furthermore, the ANN approach based on a supervised multi-layer perceptron (MLP) is used to show it can estimate the annual consumption with less error. Actual data from high energy consuming (intensive) industries in Iran from 1979 to 2003 is used to illustrate the applicability of the ANN approach. This study shows the advantage of the ANN approach through analysis of variance (ANOVA). Furthermore, the ANN forecast is compared with actual data and the conventional regression model through ANOVA to show its superiority. This is the first study to present an algorithm based on the ANN and ANOVA for forecasting long term electricity consumption in high energy consuming industries
Spatial Disaggregation of Areal Rainfall Using Two Different Artificial Neural Networks Models
Directory of Open Access Journals (Sweden)
Sungwon Kim
2015-06-01
Full Text Available The objective of this study is to develop artificial neural network (ANN models, including multilayer perceptron (MLP and Kohonen self-organizing feature map (KSOFM, for spatial disaggregation of areal rainfall in the Wi-stream catchment, an International Hydrological Program (IHP representative catchment, in South Korea. A three-layer MLP model, using three training algorithms, was used to estimate areal rainfall. The Levenberg–Marquardt training algorithm was found to be more sensitive to the number of hidden nodes than were the conjugate gradient and quickprop training algorithms using the MLP model. Results showed that the networks structures of 11-5-1 (conjugate gradient and quickprop and 11-3-1 (Levenberg-Marquardt were the best for estimating areal rainfall using the MLP model. The networks structures of 1-5-11 (conjugate gradient and quickprop and 1-3-11 (Levenberg–Marquardt, which are the inverse networks for estimating areal rainfall using the best MLP model, were identified for spatial disaggregation of areal rainfall using the MLP model. The KSOFM model was compared with the MLP model for spatial disaggregation of areal rainfall. The MLP and KSOFM models could disaggregate areal rainfall into individual point rainfall with spatial concepts.
Shanbedi, Mehdi; Jafari, Dariush; Amiri, Ahmad; Heris, Saeed Zeinali; Baniadam, Majid
2013-01-01
Here, the temperature performance of a two-phase closed thermosyphon (TPCT) was investigated using two synthesized nanofluids, including carbon nano-tube (CNT)/water and CNT-Ag/water. In order to determine the temperature performance of a TPCT, the experiments were performed for various values of weight fraction and input power. To predict the other experimental conditions, a reliable and accurate tool should be applied. Therefore Artificial Neural Network (ANN) was applied to predict the process performance. Using ANN, the operating parameters, including distribution of wall temperature (T) and the temperature difference between the input and the output water streams of condenser section (?T) were determined. To achieve this goal, the multi-layer perceptron network was employed. The Levenberg-Marquardt algorithm was chosen as learning algorithm of this network. The results of simulation showed an excellent agreement with the data resulted from the experiments. Therefore it is possible to say that ANN is a powerful tool to predict the performance of different processes.
Greek long-term energy consumption prediction using artificial neural networks
International Nuclear Information System (INIS)
In this paper artificial neural networks (ANN) are addressed in order the Greek long-term energy consumption to be predicted. The multilayer perceptron model (MLP) has been used for this purpose by testing several possible architectures in order to be selected the one with the best generalizing ability. Actual recorded input and output data that influence long-term energy consumption were used in the training, validation and testing process. The developed ANN model is used for the prediction of 2005-2008, 2010, 2012 and 2015 Greek energy consumption. The produced ANN results for years 2005-2008 were compared with the results produced by a linear regression method, a support vector machine method and with real energy consumption records showing a great accuracy. The proposed approach can be useful in the effective implementation of energy policies, since accurate predictions of energy consumption affect the capital investment, the environmental quality, the revenue analysis, the market research management, while conserve at the same time the supply security. Furthermore it constitutes an accurate tool for the Greek long-term energy consumption prediction problem, which up today has not been faced effectively.
Directory of Open Access Journals (Sweden)
GEMAN, O.
2014-02-01
Full Text Available Neurological diseases like Alzheimer, epilepsy, Parkinson's disease, multiple sclerosis and other dementias influence the lives of patients, their families and society. Parkinson's disease (PD is a neurodegenerative disease that occurs due to loss of dopamine, a neurotransmitter and slow destruction of neurons. Brain area affected by progressive destruction of neurons is responsible for controlling movements, and patients with PD reveal rigid and uncontrollable gestures, postural instability, small handwriting and tremor. Commercial activity-promoting gaming systems such as the Nintendo Wii and Xbox Kinect can be used as tools for tremor, gait or other biomedical signals acquisitions. They also can aid for rehabilitation in clinical settings. This paper emphasizes the use of intelligent optical sensors or accelerometers in biomedical signal acquisition, and of the specific nonlinear dynamics parameters or fuzzy logic in Parkinson's disease tremor analysis. Nowadays, there is no screening test for early detection of PD. So, we investigated a method to predict PD, based on the image processing of the handwriting belonging to a candidate of PD. For classification and discrimination between healthy people and PD people we used Artificial Neural Networks (Radial Basis Function - RBF and Multilayer Perceptron - MLP and an Adaptive Neuro-Fuzzy Classifier (ANFC. In general, the results may be expressed as a prognostic (risk degree to contact PD.
Comparative Study of Artificial Neural Network and ARIMA Models in Predicting Exchange Rate
Directory of Open Access Journals (Sweden)
karamollah Bagherifard
2012-11-01
Full Text Available Capital market as an organized market has an effective role in mobilizing financial resources due to have growth and economic development of countries and many countries now in the finance firms is responsible for the required credits. In the stock market, shareholders are always seeking the highest efficiency, so the stock price prediction is important for them. Since the stock market is a nonlinear system under conditions of political, economic and psychological, it is difficult to predict the correct stock price. Thus, in the present study artificial intelligence and ARIMA method has been used to predict stock prices. Multilayer Perceptron neural network and radial basis functions are two methods used in this research. Evaluation methods, selection methods and exponential smoothing methods are compared to random walk. The results showed that AI-based methods used in predicting stock performance are more accurate. Between two methods used in artificial intelligence, a method based on radial basis functions is capable to estimate stock prices in the future with higher accuracy.
Neural-network approach to modeling liquid crystals in complex confinement
Santos-Silva, T.; Teixeira, P. I. C.; Anquetil-Deck, C.; Cleaver, D. J.
2014-05-01
Finding the structure of a confined liquid crystal is a difficult task since both the density and order parameter profiles are nonuniform. Starting from a microscopic model and density-functional theory, one has to either (i) solve a nonlinear, integral Euler-Lagrange equation, or (ii) perform a direct multidimensional free energy minimization. The traditional implementations of both approaches are computationally expensive and plagued with convergence problems. Here, as an alternative, we introduce an unsupervised variant of the multilayer perceptron (MLP) artificial neural network for minimizing the free energy of a fluid of hard nonspherical particles confined between planar substrates of variable penetrability. We then test our algorithm by comparing its results for the structure (density-orientation profiles) and equilibrium free energy with those obtained by standard iterative solution of the Euler-Lagrange equations and with Monte Carlo simulation results. Very good agreement is found and the MLP method proves competitively fast, flexible, and refinable. Furthermore, it can be readily generalized to the richer experimental patterned-substrate geometries that are now experimentally realizable but very problematic to conventional theoretical treatments.
Aspects of artificial neural networks - with applications in high energy physics
International Nuclear Information System (INIS)
Different aspects of artificial neural networks are studied and discussed. They are demonstrated to be powerful general purpose algorithms, applicable to many different problem areas like pattern recognition, function fitting and prediction. Multi-layer perceptron (MPL) models are shown to out perform previous standard approaches on both off-line and on-line analysis tasks in high energy physics, like quark flavour tagging and mass reconstruction, as well as being powerful tools for prediction tasks. It is also demonstrated how a self-organizing network can be employed to extract information from data, for instance to track down origins of unexpected model discrepancies. Furthermore, it is proved that the MPL is more efficient than the learning vector quantization technique on classification problems, by producing smoother discrimination surfaces, and that an MPL network should be trained with a noisy updating schedule if the Hessian is ill-conditioned - A result that is especially important for MPL network with more than just one hidden layer. 81 refs, 6 figs
Scientific Electronic Library Online (English)
Olanrewaju A, Oludolapo; Adisa A, Jimoh; Pule A, Kholopane.
Full Text Available In view of the close association between energy and economic growth, South Africa's aspirations for higher growth, more energy is required; formulating a long-term economic development plan and implementing an energy strategy for a country /industry necessitates establishing the correct relationship [...] between energy and the economy. As insufficient energy or a lack thereof is reported to be a major cause of social and economic poverty, it is very important to select a model to forecast the consumption of energy reasonably accurately. This study presents techniques based on the development of multilayer perceptron (MLP) and radial basis function (RBF) of artificial neural network (ANN) models, for calculating the energy consumption of South Africa's industrial sector between 1993 and 2000. The approach examines the energy consumption in relation to the gross domestic product. The results indicate a strong agreement between model predictions and observed values, since the mean absolute percentage error is below 5%. When performance indices are compared, the RBF-based model is a more accurate predictor than the MLP model.
Modeling of Soft sensor based on Artificial Neural Network for Galactic Cosmic Rays Application
Suparta, W.; Putro, W. S.
2014-10-01
For successful designing of space radiation Galactic Cosmic Rays (GCRs) model, we develop a soft sensor based on the Artificial Neural Network (ANN) model. At the first step, the soft sensor based ANN was constructed as an alternative to model space radiation environment. The structure of ANN in this model is using Multilayer Perceptron (MLP) and Levenberg Marquardt algorithms with 3 inputs and 2 outputs. In the input variable, we use 12 years data (Corr, Uncorr and Press) of GCR particles obtained from Neutron Monitor of Bartol University (Fort Smith area) and the target output is (Corr and Press) from the same source but for Inuvik area in the Polar Regions. In the validation step, we obtained the Root Mean Square Error (RMSE) value of Corr 3.8670e-004 and Press 1.3414e-004 and Variance Accounted For (VAF) of Corr 99.9839 % and Press 99.9831% during the training section. After all the results obtained, then we applied into a Matlab GUI simulation (soft sensor simulation). This simulation will display the estimation of output value from input (Corr and Press). Testing results showed an error of 0.133% and 0.014% for Corr and Press, respectively.
Optimization of bending sequence in roll forming using neural network and genetic algorithm
International Nuclear Information System (INIS)
In the roll forming process, the bending sequence plays a major role in the product quality. The optimal bending sequence results in the smallest number of passes and the flawless process. This paper presents a new optimization procedure of bending sequence in a roll forming process. The multilayer perceptron is used to build the neural network (NN), which models the variation of longitudinal strain in process while the genetic algorithm (GA) is employed to optimize the bending sequence. The data used for training the network is automatically obtained by the integration between CAD and CAE. The values of peak longitudinal strains are maximized while the number of passes is reduced to the smallest and the constraint conditions being set on the maximal longitudinal strain to avoid buckling. The overbending at final pass after spring back is also considered in this paper. Two roll forming processes are optimized in order to prove applicability and efficiency of the optimization procedure. This method maintains the longitudinal strain less than the buckling limit, whereas reducing the number of passes to the smallest. Thus, the advantages of the proposed method show the high applicability in designing and optimizing the bending sequence in the roll forming process
Use of artificial neural networks and geographic objects for classifying remote sensing imagery
Directory of Open Access Journals (Sweden)
Pedro Resende Silva
2014-06-01
Full Text Available The aim of this study was to develop a methodology for mapping land use and land cover in the northern region of Minas Gerais state, where, in addition to agricultural land, the landscape is dominated by native cerrado, deciduous forests, and extensive areas of vereda. Using forest inventory data, as well as RapidEye, Landsat TM and MODIS imagery, three specific objectives were defined: 1 to test use of image segmentation techniques for an object-based classification encompassing spectral, spatial and temporal information, 2 to test use of high spatial resolution RapidEye imagery combined with Landsat TM time series imagery for capturing the effects of seasonality, and 3 to classify data using Artificial Neural Networks. Using MODIS time series and forest inventory data, time signatures were extracted from the dominant vegetation formations, enabling selection of the best periods of the year to be represented in the classification process. Objects created with the segmentation of RapidEye images, along with the Landsat TM time series images, were classified by ten different Multilayer Perceptron network architectures. Results showed that the methodology in question meets both the purposes of this study and the characteristics of the local plant life. With excellent accuracy values for native classes, the study showed the importance of a well-structured database for classification and the importance of suitable image segmentation to meet specific purposes.
/ Artificial neural networks (ANN): prediction of sensory measurements from instrumental data
Scientific Electronic Library Online (English)
Naiara Barbosa, Carvalho; Valéria Paula Rodrigues, Minim; Rita de Cássia dos Santos Navarro, Silva; Suzana Maria, Della Lucia; Luis Aantonio, Minim.
2013-12-01
Full Text Available [...] Abstract in english The objective of this study was to predict by means of Artificial Neural Network (ANN), multilayer perceptrons, the texture attributes of light cheesecurds perceived by trained judges based on instrumental texture measurements. Inputs to the network were the instrumental texture measurements of ligh [...] t cheesecurd (imitative and fundamental parameters). Output variables were the sensory attributes consistency and spreadability. Nine light cheesecurd formulations composed of different combinations of fat and water were evaluated. The measurements obtained by the instrumental and sensory analyses of these formulations constituted the data set used for training and validation of the network. Network training was performed using a back-propagation algorithm. The network architecture selected was composed of 8-3-9-2 neurons in its layers, which quickly and accurately predicted the sensory texture attributes studied, showing a high correlation between the predicted and experimental values for the validation data set and excellent generalization ability, with a validation RMSE of 0.0506.
Computationally efficient model predictive control algorithms a neural network approach
?awry?czuk, Maciej
2014-01-01
This book thoroughly discusses computationally efficient (suboptimal) Model Predictive Control (MPC) techniques based on neural models. The subjects treated include: · A few types of suboptimal MPC algorithms in which a linear approximation of the model or of the predicted trajectory is successively calculated on-line and used for prediction. · Implementation details of the MPC algorithms for feedforward perceptron neural models, neural Hammerstein models, neural Wiener models and state-space neural models. · The MPC algorithms based on neural multi-models (inspired by the idea of predictive control). · The MPC algorithms with neural approximation with no on-line linearization. · The MPC algorithms with guaranteed stability and robustness. · Cooperation between the MPC algorithms and set-point optimization. Thanks to linearization (or neural approximation), the presented suboptimal algorithms do not require d...
Hosseini-Golgoo, S. M.; Bozorgi, H.; Saberkari, A.
2015-06-01
Performances of three neural networks, consisting of a multi-layer perceptron, a radial basis function, and a neuro-fuzzy network with local linear model tree training algorithm, in modeling and extracting discriminative features from the response patterns of a temperature-modulated resistive gas sensor are quantitatively compared. For response pattern recording, a voltage staircase containing five steps each with a 20?s plateau is applied to the micro-heater of the sensor, when 12 different target gases, each at 11 concentration levels, are present. In each test, the hidden layer neuron weights are taken as the discriminatory feature vector of the target gas. These vectors are then mapped to a 3D feature space using linear discriminant analysis. The discriminative information content of the feature vectors are determined by the calculation of the Fisher’s discriminant ratio, affording quantitative comparison among the success rates achieved by the different neural network structures. The results demonstrate a superior discrimination ratio for features extracted from local linear neuro-fuzzy and radial-basis-function networks with recognition rates of 96.27% and 90.74%, respectively.
Scientific Electronic Library Online (English)
Hamid Reza, Tavakoli; Omid Lotfi, Omran; Saman Soleimani, Kutanaei; Masoud Falahtabar, shiade.
2014-11-01
Full Text Available The main objective of the present work is to utilize feedforward multi-layer perceptron (MLP) type of artificial neural networks (ANN) to find the combined effect of nano-silica and different fibers (steel, polypropylene, glass) on the toughness, flexural strength and fracture energy of concrete is [...] evaluated.For this purpose, 40 mix plot including 4 series A and B and C and D, which contain, respectively, 0, 2, 4 and 6% weight of cement, nano-silica particles were used as a substitute for cement. Each of series includes three types of fibers (metal: 0.2, 0.3 and 0.5% volume and polypropylene: 0.1, 0.15 and 0.2 % volume and glass 0.15 and 0.2 and 0.3% by volume) were tested. The obtained results from the experimental data are used to train the MLP type artificial neural network. The Results of this study show that fibers conjugate presence and optimal percent of nano-silica improved toughness, flexural strength and fracture energy of concrete of Self-compacting concrete (SCC). Results of this study show that fibers conjugate presence and optimal per-cent of nano-silica improved toughness, toughness, fracture ener-gy and flexural strength of SCC.
Directory of Open Access Journals (Sweden)
Rajesh Rai
2010-11-01
Full Text Available In this paper, an attempt is made to apply the principles of artificial neural networks (ANN towards developing a prediction model for surface roughness during the machining of high chromium steel through face milling process. Now a days, hot chromium steel is prominently used in die and mould industry as well as in press tools, helicopter rotor blades, etc... Initially, Taguchi design of experiments was applied while conducting the experiments to reduce the time and cost of experiment. Multilayer perceptron (MLP network using Feed Forward Error Back propagation was chosen as the Neural Network architecture to describe the process model. The experiments were conducted on a C.N.C milling machine using carbide cutters. Pearson correlation coefficient was also calculated to analyze the correlation between the system inputs and selected system output i.e. surface roughness. The results of ANN modeling were substantiated by testing and validation of the resulting surface roughness values and the results have been encouraging. The outputs of Pearson correlation coefficient also showed a strong correlation between the feed per tooth and surface roughness, followed by cutting speed.
Energy Technology Data Exchange (ETDEWEB)
Labrador, I.; Carrasco, R.; Martinez, L.
1996-07-01
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs.
International Nuclear Information System (INIS)
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs
COCOMO Estimates Using Neural Networks
Directory of Open Access Journals (Sweden)
Anupama Kaushik
2012-08-01
Full Text Available Software cost estimation is an important phase in software development. It predicts the amount of effort and development time required to build a software system. It is one of the most critical tasks and an accurate estimate provides a strong base to the development procedure. In this paper, the most widely used software cost estimation model, the Constructive Cost Model (COCOMO is discussed. The model is implemented with the help of artificial neural networks and trained using the perceptron learning algorithm. The COCOMO dataset is used to train and to test the network. The test results from the trained neural network are compared with that of the COCOMO model. The aim of our research is to enhance the estimation accuracy of the COCOMO model by introducing the artificial neural networks to it.
Handwritten Arabic Numeral Recognition using a Multi Layer Perceptron
Das, Nibaran; Saha, Sudip; Haque, Syed Sahidul
2010-01-01
Handwritten numeral recognition is in general a benchmark problem of Pattern Recognition and Artificial Intelligence. Compared to the problem of printed numeral recognition, the problem of handwritten numeral recognition is compounded due to variations in shapes and sizes of handwritten characters. Considering all these, the problem of handwritten numeral recognition is addressed under the present work in respect to handwritten Arabic numerals. Arabic is spoken throughout the Arab World and the fifth most popular language in the world slightly before Portuguese and Bengali. For the present work, we have developed a feature set of 88 features is designed to represent samples of handwritten Arabic numerals for this work. It includes 72 shadow and 16 octant features. A Multi Layer Perceptron (MLP) based classifier is used here for recognition handwritten Arabic digits represented with the said feature set. On experimentation with a database of 3000 samples, the technique yields an average recognition rate of 94....
A neural-network method for diagnosing beam-position monitors in storage ring
International Nuclear Information System (INIS)
We propose a neural-network method to diagnose beam-position monitors in a storage ring. Since a circulating beam in a storage ring passes through many beam-position monitors, there is a correlation among measurements of the orbit at the monitors. A perceptron is trained to predict the orbit at a particular beam-position monitor based on orbit measurements at other beam-position monitors. If the perceptron's prediction is significantly different from the actual measurement, the corresponding beam-position monitor is considered to be malfunctioning. Experimental results from the storage ring of the Pohang light source indicate that the scheme could be used for fault diagnosis of beam-position monitors in the storage ring. The accuracy of the perceptron's prediction is found to be better than that of the numerical approach based on the measured sensitivity matrix. The neural-network approach is more economical, less disruptive and less time consuming than the numerical approach. (orig.)
Directory of Open Access Journals (Sweden)
Vitor Hugo Ferreira
2011-12-01
Full Text Available After 1991, the literature on load forecasting has been dominated by neural network based proposals. However, one major risk in using neural models is the possibility of excessive training, i.e., data overfitting. The extent of nonlinearity provided by neural network based load forecasters, which depends on the input space representation, has been adjusted using heuristic procedures. The empirical nature of these procedures makes their application cumbersome and time consuming. Autonomous modeling including automatic input selection and model complexity control has been proposed recently for short-term load forecasting. However, these techniques require the specification of an initial input set that will be processed by the model in order to select the most relevant variables. This paper explores chaos theory as a tool from non-linear time series analysis to automatic select the lags of the load series data that will be used by the neural models. In this paper, Bayesian inference applied to multi-layered perceptrons and relevance vector machines are used in the development of autonomous neural models.Após 1991, a literatura sobre previsão de carga passou a ser dominada por propostas baseadas em modelos neurais. Entretanto, um empecilho na aplicação destes modelos reside na possibilidade do ajuste excessivo dos dados, i.e, overfitting. O excesso de não-linearidade disponibilizado pelos modelos neurais de previsão de carga, que depende da representação do espaço de entrada, vem sendo ajustado de maneira heurística. Modelos autônomos incluindo técnicas automáticas e acopladas para seleção de entradas e controle de complexidade dos modelos foram propostos recentemente para previsão de carga em curto prazo. Entretanto, estas técnicas necessitam da especificação do conjunto inicial de entradas que será processado pelo modelo visando determinar aquelas mais relevantes. Este trabalho explora a teoria do caos como ferramenta de análise não-linear de séries temporais na definição automática do conjunto de atrasos de uma dada série de carga a serem utilizados como entradas de modelos neurais autônomos. Neste trabalho, inferência Bayesiana aplicada a perceptrons de múltiplas camadas e máquinas de vetores relevantes são utilizadas no desenvolvimento de modelos neurais autônomos.
Scientific Electronic Library Online (English)
Vitor Hugo, Ferreira; Alexandre Pinto Alves da, Silva.
2011-12-01
Full Text Available Após 1991, a literatura sobre previsão de carga passou a ser dominada por propostas baseadas em modelos neurais. Entretanto, um empecilho na aplicação destes modelos reside na possibilidade do ajuste excessivo dos dados, i.e, overfitting. O excesso de não-linearidade disponibilizado pelos modelos ne [...] urais de previsão de carga, que depende da representação do espaço de entrada, vem sendo ajustado de maneira heurística. Modelos autônomos incluindo técnicas automáticas e acopladas para seleção de entradas e controle de complexidade dos modelos foram propostos recentemente para previsão de carga em curto prazo. Entretanto, estas técnicas necessitam da especificação do conjunto inicial de entradas que será processado pelo modelo visando determinar aquelas mais relevantes. Este trabalho explora a teoria do caos como ferramenta de análise não-linear de séries temporais na definição automática do conjunto de atrasos de uma dada série de carga a serem utilizados como entradas de modelos neurais autônomos. Neste trabalho, inferência Bayesiana aplicada a perceptrons de múltiplas camadas e máquinas de vetores relevantes são utilizadas no desenvolvimento de modelos neurais autônomos. Abstract in english After 1991, the literature on load forecasting has been dominated by neural network based proposals. However, one major risk in using neural models is the possibility of excessive training, i.e., data overfitting. The extent of nonlinearity provided by neural network based load forecasters, which de [...] pends on the input space representation, has been adjusted using heuristic procedures. The empirical nature of these procedures makes their application cumbersome and time consuming. Autonomous modeling including automatic input selection and model complexity control has been proposed recently for short-term load forecasting. However, these techniques require the specification of an initial input set that will be processed by the model in order to select the most relevant variables. This paper explores chaos theory as a tool from non-linear time series analysis to automatic select the lags of the load series data that will be used by the neural models. In this paper, Bayesian inference applied to multi-layered perceptrons and relevance vector machines are used in the development of autonomous neural models.
Munro, Kelly; Miller, Thomas H; Martins, Claudia P B; Edge, Anthony M; Cowan, David A; Barron, Leon P
2015-05-29
The modelling and prediction of reversed-phase chromatographic retention time (tR) under gradient elution conditions for 166 pharmaceuticals in wastewater extracts is presented using artificial neural networks for the first time. Radial basis function, multilayer perceptron and generalised regression neural networks were investigated and a comparison of their predictive ability for model solutions discussed. For real world application, the effect of matrix complexity on tR measurements is presented. Measured tR for some compounds in influent wastewater varied by >1min in comparison to tR in model solutions. Similarly, matrix impact on artificial neural network predictive ability was addressed towards developing a more robust approach for routine screening applications. Overall, the best neural network had a predictive accuracy of <1.3min at the 75th percentile of all measured tR data in wastewater samples (<10% of the total runtime). Coefficients of determination for 30 blind test compounds in wastewater matrices lay at or above R(2)=0.92. Finally, the model was evaluated for application to the semi-targeted identification of pharmaceutical residues during a weeklong wastewater sampling campaign. The model successfully identified native compounds at a rate of 83±4% and 73±5% in influent and effluent extracts, respectively. The use of an HRMS database and the optimised ANN model was also applied to shortlisting of 37 additional compounds in wastewater. Ultimately, this research will potentially enable faster identification of emerging contaminants in the environment through more efficient post-acquisition data mining. PMID:25892634
Perceptron-like Algorithms and Generalization Bounds for Learning to Rank
Chaudhuri, Sougata; Tewari, Ambuj
2014-01-01
Learning to rank is a supervised learning problem where the output space is the space of rankings but the supervision space is the space of relevance scores. We make theoretical contributions to the learning to rank problem both in the online and batch settings. First, we propose a perceptron-like algorithm for learning a ranking function in an online setting. Our algorithm is an extension of the classic perceptron algorithm for the classification problem. Second, in the set...
On-line learning of non-monotonic rules by simple perceptron
Inoue, Jun-ichi; Nishimori, Hidetoshi; Kabashima, Yoshiyuki
1997-01-01
We study the generalization ability of a simple perceptron which learns unlearnable rules. The rules are presented by a teacher perceptron with a non-monotonic transfer function. The student is trained in the on-line mode. The asymptotic behaviour of the generalization error is estimated under various conditions. Several learning strategies are proposed and improved to obtain the theoretical lower bound of the generalization error.
Introduction to neural networks
International Nuclear Information System (INIS)
This lecture is a presentation of today's research in neural computation. Neural computation is inspired by knowledge from neuro-science. It draws its methods in large degree from statistical physics and its potential applications lie mainly in computer science and engineering. Neural networks models are algorithms for cognitive tasks, such as learning and optimization, which are based on concepts derived from research into the nature of the brain. The lecture first gives an historical presentation of neural networks development and interest in performing complex tasks. Then, an exhaustive overview of data management and networks computation methods is given: the supervised learning and the associative memory problem, the capacity of networks, the Perceptron networks, the functional link networks, the Madaline (Multiple Adalines) networks, the back-propagation networks, the reduced coulomb energy (RCE) networks, the unsupervised learning and the competitive learning and vector quantization. An example of application in high energy physics is given with the trigger systems and track recognition system (track parametrization, event selection and particle identification) developed for the CPLEAR experiment detectors from the LEAR at CERN. (J.S.). 56 refs., 20 figs., 1 tab., 1 appendix
Directory of Open Access Journals (Sweden)
Paula Schmitt
2012-08-01
Full Text Available The identification of lithofacies from well is usually an interpretative process based on geophysical logs since core and sidewall samples are not usually available. Despite being always sampled and described, cuttings are useful only as a reference for determining the rocks because a number of problems occur during the drilling and sampling activities. Well logs are in situ continuous records of different physical properties of the drilled rocks, which can be associated with different lithofacies by experienced log analysts. This task needs a relatively great amount of time and it is likely to be imperfect because the human analysis is subjective. Thus, any alternative method of classification with high accuracy and promptness is very welcome by the log analysts. This paper is based on Neural Networks (NNs applied in well data from the Leão Coal Mine, southern Brazil, in order to classify organic mudrocks, coals and siliciclastic sandstones, the main rocks present in the Rio Bonito and Palermo formations, by using their well logs as database. The training and validation set of the NN contain data from eight cored and logged boreholes. The input included 409 values of depth and logs of gamma-ray, spontaneous potential, resistance and resistivity for each electrofacies. The neural network model was the feedforward multilayer perceptron (MLP and the neural networks were trained with variations of the backpropagation algorithm: Levenberg-Marquardt and Resilient backpropagation. Although an accuracy of approximately 80% had been achieved in the general classification, discrepant accuracies in the classification of the different electrofacies are discussed in order to better understand the reasons that affected negatively the NN performance.
Locus minimization in breed prediction using artificial neural network approach.
Iquebal, M A; Ansari, M S; Sarika; Dixit, S P; Verma, N K; Aggarwal, R A K; Jayakumar, S; Rai, A; Kumar, D
2014-12-01
Molecular markers, viz. microsatellites and single nucleotide polymorphisms, have revolutionized breed identification through the use of small samples of biological tissue or germplasm, such as blood, carcass samples, embryos, ova and semen, that show no evident phenotype. Classical tools of molecular data analysis for breed identification have limitations, such as the unavailability of referral breed data, causing increased cost of collection each time, compromised computational accuracy and complexity of the methodology used. We report here the successful use of an artificial neural network (ANN) in background to decrease the cost of genotyping by locus minimization. The webserver is freely accessible (http://nabg.iasri.res.in/bisgoat) to the research community. We demonstrate that the machine learning (ANN) approach for breed identification is capable of multifold advantages such as locus minimization, leading to a drastic reduction in cost, and web availability of reference breed data, alleviating the need for repeated genotyping each time one investigates the identity of an unknown breed. To develop this model web implementation based on ANN, we used 51,850 samples of allelic data of microsatellite-marker-based DNA fingerprinting on 25 loci covering 22 registered goat breeds of India for training. Minimizing loci to up to nine loci through the use of a multilayer perceptron model, we achieved 96.63% training accuracy. This server can be an indispensable tool for identification of existing breeds and new synthetic commercial breeds, leading to protection of intellectual property in case of sovereignty and bio-piracy disputes. This server can be widely used as a model for cost reduction by locus minimization for various other flora and fauna in terms of variety, breed and/or line identification, especially in conservation and improvement programs. PMID:25183434
Neural Network Aided Glitch-Burst Discrimination and Glitch Classification
Rampone, Salvatore; Pierro, Vincenzo; Troiano, Luigi; Pinto, Innocenzo M.
2013-11-01
We investigate the potential of neural-network based classifiers for discriminating gravitational wave bursts (GWBs) of a given canonical family (e.g. core-collapse supernova waveforms) from typical transient instrumental artifacts (glitches), in the data of a single detector. The further classification of glitches into typical sets is explored. In order to provide a proof of concept, we use the core-collapse supernova waveform catalog produced by H. Dimmelmeier and co-Workers, and the data base of glitches observed in laser interferometer gravitational wave observatory (LIGO) data maintained by P. Saulson and co-Workers to construct datasets of (windowed) transient waveforms (glitches and bursts) in additive (Gaussian and compound-Gaussian) noise with different signal-to-noise ratios (SNR). Principal component analysis (PCA) is next implemented for reducing data dimensionality, yielding results consistent with, and extending those in the literature. Then, a multilayer perceptron is trained by a backpropagation algorithm (MLP-BP) on a data subset, and used to classify the transients as glitch or burst. A Self-Organizing Map (SOM) architecture is finally used to classify the glitches. The glitch/burst discrimination and glitch classification abilities are gauged in terms of the related truth tables. Preliminary results suggest that the approach is effective and robust throughout the SNR range of practical interest. Perspective applications pertain both to distributed (network, multisensor) detection of GWBs, where some intelligence at the single node level can be introduced, and instrument diagnostics/optimization, where spurious transients can be identified, classified and hopefully traced back to their entry points.
Directory of Open Access Journals (Sweden)
Zhe Dong
2014-02-01
Full Text Available Small modular reactors (SMRs could be beneficial in providing electricity power safely and also be viable for applications such as seawater desalination and heat production. Due to its inherent safety features, the modular high temperature gas-cooled reactor (MHTGR has been seen as one of the best candidates for building SMR-based nuclear power plants. Since the MHTGR dynamics display high nonlinearity and parameter uncertainty, it is necessary to develop a nonlinear adaptive power-level control law which is not only beneficial to the safe, stable, efficient and autonomous operation of the MHTGR, but also easy to implement practically. In this paper, based on the concept of shifted-ectropy and the physically-based control design approach, it is proved theoretically that the simple proportional-differential (PD output-feedback power-level control can provide asymptotic closed-loop stability. Then, based on the strong approximation capability of the multi-layer perceptron (MLP artificial neural network (ANN, a compensator is established to suppress the negative influence caused by system parameter uncertainty. It is also proved that the MLP-compensated PD power-level control law constituted by an experientially-tuned PD regulator and this MLP-based compensator can guarantee bounded closed-loop stability. Numerical simulation results not only verify the theoretical results, but also illustrate the high performance of this MLP-compensated PD power-level controller in suppressing the oscillation of process variables caused by system parameter uncertainty.
International Nuclear Information System (INIS)
A technique for level measurement in pressure vessels was developed using thermal probes with internal cooling and artificial neural networks (ANN's). This new concept of thermal probes was experimentally tested in an experimental facility (BETSNI) with two test sections, ST1 and ST2. Two different thermal probes were designed and constructed: concentric tubes probe and U tube probe. A data acquisition system (DAS) was assembled to record the experimental data during the tests. Steady state and transient level tests were carried out and the experimental data obtained were used as learning and recall data sets in the ANN's program RETRO-05 that simulate a multilayer perceptron with backpropagation. The results of the analysis show that the technique can be applied for level measurements in pressure vessel. The technique is applied for a less input temperature data than the initially designed to the probes. The technique is robust and can be used in case of lack of some temperature data. Experimental data available in literature from electrically heated thermal probe were also used in the ANN's analysis producing good results. The results of the ANN's analysis show that the technique can be improved and applied to level measurements in pressure vessels. (author)
Directory of Open Access Journals (Sweden)
Pablo García
2013-06-01
Full Text Available Thanks to the built in intelligence (deployment of new intelligent devices and sensors in places where historically they were not present, the Smart Grid and Microgrid paradigms are able to take advantage from aggregated load forecasting, which opens the door for the implementation of new algorithms to seize this information for optimization and advanced planning. Therefore, accuracy in load forecasts will potentially have a big impact on key operation factors for the future Smart Grid/Microgrid-based energy network like user satisfaction and resource saving, and new methods to achieve an efficient prediction in future energy landscapes (very different from the centralized, big area networks studied so far. This paper proposes different improved models to forecast next day’s aggregated load using artificial neural networks, taking into account the variables that are most relevant for the aggregated. In particular, seven models based on the multilayer perceptron will be proposed, progressively adding input variables after analyzing the influence of climate factors on aggregated load. The results section presents the forecast from the proposed models, obtained from real data.
Anderson, R. B.; Morris, Richard V.; Clegg, S. M.; Humphries, S. D.; Wiens, R. C.; Bell, J. F., III; Mertzman, S. A.
2010-01-01
The ChemCam instrument [1] on the Mars Science Laboratory (MSL) rover will be used to obtain the chemical composition of surface targets within 7 m of the rover using Laser Induced Breakdown Spectroscopy (LIBS). ChemCam analyzes atomic emission spectra (240-800 nm) from a plasma created by a pulsed Nd:KGW 1067 nm laser. The LIBS spectra can be used in a semiquantitative way to rapidly classify targets (e.g., basalt, andesite, carbonate, sulfate, etc.) and in a quantitative way to estimate their major and minor element chemical compositions. Quantitative chemical analysis from LIBS spectra is complicated by a number of factors, including chemical matrix effects [2]. Recent work has shown promising results using multivariate techniques such as partial least squares (PLS) regression and artificial neural networks (ANN) to predict elemental abundances in samples [e.g. 2-6]. To develop, refine, and evaluate analysis schemes for LIBS spectra of geologic materials, we collected spectra of a diverse set of well-characterized natural geologic samples and are comparing the predictive abilities of PLS, cascade correlation ANN (CC-ANN) and multilayer perceptron ANN (MLP-ANN) analysis procedures.
Quang Truong, Dinh; Ahn, Kyoung Kwan
2014-07-01
An ion polymer metal composite (IPMC) is an electroactive polymer that bends in response to a small applied electric field as a result of mobility of cations in the polymer network and vice versa. This paper presents an innovative and accurate nonlinear black-box model (NBBM) for estimating the bending behavior of IPMC actuators. The model is constructed via a general multilayer perceptron neural network (GMLPNN) integrated with a smart learning mechanism (SLM) that is based on an extended Kalman filter with self-decoupling ability (SDEKF). Here the GMLPNN is built with an ability to autoadjust its structure based on its characteristic vector. Furthermore, by using the SLM based on the SDEKF, the GMLPNN parameters are optimized with small computational effort, and the modeling accuracy is improved. An apparatus employing an IPMC actuator is first set up to investigate the IPMC characteristics and to generate the data for training and validating the model. The advanced NBBM model for the IPMC system is then created with the proper inputs to estimate IPMC tip displacement. Next, the model is optimized using the SLM mechanism with the training data. Finally, the optimized NBBM model is verified with the validating data. A comparison between this model and the previously developed model is also carried out to prove the effectiveness of the proposed modeling technique.
DEFF Research Database (Denmark)
S. Nadimi, Esmaeil; Nyholm JØrgensen, Rasmus
2012-01-01
Animal welfare is an issue of great importance in modern food production systems. Because animal behavior provides reliable information about animal health and welfare, recent research has aimed at designing monitoring systems capable of measuring behavioral parameters and transforming them into their corresponding behavioral modes. However, network unreliability and high-energy consumption have limited the applicability of those systems. In this study, a 2.4-GHz ZigBee-based mobile ad hoc wireless sensor network (MANET) that is able to overcome those problems is presented. The designed MANET showed high communication reliability, low energy consumption and low packet loss rate (14.8%) due to the deployment of modern communication protocols (e.g. multi-hop communication and handshaking protocol). The measured behavioral parameters were transformed into the corresponding behavioral modes using a multilayer perceptron (MLP)-based artificial neural network (ANN). The best performance of the ANN in terms of the mean squared error (MSE) and the convergence speed was achieved when it was initialized and trained using the Nguyen–Widrow and Levenberg–Marquardt back-propagation algorithms, respectively. The success rate of behavior classification into five classes (i.e. grazing, lying down, walking, standing and others) was 76.2% (?mean=1.06)(?mean=1.06) on average. The results of this study showed an important improvement regarding the performance of the designed MANET and behavior classification compared to the results of other similar studies.
DeLong, Caroline M; Heberle, Amanda L; Wisniewski, Matthew G; Mercado, Eduardo
2014-05-01
Object constancy, the ability to recognize objects despite changes in orientation, has not been well studied in the auditory modality. Dolphins use echolocation for object recognition, and objects ensonified by dolphins produce echoes that can vary significantly as a function of orientation. In this experiment, human listeners had to classify echoes from objects varying in material, shape, and size that were ensonified with dolphin signals. Participants were trained to discriminate among the objects using an 18-echo stimulus from a 10° range of aspect angles, then tested with novel aspect angles across a 60° range. Participants were typically successful recognizing the objects at all angles (M = 78 %). Artificial neural networks were trained and tested with the same stimuli with the purpose of identifying acoustic cues that enable object recognition. A multilayer perceptron performed similarly to the humans and revealed that recognition was enabled by both the amplitude and frequency of echoes, as well as the temporal dynamics of these features over the course of echo trains. These results provide insight into representational processes underlying echoic recognition in dolphins and suggest that object constancy perceived through the auditory modality is likely to parallel what has been found in the visual domain in studies with both humans and animals. PMID:24072644
Competing neural networks Finding a strategy for the game of matching pennies
Samengo, I
2000-01-01
The ability of a deterministic, plastic system to learn to imitate stochasticbehavior is analyzed. Two neural networks -actually, two perceptrons- are putto play a zero-sum game one against the other. The competition, by acting as akind of mutually supervised learning, drives the networks to produce anapproximation to the optimal strategy, that is to say, a random signal.
Scientific Electronic Library Online (English)
Eduardo Costa da, Silva; Marley M. B. R., Vellasco; Carlos R. Hall, Barbosa; Elisabeth Costa, Monteiro; Luiz A. P. de, Gusmão.
2012-10-01
Full Text Available Ao longo dos últimos anos, diversos trabalhos têm sido desenvolvidos a fim de se modelar quantitativamente o efeito GMI (Magnetoimpedância Gigante). No entanto, esses modelos adotam simplificações que afetam significativamente seu desempenho teórico-experimental e sua generalidade, e ainda são raros [...] os modelos quantitativos que incorporam parâmetros geradores de assimetria - AGMI (GMI assimétrica) - como, por exemplo, o nível CC da corrente de excitação das amostras GMI. Este trabalho objetiva o desenvolvimento de um novo modelo, suficientemente geral, que incorpore inclusive a assimetria induzida pelo nível CC da corrente de excitação, capaz de guiar os procedimentos experimentais de caracterização das amostras GMI. Assim, este artigo propõe, apresenta e discute a utilização de um modelo computacional baseado em Redes Neurais feedforward Multilayer Perceptron na modelagem da sensibilidade de módulo e fase da impedância do efeito GMI em função do campo magnético, para ligas ferromagnéticas amorfas de composição Co70Fe5Si15B10. O modelo proposto permite a obtenção da sensibilidade a partir de alguns dos principais parâmetros que a afetam: comprimento das amostras, nível CC e frequência da corrente de excitação e campo magnético externo. Abstract in english Over the past few years, several studies have been developed in order to quantitatively model the GMI effect (Giant Magnetoimpedance). However, these models adopt simplifications that significantly affect its theoretical-experimental performance and its generalization capability, and models that inc [...] orporate parameters that generate asymmetry - AGMI (asymmetric GMI) - such as the DC level of the excitation current of the GMI samples are still rare. This work aims to develop a new model, sufficiently general, which also incorporates the asymmetry induced by the DC level of the excitation current, capable of guiding the experimental procedures of characterization of the GMI samples. Thus, this paper proposes, presents and discusses the use of a computational model based on feedforward Multilayer Perceptron Neural Networks to model the impedance magnitude sensitivity and impedance phase sensitivity, of the GMI effect, as functions of the magnetic field, for Co70Fe5Si15B10 ferromagnetic amorphous alloys. The proposed model allows obtaining these sensitivities based on some of the main parameters that affect it: length of the samples, DC level and frequency of the excitation current and the external magnetic field.
Application of Artificial Neural Networks Model as Analytical Tool for Groundwater Salinity
Directory of Open Access Journals (Sweden)
Yunes Mogheir
2011-03-01
Full Text Available The main source of water in Gaza Strip is the shallow coastal aquifer. It is extremely deteriorated in terms of salinity which influenced by many variables. Studying the relation between these variables and salinity is often a complex and nonlinear process, making it suitable to model by Artificial Neural Networks (ANN. Initially, it is assumed that the salinity (represented by chloride concentration, mg/l may be affected by some variables as: recharge rate, abstraction, abstraction average rate, life time and aquifer thickness. Data were extracted from 56 municipal wells, covering the area of Gaza Strip. After a number of modeling trials, the best neural network was determined to be Multilayer Perceptron network (MLP with four layers: an input layer of 6 neurons, first hidden layer with 10 neurons, second hidden layer with 7 neurons and the output layer with 1 neuron which gives the final chloride concentration. The ANN model generated very good results depending on the high correlation between the observed and simulated values of chloride concentration. The correlation coefficient (r was 0.9848. The high value of (r showed that the simulated chloride concentration values using the ANN model were in very good agreement with the observed chloride concentration which mean that ANN model is useful and applicable for groundwater salinity modeling. ANN model was successfully utilized as analytical tool to study influence of the input variables on chloride concentration. It proved that chloride concentration in groundwater is reduced by decreasing abstraction, abstraction average rate and life time. Furthermore, it is reduced by increasing recharge rate and aquifer thickness.
Monthly evaporation forecasting using artificial neural networks and support vector machines
Tezel, Gulay; Buyukyildiz, Meral
2015-02-01
Evaporation is one of the most important components of the hydrological cycle, but is relatively difficult to estimate, due to its complexity, as it can be influenced by numerous factors. Estimation of evaporation is important for the design of reservoirs, especially in arid and semi-arid areas. Artificial neural network methods and support vector machines (SVM) are frequently utilized to estimate evaporation and other hydrological variables. In this study, usability of artificial neural networks (ANNs) (multilayer perceptron (MLP) and radial basis function network (RBFN)) and ?-support vector regression (SVR) artificial intelligence methods was investigated to estimate monthly pan evaporation. For this aim, temperature, relative humidity, wind speed, and precipitation data for the period 1972 to 2005 from Beysehir meteorology station were used as input variables while pan evaporation values were used as output. The Romanenko and Meyer method was also considered for the comparison. The results were compared with observed class A pan evaporation data. In MLP method, four different training algorithms, gradient descent with momentum and adaptive learning rule backpropagation (GDX), Levenberg-Marquardt (LVM), scaled conjugate gradient (SCG), and resilient backpropagation (RBP), were used. Also, ?-SVR model was used as SVR model. The models were designed via 10-fold cross-validation (CV); algorithm performance was assessed via mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R 2). According to the performance criteria, the ANN algorithms and ?-SVR had similar results. The ANNs and ?-SVR methods were found to perform better than the Romanenko and Meyer methods. Consequently, the best performance using the test data was obtained using SCG(4,2,2,1) with R 2 = 0.905.
Isomorphisms in Multilayer Networks
Kivelä, Mikko
2015-01-01
We extend the concept of graph isomorphisms to multilayer networks, and we identify multiple types of isomorphisms. For example, in multilayer networks with a single "aspect" (i.e., type of layering), permuting vertex labels, layer labels, and both of types of layers each yield a different type of isomorphism. We discuss how multilayer network isomorphisms naturally lead to defining isomorphisms in any type of network that can be represented as a multilayer network. This thereby yields isomorphisms for multiplex networks, temporal networks, networks with both such features, and more. We reduce each of the multilayer network isomorphism problems to a graph isomorphism problem, and we use this reduction to prove that the multilayer network isomorphism problem is computationally equally hard as the graph isomorphism problem. One can thus use software that has been developed to solve graph isomorphism problems as a practical means for solving multilayer network isomorphism problems.
An Improved Compression Scheme Using Particle Swarm Optimised Neural Network for ECG Signals
Jayashree, M. J.; Sukesh Kumar, Dr A.
2013-01-01
The emergence of artificial neural networks in signal processing has led to improvements in signal compression. In this paper a comparison of ECG signal compression using Multi Layer Perceptron(MLP) neural network and Particle Swarm Optimisation(PSO) is made. For this different back propagation artificial networks are used as compressor and decompressor. Particle swarm optimisation (PSO) is used for optimising the learning rate and momentum. The proposed algorithm yields minimum mean square e...
Transformation of Neural State Space Models into LFT Models for Robust Control Design
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon; Trangbæk, Klaus
2000-01-01
This paper considers the extraction of linear state space models and uncertainty models from neural networks trained as state estimators with direct application to robust control. A new method for writing a neural state space model in a linear fractional transformation form in a non-conservative way is proposed, and it is demonstrated how a standard robust control law can be designed for a system described by means of a multi layer perceptron.
Kumar Mishra, Sudhansu; Panda, Ganpati; Meher, Sukadev
2010-01-01
Here we have presented an alternate ANN structure called functional link ANN (FLANN) for image denoising. In contrast to a feed forward ANN structure i.e. a multilayer perceptron (MLP), the FLANN is basically a single layer structure in which non-linearity is introduced by enhancing the input pattern with nonlinear function expansion. In this work three different expansions is applied. With the proper choice of functional expansion in a FLANN , this network performs as good as and in some cas...
Learning and Generalisation in Neural Networks with Local Preprocessing
Kutsia, Merab
2007-01-01
We study learning and generalisation ability of a specific two-layer feed-forward neural network and compare its properties to that of a simple perceptron. The input patterns are mapped nonlinearly onto a hidden layer, much larger than the input layer, and this mapping is either fixed or may result from an unsupervised learning process. Such preprocessing of initially uncorrelated random patterns results in the correlated patterns in the hidden layer. The hidden-to-output mapping of the net...
Chakrabarti, Bikas K.; Dasgupta, Prabir K.
1992-07-01
We review here briefly some of our recent studies on neural network modelling. We discuss the studies on relaxation and growth of correlation in the Hopfield model, increase in memory loading capacity with an extended Hopfield-like model with delayed dynamics, the prediction capability of time series with a multi-layered network with supervised learning and studies on some generalised versions of the travelling salesman problem.
Plaza, Javier; Martinez, Pablo J.; Perez, Rosa M.; Plaza, Antonio; Cantero, Carmen
2004-12-01
The development of hyperspectral imaging instruments designed for water quality assessment, such as the DLR Reflective Optics System Imaging Spectrometer (ROSIS), has created a need for methods which are able to infer water quality parameters of turbid inland waters, and to use those parameters as indicators for water quality. It has been reported that the irradiance reflectance and, subsequently, the radiance collected by the sensor in such scenario is usually the result of an intimate mixture of sub-pixel components. As a result, the commonly used linear mixing model may not be appropriate to describe materials composition. In this work, we develop a nonlinear neural network-based algorithm for estimating water constituent concentrations, with special emphasis on the detection of chemical substances provided by agricultural and industrial sources. The proposed neural network architecture consists of a modified multi-layer perceptron (MLP) whose entries are determined by a linear function activation provided by a Hopfield neural network algorithm (HNN). The combined HNN/MLP supervised model has been used to estimate the concentration of water constituents by training the MLP with ground spectra of nitrogen salts, which are commonly used in extensive agricultural farms. Such spectra were collected using a Minolta spectro-photometer. The model was calibrated in our laboratory by using mixtures of water and nitrogen salt in different proportions. Hyperspectral images collected by the ROSIS imaging spectrometer over the Guadiloba reservoir in Cáceres, SW Spain, are also used in this study to estimate the concentration of nitrogen salts in turbid inland waters.
Guo, Zhiqiang; Wang, Huaiqing; Yang, Jie; Miller, David J
2015-01-01
In this paper, we propose and implement a hybrid model combining two-directional two-dimensional principal component analysis ((2D)2PCA) and a Radial Basis Function Neural Network (RBFNN) to forecast stock market behavior. First, 36 stock market technical variables are selected as the input features, and a sliding window is used to obtain the input data of the model. Next, (2D)2PCA is utilized to reduce the dimension of the data and extract its intrinsic features. Finally, an RBFNN accepts the data processed by (2D)2PCA to forecast the next day's stock price or movement. The proposed model is used on the Shanghai stock market index, and the experiments show that the model achieves a good level of fitness. The proposed model is then compared with one that uses the traditional dimension reduction method principal component analysis (PCA) and independent component analysis (ICA). The empirical results show that the proposed model outperforms the PCA-based model, as well as alternative models based on ICA and on the multilayer perceptron. PMID:25849483
International Nuclear Information System (INIS)
Highlights: ? Solar radiation estimation based on Gene Expression Programming is unexplored. ? This approach is evaluated for the first time in this study. ? Other artificial intelligence models (ANN and ANFIS) are also included in the study. ? New alternatives for solar radiation estimation based on temperatures are provided. - Abstract: Surface incoming solar radiation is a key variable for many agricultural, meteorological and solar energy conversion related applications. In absence of the required meteorological sensors for the detection of global solar radiation it is necessary to estimate this variable. Temperature based modeling procedures are reported in this study for estimating daily incoming solar radiation by using Gene Expression Programming (GEP) for the first time, and other artificial intelligence models such as Artificial Neural Networks (ANNs), and Adaptive Neuro-Fuzzy Inference System (ANFIS). A comparison was also made among these techniques and traditional temperature based global solar radiation estimation equations. Root mean square error (RMSE), mean absolute error (MAE) RMSE-based skill score (SSRMSE), MAE-based skill score (SSMAE) and r2 criterion of Nash and Sutcliffe criteria were used to assess the models’ performances. An ANN (a four-input multilayer perceptron with 10 neurons in the hidden layer) presented the best performance among the studied models (2.93 MJ m?2 d?1 oup>?2 d?1 of RMSE). The ability of GEP approach to model global solar radiation based on daily atmospheric variables was found to be satisfactory.
International Nuclear Information System (INIS)
Fall prevention lacks easy, quantitative and wearable methods for the classification of fall-risk (FR). Efforts must be thus devoted to the choice of an ad hoc classifier both to reduce the size of the sample used to train the classifier and to improve performances. A new methodology that uses a neural network (NN) and a wearable device are hereby proposed for this purpose. The NN uses kinematic parameters assessed by a wearable device with accelerometers and rate gyroscopes during a posturography protocol. The training of the NN was based on the Mahalanobis distance and was carried out on two groups of 30 elderly subjects with varying fall-risk Tinetti scores. The validation was done on two groups of 100 subjects with different fall-risk Tinetti scores and showed that, both in terms of specificity and sensitivity, the NN performed better than other classifiers (naive Bayes, Bayes net, multilayer perceptron, support vector machines, statistical classifiers). In particular, (i) the proposed NN methodology improved the specificity and sensitivity by a mean of 3% when compared to the statistical classifier based on the Mahalanobis distance (SCMD) described in Giansanti (2006 Physiol. Meas. 27 1081–90); (ii) the assessed specificity was 97%, the assessed sensitivity was 98% and the area under receiver operator characteristics was 0.965. (note)
Multilayer Insulation Material Guidelines
Finckenor, M. M.; Dooling, D.
1999-01-01
Multilayer Insulation Material Guidelines provides data on multilayer insulation materials used by previous spacecraft such as Spacelab and the Long-Duration Exposure Facility and outlines other concerns. The data presented in the document are presented for information only. They can be used as guidelines for multilayer insulation design for future spacecraft provided the thermal requirements of each new design and the environmental effects on these materials are taken into account.
Scientific Electronic Library Online (English)
Ernesto, Gómez Vargas; Nelson, Obregón Neira; Virgilio, Socarras Quintero.
2010-07-01
Full Text Available Este artículo muestra los resultados obtenidos en la exploración de la bondad de la implementación del modelo neurodifuso ANFIS y de las redes neuronales para la predicción de caudales medios mensuales en la cuenca del Rio Bogotá en la ciudad de Villapinzón. Se desarrolla e implementa el modelo ANFI [...] S y se evalúa el comportamiento de seis modelos, al variar el número de entradas, y el número y tipo de conjuntos difusos (funciones de pertenencia), que son los parámetros fundamentales del modelo ANFIS. Los resultados se comparan con los obtenidos con las redes neuronales perceptrón multicapa. Abstract in english This paper shows the results in the exploration of the benefits of the implementation of neuro-fuzzy AN-FIS model and neural networks for the prediction of monthly mean flows in the basin of Bogota River in Villapinzón. The ANFIS model is developed, implemented and the performance of six models is e [...] valuated bychanging entries number, number and type of fuzzy sets (membership functions), which are the basic parameters of the ANFIS model. The results are compared with those obtained with multilayer perceptron neural networks.
Aksin, Devrim Y?lmaz; Aras, Sualp; Goknar, Izzet Cem
2011-01-01
The implementation of a perceptron that can classify data separable by two parallel hyper-planes or equivalentlyof a Single-Level TL-XOR gate is proposed using 10 MOS transistors and 2 capacitors. The functional subblockdecomposition of the Perceptron with two separating hyper-planes, its CMOS implementation explainingthe operation of each sub-block and simulation results, obtained using the SpectreS simulator and AMS 0.8mmCMOS double-poly double-metal technology parameters are presented. A b...
Directory of Open Access Journals (Sweden)
Siamak Khorram
2009-07-01
Full Text Available This paper focuses on an automated ANN classification system consisting of two modules: an unsupervised Kohonen’s Self-Organizing Mapping (SOM neural network module, and a supervised Multilayer Perceptron (MLP neural network module using the Backpropagation (BP training algorithm. Two training algorithms were provided for the SOM network module: the standard SOM, and a refined SOM learning algorithm which incorporated Simulated Annealing (SA. The ability of our automated ANN system to perform Land-Use/Land-Cover (LU/LC classifications of a Landsat Thematic Mapper (TM image was tested using a supervised MLP network, an unsupervised SOM network, and a combination of SOM with SA network. Our case study demonstrated that the ANN classification system fulfilled the tasks of network training pattern creation, network training, and network generalization. The results from the three networks were assessed via a comparison with reference data derived from the high spatial resolution Digital Colour Infrared (CIR Digital Orthophoto Quarter Quad (DOQQ data. The supervised MLP network obtained the most accurate classification accuracy as compared to the two unsupervised SOM networks. Additionally, the classification performance of the refined SOM network was found to be significantly better than that of the standard SOM network essentially due to the incorporation of SA. This is mainly due to the SA-assisted classification utilizing the scheduling cooling scheme. It is concluded that our automated ANN classification system can be utilized for LU/LC applications and will be particularly useful when traditional statistical classification methods are not suitable due to a statistically abnormal distribution of the input data.
Directory of Open Access Journals (Sweden)
Savi? Ivan M.
2013-01-01
Full Text Available The aim of this paper was to model and optimize the process of total flavonoid extraction from the green tea using the artificial neural network and response surface methodology, as well as the comparation of these optimization techniques. The extraction time, ethanol concentration and solid-to-liquid ratio were identified as the independent variables, while the yield of total flavonoid was selected as the dependent variable. Central composite design (CCD, using second-order polynomial model and multilayer perceptron (MLP were used for fitting the obtained experimental data. The values of root mean square error, cross-validated correlation coefficient and normal correlation coefficient for both models indicate that the artificial neural network is better in prediction of total flavonoid yield than CCD. The optimal conditions using the desirability function at CCD model was achieved for the extraction time of 32.5 min, ethanol concentration of 100% (v/v and solid-to-liquid ratio of 1:32.5 (m/v. The predicted yield at these conditions was 2.11 g/100 g of the dried extract (d.e., while the experimentally obtained was 2.39 g/100 g d.e. The extraction process was optimized by the use of simplex method at MLP model. The optimal value of total flavonoid yield (2.80 g/100 g d.e. was achieved after the extraction time of 27.2 min using ethanol concentration of 100% (v/v at solid-to-liquid ratio of 1:20.7 (m/v. The predicted value of response under optimal conditions for MLP model was also experimentally confirmed (2.71 g/100 g d.e..
A multi-scale hybrid neural network retrieval model for dust storm detection, a study in Asia
Wong, Man Sing; Xiao, Fei; Nichol, Janet; Fung, Jimmy; Kim, Jhoon; Campbell, James; Chan, P. W.
2015-05-01
Dust storms are known to have adverse effects on human health and significant impact on weather, air quality, hydrological cycle, and ecosystem. Atmospheric dust loading is also one of the large uncertainties in global climate modeling, due to its significant impact on the radiation budget and atmospheric stability. Observations of dust storms in humid tropical south China (e.g. Hong Kong), are challenging due to high industrial pollution from the nearby Pearl River Delta region. This study develops a method for dust storm detection by combining ground station observations (PM10 concentration, AERONET data), geostationary satellite images (MTSAT), and numerical weather and climatic forecasting products (WRF/Chem). The method is based on a hybrid neural network (NN) retrieval model for two scales: (i) a NN model for near real-time detection of dust storms at broader regional scale; (ii) a NN model for detailed dust storm mapping for Hong Kong and Taiwan. A feed-forward multilayer perceptron (MLP) NN, trained using back propagation (BP) algorithm, was developed and validated by the k-fold cross validation approach. The accuracy of the near real-time detection MLP-BP network is 96.6%, and the accuracies for the detailed MLP-BP neural network for Hong Kong and Taiwan is 74.8%. This newly automated multi-scale hybrid method can be used to give advance near real-time mapping of dust storms for environmental authorities and the public. It is also beneficial for identifying spatial locations of adverse air quality conditions, and estimates of low visibility associated with dust events for port and airport authorities.
Feng, Xiao; Li, Qi; Zhu, Yajie; Hou, Junxiong; Jin, Lingyan; Wang, Jingjie
2015-04-01
In the paper a novel hybrid model combining air mass trajectory analysis and wavelet transformation to improve the artificial neural network (ANN) forecast accuracy of daily average concentrations of PM2.5 two days in advance is presented. The model was developed from 13 different air pollution monitoring stations in Beijing, Tianjin, and Hebei province (Jing-Jin-Ji area). The air mass trajectory was used to recognize distinct corridors for transport of "dirty" air and "clean" air to selected stations. With each corridor, a triangular station net was constructed based on air mass trajectories and the distances between neighboring sites. Wind speed and direction were also considered as parameters in calculating this trajectory based air pollution indicator value. Moreover, the original time series of PM2.5 concentration was decomposed by wavelet transformation into a few sub-series with lower variability. The prediction strategy applied to each of them and then summed up the individual prediction results. Daily meteorological forecast variables as well as the respective pollutant predictors were used as input to a multi-layer perceptron (MLP) type of back-propagation neural network. The experimental verification of the proposed model was conducted over a period of more than one year (between September 2013 and October 2014). It is found that the trajectory based geographic model and wavelet transformation can be effective tools to improve the PM2.5 forecasting accuracy. The root mean squared error (RMSE) of the hybrid model can be reduced, on the average, by up to 40 percent. Particularly, the high PM2.5 days are almost anticipated by using wavelet decomposition and the detection rate (DR) for a given alert threshold of hybrid model can reach 90% on average. This approach shows the potential to be applied in other countries' air quality forecasting systems.
Directory of Open Access Journals (Sweden)
M.R. Mustafa
2014-05-01
Full Text Available Estimation of suspended sediments in rivers using soft computing techniques has been extensively performed around the world since 1990’s. However, accuracy in the results was always found to be highly desired and a profound crucial task. This study presents a thorough comparison between the performances of best basis function of Radial Basis Functions (RBF and the best training algorithm in Multilayer Perceptron (MLP neural networks for prediction of suspended sediments in Pari River, Perak, Malaysia. Time series data of water discharge and suspended sediments was used to develop MLP and RBF models. A comparison between six basis functions was performed to identify the most appropriate and best basis function for the selected time series of the river’s data. The performance of the models was compared using several statistical measures including coefficient of determination, coefficient of efficiency and mean absolute error. The performance of the best RBF function was compared with the previously identified best training algorithm of MLP neural networks. The results showed that comparison of various basis functions is always advantageous to achieve the most appropriate basis function for the accurate prediction of the time series data. The results also showed that the performances of both particular RBF and MLP models were close to each other and capable to capture the exact pattern of the sediment data in the river. However, the RBF model showed some inconsistency while predicting the time series data. Furthermore, RBF modeling required more investigation to choose appropriate value for the predefined parameters as compared to MLP modeling.