Prediction of Parametric Roll Resonance by Multilayer Perceptron Neural Network
Mi?guez Gonza?lez, M.; Lo?pez Pen?a, F.; Di?az Casa?s, V.; Galeazzi, Roberto; Blanke, Mogens
2011-01-01
Parametric roll resonance is a ship stability related phenomenon that generates sudden large amplitude oscillations up to 30-40 degrees of roll. This can cause severe damage, and it can put the crew in serious danger. The need for a parametric rolling real time prediction system has been acknowledged in the last few years. This work proposes a prediction system based on a multilayer perceptron (MP) neural network. The training and testing of the MP network is accomplished ...
Multilayer perceptron neural network for flow prediction.
Araujo, P; Astray, G; Ferrerio-Lage, J A; Mejuto, J C; Rodriguez-Suarez, J A; Soto, B
2011-01-01
Artificial neural networks (ANNs) have proven to be a tool for characterizing, modeling and predicting many of the non-linear hydrological processes such as rainfall-runoff, groundwater evaluation or simulation of water quality. After proper training they are able to generate satisfactory predictive results for many of these processes. In this paper they have been used to predict 1 or 2 days ahead the average and maximum daily flow of a river in a small forest headwaters in northwestern Spain. The inputs used were the flow and climate data (precipitation, temperature, relative humidity, solar radiation and wind speed) as recorded in the basin between 2003 and 2008. Climatic data have been utilized in a disaggregated form by considering each one as an input variable in ANN(1), or in an aggregated form by its use in the calculation of evapotranspiration and using this as input variable in ANN(2). Both ANN(1) and ANN(2), after being trained with the data for the period 2003-2007, have provided a good fit between estimated and observed data, with R(2) values exceeding 0.95. Subsequently, its operation has been verified making use of the data for the year 2008. The correlation coefficients obtained between the data estimated by ANNs and those observed were in all cases superior to 0.85, confirming the capacity of ANNs as a model for predicting average and maximum daily flow 1 or 2 days in advance. PMID:21088795
Prediction of Parametric Roll Resonance by Multilayer Perceptron Neural Network
DEFF Research Database (Denmark)
Míguez González, M; López Peña, F.
2011-01-01
Parametric roll resonance is a ship stability related phenomenon that generates sudden large amplitude oscillations up to 30-40 degrees of roll. This can cause severe damage, and it can put the crew in serious danger. The need for a parametric rolling real time prediction system has been acknowledged in the last few years. This work proposes a prediction system based on a multilayer perceptron (MP) neural network. The training and testing of the MP network is accomplished by feeding it with simulated data of a three degrees-of-freedom nonlinear model of a fishing vessel. The neural network is shown to be capable of forecasting the ship’s roll motion in realistic scenarios.
Optical proximity correction using a multilayer perceptron neural network
International Nuclear Information System (INIS)
Optical proximity correction (OPC) is one of the resolution enhancement techniques (RETs) in optical lithography, where the mask pattern is modified to improve the output pattern fidelity. Algorithms are needed to generate the modified mask pattern automatically and efficiently. In this paper, a multilayer perceptron (MLP) neural network (NN) is used to synthesize the mask pattern. We employ the pixel-based approach in this work. The MLP takes the pixel values of the desired output wafer pattern as input, and outputs the optimal mask pixel values. The MLP is trained with the backpropagation algorithm, with a training set retrieved from the desired output pattern, and the optimal mask pattern obtained by the model-based method. After training, the MLP is able to generate the optimal mask pattern non-iteratively with good pattern fidelity. (paper)
Inversion of Self Potential Anomalies with Multilayer Perceptron Neural Networks
Kaftan, Ilknur; S?nd?rg?, Petek; Akdemir, Özer
2014-08-01
This study investigates the inverse solution on a buried and polarized sphere-shaped body using the self-potential method via multilayer perceptron neural networks (MLPNN). The polarization angle ( ?), depth to the centre of sphere ( h), electrical dipole moment ( K) and the zero distance from the origin ( x 0) were estimated. For testing the success of the MLPNN for sphere model, parameters were also estimated by the traditional Damped Least Squares (Levenberg-Marquardt) inversion technique (DLS). The MLPNN was first tested on a synthetic example. The performance of method was also tested for two S/N ratios (5 % and 10 %) by adding noise to the same synthetic data, the estimated model parameters with MLPNN and DLS method are satisfactory. The MLPNN also applied for the field data example in ?zmir, Urla district, Turkey, with two cross-section data evaluated by MLPNN and DLS, and the two methods showed good agreement.
Vanzella, E.; Cristiani, S.; Fontana, A.; Nonino, M.; Arnouts, S.; Giallongo, E.; Grazian, A.; Fasano, G.; Popesso, P.; Saracco, P.; Zaggia, S.
2003-01-01
We present a technique for the estimation of photometric redshifts based on feed-forward neural networks. The Multilayer Perceptron (MLP) Artificial Neural Network is used to predict photometric redshifts in the HDF-S from an ultra deep multicolor catalog. Various possible approaches for the training of the neural network are explored, including the deepest and most complete spectroscopic redshift catalog currently available (the Hubble Deep Field North dataset) and models o...
Charniya, Nadir N.
2013-01-01
The Multi-layer Perceptron Neural Networks (MLP NN) are well known for their simplicity, ease of training for small-scale problems, and suitability for online implementation. This paper presents the methodology and challenges in the design of near-optimal MLP NN based classifier with maximize classification accuracy under the constraints of minimum network dimension for implementation intelligent sensors.
Classification of fused face images using multilayer perceptron neural network
Bhattacharjee, Debotosh; Nasipuri, Mita; Basu, Dipak Kumar; Kundu, Mahantapas
2010-01-01
This paper presents a concept of image pixel fusion of visual and thermal faces, which can significantly improve the overall performance of a face recognition system. Several factors affect face recognition performance including pose variations, facial expression changes, occlusions, and most importantly illumination changes. So, image pixel fusion of thermal and visual images is a solution to overcome the drawbacks present in the individual thermal and visual face images. Fused images are projected into eigenspace and finally classified using a multi-layer perceptron. In the experiments we have used Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database benchmark thermal and visual face images. Experimental results show that the proposed approach significantly improves the verification and identification performance and the success rate is 95.07%. The main objective of employing fusion is to produce a fused image that provides the most detailed and reliable information. Fusion of multip...
DEFF Research Database (Denmark)
Proud, Simon Richard
2015-01-01
A multilayer perceptron neural network cloud mask for Meteosat Second Generation SEVIRI (Spinning Enhanced Visible and Infrared Imager) images is introduced and evaluated. The model is trained for cloud detection on MSG SEVIRI daytime data. It consists of a multi-layer perceptron with one hidden sigmoid layer, trained with the error back-propagation algorithm. The model is fed by six bands of MSG data (0.6, 0.8, 1.6, 3.9, 6.2 and 10.8 ?m) with 10 hidden nodes. The multiple-layer perceptrons lead to a cloud detection accuracy of 88.96%, when trained to map two predefined values that classify cloud and clear sky. The network was further evaluated using sixty MSG images taken at different dates. The network detected not only bright thick clouds but also thin or less bright clouds. The analysis demonstrated the feasibility of using machine learning models of cloud detection in MSG SEVIRI imagery.
Multilayer perceptron for nonlinear programming
International Nuclear Information System (INIS)
A new method for solving nonlinear programming problems within the framework of a multilayer neural network perceptron is proposed. The method employs the Penalty Function method to transform a constrained optimization problem into a sequence of unconstrained optimization problems and then solves the sequence of unconstrained optimizations of the transformed problem by training a series of multilayer perceptrons. The neural network formulation is represented in such a way that the multilayer perceptron prediction error to be minimized mimics the objective function of the unconstrained problem, and therefore, the minimization of the objective function for each unconstrained optimization is attained by training a single perceptron. The multilayer perceptron allows for the transformation of problems with two-sided bounding constraints on the decision variables x, e.g., a?xn?b, into equivalent optimization problems in which these constraints do not explicitly appear. Hence, when these are the only constraints in the problem, the transformed problem is constraint free (i.e., the transformed objective function contains no penalty terms) and is solved by training a multilayer perceptron only once. In addition, we present a new Penalty Function method for solving nonlinear programming problems that is parameter free and guarantees that feasible solutions are obtained when the optimal solution is on the boundary of the feasible region. Simulation results, includble region. Simulation results, including an example from operations research, illustrate the proposed methods.
International Nuclear Information System (INIS)
This paper deals with the controversial topic of the selection of the parameters of a genetic algorithm, in this case hierarchical, used for training of multilayer perceptron neural networks for the binary classification. The parameters to select are the crossover and mutation probabilities of the control and parametric genes and the permanency percent. The results can be considered as a guide for using this kind of algorithm.
Flávio Clésio Silva de Souza; Renato José Sassi
2014-01-01
The purpose of the present research is to apply a Multilayer Perceptron (MLP) neural network technique to create classification models from a portfolio of Non-Performing Loans (NPLs) to classify this type of credit derivative. These credit derivatives are characterized as the amount of loans that were not paid and are already overdue more than 90 days. Since these titles are, because of legislative motives, moved by losses, Credit Rights Investment Funds (FDIC) performs the purchase of these ...
Mohammad Fathian,; Kia, Arash N.
2012-01-01
In this paper, the problem of predicting the exchange rate time series in the foreign exchange rate market is going to be solved using a time-delayed multilayer perceptron neural network with gold price as external factor. The input for the learning phase of the artificial neural network are the exchange rate data of the last five days plus the gold price in two different currencies of the exchange rate as the external factor for helping the artificial neural network improving its forecast ac...
Ouadfeul, S.; Aliouane, L.; Tourtchine, V.
2013-09-01
In this paper, a tentative of geomagnetic storms prediction is implanted by analyzing the International Real-Time Magnetic Observatory Network data using the Artificial Neural Network (ANN). The implanted method is based on the prediction of future horizontal geomagnetic field component using a Multilayer Perceptron (MLP) neural network model. The input is the time and the output is the X and Y magnetic field components. Application to geomagnetic data of Mai 2002 shows that the implanted ANN model can greatly help the geomagnetic storms prediction.
Multidimensional scaling using multilayer perceptron
Tuovinen, Tommi
2013-01-01
The objective of this thesis is to introduce the reader to the concepts of neural network and multidimensional scaling and to demonstrate how these two can be used together. The thesis introduces a construction in which a multilayer perceptron is trained by means of multidimensional scaling in order to perform dimensionality reduction. The algorithm is tested in four different test experiments.
Generation of hourly irradiation synthetic series using the neural network multilayer perceptron
Energy Technology Data Exchange (ETDEWEB)
Hontoria, L.; Aguilera, J. [Universidad de Jaen, Linares-Jaen (Spain). Dpto. de Electronica; Zufiria, P. [Ciudad Universitaria, Madrid (Spain). Grupo de Redes Neuronales
2002-05-01
In this work, a methodology based on the neural network model called multilayer perceptron (MLP) to solve a typical problem in solar energy is presented. This methodology consists of the generation of synthetic series of hourly solar irradiation. The model presented is based on the capacity of the MLP for finding relations between variables for which interrelation is unknown explicitly. The information available can be included progressively at the series generator at different stages. A comparative study with other solar irradiation synthetic generation methods has been done in order to demonstrate the validity of the one proposed. (author)
Directory of Open Access Journals (Sweden)
Alireza Taravat
2015-02-01
Full Text Available A multilayer perceptron neural network cloud mask for Meteosat Second Generation SEVIRI (Spinning Enhanced Visible and Infrared Imager images is introduced and evaluated. The model is trained for cloud detection on MSG SEVIRI daytime data. It consists of a multi-layer perceptron with one hidden sigmoid layer, trained with the error back-propagation algorithm. The model is fed by six bands of MSG data (0.6, 0.8, 1.6, 3.9, 6.2 and 10.8 ?m with 10 hidden nodes. The multiple-layer perceptrons lead to a cloud detection accuracy of 88.96%, when trained to map two predefined values that classify cloud and clear sky. The network was further evaluated using sixty MSG images taken at different dates. The network detected not only bright thick clouds but also thin or less bright clouds. The analysis demonstrated the feasibility of using machine learning models of cloud detection in MSG SEVIRI imagery.
Classification of fuels using multilayer perceptron neural networks
International Nuclear Information System (INIS)
Electrical impedance data obtained with an array of conducting polymer chemical sensors was used by a neural network (ANN) to classify fuel adulteration. Real samples were classified with accuracy greater than 90% in two groups: approved and adulterated.
Übeyli, Mustafa; Übeyli, Elif Derya
2008-12-01
Artificial neural networks (ANNs) have recently been utilized in the nuclear technology applications since they are fast, precise and flexible vehicles to modeling, simulation and optimization. This paper presents a new approach based on multilayer perceptron neural networks (MLPNNs) for the estimation of some important neutronic parameters (net 239Pu production, tritium breeding ratio, cumulative fissile fuel enrichment, and fission rate) of a high power density fusion-fission (hybrid) reactor using light water reactor (LWR) spent fuel. A comparison of the results obtained by the MLPNNs and those found by using the code (Scale 4.3) was carried out. The results pointed out that the MLPNNs trained with least mean squares (LMS) algorithm could provide an accurate computation of the main neutronic parameters for the high power density reactor.
Directory of Open Access Journals (Sweden)
Mohammad Fathian
2012-04-01
Full Text Available In this paper, the problem of predicting the exchange rate time series in the foreign exchange rate market is going to be solved using a time-delayed multilayer perceptron neural network with gold price as external factor. The input for the learning phase of the artificial neural network are the exchange rate data of the last five days plus the gold price in two different currencies of the exchange rate as the external factor for helping the artificial neural network improving its forecast accuracy. The five-day delay has been chosen because of the weekly cyclic behavior of the exchange rate time series with the consideration of two holidays in a week. The result of forecasts are then compared with using the multilayer peceptron neural network without gold price external factor by two most important evaluation techniques in the literature of exchange rate prediction. For the experimental analysis phase, the data of three important exchange rates of EUR/USD, GBP/USD, and USD/JPY are used.
LALIT KUMAR BEHERA; MAYA NAYAK; SAREETA MOHANTY
2011-01-01
This paper presents discrete wavelet transform and the S-transform based neural classifier scheme used for time series data mining of power quality events occurring due to power signal disturbances. The DWT and the S –transform are used for feature extraction and then the extracted features are classified with neural classifiers such as multilayered perceptron network (MLP) for pattern classification, data mining and subsequent knowledge discovery.
Piotrowski, A.; Wallis, S. G.; Napio?rkowski, J. J.; Rowin?ski, P. M.
2007-01-01
The prediction of temporal concentration profiles of a transported pollutant in a river is still a subject of ongoing research efforts worldwide. The present paper is aimed at studying the possibility of using Multi-Layer Perceptron Neural Networks to evaluate the whole concentration versus time profile at several cross-sections of a river under various flow conditions, using as little information about the river system as possible. In contrast with the earlier neural networks based work on l...
An Analog Multilayer Perceptron Neural Network for a Portable Electronic Nose
Directory of Open Access Journals (Sweden)
Chih-Heng Pan
2012-12-01
Full Text Available This study examines an analog circuit comprising a multilayer perceptron neural network (MLPNN. This study proposes a low-power and small-area analog MLP circuit to implement in an E-nose as a classifier, such that the E-nose would be relatively small, power-efficient, and portable. The analog MLP circuit had only four input neurons, four hidden neurons, and one output neuron. The circuit was designed and fabricated using a 0.18 ?m standard CMOS process with a 1.8 V supply. The power consumption was 0.553 mW, and the area was approximately 1.36 × 1.36 mm2. The chip measurements showed that this MLPNN successfully identified the fruit odors of bananas, lemons, and lychees with 91.7% accuracy.
An Analog Multilayer Perceptron Neural Network for a Portable Electronic Nose
Pan, Chih-Heng; Hsieh, Hung-Yi; Tang, Kea-Tiong
2013-01-01
This study examines an analog circuit comprising a multilayer perceptron neural network (MLPNN). This study proposes a low-power and small-area analog MLP circuit to implement in an E-nose as a classifier, such that the E-nose would be relatively small, power-efficient, and portable. The analog MLP circuit had only four input neurons, four hidden neurons, and one output neuron. The circuit was designed and fabricated using a 0.18 ?m standard CMOS process with a 1.8 V supply. The power consumption was 0.553 mW, and the area was approximately 1.36 × 1.36 mm2. The chip measurements showed that this MLPNN successfully identified the fruit odors of bananas, lemons, and lychees with 91.7% accuracy. PMID:23262482
Highly Accurate Multi-layer Perceptron Neural Network for Air Data System
Directory of Open Access Journals (Sweden)
H. S. Krishna
2009-11-01
Full Text Available The error backpropagation multi-layer perceptron algorithm is revisited. This algorithm is used to train and validate two models of three-layer neural networks that can be used to calibrate a 5-hole pressure probe. This paper addresses Occam's Razor problem as it describes the adhoc training methodology applied to improve accuracy and sensitivity. The trained outputs from 5-4-3 feed-forward network architecture with jump connection are comparable to second decimal digit (~0.05 accuracy, hitherto unreported in literature.Defence Science Journal, 2009, 59(6, pp.670-674, DOI:http://dx.doi.org/10.14429/dsj.59.1574
Neural Networks for Gas Turbine Fault Identification: Multilayer Perceptron or Radial Basis Network?
Loboda, Igor; Feldshteyn, Yakov; Ponomaryov, Volodymyr
2012-03-01
Efficiency of gas turbine condition monitoring systems depends on quality of diagnostic analysis at all its stages such as feature extraction (from raw input data), fault detection, fault identification, and prognosis. Fault identification algorithms based on the gas path analysis may be considered as an important and sophisticated component of these systems. These algorithms widely use pattern recognition techniques, mostly different artificial neural networks. In order to choose the best technique, the present paper compares two network types: a multilayer perceptron and a radial basis network. The first network is being commonly applied to recognize gas turbine faults. However, some studies note high recognition capabilities of the second network. For the purpose of the comparison, both networks were included into a special testing procedure that computes for each network the true positive rate that is the probability of a correct diagnosis. Networks were first tuned and then compared using this criterion. Same procedure input data were fed to both networks during the comparison. However, to draw firm conclusions on the networks' applicability, comparative calculations were repeated with different variations of these data. In particular, two engines that differ in an application and gas path structure were chosen as a test case. By way of summing up comparison results, the conclusion is that the radial basis network is a little more accurate than the perceptron, however the former needs much more available computer memory and computation time.
Vanzella, E; Fontana, A; Nonino, M; Arnouts, S; Giallongo, E; Grazian, A; Fasano, G; Popesso, P; Saracco, P; Zaggia, S R
2003-01-01
We present a technique for the estimation of photometric redshifts based on feed-forward neural networks. The Multilayer Perceptron (MLP) Artificial Neural Network is used to predict photometric redshifts in the HDF-S from an ultra deep multicolor catalog. Various possible approaches for the training of the neural network are explored, including the deepest and most complete spectroscopic redshift catalog currently available (the Hubble Deep Field North dataset) and models of the spectral energy distribution of galaxies available in the literature. The MLP can be trained on observed data, theoretical data and mixed samples. The prediction of the method is tested on the spectroscopic sample in the HDF-S (44 galaxies). Over the entire redshift range, $0.1
Energy Technology Data Exchange (ETDEWEB)
Lin, Yu-Jen [Dept. of Electrical Engineering, I-Shou University, Kaohsiung County (China)
2010-10-15
In the past two decades, artificial neural networks (ANN) have been applied to quickly compute the critical clearing time (CCT), a frequently quoted measurement for power systems transient stability. This kind of applications mainly concerns the CCT prediction rather than the explanation because ANN was commonly considered as a black box. This paper will challenge this myth. In this paper, we describe the procedures for explaining CCT by means of a multilayer perceptron (MLP) artificial neural network. The explanation is expressed in terms of ''IF antecedent THEN consequent'' rules, where the antecedent indicates the power system operating conditions and the consequent refers to whether the CCT is high or low. We can accordingly explain CCT, and in turn we can observe under what circumstances will cause the power system CCT to be high or low. To justify the proposed method, the CCTs of two contingencies in 39-bus power systems are investigated. The results have demonstrated that the CCT can be explained by MLP very well. (author)
Geomagnetic Dst index forecast using a multilayer perceptrons artificial neural network
International Nuclear Information System (INIS)
Complete text of publication follows. The best known manifestations of the impact of solar wind on the magnetosphere are the geomagnetic storms. The prediction of geomagnetic field behavior allows the alert of geomagnetic storms occurrence, as those phenomena can cause many damages in the planet. The Artificial Intelligence tools have been applied in many multidisciplinary studies, covering several areas of knowledge, as a choice of approach to the solution of problems with characteristics like non-linearity, imprecision, and other features that can not be easily solved with conventional computational models. Techniques such as Artificial Neural Networks, Expert Systems and Decision Trees have been used in the Space Weather studies to perform tasks such as forecasting geomagnetic storms and the investigation of rules and parameters related on its occurrence. The main focus of this work is on forecasting the geomagnetic field behavior, represented this time by the Dst index, using for that task, mainly, the interplanetary magnetic field components and solar wind data. The tool chosen here to solve the non-linear problem was a Multi-layer Perceptrons Artificial Neural Network, trained with the backpropagation algorithm. Unlike what was done in other studies, we chose to predict calm and disturbed periods like, for example, a full month of data, for application in a real time forecasting system. It was possible to predict the geomagnetic Dst index one or two hours beforemagnetic Dst index one or two hours before with great percentage efficiency.
Cross Validation Evaluation for Breast Cancer Prediction Using Multilayer Perceptron Neural Networks
Directory of Open Access Journals (Sweden)
Shirin A. Mojarad
2011-01-01
Full Text Available Problem statement: The presence of metastasis in the regional lymph nodes is the most important factor in predicting prognosis in breast cancer. Many biomarkers have been identified that appear to relate to the aggressive behaviour of cancer. However, the nonlinear relation of these markers to nodal status and also the existence of complex interaction between markers have prohibited an accurate prognosis. Approach: The aim of this study is to investigate the effectiveness of a Multilayer Perceptron (MLP for predicting breast cancer progression using a set of four biomarkers of breast tumors. The biomarkers include DNA ploidy, cell cycle distribution (G0G1/G2M, steroid receptors (ER/PR and S-Phase Fraction (SPF. A further objective of the study is to explore the predictive potential of these markers in defining the state of nodal involvement in breast cancer. Two methods of outcome evaluation viz. stratified and simple k-fold Cross Validation (CV are studied in order to assess their accuracy and reliability for neural network validation. Criteria such as output accuracy, sensitivity and specificity are used for selecting the best validation technique besides evaluating the network outcome for different combinations of markers. Results: The results show that stratified 2-fold CV is more accurate and reliable compared to simple k-fold CV as it obtains a higher accuracy and specificity and also provides a more stable network validation in terms of sensitivity. Best prediction results are obtained by using an individual marker-SPF which obtains an accuracy of 65%. Conclusion/Recommendations: Our findings suggest that MLP-based analysis provides an accurate and reliable platform for breast cancer prediction given that an appropriate design and validation method is employed.
Rodrigo Martins da Silva; Luiza de Macedo Mourelle; Nadia Nedjah
2011-01-01
There are several neural network implementations using either software, hardware-based or a hardware/software co-design. This work proposes a hardware architecture to implement an artificial neural network (ANN), whose topology is the multilayer perceptron (MLP). In this paper, we explore the parallelism of neural networks and allow on-thefly changes of the number of inputs, number of layers and number of neurons per layer of the net. This reconfigurability characteristic permits that any app...
Quaternionic Multilayer Perceptron with Local Analyticity
Directory of Open Access Journals (Sweden)
Nobuyuki Matsui
2012-11-01
Full Text Available A multi-layered perceptron type neural network is presented and analyzed in this paper. All neuronal parameters such as input, output, action potential and connection weight are encoded by quaternions, which are a class of hypercomplex number system. Local analytic condition is imposed on the activation function in updating neurons’ states in order to construct learning algorithm for this network. An error back-propagation algorithm is introduced for modifying the connection weights of the network.
Quaternionic Multilayer Perceptron with Local Analyticity
Nobuyuki Matsui; Haruhiko Nishimura; Teijiro Isokawa
2012-01-01
A multi-layered perceptron type neural network is presented and analyzed in this paper. All neuronal parameters such as input, output, action potential and connection weight are encoded by quaternions, which are a class of hypercomplex number system. Local analytic condition is imposed on the activation function in updating neurons’ states in order to construct learning algorithm for this network. An error back-propagation algorithm is introduced for modifying the connection weights...
Curteanu, S.; Cartwright, H.
2011-01-01
Artificial neural networks (ANNs) are comparatively straightforward to understand and use in the analysis of scientific data. However, this relative transparency may encourage their use in an uncritical, and therefore possibly unproductive, fashion. The geometry of a network is among the most crucial factors in the successful deployment of network tools; in this review, we cover methods that can be used to determine optimum or near-optimum geometries. These methods of determining neural netwo...
International Nuclear Information System (INIS)
Critical heat flux (CHF) is an important parameter for the design of nuclear reactors. Although many experimental and theoretical researches have been performed, there is not a single correlation to predict CHF because it is influenced by many parameters. These parameters are based on fixed inlet, local and fixed outlet conditions. Artificial neural networks (ANNs) have been applied to a wide variety of different areas such as prediction, approximation, modeling and classification. In this study, two types of neural networks, radial basis function (RBF) and multilayer perceptron (MLP), are trained with the experimental CHF data and their performances are compared. RBF predicts CHF with root mean square (RMS) errors of 0.24%, 7.9%, 0.16% and MLP predicts CHF with RMS errors of 1.29%, 8.31% and 2.71%, in fixed inlet conditions, local conditions and fixed outlet conditions, respectively. The results show that neural networks with RBF structure have superior performance in CHF data prediction over MLP neural networks. The parametric trends of CHF obtained by the trained ANNs are also evaluated and results reported
Energy Technology Data Exchange (ETDEWEB)
Vaziri, Nima [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of)]. E-mail: n.vaziri@gmail.com; Hojabri, Alireza [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of); Erfani, Ali [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of); Monsefi, Mehrdad [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of); Nilforooshan, Behnam [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of)
2007-02-15
Critical heat flux (CHF) is an important parameter for the design of nuclear reactors. Although many experimental and theoretical researches have been performed, there is not a single correlation to predict CHF because it is influenced by many parameters. These parameters are based on fixed inlet, local and fixed outlet conditions. Artificial neural networks (ANNs) have been applied to a wide variety of different areas such as prediction, approximation, modeling and classification. In this study, two types of neural networks, radial basis function (RBF) and multilayer perceptron (MLP), are trained with the experimental CHF data and their performances are compared. RBF predicts CHF with root mean square (RMS) errors of 0.24%, 7.9%, 0.16% and MLP predicts CHF with RMS errors of 1.29%, 8.31% and 2.71%, in fixed inlet conditions, local conditions and fixed outlet conditions, respectively. The results show that neural networks with RBF structure have superior performance in CHF data prediction over MLP neural networks. The parametric trends of CHF obtained by the trained ANNs are also evaluated and results reported.
Fourier-Lapped Multilayer Perceptron Method for Speech Quality Assessment
Amauri Lopes; Marcos Travassos Romano, Jo O.; Jayme Garcia Arnal Barbedo; Vidal Ribeiro, Mois S.
2005-01-01
The paper introduces a new objective method for speech quality assessment called Fourier-lapped multilayer perceptron (FLMLP). This method uses an overcomplete transform based on the discrete Fourier transform (DFT) and modulated lapped transform (MLT). This transform generates the DFT and the MLT speech spectral domains from which several relevant perceptual parameters are extracted. The proposed method also employs a multilayer perceptron neural network trained by a modified version of the...
Comparison of sinusoidal perceptron with multilayer classical perceptron
Karimi, B.; Baradaran, T.; Ashenayi, Kaveh; Vogh, James
1991-03-01
A new multi-threshold Perceptron capable of handling both binary and analog input is presented and discussed. The modified Perceptron replaces the sigmoid function with sinusoidal function. A computer program has been developed to simulate behavior of a network utilizing the modified Perceptron. Both XOR and Parity Check problems were solved using a single-layer network utilizing this modified Perceptron. Based on the results obtained from the simulation the modified Perceptron is capable of solving problems (such as XOR) that can not be solved using a single-layer of the classical Perceptron. Also a network utilizing this modified Perceptron requires fewer number of iterations to converge to a solution than that of a multi-layer Perceptron network using back propagation. 1.
Directory of Open Access Journals (Sweden)
Alireza Taravat
2014-12-01
Full Text Available Oil spills represent a major threat to ocean ecosystems and their environmental status. Previous studies have shown that Synthetic Aperture Radar (SAR, as its recording is independent of clouds and weather, can be effectively used for the detection and classification of oil spills. Dark formation detection is the first and critical stage in oil-spill detection procedures. In this paper, a novel approach for automated dark-spot detection in SAR imagery is presented. A new approach from the combination of adaptive Weibull Multiplicative Model (WMM and MultiLayer Perceptron (MLP neural networks is proposed to differentiate between dark spots and the background. The results have been compared with the results of a model combining non-adaptive WMM and pulse coupled neural networks. The presented approach overcomes the non-adaptive WMM filter setting parameters by developing an adaptive WMM model which is a step ahead towards a full automatic dark spot detection. The proposed approach was tested on 60 ENVISAT and ERS2 images which contained dark spots. For the overall dataset, an average accuracy of 94.65% was obtained. Our experimental results demonstrate that the proposed approach is very robust and effective where the non-adaptive WMM & pulse coupled neural network (PCNN model generates poor accuracies.
Directory of Open Access Journals (Sweden)
A. Piotrowski
2007-08-01
Full Text Available The prediction of temporal concentration profiles of a transported pollutant in a river is still a subject of ongoing research efforts worldwide. The present paper is aimed at studying the possibility of using Multi-Layer Perceptron Neural Networks to evaluate the whole concentration versus time profile at several cross-sections of a river under various flow conditions, using as little information about the river system as possible. In contrast with the earlier neural networks based work on longitudinal dispersion coefficients, this new approach relies more heavily on measurements of concentration collected during tracer tests over a range of flow conditions, but fewer hydraulic and morphological data are needed. The study is based upon 26 tracer experiments performed in a small river in Edinburgh, UK (Murray Burn at various flow rates in a 540 m long reach. The only data used in this study were concentration measurements collected at 4 cross-sections, distances between the cross-sections and the injection site, time, as well as flow rate and water velocity, obtained according to the data measured at the 1st and 2nd cross-sections.
The four main features of concentration versus time profiles at a particular cross-section, namely the peak concentration, the arrival time of the peak at the cross-section, and the shapes of the rising and falling limbs of the profile are modeled, and for each of them a separately designed neural network was used. There was also a variant investigated in which the conservation of the injected mass was assured by adjusting the predicted peak concentration. The neural network methods were compared with the unit peak attenuation curve concept.
In general the neural networks predicted the main features of the concentration profiles satisfactorily. The predicted peak concentrations were generally better than those obtained using the unit peak attenuation method, and the method with mass-conservation assured generally performed better than the method that did not account for mass-conservation. Predictions of peak travel time were also better using the neural networks than the unit peak attenuation method. Including more data into the neural network training set clearly improved the prediction of the shapes of the concentration profiles. Similar improvements in peak concentration were less significant and the travel time prediction appeared to be largely unaffected.
Directory of Open Access Journals (Sweden)
A. Piotrowski
2007-12-01
Full Text Available The prediction of temporal concentration profiles of a transported pollutant in a river is still a subject of ongoing research efforts worldwide. The present paper is aimed at studying the possibility of using Multi-Layer Perceptron Neural Networks to evaluate the whole concentration versus time profile at several cross-sections of a river under various flow conditions, using as little information about the river system as possible. In contrast with the earlier neural networks based work on longitudinal dispersion coefficients, this new approach relies more heavily on measurements of concentration collected during tracer tests over a range of flow conditions, but fewer hydraulic and morphological data are needed. The study is based upon 26 tracer experiments performed in a small river in Edinburgh, UK (Murray Burn at various flow rates in a 540 m long reach. The only data used in this study were concentration measurements collected at 4 cross-sections, distances between the cross-sections and the injection site, time, as well as flow rate and water velocity, obtained according to the data measured at the 1st and 2nd cross-sections.
The four main features of concentration versus time profiles at a particular cross-section, namely the peak concentration, the arrival time of the peak at the cross-section, and the shapes of the rising and falling limbs of the profile are modeled, and for each of them a separately designed neural network was used. There was also a variant investigated in which the conservation of the injected mass was assured by adjusting the predicted peak concentration. The neural network methods were compared with the unit peak attenuation curve concept.
In general the neural networks predicted the main features of the concentration profiles satisfactorily. The predicted peak concentrations were generally better than those obtained using the unit peak attenuation method, and the method with mass-conservation assured generally performed better than the method that did not account for mass-conservation. Predictions of peak travel time were also better using the neural networks than the unit peak attenuation method. Including more data into the neural network training set clearly improved the prediction of the shapes of the concentration profiles. Similar improvements in peak concentration were less significant and the travel time prediction appeared to be largely unaffected.
Wind speed estimation using multilayer perceptron
International Nuclear Information System (INIS)
Highlights: • We present a method for determining the average wind speed using neural networks. • We use data from that site in the short term and data from other nearby stations. • The inputs used in the ANN were wind speed and direction data from a station. • The method allows knowing the wind speed without topographical data. - Abstract: Wind speed knowledge is prerequisite in the siting of wind turbines. In consequence the wind energy use requires meticulous and specified knowledge of the wind characteristics at a location. This paper presents a method for determining the annual average wind speed at a complex terrain site by using neural networks, when only short term data are available for that site. This information is useful for preliminary calculations of the wind resource at a remote area having only a short time period of wind measurements measurement in a site. Artificial neural networks are useful for implementing non-linear process variables over time, and therefore are a useful tool for estimating the wind speed. The neural network used is multilayer perceptron with three layers and the supervised learning algorithm used is backpropagation. The inputs used in the neural network were wind speed and direction data from a single station, and the training patterns used correspond to sixty days data. The results obtained by simulating the annual average wind speed at the selected site based on data from nearby stations with correlation coefficients above 0.5 were satisfactory, compared with actual values. Reliable estimations were obtained, with errors below 6%
Cross Validation Evaluation for Breast Cancer Prediction Using Multilayer Perceptron Neural Networks
Mojarad, Shirin A.; Dlay, Satnam S.; Woo, Wai L.; Sherbet, Gajanan V.
2011-01-01
Problem statement: The presence of metastasis in the regional lymph nodes is the most important factor in predicting prognosis in breast cancer. Many biomarkers have been identified that appear to relate to the aggressive behaviour of cancer. However, the nonlinear relation of these markers to nodal status and also the existence of complex interaction between markers have prohibited an accurate prognosis. Approach: The aim of this study is to investigate the effectiveness of a Multilayer Perc...
Sarakhs branch; Sarakhs, Iran
2012-01-01
This paper presents a multi-layered perceptronneural network (MLPNN) method to solve the combinedeconomic and emission dispatch (CEED) problem. The harmfulecological effects caused by the emission of particulate andgaseous pollutants like sulfur dioxide (SO2) and oxides ofnitrogen ( NOx ) can be reduced by adequate distribution ofload between the plants of a power system. However, this leadsto a noticeable increase in the operating cost of the plants. Thispaper presents the (MLPNN) method app...
Murat Kayri; Omay Cokluk
2010-01-01
Problem statement: The aim of the present study is to exemplify the use of Artificial Neural Networks (ANN) for parameter prediction. Missing value or unreal approach to some questions in scale is a problem for unbiased findings. To learn a real pattern with ANN provides robust and unbiased parameter estimation. Approach: To this end, data was collected from 906 students using ?Scale of student views about the expected situations and the current expectations from their families during learnin...
Auto-kernel using multilayer perceptron
Wei-Chen Cheng
2012-01-01
This work presents a constructive method to train the multilayer perceptron layer after layer successively and to accomplish the kernel used in the support vector machine. Data in different classes will be trained to map to distant points in each layer. This will ease the mapping of the next layer. A perfect mapping kernel can be accomplished successively. Those distant mapped points can be discriminated easily by a single perceptron.
Hierarchical Multilayer Perceptron based Language Identification
Imseng, David; Magimai -doss, Mathew; Bourlard, Herve?
2010-01-01
Automatic language identification (LID) systems generally exploit acoustic knowledge, possibly enriched by explicit language specific phonotactic or lexical constraints. This paper investigates a new LID approach based on hierarchical multilayer perceptron (MLP) classifiers, where the first layer is a ``universal phoneme set MLP classifier''. The resulting (multilingual) phoneme posterior sequence is fed into a second MLP taking a larger temporal context into account. The second MLP can learn...
A Parallel Framework for Multilayer Perceptron for Human Face Recognition
Bhowmik, M K; Nasipuri, M; Basu, D K; Kundu, M
2010-01-01
Artificial neural networks have already shown their success in face recognition and similar complex pattern recognition tasks. However, a major disadvantage of the technique is that it is extremely slow during training for larger classes and hence not suitable for real-time complex problems such as pattern recognition. This is an attempt to develop a parallel framework for the training algorithm of a perceptron. In this paper, two general architectures for a Multilayer Perceptron (MLP) have been demonstrated. The first architecture is All-Class-in-One-Network (ACON) where all the classes are placed in a single network and the second one is One-Class-in-One-Network (OCON) where an individual single network is responsible for each and every class. Capabilities of these two architectures were compared and verified in solving human face recognition, which is a complex pattern recognition task where several factors affect the recognition performance like pose variations, facial expression changes, occlusions, and ...
A Choice of Input Variables for a Multilayer Perceptron
International Nuclear Information System (INIS)
In the paper some aspects of multilayer perceptron (MLP) application to the problem of classifying the events presented by empirical samples of a finite volume are considered. The results of the MLP learning for various forms of the input data are analyzed and the reasons leading to the effect of an instantaneous learning of the MLP and rise of the neural network are investigated for the case when the input data are presented in a form of variational series. The problem of hidden layer neuron reduction without raising the recognition error is discussed. (author). 13 refs., 6 figs., 1 tab
Çaylak, Ça?r?; Kaftan, ?lknur
2014-12-01
This study proposes the use of multi-layer perceptron neural networks (MLPNN) to invert dispersion curves obtained via multi-channel analysis of surface waves (MASW) for shear S-wave velocity profile. The dispersion curve used in inversion includes the fundamental-mode dispersion data. In order to investigate the applicability and performance of the proposed MLPNN algorithm, test studies were performed using both synthetic and field examples. Gaussian random noise with a standard deviation of 4 and 8% was added to the noise-free test data to make the synthetic test more realistic. The model parameters, such as S-wave velocities and thicknesses of the synthetic layered-earth model, were obtained for different S/N ratios and noise-free data. The field survey was performed over the natural gas pipeline, located in the Germencik district of Ayd?n city, western Turkey. The results show that depth, velocity, and location of the embedded natural gas pipe are successfully estimated with reasonably good approximation.
International Nuclear Information System (INIS)
In this work, multilayered perceptron neural networks (MLPNNs) were presented for the computation of the gamma-ray energy absorption buildup factors (BA) of seven thermoluminescent dosimetric (TLD) materials [LiF, BeO, Na2B4O7, CaSO4, Li2B4O7, KMgF3, Ca3(PO4)2] in the energy region 0.015–15 MeV, and for penetration depths up to 10 mfp (mean-free-path). The MLPNNs have been trained by a Levenberg–Marquardt learning algorithm. The developed model is in 99% agreement with the ANSI/ANS-6.4.3 standard data set. Furthermore, the model is fast and does not require tremendous computational efforts. The estimated BA data for TLD materials have been given with penetration depth and incident photon energy as comparative to the results of the interpolation method using the Geometrical Progression (G-P) fitting formula. - Highlights: ? Gamma-ray energy absorption buildup factors estimation in TLD materials. ? The ANN approach can be alternative to G-P fitting method for BA calculations. ? The applied model is not time-consuming and easily predicted
Efficient block training of multilayer perceptrons.
Navia-Vázquez, A; Figueiras-Vidal, A R
2000-06-01
The attractive possibility of applying layerwise block training algorithms to multilayer perceptrons MLP, which offers initial advantages in computational effort, is refined in this article by means of introducing a sensitivity correction factor in the formulation. This results in a clear performance advantage, which we verify in several applications. The reasons for this advantage are discussed and related to implicit relations with second-order techniques, natural gradient formulations through Fisher's information matrix, and sample selection. Extensions to recurrent networks and other research lines are suggested at the close of the article. PMID:10935721
Scientific Electronic Library Online (English)
Rodrigo Martins da, Silva; Luiza de Macedo, Mourelle; Nadia, Nedjah.
2011-12-01
Full Text Available Em termos computacionais, uma rede neural artificial (RNA) pode ser implementada em software ou em hardware, ou ainda de maneira híbrida, combinando ambos os recursos. O presente trabalho propõe uma arquitetura de hardware para a computação de uma rede neural do tipo perceptron com múltiplas camadas [...] (MLP). Soluções em hardware tendem a ser mais eficientes do que soluções em software. O projeto em questão, além de explorar fortemente o paralelismo das redes neurais, permite alterações do número de entradas, número de camadas e de neurônios por camada, de modo que diversas aplicações de RNAs possam ser executadas no hardware proposto. Visando a uma redução de tempo do processamento aritmético, um número real é aproximado por uma fração de inteiros. Dessa forma, as operações aritméticas limitam-se a operações inteiras, executadas por circuitos combinacionais. Uma simples máquina de estados é demandada para controlar somas e produtos de frações. A função de ativação usada neste projeto é a sigmóide. Essa função é aproximada mediante o uso de polinômios, cujas operações são regidas por somas e produtos. Um teorema é introduzido e provado, permitindo a fundamentação da estratégia de cálculo da função de ativação. Dessa forma, reaproveita-se o circuito aritmético da soma ponderada para também computar a sigmóide. Essa re-utilização dos recursos levou a uma redução drástica de área total de circuito. Após modelagem e simulação para validação do bom funcionamento, a arquitetura proposta foi sintetizada utilizando recursos reconfiguráveis, do tipo FPGA. Os resultados são promissores. Abstract in english There are several neural network implementations using either software, hardware-based or a hardware/software co-design. This work proposes a hardware architecture to implement an artificial neural network (ANN), whose topology is the multilayer perceptron (MLP). In this paper, we explore the parall [...] elism of neural networks and allow on-thefly changes of the number of inputs, number of layers and number of neurons per layer of the net. This reconfigurability characteristic permits that any application of ANNs may be implemented using the proposed hardware. In order to reduce the processing time that is spent in arithmetic computation, a real number is represented using a fraction of integers. In this way, the arithmetics is limited to integer operations, performed by fast combinational circuits. A simple state machine is required to control sums and products of fractions. Sigmoid is used as the activation function in the proposed implementation. It is approximated by polynomials, whose underlying computation requires only sums and products. A theorem is introduced and proven so as to cover the arithmetic strategy of the computation of the activation function. Thus, the arithmetic circuitry used to implement the neuron weighted sum is reused for computing the sigmoid. this resource sharing decreased drastically the total area of the system. After modeling and simulation for functionality validation, the proposed architecture synthesized using reconfigurable hardware. The results are promising.
Directory of Open Access Journals (Sweden)
Rodrigo Martins da Silva
2011-12-01
Full Text Available There are several neural network implementations using either software, hardware-based or a hardware/software co-design. This work proposes a hardware architecture to implement an artificial neural network (ANN, whose topology is the multilayer perceptron (MLP. In this paper, we explore the parallelism of neural networks and allow on-thefly changes of the number of inputs, number of layers and number of neurons per layer of the net. This reconfigurability characteristic permits that any application of ANNs may be implemented using the proposed hardware. In order to reduce the processing time that is spent in arithmetic computation, a real number is represented using a fraction of integers. In this way, the arithmetics is limited to integer operations, performed by fast combinational circuits. A simple state machine is required to control sums and products of fractions. Sigmoid is used as the activation function in the proposed implementation. It is approximated by polynomials, whose underlying computation requires only sums and products. A theorem is introduced and proven so as to cover the arithmetic strategy of the computation of the activation function. Thus, the arithmetic circuitry used to implement the neuron weighted sum is reused for computing the sigmoid. this resource sharing decreased drastically the total area of the system. After modeling and simulation for functionality validation, the proposed architecture synthesized using reconfigurable hardware. The results are promising.Em termos computacionais, uma rede neural artificial (RNA pode ser implementada em software ou em hardware, ou ainda de maneira híbrida, combinando ambos os recursos. O presente trabalho propõe uma arquitetura de hardware para a computação de uma rede neural do tipo perceptron com múltiplas camadas (MLP. Soluções em hardware tendem a ser mais eficientes do que soluções em software. O projeto em questão, além de explorar fortemente o paralelismo das redes neurais, permite alterações do número de entradas, número de camadas e de neurônios por camada, de modo que diversas aplicações de RNAs possam ser executadas no hardware proposto. Visando a uma redução de tempo do processamento aritmético, um número real é aproximado por uma fração de inteiros. Dessa forma, as operações aritméticas limitam-se a operações inteiras, executadas por circuitos combinacionais. Uma simples máquina de estados é demandada para controlar somas e produtos de frações. A função de ativação usada neste projeto é a sigmóide. Essa função é aproximada mediante o uso de polinômios, cujas operações são regidas por somas e produtos. Um teorema é introduzido e provado, permitindo a fundamentação da estratégia de cálculo da função de ativação. Dessa forma, reaproveita-se o circuito aritmético da soma ponderada para também computar a sigmóide. Essa re-utilização dos recursos levou a uma redução drástica de área total de circuito. Após modelagem e simulação para validação do bom funcionamento, a arquitetura proposta foi sintetizada utilizando recursos reconfiguráveis, do tipo FPGA. Os resultados são promissores.
Scientific Electronic Library Online (English)
Héctor, Tabares; John, Branch; Jaime, Valencia.
2006-09-01
Full Text Available SciELO Colombia | Language: Spanish Abstract in spanish En este trabajo se aplica un método constructivo aproximado para encontrar arquitecturas de redes neuronales artificiales (RNA) de tipo perceptrón multicapa (PMC). El método se complementa con la técnica de la búsqueda forzada de mejores mínimos locales. El entrenamiento de la red se lleva a cabo a [...] través del algoritmo gradiente descendente básico (GDB); se aplican técnicas como la repetición del entrenamiento y la detención temprana (validación cruzada), para mejorar los resultados. El criterio de evaluación se basa en las habilidades de aprendizaje y de generalización de las arquitecturas generadas específicas de un dominio. Se presentan resultados experimentales con los cuales se demuestra la efectividad del método propuesto y comparan con las arquitecturas halladas por otros métodos. Abstract in english This paper deals with an approximate constructive method to find architectures of artificial neuronal network (ANN) of the type MultiLayer Percetron (MLP) which solves a particular problem. This method is supplemented with the technique of the Forced search of better local minima. The training of th [...] e net uses an algorithm basic descending gradient (BDG). Techniques such as repetition of the training and the early stopping (cross validation) are used to improve the results. The evaluation approach is based not only on the learning abilities but also on the generalization of the specific generated architectures of a domain. Experimental results are presented in order to prove the effectiveness of the proposed method. These are compared with architectures found by other methods.
Online learning dynamics of multilayer perceptrons with unidentifiable parameters
International Nuclear Information System (INIS)
In the over-realizable learning scenario of multilayer perceptrons, in which the student network has a larger number of hidden units than the true or optimal network, some of the weight parameters are unidentifiable. In this case, the teacher network consists of a union of optimal subspaces included in the parameter space. The optimal subspaces, which lead to singularities, are known to affect the estimation performance of neural networks. Using statistical mechanics, we investigate the online learning dynamics of two-layer neural networks in the over-realizable scenario with unidentifiable parameters. We show that the convergence speed strongly depends on the initial parameter conditions. We also show that there is a quasi-plateau around the optimal subspace, which differs from the well-known plateaus caused by permutation symmetry. In addition, we discuss the property of the final learning state, relating this to the singular structures
A Parallel Framework for Multilayer Perceptron for Human Face Recognition
Directory of Open Access Journals (Sweden)
Mita Nasipuri
2010-01-01
Full Text Available Artificial neural networks have already shown their success in face recognition and similar complex pattern recognition tasks. However, a major disadvantage of the technique is that it is extremely slow during training for larger classes and hence not suitable for real-time complex problems such as pattern recognition. This is an attempt to develop a parallel framework for the training algorithm of a perceptron. In this paper, two general architectures for a Multilayer Perceptron (MLP have been demonstrated. The first architecture is All-Class-in-One-Network (ACON where all the classes are placed in a single network and the second one is One-Class-in-One-Network (OCON where an individual single network is responsible for each and every class. Capabilities of these two architectures were compared and verified in solving human face recognition, which is a complex pattern recognition task where several factors affect the recognition performance like pose variations, facial expression changes, occlusions, and most importantly illumination changes. Experimental results show that the proposed OCON structure performs better than the conventional ACON in terms of network training convergence speed and which can be easily exercised in a parallel environment.
Autonomous Quantum Perceptron Neural Network
Sagheer, Alaa; Zidan, Mohammed
2013-01-01
Recently, with the rapid development of technology, there are a lot of applications require to achieve low-cost learning. However the computational power of classical artificial neural networks, they are not capable to provide low-cost learning. In contrast, quantum neural networks may be representing a good computational alternate to classical neural network approaches, based on the computational power of quantum bit (qubit) over the classical bit. In this paper we present ...
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
Pedroni, N.; Zio, E.; Cadini, F.
2008-01-01
Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP) for nuclear dynamics are considered in comparison to static mo...
Efficient Estimation of Multidimensional Regression Model with Multilayer Perceptron
Rynkiewicz, Joseph
2008-01-01
This work concerns estimation of multidimensional nonlinear regression models using multilayer perceptron (MLP). The main problem with such model is that we have to know the covariance matrix of the noise to get optimal estimator. however we show that, if we choose as cost function the logarithm of the determinant of the empirical error covariance matrix, we get an asymptotically optimal estimator.
Estimating the Number of Components in a Mixture of Multilayer Perceptrons
Olteanu, Madalina
2008-01-01
BIC criterion is widely used by the neural-network community for model selection tasks, although its convergence properties are not always theoretically established. In this paper we will focus on estimating the number of components in a mixture of multilayer perceptrons and proving the convergence of the BIC criterion in this frame. The penalized marginal-likelihood for mixture models and hidden Markov models introduced by Keribin (2000) and, respectively, Gassiat (2002) is extended to mixtures of multilayer perceptrons for which a penalized-likelihood criterion is proposed. We prove its convergence under some hypothesis which involve essentially the bracketing entropy of the generalized score-functions class and illustrate it by some numerical examples.
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
International Nuclear Information System (INIS)
Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP) for nuclear dynamics are considered in comparison to static modeling by a finite impulse response multilayer perceptron (FIR-MLP) and a conventional static MLP. The comparison is made with respect to the nonlinear dynamics of a nuclear reactor as investigated by IIR-MLP in a previous paper. The superior performance of the locally recurrent scheme is demonstrated
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
Directory of Open Access Journals (Sweden)
N. Pedroni
2008-03-01
Full Text Available Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP for nuclear dynamics are considered in comparison to static modeling by a finite impulse response multilayer perceptron (FIR-MLP and a conventional static MLP. The comparison is made with respect to the nonlinear dynamics of a nuclear reactor as investigated by IIR-MLP in a previous paper. The superior performance of the locally recurrent scheme is demonstrated.
Asymptotic law of likelihood ratio for multilayer perceptron models
Rynkiewicz, Joseph
2010-01-01
We consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The data are assumed to be generated by a true MLP model and the estimation of the parameters of the MLP is done by maximizing the likelihood of the model. When the number of hidden units of the true model is known, the asymptotic distribution of the maximum likelihood estimator (MLE) and the likelihood ratio (LR) statistic is easy to compute and converge to a $\\c...
Classification of Log-Polar-Visual Eigenfaces using Multilayer Perceptron
Bhowmik, Mrinal Kanti; Bhattacharjee, Debotosh; Nasipuri, Mita; Kundu, Mahantapas; Basu, Dipak Kumar
2010-01-01
In this paper we present a simple novel approach to tackle the challenges of scaling and rotation of face images in face recognition. The proposed approach registers the training and testing visual face images by log-polar transformation, which is capable to handle complicacies introduced by scaling and rotation. Log-polar images are projected into eigenspace and finally classified using an improved multi-layer perceptron. In the experiments we have used ORL face database an...
Key Generation and Certification using Multilayer Perceptron in Wireless communication(KGCMLP)
Sarkar, Arindam; Mandal, J. K.
2012-01-01
In this paper, a key generation and certification technique using multilayer perceptron (KGCMLP) has been proposed in wireless communication of data/information. In this proposed KGCMLP technique both sender and receiver uses an identical multilayer perceptrons. Both perceptrons are start synchronization by exchanging some control frames. During synchronization process message integrity test and synchronization test has been carried out. Only the synchronization test does no...
Error correcting code using tree-like multilayer perceptron
Cousseau, Florent; Mimura, Kazushi; Okada, Masato
2008-01-01
An error correcting code using a tree-like multilayer perceptron is proposed. An original message $\\mbi{s}^0$ is encoded into a codeword $\\boldmath{y}_0$ using a tree-like committee machine (committee tree) or a tree-like parity machine (parity tree). Based on these architectures, several schemes featuring monotonic or non-monotonic units are introduced. The codeword $\\mbi{y}_0$ is then transmitted via a Binary Asymmetric Channel (BAC) where it is corrupted by noise. The ana...
Voyant, Cyril; Tamas, Wani; Nivet, Marie Laure; Notton, Gilles; Paoli, Christophe; Balu, Aure?lia; Muselli, Marc
2014-01-01
A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the exhaustive approach where "all" configurations are tested) and learning phases of this artificial intelligence tool (often based on the Levenberg-Marquardt algorithm; LMA) are weaknesses of this approach (exhaustively and local minima). Thes...
Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method
Voyant, Cyril; Tamas, Wani; Paoli, Christophe; Balu, Aure?lia; Muselli, Marc; Nivet, Marie Laure; Notton, Gilles
2013-01-01
A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the exhaustive approach where "all" configurations are tested) and learning phases of this artificial intelligence tool (often based on the Levenberg-Marquardt algorithm; LMA) are weaknesses of this approach (exhaustively and local minima). Thes...
The Normalized Radial Basis Function Neural Network and its Relation to the Perceptron
Grabec, I
2007-01-01
The normalized radial basis function neural network emerges in the statistical modeling of natural laws that relate components of multivariate data. The modeling is based on the kernel estimator of the joint probability density function pertaining to given data. From this function a governing law is extracted by the conditional average estimator. The corresponding nonparametric regression represents a normalized radial basis function neural network and can be related with the multi-layer perceptron equation. In this article an exact equivalence of both paradigms is demonstrated for a one-dimensional case with symmetric triangular basis functions. The transformation provides for a simple interpretation of perceptron parameters in terms of statistical samples of multivariate data.
Dynamics of learning in multilayer perceptrons near singularities.
Cousseau, Florent; Ozeki, Tomoko; Amari, Shun-Ichi
2008-08-01
The dynamical behavior of learning is known to be very slow for the multilayer perceptron, being often trapped in the "plateau." It has been recently understood that this is due to the singularity in the parameter space of perceptrons, in which trajectories of learning are drawn. The space is Riemannian from the point of view of information geometry and contains singular regions where the Riemannian metric or the Fisher information matrix degenerates. This paper analyzes the dynamics of learning in a neighborhood of the singular regions when the true teacher machine lies at the singularity. We give explicit asymptotic analytical solutions (trajectories) both for the standard gradient (SGD) and natural gradient (NGD) methods. It is clearly shown, in the case of the SGD method, that the plateau phenomenon appears in a neighborhood of the critical regions, where the dynamical behavior is extremely slow. The analysis of the NGD method is much more difficult, because the inverse of the Fisher information matrix diverges. We conquer the difficulty by introducing the "blow-down" technique used in algebraic geometry. The NGD method works efficiently, and the state converges directly to the true parameters very quickly while it staggers in the case of the SGD method. The analytical results are compared with computer simulations, showing good agreement. The effects of singularities on learning are thus qualitatively clarified for both standard and NGD methods. PMID:18701364
Second-Order Learning Methods for a Multilayer Perceptron
International Nuclear Information System (INIS)
First- and second-order learning methods for feed-forward multilayer neural networks are studied. Newton-type and quasi-Newton algorithms are considered and compared with commonly used back-propagation algorithm. It is shown that, although second-order algorithms require enhanced computer facilities, they provide better convergence and simplicity in usage. 13 refs., 2 figs., 2 tabs
Theoretical Properties of Projection Based Multilayer Perceptrons with Functional Inputs
Rossi, F; Rossi, Fabrice; Conan-Guez, Brieuc
2006-01-01
Many real world data are sampled functions. As shown by Functional Data Analysis (FDA) methods, spectra, time series, images, gesture recognition data, etc. can be processed more efficiently if their functional nature is taken into account during the data analysis process. This is done by extending standard data analysis methods so that they can apply to functional inputs. A general way to achieve this goal is to compute projections of the functional data onto a finite dimensional sub-space of the functional space. The coordinates of the data on a basis of this sub-space provide standard vector representations of the functions. The obtained vectors can be processed by any standard method. In our previous work, this general approach has been used to define projection based Multilayer Perceptrons (MLPs) with functional inputs. We study in this paper important theoretical properties of the proposed model. We show in particular that MLPs with functional inputs are universal approximators: they can approximate to ...
Fast parallel off-line training of multilayer perceptrons.
McLoone, S; Irwin, G W
1997-01-01
Various approaches to the parallel implementation of second-order gradient-based multilayer perceptron training algorithms are described. Two main classes of algorithm are defined involving Hessian and conjugate gradient-based methods. The limited- and full-memory Broyden-Fletcher-Goldfarb-Shanno (BFGS) algorithms are selected as representative examples and used to show that the step size and gradient calculations are critical components. For larger problems the matrix calculations in the full-memory algorithm are also significant. Various strategies are considered for parallelization, the best of which is implemented on parallel virtual machine (PVM) and transputer-based architectures. Results from a range of problems are used to demonstrate the performance achievable with each architecture. The transputer implementation is found to give excellent speed-ups but the problem size is limited by memory constraints. The speed-ups achievable with the PVM implementation are much poorer because of inefficient communication, but memory is not a difficulty. PMID:18255667
Consistent estimation of the architecture of multilayer perceptrons
Rynkiewicz, Joseph
2008-01-01
We consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The estimation of the parameters of the MLP can be done by maximizing the likelihood of the model. In this framework, it is difficult to determine the true number of hidden units using an information criterion, like the Bayesian information criteria (BIC), because the information matrix of Fisher is not invertible if the number of hidden units is overestimated. Indeed, the classical theoretical justification of information criteria relies entirely on the invertibility of this matrix. However, using recent methodology introduced to deal with models with a loss of identifiability, we prove that suitable information criterion leads to consistent estimation of the true number of hidden units.
Missing value imputation on missing completely at random data using multilayer perceptrons.
Silva-Ramírez, Esther-Lydia; Pino-Mejías, Rafael; López-Coello, Manuel; Cubiles-de-la-Vega, María-Dolores
2011-01-01
Data mining is based on data files which usually contain errors in the form of missing values. This paper focuses on a methodological framework for the development of an automated data imputation model based on artificial neural networks. Fifteen real and simulated data sets are exposed to a perturbation experiment, based on the random generation of missing values. These data set sizes range from 47 to 1389 records. A perturbation experiment was performed for each data set where the probability of missing value was set to 0.05. Several architectures and learning algorithms for the multilayer perceptron are tested and compared with three classic imputation procedures: mean/mode imputation, regression and hot-deck. The obtained results, considering different performance measures, not only suggest this approach improves the quality of a database with missing values, but also the best results are clearly obtained using the Multilayer Perceptron model in data sets with categorical variables. Three learning rules (Levenberg-Marquardt, BFGS Quasi-Newton and Conjugate Gradient Fletcher-Reeves Update) and a small number of hidden nodes are recommended. PMID:20875726
Dynamics of a multi-layered perceptron model : a rigorous result
Patrick, A. E.; Zagrebnov, V. A.
1990-01-01
We derive exactly and rigorously the system of dynamical equations for a multi-layered perceptron proposed by Domany, Meir and Kinzel (DMK-model). They describes both the main and the residual overlaps evolution.
Sarkar, Arindam; Mandal, J. K.
2012-01-01
In this paper, a multilayer perceptron guided key generation for encryption/decryption (MLPKG) has been proposed through recursive replacement using mutated character code generation for wireless communication of data/information. Multilayer perceptron transmitting systems at both ends accept an identical input vector, generate an output bit and the network are trained based on the output bit which is used to form a protected variable length secret-key. For each session, dif...
Multi-layer perceptrons in filtering geophysical signals
Fortuna, L.; Graziani, S.; Lo Presti, M.; Nunnari, G.
Multilayer neural networks are used to model the influence of noise sources on some types of geophysical signals. The role of neural networks is to identify nonlinear time-invariant NARMAX (nonlinear autoregressive moving average with exogenous inputs) models which are used to filter corrupted data using a model-based approach, avoiding the drawbacks of the classical digital filtering techniques. The effectiveness of the proposed approach is shown by considering a case study concerning the filtering of tilt signals recorded in volcanically active areas.
Arindam Sarkar; Mandal, J. K.
2013-01-01
In this paper, a group session Key Exchange multilayer Perceptron based Simulated Annealing guidedAutomata and Comparison based Metamorphosed encryption technique (GSMLPSA) has been proposed inwireless communication of data/information. Both sender and receiver uses identical multilayer perceptronand depending on the final output of the both side multilayer perceptron, weights vector of hidden layer gettuned in both ends. As a results both perceptrons generates identical weight vectors which ...
Recognition of Epileptiform Patterns in the Human Electroencephalogram Using Multi-Layer Perceptron
Directory of Open Access Journals (Sweden)
V. Mokran
1995-06-01
Full Text Available Automatic detection of epileptiform patterns is highly desirable during continuous monitoring of patients with epilepsy. This paper describes an unconvential system for automatic off-line recognition of epileptic sharp transients in the human electroencephalogram (EEG, based on a standard neural network architecture - multi-layer perceptron (MLP, and implemented on a Silicon Graphics Indigo workstation. The system makes comprehensive use of wide spatial contextual information available on 12 channels of EEG and takes advantage of discrete dyadic wavelet transform (DDWT for efficient parameterisation of EEG data. The EEG database consists of 12 patients, 7 of which are used in the process of training of MLP. The resulting MLP is presented with the testing data set consisting of all data vectors from all 12 patients, and is shown to be capable to recognise a wide variety of epileptic signals.
Mozumder, Chitrini; Tripathi, Nitin K.
2014-10-01
In recent decades, the world has experienced unprecedented urban growth which endangers the green environment in and around urban areas. In this work, an artificial neural network (ANN) based model is developed to predict future impacts of urban and agricultural expansion on the uplands of Deepor Beel, a Ramsar wetland in the city area of Guwahati, Assam, India, by 2025 and 2035 respectively. Simulations were carried out for three different transition rates as determined from the changes during 2001-2011, namely simple extrapolation, Markov Chain (MC), and system dynamic (SD) modelling, using projected population growth, which were further investigated based on three different zoning policies. The first zoning policy employed no restriction while the second conversion restriction zoning policy restricted urban-agricultural expansion in the Guwahati Municipal Development Authority (GMDA) proposed green belt, extending to a third zoning policy providing wetland restoration in the proposed green belt. The prediction maps were found to be greatly influenced by the transition rates and the allowed transitions from one class to another within each sub-model. The model outputs were compared with GMDA land demand as proposed for 2025 whereby the land demand as produced by MC was found to best match the projected demand. Regarding the conservation of Deepor Beel, the Landscape Development Intensity (LDI) Index revealed that wetland restoration zoning policies may reduce the impact of urban growth on a local scale, but none of the zoning policies was found to minimize the impact on a broader base. The results from this study may assist the planning and reviewing of land use allocation within Guwahati city to secure ecological sustainability of the wetlands.
Asymptotic law of likelihood ratio for multilayer perceptron models
Rynkiewicz, Joseph
2010-01-01
We consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The data are assumed to be generated by a true MLP model and the estimation of the parameters of the MLP is done by maximizing the likelihood of the model. When the number of hidden units of the true model is known, the asymptotic distribution of the maximum likelihood estimator (MLE) and the likelihood ratio (LR) statistic is easy to compute and converge to a $\\chi^2$ law. However, if the number of hidden unit is over-estimated the Fischer information matrix of the model is singular and the asymptotic behavior of the MLE is unknown. This paper deals with this case, and gives the exact asymptotic law of the LR statistics. Namely, if the parameters of the MLP lie in a suitable compact set, we show that the LR statistics is the supremum of the square of a Gaussian process indexed by a class of limit score functions.
Classification of Log-Polar-Visual Eigenfaces using Multilayer Perceptron
Bhowmik, Mrinal Kanti; Nasipuri, Mita; Kundu, Mahantapas; Basu, Dipak Kumar
2010-01-01
In this paper we present a simple novel approach to tackle the challenges of scaling and rotation of face images in face recognition. The proposed approach registers the training and testing visual face images by log-polar transformation, which is capable to handle complicacies introduced by scaling and rotation. Log-polar images are projected into eigenspace and finally classified using an improved multi-layer perceptron. In the experiments we have used ORL face database and Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database for visual face images. Experimental results show that the proposed approach significantly improves the recognition performances from visual to log-polar-visual face images. In case of ORL face database, recognition rate for visual face images is 89.5% and that is increased to 97.5% for log-polar-visual face images whereas for OTCBVS face database recognition rate for visual images is 87.84% and 96.36% for log-polar-visual face images.
Multi-objective turbomachinery optimization using a gradient-enhanced multi-layer perceptron
Duta, Mc; Duta, Md
2009-01-01
Response surface models (RSMs) have found widespread use to reduce the overall computational cost of turbomachinery blading design optimization. Recent developments have seen the successful use of gradient information alongside sampled response values in building accurate response surfaces. This paper describes the use of gradients to enhance the performance of the RSM provided by a multi-layer perceptron. Gradient information is included in the perceptron by modifying the error function such...
An application of the multilayer perceptron: Solar radiation maps in Spain
Energy Technology Data Exchange (ETDEWEB)
Hontoria, L.; Aguilera, J. [Grupo Investigacion y Desarrollo en Energia Solar y Automatica, Dpto. de Ingenieria Electronica, de Telecomunicaciones y Automatica, Escuela Politecnica Superior de Jaen, Campus de las Lagunillas, Universidad de Jaen, 23071 Jaen (Spain); Zufiria, P. [Grupo de Redes Neuronales, Dpto. de Matematica Aplicada a las Tecnologias de la Informacion, ETSI Telecomunicaciones, UPM Ciudad Universitaria s/n, 28040 Madrid (Spain)
2005-11-01
In this work an application of a methodology to obtain solar radiation maps is presented. This methodology is based on a neural network system [Lippmann, R.P., 1987. An introduction to computing with neural nets. IEEE ASSP Magazine, 4-22] called Multi-Layer Perceptron (MLP) [Haykin, S., 1994. Neural Networks. A Comprehensive Foundation. Macmillan Publishing Company; Hornik, K., Stinchcombe, M., White, H., 1989. Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359-366]. To obtain a solar radiation map it is necessary to know the solar radiation of many points spread wide across the zone of the map where it is going to be drawn. For most of the locations all over the world the records of these data (solar radiation in whatever scale, daily or hourly values) are non-existent. Only very few locations have the privilege of having good meteorological stations where records of solar radiation have being registered. But even in those locations with historical records of solar data, the quality of these solar series is not as good as it should be for most purposes. In addition, to draw solar radiation maps the number of points on the maps (real sites) that it is necessary to work with makes this problem difficult to solve. Nevertheless, with the application of the methodology proposed in this paper, this problem has been solved and solar radiation maps have been obtained for a small region of Spain: Jaen province, a southern province of Spain between parallels 38{sup o}25' N and 37{sup o}25' N, and meridians 4{sup o}10' W and 2{sup o}10' W, and for a larger region: Andalucia, the most southern region of Spain situated between parallels 38{sup o}40' N and 36{sup o}00' N, and meridians 7{sup o}30' W and 1{sup o}40' W. (author)
International Nuclear Information System (INIS)
The problem of pion-electron identification based on their energy losses in the TRD is considered in the frame of the CBM experiment. For particles identification an artificial neural network (ANN) was used, a multilayer perceptron realized in JETNET and ROOT packages. It is demonstrated that, in order to get correct and comparable results, it is important to define the network structure correctly. The recommendations for such a selection are given. In order to achieve an acceptable level of pions suppression, the energy losses need to be transformed to more 'effective' variables. The dependency of ANN output threshold for a fixed portion of electron loss on the particle momentum is presented
Face Recognition through Multilayer Perceptron (MLP and Learning Vector Quantization (LVQ
Directory of Open Access Journals (Sweden)
Dr. Ikvinderpal Singh
2012-12-01
Full Text Available Face recognition is challenging problems and there is still a lot of work that needs to be done in this area. Over the past ten years, face recognition has received substantial attention from researchers in biometrics, pattern recognition, computer vision, and cognitive psychology communities. This common interest in facial recognition technology among researchers working in diverse fields is motivated both by the remarkable ability to recognize people and by the increased attention being devoted to security applications. Applications of face recognition can be found in security, tracking, multimedia, and entertainment domains.This paper presents a face recognition system using artificial neural network. Here, we have designed a neural network with some own set network parameters. The results presented here have been obtained using two basic methods: multilayer perceptron (MLP, and learning vector quantization (LVQ. In both cases, two kinds of data have been fed to the classifiers: reduced resolution images (gray level or segmented, and feature vectors. The experimental results also show that, for the approaches considered here, analyzing gray level images produced better results than analyzing geometrical features, either because of the errors introduced during their extraction or because the original images have a richer information content. Furthermore, training times were much shorter for LVQ than for MLP. On the other hand, MLP achieved lower error rates when dealing with geometrical features.
Saleh Salimi; Hamid Mahmoodi; Nader Barahmand
2013-01-01
In order to perceive of rainfall- runoff process, essential prediction for water surface source management has special importance. Thereby in this paper, Tang-e Karzin hydrometric station which is located in sub-domain of salman-farsi dam had been considered. By utilizing of weekly statistical discharge information related to past 36 years, multilayer perceptron neural network model was used to predict the average weekly discharge of Tang-e Karzin station through the discharge information of ...
International Nuclear Information System (INIS)
In the thesis the results of verification of multilayer perceptron (MLP) {20–41–1} application with sigmoid activation function for prediction of lateral radionuclide migration are presented. The calculated values of Cs 137 and Sr 90 volumetric activity are close to experimental measurement limits, indicating the possibility of MLP application for the solving problem. (authors)
Multilayer perceptron for robust nonlinear interval regression analysis using genetic algorithms.
Hu, Yi-Chung
2014-01-01
On the basis of fuzzy regression, computational models in intelligence such as neural networks have the capability to be applied to nonlinear interval regression analysis for dealing with uncertain and imprecise data. When training data are not contaminated by outliers, computational models perform well by including almost all given training data in the data interval. Nevertheless, since training data are often corrupted by outliers, robust learning algorithms employed to resist outliers for interval regression analysis have been an interesting area of research. Several approaches involving computational intelligence are effective for resisting outliers, but the required parameters for these approaches are related to whether the collected data contain outliers or not. Since it seems difficult to prespecify the degree of contamination beforehand, this paper uses multilayer perceptron to construct the robust nonlinear interval regression model using the genetic algorithm. Outliers beyond or beneath the data interval will impose slight effect on the determination of data interval. Simulation results demonstrate that the proposed method performs well for contaminated datasets. PMID:25110755
Analog Multilayer Perceptron Circuit with On-chip Learning: Portable Electronic Nose
Pan, Chih-Heng; Tang, Kea-Tiong
2011-09-01
This article presents an analog multilayer perceptron (MLP) neural network circuit with on-chip back propagation learning. This low power and small area analog MLP circuit is proposed to implement as a classifier in an electronic nose (E-nose). Comparing with the E-nose using microprocessor or FPGA as a classifier, the E-nose applying analog circuit as a classifier can be faster and much smaller, demonstrate greater power efficiency and be capable of developing a portable E-nose [1]. The system contains four inputs, four hidden neurons, and only one output neuron; this simple structure allows the circuit to have a smaller area and less power consumption. The circuit is fabricated using TSMC 0.18 ?m 1P6M CMOS process with 1.8 V supply voltage. The area of this chip is 1.353×1.353 mm2 and the power consumption is 0.54 mW. Post-layout simulations show that the proposed analog MLP circuit can be successively trained to identify three kinds of fruit odors.
A multilayered perceptron approach to prediction of the SEC's investigation targets.
Kwon, T M; Feroz, E H
1996-01-01
In the fields of accounting and auditing, detection of firms engaged in fraudulent financial reporting has become increasingly important, due to the increased frequency of such events and the attendant costs of litigation. The neural-network approach sheds some light on this problem due to the attributes that it requires minimum prior knowledge of the data and achieves a highly nonlinear computational model based on past experience (training). In this study, we employ seven red flags which are composed of four financial red flags and three turnover red flags in order to detect targets of the Securities and Exchange Commission's (SECs) investigation of fraudulent financial reporting. The red flags are computed over 70 firms spread among various industrial sectors, and form the base data that is used for developing the computational prediction model. Multilayered perceptron computation of this data was able to predict the targets of the SEC investigated firms with an average of 88% accuracy in the cross-validation test. On the other hand, the same data computed by the logit program gave an average prediction rate of 47% PMID:18263521
Estimate of significant wave height from non-coherent marine radar images by multilayer perceptrons
Vicen-Bueno, Raúl; Lido-Muela, Cristina; Nieto-Borge, José Carlos
2012-12-01
One of the most relevant parameters to characterize the severity of ocean waves is the significant wave height ( H s ). The estimate of H s from remotely sensed data acquired by non-coherent X-band marine radars is a problem not completely solved nowadays. A method commonly used in the literature (standard method) uses the square root of the signal-to-noise ratio (SNR) to linearly estimate H s . This method has been widely used during the last decade, but it presents some limitations, especially when swell-dominated sea states are present. To overcome these limitations, a new non-linear method incorporating additional sea state information is proposed in this article. This method is based on artificial neural networks (ANNs), specifically on multilayer perceptrons (MLPs). The information incorporated in the proposed MLP-based method is given by the wave monitoring system (WaMoS II) and concerns not only to the square root of the SNR, as in the standard method, but also to the peak wave length and mean wave period. Results for two different platforms (Ekofisk and FINO 1) placed in different locations of the North Sea are presented to analyze whether the proposed method works regardless of the sea states observed in each location or not. The obtained results empirically demonstrate how the proposed non-linear solution outperforms the standard method regardless of the environmental conditions (platform), maintaining real-time properties.
Hoi, K. I.; Yuen, K. V.; Mok, K. M.
2013-09-01
Multilayer perceptron (MLP), normally trained by the offline backpropagation algorithm, could not adapt to the changing air quality system and subsequently underperforms. To improve this, the extended Kalman filter is adopted into the learning algorithm to build a time-varying multilayer perceptron (TVMLP) in this study. Application of the TVMLP to model the daily averaged concentration of the respirable suspended particulates with aerodynamic diameter of not more than 10 µm (PM10) in Macau shows statistically significant improvement on the performance indicators over the MLP counterpart. In addition, the adaptive learning algorithm could also address explicitly the uncertainty of the prediction so that confidence intervals can be provided. More importantly, the adaptiveness of the TVMLP gives prediction improvement on the region of higher particulate concentrations that the public concerns.
Approximations of Functions by a Multilayer Perceptron: a New Approach.
Pagès, Gilles; Attali, Jean Gabriel
1997-08-01
We provide a radically elementary proof of the universal approximation property of the one-hidden layer perceptron based on the Taylor expansion and the Vandermonde determinant. It works for both L(q) and uniform approximation on compact sets. This approach naturally yields some bounds for the design of the hidden layer and convergence results (including some rates) for the derivatives. A partial answer to Hornik's conjecture on the universality of the bias is proposed. An extension to vector valued functions is also carried out. Copyright 1997 Elsevier Science Ltd. PMID:12662500
Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis
Rossi, Fabrice; Conan-guez, Brieuc
2007-01-01
This paper is an improved version of \\cit in which we study a natural extension of Multi-Layer Perceptrons (MLP) to functional inputs. We show that fundamental results for classical MLP can be extended to functional MLP. We obtain universal approximation results that show the expressive power of functional MLP is comparable to that of numerical MLP. We obtain consistency results which imply that the estimation of optimal parameters for functional MLP is statistically well defined. We finally ...
Experts Fusion and Multilayer Perceptron Based on Belief Learning for Sonar Image Classification
Martin, Arnaud; Osswald, Christophe
2008-01-01
The sonar images provide a rapid view of the seabed in order to characterize it. However, in such as uncertain environment, real seabed is unknown and the only information we can obtain, is the interpretation of different human experts, sometimes in conflict. In this paper, we propose to manage this conflict in order to provide a robust reality for the learning step of classification algorithms. The classification is conducted by a multilayer perceptron, taking into account ...
Cho, Kyunghyun
2013-01-01
In this paper, a simple, general method of adding auxiliary stochastic neurons to a multi-layer perceptron is proposed. It is shown that the proposed method is a generalization of recently successful methods of dropout (Hinton et al., 2012), explicit noise injection (Vincent et al., 2010; Bishop, 1995) and semantic hashing (Salakhutdinov & Hinton, 2009). Under the proposed framework, an extension of dropout which allows using separate dropping probabilities for different hid...
Image Binarization Using Multi-Layer Perceptron: A Semi-Supervised Approach
Amlan Raychaudhuri; Jayanta Dutta
2012-01-01
In this paper, we have discussed the Image Binarization technique using Multilayer Perceptron (MLP). The purpose of Image Binarization is to extract the lightness (brightness, density) as a feature amount from the Image. It converts a gray-scale image of up to 256 gray levels to a black and white image. We use Backpropagation algorithm for training MLP. It is a supervised learning technique. Here Kmeans clustering algorithm has been used for clustering a 256 × 256 gray-level image. The datas...
Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
Mimura, Kazushi; Cousseau, Florent; Okada, Masato
2011-01-01
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limitation, while the theoretical results seems a bit promising. Instead, it reveals ...
Directory of Open Access Journals (Sweden)
Hadi Memarian
2012-10-01
Full Text Available Prediction of highly non-linear behavior of suspended sediment flow in rivers has prime importance in environmental studies and watershed management. In this study, the predictive performance of two Artificial Neural Networks (ANNs, namely Radial Basis Function (RBF and Multi-Layer Perceptron (MLP were compared. Time series data of daily suspended sediment discharge and water discharge at the Langat River, Malaysia were used for training and testing the networks. Mean Square Error (MSE, Normalized Mean Square Error (NMSE and correlation coefficient (r were used for performance evaluation of the models. Using the testing data set, both models produced a similar level of robustness in sediment load simulation. The MLP network model showed a slightly better output than the RBF network model in predicting suspended sediment discharge, especially in the training process. However, both ANNs showed a weak robustness in estimating large magnitudes of sediment load.
Directory of Open Access Journals (Sweden)
Saleh Salimi
2013-10-01
Full Text Available In order to perceive of rainfall- runoff process, essential prediction for water surface source management has special importance. Thereby in this paper, Tang-e Karzin hydrometric station which is located in sub-domain of salman-farsi dam had been considered. By utilizing of weekly statistical discharge information related to past 36 years, multilayer perceptron neural network model was used to predict the average weekly discharge of Tang-e Karzin station through the discharge information of its two upside stations. In order to optimize the weights and biases of the MLP network, we tried to use Artificial Bee Colony (ABC algorithm within training phase of the ANN network. The results indicated that by changing of different parameters of hidden layer of perceptron model, ABC can well optimize ANN’s weights and biases. Among five activation function Log-sigmoid was performed better than others with 9 neurons in hidden layer
Hybrid Evolutionary Algorithm for Multilayer Perceptron Networks with Competetive Performance.
Czech Academy of Sciences Publication Activity Database
Neruda, Roman
Los Alamitos : IEEE, 2007, s. 1620-1627. ISBN 978-1-4244-1339-3. [CEC 2007. Congress on Evolutionary Computation . Singapore (SG), 25.09.2007-28.09.2007] R&D Projects: GA AV ?R 1ET100300419 Institutional research plan: CEZ:AV0Z10300504 Keywords : hybrid algorithms * evolutionary learning * neural networks Subject RIV: IN - Informatics, Computer Science
International Nuclear Information System (INIS)
Highlights: • Multilayer perceptrons are used to simulate the I–V curve of thin-film PV modules. • APE from the spectral irradiance was added as an input variable to the network. • A self-organised map is used to select the curves used for training the network. • Curve error and maximum power error decrease when using this technique. • This method could provide accurate estimation of the output of a PV plant. - Abstract: In this paper, we propose the use of a methodology to characterise the electrical parameters of several thin-film photovoltaic module technologies. This methodology allows us to use not only solar irradiance and module temperature as classical models do, but also spectral distribution of solar radiation. The methodology is based on the use of neural network models. From all measured I–V curves of a module, a previous selection of them has been used in order to train the neural network model. This selection is performed using a Kohonen self-organising map fed with spectral data. This spectral information has been added as an input to the neural network itself. The results show that the incorporation of spectral measurements to simulate thin-film modules improves significantly both the fitting of the predicted I–V curve to the measured one and the peak power point estimation
Classification of Parking Spots Using Multilayer Perceptron Networks
Directory of Open Access Journals (Sweden)
FALCAO, H. S.
2013-12-01
Full Text Available This project intends to develop a prototype for the identification of free spots in open air parking area where there is a good aerial view without obstacles, allowing for the identification of occupied and free spots. We used image processing techniques and pattern recognition using Artificial Neural Networks (ANN. In order to help implement the prototype, we used Matlab. In order to simulate the parking area, we created a model so that we could acquire the images using a webcam, process them, train the neural network, classify the spots and finally, show the results. The results show that it is viable to apply pattern recognition through image capture to classify parking spots
Multilayer Perceptron with Functional Inputs: an Inverse Regression Approach
Ferre?, Louis; Villa, Nathalie
2007-01-01
Abstract. Functional data analysis is a growing research field as more and more practical applications involve functional data. In this paper, we focus on the problem of regression and classification with functional predictors: the model suggested combines an efficient dimension reduction procedure [functional sliced inverse regression, first introduced by Ferré & Yao (Statistics, 37, 2003, 475)], for which we give a regularized version, with the accuracy of a neural network. Some consistenc...
Fuzzy and Multilayer Perceptron for Evaluation of HV Bushings
Dhlamini, Sizwe M.; Marwala, Tshilidzi; Majozi, Thokozani
2007-01-01
The work proposes the application of fuzzy set theory (FST) to diagnose the condition of high voltage bushings. The diagnosis uses dissolved gas analysis (DGA) data from bushings based on IEC60599 and IEEE C57-104 criteria for oil impregnated paper (OIP) bushings. FST and neural networks are compared in terms of accuracy and computational efficiency. Both FST and NN simulations were able to diagnose the bushings condition with 10% error. By using fuzzy theory, the maintenanc...
Classification of Parking Spots Using Multilayer Perceptron Networks
Falcao, H. S.; Lovato, A. V.; Dos, Santos A. F.; Oliveira, L. S.
2013-01-01
This project intends to develop a prototype for the identification of free spots in open air parking area where there is a good aerial view without obstacles, allowing for the identification of occupied and free spots. We used image processing techniques and pattern recognition using Artificial Neural Networks (ANN). In order to help implement the prototype, we used Matlab. In order to simulate the parking area, we created a model so that we could acquire the images using a webcam, process th...
FPGA Implementation of Multilayer Perceptron for Modeling of Photovoltaic panel
Mekki, H.; Mellit, A.; Salhi, H.; Belhout, K.
2008-06-01
The Number of electronic applications using artificial neural network-based solutions has increased considerably in the last few years. However, their applications in photovoltaic systems are very limited. This paper introduces the preliminary result of the modeling and simulation of photovoltaic panel based on neural network and VHDL-language. In fact, an experimental database of meteorological data (irradiation, temperature) and output electrical generation signals of the PV-panel (current and voltage) has been used in this study. The inputs of the ANN-PV-panel are the daily total irradiation and mean average temperature while the outputs are the current and voltage generated from the panel. Firstly, a dataset of 4x364 have been used for training the network. Subsequently, the neural network (MLP) corresponding to PV-panel is simulated using VHDL language based on the saved weights and bias of the network. Simulation results of the trained MLP-PV panel based on Matlab and VHDL are presented. The proposed PV-panel model based ANN and VHDL permit to evaluate the performance PV-panel using only the environmental factors and involves less computational efforts, and it can be used for predicting the output electrical energy from the PV-panel.
FPGA Implementation of Multilayer Perceptron for Modeling of Photovoltaic panel
International Nuclear Information System (INIS)
The Number of electronic applications using artificial neural network-based solutions has increased considerably in the last few years. However, their applications in photovoltaic systems are very limited. This paper introduces the preliminary result of the modeling and simulation of photovoltaic panel based on neural network and VHDL-language. In fact, an experimental database of meteorological data (irradiation, temperature) and output electrical generation signals of the PV-panel (current and voltage) has been used in this study. The inputs of the ANN-PV-panel are the daily total irradiation and mean average temperature while the outputs are the current and voltage generated from the panel. Firstly, a dataset of 4x364 have been used for training the network. Subsequently, the neural network (MLP) corresponding to PV-panel is simulated using VHDL language based on the saved weights and bias of the network. Simulation results of the trained MLP-PV panel based on Matlab and VHDL are presented. The proposed PV-panel model based ANN and VHDL permit to evaluate the performance PV-panel using only the environmental factors and involves less computational efforts, and it can be used for predicting the output electrical energy from the PV-panel
Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis
Rossi, Fabrice
2005-01-01
In this paper, we study a natural extension of Multi-Layer Perceptrons (MLP) to functional inputs. We show that fundamental results for classical MLP can be extended to functional MLP. We obtain universal approximation results that show the expressive power of functional MLP is comparable to that of numerical MLP. We obtain consistency results which imply that the estimation of optimal parameters for functional MLP is statistically well defined. We finally show on simulated and real world data that the proposed model performs in a very satisfactory way.
Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
Mimura, Kazushi; Okada, Masato
2011-01-01
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limitation, while the theoretical results seems a bit promising. Instead, it reveals it might have a rich and complex structure of the solution space via the BP-based algorithms.
Experts Fusion and Multilayer Perceptron Based on Belief Learning for Sonar Image Classification
Martin, Arnaud
2008-01-01
The sonar images provide a rapid view of the seabed in order to characterize it. However, in such as uncertain environment, real seabed is unknown and the only information we can obtain, is the interpretation of different human experts, sometimes in conflict. In this paper, we propose to manage this conflict in order to provide a robust reality for the learning step of classification algorithms. The classification is conducted by a multilayer perceptron, taking into account the uncertainty of the reality in the learning stage. The results of this seabed characterization are presented on real sonar images.
Fuzzy and Multilayer Perceptron for Evaluation of HV Bushings
Dhlamini, Sizwe M; Majozi, Thokozani
2007-01-01
The work proposes the application of fuzzy set theory (FST) to diagnose the condition of high voltage bushings. The diagnosis uses dissolved gas analysis (DGA) data from bushings based on IEC60599 and IEEE C57-104 criteria for oil impregnated paper (OIP) bushings. FST and neural networks are compared in terms of accuracy and computational efficiency. Both FST and NN simulations were able to diagnose the bushings condition with 10% error. By using fuzzy theory, the maintenance department can classify bushings and know the extent of degradation in the component.
Approximating Gaussian mixture model or radial basis function network with multilayer perceptron.
Patrikar, Ajay M
2013-07-01
Gaussian mixture models (GMMs) and multilayer perceptron (MLP) are both popular pattern classification techniques. This brief shows that a multilayer perceptron with quadratic inputs (MLPQ) can accurately approximate GMMs with diagonal covariance matrices. The mapping equations between the parameters of GMM and the weights of MLPQ are presented. A similar approach is applied to radial basis function networks (RBFNs) to show that RBFNs with Gaussian basis functions and Euclidean norm can be approximated accurately with MLPQ. The mapping equations between RBFN and MLPQ weights are presented. There are well-established training procedures for GMMs, such as the expectation maximization (EM) algorithm. The GMM parameters obtained by the EM algorithm can be used to generate a set of initial weights of MLPQ. Similarly, a trained RBFN can be used to generate a set of initial weights of MLPQ. MLPQ training can be continued further with gradient-descent based methods, which can lead to improvement in performance compared to the GMM or RBFN from which it is initialized. Thus, the MLPQ can always perform as well as or better than the GMM or RBFN. PMID:24808530
Multilayer neural networks a generalized net perspective
Krawczak, Maciej
2013-01-01
The primary purpose of this book is to show that a multilayer neural network can be considered as a multistage system, and then that the learning of this class of neural networks can be treated as a special sort of the optimal control problem. In this way, the optimal control problem methodology, like dynamic programming, with modifications, can yield a new class of learning algorithms for multilayer neural networks. Another purpose of this book is to show that the generalized net theory can be successfully used as a new description of multilayer neural networks. Several generalized net descriptions of neural networks functioning processes are considered, namely: the simulation process of networks, a system of neural networks and the learning algorithms developed in this book. The generalized net approach to modelling of real systems may be used successfully for the description of a variety of technological and intellectual problems, it can be used not only for representing the parallel functioning of homogen...
Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method
Voyant, Cyril; Tamas, Wani; Paoli, Christophe; Balu, Aurélia; Muselli, Marc; Nivet, Marie-Laure; Notton, Gilles
2014-03-01
A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the exhaustive approach where "all" configurations are tested) and learning phases of this artificial intelligence tool (often based on the Levenberg-Marquardt algorithm; LMA) are weaknesses of this approach (exhaustively and local minima). These two tasks must be repeated depending on the knowledge of each new problem studied, making the process, long, laborious and not systematically robust. In this paper a pruning process is proposed. This method allows, during the training phase, to carry out an inputs selecting method activating (or not) inter-nodes connections in order to verify if forecasting is improved. We propose to use iteratively the popular damped least-squares method to activate inputs and neurons. A first pass is applied to 10% of the learning sample to determine weights significantly different from 0 and delete other. Then a classical batch process based on LMA is used with the new MLP. The validation is done using 25 measured meteorological TS and cross-comparing the prediction results of the classical LMA and the 2-stage LMA.
A New Approach to Predicting Bankruptcy: Combining DEA and Multi-Layer Perceptron
Directory of Open Access Journals (Sweden)
Ayan Mukhopadhyay
2012-07-01
Full Text Available The question of financial health and sustenance of a firm is so intriguing that it has spanned numerous studies. For investors,stakeholders and lenders, assessing the risk associated with an enterprise is vital. Several tools have been formulated to deal with predicting the solvency of a firm. This paper attempts to combine Data Envelopment Analysis and Multi-Layer Perceptron (MLP to suggest a new method for prediction of bankruptcy that not only focusses on historical financial data of firms that filed for bankruptcy like other past studies but also takes into account the data of those firms that were likely to do so. This method thus identifies firms that have a high chance of facing bankruptcy along with those that have filed for bankruptcy. The performance of this procedure is compared with MLP. The suggested method outperforms MLP in prediction of bankruptcy.
Leaf Recognition Algorithm Using MLP Neural Network Based Image Processing
Ekshinge Sandip Sambhaji*1,; Andore, D. B.
2014-01-01
In this paper, we employ Multilayer Perceptron with image and data processing techniques and neuralIn this paper, we employ Multilayer Perceptron with image and data processing techniques and neuralIn this paper, we employ Multilayer Perceptron with image and data processing techniques and neuralnetwork to implement a general purpose automated leaf recognition. Sampling leaves and photoing them are low cost and convenient. One can easily transfer the leaf image to a computer and a computer ca...
Salmon, Brian Paxton; Olivier, Jan Corne; Kleynhans, Waldo; Wessels, Konrad J.; Den Bergh, Frans; Steenkamp, Karen C.
2011-01-01
This paper presents a novel land cover change detection method that employs a sliding window over hyper-temporal multi-spectral images acquired from the 7 bands of the MODerate-resolution Imaging Spectroradiometer (MODIS) land surface reflectance product. The method uses a Feedforward Multilayer Perceptron (MLP) for supervised change detection that operates on multi-spectral time series extracted with a sliding window from the dataset. The method was evaluated on both real and simulated land ...
Xiao, Wei; Pu, Dun; Dong, Zhicheng; Liu, Cungen
2013-07-01
The paper presents a novel method of initial weights optimization method in Multi-Layer Perceptron Network(MLPN). Firstly, the sample sets should be transformed by K-L Transform. Secondly, use K-L Converting Matrix to initialize the weights between input and hidden layer. Thirdly the MLPN is trained by BP algorithm, and the convergence speed of MLPN is improved evidently. The ultimate test shows the new algorithm is suitable for the situation of low-dimensional data.
Directory of Open Access Journals (Sweden)
Hafizah Talib
2009-02-01
Full Text Available Normalization is important for Electrical Capacitance Tomography (ECT data due to the very small capacitance values obtained either from the physical or simulated ECT system. Thus far, there are two commonly used normalization methods for ECT, but their suitability has not been investigated. This paper presents the work on comparing the performances of two Multilayer Perceptron (MLP neural networks; one trained based on ECT data normalized using the conventional equation and the other normalized using the improved equation, to recognize gas-oil flow patterns. The correct pattern recognition percentages for both MLPs were calculated and compared. The results showed that the MLP trained with the conventional ECT normalization equation out-performed the ones trained with the improved normalization data for the task of gas-oil pattern recognition.
Directory of Open Access Journals (Sweden)
Alejandro J. Orozco-Naranjo
2013-11-01
Full Text Available This paper presents the results obtained by developing a methodology to detect 5 types of heartbeats (Normal (N, Right bundle branch block (RBBB, Left bundle branch block (LBBB, Premature atrial contraction (APC and Premature ventricular contraction (PVC, using Wavelet transform packets with non-adaptative mode applied on features extraction from heartbeats. It was used the Shannon function to calculate the entropy and It was added an identification nodes stage per every type of cardiac signal in the Wavelet tree. The using of Wavelet packets transform allows the access to information which results of decomposition of low and high frecuency, giving providing a more integral analysis than achieved by the discrete Wavelet transform. Three families of mother Wavelet were evaluated on transformation: Daubechies, Symlet and Reverse Biorthogonal, which were results from a previous research in that were identified the mother Wavelet that had higher entropy with the cardiac signals. With non-adaptive mode, the computational cost is reduced when Wavelet packets are used; this cost represents the most marked disadvantage from the transform. To classify the heartbeats were used Support Vector Machines and Multilayer Perceptron. The best classification error was achieved employing Support Vector Machine and a radial basis function; it was 2.57 %.
Liu, Zhansheng; Violas, Manuel Alberto; Carvalho, Nuno Borges
2013-02-11
In this paper, we propose a wideband dynamic behavioral model for a bulk reflective semiconductor optical amplifier (RSOA) used as a modulator in colorless radio over fiber (RoF) systems using a tapped-delay multilayer perceptron (TDMLP). 64 quadrature amplitude modulation (QAM) signals with 20 Msymbol/s were used to train, validate and test the model. Nonlinear distortion and dynamic effects induced by the RSOA modulator are demonstrated. The parameters of the model such as the number of nodes in the hidden layer and memory depth were optimized to ensure the generality and accuracy. The normalized mean square error (NMSE) is used as a figure of merit. The NMSE was up to -44.33 dB when the number of nodes in the hidden layer and memory depth were set to 20 and 3, respectively. The TDMLP model can accurately approximate to the dynamic characteristics of the RSOA modulator. The dynamic AM-AM and dynamic AM-PM distortions of the RSOA modulator are drawn. The results show that the single hidden layer TDMLP can provide accurate approximation for behaviors of the RSOA modulator. PMID:23481795
Classification of fused face images using multilayer perceptron neural network
Bhattacharjee, Debotosh; Bhowmik, Mrinal Kanti; Nasipuri, Mita; Basu, Dipak Kumar; Kundu, Mahantapas
2010-01-01
This paper presents a concept of image pixel fusion of visual and thermal faces, which can significantly improve the overall performance of a face recognition system. Several factors affect face recognition performance including pose variations, facial expression changes, occlusions, and most importantly illumination changes. So, image pixel fusion of thermal and visual images is a solution to overcome the drawbacks present in the individual thermal and visual face images. F...
FORECASTING ON FOREX MARKET WITH RBF AND PERCEPTRON NEURAL NETWORKS
ALEXANDRA KOTTILOVÁ; LUKÁŠ FALÁT
2012-01-01
This work deals with an alternative approach in financial modelling -artificial neural networks approach. The aim of this paper is to show that this type oftime series modelling is an excellent alternative to classical econometric modelling. Atfirst, neural networks using methods of supervised machine learning are discussed.After explaining theoretical basis of ANN, these models are then applied to specificexchange rate (AUD/USD). Finally, the comparison between statistical models andRBF and ...
Altunkaynak, Abdüsselam; Strom, Kyle B.
2009-12-01
This study uses multilayer perceptron (MP) methods to develop classification models for predicting cascade, step-pool, plane bed, and pool-riffle type reach morphologies in mountain streams. Several models were developed with MP and classical linear regression methods on the basis of the following input variables: channel slope (S), sediment size (d84), bankfull depth (h), and bankfull width (w). Data for model calibration and testing were compiled from previous studies in mountain environments. The data were divided into separate calibration (training) and testing (prediction) sets for both the MP and classical linear regression methods; model performance was based on the percentage of accurately predicted reach morphologies using the testing portion of the data. The results indicate that (1) the MP models outperformed the linear regression models for reach morphology classification; (2) relative submergence (h/d84) was useful for classifying step-pool and pool-riffle reaches but performed poorly in discriminating cascade and plane bed type reaches; (3) inclusion of channel slope in models was important for classifying cascade type reaches; and (4) plane bed reaches were the most difficult to classify and delineate from pool-riffle reaches. The two best performing MP models included the input variables (S, h/d84) and (S, h/d84, w). The overall predictive accuracy for classification of reach type for the two models was 81% and 83%, respectively, with predictive accuracies by reach type as follows: cascade, 100%; step-pool, 81%; plane bed, 67%; pool-riffle, 88% (first model) and cascade, 100%; step-pool, 87%; plane bed, 70%; pool-riffle, 90% (second model).
Replica Symmetry Breaking and the Kuhn-Tucker Cavity Method in simple and multilayer Perceptrons
Gerl, F.; Krey, U.
1996-01-01
Within a Kuhn-Tucker cavity method introduced in a former paper, we study optimal stability learning for situations, where in the replica formalism the replica symmetry may be broken, namely (i) the case of a simple perceptron above the critical loading, and (ii) the case of two-layer AND-perceptrons, if one learns with maximal stability. We find that the deviation of our cavity solution from the replica symmetric one in these cases is a clear indication of the nece...
Fast accurate MEG source localization using a multilayer perceptron trained with real brain noise
Energy Technology Data Exchange (ETDEWEB)
Jun, Sung Chan [Department of Computer Science, University of New Mexico, Albuquerque, NM (Mexico)]. E-mail: junsc@cs.unm.edu; Pearlmutter, Barak A.; Nolte, Guido [Department of Computer Science, University of New Mexico, Albuquerque, NM (Mexico)
2002-07-21
Iterative gradient methods such as Levenberg-Marquardt (LM) are in widespread use for source localization from electroencephalographic (EEG) and magnetoencephalographic (MEG) signals. Unfortunately, LM depends sensitively on the initial guess, necessitating repeated runs. This, combined with LM's high per-step cost, makes its computational burden quite high. To reduce this burden, we trained a multilayer perceptron (MLP) as a real-time localizer. We used an analytical model of quasistatic electromagnetic propagation through a spherical head to map randomly chosen dipoles to sensor activities according to the sensor geometry of a 4D Neuroimaging Neuromag-122 MEG system, and trained a MLP to invert this mapping in the absence of noise or in the presence of various sorts of noise such as white Gaussian noise, correlated noise, or real brain noise. A MLP structure was chosen to trade off computation and accuracy. This MLP was trained four times, with each type of noise. We measured the effects of initial guesses on LM performance, which motivated a hybrid MLP-start-LM method, in which the trained MLP initializes LM. We also compared the localization performance of LM, MLPs, and hybrid MLP-start-LMs for realistic brain signals. Trained MLPs are much faster than other methods, while the hybrid MLP-start-LMs are faster and more accurate than fixed-4-start-LM. In particular, the hybrid MLP-start-LM initialized by a MLP trained with the real brain noise dataset is 60 times faster and is comparable in accuracy to random-20-start-LM, and this hybrid system (localization error: 0.28 cm, computation time: 36 ms) shows almost as good performance as optimal-1-start-LM (localization error: 0.23 cm, computation time: 22 ms), which initializes LM with the correct dipole location. MLPs trained with noise perform better than the MLP trained without noise, and the MLP trained with real brain noise is almost as good an initial guesser for LM as the correct dipole location. (author)
Nuzhny, Anton S.; Shumsky, Sergey A.; Korzhov, Alexey G.; Lyubynskaya, Tatiana E.
2008-02-01
Optical scattering spectra obtained in the clinical trials of breast cancer diagnostic system were analyzed for the purpose to detect in the dataflow the segments corresponding to malignant tissues. Minimal invasive probe with optical fibers inside delivers white light from the source and collects the scattering light while being moved through the tissue. The sampling rate is 100 Hz and each record contains the results of measurements of scattered light intensity at 184 fixed wavelength points. Large amount of information acquired in each procedure, fuzziness in criteria of 'cancer' family membership and data noisiness make neural networks to be an attractive tool for analysis of these data. To define the dividing rule between 'cancer' and 'non-cancer' spectral families a three-layer perceptron was applied. In the process of perceptron learning back propagation method was used to minimize the learning error. Regularization was done using the Bayesian approach. The learning sample was formed by the experts. End-to-end probability calculation throughout the procedure dataset showed reliable detection of the 'cancer' segments. Much attention was paid on the spectra of the tissues with high blood content. Often the reason is vessel injury caused by the penetrating optical probe. But also it can be a dense vessel net surrounding the malignant tumor. To make the division into 'cancer' and 'non-cancer' families for the tissues with high blood content a special perceptron was learnt exceptionally on such spectra.
An Optical Thresholding Perceptron
Saxena, Indu; Moerland, Perry; Fiesler, Emile; Pourzand, A. R.; Collings, N.
1997-01-01
An implementation of an optical perceptron with a soft optical threshold trained with an adapted BP algorithm is described as a precursor to an optical multilayer perceptron (MLP). It has 64 inputs and ten outputs. The soft threshold is implemented by a liquid crystal light valve. Experimental results on perceptron recall are also reported. The effect of a modified grey-scale to weight mapping for weight levels implemented by LCTVs is evaluated based on the results of handwritten digit recogn...
Bachtiar, Luqman R; Unsworth, Charles P; Newcomb, Richard D
2015-01-01
The model organism, Drosophila melanogaster, and the mosquito Anopheles gambiae use 60 and 79 odorant receptors, respectively, to sense their olfactory world. However, a commercial "electronic nose" in the form of an insect olfactory biosensor demands very low numbers of receptors at its front end of detection due to the difficulties of receptor/sensor integration and functionalization. In this letter, we demonstrate how computation via artificial neural networks (ANNs), in the form of multilayer perceptrons (MLPs), can be successfully incorporated as the signal processing back end of the biosensor to drastically reduce the number of receptors to three while still retaining 100% performance of odorant detection to that of a full complement of receptors. In addition, we provide a detailed performance comparison between D. melanogaster and A. gambiae odorant receptors and demonstrate that A. gambiae receptors provide superior olfaction detection performance over D. melanogaster for very low receptor numbers. The results from this study present the possibility of using the computation of MLPs to discover ideal biological olfactory receptors for an olfactory biosensor device to provide maximum classification performance of unknown odorants. PMID:25380337
Cebrian, Manuel
2007-01-01
The random initialization of weights of a multilayer perceptron makes it possible to model its training process as a Las Vegas algorithm, i.e. a randomized algorithm which stops when some required training error is obtained, and whose execution time is a random variable. This modelling is used to perform a case study on a well-known pattern recognition benchmark: the UCI Thyroid Disease Database. Empirical evidence is presented of the training time probability distribution exhibiting a heavy tail behavior, meaning a big probability mass of long executions. This fact is exploited to reduce the training time cost by applying two simple restart strategies. The first assumes full knowledge of the distribution yielding a 40% cut down in expected time with respect to the training without restarts. The second, assumes null knowledge, yielding a reduction ranging from 9% to 23%.
Berrar, Daniel; Dubitzky, Werner
2006-01-01
This paper presents a novel type of artificial neural network, called neural plasma, which is tailored for classification tasks involving few observations with a large number of variables. Neural plasma learns to adapt its classification confidence by generating artificial training data as a function of its confidence in previous decisions. In contrast to multilayer perceptrons and similar techniques, which are inspired by topological and operational aspects of biological neural networks, neu...
Bahi, Jacques M.; Couchot, Jean-François; Guyeux, Christophe; Salomon, Michel
2012-03-01
Many research works deal with chaotic neural networks for various fields of application. Unfortunately, up to now, these networks are usually claimed to be chaotic without any mathematical proof. The purpose of this paper is to establish, based on a rigorous theoretical framework, an equivalence between chaotic iterations according to Devaney and a particular class of neural networks. On the one hand, we show how to build such a network, on the other hand, we provide a method to check if a neural network is a chaotic one. Finally, the ability of classical feedforward multilayer perceptrons to learn sets of data obtained from a dynamical system is regarded. Various boolean functions are iterated on finite states. Iterations of some of them are proven to be chaotic as it is defined by Devaney. In that context, important differences occur in the training process, establishing with various neural networks that chaotic behaviors are far more difficult to learn.
Evolutionary Learning Algorithm for Multi-layer Morphological Neural Networks
He Chunmei
2013-01-01
Morphological Neural Network (MNN) is a novel and important neural network and it has many applications such as image processing and pattern recognition. It makes sense to research the learning algorithm of MNN and its application. A method based on genetic algorithm is presented to train and implement multi-layer morphological neural network in this study. The algorithm calculates the weights and biases of morphological neural network and the genetic algorithm automatically acquire the learn...
Feature-Based Facial Expression Recognition: Experiments With a Multi-Layer Perceptron
Zhang, Zhengyou
1998-01-01
In this paper, we report our experiments on feature-based facial expression recognition within an architecture based on a two-layer perceptron. We investigate the use of two types of features extracted from face images: the geometric positions of a set of fiducialpoints on a face, and a set of multi-scale and multi-orientation Gabor wavelet coefficients at these points. They can be used either independently or jointly. The recognition performance with different types of features has been comp...
Directory of Open Access Journals (Sweden)
Vânia Medianeira Flores Costa
2012-04-01
Full Text Available When investors decide to “adventure” through stock markets they search for a method to provide safety on making decision. In fact, there is no precise way to know which stocks will became a profitable investiment. Technical analysis is a discipline that support the investors on making decisions. Such a discipline uses a set of tools and statistical methods to forecast the market’s movement. Such a paper presents the develpment of a robotical Trade System, using a heuristic method. The system has a Neural Network multilayer perceptron, trained with an algorithm for back propagation error. Thus, approaching to the technical analysis without emotional aspects, using the Neural Network forecast on supporting the decisions of a investor on stock market. In analyzing the results of the neural network can be seen that the neural network got a result of 42.6% higher than the diagnostic of the technical analysis.Quando investidores decidem se “aventurar” pelo mercado de renda variável, como pelo mercado de ações, buscam um método de ter mais segurança na tomada de decisão. Na prática, não há como saber quais ativos tornar-se-ão um investimento lucrativo. No mercado acionário, a Análise Técnica procura auxiliar o investidor na tomada de decisão. Para isso, utiliza-se de ferramentas e de métodos estatísticos para tentar predizer os movimentos do mercado. Este artigo apresenta o desenvolvimento de um Trade System robótico, utilizando um método heurístico. O sistema conta com uma rede neural multilayer perceptron, treinada com o algoritmo de retro propagação de erro, aproximando-se da análise técnica sem o fator emoção. Ao avaliar os resultados da rede neural, pode ser visto que a mesma obteve um resultado de 42,6% maior do que o diagnóstico da análise técnica.
Introduction to Perceptron Networks
DEFF Research Database (Denmark)
Jantzen, Jan
1998-01-01
When it is time-consuming or expensive to model a plant using the basic laws of physics, a neural network approach can be an alternative. From a control engineer's viewpoint a two-layer perceptron network is sufficient. It is indicated how to model a dynamic plant using a perceptron network.
Data assimilation: Particle filter and artificial neural networks
International Nuclear Information System (INIS)
The goal of this work is to present the performance of the Neural Network Multilayer Perceptrons trained to emulate a Particle Filter in the context of data assimilation. Techniques for data assimilation are applied for the Lorenz system, which presents a strong nonlinearity and chaotic nature. The cross validation method was used for training the network. Good results were obtained applying the multilayer perceptrons neural network.
Salmon, B. P.; Olivier, J. C.; Kleynhans, W.; Wessels, K. J.; van den Bergh, F.; Steenkamp, K. C.
2011-12-01
This paper presents a novel land cover change detection method that employs a sliding window over hyper-temporal multi-spectral images acquired from the 7 bands of the MODerate-resolution Imaging Spectroradiometer (MODIS) land surface reflectance product. The method uses a Feedforward Multilayer Perceptron (MLP) for supervised change detection that operates on multi-spectral time series extracted with a sliding window from the dataset. The method was evaluated on both real and simulated land cover change examples. The simulated land cover change comprises of concatenated time series that are produced by blending actual time series of pixels from human settlements to those from adjacent areas covered by natural vegetation. The method employs an iteratively retrained MLP to capture all local patterns and to compensate for the time-varying climate change in the geographical area. The iteratively retrained MLP was compared to a classical batch mode trained MLP. Depending on the length of the temporal sliding window used, an overall change detection accuracy between 83% and 90% was achieved. It is shown that a sliding window of 6 months using all 7 bands of MODIS data is sufficient to detect land cover change reliably. Window sizes of 18 months and longer provide minor improvements to classification accuracy and change detection performance at the cost of longer time delays.
Hybrid Optimized Back propagation Learning Algorithm For Multi-layer Perceptron
Chakraborty, Mriganka; Ghosh, Arka
2012-01-01
Standard neural network based on general back propagation learning using delta method or gradient descent method has some great faults like poor optimization of error-weight objective function, low learning rate, instability .This paper introduces a hybrid supervised back propagation learning algorithm which uses trust-region method of unconstrained optimization of the error objective function by using quasi-newton method .This optimization leads to more accurate weight upda...
Evolutionary Learning Algorithm for Multi-layer Morphological Neural Networks
Directory of Open Access Journals (Sweden)
He Chunmei
2013-01-01
Full Text Available Morphological Neural Network (MNN is a novel and important neural network and it has many applications such as image processing and pattern recognition. It makes sense to research the learning algorithm of MNN and its application. A method based on genetic algorithm is presented to train and implement multi-layer morphological neural network in this study. The algorithm calculates the weights and biases of morphological neural network and the genetic algorithm automatically acquire the learning rate. After that, the trained morphological neural network is applied to image restoration. The image restoration simulation and a comparison with the median filter are shown in the end. It shows that the morphological neural network is a quite good method applied to image restoration.
Schwindling Jerome
2010-01-01
This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in par...
Electron/pion identification in the CBM TRD using a multilayer perceptron
International Nuclear Information System (INIS)
The problem of electron/pion identification in the CBM experiment based on the measurements of energy losses and transition radiation in the TRD detector is discussed. A possibility to solve such a problem by applying an artificial neural network (ANN) is considered. As input information for the network we used both the samples of energy losses of pions or electrons in the TRD absorbers and the 'clever' variable obtained on the basis of the original data. We show that usage of this new variable permits one to reach a reliable level of particle recognition no longer than after 10-20 training epochs; there are practically no fluctuations against the trend, and the needed level of pions suppression is obtained under the condition of a minimal loss of electrons
Directory of Open Access Journals (Sweden)
Emin AVCI
2007-06-01
Full Text Available Especially for the last decade, the neural network models have been applied to solve financial problems like portfolio construction and stock market forecasting. Among the alternative neural network models, the multilayer perceptron models are expected to be effective and widely applied in financial forecasting. This study examines the forecasting power multilayer perceptron models for daily and sessional returns of ISE-100 index. The findings imply that the multilayer perceptron models presented promising performance in forecasting the ISE-100 index returns. However, further emphasis should be placed on different input variables and model architectures in order to improve the forecasting performances.
Scientific Electronic Library Online (English)
Yuleidys, Mejías César; Ramón, Carrasco Velar; Isbel, Ochoa Izquierdo; Edel, Moreno Lemus.
2013-12-01
Full Text Available El perceptrón multicapa (PMC) figura dentro de los tipos de redes neuronales artificiales (RNA) con resultados útiles en los estudios de relación estructura-actividad. Dado que los volúmenes de datos en proyectos de Bioinformática son eventualmente grandes, se propuso evaluar algoritmos para acortar [...] el tiempo de entrenamiento de la red sin afectar su eficiencia. Se desarrolló un algoritmo para el entrenamiento local y distribuido del PMC con la posibilidad de variar las funciones de transferencias para lo cual se utilizaron el Weka y la Plataforma de Tareas Distribuidas Tarenal para distribuir el entrenamiento del perceptrón multicapa. Se demostró que en dependencia de la muestra de entrenamiento, la variación de las funciones de transferencia pueden reportar resultados mucho más eficientes que los obtenidos con la clásica función Sigmoidal, con incremento de la g-media entre el 4.5 y el 17 %. Se encontró además que en los entrenamientos distribuidos es posible alcanzar eventualmente mejores resultados que los logrados en ambiente local. Abstract in english The multilayer perceptron (PMC) ranks among the types of artificial neural networks (ANN), which has provided better results in studies of structure-activity relationship. As the data volumes in Bioinformatics' projects are eventually big, it was proposed to evaluate algorithms to shorten the traini [...] ng time of the network without affecting its efficiency. There were evaluated different tools that work with ANN and were selected Weka algorithm for extracting the network and the Platform for Distributed Task Tarenal to distribute the training of multilayer perceptron. Finally, it was developed a training algorithm for local and distributed the MLP with the possibility of varying transfer functions. It was shown that depending on the training sample, the change of transfer functions can yield results much more efficient than those obtained with the classic sigmoid function with increased g-media between 4.5 and 17 %. Moreover, it was found that with distributed training can be achieved eventually, better results than those achieved in the local environment.
Schwindling, Jerome
2010-04-01
This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p.) corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Directory of Open Access Journals (Sweden)
Schwindling Jerome
2010-04-01
Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Building a Chaotic Proved Neural Network
Bahi, Jacques M; Salomon, Michel
2011-01-01
Chaotic neural networks have received a great deal of attention these last years. In this paper we establish a precise correspondence between the so-called chaotic iterations and a particular class of artificial neural networks: global recurrent multi-layer perceptrons. We show formally that it is possible to make these iterations behave chaotically, as defined by Devaney, and thus we obtain the first neural networks proven chaotic. Several neural networks with different architectures are trained to exhibit a chaotical behavior.
Kallin Westin, Lena
2004-01-01
Reliable results are crucial when working with medical decision support systems. A decision support system should be reliable but also be interpretable, i.e. able to show how it has inferred its conclusions. In this thesis, the preprocessing perceptron is presented as a simple but effective and efficient analysis method to consider when creating medical decision support systems. The preprocessing perceptron has the simplicity of a perceptron combined with a performance comparable to the multi...
Artificial neural networks in predicting current in electric arc furnaces
Panoiu, M.; Panoiu, C.; Iordan, A.; Ghiormez, L.
2014-03-01
The paper presents a study of the possibility of using artificial neural networks for the prediction of the current and the voltage of Electric Arc Furnaces. Multi-layer perceptron and radial based functions Artificial Neural Networks implemented in Matlab were used. The study is based on measured data items from an Electric Arc Furnace in an industrial plant in Romania.
Advances in Artificial Neural Networks - Methodological Development and Application
Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other ne...
Zhang, Xiuping
In this paper, the weights of a Neural Network using Chaotic Imperialist Competitive Algorithm are updated. A three-layered Perseptron Neural Network applied for prediction of the maximum worth of the stocks changed in TEHRAN's bourse market. We trained this neural network with CICA, ICA, PSO and GA algorithms and compared the results with each other. The consideration of the results showed that the training and test error of the network trained by the CICA algorithm has been reduced in comparison to the other three methods.
The use of artificial neural networks for residential buildings conceptual cost estimation
Juszczyk, Micha?
2013-10-01
Accurate cost estimation in the early phase of the building's design process is of key importance for a project's success. Both underestimation and overestimation may lead to projects failure in terms of costs. The paper presents synthetically some research results on the use of neural networks for conceptual cost estimation of residential buildings. In the course of the research the author focused on regression models binding together the basic information about residential buildings available in the early stage of design and construction cost. Application of different neural networks types was analysed (multilayer perceptron, multilayer perceptron with data compression based on principal component analysis and radial basis function networks). Due to the research results, multilayer perceptron networks proved to be the best neural network type for the problem solution. The research results indicate that a neural approach may be an interesting alternative for the traditional methods of conceptual cost estimation in construction projects.
Unsupervised classification of neural spikes with a hybrid multilayer artificial neural network.
García, P; Suárez, C P; Rodríguez, J; Rodríguez, M
1998-07-01
The understanding of the brain structure and function and its computational style is one of the biggest challenges both in Neuroscience and Neural Computation. In order to reach this and to test the predictions of neural network modeling, it is necessary to observe the activity of neural populations. In this paper we propose a hybrid modular computational system for the spike classification of multiunits recordings. It works with no knowledge about the waveform, and it consists of two moduli: a Preprocessing (Segmentation) module, which performs the detection and centering of spike vectors using programmed computation; and a Processing (Classification) module, which implements the general approach of neural classification: feature extraction, clustering and discrimination, by means of a hybrid unsupervised multilayer artificial neural network (HUMANN). The operations of this artificial neural network on the spike vectors are: (i) compression with a Sanger Layer from 70 points vector to five principal component vector; (ii) their waveform is analyzed by a Kohonen layer; (iii) the electrical noise and overlapping spikes are rejected by a previously unreported artificial neural network named Tolerance layer; and (iv) finally the spikes are labeled into spike classes by a Labeling layer. Each layer of the system has a specific unsupervised learning rule that progressively modifies itself until the performance of the layer has been automatically optimized. The procedure showed a high sensitivity and specificity also when working with signals containing four spike types. PMID:10223516
Sanz, Javier; Perera Velamaza?n, Ricardo; Huerta Gomez Merodio, M. Consuelo
2012-01-01
This paper presents a multi-stage algorithm for the dynamic condition monitoring of a gear. The algorithm provides information referred to the gear status (fault or normal condition) and estimates the mesh stiffness per shaft revolution in case that any abnormality is detected. In the first stage, the analysis of coefficients generated through discrete wavelet transformation (DWT) is proposed as a fault detection and localization tool. The second stage consists in establishing the mesh stiffn...
Application of artificial neural networks (multilayer perceptron) in reactor safety research
International Nuclear Information System (INIS)
One of the key areas of reactor safety research are studies of reliable and safe heat removal from the reactor core and the containment, respectively, of light water reactors. Leakage accidents could carry insulating material into the containment or the building sump of the containment and the associated post-decay heat removal systems. This could obstruct systems functions. In the study titled ''Knowledge-based Modeling of Transport Processes in BWR Coolant Flows Carrying Particle Loads after Loss-of-Coolant Accidents,'' a tool is being created for engineering application which allows the deposition and retention of insulating material in the sump of the reactor containment to be estimated. Potential plant conditions in accidents can be assessed in this way. The study serves the purpose of modeling by means of data-based and knowledge-based methods. In this way, the results of experimental investigations (such as differential pressure tests of retention systems) can be used for modeling purposes. (orig.)
Identification of botanical specimens using artificial neural networks
Clark, Jy
2004-01-01
his paper describes a method of training an artificial neural network, specifically a multilayer perceptron (MLP), to identify plants using morphological characters collected from herbarium specimens. A practical methodology is presented to enable taxonomists to use neural networks as advisory tools for identification purposes, by collating results from a population of neural networks. A comparison is made between the ability of the neural network and that of other methods for identi...
Neural-estimator for the surface emission rate of atmospheric gases
Paes, F F
2009-01-01
The emission rate of minority atmospheric gases is inferred by a new approach based on neural networks. The neural network applied is the multi-layer perceptron with backpropagation algorithm for learning. The identification of these surface fluxes is an inverse problem. A comparison between the new neural-inversion and regularized inverse solution id performed. The results obtained from the neural networks are significantly better. In addition, the inversion with the neural netwroks is fster than regularized approaches, after training.
Automated plant identification using artificial neural networks
Clark, Jy
2012-01-01
This paper describes a method of training an artificial neural network, specifically a multilayer perceptron (MLP), to act as a tool to help identify plants using morphological characters collected automatically from images of botanical herbarium specimens. A methodology is presented here to provide a practical way for taxonomists to use neural networks as automated identification tools, by collating results from a population of neural networks. A case study is provided using data extracted f...
García-Cuesta, Esteban; de Castro, Antonio J; Galván, Inés M; López, Fernando
2014-01-01
In this work, a methodology based on the combined use of a multilayer perceptron model fed using selected spectral information is presented to invert the radiative transfer equation (RTE) and to recover the spatial temperature profile inside an axisymmetric flame. The spectral information is provided by the measurement of the infrared CO2 emission band in the 3-5 ?m spectral region. A guided spectral feature selection was carried out using a joint criterion of principal component analysis and a priori physical knowledge of the radiative problem. After applying this guided feature selection, a subset of 17 wavenumbers was selected. The proposed methodology was applied over synthetic scenarios. Also, an experimental validation was carried out by measuring the spectral emission of the exhaust hot gas plume in a microjet engine with a Fourier transform-based spectroradiometer. Temperatures retrieved using the proposed methodology were compared with classical thermocouple measurements, showing a good agreement between them. Results obtained using the proposed methodology are very promising and can encourage the use of sensor systems based on the spectral measurement of the CO2 emission band in the 3-5 ?m spectral window to monitor combustion processes in a nonintrusive way. PMID:25061791
Polyhedrons and Perceptrons Are Functionally Equivalent
Crespin, Daniel
2013-01-01
Mathematical definitions of polyhedrons and perceptron networks are discussed. The formalization of polyhedrons is done in a rather traditional way. For networks, previously proposed systems are developed. Perceptron networks in disjunctive normal form (DNF) and conjunctive normal forms (CNF) are introduced. The main theme is that single output perceptron neural networks and characteristic functions of polyhedrons are one and the same class of functions. A rigorous formulati...
Stojnic, Mihailo
2013-01-01
In this paper we consider the classical spherical perceptron problem. This problem and its variants have been studied in a great detail in a broad literature ranging from statistical physics and neural networks to computer science and pure geometry. Among the most well known results are those created using the machinery of statistical physics in \\cite{Gar88}. They typically relate to various features ranging from the storage capacity to typical overlap of the optimal configu...
Energy Technology Data Exchange (ETDEWEB)
Oku, Makito, E-mail: oku@sat.t.u-tokyo.ac.j [Department of Mathematical Informatics, Graduate School of Information Science and Technology, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 (Japan); Aihara, Kazuyuki [Institute of Industrial Science, University of Tokyo, 4-6-1 Komaba, Meguro-ku, Tokyo 153-8505 (Japan); Department of Mathematical Informatics, Graduate School of Information Science and Technology, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 (Japan)
2010-11-01
A modularly-structured neural network model is considered. Each module, which we call a 'cell', consists of two parts: a Hopfield neural network model and a multilayered perceptron. An array of such cells is used to simulate the Rule 110 cellular automaton with high accuracy even when all the units of neural networks are replaced by stochastic binary ones. We also find that noise not only degrades but also facilitates computation if the outputs of multilayered perceptrons are below the threshold required to update the states of the cells, which is a stochastic resonance in computation.
International Nuclear Information System (INIS)
A modularly-structured neural network model is considered. Each module, which we call a 'cell', consists of two parts: a Hopfield neural network model and a multilayered perceptron. An array of such cells is used to simulate the Rule 110 cellular automaton with high accuracy even when all the units of neural networks are replaced by stochastic binary ones. We also find that noise not only degrades but also facilitates computation if the outputs of multilayered perceptrons are below the threshold required to update the states of the cells, which is a stochastic resonance in computation.
Philippe Thomas; Marie-Christine Suhner; André Thomas
2013-01-01
Simulation is a useful tool for the evaluation of a Master Production/Distribution Schedule (MPS). The goal of this paper is to propose a new approach to designing a simulation model by reducing its complexity. According to the theory of constraints, a reduced model is built using bottlenecks and a neural network exclusively. This paper focuses on one step of the network model design: determining the structure of the network. This task may be performed by using the constructive or pruning app...
Multi-modular neural networks for the classification of e+e- hadronic events
International Nuclear Information System (INIS)
Some multi-modular neural network methods of classifying e+e- hadronic events are presented. We compare the performances of the following neural networks: MLP (multilayer perceptron), MLP and LVQ (learning vector quantization) trained sequentially, and MLP and RBF (radial basis function) trained sequentially. We introduce a MLP-RBF cooperative neural network. Our last study is a multi-MLP neural network. (orig.)
Discrete Orthogonal Transforms and Neural Networks for Image Interpolation
Directory of Open Access Journals (Sweden)
J. Polec
1999-09-01
Full Text Available In this contribution we present transform and neural network approaches to the interpolation of images. From transform point of view, the principles from [1] are modified for 1st and 2nd order interpolation. We present several new interpolation discrete orthogonal transforms. From neural network point of view, we present interpolation possibilities of multilayer perceptrons. We use various configurations of neural networks for 1st and 2nd order interpolation. The results are compared by means of tables.
Artificial Neural Networks in Catalyst Development. Chapter 10.
Czech Academy of Sciences Publication Activity Database
Hole?a, Martin; Baerns, M.
New Jersey : John Wiley and Sons, 2003 - (Cawse, J.), s. 163-202 ISBN 0-471-20343-2 Source of funding: V - iné verejné zdroje Keywords : artificial neural networks * multilayer perceptrons * nonlinear dependency * approximation * network training * knowledge extraction Subject RIV: IN - Informatics, Computer Science
Novel LDPC Decoder via MLP Neural Networks
Karami, Alireza; Attari, Mahmoud Ahmadian
2014-01-01
In this paper, a new method for decoding Low Density Parity Check (LDPC) codes, based on Multi-Layer Perceptron (MLP) neural networks is proposed. Due to the fact that in neural networks all procedures are processed in parallel, this method can be considered as a viable alternative to Message Passing Algorithm (MPA), with high computational complexity. Our proposed algorithm runs with soft criterion and concurrently does not use probabilistic quantities to decide what the es...
Heterogeneous neural networks: theory and applications
Belanche Mun?oz, Lluis
2000-01-01
This work presents a class of functions serving as generalized neuron models to be used in artificial neural networks. They are cast into the common framework of computing a similarity function, a flexible definition of a neuron as a pattern recognizer. The similarity endows the model with a clear conceptual view and serves as a unification cover for many of the existing neural models, including those classically used for the MultiLayer Perceptron (MLP) and most of those used in Radial Basis ...
Comparision of Neural Algorithms for Funchtion Approximation
Lale Ozyilmaz; Tulay Yildirim; Kevser Koklu
2002-01-01
In this work, various neural network algorithms have been compared for function approximation problems. Multilayer Perceptron (MLP) structure with standard back propagation, MLP with fast back propagation (adaptive learning and momentum term added), MLP with Levenberg-Marquardt learning algorithms, Radial Basis Function (RBF) network structure trained by OLS algorithm and Conic Section Function Neural Network (CSFNN) with adaptive learning have been investigated for various functions. Results...
Schroeder, M.; Kinzel, W.
1997-01-01
An artificial neural network can be used to generate a series of numbers. A boolean perceptron generates bit sequences with a periodic structure. The corresponding spectrum of cycle lengths is investigated analytically and numerically; it has similarities with properties of rational numbers.
A New Filter Design Method for Disturbed Multilayer Hopfield Neural Networks
Directory of Open Access Journals (Sweden)
AHN, C. K.
2011-05-01
Full Text Available This paper investigates the passivity based filtering problem for multilayer Hopfield neural networks with external disturbance. A new passivity based filter design method for multilayer Hopfield neural networks is developed to ensure that the filtering error system is exponentially stable and passive from the external disturbance vector to the output error vector. The unknown gain matrix is obtained by solving a linear matrix inequality (LMI, which can be easily facilitated by using some standard numerical packages. An illustrative example is given to demonstrate the effectiveness of the proposed filter.
Fault Diagnosis System for NPC Inverter based on Multi-Layer Principal Component Neural Network
Directory of Open Access Journals (Sweden)
Danjiang Chen
2013-06-01
Full Text Available This paper presents a fault diagnosis method for a neutral point clamped (NPC inverter using a multi-layer artificial neural network (MANN. The considered possible faults of NPC inverter include the open-circuit fault occurring in one single device or more devices. The upper, middle and down bridge voltages are adopted the test signals because of the difficulties in isolating some fault modes. A novel multi-layer neural network is proposed to diagnose all possible open-circuit faults. Furthermore, the principal component analysis (PCA is utilized to reduce the input size of neural network. The comparison between neural network with and without PCA is performed. The simulation and experimental results prove the feasibility of the diagnostic method and show that the proposed method has the advantages of good classification performance and high reliability.
Fuzzy neural network for invariant optical pattern recognition
Wen, Zhiqing; Yeh, Pochi; Yang, Xiangyang
1996-08-01
A novel fuzzy neural network (FNN) model for invariant pattern recognition is presented that combines fuzzy set reasoning and artificial neural network techniques. The presented FNN consists of three blocks: fuzzifier, fuzzy perceptron, and defuzzifier. It fuzzifies the input patterns and trains the interconnection weights according to membership functions instead of traditional binary values. The proposed FNN has been applied to 2D binary-image pattern recognition under shift and some other types of distortions. In comparison with the classical multilayer perceptron, the FNN possesses a higher recognition rate and is more robust to input distortions.
ESTIMATION OF INPUT IMPEDANCE OF MICROSTRIP PATCH ANTENNA USING FUZZY NEURAL NETWORK
VANDANA VIKAS THAKARE; PRAMOD KUMAR SINGHAL
2010-01-01
The paper presents the use of fuzzy neural network (FNN) as a fast and better technique for the determination of input impedance of coaxial feed rectangular microstrip antenna. The fuzzy parameter ensures better performance as compared to three layer multilayered perceptron feed forward back propagation artificial neural network (MLPFFBP ANN) and radial basis function artificial neural network (RBF ANN) in the determination of input impedance of the coaxial feed microstrip antenna.
ESTIMATION OF INPUT IMPEDANCE OF MICROSTRIP PATCH ANTENNA USING FUZZY NEURAL NETWORK
Directory of Open Access Journals (Sweden)
VANDANA VIKAS THAKARE
2010-10-01
Full Text Available The paper presents the use of fuzzy neural network (FNN as a fast and better technique for the determination of input impedance of coaxial feed rectangular microstrip antenna. The fuzzy parameter ensures better performance as compared to three layer multilayered perceptron feed forward back propagation artificial neural network (MLPFFBP ANN and radial basis function artificial neural network (RBF ANN in the determination of input impedance of the coaxial feed microstrip antenna.
International Nuclear Information System (INIS)
A nonlinear multivariable empirical model is developed for a U-tube steam generator using the recurrent multilayer perceptron network as the underlying model structure. The recurrent multilayer perceptron is a dynamic neural network, very effective in the input-output modeling of complex process systems. A dynamic gradient descent learning algorithm is used to train the recurrent multilayer perceptron, resulting in an order of magnitude improvement in convergence speed over static learning algorithms. In developing the U-tube steam generator empirical model, the effects of actuator, process,and sensor noise on the training and testing sets are investigated. Learning and prediction both appear very effective, despite the presence of training and testing set noise, respectively. The recurrent multilayer perceptron appears to learn the deterministic part of a stochastic training set, and it predicts approximately a moving average response. Extensive model validation studies indicate that the empirical model can substantially generalize (extrapolate), though online learning becomes necessary for tracking transients significantly different than the ones included in the training set and slowly varying U-tube steam generator dynamics. In view of the satisfactory modeling accuracy and the associated short development time, neural networks based empirical models in some cases appear to provide a serious alternative to first principles models. Caution, however, must be exercisemodels. Caution, however, must be exercised because extensive on-line validation of these models is still warranted
Scientific Electronic Library Online (English)
Haydeé Elena, Musso; Orlando José, Ávila Blas.
2013-01-01
Full Text Available En este trabajo se realizó un estudio estadístico de variables físico químicas asociadas al fenómeno de contaminación ambiental, en particular concentración media mensual de SO2 , medidas en la ciudad Salta Capital, Argentina, simultáneamente a concentraciones de NO2 y O3 . Las series bajo estudio p [...] resentaban comportamientos dinámicos no lineales, datos atípicos y cambios estructurales, lo que hizo imposible modelarlas con tipologías econométricas tradiciones (AR, MA, ARMA, ARIMA, entre otras). Una solución eficiente que se encontró, hace uso de la teoría de los perceptrones multicapa. Mediante el modelo estructural de series de tiempo, esta solución se presenta como un proceso matemático iterativo que permite obtener un modelado final el cual tiene una muy alta confiabilidad (95%), para realizar pronoósticos a futuro sobre el comportamiento de la variable estudiada. Abstract in english In this paper a statistical study of phisical-chemistry variables connected with enviroment pollution, specifically SO2 monthly average concentration, measured in Salta Capital city, Argentina, together with NO2 and O3 concentrations, was made. Time series under study shown non linear dinamic behavi [...] our, outliers and structural changes. Due to these it was impossible to use typical econometric typologies (AR, MA, ARMA, ARIMA, among others). An effective solution which uses multistep perceptrons theory was found. By using structural time series modelling, this solution is presented by an iterative mathematical process that allows us to obtain a final model with a high confidence level (95%) in order to do the forecasting step on the studied variable.
Directory of Open Access Journals (Sweden)
Haydeé Elena Musso
2013-01-01
Full Text Available En este trabajo se realizó un estudio estadístico de variables físico químicas asociadas al fenómeno de contaminación ambiental, en particular concentración media mensual de SO2 , medidas en la ciudad Salta Capital, Argentina, simultáneamente a concentraciones de NO2 y O3 . Las series bajo estudio presentaban comportamientos dinámicos no lineales, datos atípicos y cambios estructurales, lo que hizo imposible modelarlas con tipologías econométricas tradiciones (AR, MA, ARMA, ARIMA, entre otras. Una solución eficiente que se encontró, hace uso de la teoría de los perceptrones multicapa. Mediante el modelo estructural de series de tiempo, esta solución se presenta como un proceso matemático iterativo que permite obtener un modelado final el cual tiene una muy alta confiabilidad (95%, para realizar pronoósticos a futuro sobre el comportamiento de la variable estudiada.In this paper a statistical study of phisical-chemistry variables connected with enviroment pollution, specifically SO2 monthly average concentration, measured in Salta Capital city, Argentina, together with NO2 and O3 concentrations, was made. Time series under study shown non linear dinamic behaviour, outliers and structural changes. Due to these it was impossible to use typical econometric typologies (AR, MA, ARMA, ARIMA, among others. An effective solution which uses multistep perceptrons theory was found. By using structural time series modelling, this solution is presented by an iterative mathematical process that allows us to obtain a final model with a high confidence level (95% in order to do the forecasting step on the studied variable.
Lee, I-Chi; Wu, Yu-Chieh; Cheng, En-Ming; Yang, Wen-Ting
2015-05-01
Polyelectrolyte multilayer films have been suggested as tunable substrates with flexible surface properties that can modulate cell behavior. However, these films' biological effects on neural stem/progenitor cells have rarely been studied. Herein, biomimetic multilayer films composed of hyaluronic acid and poly-L-lysine were chosen to mimic the native extracellular matrix niche of brain tissue and were evaluated for their inductive effects, without the addition of chemical factors. Because neural stem/progenitor cells are sensitive to substrate properties, it is important that this system provides control over the surface charge, and slight stiffness variations are also possible. Both of these factors affect neural stem/progenitor cell differentiation. The results showed that neural stem/progenitor cells were induced to differentiate on the poly-L-lysine/hyaluronic acid multilayer films with 0.5-4 alternating layers. In addition, the neurite outgrowth length was regulated by the surface charge of the terminal layer but did not increase with the layer number. In contrast, the quantity of differentiated neurons was enhanced slightly as the number of layers increased but was not affected by the surface charge of the terminal layer. In sum, material pairs in the form of native poly-L-lysine/hyaluronic acid films achieved important targets for neural regenerative medicine, including enhancement of the neurite outgrowth length, regulation of neuron differentiation, and the formation of a network. These extracellular matrix-mimetic poly-L-lysine/hyaluronic acid multilayer films may provide a versatile platform that could be useful for surface modification for applications in neural engineering. PMID:25502767
Gamma-ray energy determination using neural network algorithms for an imaging silicon calorimeter
Borisyuk, R.; Casolino, M.; De Pascale, M. P.; Morselli, A.; Picozza, P.; Ogurtsov, A.; Ricci, M.; Sparvoli, R.
1996-02-01
A neural network technique, based on multi-layer perceptrons, is used to fully exploit the performances of a sampling silicon calorimeter in energy identification of gamma rays. The results obtained on simulated data are significantly better than those coming from a classic method analysis.
Scientific Electronic Library Online (English)
Carlos A., de Luna-Ortega; Miguel, Mora-González; Julio C., Martínez-Romo; Francisco J., Luna-Rosas; Jesús, Muñoz-Maciel.
Full Text Available En el presente artículo se da a conocer una alternativa algorítimica a los sistemas actuales de reconocimiento automático del habla (ASR), mediante una propuesta en la forma de realizar la caracterización de las palabras basada en una aproximación que usa la extracción de coeficientes de la codifica [...] ción de predicción lineal (LPC) y la correlación cruzada. La implementación consiste en extraer las características fonéticas mediante los coeficientes LPC, después se forman vectores de patrones de la pronunciación conformados por el promedio de los coeficientes LPC de las muestras de las palabras obteniendo un vector característico de cada pronunciación mediante la autocorrelación de las secuencias de coeficientes LPC; estos vectores se utilizan para entrenar un clasificador de tipo perceptrón multicapa (MLP). Se realizaron pruebas de desempeño previo entrenamiento con los diferentes patrones de las palabras a reconocer. Se utilizó la fonética de los dígitos del cero al nueve como vocabulario objetivo, debido a su amplia aplicación, y para estimar el desempeño de este método se utilizaron dos corpus de pronunciaciones: el corpus UPA, que contempla en su base de datos la pronuncación de la región occidente de México, y el corpus Tlatoa, que hace lo propio para la región centro de México. Las señales en ambos corpus fueron adquiridas en el lenguaje español, y a una frecuencia de muestreo de 8kHz. Los porcentajes de reconocimiento obtenidos fueron del 96.7 y 93.3% para las modalidades de mono-locutor para el corpus UPA y múltiple-locutor para el corpus Tlatoa, respectivamente. Asimismo, se realizó una comparación contra dos métodos clásicos del reconocimiento de voz y del habla, Dynamic Time Warping (DTW) y Hidden Markov Models (HMM). Abstract in english It this paper we present an algorithmic alternative to the current Automatic Speech Recognition (ASR) systems by proposing a way to characterize words based on approximations that use an extracted coefficient from Linear Predictive Coding (LPC). The method consists in extracting phonetic characteris [...] tics through the use of LPC coefficients, after which pattern vectors are formed from the LPC coefficient averages taken from the word sampling, thus creating a unique vector for each pronunciation through the auto correlation of the LPC coefficient sequences. These vectors are used to train a Multilayer Perceptron (MLP) classifier. After training performance trials were executed. The sounds from the digits zero through nine where used as a target vocabulary, given its general use, and to estimate the performance of this method two corpus where used: the UPA corpus, which in its vocabulary uses a pronunciation familiar to the western part of Mexico, and the Tlatoa corpus, who's vocabulary presents a pronunciation typical of the central region of Mexico. The signals from both corpus where sampled in the Spanish language, and at a sampling frequency of 8kHz. The recognition rate for the mono-speaker from the UPA corpus and the multiple-speaker from the Tlatoa corpus were 96.7% and 93.3% respectively. Additionally, there where comparisons done against two classic methods used for speech recognition, Dynamic Time Warping (DTW) and Hidden Markov Models (HMM).
Bearing Fault Detection Using Artificial Neural Networks and Genetic Algorithm
Samanta B; Al-Balushi Khamis R; Al-Araimi Saeed A
2004-01-01
A study is presented to compare the performance of bearing fault detection using three types of artificial neural networks (ANNs), namely, multilayer perceptron (MLP), radial basis function (RBF) network, and probabilistic neural network (PNN). The time domain vibration signals of a rotating machine with normal and defective bearings are processed for feature extraction. The extracted features from original and preprocessed signals are used as inputs to all three ANN classifiers: MLP, RBF, a...
Neural Network Revisited: Perception on Modified Poincare Map of Financial Time Series Data
Situngkir, H; Situngkir, Hokky; Surya, Yohanes
2004-01-01
Artificial Neural Network Model for prediction of time-series data is revisited on analysis of the Indonesian stock-exchange data. We introduce the use of Multi-Layer Perceptron to percept the modified Poincare-map of the given financial time-series data. The modified Poincare-map is believed to become the pattern of the data that transforms the data in time-t versus the data in time-t+1 graphically. We built the Multi-Layer Perceptron to percept and demonstrate predicting the data on specific stock-exchange in Indonesia.
Neural Network Revisited: Perception on Modified Poincare Map of Financial Time Series Data
Situngkir, Hokky; Surya, Yohanes
2004-01-01
Artificial Neural Network Model for prediction of time-series data is revisited on analysis of the Indonesian stock-exchange data. We introduce the use of Multi-Layer Perceptron to percept the modified Poincare-map of the given financial time-series data. The modified Poincare-map is believed to become the pattern of the data that transforms the data in time-t versus the data in time-t+1 graphically. We built the Multi-Layer Perceptron to percept and demonstrate predicting t...
Bianconi, Andre?; Zuben, Cla?udio J. Von; Serapia?o, Adriane B. S.; Govone, Jose? S.
2010-01-01
Bionomic features of blowflies may be clarified and detailed by the deployment of appropriate modelling techniques such as artificial neural networks, which are mathematical tools widely applied to the resolution of complex biological problems. The principal aim of this work was to use three well-known neural networks, namely Multi-Layer Perceptron (MLP), Radial Basis Function (RBF), and Adaptive Neural Network-Based Fuzzy Inference System (ANFIS), to ascertain whether these tools would be ab...
Distinction of The Authors of Texts Using Multilayered Feedforward Neural Networks
Directory of Open Access Journals (Sweden)
Suvad Selman
2012-03-01
Full Text Available his paper proposes a means of using a multilayered feedforward neural network to identify the author of a text. The network has to be trained where multilayer feedforward neural network as a powerful scheme for learning complex input-output mapping have been used in learning of the average number of words and average characters of words in a paragraphs of an author. The resulting training information we get will be used to identify the texts written by authors. The computational complexity is solved by dividing it into a number of computationally simple tasks where the input space is divided into a set of subspaces and then combining the solutions to those tasks. By this, we have been able to successfully distinguish the books authored by Leo Tolstoy, from the ones authored by George Orwell and Boris Pasternak.
Artificial neural network analysis of RBS and ERDA spectra of multilayered multielemental samples
Energy Technology Data Exchange (ETDEWEB)
Nene, N.R. [Instituto Tecnologico e Nuclear, Apartado 21, E.N. 10, 2686-953 Sacavem (Portugal); Vieira, A. [Instituto Superior de Engenharia do Porto, R. Antonio Bernardino de Almeida 431, 4200 Porto (Portugal); Barradas, N.P. [Instituto Tecnologico e Nuclear, Apartado 21, E.N. 10, 2686-953 Sacavem (Portugal) and Centro de Fisica Nuclear da Universidade de Lisboa, Av. Prof. Gama Pinto 2, 1649-003 Lisbon (Portugal)]. E-mail: nunoni@itn.pt
2006-05-15
We have developed artificial neural networks (ANNs) for simultaneous analysis of Rutherford backscattering spectrometry and elastic recoil detection analysis data. The ANNs developed were applied to a highly complex problem, namely the analysis of multilayered silica-titania films doped with Ag and Er, where 11 parameters are required to describe the samples. Extensive optimization of network architecture, connectivity and pre-processing is presented. The optimized ANN was applied to experimental data leading to accurate results.
Pelossof, Raphael; Ying, Zhiliang
2010-01-01
We propose a focus of attention mechanism to speed up the Perceptron algorithm. Focus of attention speeds up the Perceptron algorithm by lowering the number of features evaluated throughout training and prediction. Whereas the traditional Perceptron evaluates all the features of each example, the Attentive Perceptron evaluates less features for easy to classify examples, thereby achieving significant speedups and small losses in prediction accuracy. Focus of attention allows...
Forecasting financial markets with artificial neural networks
Vieira, Cristiano Ribeiro
2013-01-01
Artificial Neural Networks are exible nonlinear mathematical models widely used in forecasting. This work is intended to investigate the support these models can give to nancial economists predicting prices movements of oil and gas companies listed in stock exchanges. Multilayer Perceptron models with logistic activation functions achieved better results predicting the direction of stocks returns than traditional linear regressions and better performances in companies with lower market capit...
Comparision of Neural Algorithms for Funchtion Approximation
Directory of Open Access Journals (Sweden)
Lale Ozyilmaz
2002-01-01
Full Text Available In this work, various neural network algorithms have been compared for function approximation problems. Multilayer Perceptron (MLP structure with standard back propagation, MLP with fast back propagation (adaptive learning and momentum term added, MLP with Levenberg-Marquardt learning algorithms, Radial Basis Function (RBF network structure trained by OLS algorithm and Conic Section Function Neural Network (CSFNN with adaptive learning have been investigated for various functions. Results showed that the neural algorithms can be used for functional estimation as an alternative to classical methods.
Pelossof, Raphael
2010-01-01
We propose a focus of attention mechanism to speed up the Perceptron algorithm. Focus of attention speeds up the Perceptron algorithm by lowering the number of features evaluated throughout training and prediction. Whereas the traditional Perceptron evaluates all the features of each example, the Attentive Perceptron evaluates less features for easy to classify examples, thereby achieving significant speedups and small losses in prediction accuracy. Focus of attention allows the Attentive Perceptron to stop the evaluation of features at any interim point and filter the example. This creates an attentive filter which concentrates computation at examples that are hard to classify, and quickly filters examples that are easy to classify.
Czech Academy of Sciences Publication Activity Database
Hole?a, Martin; Baerns, M.
2003-01-01
Ro?. 81, - (2003), s. 485-494. ISSN 0920-5861 Grant ostatní: BMBF(DE) FKZ 03C3013 Institutional research plan: CEZ:AV0Z1030915 Keywords : artificial neural networks * multilayer perceptron * dependency * approximation * network training * overtraining * knowledge extraction * logical rules * oxidative dehydrogenation of propane Subject RIV: BA - General Mathematics Impact factor: 2.627, year: 2003
A fast identification of insufficiency of nutrients using spectral features would be a useful instrument in farming and in other nutrient demanding agricultural systems such as those proposed for long period space missions. A Multilayer Perceptron (MLP) neural network and backpropagation algorithm w...
IEEE Conference on Neural Information Processing Systems, Natural and Synthetic
Sejnowski, Terrence
1989-08-01
The proceedings from this conference are presented. Some areas of discussion are as follows: Speedy Alternatives to Back Propagation; Mean Field Annealing and Neural Networks; Comparison of Two LP Parametric Representations in a Neural Network-Based Speech Recognizer; Neural Net Receivers in Spread-Spectrum Multiple-Access Communication Systems; Modeling a Central Pattern Generator in Software and Hardware: Tritonia in Sea Moss; Storage of Covariance by the Selective Long-Term Potentiation and Depression of Synaptic Strengths in the Hippocampus; Convergence and Pattern-Stabilization in the Boltzmann Machine; MOS Charge Storage of Adaptive Networks; A Link Between Markov Models and Multilayer Perceptrons; and Programmable Analog Pulse-Firing Neural Networks.
Evolutionary feature selection applied to artificial neural networks for wood veneer classification
Castellani, Marco; Rowlands, Hefin
2008-01-01
Abstract This paper presents the application of FeaSANNT, an evolutionary algorithm for optimisation of artificial neural networks, to the training of a multi-layer perceptron for identification of defects in wood veneer. Given a fixed artificial neural network structure, FeaSANNT concurrently evolves the input feature vector and the network weights. The novelty of the method lies in the implementation of the embedded approach in an evolutionary feature selection paradigm. Experime...
Perez Alejo, Rigoberto; Ruiz Cabello Osuna, Jesus Maria; Cortijo Martinez, Manuel; Rodriguez, Ignacio; Echave, Imanuel; Regadera, Javier; Arrazola, Juan; Aviles, Pablo; Barreiro Elorza, Pilar; Gargallo, Domingo; Gran?a, Manuel
2003-01-01
An accurate computer-assisted method able to perform regional segmentation on 3D single modality images and measure its volume is designed using a mixture of unsupervised and supervised artificial neural networks. Firstly, an unsupervised artificial neural network is used to estimate representative textures that appear in the images. The region of interest of the resultant images is selected by means of a multi-layer perceptron after a training using a single sample slice, which contains a ce...
Piotrowski, A.; Napio?rkowski, J. J.; Rowi Ski, P. M.
2006-01-01
In this paper, Multi-Layer Perceptron and Radial-Basis Function Neural Networks, along with the Nearest Neighbour approach and linear regression are utilized for flash-flood forecasting in the mountainous Nysa Klodzka river catchment. It turned out that the Radial-Basis Function Neural Network is the best model for 3- and 6-h lead time prediction and the only reliable one for 9-h lead time forecasting for the largest flood used as a test case.
Piotrowski, A.; Napio?rkowski, J. J.; Ski, P. M. Rowi Amp X.
2006-01-01
In this paper, Multi-Layer Perceptron and Radial-Basis Function Neural Networks, along with the Nearest Neighbour approach and linear regression are utilized for flash-flood forecasting in the mountainous Nysa Klodzka river catchment. It turned out that the Radial-Basis Function Neural Network is the best model for 3- and 6-h lead time prediction and the only reliable one for 9-h lead time forecasting for the largest flood used as a test case.
Directory of Open Access Journals (Sweden)
A. Piotrowski
2006-01-01
Full Text Available In this paper, Multi-Layer Perceptron and Radial-Basis Function Neural Networks, along with the Nearest Neighbour approach and linear regression are utilized for flash-flood forecasting in the mountainous Nysa Klodzka river catchment. It turned out that the Radial-Basis Function Neural Network is the best model for 3- and 6-h lead time prediction and the only reliable one for 9-h lead time forecasting for the largest flood used as a test case.
Filippidis, George; Zacharakis, Giannis; Katsamouris, A.; Rovithakis, G. A.; Maniadakis, M.; Zervakis, M.; Papazoglou, Theodore G.
2001-01-01
This study concerns the identification of the state of human peripheral vascular tissue by using Artificial Neural Networks. The fluorescence spectra, obtained by dual wavelength excitation of the tissue samples, were passed through a non-linear filter, based on a High Order Neural Network (HONN). Then a classical Multi-Layer Perceptron was employed to serve as the classifier of the feature vector. The above process resulted in the successful discrimination between normal and different types of pathological tissue.
An Interval-Valued Neural Network Approach for Prediction Uncertainty Quantification
Ak, Ronay; Vitelli, Valeria; Zio, Enrico
2013-01-01
We consider the task of performing prediction with neural networks on the basis of uncertain input data expressed in the form of intervals. We aim at quantifying the uncertainty in the prediction arising from both the input data and the prediction model. A multi-layer perceptron neural network (NN) is trained to map interval-valued input data into interval outputs, representing the prediction intervals (PIs) of the real target values. The NN training is performed by non-dominated sorting gene...
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
Kirkegaard, Poul Henning; Rytter, A.
1994-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving to be an effective tool for pattern recognition, the basic idea is to train a neural network with simulated values of modal parameters in order to recognize the behaviour of the damaged as well as the un...
Neurale Netværk anvendt indenfor Proceskontrol. Neural Network for Process Control
DEFF Research Database (Denmark)
Madsen, Per Printz
1993-01-01
Dette projekt omhandler anvendelsen af neurale netværksmodeller til proceskontrol. Neurale netværksmodeller er simple modeller af de processer, der forløber i det biologiske neurale netværk. Det biologiske neurale netværk er det netværk af nerveceller, der tilsammen danner centralnervesystemet hos mennesket (hjernen). Som bekendt er vi som mennesker i stand til at løse meget krævende styrings- og reguleringsopgaver, som fx. At holde balancen og gå samtidigt, at cykle ect. Disse styrings- og reguleringsopgaver er alle karakteriseret ved, at der samtidig skal udnyttes en mængde forskellige og svært beskrivelige inputsignaler. Det biologiske neurale netværk dvs. hjernen er således gennem indlæring i stand til at læse, hvorledes der skal stryes og reguleres på baggrund af disse inputsignaler, så det ønskede resultat opnås. Det er derfor nærliggende at undersøge, hvorvidt neurale netværk er anvendelige indenfor proceskontrol i almindelighed. Med anvendelser til proceskontrol menes der her anvendeler til prediction, simulering og regulering af dynamiske systemer. For at teste, hvorvidt neurale netværk er anvendelig til prediction og simulering, er der anvendt en tre-trinsoverheder simulator til at generere indlærings- og testdata. Af de tre valgte netværkstyper er der kun Multi-Layer Perceptron nette, der e ranvendeligt til prediction og simulering af dynamiske systemer ud fra de opstillede koncepter og metoder. I sidste kapitel, omhandlende regulering, er der således også anvendt Multi-Layer Perceptron net. Der er opstillet koncepter/metoder til såvel feedforward regulering som feedback regulering. Multi-Layer Perceptronen er i stand til at regulere et ulineært, multivariabelt og dynamisk system, således at der opnås følgende: 1. Systemet lineariseres således, at der opnås ensartet steprespons i hele arbejdsområdet. 2. Systemet afkobles således, at det er muligt at styre hvert enkelt output uafhængigt af hinanden. 3. Alle målelige forstyrrelser udkompenseres. 4. Det er muligt, at kombinere den neurale regulator med eteksisterende feedback reguleringssystem.
Baghdadi, N.; Cresson, R.; El Hajj, M.; Ludwig, R.; La Jeunesse, I.
2012-01-01
The purpose of this study was to develop an approach to estimate soil surface parameters from C-band polarimetric SAR data in the case of bare agricultural soils. An inversion technique based on Multi-Layer Perceptron (MLP) neural networks was introduced. The neural networks were trained and validated on a noisy simulated dataset generated from the Integral Equation Model (IEM) on a wide range of surface roughness and soil moisture, as it is encountered in agricultural contexts for bare ...
Baghdadi, N.; Cresson, R.; El Hajj, M.; Ludwig, R.; La Jeunesse, I.
2012-01-01
The purpose of this study was to develop an approach to estimate soil surface parameters from C-band polarimetric SAR data in the case of bare agricultural soils. An inversion technique based on multi-layer perceptron (MLP) neural networks was introduced. The neural networks were trained and validated on a noisy simulated dataset generated from the Integral Equation Model (IEM) on a wide range of surface roughness and soil moisture, as it is encountered in agricultural contexts for bare soils...
Andrecut, M.; Ali, M. K.
The task of a classical perceptron is to classify two classes of patterns by generating a separation hyperplane. Here, we give a complete description of a quantum perceptron. The quantum algorithms for classification and learning are formulated in terms of unitary quantum gates operators. In the quantum case, the concept of separable or non-separable classes is irrelevant because the quantum perceptron can learn a superposition of patterns which are not separable by a hyperplane.
Handwritten Digit Recognition with Binary Optical Perceptron
Saxena, Indu; Moerland, Perry; Fiesler, Emile; Pourzand, A. R.
1997-01-01
Binary weights are favored in electronic and optical hardware implementations of neural networks as they lead to improved system speeds. Optical neural networks based on fast ferroelectric liquid crystal binary level devices can benefit from the many orders of magnitudes improved liquid crystal response times. An optimized learning algorithm for all-positive perceptrons is simulated on a limited data set of hand-written digits and the resultant network implemented optically. First, gray-scale...
A Study on the Structure Optimization of Multilayer Neural Networks using Rough Set Theory
Energy Technology Data Exchange (ETDEWEB)
Chung, Young June; Jun, Hyo Byung; Sim, Kwee Bo [Chungang University (Korea, Republic of)
1999-01-01
In this paper, we propose a new structure optimization method of multilayer neural neural networks which begin and carry out learning from a bigger network. This method reduces redundant links and neurons according to the rough set theory. In order to find redundant links, we analyze the variations of all weights and output errors in errors in every step of the learning process, and then make the decision table from their variation of weights and output errors. We can find the redundant links from the initial structure by analyzing the decision table using the rough set theory. This enables use to build a structure as compact as possible, and also enables mapping between input and output. We show the validity and effectiveness of the proposed algorithm by applying it to the XOR problem. (author). 7 refs., 6 figs., 3 tabs.
Generalization ability of a perceptron with non-monotonic transfer function
Inoue, Jun-ichi; Nishimori, Hidetoshi; Kabashima, Yoshiyuki
1997-01-01
We investigate the generalization ability of a perceptron with non-monotonic transfer function of a reversed-wedge type in on-line mode. This network is identical to a parity machine, a multilayer network. We consider several learning algorithms. By the perceptron algorithm the generalization error is shown to decrease by the ${\\alpha}^{-1/3}$-law similarly to the case of a simple perceptron in a restricted range of the parameter $a$ characterizing the non-monotonic transfer...
Handwritten Farsi Character Recognition using Artificial Neural Network
Reza Gharoie Ahangar; Mohammad Farajpoor Ahangar
2009-01-01
Neural Networks are being used for character recognition from last many years but most of the work was confined to English character recognition. Till date, a very little work has been reported for Handwritten Farsi Character recognition. In this paper, we have made an attempt to recognize handwritten Farsi characters by using a multilayer perceptron with one hidden layer. The error backpropagation algorithm has been used to train the MLP network. In addition, an analysis ha...
Particle identification using artificial neural networks at BESIII
International Nuclear Information System (INIS)
A multilayered perceptrons' neural network technique has been applied in the particle identification at BESIII. The networks are trained in each sub-detector level. The NN output of sub-detectors can be sent to a sequential network or be constructed as PDFs for a likelihood. Good muon-ID, electron-ID and hadron-ID are obtained from the networks by using the simulated Monte Carlo samples. (authors)
Firefly Algorithm with Artificial Neural Network for Time Series Problems
Mohammed Alweshah
2014-01-01
Time series classification is a supervised learning method maps the input to the output using historical data. The primary objective is to discover interesting patterns hidden in the data. For the purpose of solving time series classification problems used the multi-layered perceptrons Artificial Neural Networks (ANN). The weights in the ANN are modified to provide the output values of the net, which are much closer to the values of the preferred output. For this reason, several algorithms ha...
On the Adaptability of Neural Network Image Super-Resolution
Chua, Kah Keong; Tay, Yong Haur
2012-01-01
In this paper, we described and developed a framework for Multilayer Perceptron (MLP) to work on low level image processing, where MLP will be used to perform image super-resolution. Meanwhile, MLP are trained with different types of images from various categories, hence analyse the behaviour and performance of the neural network. The tests are carried out using qualitative test, in which Mean Squared Error (MSE), Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity I...
Mixed neural-traditional classifier for character recognition
Stajniak, Andrzej; Szostakowski, Jaroslaw; Skoneczny, Slawomir
1997-02-01
In this paper, we present the efficient voting classifier for the recognition of handwritten and printed characters. This system consists of three voting nonlinear classifiers: two of them based on the multilayer perceptron, and one uses the moments method. The combination of these kinds of systems shows superiority of neural techniques applied with classical against exclusive traditional approach and results in high percentage of correctly recognized characters. Also, we present a comparison of the recognition results.
Arouri, Cyrine; Nguifo, Engelbert Mephu; Aridhi, Sabeur; Roucelle, Ce?cile; Bonnet-loosli, Gaelle; Tsopze?, Norbert
2014-01-01
The choice of architecture of artificial neuron network (ANN) is still a challenging task that users face every time. It greatly affects the accuracy of the built network. In fact there is no optimal method that is applicable to various implementations at the same time. In this paper we propose a method to construct ANN based on clustering, that resolves the problems of random and ad hoc approaches for multilayer ANN architecture. Our method can be applied to regression prob...
Mohri, Mehryar; Rostamizadeh, Afshin
2013-01-01
We present a brief survey of existing mistake bounds and introduce novel bounds for the Perceptron or the kernel Perceptron algorithm. Our novel bounds generalize beyond standard margin-loss type bounds, allow for any convex and Lipschitz loss function, and admit a very simple proof.
Mónica Bocco; Enrique Willington; Mónica Arias
2010-01-01
The incident solar radiation on soil is an important variable used in agricultural applications; it is also relevant in hydrology, meteorology and soil physics, among others. To estimate this variable, empirical models have been developed using several parameters and, recently, prognostic and prediction models based on artificial intelligence techniques such as neural networks. The aim of this work was to develop linear models and neural networks, multilayer perceptron, to estimate daily glob...
A perceptron network theorem prover for the propositional calculus
Drossaers, M. F. J.
1989-01-01
In this paper a short introduction to neural networks and a design for a perceptron network theorem prover for the propositional calculus are presented. The theorem prover is a representation of a variant of the semantic tableau method, called the parallel tableau method, by a network of perceptrons. The parallel tableau method is designed to enable determination of the counter-examples of a formula (if any) concurrently. It is proven that the parallel method is complete, and t...
Intelligent detection of impulse noise using multilayer neural network with multi-valued neurons
Aizenberg, Igor; Wallace, Glen
2012-03-01
In this paper, we solve the impulse noise detection problem using an intelligent approach. We use a multilayer neural network based on multi-valued neurons (MLMVN) as an intelligent impulse noise detector. MLMVN was already used for point spread function identification and intelligent edge enhancement. So it is very attractive to apply it for solving another image processing problem. The main result, which is presented in the paper, is the proven ability of MLMVN to detect impulse noise on different images after a learning session with the data taken just from a single noisy image. Hence MLMVN can be used as a robust impulse detector. It is especially efficient for salt and pepper noise detection and outperforms all competitive techniques. It also shows comparable results in detection of random impulse noise. Moreover, for random impulse noise detection, MLMVN with the output neuron with a periodic activation function is used for the first time.
Directory of Open Access Journals (Sweden)
Eduardo O. de Cerqueira
2001-12-01
Full Text Available Neural Networks are a set of mathematical methods and computer programs designed to simulate the information process and the knowledge acquisition of the human brain. In last years its application in chemistry is increasing significantly, due the special characteristics for model complex systems. The basic principles of two types of neural networks, the multi-layer perceptrons and radial basis functions, are introduced, as well as, a pruning approach to architecture optimization. Two analytical applications based on near infrared spectroscopy are presented, the first one for determination of nitrogen content in wheat leaves using multi-layer perceptrons networks and second one for determination of BRIX in sugar cane juices using radial basis functions networks.
International Nuclear Information System (INIS)
In this paper, an automatic system is presented for word recognition using real Turkish word signals. This paper especially deals with combination of the feature extraction and classification from real Turkish word signals. A Discrete Wavelet Neural Network (DWNN) model is used, which consists of two layers: discrete wavelet layer and multi-layer perceptron. The discrete wavelet layer is used for adaptive feature extraction in the time-frequency domain and is composed of Discrete Wavelet Transform (DWT) and wavelet entropy. The multi-layer perceptron used for classification is a feed-forward neural network. The performance of the used system is evaluated by using noisy Turkish word signals. Test results showing the effectiveness of the proposed automatic system are presented in this paper. The rate of correct recognition is about 92.5% for the sample speech signals. (author)
Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI
Energy Technology Data Exchange (ETDEWEB)
Olyaee, Saeed; Hamedi, Samaneh, E-mail: s_olyaee@srttu.edu [Nano-photonics and Optoelectronics Research Laboratory (NORLab), Faculty of Electrical and Computer Engineering, Shahid Rajaee Teacher Training University (SRTTU), Lavizan, 16788, Tehran (Iran, Islamic Republic of)
2011-02-01
In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.
Directory of Open Access Journals (Sweden)
Alireza Pazoki
2013-10-01
Full Text Available The ability of Multi-Layer Perceptron (MLP and Neuro-Fuzzy neural networks to classify corn seed varieties based on mixed morphological and color Features has been evaluated that would be helpful for automation of corn handling. This research was done in Islamic Azad University, Shahr-e-Rey Branch, during 2011 on 5 main corn varieties were grown in different environments of Iran. A total of 12 color features, 11 morphological features and 4 shape factors were extracted from color images of each corn kernel. Two types of neural networks contained Multilayer Perceptron (MLP and Neuro-Fuzzy were used to classify the corn seed varieties. Average classification’s accuracy of corn seed varieties were obtained 94% and 96% by MLP and Neuro-Fuzzy classifiers respectively. After feature selection by UTA algorithm, more effective features were selected to decrease the classification processing time, without any meaningful decreasing of accuracies.
Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI
International Nuclear Information System (INIS)
In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.
Scientific Electronic Library Online (English)
Eduardo O. de, Cerqueira; João C. de, Andrade; Ronei J., Poppi; Cesar, Mello.
2001-12-01
Full Text Available SciELO Brazil | Language: Portuguese Abstract in portuguese [...] Abstract in english Neural Networks are a set of mathematical methods and computer programs designed to simulate the information process and the knowledge acquisition of the human brain. In last years its application in chemistry is increasing significantly, due the special characteristics for model complex systems. Th [...] e basic principles of two types of neural networks, the multi-layer perceptrons and radial basis functions, are introduced, as well as, a pruning approach to architecture optimization. Two analytical applications based on near infrared spectroscopy are presented, the first one for determination of nitrogen content in wheat leaves using multi-layer perceptrons networks and second one for determination of BRIX in sugar cane juices using radial basis functions networks.
Bolle, D.; Kozlowski, P.
2000-01-01
Ashkin-Teller type perceptron models are introduced. Their maximal capacity per number of couplings is calculated within a first-step replica-symmetry-breaking Gardner approach. The results are compared with extensive numerical simulations using several algorithms.
Storage capacity of a Potts-perceptron
Nadal, Jean-pierre; Rau, Albrecht
1991-01-01
We consider the properties of “Potts” neural networks where each neuron can be in Q different states. For a “Potts-perceptron” with N Q-states input neurons and one Q' states output neutron, we compute the maximal storage capacity for unbiased patterns. In the large N limit the maximal number of patterns that can be stored is found to be proportional to N(Q-1)f(Q'), where f(Q') is of order 1.
Simulating a perceptron on a quantum computer
Schuld, Maria; Sinayskiy, Ilya; Petruccione, Francesco
2014-01-01
Perceptrons are the basic computational unit of artificial neural networks, as they model the activation mechanism of an output neuron due to incoming signals from its neighbours. As linear classifiers, they play an important role in the foundations of machine learning. In the context of the emerging field of quantum machine learning, several attempts have been made to develop a corresponding unit using quantum information theory. Based on the quantum phase estimation algori...
Neural network modeling and correcting for delay-line data sets
International Nuclear Information System (INIS)
Because of the effects of the capacitance and inductance parasitized on the readout PCB in GEM detector, the output time of the delay-line PCB puts up a non-linear relationship with the position of its input signal. Based on Back Propagation algorithm, the multi-layer perceptrons neural network approximated the non-linear function and gave out accurate analyses, which is a better method for data correcting in Delay-Line readout. (authors)
A numerical modeling of nonlinear load behavior using artificial neural networks
Panoiu, Manuela; Ghiormez, Loredana; Panoiu, Caius; Iordan, Anca
2013-10-01
In this paper it is performed a numerical study of the voltage-current characteristic of an electric arc. To predict voltages and currents values, a multi-layer perceptron Artificial Neural Networks was used under the Matlab 2012 environment. The study is based on actual recorded data obtained from a 100 tones AC Electric Arc Furnace. Results obtained by simulation are compared with the measured one.
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
El-shafie, A.; Noureldin, A.; Taha, M.; Hussain, A.; Mukhlisin, M.
2011-01-01
Rainfall is considered as one of the major component of the hydrological process, it takes significant part of evaluating drought and flooding events. Therefore, it is important to have accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting task such as Multi-Layer Perceptron Neural Networks (MLP-NN). In fact, the rainfall time series modeling involves an important temporal dimension. On the other ha...
A Hybrid Model based on Neural Network and Hybrid Genetic Algorithm for Automotive Price Forecasting
Reza Peyghami, M.; Khanduzi, R.
2011-01-01
In this paper, we introduce a new intelligent combination method based on Multilayer Perceptron Neural Network (MLP?NN) and Hybrid Genetic Algorithm (HGA) for automotive price forecasting. The combination of MLPNN and HGA lead us to accelerate convergence to the optimal weights and improve the forecasting performance. In this structure, the Levenberg? Marquardt (LM) algorithm is employed for training of the network, and the hybridization of Genetic Algorithm (GA) with some local search op...
On Data Mining in Inverse Scattering Problems: Neural Networks Applied to GPR Data Analysis
Caorsi, Salvatore; Stasolla, Mattia
2012-01-01
This paper presents a (semi-)automatic processing technique for GPR data analysis. Exploiting the generalization capabilities of artificial neural networks (ANN), it will be shown that it is possible to feed a Multi-Layer Perceptron (MLP) with a suitable set of input features in order to determine the permittivity of a ground layer. A detailed performance assessment have proven that the algorithm provides very promising results, reconstructing with high accuracy the dielectric properties of b...
Tierra, Alfonso; Romero, Ricardo
2014-12-01
Prior any satellite technology developments, the geodetic networks of a country were realized from a topocentric datum, and hence the respective cartography was performed. With availability of Global Navigation Satellite Systems-GNSS, cartography needs to be updated and referenced to a geocentric datum to be compatible with this technology. Cartography in Ecuador has been performed using the PSAD56 (Provisional South American Datum 1956) systems, nevertheless it's necessary to have inside the system SIRGAS (SIstema de Referencia Geocéntrico para las AmericaS). This transformation between PSAD56 to SIRGAS use seven transformation parameters calculated with the method Helmert. These parameters, in case of Ecuador are compatible for scales of 1:25 000 or less, that does not satisfy the requirements on applications for major scales. In this study, the technique of neural networks is demonstrated as an alternative for improving the processing of UTM planes coordinates E, N (East, North) from PSAD56 to SIRGAS. Therefore, from the coordinates E, N, of the two systems, four transformation parameters were calculated (two of translation, one of rotation, and one scale difference) using the technique bidimensional transformation. Additionally, the same coordinates were used to training Multilayer Artificial Neural Network -MANN, in which the inputs are the coordinates E, N in PSAD56 and output are the coordinates E, N in SIRGAS. Both the two-dimensional transformation and ANN were used as control points to determine the differences between the mentioned methods. The results imply that, the coordinates transformation obtained with the artificial neural network multilayer trained have been improving the results that the bidimensional transformation, and compatible to scales 1:5000. Dost?p do nowoczesnych technologii, w tym GNSS umo?liwi?y dok?adniejsze zdefi niowanie systemów odniesie? przestrzennych wykorzystywanych m.in. w defi niowaniu krajowych uk?adów odniesie? i uk?adów wspó?rz?dnych. W Ekwadorze wykorzystywany jest system PSAD56 (Provisional South American Datum 1956), ale w ostatnim czasie zasz?a konieczno?? zdefi niowania wewn?trznego(krajowego) systemu SIRGAS (SIstema de Referencia Geocéntrico para las AmericaS). Do transformacji pomi?dzy oboma systemami powszechnie wykorzystuje si? metod? Helmerta, stosuj?c uk?ad siedmioparametrowy. Transformacja taka pozwala na zachowanie dok?adno?ci wystarczaj?cej do opracowania map topografi cznych w skalach 1:25 000 lub mniejszych. W artykule do transformacji zastosowano sieci neuronowe, co umo?liwi?o podniesienie dok?adno?ci do skali 1:5 000
A design philosophy for multi-layer neural networks with applications to robot control
Vadiee, Nader; Jamshidi, MO
1989-01-01
A system is proposed which receives input information from many sensors that may have diverse scaling, dimension, and data representations. The proposed system tolerates sensory information with faults. The proposed self-adaptive processing technique has great promise in integrating the techniques of artificial intelligence and neural networks in an attempt to build a more intelligent computing environment. The proposed architecture can provide a detailed decision tree based on the input information, information stored in a long-term memory, and the adapted rule-based knowledge. A mathematical model for analysis will be obtained to validate the cited hypotheses. An extensive software program will be developed to simulate a typical example of pattern recognition problem. It is shown that the proposed model displays attention, expectation, spatio-temporal, and predictory behavior which are specific to the human brain. The anticipated results of this research project are: (1) creation of a new dynamic neural network structure, and (2) applications to and comparison with conventional multi-layer neural network structures. The anticipated benefits from this research are vast. The model can be used in a neuro-computer architecture as a building block which can perform complicated, nonlinear, time-varying mapping from a multitude of input excitory classes to an output or decision environment. It can be used for coordinating different sensory inputs and past experience of a dynamic system and actuating signals. The commercial applications of this project can be the creation of a special-purpose neuro-computer hardware which can be used in spatio-temporal pattern recognitions in such areas as air defense systems, e.g., target tracking, and recognition. Potential robotics-related applications are trajectory planning, inverse dynamics computations, hierarchical control, task-oriented control, and collision avoidance.
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1994-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving to be an effective tool for pattern recognition, the basic idea is to train a neural network with simulated values of modal parameters in order to recognize the behaviour of the damaged as well as the undamaged structure. Subjecting this trained neural network to measured modal parameters should imply information about damage states and locations.
Cosmic-ray discrimination capabilities of DELTA E-E silicon nuclear telescopes using neural networks
Ambriola, M; Cafagna, F; Castellano, M; Ciacio, F; Circella, M; De Marzo, C N; Montaruli, T
2000-01-01
An isotope classifier of cosmic-ray events collected by space detectors has been implemented using a multi-layer perceptron neural architecture. In order to handle a great number of different isotopes a modular architecture of the 'mixture of experts' type is proposed. The performance of this classifier has been tested on simulated data and has been compared with a 'classical' classifying procedure. The quantitative comparison with traditional techniques shows that the neural approach has classification performances comparable - within 1% - with that of the classical one, with efficiency of the order of 98%. A possible hardware implementation of such a kind of neural architecture in future space missions is considered.
Cosmic-ray discrimination capabilities of /?E-/E silicon nuclear telescopes using neural networks
Ambriola, M.; Bellotti, R.; Cafagna, F.; Castellano, M.; Ciacio, F.; Circella, M.; Marzo, C. N. D.; Montaruli, T.
2000-02-01
An isotope classifier of cosmic-ray events collected by space detectors has been implemented using a multi-layer perceptron neural architecture. In order to handle a great number of different isotopes a modular architecture of the ``mixture of experts'' type is proposed. The performance of this classifier has been tested on simulated data and has been compared with a ``classical'' classifying procedure. The quantitative comparison with traditional techniques shows that the neural approach has classification performances comparable - within /1% - with that of the classical one, with efficiency of the order of /98%. A possible hardware implementation of such a kind of neural architecture in future space missions is considered.
Cosmic-ray discrimination capabilities of ?E-E silicon nuclear telescopes using neural networks
International Nuclear Information System (INIS)
An isotope classifier of cosmic-ray events collected by space detectors has been implemented using a multi-layer perceptron neural architecture. In order to handle a great number of different isotopes a modular architecture of the 'mixture of experts' type is proposed. The performance of this classifier has been tested on simulated data and has been compared with a 'classical' classifying procedure. The quantitative comparison with traditional techniques shows that the neural approach has classification performances comparable - within 1% - with that of the classical one, with efficiency of the order of 98%. A possible hardware implementation of such a kind of neural architecture in future space missions is considered
Scientific Electronic Library Online (English)
Alejandro J., Orozco-Naranjo; Pablo A., Muñoz-Gutiérrez.
2013-12-30
Full Text Available Este artículo presenta los resultados obtenidos al desarrollar una metodología para la detección de 5 tipos de latidos cardiacos (Normal (N), Bloqueo de Rama Derecha (RBBB), Bloqueo de Rama Izquierda (LBBB), Contracción Auricular Prematura (APC) y Contracción Ventricular Prematura (PVC)) utilizando [...] la transformada por paquetes Wavelet de manera no adaptativa en la extracción de características de las señales cardiacas, empleando la función Shanon para cálculo de la entropía y adicionando una fase de identificación de nodos por cada tipo de señal cardiaca en el árbol Wavelet. La utilización de la transformada por paquetes Wavelet permite acceder a información obtenida de la descomposición tanto de baja como de alta frecuencia proporcionando un análisis más integral que el logrado con la transformada Wavelet discreta. Se evaluaron Wavelets madre de las familias Daubechies, Symlet 5 y Biortogonal inversa; que fueron resultado de una investigación previa en que se identificaron las Wavelet madre que mayor entropía presentaban con las señales cardiacas. Con la modalidad no adaptativa se reduce el costo computacional al utilizar los paquetes Wavelet, coste que representa la mayor desventaja de esta transformada, dando validez a la investigación realizada. Para la clasificación de los patrones cardiacos se emplearon las máquinas de soporte vectorial y el perceptrón multicapa. Con las máquinas de soporte vectorial empleando kernel de función de base radial, se logró un error de clasificación del 2,57 %. Abstract in english This paper presents the results obtained by developing a methodology to detect 5 types of heartbeats (Normal (N), Right bundle branch block (RBBB), Left bundle branch block (LBBB), Premature atrial contraction (APC) and Premature ventricular contraction (PVC)), using Wavelet transform packets with n [...] on-adaptative mode applied on features extraction from heartbeats. It was used the Shannon function to calculate the entropy and It was added an identification nodes stage per every type of cardiac signal in the Wavelet tree. The using of Wavelet packets transform allows the access to information which results of decomposition of low and high frecuency, giving providing a more integral analysis than achieved by the discrete Wavelet transform. Three families of mother Wavelet were evaluated on transformation: Daubechies, Symlet and Reverse Biorthogonal, which were results from a previous research in that were identified the mother Wavelet that had higher entropy with the cardiac signals. With non-adaptive mode, the computational cost is reduced when Wavelet packets are used; this cost represents the most marked disadvantage from the transform. To classify the heartbeats were used Support Vector Machines and Multilayer Perceptron. The best classification error was achieved employing Support Vector Machine and a radial basis function; it was 2.57 %.
Neural networks and statistical learning
Du, Ke-Lin
2014-01-01
Providing a broad but in-depth introduction to neural network and machine learning in a statistical framework, this book provides a single, comprehensive resource for study and further research. All the major popular neural network models and statistical learning approaches are covered with examples and exercises in every chapter to develop a practical working understanding of the content. Each of the twenty-five chapters includes state-of-the-art descriptions and important research results on the respective topics. The broad coverage includes the multilayer perceptron, the Hopfield network, associative memory models, clustering models and algorithms, the radial basis function network, recurrent neural networks, principal component analysis, nonnegative matrix factorization, independent component analysis, discriminant analysis, support vector machines, kernel methods, reinforcement learning, probabilistic and Bayesian networks, data fusion and ensemble learning, fuzzy sets and logic, neurofuzzy models, hardw...
Directory of Open Access Journals (Sweden)
Manjula Devi Ramasamy
2014-01-01
Full Text Available Multilayer Feed Forward Neural Network (MFNN has been successfully administered architectures for solving a wide range of supervised pattern recognition tasks. The most problematic task of MFNN is training phase which consumes very long training time on very huge training datasets. An enhanced linear adaptive skipping training algorithm for MFNN called Half of Threshold (HOT is proposed in this research paper. The core idea of this study is to reduce the training time through random presentation of training input samples without affecting the network’s accuracy. The random presentation is done by partitioning the training dataset into two distinct classes, classified and misclassified class, based on the comparison result of the calculated error measure with half of threshold value. Only the input samples in the misclassified class are presented to the next epoch for training, whereas the correctly classified class is skipped linearly which dynamically reducing the number of input samples exhibited at every single epoch without affecting the network’s accuracy. Thus decreasing the size of the training dataset linearly can reduce the total training time, thereby speeding up the training process. This HOT algorithm can be implemented with any training algorithm used for supervised pattern classification and its implementation is very simple and easy. Simulation study results proved that HOT training algorithm achieves faster training than the other standard training algorithm.
Two-Phase Pattern Search-based Learning Method for Multi-layer Neural Network
Wang, Xugang; Tang, Zheng; Tamura, Hiroki; Ishii, Masahiro
A new multi-layer artificial neural network learning algorithm based on pattern search method is proposed. The learning model has two phases-a pattern search phase, and a local minimum-escaping phase. In the pattern search phase, our method performs local search iteratively and minimize the error measure function along with the set of descent directions of the error measure directly and finds the nearest minima efficiently. When the network gets stuck in local minima, the local minimum-escaping phase attempts to fill up the valley by modifying temperature parameters in ascent direction of the error measure. Thus, the two phases are repeated until the network gets out of local minima. The learning model is designed to provide a very simple and effective means of searching the minima of objective function directly without any knowledge of its derivatives. We test this algorithm on benchmark problems, such as exclusive-or (XOR), parity, Arabic numerals recognition, function approximation problems and a real world classification task. For all problems, the systems are shown be trained efficiently by our method. As a simple direct search method, it can be applied in hardware implementations easily.
Artificial neural network based models for short- and long-term load forecasting in the power system
Energy Technology Data Exchange (ETDEWEB)
Malko, J. [Technical Univ. of Wroclaw (Poland); Mikolajczak, H.; Skorupski, W. [Inst. of Power Systems Automation, Wroclaw (Poland)
1995-11-01
This paper contains synthetic presentation of the layered artificial neural network from the point of view of application to the short-term as well as to long-term prediction of the power system load. Apart from the multilayer perceptron being most frequently applied to short-term prediction which is here also used to long-term forecasting, also non-conventional approaches has been proposed as: Kohonen neural network as auto-associative memory and Hecht-Nielsen neural network with examples of applications. 11 refs, 5 figs, 4 tabs
Scientific Electronic Library Online (English)
F., Dall Cortivo; E. S., Chalhoub; H. F., Campos Velho.
2012-12-01
Full Text Available Estimativa do perfil de concentração de clorofila, em águas naturais, a partir da radiação emergente na superfície de um corpo d'agua, com o uso de rede neural artificial do tipo Perceptron de Múltiplas Camadas. A concentração de clorofila está relacionada com os coeficientes de absorção e espalhame [...] nto via modelos bio-ópticos. O treinamento da rede é formulado como um problema de otimização, no qual a atualização das variáveis livres da rede (pesos, viés e parâmetros de cada função de ativação) é feita através do método quasi-Newton. Abstract in english In this work the average profile of chlorophyll concentration is estimated from the emitted radiation at the surface of natural waters. This is performed through the use an Artificial Neural Network of Multilayer Perceptron type to act as the inverse operator. Bio-optical models are used to correlat [...] e the chlorophyll concentration with the absorption and scattering coefficients. The network training is formulated as an optimization problem, in which the update of the free variables of network (weights, viéses and each slope of the activation functions) is performed through the quasi-Newton method.
Breast Fine Needle Tumor Classification using Neural Networks
Directory of Open Access Journals (Sweden)
Yasmeen M. George
2012-09-01
Full Text Available The purpose of this study is to develop an intelligent diagnosis system for breast cancer classification. Artificial Neural Networks and Support Vector Machines were being developed to classify the benign and malignant of breast tumor in fine needle aspiration cytology. First the features were extracted from 92 FNAC image. Then these features were presented to several neural network architectures to investigate the most suitable network model for classifying the tumor effectively. Four classification models were used namely multilayer perceptron (MLP using back-propagation algorithm, probabilistic neural networks (PNN, learning vector quantization (LVQ and support vector machine (SVM. The classification results were obtained using 10-fold cross validation. The performance of the networks was compared based on resulted error rate, correct rate, sensitivity and specificity. The method was evaluated using six different datasets including four datasets related to our work and two other benchmark datasets for comparison. The optimum network for classification of breast cancer cells was found using probabilistic neural networks. This is followed in order by support vector machine, learning vector quantization and multilayer perceptron. The results showed that the predictive ability of probabilistic neural networks and support vector machine are stronger than the others in all evaluated datasets.
Comparative study of different wavelet based neural network models for rainfall-runoff modeling
Shoaib, Muhammad; Shamseldin, Asaad Y.; Melville, Bruce W.
2014-07-01
The use of wavelet transformation in rainfall-runoff modeling has become popular because of its ability to simultaneously deal with both the spectral and the temporal information contained within time series data. The selection of an appropriate wavelet function plays a crucial role for successful implementation of the wavelet based rainfall-runoff artificial neural network models as it can lead to further enhancement in the model performance. The present study is therefore conducted to evaluate the effects of 23 mother wavelet functions on the performance of the hybrid wavelet based artificial neural network rainfall-runoff models. The hybrid Multilayer Perceptron Neural Network (MLPNN) and the Radial Basis Function Neural Network (RBFNN) models are developed in this study using both the continuous wavelet and the discrete wavelet transformation types. The performances of the 92 developed wavelet based neural network models with all the 23 mother wavelet functions are compared with the neural network models developed without wavelet transformations. It is found that among all the models tested, the discrete wavelet transform multilayer perceptron neural network (DWTMLPNN) and the discrete wavelet transform radial basis function (DWTRBFNN) models at decomposition level nine with the db8 wavelet function has the best performance. The result also shows that the pre-processing of input rainfall data by the wavelet transformation can significantly increases performance of the MLPNN and the RBFNN rainfall-runoff models.
Influence of different nonlinearity functions on perceptron performance
Kaveh, Ashenayi; Vogh, James
1991-03-01
Influence of two new nonlinearity functions on Perceptron performance is studied. The two new functions under consideration are Gaussian and sinusoid functions. The new functions create multithreshold Perceptions capable of handling both binary and analog inputs. A computer program has been developed to simulate behavior of a network utilizing either of the two modified Perceptrons. Both XOR and Parity Check problems were solved using a single-layer network utilizing these modified Perceptions. Based on the results obtained from the simulation the modified Perceptions are capable of solving problems (such as XOR) that can not be solved using a single-layer of the classical Perceptron. Also networks utilizing these modified Perceptions require fewer number of iterations to converge to a solution than that of a multi-layer network of classical Perceptions using back propagation. In addition the results show that Sinusoidal Perceptronperforms better than Gaussian Perception. 1.
Homayoon Seyed Rahman; Keshavarzi Alireza; Gazni Reza
2010-01-01
This paper outlines the application of the multi-layer perceptron artificial neural network (ANN), ordinary kriging (OK), and inverse distance weighting (IDW) models in the estimation of local scour depth around bridge piers. As part of this study, bridge piers were installed with bed sills at the bed of an experimental flume. Experimental tests were conducted under different flow conditions and varying distances between bridge pier and bed sill. The ANN, OK and IDW models were applied to the...
The Perceptron with Dynamic Margin
Panagiotakopoulos, Constantinos; Tsampouka, Petroula
2011-01-01
The classical perceptron rule provides a varying upper bound on the maximum margin, namely the length of the current weight vector divided by the total number of updates up to that time. Requiring that the perceptron updates its internal state whenever the normalized margin of a pattern is found not to exceed a certain fraction of this dynamic upper bound we construct a new approximate maximum margin classifier called the perceptron with dynamic margin (PDM). We demonstrate ...
A Neural Auto-depth Controller for an Unmanned Underwater Vehicle
Sutton, R.; Johnson, C.; Roberts, G. N.
Artificial neural networks offer an alternative strategy for the nonlinear control of unmanned underwater vehicles (UUVS). This paper investigates the use of a multi-layered perceptron (MLP) network in controlling an UUV over a sea-bed profile and compares the use of applying chemotaxis learning to that of the more commonly employed back propagation algorithm. The results show that, for differing sized MLPs, the chemotaxis algorithm produces a successful controller over the sea-bed profile in an improved training time. Also it will be shown that, in the presence of noise and change in vehicle mass, the neural controller out-performed a classical proportional-integral-derivative controller.
Evaluation of artificial neural network techniques for flow forecasting in the River Yangtze, China
Dawson, C. W.; Harpham, C.; Wilby, R. L.; Chen, Y.
2002-01-01
While engineers have been quantifying rainfall-runoff processes since the mid-19th century, it is only in the last decade that artificial neural network models have been applied to the same task. This paper evaluates two neural networks in this context: the popular multilayer perceptron (MLP), and the radial basis function network (RBF). Using six-hourly rainfall-runoff data for the River Yangtze at Yichang (upstream of the Three Gorges Dam) for the period 1991 to 1993, it is shown that both ...
Using neural networks for prediction of nuclear parameters
Energy Technology Data Exchange (ETDEWEB)
Pereira Filho, Leonidas; Souto, Kelling Cabral, E-mail: leonidasmilenium@hotmail.com, E-mail: kcsouto@bol.com.br [Instituto Federal de Educacao, Ciencia e Tecnologia do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ (Brazil); Machado, Marcelo Dornellas, E-mail: dornemd@eletronuclear.gov.br [Eletrobras Termonuclear S.A. (GCN.T/ELETRONUCLEAR), Rio de Janeiro, RJ (Brazil). Gerencia de Combustivel Nuclear
2013-07-01
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Empirical modeling of nuclear power plants using neural networks
International Nuclear Information System (INIS)
A summary of a procedure for nonlinear identification of process dynamics encountered in nuclear power plant components is presented in this paper using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the nonlinear structure for system identification. In the overall identification process, the feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of time-dependent system nonlinearities. The standard backpropagation learning algorithm is modified and is used to train the proposed hybrid network in a supervised manner. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The nonlinear response of a representative steam generator is predicted using a neural network and is compared to the response obtained from a sophisticated physical model during both high- and low-power operation. The transient responses compare well, though further research is warranted for training and testing of recurrent neural networks during more severe operational transients and accident scenarios
Dynamic neural controllers for induction motor.
Brdy?, M A; Kulawski, G J
1999-01-01
The paper reports application of recently developed adaptive control techniques based on neural networks to the induction motor control. This case study represents one of the more difficult control problems due to the complex, nonlinear, and time-varying dynamics of the motor and unavailability of full-state measurements. A partial solution is first presented based on a single input-single output (SISO) algorithm employing static multilayer perceptron (MLP) networks. A novel technique is subsequently described which is based on a recurrent neural network employed as a dynamical model of the plant. Recent stability results for this algorithm are reported. The technique is applied to multiinput-multioutput (MIMO) control of the motor. A simulation study of both methods is presented. It is argued that appropriately structured recurrent neural networks can provide conveniently parameterized dynamic models for many nonlinear systems for use in adaptive control. PMID:18252531
Web traffic prediction with artificial neural networks
Gluszek, Adam; Kekez, Michal; Rudzinski, Filip
2005-02-01
The main aim of the paper is to present application of the artificial neural network in the web traffic prediction. First, the general problem of time series modelling and forecasting is shortly described. Next, the details of building of dynamic processes models with the neural networks are discussed. At this point determination of the model structure in terms of its inputs and outputs is the most important question because this structure is a rough approximation of the dynamics of the modelled process. The following section of the paper presents the results obtained applying artificial neural network (classical multilayer perceptron trained with backpropagation algorithm) to the real-world web traffic prediction. Finally, we discuss the results, describe weak points of presented method and propose some alternative approaches.
Option Pricing Using Bayesian Neural Networks
Pires, Michael Maio
2007-01-01
Options have provided a field of much study because of the complexity involved in pricing them. The Black-Scholes equations were developed to price options but they are only valid for European styled options. There is added complexity when trying to price American styled options and this is why the use of neural networks has been proposed. Neural Networks are able to predict outcomes based on past data. The inputs to the networks here are stock volatility, strike price and time to maturity with the output of the network being the call option price. There are two techniques for Bayesian neural networks used. One is Automatic Relevance Determination (for Gaussian Approximation) and one is a Hybrid Monte Carlo method, both used with Multi-Layer Perceptrons.
Analysis and Prediction of Temperature using Statistical Artificial Neural Network
Directory of Open Access Journals (Sweden)
Parag Kadu
2012-04-01
Full Text Available This paper is about producing a prediction system by usingartificial neural methods that will forecast temperature. Thispaper is based on three objectives. First, study of temperature andgathers all knowledge regarding the weather this is particularlystudied in analysis part of the paper. Second, gather allknowledge about artificial neural network methods. Implementmultilayer perceptron neural network with gradient descent(backpropagation, BFGS, conjugate gradient training algorithm andwill analyze the performance of all. Lastly, achieve an objectiveof developing a temperature prediction system. The generalfinding is that with BFGS algorithm, with multilayer perceptronmodel perform well with less prediction error and more accuracythan gradient descent and conjugate gradient, thus used fortemperature prediction. To implement this project we make useof statistica software which provides the functionality calledstatistica artificial neural network(SANN which is used here fortemperature prediction and heavy weather software is used fordata gathering.
APPLICATION OF NEURAL NETWORK ALGORITHMS FOR BPM LINEARIZATION
Energy Technology Data Exchange (ETDEWEB)
Musson, John C. [JLAB; Seaton, Chad [JLAB; Spata, Mike F. [JLAB; Yan, Jianxun [JLAB
2012-11-01
Stripline BPM sensors contain inherent non-linearities, as a result of field distortions from the pickup elements. Many methods have been devised to facilitate corrections, often employing polynomial fitting. The cost of computation makes real-time correction difficult, particulalry when integer math is utilized. The application of neural-network technology, particularly the multi-layer perceptron algorithm, is proposed as an efficient alternative for electrode linearization. A process of supervised learning is initially used to determine the weighting coefficients, which are subsequently applied to the incoming electrode data. A non-linear layer, known as an ?activation layer,? is responsible for the removal of saturation effects. Implementation of a perceptron in an FPGA-based software-defined radio (SDR) is presented, along with performance comparisons. In addition, efficient calculation of the sigmoidal activation function via the CORDIC algorithm is presented.
Aphasia Classification Using Neural Networks
DEFF Research Database (Denmark)
Axer, H.; Jantzen, Jan
2000-01-01
A web-based software model (http://fuzzy.iau.dtu.dk/aphasia.nsf) was developed as an example for classification of aphasia using neural networks. Two multilayer perceptrons were used to classify the type of aphasia (Broca, Wernicke, anomic, global) according to the results in some subtests of the Aachen Aphasia Test (AAT). First a coarse classification was achieved by using an assessment of spontaneous speech of the patient. This classifier produced correct results in 87% of the test cases. For a second test, data analysis tools were used to select four features out of the 30 available test features to yield a more accurate diagnosis. This second classifier produced correct results in 92% of the test cases. This test requires four AAT scores as input for the multilayer perceptron. In practice, the second test requires hours of work on behalf of the clinician, whereas the first test can be done in about half an hour in a free interview. The results of the classifiers were analyzed regarding their accuracy dependent on the diagnosis.
AN FUZZY NEURAL APPROACH FOR MEDICAL IMAGE RETRIEVAL
Directory of Open Access Journals (Sweden)
C. Sriramakrishnan
2012-01-01
Full Text Available Image retrieval based on a query image is necessary for effective and efficient use the information that is stored in medical image databases. Medical Image Retrieval is difficult as not only the localization and directionality of human visual system is to be considered but also the pathological condition. Image identification and segmentation for feature extraction pose a challenge to image retrieval process. Challenges posed include large number of images to be processed for the image retrieval and identifying the region of interest automatically to optimize the search. In this study, we propose a novel image segmentation algorithm Fuzzy Edge Detection and Segmentation (FEDS. The proposed FEDS algorithm is tested on medical images and for classification of images, a bell fuzzy multilayer perceptron is proposed. The proposed neural network Bell Fuzzy Multi Layer Perceptron (BF-MLP Neural network is constructed by introducing a fuzzy logic in hidden layer with the sugeno model and bell function. The proposed neural network consists of two layers with the first layer being a tanh activation function and the second layer containing the bell fuzzy activation function. The proposed FEDS method was implemented using Matlab and Modelsim. A total of 44 images were considered with three class labels. The edge obtained for which segmentation is done using the proposed segmentation algorithm. The proposed BF-MLP neural network algorithm was implemented using Visual Studio and the classification accuracy compared with MLP Neural Network with sigmoid activation function. In this study, a fuzzy segmentation algorithm and a fuzzy classification algorithm is proposed to improve the medical image retrieval accuracy. The proposed segmentation algorithm, Fuzzy Edge Detection and Segmentation (FEDS, was implemented using Matlab and features were extracted using Fast Hartley Transform (FHT. The extracted features were used to train the proposed neural network, Bell Fuzzy Multi Layer Perceptron Neural Network (BF-MLP. 44 images with 3 class labels were used to test the algorithm and classification accuracy of 93.2% was obtained.
Energy Technology Data Exchange (ETDEWEB)
Furini, M.A.; Araujo, P.B. de; Pereira, A.L.S. [Universidade Estadual Paulista (FEIS/UNESP), Ilha Solteira, SP (Brazil). Fac. de Engenharia. Dept. Engenharia Eletrica], Emails: mafurini@aluno.feis.unesp.br, percival@dee.feis.unesp.br, andspa@gmail.com
2009-07-01
This paper aims at analyzing the main operation and design of operationally robust controllers in order to damp the electromechanics oscillations type inter area. For this we used an intelligent control technique based on artificial neural networks, where a multilayer perceptron it was implemented. We used a symmetrical test system of four generators, ten bars and nine transmission lines to verify the performance of the power system stabilizers and power oscillation damping (POD) for the FACTS devices, unified power flow controller (UPFC), designed for neural networks. The results show the superiority in the operation and control of oscillations in power systems using UPFC equipped with the POD.
Comparison of neural network classifiers to quadratic classifiers for sensor fusion
Brown, Joe R.; Bergondy, Daniel; Archer, Susan J.
1991-08-01
This paper summarizes a research effort to explore the use of neural networks for fusing information from multiple sensors in an automatic target recognition (ATR) scenario. Data from two sensors, forward-looking infrared (FLIR) and millimeter wave (MMW) radar, were collected on three ground targets: tank, truck, and armored personnel carrier (APC). Two different types of classifiers were developed and compared: a conventional statistical quadratic and a neural network consisting of a multilayer perceptron with a backpropagation of error training algorithm. Single sensor classifiers were developed for both FLIR and MMW radar data. In addition, multisensor classifiers were developed using merged FLIR and MMW radar features. The experimental results indicate that a backpropagation neural network (BPN) outperformed the conventional quadratic classifier. Neural networks may provide better solutions to the varying clutter problem found in ATR environments because neural networks can describe both linear and nonlinear boundaries required for complex decision surfaces.
Radial basis function neural network for power system load-flow
International Nuclear Information System (INIS)
This paper presents a method for solving the load-flow problem of the electric power systems using radial basis function (RBF) neural network with a fast hybrid training method. The main idea is that some operating conditions (values) are needed to solve the set of non-linear algebraic equations of load-flow by employing an iterative numerical technique. Therefore, we may view the outputs of a load-flow program as functions of the operating conditions. Indeed, we are faced with a function approximation problem and this can be done by an RBF neural network. The proposed approach has been successfully applied to the 10-machine and 39-bus New England test system. In addition, this method has been compared with that of a multi-layer perceptron (MLP) neural network model. The simulation results show that the RBF neural network is a simpler method to implement and requires less training time to converge than the MLP neural network. (author)
Nonlinear identification of process dynamics using neural networks
International Nuclear Information System (INIS)
In this paper the nonlinear identification of process dynamics encountered in nuclear power plant components is addressed, in an input-output sense, using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the model structure to be identified. The feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of temporal variations in the system nonlinearities. The standard backpropagation learning algorithm is modified, and it is used for the supervised training of the proposed hybrid network. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The response of representative steam generator is predicted using a neural network, and it is compared to the response obtained from a sophisticated computer model based on first principles. The transient responses compare well, although further research is warranted to determine the predictive capabilities of these networks during more severe operational transients and accident scenarios
Energy Technology Data Exchange (ETDEWEB)
Bordieu, Ch.; Rebiere, D. [Bordeaux-1 Univ., Lab. IXL, UMR CNRS 5818, 33 (France); Pistre, J.; Planata, R. [Centre d' Etudes du Bouchet, 91 - Vert-le-Petit (France)
1999-07-01
The association of artificial neural networks (multilayer perceptrons) with a real time pattern recognition technique (shifting windows) allowed the development of systems for the detection and the quantification of gases. Shifting window technique is presented and offers an interesting way to improve the detection response time. The partial detector characterization with regard to its parameters was realized. Applications dealing with the detection of gas compounds using surface acoustic sensors permit to show the shifting window technique feasibility. (author)
Perceptron-like computation based on biologically-inspired neurons with heterosynaptic mechanisms
Kaluza, Pablo; Urdapilleta, Eugenio
2014-10-01
Perceptrons are one of the fundamental paradigms in artificial neural networks and a key processing scheme in supervised classification tasks. However, the algorithm they provide is given in terms of unrealistically simple processing units and connections and therefore, its implementation in real neural networks is hard to be fulfilled. In this work, we present a neural circuit able to perform perceptron's computation based on realistic models of neurons and synapses. The model uses Wang-Buzsáki neurons with coupling provided by axodendritic and axoaxonic synapses (heterosynapsis). The main characteristics of the feedforward perceptron operation are conserved, which allows to combine both approaches: whereas the classical artificial system can be used to learn a particular problem, its solution can be directly implemented in this neural circuit. As a result, we propose a biologically-inspired system able to work appropriately in a wide range of frequencies and system parameters, while keeping robust to noise and error.
Modeling neural circuits in Parkinson's disease.
Psiha, Maria; Vlamos, Panayiotis
2015-01-01
Parkinson's disease (PD) is caused by abnormal neural activity of the basal ganglia which are connected to the cerebral cortex in the brain surface through complex neural circuits. For a better understanding of the pathophysiological mechanisms of PD, it is important to identify the underlying PD neural circuits, and to pinpoint the precise nature of the crucial aberrations in these circuits. In this paper, the general architecture of a hybrid Multilayer Perceptron (MLP) network for modeling the neural circuits in PD is presented. The main idea of the proposed approach is to divide the parkinsonian neural circuitry system into three discrete subsystems: the external stimuli subsystem, the life-threatening events subsystem, and the basal ganglia subsystem. The proposed model, which includes the key roles of brain neural circuit in PD, is based on both feed-back and feed-forward neural networks. Specifically, a three-layer MLP neural network with feedback in the second layer was designed. The feedback in the second layer of this model simulates the dopamine modulatory effect of compacta on striatum. PMID:25416983
A Novel Single Neuron Perceptron with Universal Approximation and XOR Computation Properties
Ehsan Lotfi; -r Akbarzadeh-t, M.
2014-01-01
We propose a biologically motivated brain-inspired single neuron perceptron (SNP) with universal approximation and XOR computation properties. This computational model extends the input pattern and is based on the excitatory and inhibitory learning rules inspired from neural connections in the human brain's nervous system. The resulting architecture of SNP can be trained by supervised excitatory and inhibitory online learning rules. The main features of proposed single layer perceptron are un...
Interpretation of ECG Signal with a Multi-Layer Neural Network
Dumitru Ostafe
2008-01-01
In this article there are introduced the resultsobtained in the interpretation of the components of abiomedical signal, ECG, by using a multi-layer neuralnetwork, using the backpropagation algorithm. The neuralnetwork was simulated with the Neuroshell2.0 program. Thenew obtained network was used within the program ofautomate diagnosing of the ECG.
The Perceptron with Dynamic Margin
Panagiotakopoulos, Constantinos
2011-01-01
The classical perceptron rule provides a varying upper bound on the maximum margin, namely the length of the current weight vector divided by the total number of updates up to that time. Requiring that the perceptron updates its internal state whenever the normalized margin of a pattern is found not to exceed a certain fraction of this dynamic upper bound we construct a new approximate maximum margin classifier called the perceptron with dynamic margin (PDM). We demonstrate that PDM converges in a finite number of steps and derive an upper bound on them. We also compare experimentally PDM with other perceptron-like algorithms and support vector machines on hard margin tasks involving linear kernels which are equivalent to 2-norm soft margin.
Finite Size Scaling of Perceptron
Korutcheva, Elka; Tonchev, N.
2000-01-01
We study the first-order transition in the model of a simple perceptron with continuous weights and large, bit finite value of the inputs. Making the analogy with the usual finite-size physical systems, we calculate the shift and the rounding exponents near the transition point. In the case of a general perceptron with larger variety of inputs, the analysis only gives bounds for the exponents.
Higher-order probabilistic perceptrons as Bayesian inference engines
International Nuclear Information System (INIS)
This letter makes explicit a structural connection between the Bayes optimal classifier operating on K binary input variables and corresponding two-layer perceptron having normalized output activities and couplings from input to output units of all orders up to K. Given a large and unbiased training set and an effective learning algorithm, such a neural network should be able to learn the statistics of the classification problem and match the a posteriori probabilities given by the Bayes optimal classifier. (author). 18 refs
Neural networks for predicting breeding values and genetic gains
Scientific Electronic Library Online (English)
Gabi Nunes, Silva; Rafael Simões, Tomaz; Isabela de Castro, Sant' Anna; Moysés, Nascimento; Leonardo Lopes, Bhering; Cosme Damião, Cruz.
2014-12-01
Full Text Available Analysis using Artificial Neural Networks has been described as an approach in the decision-making process that, although incipient, has been reported as presenting high potential for use in animal and plant breeding. In this study, we introduce the procedure of using the expanded data set for train [...] ing the network. Wealso proposed using statistical parameters to estimate the breeding value of genotypes in simulated scenarios, in addition to the mean phenotypic value in a feed-forward back propagation multilayer perceptron network. After evaluating artificial neural network configurations, our results showed its superiority to estimates based on linear models, as well as its applicability in the genetic value prediction process. The results further indicated the good generalization performance of the neural network model in several additional validation experiments.
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
El-Shafie, A.; Noureldin, A.; Taha, M.; Hussain, A.; Mukhlisin, M.
2012-04-01
Rainfall is considered as one of the major components of the hydrological process; it takes significant part in evaluating drought and flooding events. Therefore, it is important to have an accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting tasks as multi-layer perceptron neural networks (MLP-NN). In fact, the rainfall time series modeling involves an important temporal dimension. On the other hand, the classical MLP-NN is a static and has a memoryless network architecture that is effective for complex nonlinear static mapping. This research focuses on investigating the potential of introducing a neural network that could address the temporal relationships of the rainfall series. Two different static neural networks and one dynamic neural network, namely the multi-layer perceptron neural network (MLP-NN), radial basis function neural network (RBFNN) and input delay neural network (IDNN), respectively, have been examined in this study. Those models had been developed for the two time horizons for monthly and weekly rainfall forecasting at Klang River, Malaysia. Data collected over 12 yr (1997-2008) on a weekly basis and 22 yr (1987-2008) on a monthly basis were used to develop and examine the performance of the proposed models. Comprehensive comparison analyses were carried out to evaluate the performance of the proposed static and dynamic neural networks. Results showed that the MLP-NN neural network model is able to follow trends of the actual rainfall, however, not very accurately. RBFNN model achieved better accuracy than the MLP-NN model. Moreover, the forecasting accuracy of the IDNN model was better than that of static network during both training and testing stages, which proves a consistent level of accuracy with seen and unseen data.
Foreground removal from WMAP 5yr temperature maps using an MLP neural network
Nielsen, H U Nørgaard -
2010-01-01
One of the main obstacles for extracting the cosmic microwave background (CMB) signal from observations in the mm/sub-mm range is the foreground contamination by emission from Galactic component: mainly synchrotron, free-free, and thermal dust emission. The statistical nature of the intrinsic CMB signal makes it essential to minimize the systematic errors in the CMB temperature determinations. The feasibility of using simple neural networks to extract the CMB signal from detailed simulated data has already been demonstrated. Here, simple neural networks are applied to the WMAP 5yr temperature data without using any auxiliary data. A simple \\emph{multilayer perceptron} neural network with two hidden layers provides temperature estimates over more than 75 per cent of the sky with random errors significantly below those previously extracted from these data. Also, the systematic errors, i.e.\\ errors correlated with the Galactic foregrounds, are very small. With these results the neural network method is well prep...
Scrimaglio, R.; Rantucci, E.; Segreto, E.; Nurzia, G.; Finetti, N.; Di Gaetano, A.; Tassoni, A.; Picozza, P.; Narici, L.; Casolino, M.; Di Fino, L.; Rinaldi, A.; Zaconte, V.
In this work, we present the data analysis of the Sileye-3/Alteino experiment with neural network technique. Sileye-3/Alteino is composed of two devices: the cosmic ray-advanced silicon telescope (an 8 plane, 32 strip silicon detector) and an electroencephalograph. It was placed on board the ISS on April the 27th 2002 to investigate on the Light Flash phenomenon and the radiation environment in space. We show the possibility of using neural networks as an useful tool for real-time data analysis. A feed-forward neural network (Multi-Layer Perceptron MLP) has been implemented and trained (with Monte Carlo data) to perform on line particle identification for ions with Atomic Number (Z) ?8 and incident kinetic energy reconstruction for ions Z > 2. The result of the analysis of Sileye-3/Alteino real data with the neural network and the improvements over classical analysis techniques are discussed.
Data Analysis of SilEye-3/Alteino Data With a Neural Network Technique
Scrimaglio, R.; Finetti, N.; Nurzia, G.; di Gaetano, A.; Rantucci, E.; Segreto, E.; Tassoni, A.; Sileye-3/Alteino, C.
In this work we present the data analysis of the SilEye-3/Alteino experiment with Neural Network technique. SilEye-3/Alteino is composed of two devices: the cosmic ray advanced silicon telescope (an 8 plane, 32 strip silicon detector) and an electroencephalograph. It was placed on board the ISS on April the 27th 2002 to investigate on the Light Flash phenomenon and the radiation environment in space. We show the possibility of using Neural Networks as an useful tool for real time data analysis. A feed-forward neural network (Multi-Layer Perceptron - MLP -) has been implemented and trained (with Monte Carlo data) to perform on line particle identification for ions with Atomic Number (Z) 2. The result of the analysis of SilEye-3/Alteino real data with the Neural Network and the improvements over classical analysis techniques are discussed.
Real-time neural network inversion on the SRC-6e reconfigurable computer.
Duren, Russell W; Marks, Robert J; Reynolds, Paul D; Trumbo, Matthew L
2007-05-01
Implementation of real-time neural network inversion on the SRC-6e, a computer that uses multiple field-programmable gate arrays (FPGAs) as reconfigurable computing elements, is examined using a sonar application as a specific case study. A feedforward multilayer perceptron neural network is used to estimate the performance of the sonar system (Jung et al., 2001). A particle swarm algorithm uses the trained network to perform a search for the control parameters required to optimize the output performance of the sonar system in the presence of imposed environmental constraints (Fox et al., 2002). The particle swarm optimization (PSO) requires repetitive queries of the neural network. Alternatives for implementing neural networks and particle swarm algorithms in reconfigurable hardware are contrasted. The final implementation provides nearly two orders of magnitude of speed increase over a state-of-the-art personal computer (PC), providing a real-time solution. PMID:17526353
A Study on Modeling of MIMO Channel by Using Different Neural Network Structures
Directory of Open Access Journals (Sweden)
N. Prabhakar
2012-11-01
Full Text Available Recognition of Radio Channel (channelParameters is one of Main Challenges in SignalTransformation, and has important role in cognitive radioapproach. Goal of this paper is “Channel modeling” to estimatecoefficients of transmission functions affected on data beingtransformed in the channel. We use Multilayer perceptron(MLPNeural Network with Back-propagation learning algorithm,block-structured Neural Network with Least Squares(LSmethod(cost function and a multilayer neural network withmultiple back-propagation(MBP learning algorithm for errorestimation. These networks will be trained with received signalsto be compatible with channel, then give us an estimation of thesecoefficients. Simulation will show that this MBP method is betterthan the other two method in error estimation. It has goodperformance and also consume less execution time. Then, we willuse this network for estimating coefficients of non-lineartransmission functions of actual radio channel.
Directory of Open Access Journals (Sweden)
Hossein Naderi
2012-08-01
Full Text Available Stock market prediction is one of the most important interesting areas of research in business. Stock markets prediction is normally assumed as tedious task since there are many factors influencing the market. The primary objective of this paper is to forecast trend closing price movement of Tehran Stock Exchange (TSE using financial accounting ratios from year 2003 to year 2008. The proposed study of this paper uses two approaches namely Artificial Neural Networks and multi-layer perceptron. Independent variables are accounting ratios and dependent variable of stock price , so the latter was gathered for the industry of Motor Vehicles and Auto Parts. The results of this study show that neural networks models are useful tools in forecasting stock price movements in emerging markets but multi-layer perception provides better results in term of lowering error terms.
Finite-size effects in on-line learning of multilayer neural networks
Barber, D.; Saad, D.; Sollich, P.
1996-04-01
We complement recent advances in thermodynamic limit analyses of mean on-line gradient descent learning dynamics in multilayer networks by calculating fluctuations possessed by finite-dimensional systems. Fluctuations from the mean dynamics are largest at the onset of specialisation as student hidden unit weight vectors begin to imitate specific teacher vectors, increasing with the degree of symmetry of the initial conditions. In light of this, we include a term to stimulate asymmetry in the learning process, which typically also leads to a significant decrease in training time.
Modeling of an industrial drying process by artificial neural networks
Scientific Electronic Library Online (English)
E., Assidjo; B., Yao; K., Kisselmina; D., Amané.
2008-09-01
Full Text Available SciELO Brazil | Language: English Abstract in english A suitable method is needed to solve the nonquality problem in the grated coconut industry due to the poor control of product humidity during the process. In this study the possibility of using an artificial neural network (ANN), precisely a Multilayer Perceptron, for modeling the drying step of the [...] production of grated coconut process is highlighted. Drying must confer to the product a final moisture of 3%. Unfortunately, under industrial conditions, this moisture varies from 1.9 to 4.8 %. In order to control this parameter and consequently reduce the proportion of the product that does not meet the humidity specification, a 9-4-1 neural network architecture was established using data gathered from an industrial plant. This Multilayer Perceptron can satisfactorily model the process with less bias, ranging from -0.35 to 0.34%, and can reduce the rate of rejected products from 92% to 3% during the first cycle of drying.
Neural networks in front-end processing and control
International Nuclear Information System (INIS)
Research into neural networks has gained a large following in recent years. In spite of the long term timescale of this Artificial Intelligence research, the tools which the community is developing can already find useful applications to real practical problems in experimental research. One of the main advantages of the parallel algorithms being developed in AI is the structural simplicity of the required hardware implementation, and the simple nature of the calculations involved. This makes these techniques ideal for problems in which both speed and data volume reduction are important, the case for most front-end processing tasks. In this paper the authors illustrate the use of a particular neural network known as the Multi-Layer Perceptron as a method for solving several different tasks, all drawn from the field of Tokamak research. The authors also briefly discuss the use of the Multi-Layer Perceptron as a non-linear controller in a feedback loop. The authors outline the type of problem which can be usefully addressed by these techniques, even before the large-scale parallel processing hardware currently under development becomes cheaply available. The authors also present some of the difficulties encountered in applying these networks
EEG signal classification based on artificial neural networks and amplitude spectra features
Chojnowski, K.; FrÄ czek, J.
BCI (called Brain-Computer Interface) is an interface that allows direct communication between human brain and an external device. It bases on EEG signal collection, processing and classification. In this paper a complete BCI system is presented which classifies EEG signal using artificial neural networks. For this purpose we used a multi-layered perceptron architecture trained with the RProp algorithm. Furthermore a simple multi-threaded method for automatic network structure optimizing was shown. We presented the results of our system in the opening and closing eyes recognition task. We also showed how our system could be used for controlling devices basing on imaginary hand movements.
Fast non-linear extraction of plasma equilibrium parameters using a neural network mapping
International Nuclear Information System (INIS)
The shaping of non-circular plasmas requires a non-linear mapping between the measured diagnostic signals and selected equilibrium parameters. The particular configuration of Neural Network known as the multi-layer perceptron provides a powerful and general technique for formulating an arbitrary continuous non-linear multi-dimensional mapping. This technique has been successfully applied to the extraction of equilibrium parameters from measurements of single-null diverted plasmas in the DIII-D tokamak; the results are compared with a purely linear mapping. The method is promising, and hardware implementation is straightforward. (author) 15 refs., 7 figs
Artificial Neural Network Solutions of Slab-Geometry Neutron Diffusion Problems
International Nuclear Information System (INIS)
Artificial neural network (ANN) methods have been researched extensively within the nuclear community for applications in systems control, diagnostics, and signal processing. We consider here the use of multilayer perceptron ANNs as an alternative to finite-difference and finite-element methods for obtaining solutions to neutron diffusion problems. This work is based on a method proposed by van Milligen et. al. to obtain solutions of the differential equations arising in plasma physics applications. This ANN method has the potential advantage of yielding an accurate, differentiable approximation to the solution of diffusion problems at all points in the spatial domain
Artificial Neural Network Solutions of Slab-Geometry Neutron Diffusion Problems
Energy Technology Data Exchange (ETDEWEB)
Brantley, P.S.
2000-06-12
Artificial neural network (ANN) methods have been researched extensively within the nuclear community for applications in systems control, diagnostics, and signal processing. We consider here the use of multilayer perceptron ANNs as an alternative to finite-difference and finite-element methods for obtaining solutions to neutron diffusion problems. This work is based on a method proposed by van Milligen et. al. to obtain solutions of the differential equations arising in plasma physics applications. This ANN method has the potential advantage of yielding an accurate, differentiable approximation to the solution of diffusion problems at all points in the spatial domain.
Induction machine fault detection using stray flux EMF measurement and neural network-based decision
Energy Technology Data Exchange (ETDEWEB)
Bacha, Khmais; Gossa, Moncef [Ecole Superieure des Sciences et Techniques de Tunis, C3S, 5 avenue Taha Hussein, BP 96, 1008 Tunis (Tunisia); Henao, Humberto; Capolino, Gerard-Andre [University of Picardie Jules Verne, Department of Electrical Engineering, 33 rue Saint Leu, 80039 Amiens cedex 1 (France)
2008-07-15
The aim of this paper is to present the performances of voltage unbalance and rotor fault detections using an external stray flux sensor in a working three-phase induction machine. The automatic classification and fault severity degree evaluation are realized by using a neural network approach based on a multi-layer perceptron (MLP) structure. In this paper, it is proved that a simple external stray flux sensor is more efficient than the classical stator current sensor to detect rotor broken bar and voltage unbalance, using data processing at low-frequency resolution. (author)
Alireza Pazoki; Fardad Farokhi; Zohreh Pazoki
2013-01-01
The ability of Multi-Layer Perceptron (MLP) and Neuro-Fuzzy neural networks to classify corn seed varieties based on mixed morphological and color Features has been evaluated that would be helpful for automation of corn handling. This research was done in Islamic Azad University, Shahr-e-Rey Branch, during 2011 on 5 main corn varieties were grown in different environments of Iran. A total of 12 color features, 11 morphological features and 4 shape factors were extracted from color images of e...
Alternative Sensor System and MLP Neural Network for Vehicle Pedal Activity Estimation
Directory of Open Access Journals (Sweden)
Ahmed M. Wefky
2010-04-01
Full Text Available It is accepted that the activity of the vehicle pedals (i.e., throttle, brake, clutch reflects the driver’s behavior, which is at least partially related to the fuel consumption and vehicle pollutant emissions. This paper presents a solution to estimate the driver activity regardless of the type, model, and year of fabrication of the vehicle. The solution is based on an alternative sensor system (regime engine, vehicle speed, frontal inclination and linear acceleration that reflects the activity of the pedals in an indirect way, to estimate that activity by means of a multilayer perceptron neural network with a single hidden layer.
Artificial Neural Networks in the Assessment of Stand Parameters from an IKONOS Satellite Image
Damir Klobu?ar; Renata Pernar; Sven Lon?ari?; Marko Subaši?
2008-01-01
The paper explores the possibilities of assessing five stand parameters (tree number, volume, stocking, basal area and stand age) with the application of a multi-layer perceptron artificial neural network. An IKONOS satellite image (PAN 1 m x 1 m) was used to asses parts of stands in the sixth (121–140 yrs) and seventh (141–160 yrs) age class of pedunculate oak management class in the »Slavir« Management Unit of Otok Forest Office. Six features extracted from the first order histogram a...
Noise reduction technique for images using radial basis function neural networks
International Nuclear Information System (INIS)
This paper presents a NN (Neural Network) based model for reducing the noise from images. This is a RBF (Radial Basis Function) network which is used to reduce the effect of noise and blurring from the captured images. The proposed network calculates the mean MSE (Mean Square Error) and PSNR (Peak Signal to Noise Ratio) of the noisy images. The proposed network has also been successfully applied to medical images. The performance of the trained RBF network has been compared with the MLP (Multilayer Perceptron) Network and it has been demonstrated that the performance of the RBF network is better than the MLP network. (author)
International Nuclear Information System (INIS)
The artificial neural network technique was used to identify drugs and plastic explosives, from a tomography composed by a set of six neutrongraphic projections obtained in real time. Bidimensional tomographic images of samples of drugs, explosives and other materials, when digitally processed, yield the characteristic spectra of each type of material. The information contained in those spectra was then used for ANN training, the best images being obtained when the multilayer perceptron model, the back-propagation training algorithm and the Cross-validation interruption criterion were used. ANN showed to be useful in forecasting presence of drugs and explosives hitting a rate of success above 97 %. (author)
Multilayer cellular neural network and fuzzy C-mean classifiers: comparison and performance analysis
Trujillo San-Martin, Maite; Hlebarov, Vejen; Sadki, Mustapha
2004-11-01
Neural Networks and Fuzzy systems are considered two of the most important artificial intelligent algorithms which provide classification capabilities obtained through different learning schemas which capture knowledge and process it according to particular rule-based algorithms. These methods are especially suited to exploit the tolerance for uncertainty and vagueness in cognitive reasoning. By applying these methods with some relevant knowledge-based rules extracted using different data analysis tools, it is possible to obtain a robust classification performance for a wide range of applications. This paper will focus on non-destructive testing quality control systems, in particular, the study of metallic structures classification according to the corrosion time using a novel cellular neural network architecture, which will be explained in detail. Additionally, we will compare these results with the ones obtained using the Fuzzy C-means clustering algorithm and analyse both classifiers according to its classification capabilities.
Neural networks for segmentation, tracking, and identification
Rogers, Steven K.; Ruck, Dennis W.; Priddy, Kevin L.; Tarr, Gregory L.
1992-09-01
The main thrust of this paper is to encourage the use of neural networks to process raw data for subsequent classification. This article addresses neural network techniques for processing raw pixel information. For this paper the definition of neural networks includes the conventional artificial neural networks such as the multilayer perceptrons and also biologically inspired processing techniques. Previously, we have successfully used the biologically inspired Gabor transform to process raw pixel information and segment images. In this paper we extend those ideas to both segment and track objects in multiframe sequences. It is also desirable for the neural network processing data to learn features for subsequent recognition. A common first step for processing raw data is to transform the data and use the transform coefficients as features for recognition. For example, handwritten English characters become linearly separable in the feature space of the low frequency Fourier coefficients. Much of human visual perception can be modelled by assuming low frequency Fourier as the feature space used by the human visual system. The optimum linear transform, with respect to reconstruction, is the Karhunen-Loeve transform (KLT). It has been shown that some neural network architectures can compute approximations to the KLT. The KLT coefficients can be used for recognition as well as for compression. We tested the use of the KLT on the problem of interfacing a nonverbal patient to a computer. The KLT uses an optimal basis set for object reconstruction. For object recognition, the KLT may not be optimal.
International Nuclear Information System (INIS)
In this paper, the OTTANNO version of four -quadrant CMOS analog multiplier circuit for artificial neural networks multi layer perception operation will be proposed. The proposed multiplier can be divided into two or three parts, which will be in the input, synapse and neuron. The percentage of silicon area saving is 95% with respect to that multiplier presented in (Chible,1997). A comparison between OTANNO and OTANPS is also presented. (author)
Time Series Data Mining in Rainfall Forecasting Using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Prince Gupta, S.K.Pandey
2014-01-01
Full Text Available Rainfall is very important parameter in hydrological model. Many techniques and models have been developed for rainfall time series prediction. In this study an artificial neural network (ANN based model was developed for rainfall time series forecasting. Proposed model used Multilayer perceptron (MLP network with back propagation algorithm for training. Discharge and rainfall data are took as input parameter for ANN model to predict rainfall time series. Data preprocessing and model’s sensitivity analysis were executed. Collected data is divided in three sets for optimal neural network training. The first set is the training set, used for calculate the gradient and updating the network weights and biases. The second set is the validation set. The error on the validation set is follow during the training process. The third set is test set. It is used to compare different models. Different topologies of Neural Networks were created with change in hidden layer, number of processing element and activation function. (MAE, Mean Squared error (MSE and correlation coefficient (CC are used to evaluate the model performance. On the basis of these evaluation parameter results, it is found that multilayer perceptron (MLP network predict more accurate than other traditional models.
Fernández-Delgado, Manuel; Cernadas, Eva; Barro, Senén; Ribeiro, Jorge; Neves, José
2014-02-01
The Direct Kernel Perceptron (DKP) (Fernández-Delgado et al., 2010) is a very simple and fast kernel-based classifier, related to the Support Vector Machine (SVM) and to the Extreme Learning Machine (ELM) (Huang, Wang, & Lan, 2011), whose ?-coefficients are calculated directly, without any iterative training, using an analytical closed-form expression which involves only the training patterns. The DKP, which is inspired by the Direct Parallel Perceptron, (Auer et al., 2008), uses a Gaussian kernel and a linear classifier (perceptron). The weight vector of this classifier in the feature space minimizes an error measure which combines the training error and the hyperplane margin, without any tunable regularization parameter. This weight vector can be translated, using a variable change, to the ?-coefficients, and both are determined without iterative calculations. We calculate solutions using several error functions, achieving the best trade-off between accuracy and efficiency with the linear function. These solutions for the ? coefficients can be considered alternatives to the ELM with a new physical meaning in terms of error and margin: in fact, the linear and quadratic DKP are special cases of the two-class ELM when the regularization parameter C takes the values C=0 and C=?. The linear DKP is extremely efficient and much faster (over a vast collection of 42 benchmark and real-life data sets) than 12 very popular and accurate classifiers including SVM, Multi-Layer Perceptron, Adaboost, Random Forest and Bagging of RPART decision trees, Linear Discriminant Analysis, K-Nearest Neighbors, ELM, Probabilistic Neural Networks, Radial Basis Function neural networks and Generalized ART. Besides, despite its simplicity and extreme efficiency, DKP achieves higher accuracies than 7 out of 12 classifiers, exhibiting small differences with respect to the best ones (SVM, ELM, Adaboost and Random Forest), which are much slower. Thus, the DKP provides an easy and fast way to achieve classification accuracies which are not too far from the best one for a given problem. The C and Matlab code of DKP are freely available. PMID:24287336
Scientific Electronic Library Online (English)
Olívio F., Galão; Dionísio, Borsato; Jurandir P., Pinto; Jesuí V., Visentainer; Mercedes Concórdia, Carrão-Panizzi.
2011-01-01
Full Text Available Vinte variedades de soja (Glycine max), quatorze convencionais e seis variedades transgênicas (RR) foram analisadas quanto ao teor de proteína, ácido fítico, teor de óleo, fitosteróis, cinzas, minerais e ácidos graxos que foram tabelados e apresentados à rede neural do tipo perceptron de múltiplas c [...] amadas para a classificação e identificação quanto a região de plantio e quanto a variedade convencional ou transgênica. A rede neural utilizada classificou e testou corretamente 100% das amostras cultivadas por região. Para o banco de dados contendo informações sobre sojas transgênicas e convencionais foi obtido um desempenho de 94,43% no treinamento da rede, 83,30% no teste e 100% na validação. Abstract in english Twenty soybean (Glycine max) varieties, 14 conventional and 6 transgenic varieties were analyzed for protein content, phytic acid, oil content, phytosterols, ash, minerals and fatty acids. The data were tabled and presented to the multilayer perceptron neural network for classification and identific [...] ation of their planting region and whether they were a conventional or transgenic. The neural network used correctly classified and tested 100% of the samples cultivated per region. For the data bank containing information on transgenic and conventional soybean, a performance of 94.43% was obtained in the training of the neural network, 83.30% in the test and 100% in the validation.
Implementation of multi-layer feed forward neural network on PIC16F877 microcontroller
International Nuclear Information System (INIS)
Artificial Neural Network (ANN) is an electronic model based on the neural structure of the brain. Similar to human brain, ANN consists of interconnected simple processing units or neurons that process input to generate output signals. ANN operation is divided into 2 categories; training mode and service mode. This project aims to implement ANN on PIC micro-controller that enable on-chip or stand alone training and service mode. The input can varies from sensors or switches, while the output can be used to control valves, motors, light source and a lot more. As partial development of the project, this paper reports the current status and results of the implemented ANN. The hardware fraction of this project incorporates Microchip PIC16F877A microcontrollers along with uM-FPU math co-processor. uM-FPU is a 32-bit floating point co-processor utilized to execute complex calculation requires by the sigmoid activation function for neuron. ANN algorithm is converted to software program written in assembly language. The implemented ANN structure is three layer with one hidden layer, and five neurons with two hidden neurons. To prove the operability and functionality, the network is trained to solve three common logic gate operations; AND, OR, and XOR. This paper concludes that the ANN had been successfully implemented on PIC16F877a and uM-FPU math co-processor hardware that works accordingly on both training and service mode. (Author)
Practical Application of Neural Networks in State Space Control
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon
1999-01-01
In the present thesis we address some problems in discrete-time state space control of nonlinear dynamical systems and attempt to solve them using generic nonlinear models based on artificial neural networks. The main aim of the work is to examine how well such control algorithms perform when applied to a realistic process. The thesis therefore strives to provide a thorough treatment of two classes of neural network-based controllers, and to make a rigorous comparison between them and a classical linear controller. Thus, the thesis starts out with a short review of some relevant system theoretic notions followed by a detailed description of the topology, neuron functions and learning rules of the two types of neural networks treated in the thesis, the multilayer perceptron and the neurofuzzy networks. In both cases, a Least Squares second-order gradient method is used to train the networks, although some modifications are needed for the method to apply to the multilayer perceptron network. In connection with the multilayer perceptron networks it is also pointed out how instantaneous, sample-by-sample linearized state space models can be extracted from a trained network, thus opening up for application of linear theory at each sample instant. The case study addressed in this work is an attemporator for a high-temperature steam circuit situated in a Danish powerplant, I/S Vestkraft unit 3. The attemporator is fitted with a nonlinear and nonconstant valve, so nonlinear and adaptive control is desired to control the steam temperature tightly. A second-order nonlinear model of the attemporator based on system identification with a multilayer perceptron network is found from data collected from the actual process. It is shown to be a highly satisfying prediction and simulation model of the process. With this model in place, we turn to the control concepts. A pole placement controller based on the sample-by-sample linearizations extracted from a multilayer perceptron state observer is first derived, and it is shown how to make the control concept adaptive by continuing the training online. Then the controller is shown to work on a simulation example. We also address the potential problem of too rapidly fluctuating parameters by including regularization in the learning rule. Next we develop a direct adaptive certainty-equivalence controller based on neurofuzzy models. The control loop is proven to be stable under certain assumptions, and we address the question of how many basis functions are necessary. It is shown that basis functions with compact supports, whose supports are not entered by a system trajectory, do not need parameter updates. Therefore, a system with bounded trajectories can be controlled by a finite-dimensional model. We also introduce a modification to the algorithm which-if an upper bound on the nonlinearity growth is known-enables us to remove a sector-boundedness assumption on the nonlinearity. Finally the control concepts are applied to the nonlinear simulation model discussed above, and it is seen that the neural network -based control concepts outperform a classical linear controller.
An Approach to Neural Network Based Pattern Classifier for Printed Bengali Characters
Directory of Open Access Journals (Sweden)
sabyasachi samanta
2011-04-01
Full Text Available In this paper, we have designed a Neural Network based pattern classifier for recognizing Bengali printed characters. Here view-based approach is used for extracting features from individual characters and a neural network based classifier is built to analyze the performance of the view-based approach in various experimental setups. Different Bengali character samples have been taken and whole image of individual character is considered for view based analysis. The characteristic points are extracted from the characters using left-right view based approach. These points are then used to form a feature vector which represents the given character. Multi-Layer Perceptrons Neural network has been used and it was trained by back propagation algorithm to create this recognition engine. Internal shape of each character has been considered to generate the feature vector for individual images.
Inversion of rocket-borne photometer measurements by an artificial neural network technique
International Nuclear Information System (INIS)
Complete text of publication follows. The inverse problem to retrieve useful airglow volume emission rate profiles from rocket-borne photometer measurements has been solved by adopting the well-characterized spectral photometric methods. An alternative recovery method based on artificial neural network (ANN) is presented. In this work, a multilayer perceptron neural network was trained with a range of cases from the empirical and experimental volume emission rate profiles. A numerical experiment was also carried out with synthetic experimental data considering a noise level of 5%. Integrated emission profiles measured by a Brazilian sounding rocket experiment launched from an Equatorial station were taken as the input data. From the results obtained it may be concluded that the ANN technique is a convenient tool to recover volume emission rate profiles. The advantages of using neural network based systems are related to their intrinsic features of parallelism, after trained, the networks are much faster than traditional inversion approaches.
Robert, Stéphane; Battie, Yann; Jamon, Damien; Royer, Francois
2007-04-01
Optimal performances of integrated optical devices are obtained by the use of an accurate and reliable characterization method. The parameters of interest, i.e., optical indices and thickness of the waveguide structure, are calculated from effective indices by means of an inversion procedure. We demonstrate how an artificial neural network can achieve such a process. The artificial neural network used is a multilayer perceptron. The first result concerns a simulated anisotropic waveguide. The accuracy in the determination of optical indices and waveguide thickness is 5×10-5 and 4 nm, respectively. Then an experimental application on a silica-titania thin film is performed. In addition, effective indices are measured by m-lines spectroscopy. Finally, a comparison with a classical optimization algorithm demonstrates the robustness of the neural method.
Energy Technology Data Exchange (ETDEWEB)
Ambriola, M.; Bellotti, R.; Cafagna, F.; Castellano, M.; Ciacio, F. E-mail: francesco.ciacio@ba.infn.it; Circella, M.; De Marzo, C.N.; Montaruli, T
2000-02-01
An isotope classifier of cosmic-ray events collected by space detectors has been implemented using a multi-layer perceptron neural architecture. In order to handle a great number of different isotopes a modular architecture of the 'mixture of experts' type is proposed. The performance of this classifier has been tested on simulated data and has been compared with a 'classical' classifying procedure. The quantitative comparison with traditional techniques shows that the neural approach has classification performances comparable - within 1% - with that of the classical one, with efficiency of the order of 98%. A possible hardware implementation of such a kind of neural architecture in future space missions is considered.
Directory of Open Access Journals (Sweden)
Kutalmis Gumus
2013-01-01
Full Text Available Interpolation of a spatially continuous variable from point samples is an important field in spatial analysis and surface models for geosciences. In this study, spatial interpolation methods which are Inverse Distance Weighted (IDW, Ordinary Kriging (OK, Modified Shepard's (MS, Multiquadric Radial Basis Function (MRBF and Triangulation with Linear (TWL, and Multi-Layer Perceptron (MLP which is an Artificial Neural Networks (ANN method were compared in order to predict height for different point distributions such as curvature, grid, random and uniform on a Digital Elevation Model which is an USGS National Elevation Dataset (NED. This study also aims to quantify the effects of topographic variability and sampling density. Errors of different interpolations and ANN prediction were evaluated for different point distributions and three different crosssections on the characteristic parts of the surface were selected and analyzed. Generally, OK, MS, MRBF and TWL gave promising results and were more effective in terms of characteristics of surface than MLP and IDW. Although MLP simplified the contours obtained from predicted heights, it was a satisfactory predictor for curvature, grid, random and uniform distributions ; Interpolacija prostorsko zvezne spremenljivke iz to?kovnih primerov je v geoznanosti pomembno podro?je prostorske analize in modelov površja. V opisani študiji je bila izvedena primerjava interpolacijskih metod v trirazsežnem prostoru, in sicer so to metoda z inverzno uteženo razdaljo (IDW, navadni kriging (OK, modificirana Shepardova metoda (MS, multikvadri?na radialna funkcija (MRBF in triangulacija z linearno interpolacijo (TWL ter ve?slojni perceptron (MLP, ki je predstavnik umetnih nevronskih mrež (ANN. Cilj je bil napovedati višino za razli?ne geometrijske razporeditve to?k, kot so ukrivljenost, mreža, naklju?na in enotna porazdelitev na digitalnem modelu višin, ki je podatkovni niz digitalnega modela višin ameriške geološke službe USGS. Namen študije je koli?insko opredeliti u?inek topografske variabilnosti in gostote vzor?enja. Napake razli?nih interpolacij in napovedi z umetnimi nevronskimi mrežami so bile ovrednotene glede na razli?ne geometrijske porazdelitve to?k, izbrani in analizirani so bili tri razli?ni prerezi zna?ilnih delov površja. Na splošno se je izkazalo, da metode navadni kriging (OK, modificirana Shepardova metoda (MS, multikvadri?na radialna funkcija (MRBF in triangulacija z linearno interpolacijo (TWL dajejo boljše rezultate ter so bolj u?inkovite glede zna?ilnosti površja kot ve?slojni perceptron (MLP in metoda z uteženo inverzno razdaljo (IDW. ?eprav je ve?slojni perceptron (MLP poenostavil obrise, pridobljene iz napovedanih višin, se je izkazal kot zadovoljiv pri napovedovanju ukrivljenosti ter dolo?itvi celi?ne mreže za naklju?ne in znane geometrijske porazdelitve to?k
Application of artificial neural networks to clinical pharmacology.
Brier, M E; Aronoff, G R
1996-11-01
Drug dosages and drug choices are determined by a knowledge of the drug's pharmacokinetics and pharmacodynamics. Often, insufficient information is available to determine the pharmacokinetics of a drug or which drug will have a desired effect for an individual patient. We propose that a form of nonlinear regression, an artificial neural network, can be used. We have demonstrated this use with 2 examples. In the first example we use a neural network to predict gentamicin peak and trough concentrations from routine therapeutic drug monitoring. In the second example we predict delayed renal allograft function as a guide for induction of immunosuppression therapy. Predictions were made using a multilayer feedforward perceptron and compared to nonlinear mixed effect modeling (NONMEM) and logistic regression. Neural network peak and trough gentamicin predictions were more precise and less biased than control predictions made using NONMEM. Prediction error for peak serum concentrations averaged 16.5% for the neural networks and 18.6% for NONMEM. Prediction error for trough concentrations were 48.3% for neural networks and 59.0% for NONMEM. When used for the prediction of delayed graft function, the neural network correctly predicted immediate graft function 73% of the time and delayed graft function 65% of the time. For those patients predicted to develop delayed graft function, alternate induction using anti-lymphocyte globulin may be indicated. These 2 examples demonstrate how an artificial neural network may be applied to predictions in clinical pharmacology. PMID:8937935
PREDICTION OF BOD AND COD OF A REFINERY WASTEWATER USING MULTILAYER ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Eldon Raj Rene
2008-06-01
Full Text Available In the recent past, artificial neural networks (ANNs have shown the ability to learn and capture non-linear static or dynamic behaviour among variables based on the given set of data. Since the knowledge of internal procedure is not necessary, the modelling can take place with minimum previous knowledge about the process through proper training of the network. In the present study, 12 ANN based models were proposed to predict the Biochemical Oxygen Demand (BOD5 and Chemical Oxygen Demand (COD concentrations of wastewater generated from the effluent treatment plant of a petrochemical industry. By employing the standard back error propagation (BEP algorithm, the network was trained with 103 data points for water quality indices such as Total Suspended Solids (TSS, Total Dissolved Solids (TDS, Phenol concentration, Ammoniacal Nitrogen (AMN, Total Organic Carbon (TOC and Kjeldahl’s Nitrogen (KJN to predict BOD and COD. After appropriate training, the network was tested with a separate test data and the best model was chosen based on the sum square error (training and percentage average relative error (% ARE for testing. The results from this study reveal that ANNs can be accurate and efficacious in predicting unknown concentrations of water quality parameters through its versatile training process.
Product-Units neural networks for catchment runoff forecasting
Piotrowski, Adam P.; Napiorkowski, Jaros?aw J.
2012-12-01
In this paper Product-Units neural networks (PUNNs), which probably have never been used within the field of hydrology, are introduced and applied for catchment runoff forecasting in cold climate zones. This type of neural networks, a subclass of higher order neural networks uses product nodes with inputs raised to exponential weights in one layer and well-known summation nodes in another layer. The present paper empirically shows that PUNNs with unbounded weights are difficult to train and do not perform well for catchment runoff forecasting. However, a very good predictive performance may be achieved when the weights are bounded within [-1, 1] interval. Several variants of optimization methods, mostly Differential Evolution-based algorithms, and a few approaches enabling good generalization capabilities of neural networks are compared in order to select the appropriate technique for PUNNs training. PUNNs with parameters bounded within [-1, 1] interval are shown to outperform Multi-Layer Perceptron neural networks and HBV conceptual model for runoff forecasting case study at Annapolis River, Nova Scotia, Canada. Gradient-based Levenberg-Marquardt algorithm and Evolutionary Computation-based Differential Evolution with Global and Local Neighborhood method turn out to be the most successful among the tested training algorithms. Surprisingly, in the case of Product-Units neural networks with weights bounded within [-1, 1] interval using noise injection or early stopping do not improve the results obtained when no method to avoid overfitting is used.
Neural network classifier of attacks in IP telephony
Safarik, Jakub; Voznak, Miroslav; Mehic, Miralem; Partila, Pavol; Mikulec, Martin
2014-05-01
Various types of monitoring mechanism allow us to detect and monitor behavior of attackers in VoIP networks. Analysis of detected malicious traffic is crucial for further investigation and hardening the network. This analysis is typically based on statistical methods and the article brings a solution based on neural network. The proposed algorithm is used as a classifier of attacks in a distributed monitoring network of independent honeypot probes. Information about attacks on these honeypots is collected on a centralized server and then classified. This classification is based on different mechanisms. One of them is based on the multilayer perceptron neural network. The article describes inner structure of used neural network and also information about implementation of this network. The learning set for this neural network is based on real attack data collected from IP telephony honeypot called Dionaea. We prepare the learning set from real attack data after collecting, cleaning and aggregation of this information. After proper learning is the neural network capable to classify 6 types of most commonly used VoIP attacks. Using neural network classifier brings more accurate attack classification in a distributed system of honeypots. With this approach is possible to detect malicious behavior in a different part of networks, which are logically or geographically divided and use the information from one network to harden security in other networks. Centralized server for distributed set of nodes serves not only as a collector and classifier of attack data, but also as a mechanism for generating a precaution steps against attacks.
A Multi-threaded Neural Network approach for Steganography
Directory of Open Access Journals (Sweden)
Srinivasan SP
2011-11-01
Full Text Available Steganographic techniques are being applied across a broad set of different modern digital technologies. Steganography is basically the process of hiding one medium of communication (Text, Sound, and Image within another. It can work on JPEG 2000 compressed images & stir Mark images. The steganographic method will be used for internet/network security, watermarking and so on. „Steganalysis? is the field of detecting the covert messages. The new methods of steganalysis are based on neural network to get the statistics and features of images to identify the underlying hidden data. We first extract the features of image embedded information, and then input them into neural network to get the output. Experiment result indicates this method is valid in „Steganalysis?. Almost all steganalysis consist of hand-crafted tests or human visual inspection to detect whether a file contains a message hidden by a specific steganography algorithm. The neural network in images is used to overcome the hurdles by hiding the data indirectly into graphical image using neural network algorithm to get cipher bits. The generated cipher bits are then placed in the least significant bit position of the carrier image. A Multi threaded back propagation algorithm is used in the neural network. Multi threading in the back propagation algorithm increases the speed of processing in the neural layers and thereby significantly increases the efficiency. The XOR propagation network model is used which acts as a multilayer perceptron
Nonlinear Process Identification using Neural Networks
Directory of Open Access Journals (Sweden)
Miss.Mali Priyadarshani S. *1,
2014-06-01
Full Text Available In industry process control, the model identification of nonlinear systems are always difficult problems. The main aim of this paper is to establish a reliable model for the nonlinear process. In many applications, development of empirical nonlinear model from dynamic plant data. This process is known as ‘Nonlinear System Identification’. Artificial neural networks are the most popular frame-work for empirical model development .In order to obtain this reliable model for the process dynamics, the neural black-box identification by means of a Nonlinear Autoregressive exogenous input (NARMAX model has been chosen in this study. The model is implemented by training a Multi-Layer Perceptron Artificial Neural Network (MLP-ANN with input-output experimental data is found and results shown that the neural model successfully predicts the evolution of the product composition. The simulation result illustrates the validity and feasibility of the nonlinear model identification. Trained data obtained from nonlinear process identification, can be used to control the nonlinear system
Evaluation of artificial neural network techniques for flow forecasting in the River Yangtze, China
Directory of Open Access Journals (Sweden)
C. W. Dawson
2002-01-01
Full Text Available While engineers have been quantifying rainfall-runoff processes since the mid-19th century, it is only in the last decade that artificial neural network models have been applied to the same task. This paper evaluates two neural networks in this context: the popular multilayer perceptron (MLP, and the radial basis function network (RBF. Using six-hourly rainfall-runoff data for the River Yangtze at Yichang (upstream of the Three Gorges Dam for the period 1991 to 1993, it is shown that both neural network types can simulate river flows beyond the range of the training set. In addition, an evaluation of alternative RBF transfer functions demonstrates that the popular Gaussian function, often used in RBF networks, is not necessarily the ‘best’ function to use for river flow forecasting. Comparisons are also made between these neural networks and conventional statistical techniques; stepwise multiple linear regression, auto regressive moving average models and a zero order forecasting approach. Keywords: Artificial neural network, multilayer perception, radial basis function, flood forecasting
Energy Technology Data Exchange (ETDEWEB)
Guia, Jose G.C. da; Araujo, Adevid L. de [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia Mecanica; Irmao, Marcos A. da Silva [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia de Processos; Silva, Antonio A. [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia Mecanica
2003-07-01
The condition monitoring and diagnostic of structural faults in pipelines are an important problem for the petroleum's industry, being necessary to develop supervisory systems for detection, prediction and evaluation of a fault in the pipelines to avoid environmental and financial damages. In this work, three types of Artificial Neural Networks (ANNs) are reviewed and used to detect and locate a fault in a simulated pipe. The simulated pipe was modeled through the Finite Elements Method. In Neural Networks' analysis, the first six natural frequencies of the pipe are used as networks' inputs. The used ANNs were the Multi-Layer Perceptron Network with backpropagation, the Probabilistic Neural Network and the Generalized Regression Neural Network. After the analysis, it was concluded that the ANN are a good computational tool in problems of faults detection on pipelines with a great precision. In the localization of the faults were obtained errors smaller than 5%. (author)
A balanced neural tree for pattern classification.
Micheloni, Christian; Rani, Asha; Kumar, Sanjeev; Foresti, Gian Luca
2012-03-01
This paper proposes a new neural tree (NT) architecture, balanced neural tree (BNT), to reduce tree size and improve classification with respect to classical NTs. To achieve this result, two main innovations have been introduced: (a) perceptron substitution and (b) pattern removal. The first innovation aims to balance the structure of the tree. If the last-trained perceptron largely misclassifies the given training set into a reduced number of classes, then this perceptron is substituted with a new perceptron. The second novelty consists of the introduction of a new criterion for the removal of tough training patterns that generate the problem of over-fitting. Finally, a new error function based on the depth of the tree is introduced to reduce perceptron training time. The proposed BNT has been tested on various synthetic and real datasets. The experimental results show that the proposed BNT leads to satisfactory results in terms of both tree depth reduction and classification accuracy. PMID:22071271
Energy Technology Data Exchange (ETDEWEB)
Patil, R.B.
1995-05-01
Traditional neural networks like multi-layered perceptrons (MLP) use example patterns, i.e., pairs of real-valued observation vectors, ({rvec x},{rvec y}), to approximate function {cflx f}({rvec x}) = {rvec y}. To determine the parameters of the approximation, a special version of the gradient descent method called back-propagation is widely used. In many situations, observations of the input and output variables are not precise; instead, we usually have intervals of possible values. The imprecision could be due to the limited accuracy of the measuring instrument or could reflect genuine uncertainty in the observed variables. In such situation input and output data consist of mixed data types; intervals and precise numbers. Function approximation in interval domains is considered in this paper. We discuss a modification of the classical backpropagation learning algorithm to interval domains. Results are presented with simple examples demonstrating few properties of nonlinear interval mapping as noise resistance and finding set of solutions to the function approximation problem.
Scientific Electronic Library Online (English)
Dionísio, Borsato; Ivanira, Moreira; Marcelo Medre, Nobrega; Mariete Barbosa, Moreira; Gabriel Henrique, Dias; Rui Sérgio dos Santos Ferreira da, Silva; Evandro, Bona.
2328-23-01
Full Text Available SciELO Brazil | Language: Portuguese Abstract in portuguese [...] Abstract in english The multilayer perceptron network was used to classify the gasoline. The main parameters used in the classification were established by the Ordinance nº 309 of the Agência Nacional do Petróleo, but without informing the network the legal limits of these parameters. The network used had 10 neurons in [...] a single hidden layer, learning rate of 0.04 and 250 training epochs. The application of artificial neural network served classify 100% of the commercialized gas in the region of Londrina-PR and to identify the tampered gasoline even those suspected of tampering.
Chattopadhyay, S
2006-01-01
In the present research, possibility of predicting average summer-monsoon rainfall over India has been analyzed through Artificial Neural Network models. In formulating the Artificial Neural Network based predictive model, three layered networks have been constructed with sigmoid non-linearity. The models under study are different in the number of hidden neurons. After a thorough training and test procedure, neural net with three nodes in the hidden layer is found to be the best predictive model.
Chattopadhyay, Surajit
2006-01-01
In the present research, possibility of predicting average summer-monsoon rainfall over India has been analyzed through Artificial Neural Network models. In formulating the Artificial Neural Network based predictive model, three layered networks have been constructed with sigmoid non-linearity. The models under study are different in the number of hidden neurons. After a thorough training and test procedure, neural net with three nodes in the hidden layer is found to be the ...
Foreground removal from Planck Sky Model temperature maps using a MLP neural network
DEFF Research Database (Denmark)
NØrgaard-Nielsen, Hans Ulrik; Hebert, K.
2009-01-01
Unfortunately, the Cosmic Microwave Background (CMB) radiation is contaminated by emission originating in the Milky Way (synchrotron, free-free and dust emission). Since the cosmological information is statistically in nature, it is essential to remove this foreground emission and leave the CMB with no systematic errors. To demonstrate the feasibility of a simple multilayer perceptron (MLP) neural network for extracting the CMB temperature signal, we have analyzed a specific data set, namely the Planck Sky Model maps, developed for evaluation of different component separation methods before including them in the Planck data analysis pipeline. It is found that a MLP neural network can provide a CMB map of about 80% of the sky to a very high degree uncorrelated with the foreground components. Also the derived power spectrum shows little evidence for systematic errors.
DEFF Research Database (Denmark)
Farrokhzad, F.; Barari, Amin
2011-01-01
The purpose of this study was to create an empirical model for assessing the landslide risk potential at Savadkouh Azad University, which is located in the rural surroundings of Savadkouh, about 5 km from the city of Pol-Sefid in northern Iran. The soil longitudinal profile of the city of Babol, located 25 km from the Caspian Sea, also was predicted with an artificial neural network (ANN). A multilayer perceptron neural network model was applied to the landslide area and was used to analyze specific elements in the study area that contributed to previous landsliding events. The ANN models were trained with geotechnical data obtained from an investigation of the study area. The quality of the modeling was improved further by the application of some controlling techniques involved in ANN. The observed >90% overall accuracy produced by the ANN technique in both cases is promising for future studies in landslide susceptibility zonation.
Neural Network on Photodegradation of Octylphenol using Natural and Artificial UV Radiation
Directory of Open Access Journals (Sweden)
Lorentz JÄNTSCHI
2011-09-01
Full Text Available The present paper comes up with an experimental design meant to point out the factors interferingin octylphenol’s degradation in surface waters under solar radiation, underlining each factor’sinfluence on the process observable (concentration of p-octylphenol. Multiple linear regressionanalysis and artificial neural network (Multi-Layer Perceptron type were applied in order to obtaina mathematical model capable to explain the action of UV-light upon synthetic solutions of OP inultra-pure water (MilliQ type. Neural network proves to be the most efficient method in predictingthe evolution of OP concentration during photodegradation process. Thus, determination in neuralnetwork’s case has almost double value versus the regression analysis.
Artificial neural network for modeling the extraction of aromatic hydrocarbons from lube oil cuts
Energy Technology Data Exchange (ETDEWEB)
Mehrkesh, A.H.; Hajimirzaee, S. [Islamic Azad University, Majlesi Branch, Isfahan (Iran, Islamic Republic of); Hatamipour, M.S.; Tavakoli, T. [Department of Chemical Engineering, University of Isfahan, Isfahan (Iran, Islamic Republic of)
2011-03-15
An artificial neural network (ANN) approach was used to obtain a simulation model to predict the rotating disc contactor (RDC) performance during the extraction of aromatic hydrocarbons from lube oil cuts, to produce a lubricating base oil using furfural as solvent. The field data used for training the ANN model was obtained from a lubricating oil production company. The input parameters of the ANN model were the volumetric flow rates of feed and solvent, the temperatures of feed and solvent, and the disc rotation rate. The output parameters were the volumetric flow rate of the raffinate phase and the extraction yield. In this study, a feed-forward multi-layer perceptron neural network was successfully used to demonstrate the complex relationship between the mentioned input and output parameters. (Copyright copyright 2011 WILEY-VCH Verlag GmbH and Co. KGaA, Weinheim)
Neural network controller for Active Demand-Side Management with PV energy in the residential sector
International Nuclear Information System (INIS)
Highlights: ? We have developed a neural controller for Active Demand-Side Management. ? The controller consists of Multilayer Perceptrons evolved with a genetic algorithm. ? The architecture of the controller is distributed and modular. ? The simulations show that the electrical local behavior improves. ? Active Demand-Side Management helps users to control his energy behaviour. -- Abstract: In this paper, we describe the development of a control system for Demand-Side Management in the residential sector with Distributed Generation. The electrical system under study incorporates local PV energy generation, an electricity storage system, connection to the grid and a home automation system. The distributed control system is composed of two modules: a scheduler and a coordinator, both implemented with neural networks. The control system enhances the local energy performance, scheduling the tasks demanded by the user and maximizing the use of local generation.
Neural network model for a reactor subsystem using real time data
International Nuclear Information System (INIS)
Modern nuclear power plant is a very complex arrangement of machinery consisting of huge number of control and support systems. In real time it is possible to implement intelligent systems in the form of neural network, data mining, expert system etc. for modeling the power plant. This paper describes the development of an artificial neural network model for intermediate heat exchanger subsystem of fast breeder test reactor. Multilayer perceptron network using back propagation algorithm is implemented for training the safety critical, safety related real time data. It takes in to account the weight correction method. The results indicate a very good convergence of the algorithm. The model can be used as an operator support system for predictive measures of various parameters of the reactor subsystems. (author)
Directory of Open Access Journals (Sweden)
2009-03-01
Full Text Available An electrocardiogram (ECG beat classification scheme based on multiple signal classification (MUSIC algorithm, morphological descriptors, and neural networks is proposed for discriminating nine ECG beat types. These are normal, fusion of ventricular and normal, fusion of paced and normal, left bundle branch block, right bundle branch block, premature ventricular concentration, atrial premature contraction, paced beat, and ventricular flutter. ECG signal samples from MIT-BIH arrhythmia database are used to evaluate the scheme. MUSIC algorithm is used to calculate pseudospectrum of ECG signals. The low-frequency samples are picked to have the most valuable heartbeat information. These samples along with two morphological descriptors, which deliver the characteristics and features of all parts of the heart, form an input feature vector. This vector is used for the initial training of a classifier neural network. The neural network is designed to have nine sample outputs which constitute the nine beat types. Two neural network schemes, namely multilayered perceptron (MLP neural network and a probabilistic neural network (PNN, are employed. The experimental results achieved a promising accuracy of 99.03% for classifying the beat types using MLP neural network. In addition, our scheme recognizes NORMAL class with 100% accuracy and never misclassifies any other classes as NORMAL.
Handwritten Farsi Character Recognition using Artificial Neural Network
Ahangar, Reza Gharoie
2009-01-01
Neural Networks are being used for character recognition from last many years but most of the work was confined to English character recognition. Till date, a very little work has been reported for Handwritten Farsi Character recognition. In this paper, we have made an attempt to recognize handwritten Farsi characters by using a multilayer perceptron with one hidden layer. The error backpropagation algorithm has been used to train the MLP network. In addition, an analysis has been carried out to determine the number of hidden nodes to achieve high performance of backpropagation network in the recognition of handwritten Farsi characters. The system has been trained using several different forms of handwriting provided by both male and female participants of different age groups. Finally, this rigorous training results an automatic HCR system using MLP network. In this work, the experiments were carried out on two hundred fifty samples of five writers. The results showed that the MLP networks trained by the err...
Artificial neural networks for load flow and external equivalents studies
Energy Technology Data Exchange (ETDEWEB)
Mueller, Heloisa H.; Castro, Carlos A. [University of Campinas, DSEE/FEEC/UNICAMP, C.P. 6101, 13083-852 Campinas, SP (Brazil); Rider, Marcos J. [Universidade Estadual Paulista, DEE/FEIS/UNESP, C.P. 31, 15385-000 ILha Solteira, SP (Brazil)
2010-09-15
In this paper an artificial neural network (ANN) based methodology is proposed for (a) solving the basic load flow, (b) solving the load flow considering the reactive power limits of generation (PV) buses, (c) determining a good quality load flow starting point for ill-conditioned systems, and (d) computing static external equivalent circuits. An analysis of the input data required as well as the ANN architecture is presented. A multilayer perceptron trained with the Levenberg-Marquardt second order method is used. The proposed methodology was tested with the IEEE 30- and 57-bus, and an ill-conditioned 11-bus system. Normal operating conditions (base case) and several contingency situations including different load and generation scenarios have been considered. Simulation results show the excellent performance of the ANN for solving problems (a)-(d). (author)
Neural Network Aided Glitch-Burst Discrimination and Glitch Classification
Rampone, Salvatore; Troiano, Luigi; Pinto, Innocenzo M
2014-01-01
We investigate the potential of neural-network based classifiers for discriminating gravitational wave bursts (GWBs) of a given canonical family (e.g. core-collapse supernova waveforms) from typical transient instrumental artifacts (glitches), in the data of a single detector. The further classification of glitches into typical sets is explored.In order to provide a proof of concept,we use the core-collapse supernova waveform catalog produced by H. Dimmelmeier and co-Workers, and the data base of glitches observed in laser interferometer gravitational wave observatory (LIGO) data maintained by P. Saulson and co-Workers to construct datasets of (windowed) transient waveforms (glitches and bursts) in additive (Gaussian and compound-Gaussian) noise with different signal-tonoise ratios (SNR). Principal component analysis (PCA) is next implemented for reducing data dimensionality, yielding results consistent with, and extending those in the literature. Then, a multilayer perceptron is trained by a backpropagation ...
Prediction of Bladder Cancer Recurrences Using Artificial Neural Networks
Zulueta Guerrero, Ekaitz; Garay, Naiara Telleria; Lopez-Guede, Jose Manuel; Vilches, Borja Ayerdi; Iragorri, Eider Egilegor; Castaños, David Lecumberri; de La Hoz Rastrollo, Ana Belén; Peña, Carlos Pertusa
Even if considerable advances have been made in the field of early diagnosis, there is no simple, cheap and non-invasive method that can be applied to the clinical monitorisation of bladder cancer patients. Moreover, bladder cancer recurrences or the reappearance of the tumour after its surgical resection cannot be predicted in the current clinical setting. In this study, Artificial Neural Networks (ANN) were used to assess how different combinations of classical clinical parameters (stage-grade and age) and two urinary markers (growth factor and pro-inflammatory mediator) could predict post surgical recurrences in bladder cancer patients. Different ANN methods, input parameter combinations and recurrence related output variables were used and the resulting positive and negative prediction rates compared. MultiLayer Perceptron (MLP) was selected as the most predictive model and urinary markers showed the highest sensitivity, predicting correctly 50% of the patients that would recur in a 2 year follow-up period.
Hybrid Learning Algorithm in Neural Network System for Enzyme Classification
Directory of Open Access Journals (Sweden)
Mohd Haniff Osman
2010-07-01
Full Text Available Nucleic acid and protein sequences store a wealth of informationwhich ultimately determines their functions and characteristics.Protein sequences classification deals with the assignment ofsequences to known categories based on homology detectionproperties. In this paper, we developed a hybrid learning algorithm inneural network system called Neural Network Enzyme Classification(NNEC to classify an enzyme found in Protein Data Bank (PDB to agiven family of enzymes. NNEC was developed based on MultilayerPerceptron with hybrid learning algorithm combining the geneticalgorithm (GA and Backpropagation (BP, where one of them acts asan operator in the other. Here, BP is used as a mutation-like-operatorof the general GA search template. The proposed hybrid model wastested with different topologies of network architecture, especially indetermining the number of hidden nodes. The precision results arequite promising in classifying the enzyme accordingly.
Recognition of Japanese finger spelling gestures using neural networks.
Machacon, H T C; Shiga, S
2010-05-01
Effective communication with the hearing and speech impaired often requires at least a basic working knowledge of sign language gestures, without which a memo pad and pen, or a mobile phone's notepad is indispensable. The aim of this study was to build a neural network that could be used to recognize static finger-hand gestures of the yubimoji, the Japanese sign language syllabary. To build the network, signal inputs from a data glove interface were taken for each of the static yubimoji gestures. The network was trained and tested 10 times using a multilayer perceptron model. Overall, only 18 of the 41 static gestures were successfully recognized. One of the reasons was attributed to the inability of the data glove to measure gesture directions particularly for yubimoji gestures with similar finger configurations. Future work will focus on these problems as well as the inclusion of dynamic yubimoji gestures. PMID:20143958
View-invariant action recognition based on artificial neural networks.
Iosifidis, Alexandros; Tefas, Anastasios; Pitas, Ioannis
2012-03-01
In this paper, a novel view invariant action recognition method based on neural network representation and recognition is proposed. The novel representation of action videos is based on learning spatially related human body posture prototypes using self organizing maps. Fuzzy distances from human body posture prototypes are used to produce a time invariant action representation. Multilayer perceptrons are used for action classification. The algorithm is trained using data from a multi-camera setup. An arbitrary number of cameras can be used in order to recognize actions using a Bayesian framework. The proposed method can also be applied to videos depicting interactions between humans, without any modification. The use of information captured from different viewing angles leads to high classification performance. The proposed method is the first one that has been tested in challenging experimental setups, a fact that denotes its effectiveness to deal with most of the open issues in action recognition. PMID:24808548
Radar classification using a neural network
Willson, Gregory B.
1990-08-01
Commonly used signal recognition techniques have many drawbacks. Many signal recognition and analysis techniques rely on complex algorithms which are computationally intensive and require a man in the loop to verify and validate the analysis. Classical signal recognition techniques often are unable to function in near real time. Classical techniques include nearest neighbor classifiers parameter range-matching statistical estimation techniques and heuristic algorithms. Hard-limited decision boundaries can produce ambiguities because signals which are outside these boundaries may not be classified or may be matched to more than one class. Lastly the addition of more signals to the signal recognition database of these algorithms typically necessitates additional software or hardware. We describe the use of an artificial neural network for classifying radar signals collected by a passive receiver. We selected neural classifiers because of their ability to adapt to the environment through training which allows them to avoid many of the problems associated with traditional classifiers. We used an artificial neural network employing a multilayer perceptron with back propagation to solve two common pattern recognition problems encountered when classifying radar signals. The first problem that of pulse sorting or deinterleaving is to sort individual pulses into " bins" associated with the radar emitter each pulse is from. The second problem that of radar classification or identifying radar type is to determine the type (and function) of the radar emitter represented by each bin
Shale Gas reservoirs characterization using neural network
Ouadfeul, Sid-Ali; Aliouane, Leila
2014-05-01
In this paper, a tentative of shale gas reservoirs characterization enhancement from well-logs data using neural network is established. The goal is to predict the Total Organic carbon (TOC) in boreholes where the TOC core rock or TOC well-log measurement does not exist. The Multilayer perceptron (MLP) neural network with three layers is established. The MLP input layer is constituted with five neurons corresponding to the Bulk density, Neutron porosity, sonic P wave slowness and photoelectric absorption coefficient. The hidden layer is forms with nine neurons and the output layer is formed with one neuron corresponding to the TOC log. Application to two boreholes located in Barnett shale formation where a well A is used as a pilot and a well B is used for propagation shows clearly the efficiency of the neural network method to improve the shale gas reservoirs characterization. The established formalism plays a high important role in the shale gas plays economy and long term gas energy production.
The Margitron: A Generalised Perceptron with Margin
Panagiotakopoulos, Constantinos; Tsampouka, Petroula
2008-01-01
We identify the classical Perceptron algorithm with margin as a member of a broader family of large margin classifiers which we collectively call the Margitron. The Margitron, (despite its) sharing the same update rule with the Perceptron, is shown in an incremental setting to converge in a finite number of updates to solutions possessing any desirable fraction of the maximum margin. Experiments comparing the Margitron with decomposition SVMs on tasks involving linear kernel...
Robust chaos generation by a perceptron
Priel, A.; Kanter, I.
2000-01-01
The properties of time series generated by a perceptron with monotonic and non-monotonic transfer function, where the next input vector is determined from past output values, are examined. Analysis of the parameter space reveals the following main finding: a perceptron with a monotonic function can produce fragile chaos only whereas a non-monotonic function can generate robust chaos as well. For non-monotonic functions, the dimension of the attractor can be controlled monoto...
The Margitron: A Generalised Perceptron with Margin
Panagiotakopoulos, Constantinos
2008-01-01
We identify the classical Perceptron algorithm with margin as a member of a broader family of large margin classifiers which we collectively call the Margitron. The Margitron, (despite its) sharing the same update rule with the Perceptron, is shown in an incremental setting to converge in a finite number of updates to solutions possessing any desirable fraction of the maximum margin. Experiments comparing the Margitron with decomposition SVMs on tasks involving linear kernels and 2-norm soft margin are also reported.
Perceptrons with Hebbian learning based on wave ensembles in plastic potentials
Espinosa-ortega, T.; Liew, T. C. H.
2014-01-01
We present a general theoretical model to realize a bilayer perceptron for hardware neural networks with applications in pattern recognition. In the network, multiple interconnections are allowed, by using the Schrodinger wave function as input and outputs signals; moreover, microscopic plastic potentials allow to process information and \\train" the system in micrometer's scale. As particular cases, we present the calculations for two devices where the information is carrie...
Generalization and capacity of extensively large two-layered perceptrons
International Nuclear Information System (INIS)
The generalization ability and storage capacity of a treelike two-layered neural network with a number of hidden units scaling as the input dimension is examined. The mapping from the input to the hidden layer is via Boolean functions; the mapping from the hidden layer to the output is done by a perceptron. The analysis is within the replica framework where an order parameter characterizing the overlap between two networks in the combined space of Boolean functions and hidden-to-output couplings is introduced. The maximal capacity of such networks is found to scale linearly with the logarithm of the number of Boolean functions per hidden unit. The generalization process exhibits a first-order phase transition from poor to perfect learning for the case of discrete hidden-to-output couplings. The critical number of examples per input dimension, ?c, at which the transition occurs, again scales linearly with the logarithm of the number of Boolean functions. In the case of continuous hidden-to-output couplings, the generalization error decreases according to the same power law as for the perceptron, with the prefactor being different
Vibration Based Damage Assessment of a Cantilever using a Neural Network
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1993-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated.
Hosseini, Seiyed Mossa; Mahjouri, Najmeh
2014-06-01
The aim of this study is to develop a fuzzy neural network-based support vector regression model (FNN-SVR) for mapping crisp-input and fuzzy-output variables. In this model, an artificial neural network (ANN) estimator based on multilayer perceptron (MLP) is considered as the kernel function of the SVR, whereas asymmetric triangular fuzzy H-level sets are assumed for model parameters including weight and biases of the ANN model. A genetic algorithm (GA) with real coding is implemented to optimize the model parameters during the training phase. To evaluate the efficiency and applicability of the proposed model, it is applied for simulating and regionalizing nitrate concentration in Karaj Aquifer in Iran. The goodness-of-fit criteria indicate a better performance of the FNN-SVR compared to some benchmark models such as geostatistic techniques as well as traditional SVR models with linear, quadratic, polynomial, and Gaussian kernel functions for modeling nitrate concentrations in groundwater. PMID:24493265
Directory of Open Access Journals (Sweden)
Palukuru NAGENDRA
2010-12-01
Full Text Available In this study, the use of artificial neural network (ANN based model, multi-layer perceptron (MLP network, to compute the transfer capabilities in a multi-area power system was explored. The input for the ANN is load status and the outputs are the transfer capability among the system areas, voltage magnitudes and voltage angles at concerned buses of the areas under consideration. The repeated power flow (RPF method is used in this paper for calculating the power transfer capability, voltage magnitudes and voltage angles necessary for the generation of input-output patterns for training the proposed MLP neural network. Preliminary investigations on a three area 30-bus system reveal that the proposed model is computationally faster than the conventional method.
Scientific Electronic Library Online (English)
Gustavo A., García; Octavio, Salcedo.
2010-06-01
Full Text Available El presente artículo describe la implementación de un sistema de predicción de fallos en redes LAN (fallos de timeout y rechazo en las conexiones), utilizando redes neuronales artificiales Perceptrón Multicapa. Se describe como se implementó el sistema, las pruebas realizadas para la selección de lo [...] s parámetros propios de la red neuronal, como del algoritmo de entrenamiento y los resultados de evaluación obtenidos. Abstract in english The paper presents the implementation of a system for predicting failures in LAN (timeout failure and rejection of connections), using neural networks (multilayer perceptron). It describes the implementation of the system, experiments conducted for the selection of specific parameters of the neural [...] network, training algorithm and evaluation results.
Control on a 2-D Wing Flutter Using an AdaptiveNonlinear Neural Controller
Directory of Open Access Journals (Sweden)
Hayder S. Abd Al-Amir
2011-01-01
Full Text Available An adaptive nonlinear neural controller to reduce the nonlinear flutter in 2-D wing is proposed in the paper. The nonlinearities in the system come from the quasi steady aerodynamic model and torsional spring in pitch direction. Time domain simulations are used to examine the dynamic aero elastic instabilities of the system (e.g. the onset of flutter and limit cycle oscillation, LCO. The structure of the controller consists of two models :the modified Elman neural network (MENN and the feed forward multi-layer Perceptron (MLP. The MENN model is trained with off-line and on-line stages to guarantee that the outputs of the model accurately represent the plunge and pitch motion of the wing and this neural model acts as the identifier. The feed forward neural controller is trained off-line and adaptive weights are implemented on-line to find the flap angles, which controls the plunge and pitch motion of the wing. The general back propagation algorithm is used to learn the feed forward neural controller and the neural identifier. The simulation results show the effectiveness of the proposed control algorithm; this is demonstrated by the minimized tracking error to zero approximation with very acceptable settling time even with the existence of bounded external disturbances.
Fuzzy neural networks for classification and detection of anomalies.
Meneganti, M; Saviello, F S; Tagliaferri, R
1998-01-01
In this paper, a new learning algorithm for the Simpson's fuzzy min-max neural network is presented. It overcomes some undesired properties of the Simpson's model: specifically, in it there are neither thresholds that bound the dimension of the hyperboxes nor sensitivity parameters. Our new algorithm improves the network performance: in fact, the classification result does not depend on the presentation order of the patterns in the training set, and at each step, the classification error in the training set cannot increase. The new neural model is particularly useful in classification problems as it is shown by comparison with some fuzzy neural nets cited in literature (Simpson's min-max model, fuzzy ARTMAP proposed by Carpenter, Grossberg et al. in 1992, adaptive fuzzy systems as introduced by Wang in his book) and the classical multilayer perceptron neural network with backpropagation learning algorithm. The tests were executed on three different classification problems: the first one with two-dimensional synthetic data, the second one with realistic data generated by a simulator to find anomalies in the cooling system of a blast furnace, and the third one with real data for industrial diagnosis. The experiments were made following some recent evaluation criteria known in literature and by using Microsoft Visual C++ development environment on personal computers. PMID:18255771
Applying Neural Network Architecture for Inverse Kinematics Problem in Robotics
Directory of Open Access Journals (Sweden)
Shadi Khawandi
2010-03-01
Full Text Available One of the most important problems in robot kinematics and control is, finding the solution of Inverse Kinematics. Inverse kinematics computation has been one of the main problems in robotics research. As the Complexity of robot increases, obtaining the inverse kinematics is difficult and computationally expensive. Traditional methods such as geometric, iterative and algebraic are inadequate if the joint structure of the manipulator is more complex. As alternative approaches, neural networks and optimal search methods have been widely used for inverse kinematics modeling and control in robotics This paper proposes neural network architecture that consists of 6 sub-neural networks to solve the inverse kinematics problem for robotics manipulators with 2 or higher degrees of freedom. The neural networks utilized are multi-layered perceptron (MLP with a back-propagation training algorithm. This approach will reduce the complexity of the algorithm and calculation (matrix inversion faced when using the Inverse Geometric Models implementation (IGM in robotics. The obtained results are presented and analyzed in order to prove the efficiency of the proposed approach.
Mathematically Reduced Chemical Reaction Mechanism Using Neural Networks
Energy Technology Data Exchange (ETDEWEB)
Ziaul Huque
2007-08-31
This is the final technical report for the project titled 'Mathematically Reduced Chemical Reaction Mechanism Using Neural Networks'. The aim of the project was to develop an efficient chemistry model for combustion simulations. The reduced chemistry model was developed mathematically without the need of having extensive knowledge of the chemistry involved. To aid in the development of the model, Neural Networks (NN) was used via a new network topology known as Non-linear Principal Components Analysis (NPCA). A commonly used Multilayer Perceptron Neural Network (MLP-NN) was modified to implement NPCA-NN. The training rate of NPCA-NN was improved with the GEneralized Regression Neural Network (GRNN) based on kernel smoothing techniques. Kernel smoothing provides a simple way of finding structure in data set without the imposition of a parametric model. The trajectory data of the reaction mechanism was generated based on the optimization techniques of genetic algorithm (GA). The NPCA-NN algorithm was then used for the reduction of Dimethyl Ether (DME) mechanism. DME is a recently discovered fuel made from natural gas, (and other feedstock such as coal, biomass, and urban wastes) which can be used in compression ignition engines as a substitute for diesel. An in-house two-dimensional Computational Fluid Dynamics (CFD) code was developed based on Meshfree technique and time marching solution algorithm. The project also provided valuable research experience to two graduate students.
Dynamic Baysesian state-space model with a neural network for an online river flow prediction
Ham, Jonghwa; Hong, Yoon-Seok
2013-04-01
The usefulness of artificial neural networks in complex hydrological modeling has been demonstrated by successful applications. Several different types of neural network have been used for the hydrological modeling task but the multi-layer perceptron (MLP) neural network (also known as the feed-forward neural network) has enjoyed a predominant position because of its simplicity and its ability to provide good approximations. In many hydrological applications of MLP neural networks, the gradient descent-based batch learning algorithm such as back-propagation, quasi-Newton, Levenburg-Marquardt, and conjugate gradient algorithms has been used to optimize the cost function (usually by minimizing the error function in the prediction) by updating the parameters and structure in a neural network defined using a set of input-output training examples. Hydrological systems are highly with time-varying inputs and outputs, and are characterized by data that arrive sequentially. The gradient descent-based batch learning approaches that are implemented in MLP neural networks have significant disadvantages for online dynamic hydrological modeling because they could not update the model structure and parameter when a new set of hydrological measurement data becomes available. In addition, a large amount of training data is always required off-line with a long model training time. In this work, a dynamic nonlinear Bayesian state-space model with a multi-layer perceptron (MLP) neural network via a sequential Monte Carlo (SMC) learning algorithm is proposed for an online dynamic hydrological modeling. This proposed new method of modeling is herein known as MLP-SMC. The sequential Monte Carlo learning algorithm in the MLP-SMC is designed to evolve and adapt the weight of a MLP neural network sequentially in time on the arrival of each new item of hydrological data. The weight of a MLP neural network is treated as the unknown dynamic state variable in the dynamic Bayesian state-space model formulation. The nonlinear Monte Carlo filtering algorithm is based on recursively constructing the posterior probability density (distribution) of the state variable of neural network's weight, with respect to measured data (in our case, river flow), through a random trajectory of the state by entities called 'particles' in the dynamic state-space model formulation. A weight, which is the probability of the trajectory of the state, is assigned to each particle by a Bayesian correction term based on measurement. The algorithms differ in the way that the swarm of particles evolves and adapts to incoming online measurement data. In order to demonstrate the efficiency and usefulness of the proposed MLP-SMC, a practical application of hydrological modeling is carried out to predict the river flow sequentially in advance on the arrival of each new item of river flow data at intervals of 10 minutes. The performance of the proposed MLP-SMC is compared with the performance of a multi-layer perceptron (MLP) model trained using the back-propagation learning algorithm (MLP-BP) in which a batch off-line learning algorithm is implemented. The results show that the proposed MLP-SMC shows superiority in terms of model accuracy and computational cost compared with MLP-BP. The sequential Monte Carlo learning algorithm implemented in MLP-SMC is shown to have less sensitivity to noisy and sparsely distributed data compared to the batch off-line learning algorithm used in MLP-BP.
Al-Abadi, Alaa M.
2014-12-01
The potential of using three different data-driven techniques namely, multilayer perceptron with backpropagation artificial neural network (MLP), M5 decision tree model, and Takagi-Sugeno (TS) inference system for mimic stage-discharge relationship at Gharraf River system, southern Iraq has been investigated and discussed in this study. The study used the available stage and discharge data for predicting discharge using different combinations of stage, antecedent stages, and antecedent discharge values. The models' results were compared using root mean squared error (RMSE) and coefficient of determination (R 2) error statistics. The results of the comparison in testing stage reveal that M5 and Takagi-Sugeno techniques have certain advantages for setting up stage-discharge than multilayer perceptron artificial neural network. Although the performance of TS inference system was very close to that for M5 model in terms of R 2, the M5 method has the lowest RMSE (8.10 m3/s). The study implies that both M5 and TS inference systems are promising tool for identifying stage-discharge relationship in the study area.
Perceptron beyond the limit of capacity
Del Giudice, P.; Franz, S.; Virasoro, M. A.
1989-01-01
An input-output map in which the patterns are divided into classes is considered for the perceptron. The statistical mechanical analysis with a finite number of classes turns out to give the same results as the case of only one class of patterns ; the limit of capacity and the relevant order parameters are calculated in a mean field approach. The analysis is then extended to the Derrida Gardner canonical ensemble in which the perceptron can be studied beyond the limit of capacity. We complete...
The margitron: a generalized perceptron with margin.
Panagiotakopoulos, Constantinos; Tsampouka, Petroula
2011-03-01
We identify the classical perceptron algorithm with margin as a member of a broader family of large margin classifiers, which we collectively call the margitron. The margitron, (despite its) sharing the same update rule with the perceptron, is shown in an incremental setting to converge in a finite number of updates to solutions possessing any desirable fraction of the maximum margin. We also report on experiments comparing the margitron with decomposition support vector machines, cutting-plane algorithms, and gradient descent methods on hard margin tasks involving linear kernels which are equivalent to 2-norm soft margin. Our results suggest that the margitron is very competitive. PMID:21216709
Parallel strategy for optimal learning in perceptrons
Energy Technology Data Exchange (ETDEWEB)
Neirotti, J P [NCRG, Aston University, Birmingham (United Kingdom)], E-mail: j.p.neirotti@aston.ac.uk
2010-03-26
We developed a parallel strategy for learning optimally specific realizable rules by perceptrons, in an online learning scenario. Our result is a generalization of the Caticha-Kinouchi (CK) algorithm developed for learning a perceptron with a synaptic vector drawn from a uniform distribution over the N-dimensional sphere, so called the typical case. Our method outperforms the CK algorithm in almost all possible situations, failing only in a denumerable set of cases. The algorithm is optimal in the sense that it saturates Bayesian bounds when it succeeds.
Parallel strategy for optimal learning in perceptrons
International Nuclear Information System (INIS)
We developed a parallel strategy for learning optimally specific realizable rules by perceptrons, in an online learning scenario. Our result is a generalization of the Caticha-Kinouchi (CK) algorithm developed for learning a perceptron with a synaptic vector drawn from a uniform distribution over the N-dimensional sphere, so called the typical case. Our method outperforms the CK algorithm in almost all possible situations, failing only in a denumerable set of cases. The algorithm is optimal in the sense that it saturates Bayesian bounds when it succeeds.
Directory of Open Access Journals (Sweden)
J. C. Ochoa-Rivera
2002-01-01
Full Text Available A model for multivariate streamflow generation is presented, based on a multilayer feedforward neural network. The structure of the model results from two components, the neural network (NN deterministic component and a random component which is assumed to be normally distributed. It is from this second component that the model achieves the ability to incorporate effectively the uncertainty associated with hydrological processes, making it valuable as a practical tool for synthetic generation of streamflow series. The NN topology and the corresponding analytical explicit formulation of the model are described in detail. The model is calibrated with a series of monthly inflows to two reservoir sites located in the Tagus River basin (Spain, while validation is performed through estimation of a set of statistics that is relevant for water resources systems planning and management. Among others, drought and storage statistics are computed and compared for both the synthetic and historical series. The performance of the NN-based model was compared to that of a standard autoregressive AR(2 model. Results show that NN represents a promising modelling alternative for simulation purposes, with interesting potential in the context of water resources systems management and optimisation. Keywords: neural networks, perceptron multilayer, error backpropagation, hydrological scenario generation, multivariate time-series..
A new source difference artificial neural network for enhanced positioning accuracy
International Nuclear Information System (INIS)
Integrated inertial navigation system (INS) and global positioning system (GPS) units provide reliable navigation solution compared to standalone INS or GPS. Traditional Kalman filter-based INS/GPS integration schemes have several inadequacies related to sensor error model and immunity to noise. Alternatively, multi-layer perceptron (MLP) neural networks with three layers have been implemented to improve the position accuracy of the integrated system. However, MLP neural networks show poor accuracy for low-cost INS because of the large inherent sensor errors. For the first time the paper demonstrates the use of knowledge-based source difference artificial neural network (SDANN) to improve navigation performance of low-cost sensor, with or without external aiding sources. Unlike the conventional MLP or artificial neural networks (ANN), the structure of SDANN consists of two MLP neural networks called the coarse model and the difference model. The coarse model learns the input–output data relationship whereas the difference model adds knowledge to the system and fine-tunes the coarse model output by learning the associated training or estimation error. Our proposed SDANN model illustrated a significant improvement in navigation accuracy of up to 81% over conventional MLP. The results demonstrate that the proposed SDANN method is effective for GPS/INS integration schemes using low-cost inertial sensors, with and without GPS
Evaluation of pan evaporation modeling with two different neural networks and weather station data
Kim, Sungwon; Singh, Vijay P.; Seo, Youngmin
2014-07-01
This study evaluates neural networks models for estimating daily pan evaporation for inland and coastal stations in Republic of Korea. A multilayer perceptron neural networks model (MLP-NNM) and a cascade correlation neural networks model (CCNNM) are developed for local implementation. Five-input models (MLP 5 and CCNNM 5) are generally found to be the best for local implementation. The optimal neural networks models, including MLP 4, MLP 5, CCNNM 4, and CCNNM 5, perform well for homogeneous (cross-stations 1 and 2) and nonhomogeneous (cross-stations 3 and 4) weather stations. Statistical results of CCNNM are better than those of MLP-NNM during the test period for homogeneous and nonhomogeneous weather stations except for MLP 4 being better in BUS-DAE and POH-DAE, and MLP 5 being better in POH-DAE. Applying the conventional models for the test period, it is found that neural networks models perform better than the conventional models for local, homogeneous, and nonhomogeneous weather stations.
Digital Hardware Implementation of a Neural System Used for Nonlinear Adaptive Prediction
Directory of Open Access Journals (Sweden)
HassÃ¨ne Faiedh
2006-01-01
Full Text Available Neural networks have been widely used for many applications in digital communications. They are able to give solutions to complex problems due to their nonlinear processing and their learning and generalization. Neural networks are one of the key technologies for the communication domain and accordingly a special effort may be expected to be paid to real time hardware implementation issues. In this study, it is proposed a digital hardware implementation of a neural system based on a multilayer perceptron (MLP. The neural system is used for the nonlinear adaptive prediction of nonstationary signals such as speech signals. The implemented architecture of the MLP is generated using a generic elementary neuron (EN. The polynomial approximation method is used to implement the sigmoidal activation function. The back-propagation algorithm is used to implant the prediction task. The circuit implementation architecture is detailed, for achieving real-time prediction for speech signals. The designed ASIC circuit includes a neural network block, an on-chip learning block and a memory used for storing the synaptic weights for updating.
Unfolding the neutron spectrum of a NE213 scintillator using artificial neural networks.
Sharghi Ido, A; Bonyadi, M R; Etaati, G R; Shahriari, M
2009-10-01
Artificial neural networks technology has been applied to unfold the neutron spectra from the pulse height distribution measured with NE213 liquid scintillator. Here, both the single and multi-layer perceptron neural network models have been implemented to unfold the neutron spectrum from an Am-Be neutron source. The activation function and the connectivity of the neurons have been investigated and the results have been analyzed in terms of the network's performance. The simulation results show that the neural network that utilizes the Satlins transfer function has the best performance. In addition, omitting the bias connection of the neurons improve the performance of the network. Also, the SCINFUL code is used for generating the response functions in the training phase of the process. Finally, the results of the neural network simulation have been compared with those of the FORIST unfolding code for both (241)Am-Be and (252)Cf neutron sources. The results of neural network are in good agreement with FORIST code. PMID:19586776
Chaotic diagonal recurrent neural network
International Nuclear Information System (INIS)
We propose a novel neural network based on a diagonal recurrent neural network and chaos, and its structure and learning algorithm are designed. The multilayer feedforward neural network, diagonal recurrent neural network, and chaotic diagonal recurrent neural network are used to approach the cubic symmetry map. The simulation results show that the approximation capability of the chaotic diagonal recurrent neural network is better than the other two neural networks. (interdisciplinary physics and related areas of science and technology)
A diluted version of the perceptron model
Marquez-carreras, David; Rovira, Carles; Tindel, Samy
2006-01-01
This note is concerned with a diluted version of the perceptron model. We establish a replica symmetric formula at high temperature, which is achieved by studying the asymptotic behavior of a given spin magnetization. Our main task will be to identify the order parameter of the system.
Hong, Yoon-Seok Timothy
2012-10-01
SummaryThis paper proposes a dynamic nonlinear state-space model with a neural network that uses a sequential learning algorithm capable of online simulation, in which the model predicts and adapts to the arrival of each new item of hydrological data in a sequential manner (as opposed to a 'batch'), thereby enabling online real-time hydrological modeling. The improved sequential extended Kalman filtering (EKF) learning algorithm is developed to train multi-layer perceptron (MLP) neural networks, and is known as the MLP-EKF method with updating of noise covariance (MLP-EKFQ). It is herein proposed to allow the evolution of the weight of a neural network sequentially in time while also computing the noise covariance matrices of the EKF algorithm automatically by maximizing the evidence density function with respect to the noise covariance matrices. The proposed MLP-EKFQ was used to develop an online real-time warning system to predict river temperatures affected by the discharge of cooling water 1 km downstream of a thermal power station, from real-time to 2 h ahead, sequentially on the arrival of each new item of hydrological, meteorological, and power station operational data at 10 min intervals. It is demonstrated that the proposed MLP-EKFQ is superior in terms of both model performance and computational efficiency to those models that adopt a batch learning algorithm such as a multi-layer perceptron (MLP) system trained using the back-prorogation learning algorithm (MLP-BP), or an adaptive neural-fuzzy inference system (ANFIS). Due to its computational efficiency, its online simulation capability, and the high levels of accuracy achieved by the proposed MLP-EKFQ method, there is a great deal of potential for its use as an online dynamic hydrological modeling tool that may be suitable for a variety of complex dynamic and/or real-time tasks.
Dynamic model of a PEM electrolyser based on artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Chavez-Ramirez, A.U.; Munoz-Guerrero, R.; Sanchez-Huerta, V.; Ramirez-Arredondo, Juan M.; Ornelas, R.; Arriaga, L.G.; Siracusano, S.; Brunaccini, G.; Napoli, G.; Antonucci, V.; Arico, A.S.
2011-01-15
Hydrogen production by electrolysis is emerging as a promising way to meet future fuel demand, and developing models capable of simulating the operation of electrolysis devices is indispensable to efficiently design power generation systems, reduce manufacturing costs and save resources. The nonlinear nature of the Artificial Neural Network (ANN) plays a key role in developing models predicting the performance of complex systems. The behaviour of a Polymer Electrolyte Membrane (PEM) Electrolyser of three cell stack was modelled successfully using a Multilayer Perceptron Network (MLP). This dynamic model was trained to learn the internal relationships of this electrolysis device and predict its behaviour without physical equations. Electric current supply and operation temperature were used as input vector able to predict each cell voltage behaviour. An accuracy (< 2%) was reached after comparing the single cell performance of the real electrolyser versus the ANN based model. This predictive model can be used as a virtual device into a more complex energy system.
Directory of Open Access Journals (Sweden)
Ali Abroudi
2013-04-01
Full Text Available This paper presents a hybrid approach with two phases for improving the performance of training artificial neural networks (ANNs by selection of the most important instances for training, and then reduction the dimensionality of features. The ANNs which are applied in this paper for validation, are included Multi-Layer Perceptron (MLP and Neuro-Fuzzy Network (NFN. In the first phase, the Modified Fast Condensed Nearest Neighbor (MFCNN algorithm is used to construct the subset with instances very close to the decision boundary. It leads to achieve the instances more useful for training the network. And in the second phase, an Ant-based approach to the supervised reduction of feature dimensionality is introduced, aims to reduce the complexity, and improve the accuracy of learning the ANN. The main purpose of this method is to enhance the classification performance by improving the quality of the training set. Experimental results illustrated the efficiency of the proposed approach.
Cintra, Rosangela S
2014-01-01
This paper presents an approach for employing artificial neural networks (NN) to emulate an ensemble Kalman filter (EnKF) as a method of data assimilation. The assimilation methods are tested in the Simplified Parameterizations PrimitivE-Equation Dynamics (SPEEDY) model, an atmospheric general circulation model (AGCM), using synthetic observational data simulating localization of balloon soundings. For the data assimilation scheme, the supervised NN, the multilayer perceptrons (MLP-NN), is applied. The MLP-NN are able to emulate the analysis from the local ensemble transform Kalman filter (LETKF). After the training process, the method using the MLP-NN is seen as a function of data assimilation. The NN were trained with data from first three months of 1982, 1983, and 1984. A hind-casting experiment for the 1985 data assimilation cycle using MLP-NN were performed with synthetic observations for January 1985. The numerical results demonstrate the effectiveness of the NN technique for atmospheric data assimilati...
Artificial Neural Network Based Method to Mitigate Temporary Over-voltages
Directory of Open Access Journals (Sweden)
Iman Sadeghkhani
2011-09-01
Full Text Available Uncontrolled energization of large power transformers may result in magnetizing inrush current of high amplitude and switching over-voltages. The most effective method for the limitation of the switching over-voltages is controlled switching since the magnitudes of the produced transients are strongly dependent on the closing instants of the switch.? We introduce a harmonic index that its minimum value is corresponding to the best-case switching time.? Also, this paper ?presents an Artificial Neural Network (ANN-based approach to ?estimate the optimum switching instants for real time applications. In the proposed ANN, second order Levenberg–Marquardt ? method is used to train the multilayer perceptron. ANN training is performed based on equivalent circuit parameters of the network. Thus, trained ANN is applicable to every studied system. To verify the effectiveness of the proposed index and accuracy of the ANN-based approach, two case studies are presented and demonstrated.
Static sign language recognition using 1D descriptors and neural networks
Solís, José F.; Toxqui, Carina; Padilla, Alfonso; Santiago, César
2012-10-01
A frame work for static sign language recognition using descriptors which represents 2D images in 1D data and artificial neural networks is presented in this work. The 1D descriptors were computed by two methods, first one consists in a correlation rotational operator.1 and second is based on contour analysis of hand shape. One of the main problems in sign language recognition is segmentation; most of papers report a special color in gloves or background for hand shape analysis. In order to avoid the use of gloves or special clothing, a thermal imaging camera was used to capture images. Static signs were picked up from 1 to 9 digits of American Sign Language, a multilayer perceptron reached 100% recognition with cross-validation.
Neural networks for emulation variational method for data assimilation in nonlinear dynamics
International Nuclear Information System (INIS)
Description of a physical phenomenon through differential equations has errors involved, since the mathematical model is always an approximation of reality. For an operational prediction system, one strategy to improve the prediction is to add some information from the real dynamics into mathematical model. This additional information consists of observations on the phenomenon. However, the observational data insertion should be done carefully, for avoiding a worse performance of the prediction. Technical data assimilation are tools to combine data from physical-mathematics model with observational data to obtain a better forecast. The goal of this work is to present the performance of the Neural Network Multilayer Perceptrons trained to emulate a Variational method in context of data assimilation. Techniques for data assimilation are applied for the Lorenz systems; which presents a strong nonlinearity and chaotic nature.
Neural networks for emulation variational method for data assimilation in nonlinear dynamics
Energy Technology Data Exchange (ETDEWEB)
Morais Furtado, Helaine Cristina; Fraga de Campos Velho, Haroldo; Macau, Elbert E N, E-mail: helaine.furtado@lac.inpe.br, E-mail: haroldo@lac.inpe.br, E-mail: elbert@lac.inpe.br [Laboratorio Associado de Computacao e Matematica Aplicada, Sao Jose dos Campos (Brazil)
2011-03-01
Description of a physical phenomenon through differential equations has errors involved, since the mathematical model is always an approximation of reality. For an operational prediction system, one strategy to improve the prediction is to add some information from the real dynamics into mathematical model. This additional information consists of observations on the phenomenon. However, the observational data insertion should be done carefully, for avoiding a worse performance of the prediction. Technical data assimilation are tools to combine data from physical-mathematics model with observational data to obtain a better forecast. The goal of this work is to present the performance of the Neural Network Multilayer Perceptrons trained to emulate a Variational method in context of data assimilation. Techniques for data assimilation are applied for the Lorenz systems; which presents a strong nonlinearity and chaotic nature.
Modeling mechanical properties of cast aluminum alloy using artificial neural network
International Nuclear Information System (INIS)
Modeling is widely used to investigate the mechanical properties of engineering materials due to increasing demand of low cost and high strength to weight ratio for many engineering applications. The aluminum casting alloys are cost competitive material and possess the desired properties. The mechanical properties largely depend upon composition of alloys and their processing method. Alloy design involves controlling mechanical properties via optimization of the composition and processing parameters. For optimization the possible root is empirical modeling and its more refined version is the analysis of the wide range of data using ANN (Artificial Neural Networks) modeling. The modeling of mechanical properties of the aluminum alloys are the main objective of present work. For this purpose, some data were collected and experimentally prepared using conventional casting method. A MLP (Multilayer Perceptron) network was developed, which is trained by using the error back propagation algorithm. (author)
A Review of Artificial Neural Networks: How Well Do They Perform in Forecasting Time Series?
Directory of Open Access Journals (Sweden)
Elsy Gómez-Ramos
2013-12-01
Full Text Available At the beginning of the 90’s, Artificial Neural Networks (ANNs started their applications in finance. The ANNs are data-drive, self-adaptive and non-linear methods that do not require specific assumptions about the underlying model. In general, there are five groups of networks used as forecasting tools: 1 Feedforward Networks, like the Multilayer Perceptron (MLP, 2 Recurrent Networks, 3 Polynomial Networks, 4 Modular Networks, and 5 Support Vector Machine. This paper carries out a review of the specialized literature on ANNs and makes a comparative analysis according to their performance in forecasting stock indices and exchange rates. The objective is to assess the performance when applying different types of networks in relation to MLP. It is shown that the MLP is the best network in forecasting time series. However, it is shown that the MLP has important delimitations in several respects: network architecture, basic functions and initialization weights.
International Nuclear Information System (INIS)
This paper presents an automated approach to apply a self-organizing map (SOM) artificial neural network (ANN) as a tool for feature extraction and dimensionality reduction to recognize and characterize radiologic patterns of interstitial lung diseases in chest radiography. After feature extraction and dimensionality reduction a multilayer perceptron (MLP) ANN is applied for radiologic patterns classification in normal, linear, nodular or mixed. A leave-one-out methodology was applied for training and test over a database containing 17 samples of linear pattern, 9 samples of nodular pattern, 9 samples of mixed pattern and 18 samples of normal pattern. The MLP network provided an average result of 88.7% of right classification, with 100% of right classification for linear pattern, 55.5% for nodular pattern, 77.7% for mixed pattern and 100% for normal pattern. (orig.)
Concept and design of the fast H1 second level trigger using artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Kolanoski, H. [Humboldt-Universitaet, Berlin (Germany). Inst. fuer Physik; Getta, H.; Goldner, D. [Dortmund Univ. (Germany). Inst. fuer Physik] [and others
1996-07-01
The experiments at the HERA ep collider have to cope with machine background rates which exceed the rates of the majority ofinteresting physics interactions by several orders of magnitude. To deal with this the H1 experiment was designed with a four staged trigger system. The second trigger level is currently being equipped with a highly parallel computing system that is specialized to run Artificial Neural Network (ANN) algorithms. The trigger is based on CNAPS neurocomputer boards, which are able to compute multilayer perceptron networks with 64 inputs, 64 hidden nodes and one output node in less than 8 {mu}s. In this contribution we present the concept and design of this system. (author)
Analysis and Prediction of Temperature using Statistical Artificial Neural Network
Parag Kadu; Kishor Wagh; Prashant Chatur
2012-01-01
This paper is about producing a prediction system by usingartificial neural methods that will forecast temperature. Thispaper is based on three objectives. First, study of temperature andgathers all knowledge regarding the weather this is particularlystudied in analysis part of the paper. Second, gather allknowledge about artificial neural network methods. Implementmultilayer perceptron neural network with gradient descent(backpropagation), BFGS, conjugate gradient training algorithm andwill ...
Neural Network Based Lna Design for Mobile Satellite Receiver
Directory of Open Access Journals (Sweden)
Abhijeet Upadhya
2014-08-01
Full Text Available Paper presents a Neural Network Modelling approach to microwave LNA design. To acknowledge the specifications of the amplifier, Mobile Satellite Systems are analyzed. Scattering parameters of the LNA in the frequency range 0.5 to 18 GHz are calculated using a Multilayer Perceptron Artificial Neural Network model and corresponding smith charts and polar charts are plotted as output to the model. From these plots, the microwave scattering parameter description of the LNA are obtained. Model is efficiently trained using Agilent ATF 331M4 InGaAs/InP Low Noise pHEMT amplifier datasheet and the neural model’s output seem to follow the various device characteristic curves with high regression. Next, Maximum Allowable Gain and Noise figure of the device are modelled and plotted for the same frequency range. Finally, the optimized model is utilized as an interpolator and the resolution of the amplifying capability with noise characteristics are obtained for the L Band of MSS operation.
Scientific Electronic Library Online (English)
Mayra Luiza Marques da Silva, Binoti; Helio Garcia, Leite; Daniel Henrique Breda, Binoti; José Marinaldo, Gleriani.
2015-03-01
Full Text Available Objetivou-se, neste estudo, treinar, aplicar e avaliar a eficiência de redes neurais artificiais (RNA) para realizar a prognose da produção de povoamentos equiâneos de clones de eucalipto. Os dados utilizados foram provenientes de povoamentos localizados no sul da Bahia, totalizando cerca de 2.000 h [...] ectares de floresta. Foram utilizadas variáveis numéricas, como: idade, área basal, volume e variáveis categóricas, como classe de solo, textura, tipos de espaçamento, relevo, projeto e clone. Os dados foram divididos aleatoriamente em dois grupos: treinamento (80%) e generalização (20%). Foram treinadas redes de três tipos: perceptron, perceptron de múltiplas camadas e redes de função de base radial. As RNA que apresentaram os melhores desempenhos no treinamento e generalização foram selecionadas para realizar a prognose com dados, a partir do primeiro inventário florestal. Conclui-se que as RNA apresentaram resultados satisfatórios, comprovando o potencial e aplicabilidade da técnica na solução dos problemas de mensuração e manejo florestal. Abstract in english The objective of this study was to train, implement and evaluate the efficiency of artificial neural networks (ANN) to perform production prognosis of even-aged stands of eucalyptus clones. The data used were from plantations located in southern Bahia, totaling about 2,000 acres of forest. Numeric v [...] ariables, such as age, basal area, volume and categorical variables, such as soil class texture, spacing, land relief, project and clone were used. The data were randomly divided into two groups: training (80%) and generalization (20%). Three types of networks were trained: perceptron, multilayer perceptron networks and radial basis function. The RNA that showed the best performance in training and generalization were selected to perform the prognosis with data from the first forest inventory. We conclude that the RNA had satisfactory results, showing the potential and applicability of the technique in solving measurement and forest management problems.
Prediction of the local power factor in BWR fuel cells by means of a multilayer neural network
International Nuclear Information System (INIS)
To the beginning of a new operation cycle in a BWR reactor the reactivity of this it increases by means of the introduction of fresh fuel, the one denominated reload fuel. The problem of the definition of the characteristics of this reload fuel represents a combinatory optimization problem that requires significantly a great quantity of CPU time for their determination. This situation has motivated to study the possibility to substitute the Helios code, the one which is used to generate the new cells of the reload fuel parameters, by an artificial neuronal network, with the purpose of predicting the parameters of the fuel reload cell of a BWR reactor. In this work the results of the one training of a multilayer neuronal net that can predict the local power factor (LPPF) in such fuel cells are presented. The prediction of the LPPF is carried out in those condition of beginning of the life of the cell (0.0 MWD/T, to 40% of holes in the one moderator, temperature of 793 K in the fuel and a moderator temperature of 560 K. The cells considered in the present study consist of an arrangement of 10x10 bars, of those which 92 contains U235, some of these bars also contain a concentration of Gd2O3 and 8 of them contain only water. The axial location inside the one assembles of recharge of these cells it is exactly up of the cells that contain natural uranium in the base of the reactor core. The training of the neuronal net is carried out by meanof the neuronal net is carried out by means of a retro-propagation algorithm that uses a space of training formed starting from previous evaluations of cells by means of the Helios code. They are also presented the results of the application of the neuronal net found for the prediction of the LPPF of some cells used in the real operation of the Unit One of the Laguna Verde Nuclear Power station. (Author)
Draaisma, Henricus Johannes George
Multilayers were prepared by vacuum deposition and characterized. A Pd/Co multilayer was examined using X-ray diffraction, computer simulations, spectroscopy and transmission electron microscopy. Magnetic measurements are presented. It is shown that the magnetic properties of multilayer thin films, especially magnetic anisotropy, can be understood and modified by the influence of the interfaces between the different materials.
Kusumoputro, Benyamin; Pangabean, Martha Y.; Rachman, Leila F.
2001-09-01
In this paper, a 3-D face recognition system is developed using a modified neural network. This modified neural network is constructed by substituting each of neuron in its hidden layer of conventional multilayer perceptron with a circular-structure of neurons. This neural system is then called as cylindrical-structure of hidden layer neural network (CHL-NN). The neural system is then applied on a real 3-D face image database that consists of 5 Indonesian persons. The images are taken under four different expressions such as neutral, smile, laugh and free expression. The 2-D images is taken from the human face images by gradually changing visual points, which is done by successively varies the camera position from - 90 to +90 with an interval of 15 degree. The experimental result has shown that the average recognition rate of 60% could be achieved when we used the image in its spatial domain. Improvement of the system is then developed, by transforming the image in its spatial domain into its eigenspace domain. Karhunen Loeve transformation technique is used, and each image in the spatial domain is represented as a point in the eigenspace domain. Fisherface method is then utilized as a feature extraction on the eigenspace domain, and using the same database and experimental procedure, the recognition rate of the system could be increased into 84% in average.
Energy Technology Data Exchange (ETDEWEB)
Lobato, Justo; Canizares, Pablo; Rodrigo, Manuel A.; Linares, Jose J. [Chemical Engineering Department, University of Castilla-La Mancha, Campus Universitario s/n, 13004 Ciudad Real (Spain); Piuleac, Ciprian-George; Curteanu, Silvia [Faculty of Chemical Engineering and Environmental Protection, Department of Chemical Engineering, ' ' Gh. Asachi' ' Technical University Iasi Bd. D. Mangeron, No. 71A, 700050 IASI (Romania)
2010-08-15
This article shows the application of a very useful mathematical tool, artificial neural networks, to predict the fuel cells results (the value of the tortuosity and the cell voltage, at a given current density, and therefore, the power) on the basis of several properties that define a Gas Diffusion Layer: Teflon content, air permeability, porosity, mean pore size, hydrophobia level. Four neural networks types (multilayer perceptron, generalized feedforward network, modular neural network, and Jordan-Elman neural network) have been applied, with a good fitting between the predicted and the experimental values in the polarization curves. A simple feedforward neural network with one hidden layer proved to be an accurate model with good generalization capability (error about 1% in the validation phase). A procedure based on inverse neural network modelling was able to determine, with small errors, the initial conditions leading to imposed values for characteristics of the fuel cell. In addition, the use of this tool has been proved to be very attractive in order to predict the cell performance, and more interestingly, the influence of the properties of the gas diffusion layer on the cell performance, allowing possible enhancements of this material by changing some of its properties. (author)
On-line learning through simple perceptron with a margin
Hara, Kazuyuki; Okada, Masato
2003-01-01
We analyze a learning method that uses a margin $\\kappa$ {\\it a la} Gardner for simple perceptron learning. This method corresponds to the perceptron learning when $\\kappa=0$, and to the Hebbian learning when $\\kappa \\to \\infty$. Nevertheless, we found that the generalization ability of the method was superior to that of the perceptron and the Hebbian methods at an early stage of learning. We analyzed the asymptotic property of the learning curve of this method through compu...
Multifractal analysis of perceptron learning with errors
Weigt, M.
1997-01-01
Random input patterns induce a partition of the coupling space of a perceptron into cells labeled by their output sequences. Learning some data with a maximal error rate leads to clusters of neighboring cells. By analyzing the internal structure of these clusters with the formalism of multifractals, we can handle different storage and generalization tasks for lazy students and absent-minded teachers within one unified approach. The results also allow some conclusions on the ...
Landscape statistics of the binary perceptron
Fontanari, J. F.; Ko?berle, R.
1990-01-01
The landscape of the binary perceptron is studied by Simulated Annealing, exhaustive search and performing random walks on the landscape. We find that the number of local minima increases exponentially with the number of bonds, becoming deeper in the vicinity of a global minimum, but more and more shallow as we move away from it. The random walker detects a simple dependence on the size of the mapping, the architecture introducing a nontrivial dependence on the number of steps.
Storage of correlated patterns in a perceptron
Lopez, B.; Schroeder, M.; Opper, M.
1995-01-01
We calculate the storage capacity of a perceptron for correlated gaussian patterns. We find that the storage capacity $\\alpha_c$ can be less than 2 if similar patterns are mapped onto different outputs and vice versa. As long as the patterns are in general position we obtain, in contrast to previous works, that $\\alpha_c \\geq 1$ in agreement with Cover's theorem. Numerical simulations confirm the results.
Finite size scaling of the bayesian perceptron
Buhot, A.; Moreno, J. -m Torres; Gordon, M. B.
1997-01-01
We study numerically the properties of the bayesian perceptron through a gradient descent on the optimal cost function. The theoretical distribution of stabilities is deduced. It predicts that the optimal generalizer lies close to the boundary of the space of (error-free) solutions. The numerical simulations are in good agreement with the theoretical distribution. The extrapolation of the generalization error to infinite input space size agrees with the theoretical results. ...
Use of Neural Networks for Damage Assessment in a Steel Mast
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1995-01-01
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorithm for detecting location and size of a damage in a civil engineering structure is investigated. The structure considered is a 20 m high steel lattice mast subjected to wind excitation. The basic idea is to train a neural network with simulated patterns of the relative changes in natural frequencies and corresponding sizes and locations of damages in order to recognize the behaviour of the damaged as well as the undamaged structure. Subjecting this trained neural network to measured values should imply information about damages states and locations. The training data are obtained by an FEM of the mast. Different damage scenarios are established by simulating a damage in one of the eight lower diagonals. The eight lower diagonals are cut and provided with bolted joints. Each bolted joint consists of 4 slice plates giving the possibilities of simulating a 1/4, 1/2, 3/4 and full reduction of the area of a diagonal. A damage is simulated by removing one or more splice plates in these bolted joints. The utility of the neural network approach is demonstrated by a simulation study as well as full-scale tests where the mast is identified by an ARMA-model. The results show that a neural network trained with simulated data is capable for detecting location of a damage in a steel lattice mast when the network is subjected to experimental data.·
Application of Artificial Neural Networks for Efficient High-Resolution 2D DOA Estimation
Directory of Open Access Journals (Sweden)
M. Agatonovi?
2012-12-01
Full Text Available A novel method to provide high-resolution Two-Dimensional Direction of Arrival (2D DOA estimation employing Artificial Neural Networks (ANNs is presented in this paper. The observed space is divided into azimuth and elevation sectors. Multilayer Perceptron (MLP neural networks are employed to detect the presence of a source in a sector while Radial Basis Function (RBF neural networks are utilized for DOA estimation. It is shown that a number of appropriately trained neural networks can be successfully used for the high-resolution DOA estimation of narrowband sources in both azimuth and elevation. The training time of each smaller network is significantly re¬duced as different training sets are used for networks in detection and estimation stage. By avoiding the spectral search, the proposed method is suitable for real-time ap¬plications as it provides DOA estimates in a matter of seconds. At the same time, it demonstrates the accuracy comparable to that of the super-resolution 2D MUSIC algorithm.
Integrated on-line plant monitoring system for HTTR with neural networks
International Nuclear Information System (INIS)
The neural networks have been utilized in on-line monitoring-system of High Temperature Engineering Tested Reactor (HTTR) with thermal power of 30 MW. In this system, several neural networks can independently model the plant dynamics with different architecture, input and output signals and learning algorithm. Monitoring task of each neural network is also different, respectively. Those parallel method applications require distributed architecture of computer network for performing real-time tasks. One of main task is real-time plant monitoring by Multi-Layer Perceptron (MLP) in auto-associative mode, which can model and estimate the whole plant dynamics by training normal operational data only. The basic principle of the anomaly detection is to monitor the difference between process signals measured from the actual plant and the corresponding values estimated by MLP. Other tasks are on-line reactivity prediction, reactivity and helium leak monitoring, respectively. From the on-line monitoring results at the safety demonstration tests, each neural network shows good prediction and reliable detection performances. (author)
Integrated on-line plant monitoring system for HTTR using neural networks
International Nuclear Information System (INIS)
The neural networks have been utilized in on-line monitoring-system of High Temperature Engineering Tested Reactor (HTTR) with thermal power of 30 MW. In this system, several neural networks can independently model the plant dynamics with different architecture, input and output signals and learning algorithm. Monitoring task of each neural network is also different, respectively. Those parallel method applications require distributed architecture of computer network for performing real-time tasks. One of main task is real-time monitoring by Multi-Layer Perceptron (MLP) in auto-associative mode, which can model and estimate the whole plant dynamics by training normal operational data only. The basic principle of the anomaly detection is to monitor the difference between process signals measured from the actual plant and the corresponding values estimated by MLP. Other tasks are on-line reactivity prediction, reactivity and helium leak monitoring, respectively. From the on-line test results, each neural network shows good prediction and reliable detection performances. (author)
Foreground removal from WMAP 5 yr temperature maps using an MLP neural network
DEFF Research Database (Denmark)
NØrgaard-Nielsen, Hans Ulrik
2010-01-01
Aims. One of the main obstacles for extracting the cosmic microwave background (CMB) signal from observations in the mm/sub-mm range is the foreground contamination by emission from Galactic component: mainly synchrotron, free-free, and thermal dust emission. The statistical nature of the intrinsic CMB signal makes it essential to minimize the systematic errors in the CMB temperature determinations. Methods. The feasibility of using simple neural networks to extract the CMB signal from detailed simulated data has already been demonstrated. Here, simple neural networks are applied to the WMAP 5 yr temperature data without using any auxiliary data. Results. A simple multilayer perceptron neural network with two hidden layers provides temperature estimates over more than 75 per cent of the sky with random errors significantly below those previously extracted from these data. Also, the systematic errors, i.e. errors correlated with the Galactic foregrounds, are very small. Conclusions. With these results the neural network method is well prepared for dealing with the high-quality CMB data from the ESA Planck Surveyor satellite. © ESO, 2010.
Neural networks type MLP in the process of identification chosen varieties of maize
Boniecki, P.; Nowakowski, K.; Tomczak, R.
2011-06-01
During the adaptation process of the weights vector that occurs in the iterative presentation of the teaching vector, the the MLP type artificial neural network (MultiLayer Perceptron) attempts to learn the structure of the data. Such a network can learn to recognise aggregates of input data occurring in the input data set regardless of the assumed criteria of similarity and the quantity of the data explored. The MLP type neural network can be also used to detect regularities occurring in the obtained graphic empirical data. The neuronal image analysis is then a new field of digital processing of signals. It is possible to use it to identify chosen objects given in the form of bitmap. If at the network input, a new unknown case appears which the network is unable to recognise, it means that it is different from all the classes known previously. The MLP type artificial neural network taught in this way can serve as a detector signalling the appearance of a widely understood novelty. Such a network can also look for similarities between the known data and the noisy data. In this way, it is able to identify fragments of images presented in photographs of e.g. maze's grain. The purpose of the research was to use the MLP neural networks in the process of identification of chosen varieties of maize with the use of image analysis method. The neuronal classification shapes of grains was performed with the use of the Johan Gielis super formula.
Pattern Capacity of a Perceptron for Sparse Discrimination
Itskov, Vladimir; Abbott, L. F.
2008-07-01
We evaluate the capacity and performance of a perceptron discriminator operating in a highly sparse regime where classic perceptron results do not apply. The perceptron is constructed to respond to a specified set of q stimuli, with only statistical information provided about other stimuli to which it is not supposed to respond. We compute the probability of both false-positive and false-negative errors and determine the capacity of the system for not responding to nonselected stimuli and for responding to selected stimuli in the presence of noise. If q is a sublinear function of N, the number of inputs to the perceptron, these capacities are exponential in N/q.
Perceptrons with Hebbian Learning Based on Wave Ensembles in Spatially Patterned Potentials
Espinosa-Ortega, T.; Liew, T. C. H.
2015-03-01
A general scheme to realize a perceptron for hardware neural networks is presented, where multiple interconnections are achieved by a superposition of Schrödinger waves. Spatially patterned potentials process information by coupling different points of reciprocal space. The necessary potential shape is obtained from the Hebbian learning rule, either through exact calculation or construction from a superposition of known optical inputs. This allows implementation in a wide range of compact optical systems, including (1) any nonlinear optical system, (2) optical systems patterned by optical lithography, and (3) exciton-polariton systems with phonon or nuclear spin interactions.
Neural network implementation using bit streams.
Patel, Nitish D; Nguang, Sing Kiong; Coghill, George G
2007-09-01
A new method for the parallel hardware implementation of artificial neural networks (ANNs) using digital techniques is presented. Signals are represented using uniformly weighted single-bit streams. Techniques for generating bit streams from analog or multibit inputs are also presented. This single-bit representation offers significant advantages over multibit representations since they mitigate the fan-in and fan-out issues which are typical to distributed systems. To process these bit streams using ANNs concepts, functional elements which perform summing, scaling, and squashing have been implemented. These elements are modular and have been designed such that they can be easily interconnected. Two new architectures which act as monotonically increasing differentiable nonlinear squashing functions have also been presented. Using these functional elements, a multilayer perceptron (MLP) can be easily constructed. Two examples successfully demonstrate the use of bit streams in the implementation of ANNs. Since every functional element is individually instantiated, the implementation is genuinely parallel. The results clearly show that this bit-stream technique is viable for the hardware implementation of a variety of distributed systems and for ANNs in particular. PMID:18220196
Optimal Capacity of the Blume-Emery-Griffiths perceptron
Bolle, D.; Castillo, I. Perez; Shim, G. M.
2002-01-01
A Blume-Emery-Griffiths perceptron model is introduced and its optimal capacity is calculated within the replica-symmetric Gardner approach, as a function of the pattern activity and the imbedding stability parameter. The stability of the replica-symmetric approximation is studied via the analogue of the Almeida-Thouless line. A comparison is made with other three-state perceptrons.
Neural network based daily precipitation generator (NNGEN-P)
Energy Technology Data Exchange (ETDEWEB)
Boulanger, Jean-Philippe [LODYC, UMR CNRS/IRD/UPMC, Paris (France); University of Buenos Aires, Departamento de Ciencias de la Atmosfera y los Oceanos, Facultad de Ciencias Exactas y Naturales, Buenos Aires (Argentina); Martinez, Fernando; Segura, Enrique C. [University of Buenos Aires, Departamento de Computacion, Facultad de Ciencias Exactas y Naturales, Buenos Aires (Argentina); Penalba, Olga [University of Buenos Aires, Departamento de Ciencias de la Atmosfera y los Oceanos, Facultad de Ciencias Exactas y Naturales, Buenos Aires (Argentina)
2007-02-15
Daily weather generators are used in many applications and risk analyses. The present paper explores the potential of neural network architectures to design daily weather generator models. Focusing this first paper on precipitation, we design a collection of neural networks (multi-layer perceptrons in the present case), which are trained so as to approximate the empirical cumulative distribution (CDF) function for the occurrence of wet and dry spells and for the precipitation amounts. This approach contributes to correct some of the biases of the usual two-step weather generator models. As compared to a rainfall occurrence Markov model, NNGEN-P represents fairly well the mean and standard deviation of the number of wet days per month, and it significantly improves the simulation of the longest dry and wet periods. Then, we compared NNGEN-P to three parametric distribution functions usually applied to fit rainfall cumulative distribution functions (Gamma, Weibull and double-exponential). A data set of 19 Argentine stations was used. Also, data corresponding to stations in the United States, in Europe and in the Tropics were included to confirm the results. One of the advantages of NNGEN-P is that it is non-parametric. Unlike other parametric function, which adapt to certain types of climate regimes, NNGEN-P is fully adaptive to the observed cumulative distribution functions, which, on some occasions, may present complex shapes. On-going works will soon produce an extended version of NNGEN to temperature and radiation. (orig.)
Jordan recurrent neural network versus IHACRES in modelling daily streamflows
Carcano, Elena Carla; Bartolini, Paolo; Muselli, Marco; Piroddi, Luigi
2008-12-01
SummaryA study of possible scenarios for modelling streamflow data from daily time series, using artificial neural networks (ANNs), is presented. Particular emphasis is devoted to the reconstruction of drought periods where water resource management and control are most critical. This paper considers two connectionist models: a feedforward multilayer perceptron (MLP) and a Jordan recurrent neural network (JNN), comparing network performance on real world data from two small catchments (192 and 69 km 2 in size) with irregular and torrential regimes. Several network configurations are tested to ensure a good combination of input features (rainfall and previous streamflow data) that capture the variability of the physical processes at work. Tapped delayed line (TDL) and memory effect techniques are introduced to recognize and reproduce temporal dependence. Results show a poor agreement when using TDL only, but a remarkable improvement can be obtained with JNN and its memory effect procedures, which are able to reproduce the system memory over a catchment in a more effective way. Furthermore, the IHACRES conceptual model, which relies on both rainfall and temperature input data, is introduced for comparative study. The results suggest that when good input data is unavailable, metric models perform better than conceptual ones and, in general, it is difficult to justify substantial conceptualization of complex processes.
Firefly Algorithm with Artificial Neural Network for Time Series Problems
Directory of Open Access Journals (Sweden)
Mohammed Alweshah
2014-05-01
Full Text Available Time series classification is a supervised learning method maps the input to the output using historical data. The primary objective is to discover interesting patterns hidden in the data. For the purpose of solving time series classification problems used the multi-layered perceptrons Artificial Neural Networks (ANN. The weights in the ANN are modified to provide the output values of the net, which are much closer to the values of the preferred output. For this reason, several algorithms had been proposed to train the parameters of the neural network for time series classification problems. This study attempts to hybrid the Firefly Algorithm (FA with the ANN in order to minimize the error rate of classification (coded as FA-ANN. The FA is employed to optimize the weights of the ANN model based on the processes. The proposed FA-ANN algorithm was tested on 6 benchmark UCR time series data sets. The experimental results have revealed that the proposed FA-ANN can effectively solve time series classification problems.
Recursive least-squares learning algorithms for neural networks
Energy Technology Data Exchange (ETDEWEB)
Lewis, P.S. (Los Alamos National Lab., NM (USA)); Hwang, Jenq-Neng (Washington Univ., Seattle, WA (USA). Dept. of Electrical Engineering)
1990-01-01
This paper presents the development of a pair of recursive least squares (RLS) algorithms for online training of multilayer perceptrons, which are a class of feedforward artificial neural networks. These algorithms incorporate second order information about the training error surface in order to achieve faster learning rates than are possible using first order gradient descent algorithms such as the generalized delta rule. A least squares formulation is derived from a linearization of the training error function. Individual training pattern errors are linearized about the network parameters that were in effect when the pattern was presented. This permits the recursive solution of the least squares approximation, either via conventional RLS recursions or by recursive QR decomposition-based techniques. The computational complexity of the update is in the order of (N{sup 2}), where N is the number of network parameters. This is due to the estimation of the N {times} N inverse Hessian matrix. Less computationally intensive approximations of the RLS algorithms can be easily derived by using only block diagonal elements of this matrix, thereby partitioning the learning into independent sets. A simulation example is presented in which a neural network is trained to approximate a two dimensional Gaussian bump. In this example, RLS training required an order of magnitude fewer iterations on average (527) than did training with the generalized delta rule (6331). 14 refs., 3 figs.
Machine and component residual life estimation through the application of neural networks
International Nuclear Information System (INIS)
This paper concerns the use of neural networks for predicting the residual life of machines and components. In addition, the advantage of using condition-monitoring data to enhance the predictive capability of these neural networks was also investigated. A number of neural network variations were trained and tested with the data of two different reliability-related datasets. The first dataset represents the renewal case where the failed unit is repaired and restored to a good-as-new condition. Data were collected in the laboratory by subjecting a series of similar test pieces to fatigue loading with a hydraulic actuator. The average prediction error of the various neural networks being compared varied from 431 to 841 s on this dataset, where test pieces had a characteristic life of 8971 s. The second dataset were collected from a group of pumps used to circulate a water and magnetite solution within a plant. The data therefore originated from a repaired system affected by reliability degradation. When optimized, the multi-layer perceptron neural networks trained with the Levenberg-Marquardt algorithm and the general regression neural network produced a sum-of-squares error within 11.1% of each other for the renewal dataset. The small number of inputs and poorly mapped input space on the second dataset meant that much larger errors were recorded on some of the test data. The potential for using neural networks for residual life prediction and the advantage of incorpora prediction and the advantage of incorporating condition-based data into the model was nevertheless proven for both examples
Finite size scaling of the Bayesian perceptron
Buhot, Arnaud; Torres Moreno, Juan-Manuel; Gordon, Mirta B.
1997-06-01
We study numerically the properties of the Bayesian perceptron through a gradient descent on the optimal cost function. The theoretical distribution of stabilities is deduced. It predicts that the optimal generalizer lies close to the boundary of the space of (error-free) solutions. The numerical simulations are in good agreement with the theoretical distribution. The extrapolation of the generalization error to infinite input space size agrees with the theoretical results. Finite size corrections are negative and exhibit two different scaling regimes, depending on the training set size. The variance of the generalization error vanishes for N-->? confirming the property of self-averaging.
Finite size scaling of the bayesian perceptron
Buhot, A; Gordon, M B
1997-01-01
We study numerically the properties of the bayesian perceptron through a gradient descent on the optimal cost function. The theoretical distribution of stabilities is deduced. It predicts that the optimal generalizer lies close to the boundary of the space of (error-free) solutions. The numerical simulations are in good agreement with the theoretical distribution. The extrapolation of the generalization error to infinite input space size agrees with the theoretical results. Finite size corrections are negative and exhibit two different scaling regimes, depending on the training set size. The variance of the generalization error vanishes for $N \\rightarrow \\infty$ confirming the property of self-averaging.
Stochastic resonance in an intracellular genetic perceptron
Bates, Russell; Blyuss, Oleg; Zaikin, Alexey
2014-03-01
Intracellular genetic networks are more intelligent than was first assumed due to their ability to learn. One of the manifestations of this intelligence is the ability to learn associations of two stimuli within gene-regulating circuitry: Hebbian-type learning within the cellular life. However, gene expression is an intrinsically noisy process; hence, we investigate the effect of intrinsic and extrinsic noise on this kind of intracellular intelligence. We report a stochastic resonance in an intracellular associative genetic perceptron, a noise-induced phenomenon, which manifests itself in noise-induced increase of response in efficiency after the learning event under the conditions of optimal stochasticity.
Offline analysis of HEP events by ''dynamic perceptron'' neural network
International Nuclear Information System (INIS)
In this paper we start from a critical analysis of the fundamental problems of the parallel calculus in linear structures and of their extension to the partial solutions obtained with non-linear architectures. Then, we present shortly a new dynamic architecture able to solve the limitations of the previous architectures through an automatic re-definition of the topology. This architecture is applied to real-time recognition of particle tracks in high-energy accelerators. (orig.)
Directory of Open Access Journals (Sweden)
Bednyakov Dmitriy Andreevich
2012-11-01
Full Text Available The article is devoted to the simulation of the influence of environmental osmotic pressure on the changes of the level of ?-amylase activity of mucous tunic of the intestine of Russian sturgeon (Acipenser güldenstädtii Brandt. For the solving of this problem the apparatus of neural networks is used. The designed model can be classified as multilayer perceptrone and has rather transparent structure. The conformities of this influence are examined and the model with high approximating and generalizing properties is created. The conclusion about high availability of application of the approach in the studies of adaptations of the digestive system of aquatic organisms to the influence of environmental factors with some qualifications about used rate of exactness of the simulation is made.
Torrecilla, José S; García, Julián; Rojo, Ester; Rodríguez, Francisco
2009-05-15
Multiple linear regression (MLR), radial basis network (RB), and multilayer perceptron (MLP) neural network (NN) models have been explored for the estimation of toxicity of ammonium, imidazolium, morpholinium, phosphonium, piperidinium, pyridinium, pyrrolidinium and quinolinium ionic liquid salts in the Leukemia Rat Cell Line (IPC-81) and Acetylcholinesterase (AChE) using only their empirical formulas (elemental composition) and molecular weights. The toxicity values were estimated by means of decadic logarithms of the half maximal effective concentration (EC(50)) in microM (log(10)EC(50)). The model's performances were analyzed by statistical parameters, analysis of residuals and central tendency and statistical dispersion tests. The MLP model estimates the log(10)EC(50) in IPC-81 and AchE with a mean prediction error less than 2.2 and 3.8%, respectively. PMID:18805639
Borkowski, Wojciech; Kostrzy?ska, Lidia
The development of an efficient image-based computer identification system for plants or other organisms is an important ambitious goal, which is still far from realization. This paper presents three new methods potentially usable for such a system: fractal-based measures of complexity of leaf outline, a heuristic algorithm for automatic detection of leaf parts — the blade and the petiole, and a hierarchical perceptron — a kind of neural network classifier. The next few sets of automatically extractable features of leaf blades, encompassed those presented and/or traditionally used, are compared in the task of plant identification using the simplest known "nearest neighbor" identification algorithm, and more realistic neural network classifiers, especially the hierarchical. We show on two real data sets that the presented techniques are really usable for automatic identification, and are worthy of further investigation.
Protein Secondary Structure Prediction Using Local Adaptive Techniques in Training Neural Networks
Aik, Lim Eng; Zainuddin, Zarita; Joseph, Annie
2008-01-01
One of the most significant problems in computer molecular biology today is how to predict a protein's three-dimensional structure from its one-dimensional amino acid sequence or generally call the protein folding problem and difficult to determine the corresponding protein functions. Thus, this paper involves protein secondary structure prediction using neural network in order to solve the protein folding problem. The neural network used for protein secondary structure prediction is multilayer perceptron (MLP) of the feed-forward variety. The training set are taken from the protein data bank which are 120 proteins while 60 testing set is the proteins which were chosen randomly from the protein data bank. Multiple sequence alignment (MSA) is used to get the protein similar sequence and Position Specific Scoring matrix (PSSM) is used for network input. The training process of the neural network involves local adaptive techniques. Local adaptive techniques used in this paper comprises Learning rate by sign changes, SuperSAB, Quickprop and RPROP. From the simulation, the performance for learning rate by Rprop and Quickprop are superior to all other algorithms with respect to the convergence time. However, the best result was obtained using Rprop algorithm.
Identification and control of plasma vertical position using neural network in Damavand tokamak
International Nuclear Information System (INIS)
In this work, a nonlinear model is introduced to determine the vertical position of the plasma column in Damavand tokamak. Using this model as a simulator, a nonlinear neural network controller has been designed. In the first stage, the electronic drive and sensory circuits of Damavand tokamak are modified. These circuits can control the vertical position of the plasma column inside the vacuum vessel. Since the vertical position of plasma is an unstable parameter, a direct closed loop system identification algorithm is performed. In the second stage, a nonlinear model is identified for plasma vertical position, based on the multilayer perceptron (MLP) neural network (NN) structure. Estimation of simulator parameters has been performed by back-propagation error algorithm using Levenberg–Marquardt gradient descent optimization technique. The model is verified through simulation of the whole closed loop system using both simulator and actual plant in similar conditions. As the final stage, a MLP neural network controller is designed for simulator model. In the last step, online training is performed to tune the controller parameters. Simulation results justify using of the NN controller for the actual plant.
Chansanroj, Krisanin; Petrovi?, Jelena; Ibri?, Svetlana; Betz, Gabriele
2011-10-01
Artificial neural networks (ANNs) were applied for system understanding and prediction of drug release properties from direct compacted matrix tablets using sucrose esters (SEs) as matrix-forming agents for controlled release of a highly water soluble drug, metoprolol tartrate. Complexity of the system was presented through the effects of SE concentration and tablet porosity at various hydrophilic-lipophilic balance (HLB) values of SEs ranging from 0 to 16. Both effects contributed to release behaviors especially in the system containing hydrophilic SEs where swelling phenomena occurred. A self-organizing map neural network (SOM) was applied for visualizing interrelation among the variables and multilayer perceptron neural networks (MLPs) were employed to generalize the system and predict the drug release properties based on HLB value and concentration of SEs and tablet properties, i.e., tablet porosity, volume and tensile strength. Accurate prediction was obtained after systematically optimizing network performance based on learning algorithm of MLP. Drug release was mainly attributed to the effects of SEs, tablet volume and tensile strength in multi-dimensional interrelation whereas tablet porosity gave a small impact. Ability of system generalization and accurate prediction of the drug release properties proves the validity of SOM and MLPs for the formulation modeling of direct compacted matrix tablets containing controlled release agents of different material properties. PMID:21878388
Wang, Baijie; Wang, Xin; Chen, Zhangxin
2013-08-01
Reservoir characterization refers to the process of quantitatively assigning reservoir properties using all available field data. Artificial neural networks (ANN) have recently been introduced to solve reservoir characterization problems dealing with the complex underlying relationships inherent in well log data. Despite the utility of ANNs, the current limitation is that most existing applications simply focus on directly implementing existing ANN models instead of improving/customizing them to fit the specific reservoir characterization tasks at hand. In this paper, we propose a novel intelligent framework that integrates fuzzy ranking (FR) and multilayer perceptron (MLP) neural networks for reservoir characterization. FR can automatically identify a minimum subset of well log data as neural inputs, and the MLP is trained to learn the complex correlations from the selected well log data to a target reservoir property. FR guarantees the selection of the optimal subset of representative data from the overall well log data set for the characterization of a specific reservoir property; and, this implicitly improves the modeling and predication accuracy of the MLP. In addition, a growing number of industrial agencies are implementing geographic information systems (GIS) in field data management; and, we have designed the GFAR solution (GIS-based FR ANN Reservoir characterization solution) system, which integrates the proposed framework into a GIS system that provides an efficient characterization solution. Three separate petroleum wells from southwestern Alberta, Canada, were used in the presented case study of reservoir porosity characterization. Our experiments demonstrate that our method can generate reliable results.
Identification and control of plasma vertical position using neural network in Damavand tokamak
Energy Technology Data Exchange (ETDEWEB)
Rasouli, H. [School of Plasma Physics and Nuclear Fusion, Institute of Nuclear Science and Technology, AEOI, P.O. Box 14155-1339, Tehran (Iran, Islamic Republic of); Advanced Process Automation and Control (APAC) Research Group, Faculty of Electrical Engineering, K.N. Toosi University of Technology, P.O. Box 16315-1355, Tehran (Iran, Islamic Republic of); Rasouli, C.; Koohi, A. [School of Plasma Physics and Nuclear Fusion, Institute of Nuclear Science and Technology, AEOI, P.O. Box 14155-1339, Tehran (Iran, Islamic Republic of)
2013-02-15
In this work, a nonlinear model is introduced to determine the vertical position of the plasma column in Damavand tokamak. Using this model as a simulator, a nonlinear neural network controller has been designed. In the first stage, the electronic drive and sensory circuits of Damavand tokamak are modified. These circuits can control the vertical position of the plasma column inside the vacuum vessel. Since the vertical position of plasma is an unstable parameter, a direct closed loop system identification algorithm is performed. In the second stage, a nonlinear model is identified for plasma vertical position, based on the multilayer perceptron (MLP) neural network (NN) structure. Estimation of simulator parameters has been performed by back-propagation error algorithm using Levenberg-Marquardt gradient descent optimization technique. The model is verified through simulation of the whole closed loop system using both simulator and actual plant in similar conditions. As the final stage, a MLP neural network controller is designed for simulator model. In the last step, online training is performed to tune the controller parameters. Simulation results justify using of the NN controller for the actual plant.
A new approach to self-organizing fuzzy polynomial neural networks guided by genetic optimization
Energy Technology Data Exchange (ETDEWEB)
Oh, Sung-Kwun [Department of Electrical Engineering, The University of Suwon, San 2-2 Wau-ri, Bongdam-eup, Hwaseong-si, Gyeonggi-do 445-743 (Korea, Republic of); Pedrycz, Witold [Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, T6G 2G6 (Canada) and Systems Research Institute, Polish Academy of Sciences, Warsaw (Poland)]. E-mail: pedrycz@ee.ualberta.ca
2005-09-26
In this study, we introduce a new topology of Fuzzy Polynomial Neural Networks (FPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology. The underlying methodology involves mechanisms of genetic optimization, especially genetic algorithms (GAs). Let us recall that the design of the 'conventional' FPNNs uses an extended Group Method of Data Handling (GMDH) and exploits a fixed fuzzy inference type located at each FPN of the FPNN as well as considers a fixed number of input nodes at FPNs (or nodes) located in each layer. The proposed FPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional FPNNs. The structural optimization is realized via GAs whereas in the case of the parametric optimization we proceed with a standard least square method based learning. Through the consecutive process of such structural and parametric optimization, an optimized and flexible fuzzy neural network is generated in a dynamic fashion. The performance of the proposed gFPNN is quantified through experimentation that exploits standard data already being used in fuzzy modeling. The results reveal superiority of the proposed networks over the existing fuzzy and neural models.
Neural-network classifiers for automatic real-world aerial image recognition
Greenberg, Shlomo; Guterman, Hugo
1996-08-01
We describe the application of the multilayer perceptron (MLP) network and a version of the adaptive resonance theory version 2-A (ART 2-A) network to the problem of automatic aerial image recognition (AAIR). The classification of aerial images, independent of their positions and orientations, is required for automatic tracking and target recognition. Invariance is achieved by the use of different invariant feature spaces in combination with supervised and unsupervised neural networks. The performance of neural-network-based classifiers in conjunction with several types of invariant AAIR global features, such as the Fourier-transform space, Zernike moments, central moments, and polar transforms, are examined. The advantages of this approach are discussed. The performance of the MLP network is compared with that of a classical correlator. The MLP neural-network correlator outperformed the binary phase-only filter (BPOF) correlator. It was found that the ART 2-A distinguished itself with its speed and its low number of required training vectors. However, only the MLP classifier was able to deal with a combination of shift and rotation geometric distortions.
Kaftan, Ilknur; Salk, Mujgan; Senol, Yavuz
2011-12-01
Artificial neural networks (ANN) have been used in a variety of problems in the fields of science and engineering. Applications of ANN to the geophysical problems have increased within the last decade. In particular, it has been used to solve such inversion problems as seismic, electromagnetic, resistivity. There are also some other applications such as parameter estimation, prediction, and classification. In this study, multilayer perceptron neural networks (MLPNN) and radial basis function neural networks (RBFNN) were applied to synthetic gravity data and Seferihisar gravity data to investigate the applicability and performance of these networks for the method of gravity. Additionally performance of MLPNN and RBFNN were tested by adding random noise to the same synthetic test data. The structure parameters, such as the depths, the density contrasts, and the locations of the structures were obtained closely for different signal-to-noise ratios ( S/ N). Bouguer data of Seferihisar area were analyzed by MLPNN and RBFNN to estimate depth, density contrast, and location of the structure. The results of MLPNN, RBFNN, and classical inversion method were compared for real data obtained from Seferihisar Geothermal area and similar structure parameters were obtained. The experiments show that in general RBFNN not only increases the speed of the training stage enormously, but also provides slightly better performance.
Selection of input parameters to model direct solar irradiance by using artificial neural networks
International Nuclear Information System (INIS)
A very important factor in the assessment of solar energy resources is the availability of direct irradiance data of high quality. However, this component of solar radiation is seldom measured and thus must be estimated from data of global solar irradiance, which is registered in most radiometric stations. In recent years, artificial neural networks (ANN) have shown to be a powerful tool for mapping complex and non-linear relationships. In this work, the Bayesian framework for ANN, named as automatic relevance determination method (ARD), was employed to obtain the relative relevance of a large set of atmospheric and radiometric variables used for estimating hourly direct solar irradiance. In addition, we analysed the viability of this novel technique applied to select the optimum input parameters to the neural network. For that, a multi-layer feedforward perceptron is trained on these data. The results reflect the relative importance of the inputs selected. Clearness index and relative air mass were found to be the more relevant input variables to the neural network, as it was expected, proving the reliability of the ARD method. Moreover, we show that this novel methodology can be used in unfavourable conditions, in terms of limited amount of available data, performing successful results
A new approach to self-organizing fuzzy polynomial neural networks guided by genetic optimization
International Nuclear Information System (INIS)
In this study, we introduce a new topology of Fuzzy Polynomial Neural Networks (FPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology. The underlying methodology involves mechanisms of genetic optimization, especially genetic algorithms (GAs). Let us recall that the design of the 'conventional' FPNNs uses an extended Group Method of Data Handling (GMDH) and exploits a fixed fuzzy inference type located at each FPN of the FPNN as well as considers a fixed number of input nodes at FPNs (or nodes) located in each layer. The proposed FPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional FPNNs. The structural optimization is realized via GAs whereas in the case of the parametric optimization we proceed with a standard least square method based learning. Through the consecutive process of such structural and parametric optimization, an optimized and flexible fuzzy neural network is generated in a dynamic fashion. The performance of the proposed gFPNN is quantified through experimentation that exploits standard data already being used in fuzzy modeling. The results reveal superiority of the proposed networks over the existing fuzzy and neural models
Vassiliadis, V S
2006-01-01
A novel algorithm for tunable compression to within the precision of reproduction targets, or storage, is proposed. The new algorithm is termed the `Perceptron Algorithm', which utilises simple existing concepts in a novel way, has multiple immediate commercial application aspects as well as it opens up a multitude of fronts in computational science and technology. The aims of this paper are to present the concepts underlying the algorithm, observations by its application to some example cases, and the identification of a multitude of potential areas of applications such as: image compression by orders of magnitude, signal compression including sound as well, image analysis in a multilayered detailed analysis, pattern recognition and matching and rapid database searching (e.g. face recognition), motion analysis, biomedical applications e.g. in MRI and CAT scan image analysis and compression, as well as hints on the link of these ideas to the way how biological memory might work leading to new points of view i...
Synapse:neural network for predict power consumption: users guide
Energy Technology Data Exchange (ETDEWEB)
Muller, C.; Mangeas, M.; Perrot, N.
1994-08-01
SYNAPSE is forecasting tool designed to predict power consumption in metropolitan France on the half hour time scale. Some characteristics distinguish this forecasting model from those which already exist. In particular, it is composed of numerous neural networks. The idea for using many neural networks arises from past tests. These tests showed us that a single neural network is not able to solve the problem correctly. From this result, we decided to perform unsupervised classification of the 24 consumption curves. From this classification, six classes appeared, linked with the weekdays: Mondays, Tuesdays, Wednesdays, Thursdays, Fridays, Saturdays, Sundays, holidays and bridge days. For each class and for each half hour, two multilayer perceptrons are built. The two of them forecast the power for one particular half hour, and for a day including one of the determined class. The input of these two network are different: the first one (short time forecasting) includes the powers for the most recent half hour and relative power of the previous day; the second (medium time forecasting) includes only the relative power of the previous day. A process connects the results of every networks and allows one to forecast more than one half-hour in advance. In this process, short time forecasting networks and medium time forecasting networks are used differently. The first kind of neural networks gives good results on the scale of one day. The second one gives good forecasts for the next predicted powers. In this note, the organization of the SYNAPSE program is detailed, and the user`s menu is described. This first version of synapse works and should allow the APC group to evaluate its utility. (authors). 6 refs., 2 appends.
Directory of Open Access Journals (Sweden)
Epping W. J. M.
2006-11-01
Full Text Available Neural networks with the multi-layered perceptron architecture were trained on an autoassociation task to compress 2D seismic data. Networks with linear transfer functions outperformed nonlinear neural nets with single or multiple hidden layers. This indicates that the correlational structure of the seismic data is predominantly linear. A compression factor of 5 to 7 can be achieved if a reconstruction error of 10% is allowed. The performance on new test data was similar to that achieved with the training data. The hidden units developed feature-detecting properties that resemble oriented line, edge and more complex feature detectors. The feature detectors of linear neural nets are near-orthogonal rotations of the principal eigenvectors of the Karhunen-Loève transformation. Des réseaux neuronaux à architecture de perceptron multicouches ont été expérimentés en auto-association pour permettre la compression de données sismiques bidimensionnelles. Les réseaux neuronaux à fonctions de transfert linéaires s'avèrent plus performants que les réseaux neuronaux non linéaires, à une ou plusieurs couches cachées. Ceci indique que la structure corrélative des données sismiques est à prédominance linéaire. Un facteur de compression de 5 à 7 peut être obtenu si une erreur de reconstruction de 10 % est admise. La performance sur les données de test est très proche de celle obtenue sur les données d'apprentissage. Les unités cachées développent des propriétés de détection de caractéristiques ressemblant à des détecteurs de lignes orientées, de bords et de figures plus complexes. Les détecteurs de caractéristique des réseaux neuronaux linéaires sont des rotations quasi orthogonales des vecteurs propres principaux de la transformation de Karhunen-Loève.
?/?0 separation in shower maximum detector using neural network algorithm
International Nuclear Information System (INIS)
Procedure of gamma/pion neutral separation based on a multilayered perceptron algorithm are presented. Recognition capacities of these procedures and one of the CDF separation methods have been examined. The procedure were tested with the simulated data from one EMC+SMD tower of the STAR experiment. 10 refs., 1 tab., 9 figs
Tagging b quark events in ALEPH with neural networks
International Nuclear Information System (INIS)
Comparison of different methods to tag b quark events are presented: multilayered perceptron (MLP), Learning Vector Quantization (LVQ), discriminant analysis, combination of any two of the above methods. The sample events come from the ALEPH Monte Carlo and data, from the 1990 ALEPH runs. (authors) 12 refs., 16 figs., 5 tabs
Learning from correlated patterns by simple perceptrons
Energy Technology Data Exchange (ETDEWEB)
Shinzato, Takashi; Kabashima, Yoshiyuki [Department of Computational Intelligence and Systems Science, Tokyo Institute of Technology, Yokohama 226-8502 (Japan)], E-mail: shinzato@sp.dis.titech.ac.jp, E-mail: kaba@dis.titech.ac.jp
2009-01-09
Learning behavior of simple perceptrons is analyzed for a teacher-student scenario in which output labels are provided by a teacher network for a set of possibly correlated input patterns, and such that the teacher and student networks are of the same type. Our main concern is the effect of statistical correlations among the input patterns on learning performance. For this purpose, we extend to the teacher-student scenario a methodology for analyzing randomly labeled patterns recently developed in Shinzato and Kabashima 2008 J. Phys. A: Math. Theor. 41 324013. This methodology is used for analyzing situations in which orthogonality of the input patterns is enhanced in order to optimize the learning performance.
Kivelä, Mikko; Barthelemy, Marc; Gleeson, James P; Moreno, Yamir; Porter, Mason A
2013-01-01
Most real and engineered systems include multiple subsystems and layers of connectivity, and it is important to take such features into account to try to obtain a complete understanding of these systems. It is thus necessary to generalize "traditional" network theory by developing (and validating) a framework and associated tools to study multilayer systems in a comprehensive fashion. The origins of such efforts occurred several decades ago, but now the study of multilayer networks has become one of the major directions in network science. In this paper, we discuss the history of multilayer networks (and related concepts) and then review the exploding body of work on such networks. To unify the disparate terminology in the large body of recent work, we discuss a general framework for multilayer networks, construct a dictionary of terminology to relate the numerous existing concepts to each other, and provide a thorough discussion that compares, contrasts, and translates between related notions such as multila...
A Simple Perceptron that Learns Non-Monotonic Rules
Inoue, Jun-ichi; Nishimori, Hidetoshi; Kabashima, Yoshiyuki
1997-01-01
We investigate the generalization ability of a simple perceptron trained in the off-line and on-line supervised modes. Examples are extracted from the teacher who is a non-monotonic perceptron. For this system, difficulties of training can be controlled continuously by changing a parameter of the teacher. We train the student by several learning strategies in order to obtain the theoretical lower bounds of generalization errors under various conditions. Asymptotic behavior o...
Ensemble learning of linear perceptron; Online learning theory
Hara, Kazuyuki; Okada, Masato
2004-01-01
Within the framework of on-line learning, we study the generalization error of an ensemble learning machine learning from a linear teacher perceptron. The generalization error achieved by an ensemble of linear perceptrons having homogeneous or inhomogeneous initial weight vectors is precisely calculated at the thermodynamic limit of a large number of input elements and shows rich behavior. Our main findings are as follows. For learning with homogeneous initial weight vectors...
An Efficient Rescaled Perceptron Algorithm for Conic Systems
Vempala, Santosh; Belloni, Alexandre; Freund, Robert Michael
2009-01-01
The classical perceptron algorithm is an elementary row-action/relaxation algorithm for solving a homogeneous linear inequality system Ax > 0. A natural condition measure associated with this algorithm is the Euclidean width {tau} of the cone of feasible solutions, and the iteration complexity of the perceptron algorithm is bounded by 1/{tau}2 [see Rosenblatt, F. 1962. Principles of Neurodynamics. Spartan Books, Washington, DC]. Dunagan and Vempala [Dunagan, J., S. Vempala. 2007. A simple pol...
Entropy landscape of solutions in the binary perceptron problem
Huang, Haiping; Wong, K. Y. Michael; Kabashima, Yoshiyuki
2013-01-01
The statistical picture of the solution space for a binary perceptron is studied. The binary perceptron learns a random classification of input random patterns by a set of binary synaptic weights. The learning of this network is difficult especially when the pattern (constraint) density is close to the capacity, which is supposed to be intimately related to the structure of the solution space. The geometrical organization is elucidated by the entropy landscape from a referen...
Stability of the replica symmetric solution in diluted perceptron learning
Lage-castellanos, Alejandro; Pagnani, Andrea; Angulo, Gretel Quintero
2012-01-01
We study the role played by the dilution in the average behavior of a perceptron model with continuous coupling with the replica method. We analyze the stability of the replica symmetric solution as a function of the dilution field for the generalization and memorization problems. Thanks to a Gardner like stability analysis we show that at any fixed ratio $\\alpha$ between the number of patterns M and the dimension N of the perceptron ($\\alpha=M/N$), there exists a critical d...
Generalization learning in a perceptron with binary synapses
Baldassi, Carlo
2012-01-01
We consider the generalization problem for a perceptron with binary synapses, implementing the Stochastic Belief-Propagation-Inspired (SBPI) learning algorithm which we proposed earlier, and perform a mean-field calculation to obtain a differential equation which describes the behaviour of the device in the limit of a large number of synapses N. We show that the solving time of SBPI is of order N*sqrt(log(N)), while the similar, well-known clipped perceptron (CP) algorithm d...
The Projectron: a Bounded Kernel-Based Perceptron
Orabona, Francesco; Keshet, Joseph; Caputo, Barbara
2008-01-01
We present a discriminative online algorithm with a bounded memory growth, which is based on the kernel-based Perceptron. Generally, the required memory of the kernel-based Perceptron for storing the online hypothesis is not bounded. Previous work has been focused on discarding part of the instances in order to keep the memory bounded. In the proposed algorithm the instances are not discarded, but projected onto the space spanned by the previous online hypothesis. We derive a relative mistake...
Training a perceptron in a discrete weight space
Rosen-zvi, Michal; Kanter, Ido
2001-01-01
On-line and batch learning of a perceptron in a discrete weight space, where each weight can take $2 L+1$ different values, are examined analytically and numerically. The learning algorithm is based on the training of the continuous perceptron and prediction following the clipped weights. The learning is described by a new set of order parameters, composed of the overlaps between the teacher and the continuous/clipped students. Different scenarios are examined among them on-...
Spherical perceptron as a storage memory with limited errors
Stojnic, Mihailo
2013-01-01
It has been known for a long time that the classical spherical perceptrons can be used as storage memories. Seminal work of Gardner, \\cite{Gar88}, started an analytical study of perceptrons storage abilities. Many of the Gardner's predictions obtained through statistical mechanics tools have been rigorously justified. Among the most important ones are of course the storage capacities. The first rigorous confirmations were obtained in \\cite{SchTir02,SchTir03} for the storage ...
Crash Introduction to Artificial Neural Networks
Galkin, Ivan
The Crash Introduction to Artificial Neural Networks is not a comprehensive resource, but it provides a good overview of many aspects of the topic. Beginning with a discussion of biological processes in the brain, the site describes the function of neurons and how they are interconnected. Some historical events are mentioned, leading to the development of an artificial neural network. The famous perceptron configuration is the basis of subsequent discussions of training algorithms, prediction and classification functions, and data processing.
Energy Technology Data Exchange (ETDEWEB)
Rahimikhoob, Ali [Irrigation and Drainage Engineering Department, College of Abouraihan, University of Tehran (Iran)
2010-09-15
Global solar radiation (GSR) data are desirable for many areas of research and applications in various engineering fields. However, GSR is not as readily available as air temperature data. Artificial neural networks (ANNs) are effective tools to model nonlinear systems and require fewer inputs. The objective of this study was to test an artificial neural network (ANN) for estimating the global solar radiation (GSR) as a function of air temperature data in a semi-arid environment. The ANNs (multilayer perceptron type) were trained to estimate GSR as a function of the maximum and minimum air temperature and extraterrestrial radiation. The data used in the network training were obtained from a historical series (1994-2001) of daily climatic data collected in weather station of Ahwaz located in Khuzestan plain in the southwest of Iran. The empirical Hargreaves and Samani equation (HS) is also considered for the comparison. The HS equation calibrated by applying the same data used for neural network training. Two historical series (2002-2003) were utilized to test the network and for comparison between the ANN and calibrated HS method. The study demonstrated that modelling of daily GSR through the use of the ANN technique gave better estimates than the HS equation. RMSE and R{sup 2} for the comparison between observed and estimated GSR for the tested data using the proposed ANN model are 2.534 MJ m{sup -2} day{sup -1} and 0.889 respectively. (author)
Directory of Open Access Journals (Sweden)
R. Rezae Arshad
2012-07-01
Full Text Available Direct measurement of soil hydraulic characteristics is costly and time-consuming. Also, the method is partly unreliable due to soil heterogeneity and laboratory errors. Instead, soil hydraulic characteristics can be predicted using readily available data such as soil texture and bulk density using pedotransfer functions (PTFs. Artificial neural networks (ANNs and statistical regression are two methods which are used to develop PTFs. In this study, the multi-layer perceptron (MLP neural network and backward and stepwise regression models were used to estimate saturated hydraulic conductivity using some soil characteristics including the percentage of particle size distribution, porosity, and bulk density. Data of 125 soil profiles were collected from the reports of basic soil science and land reclamation studies conducted by Khuzestan Water and Power Organization. The results showed that MLP neural network having Bayesian training algorithm with the greater coefficient of determination (R2=0.65 and the lower error (RMSE =0.04 had better performance than multiple linear regression model in predicting saturated hydraulic conductivity.
Amani, Tahat; Jordi, Marti; Ali, Khwaldeh; Kaher, Tahat
2014-04-01
In computational physics proton transfer phenomena could be viewed as pattern classification problems based on a set of input features allowing classification of the proton motion into two categories: transfer ‘occurred’ and transfer ‘not occurred’. The goal of this paper is to evaluate the use of artificial neural networks in the classification of proton transfer events, based on the feed-forward back propagation neural network, used as a classifier to distinguish between the two transfer cases. In this paper, we use a new developed data mining and pattern recognition tool for automating, controlling, and drawing charts of the output data of an Empirical Valence Bond existing code. The study analyzes the need for pattern recognition in aqueous proton transfer processes and how the learning approach in error back propagation (multilayer perceptron algorithms) could be satisfactorily employed in the present case. We present a tool for pattern recognition and validate the code including a real physical case study. The results of applying the artificial neural networks methodology to crowd patterns based upon selected physical properties (e.g., temperature, density) show the abilities of the network to learn proton transfer patterns corresponding to properties of the aqueous environments, which is in turn proved to be fully compatible with previous proton transfer studies.
Convergence Analysis of Adaptive Recurrent Neural Network
Hong Li; Ali Setoodehnia
2014-01-01
This paper presents analysis of a modified Feed Forward Multilayer Perceptron (FMP) by inserting an ARMA (Auto Regressive Moving Average) model at each neuron (processor node) with the Backp ropagation learning algorithm. The stability analysis is presented to establish the convergence theory of the Back propagation algorithm based on the Lyapunov function. Furthermore, the analysis extends the Back propagation learning rule by introducing the adaptive learning factors. A rang...
New Algorithm to Investigate Neural Networks
Berg, Bernd A.
1996-01-01
Random cost simulations were introduced as a method to investigate optimization problems in systems with conflicting constraints. Here I study the approach in connection with the training of a feed-forward multilayer perceptron, as used in high energy physics applications. It is suggested to use random cost simulations for generating a set of selected configurations. On each of those final minimization may then be performed by a standard algorithm. For the training example a...
Comments on "Quantum M-P Neural Network"
da Silva, Adenilton J.; de Oliveira, Wilson R.; Ludermir, Teresa B.
2014-11-01
In a paper on quantum neural networks, Zhou and Ding (Int. J. Theor. Phys. 46(12):3209-3215 ([2007])) proposed a new model of quantum perceptron denoted quantum M-P neural network and showed its functionality by an example. In this letter, we show that the proposed learning algorithm does not follow an unitary evolution and the proposed neuron can be efficiently simulated by a classical single layer neural network.
Retinal vessel extraction using Lattice Neural Networks with Dendritic Processing.
Vega, Roberto; Sanchez-Ante, Gildardo; Falcon-Morales, Luis E; Sossa, Humberto; Guevara, Elizabeth
2015-03-01
Retinal images can be used to detect and follow up several important chronic diseases. The classification of retinal images requires an experienced ophthalmologist. This has been a bottleneck to implement routine screenings performed by general physicians. It has been proposed to create automated systems that can perform such task with little intervention from humans, with partial success. In this work, we report advances in such endeavor, by using a Lattice Neural Network with Dendritic Processing (LNNDP). We report results using several metrics, and compare against well known methods such as Support Vector Machines (SVM) and Multilayer Perceptrons (MLP). Our proposal shows better performance than other approaches reported in the literature. An additional advantage is that unlike those other tools, LNNDP requires no parameters, and it automatically constructs its structure to solve a particular problem. The proposed methodology requires four steps: (1) Pre-processing, (2) Feature computation, (3) Classification and (4) Post-processing. The Hotelling T(2) control chart was used to reduce the dimensionality of the feature vector, from 7 that were used before to 5 in this work. The experiments were run on images of DRIVE and STARE databases. The results show that on average, F1-Score is better in LNNDP, compared with SVM and MLP implementations. Same improvement is observed for MCC and the accuracy. PMID:25589415
Monthly monsoon rainfall forecasting using artificial neural networks
Ganti, Ravikumar
2014-10-01
Indian agriculture sector heavily depends on monsoon rainfall for successful harvesting. In the past, prediction of rainfall was mainly performed using regression models, which provide reasonable accuracy in the modelling and forecasting of complex physical systems. Recently, Artificial Neural Networks (ANNs) have been proposed as efficient tools for modelling and forecasting. A feed-forward multi-layer perceptron type of ANN architecture trained using the popular back-propagation algorithm was employed in this study. Other techniques investigated for modeling monthly monsoon rainfall include linear and non-linear regression models for comparison purposes. The data employed in this study include monthly rainfall and monthly average of the daily maximum temperature in the North Central region in India. Specifically, four regression models and two ANN model's were developed. The performance of various models was evaluated using a wide variety of standard statistical parameters and scatter plots. The results obtained in this study for forecasting monsoon rainfalls using ANNs have been encouraging. India's economy and agricultural activities can be effectively managed with the help of the availability of the accurate monsoon rainfall forecasts.
Energy demand estimation of South Korea using artificial neural network
Energy Technology Data Exchange (ETDEWEB)
Geem, Zong Woo [Environmental Planning and Management Program, Johns Hopkins University, Clarksburg, Maryland 20871 (United States); Roper, William E. [Department of Geography and Geo-information Science, George Mason University, Fairfax, Virginia 22030 (United States)
2009-10-15
Because South Korea's industries depend heavily on imported energy sources (fifth largest importer of oil and second largest importer of liquefied natural gas in the world), the accurate estimating of its energy demand is critical in energy policy-making. This research proposes an artificial neural network model (a structure with feed-forward multilayer perceptron, error back-propagation algorithm, momentum process, and scaled data) to efficiently estimate the energy demand for South Korea. The model has four independent variables, such as gross domestic product (GDP), population, import, and export amounts. The data are obtained from diverse local and international sources. The proposed model better estimated energy demand than a linear regression model (a structure with multiple linear variables and least square method) or an exponential model (a structure with mixed integer variables, branch and bound method, and Broyden-Fletcher-Goldfarb-Shanno (BFGS) method) in terms of root mean squared error (RMSE). The model also forecasted better than the other two models in terms of RMSE without any over-fitting problem. Further testing with four scenarios based upon reliable source data showed unanticipated results. Instead of growing permanently, the energy demands peaked at certain points, and then decreased gradually. This trend is quite different from the results by regression or exponential model. (author)
QSO Selection and Photometric Redshifts with Neural Networks
Yeche, Ch; Rich, J; Aubourg, E; Busca, N; Hamilton, J -Ch; Goff, J -M Le; Paris, I; Peirani, S; Pichon, Ch; Rollinde, E; Vargas-Magana, M
2009-01-01
Baryonic Acoustic Oscillations (BAO) and their effects on the matter power spectrum can be studied by using the Lyman-alpha absorption signature of the matter density field along quasar (QSO) lines of sight. A measurement sufficiently accurate to provide useful cosmological constraints requires the observation of ~100000 quasars in the redshift range 2.2
Energy demand estimation of South Korea using artificial neural network
International Nuclear Information System (INIS)
Because South Korea's industries depend heavily on imported energy sources (fifth largest importer of oil and second largest importer of liquefied natural gas in the world), the accurate estimating of its energy demand is critical in energy policy-making. This research proposes an artificial neural network model (a structure with feed-forward multilayer perceptron, error back-propagation algorithm, momentum process, and scaled data) to efficiently estimate the energy demand for South Korea. The model has four independent variables, such as gross domestic product (GDP), population, import, and export amounts. The data are obtained from diverse local and international sources. The proposed model better estimated energy demand than a linear regression model (a structure with multiple linear variables and least square method) or an exponential model (a structure with mixed integer variables, branch and bound method, and Broyden-Fletcher-Goldfarb-Shanno (BFGS) method) in terms of root mean squared error (RMSE). The model also forecasted better than the other two models in terms of RMSE without any over-fitting problem. Further testing with four scenarios based upon reliable source data showed unanticipated results. Instead of growing permanently, the energy demands peaked at certain points, and then decreased gradually. This trend is quite different from the results by regression or exponential model.
NNERVE: neural network extraction of repetitive vectors for electromyography--Part I: Algorithm.
Hassoun, M H; Wang, C; Spitzer, A R
1994-11-01
Artificial neural network (ANN) based signal processing methods have been shown to have significant robustness in processing complex, degraded, noisy, and unstable signals. A novel approach to automated electromyogram (EMG) signal decomposition, using an ANN processing architecture, is presented in this paper. Due to the lack of a priori knowledge of motor unit action potential (MUAP) morphology, the EMG decomposition must be performed in an unsupervised manner. An ANN classifier, consisting of a multilayer perceptron neural network and employing a novel unsupervised training strategy, is proposed. The ANN learns repetitive appearances of MUAP waveforms from their suspected occurrences in a filtered EMG signal in an autoassociative learning task. The same training waveforms are fed into the trained ANN and the output of the ANN is fed back to its input, giving rise to a dynamic retrieval net classifier. For each waveform in the data, the network discovers a feature vector associated with that waveform. For each waveform, classification is achieved by comparing its feature vector with those of the other waveforms. Firing information of each MUAP is further used to refine the classification results of the ANN classifier. Then, individual MUAP waveform shapes are derived and their firing tables are created. PMID:8001993
Predicting neutron diffusion eigenvalues with a query-based adaptive neural architecture.
Lysenko, M G; Wong, H I; Maldonado, G I
1999-01-01
A query-based approach for adaptively retraining and restructuring a two-hidden-layer artificial neural network (ANN) has been developed for the speedy prediction of the fundamental mode eigenvalue of the neutron diffusion equation, a standard nuclear reactor core design calculation which normally requires the iterative solution of a large-scale system of nonlinear partial differential equations (PDE's). The approach developed focuses primarily upon the adaptive selection of training and cross-validation data and on artificial neural-network (ANN) architecture adjustments, with the objective of improving the accuracy and generalization properties of ANN-based neutron diffusion eigenvalue predictions. For illustration, the performance of a "bare bones" feedforward multilayer perceptron (MLP) is upgraded through a variety of techniques; namely, nonrandom initial training set selection, adjoint function input weighting, teacher-student membership and equivalence queries for generation of appropriate training data, and a dynamic node architecture (DNA) implementation. The global methodology is flexible in that it can "wrap around" any specific training algorithm selected for the static calculations (i.e., training iterations with a fixed training set and architecture). Finally, the improvements obtained are carefully contrasted against past works reported in the literature. PMID:18252578
On-line control of the COMPASS-D tokamak using a neural network
International Nuclear Information System (INIS)
Multi-layer perceptron (MLP) networks are particularly appropriate for performing rapid non-linear mapping. In the application discussed in this Paper the position and shape of the plasma within the experimental fusion research tokamak COMPASS-D at UKAEA's Culham Laboratory is determined from a series of magnetic sensors placed around the vacuum vessel, close to the plasma boundary. By using a real-time analogue neural network it is possible to achieve control within a sub-millisecond time-scale. In this application the neural network is needed to solve an inverse problem. Numerical codes exist that are able to calculate the signals expected on the magnetic sensors for a given plasma position and profile. The problem is well defined from the solution of the Grad-Shafranov equation. However, no easy analytical formalism exists to reverse the problem - to calculate the plasma parameters given the magnetic signals. It is this mapping, from the set of magnetic diagnostic input signals to the parameters of the plasma, that an MLP network can be trained to solve. The training data are some 2000 example plasma equilibria, covering the likely possible configurations of the plasma, solved by numerical methods. The desired aim, to control the plasma boundary position to within a few millimetres, has now been achieved. (author)
Valous, Nektarios A; Mendoza, Fernando; Sun, Da-Wen; Allen, Paul
2010-03-01
The quaternionic singular value decomposition is a technique to decompose a quaternion matrix (representation of a colour image) into quaternion singular vector and singular value component matrices exposing useful properties. The objective of this study was to use a small portion of uncorrelated singular values, as robust features for the classification of sliced pork ham images, using a supervised artificial neural network classifier. Images were acquired from four qualities of sliced cooked pork ham typically consumed in Ireland (90 slices per quality), having similar appearances. Mahalanobis distances and Pearson product moment correlations were used for feature selection. Six highly discriminating features were used as input to train the neural network. An adaptive feedforward multilayer perceptron classifier was employed to obtain a suitable mapping from the input dataset. The overall correct classification performance for the training, validation and test set were 90.3%, 94.4%, and 86.1%, respectively. The results confirm that the classification performance was satisfactory. Extracting the most informative features led to the recognition of a set of different but visually quite similar textural patterns based on quaternionic singular values. PMID:20374805
Artificial neural networks for simulating wind effects on sprinkler distribution patterns
Energy Technology Data Exchange (ETDEWEB)
Sayyadi, H.; Sadraddini, A. A.; Farsadi Zadeh, D.; Montero, J.
2012-07-01
A new approach based on Artificial Neural Networks (ANNs) is presented to simulate the effects of wind on the distribution pattern of a single sprinkler under a center pivot or block irrigation system. Field experiments were performed under various wind conditions (speed and direction). An experimental data from different distribution patterns using a Nelson R3000 Rotator sprinkler have been split into three and used for model training, validation and testing. Parameters affecting the distribution pattern were defined. To find an optimal structure, various networks with different architectures have been trained using an Early Stopping method. The selected structure produced R2 0.929 and RMSE = 6.69 mL for the test subset, consisting of a Multi-Layer Perceptron (MLP) neural network with a backpropagation training algorithm; two hidden layers (twenty neurons in the first hidden layer and six neurons in the second hidden layer) and a tangent-sigmoid transfer function. This optimal network was implemented in MATLAB to develop a model termed ISSP (Intelligent Simulator of Sprinkler Pattern). ISSP uses wind speed and direction as input variables and is able to simulate the distorted distribution pattern from a R3000 Rotator sprinkler with reasonable accuracy (R{sup 2} > 0.935). Results of model evaluation confirm the accuracy and robustness of ANNs for simulation of a single sprinkler distribution pattern under real field conditions. (Author) 41 refs.
Energy Technology Data Exchange (ETDEWEB)
Dashtbayazi, M.R. [Faculty of Mechanical Engineering, K. N. Toosi University of Technology, P.O. Box 16765-3381, Tehran (Iran, Islamic Republic of)], E-mail: dashtbayazi@me.kntu.ac.ir; Shokuhfar, A. [Faculty of Mechanical Engineering, K. N. Toosi University of Technology, P.O. Box 16765-3381, Tehran (Iran, Islamic Republic of); Simchi, A. [Department of Materials Science and Engineering, Institute for Nanoscience and Nanotechnology, Sharif University of Technology, P.O. Box 11365-9466, Azadi Avenue, 14588 Tehran (Iran, Islamic Republic of)
2007-09-25
An artificial neural network model was developed for modeling of the effects of mechanical alloying parameters including milling time, milling speed and ball to powder weight ratio on the characteristics of Al-8 vol%SiC nanocomposite powders. The crystallite size and lattice strain of the aluminum matrix were considered for modeling. This nanostructured nanocomposite powder was synthesized by utilizing planetary high energy ball mill and the required data for training were collected from the experimental results. The characteristics of the particles were determined by X-ray diffraction, scanning and transmission electron microscopy. Two types of neural network architecture, i.e. multi-layer perceptron (MLP) and radial basis function (RBF), were used. The steepest descent along with variable learning rate back-propagation algorithm known as a heuristic technique was utilized for training the MLP network. It was found that MLP network yields better results compared to RBF network, giving an acceptable mapping between the network responses and the target data with a high correlation coefficients. The response surfaces between the response variables, i.e. crystallite size, lattice strain of the aluminum matrix and the processing parameters are presented. The procedure modeling can be used for optimization of the MA process for synthesizing of nanostructured metal matrix nanocomposites.
International Nuclear Information System (INIS)
An artificial neural network model was developed for modeling of the effects of mechanical alloying parameters including milling time, milling speed and ball to powder weight ratio on the characteristics of Al-8 vol%SiC nanocomposite powders. The crystallite size and lattice strain of the aluminum matrix were considered for modeling. This nanostructured nanocomposite powder was synthesized by utilizing planetary high energy ball mill and the required data for training were collected from the experimental results. The characteristics of the particles were determined by X-ray diffraction, scanning and transmission electron microscopy. Two types of neural network architecture, i.e. multi-layer perceptron (MLP) and radial basis function (RBF), were used. The steepest descent along with variable learning rate back-propagation algorithm known as a heuristic technique was utilized for training the MLP network. It was found that MLP network yields better results compared to RBF network, giving an acceptable mapping between the network responses and the target data with a high correlation coefficients. The response surfaces between the response variables, i.e. crystallite size, lattice strain of the aluminum matrix and the processing parameters are presented. The procedure modeling can be used for optimization of the MA process for synthesizing of nanostructured metal matrix nanocomposites
International Nuclear Information System (INIS)
A nuclear power plant's (NPP's) status is usually monitored by a human operator. Any classifier system used to enhance the operator's capability to diagnose a safety-critical system like an NPP should classify a novel transient as ''don't-know'' if it is not contained within its accumulated knowledge base. In particular, the classifier needs some kind of proximity measure between the new data and its training set. Artificial neural networks have been proposed as NPP classifiers, the most popular ones being the multilayered perceptron (MLP) type. However, MLPs do not have a proximity measure, while learning vector quantization, probabilistic neural networks (PNNs), and some others do. This proximity measure may also serve as an explanation to the classifier's decision in the way that case-based-reasoning expert systems do. The capability of a PNN network as a classifier is demonstrated using simulator data for the three-loop 436-MW(electric) Westinghouse San Onofre unit 1 pressurized water reactor. A transient's classification history is used in an ''evidence accumulation'' technique to enhance a classifier's accuracy as well as its consistency
The fatigue life prediction of aluminium alloy using genetic algorithm and neural network
Susmikanti, Mike
2013-09-01
The behavior of the fatigue life of the industrial materials is very important. In many cases, the material with experiencing fatigue life cannot be avoided, however, there are many ways to control their behavior. Many investigations of the fatigue life phenomena of alloys have been done, but it is high cost and times consuming computation. This paper report the modeling and simulation approaches to predict the fatigue life behavior of Aluminum Alloys and resolves some problems of computation. First, the simulation using genetic algorithm was utilized to optimize the load to obtain the stress values. These results can be used to provide N-cycle fatigue life of the material. Furthermore, the experimental data was applied as input data in the neural network learning, while the samples data were applied for testing of the training data. Finally, the multilayer perceptron algorithm is applied to predict whether the given data sets in accordance with the fatigue life of the alloy. To achieve rapid convergence, the Levenberg-Marquardt algorithm was also employed. The simulations results shows that the fatigue behaviors of aluminum under pressure can be predicted. In addition, implementation of neural networks successfully identified a model for material fatigue life.
Foreground removal from CMB temperature maps using an MLP neural network
DEFF Research Database (Denmark)
NØrgaard-Nielsen, Hans Ulrik; JØrgensen, H.E.
2008-01-01
One of the main obstacles for extracting the Cosmic Microwave Background (CMB) signal from observations in the mm-submm range is the foreground contamination by emission from Galactic components: mainly synchrotron, free-free and thermal dust emission. Due to the statistical nature of the intrinsic CMB signal it is essential to minimize the systematic errors in the CMB temperature determinations. Following the available knowledge of the spectral behavior of the Galactic foregrounds simple power law-like spectra have been assumed. The feasibility of using a simple neural network for extracting the CMB temperature signal from the combined signal CMB and the foregrounds has been investigated. As a specific example, we have analysed simulated data, as expected from the ESA Planck CMB mission. A simple multilayer perceptron neural network with 2 hidden layers can provide temperature estimates over more than 80 per cent of the sky that are to a high degree uncorrelated with the foreground signals. A single network will be able to cover the dynamic range of the Planck noise level over the entire sky.
Nonlinear Multivariate and Time Series Analysis by Neural Network Methods, with Applications to ENSO
Hsieh, W. W.
2003-12-01
Methods in multivariate statistical analysis are essential for working with large amounts of geophysical data--- data from observational arrays, from satellites or from numerical model output. In classical multivariate statistical analysis, there is a hierarchy of methods, starting with linear regression (LR) at the base, followed by principal component analysis (PCA), and finally canonical correlation analysis (CCA). A multivariate time series method, the singular spectrum analysis (SSA), has been a fruitful extension of the PCA technique. The common drawback of these classical methods is that only linear structures can be correctly extracted from the data. Since the late 1980s, neural network methods have become popular for performing nonlinear regression (NLR) and classification. More recently, multi-layer perceptron neural network methods have been extended to perform nonlinear PCA (NLPCA), nonlinear CCA (NLCCA) and nonlinear SSA (NLSSA). This paper presents a unified view of the NLPCA, NLCCA and NLSSA techniques, and their applications to various datasets of the atmosphere and the ocean, especially in the nonlinear study of the El Niño-Southern Oscillation (ENSO) phenomenon.
Delogu, P; Kasae, P; Retico, A
2008-01-01
The computer-aided diagnosis system we developed for the mass characterization is mainly based on a segmentation algorithm and on the neural classification of several features computed on the segmented mass. Mass segmentation plays a key role in most computerized systems. Our technique is a gradient-based one, showing the main characteristic that no free parameters have been evaluated on the dataset used in this analysis, thus it can directly be applied to datasets acquired in different conditions without any ad-hoc modification. A dataset of 226 masses (109 malignant and 117 benign) has been used in this study. The segmentation algorithm works with a comparable efficiency both on malignant and benign masses. Sixteen features based on shape, size and intensity of the segmented masses are analyzed by a multi-layered perceptron neural network. A feature selection procedure has been carried out on the basis of the feature discriminating power and of the linear correlations interplaying among them. The comparison...
Robustness of a Neural Network Model for Power Peak Factor Estimation in Protection Systems
International Nuclear Information System (INIS)
This work presents results of robustness verification of artificial neural network correlations that improve the real time prediction of the power peak factor for reactor protection systems. The input variables considered in the correlation are those available in the reactor protection systems, namely, the axial power differences obtained from measured ex-core detectors, and the position of control rods. The correlations, based on radial basis function (RBF) and multilayer perceptron (MLP) neural networks, estimate the power peak factor, without faulty signals, with average errors between 0.13%, 0.19% and 0.15%, and maximum relative error of 2.35%. The robustness verification was performed for three different neural network correlations. The results show that they are robust against signal degradation, producing results with faulty signals with a maximum error of 6.90%. The average error associated to faulty signals for the MLP network is about half of that of the RBF network, and the maximum error is about 1% smaller. These results demonstrate that MLP neural network correlation is more robust than the RBF neural network correlation. The results also show that the input variables present redundant information. The axial power difference signals compensate the faulty signal for the position of a given control rod, and improves the results by about 10%. The results show that the errors in the power peak factor estimation by these neural network correlations, even in fase neural network correlations, even in faulty conditions, are smaller than the current PWR schemes which may have uncertainties as high as 8%. Considering the maximum relative error of 2.35%, these neural network correlations would allow decreasing the power peak factor safety margin by about 5%. Such a reduction could be used for operating the reactor with a higher power level or with more flexibility. The neural network correlation has to meet requirements of high integrity software that performs safety grade actions. It is shown that the correlation is a very simple algorithm that can be easily codified in software. Due to its simplicity, it facilitates the necessary process of validation and verification. (authors)
Directory of Open Access Journals (Sweden)
Chennai Salim
2011-09-01
Full Text Available The increased use of nonlinear devices in the industry has resulted in the direct increase of harmonic distortion in power systems during these last years. Active filter systems are proposed to mitigate current harmonics generated by nonlinear loads. The conventional scheme based on a two-level voltage source inverter controlled by a hysteresis controller has several disadvantages and cannot be used for medium or high-power applications. To overcome these drawbacks and improve the APF performance, there’s a great tendency to use multilevel inverters controlled by intelligent controllers. Three level (NPC inverter is one of the most widely used topologies in various industrial applications such as machine drives and power factor compensators. On the other hand, artificial neural networks are under study and investigation in other power electronics applications. In order to gain the advantages of the three-level inverter and artificial neural networks and to reduce the complexity of classical control schemes, a new active power filter configuration controlled by two MLPNN (Multi-Layer Perceptron Neural Network is proposed in this paper. The first ANN is used to replace the PWM current controller, and the second one to maintain a constant dc link voltage across the capacitors and compensate the inverter power losses. The performance of the global system, including power and control circuits is evaluated by Matlab-Simulink and SimPowerSystem Toolbox simulation. The obtained results confirm the effectiveness of the proposed control scheme.
Stability of the replica symmetric solution in diluted perceptron learning
International Nuclear Information System (INIS)
We study the role played by dilution in the average behavior of a perceptron model with continuous coupling with the replica method. We analyze the stability of the replica symmetric solution as a function of the dilution field for the generalization and memorization problems. Thanks to a Gardner-like stability analysis we show that at any fixed ratio ? between the number of patterns M and the dimension N of the perceptron (? = M/N), there exists a critical dilution field hc above which the replica symmetric ansatz becomes unstable. (letter)
Piotrowski, Adam P.; Napiorkowski, Jaros?aw J.
2011-09-01
SummaryAlthough neural networks have been widely applied to various hydrological problems, including river flow forecasting, for at least 15 years, they have usually been trained by means of gradient-based algorithms. Recently nature inspired Evolutionary Computation algorithms have rapidly developed as optimization methods able to cope not only with non-differentiable functions but also with a great number of local minima. Some of proposed Evolutionary Computation algorithms have been tested for neural networks training, but publications which compare their performance with gradient-based training methods are rare and present contradictory conclusions. The main goal of the present study is to verify the applicability of a number of recently developed Evolutionary Computation optimization methods, mostly from the Differential Evolution family, to multi-layer perceptron neural networks training for daily rainfall-runoff forecasting. In the present paper eight Evolutionary Computation methods, namely the first version of Differential Evolution (DE), Distributed DE with Explorative-Exploitative Population Families, Self-Adaptive DE, DE with Global and Local Neighbors, Grouping DE, JADE, Comprehensive Learning Particle Swarm Optimization and Efficient Population Utilization Strategy Particle Swarm Optimization are tested against the Levenberg-Marquardt algorithm - probably the most efficient in terms of speed and success rate among gradient-based methods. The Annapolis River catchment was selected as the area of this study due to its specific climatic conditions, characterized by significant seasonal changes in runoff, rapid floods, dry summers, severe winters with snowfall, snow melting, frequent freeze and thaw, and presence of river ice - conditions which make flow forecasting more troublesome. The overall performance of the Levenberg-Marquardt algorithm and the DE with Global and Local Neighbors method for neural networks training turns out to be superior to other Evolutionary Computation-based algorithms. The Levenberg-Marquardt optimization must be considered as the most efficient one due to its speed. Its drawback due to possible sticking in poor local optimum can be overcome by applying a multi-start approach.
An experiment on the evolution of an ensemble of neural networks for streamflow forecasting
Boucher, M.-A.; Laliberté, J.-P.; Anctil, F.
2010-03-01
We present an experiment on fifty multilayer perceptrons trained for streamflow forecasting on three watersheds using bootstrapped input series. This type of neural network is common in hydrology and using multiple training repetitions (ensembling) is a popular practice: the information issued by the ensemble is then aggregated and considered to be the final output. Some authors proposed that the ensemble could serve the calculation of confidence intervals around the ensemble mean. In the following, we are interested in the reliability of confidence intervals obtained in such fashion and in tracking the evolution of the ensemble of neural networks during the training process. For each iteration of this process, the mean of the ensemble is computed along with various confidence intervals. The performance of the ensemble mean is evaluated based on the mean absolute error. Since the ensemble of neural networks resemble an ensemble streamflow forecast, we also use ensemble-specific quality assessment tools such as the Continuous Ranked Probability Score to quantify the forecasting performance of the ensemble formed by the neural networks repetitions. We show that while the performance of the single predictor formed by the ensemble mean improves throughout the training process, the reliability of the associated confidence intervals starts to decrease shortly after the initiation of this process. While there is no moment during the training where the reliability of the confidence intervals is perfect, we show that it is best after approximately 5 to 10 iterations, depending on the basin. We also show that the Continuous Ranked Probability Score and the logarithmic score do not evolve in the same fashion during the training, due to a particularity of the logarithmic score.
Use of a Neural Network for Damage Detection and Location in a Steel Member
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
1992-01-01
The paper explores the potential of using a Multilayer Perceptron (MLP) network trained with the Backpropagation algorithm for damage assessment of free-free cracked straight steel beam based on vibration measurements. The problem of damage assessment, i.e. detecting, locating and quantifying a damage, is essentially a pattern recognition problem.
Scientific Electronic Library Online (English)
Jesús D., Villalba; Ivan D., Gómez; José E., Laier.
2012-06-01
Full Text Available En este trabajo se presenta una red neuronal perceptron multicapa combinada con el método Nelder-Mead Simplex para detectar daño en vigas. Los parámetros de entrada a la red se basan en frecuencias naturales y flexibilidad modal. Se considera que solo una cantidad específica de modos fueron identifi [...] cados y que se dispone de mediciones en grados de libertad verticales. La confiabilidad de la metodología propuesta se evalúa a partir de escenarios de daño aleatorios y de la definición de 3 tipos de error que la red puede cometer durante el proceso de detección del daño. Los resultados muestran que la metodología puede determinar confiablemente los escenarios de daño buscados. Sin embargo, su aplicación a vigas de gran tamaño puede verse limitada por el elevado costo computacional asociado al entrenamiento de la red. Abstract in english In this paper is presented a multilayer perceptron neural network combined with the Nelder-Mead Simplex method to detect damage in multiple support beams. The input parameters are based on natural frequencies and modal flexibility. It was considered that only a number of modes were available and tha [...] t only vertical degrees of freedom were measured. The reliability of the proposed methodology is assessed from the generation of random damages scenarios and the definition of three types of errors, which can be found during the damage identification process. Results show that the methodology can reliably determine the damage scenarios. However, its application to large beams may be limited by the high computational cost of training the neural network.
Salcedo-Sanz, S.; Camacho, J. L.; Pérez-Bellido, Á. M.; Hernández-Martín, E.
2010-12-01
In this paper we present a novel method for deseasonalizing TOC data using non-linear models, with evolutionary computation techniques, and its performance with a neural network as regression approach. Specifically, the proposed deseasonalization method uses an evolutionary programming (EP) approach to carry out a curve fitting problem, where a given function model is optimized to be as similar as possible to an objective curve (a real TOC measurement in this case). Different non-linear models are proposed to be optimized with the EP algorithm. In addition, we test the possibility of deseasonalizing the TOC measurement and also the meteorological input data. The deseasonalized series is then used to train a neural network (multi-layer perceptron). We test the proposed models in the prediction of several TOC series in the Iberian Peninsula, where we carry out a comparison against a reference deseasonalizing model previously proposed in the literature. The results obtained show the good performance of some of the deseasonalizing models proposed in this paper.
Maran, J Prakash; Priya, B
2015-03-01
The present study is to evaluate and compare the prediction and simulating efficiencies of response surface methodology (RSM) and artificial neural network (ANN) based models on fatty acid methyl esters (FAME) yield achieved from muskmelon oil (MMO) under ultrasonication by two step in situ process. In first in situ process, free fatty acid content of MMO was reduced from 6.43% to 0.91% using H2SO4 as acid catalyst and organic phase in the first step was subjected to second reaction by adding KOH in methanol as basic catalyst. The influence of process variables (methanol to oil molar ratio, catalyst concentration, reaction temperature and reaction time) on conversion of FAME (second step) was investigated by central composite rotatable design (CCRD) of RSM and Multi-Layer Perceptron (MLP) neural network with the topology of 4-7-1. Both (RSM and ANN) were statistically compared by the coefficient of determination, root mean square error and absolute average deviation, based on the validation data set. The coefficient of determination (R(2)) calculated from the validation data for RSM and ANN models were 0.869 and 0.991 respectively. While both models showed good predictions in this study. But, the ANN model was more precise compared to the RSM model and it showed that, ANN is to be a powerful tool for modeling and optimizing FAME production. PMID:25457517
Rai, H. M.; Trivedi, A.; Chatterjee, K.; Shukla, S.
2014-01-01
This paper employed the Daubechies wavelet transform (WT) for R-peak detection and radial basis function neural network (RBFNN) to classify the electrocardiogram (ECG) signals. Five types of ECG beats: normal beat, paced beat, left bundle branch block (LBBB) beat, right bundle branch block (RBBB) beat and premature ventricular contraction (PVC) were classified. 500 QRS complexes were arbitrarily extracted from 26 records in Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) arrhythmia database, which are available on Physionet website. Each and every QRS complex was represented by 21 points from p1 to p21 and these QRS complexes of each record were categorized according to types of beats. The system performance was computed using four types of parameter evaluation metrics: sensitivity, positive predictivity, specificity and classification error rate. The experimental result shows that the average values of sensitivity, positive predictivity, specificity and classification error rate are 99.8%, 99.60%, 99.90% and 0.12%, respectively with RBFNN classifier. The overall accuracy achieved for back propagation neural network (BPNN), multilayered perceptron (MLP), support vector machine (SVM) and RBFNN classifiers are 97.2%, 98.8%, 99% and 99.6%, respectively. The accuracy levels and processing time of RBFNN is higher than or comparable with BPNN, MLP and SVM classifiers.
International Nuclear Information System (INIS)
In this research, feed forward ANN (Artificial Neural Network) model is developed and validated for predicting the pH at 10 different locations of the distribution system of drinking water of Hyderabad city. The developed model is MLP (Multilayer Perceptron) with back propagation algorithm. The data for the training and testing of the model are collected through an experimental analysis on weekly basis in a routine examination for maintaining the quality of drinking water in the city. 17 parameters are taken into consideration including pH. These all parameters are taken as input variables for the model and then pH is predicted for 03 phases;raw water of river Indus,treated water in the treatment plants and then treated water in the distribution system of drinking water. The training and testing results of this model reveal that MLP neural networks are exceedingly extrapolative for predicting the pH of river water, untreated and treated water at all locations of the distribution system of drinking water of Hyderabad city. The optimum input and output weights are generated with minimum MSE (Mean Square Error) < 5%. Experimental, predicted and tested values of pH are plotted and the effectiveness of the model is determined by calculating the coefficient of correlation (R2=0.999) of trained and tested results. (author)
Braga, C C
2001-01-01
A neural network structure has been used for unfolding neutron spectra measured by means of a Bonner Sphere Spectrometer set and a foil activation set using several neutron induced reactions. The present work used the SNNS (Stuttgart Neural Network Simulator) as the interface for designing, training and validation of the Multilayer Perceptron network. The back-propagation algorithm was applied. The Bonner Sphere set chosen has been calibrated at the National Physical Laboratory, United Kingdom, and uses gold activation foils as thermal neutron detectors. The neutron energy covered by the response functions goes from 0.0001 eV to 14 MeV. The foil activation set chosen has been irradiated at the IEA-R1 research reactor and measured at the Nuclear Metrology Laboratory of IPEN-CNEN/SP. Two types of neutron spectra were numerically investigated: monoenergetic and continuous The unfolded spectra were compared to a conventional method using code SAND-II as part of the neutron dosimetry system SAIPS. Good results wer...
Stramaglia, Sebastiano; Satalino, Giuseppe; Sternieri, A.; Anelli, P.; Blonda, Palma N.; Pasquariello, Guido
1998-10-01
We consider the problem of classification of remote sensed data from LANDSAT Thematic Mapper images. The data have been acquired in July 1986 on an area locate din South Italy. We compare the performance obtained by feed-forward neural networks designed by a parallel genetic algorithm to determine their topology with the ones obtained by means of a multi-layer perceptron trained with Back Propagation learning rule. The parallel genetic algorithm, implemented on the APE100/Quadrics platform, is based on the coding scheme recently proposed by Sternieri and Anelli and exploits a recently proposed environment for genetic algorithms on Quadrics, called AGAPE. The SASIMD architecture of Quadrics forces the chromosome representation. The coding scheme provides that the connections weights of the neural network are organized as a floating point string. The parallelization scheme adopted is the elitistic coarse grained stepping stone model, with migration occurring only towards neighboring processors. The fitness function depends on the mean square error.After fixing the total number of individuals and running the algorithm on Quadrics architectures with different number of processors, the proposed parallel genetic algorithm displayed a superlinear speedup. We report results obtained on a data set made of 1400 patterns.
Pérez de Alejo, Rigoberto; Ruiz-Cabello, Jesús; Cortijo, Manuel; Rodriguez, Ignacio; Echave, Imanol; Regadera, Javier; Arrazola, Juan; Avilés, Pablo; Barreiro, Pilar; Gargallo, Domingo; Graña, Manuel
2003-10-01
An accurate computer-assisted method able to perform regional segmentation on 3D single modality images and measure its volume is designed using a mixture of unsupervised and supervised artificial neural networks. Firstly, an unsupervised artificial neural network is used to estimate representative textures that appear in the images. The region of interest of the resultant images is selected by means of a multi-layer perceptron after a training using a single sample slice, which contains a central portion of the 3D region of interest. The method was applied to magnetic resonance imaging data collected from an experimental acute inflammatory model (T(2) weighted) and from a clinical study of human Alzheimer's disease (T(1) weighted) to evaluate the proposed method. In the first case, a high correlation and parallelism was registered between the volumetric measurements, of the injured and healthy tissue, by the proposed method with respect to the manual measurements (r = 0.82 and p < 0.05) and to the histopathological studies (r = 0.87 and p < 0.05). The method was also applied to the clinical studies, and similar results were derived of the manual and semi-automatic volumetric measurement of both hippocampus and the corpus callosum (0.95 and 0.88). PMID:14599541
Scientific Electronic Library Online (English)
Sandra P, Mateus; Natalia, González; John W, Branch.
Full Text Available SciELO Chile | Language: Spanish Abstract in spanish En este trabajo se presenta la creación de dos Entornos Virtuales Inteligentes (EVI) con Redes Neuronales Artificiales (RNA). En un EVI se realiza el diagnóstico de problemas visuales como astigmatismo, miopía e hipermetropía. El otro se enfoca, en la percepción y el razonamiento de señales de adver [...] tencia en un entorno laboral. En el desarrollo del trabajo, se hace primero una caracterización de las Redes Neuronales Artificiales y luego se hace una simulación de ellas; de acuerdo a los resultados obtenidos, se selecciona una arquitectura de red (Perceptrón Multicapa) y ésa es la que se implementa en los EVI. Finalmente se abordan las limitantes del tiempo en el aprendizaje de la RNA y en el costo computacional aplicados a los EVI. Abstract in english In this paper, the creation and application of two Intelligent Virtual Environments (IVE) with Artificial Neural Networks (ANN) are presented. In one EVI, the diagnosis of vision problems like astigmatism, myopia and hyperopia is studied. The other one focuses to the perception and reasoning of warn [...] ing signals in a work environment. For the development of this paper, the characterization of Artificial Neural Networks is done, followed by the simulation; according to the results one network architecture is selected (Multilayer Perceptron) and then implemented in the IVE. Finally the time constraints in ANN learning and in computational cost applied to IVE are discussed.
Energy Technology Data Exchange (ETDEWEB)
Rouss, Vicky; Charon, Willy [M3M, Universite de Technologie de Belfort Montbeliard, Rue de Chateau, 90010 Belfort (France)
2008-01-03
A fuel cell system model is necessary to prepare and analyse vibration tests. However, in the literature, the mechanical aspect of the fuel cell systems is neglected. In this paper, a neural network modelling approach for the mechanical nonlinear behaviour of a proton exchange membrane (PEM) fuel cell system is proposed. An experimental set is designed for this purpose: a fuel cell system in operation is subjected to random and swept-sine excitations on a vibrating platform in three axes directions. Its mechanical response is measured with three-dimensional accelerometers. The raw experimental data are exploited to create a multi-input and multi-output (MIMO) model using a multi-layer perceptron neural network combined with a time regression input vector. The model is trained and tested. Results from the analysis show good prediction accuracy. This approach is promising because it can be extended to further complex applications. In the future, the mechanical fuel cell system controller will be implemented on a real-time system that provides an environment to analyse the performance and optimize mechanical parameters design of the PEM fuel system and its auxiliaries. (author)
Breaking a chaotic image encryption algorithm based on perceptron model
Zhang, Yu; Li, Chengqing; Li, Qin; Zhang, Dan; Shu, Shi
2011-01-01
Recently, a chaotic image encryption algorithm based on perceptron model was proposed. The present paper analyzes security of the algorithm and finds that the equivalent secret key can be reconstructed with only one pair of known-plaintext/ciphertext, which is supported by both mathematical proof and experiment results. In addition, some other security defects are also reported.
Training a perceptron by a bit sequence: Storage capacity
Schroeder, M.; Kinzel, W.; Kanter, I.
1996-01-01
A perceptron is trained by a random bit sequence. In comparison to the corresponding classification problem, the storage capacity decreases to alpha_c=1.70\\pm 0.02 due to correlations between input and output bits. The numerical results are supported by a signal to noise analysis of Hebbian weights.
Land, Walker H., Jr.; Masters, Timothy D.; Lo, Joseph Y.; McKee, Dan
2001-07-01
A new neural network technology was developed for improving the benign/malignant diagnosis of breast cancer using mammogram findings. A new paradigm, Adaptive Boosting (AB), uses a markedly different theory in solutioning Computational Intelligence (CI) problems. AB, a new machine learning paradigm, focuses on finding weak learning algorithm(s) that initially need to provide slightly better than random performance (i.e., approximately 55%) when processing a mammogram training set. Then, by successive development of additional architectures (using the mammogram training set), the adaptive boosting process improves the performance of the basic Evolutionary Programming derived neural network architectures. The results of these several EP-derived hybrid architectures are then intelligently combined and tested using a similar validation mammogram data set. Optimization focused on improving specificity and positive predictive value at very high sensitivities, where an analysis of the performance of the hybrid would be most meaningful. Using the DUKE mammogram database of 500 biopsy proven samples, on average this hybrid was able to achieve (under statistical 5-fold cross-validation) a specificity of 48.3% and a positive predictive value (PPV) of 51.8% while maintaining 100% sensitivity. At 97% sensitivity, a specificity of 56.6% and a PPV of 55.8% were obtained.
Constructive Training Methods for Feedforward Neural Networks with Binary Weights
Mayoraz, Eddy; Aviolat, Fre?de?ric
1996-01-01
Quantization of the parameters of a Perceptron is a central problem in hardware implementation of neural networks using a numerical technology. A neural model with each weight limited to a small integer range will require little surface of silicon. Moreover, according to Occam's razor principle, better generalization abilities can be expected from a simpler computational model. The price to pay for these benefits lies in the difficulty to train these kind of networks. This paper proposes esse...
Energy Technology Data Exchange (ETDEWEB)
Labrador, I.; Carrasco, R.; Martinez, L.
1996-07-01
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs.
International Nuclear Information System (INIS)
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs
Directory of Open Access Journals (Sweden)
Teodorico Alves Sobrinho
2011-06-01
Full Text Available A estimativa da evapotranspiração por métodos indiretos propicia, de modo facilitado, a geração de dados para o planejamento de sistemas de irrigação e aplicação de modelos meteorológicos e hidrológicos, ambos, úteis na gestão de bacias hidrográficas. O objetivo deste trabalho foi elaborar uma Rede Neural Artificial (RNA para estimar a evapotranspiração de referência (Eto em função de dados diários de temperatura do ar. A RNA, do tipo FeedForward Multilayer Perceptron, foi treinada tomando-se por referência a Eto diária obtida pelo método de Penman-Monteith. Nas camadas intermediárias e de saída foram utilizadas funções de ativação do tipo tan-sigmóide e lineares, respectivamente. Os valores de Eto gerados pela RNA foram comparados com os obtidos pelos métodos de Blanney-Criddle e Hargreaves considerando meses referentes às quatro estações do ano. Em relação aos outros métodos analisados, os resultados obtidos a partir da RNA foram mais próximos ao método padrão Penman-Monteith. Assim, o desempenho da RNA desenvolvida foi satisfatório, podendo-se considerá-la como integrante do conjunto de métodos indiretos para estimativa da evapotranspiração, além de representar uma diminuição dos custos de aquisição de dados para estimativa desta variável.The estimation of evapotranspiration by indirect methods provides synthetic data for planning irrigation systems and application on meteorological and hydrological models, both useful in watershed management. The objective of this study was to develop an Artificial Neural Network (ANN to estimate the reference evapotranspiration (Eto based on daily air temperature data. The ANN model of Feedforward Multilayer Perceptron type, was trained using as a reference the daily Eto obtained by the Penman-Monteith method. In the intermediate and output layers were used activation functions like tan-sigmoid and linear, respectively. Eto values generated by ANN were compared with those obtained by the methods of Blanney-Criddle and Hargreaves considering the months of the four seasons. Comparing to the other analyzed methods, the results obtained from the ANN were closer to the standard Penman-Monteith method. Thus, the performance of the developed ANN was satisfactory, and the ANN model can be considered as one indirect method for estimating evapotranspiration and allows a cost reduction on data acquisition to estimate this variable.
UNREALIZABLE LEARNING IN BINARY FEEDFORWARD NEURAL NETWORKS
Sporre, Matts
1995-01-01
Statistical mechanics is used to study unrealizable generalization in two large feed-forward neural networks with binary weights and output, a perceptron and a tree committee machine. The student is trained by a teacher being larger, i.e. having more units than the student. It is shown that this is the same as using training data corrupted by Gaussian noise. Each machine is considered in the high temperature limit and in the replica symmetric approximation as well as for one...
UNREALIZABLE LEARNING IN FEEDFORWARD NEURAL NETWORKS
Sporre, Matts
1995-01-01
Statistical mechanics is used to study unrealizable generalization in two large feed-forward neural networks with binary weights and output, a perceptron and a tree committee machine. The student is trained by a teacher being larger, i.e. having more units than the student. It is shown that this is the same as using training data corrupted by Gaussian noise. Each machine is considered in the high temperature limit and in the replica symmetric approximation as well as for one...
Techniques for Learning Binary Stochastic Feedforward Neural Networks
Raiko, Tapani; Berglund, Mathias; Alain, Guillaume; Dinh, Laurent
2014-01-01
Stochastic binary hidden units in a multi-layer perceptron (MLP) network give at least three potential benefits when compared to deterministic MLP networks. (1) They allow to learn one-to-many type of mappings. (2) They can be used in structured prediction problems, where modeling the internal structure of the output is important. (3) Stochasticity has been shown to be an excellent regularizer, which makes generalization performance potentially better in general. However, tr...
Computationally efficient model predictive control algorithms a neural network approach
?awry?czuk, Maciej
2014-01-01
This book thoroughly discusses computationally efficient (suboptimal) Model Predictive Control (MPC) techniques based on neural models. The subjects treated include: · A few types of suboptimal MPC algorithms in which a linear approximation of the model or of the predicted trajectory is successively calculated on-line and used for prediction. · Implementation details of the MPC algorithms for feedforward perceptron neural models, neural Hammerstein models, neural Wiener models and state-space neural models. · The MPC algorithms based on neural multi-models (inspired by the idea of predictive control). · The MPC algorithms with neural approximation with no on-line linearization. · The MPC algorithms with guaranteed stability and robustness. · Cooperation between the MPC algorithms and set-point optimization. Thanks to linearization (or neural approximation), the presented suboptimal algorithms do not require d...
The Role of Weight Shrinking in Large Margin Perceptron Learning
Panagiotakopoulos, Constantinos
2012-01-01
We introduce into the classical perceptron algorithm with margin a mechanism that shrinks the current weight vector as a first step of the update. If the shrinking factor is constant the resulting algorithm may be regarded as a margin-error-driven version of NORMA with constant learning rate. In this case we show that the allowed strength of shrinking depends on the value of the maximum margin. We also consider variable shrinking factors for which there is no such dependence. In both cases we obtain new generalizations of the perceptron with margin able to provably attain in a finite number of steps any desirable approximation of the maximal margin hyperplane. The new approximate maximum margin classifiers appear experimentally to be very competitive in 2-norm soft margin tasks involving linear kernels.
The Cavity Approach to Noisy Learning in Nonlinear Perceptrons
Luo, P; Luo, Peixun
2001-01-01
We analyze the learning of noisy teacher-generated examples by nonlinear and differentiable student perceptrons using the cavity method. The generic activation of an example is a function of the cavity activation of the example, which is its activation in the perceptron that learns without the example. Mean field equations for the macroscopic parameters and the stability condition yield results consistent with the replica method. When a single value of the cavity activation maps to multiple values of the generic activation, there is a competition in learning strategy between preferentially learning an example and sacrificing it in favor of the background adjustment. We find parameter regimes in which examples are learned preferentially or sacrificially, leading to a gap in the activation distribution. Full phase diagrams of this complex system are presented, and the theory predicts the existence of a phase transition from poor to good generalization states in the system. Simulation results confirm the theoret...
Son, J E
1996-12-01
The optimum management of nutrient solution in soilless culture needs the accurate control of nutrient solution, especially in recycled soilless culture system. To keep the electrical conductivity (EC) of nutrient solution within the adequate range after application of combined fertilizers, theoretically derived EC prediction methods are required. In this study, the experimental EC prediction equation, an extended form of the Robinson and Stroke's theoretical equation only available for a binary electrolyte, was developed for predicting the EC of the nutrient solution containing many kinds of inorganic compounds. And the multilayer perceptron consisting of three layers with the back propagation learning algorithm was developed for EC prediction. It consists of nine variables in the input layer for the concentrations of seven macro elements, Na+ and Cl, and one variable in the output layer for the EC of nutrient solution. The predicted ECs by experimental model as well as neural networks for the nutrient solution were compared to the measured ones and showed good agreements. PMID:11541580
Use of artificial neural networks and geographic objects for classifying remote sensing imagery
Directory of Open Access Journals (Sweden)
Pedro Resende Silva
2014-06-01
Full Text Available The aim of this study was to develop a methodology for mapping land use and land cover in the northern region of Minas Gerais state, where, in addition to agricultural land, the landscape is dominated by native cerrado, deciduous forests, and extensive areas of vereda. Using forest inventory data, as well as RapidEye, Landsat TM and MODIS imagery, three specific objectives were defined: 1 to test use of image segmentation techniques for an object-based classification encompassing spectral, spatial and temporal information, 2 to test use of high spatial resolution RapidEye imagery combined with Landsat TM time series imagery for capturing the effects of seasonality, and 3 to classify data using Artificial Neural Networks. Using MODIS time series and forest inventory data, time signatures were extracted from the dominant vegetation formations, enabling selection of the best periods of the year to be represented in the classification process. Objects created with the segmentation of RapidEye images, along with the Landsat TM time series images, were classified by ten different Multilayer Perceptron network architectures. Results showed that the methodology in question meets both the purposes of this study and the characteristics of the local plant life. With excellent accuracy values for native classes, the study showed the importance of a well-structured database for classification and the importance of suitable image segmentation to meet specific purposes.
Directory of Open Access Journals (Sweden)
GEMAN, O.
2014-02-01
Full Text Available Neurological diseases like Alzheimer, epilepsy, Parkinson's disease, multiple sclerosis and other dementias influence the lives of patients, their families and society. Parkinson's disease (PD is a neurodegenerative disease that occurs due to loss of dopamine, a neurotransmitter and slow destruction of neurons. Brain area affected by progressive destruction of neurons is responsible for controlling movements, and patients with PD reveal rigid and uncontrollable gestures, postural instability, small handwriting and tremor. Commercial activity-promoting gaming systems such as the Nintendo Wii and Xbox Kinect can be used as tools for tremor, gait or other biomedical signals acquisitions. They also can aid for rehabilitation in clinical settings. This paper emphasizes the use of intelligent optical sensors or accelerometers in biomedical signal acquisition, and of the specific nonlinear dynamics parameters or fuzzy logic in Parkinson's disease tremor analysis. Nowadays, there is no screening test for early detection of PD. So, we investigated a method to predict PD, based on the image processing of the handwriting belonging to a candidate of PD. For classification and discrimination between healthy people and PD people we used Artificial Neural Networks (Radial Basis Function - RBF and Multilayer Perceptron - MLP and an Adaptive Neuro-Fuzzy Classifier (ANFC. In general, the results may be expressed as a prognostic (risk degree to contact PD.
Two-dimensional shape classification using generalized Fourier representation and neural networks
Chodorowski, Artur; Gustavsson, Tomas; Mattsson, Ulf
2000-04-01
A shape-based classification method is developed based upon the Generalized Fourier Representation (GFR). GFR can be regarded as an extension of traditional polar Fourier descriptors, suitable for description of closed objects, both convex and concave, with or without holes. Explicit relations of GFR coefficients to regular moments, moment invariants and affine moment invariants are given in the paper. The dual linear relation between GFR coefficients and regular moments was used to compare shape features derive from GFR descriptors and Hu's moment invariants. the GFR was then applied to a clinical problem within oral medicine and used to represent the contours of the lesions in the oral cavity. The lesions studied were leukoplakia and different forms of lichenoid reactions. Shape features were extracted from GFR coefficients in order to classify potentially cancerous oral lesions. Alternative classifiers were investigated based on a multilayer perceptron with different architectures and extensions. The overall classification accuracy for recognition of potentially cancerous oral lesions when using neural network classifier was 85%, while the classification between leukoplakia and reticular lichenoid reactions gave 96% (5-fold cross-validated) recognition rate.
Rodrigo, J.; Hontoria, L.; Almonacid, F.; Fernández, Eduardo F.; Rodrigo, P. M.; Pérez-Higueras, P. J.
2012-10-01
The use of concentrators implies that CPV systems only work with the Direct Normal Irradiance (DNI). So it is necessary to know DNI data in order to estimate the energy that will be produced by the system, perform economic analysis, supervise plant operation, etc. However, DNI Typical Meteorological Year datasets are expensive and rarely available due to the cost and sophistication of measurement devices and data processing requirements. Particularly, there is a lack of data on the Sunbelt countries, which are more favorable for the use of CPV. In this work, an artificial neural network is used for the generation of DNI hourly time series for some Spanish locations. The model was trained and tested with different locations and different year's data. Although several authors have proposed different methods for the generation of solar radiation synthetic series, these methods are for global radiation and flat panel, nevertheless, we calculate them for direct normal solar radiation and used for CPV systems. A Multilayer Perceptron is explained, looking over the first rudimentary initial version and the last more elaborated final version. Finally, an application of this methodology is presented.
Aspects of artificial neural networks - with applications in high energy physics
International Nuclear Information System (INIS)
Different aspects of artificial neural networks are studied and discussed. They are demonstrated to be powerful general purpose algorithms, applicable to many different problem areas like pattern recognition, function fitting and prediction. Multi-layer perceptron (MPL) models are shown to out perform previous standard approaches on both off-line and on-line analysis tasks in high energy physics, like quark flavour tagging and mass reconstruction, as well as being powerful tools for prediction tasks. It is also demonstrated how a self-organizing network can be employed to extract information from data, for instance to track down origins of unexpected model discrepancies. Furthermore, it is proved that the MPL is more efficient than the learning vector quantization technique on classification problems, by producing smoother discrimination surfaces, and that an MPL network should be trained with a noisy updating schedule if the Hessian is ill-conditioned - A result that is especially important for MPL network with more than just one hidden layer. 81 refs, 6 figs
Estuary water-stage forecasting by using radial basis function neural network
Chang, Fi-John; Chen, Yen-Chang
2003-01-01
The Radial basis function neural network (RBFNN) has been successfully applied to many tasks due to its powerful properties in classification and functional approximation. This paper presents a novel RBFNN for water-stage forecasting in an estuary under high flood and tidal effects. The RBFNN adopts a hybrid two-stage learning scheme, unsupervised and supervised learning. In the first scheme, fuzzy min-max clustering is proposed for choosing best patterns for cluster representation in an efficient and automatic way. The second scheme uses supervised learning, which is a multivariate linear regression method to produce a weighted sum of the output from the hidden layer. Since this network has only one layer using a supervised learning algorithm, its training process is much faster than the error back propagation based multilayer perceptrons. Moreover, only one parameter, ?, must be determined manually. The other parameters used in this model can be adjusted automatically by model training. The water-stage data of the Tanshui River under tidal effect are used to construct a water-stage forecasting model that can also be used during flood. The results show that the RBFNN can be applied successfully and provide high accuracy and reliability of water-stage forecasting in an estuary.
Optical bandgap modeling of thermal annealed ZnO:Ga thin films using neural networks
Energy Technology Data Exchange (ETDEWEB)
Kim, Chang Eun; Moon, Pyung; Yun, Ilgu [School of Electrical and Electronic Engineering, Yonsei University, 262 Seongsanno, Seodaemoon-gu, Seoul 120-749 (Korea); Kim, Sungyeon; Myoung, Jae-Min [Department of Materials Science and Engineering, Yonsei University, 262 Seongsanno, Seodaemoon-gu, Seoul 120-749 (Korea); Jang, Hyeon Woo; Bang, Jungsik [LG Chem, Ltd., Research Park, 104-1 Moonji-Dong, Yuseng-Gu, Daejeon 305-380 (Korea)
2010-07-15
In this paper, the thermal annealing process modeling for the optical bandgap of ZnO:Ga thin films for transparent conductive oxide was presented using neural network (NNets) based on error backpropagation (BPNN) algorithm and multilayer perceptron (MLP). The thermal annealing process of ZnO:Ga thin films were analyzed by general factorial experimental design. The annealing temperature and film thickness were considered as input factors. To model the nonlinear annealing process, 6 experiments were trained by BPNN which has 2-4-1 structures and 2 additional samples were experimented to verify the predicted models. The output response model on optical bandgap and carrier concentration of ZnO:Ga thin films trained by BPNN was represented by surface plot of response surface model. Based on the modeling results, NNets can provide sufficient correspondence between the predicted output values and the measured. The optical bandgap variation of ZnO:Ga thin films by annealing is due to increased carrier concentration and explained by Burstein-Moss effect. The thermal annealing process is nonlinear and complex but the output response can be predicted by the NNets model. (Abstract Copyright [2010], Wiley Periodicals, Inc.)