Prediction of Parametric Roll Resonance by Multilayer Perceptron Neural Network
Míguez González, M; López Peña, F.; Díaz Casás, V.; Galeazzi, Roberto; Blanke, Mogens
acknowledged in the last few years. This work proposes a prediction system based on a multilayer perceptron (MP) neural network. The training and testing of the MP network is accomplished by feeding it with simulated data of a three degrees-of-freedom nonlinear model of a fishing vessel. The neural network is...
Optical proximity correction using a multilayer perceptron neural network
Luo, Rui
2013-07-01
Optical proximity correction (OPC) is one of the resolution enhancement techniques (RETs) in optical lithography, where the mask pattern is modified to improve the output pattern fidelity. Algorithms are needed to generate the modified mask pattern automatically and efficiently. In this paper, a multilayer perceptron (MLP) neural network (NN) is used to synthesize the mask pattern. We employ the pixel-based approach in this work. The MLP takes the pixel values of the desired output wafer pattern as input, and outputs the optimal mask pixel values. The MLP is trained with the backpropagation algorithm, with a training set retrieved from the desired output pattern, and the optimal mask pattern obtained by the model-based method. After training, the MLP is able to generate the optimal mask pattern non-iteratively with good pattern fidelity.
Optical proximity correction using a multilayer perceptron neural network
Optical proximity correction (OPC) is one of the resolution enhancement techniques (RETs) in optical lithography, where the mask pattern is modified to improve the output pattern fidelity. Algorithms are needed to generate the modified mask pattern automatically and efficiently. In this paper, a multilayer perceptron (MLP) neural network (NN) is used to synthesize the mask pattern. We employ the pixel-based approach in this work. The MLP takes the pixel values of the desired output wafer pattern as input, and outputs the optimal mask pixel values. The MLP is trained with the backpropagation algorithm, with a training set retrieved from the desired output pattern, and the optimal mask pattern obtained by the model-based method. After training, the MLP is able to generate the optimal mask pattern non-iteratively with good pattern fidelity. (paper)
Classification of fused face images using multilayer perceptron neural network
Bhattacharjee, Debotosh; Nasipuri, Mita; Basu, Dipak Kumar; Kundu, Mahantapas
2010-01-01
This paper presents a concept of image pixel fusion of visual and thermal faces, which can significantly improve the overall performance of a face recognition system. Several factors affect face recognition performance including pose variations, facial expression changes, occlusions, and most importantly illumination changes. So, image pixel fusion of thermal and visual images is a solution to overcome the drawbacks present in the individual thermal and visual face images. Fused images are projected into eigenspace and finally classified using a multi-layer perceptron. In the experiments we have used Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database benchmark thermal and visual face images. Experimental results show that the proposed approach significantly improves the verification and identification performance and the success rate is 95.07%. The main objective of employing fusion is to produce a fused image that provides the most detailed and reliable information. Fusion of multip...
Vanzella, E.; Cristiani, S.; Fontana, A.; M. Nonino(INAF/OAT); Arnouts, S.; Giallongo, E.; Grazian, A.; Fasano, G.; Popesso, P.; Saracco, P.; Zaggia, S.
2003-01-01
We present a technique for the estimation of photometric redshifts based on feed-forward neural networks. The Multilayer Perceptron (MLP) Artificial Neural Network is used to predict photometric redshifts in the HDF-S from an ultra deep multicolor catalog. Various possible approaches for the training of the neural network are explored, including the deepest and most complete spectroscopic redshift catalog currently available (the Hubble Deep Field North dataset) and models of the spectral ene...
Flávio Clésio Silva de Souza
2014-06-01
Full Text Available The purpose of the present research is to apply a Multilayer Perceptron (MLP neural network technique to create classification models from a portfolio of Non-Performing Loans (NPLs to classify this type of credit derivative. These credit derivatives are characterized as the amount of loans that were not paid and are already overdue more than 90 days. Since these titles are, because of legislative motives, moved by losses, Credit Rights Investment Funds (FDIC performs the purchase of these debts and the recovery of the credits. Using the Multilayer Perceptron (MLP architecture of Artificial Neural Network (ANN, classification models regarding the posterior recovery of these debts were created. To evaluate the performance of the models, evaluation metrics of classification relating to the neural networks with different architectures were presented. The results of the classifications were satisfactory, given the classification models were successful in the presented economics costs structure.
This paper deals with the controversial topic of the selection of the parameters of a genetic algorithm, in this case hierarchical, used for training of multilayer perceptron neural networks for the binary classification. The parameters to select are the crossover and mutation probabilities of the control and parametric genes and the permanency percent. The results can be considered as a guide for using this kind of algorithm.
Evolutionary Learning of Multi-Layer Perceptron Neural Networks
Neruda, Roman; Slušný, Stanislav
Košice : Prírodovedecká fakulta, Univerzita P. J. Šafárika, 2006 - (Vojtáš, P.), s. 125-130 ISBN 80-969184-4-3. [ITAT 2006. Workshop on Theory and Practice of Information Theory. Bystrá dolina (SK), 26.09.2006-01.10.2006] R&D Projects: GA AV ČR 1ET100300419 Institutional research plan: CEZ:AV0Z10300504 Keywords : perceptron networks * learning * evolutionary algorithms Subject RIV: IN - Informatics, Computer Science
Apply Multi-Layer Perceptrons Neural Network for Off-Line Signature Verification and Recognition
Suhail Odeh
2011-11-01
Full Text Available This paper discusses the applying of Multi-layer perceptrons for signature verification and recognition using a new approach enables the user to recognize whether a signature is original or a fraud. The approach starts by scanning images into the computer, then modifying their quality through image enhancement and noise reduction, followed by feature extraction and neural network training, and finally verifies the authenticity of the signature. The paper discusses the different stages of the process including: image pre-processing, feature extraction and pattern recognition through neural networks.
Classification of fuels using multilayer perceptron neural networks
Electrical impedance data obtained with an array of conducting polymer chemical sensors was used by a neural network (ANN) to classify fuel adulteration. Real samples were classified with accuracy greater than 90% in two groups: approved and adulterated.
Learning multilayer perceptrons efficiently
Bunzmann, C.; Biehl, M.; Urbanczik, R
2001-01-01
A learning algorithm for multilayer perceptrons is presented which is based on finding the principal components of a correlation matrix computed from the example inputs and their target outputs. For large networks our procedure needs far fewer examples to achieve good generalization than traditional on-line algorithms.
Generation of hourly irradiation synthetic series using the neural network multilayer perceptron
Hontoria, L.; Aguilera, J. [Universidad de Jaen, Linares-Jaen (Spain). Dpto. de Electronica; Zufiria, P. [Ciudad Universitaria, Madrid (Spain). Grupo de Redes Neuronales
2002-05-01
In this work, a methodology based on the neural network model called multilayer perceptron (MLP) to solve a typical problem in solar energy is presented. This methodology consists of the generation of synthetic series of hourly solar irradiation. The model presented is based on the capacity of the MLP for finding relations between variables for which interrelation is unknown explicitly. The information available can be included progressively at the series generator at different stages. A comparative study with other solar irradiation synthetic generation methods has been done in order to demonstrate the validity of the one proposed. (author)
Zhang, Haowei; Gao, Yanni; Yuan, Chengmei; Liu, Ying; Ding, Yuqing
2015-06-01
Multi-layer perceptron (MLP) neural network belongs to multi-layer feedforward neural network, and has the ability and characteristics of high intelligence. It can realize the complex nonlinear mapping by its own learning through the network. Bipolar disorder is a serious mental illness with high recurrence rate, high self-harm rate and high suicide rate. Most of the onset of the bipolar disorder starts with depressive episode, which can be easily misdiagnosed as unipolar depression and lead to a delayed treatment so as to influence the prognosis. The early identifica- tion of bipolar disorder is of great importance for patients with bipolar disorder. Due to the fact that the process of early identification of bipolar disorder is nonlinear, we in this paper discuss the MLP neural network application in early identification of bipolar disorder. This study covered 250 cases, including 143 cases with recurrent depression and 107 cases with bipolar disorder, and clinical features were statistically analyzed between the two groups. A total of 42 variables with significant differences were screened as the input variables of the neural network. Part of the samples were randomly selected as the learning sample, and the other as the test sample. By choosing different neu- ral network structures, all results of the identification of bipolar disorder were relatively good, which showed that MLP neural network could be used in the early identification of bipolar disorder. PMID:26485974
Mohammad Fathian
2012-04-01
Full Text Available In this paper, the problem of predicting the exchange rate time series in the foreign exchange rate market is going to be solved using a time-delayed multilayer perceptron neural network with gold price as external factor. The input for the learning phase of the artificial neural network are the exchange rate data of the last five days plus the gold price in two different currencies of the exchange rate as the external factor for helping the artificial neural network improving its forecast accuracy. The five-day delay has been chosen because of the weekly cyclic behavior of the exchange rate time series with the consideration of two holidays in a week. The result of forecasts are then compared with using the multilayer peceptron neural network without gold price external factor by two most important evaluation techniques in the literature of exchange rate prediction. For the experimental analysis phase, the data of three important exchange rates of EUR/USD, GBP/USD, and USD/JPY are used.
Umar Draz
2016-01-01
Full Text Available SMEs (Small and Medium Sized Enterprises sector is facing problems relating to implementation of international quality standards. These SMEs need to identify factors affecting business success abroad for intelligent allocation of resources to the process of internationalization. In this paper, MLP NN (Multi-Layer Perceptron Neural Network has been used for identifying relative importance of key variables related to firm basics, manufacturing, quality inspection labs and level of education in determining the exporting status of Pakistani SMEs. A survey has been conducted for scoring out the pertinent variables in SMEs and coded in MLP NNs. It is found that ?firm registered with OEM (Original Equipment Manufacturer and ?size of firm? are the most important in determining exporting status of SMEs followed by other variables. For internationalization, the results aid policy makers in formulating strategies
Highly Accurate Multi-layer Perceptron Neural Network for Air Data System
H. S. Krishna
2009-11-01
Full Text Available The error backpropagation multi-layer perceptron algorithm is revisited. This algorithm is used to train and validate two models of three-layer neural networks that can be used to calibrate a 5-hole pressure probe. This paper addresses Occam's Razor problem as it describes the adhoc training methodology applied to improve accuracy and sensitivity. The trained outputs from 5-4-3 feed-forward network architecture with jump connection are comparable to second decimal digit (~0.05 accuracy, hitherto unreported in literature.Defence Science Journal, 2009,59(6, pp.670-674,DOI:http://dx.doi.org/10.14429/dsj.59.1574
An Analog Multilayer Perceptron Neural Network for a Portable Electronic Nose
Chih-Heng Pan
2012-12-01
Full Text Available This study examines an analog circuit comprising a multilayer perceptron neural network (MLPNN. This study proposes a low-power and small-area analog MLP circuit to implement in an E-nose as a classifier, such that the E-nose would be relatively small, power-efficient, and portable. The analog MLP circuit had only four input neurons, four hidden neurons, and one output neuron. The circuit was designed and fabricated using a 0.18 μm standard CMOS process with a 1.8 V supply. The power consumption was 0.553 mW, and the area was approximately 1.36 × 1.36 mm2. The chip measurements showed that this MLPNN successfully identified the fruit odors of bananas, lemons, and lychees with 91.7% accuracy.
Vanzella, E; Fontana, A; Nonino, M; Arnouts, S; Giallongo, E; Grazian, A; Fasano, G; Popesso, P; Saracco, P; Zaggia, S R
2003-01-01
We present a technique for the estimation of photometric redshifts based on feed-forward neural networks. The Multilayer Perceptron (MLP) Artificial Neural Network is used to predict photometric redshifts in the HDF-S from an ultra deep multicolor catalog. Various possible approaches for the training of the neural network are explored, including the deepest and most complete spectroscopic redshift catalog currently available (the Hubble Deep Field North dataset) and models of the spectral energy distribution of galaxies available in the literature. The MLP can be trained on observed data, theoretical data and mixed samples. The prediction of the method is tested on the spectroscopic sample in the HDF-S (44 galaxies). Over the entire redshift range, $0.1
Geomagnetic Dst index forecast using a multilayer perceptrons artificial neural network
Complete text of publication follows. The best known manifestations of the impact of solar wind on the magnetosphere are the geomagnetic storms. The prediction of geomagnetic field behavior allows the alert of geomagnetic storms occurrence, as those phenomena can cause many damages in the planet. The Artificial Intelligence tools have been applied in many multidisciplinary studies, covering several areas of knowledge, as a choice of approach to the solution of problems with characteristics like non-linearity, imprecision, and other features that can not be easily solved with conventional computational models. Techniques such as Artificial Neural Networks, Expert Systems and Decision Trees have been used in the Space Weather studies to perform tasks such as forecasting geomagnetic storms and the investigation of rules and parameters related on its occurrence. The main focus of this work is on forecasting the geomagnetic field behavior, represented this time by the Dst index, using for that task, mainly, the interplanetary magnetic field components and solar wind data. The tool chosen here to solve the non-linear problem was a Multi-layer Perceptrons Artificial Neural Network, trained with the backpropagation algorithm. Unlike what was done in other studies, we chose to predict calm and disturbed periods like, for example, a full month of data, for application in a real time forecasting system. It was possible to predict the geomagnetic Dst index one or two hours before with great percentage efficiency.
Kamal Ahmed; Shamsuddin Shahid; Sobri Bin Haroon; Wang Xiao-Jun
2015-08-01
Downscaling rainfall in an arid region is much challenging compared to wet region due to erratic and infrequent behaviour of rainfall in the arid region. The complexity is further aggregated due to scarcity of data in such regions. A multilayer perceptron (MLP) neural network has been proposed in the present study for the downscaling of rainfall in the data scarce arid region of Baluchistan province of Pakistan, which is considered as one of the most vulnerable areas of Pakistan to climate change. The National Center for Environmental Prediction (NCEP) reanalysis datasets from 20 grid points surrounding the study area were used to select the predictors using principal component analysis. Monthly rainfall data for the time periods 1961–1990 and 1991–2001 were used for the calibration and validation of the MLP model, respectively. The performance of the model was assessed using various statistics including mean, variance, quartiles, root mean square error (RMSE), mean bias error (MBE), coefficient of determination (R2) and Nash–Sutcliffe efficiency (NSE). Comparisons of mean monthly time series of observed and downscaled rainfall showed good agreement during both calibration and validation periods, while the downscaling model was found to underpredict rainfall variance in both periods. Other statistical parameters also revealed good agreement between observed and downscaled rainfall during both calibration and validation periods in most of the stations.
Ahmed, Kamal; Shahid, Shamsuddin; Haroon, Sobri Bin; Xiao-jun, Wang
2015-08-01
Downscaling rainfall in an arid region is much challenging compared to wet region due to erratic and infrequent behaviour of rainfall in the arid region. The complexity is further aggregated due to scarcity of data in such regions. A multilayer perceptron (MLP) neural network has been proposed in the present study for the downscaling of rainfall in the data scarce arid region of Baluchistan province of Pakistan, which is considered as one of the most vulnerable areas of Pakistan to climate change. The National Center for Environmental Prediction (NCEP) reanalysis datasets from 20 grid points surrounding the study area were used to select the predictors using principal component analysis. Monthly rainfall data for the time periods 1961-1990 and 1991-2001 were used for the calibration and validation of the MLP model, respectively. The performance of the model was assessed using various statistics including mean, variance, quartiles, root mean square error (RMSE), mean bias error (MBE), coefficient of determination (R 2) and Nash-Sutcliffe efficiency (NSE). Comparisons of mean monthly time series of observed and downscaled rainfall showed good agreement during both calibration and validation periods, while the downscaling model was found to underpredict rainfall variance in both periods. Other statistical parameters also revealed good agreement between observed and downscaled rainfall during both calibration and validation periods in most of the stations.
Experiments with Evolutionary and Hybrid Learning of Multi-layer Perceptron Neural Networks
Neruda, Roman; Slušný, Stanislav
Ostrava : VŠB Technická univerzita, 2007 - (Mikulecký, P.; Dvorský, J.; Krátký, M.), s. 75-84 ISBN 978-80-248-1279-3. [Znalosti 2007. Ostrava (CZ), 21.02.2007-23.02.2007] R&D Projects: GA AV ČR 1ET100300414 Institutional research plan: CEZ:AV0Z10300504 Keywords : multilayer perceptron * evolutionary learning * hybrid algorithms Subject RIV: IN - Informatics, Computer Science
Cross Validation Evaluation for Breast Cancer Prediction Using Multilayer Perceptron Neural Networks
Shirin A. Mojarad
2011-01-01
Full Text Available Problem statement: The presence of metastasis in the regional lymph nodes is the most important factor in predicting prognosis in breast cancer. Many biomarkers have been identified that appear to relate to the aggressive behaviour of cancer. However, the nonlinear relation of these markers to nodal status and also the existence of complex interaction between markers have prohibited an accurate prognosis. Approach: The aim of this study is to investigate the effectiveness of a Multilayer Perceptron (MLP for predicting breast cancer progression using a set of four biomarkers of breast tumors. The biomarkers include DNA ploidy, cell cycle distribution (G0G1/G2M, steroid receptors (ER/PR and S-Phase Fraction (SPF. A further objective of the study is to explore the predictive potential of these markers in defining the state of nodal involvement in breast cancer. Two methods of outcome evaluation viz. stratified and simple k-fold Cross Validation (CV are studied in order to assess their accuracy and reliability for neural network validation. Criteria such as output accuracy, sensitivity and specificity are used for selecting the best validation technique besides evaluating the network outcome for different combinations of markers. Results: The results show that stratified 2-fold CV is more accurate and reliable compared to simple k-fold CV as it obtains a higher accuracy and specificity and also provides a more stable network validation in terms of sensitivity. Best prediction results are obtained by using an individual marker-SPF which obtains an accuracy of 65%. Conclusion/Recommendations: Our findings suggest that MLP-based analysis provides an accurate and reliable platform for breast cancer prediction given that an appropriate design and validation method is employed.
Multilayered perceptron neural networks to compute energy losses in magnetic cores
This paper presents a new approach based on multilayered perceptrons (MLPs) to compute the specific energy losses of toroidal wound cores built from 3% SiFe 0.27 mm thick M4, 0.1 and 0.08 mm thin gauge electrical steel strips. The MLP has been trained by a back-propagation and extended delta-bar-delta learning algorithm. The results obtained by using the MLP model were compared with a commonly used conventional method. The comparison has shown that the proposed model improved loss estimation with respect to the conventional method
Quaternionic Multilayer Perceptron with Local Analyticity
Nobuyuki Matsui
2012-11-01
Full Text Available A multi-layered perceptron type neural network is presented and analyzed in this paper. All neuronal parameters such as input, output, action potential and connection weight are encoded by quaternions, which are a class of hypercomplex number system. Local analytic condition is imposed on the activation function in updating neurons’ states in order to construct learning algorithm for this network. An error back-propagation algorithm is introduced for modifying the connection weights of the network.
Vaziri, Nima [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of)]. E-mail: n.vaziri@gmail.com; Hojabri, Alireza [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of); Erfani, Ali [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of); Monsefi, Mehrdad [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of); Nilforooshan, Behnam [Department of Physics, Islamic Azad University, Karaj Branch, Moazen Blvd., Rajaee shahr (Iran, Islamic Republic of)
2007-02-15
Critical heat flux (CHF) is an important parameter for the design of nuclear reactors. Although many experimental and theoretical researches have been performed, there is not a single correlation to predict CHF because it is influenced by many parameters. These parameters are based on fixed inlet, local and fixed outlet conditions. Artificial neural networks (ANNs) have been applied to a wide variety of different areas such as prediction, approximation, modeling and classification. In this study, two types of neural networks, radial basis function (RBF) and multilayer perceptron (MLP), are trained with the experimental CHF data and their performances are compared. RBF predicts CHF with root mean square (RMS) errors of 0.24%, 7.9%, 0.16% and MLP predicts CHF with RMS errors of 1.29%, 8.31% and 2.71%, in fixed inlet conditions, local conditions and fixed outlet conditions, respectively. The results show that neural networks with RBF structure have superior performance in CHF data prediction over MLP neural networks. The parametric trends of CHF obtained by the trained ANNs are also evaluated and results reported.
Critical heat flux (CHF) is an important parameter for the design of nuclear reactors. Although many experimental and theoretical researches have been performed, there is not a single correlation to predict CHF because it is influenced by many parameters. These parameters are based on fixed inlet, local and fixed outlet conditions. Artificial neural networks (ANNs) have been applied to a wide variety of different areas such as prediction, approximation, modeling and classification. In this study, two types of neural networks, radial basis function (RBF) and multilayer perceptron (MLP), are trained with the experimental CHF data and their performances are compared. RBF predicts CHF with root mean square (RMS) errors of 0.24%, 7.9%, 0.16% and MLP predicts CHF with RMS errors of 1.29%, 8.31% and 2.71%, in fixed inlet conditions, local conditions and fixed outlet conditions, respectively. The results show that neural networks with RBF structure have superior performance in CHF data prediction over MLP neural networks. The parametric trends of CHF obtained by the trained ANNs are also evaluated and results reported
Alireza Taravat
2014-12-01
Full Text Available Oil spills represent a major threat to ocean ecosystems and their environmental status. Previous studies have shown that Synthetic Aperture Radar (SAR, as its recording is independent of clouds and weather, can be effectively used for the detection and classification of oil spills. Dark formation detection is the first and critical stage in oil-spill detection procedures. In this paper, a novel approach for automated dark-spot detection in SAR imagery is presented. A new approach from the combination of adaptive Weibull Multiplicative Model (WMM and MultiLayer Perceptron (MLP neural networks is proposed to differentiate between dark spots and the background. The results have been compared with the results of a model combining non-adaptive WMM and pulse coupled neural networks. The presented approach overcomes the non-adaptive WMM filter setting parameters by developing an adaptive WMM model which is a step ahead towards a full automatic dark spot detection. The proposed approach was tested on 60 ENVISAT and ERS2 images which contained dark spots. For the overall dataset, an average accuracy of 94.65% was obtained. Our experimental results demonstrate that the proposed approach is very robust and effective where the non-adaptive WMM & pulse coupled neural network (PCNN model generates poor accuracies.
Proud, Simon Richard
2015-01-01
sigmoid layer, trained with the error back-propagation algorithm. The model is fed by six bands of MSG data (0.6, 0.8, 1.6, 3.9, 6.2 and 10.8 μm) with 10 hidden nodes. The multiple-layer perceptrons lead to a cloud detection accuracy of 88.96%, when trained to map two predefined values that classify cloud...
Sarakhs branch
2012-01-01
Full Text Available This paper presents a multi-layered perceptronneural network (MLPNN method to solve the combinedeconomic and emission dispatch (CEED problem. The harmfulecological effects caused by the emission of particulate andgaseous pollutants like sulfur dioxide (SO2 and oxides ofnitrogen ( NOx can be reduced by adequate distribution ofload between the plants of a power system. However, this leadsto a noticeable increase in the operating cost of the plants. Thispaper presents the (MLPNN method applied for the successfuloperation of the power system subject to economical andenvironmental constraints. The proposed MLP NN method istested for a three plant thermal power system and the results arecompared with the solutions obtained from the classical lambdaiterative technique and simple genetic algorithm (SGA refinedgenetic algorithm (RGA method.
Wind speed estimation using multilayer perceptron
Highlights: • We present a method for determining the average wind speed using neural networks. • We use data from that site in the short term and data from other nearby stations. • The inputs used in the ANN were wind speed and direction data from a station. • The method allows knowing the wind speed without topographical data. - Abstract: Wind speed knowledge is prerequisite in the siting of wind turbines. In consequence the wind energy use requires meticulous and specified knowledge of the wind characteristics at a location. This paper presents a method for determining the annual average wind speed at a complex terrain site by using neural networks, when only short term data are available for that site. This information is useful for preliminary calculations of the wind resource at a remote area having only a short time period of wind measurements measurement in a site. Artificial neural networks are useful for implementing non-linear process variables over time, and therefore are a useful tool for estimating the wind speed. The neural network used is multilayer perceptron with three layers and the supervised learning algorithm used is backpropagation. The inputs used in the neural network were wind speed and direction data from a single station, and the training patterns used correspond to sixty days data. The results obtained by simulating the annual average wind speed at the selected site based on data from nearby stations with correlation coefficients above 0.5 were satisfactory, compared with actual values. Reliable estimations were obtained, with errors below 6%
Newton's Method Backpropagation for Complex-Valued Holomorphic Multilayer Perceptrons
La Corte, Diana Thomson; Zou, Yi Ming
2014-01-01
The study of Newton's method in complex-valued neural networks faces many difficulties. In this paper, we derive Newton's method backpropagation algorithms for complex-valued holomorphic multilayer perceptrons, and investigate the convergence of the one-step Newton steplength algorithm for the minimization of real-valued complex functions via Newton's method. To provide experimental support for the use of holomorphic activation functions, we perform a comparison of using sigmoidal functions v...
Extreme Learning Machine for Multilayer Perceptron.
Tang, Jiexiong; Deng, Chenwei; Huang, Guang-Bin
2016-04-01
Extreme learning machine (ELM) is an emerging learning algorithm for the generalized single hidden layer feedforward neural networks, of which the hidden node parameters are randomly generated and the output weights are analytically computed. However, due to its shallow architecture, feature learning using ELM may not be effective for natural signals (e.g., images/videos), even with a large number of hidden nodes. To address this issue, in this paper, a new ELM-based hierarchical learning framework is proposed for multilayer perceptron. The proposed architecture is divided into two main components: 1) self-taught feature extraction followed by supervised feature classification and 2) they are bridged by random initialized hidden weights. The novelties of this paper are as follows: 1) unsupervised multilayer encoding is conducted for feature extraction, and an ELM-based sparse autoencoder is developed via l1 constraint. By doing so, it achieves more compact and meaningful feature representations than the original ELM; 2) by exploiting the advantages of ELM random feature mapping, the hierarchically encoded outputs are randomly projected before final decision making, which leads to a better generalization with faster learning speed; and 3) unlike the greedy layerwise training of deep learning (DL), the hidden layers of the proposed framework are trained in a forward manner. Once the previous layer is established, the weights of the current layer are fixed without fine-tuning. Therefore, it has much better learning efficiency than the DL. Extensive experiments on various widely used classification data sets show that the proposed algorithm achieves better and faster convergence than the existing state-of-the-art hierarchical learning methods. Furthermore, multiple applications in computer vision further confirm the generality and capability of the proposed learning scheme. PMID:25966483
KLASIFIKASI WEBSITE MENGGUNAKAN ALGORITMA MULTILAYER PERCEPTRON
Nyoman Purnama
2014-12-01
Full Text Available Sistem klasifikasi merupakan proses temu balik informasi yang sangat bergantung dari elemen-elemen penyusunnya.Sistem ini banyak digunakan untuk mengatasi permasalahan segmentasi data. Klasifikasi dapat digunakan pada website sebagaimetode untuk mengelompokkan website. Website merupakan salah satu data yang memiliki informasi yang beraneka-ragam,sehingga pengelompokan data ini penting untuk diteliti. Sistem klasifikasi dimulai dengan melakukan proses pengumpulaninformasi dari halaman website (parsing dan untuk setiap hasil parsing dilakukan proses penghapusan kata henti, stemming,feature selection dengan tf-idf. Hasil dari proses ini berupa fitur yang menjadi inputan algoritma Multilayer Perceptron. Dalamalgoritma ini terjadi proses pembelajaran terhadap pola input masukan dan pembuatan bobot pelatihan. Bobot ini akandigunakan pada proses klasifikasi. Hasil dari penelitian menunjukkan bahwa algoritma Multilayer Perceptron dapatmenghasilkan klasifikasi website dengan akurasi yang bagus. Hal ini dibuktikan dengan beberapa tahapan penelitian yangberbeda dan didapatkan nilai akurasi rata-rata diatas 70%.
A Parallel Framework for Multilayer Perceptron for Human Face Recognition
Bhowmik, M K; Nasipuri, M; Basu, D K; Kundu, M
2010-01-01
Artificial neural networks have already shown their success in face recognition and similar complex pattern recognition tasks. However, a major disadvantage of the technique is that it is extremely slow during training for larger classes and hence not suitable for real-time complex problems such as pattern recognition. This is an attempt to develop a parallel framework for the training algorithm of a perceptron. In this paper, two general architectures for a Multilayer Perceptron (MLP) have been demonstrated. The first architecture is All-Class-in-One-Network (ACON) where all the classes are placed in a single network and the second one is One-Class-in-One-Network (OCON) where an individual single network is responsible for each and every class. Capabilities of these two architectures were compared and verified in solving human face recognition, which is a complex pattern recognition task where several factors affect the recognition performance like pose variations, facial expression changes, occlusions, and ...
Learning of Multilayer Perceptrons with Piecewise-Linear Activation Functions
Kozub, P.; Holeňa, Martin
Praha : Matfyzpress, 2008 - (Obdržálek, D.; Štanclová, J.; Plátek, M.), s. 27-46 ISBN 978-80-7378-076-0. [ MIS 2008. Malý informatický seminář /25./. Josefův důl (CZ), 12.01.2008-19.01.2008] R&D Projects: GA ČR GA201/08/0802; GA ČR GA201/08/1744 Institutional research plan: CEZ:AV0Z10300504 Keywords : artificial neural networks * multilayer perceptrons * activation functions * function approximation * constrained optimization Subject RIV: IN - Informatics, Computer Science
A Choice of Input Variables for a Multilayer Perceptron
In the paper some aspects of multilayer perceptron (MLP) application to the problem of classifying the events presented by empirical samples of a finite volume are considered. The results of the MLP learning for various forms of the input data are analyzed and the reasons leading to the effect of an instantaneous learning of the MLP and rise of the neural network are investigated for the case when the input data are presented in a form of variational series. The problem of hidden layer neuron reduction without raising the recognition error is discussed. (author). 13 refs., 6 figs., 1 tab
Multilayer Perceptron for Prediction of 2006 World Cup Football Game
Kou-Yuan Huang; Kai-Ju Chen
2011-01-01
Multilayer perceptron (MLP) with back-propagation learning rule is adopted to predict the winning rates of two teams according to their official statistical data of 2006 World Cup Football Game at the previous stages. There are training samples from three classes: win, draw, and loss. At the new stage, new training samples are selected from the previous stages and are added to the training samples, then we retrain the neural network. It is a type of on-line learning. The 8 features are select...
In this work, multilayered perceptron neural networks (MLPNNs) were presented for the computation of the gamma-ray energy absorption buildup factors (BA) of seven thermoluminescent dosimetric (TLD) materials [LiF, BeO, Na2B4O7, CaSO4, Li2B4O7, KMgF3, Ca3(PO4)2] in the energy region 0.015–15 MeV, and for penetration depths up to 10 mfp (mean-free-path). The MLPNNs have been trained by a Levenberg–Marquardt learning algorithm. The developed model is in 99% agreement with the ANSI/ANS-6.4.3 standard data set. Furthermore, the model is fast and does not require tremendous computational efforts. The estimated BA data for TLD materials have been given with penetration depth and incident photon energy as comparative to the results of the interpolation method using the Geometrical Progression (G-P) fitting formula. - Highlights: ► Gamma-ray energy absorption buildup factors estimation in TLD materials. ► The ANN approach can be alternative to G-P fitting method for BA calculations. ► The applied model is not time-consuming and easily predicted
aylak, a?r?; Kaftan, ?lknur
2014-12-01
This study proposes the use of multi-layer perceptron neural networks (MLPNN) to invert dispersion curves obtained via multi-channel analysis of surface waves (MASW) for shear S-wave velocity profile. The dispersion curve used in inversion includes the fundamental-mode dispersion data. In order to investigate the applicability and performance of the proposed MLPNN algorithm, test studies were performed using both synthetic and field examples. Gaussian random noise with a standard deviation of 4 and 8% was added to the noise-free test data to make the synthetic test more realistic. The model parameters, such as S-wave velocities and thicknesses of the synthetic layered-earth model, were obtained for different S/N ratios and noise-free data. The field survey was performed over the natural gas pipeline, located in the Germencik district of Ayd?n city, western Turkey. The results show that depth, velocity, and location of the embedded natural gas pipe are successfully estimated with reasonably good approximation.
Online learning dynamics of multilayer perceptrons with unidentifiable parameters
In the over-realizable learning scenario of multilayer perceptrons, in which the student network has a larger number of hidden units than the true or optimal network, some of the weight parameters are unidentifiable. In this case, the teacher network consists of a union of optimal subspaces included in the parameter space. The optimal subspaces, which lead to singularities, are known to affect the estimation performance of neural networks. Using statistical mechanics, we investigate the online learning dynamics of two-layer neural networks in the over-realizable scenario with unidentifiable parameters. We show that the convergence speed strongly depends on the initial parameter conditions. We also show that there is a quasi-plateau around the optimal subspace, which differs from the well-known plateaus caused by permutation symmetry. In addition, we discuss the property of the final learning state, relating this to the singular structures
Power grid higher-order harmonics estimation with multilayer perceptrons
Nguyen, Thien Minh; Wira, Patrice
2015-12-01
This work proposes a new neural approach based on the structure of a Multi-Layer Perceptron (MLP) for identifying current harmonics in power systems. The learning approach is based on several MLP, adopts the Fourier decomposition of a signal and a training set generated from harmonic waveforms is used to calculate the weights. After training, each MLP is able to identify two coefficients for each harmonic term of the input signal. The effectiveness of the new approach is evaluated by experiments. Results show that the proposed MLPs of the new approach enable to identify effectively the amplitudes of harmonic terms from the signals under noisy condition. Results are compared to other and recent MLP approaches. The new approach can be applied in harmonic compensation strategies by being implement in an active power filter to ensure the power quality in electrical power systems.
Forecasting PM10 in Algiers: efficacy of multilayer perceptron networks.
Abderrahim, Hamza; Chellali, Mohammed Reda; Hamou, Ahmed
2016-01-01
Air quality forecasting system has acquired high importance in atmospheric pollution due to its negative impacts on the environment and human health. The artificial neural network is one of the most common soft computing methods that can be pragmatic for carving such complex problem. In this paper, we used a multilayer perceptron neural network to forecast the daily averaged concentration of the respirable suspended particulates with aerodynamic diameter of not more than 10 μm (PM10) in Algiers, Algeria. The data for training and testing the network are based on the data sampled from 2002 to 2006 collected by SAMASAFIA network center at El Hamma station. The meteorological data, air temperature, relative humidity, and wind speed, are used as inputs network parameters in the formation of model. The training patterns used correspond to 41 days data. The performance of the developed models was evaluated on the basis index of agreement and other statistical parameters. It was seen that the overall performance of model with 15 neurons is better than the ones with 5 and 10 neurons. The results of multilayer network with as few as one hidden layer and 15 neurons were quite reasonable than the ones with 5 and 10 neurons. Finally, an error around 9% has been reached. PMID:26381787
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
N. Pedroni
2008-03-01
Full Text Available Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP for nuclear dynamics are considered in comparison to static modeling by a finite impulse response multilayer perceptron (FIR-MLP and a conventional static MLP. The comparison is made with respect to the nonlinear dynamics of a nuclear reactor as investigated by IIR-MLP in a previous paper. The superior performance of the locally recurrent scheme is demonstrated.
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP) for nuclear dynamics are considered in comparison to static modeling by a finite impulse response multilayer perceptron (FIR-MLP) and a conventional static MLP. The comparison is made with respect to the nonlinear dynamics of a nuclear reactor as investigated by IIR-MLP in a previous paper. The superior performance of the locally recurrent scheme is demonstrated
Sartori, Michael A.; Passino, Kevin M.; Antsaklis, Panos J.
1992-01-01
In rule-based AI planning, expert, and learning systems, it is often the case that the left-hand-sides of the rules must be repeatedly compared to the contents of some 'working memory'. The traditional approach to solve such a 'match phase problem' for production systems is to use the Rete Match Algorithm. Here, a new technique using a multilayer perceptron, a particular artificial neural network model, is presented to solve the match phase problem for rule-based AI systems. A syntax for premise formulas (i.e., the left-hand-sides of the rules) is defined, and working memory is specified. From this, it is shown how to construct a multilayer perceptron that finds all of the rules which can be executed for the current situation in working memory. The complexity of the constructed multilayer perceptron is derived in terms of the maximum number of nodes and the required number of layers. A method for reducing the number of layers to at most three is also presented.
Pham, Binh Thai; Tien Bui, Dieu; Pourghasemi, Hamid Reza; Indra, Prakash; Dholakia, M. B.
2015-12-01
The objective of this study is to make a comparison of the prediction performance of three techniques, Functional Trees (FT), Multilayer Perceptron Neural Networks (MLP Neural Nets), and Naïve Bayes (NB) for landslide susceptibility assessment at the Uttarakhand Area (India). Firstly, a landslide inventory map with 430 landslide locations in the study area was constructed from various sources. Landslide locations were then randomly split into two parts (i) 70 % landslide locations being used for training models (ii) 30 % landslide locations being employed for validation process. Secondly, a total of eleven landslide conditioning factors including slope angle, slope aspect, elevation, curvature, lithology, soil, land cover, distance to roads, distance to lineaments, distance to rivers, and rainfall were used in the analysis to elucidate the spatial relationship between these factors and landslide occurrences. Feature selection of Linear Support Vector Machine (LSVM) algorithm was employed to assess the prediction capability of these conditioning factors on landslide models. Subsequently, the NB, MLP Neural Nets, and FT models were constructed using training dataset. Finally, success rate and predictive rate curves were employed to validate and compare the predictive capability of three used models. Overall, all the three models performed very well for landslide susceptibility assessment. Out of these models, the MLP Neural Nets and the FT models had almost the same predictive capability whereas the MLP Neural Nets (AUC = 0.850) was slightly better than the FT model (AUC = 0.849). The NB model (AUC = 0.838) had the lowest predictive capability compared to other models. Landslide susceptibility maps were final developed using these three models. These maps would be helpful to planners and engineers for the development activities and land-use planning.
Key Generation and Certification using Multilayer Perceptron in Wireless communication(KGCMLP)
Sarkar, Arindam; Mandal, J. K.
2012-01-01
In this paper, a key generation and certification technique using multilayer perceptron (KGCMLP) has been proposed in wireless communication of data/information. In this proposed KGCMLP technique both sender and receiver uses an identical multilayer perceptrons. Both perceptrons are start synchronization by exchanging some control frames. During synchronization process message integrity test and synchronization test has been carried out. Only the synchronization test does not guarantee the se...
Dynamics of learning in multilayer perceptrons near singularities.
Cousseau, Florent; Ozeki, Tomoko; Amari, Shun-Ichi
2008-08-01
The dynamical behavior of learning is known to be very slow for the multilayer perceptron, being often trapped in the "plateau." It has been recently understood that this is due to the singularity in the parameter space of perceptrons, in which trajectories of learning are drawn. The space is Riemannian from the point of view of information geometry and contains singular regions where the Riemannian metric or the Fisher information matrix degenerates. This paper analyzes the dynamics of learning in a neighborhood of the singular regions when the true teacher machine lies at the singularity. We give explicit asymptotic analytical solutions (trajectories) both for the standard gradient (SGD) and natural gradient (NGD) methods. It is clearly shown, in the case of the SGD method, that the plateau phenomenon appears in a neighborhood of the critical regions, where the dynamical behavior is extremely slow. The analysis of the NGD method is much more difficult, because the inverse of the Fisher information matrix diverges. We conquer the difficulty by introducing the "blow-down" technique used in algebraic geometry. The NGD method works efficiently, and the state converges directly to the true parameters very quickly while it staggers in the case of the SGD method. The analytical results are compared with computer simulations, showing good agreement. The effects of singularities on learning are thus qualitatively clarified for both standard and NGD methods. PMID:18701364
Theoretical Properties of Projection Based Multilayer Perceptrons with Functional Inputs
Rossi, F; Rossi, Fabrice; Conan-Guez, Brieuc
2006-01-01
Many real world data are sampled functions. As shown by Functional Data Analysis (FDA) methods, spectra, time series, images, gesture recognition data, etc. can be processed more efficiently if their functional nature is taken into account during the data analysis process. This is done by extending standard data analysis methods so that they can apply to functional inputs. A general way to achieve this goal is to compute projections of the functional data onto a finite dimensional sub-space of the functional space. The coordinates of the data on a basis of this sub-space provide standard vector representations of the functions. The obtained vectors can be processed by any standard method. In our previous work, this general approach has been used to define projection based Multilayer Perceptrons (MLPs) with functional inputs. We study in this paper important theoretical properties of the proposed model. We show in particular that MLPs with functional inputs are universal approximators: they can approximate to ...
Second-Order Learning Methods for a Multilayer Perceptron
First- and second-order learning methods for feed-forward multilayer neural networks are studied. Newton-type and quasi-Newton algorithms are considered and compared with commonly used back-propagation algorithm. It is shown that, although second-order algorithms require enhanced computer facilities, they provide better convergence and simplicity in usage. 13 refs., 2 figs., 2 tabs
Jos C, Crvelo Santana; Sidnei A, de Arajo; Joana P, M. Biazus; Roberto R, de Souza.
2015-04-01
Full Text Available En este trabajo se propone utilizar una Red Neuronal Artificial (RNA) Perceptrn Multicapa (PMC) para simular la variacin de la concentracin de protena de acuerdo con el tiempo y tambin para determinar la hora final del procedimiento, adems de los parmetros ptimos del proceso de biodegradaci [...] n de las protenas de un efluente de matadero. Para eso, han sido utilizadas las papanas, presentes en el ltex de la papaya (Carica papaya) con el objetivo de disminuir la concentracin de protenas de un efluente de matadero a pH (5 y 7) con una temperatura de (25 y 30 C) controlada. Los resultados mostraron que las papanas redujeron de 82% a 91% la concentracin de protena en 30 y 40 h de proceso. Las simulaciones con la RNA apuntaron que las condiciones perfectas fueron obtenidas a pH 5, con 30 C y en 35 h, en el cual se ha alcanzado una reduccin de 91% de la concentracin de protenas. Abstract in english In this paper, the use of a multilayer perceptron (MLP) artificial neural network (ANN) is proposed to simulate the variation of protein concentration according to the time and also to determine the end and optimal conditions of the biodegradation process of wastewater from meat industry. To reduce [...] the protein concentration, papains from Carica papaya latex have been used at controlled condition of pH (5 and 7) and temperature (25 and 30 C). Results showed that a reduction of 82 to 91% of protein concentration by the action of papains for 30 to 40 h of process time. Simulations showed that the best condition of the process occurred at pH 5, 30 C and 35 h, in which a maximum biodegradation of 91% was obtained.
Ground Radar Target Classification Using Singular Value Decomposition and Multilayer Perceptron
I. Mokris; J. Kurty; Z. Matousek
2001-01-01
The paper deals with classification of ground radar targets. Areceived radar signal backscattered from a ground radar target wasdigitized and in the form of radar signal matrix utilized for a featureextraction based on Singular Value Decomposition. Furthermore, singularvalues of a backscattered radar signal matrix, as a target feature,were utilized for Radar Target Classification by multilayer perceptron.In the learning phase of a multilayer perceptron we used the learningtarget set and in th...
FORECASTING ON FOREX MARKET WITH RBF AND PERCEPTRON NEURAL NETWORKS
ALEXANDRA KOTTILOV
2012-01-01
Full Text Available This work deals with an alternative approach in financial modelling -artificial neural networks approach. The aim of this paper is to show that this type oftime series modelling is an excellent alternative to classical econometric modelling. Atfirst, neural networks using methods of supervised machine learning are discussed.After explaining theoretical basis of ANN, these models are then applied to specificexchange rate (AUD/USD. Finally, the comparison between statistical models andRBF and perceptron neural networks is made to illustrate the sense of using ANNmodels
Query-based learning applied to partially trained multilayer perceptrons.
Hwang, J N; Choi, J J; Oh, S; Marks, R J
1991-01-01
An approach is presented for query-based neural network learning. A layered perceptron partially trained for binary classification is considered. The single-output neuron is trained to be either a zero or a one. A test decision is made by thresholding the output at, for example, one-half. The set of inputs that produce an output of one-half forms the classification boundary. The authors adopted an inversion algorithm for the neural network that allows generation of this boundary. For each boundary point, the classification gradient can be generated. The gradient provides a useful measure of the steepness of the multidimensional decision surfaces. Conjugate input pairs are generated using the boundary point and gradient information and presented to an oracle for proper classification. These data are used to refine further the classification boundary, thereby increasing the classification accuracy. The result can be a significant reduction in the training set cardinality in comparison with, for example, randomly generated data points. An application example to power system security assessment is given. PMID:18276359
Asymptotic law of likelihood ratio for multilayer perceptron models
Rynkiewicz, Joseph
2010-01-01
We consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The data are assumed to be generated by a true MLP model and the estimation of the parameters of the MLP is done by maximizing the likelihood of the model. When the number of hidden units of the true model is known, the asymptotic distribution of the maximum likelihood estimator (MLE) and the likelihood ratio (LR) statistic is easy to compute and converge to a $\\chi^2$ law. However, if the number of hidden unit is over-estimated the Fischer information matrix of the model is singular and the asymptotic behavior of the MLE is unknown. This paper deals with this case, and gives the exact asymptotic law of the LR statistics. Namely, if the parameters of the MLP lie in a suitable compact set, we show that the LR statistics is the supremum of the square of a Gaussian process indexed by a class of limit score functions.
Classification of Log-Polar-Visual Eigenfaces using Multilayer Perceptron
Bhowmik, Mrinal Kanti; Nasipuri, Mita; Kundu, Mahantapas; Basu, Dipak Kumar
2010-01-01
In this paper we present a simple novel approach to tackle the challenges of scaling and rotation of face images in face recognition. The proposed approach registers the training and testing visual face images by log-polar transformation, which is capable to handle complicacies introduced by scaling and rotation. Log-polar images are projected into eigenspace and finally classified using an improved multi-layer perceptron. In the experiments we have used ORL face database and Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database for visual face images. Experimental results show that the proposed approach significantly improves the recognition performances from visual to log-polar-visual face images. In case of ORL face database, recognition rate for visual face images is 89.5% and that is increased to 97.5% for log-polar-visual face images whereas for OTCBVS face database recognition rate for visual images is 87.84% and 96.36% for log-polar-visual face images.
Mozumder, Chitrini; Tripathi, Nitin K.
2014-10-01
In recent decades, the world has experienced unprecedented urban growth which endangers the green environment in and around urban areas. In this work, an artificial neural network (ANN) based model is developed to predict future impacts of urban and agricultural expansion on the uplands of Deepor Beel, a Ramsar wetland in the city area of Guwahati, Assam, India, by 2025 and 2035 respectively. Simulations were carried out for three different transition rates as determined from the changes during 2001-2011, namely simple extrapolation, Markov Chain (MC), and system dynamic (SD) modelling, using projected population growth, which were further investigated based on three different zoning policies. The first zoning policy employed no restriction while the second conversion restriction zoning policy restricted urban-agricultural expansion in the Guwahati Municipal Development Authority (GMDA) proposed green belt, extending to a third zoning policy providing wetland restoration in the proposed green belt. The prediction maps were found to be greatly influenced by the transition rates and the allowed transitions from one class to another within each sub-model. The model outputs were compared with GMDA land demand as proposed for 2025 whereby the land demand as produced by MC was found to best match the projected demand. Regarding the conservation of Deepor Beel, the Landscape Development Intensity (LDI) Index revealed that wetland restoration zoning policies may reduce the impact of urban growth on a local scale, but none of the zoning policies was found to minimize the impact on a broader base. The results from this study may assist the planning and reviewing of land use allocation within Guwahati city to secure ecological sustainability of the wetlands.
An application of the multilayer perceptron: Solar radiation maps in Spain
Hontoria, L.; Aguilera, J. [Grupo Investigacion y Desarrollo en Energia Solar y Automatica, Dpto. de Ingenieria Electronica, de Telecomunicaciones y Automatica, Escuela Politecnica Superior de Jaen, Campus de las Lagunillas, Universidad de Jaen, 23071 Jaen (Spain); Zufiria, P. [Grupo de Redes Neuronales, Dpto. de Matematica Aplicada a las Tecnologias de la Informacion, ETSI Telecomunicaciones, UPM Ciudad Universitaria s/n, 28040 Madrid (Spain)
2005-11-01
In this work an application of a methodology to obtain solar radiation maps is presented. This methodology is based on a neural network system [Lippmann, R.P., 1987. An introduction to computing with neural nets. IEEE ASSP Magazine, 4-22] called Multi-Layer Perceptron (MLP) [Haykin, S., 1994. Neural Networks. A Comprehensive Foundation. Macmillan Publishing Company; Hornik, K., Stinchcombe, M., White, H., 1989. Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359-366]. To obtain a solar radiation map it is necessary to know the solar radiation of many points spread wide across the zone of the map where it is going to be drawn. For most of the locations all over the world the records of these data (solar radiation in whatever scale, daily or hourly values) are non-existent. Only very few locations have the privilege of having good meteorological stations where records of solar radiation have being registered. But even in those locations with historical records of solar data, the quality of these solar series is not as good as it should be for most purposes. In addition, to draw solar radiation maps the number of points on the maps (real sites) that it is necessary to work with makes this problem difficult to solve. Nevertheless, with the application of the methodology proposed in this paper, this problem has been solved and solar radiation maps have been obtained for a small region of Spain: Jaen province, a southern province of Spain between parallels 38{sup o}25' N and 37{sup o}25' N, and meridians 4{sup o}10' W and 2{sup o}10' W, and for a larger region: Andalucia, the most southern region of Spain situated between parallels 38{sup o}40' N and 36{sup o}00' N, and meridians 7{sup o}30' W and 1{sup o}40' W. (author)
Ouadfeul, S.-A.; Aliouane, L.
2013-06-01
In this paper, a combination of supervised and unsupervised leanings is used for lithofacies classification from well log data. The main idea consists of enhancing the multilayer perceptron (MLP) learning by the output of the self-organizing map (SOM) neural network. Application to real data of two wells located the Algerian Sahara clearly shows that the lithofacies model built by the neural combination is able to give better results than a self-organizing map.
Face Recognition through Multilayer Perceptron (MLP and Learning Vector Quantization (LVQ
Dr. Ikvinderpal Singh
2012-12-01
Full Text Available Face recognition is challenging problems and there is still a lot of work that needs to be done in this area. Over the past ten years, face recognition has received substantial attention from researchers in biometrics, pattern recognition, computer vision, and cognitive psychology communities. This common interest in facial recognition technology among researchers working in diverse fields is motivated both by the remarkable ability to recognize people and by the increased attention being devoted to security applications. Applications of face recognition can be found in security, tracking, multimedia, and entertainment domains.This paper presents a face recognition system using artificial neural network. Here, we have designed a neural network with some own set network parameters. The results presented here have been obtained using two basic methods: multilayer perceptron (MLP, and learning vector quantization (LVQ. In both cases, two kinds of data have been fed to the classifiers: reduced resolution images (gray level or segmented, and feature vectors. The experimental results also show that, for the approaches considered here, analyzing gray level images produced better results than analyzing geometrical features, either because of the errors introduced during their extraction or because the original images have a richer information content. Furthermore, training times were much shorter for LVQ than for MLP. On the other hand, MLP achieved lower error rates when dealing with geometrical features.
Using multilayer perceptron and a satellite image for the estimation of soil salinity
Applying the model of the Perceptron multilayer with momentum of an artificial neural network particularly and a multispectral image of high resolution spatial and radiometric, for the first time estimated the salinity of the soil cultivated with sugar cane. The study area is the UBPC 'Lazaro Romero' of the sugar company 'Hector Molina' of the locality San Nicolas de Bari, Havana province, located at 22° 44' North latitude and 81 ° 56' longitude West. The experiments were made in the framework of the El-479 project funded by the Inter universities Council of Flanders, Belgium. 36 samples geo referenced of soils were taken at 3 depths in each of the 4 sugar cane selected blocks, which determined the electrical conductivity of the saturation extract; half of that amount of data was used for the training of the network and the other half for control in a computer program of the artificial neural network created to that effect, together with the reflectance of vegetation indexes for the image, which were maps of electrical conductivity of each block and bands. They were compared with those obtained by simple linear regression between the normalized difference vegetation index and electrical conductivity, Ndv with the approach of the neuronal network, the correlation coefficient was 0.78 to 0.83, while the linear regression was between 0.65 to 0.75
In the thesis the results of verification of multilayer perceptron (MLP) {20–41–1} application with sigmoid activation function for prediction of lateral radionuclide migration are presented. The calculated values of Cs 137 and Sr 90 volumetric activity are close to experimental measurement limits, indicating the possibility of MLP application for the solving problem. (authors)
Chaudhuri, Sutapa; Das, Debanjana; Sarkar, Ishita; Goswami, Sayantika
2015-10-01
The reduction in the visibility during fog significantly influences surface as well as air transport operations. The prediction of fog remains difficult despite improvements in numerical weather prediction models. The present study aims at identifying a suitable neural network model with proper architecture to provide precise nowcast of the horizontal visibility during fog over the airports of three significantly affected metropolises of India, namely: Kolkata (22°32'N; 88°20'E), Delhi (28°38'N; 77°12'E) and Bengaluru (12°95'N; 77°72'E). The investigation shows that the multilayer perceptron (MLP) model provides considerably less error in nowcasting the visibility during fog over the said metropolises than radial basis function network, generalized regression neural network or linear neural network. The MLP models of different architectures are trained with the data and records from 2000 to 2010. The model results are validated with observations from 2011 to 2014. Our results reveal that MLP models with different configurations (1) four input layers, three hidden layers with three hidden nodes in each layer and a single output; (2) four input layers with two hidden layers having one hidden node in the first hidden layer and two hidden nodes in the second hidden layer, and a single output layer; and (3) four input layers with two hidden layers having two hidden nodes in each hidden layer and a single output layer] provide minimum error in nowcasting the visibility during fog over the airports of Kolkata, Delhi and Bengaluru, respectively. The results show that the MLP model is well suited for nowcasting visibility during fog with 6 h lead time, however, the study reveals that the MLP model sensitive to dissimilar station altitudes in nowcasting visibility, as the minimum prediction error for the three metropolises having dissimilar mean sea level altitudes is observed through different configurations of the model.
Marwala, Tshilidzi; Chakraverty, Snehashish
2007-01-01
Gaussian mixture models (GMM) and support vector machines (SVM) are introduced to classify faults in a population of cylindrical shells. The proposed procedures are tested on a population of 20 cylindrical shells and their performance is compared to the procedure, which uses multi-layer perceptrons (MLP). The modal properties extracted from vibration data are used to train the GMM, SVM and MLP. It is observed that the GMM produces 98%, SVM produces 94% classification accuracy while the MLP produces 88% classification rates.
Siamese Multi-layer Perceptrons for Dimensionality Reduction and Face Identification
Zheng, Lilei; Duffner, Stefan; Idrissi, Khalid; Garcia, Christophe; Baskurt, Atilla
2015-01-01
This paper presents a framework using siamese Multi-layer Percep-trons (MLP) for supervised dimensionality reduction and face identification. Compared with the classical MLP that trains on fully labeled data, the siamese MLP learns on side information only, i.e., how similar of data examples are to each other. In this study, we compare it with the classical MLP on the problem of face identification. Experimental results on the Extended Yale B database demonstrate that the siamese MLP training...
Multilayer perceptron and regression modelling to forecast hourly nitrogen dioxide concentrations
Capilla, Carmen
2014-01-01
This paper presents the application of feed-forward multilayer perceptron networks and multiple regression models, to forecast hourly nitrogen dioxide levels 24 hours in advance. Input data are traffic and meteorological variables, and nitrogen dioxide hourly levels. The introduction of four periodic components (sine and cosine terms for the daily and weekly cycles), and nitrogen oxide hourly levels was analyzed in order to improve the prediction power. The data were measure...
Lenniet Coello
2015-01-01
Full Text Available The most widely used neural network model is Multilayer Perceptron (MLP, in which training of the connection weights is normally completed by a Back Propagation learning algorithm. G ood initial values of weights bear a fast convergence and a better generalization capability even with simple gradient - based error minimization techniques. This work presen ts a method to calculate the initial weights in order to train the Multilayer Perceptron Model. The method named PSO+RST+FUZZY is based on the similarity quality measure proposed within the framework of the extended Rough Set Theory that employs fuzzy sets to characterize the domain of similarity thresholds. Sensitivity of BP to initial weights with PSO+RST+FUZZY was studied experimentally, showing better performance than other methods used to calculate feature weights .
Classification of Parking Spots Using Multilayer Perceptron Networks
FALCAO, H. S.
2013-12-01
Full Text Available This project intends to develop a prototype for the identification of free spots in open air parking area where there is a good aerial view without obstacles, allowing for the identification of occupied and free spots. We used image processing techniques and pattern recognition using Artificial Neural Networks (ANN. In order to help implement the prototype, we used Matlab. In order to simulate the parking area, we created a model so that we could acquire the images using a webcam, process them, train the neural network, classify the spots and finally, show the results. The results show that it is viable to apply pattern recognition through image capture to classify parking spots
Hybrid Evolutionary Algorithm for Multilayer Perceptron Networks with Competetive Performance
Neruda, Roman
Los Alamitos : IEEE, 2007, s. 1620-1627. ISBN 978-1-4244-1339-3. [CEC 2007. Congress on Evolution ary Computation. Singapore (SG), 25.09.2007-28.09.2007] R&D Projects: GA AV ČR 1ET100300419 Institutional research plan: CEZ:AV0Z10300504 Keywords : hybrid algorithms * evolution ary learning * neural networks Subject RIV: IN - Informatics, Computer Science
FPGA Implementation of Multilayer Perceptron for Modeling of Photovoltaic panel
The Number of electronic applications using artificial neural network-based solutions has increased considerably in the last few years. However, their applications in photovoltaic systems are very limited. This paper introduces the preliminary result of the modeling and simulation of photovoltaic panel based on neural network and VHDL-language. In fact, an experimental database of meteorological data (irradiation, temperature) and output electrical generation signals of the PV-panel (current and voltage) has been used in this study. The inputs of the ANN-PV-panel are the daily total irradiation and mean average temperature while the outputs are the current and voltage generated from the panel. Firstly, a dataset of 4x364 have been used for training the network. Subsequently, the neural network (MLP) corresponding to PV-panel is simulated using VHDL language based on the saved weights and bias of the network. Simulation results of the trained MLP-PV panel based on Matlab and VHDL are presented. The proposed PV-panel model based ANN and VHDL permit to evaluate the performance PV-panel using only the environmental factors and involves less computational efforts, and it can be used for predicting the output electrical energy from the PV-panel
Quantum perceptron over a field and neural network architecture selection in a quantum computer.
da Silva, Adenilton José; Ludermir, Teresa Bernarda; de Oliveira, Wilson Rosa
2016-04-01
In this work, we propose a quantum neural network named quantum perceptron over a field (QPF). Quantum computers are not yet a reality and the models and algorithms proposed in this work cannot be simulated in actual (or classical) computers. QPF is a direct generalization of a classical perceptron and solves some drawbacks found in previous models of quantum perceptrons. We also present a learning algorithm named Superposition based Architecture Learning algorithm (SAL) that optimizes the neural network weights and architectures. SAL searches for the best architecture in a finite set of neural network architectures with linear time over the number of patterns in the training set. SAL is the first learning algorithm to determine neural network architectures in polynomial time. This speedup is obtained by the use of quantum parallelism and a non-linear quantum operator. PMID:26878722
Experts Fusion and Multilayer Perceptron Based on Belief Learning for Sonar Image Classification
Martin, Arnaud
2008-01-01
The sonar images provide a rapid view of the seabed in order to characterize it. However, in such as uncertain environment, real seabed is unknown and the only information we can obtain, is the interpretation of different human experts, sometimes in conflict. In this paper, we propose to manage this conflict in order to provide a robust reality for the learning step of classification algorithms. The classification is conducted by a multilayer perceptron, taking into account the uncertainty of the reality in the learning stage. The results of this seabed characterization are presented on real sonar images.
Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis
Rossi, Fabrice
2005-01-01
In this paper, we study a natural extension of Multi-Layer Perceptrons (MLP) to functional inputs. We show that fundamental results for classical MLP can be extended to functional MLP. We obtain universal approximation results that show the expressive power of functional MLP is comparable to that of numerical MLP. We obtain consistency results which imply that the estimation of optimal parameters for functional MLP is statistically well defined. We finally show on simulated and real world data that the proposed model performs in a very satisfactory way.
Highlights: Multilayer perceptrons are used to simulate the IV curve of thin-film PV modules. APE from the spectral irradiance was added as an input variable to the network. A self-organised map is used to select the curves used for training the network. Curve error and maximum power error decrease when using this technique. This method could provide accurate estimation of the output of a PV plant. - Abstract: In this paper, we propose the use of a methodology to characterise the electrical parameters of several thin-film photovoltaic module technologies. This methodology allows us to use not only solar irradiance and module temperature as classical models do, but also spectral distribution of solar radiation. The methodology is based on the use of neural network models. From all measured IV curves of a module, a previous selection of them has been used in order to train the neural network model. This selection is performed using a Kohonen self-organising map fed with spectral data. This spectral information has been added as an input to the neural network itself. The results show that the incorporation of spectral measurements to simulate thin-film modules improves significantly both the fitting of the predicted IV curve to the measured one and the peak power point estimation
Classification of Polar-Thermal Eigenfaces using Multilayer Perceptron for Human Face Recognition
Bhowmik, Mrinal Kanti; Nasipuri, Mita; Basu, Dipak Kumar; Kundu, Mahantapas
2010-01-01
This paper presents a novel approach to handle the challenges of face recognition. In this work thermal face images are considered, which minimizes the affect of illumination changes and occlusion due to moustache, beards, adornments etc. The proposed approach registers the training and testing thermal face images in polar coordinate, which is capable to handle complicacies introduced by scaling and rotation. Polar images are projected into eigenspace and finally classified using a multi-layer perceptron. In the experiments we have used Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database benchmark thermal face images. Experimental results show that the proposed approach significantly improves the verification and identification performance and the success rate is 97.05%.
A New Approach to Predicting Bankruptcy: Combining DEA and Multi-Layer Perceptron
Ayan Mukhopadhyay
2012-07-01
Full Text Available The question of financial health and sustenance of a firm is so intriguing that it has spanned numerous studies. For investors,stakeholders and lenders, assessing the risk associated with an enterprise is vital. Several tools have been formulated to deal with predicting the solvency of a firm. This paper attempts to combine Data Envelopment Analysis and Multi-Layer Perceptron (MLP to suggest a new method for prediction of bankruptcy that not only focusses on historical financial data of firms that filed for bankruptcy like other past studies but also takes into account the data of those firms that were likely to do so. This method thus identifies firms that have a high chance of facing bankruptcy along with those that have filed for bankruptcy. The performance of this procedure is compared with MLP. The suggested method outperforms MLP in prediction of bankruptcy.
Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method
A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its ''black box'' aspect, many researchers refuse to use it. Moreover, the optimization (often based on the exhaustive approach where ''all'' configurations are tested) and learning phases of this artificial intelligence tool (often based on the Levenberg-Marquardt algorithm; LMA) are weaknesses of this approach (exhaustively and local minima). These two tasks must be repeated depending on the knowledge of each new problem studied, making the process, long, laborious and not systematically robust. In this paper a pruning process is proposed. This method allows, during the training phase, to carry out an inputs selecting method activating (or not) inter-nodes connections in order to verify if forecasting is improved. We propose to use iteratively the popular damped least-squares method to activate inputs and neurons. A first pass is applied to 10% of the learning sample to determine weights significantly different from 0 and delete other. Then a classical batch process based on LMA is used with the new MLP. The validation is done using 25 measured meteorological TS and cross-comparing the prediction results of the classical LMA and the 2-stage LMA
FORECASTING ON FOREX MARKET WITH RBF AND PERCEPTRON NEURAL NETWORKS
ALEXANDRA KOTTILOV; LUK FALT
2012-01-01
This work deals with an alternative approach in financial modelling -artificial neural networks approach. The aim of this paper is to show that this type oftime series modelling is an excellent alternative to classical econometric modelling. Atfirst, neural networks using methods of supervised machine learning are discussed.After explaining theoretical basis of ANN, these models are then applied to specificexchange rate (AUD/USD). Finally, the comparison between statistical models andRBF and ...
Alejandro J. Orozco-Naranjo
2013-11-01
Full Text Available This paper presents the results obtained by developing a methodology to detect 5 types of heartbeats (Normal (N, Right bundle branch block (RBBB, Left bundle branch block (LBBB, Premature atrial contraction (APC and Premature ventricular contraction (PVC, using Wavelet transform packets with non-adaptative mode applied on features extraction from heartbeats. It was used the Shannon function to calculate the entropy and It was added an identification nodes stage per every type of cardiac signal in the Wavelet tree. The using of Wavelet packets transform allows the access to information which results of decomposition of low and high frecuency, giving providing a more integral analysis than achieved by the discrete Wavelet transform. Three families of mother Wavelet were evaluated on transformation: Daubechies, Symlet and Reverse Biorthogonal, which were results from a previous research in that were identified the mother Wavelet that had higher entropy with the cardiac signals. With non-adaptive mode, the computational cost is reduced when Wavelet packets are used; this cost represents the most marked disadvantage from the transform. To classify the heartbeats were used Support Vector Machines and Multilayer Perceptron. The best classification error was achieved employing Support Vector Machine and a radial basis function; it was 2.57 %.
Liu, Zhansheng; Violas, Manuel Alberto; Carvalho, Nuno Borges
2013-02-11
In this paper, we propose a wideband dynamic behavioral model for a bulk reflective semiconductor optical amplifier (RSOA) used as a modulator in colorless radio over fiber (RoF) systems using a tapped-delay multilayer perceptron (TDMLP). 64 quadrature amplitude modulation (QAM) signals with 20 Msymbol/s were used to train, validate and test the model. Nonlinear distortion and dynamic effects induced by the RSOA modulator are demonstrated. The parameters of the model such as the number of nodes in the hidden layer and memory depth were optimized to ensure the generality and accuracy. The normalized mean square error (NMSE) is used as a figure of merit. The NMSE was up to -44.33 dB when the number of nodes in the hidden layer and memory depth were set to 20 and 3, respectively. The TDMLP model can accurately approximate to the dynamic characteristics of the RSOA modulator. The dynamic AM-AM and dynamic AM-PM distortions of the RSOA modulator are drawn. The results show that the single hidden layer TDMLP can provide accurate approximation for behaviors of the RSOA modulator. PMID:23481795
Arindam Sarkar
2013-08-01
Full Text Available In this paper, a group session Key Exchange multilayer Perceptron based Simulated Annealing guidedAutomata and Comparison based Metamorphosed encryption technique (GSMLPSA has been proposed inwireless communication of data/information. Both sender and receiver uses identical multilayer perceptronand depending on the final output of the both side multilayer perceptron, weights vector of hidden layer gettuned in both ends. As a results both perceptrons generates identical weight vectors which is consider as anone time session key. In GSMLPSA technique plain text is encrypted using metamorphosed code table forproducing level 1 encrypted text. Then comparison based technique is used to further encerypt the level 1encrypted text and produce level 2 encrypted text. Simulated Annealing based keystream is xored with theleve2 encrypted text and form a level 3 encrypted text. Finally level 3 encrypted text is xored with the MLPbased session key and get transmitted to the receiver. GSMLPSA technique uses two keys for encryptionpurpose. SA based key get further encrypted using Automata based technique and finally xored with MLPbased session key and transmitted to the receiver. This technique ensures that if intruders intercept the keyof the keystream then also values of the key not be known to the intruders because of the automata basedencoding. Receiver will perform same operation in reverse order to get the plain text back. Two partiescan swap over a common key using synchronization between their own multilayer perceptrons. But theproblem crop up when group of N parties desire to swap over a key. Since in this case each communicatingparty has to synchronize with other for swapping over the key. So, if there are N parties then total numberof synchronizations needed before swapping over the actual key is O(N2. GSMLPSA scheme offers a noveltechnique in which complete binary tree structure is follows for key swapping over. Using proposedalgorithm a set of N parties can be able to share a common key with only O(log2 N synchronization.Parametric tests have been done and results are compared with some existing classical techniques, whichshow comparable results for the proposed technique
APPLICATION OF A MULTI-LAYER PERCEPTRON NETWORK FOR DETECTION OF HUMAN FACES ON A LARGE DATABASE
Salihmuhsin, Metin; İşler, Yavuz Selim
2015-01-01
In this paper, we present a face detection system that we have developed. The system is consisted of a camera, a computer, an image acquisition setup and a face detection method written in Matlab. In order to test detection capability of the system, we have collected a database that contains 125 different images of 125 different people with this system. A program based on a multilayer perceptron network (MLP) is developed in order to detect faces. The program works in two levels and uses the...
Fast accurate MEG source localization using a multilayer perceptron trained with real brain noise
Iterative gradient methods such as Levenberg-Marquardt (LM) are in widespread use for source localization from electroencephalographic (EEG) and magnetoencephalographic (MEG) signals. Unfortunately, LM depends sensitively on the initial guess, necessitating repeated runs. This, combined with LM's high per-step cost, makes its computational burden quite high. To reduce this burden, we trained a multilayer perceptron (MLP) as a real-time localizer. We used an analytical model of quasistatic electromagnetic propagation through a spherical head to map randomly chosen dipoles to sensor activities according to the sensor geometry of a 4D Neuroimaging Neuromag-122 MEG system, and trained a MLP to invert this mapping in the absence of noise or in the presence of various sorts of noise such as white Gaussian noise, correlated noise, or real brain noise. A MLP structure was chosen to trade off computation and accuracy. This MLP was trained four times, with each type of noise. We measured the effects of initial guesses on LM performance, which motivated a hybrid MLP-start-LM method, in which the trained MLP initializes LM. We also compared the localization performance of LM, MLPs, and hybrid MLP-start-LMs for realistic brain signals. Trained MLPs are much faster than other methods, while the hybrid MLP-start-LMs are faster and more accurate than fixed-4-start-LM. In particular, the hybrid MLP-start-LM initialized by a MLP trained with the real brain noise dataset is 60 times faster and is comparable in accuracy to random-20-start-LM, and this hybrid system (localization error: 0.28 cm, computation time: 36 ms) shows almost as good performance as optimal-1-start-LM (localization error: 0.23 cm, computation time: 22 ms), which initializes LM with the correct dipole location. MLPs trained with noise perform better than the MLP trained without noise, and the MLP trained with real brain noise is almost as good an initial guesser for LM as the correct dipole location. (author) )
The Normalized Radial Basis Function Neural Network and its Relation to the Perceptron
Grabec, I.
2007-01-01
The normalized radial basis function neural network emerges in the statistical modeling of natural laws that relate components of multivariate data. The modeling is based on the kernel estimator of the joint probability density function pertaining to given data. From this function a governing law is extracted by the conditional average estimator. The corresponding nonparametric regression represents a normalized radial basis function neural network and can be related with the multi-layer perc...
Heremans, Stien; Suykens, Johan A. K.; Van Orshoven, Jos
2016-02-01
To be physically interpretable, sub-pixel land cover fractions or abundances should fulfill two constraints, the Abundance Non-negativity Constraint (ANC) and the Abundance Sum-to-one Constraint (ASC). This paper focuses on the effect of imposing these constraints onto the MultiLayer Perceptron (MLP) for a multi-class sub-pixel land cover classification of a time series of low resolution MODIS-images covering the northern part of Belgium. Two constraining modes were compared, (i) an in-training approach that uses 'softmax' as the transfer function in the MLP's output layer and (ii) a post-training approach that linearly rescales the outputs of the unconstrained MLP. Our results demonstrate that the pixel-level prediction accuracy is markedly increased by the explicit enforcement, both in-training and post-training, of the ANC and the ASC. For aggregations of pixels (municipalities), the constrained perceptrons perform at least as well as their unconstrained counterparts. Although the difference in performance between the in-training and post-training approach is small, we recommend the former for integrating the fractional abundance constraints into MLPs meant for sub-pixel land cover estimation, regardless of the targeted level of spatial aggregation.
Cebrian, Manuel
2007-01-01
The random initialization of weights of a multilayer perceptron makes it possible to model its training process as a Las Vegas algorithm, i.e. a randomized algorithm which stops when some required training error is obtained, and whose execution time is a random variable. This modelling is used to perform a case study on a well-known pattern recognition benchmark: the UCI Thyroid Disease Database. Empirical evidence is presented of the training time probability distribution exhibiting a heavy tail behavior, meaning a big probability mass of long executions. This fact is exploited to reduce the training time cost by applying two simple restart strategies. The first assumes full knowledge of the distribution yielding a 40% cut down in expected time with respect to the training without restarts. The second, assumes null knowledge, yielding a reduction ranging from 9% to 23%.
Multilayer neural networks a generalized net perspective
Krawczak, Maciej
2013-01-01
The primary purpose of this book is to show that a multilayer neural network can be considered as a multistage system, and then that the learning of this class of neural networks can be treated as a special sort of the optimal control problem. In this way, the optimal control problem methodology, like dynamic programming, with modifications, can yield a new class of learning algorithms for multilayer neural networks. Another purpose of this book is to show that the generalized net theory can be successfully used as a new description of multilayer neural networks. Several generalized net descriptions of neural networks functioning processes are considered, namely: the simulation process of networks, a system of neural networks and the learning algorithms developed in this book. The generalized net approach to modelling of real systems may be used successfully for the description of a variety of technological and intellectual problems, it can be used not only for representing the parallel functioning of homogen...
A multi-layer feed-forward perceptron for microwave signals processing
Rouveure, R.; Faure, P.; Monod, M.O.
2003-01-01
This paper investigates the processing of radar signals using artificial neural networks. Today, the use of FMCW radar is considered to control the agricultural implements working depth, in order to overcome the limitations of sensors based on optical or ultrasound devices towards agricultural environment (dust, rain, etc.). The objective is to determine the radar-target distance R with a direct identification of the discrete-time radar signal Sb[n]. The neural network structure in a multi-la...
Tabari, Hossein; Hosseinzadeh Talaee, P.; Abghari, Hirad
2012-05-01
Estimation of pan evaporation ( E pan) using black-box models has received a great deal of attention in developing countries where measurements of E pan are spatially and temporally limited. Multilayer perceptron (MLP) and coactive neuro-fuzzy inference system (CANFIS) models were used to predict daily E pan for a semi-arid region of Iran. Six MLP and CANFIS models comprising various combinations of daily meteorological parameters were developed. The performances of the models were tested using correlation coefficient ( r), root mean square error (RMSE), mean absolute error (MAE) and percentage error of estimate (PE). It was found that the MLP6 model with the Momentum learning algorithm and the Tanh activation function, which requires all input parameters, presented the most accurate E pan predictions ( r = 0.97, RMSE = 0.81 mm day-1, MAE = 0.63 mm day-1 and PE = 0.58 %). The results also showed that the most accurate E pan predictions with a CANFIS model can be achieved with the Takagi-Sugeno-Kang (TSK) fuzzy model and the Gaussian membership function. Overall performances revealed that the MLP method was better suited than CANFIS method for modeling the E pan process.
Hybrid Optimized Back propagation Learning Algorithm For Multi-layer Perceptron
Chakraborty, Mriganka; Ghosh, Arka
2012-01-01
Standard neural network based on general back propagation learning using delta method or gradient descent method has some great faults like poor optimization of error-weight objective function, low learning rate, instability .This paper introduces a hybrid supervised back propagation learning algorithm which uses trust-region method of unconstrained optimization of the error objective function by using quasi-newton method .This optimization leads to more accurate weight update system for mini...
Electron/pion identification in the CBM TRD using a multilayer perceptron
The problem of electron/pion identification in the CBM experiment based on the measurements of energy losses and transition radiation in the TRD detector is discussed. A possibility to solve such a problem by applying an artificial neural network (ANN) is considered. As input information for the network we used both the samples of energy losses of pions or electrons in the TRD absorbers and the 'clever' variable obtained on the basis of the original data. We show that usage of this new variable permits one to reach a reliable level of particle recognition no longer than after 10-20 training epochs; there are practically no fluctuations against the trend, and the needed level of pions suppression is obtained under the condition of a minimal loss of electrons
Neural network simulation of the industrial producer price index dynamical series
Soshnikov, L. E.
2013-01-01
This paper is devoted the simulation and forecast of dynamical series of the economical indicators. Multilayer perceptron and Radial basis function neural networks have been used. The neural networks model results are compared with the econometrical modeling.
Berrar, Daniel; Dubitzky, Werner
2006-01-01
This paper presents a novel type of artificial neural network, called neural plasma, which is tailored for classification tasks involving few observations with a large number of variables. Neural plasma learns to adapt its classification confidence by generating artificial training data as a function of its confidence in previous decisions. In contrast to multilayer perceptrons and similar techniques, which are inspired by topological and operational aspects of biological neural networks, neu...
Self-Organizing Multilayered Neural Networks of Optimal Complexity
V. Schetinin
2005-01-01
The principles of self-organizing the neural networks of optimal complexity is considered under the unrepresentative learning set. The method of self-organizing the multi-layered neural networks is offered and used to train the logical neural networks which were applied to the medical diagnostics.
Advances in Artificial Neural Networks – Methodological Development and Application
Yanbo Huang
2009-01-01
Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other networks such as radial basis function, recurrent network, feedback network, and unsupervised Kohonen self-organizing network. These networks, especially the multilayer perceptron network with a back...
Yuleidys, Mejas Csar; Ramn, Carrasco Velar; Isbel, Ochoa Izquierdo; Edel, Moreno Lemus.
2013-12-01
Full Text Available El perceptrn multicapa (PMC) figura dentro de los tipos de redes neuronales artificiales (RNA) con resultados tiles en los estudios de relacin estructura-actividad. Dado que los volmenes de datos en proyectos de Bioinformtica son eventualmente grandes, se propuso evaluar algoritmos para acortar [...] el tiempo de entrenamiento de la red sin afectar su eficiencia. Se desarroll un algoritmo para el entrenamiento local y distribuido del PMC con la posibilidad de variar las funciones de transferencias para lo cual se utilizaron el Weka y la Plataforma de Tareas Distribuidas Tarenal para distribuir el entrenamiento del perceptrn multicapa. Se demostr que en dependencia de la muestra de entrenamiento, la variacin de las funciones de transferencia pueden reportar resultados mucho ms eficientes que los obtenidos con la clsica funcin Sigmoidal, con incremento de la g-media entre el 4.5 y el 17 %. Se encontr adems que en los entrenamientos distribuidos es posible alcanzar eventualmente mejores resultados que los logrados en ambiente local. Abstract in english The multilayer perceptron (PMC) ranks among the types of artificial neural networks (ANN), which has provided better results in studies of structure-activity relationship. As the data volumes in Bioinformatics' projects are eventually big, it was proposed to evaluate algorithms to shorten the traini [...] ng time of the network without affecting its efficiency. There were evaluated different tools that work with ANN and were selected Weka algorithm for extracting the network and the Platform for Distributed Task Tarenal to distribute the training of multilayer perceptron. Finally, it was developed a training algorithm for local and distributed the MLP with the possibility of varying transfer functions. It was shown that depending on the training sample, the change of transfer functions can yield results much more efficient than those obtained with the classic sigmoid function with increased g-media between 4.5 and 17 %. Moreover, it was found that with distributed training can be achieved eventually, better results than those achieved in the local environment.
Jeong, Sungmoon; Jung, Chanwoong; Kim, Cheol-Su; Shim, Jae Hoon; Lee, Minho
2011-08-01
This paper presents a new computer interface system based on laser spot detection and moving pattern analysis of the detected laser spots in real-time processing. We propose a systematic method that uses either the frame difference of successive input images or an autoassociative multilayer perceptron (AAMLP) to detect laser spots. The AAMLP is applied only to areas of the input images where the frame difference of the successive images is not effective for detecting laser spots. In order to enhance the detection performance, the AAMLP is trained by a new training algorithm that increases the sensitivity of the input-to-output mapping of the AAMLP allowing a small variation in the input feature of the laser spot image to be successfully indicated. The proposed interface system is also able to keep track of the laser spot and recognize gesture commands. The moving pattern of the laser spot is recognized by using a multilayer perception. It is experimentally shown that the proposed computer interface system is fast enough for real-time operation with reliable accuracy.
Vnia Medianeira Flores Costa
2012-04-01
Full Text Available When investors decide to adventure through stock markets they search for a method to provide safety on making decision. In fact, there is no precise way to know which stocks will became a profitable investiment. Technical analysis is a discipline that support the investors on making decisions. Such a discipline uses a set of tools and statistical methods to forecast the markets movement. Such a paper presents the develpment of a robotical Trade System, using a heuristic method. The system has a Neural Network multilayer perceptron, trained with an algorithm for back propagation error. Thus, approaching to the technical analysis without emotional aspects, using the Neural Network forecast on supporting the decisions of a investor on stock market. In analyzing the results of the neural network can be seen that the neural network got a result of 42.6% higher than the diagnostic of the technical analysis.Quando investidores decidem se aventurar pelo mercado de renda varivel, como pelo mercado de aes, buscam um mtodo de ter mais segurana na tomada de deciso. Na prtica, no h como saber quais ativos tornar-se-o um investimento lucrativo. No mercado acionrio, a Anlise Tcnica procura auxiliar o investidor na tomada de deciso. Para isso, utiliza-se de ferramentas e de mtodos estatsticos para tentar predizer os movimentos do mercado. Este artigo apresenta o desenvolvimento de um Trade System robtico, utilizando um mtodo heurstico. O sistema conta com uma rede neural multilayer perceptron, treinada com o algoritmo de retro propagao de erro, aproximando-se da anlise tcnica sem o fator emoo. Ao avaliaros resultados darede neural, podeser visto que amesma obteve um resultadode 42,6% maior do queo diagnstico daanlise tcnica.
Fault Diagnosis of Multilevel Cascaded Inverter Using Multi Layer Perceptron Network
E. Parimalasundar; N.Suthanthira Vanitha
2015-01-01
In this study, a fault diagnostic system in a multi-level inverter using a MLP network is developed. Using a mathematical model, it is difficult to diagnose a Multilevel-Inverter Drive (MLID) system, because MLID system complexity has a non-linear factor and it consist of many switching devices. Therefore neural network classification is applied to fault diagnosis of MLID system. Multilayer perceptron networks (MLP) are used to identify the type and location of occurring faults from inverter ...
Wave transmission prediction of multilayer floating breakwater using neural network
Mandal, S.; Patil, S.G.; Hegde, A.V.
in unison to solve a specific problem. The network learns through examples, so it requires good examples to train properly and further a trained network model can be used for prediction purpose. Proceedings of ICOE 2009 Wave transmission... prediction of multilayer floating breakwater using neural network 577 In order to allow the network to learn both non-linear and linear relationships between input nodes and output nodes, multiple-layer neural networks are often used...
Ferreira, B D L; Sebastião, R C O; Yoshida, M I; Mussel, W N; Fialho, S L; Barbosa, J
2016-01-01
Kinetic study by thermal decomposition of antiretroviral drugs, Efavirenz (EFV) and Lamivudine (3TC), usually present in the HIV cocktail, can be done by individual adjustment of the solid decomposition models. However, in some cases unacceptable errors are found using this methodology. To circumvent this problem, here is proposed to use a multilayer perceptron neural network (MLP), with an appropriate algorithm, which constitutes a linearization of the network by setting weights between the input layer and the intermediate one and the use of Kinetic models as activation functions of neurons in the hidden layer. The interconnection weights between that intermediate layer and output layer determines the contribution of each model in the overall fit of the experimental data. Thus, the decomposition is assumed to be a phenomenon that can occur following different kinetic processes. In the investigated data, the kinetic thermal decomposition process was best described by R1 and D4 model for all temperatures to EF...
Emin AVCI
2007-06-01
Full Text Available Especially for the last decade, the neural network models have been applied to solve financial problems like portfolio construction and stock market forecasting. Among the alternative neural network models, the multilayer perceptron models are expected to be effective and widely applied in financial forecasting. This study examines the forecasting power multilayer perceptron models for daily and sessional returns of ISE-100 index. The findings imply that the multilayer perceptron models presented promising performance in forecasting the ISE-100 index returns. However, further emphasis should be placed on different input variables and model architectures in order to improve the forecasting performances.
Multilayer Neural Net Trajectory Tracking Control for Underwater Vehicle
Kuljača, Ognjen; Gadewadikar, Jyotirmay; Horvat, Krunoslav
2009-01-01
An adaptive multilayer neural network controller for high precision maneuvering of underwater vehicles is presented. Maneuvering of underwater vehicles requires special attention to a number of factors, including thruster and vehicle’s nonlinearities, couplings which exist between various degrees of freedom as well as effects of the sea currents. The neuro control system for underwater vehicle maneuvering described in this paper is based on a conventional controller supported with the so-c...
Schwindling Jerome
2010-04-01
Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Schwindling, Jerome
2010-04-01
This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p.) corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Multilayer associative neural networks (MANN's): storage capacity versus perfect recall.
Kang, H
1994-01-01
The objective of this paper is to to resolve important issues in artificial neural nets-exact recall and capacity in multilayer associative memories. These problems have imposed restrictions on coding strategies. We propose the following triple-layered hybrid neural network: the first synapse is a one-shot associative memory using the modified Kohonen's adaptive learning algorithm with arbitrary input patterns; the second one is Kosko's bidirectional associative memory consisting of orthogonal input/output basis vectors such as Walsh series satisfying the strict continuity condition; and finally, the third one is a simple one-shot associative memory with arbitrary output images. A mathematical framework based on the relationship between energy local minima (capacity of the neural net) and noise-free recall is established. The robust capacity conditions of this multilayer associative neural network that lead to forming the local minima of the energy function at the exact training pairs are derived. The chosen strategy not only maximizes the total number of stored images but also completely relaxes any code-dependent conditions of the learning pairs. PMID:18267854
Artificial neural networks in predicting current in electric arc furnaces
Panoiu, M.; Panoiu, C.; Iordan, A.; Ghiormez, L.
2014-03-01
The paper presents a study of the possibility of using artificial neural networks for the prediction of the current and the voltage of Electric Arc Furnaces. Multi-layer perceptron and radial based functions Artificial Neural Networks implemented in Matlab were used. The study is based on measured data items from an Electric Arc Furnace in an industrial plant in Romania.
Advances in Artificial Neural Networks - Methodological Development and Application
Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other ne...
Unsupervised classification of neural spikes with a hybrid multilayer artificial neural network.
García, P; Suárez, C P; Rodríguez, J; Rodríguez, M
1998-07-01
The understanding of the brain structure and function and its computational style is one of the biggest challenges both in Neuroscience and Neural Computation. In order to reach this and to test the predictions of neural network modeling, it is necessary to observe the activity of neural populations. In this paper we propose a hybrid modular computational system for the spike classification of multiunits recordings. It works with no knowledge about the waveform, and it consists of two moduli: a Preprocessing (Segmentation) module, which performs the detection and centering of spike vectors using programmed computation; and a Processing (Classification) module, which implements the general approach of neural classification: feature extraction, clustering and discrimination, by means of a hybrid unsupervised multilayer artificial neural network (HUMANN). The operations of this artificial neural network on the spike vectors are: (i) compression with a Sanger Layer from 70 points vector to five principal component vector; (ii) their waveform is analyzed by a Kohonen layer; (iii) the electrical noise and overlapping spikes are rejected by a previously unreported artificial neural network named Tolerance layer; and (iv) finally the spikes are labeled into spike classes by a Labeling layer. Each layer of the system has a specific unsupervised learning rule that progressively modifies itself until the performance of the layer has been automatically optimized. The procedure showed a high sensitivity and specificity also when working with signals containing four spike types. PMID:10223516
Multi-Layered Neural Networks Infer Fundamental Stellar Parameters
Verma, Kuldeep; Bhattacharya, Jishnu; Antia, H M; Krishnamurthy, Ganapathy
2016-01-01
The advent of space-based observatories such as CoRoT and Kepler has enabled the testing of our understanding of stellar evolution on thousands of stars. Evolutionary models typically require five input parameters, the mass, initial Helium abundance, initial metallicity, mixing-length (assumed to be constant over time) and the age to which the star must be evolved. These parameters are also very useful in characterizing the associated planets and in studying galactic archaeology. How to obtain the parameters from observations rapidly and accurately, specifically in the context of surveys of thousands of stars, is an outstanding question, one that has eluded straightforward resolution. For a given star, we typically measure the effective temperature and surface metallicity spectroscopically and low-degree oscillation frequencies through space observatories. Here we demonstrate that statistical learning, using multi-layered neural networks, is successful in determining the evolutionary parameters based on spect...
Kucuk, Nil; Manohara, S.R.; Hanagodimath, S.M.; Gerward, L.
2013-01-01
for penetration depths up to 10 mfp (mean-free-path). The MLPNNs have been trained by a Levenberg–Marquardt learning algorithm. The developed model is in 99% agreement with the ANSI/ANS-6.4.3 standard data set. Furthermore, the model is fast and does not require tremendous computational efforts. The...
An Efficient Supervised Training Algorithm for Multilayer Spiking Neural Networks.
Xie, Xiurui; Qu, Hong; Liu, Guisong; Zhang, Malu; Kurths, Jürgen
2016-01-01
The spiking neural networks (SNNs) are the third generation of neural networks and perform remarkably well in cognitive tasks such as pattern recognition. The spike emitting and information processing mechanisms found in biological cognitive systems motivate the application of the hierarchical structure and temporal encoding mechanism in spiking neural networks, which have exhibited strong computational capability. However, the hierarchical structure and temporal encoding approach require neurons to process information serially in space and time respectively, which reduce the training efficiency significantly. For training the hierarchical SNNs, most existing methods are based on the traditional back-propagation algorithm, inheriting its drawbacks of the gradient diffusion and the sensitivity on parameters. To keep the powerful computation capability of the hierarchical structure and temporal encoding mechanism, but to overcome the low efficiency of the existing algorithms, a new training algorithm, the Normalized Spiking Error Back Propagation (NSEBP) is proposed in this paper. In the feedforward calculation, the output spike times are calculated by solving the quadratic function in the spike response model instead of detecting postsynaptic voltage states at all time points in traditional algorithms. Besides, in the feedback weight modification, the computational error is propagated to previous layers by the presynaptic spike jitter instead of the gradient decent rule, which realizes the layer-wised training. Furthermore, our algorithm investigates the mathematical relation between the weight variation and voltage error change, which makes the normalization in the weight modification applicable. Adopting these strategies, our algorithm outperforms the traditional SNN multi-layer algorithms in terms of learning efficiency and parameter sensitivity, that are also demonstrated by the comprehensive experimental results in this paper. PMID:27044001
Training trajectories by continuous recurrent multilayer networks.
Leistritz, L; Galicki, M; Witte, H; Kochs, E
2002-01-01
This paper addresses the problem of training trajectories by means of continuous recurrent neural networks whose feedforward parts are multilayer perceptrons. Such networks can approximate a general nonlinear dynamic system with arbitrary accuracy. The learning process is transformed into an optimal control framework where the weights are the controls to be determined. A training algorithm based upon a variational formulation of Pontryagin's maximum principle is proposed for such networks. Computer examples demonstrating the efficiency of the given approach are also presented. PMID:18244431
Multi-modular neural networks for the classification of e+e- hadronic events
Some multi-modular neural network methods of classifying e+e- hadronic events are presented. We compare the performances of the following neural networks: MLP (multilayer perceptron), MLP and LVQ (learning vector quantization) trained sequentially, and MLP and RBF (radial basis function) trained sequentially. We introduce a MLP-RBF cooperative neural network. Our last study is a multi-MLP neural network. (orig.)
Artificial Neural Networks in Catalyst Development. Chapter 10
Holeňa, Martin; Baerns, M.
New Jersey : John Wiley and Sons, 2003 - (Cawse, J.), s. 163-202 ISBN 0-471-20343-2 Source of funding: V - iné verejné zdroje Keywords : artificial neural network s * multilayer perceptrons * nonlinear dependency * approximation * network training * knowledge extraction Subject RIV: IN - Informatics, Computer Science
Artificial neural networks applied to forecasting time series
Montaño Moreno, Juan José; Palmer Pol, Alfonso; Muñoz Gracia, María del Pilar
2011-01-01
This study offers a description and comparison of the main models of Artificial Neural Networks (ANN) which have proved to be useful in time series forecasting, and also a standard procedure for the practical application of ANN in this type of task. The Multilayer Perceptron (MLP), Radial Base Function (RBF), Generalized Regression Neural Network (GRNN), and Recurrent Neural Network (RNN) models are analyzed. With this aim in mind, we use a time series made up of 244 time points. A comparativ...
Multilayer neural-net robot controller with guaranteed tracking performance.
Lewis, F L; Yegildirek, A; Liu, K
1996-01-01
A multilayer neural-net (NN) controller for a general serial-link rigid robot arm is developed. The structure of the NN controller is derived using a filtered error/passivity approach. No off-line learning phase is needed for the proposed NN controller and the weights are easily initialized. The nonlinear nature of the NN, plus NN functional reconstruction inaccuracies and robot disturbances, mean that the standard delta rule using backpropagation tuning does not suffice for closed-loop dynamic control. Novel online weight tuning algorithms, including correction terms to the delta rule plus an added robust signal, guarantee bounded tracking errors as well as bounded NN weights. Specific bounds are determined, and the tracking error bound can be made arbitrarily small by increasing a certain feedback gain. The correction terms involve a second-order forward-propagated wave in the backpropagation network. New NN properties including the notions of a passive NN, a dissipative NN, and a robust NN are introduced. PMID:18255592
Applying Backpropagation Neural Networks to Bankruptcy Prediction
Yi-Chung Hu; Fang-Mei Tseng
2005-01-01
Bankruptcy prediction is an important classification problem for a business, and has become a major concern of managers. In this paper, two well-known backpropagation neural network models serving as data mining tools for classification problems are employed to perform bankruptcy forecasting: one is the backpropagation multi-layer perceptron, and the other is the radial basis function network. In particular, the radial basis function network can be treated as a fuzzy neural network. Through e...
Novel LDPC Decoder via MLP Neural Networks
Karami, Alireza; Attari, Mahmoud Ahmadian
2014-01-01
In this paper, a new method for decoding Low Density Parity Check (LDPC) codes, based on Multi-Layer Perceptron (MLP) neural networks is proposed. Due to the fact that in neural networks all procedures are processed in parallel, this method can be considered as a viable alternative to Message Passing Algorithm (MPA), with high computational complexity. Our proposed algorithm runs with soft criterion and concurrently does not use probabilistic quantities to decide what the estimated codeword i...
A Comparative Study of RBF and MLP Neural Model for Seven Element Dynamic Phased Array Smart Antenna
Rahul Shrivastava; Abhishek Rawat; Yogendra Kumar Jain
2013-01-01
In this paper we present the neural Modelling techniques for dynamic phased array smart antenna. Neural networks are mathematical and computation models that are used to optimize the smart antenna system, which are very much suitable for real time applications. Here we are optimizing the seven element dynamic phased array smart antenna using Radial basis function neural network (RBFNN) and Multilayer Perceptron neural network (MLPNN). The beam ship prediction of seven element DPA is done up t...
Efficient learning algorithm for quantum perceptron unitary weights
Seow, Kok-Leong; Behrman, Elizabeth; Steck, James
2015-01-01
For the past two decades, researchers have attempted to create a Quantum Neural Network (QNN) by combining the merits of quantum computing and neural computing. In order to exploit the advantages of the two prolific fields, the QNN must meet the non-trivial task of integrating the unitary dynamics of quantum computing and the dissipative dynamics of neural computing. At the core of quantum computing and neural computing lies the qubit and perceptron, respectively. We see that past implementat...
A nonlinear multivariable empirical model is developed for a U-tube steam generator using the recurrent multilayer perceptron network as the underlying model structure. The recurrent multilayer perceptron is a dynamic neural network, very effective in the input-output modeling of complex process systems. A dynamic gradient descent learning algorithm is used to train the recurrent multilayer perceptron, resulting in an order of magnitude improvement in convergence speed over static learning algorithms. In developing the U-tube steam generator empirical model, the effects of actuator, process,and sensor noise on the training and testing sets are investigated. Learning and prediction both appear very effective, despite the presence of training and testing set noise, respectively. The recurrent multilayer perceptron appears to learn the deterministic part of a stochastic training set, and it predicts approximately a moving average response. Extensive model validation studies indicate that the empirical model can substantially generalize (extrapolate), though online learning becomes necessary for tracking transients significantly different than the ones included in the training set and slowly varying U-tube steam generator dynamics. In view of the satisfactory modeling accuracy and the associated short development time, neural networks based empirical models in some cases appear to provide a serious alternative to first principles models. Caution, however, must be exercised because extensive on-line validation of these models is still warranted
A New Filter Design Method for Disturbed Multilayer Hopfield Neural Networks
AHN, C. K.
2011-05-01
Full Text Available This paper investigates the passivity based filtering problem for multilayer Hopfield neural networks with external disturbance. A new passivity based filter design method for multilayer Hopfield neural networks is developed to ensure that the filtering error system is exponentially stable and passive from the external disturbance vector to the output error vector. The unknown gain matrix is obtained by solving a linear matrix inequality (LMI, which can be easily facilitated by using some standard numerical packages. An illustrative example is given to demonstrate the effectiveness of the proposed filter.
Gamma-ray energy determination using neural network algorithms for an imaging silicon calorimeter
A neural network technique, based on multi-layer perceptrons, is used to fully exploit the performances of a sampling silicon calorimeter in energy identification of gamma rays. The results obtained on simulated data are significantly better than those coming from a classic method analysis. (orig.)
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving to be...
ESTIMATION OF INPUT IMPEDANCE OF MICROSTRIP PATCH ANTENNA USING FUZZY NEURAL NETWORK
VANDANA VIKAS THAKARE; PRAMOD KUMAR SINGHAL
2010-01-01
The paper presents the use of fuzzy neural network (FNN) as a fast and better technique for the determination of input impedance of coaxial feed rectangular microstrip antenna. The fuzzy parameter ensures better performance as compared to three layer multilayered perceptron feed forward back propagation artificial neural network (MLPFFBP ANN) and radial basis function artificial neural network (RBF ANN) in the determination of input impedance of the coaxial feed microstrip antenna.
Stasinakis, Charalampos; Sermpinis, Georgios; Theofilatos, Konstantinos; Karathanasopoulos, Andreas
2015-01-01
This study investigates the efficiency of the radial basis function neural networks in forecasting the US unemployment and explores the utility of Kalman filter and support vector regression as forecast combination techniques. On one hand, an autoregressive moving average model, a smooth transition autoregressive model and three different neural networks architectures, namely a multi-layer perceptron, recurrent neural network and a psi sigma network are used as benchmarks for our radial basis...
ESTIMATION OF INPUT IMPEDANCE OF MICROSTRIP PATCH ANTENNA USING FUZZY NEURAL NETWORK
VANDANA VIKAS THAKARE
2010-10-01
Full Text Available The paper presents the use of fuzzy neural network (FNN as a fast and better technique for the determination of input impedance of coaxial feed rectangular microstrip antenna. The fuzzy parameter ensures better performance as compared to three layer multilayered perceptron feed forward back propagation artificial neural network (MLPFFBP ANN and radial basis function artificial neural network (RBF ANN in the determination of input impedance of the coaxial feed microstrip antenna.
Stacked Heterogeneous Neural Networks for Time Series Forecasting
Mihai Horia Zaharia; Florin Leon
2010-01-01
A hybrid model for time series forecasting is proposed. It is a stacked neural network, containing one normal multilayer perceptron with bipolar sigmoid activation functions, and the other with an exponential activation function in the output layer. As shown by the case studies, the proposed stacked hybrid neural model performs well on a variety of benchmark time series. The combination of weights of the two stack components that leads to optimal performance is also studied.
Using Artificial Neural Networks for ECG Signals Denoising
Zoltn Germn-Sall; Katalin Gyrgy
2010-01-01
The authors have investigated some potential applications of artificial neural networks in electrocardiografic (ECG) signal prediction. For this, the authors used an adaptive multilayer perceptron structure to predict the signal. The proposed procedure uses an artificial neural network based learning structure to estimate the (n+1)th sample from n previous samples To train and adjust the network weights, the backpropagation (BP) algorithm was used. In this paper, prediction of ECG signals (as...
Classification of Magneto-Optic Images using Neural Networks
Nath, Shridhar; Wincheski, Buzz; Fulton, Jim; Namkung, Min
1994-01-01
A real time imaging system with a neural network classifier has been incorporated on a Macintosh computer in conjunction with an MOI system. This system images rivets on aircraft aluminium structures using eddy currents and magnetic imaging. Moment invariant functions from the image of a rivet is used to train a multilayer perceptron neural network to classify the rivets as good or bad (rivets with cracks).
Fault Diagnosis of Multilevel Cascaded Inverter Using Multi Layer Perceptron Network
E. Parimalasundar
2015-02-01
Full Text Available In this study, a fault diagnostic system in a multi-level inverter using a MLP network is developed. Using a mathematical model, it is difficult to diagnose a Multilevel-Inverter Drive (MLID system, because MLID system complexity has a non-linear factor and it consist of many switching devices. Therefore neural network classification is applied to fault diagnosis of MLID system. Multilayer perceptron networks (MLP are used to identify the type and location of occurring faults from inverter output voltage measurement. Here, MLP network based fault identification system for five level cascade H-bridge Multilevel Inverter (MLI is analyzed. The proposed system identifies the fault with a greater accuracy and the results to various input patterns are presented for easy comprehension.
Forecasting Runoff with Artificial Neural Networks
Neruda, M.; Neruda, Roman; Kudová, Petra
Paris : UNESCO, 2005 - (Maraga, F.), s. 65-69 [ERB 2004. Euromediterranean Network of Experimental and Representative Basins /10./. Turin (IT), 13.10.2004-17.10.2004] R&D Projects: GA ČR(CZ) GA201/02/0428 Institutional research plan: CEZ:AV0Z10300504 Keywords : artificial neural network s * rainfall-runoff modelling * multilayer perceptron * Radial Basis Functions (RBF) Subject RIV: BA - General Mathematics
Forecasting SPEI and SPI Drought Indices Using the Integrated Artificial Neural Networks
Maca, Petr; Pech, Pavel
2016-01-01
The presented paper compares forecast of drought indices based on two different models of artificial neural networks. The first model is based on feedforward multilayer perceptron, sANN, and the second one is the integrated neural network model, hANN. The analyzed drought indices are the standardized precipitation index (SPI) and the standardized precipitation evaporation index (SPEI) and were derived for the period of 19482002 on two US catchments. The meteorological and hydrological data were obtained from MOPEX experiment. The training of both neural network models was made by the adaptive version of differential evolution, JADE. The comparison of models was based on six model performance measures. The results of drought indices forecast, explained by the values of four model performance indices, show that the integrated neural network model was superior to the feedforward multilayer perceptron with one hidden layer of neurons.
Forecasting SPEI and SPI Drought Indices Using the Integrated Artificial Neural Networks.
Maca, Petr; Pech, Pavel
2016-01-01
The presented paper compares forecast of drought indices based on two different models of artificial neural networks. The first model is based on feedforward multilayer perceptron, sANN, and the second one is the integrated neural network model, hANN. The analyzed drought indices are the standardized precipitation index (SPI) and the standardized precipitation evaporation index (SPEI) and were derived for the period of 1948-2002 on two US catchments. The meteorological and hydrological data were obtained from MOPEX experiment. The training of both neural network models was made by the adaptive version of differential evolution, JADE. The comparison of models was based on six model performance measures. The results of drought indices forecast, explained by the values of four model performance indices, show that the integrated neural network model was superior to the feedforward multilayer perceptron with one hidden layer of neurons. PMID:26880875
A fast identification of insufficiency of nutrients using spectral features would be a useful instrument in farming and in other nutrient demanding agricultural systems such as those proposed for long period space missions. A Multilayer Perceptron (MLP) neural network and backpropagation algorithm w...
Multi-layer holographic bifurcative neural network system for real-time adaptive EOS data analysis
Liu, Hua-Kuang; Huang, K. S.; Diep, J.
1993-01-01
Optical data processing techniques have the inherent advantage of high data throughout, low weight and low power requirements. These features are particularly desirable for onboard spacecraft in-situ real-time data analysis and data compression applications. the proposed multi-layer optical holographic neural net pattern recognition technique will utilize the nonlinear photorefractive devices for real-time adaptive learning to classify input data content and recognize unexpected features. Information can be stored either in analog or digital form in a nonlinear photofractive device. The recording can be accomplished in time scales ranging from milliseconds to microseconds. When a system consisting of these devices is organized in a multi-layer structure, a feedforward neural net with bifurcating data classification capability is formed. The interdisciplinary research will involve the collaboration with top digital computer architecture experts at the University of Southern California.
Evaluation of artificial neural network techniques for flow forecasting in the River Yangtze, China
C. W. Dawson; Harpham, C.; Wilby, R. L.; Chen, Y
2002-01-01
While engineers have been quantifying rainfall-runoff processes since the mid-19th century, it is only in the last decade that artificial neural network models have been applied to the same task. This paper evaluates two neural networks in this context: the popular multilayer perceptron (MLP), and the radial basis function network (RBF). Using six-hourly rainfall-runoff data for the River Yangtze at Yichang (upstream of the Three Gorges Dam) for the period 1991 to 1993, i...
Forecasting SPEI and SPI Drought Indices Using the Integrated Artificial Neural Networks
Petr Maca; Pavel Pech
2016-01-01
The presented paper compares forecast of drought indices based on two different models of artificial neural networks. The first model is based on feedforward multilayer perceptron, sANN, and the second one is the integrated neural network model, hANN. The analyzed drought indices are the standardized precipitation index (SPI) and the standardized precipitation evaporation index (SPEI) and were derived for the period of 1948–2002 on two US catchments. The meteorological and hydrological data w...
Polanco, Xavier; Franois, Claire; Keim, Jean-Pierre
1998-01-01
This paper describes the implementation of multivariate data analysis: NEURODOC applies the axial k-means method for automatic, non-hierarchical cluster analysis and a Principal Component Analysis (PCA) for representing the clusters on a map. We next introduce Artificial Neural Networks (ANNs) to extend NEURODOC into a neural platform for the cluster analysis and cartography of bibliographic data. The ANNs tested are: the Adaptive Resonance Theory (ART 1), a Multilayer Perceptron (MLP), and a...
Weight-decay induced phase transitions in multilayer neural networks
Ahr, M.; Biehl, M.; Schlösser, E.
1999-07-01
We investigate layered neural networks with differentiable activation function and student vectors without normalization constraint by means of equilibrium statistical physics. We consider the learning of perfectly realizable rules and find that the length of student vectors becomes infinite, unless a proper weight decay term is added to the energy. Then, the system undergoes a first-order phase transition between states with very long student vectors and states where the lengths are comparable to those of the teacher vectors. Additionally, in both configurations there is a phase transition between a specialized and an unspecialized phase. An anti-specialized phase with long student vectors exists in networks with a small number of hidden units.
OMER MAHMOUD
2007-08-01
Full Text Available One of the essential factors that affect the performance of Artificial Neural Networks is the learning algorithm. The performance of Multilayer Feed Forward Artificial Neural Network performance in image compression using different learning algorithms is examined in this paper. Based on Gradient Descent, Conjugate Gradient, Quasi-Newton techniques three different error back propagation algorithms have been developed for use in training two types of neural networks, a single hidden layer network and three hidden layers network. The essence of this study is to investigate the most efficient and effective training methods for use in image compression and its subsequent applications. The obtained results show that the Quasi-Newton based algorithm has better performance as compared to the other two algorithms.
Epping W. J. M.; L'istelle A. R.
2006-01-01
Neural networks with the multi-layered perceptron architecture were trained on an autoassociation task to compress 2D seismic data. Networks with linear transfer functions outperformed nonlinear neural nets with single or multiple hidden layers. This indicates that the correlational structure of the seismic data is predominantly linear. A compression factor of 5 to 7 can be achieved if a reconstruction error of 10% is allowed. The performance on new test data was similar to that achieved with...
A. Piotrowski
2006-01-01
Full Text Available In this paper, Multi-Layer Perceptron and Radial-Basis Function Neural Networks, along with the Nearest Neighbour approach and linear regression are utilized for flash-flood forecasting in the mountainous Nysa Klodzka river catchment. It turned out that the Radial-Basis Function Neural Network is the best model for 3- and 6-h lead time prediction and the only reliable one for 9-h lead time forecasting for the largest flood used as a test case.
Piotrowski, A.; Napiórkowski, J. J.; P. M. Rowiński
2006-01-01
In this paper, Multi-Layer Perceptron and Radial-Basis Function Neural Networks, along with the Nearest Neighbour approach and linear regression are utilized for flash-flood forecasting in the mountainous Nysa Klodzka river catchment. It turned out that the Radial-Basis Function Neural Network is the best model for 3- and 6-h lead time prediction and the only reliable one for 9-h lead time forecasting for the largest flood used as a test case.
Generalized classifier neural network.
Ozyildirim, Buse Melis; Avci, Mutlu
2013-03-01
In this work a new radial basis function based classification neural network named as generalized classifier neural network, is proposed. The proposed generalized classifier neural network has five layers, unlike other radial basis function based neural networks such as generalized regression neural network and probabilistic neural network. They are input, pattern, summation, normalization and output layers. In addition to topological difference, the proposed neural network has gradient descent based optimization of smoothing parameter approach and diverge effect term added calculation improvements. Diverge effect term is an improvement on summation layer calculation to supply additional separation ability and flexibility. Performance of generalized classifier neural network is compared with that of the probabilistic neural network, multilayer perceptron algorithm and radial basis function neural network on 9 different data sets and with that of generalized regression neural network on 3 different data sets include only two classes in MATLAB environment. Better classification performance up to %89 is observed. Improved classification performances proved the effectivity of the proposed neural network. PMID:23298551
Multilayer neural networks for reduced-rank approximation.
Diamantaras, K I; Kung, S Y
1994-01-01
This paper is developed in two parts. First, the authors formulate the solution to the general reduced-rank linear approximation problem relaxing the invertibility assumption of the input autocorrelation matrix used by previous authors. The authors' treatment unifies linear regression, Wiener filtering, full rank approximation, auto-association networks, SVD and principal component analysis (PCA) as special cases. The authors' analysis also shows that two-layer linear neural networks with reduced number of hidden units, trained with the least-squares error criterion, produce weights that correspond to the generalized singular value decomposition of the input-teacher cross-correlation matrix and the input data matrix. As a corollary the linear two-layer backpropagation model with reduced hidden layer extracts an arbitrary linear combination of the generalized singular vector components. Second, the authors investigate artificial neural network models for the solution of the related generalized eigenvalue problem. By introducing and utilizing the extended concept of deflation (originally proposed for the standard eigenvalue problem) the authors are able to find that a sequential version of linear BP can extract the exact generalized eigenvector components. The advantage of this approach is that it's easier to update the model structure by adding one more unit or pruning one or more units when the application requires it. An alternative approach for extracting the exact components is to use a set of lateral connections among the hidden units trained in such a way as to enforce orthogonality among the upper- and lower-layer weights. The authors call this the lateral orthogonalization network (LON) and show via theoretical analysis-and verify via simulation-that the network extracts the desired components. The advantage of the LON-based model is that it can be applied in a parallel fashion so that the components are extracted concurrently. Finally, the authors show the application of their results to the solution of the identification problem of systems whose excitation has a non-invertible autocorrelation matrix. Previous identification methods usually rely on the invertibility assumption of the input autocorrelation, therefore they can not be applied to this case. PMID:18267843
AN EFFICIENT NEURAL NETWORK FOR RECOGNIZING GESTURAL HINDI DIGITS
Nidal Fawzi Shilbayeh; Mohammad Mahmmoud Alwakeel; Maisa Mohy Naser
2013-01-01
Handwritten Hindi digit recognition plays an important role in eastern Arab countries especially in the courtesy amounts of Arab bank checks, recognizing numbers in car plates, or in postal code for mail sorting. In our study, we proposed an efficient Hindi Digit Recognition System drawn by the mouse and developed using Multilayer Perceptron Neural Network (MLP) with backpropagation. The system has been designed, implemented and tested successfully. Analysis has been carried out to determine ...
Neural networks for nonlinear discriminant analysis in continuous speech recognition
Reichl, W.; Harengel, S.; Wolfertstetter, F.; Ruske, G.
1996-01-01
In this paper neural networks for Nonlinear Discriminant Analysis in continuous speech recognition are presented. Multilayer Perceptrons are used to estimate a-posteriori probabilities for Hidden-Markov Model states, which are the optimal discriminant features for the separation of the HMM states. The a-posteriori probabilities are transformed by a principal component analysis to calculate the new features for semicontinuous HMMs, which are trained by the known Maximum-Likelihood training. Th...
On the Adaptability of Neural Network Image Super-Resolution
Chua, Kah Keong; Tay, Yong Haur
2012-01-01
In this paper, we described and developed a framework for Multilayer Perceptron (MLP) to work on low level image processing, where MLP will be used to perform image super-resolution. Meanwhile, MLP are trained with different types of images from various categories, hence analyse the behaviour and performance of the neural network. The tests are carried out using qualitative test, in which Mean Squared Error (MSE), Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM). The r...
Handwritten Farsi Character Recognition using Artificial Neural Network
Reza Gharoie Ahangar; Mohammad Farajpoor Ahangar
2009-01-01
Neural Networks are being used for character recognition from last many years but most of the work was confined to English character recognition. Till date, a very little work has been reported for Handwritten Farsi Character recognition. In this paper, we have made an attempt to recognize handwritten Farsi characters by using a multilayer perceptron with one hidden layer. The error backpropagation algorithm has been used to train the MLP network. In addition, an analysis has been carried out...
Haydeé Elena Musso
2013-01-01
Full Text Available En este trabajo se realizó un estudio estadístico de variables físico químicas asociadas al fenómeno de contaminación ambiental, en particular concentración media mensual de SO2 , medidas en la ciudad Salta Capital, Argentina, simultáneamente a concentraciones de NO2 y O3 . Las series bajo estudio presentaban comportamientos dinámicos no lineales, datos atípicos y cambios estructurales, lo que hizo imposible modelarlas con tipologías econométricas tradiciones (AR, MA, ARMA, ARIMA, entre otras. Una solución eficiente que se encontró, hace uso de la teoría de los perceptrones multicapa. Mediante el modelo estructural de series de tiempo, esta solución se presenta como un proceso matemático iterativo que permite obtener un modelado final el cual tiene una muy alta confiabilidad (95%, para realizar pronoósticos a futuro sobre el comportamiento de la variable estudiada.In this paper a statistical study of phisical-chemistry variables connected with enviroment pollution, specifically SO2 monthly average concentration, measured in Salta Capital city, Argentina, together with NO2 and O3 concentrations, was made. Time series under study shown non linear dinamic behaviour, outliers and structural changes. Due to these it was impossible to use typical econometric typologies (AR, MA, ARMA, ARIMA, among others. An effective solution which uses multistep perceptrons theory was found. By using structural time series modelling, this solution is presented by an iterative mathematical process that allows us to obtain a final model with a high confidence level (95% in order to do the forecasting step on the studied variable.
A Comparative Study of RBF and MLP Neural Model for Seven Element Dynamic Phased Array Smart Antenna
Rahul Shrivastava
2013-05-01
Full Text Available In this paper we present the neural Modelling techniques for dynamic phased array smart antenna. Neural networks are mathematical and computation models that are used to optimize the smart antenna system, which are very much suitable for real time applications. Here we are optimizing the seven element dynamic phased array smart antenna using Radial basis function neural network (RBFNN and Multilayer Perceptron neural network (MLPNN. The beam ship prediction of seven element DPA is done up to 60 deg scan angle and results of RBF and MLP are compared to find out the better neural network approach for smart antenna optimization.
Neural networks for gamma-hadron separation in MAGIC
Boinee, P; De Angelis, A; Saggion, A; Zacchello, M
2005-01-01
Neural networks have proved to be versatile and robust for particle separation in many experiments related to particle astrophysics. We apply these techniques to separate gamma rays from hadrons for the MAGIC Cerenkov Telescope. Two types of neural network architectures have been used for the classi cation task: one is the MultiLayer Perceptron (MLP) based on supervised learning, and the other is the Self-Organising Tree Algorithm (SOTA), which is based on unsupervised learning. We propose a new architecture by combining these two neural networks types to yield better and faster classi cation results for our classi cation problem.
Sankalia, Mayur G.; Mashru, Rajshree C.; Sankalia, Jolly M.; Sutariya, Vijay B.
2005-01-01
This work examines the influence of various process parameters (like sodium alginate concentration, calcium chloride concentration, and hardening time) on papain entrapped in ionotropically cross-linked alginate beads for stability improvement and site-specific delivery to the small intestine using neural network modeling. A 33 full-factorial design and feed-forward neural network with multilayer perceptron was used to investigate the effect of process variables on percentage of entrapment, t...
Eduardo O. Cerqueira; João C. de Andrade; Ronei J. Poppi; Cesar Mello
2001-01-01
Neural Networks are a set of mathematical methods and computer programs designed to simulate the information process and the knowledge acquisition of the human brain. In last years its application in chemistry is increasing significantly, due the special characteristics for model complex systems. The basic principles of two types of neural networks, the multi-layer perceptrons and radial basis functions, are introduced, as well as, a pruning approach to architecture optimization. Two analytic...
Higher-order probabilistic perceptrons as Bayesian inference engines
This letter makes explicit a structural connection between the Bayes optimal classifier operating on K binary input variables and corresponding two-layer perceptron having normalized output activities and couplings from input to output units of all orders up to K. Given a large and unbiased training set and an effective learning algorithm, such a neural network should be able to learn the statistics of the classification problem and match the a posteriori probabilities given by the Bayes optimal classifier. (author). 18 refs
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
Mücella ÖZBAY KARAKUŞ
2013-11-01
Full Text Available This paper reports results of artificial neural network for robot navigation tasks. Machine learning methods have proven usability in many complex problems concerning mobile robots control. In particular we deal with the well-known strategy of navigating by “wall-following”. In this study, probabilistic neural network (PNN structure was used for robot navigation tasks. The PNN result was compared with the results of the Logistic Perceptron, Multilayer Perceptron, Mixture of Experts and Elman neural networks and the results of the previous studies reported focusing on robot navigation tasks and using same dataset. It was observed the PNN is the best classification accuracy with 99,635% accuracy using same dataset.
Onursal Çetin
2015-06-01
Full Text Available Objective: Implementation of multilayer neural network (MLNN with sigmoid activation function for the diagnosis of hepatitis disease. Methods: Artificial neural networks (ANNs are efficient tools currently in common use for medical diagnosis. In hardware based architectures activation functions play an important role in ANN behavior. Sigmoid function is the most frequently used activation function because of its smooth response. Thus, sigmoid function and its close approximations were implemented as activation function. The dataset is taken from the UCI machine learning database. Results: For the diagnosis of hepatitis disease, MLNN structure was implemented and Levenberg Morquardt (LM algorithm was used for learning. Our method of classifying hepatitis disease produced an accuracy of 91.9% to 93.8% via 10 fold cross validation. Conclusion: When compared to previous work that diagnosed hepatitis disease using artificial neural networks and the identical data set, our results are promising in order to reduce the size and cost of neural network based hardware. Thus, hardware based diagnosis systems can be developed effectively by using approximations of sigmoid function.
Perceptron-like computation based on biologically-inspired neurons with heterosynaptic mechanisms
Kaluza, Pablo; Urdapilleta, Eugenio
2014-10-01
Perceptrons are one of the fundamental paradigms in artificial neural networks and a key processing scheme in supervised classification tasks. However, the algorithm they provide is given in terms of unrealistically simple processing units and connections and therefore, its implementation in real neural networks is hard to be fulfilled. In this work, we present a neural circuit able to perform perceptron's computation based on realistic models of neurons and synapses. The model uses Wang-Buzsáki neurons with coupling provided by axodendritic and axoaxonic synapses (heterosynapsis). The main characteristics of the feedforward perceptron operation are conserved, which allows to combine both approaches: whereas the classical artificial system can be used to learn a particular problem, its solution can be directly implemented in this neural circuit. As a result, we propose a biologically-inspired system able to work appropriately in a wide range of frequencies and system parameters, while keeping robust to noise and error.
Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI
Olyaee, Saeed; Hamedi, Samaneh, E-mail: s_olyaee@srttu.edu [Nano-photonics and Optoelectronics Research Laboratory (NORLab), Faculty of Electrical and Computer Engineering, Shahid Rajaee Teacher Training University (SRTTU), Lavizan, 16788, Tehran (Iran, Islamic Republic of)
2011-02-01
In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.
Neural network approximation of nonlinearity in laser nano-metrology system based on TLMI
In this paper, an approach based on neural network (NN) for nonlinearity modeling in a nano-metrology system using three-longitudinal-mode laser heterodyne interferometer (TLMI) for length and displacement measurements is presented. We model nonlinearity errors that arise from elliptically and non-orthogonally polarized laser beams, rotational error in the alignment of laser head with respect to the polarizing beam splitter, rotational error in the alignment of the mixing polarizer, and unequal transmission coefficients in the polarizing beam splitter. Here we use a neural network algorithm based on the multi-layer perceptron (MLP) network. The simulation results show that multi-layer feed forward perceptron network is successfully applicable to real noisy interferometer signals.
Mónica Bocco; Enrique Willington; Mónica Arias
2010-01-01
The incident solar radiation on soil is an important variable used in agricultural applications; it is also relevant in hydrology, meteorology and soil physics, among others. To estimate this variable, empirical models have been developed using several parameters and, recently, prognostic and prediction models based on artificial intelligence techniques such as neural networks. The aim of this work was to develop linear models and neural networks, multilayer perceptron, to estimate daily glob...
Viscosity Calculation at Moderate Pressure for Nonpolar Gases via Neural Network
Bouzidi, A.; S. Hanini; F. Souahi; B. Mohammedi; M. Touiza
2007-01-01
A new method, based on Artificial Neural Networks (ANN) of Multi-Layer Perceptron (MLP) type, has been developed to estimate the viscosity at moderate pressure for pure nonpolar gases over a wide range of temperatures. An ANN was trained, using four physicochemical properties: Molecular weight (M), boiling point (Tb), critical Temperature (Tc) and critical Pressure (Pc) combined with absolute Temperature (T) as its inputs, to correlate and predict viscosity. A group of 52 nonpolar gases were ...
Gholamreza Asadollahfardi; Azadeh Hemati; Saber Moradinejad; Rashin Asadollahfardi
2013-01-01
Considering the significance of the Sodium Adsorption Ratio (SAR) for growing plants, its prediction is essential for water quality management for irrigation. The SAR prediction in Chelghazy River in Kurdistan, northwest of Iran, using an Artificial Neural Network (ANN) was studied. The study applied the Multilayer Perceptron (MLP) of the ANN to average monthly data, which was collected by the water authority of the Kurdistan province for the period of 1998-2009. The input parameters of the M...
Neural network modeling and correcting for delay-line data sets
Because of the effects of the capacitance and inductance parasitized on the readout PCB in GEM detector, the output time of the delay-line PCB puts up a non-linear relationship with the position of its input signal. Based on Back Propagation algorithm, the multi-layer perceptrons neural network approximated the non-linear function and gave out accurate analyses, which is a better method for data correcting in Delay-Line readout. (authors)
A numerical modeling of nonlinear load behavior using artificial neural networks
Panoiu, Manuela; Ghiormez, Loredana; Panoiu, Caius; Iordan, Anca
2013-10-01
In this paper it is performed a numerical study of the voltage-current characteristic of an electric arc. To predict voltages and currents values, a multi-layer perceptron Artificial Neural Networks was used under the Matlab 2012 environment. The study is based on actual recorded data obtained from a 100 tones AC Electric Arc Furnace. Results obtained by simulation are compared with the measured one.
Extraction of Rules from Data using Piecewise-Linear Neural Networks
Holeňa, Martin
Istanbul : ITU Management Science Fakulty, 2002, s. 1-8. ISBN 975-97963-0-9. [FSSCTIMIE'02. Istanbul (TR), 29.05.2002-31.05.2002] R&D Projects: GA AV ČR IAB2030007 Institutional research plan: AV0Z1030915 Keywords : knowledge extraction with artificial neural networks * Boolean rules * fuzzy rules * multilayer perceptron * piecewise-linear activation function * polyhedra and pseudopolyhedra * Lukasiewicz predicate calculus * rational McNaughton function Subject RIV: BA - General Mathematics
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
El-Shafie, A.; A. Noureldin; Taha, M. R.; A. Hussain
2011-01-01
Rainfall is considered as one of the major component of the hydrological process, it takes significant part of evaluating drought and flooding events. Therefore, it is important to have accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting task such as Multi-Layer Perceptron Neural Networks (MLP-NN). In fact, the rainfall time series modeling involves an important temporal dimension. On the other ha...
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
El-Shafie, A.; A. Noureldin; Taha, M.; A. Hussain; M. Mukhlisin
2012-01-01
Rainfall is considered as one of the major components of the hydrological process; it takes significant part in evaluating drought and flooding events. Therefore, it is important to have an accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting tasks as multi-layer perceptron neural networks (MLP-NN). In fact, the rainfall time series modeling involves an important temporal dimension. On t...
Spatial Disaggregation of Areal Rainfall Using Two Different Artificial Neural Networks Models
Sungwon Kim; Singh, Vijay P.
2015-01-01
The objective of this study is to develop artificial neural network (ANN) models, including multilayer perceptron (MLP) and Kohonen self-organizing feature map (KSOFM), for spatial disaggregation of areal rainfall in the Wi-stream catchment, an International Hydrological Program (IHP) representative catchment, in South Korea. A three-layer MLP model, using three training algorithms, was used to estimate areal rainfall. The Levenberg–Marquardt training algorithm was found to be more sensitive...
Artificial neural networks (ANN): prediction of sensory measurements from instrumental data
Naiara Barbosa Carvalho; Valéria Paula Rodrigues Minim; Rita de Cássia dos Santos Navarro Silva; Suzana Maria Della Lucia; Luis Aantonio Minim
2013-01-01
The objective of this study was to predict by means of Artificial Neural Network (ANN), multilayer perceptrons, the texture attributes of light cheesecurds perceived by trained judges based on instrumental texture measurements. Inputs to the network were the instrumental texture measurements of light cheesecurd (imitative and fundamental parameters). Output variables were the sensory attributes consistency and spreadability. Nine light cheesecurd formulations composed of different combination...
Dong, Zhekang; Duan, Shukai; Hu, Xiaofang; Wang, Lidan; Li, Hai
2014-01-01
In this paper, we present an implementation scheme of memristor-based multilayer feedforward small-world neural network (MFSNN) inspirited by the lack of the hardware realization of the MFSNN on account of the need of a large number of electronic neurons and synapses. More specially, a mathematical closed-form charge-governed memristor model is presented with derivation procedures and the corresponding Simulink model is presented, which is an essential block for realizing the memristive synapse and the activation function in electronic neurons. Furthermore, we investigate a more intelligent memristive PID controller by incorporating the proposed MFSNN into intelligent PID control based on the advantages of the memristive MFSNN on computation speed and accuracy. Finally, numerical simulations have demonstrated the effectiveness of the proposed scheme. PMID:25202723
Video Traffic Prediction Using Neural Networks
Miloš Oravec
2008-10-01
Full Text Available In this paper, we consider video stream prediction for application in services likevideo-on-demand, videoconferencing, video broadcasting, etc. The aim is to predict thevideo stream for an efficient bandwidth allocation of the video signal. Efficient predictionof traffic generated by multimedia sources is an important part of traffic and congestioncontrol procedures at the network edges. As a tool for the prediction, we use neuralnetworks – multilayer perceptron (MLP, radial basis function networks (RBF networksand backpropagation through time (BPTT neural networks. At first, we briefly introducetheoretical background of neural networks, the prediction methods and the differencebetween them. We propose also video time-series processing using moving averages.Simulation results for each type of neural network together with final comparisons arepresented. For comparison purposes, also conventional (non-neural prediction isincluded. The purpose of our work is to construct suitable neural networks for variable bitrate video prediction and evaluate them. We use video traces from [1].
Multi-layer SOM neural network for IC-items detection on photo-snapshot images of poly-silicon layer
Vatkin, M. E.
2003-01-01
The structure of multi-layer SOM neural network for structural items detection on a gray scale image of an integrated circuit (1С) is considered. The IC-items shape distortions invariant neural network structure and training rule are represented. The comparative outcomes of recognition have shown an advantage of neural network approach.
A design philosophy for multi-layer neural networks with applications to robot control
Vadiee, Nader; Jamshidi, MO
1989-01-01
A system is proposed which receives input information from many sensors that may have diverse scaling, dimension, and data representations. The proposed system tolerates sensory information with faults. The proposed self-adaptive processing technique has great promise in integrating the techniques of artificial intelligence and neural networks in an attempt to build a more intelligent computing environment. The proposed architecture can provide a detailed decision tree based on the input information, information stored in a long-term memory, and the adapted rule-based knowledge. A mathematical model for analysis will be obtained to validate the cited hypotheses. An extensive software program will be developed to simulate a typical example of pattern recognition problem. It is shown that the proposed model displays attention, expectation, spatio-temporal, and predictory behavior which are specific to the human brain. The anticipated results of this research project are: (1) creation of a new dynamic neural network structure, and (2) applications to and comparison with conventional multi-layer neural network structures. The anticipated benefits from this research are vast. The model can be used in a neuro-computer architecture as a building block which can perform complicated, nonlinear, time-varying mapping from a multitude of input excitory classes to an output or decision environment. It can be used for coordinating different sensory inputs and past experience of a dynamic system and actuating signals. The commercial applications of this project can be the creation of a special-purpose neuro-computer hardware which can be used in spatio-temporal pattern recognitions in such areas as air defense systems, e.g., target tracking, and recognition. Potential robotics-related applications are trajectory planning, inverse dynamics computations, hierarchical control, task-oriented control, and collision avoidance.
Neural networks and statistical learning
Du, Ke-Lin
2014-01-01
Providing a broad but in-depth introduction to neural network and machine learning in a statistical framework, this book provides a single, comprehensive resource for study and further research. All the major popular neural network models and statistical learning approaches are covered with examples and exercises in every chapter to develop a practical working understanding of the content. Each of the twenty-five chapters includes state-of-the-art descriptions and important research results on the respective topics. The broad coverage includes the multilayer perceptron, the Hopfield network, associative memory models, clustering models and algorithms, the radial basis function network, recurrent neural networks, principal component analysis, nonnegative matrix factorization, independent component analysis, discriminant analysis, support vector machines, kernel methods, reinforcement learning, probabilistic and Bayesian networks, data fusion and ensemble learning, fuzzy sets and logic, neurofuzzy models, hardw...
Design and FPGA-implementation of multilayer neural networks with on-chip learning
Artificial Neural Networks (ANN) is used in many applications in the industry because of their parallel structure, high speed, and their ability to give easy solution to complicated problems. For example identifying the orange and apple in the sorting machine with neural network is easier than using image processing techniques to do the same thing. There are different software for designing, training, and testing the ANN, but in order to use the ANN in the industry, it should be implemented on hardware outside the computer. Neural networks are artificial systems inspired on the brain's cognitive behavior, which can learn tasks with some degree of complexity, such as signal processing, diagnosis, robotics, image processing, and pattern recognition. Many applications demand a high computing power and the traditional software implementation are not sufficient.This thesis presents design and FPGA implementation of Multilayer Neural Networks with On-chip learning in re-configurable hardware. Hardware implementation of neural network algorithm is very interesting due their high performance and they can easily be made parallel. The architecture proposed herein takes advantage of distinct data paths for the forward and backward propagation stages and a pipelined adaptation of the on- line backpropagation algorithm to significantly improve the performance of the learning phase. The architecture is easily scalable and able to cope with arbitrary network sizes with the same hardware. The implementation is targeted diagnosis of the Research Reactor accidents to avoid the risk of occurrence of a nuclear accident. The proposed designed circuits are implemented using Xilinx FPGA Chip XC40150xv and occupied 73% of Chip CLBs. It achieved 10.8 μs to take decision in the forward propagation compared with current software implemented of RPS which take 24 ms. The results show that the proposed architecture leads to significant speed up comparing to high end software solutions. On-chip learning allows on line reconstruction of ANN. Re-configure ability and parallel structure of FPGA makes it possible to accomplish this task.
Limitations of One-Hidden-Layer Perceptron Networks
Kůrková, Věra
Aachen & Charleston : Technical University & CreateSpace Independent Publishing Platform, 2015 - (Yaghob, J.), s. 167-171 ISBN 978-1-5151-2065-0. ISSN 1613-0073. - (CEUR Workshop Proceedings. V-1422). [ITAT 2015. Conference on Theory and Practice of Information Technologies /15./. Slovenský Raj (SK), 17.09.2015-21.09.2015] R&D Projects: GA MŠk(CZ) LD13002 Institutional support: RVO:67985807 Keywords : perceptron networks * model complexity * representations of finite mappings by neural networks Subject RIV: IN - Informatics, Computer Science
Eduardo O. de Cerqueira
2001-12-01
Full Text Available Neural Networks are a set of mathematical methods and computer programs designed to simulate the information process and the knowledge acquisition of the human brain. In last years its application in chemistry is increasing significantly, due the special characteristics for model complex systems. The basic principles of two types of neural networks, the multi-layer perceptrons and radial basis functions, are introduced, as well as, a pruning approach to architecture optimization. Two analytical applications based on near infrared spectroscopy are presented, the first one for determination of nitrogen content in wheat leaves using multi-layer perceptrons networks and second one for determination of BRIX in sugar cane juices using radial basis functions networks.
A Novel Technique to Image Annotation using Neural Network
Pankaj Savita
2013-03-01
Full Text Available : Automatic annotation of digital pictures is a key technology for managing and retrieving images from large image collection. Traditional image semantics extraction and representation schemes were commonly divided into two categories, namely visual features and text annotations. However, visual feature scheme are difficult to extract and are often semantically inconsistent. On the other hand, the image semantics can be well represented by text annotations. It is also easier to retrieve images according to their annotations. Traditional image annotation techniques are time-consuming and requiring lots of human effort. In this paper we propose Neural Network based a novel approach to the problem of image annotation. These approaches are applied to the Image data set. Our main work is focused on the image annotation by using multilayer perceptron, which exhibits a clear-cut idea on application of multilayer perceptron with special features. MLP Algorithm helps us to discover the concealed relations between image data and annotation data, and annotate image according to such relations. By using this algorithm we can save more memory space, and in case of web applications, transferring of images and download should be fast. This paper reviews 50 image annotation systems using supervised machine learning Techniques to annotate images for image retrieval. Results obtained show that the multi layer perceptron Neural Network classifier outperforms conventional DST Technique.
Using Artificial Neural Networks for ECG Signals Denoising
Zoltn Germn-Sall
2010-12-01
Full Text Available The authors have investigated some potential applications of artificial neural networks in electrocardiografic (ECG signal prediction. For this, the authors used an adaptive multilayer perceptron structure to predict the signal. The proposed procedure uses an artificial neural network based learning structure to estimate the (n+1th sample from n previous samples To train and adjust the network weights, the backpropagation (BP algorithm was used. In this paper, prediction of ECG signals (as time series using multi-layer feedforward neural networks will be described. The results are evaluated through approximation error which is defined as the difference between the predicted and the original signal.The prediction procedure is carried out (simulated in MATLAB environment, using signals from MIT-BIH arrhythmia database. Preliminary results are encouraging enough to extend the proposed method for other types of data signals.
Holeňa, Martin; Baerns, M.
2003-01-01
Roč. 81, - (2003), s. 485-494. ISSN 0920-5861 Grant ostatní: BMBF(DE) FKZ 03C3013 Institutional research plan: CEZ:AV0Z1030915 Keywords : artificial neural network s * multilayer perceptron * dependency * approximation * network training * overtraining * knowledge extraction * logical rules * oxidative dehydrogenation of propane Subject RIV: BA - General Mathematics Impact factor: 2.627, year: 2003
Manjula Devi Ramasamy
2014-01-01
Full Text Available Multilayer Feed Forward Neural Network (MFNN has been successfully administered architectures for solving a wide range of supervised pattern recognition tasks. The most problematic task of MFNN is training phase which consumes very long training time on very huge training datasets. An enhanced linear adaptive skipping training algorithm for MFNN called Half of Threshold (HOT is proposed in this research paper. The core idea of this study is to reduce the training time through random presentation of training input samples without affecting the networks accuracy. The random presentation is done by partitioning the training dataset into two distinct classes, classified and misclassified class, based on the comparison result of the calculated error measure with half of threshold value. Only the input samples in the misclassified class are presented to the next epoch for training, whereas the correctly classified class is skipped linearly which dynamically reducing the number of input samples exhibited at every single epoch without affecting the networks accuracy. Thus decreasing the size of the training dataset linearly can reduce the total training time, thereby speeding up the training process. This HOT algorithm can be implemented with any training algorithm used for supervised pattern classification and its implementation is very simple and easy. Simulation study results proved that HOT training algorithm achieves faster training than the other standard training algorithm.
Memristor-based multilayer neural networks with online gradient descent training.
Soudry, Daniel; Di Castro, Dotan; Gal, Asaf; Kolodny, Avinoam; Kvatinsky, Shahar
2015-10-01
Learning in multilayer neural networks (MNNs) relies on continuous updating of large matrices of synaptic weights by local rules. Such locality can be exploited for massive parallelism when implementing MNNs in hardware. However, these update rules require a multiply and accumulate operation for each synaptic weight, which is challenging to implement compactly using CMOS. In this paper, a method for performing these update operations simultaneously (incremental outer products) using memristor-based arrays is proposed. The method is based on the fact that, approximately, given a voltage pulse, the conductivity of a memristor will increment proportionally to the pulse duration multiplied by the pulse magnitude if the increment is sufficiently small. The proposed method uses a synaptic circuit composed of a small number of components per synapse: one memristor and two CMOS transistors. This circuit is expected to consume between 2% and 8% of the area and static power of previous CMOS-only hardware alternatives. Such a circuit can compactly implement hardware MNNs trainable by scalable algorithms based on online gradient descent (e.g., backpropagation). The utility and robustness of the proposed memristor-based circuit are demonstrated on standard supervised learning tasks. PMID:25594981
A Deterministic and Polynomial Modified Perceptron Algorithm
Olof Barr
2006-01-01
Full Text Available We construct a modified perceptron algorithm that is deterministic, polynomial and also as fast as previous known algorithms. The algorithm runs in time O(mn3lognlog(1/ρ, where m is the number of examples, n the number of dimensions and ρ is approximately the size of the margin. We also construct a non-deterministic modified perceptron algorithm running in timeO(mn2lognlog(1/ρ.
Evaluation of artificial neural network techniques for flow forecasting in the River Yangtze, China
C. W. Dawson; Harpham, C.; Wilby, R. L.; Chen, Y
2002-01-01
While engineers have been quantifying rainfall-runoff processes since the mid-19th century, it is only in the last decade that artificial neural network models have been applied to the same task. This paper evaluates two neural networks in this context: the popular multilayer perceptron (MLP), and the radial basis function network (RBF). Using six-hourly rainfall-runoff data for the River Yangtze at Yichang (upstream of the Three Gorges Dam) for the period 1991 to 1993, it is shown that both ...
A Neural Auto-depth Controller for an Unmanned Underwater Vehicle
Sutton, R.; Johnson, C.; Roberts, G. N.
Artificial neural networks offer an alternative strategy for the nonlinear control of unmanned underwater vehicles (UUVS). This paper investigates the use of a multi-layered perceptron (MLP) network in controlling an UUV over a sea-bed profile and compares the use of applying chemotaxis learning to that of the more commonly employed back propagation algorithm. The results show that, for differing sized MLPs, the chemotaxis algorithm produces a successful controller over the sea-bed profile in an improved training time. Also it will be shown that, in the presence of noise and change in vehicle mass, the neural controller out-performed a classical proportional-integral-derivative controller.
THE USE OF NEURAL NETWORK TECHNOLOGY TO MODEL SWIMMING PERFORMANCE
António José Silva
2007-03-01
Full Text Available The aims of the present study were: to identify the factors which are able to explain the performance in the 200 meters individual medley and 400 meters front crawl events in young swimmers, to model the performance in those events using non-linear mathematic methods through artificial neural networks (multi-layer perceptrons and to assess the neural network models precision to predict the performance. A sample of 138 young swimmers (65 males and 73 females of national level was submitted to a test battery comprising four different domains: kinanthropometric evaluation, dry land functional evaluation (strength and flexibility, swimming functional evaluation (hydrodynamics, hydrostatic and bioenergetics characteristics and swimming technique evaluation. To establish a profile of the young swimmer non-linear combinations between preponderant variables for each gender and swim performance in the 200 meters medley and 400 meters font crawl events were developed. For this purpose a feed forward neural network was used (Multilayer Perceptron with three neurons in a single hidden layer. The prognosis precision of the model (error lower than 0.8% between true and estimated performances is supported by recent evidence. Therefore, we consider that the neural network tool can be a good approach in the resolution of complex problems such as performance modeling and the talent identification in swimming and, possibly, in a wide variety of sports
Using neural networks for prediction of nuclear parameters
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Using neural networks for prediction of nuclear parameters
Pereira Filho, Leonidas; Souto, Kelling Cabral, E-mail: leonidasmilenium@hotmail.com, E-mail: kcsouto@bol.com.br [Instituto Federal de Educacao, Ciencia e Tecnologia do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ (Brazil); Machado, Marcelo Dornellas, E-mail: dornemd@eletronuclear.gov.br [Eletrobras Termonuclear S.A. (GCN.T/ELETRONUCLEAR), Rio de Janeiro, RJ (Brazil). Gerencia de Combustivel Nuclear
2013-07-01
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
APPLICATION OF NEURAL NETWORK ALGORITHMS FOR BPM LINEARIZATION
Musson, John C. [JLAB; Seaton, Chad [JLAB; Spata, Mike F. [JLAB; Yan, Jianxun [JLAB
2012-11-01
Stripline BPM sensors contain inherent non-linearities, as a result of field distortions from the pickup elements. Many methods have been devised to facilitate corrections, often employing polynomial fitting. The cost of computation makes real-time correction difficult, particulalry when integer math is utilized. The application of neural-network technology, particularly the multi-layer perceptron algorithm, is proposed as an efficient alternative for electrode linearization. A process of supervised learning is initially used to determine the weighting coefficients, which are subsequently applied to the incoming electrode data. A non-linear layer, known as an activation layer, is responsible for the removal of saturation effects. Implementation of a perceptron in an FPGA-based software-defined radio (SDR) is presented, along with performance comparisons. In addition, efficient calculation of the sigmoidal activation function via the CORDIC algorithm is presented.
Dynamic neural controllers for induction motor.
Brdy?, M A; Kulawski, G J
1999-01-01
The paper reports application of recently developed adaptive control techniques based on neural networks to the induction motor control. This case study represents one of the more difficult control problems due to the complex, nonlinear, and time-varying dynamics of the motor and unavailability of full-state measurements. A partial solution is first presented based on a single input-single output (SISO) algorithm employing static multilayer perceptron (MLP) networks. A novel technique is subsequently described which is based on a recurrent neural network employed as a dynamical model of the plant. Recent stability results for this algorithm are reported. The technique is applied to multiinput-multioutput (MIMO) control of the motor. A simulation study of both methods is presented. It is argued that appropriately structured recurrent neural networks can provide conveniently parameterized dynamic models for many nonlinear systems for use in adaptive control. PMID:18252531
Advances in Artificial Neural Networks – Methodological Development and Application
Yanbo Huang
2009-08-01
Full Text Available Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other networks such as radial basis function, recurrent network, feedback network, and unsupervised Kohonen self-organizing network. These networks, especially the multilayer perceptron network with a backpropagation training algorithm, have gained recognition in research and applications in various scientific and engineering areas. In order to accelerate the training process and overcome data over-fitting, research has been conducted to improve the backpropagation algorithm. Further, artificial neural networks have been integrated with other advanced methods such as fuzzy logic and wavelet analysis, to enhance the ability of data interpretation and modeling and to avoid subjectivity in the operation of the training algorithm. In recent years, support vector machines have emerged as a set of high-performance supervised generalized linear classifiers in parallel with artificial neural networks. A review on development history of artificial neural networks is presented and the standard architectures and algorithms of artificial neural networks are described. Furthermore, advanced artificial neural networks will be introduced with support vector machines, and limitations of ANNs will be identified. The future of artificial neural network development in tandem with support vector machines will be discussed in conjunction with further applications to food science and engineering, soil and water relationship for crop management, and decision support for precision agriculture. Along with the network structures and training algorithms, the applications of artificial neural networks will be reviewed as well, especially in the fields of agricultural and biological engineering.
An optimization methodology for neural network weights and architectures.
Ludermir, Teresa B; Yamazaki, Akio; Zanchettin, Cleber
2006-11-01
This paper introduces a methodology for neural network global optimization. The aim is the simultaneous optimization of multilayer perceptron (MLP) network weights and architectures, in order to generate topologies with few connections and high classification performance for any data sets. The approach combines the advantages of simulated annealing, tabu search and the backpropagation training algorithm in order to generate an automatic process for producing networks with high classification performance and low complexity. Experimental results obtained with four classification problems and one prediction problem has shown to be better than those obtained by the most commonly used optimization techniques. PMID:17131660
Prediction of total resistance coefficients using neural networks
Ortigosa Barragn, Inma; Revilla Lpez, Guillermo; Garca Espinosa, Julio
2009-01-01
The Holtrop & Mennen method is widely used at the initial design stage of ships for estimating the resistance of the ship (Holtrop and Mennen, 1982). The Holtrop & Mennen method provide a prediction of the total resistances components. In this work we present a neural network model which performs the same task as the Holtrop & Mennems method, for two of the total resistances components. A multilayer perceptron has been therefore trained to learn the relationship between the input (length-d...
Intelligent Handwritten Digit Recognition using Artificial Neural Network
Saeed AL-Mansoori
2015-05-01
Full Text Available The aim of this paper is to implement a Multilayer Perceptron (MLP Neural Network to recognize and predict handwritten digits from 0 to 9. A dataset of 5000 samples were obtained from MNIST. The dataset was trained using gradient descent back-propagation algorithm and further tested using the feed-forward algorithm. The system performance is observed by varying the number of hidden units and the number of iterations. The performance was thereafter compared to obtain the network with the optimal parameters. The proposed system predicts the handwritten digits with an overall accuracy of 99.32%.
AN FUZZY NEURAL APPROACH FOR MEDICAL IMAGE RETRIEVAL
C. Sriramakrishnan
2012-01-01
Full Text Available Image retrieval based on a query image is necessary for effective and efficient use the information that is stored in medical image databases. Medical Image Retrieval is difficult as not only the localization and directionality of human visual system is to be considered but also the pathological condition. Image identification and segmentation for feature extraction pose a challenge to image retrieval process. Challenges posed include large number of images to be processed for the image retrieval and identifying the region of interest automatically to optimize the search. In this study, we propose a novel image segmentation algorithm Fuzzy Edge Detection and Segmentation (FEDS. The proposed FEDS algorithm is tested on medical images and for classification of images, a bell fuzzy multilayer perceptron is proposed. The proposed neural network Bell Fuzzy Multi Layer Perceptron (BF-MLP Neural network is constructed by introducing a fuzzy logic in hidden layer with the sugeno model and bell function. The proposed neural network consists of two layers with the first layer being a tanh activation function and the second layer containing the bell fuzzy activation function. The proposed FEDS method was implemented using Matlab and Modelsim. A total of 44 images were considered with three class labels. The edge obtained for which segmentation is done using the proposed segmentation algorithm. The proposed BF-MLP neural network algorithm was implemented using Visual Studio and the classification accuracy compared with MLP Neural Network with sigmoid activation function. In this study, a fuzzy segmentation algorithm and a fuzzy classification algorithm is proposed to improve the medical image retrieval accuracy. The proposed segmentation algorithm, Fuzzy Edge Detection and Segmentation (FEDS, was implemented using Matlab and features were extracted using Fast Hartley Transform (FHT. The extracted features were used to train the proposed neural network, Bell Fuzzy Multi Layer Perceptron Neural Network (BF-MLP. 44 images with 3 class labels were used to test the algorithm and classification accuracy of 93.2% was obtained.
Furini, M.A.; Araujo, P.B. de; Pereira, A.L.S. [Universidade Estadual Paulista (FEIS/UNESP), Ilha Solteira, SP (Brazil). Fac. de Engenharia. Dept. Engenharia Eletrica], Emails: mafurini@aluno.feis.unesp.br, percival@dee.feis.unesp.br, andspa@gmail.com
2009-07-01
This paper aims at analyzing the main operation and design of operationally robust controllers in order to damp the electromechanics oscillations type inter area. For this we used an intelligent control technique based on artificial neural networks, where a multilayer perceptron it was implemented. We used a symmetrical test system of four generators, ten bars and nine transmission lines to verify the performance of the power system stabilizers and power oscillation damping (POD) for the FACTS devices, unified power flow controller (UPFC), designed for neural networks. The results show the superiority in the operation and control of oscillations in power systems using UPFC equipped with the POD.
Best approximation by Heaviside perceptron networks.
Kainen, P; K?rkov, V; Vogt, A
2000-09-01
In Lp-spaces with p an integer from [1, infinity) there exists a best approximation mapping to the set of functions computable by Heaviside perceptron networks with n hidden units; however for p an integer from (1, infinity) such best approximation is not unique and cannot be continuous. PMID:11152201
Neural Networks for Non-linear Control
Sørensen, O.
This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process.......This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process....
Radial basis function neural network for power system load-flow
This paper presents a method for solving the load-flow problem of the electric power systems using radial basis function (RBF) neural network with a fast hybrid training method. The main idea is that some operating conditions (values) are needed to solve the set of non-linear algebraic equations of load-flow by employing an iterative numerical technique. Therefore, we may view the outputs of a load-flow program as functions of the operating conditions. Indeed, we are faced with a function approximation problem and this can be done by an RBF neural network. The proposed approach has been successfully applied to the 10-machine and 39-bus New England test system. In addition, this method has been compared with that of a multi-layer perceptron (MLP) neural network model. The simulation results show that the RBF neural network is a simpler method to implement and requires less training time to converge than the MLP neural network. (author)
Hierarchical Neural Network Structures for Phoneme Recognition
Vasquez, Daniel; Minker, Wolfgang
2013-01-01
In this book, hierarchical structures based on neural networks are investigated for automatic speech recognition. These structures are evaluated on the phoneme recognition task where a Hybrid Hidden Markov Model/Artificial Neural Network paradigm is used. The baseline hierarchical scheme consists of two levels each which is based on a Multilayered Perceptron. Additionally, the output of the first level serves as a second level input. The computational speed of the phoneme recognizer can be substantially increased by removing redundant information still contained at the first level output. Several techniques based on temporal and phonetic criteria have been investigated to remove this redundant information. The computational time could be reduced by 57% whilst keeping the system accuracy comparable to the baseline hierarchical approach.
Chattopadhyay, Surajit; Chattopadhyay, Goutami
2012-10-01
In the work discussed in this paper we considered total ozone time series over Kolkata (22°34'10.92″N, 88°22'10.92″E), an urban area in eastern India. Using cloud cover, average temperature, and rainfall as the predictors, we developed an artificial neural network, in the form of a multilayer perceptron with sigmoid non-linearity, for prediction of monthly total ozone concentrations from values of the predictors in previous months. We also estimated total ozone from values of the predictors in the same month. Before development of the neural network model we removed multicollinearity by means of principal component analysis. On the basis of the variables extracted by principal component analysis, we developed three artificial neural network models. By rigorous statistical assessment it was found that cloud cover and rainfall can act as good predictors for monthly total ozone when they are considered as the set of input variables for the neural network model constructed in the form of a multilayer perceptron. In general, the artificial neural network has good potential for predicting and estimating monthly total ozone on the basis of the meteorological predictors. It was further observed that during pre-monsoon and winter seasons, the proposed models perform better than during and after the monsoon.
Neural networks: a biased overview
An overview of recent activity in the field of neural networks is presented. The long-range aim of this research is to understand how the brain works. First some of the problems are stated and terminology defined; then an attempt is made to explain why physicists are drawn to the field, and their main potential contribution. In particular, in recent years some interesting models have been introduced by physicists. A small subset of these models is described, with particular emphasis on those that are analytically soluble. Finally a brief review of the history and recent developments of single- and multilayer perceptrons is given, bringing the situation up to date regarding the central immediate problem of the field: search for a learning algorithm that has an associated convergence theorem
Practical Application of Neural Networks in State Space Control
Bendtsen, Jan Dimon
In the present thesis we address some problems in discrete-time state space control of nonlinear dynamical systems and attempt to solve them using generic nonlinear models based on artificial neural networks. The main aim of the work is to examine how well such control algorithms perform when...... applied to a realistic process. The thesis therefore strives to provide a thorough treatment of two classes of neural network-based controllers, and to make a rigorous comparison between them and a classical linear controller. Thus, the thesis starts out with a short review of some relevant system...... theoretic notions followed by a detailed description of the topology, neuron functions and learning rules of the two types of neural networks treated in the thesis, the multilayer perceptron and the neurofuzzy networks. In both cases, a Least Squares second-order gradient method is used to train the...
Inversion of surface parameters using fast learning neural networks
Dawson, M. S.; Olvera, J.; Fung, A. K.; Manry, M. T.
1992-01-01
A neural network approach to the inversion of surface scattering parameters is presented. Simulated data sets based on a surface scattering model are used so that the data may be viewed as taken from a completely known randomly rough surface. The fast learning (FL) neural network and a multilayer perceptron (MLP) trained with backpropagation learning (BP network) are tested on the simulated backscattering data. The RMS error of training the FL network is found to be less than one half the error of the BP network while requiring one to two orders of magnitude less CPU time. When applied to inversion of parameters from a statistically rough surface, the FL method is successful at recovering the surface permittivity, the surface correlation length, and the RMS surface height in less time and with less error than the BP network. Further applications of the FL neural network to the inversion of parameters from backscatter measurements of an inhomogeneous layer above a half space are shown.
Determination of osteoporosis risk using by neural networks method
Veysi Akpolat
2009-06-01
Full Text Available Artificial neural networks (ANNs have become modeling tools that have found extensive acceptance and they have frequently used in applications in many disciplines for solving complex problems. Different ANN structures are valuable models, which are used in the medical field for the development of decision support systems. In this paper, the learning and classification processes are used for determining the level of bone-density (safe / risk of osteoporosis in woman. In this study, three different structured neural networks were used for classifying of osteoporosis and the most efficient structure was determined. The training network structures were Multilayer perceptron neural network (MLP, Linear Vector Quantization (LVQ and Self Organizing Map (SOM. Performance indicators and statistical measures were used for evaluating the structures and the results demonstrated that the MLP was the most efficient structure for classifying of osteoporosis.
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
A. El-Shafie
2012-04-01
Full Text Available Rainfall is considered as one of the major components of the hydrological process; it takes significant part in evaluating drought and flooding events. Therefore, it is important to have an accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting tasks as multi-layer perceptron neural networks (MLP-NN. In fact, the rainfall time series modeling involves an important temporal dimension. On the other hand, the classical MLP-NN is a static and has a memoryless network architecture that is effective for complex nonlinear static mapping. This research focuses on investigating the potential of introducing a neural network that could address the temporal relationships of the rainfall series.
Two different static neural networks and one dynamic neural network, namely the multi-layer perceptron neural network (MLP-NN, radial basis function neural network (RBFNN and input delay neural network (IDNN, respectively, have been examined in this study. Those models had been developed for the two time horizons for monthly and weekly rainfall forecasting at Klang River, Malaysia. Data collected over 12 yr (1997–2008 on a weekly basis and 22 yr (1987–2008 on a monthly basis were used to develop and examine the performance of the proposed models. Comprehensive comparison analyses were carried out to evaluate the performance of the proposed static and dynamic neural networks. Results showed that the MLP-NN neural network model is able to follow trends of the actual rainfall, however, not very accurately. RBFNN model achieved better accuracy than the MLP-NN model. Moreover, the forecasting accuracy of the IDNN model was better than that of static network during both training and testing stages, which proves a consistent level of accuracy with seen and unseen data.
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
El-Shafie, A.; Noureldin, A.; Taha, M.; Hussain, A.; Mukhlisin, M.
2012-04-01
Rainfall is considered as one of the major components of the hydrological process; it takes significant part in evaluating drought and flooding events. Therefore, it is important to have an accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting tasks as multi-layer perceptron neural networks (MLP-NN). In fact, the rainfall time series modeling involves an important temporal dimension. On the other hand, the classical MLP-NN is a static and has a memoryless network architecture that is effective for complex nonlinear static mapping. This research focuses on investigating the potential of introducing a neural network that could address the temporal relationships of the rainfall series. Two different static neural networks and one dynamic neural network, namely the multi-layer perceptron neural network (MLP-NN), radial basis function neural network (RBFNN) and input delay neural network (IDNN), respectively, have been examined in this study. Those models had been developed for the two time horizons for monthly and weekly rainfall forecasting at Klang River, Malaysia. Data collected over 12 yr (1997-2008) on a weekly basis and 22 yr (1987-2008) on a monthly basis were used to develop and examine the performance of the proposed models. Comprehensive comparison analyses were carried out to evaluate the performance of the proposed static and dynamic neural networks. Results showed that the MLP-NN neural network model is able to follow trends of the actual rainfall, however, not very accurately. RBFNN model achieved better accuracy than the MLP-NN model. Moreover, the forecasting accuracy of the IDNN model was better than that of static network during both training and testing stages, which proves a consistent level of accuracy with seen and unseen data.
Neural networks in front-end processing and control
Research into neural networks has gained a large following in recent years. In spite of the long term timescale of this Artificial Intelligence research, the tools which the community is developing can already find useful applications to real practical problems in experimental research. One of the main advantages of the parallel algorithms being developed in AI is the structural simplicity of the required hardware implementation, and the simple nature of the calculations involved. This makes these techniques ideal for problems in which both speed and data volume reduction are important, the case for most front-end processing tasks. In this paper we illustrate the use of a particular neural network known as the Multi-Layer Perceptron as a method for solving several different tasks, all drawn from the field of Tokamak research. We also briefly discuss the use of the Multi-Layer Perceptron as a non-linear controller in a feedback loop. We outline the type of problem which can be usefully addressed by these techniques, even before the large-scale parallel processing hardware currently under development becomes cheaply available. We also present some of the difficulties encountered in applying these networks. (author) 13 figs., 9 refs
An Intelligent Ensemble Neural Network Model for Wind Speed Prediction in Renewable Energy Systems
Ranganayaki, V.; Deepa, S. N.
2016-01-01
Various criteria are proposed to select the number of hidden neurons in artificial neural network (ANN) models and based on the criterion evolved an intelligent ensemble neural network model is proposed to predict wind speed in renewable energy applications. The intelligent ensemble neural model based wind speed forecasting is designed by averaging the forecasted values from multiple neural network models which includes multilayer perceptron (MLP), multilayer adaptive linear neuron (Madaline), back propagation neural network (BPN), and probabilistic neural network (PNN) so as to obtain better accuracy in wind speed prediction with minimum error. The random selection of hidden neurons numbers in artificial neural network results in overfitting or underfitting problem. This paper aims to avoid the occurrence of overfitting and underfitting problems. The selection of number of hidden neurons is done in this paper employing 102 criteria; these evolved criteria are verified by the computed various error values. The proposed criteria for fixing hidden neurons are validated employing the convergence theorem. The proposed intelligent ensemble neural model is applied for wind speed prediction application considering the real time wind data collected from the nearby locations. The obtained simulation results substantiate that the proposed ensemble model reduces the error value to minimum and enhances the accuracy. The computed results prove the effectiveness of the proposed ensemble neural network (ENN) model with respect to the considered error factors in comparison with that of the earlier models available in the literature.
An Intelligent Ensemble Neural Network Model for Wind Speed Prediction in Renewable Energy Systems.
Ranganayaki, V; Deepa, S N
2016-01-01
Various criteria are proposed to select the number of hidden neurons in artificial neural network (ANN) models and based on the criterion evolved an intelligent ensemble neural network model is proposed to predict wind speed in renewable energy applications. The intelligent ensemble neural model based wind speed forecasting is designed by averaging the forecasted values from multiple neural network models which includes multilayer perceptron (MLP), multilayer adaptive linear neuron (Madaline), back propagation neural network (BPN), and probabilistic neural network (PNN) so as to obtain better accuracy in wind speed prediction with minimum error. The random selection of hidden neurons numbers in artificial neural network results in overfitting or underfitting problem. This paper aims to avoid the occurrence of overfitting and underfitting problems. The selection of number of hidden neurons is done in this paper employing 102 criteria; these evolved criteria are verified by the computed various error values. The proposed criteria for fixing hidden neurons are validated employing the convergence theorem. The proposed intelligent ensemble neural model is applied for wind speed prediction application considering the real time wind data collected from the nearby locations. The obtained simulation results substantiate that the proposed ensemble model reduces the error value to minimum and enhances the accuracy. The computed results prove the effectiveness of the proposed ensemble neural network (ENN) model with respect to the considered error factors in comparison with that of the earlier models available in the literature. PMID:27034973
Artificial Neural Network Solutions of Slab-Geometry Neutron Diffusion Problems
Artificial neural network (ANN) methods have been researched extensively within the nuclear community for applications in systems control, diagnostics, and signal processing. We consider here the use of multilayer perceptron ANNs as an alternative to finite-difference and finite-element methods for obtaining solutions to neutron diffusion problems. This work is based on a method proposed by van Milligen et. al. to obtain solutions of the differential equations arising in plasma physics applications. This ANN method has the potential advantage of yielding an accurate, differentiable approximation to the solution of diffusion problems at all points in the spatial domain
Alternative Sensor System and MLP Neural Network for Vehicle Pedal Activity Estimation
Ahmed M. Wefky
2010-04-01
Full Text Available It is accepted that the activity of the vehicle pedals (i.e., throttle, brake, clutch reflects the driver’s behavior, which is at least partially related to the fuel consumption and vehicle pollutant emissions. This paper presents a solution to estimate the driver activity regardless of the type, model, and year of fabrication of the vehicle. The solution is based on an alternative sensor system (regime engine, vehicle speed, frontal inclination and linear acceleration that reflects the activity of the pedals in an indirect way, to estimate that activity by means of a multilayer perceptron neural network with a single hidden layer.
Noise reduction technique for images using radial basis function neural networks
This paper presents a NN (Neural Network) based model for reducing the noise from images. This is a RBF (Radial Basis Function) network which is used to reduce the effect of noise and blurring from the captured images. The proposed network calculates the mean MSE (Mean Square Error) and PSNR (Peak Signal to Noise Ratio) of the noisy images. The proposed network has also been successfully applied to medical images. The performance of the trained RBF network has been compared with the MLP (Multilayer Perceptron) Network and it has been demonstrated that the performance of the RBF network is better than the MLP network. (author)
The artificial neural network technique was used to identify drugs and plastic explosives, from a tomography composed by a set of six neutrongraphic projections obtained in real time. Bidimensional tomographic images of samples of drugs, explosives and other materials, when digitally processed, yield the characteristic spectra of each type of material. The information contained in those spectra was then used for ANN training, the best images being obtained when the multilayer perceptron model, the back-propagation training algorithm and the Cross-validation interruption criterion were used. ANN showed to be useful in forecasting presence of drugs and explosives hitting a rate of success above 97 %. (author)
EEG signal classification based on artificial neural networks and amplitude spectra features
Chojnowski, K.; FrÄ czek, J.
BCI (called Brain-Computer Interface) is an interface that allows direct communication between human brain and an external device. It bases on EEG signal collection, processing and classification. In this paper a complete BCI system is presented which classifies EEG signal using artificial neural networks. For this purpose we used a multi-layered perceptron architecture trained with the RProp algorithm. Furthermore a simple multi-threaded method for automatic network structure optimizing was shown. We presented the results of our system in the opening and closing eyes recognition task. We also showed how our system could be used for controlling devices basing on imaginary hand movements.
Pattern recognition in high energy physics with artificial neural networks - JETNET 2.0
A F77 package of adaptive artificial neural network algorithms, JETNET 2.0, is presented. Its primary target is the high energy physics community, but it is general enough to be used in any pattern-recognition application area. The basic ingredients are the multilayer perceptron back-propagation algorithm and the topological self-organizing map. The package consists of a set of subroutines, which can either be used with standard options or be easily modified to host alternative architectures and procedures. (orig.)
Fast non-linear extraction of plasma equilibrium parameters using a neural network mapping
The shaping of non-circular plasmas requires a non-linear mapping between the measured diagnostic signals and selected equilibrium parameters. The particular configuration of Neural Network known as the multi-layer perceptron provides a powerful and general technique for formulating an arbitrary continuous non-linear multi-dimensional mapping. This technique has been successfully applied to the extraction of equilibrium parameters from measurements of single-null diverted plasmas in the DIII-D tokamak; the results are compared with a purely linear mapping. The method is promising, and hardware implementation is straightforward. (author) 15 refs., 7 figs
Foreground removal from WMAP 5yr temperature maps using an MLP neural network
Nielsen, H U Nørgaard -
2010-01-01
One of the main obstacles for extracting the cosmic microwave background (CMB) signal from observations in the mm/sub-mm range is the foreground contamination by emission from Galactic component: mainly synchrotron, free-free, and thermal dust emission. The statistical nature of the intrinsic CMB signal makes it essential to minimize the systematic errors in the CMB temperature determinations. The feasibility of using simple neural networks to extract the CMB signal from detailed simulated data has already been demonstrated. Here, simple neural networks are applied to the WMAP 5yr temperature data without using any auxiliary data. A simple \\emph{multilayer perceptron} neural network with two hidden layers provides temperature estimates over more than 75 per cent of the sky with random errors significantly below those previously extracted from these data. Also, the systematic errors, i.e.\\ errors correlated with the Galactic foregrounds, are very small. With these results the neural network method is well prep...
A Study on Modeling of MIMO Channel by Using Different Neural Network Structures
N. Prabhakar
2012-11-01
Full Text Available Recognition of Radio Channel (channelParameters is one of Main Challenges in SignalTransformation, and has important role in cognitive radioapproach. Goal of this paper is “Channel modeling” to estimatecoefficients of transmission functions affected on data beingtransformed in the channel. We use Multilayer perceptron(MLPNeural Network with Back-propagation learning algorithm,block-structured Neural Network with Least Squares(LSmethod(cost function and a multilayer neural network withmultiple back-propagation(MBP learning algorithm for errorestimation. These networks will be trained with received signalsto be compatible with channel, then give us an estimation of thesecoefficients. Simulation will show that this MBP method is betterthan the other two method in error estimation. It has goodperformance and also consume less execution time. Then, we willuse this network for estimating coefficients of non-lineartransmission functions of actual radio channel.
Intelligent control of HVAC systems. Part II: perceptron performance analysis
Ioan URSU
2013-09-01
Full Text Available This is the second part of a paper on intelligent type control of Heating, Ventilating, and Air-Conditioning (HVAC systems. The whole study proposes a unified approach in the design of intelligent control for such systems, to ensure high energy efficiency and air quality improving. In the first part of the study it is considered as benchmark system a single thermal space HVAC system, for which it is assigned a mathematical model of the controlled system and a mathematical model(algorithm of intelligent control synthesis. The conception of the intelligent control is of switching type, between a simple neural network, a perceptron, which aims to decrease (optimize a cost index,and a fuzzy logic component, having supervisory antisaturating role for neuro-control. Based on numerical simulations, this Part II focuses on the analysis of system operation in the presence only ofthe neural control component. Working of the entire neuro-fuzzy system will be reported in a third part of the study.
How to Improve the Generalization Ability of Multi-layer Neural Networks
Šebesta, Václav
Vol. 6. Orlando : IIIS, 2002 - (Callaos, N.; Pisarchik, A.; Ueda, M.), s. 108-113 ISBN 980-07-8150-1. [ISAS SCI 2002. World Multiconference on Systemics, Cybernetics and Informatics /6./. Orlando (US), 14.07.2002-18.07.2002] R&D Projects: GA AV ČR IAA2030801; GA ČR GA102/02/0124 Institutional research plan: AV0Z1030915 Keywords : neural networks topology * neural networks learning * generalization ability * prediction * classification * data mining Subject RIV: BA - General Mathematics
Representations of Boolean Functions by Perceptron Networks
Kůrková, Věra
Prague : Institute of Computer Science AS CR, 2014 - (Kůrková, V.; Bajer, L.; Peška, L.; Vojtáš, R.; Holeňa, M.; Nehéz, M.), s. 68-70 ISBN 978-80-87136-19-5. [ITAT 2014. European Conference on Information Technologies - Applications and Theory /14./. Demänovská dolina (SK), 25.09.2014-29.09.2014] R&D Projects: GA MŠk(CZ) LD13002 Institutional support: RVO:67985807 Keywords : perceptron networks * model complexity * Boolean functions Subject RIV: IN - Informatics, Computer Science
Identification of Non-Linear Structures using Recurrent Neural Networks
Kirkegaard, Poul Henning; Nielsen, Søren R. K.; Hansen, H. I.
Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure.......Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure....
Training a multilayer neural network for the Euro-dollar (EUR/ USD exchange rate
Jaime Alberto Villamil Torres
2010-04-01
Full Text Available A mathematical tool or model for predicting how an economic variable like the exchange rate (relative price between two currencies will respond is a very important need for investors and policy-makers. Most current techniques are based on statistics, particularly linear time series theory. Artificial neural networks (ANNs are mathematical models which try to emulate biological neural networks’ parallelism and nonlinearity; these models have been successfully applied in Economics and Engineering since the 1980s. ANNs appear to be an alternative for modelling the behaviour of financial variables which resemble (as first approximation a random walk. This paper reports the results of using ANNs for Euro/USD exchange rate trading and the usefulness of the algorithm for chemotaxis leading to training networks thereby maximising an objective function re predicting a trader’s profits. JEL: F310, C450.
PREDICTION OF BOD AND COD OF A REFINERY WASTEWATER USING MULTILAYER ARTIFICIAL NEURAL NETWORKS
Eldon Raj Rene; Saidutta, M. B.
2008-01-01
In the recent past, artificial neural networks (ANNs) have shown the ability to learn and capture non-linear static or dynamic behaviour among variables based on the given set of data. Since the knowledge of internal procedure is not necessary, the modelling can take place with minimum previous knowledge about the process through proper training of the network. In the present study, 12 ANN based models were proposed to predict the Biochemical Oxygen Demand (BOD5) and Chemical Oxygen Demand (C...
S. Nadimi, Esmaeil; Nyholm Jørgensen, Rasmus; Blanes-Vidal, Victoria; Christensen, Svend
2012-01-01
a multilayer perceptron (MLP)-based artificial neural network (ANN). The best performance of the ANN in terms of the mean squared error (MSE) and the convergence speed was achieved when it was initialized and trained using the Nguyen–Widrow and Levenberg–Marquardt back-propagation algorithms...... their corresponding behavioral modes. However, network unreliability and high-energy consumption have limited the applicability of those systems. In this study, a 2.4-GHz ZigBee-based mobile ad hoc wireless sensor network (MANET) that is able to overcome those problems is presented. The designed MANET...
Optimal Capacity of the Blume-Emery-Griffiths perceptron
Bolle', D.; Castillo, I. Perez; Shim, G. M.
2002-01-01
A Blume-Emery-Griffiths perceptron model is introduced and its optimal capacity is calculated within the replica-symmetric Gardner approach, as a function of the pattern activity and the imbedding stability parameter. The stability of the replica-symmetric approximation is studied via the analogue of the Almeida-Thouless line. A comparison is made with other three-state perceptrons.
Multi-Party Security System using Artificial Neural Networks
Urvashi Rahul Saxena
2012-09-01
Full Text Available Multi-Party Security System is an improvised version of various security systems available using Artificial Neural Networks (ANNs as an Intelligent Agent for Intrusion Detection. This Paper focuses how inputs can be preserved to serve as a measure for securing communication protocol between two parties using privacy protocols at the hidden layer of Multi-layer Perceptron model. Various neural network structures are observed for evaluating the optimal network considering the number of hidden layers. Results depict that the generated system is capable of classifying records with about 90% of accuracy when two hidden layers are engulfed and the accuracy reduces to 87% with one hidden layer under observation.
Implementation of multi-layer feed forward neural network on PIC16F877 microcontroller
Artificial Neural Network (ANN) is an electronic model based on the neural structure of the brain. Similar to human brain, ANN consists of interconnected simple processing units or neurons that process input to generate output signals. ANN operation is divided into 2 categories; training mode and service mode. This project aims to implement ANN on PIC micro-controller that enable on-chip or stand alone training and service mode. The input can varies from sensors or switches, while the output can be used to control valves, motors, light source and a lot more. As partial development of the project, this paper reports the current status and results of the implemented ANN. The hardware fraction of this project incorporates Microchip PIC16F877A microcontrollers along with uM-FPU math co-processor. uM-FPU is a 32-bit floating point co-processor utilized to execute complex calculation requires by the sigmoid activation function for neuron. ANN algorithm is converted to software program written in assembly language. The implemented ANN structure is three layer with one hidden layer, and five neurons with two hidden neurons. To prove the operability and functionality, the network is trained to solve three common logic gate operations; AND, OR, and XOR. This paper concludes that the ANN had been successfully implemented on PIC16F877a and uM-FPU math co-processor hardware that works accordingly on both training and service mode. (Author)
Multilayered microfluidic devices with a micronozzle array structure have been developed to prepare unique hydrogel microfibers with highly complex cross-sectional morphologies. Hydrogel precursor solutions with different compositions are introduced through vertical micronozzles, united and focused, and continuously gelled to form hydrogel fibers with multiple regions of different physicochemical composition. We prepared alginate hydrogel microfibers with diameters of 60 ∼ 130 μm and 4/8 parallel regions in the periphery. Neuron-like PC12 cells encapsulated in the parallel region, which was made of a soft hydrogel matrix, proliferated and formed linear intercellular networks along the fiber length because of the physical restrictions imposed by the relatively rigid regions. After cultivation for 14 days, one-millimeter-long intercellular networks that structurally mimic complex nerve bundles found in vivo were formed. The proposed fibers should be useful for producing various in vivo linear tissues and should be applicable to regenerative medicine and physiological studies of cells. (papers)
Learning from correlated patterns by simple perceptrons
Learning behavior of simple perceptrons is analyzed for a teacher-student scenario in which output labels are provided by a teacher network for a set of possibly correlated input patterns, and such that the teacher and student networks are of the same type. Our main concern is the effect of statistical correlations among the input patterns on learning performance. For this purpose, we extend to the teacher-student scenario a methodology for analyzing randomly labeled patterns recently developed in Shinzato and Kabashima 2008 J. Phys. A: Math. Theor. 41 324013. This methodology is used for analyzing situations in which orthogonality of the input patterns is enhanced in order to optimize the learning performance
N. Lauzon
2006-02-01
Full Text Available This work addresses the issue of better considering the heterogeneity of precipitation fields within lumped rainfall-runoff models where only areal mean precipitation is usually used as an input. A method using a Kohonen neural network is proposed for the classification of precipitation fields. The evaluation and improvement of the performance of a lumped rainfall-runoff model for one-day ahead predictions is then established based on this classification. Multilayer perceptron neural networks are employed as lumped rainfall-runoff models. The Bas-en-Basset watershed in France, which is equipped with 23 rain gauges with data for a 21-year period, is employed as the application case. The results demonstrate the relevance of the proposed classification method, which produces groups of precipitation fields that are in agreement with the global climatological features affecting the region, as well as with the topographic constraints of the watershed (i.e., orography. The strengths and weaknesses of the rainfall-runoff models are highlighted by the analysis of their performance vis-à-vis the classification of precipitation fields. The results also show the capability of multilayer perceptron neural networks to account for the heterogeneity of precipitation, even when built as lumped rainfall-runoff models.
N. Lauzon
2006-01-01
Full Text Available This work addresses the issue of better considering the heterogeneity of precipitation fields within lumped rainfall-runoff models where only areal mean precipitation is usually used as an input. A method using a Kohonen neural network is proposed for the clustering of precipitation fields. The evaluation and improvement of the performance of a lumped rainfall-runoff model for one-day ahead predictions is then established based on this clustering. Multilayer perceptron neural networks are employed as lumped rainfall-runoff models. The Bas-en-Basset watershed in France, which is equipped with 23 rain gauges with data for a 21-year period, is employed as the application case. The results demonstrate the relevance of the proposed clustering method, which produces groups of precipitation fields that are in agreement with the global climatological features affecting the region, as well as with the topographic constraints of the watershed (i.e., orography. The strengths and weaknesses of the rainfall-runoff models are highlighted by the analysis of their performance vis-à-vis the clustering of precipitation fields. The results also show the capability of multilayer perceptron neural networks to account for the heterogeneity of precipitation, even when built as lumped rainfall-runoff models.
Lauzon, N.; Anctil, F.; Baxter, C. W.
2006-07-01
This work addresses the issue of better considering the heterogeneity of precipitation fields within lumped rainfall-runoff models where only areal mean precipitation is usually used as an input. A method using a Kohonen neural network is proposed for the clustering of precipitation fields. The evaluation and improvement of the performance of a lumped rainfall-runoff model for one-day ahead predictions is then established based on this clustering. Multilayer perceptron neural networks are employed as lumped rainfall-runoff models. The Bas-en-Basset watershed in France, which is equipped with 23 rain gauges with data for a 21-year period, is employed as the application case. The results demonstrate the relevance of the proposed clustering method, which produces groups of precipitation fields that are in agreement with the global climatological features affecting the region, as well as with the topographic constraints of the watershed (i.e., orography). The strengths and weaknesses of the rainfall-runoff models are highlighted by the analysis of their performance vis-à-vis the clustering of precipitation fields. The results also show the capability of multilayer perceptron neural networks to account for the heterogeneity of precipitation, even when built as lumped rainfall-runoff models.
Therasa Chandrasekar
2015-10-01
Full Text Available This paper provides an exposition about application of neural networks in the context of research to find out the contribution of individual job satisfiers towards work commitment. The purpose of the current study is to build a predictive model to estimate the normalized importance of individual job satisfiers towards work commitment of employees working in TVS Group, an Indian automobile company. The study is based on the tool developed by Spector (1985 and Sue Hayday (2003.The input variable of the study consists of nine independent individual job satisfiers which includes Pay, Promotion, Supervision, Benefits, Rewards, Operating procedures, Co-workers, Work-itself and Communication of Spector (1985 and dependent variable as work commitment of Sue Hayday (2003.The primary data has been collected using a closed-ended questionnaire based on simple random sampling approach. This study employed the multilayer Perceptron neural network model to envisage the level of job satisfiers towards work commitment. The result from the multilayer Perceptron neural network model displayed with four hidden layer with correct classification rate of 70% and 30% for training and testing data set. The normalized importance shows high value for coworkers, superior satisfaction and communication and which acts as most significant attributes of job satisfiers that predicts the overall work commitment of employees.
Effect of direction on wind speed estimation in complex terrain using neural networks
Lopez, P.; Velo, R.; Maseda, F. [Department of Agroforestry Engineering, Higher Polytechnic School. University of Santiago de Compostela, Campus Universitario, s/n, 27002, Lugo (Spain)
2008-10-15
A method of estimating the annual average wind speed at a selected site using neural networks is presented. The method proposed uses only a few measurements taken at the selected site in a short time period and data collected at nearby fixed stations. The neural network used in this study is a multilayer perceptron with one hidden layer of 15 neurons, trained by the Bayesian regularization algorithm. The number of inputs that must be used in the neural network was analyzed in detail, and results suggest that only wind speed and direction data for a single station are required. In sites of complex terrain, direction is a very important input that can cause a decrease of 23% in root mean square (RMS). The results obtained by simulating the annual average wind speed at the selected site based on data from nearby stations are satisfactory, with errors below 2%. (author)
Application of Neural Networks for unfolding neutron spectra measured by means of Bonner Spheres
A Neural Network structure has been used for unfolding neutron spectra measured by means of a Bonner Sphere Spectrometer set. The present work used the 'Stuttgart Neural Network Simulator' as the interface for designing, training and validation of a MultiLayer Perceptron network. The back-propagation algorithm was applied. The Bonner Sphere set chosen has been calibrated at the National Physical Laboratory, United Kingdom, and uses gold activation foils as thermal neutron detectors. The neutron energy covered by the response functions goes from 0.0001 eV to 10 MeV. Two types of neutron spectra were numerically investigated: monoenergetic and continuous. Good results were obtained, indicating that the Neural Network can be considered an interesting alternative among the neutron spectrum unfolding methodologies
Feature extraction and pattern classification of remote sensing data by a modular neural system
Blonda, Palma; la Forgia, Vincenza; Pasquariello, Guido; Satalino, Giuseppe
1996-02-01
A modular neural network architecture has been used for the classification of remote sensed data in two experiments carried out to study two different but rather usual situations in real remote sensing applications. Such situations concern the availability of high-dimensional data in the first setting and an imperfect data set with a limited number of features in the second. The learning task of the supervised multilayer perceptron classifier has been made more efficient by preprocessing the input with unsupervised neural modules for feature discovery. The linear propagation network is introduced in the first experiment to evaluate the effectiveness of the neural data compression stage before classification, whereas in the second experiment data clustering before labeling is evaluated by the Kohonen self-organizing feature map network. The results of the two experiments confirm that modular learning performs better than nonmodular learning with respect to both learning quality and speed.
An Approach to Neural Network Based Pattern Classifier for Printed Bengali Characters
sabyasachi samanta
2011-04-01
Full Text Available In this paper, we have designed a Neural Network based pattern classifier for recognizing Bengali printed characters. Here view-based approach is used for extracting features from individual characters and a neural network based classifier is built to analyze the performance of the view-based approach in various experimental setups. Different Bengali character samples have been taken and whole image of individual character is considered for view based analysis. The characteristic points are extracted from the characters using left-right view based approach. These points are then used to form a feature vector which represents the given character. Multi-Layer Perceptrons Neural network has been used and it was trained by back propagation algorithm to create this recognition engine. Internal shape of each character has been considered to generate the feature vector for individual images.
Evaluation of the efficiency of artificial neural networks for genetic value prediction.
Silva, G N; Tomaz, R S; Sant'Anna, I C; Carneiro, V Q; Cruz, C D; Nascimento, M
2016-01-01
Artificial neural networks have shown great potential when applied to breeding programs. In this study, we propose the use of artificial neural networks as a viable alternative to conventional prediction methods. We conduct a thorough evaluation of the efficiency of these networks with respect to the prediction of breeding values. Therefore, we considered eight simulated scenarios, and for the purpose of genetic value prediction, seven statistical parameters in addition to the phenotypic mean in a network designed as a multilayer perceptron. After an evaluation of different network configurations, the results demonstrated the superiority of neural networks compared to estimation procedures based on linear models, and indicated high predictive accuracy and network efficiency. PMID:27051007
Classification of drug-induced behaviors using a multi-layer feed-forward neural network.
Gonzalez, L P; Arnaldo, C M
1993-07-01
Measurement of laboratory animal motor behavior is an important part of many studies of experimental manipulations of the central nervous system. Current automated data collection and analysis systems are limited in the number of behaviors that can be monitored and quantified simultaneously. This paper describes a signal analysis technique that when used to analyze the data from a modified Stoelting electronic activity monitor is capable of classifying multiple behavior categories automatically. In this technique, the output signal from the motility monitor is fixed-length segmented and feature extraction is performed, calculating the Fourier transform and power spectrum of each data segment. An error back-propagation neural network, implemented on a microcomputer, is used to perform behavior classification of the segment power spectra. The technique provides a high degree of accuracy in automatic behavior classification and should prove useful in the quantitative assessment of behavior. PMID:8243074
Ahmed M.A. Haidar
2008-01-01
Full Text Available Vulnerability assessment in power systems is important so as to determine how vulnerable a power system in case of any unforeseen catastrophic events. This paper presents the application of Radial Basis Function Neural Network (RBFNN for vulnerability assessment of power system incorporating a new proposed feature extraction method named as the Neural Network Weight Extraction (NNWE for dimensionality reduction of input data. The performance of the RBFNN is compared with the Multi Layer Perceptron Neural Network (MLPNN so as to evaluate the effectiveness of the RBFNN in assessing the vulnerability of a power system based on the indices, power system loss and possible loss of load. In this study, vulnerability analysis simulations were carried out on the IEEE 300 bus test system using the Power System Analysis Toolbox and the development of neural network models were implemented in MATLAB version 7. Test results prove that the RBFNN give better vulnerability assessment performance than the multilayer perceptron neural network in terms of accuracy and training time. The proposed feature extraction method decreases the training time drastically from hours to less than seconds, this bound to influence the vulnerability classification and increase the speed of convergence. It is also concluded that the reduction in error is achieved by using PSL as an output variable of ANN, in all the cases the error of RBFNN output by PSL is less than 4.87% which is well within tolerable limits.
Shoaib, Muhammad; Shamseldin, Asaad Y.; Melville, Bruce W.; Khan, Mudasser Muneer
2016-04-01
In order to predict runoff accurately from a rainfall event, the multilayer perceptron type of neural network models are commonly used in hydrology. Furthermore, the wavelet coupled multilayer perceptron neural network (MLPNN) models has also been found superior relative to the simple neural network models which are not coupled with wavelet. However, the MLPNN models are considered as static and memory less networks and lack the ability to examine the temporal dimension of data. Recurrent neural network models, on the other hand, have the ability to learn from the preceding conditions of the system and hence considered as dynamic models. This study for the first time explores the potential of wavelet coupled time lagged recurrent neural network (TLRNN) models for runoff prediction using rainfall data. The Discrete Wavelet Transformation (DWT) is employed in this study to decompose the input rainfall data using six of the most commonly used wavelet functions. The performance of the simple and the wavelet coupled static MLPNN models is compared with their counterpart dynamic TLRNN models. The study found that the dynamic wavelet coupled TLRNN models can be considered as alternative to the static wavelet MLPNN models. The study also investigated the effect of memory depth on the performance of static and dynamic neural network models. The memory depth refers to how much past information (lagged data) is required as it is not known a priori. The db8 wavelet function is found to yield the best results with the static MLPNN models and with the TLRNN models having small memory depths. The performance of the wavelet coupled TLRNN models with large memory depths is found insensitive to the selection of the wavelet function as all wavelet functions have similar performance.
PREDICTION OF BOD AND COD OF A REFINERY WASTEWATER USING MULTILAYER ARTIFICIAL NEURAL NETWORKS
Eldon Raj Rene
2008-06-01
Full Text Available In the recent past, artificial neural networks (ANNs have shown the ability to learn and capture non-linear static or dynamic behaviour among variables based on the given set of data. Since the knowledge of internal procedure is not necessary, the modelling can take place with minimum previous knowledge about the process through proper training of the network. In the present study, 12 ANN based models were proposed to predict the Biochemical Oxygen Demand (BOD5 and Chemical Oxygen Demand (COD concentrations of wastewater generated from the effluent treatment plant of a petrochemical industry. By employing the standard back error propagation (BEP algorithm, the network was trained with 103 data points for water quality indices such as Total Suspended Solids (TSS, Total Dissolved Solids (TDS, Phenol concentration, Ammoniacal Nitrogen (AMN, Total Organic Carbon (TOC and Kjeldahl’s Nitrogen (KJN to predict BOD and COD. After appropriate training, the network was tested with a separate test data and the best model was chosen based on the sum square error (training and percentage average relative error (% ARE for testing. The results from this study reveal that ANNs can be accurate and efficacious in predicting unknown concentrations of water quality parameters through its versatile training process.
Offline analysis of HEP events by ''dynamic perceptron'' neural network
In this paper we start from a critical analysis of the fundamental problems of the parallel calculus in linear structures and of their extension to the partial solutions obtained with non-linear architectures. Then, we present shortly a new dynamic architecture able to solve the limitations of the previous architectures through an automatic re-definition of the topology. This architecture is applied to real-time recognition of particle tracks in high-energy accelerators. (orig.)
Mustafa Yıldız
2012-08-01
Full Text Available Introduction: We aimed to develop a classification method to discriminate ventricular septal defect and atrial septal defect by using severalhemodynamic parameters.Patients and Methods: Forty three patients (30 atrial septal defect, 13 ventricular septal defect; 26 female, 17 male with documentedhemodynamic parameters via cardiac catheterization are included to study. Such parameters as blood pressure values of different areas,gender, age and Qp/Qs ratios are used for classification. Parameters, we used in classification are determined by divergence analysismethod. Those parameters are; i pulmonary artery diastolic pressure, ii Qp/Qs ratio, iii right atrium pressure, iv age, v pulmonary arterysystolic pressure, vi left ventricular sistolic pressure, vii aorta mean pressure, viii left ventricular diastolic pressure, ix aorta diastolicpressure, x aorta systolic pressure. Those parameters detected from our study population, are uploaded to multi-layered artificial neuralnetwork and the network was trained by genetic algorithm.Results: Trained cluster consists of 14 factors (7 atrial septal defect and 7 ventricular septal defect. Overall success ratio is 79.2%, andwith a proper instruction of artificial neural network this ratio increases up to 89%.Conclusion: Parameters, belonging to artificial neural network, which are needed to be detected by the investigator in classical methods,can easily be detected with the help of genetic algorithms. During the instruction of artificial neural network by genetic algorithms, boththe topology of network and factors of network can be determined. During the test stage, elements, not included in instruction cluster, areassumed as in test cluster, and as a result of this study, we observed that multi-layered artificial neural network can be instructed properly,and neural network is a successful method for aimed classification.
Aliouane, Leila; Ouadfeul, Sid-Ali; Boudella, Amar
2015-04-01
The main goal of the proposed idea is to use the artificial intelligence such as the neural network and fuzzy logic to predict the pore pressure in shale gas reservoirs. Pore pressure is a very important parameter that will be used or estimation of effective stress. This last is used to resolve well-bore stability problems, failure plan identification from Mohr-Coulomb circle and sweet spots identification. Many models have been proposed to estimate the pore pressure from well-logs data; we can cite for example the equivalent depth model, the horizontal model for undercompaction called the Eaton's model…etc. All these models require a continuous measurement of the slowness of the primary wave, some thing that is not easy during well-logs data acquisition in shale gas formtions. Here, we suggest the use the fuzzy logic and the multilayer perceptron neural network to predict the pore pressure in two horizontal wells drilled in the lower Barnett shale formation. The first horizontal well is used for the training of the fuzzy set and the multilayer perecptron, the input is the natural gamma ray, the neutron porosity, the slowness of the compression and shear wave, however the desired output is the estimated pore pressure using Eaton's model. Data of another horizontal well are used for generalization. Obtained results clearly show the power of the fuzzy logic system than the multilayer perceptron neural network machine to predict the pore pressure in shale gas reservoirs. Keywords: artificial intelligence, fuzzy logic, pore pressure, multilayer perecptron, Barnett shale.
Neural network classifier of attacks in IP telephony
Safarik, Jakub; Voznak, Miroslav; Mehic, Miralem; Partila, Pavol; Mikulec, Martin
2014-05-01
Various types of monitoring mechanism allow us to detect and monitor behavior of attackers in VoIP networks. Analysis of detected malicious traffic is crucial for further investigation and hardening the network. This analysis is typically based on statistical methods and the article brings a solution based on neural network. The proposed algorithm is used as a classifier of attacks in a distributed monitoring network of independent honeypot probes. Information about attacks on these honeypots is collected on a centralized server and then classified. This classification is based on different mechanisms. One of them is based on the multilayer perceptron neural network. The article describes inner structure of used neural network and also information about implementation of this network. The learning set for this neural network is based on real attack data collected from IP telephony honeypot called Dionaea. We prepare the learning set from real attack data after collecting, cleaning and aggregation of this information. After proper learning is the neural network capable to classify 6 types of most commonly used VoIP attacks. Using neural network classifier brings more accurate attack classification in a distributed system of honeypots. With this approach is possible to detect malicious behavior in a different part of networks, which are logically or geographically divided and use the information from one network to harden security in other networks. Centralized server for distributed set of nodes serves not only as a collector and classifier of attack data, but also as a mechanism for generating a precaution steps against attacks.
Financial time series prediction using spiking neural networks.
Reid, David; Hussain, Abir Jaafar; Tawfik, Hissam
2014-01-01
In this paper a novel application of a particular type of spiking neural network, a Polychronous Spiking Network, was used for financial time series prediction. It is argued that the inherent temporal capabilities of this type of network are suited to non-stationary data such as this. The performance of the spiking neural network was benchmarked against three systems: two "traditional", rate-encoded, neural networks; a Multi-Layer Perceptron neural network and a Dynamic Ridge Polynomial neural network, and a standard Linear Predictor Coefficients model. For this comparison three non-stationary and noisy time series were used: IBM stock data; US/Euro exchange rate data, and the price of Brent crude oil. The experiments demonstrated favourable prediction results for the Spiking Neural Network in terms of Annualised Return and prediction error for 5-Step ahead predictions. These results were also supported by other relevant metrics such as Maximum Drawdown and Signal-To-Noise ratio. This work demonstrated the applicability of the Polychronous Spiking Network to financial data forecasting and this in turn indicates the potential of using such networks over traditional systems in difficult to manage non-stationary environments. PMID:25170618
Vassiliadis, V S
2006-01-01
A novel algorithm for tunable compression to within the precision of reproduction targets, or storage, is proposed. The new algorithm is termed the `Perceptron Algorithm', which utilises simple existing concepts in a novel way, has multiple immediate commercial application aspects as well as it opens up a multitude of fronts in computational science and technology. The aims of this paper are to present the concepts underlying the algorithm, observations by its application to some example cases, and the identification of a multitude of potential areas of applications such as: image compression by orders of magnitude, signal compression including sound as well, image analysis in a multilayered detailed analysis, pattern recognition and matching and rapid database searching (e.g. face recognition), motion analysis, biomedical applications e.g. in MRI and CAT scan image analysis and compression, as well as hints on the link of these ideas to the way how biological memory might work leading to new points of view i...
Evaluation of artificial neural network techniques for flow forecasting in the River Yangtze, China
C. W. Dawson
2002-01-01
Full Text Available While engineers have been quantifying rainfall-runoff processes since the mid-19th century, it is only in the last decade that artificial neural network models have been applied to the same task. This paper evaluates two neural networks in this context: the popular multilayer perceptron (MLP, and the radial basis function network (RBF. Using six-hourly rainfall-runoff data for the River Yangtze at Yichang (upstream of the Three Gorges Dam for the period 1991 to 1993, it is shown that both neural network types can simulate river flows beyond the range of the training set. In addition, an evaluation of alternative RBF transfer functions demonstrates that the popular Gaussian function, often used in RBF networks, is not necessarily the ‘best’ function to use for river flow forecasting. Comparisons are also made between these neural networks and conventional statistical techniques; stepwise multiple linear regression, auto regressive moving average models and a zero order forecasting approach. Keywords: Artificial neural network, multilayer perception, radial basis function, flood forecasting
Prediction of slope stability using artificial neural network (case study: Noabad, Mazandaran, Iran)
Investigations of failures of soil masses are subjects touching both geology and engineering. These investigations call the joint efforts of engineering geologists and geotechnical engineers. Geotechnical engineers have to pay particular attention to geology, ground water, and shear strength of soils in assessing slope stability. Artificial neural networks (ANNs) are very sophisticated modeling techniques, capable of modeling extremely complex functions. In particular, neural networks are nonlinear. In this research, with respect to the above advantages, ANN systems consisting of multilayer perceptron networks are developed to predict slope stability in a specified location, based on the available site investigation data from Noabad, Mazandaran, Iran. Several important parameters, including total stress, effective stress, angle of slope, coefficient of cohesion, internal friction angle, and horizontal coefficient of earthquake, were used as the input parameters, while the slope stability was the output parameter. The results are compared with the classical methods of limit equilibrium to check the ANN model's validity. (author)
Fuzzy Artmap and Neural Network Approach to Online Processing of Inputs with Missing Values
Nelwamondo, Fulufhelo Vincent
2007-01-01
An ensemble based approach for dealing with missing data, without predicting or imputing the missing values is proposed. This technique is suitable for online operations of neural networks and as a result, is used for online condition monitoring. The proposed technique is tested in both classification and regression problems. An ensemble of Fuzzy-ARTMAPs is used for classification whereas an ensemble of multi-layer perceptrons is used for the regression problem. Results obtained using this ensemble-based technique are compared to those obtained using a combination of auto-associative neural networks and genetic algorithms and findings show that this method can perform up to 9% better in regression problems. Another advantage of the proposed technique is that it eliminates the need for finding the best estimate of the data, and hence, saves time.
Neural network model for a reactor subsystem using real time data
Modern nuclear power plant is a very complex arrangement of machinery consisting of huge number of control and support systems. In real time it is possible to implement intelligent systems in the form of neural network, data mining, expert system etc. for modeling the power plant. This paper describes the development of an artificial neural network model for intermediate heat exchanger subsystem of fast breeder test reactor. Multilayer perceptron network using back propagation algorithm is implemented for training the safety critical, safety related real time data. It takes in to account the weight correction method. The results indicate a very good convergence of the algorithm. The model can be used as an operator support system for predictive measures of various parameters of the reactor subsystems. (author)
Neural Network-Based Model for Landslide Susceptibility and Soil Longitudinal Profile Analyses
Farrokhzad, F.; Barari, Amin; Choobbasti, A. J.; Ibsen, Lars Bo
2011-01-01
The purpose of this study was to create an empirical model for assessing the landslide risk potential at Savadkouh Azad University, which is located in the rural surroundings of Savadkouh, about 5 km from the city of Pol-Sefid in northern Iran. The soil longitudinal profile of the city of Babol......, located 25 km from the Caspian Sea, also was predicted with an artificial neural network (ANN). A multilayer perceptron neural network model was applied to the landslide area and was used to analyze specific elements in the study area that contributed to previous landsliding events. The ANN models were...... trained with geotechnical data obtained from an investigation of the study area. The quality of the modeling was improved further by the application of some controlling techniques involved in ANN. The observed >90% overall accuracy produced by the ANN technique in both cases is promising for future...
Radar Signal Detection In Non-Gaussian Noise Using RBF Neural Network
D. G. Khairnar
2008-01-01
Full Text Available In this paper, we suggest a neural network signal detector using radial basis function (RBF network. We employ this RBF Neural detector to detect the presence or absence of a known signal corrupted by different Gaussian, non-Gaussian and impulsive noise components. In case of non-Gaussian noise, experimental results show that RBF network signal detector has significant improvement in performance characteristics. Detection capability is better than to those obtained with multilayer perceptrons (BP and optimum matched filter (MF detector. This signal detector is also tested on the simulated signals impacted by impulsive noise produced by atmospheric events and short lived echoes from meteor trains. Tested Results show, improved detection capability to impulsive noise compare to BP signal detector. It also show better performance as a function of signal-tonoise ratio compared to BP and MF.
Foreground removal from Planck Sky Model temperature maps using a MLP neural network
Nørgaard-Nielsen, Hans Ulrik; Hebert, K.
2009-01-01
Unfortunately, the Cosmic Microwave Background (CMB) radiation is contaminated by emission originating in the Milky Way (synchrotron, free-free and dust emission). Since the cosmological information is statistically in nature, it is essential to remove this foreground emission and leave the CMB...... with no systematic errors. To demonstrate the feasibility of a simple multilayer perceptron (MLP) neural network for extracting the CMB temperature signal, we have analyzed a specific data set, namely the Planck Sky Model maps, developed for evaluation of different component separation methods before...... including them in the Planck data analysis pipeline. It is found that a MLP neural network can provide a CMB map of about 80% of the sky to a very high degree uncorrelated with the foreground components. Also the derived power spectrum shows little evidence for systematic errors....
Foreground removal from CMB temperature maps using an MLP neural network
Norgaard-Nielsen, H U
2008-01-01
One of the main obstacles in extracting the Cosmic Microwave Background (CMB) signal from observations in the mm-submm range is the foreground contamination by emission from galactic components: mainly synchrotron, free-free and thermal dust emission. Due to the statistical nature of the intrinsic CMB signal it is essential to minimize the systematic errors in the CMB temperature determinations. Following the available knowledge of the spectral behavior of the galactic foregrounds simple, power law-like spectra have been assumed. The feasibility of using a simple neural network for extracting the CMB temperature signal from the combined CMB and foreground signals has been investigated. As a specific example, we have analysed simulated data, like that expected from the ESA Planck Surveyor mission. A simple multilayer perceptron neural network with 2 hidden layers can provide temperature estimates, over more than 80 percent of the sky, that are to a high degree uncorrelated with the foreground signals. A single...
A Comparison between Neural Networks and Wavelet Networks in Nonlinear System Identification
S. Ehsan Razavi
2012-01-01
Full Text Available In this study, identification of a nonlinear function will be presented by neural network and wavelet network methods. Behavior of a nonlinear system can be identified by intelligent methods. Two groups of the most common and at the same time the most effective of neural networks methods are multilayer perceptron and radial basis function that will be used for nonlinear system identification. The selected structure is series - parallel method that after network training by a series of training random data, the output is estimated and the nonlinear function is compared to a sinusoidal input. Then, wavelet network is used for identification and we will use Orthogonal Least Squares (OLS method for wavelet selection to reduce the volume of calculations and increase the convergence speed.
Neural network controller for Active Demand-Side Management with PV energy in the residential sector
Highlights: ► We have developed a neural controller for Active Demand-Side Management. ► The controller consists of Multilayer Perceptrons evolved with a genetic algorithm. ► The architecture of the controller is distributed and modular. ► The simulations show that the electrical local behavior improves. ► Active Demand-Side Management helps users to control his energy behaviour. -- Abstract: In this paper, we describe the development of a control system for Demand-Side Management in the residential sector with Distributed Generation. The electrical system under study incorporates local PV energy generation, an electricity storage system, connection to the grid and a home automation system. The distributed control system is composed of two modules: a scheduler and a coordinator, both implemented with neural networks. The control system enhances the local energy performance, scheduling the tasks demanded by the user and maximizing the use of local generation.
Nor A.M. Isa
2007-01-01
Full Text Available Thirteen cytology of fine needle aspiration image (i.e. cellularity, background information, cohesiveness, significant stromal component, clump thickness, nuclear membrane, bare nuclei, normal nuclei, mitosis, nucleus stain, uniformity of cell, fragility and number of cells in cluster are evaluated their possibility to be used as input data for artificial neural network in order to classify the breast pre-cancerous cases into four stages, namely malignant, fibroadenoma, fibrocystic disease, and other benign diseases. A total of 1300 reported breast pre-cancerous cases which was collected from Penang General Hospital and Hospital Universiti Sains Malaysia, Kelantan, Malaysia was used to train and test the artificial neural networks. The diagnosis system which was developed using the Hybrid Multilayered Perceptron and trained using Modified Recursive Prediction Error produced excellent diagnosis performance with 100% accuracy, 100% sensitivity and 100% specificity.
Neural Network on Photodegradation of Octylphenol using Natural and Artificial UV Radiation
Lorentz JÄNTSCHI
2011-09-01
Full Text Available The present paper comes up with an experimental design meant to point out the factors interferingin octylphenol’s degradation in surface waters under solar radiation, underlining each factor’sinfluence on the process observable (concentration of p-octylphenol. Multiple linear regressionanalysis and artificial neural network (Multi-Layer Perceptron type were applied in order to obtaina mathematical model capable to explain the action of UV-light upon synthetic solutions of OP inultra-pure water (MilliQ type. Neural network proves to be the most efficient method in predictingthe evolution of OP concentration during photodegradation process. Thus, determination in neuralnetwork’s case has almost double value versus the regression analysis.
Parameter Genetic Learning of Perceptron Networks
Neruda, Roman; Slušný, Stanislav
2006-01-01
Roč. 5, č. 10 (2006), s. 2285-2290. ISSN 1109-2777 R&D Projects: GA ČR GA201/05/0557 Institutional research plan: CEZ:AV0Z10300504 Keywords : neural networks * genetic algorithms * learning * hybrid methods Subject RIV: IN - Informatics, Computer Science
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
A. El-Shafie
2011-07-01
Full Text Available Rainfall is considered as one of the major component of the hydrological process, it takes significant part of evaluating drought and flooding events. Therefore, it is important to have accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting task such as Multi-Layer Perceptron Neural Networks (MLP-NN. In fact, the rainfall time series modeling involves an important temporal dimension. On the other hand, the classical MLP-NN is a static and memoryless network architecture that is effective for complex nonlinear static mapping. This research focuses on investigating the potential of introducing a neural network that could address the temporal relationships of the rainfall series.
Two different static neural networks and one dynamic neural network namely; Multi-Layer Peceptron Neural network (MLP-NN, Radial Basis Function Neural Network (RBFNN and Input Delay Neural Network (IDNN, respectively, have been examined in this study. Those models had been developed for two time horizon in monthly and weekly rainfall basis forecasting at Klang River, Malaysia. Data collected over 12 yr (1997–2008 on weekly basis and 22 yr (1987–2008 for monthly basis were used to develop and examine the performance of the proposed models. Comprehensive comparison analyses were carried out to evaluate the performance of the proposed static and dynamic neural network. Results showed that MLP-NN neural network model able to follow the similar trend of the actual rainfall, yet it still relatively poor. RBFNN model achieved better accuracy over the MLP-NN model. Moreover, the forecasting accuracy of the IDNN model outperformed during training and testing stage which prove a consistent level of accuracy with seen and unseen data. Furthermore, the IDNN significantly enhance the forecasting accuracy if compared with the other static neural network model as they could memorize the sequential or time varying patterns.
Inflow forecasting using Artificial Neural Networks for reservoir operation
Chiamsathit, Chuthamat; Adeloye, Adebayo J.; Bankaru-Swamy, Soundharajan
2016-05-01
In this study, multi-layer perceptron (MLP) artificial neural networks have been applied to forecast one-month-ahead inflow for the Ubonratana reservoir, Thailand. To assess how well the forecast inflows have performed in the operation of the reservoir, simulations were carried out guided by the systems rule curves. As basis of comparison, four inflow situations were considered: (1) inflow known and assumed to be the historic (Type A); (2) inflow known and assumed to be the forecast (Type F); (3) inflow known and assumed to be the historic mean for month (Type M); and (4) inflow is unknown with release decision only conditioned on the starting reservoir storage (Type N). Reservoir performance was summarised in terms of reliability, resilience, vulnerability and sustainability. It was found that Type F inflow situation produced the best performance while Type N was the worst performing. This clearly demonstrates the importance of good inflow information for effective reservoir operation.
Prediction of Bladder Cancer Recurrences Using Artificial Neural Networks
Zulueta Guerrero, Ekaitz; Garay, Naiara Telleria; Lopez-Guede, Jose Manuel; Vilches, Borja Ayerdi; Iragorri, Eider Egilegor; Castaos, David Lecumberri; de La Hoz Rastrollo, Ana Beln; Pea, Carlos Pertusa
Even if considerable advances have been made in the field of early diagnosis, there is no simple, cheap and non-invasive method that can be applied to the clinical monitorisation of bladder cancer patients. Moreover, bladder cancer recurrences or the reappearance of the tumour after its surgical resection cannot be predicted in the current clinical setting. In this study, Artificial Neural Networks (ANN) were used to assess how different combinations of classical clinical parameters (stage-grade and age) and two urinary markers (growth factor and pro-inflammatory mediator) could predict post surgical recurrences in bladder cancer patients. Different ANN methods, input parameter combinations and recurrence related output variables were used and the resulting positive and negative prediction rates compared. MultiLayer Perceptron (MLP) was selected as the most predictive model and urinary markers showed the highest sensitivity, predicting correctly 50% of the patients that would recur in a 2 year follow-up period.
Recognition of Japanese finger spelling gestures using neural networks.
Machacon, H T C; Shiga, S
2010-05-01
Effective communication with the hearing and speech impaired often requires at least a basic working knowledge of sign language gestures, without which a memo pad and pen, or a mobile phone's notepad is indispensable. The aim of this study was to build a neural network that could be used to recognize static finger-hand gestures of the yubimoji, the Japanese sign language syllabary. To build the network, signal inputs from a data glove interface were taken for each of the static yubimoji gestures. The network was trained and tested 10 times using a multilayer perceptron model. Overall, only 18 of the 41 static gestures were successfully recognized. One of the reasons was attributed to the inability of the data glove to measure gesture directions particularly for yubimoji gestures with similar finger configurations. Future work will focus on these problems as well as the inclusion of dynamic yubimoji gestures. PMID:20143958
Practical application of artificial neural networks in the neurosciences
Pinti, Antonio
1995-04-01
This article presents a practical application of artificial multi-layer perceptron (MLP) neural networks in neurosciences. The data that are processed are labeled data from the visual analysis of electrical signals of human sleep. The objective of this work is to automatically classify into sleep stages the electrophysiological signals recorded from electrodes placed on a sleeping patient. Two large data bases were designed by experts in order to realize this study. One data base was used to train the network and the other to test its generalization capacity. The classification results obtained with the MLP network were compared to a type K nearest neighbor Knn non-parametric classification method. The MLP network gave a better result in terms of classification than the Knn method. Both classification techniques were implemented on a transputer system. With both networks in their final configuration, the MLP network was 160 times faster than the Knn model in classifying a sleep period.
Hybrid Learning Algorithm in Neural Network System for Enzyme Classification
Mohd Haniff Osman
2010-07-01
Full Text Available Nucleic acid and protein sequences store a wealth of informationwhich ultimately determines their functions and characteristics.Protein sequences classification deals with the assignment ofsequences to known categories based on homology detectionproperties. In this paper, we developed a hybrid learning algorithm inneural network system called Neural Network Enzyme Classification(NNEC to classify an enzyme found in Protein Data Bank (PDB to agiven family of enzymes. NNEC was developed based on MultilayerPerceptron with hybrid learning algorithm combining the geneticalgorithm (GA and Backpropagation (BP, where one of them acts asan operator in the other. Here, BP is used as a mutation-like-operatorof the general GA search template. The proposed hybrid model wastested with different topologies of network architecture, especially indetermining the number of hidden nodes. The precision results arequite promising in classifying the enzyme accordingly.
Handwritten Farsi Character Recognition using Artificial Neural Network
Ahangar, Reza Gharoie
2009-01-01
Neural Networks are being used for character recognition from last many years but most of the work was confined to English character recognition. Till date, a very little work has been reported for Handwritten Farsi Character recognition. In this paper, we have made an attempt to recognize handwritten Farsi characters by using a multilayer perceptron with one hidden layer. The error backpropagation algorithm has been used to train the MLP network. In addition, an analysis has been carried out to determine the number of hidden nodes to achieve high performance of backpropagation network in the recognition of handwritten Farsi characters. The system has been trained using several different forms of handwriting provided by both male and female participants of different age groups. Finally, this rigorous training results an automatic HCR system using MLP network. In this work, the experiments were carried out on two hundred fifty samples of five writers. The results showed that the MLP networks trained by the err...
Neural Network Aided Glitch-Burst Discrimination and Glitch Classification
Rampone, Salvatore; Troiano, Luigi; Pinto, Innocenzo M
2014-01-01
We investigate the potential of neural-network based classifiers for discriminating gravitational wave bursts (GWBs) of a given canonical family (e.g. core-collapse supernova waveforms) from typical transient instrumental artifacts (glitches), in the data of a single detector. The further classification of glitches into typical sets is explored.In order to provide a proof of concept,we use the core-collapse supernova waveform catalog produced by H. Dimmelmeier and co-Workers, and the data base of glitches observed in laser interferometer gravitational wave observatory (LIGO) data maintained by P. Saulson and co-Workers to construct datasets of (windowed) transient waveforms (glitches and bursts) in additive (Gaussian and compound-Gaussian) noise with different signal-tonoise ratios (SNR). Principal component analysis (PCA) is next implemented for reducing data dimensionality, yielding results consistent with, and extending those in the literature. Then, a multilayer perceptron is trained by a backpropagation ...
Artificial neural network application for predicting soil distribution coefficient of nickel
The distribution (or partition) coefficient (Kd) is an applicable parameter for modeling contaminant and radionuclide transport as well as risk analysis. Selection of this parameter may cause significant error in predicting the impacts of contaminant migration or site-remediation options. In this regards, various models were presented to predict Kd values for different contaminants specially heavy metals and radionuclides. In this study, artificial neural network (ANN) is used to present simplified model for predicting Kd of nickel. The main objective is to develop a more accurate model with a minimal number of parameters, which can be determined experimentally or select by review of different studies. In addition, the effects of training as well as the type of the network are considered. The Kd values of Ni is strongly dependent on pH of the soil and mathematical relationships were presented between pH and Kd of nickel recently. In this study, the same database of these presented models was used to verify that neural network may be more useful tools for predicting of Kd. Two different types of ANN, multilayer perceptron and redial basis function, were used to investigate the effect of the network geometry on the results. In addition, each network was trained by 80 and 90% of the data and tested for 20 and 10% of the rest data. Then the results of the networks compared with the results of the mathematical models. Although the networks trained by 80 and 90% of the data the results show that all the networks predict with higher accuracy relative to mathematical models which were derived by 100% of data. More training of a network increases the accuracy of the network. Multilayer perceptron network used in this study predicts better than redial basis function network. - Highlights: ► Simplified models for predicting Kd of nickel presented using artificial neural networks. ► Multilayer perceptron and redial basis function used to predict Kd of nickel in soil. ► The neural networks predict with higher accuracy relative to mathematical models.
Artificial neural networks: opening the black box.
Dayhoff, J E; DeLeo, J M
2001-04-15
Artificial neural networks now are used in many fields. They have become well established as viable, multipurpose, robust computational methodologies with solid theoretic support and with strong potential to be effective in any discipline, especially medicine. For example, neural networks can extract new medical information from raw data, build computer models that are useful for medical decision-making, and aid in the distribution of medical expertise. Because many important neural network applications currently are emerging, the authors have prepared this article to bring a clearer understanding of these biologically inspired computing paradigms to anyone interested in exploring their use in medicine. They discuss the historical development of neural networks and provide the basic operational mathematics for the popular multilayered perceptron. The authors also describe good training, validation, and testing techniques, and discuss measurements of performance and reliability, including the use of bootstrap methods to obtain confidence intervals. Because it is possible to predict outcomes for individual patients with a neural network, the authors discuss the paradigm shift that is taking place from previous "bin-model" approaches, in which patient outcome and management is assumed from the statistical groups in which the patient fits. The authors explain that with neural networks it is possible to mediate predictions for individual patients with prevalence and misclassification cost considerations using receiver operating characteristic methodology. The authors illustrate their findings with examples that include prostate carcinoma detection, coronary heart disease risk prediction, and medication dosing. The authors identify and discuss obstacles to success, including the need for expanded databases and the need to establish multidisciplinary teams. The authors believe that these obstacles can be overcome and that neural networks have a very important role in future medical decision support and the patient management systems employed in routine medical practice. PMID:11309760
Practical target recognition in infrared imagery using a neural network
Crowe, Alistair A.; Patel, A.; Wright, William A.; Green, Michael A.; Hughes, Andrew D.
1992-07-01
This paper describes work undertaken by British Aerospace (BAe) on the development of a neural network classifier for automatic recognition of land based targets in infrared imagery. The classifier used a histogram segmentation process to extract regions from the infrared imagery. A set of features were calculated for each region to form a feature vector describing the region. These feature vectors were then used as the input to the neural classifier. Two neural classifiers were investigated based upon the multi-layer perceptron and radial basis function networks. In order to assess the merits of a neural network approach, the neural classifiers were compared with a conventional classifier originally developed by British Aerospace (Systems and Equipment) Ltd., under contract to RARDE (Chertsey), for the purpose of infrared target recognition. This conventional system was based upon a Schurman classifier which operates on data transformed using a Hotelling Trace Transform. The ability of the classifiers to perform practical recognition of real-world targets was evaluated by training and testing the classifiers on real imagery obtained from mock land battles and military vehicle trials.
Improving classification Accuracy of Neural Network through Clustering Algorithms
B.Madasamy#1, Dr.J.Jebamalar Tamilselvi
2013-09-01
Full Text Available A common problem in bio medical data using neural networks for classification purposes are complex nature of the data, high dimensionality, convoluted and overlapping classes with their remarkable ability to derive meaning from complicated data, can be extract patterns and trends are too complex. Bio medical classification is a complex process to make decisions. Classification performance of the neural network suffers dramatically. This paper proposes neural network and data mining techniques are combined to automate biomedical classification processes to support decision. To improve the classification ability and behavior of neural network is used by pre-processing and pre-clustered data with the help of Rule based induction, Multi-layer perceptron model, nearest neighbor, Radial basics function and back propagation learning algorithm is employed to classify such complex tasks. The proposed clustering algorithm applied to the bio medical dataset to reduce the amount of samples to be presented to the neural network. It improves accuracy and computation time when applied to the publicly available benchmark bio medical dataset.
Vibration Based Damage Assessment of a Cantilever using a Neural Network
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated.......In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated....
Stability of the replica symmetric solution in diluted perceptron learning
We study the role played by dilution in the average behavior of a perceptron model with continuous coupling with the replica method. We analyze the stability of the replica symmetric solution as a function of the dilution field for the generalization and memorization problems. Thanks to a Gardner-like stability analysis we show that at any fixed ratio α between the number of patterns M and the dimension N of the perceptron (α = M/N), there exists a critical dilution field hc above which the replica symmetric ansatz becomes unstable. (letter)
Altran, A.B.; Lotufo, A.D.P.; Minussi, C.R. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil). Dept. de Engenharia Eletrica], Emails: lealtran@yahoo.com.br, annadiva@dee.feis.unesp.br, minussi@dee.feis.unesp.br; Lopes, M.L.M. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil). Dept. de Matematica], E-mail: mara@mat.feis.unesp.br
2009-07-01
This paper presents a methodology for electrical load forecasting, using radial base functions as activation function in artificial neural networks with the training by backpropagation algorithm. This methodology is applied to short term electrical load forecasting (24 h ahead). Therefore, results are presented analyzing the use of radial base functions substituting the sigmoid function as activation function in multilayer perceptron neural networks. However, the main contribution of this paper is the proposal of a new formulation of load forecasting dedicated to the forecasting in several points of the electrical network, as well as considering several types of users (residential, commercial, industrial). It deals with the MLF (Multimodal Load Forecasting), with the same processing time as the GLF (Global Load Forecasting). (author)
Mahmoud Akbarian
2015-07-01
Results: Twelve features with P<0.05 and four features with P<0.1 were identified by using binary logistic regression as effective features. These sixteen features were used as input variables in artificial neural networks. The accuracy, sensitivity and specificity of the test data for the MLP network were 90.9%, 80.0%, and 94.1% respectively and for the total data were 97.3%, 93.5%, and 99.0% respectively. Conclusion: According to the results, we concluded that feed-forward Multi-Layer Perceptron (MLP neural network with scaled conjugate gradient (trainscg back propagation learning algorithm can help physicians to predict the pregnancy outcomes (spontaneous abortion and live birth among pregnant women with lupus by using identified effective variables.
Jun-Young Jung
2015-10-01
Full Text Available An exact classification of different gait phases is essential to enable the control of exoskeleton robots and detect the intentions of users. We propose a gait phase classification method based on neural networks using sensor signals from lower limb exoskeleton robots. In such robots, foot sensors with force sensing registers are commonly used to classify gait phases. We describe classifiers that use the orientation of each lower limb segment and the angular velocities of the joints to output the current gait phase. Experiments to obtain the input signals and desired outputs for the learning and validation process are conducted, and two neural network methods (a multilayer perceptron and nonlinear autoregressive with external inputs (NARX are used to develop an optimal classifier. Offline and online evaluations using four criteria are used to compare the performance of the classifiers. The proposed NARX-based method exhibits sufficiently good performance to replace foot sensors as a means of classifying gait phases.
Palukuru NAGENDRA
2010-12-01
Full Text Available In this study, the use of artificial neural network (ANN based model, multi-layer perceptron (MLP network, to compute the transfer capabilities in a multi-area power system was explored. The input for the ANN is load status and the outputs are the transfer capability among the system areas, voltage magnitudes and voltage angles at concerned buses of the areas under consideration. The repeated power flow (RPF method is used in this paper for calculating the power transfer capability, voltage magnitudes and voltage angles necessary for the generation of input-output patterns for training the proposed MLP neural network. Preliminary investigations on a three area 30-bus system reveal that the proposed model is computationally faster than the conventional method.
Griessbach, Gert; Eiselt, Michael; Drschel, Jens; Witte, Herbert; Galicki, Miroslaw
1997-08-01
In this study, a proposition of simultaneous training of the neural network (multilayer perceptron) and adaptive preprocessing unit is presented. This cooperation enables the network to affect the preprocessing and as a consequence to vary the locations of pattern vectors in a feature space. Thus, during the learning process the network tries to find a good separation of classes of patterns, which results in convergence of the whole learning process. The strategy was developed in order to make efficient EEG monitoring in neonates possible. A comparison of the method presented herein with the known learning strategies for neural networks shows the need for using it as an alternative learning process. The convergence of the whole system is also discussed. Copyright 1997 Elsevier Science Ltd. PMID:12662508
Mathematically Reduced Chemical Reaction Mechanism Using Neural Networks
Ziaul Huque
2007-08-31
This is the final technical report for the project titled 'Mathematically Reduced Chemical Reaction Mechanism Using Neural Networks'. The aim of the project was to develop an efficient chemistry model for combustion simulations. The reduced chemistry model was developed mathematically without the need of having extensive knowledge of the chemistry involved. To aid in the development of the model, Neural Networks (NN) was used via a new network topology known as Non-linear Principal Components Analysis (NPCA). A commonly used Multilayer Perceptron Neural Network (MLP-NN) was modified to implement NPCA-NN. The training rate of NPCA-NN was improved with the GEneralized Regression Neural Network (GRNN) based on kernel smoothing techniques. Kernel smoothing provides a simple way of finding structure in data set without the imposition of a parametric model. The trajectory data of the reaction mechanism was generated based on the optimization techniques of genetic algorithm (GA). The NPCA-NN algorithm was then used for the reduction of Dimethyl Ether (DME) mechanism. DME is a recently discovered fuel made from natural gas, (and other feedstock such as coal, biomass, and urban wastes) which can be used in compression ignition engines as a substitute for diesel. An in-house two-dimensional Computational Fluid Dynamics (CFD) code was developed based on Meshfree technique and time marching solution algorithm. The project also provided valuable research experience to two graduate students.
Control on a 2-D Wing Flutter Using an AdaptiveNonlinear Neural Controller
Hayder S. Abd Al-Amir
2011-01-01
Full Text Available An adaptive nonlinear neural controller to reduce the nonlinear flutter in 2-D wing is proposed in the paper. The nonlinearities in the system come from the quasi steady aerodynamic model and torsional spring in pitch direction. Time domain simulations are used to examine the dynamic aero elastic instabilities of the system (e.g. the onset of flutter and limit cycle oscillation, LCO. The structure of the controller consists of two models :the modified Elman neural network (MENN and the feed forward multi-layer Perceptron (MLP. The MENN model is trained with off-line and on-line stages to guarantee that the outputs of the model accurately represent the plunge and pitch motion of the wing and this neural model acts as the identifier. The feed forward neural controller is trained off-line and adaptive weights are implemented on-line to find the flap angles, which controls the plunge and pitch motion of the wing. The general back propagation algorithm is used to learn the feed forward neural controller and the neural identifier. The simulation results show the effectiveness of the proposed control algorithm; this is demonstrated by the minimized tracking error to zero approximation with very acceptable settling time even with the existence of bounded external disturbances.
A neural network device for on-line particle identification in cosmic ray experiments
On-line particle identification is one of the main goals of many experiments in space both for rare event studies and for optimizing measurements along the orbital trajectory. Neural networks can be a useful tool for signal processing and real time data analysis in such experiments. In this document we report on the performances of a programmable neural device which was developed in VLSI analog/digital technology. Neurons and synapses were accomplished by making use of Operational Transconductance Amplifier (OTA) structures. In this paper we report on the results of measurements performed in order to verify the agreement of the characteristic curves of each elementary cell with simulations and on the device performances obtained by implementing simple neural structures on the VLSI chip. A feed-forward neural network (Multi-Layer Perceptron, MLP) was implemented on the VLSI chip and trained to identify particles by processing the signals of two-dimensional position-sensitive Si detectors. The radiation monitoring device consisted of three double-sided silicon strip detectors. From the analysis of a set of simulated data it was found that the MLP implemented on the neural device gave results comparable with those obtained with the standard method of analysis confirming that the implemented neural network could be employed for real time particle identification
Barron, Leon P; McEneff, Gillian L
2016-01-15
For the first time, the performance of a generalised artificial neural network (ANN) approach for the prediction of 2492 chromatographic retention times (tR) is presented for a total of 1117 chemically diverse compounds present in a range of complex matrices and across 10 gradient reversed-phase liquid chromatography-(high resolution) mass spectrometry methods. Probabilistic, generalised regression, radial basis function as well as 2- and 3-layer multilayer perceptron-type neural networks were investigated to determine the most robust and accurate model for this purpose. Multi-layer perceptrons most frequently yielded the best correlations in 8 out of 10 methods. Averaged correlations of predicted versus measured tR across all methods were R(2)=0.918, 0.924 and 0.898 for the training, verification and test sets respectively. Predictions of blind test compounds (n=8-84 cases) resulted in an average absolute accuracy of 1.02±0.54min for all methods. Within this variation, absolute accuracy was observed to marginally improve for shorter runtimes, but was found to be relatively consistent with respect to analyte retention ranges (~5%). Finally, optimised and replicated network dependency on molecular descriptor data is presented and critically discussed across all methods. Overall, ANNs were considered especially suitable for suspects screening applications and could potentially be utilised in bracketed-type analyses in combination with high resolution mass spectrometry. PMID:26592605
Combining neural networks and genetic algorithms for hydrological flow forecasting
Neruda, Roman; Srejber, Jan; Neruda, Martin; Pascenko, Petr
2010-05-01
We present a neural network approach to rainfall-runoff modeling for small size river basins based on several time series of hourly measured data. Different neural networks are considered for short time runoff predictions (from one to six hours lead time) based on runoff and rainfall data observed in previous time steps. Correlation analysis shows that runoff data, short time rainfall history, and aggregated API values are the most significant data for the prediction. Neural models of multilayer perceptron and radial basis function networks with different numbers of units are used and compared with more traditional linear time series predictors. Out of possible 48 hours of relevant history of all the input variables, the most important ones are selected by means of input filters created by a genetic algorithm. The genetic algorithm works with population of binary encoded vectors defining input selection patterns. Standard genetic operators of two-point crossover, random bit-flipping mutation, and tournament selection were used. The evaluation of objective function of each individual consists of several rounds of building and testing a particular neural network model. The whole procedure is rather computational exacting (taking hours to days on a desktop PC), thus a high-performance mainframe computer has been used for our experiments. Results based on two years worth data from the Ploucnice river in Northern Bohemia suggest that main problems connected with this approach to modeling are ovetraining that can lead to poor generalization, and relatively small number of extreme events which makes it difficult for a model to predict the amplitude of the event. Thus, experiments with both absolute and relative runoff predictions were carried out. In general it can be concluded that the neural models show about 5 per cent improvement in terms of efficiency coefficient over liner models. Multilayer perceptrons with one hidden layer trained by back propagation algorithm and predicting relative runoff show the best behavior so far. Utilizing the genetically evolved input filter improves the performance of yet another 5 per cent. In the future we would like to continue with experiments in on-line prediction using real-time data from Smeda River with 6 hours lead time forecast. Following the operational reality we will focus on classification of the runoffs into flood alert levels, and reformulation of the time series prediction task as a classification problem. The main goal of all this work is to improve flood warning system operated by the Czech Hydrometeorological Institute.
Shovasis Kumar Biswas; Mohammad Mahmudul Alam Mia
2015-01-01
Abstract Support Vector Machine SVM and back-propagation neural network BPNN has been applied successfully in many areas for example rule extraction classification and evaluation. In this paper we studied the back-propagation algorithm for training the multilayer artificial neural network and a support vector machine for data classification and image reconstruction aspects. A model focused on SVM with Gaussian RBF kernel is utilized here for data classification. Back propagation neural networ...
A coherent perceptron for all-optical learning
Tezak, Nikolas; Mabuchi, Hideo [Stanford University, Edward L. Ginzton Laboratory, Stanford, CA (United States)
2015-12-15
We present nonlinear photonic circuit models for constructing programmable linear transformations and use these to realize a coherent perceptron, i.e., an all-optical linear classifier capable of learning the classification boundary iteratively from training data through a coherent feedback rule. Through extensive semi-classical stochastic simulations we demonstrate that the device nearly attains the theoretical error bound for a model classification problem. (orig.)
A coherent perceptron for all-optical learning
We present nonlinear photonic circuit models for constructing programmable linear transformations and use these to realize a coherent perceptron, i.e., an all-optical linear classifier capable of learning the classification boundary iteratively from training data through a coherent feedback rule. Through extensive semi-classical stochastic simulations we demonstrate that the device nearly attains the theoretical error bound for a model classification problem. (orig.)
Stefania Bonafoni
2009-01-01
Full Text Available In this study different approaches based on multilayer perceptron neural networks are proposed and evaluated with the aim to retrieve tropospheric profiles by using GPS radio occultation data. We employed a data set of 445 occultations covering the land surface within the Tropics, split into desert and vegetation zone. The neural networks were trained with refractivity profiles as input computed from geometrical occultation parameters provided by the FORMOSAT-3/COSMIC satellites, while the targets were the dry and wet refractivity profiles and the dry pressure profiles obtained from the contemporary European Centre for Medium-Range Weather Forecast data. Such a new retrieval algorithm was chosen to solve the atmospheric profiling problem without the constraint of an independent knowledge of one atmospheric parameter at each GPS occultation.
J. C. Ochoa-Rivera
2002-01-01
Full Text Available A model for multivariate streamflow generation is presented, based on a multilayer feedforward neural network. The structure of the model results from two components, the neural network (NN deterministic component and a random component which is assumed to be normally distributed. It is from this second component that the model achieves the ability to incorporate effectively the uncertainty associated with hydrological processes, making it valuable as a practical tool for synthetic generation of streamflow series. The NN topology and the corresponding analytical explicit formulation of the model are described in detail. The model is calibrated with a series of monthly inflows to two reservoir sites located in the Tagus River basin (Spain, while validation is performed through estimation of a set of statistics that is relevant for water resources systems planning and management. Among others, drought and storage statistics are computed and compared for both the synthetic and historical series. The performance of the NN-based model was compared to that of a standard autoregressive AR(2 model. Results show that NN represents a promising modelling alternative for simulation purposes, with interesting potential in the context of water resources systems management and optimisation. Keywords: neural networks, perceptron multilayer, error backpropagation, hydrological scenario generation, multivariate time-series..
The principles of artificial neural network information processing
In this article, the basic structure of an artificial neuron is first introduced. In addition, principles of artificial neural network as well as several important artificial neural models such as Perceptron, Back propagation model, Hopfield net, and ART model are briefly discussed and analyzed. Finally, the application of artificial neural network for Chinese Character Recognition is also given. (author)
Mayra Luiza Marques da Silva, Binoti; Helio Garcia, Leite; Daniel Henrique Breda, Binoti; Jos Marinaldo, Gleriani.
2015-03-01
Full Text Available Objetivou-se, neste estudo, treinar, aplicar e avaliar a eficincia de redes neurais artificiais (RNA) para realizar a prognose da produo de povoamentos equineos de clones de eucalipto. Os dados utilizados foram provenientes de povoamentos localizados no sul da Bahia, totalizando cerca de 2.000 h [...] ectares de floresta. Foram utilizadas variveis numricas, como: idade, rea basal, volume e variveis categricas, como classe de solo, textura, tipos de espaamento, relevo, projeto e clone. Os dados foram divididos aleatoriamente em dois grupos: treinamento (80%) e generalizao (20%). Foram treinadas redes de trs tipos: perceptron, perceptron de mltiplas camadas e redes de funo de base radial. As RNA que apresentaram os melhores desempenhos no treinamento e generalizao foram selecionadas para realizar a prognose com dados, a partir do primeiro inventrio florestal. Conclui-se que as RNA apresentaram resultados satisfatrios, comprovando o potencial e aplicabilidade da tcnica na soluo dos problemas de mensurao e manejo florestal. Abstract in english The objective of this study was to train, implement and evaluate the efficiency of artificial neural networks (ANN) to perform production prognosis of even-aged stands of eucalyptus clones. The data used were from plantations located in southern Bahia, totaling about 2,000 acres of forest. Numeric v [...] ariables, such as age, basal area, volume and categorical variables, such as soil class texture, spacing, land relief, project and clone were used. The data were randomly divided into two groups: training (80%) and generalization (20%). Three types of networks were trained: perceptron, multilayer perceptron networks and radial basis function. The RNA that showed the best performance in training and generalization were selected to perform the prognosis with data from the first forest inventory. We conclude that the RNA had satisfactory results, showing the potential and applicability of the technique in solving measurement and forest management problems.
A Review of Artificial Neural Networks: How Well Do They Perform in Forecasting Time Series?
Elsy Gómez-Ramos
2013-12-01
Full Text Available At the beginning of the 90’s, Artificial Neural Networks (ANNs started their applications in finance. The ANNs are data-drive, self-adaptive and non-linear methods that do not require specific assumptions about the underlying model. In general, there are five groups of networks used as forecasting tools: 1 Feedforward Networks, like the Multilayer Perceptron (MLP, 2 Recurrent Networks, 3 Polynomial Networks, 4 Modular Networks, and 5 Support Vector Machine. This paper carries out a review of the specialized literature on ANNs and makes a comparative analysis according to their performance in forecasting stock indices and exchange rates. The objective is to assess the performance when applying different types of networks in relation to MLP. It is shown that the MLP is the best network in forecasting time series. However, it is shown that the MLP has important delimitations in several respects: network architecture, basic functions and initialization weights.
Modeling mechanical properties of cast aluminum alloy using artificial neural network
Modeling is widely used to investigate the mechanical properties of engineering materials due to increasing demand of low cost and high strength to weight ratio for many engineering applications. The aluminum casting alloys are cost competitive material and possess the desired properties. The mechanical properties largely depend upon composition of alloys and their processing method. Alloy design involves controlling mechanical properties via optimization of the composition and processing parameters. For optimization the possible root is empirical modeling and its more refined version is the analysis of the wide range of data using ANN (Artificial Neural Networks) modeling. The modeling of mechanical properties of the aluminum alloys are the main objective of present work. For this purpose, some data were collected and experimentally prepared using conventional casting method. A MLP (Multilayer Perceptron) network was developed, which is trained by using the error back propagation algorithm. (author)
Viscosity Calculation at Moderate Pressure for Nonpolar Gases via Neural Network
A. Bouzidi
2007-01-01
Full Text Available A new method, based on Artificial Neural Networks (ANN of Multi-Layer Perceptron (MLP type, has been developed to estimate the viscosity at moderate pressure for pure nonpolar gases over a wide range of temperatures. An ANN was trained, using four physicochemical properties: Molecular weight (M, boiling point (Tb, critical Temperature (Tc and critical Pressure (Pc combined with absolute Temperature (T as its inputs, to correlate and predict viscosity. A group of 52 nonpolar gases were used to train and test the performance of the ANN. The viscosity and input data for each individual gas was compiled on average at fifty different temperatures, ranging from the boiling points for each of the chosen gases to 1100 K. The maximum absolute error in viscosity, predicted by the ANN, was approximately 15%.
Early detection of incipient faults in power plants using accelerated neural network learning
An important aspect of power plant automation is the development of computer systems able to detect and isolate incipient (slowly developing) faults at the earliest possible stages of their occurrence. In this paper, the development and testing of such a fault detection scheme is presented based on recognition of sensor signatures during various failure modes. An accelerated learning algorithm, namely adaptive backpropagation (ABP), has been developed that allows the training of a multilayer perceptron (MLP) network to a high degree of accuracy, with an order of magnitude improvement in convergence speed. An artificial neural network (ANN) has been successfully trained using the ABP algorithm, and it has been extensively tested with simulated data to detect and classify incipient faults of various types and severity and in the presence of varying sensor noise levels
Static sign language recognition using 1D descriptors and neural networks
Solís, José F.; Toxqui, Carina; Padilla, Alfonso; Santiago, César
2012-10-01
A frame work for static sign language recognition using descriptors which represents 2D images in 1D data and artificial neural networks is presented in this work. The 1D descriptors were computed by two methods, first one consists in a correlation rotational operator.1 and second is based on contour analysis of hand shape. One of the main problems in sign language recognition is segmentation; most of papers report a special color in gloves or background for hand shape analysis. In order to avoid the use of gloves or special clothing, a thermal imaging camera was used to capture images. Static signs were picked up from 1 to 9 digits of American Sign Language, a multilayer perceptron reached 100% recognition with cross-validation.
A new approach for sizing stand alone photovoltaic systems based in neural networks
Hontoria, L.; Aguilera, J. [Universidad de Jaen, Dept. de Electronica, Jaen (Spain); Zufiria, P. [UPM Ciudad Universitaria, Dept. de Matematica Aplicada a las Tecnologias de la Informacion, Madrid (Spain)
2005-02-01
Several methods for sizing stand alone photovoltaic (pv) systems has been developed. The more simplistic are called intuitive methods. They are a useful tool for a first approach in sizing stand alone photovoltaic systems. Nevertheless they are very inaccurate. Analytical methods use equations to describe the pv system size as a function of reliability. These ones are more accurate than the previous ones but they are also not accurate enough for sizing of high reliability. In a third group there are methods which use system simulations. These ones are called numerical methods. Many of the analytical methods employ the concept of reliability of the system or the complementary term: loss of load probability (LOLP). In this paper an improvement for obtaining LOLP curves based on the neural network called Multilayer Perceptron (MLP) is presented. A unique MLP for many locations of Spain has been trained and after the training, the MLP is able to generate LOLP curves for any value and location. (Author)
Scott, D J; Kilner, J A; Rossiny, J C H; McAlford, N N
2007-01-01
We describe the development of artificial neural networks (ANN) for the prediction of the properties of ceramic materials. The ceramics studied here include polycrystalline, inorganic, non-metallic materials and are investigated on the basis of their dielectric and ionic properties. Dielectric materials are of interest in telecommunication applications where they are used in tuning and filtering equipment. Ionic and mixed conductors are the subjects of a concerted effort in the search for new materials that can be incorporated into efficient, clean electrochemical devices of interest in energy production and greenhouse gas reduction applications. Multi-layer perceptron ANNs are trained using the back-propagation algorithm and utilise data obtained from the literature to learn composition-property relationships between the inputs and outputs of the system. The trained networks use compositional information to predict the relative permittivity and oxygen diffusion properties of ceramic materials. The results sh...
Neural networks for emulation variational method for data assimilation in nonlinear dynamics
Morais Furtado, Helaine Cristina; Fraga de Campos Velho, Haroldo; Macau, Elbert E N, E-mail: helaine.furtado@lac.inpe.br, E-mail: haroldo@lac.inpe.br, E-mail: elbert@lac.inpe.br [Laboratorio Associado de Computacao e Matematica Aplicada, Sao Jose dos Campos (Brazil)
2011-03-01
Description of a physical phenomenon through differential equations has errors involved, since the mathematical model is always an approximation of reality. For an operational prediction system, one strategy to improve the prediction is to add some information from the real dynamics into mathematical model. This additional information consists of observations on the phenomenon. However, the observational data insertion should be done carefully, for avoiding a worse performance of the prediction. Technical data assimilation are tools to combine data from physical-mathematics model with observational data to obtain a better forecast. The goal of this work is to present the performance of the Neural Network Multilayer Perceptrons trained to emulate a Variational method in context of data assimilation. Techniques for data assimilation are applied for the Lorenz systems; which presents a strong nonlinearity and chaotic nature.
Comparison of Neural Network and K-Nearest Neighbor Methods in Daily Flow Forecasting
Mirkhalegh Z. Ahmadi
2010-01-01
Full Text Available This study illustrates the application of Multilayer perceptron (MLP Neural Network (NN for flow prediction of a Bakhtiari River. Since measurement of variables is time consuming and defining the efficient variable is essential for better performance of NN, alternative method of flow forecasting is needed. The K-Nearest Neighbor (K-NN method which is a non-parametric regression methodology as indicated by the absence of any parameterized analytical function of the input-output relationship is used in this study. The implementation of each time series technique is investigated and the performances of the models are then compared. It is concluded that discharge in one day-ahead and Antecedent Precipitation Index (API for seven days-ahead are the most important inputs and NN model has little better result than nearest neighbor method.
Prediction of Atmospheric Pressure at Ground Level using Artificial Neural Network
Angshuman Ray
2013-01-01
Full Text Available Prediction of Atmospheric Pressure is one important and challenging task that needs lot of attention and study for analyzing atmospheric conditions. Advent of digital computers and development of data driven artificial intelligence approaches like Artificial Neural Networks (ANN have helped in numerical prediction of pressure. However, very few works have been done till now in this area. The present study developed an ANN model based on the past observations of several meteorological parameters like temperature, humidity, air pressure and vapour pressure as an input for training the model. The novel architecture of the proposed model contains several multilayer perceptron network (MLP to realize better performance. The model is enriched by analysis of alternative hybrid model of k-means clustering and MLP. The improvement of the performance in the prediction accuracy has been demonstrated by the automatic selection of the appropriate cluster
This paper presents an automated approach to apply a self-organizing map (SOM) artificial neural network (ANN) as a tool for feature extraction and dimensionality reduction to recognize and characterize radiologic patterns of interstitial lung diseases in chest radiography. After feature extraction and dimensionality reduction a multilayer perceptron (MLP) ANN is applied for radiologic patterns classification in normal, linear, nodular or mixed. A leave-one-out methodology was applied for training and test over a database containing 17 samples of linear pattern, 9 samples of nodular pattern, 9 samples of mixed pattern and 18 samples of normal pattern. The MLP network provided an average result of 88.7% of right classification, with 100% of right classification for linear pattern, 55.5% for nodular pattern, 77.7% for mixed pattern and 100% for normal pattern. (orig.)
Use of artificial neural networks for prognosis of charcoal prices in Minas Gerais
Luiz Moreira Coelho Junior
2013-06-01
Full Text Available Energy is an important factor of economic growth and is critical to the stability of a nation. Charcoal is a renewable energy resource and is a fundamental input to the development of the Brazilian forest-based industry. The objective of this study is to provide a prognosis of the charcoal price series for the year 2007 by using Artificial Neural Networks. A feedforward multilayer perceptron ANN was used, the results of which are close to reality. The main findings are that: real prices of charcoal dropped between 1975 and 2000 and rose from the early 21st century; the ANN with two hidden layers was the architecture making the best prediction; the most effective learning rate was 0.99 and 600 cycles, representing the most satisfactory and accurate ANN training. Prediction using ANN was found to be more accurate when compared by the mean squared error to other studies modeling charcoal price series in Minas Gerais state.
Artificial neural networks (ANN: prediction of sensory measurements from instrumental data
Naiara Barbosa Carvalho
2013-12-01
Full Text Available The objective of this study was to predict by means of Artificial Neural Network (ANN, multilayer perceptrons, the texture attributes of light cheesecurds perceived by trained judges based on instrumental texture measurements. Inputs to the network were the instrumental texture measurements of light cheesecurd (imitative and fundamental parameters. Output variables were the sensory attributes consistency and spreadability. Nine light cheesecurd formulations composed of different combinations of fat and water were evaluated. The measurements obtained by the instrumental and sensory analyses of these formulations constituted the data set used for training and validation of the network. Network training was performed using a back-propagation algorithm. The network architecture selected was composed of 8-3-9-2 neurons in its layers, which quickly and accurately predicted the sensory texture attributes studied, showing a high correlation between the predicted and experimental values for the validation data set and excellent generalization ability, with a validation RMSE of 0.0506.
Pérez-Marín, D; Garrido-Varo, A; Guerrero, J E; Gutiérrez-Estrada, J C
2006-09-01
The use of near-infrared reflectance spectroscopy (NIRS) calibrations to predict the ingredient composition in compound feeds (i.e., inclusion percentage of each ingredient) is a complex task, regarding both the nature of the parameters to be predicted, since they are not well-defined chemical entities, and the heterogeneousness of the matrices/formulas in which each ingredient participates. The present paper evaluates the use of nonlinear regression methods, such as artificial neural networks (ANN), for developing NIRS calibrations to predict these parameters. Two of the most representative ingredients in the Spanish compound feed formulations (wheat and sunflower meal) were selected for evaluating ANN possibilities, using a large spectral library comprising a total of 7523 commercial compound feed samples; 7423 were used as training set and 100 as validation set. Three general models of networks were studied: multilayer perceptron with back-propagation training (BP), multilayer perceptron with Levenberg-Maquartd training (LM), and radial basis function nets (RBF); moreover, in accordance with a factorial design, more complex architectures were evaluated gradually, changing the number of hidden layers and hidden neurons, for the determination of the optimal network topology. For both ingredients, the best results were obtained using ANN with BP training, showing prediction error values (SEP) of 2.72% and 0.66% for wheat and sunflower meal, respectively. These SEP values showed a significant improvement (19%-49% for sunflower meal and wheat, respectively) in comparison with those obtained using calibrations developed with linear methods. PMID:17002832
Optimal exponential synchronization of general chaotic delayed neural networks: an LMI approach.
Liu, Meiqin
2009-09-01
This paper investigates the optimal exponential synchronization problem of general chaotic neural networks with or without time delays by virtue of Lyapunov-Krasovskii stability theory and the linear matrix inequality (LMI) technique. This general model, which is the interconnection of a linear delayed dynamic system and a bounded static nonlinear operator, covers several well-known neural networks, such as Hopfield neural networks, cellular neural networks (CNNs), bidirectional associative memory (BAM) networks, and recurrent multilayer perceptrons (RMLPs) with or without delays. Using the drive-response concept, time-delay feedback controllers are designed to synchronize two identical chaotic neural networks as quickly as possible. The control design equations are shown to be a generalized eigenvalue problem (GEVP) which can be easily solved by various convex optimization algorithms to determine the optimal control law and the optimal exponential synchronization rate. Detailed comparisons with existing results are made and numerical simulations are carried out to demonstrate the effectiveness of the established synchronization laws. PMID:19443178
A new source difference artificial neural network for enhanced positioning accuracy
Bhatt, Deepak; Aggarwal, Priyanka; Devabhaktuni, Vijay; Bhattacharya, Prabir
2012-10-01
Integrated inertial navigation system (INS) and global positioning system (GPS) units provide reliable navigation solution compared to standalone INS or GPS. Traditional Kalman filter-based INS/GPS integration schemes have several inadequacies related to sensor error model and immunity to noise. Alternatively, multi-layer perceptron (MLP) neural networks with three layers have been implemented to improve the position accuracy of the integrated system. However, MLP neural networks show poor accuracy for low-cost INS because of the large inherent sensor errors. For the first time the paper demonstrates the use of knowledge-based source difference artificial neural network (SDANN) to improve navigation performance of low-cost sensor, with or without external aiding sources. Unlike the conventional MLP or artificial neural networks (ANN), the structure of SDANN consists of two MLP neural networks called the coarse model and the difference model. The coarse model learns the input-output data relationship whereas the difference model adds knowledge to the system and fine-tunes the coarse model output by learning the associated training or estimation error. Our proposed SDANN model illustrated a significant improvement in navigation accuracy of up to 81% over conventional MLP. The results demonstrate that the proposed SDANN method is effective for GPS/INS integration schemes using low-cost inertial sensors, with and without GPS.
A new source difference artificial neural network for enhanced positioning accuracy
Integrated inertial navigation system (INS) and global positioning system (GPS) units provide reliable navigation solution compared to standalone INS or GPS. Traditional Kalman filter-based INS/GPS integration schemes have several inadequacies related to sensor error model and immunity to noise. Alternatively, multi-layer perceptron (MLP) neural networks with three layers have been implemented to improve the position accuracy of the integrated system. However, MLP neural networks show poor accuracy for low-cost INS because of the large inherent sensor errors. For the first time the paper demonstrates the use of knowledge-based source difference artificial neural network (SDANN) to improve navigation performance of low-cost sensor, with or without external aiding sources. Unlike the conventional MLP or artificial neural networks (ANN), the structure of SDANN consists of two MLP neural networks called the coarse model and the difference model. The coarse model learns the input–output data relationship whereas the difference model adds knowledge to the system and fine-tunes the coarse model output by learning the associated training or estimation error. Our proposed SDANN model illustrated a significant improvement in navigation accuracy of up to 81% over conventional MLP. The results demonstrate that the proposed SDANN method is effective for GPS/INS integration schemes using low-cost inertial sensors, with and without GPS
Solar geomagnetic activity prediction using the fractal analysis and neural network
Ouadfeul, Sid-Ali; Aliouane, Leila
2010-05-01
The main goal of this work is to predict the Solar geomagnetic field activity using the neural network combined with the fractal analysis, first a multilayer perceptron neural network model is proposed to predict the future Solar geomagnetic field, the input of this machine is the geographic Coordinates and the time .The output is the three geomagnetic field components and the total field intensity recorded by the Orsted Satellite Mission. Holder Exponents of the measured geomagnetic field components and the total field intensity are calculated using the continuous wavelet transform. The Set of Holder exponents is used to train a Kohonen's Self-Organizing Map (SOM) neural machine which will become a classifier of the solar magnetic activity nature. The SOM neural network machine is used to predict the future solar magnetic storms, in this step the input is the calculated set of the Holder exponents of the predicted geomagnetic field components and the total field intensity. Obtained results show that the proposed technique is a powerful tool and can enhance the solar magnetic field activity prediction. Keywords: Solar geomagnetic activity, neural network, prediction, Orsted, Holder Exponents, Solar magnetic storms.
Digital Hardware Implementation of a Neural System Used for Nonlinear Adaptive Prediction
HassÃ¨ne Faiedh
2006-01-01
Full Text Available Neural networks have been widely used for many applications in digital communications. They are able to give solutions to complex problems due to their nonlinear processing and their learning and generalization. Neural networks are one of the key technologies for the communication domain and accordingly a special effort may be expected to be paid to real time hardware implementation issues. In this study, it is proposed a digital hardware implementation of a neural system based on a multilayer perceptron (MLP. The neural system is used for the nonlinear adaptive prediction of nonstationary signals such as speech signals. The implemented architecture of the MLP is generated using a generic elementary neuron (EN. The polynomial approximation method is used to implement the sigmoidal activation function. The back-propagation algorithm is used to implant the prediction task. The circuit implementation architecture is detailed, for achieving real-time prediction for speech signals. The designed ASIC circuit includes a neural network block, an on-chip learning block and a memory used for storing the synaptic weights for updating.
LOCALIZATION FOR WIRELESS SENSOR NETWORKS: A NEURAL NETWORK APPROACH
Shiu Kumar
2016-01-01
Full Text Available As Wireless Sensor Networks are penetrating into the industrial domain, many research opportunities are emerging. One such essential and challenging application is that of node localization. A feed-forward neural network based methodology is adopted in this paper. The Received Signal Strength Indicator (RSSI values of the anchor node beacons are used. The number of anchor nodes and their configurations has an impact on the accuracy of the localization system, which is also addressed in this paper. Five different training algorithms are evaluated to find the training algorithm that gives the best result. The multi-layer Perceptron (MLP neural network model was trained using Matlab. In order to evaluate the performance of the proposed method in real time, the model obtained was then implemented on the Arduino microcontroller. With four anchor nodes, an average 2D localization error of 0.2953 m has been achieved with a 12-12-2 neural network structure. The proposed method can also be implemented on any other embedded microcontroller system.
Artificial Neural Network Approach in Radar Target Classification
N. K. Ibrahim
2009-01-01
Full Text Available Problem statement: This study unveils the potential and utilization of Neural Network (NN in radar applications for target classification. The radar system under test is a special of it kinds and known as Forward Scattering Radar (FSR. In this study the target is a ground vehicle which is represented by typical public road transport. The features from raw radar signal were extracted manually prior to classification process using Neural Network (NN. Features given to the proposed network model are identified through radar theoretical analysis. Multi-Layer Perceptron (MLP back-propagation neural network trained with three back-propagation algorithm was implemented and analyzed. In NN classifier, the unknown target is sent to the network trained by the known targets to attain the accurate output. Approach: Two types of classifications were analyzed. The first one is to classify the exact type of vehicle, four vehicle types were selected. The second objective is to grouped vehicle into their categories. The proposed NN architecture is compared to the K Nearest Neighbor classifier and the performance is evaluated. Results: Based on the results, the proposed NN provides a higher percentage of successful classification than the KNN classifier. Conclusion/Recommendation: The result presented here show that NN can be effectively employed in radar classification applications.
Neural Network Based Lna Design for Mobile Satellite Receiver
Abhijeet Upadhya
2014-08-01
Full Text Available Paper presents a Neural Network Modelling approach to microwave LNA design. To acknowledge the specifications of the amplifier, Mobile Satellite Systems are analyzed. Scattering parameters of the LNA in the frequency range 0.5 to 18 GHz are calculated using a Multilayer Perceptron Artificial Neural Network model and corresponding smith charts and polar charts are plotted as output to the model. From these plots, the microwave scattering parameter description of the LNA are obtained. Model is efficiently trained using Agilent ATF 331M4 InGaAs/InP Low Noise pHEMT amplifier datasheet and the neural model’s output seem to follow the various device characteristic curves with high regression. Next, Maximum Allowable Gain and Noise figure of the device are modelled and plotted for the same frequency range. Finally, the optimized model is utilized as an interpolator and the resolution of the amplifying capability with noise characteristics are obtained for the L Band of MSS operation.
Representations of highly-varying functions by perceptron networks
Kůrková, Věra
North Charleston : CreateSpace Independent Publishing Platform, 2013 - (Vinař, T.; Holeňa, M.; Lexa, M.; Peška, L.; Vojtáš, P.), s. 73-76 ISBN 978-1-4909-5208-6. [ITAT 2013. Conference on Theory and Practice of Information Technologies. Donovaly (SK), 11.09.2013-15.09.2013] R&D Projects: GA ČR GAP202/11/1368 Institutional support: RVO:67985807 Keywords : one-hidden-layer networks * perceptrons * Boolean functions * network complexity Subject RIV: IN - Informatics, Computer Science
Prediction of the local power factor in BWR fuel cells by means of a multilayer neural network
To the beginning of a new operation cycle in a BWR reactor the reactivity of this it increases by means of the introduction of fresh fuel, the one denominated reload fuel. The problem of the definition of the characteristics of this reload fuel represents a combinatory optimization problem that requires significantly a great quantity of CPU time for their determination. This situation has motivated to study the possibility to substitute the Helios code, the one which is used to generate the new cells of the reload fuel parameters, by an artificial neuronal network, with the purpose of predicting the parameters of the fuel reload cell of a BWR reactor. In this work the results of the one training of a multilayer neuronal net that can predict the local power factor (LPPF) in such fuel cells are presented. The prediction of the LPPF is carried out in those condition of beginning of the life of the cell (0.0 MWD/T, to 40% of holes in the one moderator, temperature of 793 K in the fuel and a moderator temperature of 560 K. The cells considered in the present study consist of an arrangement of 10x10 bars, of those which 92 contains U235, some of these bars also contain a concentration of Gd2O3 and 8 of them contain only water. The axial location inside the one assembles of recharge of these cells it is exactly up of the cells that contain natural uranium in the base of the reactor core. The training of the neuronal net is carried out by means of a retro-propagation algorithm that uses a space of training formed starting from previous evaluations of cells by means of the Helios code. They are also presented the results of the application of the neuronal net found for the prediction of the LPPF of some cells used in the real operation of the Unit One of the Laguna Verde Nuclear Power station. (Author)
Elas, A; Ibarra-Berastegi, G; Arias, R; Barona, A
2006-07-01
Based on an experimental database consisting of 194 daily cases, artificial neural networks were used to model the removal efficiency of a biofilter for treating hydrogen sulphide (H2S). In this work, the removal efficiency of the reactor was considered as a function of the changes in the air flow and concentration of H2S entering the biofilter. In order to obtain true representative values, the removal efficiencies (outputs) were measured 24 h after each input was changed. A MLP (multilayer perceptron 2-2-1) model with two input variables (unit flow and concentration of the contaminant fed into the biofilter) rendered good prediction values with a determination coefficient of 0.92 for the removal efficiency within the range studied. This means that the MLP model can explain 92% of the overall variability detected in the biofilter corresponding to a wide range of operating conditions. PMID:16770593
Sun, Y.; Wendi, D.; Kim, D. E.; Liong, S.-Y.
2015-09-01
Accurate prediction of groundwater table is important for the efficient management of groundwater resources. Despite being the most widely used tools for depicting the hydrological regime, numerical models suffer from formidable constraints, such as extensive data demanding, high computational cost and inevitable parameter uncertainty. Artificial neural networks (ANNs), in contrast, can make predictions on the basis of more easily accessible variables, rather than requiring explicit characterization of the physical systems and prior knowledge of the physical parameters. This study applies ANN to predict the groundwater table in a swamp forest of Singapore. A standard multilayer perceptron (MLP) is selected, trained with the Levenberg-Marquardt (LM) algorithm. The inputs to the network are solely the surrounding reservoir levels and rainfall. The results reveal that ANN is able to produce accurate forecast with a leading time up to 7 days, whereas the performance slightly decreases when leading time increases.
Mizutani, Eiji; Demmel, James W
2003-01-01
This paper briefly introduces our numerical linear algebra approaches for solving structured nonlinear least squares problems arising from 'multiple-output' neural-network (NN) models. Our algorithms feature trust-region regularization, and exploit sparsity of either the 'block-angular' residual Jacobian matrix or the 'block-arrow' Gauss-Newton Hessian (or Fisher information matrix in statistical sense) depending on problem scale so as to render a large class of NN-learning algorithms 'efficient' in both memory and operation costs. Using a relatively large real-world nonlinear regression application, we shall explain algorithmic strengths and weaknesses, analyzing simulation results obtained by both direct and iterative trust-region algorithms with two distinct NN models: 'multilayer perceptrons' (MLP) and 'complementary mixtures of MLP-experts' (or neuro-fuzzy modular networks). PMID:12850030
Integration of Online Parameter Identification and Neural Network for In-Flight Adaptive Control
Hageman, Jacob J.; Smith, Mark S.; Stachowiak, Susan
2003-01-01
An indirect adaptive system has been constructed for robust control of an aircraft with uncertain aerodynamic characteristics. This system consists of a multilayer perceptron pre-trained neural network, online stability and control derivative identification, a dynamic cell structure online learning neural network, and a model following control system based on the stochastic optimal feedforward and feedback technique. The pre-trained neural network and model following control system have been flight-tested, but the online parameter identification and online learning neural network are new additions used for in-flight adaptation of the control system model. A description of the modification and integration of these two stand-alone software packages into the complete system in preparation for initial flight tests is presented. Open-loop results using both simulation and flight data, as well as closed-loop performance of the complete system in a nonlinear, six-degree-of-freedom, flight validated simulation, are analyzed. Results show that this online learning system, in contrast to the nonlearning system, has the ability to adapt to changes in aerodynamic characteristics in a real-time, closed-loop, piloted simulation, resulting in improved flying qualities.
Application of Artificial Neural Networks for Efficient High-Resolution 2D DOA Estimation
M. Agatonović
2012-12-01
Full Text Available A novel method to provide high-resolution Two-Dimensional Direction of Arrival (2D DOA estimation employing Artificial Neural Networks (ANNs is presented in this paper. The observed space is divided into azimuth and elevation sectors. Multilayer Perceptron (MLP neural networks are employed to detect the presence of a source in a sector while Radial Basis Function (RBF neural networks are utilized for DOA estimation. It is shown that a number of appropriately trained neural networks can be successfully used for the high-resolution DOA estimation of narrowband sources in both azimuth and elevation. The training time of each smaller network is significantly re¬duced as different training sets are used for networks in detection and estimation stage. By avoiding the spectral search, the proposed method is suitable for real-time ap¬plications as it provides DOA estimates in a matter of seconds. At the same time, it demonstrates the accuracy comparable to that of the super-resolution 2D MUSIC algorithm.
Zaqoot, Hossam Adel; Ansari, Abdul Khalique; Unar, Mukhtiar Ali; Khan, Shaukat Hyat
2009-01-01
Artificial Neural Networks (ANNs) are flexible tools which are being used increasingly to predict and forecast water resources variables. The human activities in areas surrounding enclosed and semi-enclosed seas such as the Mediterranean Sea always produce in the long term a strong environmental impact in the form of coastal and marine degradation. The presence of dissolved oxygen is essential for the survival of most organisms in the water bodies. This paper is concerned with the use of ANNs - Multilayer Perceptron (MLP) and Radial Basis Function neural networks for predicting the next fortnight's dissolved oxygen concentrations in the Mediterranean Sea water along Gaza. MLP and Radial Basis Function (RBF) neural networks are trained and developed with reference to five important oceanographic variables including water temperature, wind velocity, turbidity, pH and conductivity. These variables are considered as inputs of the network. The data sets used in this study consist of four years and collected from nine locations along Gaza coast. The network performance has been tested with different data sets and the results show satisfactory performance. Prediction results prove that neural network approach has good adaptability and extensive applicability for modelling the dissolved oxygen in the Mediterranean Sea along Gaza. We hope that the established model will help in assisting the local authorities in developing plans and policies to reduce the pollution along Gaza coastal waters to acceptable levels. PMID:19955628
Chaotic diagonal recurrent neural network
We propose a novel neural network based on a diagonal recurrent neural network and chaos, and its structure and learning algorithm are designed. The multilayer feedforward neural network, diagonal recurrent neural network, and chaotic diagonal recurrent neural network are used to approach the cubic symmetry map. The simulation results show that the approximation capability of the chaotic diagonal recurrent neural network is better than the other two neural networks. (interdisciplinary physics and related areas of science and technology)
Safavi, Hamid R; Malek Ahmadi, Kian
2015-01-01
Although drought impacts on water quantity are widely recognized, the impacts on water quality are less known. The Zayandehrud River basin in the west-central part of Iran plateau witnessed an increased contamination during the recent droughts and low flows. The river has been receiving wastewater and effluents from the villages, a number of small and large industries, and irrigation drainage systems along its course. What makes the situation even worse is the drought period the river basin has been going through over the last decade. Therefore, a river quality management model is required to include the adverse effects of industrial development in the region and the destructive effects of droughts which affect the river's water quality and its surrounding environment. Developing such a model naturally presupposes investigations into pollution effects in terms of both quality and quantity to be used in such management tools as mathematical models to predict the water quality of the river and to prevent pollution escalation in the environment. The present study aims to investigate electrical conductivity of the Zayandehrud River as a water quality parameter and to evaluate the effect of this parameter under drought conditions. For this purpose, artificial neural networks are used as a modeling tool to derive the relationship between electrical conductivity and the hydrological parameters of the Zayandehrud River. The models used in this research include multi-layer perceptron and radial basis function. Finally, these two models are compared in terms of their performance using the time series of electrical conductivity at eight monitoring-hydrometric stations during drought periods between the years 1997-2012. Results show that artificial neural networks can be used for modeling the relationship between electrical conductivity and hydrological parameters under drought conditions. It is further shown that radial basis function works better for the upstream stretches of the river while multi-layer perceptron is more efficient for the downstream stretches. PMID:26451249
Lobato, Justo; Canizares, Pablo; Rodrigo, Manuel A.; Linares, Jose J. [Chemical Engineering Department, University of Castilla-La Mancha, Campus Universitario s/n, 13004 Ciudad Real (Spain); Piuleac, Ciprian-George; Curteanu, Silvia [Faculty of Chemical Engineering and Environmental Protection, Department of Chemical Engineering, ' ' Gh. Asachi' ' Technical University Iasi Bd. D. Mangeron, No. 71A, 700050 IASI (Romania)
2010-08-15
This article shows the application of a very useful mathematical tool, artificial neural networks, to predict the fuel cells results (the value of the tortuosity and the cell voltage, at a given current density, and therefore, the power) on the basis of several properties that define a Gas Diffusion Layer: Teflon content, air permeability, porosity, mean pore size, hydrophobia level. Four neural networks types (multilayer perceptron, generalized feedforward network, modular neural network, and Jordan-Elman neural network) have been applied, with a good fitting between the predicted and the experimental values in the polarization curves. A simple feedforward neural network with one hidden layer proved to be an accurate model with good generalization capability (error about 1% in the validation phase). A procedure based on inverse neural network modelling was able to determine, with small errors, the initial conditions leading to imposed values for characteristics of the fuel cell. In addition, the use of this tool has been proved to be very attractive in order to predict the cell performance, and more interestingly, the influence of the properties of the gas diffusion layer on the cell performance, allowing possible enhancements of this material by changing some of its properties. (author)
Fast cosmological parameter estimation using neural networks
Auld, T; Hobson, M P; Gull, S F
2006-01-01
We present a method for accelerating the calculation of CMB power spectra, matter power spectra and likelihood functions for use in cosmological parameter estimation. The algorithm, called CosmoNet, is based on training a multilayer perceptron neural network and shares all the advantages of the recently released Pico algorithm of Fendt & Wandelt, but has several additional benefits in terms of simplicity, computational speed, memory requirements and ease of training. We demonstrate the capabilities of CosmoNet by computing CMB power spectra over a box in the parameter space of flat \\Lambda CDM models containing the 3\\sigma WMAP1 confidence region. We also use CosmoNet to compute the WMAP3 likelihood for flat \\Lambda CDM models and show that marginalised posteriors on parameters derived are very similar to those obtained using CAMB and the WMAP3 code. We find that the average error in the power spectra is typically 2-3% of cosmic variance, and that CosmoNet is \\sim 7 \\times 10^4 faster than CAMB (for flat ...
The reactor safety study with help of artificial neuron networks (multilayer perceptrons)
One deals with deposition of insulation large amounts on settling tank components that may result in malfunction of residual heat removal systems. Paper describes briefly simulation of pressure drops in confinement systems by means of an artificial neuron nets and compares the simulation data with the experiment ones
G. Sánchez
2004-01-01
Full Text Available Este artículo propone una red neuronal de tipo perceptron multicapas (MLP que optimiza tanto su matriz de pesos como el número de neuronas ocultas. Inicialmente el sistema propuesto usa un número reducido de neuronas ocultas, optimizándose la matriz de pesos mediante un algoritmo de perturbación simultánea. Una vez que la red converge se analiza su funcionamiento y si este no es el esperado se agrega una neurona oculta. Este proceso se repite hasta obtener el funcionamiento deseado. Los resultados obtenidos muestran que el sistema propuesto presenta un funcionamiento muy similar al de un MLP convencional, cuando éste tiene un número óptimo de nodos en la capa oculta y disminuye la complejidad computacional durante la etapa de entrenamiento.This paper proposes a multilayer perceptron neural network (MLP which optimizes both the matrix weights and the numbers of hidden neurons. Initially, the proposed system uses a reduced number of hidden neurons, optimizing the matrix weights by using a simultaneous perturbation algorithm. Once the network converges, its function is analyzed and if this is not as expected, a hidden neuron is added. This process is repeated until achieving the desired functioning. The results obtained show that the proposed system functions similarly to that of a conventional MLP when this has an optimal number of nodes in the hidden layer, decreasing the computational complexity during the training step.
Implementation of a spike-based perceptron learning rule using TiO2-x memristors.
Mostafa, Hesham; Khiat, Ali; Serb, Alexander; Mayr, Christian G; Indiveri, Giacomo; Prodromakis, Themis
2015-01-01
Synaptic plasticity plays a crucial role in allowing neural networks to learn and adapt to various input environments. Neuromorphic systems need to implement plastic synapses to obtain basic "cognitive" capabilities such as learning. One promising and scalable approach for implementing neuromorphic synapses is to use nano-scale memristors as synaptic elements. In this paper we propose a hybrid CMOS-memristor system comprising CMOS neurons interconnected through TiO2-x memristors, and spike-based learning circuits that modulate the conductance of the memristive synapse elements according to a spike-based Perceptron plasticity rule. We highlight a number of advantages for using this spike-based plasticity rule as compared to other forms of spike timing dependent plasticity (STDP) rules. We provide experimental proof-of-concept results with two silicon neurons connected through a memristive synapse that show how the CMOS plasticity circuits can induce stable changes in memristor conductances, giving rise to increased synaptic strength after a potentiation episode and to decreased strength after a depression episode. PMID:26483629
Implementation of a spike-based perceptron learning rule using TiO2?x memristors
Mostafa, Hesham; Khiat, Ali; Serb, Alexander; Mayr, Christian G.; Indiveri, Giacomo; Prodromakis, Themis
2015-01-01
Synaptic plasticity plays a crucial role in allowing neural networks to learn and adapt to various input environments. Neuromorphic systems need to implement plastic synapses to obtain basic cognitive capabilities such as learning. One promising and scalable approach for implementing neuromorphic synapses is to use nano-scale memristors as synaptic elements. In this paper we propose a hybrid CMOS-memristor system comprising CMOS neurons interconnected through TiO2?x memristors, and spike-based learning circuits that modulate the conductance of the memristive synapse elements according to a spike-based Perceptron plasticity rule. We highlight a number of advantages for using this spike-based plasticity rule as compared to other forms of spike timing dependent plasticity (STDP) rules. We provide experimental proof-of-concept results with two silicon neurons connected through a memristive synapse that show how the CMOS plasticity circuits can induce stable changes in memristor conductances, giving rise to increased synaptic strength after a potentiation episode and to decreased strength after a depression episode. PMID:26483629
Handwritten Arabic Numeral Recognition using a Multi Layer Perceptron
Das, Nibaran; Saha, Sudip; Haque, Syed Sahidul
2010-01-01
Handwritten numeral recognition is in general a benchmark problem of Pattern Recognition and Artificial Intelligence. Compared to the problem of printed numeral recognition, the problem of handwritten numeral recognition is compounded due to variations in shapes and sizes of handwritten characters. Considering all these, the problem of handwritten numeral recognition is addressed under the present work in respect to handwritten Arabic numerals. Arabic is spoken throughout the Arab World and the fifth most popular language in the world slightly before Portuguese and Bengali. For the present work, we have developed a feature set of 88 features is designed to represent samples of handwritten Arabic numerals for this work. It includes 72 shadow and 16 octant features. A Multi Layer Perceptron (MLP) based classifier is used here for recognition handwritten Arabic digits represented with the said feature set. On experimentation with a database of 3000 samples, the technique yields an average recognition rate of 94....
Bearing Fault Detection Using Artificial Neural Networks and Genetic Algorithm
B. Samanta
2004-03-01
Full Text Available A study is presented to compare the performance of bearing fault detection using three types of artificial neural networks (ANNs, namely, multilayer perceptron (MLP, radial basis function (RBF network, and probabilistic neural network (PNN. The time domain vibration signals of a rotating machine with normal and defective bearings are processed for feature extraction. The extracted features from original and preprocessed signals are used as inputs to all three ANN classifiers: MLP, RBF, and PNN for two-class (normal or fault recognition. The characteristic parameters like number of nodes in the hidden layer of MLP and the width of RBF, in case of RBF and PNN along with the selection of input features, are optimized using genetic algorithms (GA. For each trial, the ANNs are trained with a subset of the experimental data for known machine conditions. The ANNs are tested using the remaining set of data. The procedure is illustrated using the experimental vibration data of a rotating machine with and without bearing faults. The results show the relative effectiveness of three classifiers in detection of the bearing condition.
Automatic localization of vertebrae based on convolutional neural networks
Shen, Wei; Yang, Feng; Mu, Wei; Yang, Caiyun; Yang, Xin; Tian, Jie
2015-03-01
Localization of the vertebrae is of importance in many medical applications. For example, the vertebrae can serve as the landmarks in image registration. They can also provide a reference coordinate system to facilitate the localization of other organs in the chest. In this paper, we propose a new vertebrae localization method using convolutional neural networks (CNN). The main advantage of the proposed method is the removal of hand-crafted features. We construct two training sets to train two CNNs that share the same architecture. One is used to distinguish the vertebrae from other tissues in the chest, and the other is aimed at detecting the centers of the vertebrae. The architecture contains two convolutional layers, both of which are followed by a max-pooling layer. Then the output feature vector from the maxpooling layer is fed into a multilayer perceptron (MLP) classifier which has one hidden layer. Experiments were performed on ten chest CT images. We used leave-one-out strategy to train and test the proposed method. Quantitative comparison between the predict centers and ground truth shows that our convolutional neural networks can achieve promising localization accuracy without hand-crafted features.
Analysis of JET charge exchange spectra using neural networks
Active charge exchange spectra representing the local interaction of injected neutral beams and fully stripped impurity ions are hard to analyse due to strong blending with passive emission from the plasma edge. As a result, the deduced plasma parameters (e.g. ion temperature, rotation velocity, impurity density) cannot always be determined unambiguously. Also, the speed of the analysis is limited by the time consuming nonlinear least-squares minimization procedure. In practice, semi-manual analysis is necessary and fast, automatic analysis, based on currently used techniques, does not seem feasible. In this paper the development of a robust and accurate analysis procedure based on multi-layer perceptron (MLP) neural networks is described. This procedure is fully automatic and fast, thus enabling a real-time analysis of charge exchange spectra. Accuracy has been increased in several ways as compared to earlier straightforward neural network implementations and is comparable to a standard least-squares based analysis. Robustness is achieved by using a combination of different confidence measures. A novel technique for the creation of training data, suitable for high-dimensional inverse problems has been developed and used extensively. A new method for fast calculation of error bars directly from the hidden neurons in a MLP network is also described, and used as part of the confidence calculations. For demonstration purposes, a real-time ion temperature profile diagnostic based on this work has been implemented. (author)
Statistical process control using optimized neural networks: a case study.
Addeh, Jalil; Ebrahimzadeh, Ata; Azarbad, Milad; Ranaee, Vahid
2014-09-01
The most common statistical process control (SPC) tools employed for monitoring process changes are control charts. A control chart demonstrates that the process has altered by generating an out-of-control signal. This study investigates the design of an accurate system for the control chart patterns (CCPs) recognition in two aspects. First, an efficient system is introduced that includes two main modules: feature extraction module and classifier module. In the feature extraction module, a proper set of shape features and statistical feature are proposed as the efficient characteristics of the patterns. In the classifier module, several neural networks, such as multilayer perceptron, probabilistic neural network and radial basis function are investigated. Based on an experimental study, the best classifier is chosen in order to recognize the CCPs. Second, a hybrid heuristic recognition system is introduced based on cuckoo optimization algorithm (COA) algorithm to improve the generalization performance of the classifier. The simulation results show that the proposed algorithm has high recognition accuracy. PMID:24210290
Tagging b quark events in ALEPH with neural networks
Comparison of different methods to tag b quark events are presented: multilayered perceptron (MLP), Learning Vector Quantization (LVQ), discriminant analysis, combination of any two of the above methods. The sample events come from the ALEPH Monte Carlo and data, from the 1990 ALEPH runs. (authors) 12 refs., 16 figs., 5 tabs
Lashkari, Negin; Poshtan, Javad; Azgomi, Hamid Fekri
2015-11-01
The three-phase shift between line current and phase voltage of induction motors can be used as an efficient fault indicator to detect and locate inter-turn stator short-circuit (ITSC) fault. However, unbalanced supply voltage is one of the contributing factors that inevitably affect stator currents and therefore the three-phase shift. Thus, it is necessary to propose a method that is able to identify whether the unbalance of three currents is caused by ITSC or supply voltage fault. This paper presents a feedforward multilayer-perceptron Neural Network (NN) trained by back propagation, based on monitoring negative sequence voltage and the three-phase shift. The data which are required for training and test NN are generated using simulated model of stator. The experimental results are presented to verify the superior accuracy of the proposed method. PMID:26412499
Bednyakov Dmitriy Andreevich
2012-11-01
Full Text Available The article is devoted to the simulation of the influence of environmental osmotic pressure on the changes of the level of ?-amylase activity of mucous tunic of the intestine of Russian sturgeon (Acipenser gldenstdtii Brandt. For the solving of this problem the apparatus of neural networks is used. The designed model can be classified as multilayer perceptrone and has rather transparent structure. The conformities of this influence are examined and the model with high approximating and generalizing properties is created. The conclusion about high availability of application of the approach in the studies of adaptations of the digestive system of aquatic organisms to the influence of environmental factors with some qualifications about used rate of exactness of the simulation is made.
Witte, H; Doering, A; Galicki, M; Drschel, J; Krajca, V; Eiselt, M
1995-01-01
The main goal of this study is to demonstrate the possibility of training the Neural Network (multilayer perceptron) classifier and preprocessing units simultaneously, i.e., that properties of preprocessing are chosen automatically during the training phase. In the first realization step, adaptive recursive estimation of the power within a frequency band was used as a preprocessing unit. To improve the efficiency of special units, the power and momentary frequency estimation was replaced by methods that are based on adaptive Hilbert transformers. The strategy was developed to obtain optimized recognition units that can be efficiently integrated into strategies for monitoring the cerebral status of neonates. Therefore, applications (e.g., in neonatal EEG pattern recognition) will be shown. Additionally, a method of minimizing the error function was used, where this minimization is based on optimizing the network structure. The results of structure optimization in the field of EEG pattern recognition in epileptic patients can be demonstrated. PMID:8591340
Machine and component residual life estimation through the application of neural networks
This paper concerns the use of neural networks for predicting the residual life of machines and components. In addition, the advantage of using condition-monitoring data to enhance the predictive capability of these neural networks was also investigated. A number of neural network variations were trained and tested with the data of two different reliability-related datasets. The first dataset represents the renewal case where the failed unit is repaired and restored to a good-as-new condition. Data were collected in the laboratory by subjecting a series of similar test pieces to fatigue loading with a hydraulic actuator. The average prediction error of the various neural networks being compared varied from 431 to 841 s on this dataset, where test pieces had a characteristic life of 8971 s. The second dataset were collected from a group of pumps used to circulate a water and magnetite solution within a plant. The data therefore originated from a repaired system affected by reliability degradation. When optimized, the multi-layer perceptron neural networks trained with the Levenberg-Marquardt algorithm and the general regression neural network produced a sum-of-squares error within 11.1% of each other for the renewal dataset. The small number of inputs and poorly mapped input space on the second dataset meant that much larger errors were recorded on some of the test data. The potential for using neural networks for residual life prediction and the advantage of incorporating condition-based data into the model was nevertheless proven for both examples
Satish Kumar
2012-09-01
Full Text Available In this study, a method of artificial neural network applied for the solution of inverse kinematics of 2-link serial chain manipulator. The method is multilayer perceptrons neural network has applied. This unsupervised method learns the functional relationship between input (Cartesian space and output (joint space based on a localized adaptation of the mapping, by using the manipulator itself under joint control and adapting the solution based on a comparison between the resulting locations of the manipulator's end effectors in Cartesian space with the desired location. Even when a manipulator is not available; the approach is still valid if the forward kinematic equations are used as a model of the manipulator. The forward kinematic equations always have a unique solution, and the resulting Neural net can be used as a starting point for further refinement when the manipulator does become available. Artificial neural network especially MLP are used to learn the forward and the inverse kinematic equations of two degrees freedom robot arm. A set of some data sets were first generated as per the formula equation for this the input parameter X and Y coordinates in inches. Using these data sets was basis for the training and evaluation or testing the MLP model. Out of the sets data points, maximum were used as training data and some were used for testing for MLP. Backpropagation algorithm was used for training the network and for updating the desired weights. In this work epoch based training method was applied.
Hiva Khezri
2014-05-01
Full Text Available A deposition phenomenon is considered as one of the hydrometer processes which have ability to influence the most of the hydraulic structures and facility constructions. The exact assessment of the deposition of the rivers plays an important role not only in the management of the water sources, but also it is deemed that this factor also may have an influence on the designing, fabricating and planning phase of the utilization of Hydraulic Structures. In this survey, Neural Networks along with appropriate structure and self-training system is used as one of the methods of the estimating the amount of the sediments related to the Mahabad barrier, also the results of this survey are compared with the result of the hydrometer method. To this end, the discharge statistics of the water and sediments in two Cawter hydrometer station and Baitas village within the basin of Mahabad Dam catchment is investigated separately and at the end the estimation of the sediment load is compared and surveyed respectively by using neural networks in the Nero solution software via the multi-layer model of the Perceptron and the prevalent hydrometer approach. The results point out that the multi-layer networks in prognosticating a measure of the sediments is superior to hydrometer method.
Artificial neural network as the tool in prediction rheological features of raw minced meat
Edyta Balejko
2012-09-01
Full Text Available Background. The aim of the study was to elaborate a method of modelling and forecasting rheological features which could be applied to raw minced meat at the stage of mixture preparation with a given ingredient composition. Material and methods. The investigated material contained pork and beef meat, pork fat, fat substitutes, ice and curing mixture in various proportions. Seven texture parameters were measured for each sample of raw minced meat. The data obtained were processed using the artificial neural network module in Statistica 9.0 software. Results. The model that reached the lowest training error was a multi-layer perceptron MLP with three neural layers and architecture 7:7-11-7:7. Correlation coefficients between the experimental and calculated values in training, verification and testing subsets were similar and rather high (around 0.65 which indicated good network performance. Conclusion. High percentage of the total variance explained in PCA analysis (73.5% indicated that the percentage composition of raw minced meat can be successfully used in the prediction of its rheological features. Statistical analysis of the results revealed, that artificial neural network model is able to predict rheological parameters and thus a complete texture profile of raw minced meat.
A research about breast cancer detection using different neural networks and K-MICA algorithm
A A Kalteh
2013-01-01
Full Text Available Breast cancer is the second leading cause of death for women all over the world. The correct diagnosis of breast cancer is one of the major problems in the medical field. From the literature it has been found that different pattern recognition techniques can help them to improve in this domain. This paper presents a novel hybrid intelligent method for detection of breast cancer. The proposed method includes two main modules: Clustering module and the classifier module. In the clustering module, first the input data will be clustered by a new technique. This technique is a suitable combination of the modified imperialist competitive algorithm (MICA and K-means algorithm. Then the Euclidean distance of each pattern is computed from the determined clusters. The classifier module determines the membership of the patterns using the computed distance. In this module, several neural networks, such as the multilayer perceptron, probabilistic neural networks and the radial basis function neural networks are investigated. Using the experimental study, we choose the best classifier in order to recognize the breast cancer. The proposed system is tested on Wisconsin Breast Cancer (WBC database and the simulation results show that the recommended system has high accuracy.
Identification and control of plasma vertical position using neural network in Damavand tokamak
Rasouli, H. [School of Plasma Physics and Nuclear Fusion, Institute of Nuclear Science and Technology, AEOI, P.O. Box 14155-1339, Tehran (Iran, Islamic Republic of); Advanced Process Automation and Control (APAC) Research Group, Faculty of Electrical Engineering, K.N. Toosi University of Technology, P.O. Box 16315-1355, Tehran (Iran, Islamic Republic of); Rasouli, C.; Koohi, A. [School of Plasma Physics and Nuclear Fusion, Institute of Nuclear Science and Technology, AEOI, P.O. Box 14155-1339, Tehran (Iran, Islamic Republic of)
2013-02-15
In this work, a nonlinear model is introduced to determine the vertical position of the plasma column in Damavand tokamak. Using this model as a simulator, a nonlinear neural network controller has been designed. In the first stage, the electronic drive and sensory circuits of Damavand tokamak are modified. These circuits can control the vertical position of the plasma column inside the vacuum vessel. Since the vertical position of plasma is an unstable parameter, a direct closed loop system identification algorithm is performed. In the second stage, a nonlinear model is identified for plasma vertical position, based on the multilayer perceptron (MLP) neural network (NN) structure. Estimation of simulator parameters has been performed by back-propagation error algorithm using Levenberg-Marquardt gradient descent optimization technique. The model is verified through simulation of the whole closed loop system using both simulator and actual plant in similar conditions. As the final stage, a MLP neural network controller is designed for simulator model. In the last step, online training is performed to tune the controller parameters. Simulation results justify using of the NN controller for the actual plant.
Modeling soil temperatures at different depths by using three different neural computing techniques
Kisi, Ozgur; Tombul, Mustafa; Kermani, Mohammad Zounemat
2015-07-01
This study compares the accuracy of three different neural computing techniques, multi-layer perceptron (MLP), radial basis neural networks (RBNN), and generalized regression neural networks (GRNN), in modeling soil temperatures (ST) at different depths. Climatic data of air temperature, wind speed, solar radiation, and relative humidity from Mersin Station, Turkey, were used as inputs to the models to estimate monthly ST values. In the first part of the study, the effect of each climatic variable on ST was investigated by using GRNN models. Air temperature was found to be the most effective variable in modeling monthly ST. In the second part of the study, the accuracy of GRNN models was compared with MLP, RBNN, and multiple linear regression (MLR) models. RBNN models were found to be better than the GRNN, MLP, and MLR models in estimating monthly ST at the depths of 5 and 10 cm while the MLR and GRNN models gave the best accuracy in the case of 50- and 100-cm depths, respectively. In the third part of the study, the effect of periodicity on the training, validation, and test accuracy of the applied models was investigated. The results indicated that the adding periodicity component significantly increase models' accuracies in estimating monthly ST at different depths. Root mean square errors of the GRNN, MLP, RBNN, and MLR models were decreased by 19, 15, 19, and 15 % using periodicity in estimating monthly ST at 5-cm depth.
A new approach to self-organizing fuzzy polynomial neural networks guided by genetic optimization
In this study, we introduce a new topology of Fuzzy Polynomial Neural Networks (FPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology. The underlying methodology involves mechanisms of genetic optimization, especially genetic algorithms (GAs). Let us recall that the design of the 'conventional' FPNNs uses an extended Group Method of Data Handling (GMDH) and exploits a fixed fuzzy inference type located at each FPN of the FPNN as well as considers a fixed number of input nodes at FPNs (or nodes) located in each layer. The proposed FPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional FPNNs. The structural optimization is realized via GAs whereas in the case of the parametric optimization we proceed with a standard least square method based learning. Through the consecutive process of such structural and parametric optimization, an optimized and flexible fuzzy neural network is generated in a dynamic fashion. The performance of the proposed gFPNN is quantified through experimentation that exploits standard data already being used in fuzzy modeling. The results reveal superiority of the proposed networks over the existing fuzzy and neural models
Synapse:neural network for predict power consumption: users guide
Muller, C.; Mangeas, M.; Perrot, N.
1994-08-01
SYNAPSE is forecasting tool designed to predict power consumption in metropolitan France on the half hour time scale. Some characteristics distinguish this forecasting model from those which already exist. In particular, it is composed of numerous neural networks. The idea for using many neural networks arises from past tests. These tests showed us that a single neural network is not able to solve the problem correctly. From this result, we decided to perform unsupervised classification of the 24 consumption curves. From this classification, six classes appeared, linked with the weekdays: Mondays, Tuesdays, Wednesdays, Thursdays, Fridays, Saturdays, Sundays, holidays and bridge days. For each class and for each half hour, two multilayer perceptrons are built. The two of them forecast the power for one particular half hour, and for a day including one of the determined class. The input of these two network are different: the first one (short time forecasting) includes the powers for the most recent half hour and relative power of the previous day; the second (medium time forecasting) includes only the relative power of the previous day. A process connects the results of every networks and allows one to forecast more than one half-hour in advance. In this process, short time forecasting networks and medium time forecasting networks are used differently. The first kind of neural networks gives good results on the scale of one day. The second one gives good forecasts for the next predicted powers. In this note, the organization of the SYNAPSE program is detailed, and the user`s menu is described. This first version of synapse works and should allow the APC group to evaluate its utility. (authors). 6 refs., 2 appends.
Data acquisition in modeling using neural networks and decision trees
R. Sika
2011-04-01
Full Text Available The paper presents a comparison of selected models from area of artificial neural networks and decision trees in relation with actualconditions of foundry processes. The work contains short descriptions of used algorithms, their destination and method of data preparation,which is a domain of work of Data Mining systems. First part concerns data acquisition realized in selected iron foundry, indicating problems to solve in aspect of casting process modeling. Second part is a comparison of selected algorithms: a decision tree and artificial neural network, that is CART (Classification And Regression Trees and BP (Backpropagation in MLP (Multilayer Perceptron networks algorithms.Aim of the paper is to show an aspect of selecting data for modeling, cleaning it and reducing, for example due to too strong correlationbetween some of recorded process parameters. Also, it has been shown what results can be obtained using two different approaches:first when modeling using available commercial software, for example Statistica, second when modeling step by step using Excel spreadsheetbasing on the same algorithm, like BP-MLP. Discrepancy of results obtained from these two approaches originates from a priorimade assumptions. Mentioned earlier Statistica universal software package, when used without awareness of relations of technologicalparameters, i.e. without user having experience in foundry and without scheduling ranks of particular parameters basing on acquisition, can not give credible basis to predict the quality of the castings. Also, a decisive influence of data acquisition method has been clearly indicated, the acquisition should be conducted according to repetitive measurement and control procedures. This paper is based on about 250 records of actual data, for one assortment for 6 month period, where only 12 data sets were complete (including two that were used for validation of neural network and useful for creating a model. It is definitely too small portion in case of artificial neural networks, but it shows a scale of danger of unprofessional data acquisition.
Neural network based method for conversion of solar radiation data
Highlights: ► Generalized regression neural network is used to predict the solar radiation on tilted surfaces. ► The above network, amongst many such as multilayer perceptron, is the most successful one. ► The present neural network returns a relative mean absolute error value of 9.1%. ► The present model leads to a mean absolute error value of estimate of 14.9 Wh/m2. - Abstract: The receiving ends of the solar energy conversion systems that generate heat or electricity from radiation is usually tilted at an optimum angle to increase the solar incident on the surface. Solar irradiation data measured on horizontal surfaces is readily available for many locations where such solar energy conversion systems are installed. Various equations have been developed to convert solar irradiation data measured on horizontal surface to that on tilted one. These equations constitute the conventional approach. In this article, an alternative approach, generalized regression type of neural network, is used to predict the solar irradiation on tilted surfaces, using the minimum number of variables involved in the physical process, namely the global solar irradiation on horizontal surface, declination and hour angles. Artificial neural networks have been successfully used in recent years for optimization, prediction and modeling in energy systems as alternative to conventional modeling approaches. To show the merit of the presently developed neural network, the solar irradiation data predicted from the novel model was compared to that from the conventional approach (isotropic and anisotropic models), with strict reference to the irradiation data measured in the same location. The present neural network model was found to provide closer solar irradiation values to the measured than the conventional approach, with a mean absolute error value of 14.9 Wh/m2. The other statistical values of coefficient of determination and relative mean absolute error also indicate the advantage of the neural network approach over the conventional one. In terms of the coefficient of determination, the neural network model results in a value of 0.987 whereas the isotropic and anisotropic approaches result in values of 0.959 and 0.966, respectively. On the other hand, the isotropic and anisotropic approaches give relative mean absolute error values of 11.4% and 11.5%, respectively, while that of the neural network model is 9.1%
Comparison of four Adaboost algorithm based artificial neural networks in wind speed predictions
Highlights: • Four hybrid algorithms are proposed for the wind speed decomposition. • Adaboost algorithm is adopted to provide a hybrid training framework. • MLP neural networks are built to do the forecasting computation. • Four important network training algorithms are included in the MLP networks. • All the proposed hybrid algorithms are suitable for the wind speed predictions. - Abstract: The technology of wind speed prediction is important to guarantee the safety of wind power utilization. In this paper, four different hybrid methods are proposed for the high-precision multi-step wind speed predictions based on the Adaboost (Adaptive Boosting) algorithm and the MLP (Multilayer Perceptron) neural networks. In the hybrid Adaboost–MLP forecasting architecture, four important algorithms are adopted for the training and modeling of the MLP neural networks, including GD-ALR-BP algorithm, GDM-ALR-BP algorithm, CG-BP-FR algorithm and BFGS algorithm. The aim of the study is to investigate the promoted forecasting percentages of the MLP neural networks by the Adaboost algorithm’ optimization under various training algorithms. The hybrid models in the performance comparison include Adaboost–GD-ALR-BP–MLP, Adaboost–GDM-ALR-BP–MLP, Adaboost–CG-BP-FR–MLP, Adaboost–BFGS–MLP, GD-ALR-BP–MLP, GDM-ALR-BP–MLP, CG-BP-FR–MLP and BFGS–MLP. Two experimental results show that: (1) the proposed hybrid Adaboost–MLP forecasting architecture is effective for the wind speed predictions; (2) the Adaboost algorithm has promoted the forecasting performance of the MLP neural networks considerably; (3) among the proposed Adaboost–MLP forecasting models, the Adaboost–CG-BP-FR–MLP model has the best performance; and (4) the improved percentages of the MLP neural networks by the Adaboost algorithm decrease step by step with the following sequence of training algorithms as: GD-ALR-BP, GDM-ALR-BP, CG-BP-FR and BFGS
Convergence Analysis of Adaptive Recurrent Neural Network
Hong Li; Ali Setoodehnia
2014-01-01
This paper presents analysis of a modified Feed Forward Multilayer Perceptron (FMP) by inserting an ARMA (Auto Regressive Moving Average) model at each neuron (processor node) with the Backp ropagation learning algorithm. The stability analysis is presented to establish the convergence theory of the Back propagation algorithm based on the Lyapunov function. Furthermore, the analysis extends the Back propagation learning rule by introducing the adaptive learning factors. A rang...
hojat moayedi rad
2012-02-01
Full Text Available Due to simplicity and low cost, induction motors are more useful than direct current motors. Hence the control of these motors is important. The pervious methods are fitted normally for a limited speed range and could not be used for high, low and very low speeds. The voltage model is suitable for high speed because the voltage drop of stator resistance is not small in low speed. The current model is suitable for low speed because of the problems of flux saturation at high speed. This research presents a new method of PWM pulse generating in induction motors based on artificial neural networks in which, the switching pulses are generated by a multilayer feed-forward neural network that is trained by the voltage and current references. Also, for the estimation of required torque and flux information a multilayer perceptron is used. By application of this new method, there is no problem of stability at low and high speeds. The simulation results by matlab-simulink verify the proposed method in transient and steady-state operating modes.
Souza Reinaldo C.; Villa Fernán Alonso; Velásquez Juan David
2010-01-01
Artificial neural networks, especially multilayer perceptrons, have been recognised as being a powerful technique for forecasting nonlinear time series; however, cascade-correlation architecture is a strong competitor in this task due to it incorporating several advantages related to the statistical identification of multilayer perceptrons. This paper compares the accuracy of a cascade-co- rrelation neural network to the linear approach, multilayer perceptrons and dynamic architecture for art...
Ozren Bukovac
2016-01-01
Full Text Available Compared to the other marine engines for ship propulsion, turbocharged two-stroke low speed diesel engines have advantages due to their high efficiency and reliability. Modern low speed ”intelligent” marine diesel engines have a flexibility in its operation due to the variable fuel injection strategy and management of the exhaust valve drive. This paper carried out verified zerodimensional numerical simulations which have been used for MLP (Multilayer Perceptron neural network predictions of marine two-stroke low speed diesel engine steady state performances. The developed MLP neural network was used for marine engine optimized operation control. The paper presents an example of achieving lowest specific fuel consumption and for minimization of the cylinder process highest temperature for reducing NOx emission. Also, the developed neural network was used to achieve optimal exhaust gases heat flow for utilization. The obtained data maps give insight into the optimal working areas of simulated marine diesel engine, depending on the selected start of the fuel injection (SOI and the time of the exhaust valve opening (EVO.
A neural network structure has been used for unfolding neutron spectra measured by means of a Bonner Sphere Spectrometer set and a foil activation set using several neutron induced reactions. The present work used the SNNS (Stuttgart Neural Network Simulator) as the interface for designing, training and validation of the Multilayer Perceptron network. The back-propagation algorithm was applied. The Bonner Sphere set chosen has been calibrated at the National Physical Laboratory, United Kingdom, and uses gold activation foils as thermal neutron detectors. The neutron energy covered by the response functions goes from 0.0001 eV to 14 MeV. The foil activation set chosen has been irradiated at the IEA-R1 research reactor and measured at the Nuclear Metrology Laboratory of IPEN-CNEN/SP. Two types of neutron spectra were numerically investigated: monoenergetic and continuous The unfolded spectra were compared to a conventional method using code SAND-II as part of the neutron dosimetry system SAIPS. Good results were obtained, indicating that the Neural Network can be considered an interesting alternative among the neutron spectrum unfolding methodologies. (author)
In computational physics proton transfer phenomena could be viewed as pattern classification problems based on a set of input features allowing classification of the proton motion into two categories: transfer ‘occurred’ and transfer ‘not occurred’. The goal of this paper is to evaluate the use of artificial neural networks in the classification of proton transfer events, based on the feed-forward back propagation neural network, used as a classifier to distinguish between the two transfer cases. In this paper, we use a new developed data mining and pattern recognition tool for automating, controlling, and drawing charts of the output data of an Empirical Valence Bond existing code. The study analyzes the need for pattern recognition in aqueous proton transfer processes and how the learning approach in error back propagation (multilayer perceptron algorithms) could be satisfactorily employed in the present case. We present a tool for pattern recognition and validate the code including a real physical case study. The results of applying the artificial neural networks methodology to crowd patterns based upon selected physical properties (e.g., temperature, density) show the abilities of the network to learn proton transfer patterns corresponding to properties of the aqueous environments, which is in turn proved to be fully compatible with previous proton transfer studies. (condensed matter: structural, mechanical, and thermal properties)
A MLP neural network as an investigator of TEC time series to detect seismo-ionospheric anomalies
Akhoondzadeh, M.
2013-06-01
Anomaly detection is extremely important for earthquake parameters estimation. In this paper, an application of Artificial Neural Networks (ANNs) in the earthquake precursor's domain has been developed. This study is concerned with investigating the Total Electron Content (TEC) time series by using a Multi-Layer Perceptron (MLP) neural network to detect seismo-ionospheric anomalous variations induced by the powerful Tohoku earthquake of March 11, 2011.The duration of TEC time series dataset is 120 days at time resolution of 2 h. The results show that the MLP presents anomalies better than referenced and conventional methods such as Auto-Regressive Integrated Moving Average (ARIMA) technique. In this study, also the detected TEC anomalies using the proposed method, are compared to the previous results (Akhoondzadeh, 2012) dealing with the observed TEC anomalies by applying the mean, median, wavelet and Kalman filter methods. The MLP detected anomalies are similar to those detected using the previous methods applied on the same case study. The results indicate that a MLP feed-forward neural network can be a suitable non-parametric method to detect changes of a non linear time series such as variations of earthquake precursors.
Kivelä, Mikko; Barthelemy, Marc; Gleeson, James P; Moreno, Yamir; Porter, Mason A
2013-01-01
Most real and engineered systems include multiple subsystems and layers of connectivity, and it is important to take such features into account to try to obtain a complete understanding of these systems. It is thus necessary to generalize "traditional" network theory by developing (and validating) a framework and associated tools to study multilayer systems in a comprehensive fashion. The origins of such efforts occurred several decades ago, but now the study of multilayer networks has become one of the major directions in network science. In this paper, we discuss the history of multilayer networks (and related concepts) and then review the exploding body of work on such networks. To unify the disparate terminology in the large body of recent work, we discuss a general framework for multilayer networks, construct a dictionary of terminology to relate the numerous existing concepts to each other, and provide a thorough discussion that compares, contrasts, and translates between related notions such as multila...
AN EFFICIENT NEURAL NETWORK FOR RECOGNIZING GESTURAL HINDI DIGITS
Nidal Fawzi Shilbayeh
2013-01-01
Full Text Available Handwritten Hindi digit recognition plays an important role in eastern Arab countries especially in the courtesy amounts of Arab bank checks, recognizing numbers in car plates, or in postal code for mail sorting. In our study, we proposed an efficient Hindi Digit Recognition System drawn by the mouse and developed using Multilayer Perceptron Neural Network (MLP with backpropagation. The system has been designed, implemented and tested successfully. Analysis has been carried out to determine the number of hidden nodes that achieves high performance. The proposed system has been trained on samples of 800 images and tested on samples of 300 images written by different users selected from different ages. An experimental result shows high accuracy of about 91% on the testing samples and very close to 100% on the training samples. Experiments showed that our result is high in comparison with other Hindi digit recognition systems especially if we consider the way of writing (mouse and children in our trained and tested results.
Hidden Conditional Neural Fields for Continuous Phoneme Speech Recognition
Fujii, Yasuhisa; Yamamoto, Kazumasa; Nakagawa, Seiichi
In this paper, we propose Hidden Conditional Neural Fields (HCNF) for continuous phoneme speech recognition, which are a combination of Hidden Conditional Random Fields (HCRF) and a Multi-Layer Perceptron (MLP), and inherit their merits, namely, the discriminative property for sequences from HCRF and the ability to extract non-linear features from an MLP. HCNF can incorporate many types of features from which non-linear features can be extracted, and is trained by sequential criteria. We first present the formulation of HCNF and then examine three methods to further improve automatic speech recognition using HCNF, which is an objective function that explicitly considers training errors, provides a hierarchical tandem-style feature and includes a deep non-linear feature extractor for the observation function. We show that HCNF can be trained realistically without any initial model and outperforms HCRF and the triphone hidden Markov model trained by the minimum phone error (MPE) manner using experimental results for continuous English phoneme recognition on the TIMIT core test set and Japanese phoneme recognition on the IPA 100 test set.
Stability analysis of discrete-time recurrent neural networks.
Barabanov, N E; Prokhorov, D V
2002-01-01
We address the problem of global Lyapunov stability of discrete-time recurrent neural networks (RNNs) in the unforced (unperturbed) setting. It is assumed that network weights are fixed to some values, for example, those attained after training. Based on classical results of the theory of absolute stability, we propose a new approach for the stability analysis of RNNs with sector-type monotone nonlinearities and nonzero biases. We devise a simple state-space transformation to convert the original RNN equations to a form suitable for our stability analysis. We then present appropriate linear matrix inequalities (LMIs) to be solved to determine whether the system under study is globally exponentially stable. Unlike previous treatments, our approach readily permits one to account for non-zero biases usually present in RNNs for improved approximation capabilities. We show how recent results of others on the stability analysis of RNNs can be interpreted as special cases within our approach. We illustrate how to use our approach with examples. Though illustrated on the stability analysis of recurrent multilayer perceptrons, the approach proposed can also be applied to other forms of time-lagged RNNs. PMID:18244432
VoIP attacks detection engine based on neural network
Safarik, Jakub; Slachta, Jiri
2015-05-01
The security is crucial for any system nowadays, especially communications. One of the most successful protocols in the field of communication over IP networks is Session Initiation Protocol. It is an open-source project used by different kinds of applications, both open-source and proprietary. High penetration and text-based principle made SIP number one target in IP telephony infrastructure, so security of SIP server is essential. To keep up with hackers and to detect potential malicious attacks, security administrator needs to monitor and evaluate SIP traffic in the network. But monitoring and following evaluation could easily overwhelm the security administrator in networks, typically in networks with a number of SIP servers, users and logically or geographically separated networks. The proposed solution lies in automatic attack detection systems. The article covers detection of VoIP attacks through a distributed network of nodes. Then the gathered data analyze aggregation server with artificial neural network. Artificial neural network means multilayer perceptron network trained with a set of collected attacks. Attack data could also be preprocessed and verified with a self-organizing map. The source data is detected by distributed network of detection nodes. Each node contains a honeypot application and traffic monitoring mechanism. Aggregation of data from each node creates an input for neural networks. The automatic classification on a centralized server with low false positive detection reduce the cost of attack detection resources. The detection system uses modular design for easy deployment in final infrastructure. The centralized server collects and process detected traffic. It also maintains all detection nodes.
Rainfall-runoff modelling using artificial neural networks: comparison of network types
Senthil Kumar, A. R.; Sudheer, K. P.; Jain, S. K.; Agarwal, P. K.
2005-04-01
Growing interest in the use of artificial neural networks (ANNs) in rainfall-runoff modelling has suggested certain issues that are still not addressed properly. One such concern is the use of network type, as theoretical studies on a multi-layer perceptron (MLP) with a sigmoid transfer function enlightens certain limitations for its use. Alternatively, there is a strong belief in the general ANN user community that a radial basis function (RBF) network performs better than an MLP, as the former bases its nonlinearities on the training data set. This argument is not yet substantiated by applications in hydrology. This paper presents a comprehensive evaluation of the performance of MLP- and RBF-type neural network models developed for rainfall-runoff modelling of two Indian river basins. The performance of both the MLP and RBF network models were comprehensively evaluated in terms of their generalization properties, predicted hydrograph characteristics, and predictive uncertainty. The results of the study indicate that the choice of the network type certainly has an impact on the model prediction accuracy. The study suggests that both the networks have merits and limitations. For instance, the MLP requires a long trial-and-error procedure to fix the optimal number of hidden nodes, whereas for an RBF the structure of the network can be fixed using an appropriate training algorithm. However, a judgment on which is superior is not clearly possible from this study.
Numerical simulation of natural circulation boiling water reactor is important in order to study its performance for different designs and under various off-design conditions. Numerical simulations can be performed by using thermal-hydraulic codes. Very fast numerical simulations, useful for extensive parametric studies and for solving design optimization problems, can be achieved by using an artificial neural network (ANN) model of the system. In the present work, numerical simulations of natural circulation boiling water reactor have been performed with RELAP5 code for different values of design parameters and operational conditions. Parametric trends observed have been discussed. The data obtained from these simulations have been used to train artificial neural networks, which in turn have been used for further parametric studies and design optimization. The ANN models showed error within ±5% for all the simulated data. Two most popular methods, multilayer perceptron (MLP) and radial basis function (RBF) networks, have been used for the training of ANN model. Sequential quadratic programming (SQP) has been used for optimization
Marmo, Roberto; Amodio, Sabrina; Tagliaferri, Roberto; Ferreri, Vittoria; Longo, Giuseppe
2005-06-01
Using more than 1000 thin section photos of ancient (Phanerozoic) carbonates from different marine environments (pelagic to shallow-water) a new numerical methodology, based on digitized images of thin sections, is proposed here. In accordance with the Dunham classification, it allows the user to automatically identify carbonate textures unaffected by post-depositional modifications (recrystallization, dolomitization, meteoric dissolution and so on). The methodology uses, as input, 256 grey-tone digital image and by image processing gives, as output, a set of 23 values of numerical features measured on the whole image including the "white areas" (calcite cement). A multi-layer perceptron neural network takes as input this features and gives, as output, the estimated class. We used 532 images of thin sections to train the neural network, whereas to test the methodology we used 268 images taken from the same photo collection and 215 images from San Lorenzello carbonate sequence (Matese Mountains, southern Italy), Early Cretaceous in age. This technique has shown 93.3% and 93.5% of accuracy to classify automatically textures of carbonate rocks using digitized images on the 268 and 215 test sets, respectively. Therefore, the proposed methodology is a further promising application to the geosciences allowing carbonate textures of many thin sections to be identified in a rapid and accurate way. A MATLAB-based computer code has been developed for the processing and display of images.
The analysis of seasonal air pollution pattern with application of neural networks
Wesolowski, Marek; Suchacz, Bogdan [Medical University of Gdansk, Department of Analytical Chemistry, Gdansk (Poland); Halkiewicz, Jan [Medical University of Gdansk, Department of Physical Chemistry, Gdansk (Poland)
2006-01-01
Air pollution monitoring includes measuring the concentrations of air contaminants such as nitrogen dioxide, sulfur dioxide, some polycyclic aromatic hydrocarbons(PAHs), suspended particulate matter (PM) and tar substances. The purpose of this study was to determine the possibility of using artificial neural networks for identification of any patterns occurring during heating and nonheating seasons. The samples included in the study were collected over a period of 5 years (1997-2001) in the area of the city of Gdansk and the levels of pollutants measured in the samples collected were used as inputs to two different types of neural networks: multilayer perceptron (MLP) and self-organizing map (SOM). The MLP was used as a tool to predict in what heating season a certain sample was collected, and the SOM was applied for mapping all samples to recognize any similarities between them. This study also presents the comparison between two projection methods - linear (principal component analysis, PCA) and nonlinear (SOM) - in extracting valuable information from multidimensional environmental data. In the research the MLP model with 13-12-1 topology was developed and successfully trained for classification of air samples from different seasons. The sensitivity analysis on the inputs to the MLP indicated benz[{alpha}]anthracene, benzo[{alpha}]pyrene, PM{sub 1}, SO{sub 2}, tar substances and PM{sub 10} as the most distinctive variables, while PCA pointed to PAHs and PM{sub 1}. (orig.)
Evaluation of oil thickness by neural network analysis of IR imagery
The feasibility of using neural network analysis of conventional thermal infra-red data gathered from surveillance aircraft to determine the thickness of oil at sea, was examined. Sea trial data was examined using Multi-Layer Perceptron neural network architecture, based on indications that it was the most appropriate configuration for determining oil thickness. Core input variables included oil brightness, time of day, sea brightness, wind speed, oil type, and sea temperature. Other variables, such as altitude, wave height, air temperature, camera gain, and others, did not appear to produce any significant difference in the prediction performance. By using only a restricted sea trial data set in training the network, it was found that it was possible to correctly classify about 80 per cent of the data into one of four thickness classes. Since there was no additional data available to validate the network, these results were considered encouraging, but not definitive. Additional data will be collected in planned future sea trials to further evaluate the accuracy of the trained network. 4 refs., 6 tabs., 4 figs
A nuclear power plant's (NPP's) status is usually monitored by a human operator. Any classifier system used to enhance the operator's capability to diagnose a safety-critical system like an NPP should classify a novel transient as ''don't-know'' if it is not contained within its accumulated knowledge base. In particular, the classifier needs some kind of proximity measure between the new data and its training set. Artificial neural networks have been proposed as NPP classifiers, the most popular ones being the multilayered perceptron (MLP) type. However, MLPs do not have a proximity measure, while learning vector quantization, probabilistic neural networks (PNNs), and some others do. This proximity measure may also serve as an explanation to the classifier's decision in the way that case-based-reasoning expert systems do. The capability of a PNN network as a classifier is demonstrated using simulator data for the three-loop 436-MW(electric) Westinghouse San Onofre unit 1 pressurized water reactor. A transient's classification history is used in an ''evidence accumulation'' technique to enhance a classifier's accuracy as well as its consistency
Foulkes, Stephen B.; Booth, David M.
1997-07-01
Object segmentation is the process by which a mask is generated which identifies the area of an image which is occupied by an object. Many object recognition techniques depend on the quality of such masks for shape and underlying brightness information, however, segmentation remains notoriously unreliable. This paper considers how the image restoration technique of Geman and Geman can be applied to the improvement of object segmentations generated by a locally adaptive background subtraction technique. Also presented is how an artificial neural network hybrid, consisting of a single layer Kohonen network with each of its nodes connected to a different multi-layer perceptron, can be used to approximate the image restoration process. It is shown that the restoration techniques are very well suited for parallel processing and in particular the artificial neural network hybrid has the potential for near real time image processing. Results are presented for the detection of ships in SPOT panchromatic imagery and the detection of vehicles in infrared linescan images, these being a fair representation of the wider class of problem.
Alcinei Mistico Azevedo
2015-12-01
Full Text Available The efficiency of artificial neural networks (ANN to model complex problems may enable the prediction of characteristics that are hard to measure, providing better results than the traditional indirect selection. Thus, this study aimed to investigate the potential of using artificial neural networks (ANN for indirect selection against early flowering in lettuce, identify the influence of genotype by environment interaction in this strategy and compare your results with the traditional indirect selection. The number of days to anthesis were used as the desired output and the information of six characteristics (fresh weight of shoots, mass of marketable fresh matter of shoots, commercial dry matter of shoots, average diameter of the head, head circumference and leaf number as input file for the training of the ANN-MLP (Perceptron Multi-Layer. The use of ANN has great potential adjustment for indirect selection for genetic improvement of lettuce against early flowering. The selection based on the predicted values by network provided estimates of gain selection largest that traditional indirect selection. The ANN trained with data from an experiment have low power extrapolation to another experiment, due to effect of interaction genotype by environment. The ANNs trained simultaneously with data from different experiments presented greater predictive power and extrapolation.
On-line control of the COMPASS-D tokamak using a neural network
Multi-layer perceptron (MLP) networks are particularly appropriate for performing rapid non-linear mapping. In the application discussed in this Paper the position and shape of the plasma within the experimental fusion research tokamak COMPASS-D at UKAEA's Culham Laboratory is determined from a series of magnetic sensors placed around the vacuum vessel, close to the plasma boundary. By using a real-time analogue neural network it is possible to achieve control within a sub-millisecond time-scale. In this application the neural network is needed to solve an inverse problem. Numerical codes exist that are able to calculate the signals expected on the magnetic sensors for a given plasma position and profile. The problem is well defined from the solution of the Grad-Shafranov equation. However, no easy analytical formalism exists to reverse the problem - to calculate the plasma parameters given the magnetic signals. It is this mapping, from the set of magnetic diagnostic input signals to the parameters of the plasma, that an MLP network can be trained to solve. The training data are some 2000 example plasma equilibria, covering the likely possible configurations of the plasma, solved by numerical methods. The desired aim, to control the plasma boundary position to within a few millimetres, has now been achieved. (author)
An artificial neural network model was developed for modeling of the effects of mechanical alloying parameters including milling time, milling speed and ball to powder weight ratio on the characteristics of Al-8 vol%SiC nanocomposite powders. The crystallite size and lattice strain of the aluminum matrix were considered for modeling. This nanostructured nanocomposite powder was synthesized by utilizing planetary high energy ball mill and the required data for training were collected from the experimental results. The characteristics of the particles were determined by X-ray diffraction, scanning and transmission electron microscopy. Two types of neural network architecture, i.e. multi-layer perceptron (MLP) and radial basis function (RBF), were used. The steepest descent along with variable learning rate back-propagation algorithm known as a heuristic technique was utilized for training the MLP network. It was found that MLP network yields better results compared to RBF network, giving an acceptable mapping between the network responses and the target data with a high correlation coefficients. The response surfaces between the response variables, i.e. crystallite size, lattice strain of the aluminum matrix and the processing parameters are presented. The procedure modeling can be used for optimization of the MA process for synthesizing of nanostructured metal matrix nanocomposites
Artificial neural networks for simulating wind effects on sprinkler distribution patterns
Sayyadi, H.; Sadraddini, A. A.; Farsadi Zadeh, D.; Montero, J.
2012-07-01
A new approach based on Artificial Neural Networks (ANNs) is presented to simulate the effects of wind on the distribution pattern of a single sprinkler under a center pivot or block irrigation system. Field experiments were performed under various wind conditions (speed and direction). An experimental data from different distribution patterns using a Nelson R3000 Rotator sprinkler have been split into three and used for model training, validation and testing. Parameters affecting the distribution pattern were defined. To find an optimal structure, various networks with different architectures have been trained using an Early Stopping method. The selected structure produced R2 0.929 and RMSE = 6.69 mL for the test subset, consisting of a Multi-Layer Perceptron (MLP) neural network with a backpropagation training algorithm; two hidden layers (twenty neurons in the first hidden layer and six neurons in the second hidden layer) and a tangent-sigmoid transfer function. This optimal network was implemented in MATLAB to develop a model termed ISSP (Intelligent Simulator of Sprinkler Pattern). ISSP uses wind speed and direction as input variables and is able to simulate the distorted distribution pattern from a R3000 Rotator sprinkler with reasonable accuracy (R{sup 2} > 0.935). Results of model evaluation confirm the accuracy and robustness of ANNs for simulation of a single sprinkler distribution pattern under real field conditions. (Author) 41 refs.
Neural and fuzzy computation techniques for playout delay adaptation in VoIP networks.
Ranganathan, Mohan Krishna; Kilmartin, Liam
2005-09-01
Playout delay adaptation algorithms are often used in real time voice communication over packet-switched networks to counteract the effects of network jitter at the receiver. Whilst the conventional algorithms developed for silence-suppressed speech transmission focused on preserving the relative temporal structure of speech frames/packets within a talkspurt (intertalkspurt adaptation), more recently developed algorithms strive to achieve better quality by allowing for playout delay adaptation within a talkspurt (intratalkspurt adaptation). The adaptation algorithms, both intertalkspurt and intratalkspurt based, rely on short term estimations of the characteristics of network delay that would be experienced by up-coming voice packets. The use of novel neural networks and fuzzy systems as estimators of network delay characteristics are presented in this paper. Their performance is analyzed in comparison with a number of traditional techniques for both inter and intratalkspurt adaptation paradigms. The design of a novel fuzzy trend analyzer system (FTAS) for network delay trend analysis and its usage in intratalkspurt playout delay adaptation are presented in greater detail. The performance of the proposed mechanism is analyzed based on measured Internet delays. Index Terms-Fuzzy delay trend analysis, intertalkspurt, intratalkspurt, multilayer perceptrons (MLPs), network delay estimation, playout buffering, playout delay adaptation, time delay neural networks (TDNNs), voice over Internet protocol (VoIP). PMID:16252825
Jokar, Ali; Godarzi, Ali Abbasi; Saber, Mohammad; Shafii, Mohammad Behshad
2016-01-01
In this paper, a novel approach has been presented to simulate and optimize the pulsating heat pipes (PHPs). The used pulsating heat pipe setup was designed and constructed for this study. Due to the lack of a general mathematical model for exact analysis of the PHPs, a method has been applied for simulation and optimization using the natural algorithms. In this way, the simulator consists of a kind of multilayer perceptron neural network, which is trained by experimental results obtained from our PHP setup. The results show that the complex behavior of PHPs can be successfully described by the non-linear structure of this simulator. The input variables of the neural network are input heat flux to evaporator (q″), filling ratio (FR) and inclined angle (IA) and its output is thermal resistance of PHP. Finally, based upon the simulation results and considering the heat pipe's operating constraints, the optimum operating point of the system is obtained by using genetic algorithm (GA). The experimental results show that the optimum FR (38.25 %), input heat flux to evaporator (39.93 W) and IA (55°) that obtained from GA are acceptable.
Aphasia Classification Using Neural Networks
Axer, H.; Jantzen, Jan; Berks, G.; Keyserlingk, Diedrich Graf von
2000-01-01
Aachen Aphasia Test (AAT). First a coarse classification was achieved by using an assessment of spontaneous speech of the patient. This classifier produced correct results in 87% of the test cases. For a second test, data analysis tools were used to select four features out of the 30 available test...... features to yield a more accurate diagnosis. This second classifier produced correct results in 92% of the test cases. This test requires four AAT scores as input for the multilayer perceptron. In practice, the second test requires hours of work on behalf of the clinician, whereas the first test can be...
Parinet, Julien; Julien, Maxime; Nun, Pierrick; Robins, Richard J; Remaud, Gerald; Höhener, Patrick
2015-09-01
We aim at predicting the effect of structure and isotopic substitutions on the equilibrium vapour pressure isotope effect of various organic compounds (alcohols, acids, alkanes, alkenes and aromatics) at intermediate temperatures. We attempt to explore quantitative structure property relationships by using artificial neural networks (ANN); the multi-layer perceptron (MLP) and compare the performances of it with multi-linear regression (MLR). These approaches are based on the relationship between the molecular structure (organic chain, polar functions, type of functions, type of isotope involved) of the organic compounds, and their equilibrium vapour pressure. A data set of 130 equilibrium vapour pressure isotope effects was used: 112 were used in the training set and the remaining 18 were used for the test/validation dataset. Two sets of descriptors were tested, a set with all the descriptors: number of(12)C, (13)C, (16)O, (18)O, (1)H, (2)H, OH functions, OD functions, CO functions, Connolly Solvent Accessible Surface Area (CSA) and temperature and a reduced set of descriptors. The dependent variable (the output) is the natural logarithm of the ratios of vapour pressures (ln R), expressed as light/heavy as in classical literature. Since the database is rather small, the leave-one-out procedure was used to validate both models. Considering higher determination coefficients and lower error values, it is concluded that the multi-layer perceptron provided better results compared to multi-linear regression. The stepwise regression procedure is a useful tool to reduce the number of descriptors. To our knowledge, a Quantitative Structure Property Relationship (QSPR) approach for isotopic studies is novel. PMID:25559176
Use of Neural Networks for Damage Assessment in a Steel Mast
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorithm for detecting location and size of a damage in a civil engineering structure is investigated. The structure considered is a 20 m high steel lattice mast subjected to wind...
Use of a Neural Network for Damage Detection and Location in a Steel Member
Kirkegaard, Poul Henning; Rytter, A.
The paper explores the potential of using a Multilayer Perceptron (MLP) network trained with the Backpropagation algorithm for damage assessment of free-free cracked straight steel beam based on vibration measurements. The problem of damage assessment, i.e. detecting, locating and quantifying a...
Variants of Memetic and Hybrid Learning of Perceptron Networks
Neruda, Roman; Slušný, Stanislav
Los Alamitos : IEEE, 2007 - (Tjoa, A.; Wagner, R.), s. 158-162 ISBN 978-0-7695-2932-5. [ETID '07. International Workshop on Evolution ary Techniques /1./, DEXA 2007 International Conference /18./. Regensburg (DE), 03.09.2007-07.09.2007] R&D Projects: GA AV ČR 1ET100300414 Institutional research plan: CEZ:AV0Z10300504 Keywords : memetic learning * evolution ary learning * neural networks Subject RIV: IN - Informatics, Computer Science
Abnormal Control Chart Pattern Classification Optimisation Using Multi Layered Perceptron
Mitra Mahdiani; Hairulliza Mohd. Judi; Noraidah Sahari Ashaari
2014-01-01
In today's industry, control charts are widely used to monitor production process. The abnormal patterns of a quality control chart could reveal problems that occur in the process. In the recent years, as an alternative of the traditional process quality management methods, such as Shewhart Statistical Process Control (SPC), Artificial Neural Networks (ANN) have been widely used to recognize the abnormal pattern of control charts. Various types of patterns are observed in control charts. Iden...
Chennai Salim
2011-09-01
Full Text Available The increased use of nonlinear devices in the industry has resulted in the direct increase of harmonic distortion in power systems during these last years. Active filter systems are proposed to mitigate current harmonics generated by nonlinear loads. The conventional scheme based on a two-level voltage source inverter controlled by a hysteresis controller has several disadvantages and cannot be used for medium or high-power applications. To overcome these drawbacks and improve the APF performance, there’s a great tendency to use multilevel inverters controlled by intelligent controllers. Three level (NPC inverter is one of the most widely used topologies in various industrial applications such as machine drives and power factor compensators. On the other hand, artificial neural networks are under study and investigation in other power electronics applications. In order to gain the advantages of the three-level inverter and artificial neural networks and to reduce the complexity of classical control schemes, a new active power filter configuration controlled by two MLPNN (Multi-Layer Perceptron Neural Network is proposed in this paper. The first ANN is used to replace the PWM current controller, and the second one to maintain a constant dc link voltage across the capacitors and compensate the inverter power losses. The performance of the global system, including power and control circuits is evaluated by Matlab-Simulink and SimPowerSystem Toolbox simulation. The obtained results confirm the effectiveness of the proposed control scheme.
Neural Networks in Control Applications
Sørensen, O.
The intention of this report is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: - Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. - Amongst numerous training algorithms, only four algorithms are examined, all in a...... recursive form (sample updating). The simplest is the Back Probagation Error Algorithm, and the most complex is the recursive Prediction Error Method using a Gauss-Newton search direction. - Over-fitting is often considered to be a serious problem when training neural networks. This problem is specifically...
Baghdadi, N.; Cresson, R.; El Hajj, M.; Ludwig, R.; La Jeunesse, I.
2012-03-01
The purpose of this study was to develop an approach to estimate soil surface parameters from C-band polarimetric SAR data in the case of bare agricultural soils. An inversion technique based on Multi-Layer Perceptron (MLP) neural networks was introduced. The neural networks were trained and validated on a noisy simulated dataset generated from the Integral Equation Model (IEM) on a wide range of surface roughness and soil moisture, as it is encountered in agricultural contexts for bare soils. The performances of neural networks in retrieving soil moisture and surface roughness were tested for several inversion cases in using or not a priori knowledge on soil parameters. The inversion approach was then validated in using RADARSAT-2 images in polarimetric mode. The introduction of expert knowledge on the soil moisture (dry to wet soils or very wet soils) improves the soil moisture estimates whereas the precision on the surface roughness estimation remains unchanged. Moreover, the use of polarimetric parameters ?1 and anisotropy were used to improve the soil parameters estimates. These parameters provide to neural networks the probable ranges of soil moisture (lower or higher than 0.30 cm3 cm-3) and surface roughness (lower or higher than 1.5 cm). Soil moisture can be retrieved correctly from C-band SAR data by using the neural networks technique. Soil moisture errors were estimated at about 0.098 without a priori information on soil parameters and 0.065 cm3 cm-3 (RMSE) applying a priori information on the soil moisture. The retrieval of surface roughness is possible only for low and medium values (lower than 2 cm). Results show that the precision on the soil roughness estimates was about 0.7 cm. For surface roughness lower than 2 cm, the precision on the soil roughness is better with a RMSE about 0.5 cm. The use of polarimetric parameters improves only slightly the soil parameters estimates.
Pan, Sha-sha; Huang, Fu-rong; Xiao, Chi; Xian, Rui-yi; Ma, Zhi-guo
2015-10-01
To explore rapid reliable methods for detection of Epicarpium citri grandis (ECG), the experiment using Fourier Transform Attenuated Total Reflection Infrared Spectroscopy (FTIR/ATR) and Fluorescence Spectrum Imaging Technology combined with Multilayer Perceptron (MLP) Neural Network pattern recognition, for the identification of ECG, and the two methods are compared. Infrared spectra and fluorescence spectral images of 118 samples, 81 ECG and 37 other kinds of ECG, are collected. According to the differences in tspectrum, the spectra data in the 550-1 800 cm(-1) wavenumber range and 400-720 nm wavelength are regarded as the study objects of discriminant analysis. Then principal component analysis (PCA) is applied to reduce the dimension of spectroscopic data of ECG and MLP Neural Network is used in combination to classify them. During the experiment were compared the effects of different methods of data preprocessing on the model: multiplicative scatter correction (MSC), standard normal variable correction (SNV), first-order derivative(FD), second-order derivative(SD) and Savitzky-Golay (SG). The results showed that: after the infrared spectra data via the Savitzky-Golay (SG) pretreatment through the MLP Neural Network with the hidden layer function as sigmoid, we can get the best discrimination of ECG, the correct percent of training set and testing set are both 100%. Using fluorescence spectral imaging technology, corrected by the multiple scattering (MSC) results in the pretreatment is the most ideal. After data preprocessing, the three layers of the MLP Neural Network of the hidden layer function as sigmoid function can get 100% correct percent of training set and 96.7% correct percent of testing set. It was shown that the FTIR/ATR and fluorescent spectral imaging technology combined with MLP Neural Network can be used for the identification study of ECG and has the advantages of rapid, reliable effect. PMID:26904814
The analysis of Balmer alpha beam emission spectra represents a challenging task, both in terms of the wealth of information hidden in them, and in terms of complex spectral features. The shape of a spectrum depends on many local plasma parameters, such as magnetic field strength and direction, beam density, effective charge and deuteron density. This paper is concerned with the deduction of local plasma deuteron densities from Balmer alpha emission from plasma atoms following charge exchange with the beam atoms. The model we will use is statistical, and is based on multi-layer perceptron neural networks (Hertz et al 1991, Bishop 1995). The use of neural networks makes the deconvolution task fully automatic and fast enough for real-time calculation of complete deuteron density profiles. It is shown that the spectra themselves and local electron densities are the only data necessary for accurate inference of local deuteron densities. This result is partly inferred from a sensitivity analysis of dependences on different plasma parameters. Proper error bars for the model predictions will be derived using Bayesian probability theory. (author)
Braga, C C
2001-01-01
A neural network structure has been used for unfolding neutron spectra measured by means of a Bonner Sphere Spectrometer set and a foil activation set using several neutron induced reactions. The present work used the SNNS (Stuttgart Neural Network Simulator) as the interface for designing, training and validation of the Multilayer Perceptron network. The back-propagation algorithm was applied. The Bonner Sphere set chosen has been calibrated at the National Physical Laboratory, United Kingdom, and uses gold activation foils as thermal neutron detectors. The neutron energy covered by the response functions goes from 0.0001 eV to 14 MeV. The foil activation set chosen has been irradiated at the IEA-R1 research reactor and measured at the Nuclear Metrology Laboratory of IPEN-CNEN/SP. Two types of neutron spectra were numerically investigated: monoenergetic and continuous The unfolded spectra were compared to a conventional method using code SAND-II as part of the neutron dosimetry system SAIPS. Good results wer...
Edia E.O.
2010-10-01
Full Text Available Despite their importance in stream management, the aquatic insect assemblages are still little known in West Africa. This is particularly true in South-Eastern Ivory Coast, where aquatic insect assemblages were hardly studied. We therefore aimed at characterising aquatic insect assemblages on four coastal rivers in South-Eastern Ivory Coast. Patterning aquatic insect assemblages was achieved using a Self-Organizing Map (SOM, an unsupervised Artificial Neural Networks (ANN method. This method was applied to pattern the samples based on the richness of five major orders of aquatic insects (Diptera, Ephemeroptera, Coleoptera, Trichoptera and Odonata. This permitted to identify three clusters that were mainly related to the local environmental status of sampling sites. Then, we used the environmental characteristics of the sites to predict, using a multilayer perceptron neural network (MLP, trained by BackPropagation algorithm (BP, a supervised ANN, the richness of the five insect orders. The BP showed high predictability (0.90 for both Diptera and Trichoptera, 0.84 for both Coleoptera and Odonata, 0.69 for Ephemeroptera. The most contributing variables in predicting the five insect order richness were pH, conductivity, total dissolved solids, water temperature, percentage of rock and the canopy. This underlines the crucial influence of both instream characteristics and riparian context.
Rouss, Vicky; Charon, Willy [M3M, Universite de Technologie de Belfort Montbeliard, Rue de Chateau, 90010 Belfort (France)
2008-01-03
A fuel cell system model is necessary to prepare and analyse vibration tests. However, in the literature, the mechanical aspect of the fuel cell systems is neglected. In this paper, a neural network modelling approach for the mechanical nonlinear behaviour of a proton exchange membrane (PEM) fuel cell system is proposed. An experimental set is designed for this purpose: a fuel cell system in operation is subjected to random and swept-sine excitations on a vibrating platform in three axes directions. Its mechanical response is measured with three-dimensional accelerometers. The raw experimental data are exploited to create a multi-input and multi-output (MIMO) model using a multi-layer perceptron neural network combined with a time regression input vector. The model is trained and tested. Results from the analysis show good prediction accuracy. This approach is promising because it can be extended to further complex applications. In the future, the mechanical fuel cell system controller will be implemented on a real-time system that provides an environment to analyse the performance and optimize mechanical parameters design of the PEM fuel system and its auxiliaries. (author)
In this research, feed forward ANN (Artificial Neural Network) model is developed and validated for predicting the pH at 10 different locations of the distribution system of drinking water of Hyderabad city. The developed model is MLP (Multilayer Perceptron) with back propagation algorithm. The data for the training and testing of the model are collected through an experimental analysis on weekly basis in a routine examination for maintaining the quality of drinking water in the city. 17 parameters are taken into consideration including pH. These all parameters are taken as input variables for the model and then pH is predicted for 03 phases;raw water of river Indus,treated water in the treatment plants and then treated water in the distribution system of drinking water. The training and testing results of this model reveal that MLP neural networks are exceedingly extrapolative for predicting the pH of river water, untreated and treated water at all locations of the distribution system of drinking water of Hyderabad city. The optimum input and output weights are generated with minimum MSE (Mean Square Error) < 5%. Experimental, predicted and tested values of pH are plotted and the effectiveness of the model is determined by calculating the coefficient of correlation (R2=0.999) of trained and tested results. (author)
M. Aquilino
2014-01-01
The historical archive of LANDSAT imagery dating back to the launch of ERTS in 1972 provides a comprehensive and permanent data source for tracking change on the planet‟s land surface. In this study case the imagery acquisition dates of 1987, 2002 and 2011 were selected to cover a time trend of 24 years. Land cover categories were based on classes outlined by the Curve Number method with the aim of characterizing land use according to the level of surface imperviousness. After comparing two land use classification methods, i.e. Maximum Likelihood Classifier (MLC and Multi-Layer Perceptron (MLP neural network, the Artificial Neural Networks (ANN approach was found the best reliable and efficient method in the absence of ground reference data. The ANN approach has a distinct advantage over statistical classification methods in that it is non-parametric and requires little or no a priori knowledge on the distribution model of input data. The results quantify land cover change patterns in the river basin area under study and demonstrate the potential of multitemporal LANDSAT data to provide an accurate and cost-effective means to map and analyse land cover changes over time that can be used as input in land management and policy decision-making.
Artificial Neural Networks for Pollution Forecast
Pasero, Eros; Mesin, Luca
2010-01-01
This chapter provides an introduction to non-linear methods for the prediction of the concentration of air pollutants. We focused on the selection of features and the modelling and processing techniques based on the theory of Artificial Neural Networks, using Multi Layer Perceptrons and Support Vector Machines. Joint measurements of meteorological data and pollutants concentrations is useful in order to increase the number of parameters to be studied for the construction of mathematical air q...
Prediction of littoral drift with artificial neural networks
Singh, A.K.; Deo, M.C.; SanilKumar, V.
, arbitrary accuracy, and difficult choices related to train- ing schemes, architectures, learning algorithms, and control parameters. Any new application of the ANN that addresses these issues therefore deserves attention of the potential user community...). The current study was also based on the same. Both multi-layered perceptron network (MLP) as well as its variant radial basis function (RBF) was used. Training of the MLP was achieved with the help of alternative learn- ing schemes like Conjugate Gradient...
Robustness of a Neural Network Model for Power Peak Factor Estimation in Protection Systems
This work presents results of robustness verification of artificial neural network correlations that improve the real time prediction of the power peak factor for reactor protection systems. The input variables considered in the correlation are those available in the reactor protection systems, namely, the axial power differences obtained from measured ex-core detectors, and the position of control rods. The correlations, based on radial basis function (RBF) and multilayer perceptron (MLP) neural networks, estimate the power peak factor, without faulty signals, with average errors between 0.13%, 0.19% and 0.15%, and maximum relative error of 2.35%. The robustness verification was performed for three different neural network correlations. The results show that they are robust against signal degradation, producing results with faulty signals with a maximum error of 6.90%. The average error associated to faulty signals for the MLP network is about half of that of the RBF network, and the maximum error is about 1% smaller. These results demonstrate that MLP neural network correlation is more robust than the RBF neural network correlation. The results also show that the input variables present redundant information. The axial power difference signals compensate the faulty signal for the position of a given control rod, and improves the results by about 10%. The results show that the errors in the power peak factor estimation by these neural network correlations, even in faulty conditions, are smaller than the current PWR schemes which may have uncertainties as high as 8%. Considering the maximum relative error of 2.35%, these neural network correlations would allow decreasing the power peak factor safety margin by about 5%. Such a reduction could be used for operating the reactor with a higher power level or with more flexibility. The neural network correlation has to meet requirements of high integrity software that performs safety grade actions. It is shown that the correlation is a very simple algorithm that can be easily codified in software. Due to its simplicity, it facilitates the necessary process of validation and verification. (authors)
Intellect Sensing of Neural Network that Trained to Classify Complex Signals
Reznik, A.; Galinskaya, A.
2003-01-01
An experimental comparison of information features used by neural network is performed. The sensing method was used. Suboptimal classifier agreeable to the gaussian model of the training data was used as a probe. Neural nets with architectures of perceptron and feedforward net with one hidden layer were used. The experiments were carried out with spatial ultrasonic data, which are used for car’s passenger safety system neural controller learning. In this paper we show that a n...
Abnormal Control Chart Pattern Classification Optimisation Using Multi Layered Perceptron
Mitra Mahdiani
2014-06-01
Full Text Available In today's industry, control charts are widely used to monitor production process. The abnormal patterns of a quality control chart could reveal problems that occur in the process. In the recent years, as an alternative of the traditional process quality management methods, such as Shewhart Statistical Process Control (SPC, Artificial Neural Networks (ANN have been widely used to recognize the abnormal pattern of control charts. Various types of patterns are observed in control charts. Identification of these Control Chart Patterns (CCPs can provide clues to potential quality problems in the manufacturing process. Each type of control chart pattern has its own geometric shape and various related features can represent this shape. Feature-based approaches can facilitate efficient pattern recognition since extracted shape features represent the main characteristics of the patterns in a condensed form. The objective of this study was to evaluate the relative performance of a feature-based CCP recognizer compared with the raw data-based recognizer. The study focused on recognition of six commonly researched CCPs plotted on the Shewhart X-bar chart. The ANN-based CCP recognizer trained using the nine shape features resulted in significantly better performance and generalization compared with the raw data-based recognizer.
GEMAN, O.
2014-02-01
Full Text Available Neurological diseases like Alzheimer, epilepsy, Parkinson's disease, multiple sclerosis and other dementias influence the lives of patients, their families and society. Parkinson's disease (PD is a neurodegenerative disease that occurs due to loss of dopamine, a neurotransmitter and slow destruction of neurons. Brain area affected by progressive destruction of neurons is responsible for controlling movements, and patients with PD reveal rigid and uncontrollable gestures, postural instability, small handwriting and tremor. Commercial activity-promoting gaming systems such as the Nintendo Wii and Xbox Kinect can be used as tools for tremor, gait or other biomedical signals acquisitions. They also can aid for rehabilitation in clinical settings. This paper emphasizes the use of intelligent optical sensors or accelerometers in biomedical signal acquisition, and of the specific nonlinear dynamics parameters or fuzzy logic in Parkinson's disease tremor analysis. Nowadays, there is no screening test for early detection of PD. So, we investigated a method to predict PD, based on the image processing of the handwriting belonging to a candidate of PD. For classification and discrimination between healthy people and PD people we used Artificial Neural Networks (Radial Basis Function - RBF and Multilayer Perceptron - MLP and an Adaptive Neuro-Fuzzy Classifier (ANFC. In general, the results may be expressed as a prognostic (risk degree to contact PD.
Indoor location system based on discriminant-adaptive neural network in IEEE 802.11 environments.
Fang, Shih-Hau; Lin, Tsung-Nan
2008-11-01
This brief paper presents a novel localization algorithm, named discriminant-adaptive neural network (DANN), which takes the received signal strength (RSS) from the access points (APs) as inputs to infer the client position in the wireless local area network (LAN) environment. We extract the useful information into discriminative components (DCs) for network learning. The nonlinear relationship between RSS and the position is then accurately constructed by incrementally inserting the DCs and recursively updating the weightings in the network until no further improvement is required. Our localization system is developed in a real-world wireless LAN WLAN environment, where the realistic RSS measurement is collected. We implement the traditional approaches on the same test bed, including weighted kappa-nearest neighbor (WKNN), maximum likelihood (ML), and multilayer perceptron (MLP), and compare the results. The experimental results indicate that the proposed algorithm is much higher in accuracy compared with other examined techniques. The improvement can be attributed to that only the useful information is efficiently extracted for positioning while the redundant information is regarded as noise and discarded. Finally, the analysis shows that our network intelligently accomplishes learning while the inserted DCs provide sufficient information. PMID:19000967
This paper presents an artificial neural network (ANN) approach for annual electricity consumption in high energy consumption industrial sectors. Chemicals, basic metals and non-metal minerals industries are defined as high energy consuming industries. It is claimed that, due to high fluctuations of energy consumption in high energy consumption industries, conventional regression models do not forecast energy consumption correctly and precisely. Although ANNs have been typically used to forecast short term consumptions, this paper shows that it is a more precise approach to forecast annual consumption in such industries. Furthermore, the ANN approach based on a supervised multi-layer perceptron (MLP) is used to show it can estimate the annual consumption with less error. Actual data from high energy consuming (intensive) industries in Iran from 1979 to 2003 is used to illustrate the applicability of the ANN approach. This study shows the advantage of the ANN approach through analysis of variance (ANOVA). Furthermore, the ANN forecast is compared with actual data and the conventional regression model through ANOVA to show its superiority. This is the first study to present an algorithm based on the ANN and ANOVA for forecasting long term electricity consumption in high energy consuming industries
Medarević, Djordje P; Kleinebudde, Peter; Djuriš, Jelena; Djurić, Zorica; Ibrić, Svetlana
2016-01-01
This study for the first time demonstrates combined application of mixture experimental design and artificial neural networks (ANNs) in the solid dispersions (SDs) development. Ternary carbamazepine-Soluplus®-poloxamer 188 SDs were prepared by solvent casting method to improve carbamazepine dissolution rate. The influence of the composition of prepared SDs on carbamazepine dissolution rate was evaluated using d-optimal mixture experimental design and multilayer perceptron ANNs. Physicochemical characterization proved the presence of the most stable carbamazepine polymorph III within the SD matrix. Ternary carbamazepine-Soluplus®-poloxamer 188 SDs significantly improved carbamazepine dissolution rate compared to pure drug. Models developed by ANNs and mixture experimental design well described the relationship between proportions of SD components and percentage of carbamazepine released after 10 (Q10) and 20 (Q20) min, wherein ANN model exhibit better predictability on test data set. Proportions of carbamazepine and poloxamer 188 exhibited the highest influence on carbamazepine release rate. The highest carbamazepine release rate was observed for SDs with the lowest proportions of carbamazepine and the highest proportions of poloxamer 188. ANNs and mixture experimental design can be used as powerful data modeling tools in the systematic development of SDs. Taking into account advantages and disadvantages of both techniques, their combined application should be encouraged. PMID:26065534
Caronongan, Arturo; Venturini, Barbara; Canuti, Debora; Dlay, Satnam; Naguib, Raouf N G; Sherbet, Gajanan V
2016-04-01
Oestrogen receptor (ER) expression is routinely measured in breast cancer management, but the clinical merits of measuring progesterone receptor (PR) expression have remained controversial. Hence the major objective of this study was to assess the potential of PR as a predictor of response to endocrine therapy. We report on analyses of the relative importance of ER and PR for predicting prognosis using robust multilayer perceptron artificial neural networks. Receptor determinations use immunohistochemical (IHC) methods or radioactive ligand binding assays (LBA). In view of the heterogeneity of intratumoral receptor distribution, we examined the relative merits of the IHC and LBA methods. Our analyses reveal a more significant correlation of IHC-determined PR than ER with both nodal status and 5-year disease-free survival (DFS). In LBA, PR displayed higher correlation with survival and ER with nodal status. There was concordance of correlation of PR with DFS by both IHC and LBA. This study suggests a clear distinction between PR and ER, with PR displaying greater correlation than ER with disease progression and prognosis, and emphasizes the marked superiority of the IHC method over LBA. These findings may be valuable in the management of patients with breast cancer. PMID:27069179
Modeling of Soft sensor based on Artificial Neural Network for Galactic Cosmic Rays Application
For successful designing of space radiation Galactic Cosmic Rays (GCRs) model, we develop a soft sensor based on the Artificial Neural Network (ANN) model. At the first step, the soft sensor based ANN was constructed as an alternative to model space radiation environment. The structure of ANN in this model is using Multilayer Perceptron (MLP) and Levenberg Marquardt algorithms with 3 inputs and 2 outputs. In the input variable, we use 12 years data (Corr, Uncorr and Press) of GCR particles obtained from Neutron Monitor of Bartol University (Fort Smith area) and the target output is (Corr and Press) from the same source but for Inuvik area in the Polar Regions. In the validation step, we obtained the Root Mean Square Error (RMSE) value of Corr 3.8670e-004 and Press 1.3414e-004 and Variance Accounted For (VAF) of Corr 99.9839 % and Press 99.9831% during the training section. After all the results obtained, then we applied into a Matlab GUI simulation (soft sensor simulation). This simulation will display the estimation of output value from input (Corr and Press). Testing results showed an error of 0.133% and 0.014% for Corr and Press, respectively
/ Artificial neural networks (ANN): prediction of sensory measurements from instrumental data
Naiara Barbosa, Carvalho; Valria Paula Rodrigues, Minim; Rita de Cssia dos Santos Navarro, Silva; Suzana Maria, Della Lucia; Luis Aantonio, Minim.
2013-12-01
Full Text Available [...] Abstract in english The objective of this study was to predict by means of Artificial Neural Network (ANN), multilayer perceptrons, the texture attributes of light cheesecurds perceived by trained judges based on instrumental texture measurements. Inputs to the network were the instrumental texture measurements of ligh [...] t cheesecurd (imitative and fundamental parameters). Output variables were the sensory attributes consistency and spreadability. Nine light cheesecurd formulations composed of different combinations of fat and water were evaluated. The measurements obtained by the instrumental and sensory analyses of these formulations constituted the data set used for training and validation of the network. Network training was performed using a back-propagation algorithm. The network architecture selected was composed of 8-3-9-2 neurons in its layers, which quickly and accurately predicted the sensory texture attributes studied, showing a high correlation between the predicted and experimental values for the validation data set and excellent generalization ability, with a validation RMSE of 0.0506.
Modeling of Soft sensor based on Artificial Neural Network for Galactic Cosmic Rays Application
Suparta, W.; Putro, W. S.
2014-10-01
For successful designing of space radiation Galactic Cosmic Rays (GCRs) model, we develop a soft sensor based on the Artificial Neural Network (ANN) model. At the first step, the soft sensor based ANN was constructed as an alternative to model space radiation environment. The structure of ANN in this model is using Multilayer Perceptron (MLP) and Levenberg Marquardt algorithms with 3 inputs and 2 outputs. In the input variable, we use 12 years data (Corr, Uncorr and Press) of GCR particles obtained from Neutron Monitor of Bartol University (Fort Smith area) and the target output is (Corr and Press) from the same source but for Inuvik area in the Polar Regions. In the validation step, we obtained the Root Mean Square Error (RMSE) value of Corr 3.8670e-004 and Press 1.3414e-004 and Variance Accounted For (VAF) of Corr 99.9839 % and Press 99.9831% during the training section. After all the results obtained, then we applied into a Matlab GUI simulation (soft sensor simulation). This simulation will display the estimation of output value from input (Corr and Press). Testing results showed an error of 0.133% and 0.014% for Corr and Press, respectively.
Monte Carlo Simulation of the EXO Gaseous Xenon Time Projection Chamber and Neural Network Analysis
Leonard, Francois
Neutrinoless double beta decay has attracted much interest since its observation would reveal the neutrino masses and determine the Majorana nature of the particle. EXO is among the next generation of experiments dedicated to the search for this phenomenon. A part of the collaboration is developing a gas phase time projection chamber prototype to study the performance of this technique for measuring the half-life of neutrinoless double beta decay in 136Xe. A Monte Carlo simulation of this prototype has been developed using the Geant4 toolkit and the Garfield and Maxwell programs to simulate ionizing events in the detector, the production and propagation of the scintillation and electroluminescence signals and their distribution on CsI photocathodes. The simulation was used to study the uniformity of light deposition on the photocathodes, the effect of the natural gamma background radiation on the detector and its response to calibration gamma sources. Furthermore, data produced with this simulation were analyzed with a neural network algorithm using the multi-layer perceptron class implemented in ROOT. The performance of this algorithm was studied for vertex reconstruction of ionizing events in the detector as well as for classification of tracks for background rejection.
A Hybrid Model based on Neural Network and Hybrid Genetic Algorithm for Automotive Price Forecasting
M. Reza Peyghami
2011-06-01
Full Text Available In this paper, we introduce a new intelligent combination method based on Multilayer Perceptron Neural Network (MLP?NN and Hybrid Genetic Algorithm (HGA for automotive price forecasting. The combination of MLPNN and HGA lead us to accelerate convergence to the optimal weights and improve the forecasting performance. In this structure, the Levenberg? Marquardt (LM algorithm is employed for training of the network, and the hybridization of Genetic Algorithm (GA with some local search optimization techniques such as steepest descent (SD method and quasi?Newton methods with DFP and BFGS formula is used to perform HGA. We apply our new hybrid model to forecast the automotive prices in Iran Khodro Company which is the biggest automotive manufacturing in IRAN. Simulation results show the enough reduction in the processing iterations and forecasting error which is mean square error. The results are well promising compared to the cases when we apply MLP?NN or hybridization of MLP?NN and GA, individually.
Greek long-term energy consumption prediction using artificial neural networks
In this paper artificial neural networks (ANN) are addressed in order the Greek long-term energy consumption to be predicted. The multilayer perceptron model (MLP) has been used for this purpose by testing several possible architectures in order to be selected the one with the best generalizing ability. Actual recorded input and output data that influence long-term energy consumption were used in the training, validation and testing process. The developed ANN model is used for the prediction of 2005-2008, 2010, 2012 and 2015 Greek energy consumption. The produced ANN results for years 2005-2008 were compared with the results produced by a linear regression method, a support vector machine method and with real energy consumption records showing a great accuracy. The proposed approach can be useful in the effective implementation of energy policies, since accurate predictions of energy consumption affect the capital investment, the environmental quality, the revenue analysis, the market research management, while conserve at the same time the supply security. Furthermore it constitutes an accurate tool for the Greek long-term energy consumption prediction problem, which up today has not been faced effectively.
Leporace, Gustavo; Batista, Luiz Alberto; Metsavaht, Leonardo; Nadal, Jurandir
2015-08-01
The aim of the study was to analyze and compare the residuals obtained from ground reaction force (GRF) models developed using two different neural network configurations (one network with three outputs; and three networks with one output each), based on accelerometer data. Seventeen healthy subjects walked along a walkway, with a force plate embedded, with a three dimensional accelerometer attached to the shank. Multilayer perceptron networks (MLP) models were developed with the 3D accelerometer data as inputs to predict the GRF. The residuals of these models were evaluated graphically and numerically to verify the fitting. A visual analysis of the simulated signals suggests the model was able to adequately predict the GRF. The errors and correlations found in the MLP models for the 3D GRF is at least similar to other studies, although some of them showed higher errors. There was not difference between the two MLP configurations. However, despite the high correlation coefficient and closeness to a normal probability distribution, the residual analysis still presented a higher kurtosis and skewness, suggesting that the inclusion of other variables and the increase of the validation sample size could increase the fitting of the simulation. PMID:26736876
Spatial Disaggregation of Areal Rainfall Using Two Different Artificial Neural Networks Models
Sungwon Kim
2015-06-01
Full Text Available The objective of this study is to develop artificial neural network (ANN models, including multilayer perceptron (MLP and Kohonen self-organizing feature map (KSOFM, for spatial disaggregation of areal rainfall in the Wi-stream catchment, an International Hydrological Program (IHP representative catchment, in South Korea. A three-layer MLP model, using three training algorithms, was used to estimate areal rainfall. The Levenberg–Marquardt training algorithm was found to be more sensitive to the number of hidden nodes than were the conjugate gradient and quickprop training algorithms using the MLP model. Results showed that the networks structures of 11-5-1 (conjugate gradient and quickprop and 11-3-1 (Levenberg-Marquardt were the best for estimating areal rainfall using the MLP model. The networks structures of 1-5-11 (conjugate gradient and quickprop and 1-3-11 (Levenberg–Marquardt, which are the inverse networks for estimating areal rainfall using the best MLP model, were identified for spatial disaggregation of areal rainfall using the MLP model. The KSOFM model was compared with the MLP model for spatial disaggregation of areal rainfall. The MLP and KSOFM models could disaggregate areal rainfall into individual point rainfall with spatial concepts.
Gholamreza Asadollahfardi
2013-08-01
Full Text Available Considering the significance of the Sodium Adsorption Ratio (SAR for growing plants, its prediction is essential for water quality management for irrigation. The SAR prediction in Chelghazy River in Kurdistan, northwest of Iran, using an Artificial Neural Network (ANN was studied. The study applied the Multilayer Perceptron (MLP of the ANN to average monthly data, which was collected by the water authority of the Kurdistan province for the period of 1998-2009. The input parameters of the MLP network was pH, discharge, sulfate, sodium, calcium, chloride, magnesium and bicarbonate, and output was predictive of the SAR. The results showed a correlation coefficient 0.976 between actual and predicted SAR, which means the accuracy of the model is acceptable. The model uses the input parameters to predict the SAR at the same month. The sensitivity analysis indicated the prediction of the SAR was affected by merely pH and calcium. As a whole, the MLP of the ANN may be applicable for prediction of the SAR which is necessary parameter ration for agriculture.
Stamenković, Lidija J; Antanasijević, Davor Z; Ristić, Mirjana Đ; Perić-Grujić, Aleksandra A; Pocajt, Viktor V
2015-12-01
Ammonia emissions at the national level are frequently estimated by applying the emission inventory approach, which includes the use of emission factors, which are difficult and expensive to determine. Emission factors are therefore the subject of estimation, and as such they contribute to inherent uncertainties in the estimation of ammonia emissions. This paper presents an alternative approach for the prediction of ammonia emissions at the national level based on artificial neural networks and broadly available sustainability and economical/agricultural indicators as model inputs. The Multilayer Perceptron (MLP) architecture was optimized using a trial-and-error procedure, including the number of hidden neurons, activation function, and a back-propagation algorithm. Principal component analysis (PCA) was applied to reduce mutual correlation between the inputs. The obtained results demonstrate that the MLP model created using the PCA transformed inputs (PCA-MLP) provides a more accurate prediction than the MLP model based on the original inputs. In the validation stage, the MLP and PCA-MLP models were tested for ammonia emission predictions for up to 2 years and compared with a principal component regression model. Among the three models, the PCA-MLP demonstrated the best performance, providing predictions for the USA and the majority of EU countries with a relative error of less than 20%. PMID:26201663
Use of artificial neural networks and geographic objects for classifying remote sensing imagery
Pedro Resende Silva
2014-06-01
Full Text Available The aim of this study was to develop a methodology for mapping land use and land cover in the northern region of Minas Gerais state, where, in addition to agricultural land, the landscape is dominated by native cerrado, deciduous forests, and extensive areas of vereda. Using forest inventory data, as well as RapidEye, Landsat TM and MODIS imagery, three specific objectives were defined: 1 to test use of image segmentation techniques for an object-based classification encompassing spectral, spatial and temporal information, 2 to test use of high spatial resolution RapidEye imagery combined with Landsat TM time series imagery for capturing the effects of seasonality, and 3 to classify data using Artificial Neural Networks. Using MODIS time series and forest inventory data, time signatures were extracted from the dominant vegetation formations, enabling selection of the best periods of the year to be represented in the classification process. Objects created with the segmentation of RapidEye images, along with the Landsat TM time series images, were classified by ten different Multilayer Perceptron network architectures. Results showed that the methodology in question meets both the purposes of this study and the characteristics of the local plant life. With excellent accuracy values for native classes, the study showed the importance of a well-structured database for classification and the importance of suitable image segmentation to meet specific purposes.
Comparative Study of Artificial Neural Network and ARIMA Models in Predicting Exchange Rate
karamollah Bagherifard
2012-11-01
Full Text Available Capital market as an organized market has an effective role in mobilizing financial resources due to have growth and economic development of countries and many countries now in the finance firms is responsible for the required credits. In the stock market, shareholders are always seeking the highest efficiency, so the stock price prediction is important for them. Since the stock market is a nonlinear system under conditions of political, economic and psychological, it is difficult to predict the correct stock price. Thus, in the present study artificial intelligence and ARIMA method has been used to predict stock prices. Multilayer Perceptron neural network and radial basis functions are two methods used in this research. Evaluation methods, selection methods and exponential smoothing methods are compared to random walk. The results showed that AI-based methods used in predicting stock performance are more accurate. Between two methods used in artificial intelligence, a method based on radial basis functions is capable to estimate stock prices in the future with higher accuracy.
A new analysis technique, called multi-level interval estimation method, is developed for locating damage in structures. In this method, the artificial neural networks (ANN) analysis method is combined with the statistics theory to estimate the range of damage location. The ANN is multilayer perceptron trained by back-propagation. Natural frequencies and modal shape at a few selected points are used as input to identify the location and severity of damage. Considering the large-scale structures which have lots of elements, multi-level interval estimation method is developed to reduce the estimation range of damage location step-by-step. Every step, estimation range of damage location is obtained from the output of ANN by using the method of interval estimation. The next ANN training cases are selected from the estimation range after linear transform, and the output of new ANN estimation range of damage location will gained a reduced estimation range. Two numerical example analyses on 10-bar truss and 100-bar truss are presented to demonstrate the effectiveness of the proposed method.
Artificial Neural Network applied as a methodology of mosquito species identification.
Lorenz, Camila; Ferraudo, Antonio Sergio; Suesdek, Lincoln
2015-12-01
There are about 200 species of mosquitoes (Culicidae) known to be vectors of pathogens that cause diseases in humans. Correct identification of mosquito species is an essential step in the development of effective control strategies for these diseases; recognizing the vectors of pathogens is integral to understanding transmission. Unfortunately, taxonomic identification of mosquitoes is a laborious task, which requires trained experts, and it is jeopardized by the high variability of morphological and molecular characters found within the Culicidae family. In this context, the development of an automatized species identification method would be a valuable and more accessible resource to non-taxonomist and health professionals. In this work, an artificial neural network (ANN) technique was proposed for the identification and classification of 17 species of the genera Anopheles, Aedes, and Culex, based on wing shape characters. We tested the hypothesis that classification using ANN is better than traditional classification by discriminant analysis (DA). Thirty-two wing shape principal components were used as input to a Multilayer Perceptron Classification ANN. The obtained ANN correctly identified species with accuracy rates ranging from 85.70% to 100%, and classified species more efficiently than did the traditional method of multivariate discriminant analysis. The results highlight the power of ANNs to diagnose mosquito species and to partly automatize taxonomic identification. These findings also support the hypothesis that wing venation patterns are species-specific, and thus should be included in taxonomic keys. PMID:26394186
Aspects of artificial neural networks - with applications in high energy physics
Different aspects of artificial neural networks are studied and discussed. They are demonstrated to be powerful general purpose algorithms, applicable to many different problem areas like pattern recognition, function fitting and prediction. Multi-layer perceptron (MPL) models are shown to out perform previous standard approaches on both off-line and on-line analysis tasks in high energy physics, like quark flavour tagging and mass reconstruction, as well as being powerful tools for prediction tasks. It is also demonstrated how a self-organizing network can be employed to extract information from data, for instance to track down origins of unexpected model discrepancies. Furthermore, it is proved that the MPL is more efficient than the learning vector quantization technique on classification problems, by producing smoother discrimination surfaces, and that an MPL network should be trained with a noisy updating schedule if the Hessian is ill-conditioned - A result that is especially important for MPL network with more than just one hidden layer. 81 refs, 6 figs
Amozegar, M; Khorasani, K
2016-04-01
In this paper, a new approach for Fault Detection and Isolation (FDI) of gas turbine engines is proposed by developing an ensemble of dynamic neural network identifiers. For health monitoring of the gas turbine engine, its dynamics is first identified by constructing three separate or individual dynamic neural network architectures. Specifically, a dynamic multi-layer perceptron (MLP), a dynamic radial-basis function (RBF) neural network, and a dynamic support vector machine (SVM) are trained to individually identify and represent the gas turbine engine dynamics. Next, three ensemble-based techniques are developed to represent the gas turbine engine dynamics, namely, two heterogeneous ensemble models and one homogeneous ensemble model. It is first shown that all ensemble approaches do significantly improve the overall performance and accuracy of the developed system identification scheme when compared to each of the stand-alone solutions. The best selected stand-alone model (i.e., the dynamic RBF network) and the best selected ensemble architecture (i.e., the heterogeneous ensemble) in terms of their performances in achieving an accurate system identification are then selected for solving the FDI task. The required residual signals are generated by using both a single model-based solution and an ensemble-based solution under various gas turbine engine health conditions. Our extensive simulation studies demonstrate that the fault detection and isolation task achieved by using the residuals that are obtained from the dynamic ensemble scheme results in a significantly more accurate and reliable performance as illustrated through detailed quantitative confusion matrix analysis and comparative studies. PMID:26881999
Trépanier, Sylvain; Mathieu, Lucie; Daigneault, Réal; Faure, Stéphane
2016-04-01
This study proposes an artificial neural networks-based method for predicting the unaltered (precursor) chemical compositions of hydrothermally altered volcanic rock. The method aims at predicting precursor's major components contents (SiO2, FeOT, MgO, CaO, Na2O, and K2O). The prediction is based on ratios of elements generally immobile during alteration processes; i.e. Zr, TiO2, Al2O3, Y, Nb, Th, and Cr, which are provided as inputs to the neural networks. Multi-layer perceptron neural networks were trained on a large dataset of least-altered volcanic rock samples that document a wide range of volcanic rock types, tectonic settings and ages. The precursors thus predicted are then used to perform mass balance calculations. Various statistics were calculated to validate the predictions of precursors' major components, which indicate that, overall, the predictions are precise and accurate. For example, rank-based correlation coefficients were calculated to compare predicted and analysed values from a least-altered test dataset that had not been used to train the networks. Coefficients over 0.87 were obtained for all components, except for Na2O (0.77), indicating that predictions for alkali might be less performant. Also, predictions are performant for most volcanic rock compositions, except for ultra-K rocks. The proposed method provides an easy and rapid solution to the often difficult task of determining appropriate volcanic precursor compositions to rocks modified by hydrothermal alteration. It is intended for large volcanic rock databases and is most useful, for example, to mineral exploration performed in complex or poorly known volcanic settings. The method is implemented as a simple C++ console program.
COCOMO Estimates Using Neural Networks
Anupama Kaushik
2012-08-01
Full Text Available Software cost estimation is an important phase in software development. It predicts the amount of effort and development time required to build a software system. It is one of the most critical tasks and an accurate estimate provides a strong base to the development procedure. In this paper, the most widely used software cost estimation model, the Constructive Cost Model (COCOMO is discussed. The model is implemented with the help of artificial neural networks and trained using the perceptron learning algorithm. The COCOMO dataset is used to train and to test the network. The test results from the trained neural network are compared with that of the COCOMO model. The aim of our research is to enhance the estimation accuracy of the COCOMO model by introducing the artificial neural networks to it.
Hamid Reza, Tavakoli; Omid Lotfi, Omran; Saman Soleimani, Kutanaei; Masoud Falahtabar, shiade.
2014-11-01
Full Text Available The main objective of the present work is to utilize feedforward multi-layer perceptron (MLP) type of artificial neural networks (ANN) to find the combined effect of nano-silica and different fibers (steel, polypropylene, glass) on the toughness, flexural strength and fracture energy of concrete is [...] evaluated.For this purpose, 40 mix plot including 4 series A and B and C and D, which contain, respectively, 0, 2, 4 and 6% weight of cement, nano-silica particles were used as a substitute for cement. Each of series includes three types of fibers (metal: 0.2, 0.3 and 0.5% volume and polypropylene: 0.1, 0.15 and 0.2 % volume and glass 0.15 and 0.2 and 0.3% by volume) were tested. The obtained results from the experimental data are used to train the MLP type artificial neural network. The Results of this study show that fibers conjugate presence and optimal percent of nano-silica improved toughness, flexural strength and fracture energy of concrete of Self-compacting concrete (SCC). Results of this study show that fibers conjugate presence and optimal per-cent of nano-silica improved toughness, toughness, fracture ener-gy and flexural strength of SCC.
Cámara, Montaña; Torrecilla, José S; Caceres, Jorge O; Sánchez Mata, M Cortes; Fernández-Ruiz, Virginia
2010-01-13
In this study a neural network (NN) model was designed to predict lycopene and beta-carotene concentrations in food samples, combined with a simple and fast technique, such as UV-vis spectroscopy. The measurement of the absorbance at 446 and 502 nm of different beta-carotene and lycopene standard mixtures was used to optimize a neural network based on a multilayer perceptron (MLP) (learning and verification process). Then, for validation purposes, the optimized NN has been applied to determine the concentration of both compounds in food samples (fresh tomato, tomato concentrate, tomato sauce, ketchup, tomato juice, watermelon, medlar, green pepper, and carrots), comparing the NN results with the known values of these compounds obtained by analytical techniques (UV-vis and HPLC). It was concluded that when the MLP-NN is used within the range studied, the optimized NN is able to estimate the beta-carotene and lycopene concentrations in food samples with an adequate accuracy, solving the UV-vis interference of beta-carotene and lycopene. PMID:19919099
Hosseini-Golgoo, S. M.; Bozorgi, H.; Saberkari, A.
2015-06-01
Performances of three neural networks, consisting of a multi-layer perceptron, a radial basis function, and a neuro-fuzzy network with local linear model tree training algorithm, in modeling and extracting discriminative features from the response patterns of a temperature-modulated resistive gas sensor are quantitatively compared. For response pattern recording, a voltage staircase containing five steps each with a 20 s plateau is applied to the micro-heater of the sensor, when 12 different target gases, each at 11 concentration levels, are present. In each test, the hidden layer neuron weights are taken as the discriminatory feature vector of the target gas. These vectors are then mapped to a 3D feature space using linear discriminant analysis. The discriminative information content of the feature vectors are determined by the calculation of the Fisher’s discriminant ratio, affording quantitative comparison among the success rates achieved by the different neural network structures. The results demonstrate a superior discrimination ratio for features extracted from local linear neuro-fuzzy and radial-basis-function networks with recognition rates of 96.27% and 90.74%, respectively.
International Conference on Artificial Neural Networks (ICANN)
Mladenov, Valeri; Kasabov, Nikola; Artificial Neural Networks : Methods and Applications in Bio-/Neuroinformatics
2015-01-01
The book reports on the latest theories on artificial neural networks, with a special emphasis on bio-neuroinformatics methods. It includes twenty-three papers selected from among the best contributions on bio-neuroinformatics-related issues, which were presented at the International Conference on Artificial Neural Networks, held in Sofia, Bulgaria, on September 10-13, 2013 (ICANN 2013). The book covers a broad range of topics concerning the theory and applications of artificial neural networks, including recurrent neural networks, super-Turing computation and reservoir computing, double-layer vector perceptrons, nonnegative matrix factorization, bio-inspired models of cell communities, Gestalt laws, embodied theory of language understanding, saccadic gaze shifts and memory formation, and new training algorithms for Deep Boltzmann Machines, as well as dynamic neural networks and kernel machines. It also reports on new approaches to reinforcement learning, optimal control of discrete time-delay systems, new al...
Mokhtar Attari; Mounir Bouhedda; Fayçal Benrekia
2013-01-01
This paper develops a primitive gas recognition system for discriminating between industrial gas species. The system under investigation consists of an array of eight micro-hotplate-based SnO2 thin film gas sensors with different selectivity patterns. The output signals are processed through a signal conditioning and analyzing system. These signals feed a decision-making classifier, which is obtained via a Field Programmable Gate Array (FPGA) with Very High-Speed Integrated Circuit Hardware D...
Introduction to neural networks
This lecture is a presentation of today's research in neural computation. Neural computation is inspired by knowledge from neuro-science. It draws its methods in large degree from statistical physics and its potential applications lie mainly in computer science and engineering. Neural networks models are algorithms for cognitive tasks, such as learning and optimization, which are based on concepts derived from research into the nature of the brain. The lecture first gives an historical presentation of neural networks development and interest in performing complex tasks. Then, an exhaustive overview of data management and networks computation methods is given: the supervised learning and the associative memory problem, the capacity of networks, the Perceptron networks, the functional link networks, the Madaline (Multiple Adalines) networks, the back-propagation networks, the reduced coulomb energy (RCE) networks, the unsupervised learning and the competitive learning and vector quantization. An example of application in high energy physics is given with the trigger systems and track recognition system (track parametrization, event selection and particle identification) developed for the CPLEAR experiment detectors from the LEAR at CERN. (J.S.). 56 refs., 20 figs., 1 tab., 1 appendix
Epping W. J. M.
2006-11-01
Full Text Available Neural networks with the multi-layered perceptron architecture were trained on an autoassociation task to compress 2D seismic data. Networks with linear transfer functions outperformed nonlinear neural nets with single or multiple hidden layers. This indicates that the correlational structure of the seismic data is predominantly linear. A compression factor of 5 to 7 can be achieved if a reconstruction error of 10% is allowed. The performance on new test data was similar to that achieved with the training data. The hidden units developed feature-detecting properties that resemble oriented line, edge and more complex feature detectors. The feature detectors of linear neural nets are near-orthogonal rotations of the principal eigenvectors of the Karhunen-Loève transformation. Des réseaux neuronaux à architecture de perceptron multicouches ont été expérimentés en auto-association pour permettre la compression de données sismiques bidimensionnelles. Les réseaux neuronaux à fonctions de transfert linéaires s'avèrent plus performants que les réseaux neuronaux non linéaires, à une ou plusieurs couches cachées. Ceci indique que la structure corrélative des données sismiques est à prédominance linéaire. Un facteur de compression de 5 à 7 peut être obtenu si une erreur de reconstruction de 10 % est admise. La performance sur les données de test est très proche de celle obtenue sur les données d'apprentissage. Les unités cachées développent des propriétés de détection de caractéristiques ressemblant à des détecteurs de lignes orientées, de bords et de figures plus complexes. Les détecteurs de caractéristique des réseaux neuronaux linéaires sont des rotations quasi orthogonales des vecteurs propres principaux de la transformation de Karhunen-Loève.
Labrador, I.; Carrasco, R.; Martinez, L.
1996-07-01
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs.
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs
Competing neural networks: Finding a strategy for the game of matching pennies
Samengo, I.; Zanette, D. H.
2000-01-01
The ability of a deterministic, plastic system to learn to imitate stochastic behavior is analyzed. Two neural networks -actually, two perceptrons- are put to play a zero-sum game one against the other. The competition, by acting as a kind of mutually supervised learning, drives the networks to produce an approximation to the optimal strategy, that is to say, a random signal.
Zhilin, V V; Filist, S A; Rakhim, Khaled Abdul; Shatalova, O V
2008-01-01
Problems of MATLAB-based simulation of hybrid neural networks for data classification in biomedical applications are considered. The neural-network structure is used as a defuzzifier. Graphic interfaces for constructing fuzzy neural-network models are suggested. Methods for merging models constructed using different MATLAB packages and an algorithm for constructing a fuzzy neural-network model are suggested. The algorithm includes both modules for tuning membership functions of the fuzzy system fuzzifier, and modules for tuning the parameters of the defuzzifier implemented as a two-layer neural-network structure of the perceptron type. PMID:18507134
Locus minimization in breed prediction using artificial neural network approach.
Iquebal, M A; Ansari, M S; Sarika; Dixit, S P; Verma, N K; Aggarwal, R A K; Jayakumar, S; Rai, A; Kumar, D
2014-12-01
Molecular markers, viz. microsatellites and single nucleotide polymorphisms, have revolutionized breed identification through the use of small samples of biological tissue or germplasm, such as blood, carcass samples, embryos, ova and semen, that show no evident phenotype. Classical tools of molecular data analysis for breed identification have limitations, such as the unavailability of referral breed data, causing increased cost of collection each time, compromised computational accuracy and complexity of the methodology used. We report here the successful use of an artificial neural network (ANN) in background to decrease the cost of genotyping by locus minimization. The webserver is freely accessible (http://nabg.iasri.res.in/bisgoat) to the research community. We demonstrate that the machine learning (ANN) approach for breed identification is capable of multifold advantages such as locus minimization, leading to a drastic reduction in cost, and web availability of reference breed data, alleviating the need for repeated genotyping each time one investigates the identity of an unknown breed. To develop this model web implementation based on ANN, we used 51,850 samples of allelic data of microsatellite-marker-based DNA fingerprinting on 25 loci covering 22 registered goat breeds of India for training. Minimizing loci to up to nine loci through the use of a multilayer perceptron model, we achieved 96.63% training accuracy. This server can be an indispensable tool for identification of existing breeds and new synthetic commercial breeds, leading to protection of intellectual property in case of sovereignty and bio-piracy disputes. This server can be widely used as a model for cost reduction by locus minimization for various other flora and fauna in terms of variety, breed and/or line identification, especially in conservation and improvement programs. PMID:25183434
Neural Network Aided Glitch-Burst Discrimination and Glitch Classification
Rampone, Salvatore; Pierro, Vincenzo; Troiano, Luigi; Pinto, Innocenzo M.
2013-11-01
We investigate the potential of neural-network based classifiers for discriminating gravitational wave bursts (GWBs) of a given canonical family (e.g. core-collapse supernova waveforms) from typical transient instrumental artifacts (glitches), in the data of a single detector. The further classification of glitches into typical sets is explored. In order to provide a proof of concept, we use the core-collapse supernova waveform catalog produced by H. Dimmelmeier and co-Workers, and the data base of glitches observed in laser interferometer gravitational wave observatory (LIGO) data maintained by P. Saulson and co-Workers to construct datasets of (windowed) transient waveforms (glitches and bursts) in additive (Gaussian and compound-Gaussian) noise with different signal-to-noise ratios (SNR). Principal component analysis (PCA) is next implemented for reducing data dimensionality, yielding results consistent with, and extending those in the literature. Then, a multilayer perceptron is trained by a backpropagation algorithm (MLP-BP) on a data subset, and used to classify the transients as glitch or burst. A Self-Organizing Map (SOM) architecture is finally used to classify the glitches. The glitch/burst discrimination and glitch classification abilities are gauged in terms of the related truth tables. Preliminary results suggest that the approach is effective and robust throughout the SNR range of practical interest. Perspective applications pertain both to distributed (network, multisensor) detection of GWBs, where some intelligence at the single node level can be introduced, and instrument diagnostics/optimization, where spurious transients can be identified, classified and hopefully traced back to their entry points.
Anderson, R. B.; Morris, Richard V.; Clegg, S. M.; Humphries, S. D.; Wiens, R. C.; Bell, J. F., III; Mertzman, S. A.
2010-01-01
The ChemCam instrument [1] on the Mars Science Laboratory (MSL) rover will be used to obtain the chemical composition of surface targets within 7 m of the rover using Laser Induced Breakdown Spectroscopy (LIBS). ChemCam analyzes atomic emission spectra (240-800 nm) from a plasma created by a pulsed Nd:KGW 1067 nm laser. The LIBS spectra can be used in a semiquantitative way to rapidly classify targets (e.g., basalt, andesite, carbonate, sulfate, etc.) and in a quantitative way to estimate their major and minor element chemical compositions. Quantitative chemical analysis from LIBS spectra is complicated by a number of factors, including chemical matrix effects [2]. Recent work has shown promising results using multivariate techniques such as partial least squares (PLS) regression and artificial neural networks (ANN) to predict elemental abundances in samples [e.g. 2-6]. To develop, refine, and evaluate analysis schemes for LIBS spectra of geologic materials, we collected spectra of a diverse set of well-characterized natural geologic samples and are comparing the predictive abilities of PLS, cascade correlation ANN (CC-ANN) and multilayer perceptron ANN (MLP-ANN) analysis procedures.
An ion polymer metal composite (IPMC) is an electroactive polymer that bends in response to a small applied electric field as a result of mobility of cations in the polymer network and vice versa. This paper presents an innovative and accurate nonlinear black-box model (NBBM) for estimating the bending behavior of IPMC actuators. The model is constructed via a general multilayer perceptron neural network (GMLPNN) integrated with a smart learning mechanism (SLM) that is based on an extended Kalman filter with self-decoupling ability (SDEKF). Here the GMLPNN is built with an ability to autoadjust its structure based on its characteristic vector. Furthermore, by using the SLM based on the SDEKF, the GMLPNN parameters are optimized with small computational effort, and the modeling accuracy is improved. An apparatus employing an IPMC actuator is first set up to investigate the IPMC characteristics and to generate the data for training and validating the model. The advanced NBBM model for the IPMC system is then created with the proper inputs to estimate IPMC tip displacement. Next, the model is optimized using the SLM mechanism with the training data. Finally, the optimized NBBM model is verified with the validating data. A comparison between this model and the previously developed model is also carried out to prove the effectiveness of the proposed modeling technique. (paper)
Li, Wei; Zhang, Yan; Cui, Lijuan; Zhang, Manyin; Wang, Yifei
2015-08-01
A horizontal subsurface flow constructed wetland (HSSF-CW) was designed to improve the water quality of an artificial lake in Beijing Wildlife Rescue and Rehabilitation Center, Beijing, China. Artificial neural networks (ANNs), including multilayer perceptron (MLP) and radial basis function (RBF), were used to model the removal of total phosphorus (TP). Four variables were selected as the input parameters based on the principal component analysis: the influent TP concentration, water temperature, flow rate, and porosity. In order to improve model accuracy, alternative ANNs were developed by incorporating meteorological variables, including precipitation, air humidity, evapotranspiration, solar heat flux, and barometric pressure. A genetic algorithm and cross-validation were used to find the optimal network architectures for the ANNs. Comparison of the observed data and the model predictions indicated that, with careful variable selection, ANNs appeared to be an efficient and robust tool for predicting TP removal in the HSSF-CW. Comparison of the accuracy and efficiency of MLP and RBF for predicting TP removal showed that the RBF with additional meteorological variables produced the most accurate results, indicating a high potentiality for modeling TP removal in the HSSF-CW. PMID:25903184
Quang Truong, Dinh; Ahn, Kyoung Kwan
2014-07-01
An ion polymer metal composite (IPMC) is an electroactive polymer that bends in response to a small applied electric field as a result of mobility of cations in the polymer network and vice versa. This paper presents an innovative and accurate nonlinear black-box model (NBBM) for estimating the bending behavior of IPMC actuators. The model is constructed via a general multilayer perceptron neural network (GMLPNN) integrated with a smart learning mechanism (SLM) that is based on an extended Kalman filter with self-decoupling ability (SDEKF). Here the GMLPNN is built with an ability to autoadjust its structure based on its characteristic vector. Furthermore, by using the SLM based on the SDEKF, the GMLPNN parameters are optimized with small computational effort, and the modeling accuracy is improved. An apparatus employing an IPMC actuator is first set up to investigate the IPMC characteristics and to generate the data for training and validating the model. The advanced NBBM model for the IPMC system is then created with the proper inputs to estimate IPMC tip displacement. Next, the model is optimized using the SLM mechanism with the training data. Finally, the optimized NBBM model is verified with the validating data. A comparison between this model and the previously developed model is also carried out to prove the effectiveness of the proposed modeling technique.
In the present study, multilayer perceptron (MLP) neural networks were applied to help in the diagnosis of obstructive sleep apnoea syndrome (OSAS). Oxygen saturation (SaO2) recordings from nocturnal pulse oximetry were used for this purpose. We performed time and spectral analysis of these signals to extract 14 features related to OSAS. The performance of two different MLP classifiers was compared: maximum likelihood (ML) and Bayesian (BY) MLP networks. A total of 187 subjects suspected of suffering from OSAS took part in the study. Their SaO2 signals were divided into a training set with 74 recordings and a test set with 113 recordings. BY-MLP networks achieved the best performance on the test set with 85.58% accuracy (87.76% sensitivity and 82.39% specificity). These results were substantially better than those provided by ML-MLP networks, which were affected by overfitting and achieved an accuracy of 76.81% (86.42% sensitivity and 62.83% specificity). Our results suggest that the Bayesian framework is preferred to implement our MLP classifiers. The proposed BY-MLP networks could be used for early OSAS detection. They could contribute to overcome the difficulties of nocturnal polysomnography (PSG) and thus reduce the demand for these studies
A technique for level measurement in pressure vessels was developed using thermal probes with internal cooling and artificial neural networks (ANN's). This new concept of thermal probes was experimentally tested in an experimental facility (BETSNI) with two test sections, ST1 and ST2. Two different thermal probes were designed and constructed: concentric tubes probe and U tube probe. A data acquisition system (DAS) was assembled to record the experimental data during the tests. Steady state and transient level tests were carried out and the experimental data obtained were used as learning and recall data sets in the ANN's program RETRO-05 that simulate a multilayer perceptron with backpropagation. The results of the analysis show that the technique can be applied for level measurements in pressure vessel. The technique is applied for a less input temperature data than the initially designed to the probes. The technique is robust and can be used in case of lack of some temperature data. Experimental data available in literature from electrically heated thermal probe were also used in the ANN's analysis producing good results. The results of the ANN's analysis show that the technique can be improved and applied to level measurements in pressure vessels. (author)
Lee, Su Jeong; Ahn, Myoung-Hwan; Lee, Yeonjin
2016-02-01
Atmospheric instability information derived from satellites plays an important role in short-term weather forecasting, especially the forecasting of severe convective storms. For the next generation of weather satellites for Korea's multi-purpose geostationary satellite program, a new imaging instrument has been developed. Although this imaging instrument is not designed to perform full sounding missions and its capability is limited, its multi-spectral infrared channels provide information on vertical sounding. To take full advantage of the observation data from the much improved spatiotemporal resolution of the imager, the feasibility of an artificial neural network approach for the derivation of the atmospheric instability is investigated. The multi-layer perceptron model with a feed-forward and back-propagation training algorithm shows quite a sensitive response to the selection of the training dataset and model architecture. Through an extensive performance test with a carefully selected training dataset of 7197 independent profiles, the model architectures are selected to be 12, 5000, and 0.3 for the number of hidden nodes, number of epochs, and learning rate, respectively. The selected model gives a mean absolute error, RMSE, and correlation coefficient of 330 J kg-1, 420 J kg-1, and 0.9, respectively. The feasibility is further demonstrated via application of the model to real observation data from a similar instrument that has comparable observation channels with the planned imager.
Menchón-Lara, Rosa-María; Bastida-Jumilla, María-Consuelo; Morales-Sánchez, Juan; Sancho-Gómez, José-Luis
2014-02-01
Atherosclerosis is the leading underlying pathologic process that results in cardiovascular diseases, which represents the main cause of death and disability in the world. The atherosclerotic process is a complex degenerative condition mainly affecting the medium- and large-size arteries, which begins in childhood and may remain unnoticed during decades. The intima-media thickness (IMT) of the common carotid artery (CCA) has emerged as one of the most powerful tool for the evaluation of preclinical atherosclerosis. IMT is measured by means of B-mode ultrasound images, which is a non-invasive and relatively low-cost technique. This paper proposes an effective image segmentation method for the IMT measurement in an automatic way. With this purpose, segmentation is posed as a pattern recognition problem, and a combination of artificial neural networks has been trained to solve this task. In particular, multi-layer perceptrons trained under the scaled conjugate gradient algorithm have been used. The suggested approach is tested on a set of 60 longitudinal ultrasound images of the CCA by comparing the automatic segmentation with four manual tracings. Moreover, the intra- and inter-observer errors have also been assessed. Despite of the simplicity of our approach, several quantitative statistical evaluations have shown its accuracy and robustness. PMID:24281725
Pablo García
2013-06-01
Full Text Available Thanks to the built in intelligence (deployment of new intelligent devices and sensors in places where historically they were not present, the Smart Grid and Microgrid paradigms are able to take advantage from aggregated load forecasting, which opens the door for the implementation of new algorithms to seize this information for optimization and advanced planning. Therefore, accuracy in load forecasts will potentially have a big impact on key operation factors for the future Smart Grid/Microgrid-based energy network like user satisfaction and resource saving, and new methods to achieve an efficient prediction in future energy landscapes (very different from the centralized, big area networks studied so far. This paper proposes different improved models to forecast next day’s aggregated load using artificial neural networks, taking into account the variables that are most relevant for the aggregated. In particular, seven models based on the multilayer perceptron will be proposed, progressively adding input variables after analyzing the influence of climate factors on aggregated load. The results section presents the forecast from the proposed models, obtained from real data.
Zhe Dong
2014-02-01
Full Text Available Small modular reactors (SMRs could be beneficial in providing electricity power safely and also be viable for applications such as seawater desalination and heat production. Due to its inherent safety features, the modular high temperature gas-cooled reactor (MHTGR has been seen as one of the best candidates for building SMR-based nuclear power plants. Since the MHTGR dynamics display high nonlinearity and parameter uncertainty, it is necessary to develop a nonlinear adaptive power-level control law which is not only beneficial to the safe, stable, efficient and autonomous operation of the MHTGR, but also easy to implement practically. In this paper, based on the concept of shifted-ectropy and the physically-based control design approach, it is proved theoretically that the simple proportional-differential (PD output-feedback power-level control can provide asymptotic closed-loop stability. Then, based on the strong approximation capability of the multi-layer perceptron (MLP artificial neural network (ANN, a compensator is established to suppress the negative influence caused by system parameter uncertainty. It is also proved that the MLP-compensated PD power-level control law constituted by an experientially-tuned PD regulator and this MLP-based compensator can guarantee bounded closed-loop stability. Numerical simulation results not only verify the theoretical results, but also illustrate the high performance of this MLP-compensated PD power-level controller in suppressing the oscillation of process variables caused by system parameter uncertainty.
Monthly evaporation forecasting using artificial neural networks and support vector machines
Tezel, Gulay; Buyukyildiz, Meral
2015-02-01
Evaporation is one of the most important components of the hydrological cycle, but is relatively difficult to estimate, due to its complexity, as it can be influenced by numerous factors. Estimation of evaporation is important for the design of reservoirs, especially in arid and semi-arid areas. Artificial neural network methods and support vector machines (SVM) are frequently utilized to estimate evaporation and other hydrological variables. In this study, usability of artificial neural networks (ANNs) (multilayer perceptron (MLP) and radial basis function network (RBFN)) and ?-support vector regression (SVR) artificial intelligence methods was investigated to estimate monthly pan evaporation. For this aim, temperature, relative humidity, wind speed, and precipitation data for the period 1972 to 2005 from Beysehir meteorology station were used as input variables while pan evaporation values were used as output. The Romanenko and Meyer method was also considered for the comparison. The results were compared with observed class A pan evaporation data. In MLP method, four different training algorithms, gradient descent with momentum and adaptive learning rule backpropagation (GDX), Levenberg-Marquardt (LVM), scaled conjugate gradient (SCG), and resilient backpropagation (RBP), were used. Also, ?-SVR model was used as SVR model. The models were designed via 10-fold cross-validation (CV); algorithm performance was assessed via mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R 2). According to the performance criteria, the ANN algorithms and ?-SVR had similar results. The ANNs and ?-SVR methods were found to perform better than the Romanenko and Meyer methods. Consequently, the best performance using the test data was obtained using SCG(4,2,2,1) with R 2 = 0.905.
Estimating Saturated Hydraulic Conductivity from Soil Water Retention Curve using Neural Networks
Ghanbarian-Alavijeh, B.; Liaghat, A. M.; Sohrabi, S.
2009-04-01
Study of soil hydraulic properties like saturated and unsaturated hydraulic conductivity is required in the environmental investigations. Since, direct measurement of soil hydraulic properties is time consuming and expensive, indirect methods such as pedotransfer function and artificial neural networks (ANN) have been developed based on the readily available soil characteristics. In this study, we used soil water retention data i.e. fractal dimension, air entry value and effective porosity, as well as bulk density and developed artificial neural networks in order to estimate saturated hydraulic conductivity. Total of 142 soil samples of the UNSODA, GRIZZLY and Puckett et al. (1985) databases was divided into two groups as 114 for the development and 28 for the validation of ANN model. We used multi-layer perceptron model with 4 layers as the inputs and one layer as the output of ANN model and back propagation algorithm for training procedure. The activation function was selected LOGSIG in the middle and exist layers. The values of statistical parameters such as coefficient of determination (R2) and mean square error (MSE) showed that the best number of neurons in the middle layer of ANN model was 24. We also compared the developed ANN model with Rawls et al. (1993) and Rawls et al. (1998) models using 28 soil samples. The results showed that developed ANN model estimates saturated hydraulic conductivity better than the other methods. The AIC values of ANN, Rawls et al. (1993) and Rawls et al. (1998) were obtained 291.8, 322.3 and 316.4, respectively.
Monthly evaporation forecasting using artificial neural networks and support vector machines
Tezel, Gulay; Buyukyildiz, Meral
2016-04-01
Evaporation is one of the most important components of the hydrological cycle, but is relatively difficult to estimate, due to its complexity, as it can be influenced by numerous factors. Estimation of evaporation is important for the design of reservoirs, especially in arid and semi-arid areas. Artificial neural network methods and support vector machines (SVM) are frequently utilized to estimate evaporation and other hydrological variables. In this study, usability of artificial neural networks (ANNs) (multilayer perceptron (MLP) and radial basis function network (RBFN)) and ɛ-support vector regression (SVR) artificial intelligence methods was investigated to estimate monthly pan evaporation. For this aim, temperature, relative humidity, wind speed, and precipitation data for the period 1972 to 2005 from Beysehir meteorology station were used as input variables while pan evaporation values were used as output. The Romanenko and Meyer method was also considered for the comparison. The results were compared with observed class A pan evaporation data. In MLP method, four different training algorithms, gradient descent with momentum and adaptive learning rule backpropagation (GDX), Levenberg-Marquardt (LVM), scaled conjugate gradient (SCG), and resilient backpropagation (RBP), were used. Also, ɛ-SVR model was used as SVR model. The models were designed via 10-fold cross-validation (CV); algorithm performance was assessed via mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R 2). According to the performance criteria, the ANN algorithms and ɛ-SVR had similar results. The ANNs and ɛ-SVR methods were found to perform better than the Romanenko and Meyer methods. Consequently, the best performance using the test data was obtained using SCG(4,2,2,1) with R 2 = 0.905.
Nath, Sankar; Kotal, S. D.; Kundu, P. K.
2016-03-01
Three artificial neural network (ANN) methods, namely, multilayer perceptron (MLP), radial basis function (RBF) and generalized regression neural network (GRNN) are utilized to predict the seasonal tropical cyclone (TC) activity over the north Indian Ocean (NIO) during the post-monsoon season (October, November, December). The frequency of TC and large-scale climate variables derived from NCEP/NCAR reanalysis dataset of resolution 2.5° × 2.5° were analyzed for the period 1971-2013. Data for the years 1971-2002 were used for the development of the models, which were tested with independent sample data for the year 2003-2013. Using the correlation analysis, the five large-scale climate variables, namely, geopotential height at 500 hPa, relative humidity at 500 hPa, sea-level pressure, zonal wind at 700 hPa and 200 hPa for the preceding month September, are selected as potential predictors of the post-monsoon season TC activity. The result reveals that all the three different ANN methods are able to provide satisfactory forecast in terms of the various metrics, such as root mean-square error (RMSE), standard deviation (SD), correlation coefficient (r), and bias and index of agreement (d). Additionally, leave-one-out cross validation (LOOCV) method is also performed and the forecast skill is evaluated. The results show that the MLP model is found to be superior to the other two models (RBF, GRNN). The (MLP) is expected to be very useful to operational forecasters for prediction of TC activity.
Golubović, Jelena; Birkemeyer, Claudia; Protić, Ana; Otašević, Biljana; Zečević, Mira
2016-03-18
Quantitative structure-property relationship (QSPR) methods are based on the hypothesis that changes in the molecular structure are reflected in changes in the observed property of the molecule. Artificial neural network is a technique of data analysis, which sets out to emulate the human brain's way of working. For the first time a quantitative structure-response relationship in electrospray ionization-mass spectrometry (ESI-MS) by means of artificial neural networks (ANN) on the group of angiotensin II receptor antagonists - sartans has been established. The investigated descriptors correspond to different properties of the analytes: polarity (logP), ionizability (pKa), surface area (solvent excluded volume) and number of proton acceptors. The influence of the instrumental parameters: methanol content in mobile phase, mobile phase pH and flow rate was also examined. Best performance showed a multilayer perceptron network with the architecture 6-3-3-1, trained with backpropagation algorithm. It showed high prediction ability on the previously unseen (test) data set with a coefficient of determination of 0.994. High prediction ability of the model would enable prediction of ESI-MS responsiveness under different conditions. This is particularly important in the method development phase. Also, prediction of responsiveness can be important in case of gradient-elution LC-MS and LC-MS/MS methods in which instrumental conditions are varied during time. Polarity, chargeability and surface area all appeared to be crucial for electrospray ionization whereby signal intensity appeared to be the result of a simultaneous influence of the molecular descriptors and their interactions. Percentage of organic phase in the mobile phase showed a positive, while flow rate showed a negative impact on signal intensity. PMID:26884139
Reconstruction of sub-surface archaeological remains from magnetic data using neural computing.
Bescoby, D. J.; Cawley, G. C.; Chroston, P. N.
2003-04-01
The remains of a former Roman colonial settlement, once part of the classical city of Butrint in southern Albania have been the subject of a high resolution magnetic survey using a caesium-vapour magnetometer. The survey revealed the surviving remains of an extensive planned settlement and a number of outlying buildings, today buried beneath over 0.5 m of alluvial deposits. The aim of the current research is to derive a sub-surface model from the magnetic survey measurements, allowing an enhanced archaeological interpretation of the data. Neural computing techniques are used to perform the non-linear mapping between magnetic data and corresponding sub-surface model parameters. The adoption of neural computing paradigms potentially holds several advantages over other modelling techniques, allowing fast solutions for complex data, while having a high tolerance to noise. A multi-layer perceptron network with a feed-forward architecture is trained to estimate the shape and burial depth of wall foundations using a series of representative models as training data. Parameters used to forward model the training data sets are derived from a number of trial trench excavations targeted over features identified by the magnetic survey. The training of the network was optimized by first applying it to synthetic test data of known source parameters. Pre-processing of the network input data, including the use of a rotationally invariant transform, enhanced network performance and the efficiency of the training data. The approach provides good results when applied to real magnetic data, accurately predicting the depths and layout of wall foundations within the former settlement, verified by subsequent excavation. The resulting sub-surface model is derived from the averaged outputs of a ‘committee’ of five networks, trained with individualized training sets. Fuzzy logic inference has also been used to combine individual network outputs through correlation with data from a second geophysical technique, allowing the integration of data from a separate series of measurements.
Gamma spectral analysis via neural networks
Keller, P.E.; Kouzes, R.T.
1994-10-01
A system combining a portable gamma-ray spectrometer with a neural network is discussed. In this system, the neural network is used to automatically identify radioactive isotopes in real-time from their gamma-ray spectra. Two neural network paradigms are examined: the linear perceptron and the optimal linear associative memory (OLAM). A comparison of the two paradigms shows that OLAM is superior to linear perceptron for this application. Both networks have a linear response and are useful in determining the composition of an unknown sample when the spectrum of the unknown is a linear superposition of known spectra. One feature of this technique is that it uses the whole spectrum in the identification process instead of only the individual photo-peaks. For this reason, it is potentially more useful for processing data from lower resolution gamma-ray spectrometers. This approach has been successfully tested with data generated by Monte Carlo simulations and with field data from both sodium iodide and germanium detectors. With the neural network approach, the intense computation takes place during the training process. Once the network is trained, normal operation consists of propagating the data through the network, which results in rapid identification of samples in the field. This approach is useful in situations that require fast response but where precise quantification is less important.
Snider, LA; Yuen, YS
1998-01-01
The paper presents a practical artificial neural network (ANN) based relay algorithm for electric distribution high impedance fault detection. The scheme utilizes the characteristics of high impedance faults (HIFs) in the resulting waveforms of the three-phase residual current, voltage, admittance and power. By using Fourier analysis, their low order harmonic vectors were evaluated and then fed to a neural network. The network was based on either perceptron or feedforward algorithms. The trai...
Transformation of Neural State Space Models into LFT Models for Robust Control Design
Bendtsen, Jan Dimon; Trangbæk, Klaus
2000-01-01
This paper considers the extraction of linear state space models and uncertainty models from neural networks trained as state estimators with direct application to robust control. A new method for writing a neural state space model in a linear fractional transformation form in a non-conservative...... way is proposed, and it is demonstrated how a standard robust control law can be designed for a system described by means of a multi layer perceptron....
ANNAM. An artificial neural net attraction model to analyze market shares.
Hruschka, Harald
1999-01-01
The marketing literature so far only considers attraction models with strict functional forms. Greater exibility can be achieved by the neural net based approach introduced which assesses brands' attraction values by means of a perceptron with one hidden layer. Using log-ratio transformed market shares as dependent variables stochastic gradient descent followed by a quasi-Newton method estimates parameters. For store-level data the neural net model performs better and implies a price response...
Remembering Past States using Long Short Term Memory Neural Networks
Sjonfjell, Vegard Aksland
2014-01-01
This project explores the ability of Recurrent Neural Networks (RNNs) to memorize previous input states in time series problems.A type of RNN called Long Short Term Memory (LSTM), which is designed specifically to be able to handle long term dependencies in input data, is being compared against recurrent multi layer perceptrons (recurrent MLPs) on two non-trivial time series problems which require a varying number of previous events to be remembered to predict the next state. The first proble...
Comparison of Rates of Linear and Neural Network Approximation
Kůrková, Věra; Sanguineti, M.
Los Alamitos : IEEE Computer Society, 2000, s. 277-282. ISBN 0-7695-0619-4. [IJCNN 2000. Como (IT), 24.07.2000-27.07.2000] R&D Projects: GA ČR GA201/99/0092 Institutional research plan: AV0Z1030915 Keywords : linear and neural networks approximation * Kolmogorov width * dimension -independent rates of approximation * perceptron networks Subject RIV: BA - General Mathematics
Nimura, Yukitaka; Hayashi, Yuichiro; Kitasaka, Takayuki; Mori, Kensaku
2015-03-01
This paper presents a method for torso organ segmentation from abdominal CT images using structured perceptron and dual decomposition. A lot of methods have been proposed to enable automated extraction of organ regions from volumetric medical images. However, it is necessary to adjust empirical parameters of them to obtain precise organ regions. This paper proposes an organ segmentation method using structured output learning. Our method utilizes a graphical model and binary features which represent the relationship between voxel intensities and organ labels. Also we optimize the weights of the graphical model by structured perceptron and estimate the best organ label for a given image by dynamic programming and dual decomposition. The experimental result revealed that the proposed method can extract organ regions automatically using structured output learning. The error of organ label estimation was 4.4%. The DICE coeﬃcients of left lung, right lung, heart, liver, spleen, pancreas, left kidney, right kidney, and gallbladder were 0.91, 0.95, 0.77, 0.81, 0.74, 0.08, 0.83, 0.84, and 0.03, respectively.
Learning by random walks in the weight space of the Ising perceptron
Several variants of a stochastic local search process for constructing the synaptic weights of an Ising perceptron are studied. In this process, binary patterns are sequentially presented to the Ising perceptron and are then learned as the synaptic weight configuration is modified through a chain of single- or double-weight flips within the compatible weight configuration space of the earlier learned patterns. This process is able to reach a storage capacity of α≈0.63 for pattern length N = 101 and α≈0.41 for N = 1001. If in addition a relearning process is exploited, the learning performance is further improved to a storage capacity of α≈0.80 for N = 101 and α≈0.42 for N = 1001. We found that, for a given learning task, the solutions constructed by the random walk learning process are separated by a typical Hamming distance, which decreases with the constraint density α of the learning task; at a fixed value of α, the width of the Hamming distance distribution decreases with N
Neural network analysis of W UMa eclipsing binaries
Zeraatgari, F. Z.; Abedi, A.; Farshad, M.; Ebadian, M.; Riazi, N.
2015-04-01
We try five different artificial neural models, four models based on PNN (Perceptron Neural Network), and one using GRNN (Generalized Regression Neural Network) as tools for the automated light curve analysis of W UMa-type eclipsing binary systems. These algorithms, which are inspired by the Rucinski method, are designed and trained using MATLAB 7.6. A total of 17,820 generated contact binary light curves are first analyzed using a truncated cosine series with 11 coefficients and the most significant coefficients are applied as inputs of the neural models. The required sample light curves are systematically generated, using the WD2007 program (Wilson and Devinney 2007). The trained neural models are then applied to estimate the geometrical parameters of seven W UMa-type systems. The efficiency of different neural network models are then evaluated and compared to find the most efficient one.
Juan David Velásquez Henao
2007-12-01
Full Text Available En este artículo, se modela el precio promedio mensual del café colombiano en la Bolsa de Nueva York, usando varios modelos alternativos. El modelo final seleccionado está compuesto por una componente lineal autorregresiva más una red neuronal artificial tipo perceptron multicapa con dos neuronas en la capa oculta, que permite representar la dinámica que sigue el valor esperado de la serie de precios; mientras que la dinámica de los residuales es especificada usando un proceso heterocedástico condicional autoregresivo de primer orden. Los residuales normalizados del modelo son incorrelacionados y homocedásticos, y siguen aproximadamente una distribución normal. Los resultados indican que el precio actual depende de los precios ocurridos en los últimos cuatro meses.In this paper, the monthly average price of the Colombian coffee in the New York Stock Exchange, is modelling by means of several alternative models. The preferred model is composed by a lineal autoregressive component plus a multilayer perceptron neural network with two neurons in the hidden layer, that allow us to representing the dynamic following by the expected value of the price time series; while, the dynamic of the residuals is specified by an autoregressive conditional heterocedastic model of first order. The normalized residuals of the preferred model are uncorrelated, homocedastic and are distributed following a normal distribution. The results indicate that the current price depend of the prices in the previous four months.
Isomorphisms in Multilayer Networks
Kivelä, Mikko
2015-01-01
We extend the concept of graph isomorphisms to multilayer networks, and we identify multiple types of isomorphisms. For example, in multilayer networks with a single "aspect" (i.e., type of layering), permuting vertex labels, layer labels, and both of types of layers each yield a different type of isomorphism. We discuss how multilayer network isomorphisms naturally lead to defining isomorphisms in any type of network that can be represented as a multilayer network. This thereby yields isomorphisms for multiplex networks, temporal networks, networks with both such features, and more. We reduce each of the multilayer network isomorphism problems to a graph isomorphism problem, and we use this reduction to prove that the multilayer network isomorphism problem is computationally equally hard as the graph isomorphism problem. One can thus use software that has been developed to solve graph isomorphism problems as a practical means for solving multilayer network isomorphism problems.
Vitor Hugo Ferreira
2011-12-01
Full Text Available After 1991, the literature on load forecasting has been dominated by neural network based proposals. However, one major risk in using neural models is the possibility of excessive training, i.e., data overfitting. The extent of nonlinearity provided by neural network based load forecasters, which depends on the input space representation, has been adjusted using heuristic procedures. The empirical nature of these procedures makes their application cumbersome and time consuming. Autonomous modeling including automatic input selection and model complexity control has been proposed recently for short-term load forecasting. However, these techniques require the specification of an initial input set that will be processed by the model in order to select the most relevant variables. This paper explores chaos theory as a tool from non-linear time series analysis to automatic select the lags of the load series data that will be used by the neural models. In this paper, Bayesian inference applied to multi-layered perceptrons and relevance vector machines are used in the development of autonomous neural models.Após 1991, a literatura sobre previsão de carga passou a ser dominada por propostas baseadas em modelos neurais. Entretanto, um empecilho na aplicação destes modelos reside na possibilidade do ajuste excessivo dos dados, i.e, overfitting. O excesso de não-linearidade disponibilizado pelos modelos neurais de previsão de carga, que depende da representação do espaço de entrada, vem sendo ajustado de maneira heurística. Modelos autônomos incluindo técnicas automáticas e acopladas para seleção de entradas e controle de complexidade dos modelos foram propostos recentemente para previsão de carga em curto prazo. Entretanto, estas técnicas necessitam da especificação do conjunto inicial de entradas que será processado pelo modelo visando determinar aquelas mais relevantes. Este trabalho explora a teoria do caos como ferramenta de análise não-linear de séries temporais na definição automática do conjunto de atrasos de uma dada série de carga a serem utilizados como entradas de modelos neurais autônomos. Neste trabalho, inferência Bayesiana aplicada a perceptrons de múltiplas camadas e máquinas de vetores relevantes são utilizadas no desenvolvimento de modelos neurais autônomos.
Characterisation of the plasma density with two artificial neural network models
This paper establishes two artificial neural network models by using a multi layer perceptron algorithm and radial based function algorithm in order to predict the plasma density in a plasma system. In this model, the input layer is composed of five neurons: the radial position, the axial position, the gas pressure, the microwave power and the magnet coil current. The output layer is the target output neuron: the plasma density. The accuracy of prediction is tested with the experimental data obtained by the Langmuir probe. The effectiveness of two artificial neural network models are demonstrated, the results show good agreements with corresponding experimental data. The ability of the artificial neural network model to predict the plasma density accurately in an electron cyclotron resonance-plasma enhanced chemical vapour deposition system can be concluded, and the radial based function is more suitable than the multi layer perceptron in this work. (general)
A framework to analyze inference performance in densely connected single-layer feed-forward networks is developed for situations where a given data set is composed of correlated patterns. The framework is based on the assumption that the left and right singular value bases of the given pattern matrix are generated independently and uniformly from Haar measures. This assumption makes it possible to characterize the objective system by a single function of two variables which is determined by the eigenvalue spectrum of the cross-correlation matrix of the pattern matrix. Links to existing methods for analysis of perceptron learning and Gaussian linear vector channels and an application to a simple but nontrivial problem are also shown
Fall prevention lacks easy, quantitative and wearable methods for the classification of fall-risk (FR). Efforts must be thus devoted to the choice of an ad hoc classifier both to reduce the size of the sample used to train the classifier and to improve performances. A new methodology that uses a neural network (NN) and a wearable device are hereby proposed for this purpose. The NN uses kinematic parameters assessed by a wearable device with accelerometers and rate gyroscopes during a posturography protocol. The training of the NN was based on the Mahalanobis distance and was carried out on two groups of 30 elderly subjects with varying fall-risk Tinetti scores. The validation was done on two groups of 100 subjects with different fall-risk Tinetti scores and showed that, both in terms of specificity and sensitivity, the NN performed better than other classifiers (naive Bayes, Bayes net, multilayer perceptron, support vector machines, statistical classifiers). In particular, (i) the proposed NN methodology improved the specificity and sensitivity by a mean of 3% when compared to the statistical classifier based on the Mahalanobis distance (SCMD) described in Giansanti (2006 Physiol. Meas. 27 1081–90); (ii) the assessed specificity was 97%, the assessed sensitivity was 98% and the area under receiver operator characteristics was 0.965. (note)
Behniafar Ali
2013-01-01
Full Text Available The electric marine instruments are newly inserted in the trade and industry, for which the existence of an equipped and reliable power system is necessitated. One of the features of such a power system is that it cannot have an earth system causing the protection relays not to be able to detect the single line to ground short circuit fault. While on the other hand, the occurrence of another similar fault at the same time can lead to the double line fault and thereby the tripping of relays and shortening of vital loads. This in turn endangers the personals' security and causes the loss of military plans. From the above considerations, it is inferred that detecting the single line to ground fault in the marine instruments is of a special importance. In this way, this paper intends to detect the single line to ground fault in the power systems of the marine instruments using the wavelet transform and Multi-Layer Perceptron (MLP neural network. In the numerical analysis, several different types of short circuit faults are simulated on several marine power systems and the proposed approach is applied to detect the single line to ground fault. The results are of a high quality and preciseness and perfectly demonstrate the effectiveness of the proposed approach.
Utilizando uma rede neural artificial para aproximação da função de evolução do sistema de Lorentz
Andrea Martiniano
2016-04-01
Full Text Available O objetivo principal deste artigo é realizar a aproximação da função de evolução temporal do Sistema de Lorenz utilizando uma Rede Neural Artificial do tipo MLP (Multilayer Perceptron. Além deste objetivo principal, como objetivo específico, apresentam-se os conceitos básicos das Redes Neurais Artificiais (RNAs, um breve histórico da Teoria do Caos e o Sistema de Lorentz. A metodologia adotada na estruturação deste artigo foi definida como bibliográfica e experimental. Atualmente, existe grande interesse nos modelos de redes neurais para resolver problemas não convencionais e complexos, nesse contexto, as Redes Neurais Artificiais têm surgido como alternativa para inúmeras aplicações em diversas áreas do conhecimento. Os resultados obtidos nos experimentos apontam positivamente para a utilização das RNAs. Espera-se com esse artigo incentive a utilização das RNAs em aplicações complexas em que a aprendizagem, associação, generalização e abstração são necessárias para apoio à tomada de decisão.
Highlights: ► Solar radiation estimation based on Gene Expression Programming is unexplored. ► This approach is evaluated for the first time in this study. ► Other artificial intelligence models (ANN and ANFIS) are also included in the study. ► New alternatives for solar radiation estimation based on temperatures are provided. - Abstract: Surface incoming solar radiation is a key variable for many agricultural, meteorological and solar energy conversion related applications. In absence of the required meteorological sensors for the detection of global solar radiation it is necessary to estimate this variable. Temperature based modeling procedures are reported in this study for estimating daily incoming solar radiation by using Gene Expression Programming (GEP) for the first time, and other artificial intelligence models such as Artificial Neural Networks (ANNs), and Adaptive Neuro-Fuzzy Inference System (ANFIS). A comparison was also made among these techniques and traditional temperature based global solar radiation estimation equations. Root mean square error (RMSE), mean absolute error (MAE) RMSE-based skill score (SSRMSE), MAE-based skill score (SSMAE) and r2 criterion of Nash and Sutcliffe criteria were used to assess the models’ performances. An ANN (a four-input multilayer perceptron with 10 neurons in the hidden layer) presented the best performance among the studied models (2.93 MJ m−2 d−1 of RMSE). The ability of GEP approach to model global solar radiation based on daily atmospheric variables was found to be satisfactory.
Guo, Zhiqiang; Wang, Huaiqing; Yang, Jie; Miller, David J
2015-01-01
In this paper, we propose and implement a hybrid model combining two-directional two-dimensional principal component analysis ((2D)2PCA) and a Radial Basis Function Neural Network (RBFNN) to forecast stock market behavior. First, 36 stock market technical variables are selected as the input features, and a sliding window is used to obtain the input data of the model. Next, (2D)2PCA is utilized to reduce the dimension of the data and extract its intrinsic features. Finally, an RBFNN accepts the data processed by (2D)2PCA to forecast the next day's stock price or movement. The proposed model is used on the Shanghai stock market index, and the experiments show that the model achieves a good level of fitness. The proposed model is then compared with one that uses the traditional dimension reduction method principal component analysis (PCA) and independent component analysis (ICA). The empirical results show that the proposed model outperforms the PCA-based model, as well as alternative models based on ICA and on the multilayer perceptron. PMID:25849483
Ivana Đurđević Babić
2015-03-01
Full Text Available Student satisfaction with courses in academic institutions is an important issue and is recognized as a form of support in ensuring effective and quality education, as well as enhancing student course experience. This paper investigates whether there is a connection between student satisfaction with courses and log data on student courses in a virtual learning environment. Furthermore, it explores whether a successful classification model for predicting student satisfaction with course can be developed based on course log data and compares the results obtained from implemented methods. The research was conducted at the Faculty of Education in Osijek and included analysis of log data and course satisfaction on a sample of third and fourth year students. Multilayer Perceptron (MLP with different activation functions and Radial Basis Function (RBF neural networks as well as classification tree models were developed, trained and tested in order to classify students into one of two categories of course satisfaction. Type I and type II errors, and input variable importance were used for model comparison and classification accuracy. The results indicate that a successful classification model using tested methods can be created. The MLP model provides the highest average classification accuracy and the lowest preference in misclassification of students with a low level of course satisfaction, although a t-test for the difference in proportions showed that the difference in performance between the compared models is not statistically significant. Student involvement in forum discussions is recognized as a valuable predictor of student satisfaction with courses in all observed models.
Kumari, Amrita; Das, Suchandan Kumar; Srivastava, Prem Kumar
2016-04-01
Application of computational intelligence for predicting industrial processes has been in extensive use in various industrial sectors including power sector industry. An ANN model using multi-layer perceptron philosophy has been proposed in this paper to predict the deposition behaviors of oxide scale on waterwall tubes of a coal fired boiler. The input parameters comprises of boiler water chemistry and associated operating parameters, such as, pH, alkalinity, total dissolved solids, specific conductivity, iron and dissolved oxygen concentration of the feed water and local heat flux on boiler tube. An efficient gradient based network optimization algorithm has been employed to minimize neural predictions errors. Effects of heat flux, iron content, pH and the concentrations of total dissolved solids in feed water and other operating variables on the scale deposition behavior have been studied. It has been observed that heat flux, iron content and pH of the feed water have a relatively prime influence on the rate of oxide scale deposition in water walls of an Indian boiler. Reasonably good agreement between ANN model predictions and the measured values of oxide scale deposition rate has been observed which is corroborated by the regression fit between these values.
Atila, U.; Karas, I. R.; Turan, M. K.; Rahman, A. A.
2013-09-01
One of the most dangerous disaster threatening the high rise and complex buildings of today's world including thousands of occupants inside is fire with no doubt. When we consider high population and the complexity of such buildings it is clear to see that performing a rapid and safe evacuation seems hard and human being does not have good memories in case of such disasters like world trade center 9/11. Therefore, it is very important to design knowledge based realtime interactive evacuation methods instead of classical strategies which lack of flexibility. This paper presents a 3D-GIS implementation which simulates the behaviour of an intelligent indoor pedestrian navigation model proposed for a self -evacuation of a person in case of fire. The model is based on Multilayer Perceptron (MLP) which is one of the most preferred artificial neural network architecture in classification and prediction problems. A sample fire scenario following through predefined instructions has been performed on 3D model of the Corporation Complex in Putrajaya (Malaysia) and the intelligent evacuation process has been realized within a proposed 3D-GIS based simulation.
using artificial neural network
Rafael do Espírito Santo
2007-01-01
Full Text Available In this work, a Multilayer Perceptron implementation MLP using functional Magnetic Resonance Imaging (fMRI is used to infer stimuli performed. Sets of images of brain activation were generated by visual, auditory and finger tapping paradigms in 54 healthy volunteers. These images were used for training the MLP network in a leave-one-out manner in order to predict the paradigm that a subject performed by using other images, so far unseen by the MLP network. The aim in this paper is the exploring of the influence of the number of the Principal Component (PC on the performance of the MLP in classifying fMRI paradigms. The classifier´s performance was evaluated in terms of the Sensitivity and Specificity, Prediction Accuracy and the area Az under the receiver operating characteristics (ROC curve. From the ROC analysis, values of Az up to 1 were obtained with 60 PCs in discriminating the visual paradigm from the auditory paradigm.
Feng, Xiao; Li, Qi; Zhu, Yajie; Hou, Junxiong; Jin, Lingyan; Wang, Jingjie
2015-04-01
In the paper a novel hybrid model combining air mass trajectory analysis and wavelet transformation to improve the artificial neural network (ANN) forecast accuracy of daily average concentrations of PM2.5 two days in advance is presented. The model was developed from 13 different air pollution monitoring stations in Beijing, Tianjin, and Hebei province (Jing-Jin-Ji area). The air mass trajectory was used to recognize distinct corridors for transport of "dirty" air and "clean" air to selected stations. With each corridor, a triangular station net was constructed based on air mass trajectories and the distances between neighboring sites. Wind speed and direction were also considered as parameters in calculating this trajectory based air pollution indicator value. Moreover, the original time series of PM2.5 concentration was decomposed by wavelet transformation into a few sub-series with lower variability. The prediction strategy applied to each of them and then summed up the individual prediction results. Daily meteorological forecast variables as well as the respective pollutant predictors were used as input to a multi-layer perceptron (MLP) type of back-propagation neural network. The experimental verification of the proposed model was conducted over a period of more than one year (between September 2013 and October 2014). It is found that the trajectory based geographic model and wavelet transformation can be effective tools to improve the PM2.5 forecasting accuracy. The root mean squared error (RMSE) of the hybrid model can be reduced, on the average, by up to 40 percent. Particularly, the high PM2.5 days are almost anticipated by using wavelet decomposition and the detection rate (DR) for a given alert threshold of hybrid model can reach 90% on average. This approach shows the potential to be applied in other countries' air quality forecasting systems.
A multi-scale hybrid neural network retrieval model for dust storm detection, a study in Asia
Wong, Man Sing; Xiao, Fei; Nichol, Janet; Fung, Jimmy; Kim, Jhoon; Campbell, James; Chan, P. W.
2015-05-01
Dust storms are known to have adverse effects on human health and significant impact on weather, air quality, hydrological cycle, and ecosystem. Atmospheric dust loading is also one of the large uncertainties in global climate modeling, due to its significant impact on the radiation budget and atmospheric stability. Observations of dust storms in humid tropical south China (e.g. Hong Kong), are challenging due to high industrial pollution from the nearby Pearl River Delta region. This study develops a method for dust storm detection by combining ground station observations (PM10 concentration, AERONET data), geostationary satellite images (MTSAT), and numerical weather and climatic forecasting products (WRF/Chem). The method is based on a hybrid neural network (NN) retrieval model for two scales: (i) a NN model for near real-time detection of dust storms at broader regional scale; (ii) a NN model for detailed dust storm mapping for Hong Kong and Taiwan. A feed-forward multilayer perceptron (MLP) NN, trained using back propagation (BP) algorithm, was developed and validated by the k-fold cross validation approach. The accuracy of the near real-time detection MLP-BP network is 96.6%, and the accuracies for the detailed MLP-BP neural network for Hong Kong and Taiwan is 74.8%. This newly automated multi-scale hybrid method can be used to give advance near real-time mapping of dust storms for environmental authorities and the public. It is also beneficial for identifying spatial locations of adverse air quality conditions, and estimates of low visibility associated with dust events for port and airport authorities.
M.R. Mustafa
2014-05-01
Full Text Available Estimation of suspended sediments in rivers using soft computing techniques has been extensively performed around the world since 1990’s. However, accuracy in the results was always found to be highly desired and a profound crucial task. This study presents a thorough comparison between the performances of best basis function of Radial Basis Functions (RBF and the best training algorithm in Multilayer Perceptron (MLP neural networks for prediction of suspended sediments in Pari River, Perak, Malaysia. Time series data of water discharge and suspended sediments was used to develop MLP and RBF models. A comparison between six basis functions was performed to identify the most appropriate and best basis function for the selected time series of the river’s data. The performance of the models was compared using several statistical measures including coefficient of determination, coefficient of efficiency and mean absolute error. The performance of the best RBF function was compared with the previously identified best training algorithm of MLP neural networks. The results showed that comparison of various basis functions is always advantageous to achieve the most appropriate basis function for the accurate prediction of the time series data. The results also showed that the performances of both particular RBF and MLP models were close to each other and capable to capture the exact pattern of the sediment data in the river. However, the RBF model showed some inconsistency while predicting the time series data. Furthermore, RBF modeling required more investigation to choose appropriate value for the predefined parameters as compared to MLP modeling.
Siamak Khorram
2009-07-01
Full Text Available This paper focuses on an automated ANN classification system consisting of two modules: an unsupervised Kohonen’s Self-Organizing Mapping (SOM neural network module, and a supervised Multilayer Perceptron (MLP neural network module using the Backpropagation (BP training algorithm. Two training algorithms were provided for the SOM network module: the standard SOM, and a refined SOM learning algorithm which incorporated Simulated Annealing (SA. The ability of our automated ANN system to perform Land-Use/Land-Cover (LU/LC classifications of a Landsat Thematic Mapper (TM image was tested using a supervised MLP network, an unsupervised SOM network, and a combination of SOM with SA network. Our case study demonstrated that the ANN classification system fulfilled the tasks of network training pattern creation, network training, and network generalization. The results from the three networks were assessed via a comparison with reference data derived from the high spatial resolution Digital Colour Infrared (CIR Digital Orthophoto Quarter Quad (DOQQ data. The supervised MLP network obtained the most accurate classification accuracy as compared to the two unsupervised SOM networks. Additionally, the classification performance of the refined SOM network was found to be significantly better than that of the standard SOM network essentially due to the incorporation of SA. This is mainly due to the SA-assisted classification utilizing the scheduling cooling scheme. It is concluded that our automated ANN classification system can be utilized for LU/LC applications and will be particularly useful when traditional statistical classification methods are not suitable due to a statistically abnormal distribution of the input data.
Ernesto, Gmez Vargas; Nelson, Obregn Neira; Virgilio, Socarras Quintero.
2010-07-01
Full Text Available Este artculo muestra los resultados obtenidos en la exploracin de la bondad de la implementacin del modelo neurodifuso ANFIS y de las redes neuronales para la prediccin de caudales medios mensuales en la cuenca del Rio Bogot en la ciudad de Villapinzn. Se desarrolla e implementa el modelo ANFI [...] S y se evala el comportamiento de seis modelos, al variar el nmero de entradas, y el nmero y tipo de conjuntos difusos (funciones de pertenencia), que son los parmetros fundamentales del modelo ANFIS. Los resultados se comparan con los obtenidos con las redes neuronales perceptrn multicapa. Abstract in english This paper shows the results in the exploration of the benefits of the implementation of neuro-fuzzy AN-FIS model and neural networks for the prediction of monthly mean flows in the basin of Bogota River in Villapinzn. The ANFIS model is developed, implemented and the performance of six models is e [...] valuated bychanging entries number, number and type of fuzzy sets (membership functions), which are the basic parameters of the ANFIS model. The results are compared with those obtained with multilayer perceptron neural networks.
Multilayer Insulation Material Guidelines
Finckenor, M. M.; Dooling, D.
1999-01-01
Multilayer Insulation Material Guidelines provides data on multilayer insulation materials used by previous spacecraft such as Spacelab and the Long-Duration Exposure Facility and outlines other concerns. The data presented in the document are presented for information only. They can be used as guidelines for multilayer insulation design for future spacecraft provided the thermal requirements of each new design and the environmental effects on these materials are taken into account.
Ed Pinheiro Lima
2003-04-01
Full Text Available As capacidades de interpolao de redes perceptron multicamada (MLP foram utilizadas para resolver um sistema de equaes diferencias ordinrias que modela um reator no-adiabtico com leito fixo e disperso axial. As metodologias descritas neste artigo seguem as propostas por Lagaris et al. (1998, 2000, estendidas para modelos com condies de contorno mistas e pelo uso do mtodo da penalidade para converter o problema de otimizao original de restrito para irrestrito no treinamento das redes MLP. Os resultados so compatveis com aqueles apresentados em Luize e Biscaia (1991, que foram obtidos com tcnicas numricas j consagradas, como elementos finitos e colocao ortogonal. O mtodo de neuro-interpolao adotado neste artigo de fcil manuseio se comparado com os mtodos clssicos para soluo numrica de equaes diferenciais, particularmente para sistemas diferenciais no-lineares, e define uma aproximao global, na forma analtica, para a soluo de problemas.The interpolation capabilities of multilayer perceptron networks (MLP were used to solve a system of ordinary differential equations that models an axial dispersed non-adiabatic fixed bed reactor. The methodologies described in this paper follow the first ones proposed by Lagaris et al. (1998, 2000, but enlarge them to differential models with mix boundary conditions and by the use of the penalty method to convert the original constrained to unconstrained optimization problem in training the MLP networks. The results are in agreement on those in Luize e Biscaia (1991, which were obtained by well-established numerical techniques as finite element and orthogonal collocation methods. The neural interpolation method used in this paper is easier to handle than the classical methods for numerical solution of differential equations, particularly for non-linear differential systems, and defines a global approximation, in analytic form, for problems solution.
N. Baghdadi
2012-06-01
Full Text Available The purpose of this study was to develop an approach to estimate soil surface parameters from C-band polarimetric SAR data in the case of bare agricultural soils. An inversion technique based on multi-layer perceptron (MLP neural networks was introduced. The neural networks were trained and validated on a noisy simulated dataset generated from the Integral Equation Model (IEM on a wide range of surface roughness and soil moisture, as it is encountered in agricultural contexts for bare soils. The performances of neural networks in retrieving soil moisture and surface roughness were tested for several inversion cases using or not using a-priori knowledge on soil parameters. The inversion approach was then validated using RADARSAT-2 images in polarimetric mode. The introduction of expert knowledge on the soil moisture (dry to wet soils or very wet soils improves the soil moisture estimates, whereas the precision on the surface roughness estimation remains unchanged. Moreover, the use of polarimetric parameters ?_{1} and anisotropy were used to improve the soil parameters estimates. These parameters provide to neural networks the probable ranges of soil moisture (lower or higher than 0.30 cm^{3} cm^{?3} and surface roughness (root mean square surface height lower or higher than 1.0 cm. Soil moisture can be retrieved correctly from C-band SAR data by using the neural networks technique. Soil moisture errors were estimated at about 0.098 cm^{3} cm^{?3} without a-priori information on soil parameters and 0.065 cm^{3} cm^{?3} (RMSE applying a-priori information on the soil moisture. The retrieval of surface roughness is possible only for low and medium values (lower than 2 cm. Results show that the precision on the soil roughness estimates was about 0.7 cm. For surface roughness lower than 2 cm, the precision on the soil roughness is better with an RMSE about 0.5 cm. The use of polarimetric parameters improves only slightly the soil parameters estimates.
Baghdadi, N.; Cresson, R.; El Hajj, M.; Ludwig, R.; La Jeunesse, I.
2012-06-01
The purpose of this study was to develop an approach to estimate soil surface parameters from C-band polarimetric SAR data in the case of bare agricultural soils. An inversion technique based on multi-layer perceptron (MLP) neural networks was introduced. The neural networks were trained and validated on a noisy simulated dataset generated from the Integral Equation Model (IEM) on a wide range of surface roughness and soil moisture, as it is encountered in agricultural contexts for bare soils. The performances of neural networks in retrieving soil moisture and surface roughness were tested for several inversion cases using or not using a-priori knowledge on soil parameters. The inversion approach was then validated using RADARSAT-2 images in polarimetric mode. The introduction of expert knowledge on the soil moisture (dry to wet soils or very wet soils) improves the soil moisture estimates, whereas the precision on the surface roughness estimation remains unchanged. Moreover, the use of polarimetric parameters ?1 and anisotropy were used to improve the soil parameters estimates. These parameters provide to neural networks the probable ranges of soil moisture (lower or higher than 0.30 cm3 cm-3) and surface roughness (root mean square surface height lower or higher than 1.0 cm). Soil moisture can be retrieved correctly from C-band SAR data by using the neural networks technique. Soil moisture errors were estimated at about 0.098 cm3 cm-3 without a-priori information on soil parameters and 0.065 cm3 cm-3 (RMSE) applying a-priori information on the soil moisture. The retrieval of surface roughness is possible only for low and medium values (lower than 2 cm). Results show that the precision on the soil roughness estimates was about 0.7 cm. For surface roughness lower than 2 cm, the precision on the soil roughness is better with an RMSE about 0.5 cm. The use of polarimetric parameters improves only slightly the soil parameters estimates.
Application of neural networks to measurement methods based on radiation interactions with matter
The possibility of improving by neuronal techniques the preparation and interpretation of nuclear measurements was investigated. A general methodology was developed and applied to various problems in this field. Whatever the problem to be treated, to solve it comes to determine the relation which binds the inputs to the outputs. Neural networks based on supervised training, like the multilayer Perceptron, have the capability to calculate any relation between a set of input and output data. On the other hand, the training phase is often a long and delicate operation whose difficulties grow with the size of the network: it is thus interesting to reduce it by introducing knowledge a priori and/or by reducing the number of inputs in order to extract the relevant information. If the correlations between the inputs are linear, the Principal Components Analysis (PCA) and its neuronal equivalents make it possible to obtain by orthogonal projection a reduced number of input components while preserving the maximum of initial information. If the correlations are nonlinear, the Curvilinear Components Analysis (CCA) allows, by a unsupervised training, to carry out a nonlinear projection of the inputs in a space of reduced size. Besides, it is noticed that when the dimension of the input space is equal to the intrinsic dimension of the problem, this last is practically solved by CCA. We propose a general method which consists in characterizing as well as possible the problem by its inputs and then to extract and classify the information contained in those by projection in a space of reduced size. Association between the projected data and the problem outputs is then carried out by a supervised training network. Certain results having to be provided with their associated uncertainty, a statistical method based on the bootstrap algorithm is proposed. Potential applications other that those treated are considered. (author)
Modeling of global horizontal irradiance in the United Arab Emirates with artificial neural networks
This paper employs ANN (Artificial Neural Network) models to estimate GHI (global horizontal irradiance) for three major cities in the UAE (United Arab Emirates), namely Abu Dhabi, Dubai and Al-Ain. City data are then used to develop a comprehensive global GHI model for other nearby locations in the UAE. The ANN models use MLP (Multi-Layer Perceptron) and RBF (Radial Basis Function) techniques with comprehensive training algorithms, architectures, and different combinations of inputs. The UAE models are tested and validated against individual city models and data available from the UAE Solar Atlas with good agreement as attested by the computed statistical error parameters. The optimal ANN model is MLP-based and requires four mean daily weather parameters; namely, maximum temperature, wind speed, sunshine hours, and relative humidity. The computed statistical error parameters for the optimal MLP-ANN model in relation to the measured three-cities mean data (referred to as UAE data) are MBE (mean bias error) = −0.0003 kWh/m2, RMSE = 0.179 kWh/m2, R2 = 99%, NSE (Nash-Sutcliffe model Efficiency coefficient) = 99%, and t-statistic = 0.005 at 5% significance level. Results prove the suitability of the ANN models for estimating the monthly mean daily GHI in different locations of the UAE. - Highlights: • ANN prediction models for the GHI (global horizontal irradiance) in the UAE. • Models used to estimate the potential of global solar radiation for UAE cities. • Data from the UAE Solar Atlas are used to validate developed ANN models. • ANN models are more efficient than regression models in predicting GHI
Can artificial neural networks be used to predict the origin of ozone episodes?
Tropospheric ozone is a secondary pollutant having a negative impact on health and environment. To control and minimize such impact the European Community established regulations to promote a clean air all over Europe. However, when an episode is related with natural mechanisms as Stratosphere–Troposphere Exchanges (STE), the benefits of an action plan to minimize precursor emissions are inefficient. Therefore, this work aims to develop a tool to identify the sources of ozone episodes in order to minimize misclassification and thus avoid the implementation of inappropriate air quality plans. For this purpose, an artificial neural network model – the Multilayer Perceptron – is used as a binary classifier of the source of an ozone episode. Long data series, between 2001 and 2010, considering the ozone precursors, 7Be activity and meteorological conditions were used. With this model, 2–7% of a mean error was achieved, which is considered as a good generalization. Accuracy measures for imbalanced data are also discussed. The MCC values show a good performance of the model (0.65–0.92). Precision and F1-measure indicate that the model specifies a little better the rare class. Thus, the results demonstrate that such a tool can be used to help authorities in the management of ozone, namely when its thresholds are exceeded due natural causes, as the above mentioned STE. Therefore, the resources used to implement an action plan to minimize ozone precursors could be better managed avoiding the implementation of inappropriate measures. - Highlights: • ANN can classify the origin of an O3 episode with a mean error around 2-7%. • The best classification is obtained when a simpler input combination is used. • ANN can help authorities to foster O3 action plans to control exceedances
A simulated-based neural network algorithm for forecasting electrical energy consumption in Iran
This study presents an integrated algorithm for forecasting monthly electrical energy consumption based on artificial neural network (ANN), computer simulation and design of experiments using stochastic procedures. First, an ANN approach is illustrated based on supervised multi-layer perceptron (MLP) network for the electrical consumption forecasting. The chosen model, therefore, can be compared to that of estimated by time series model. Computer simulation is developed to generate random variables for monthly electricity consumption. This is achieved to foresee the effects of probabilistic distribution on monthly electricity consumption. The simulated-based ANN model is then developed. Therefore, there are four treatments to be considered in analysis of variance (ANOVA), which are actual data, time series, ANN and simulated-based ANN. Furthermore, ANOVA is used to test the null hypothesis of the above four alternatives being statistically equal. If the null hypothesis is accepted, then the lowest mean absolute percentage error (MAPE) value is used to select the best model, otherwise the Duncan method (DMRT) of paired comparison is used to select the optimum model which could be time series, ANN or simulated-based ANN. In case of ties the lowest MAPE value is considered as the benchmark. The integrated algorithm has several unique features. First, it is flexible and identifies the best model based on the results of ANOVA and MAPE, whereas previous studies consider the best fitted ANN model based on MAPE or relative error results. Second, the proposed algorithm may identify conventional time series as the best model for future electricity consumption forecasting because of its dynamic structure, whereas previous studies assume that ANN always provide the best solutions and estimation. To show the applicability and superiority of the proposed algorithm, the monthly electricity consumption in Iran from March 1994 to February 2005 (131 months) is used and applied to the proposed algorithm
Artificial neural networks as supervised techniques for FT-IR microspectroscopic imaging.
Lasch, Peter; Diem, Max; Hänsch, Wolfgang; Naumann, Dieter
2007-03-28
In this report the applicability of an improved method of image segmentation of infrared microspectroscopic data from histological specimens is demonstrated. Fourier transform infrared (FT-IR) microspectroscopy was used to record hyperspectral data sets from human colorectal adenocarcinomas and to build up a database of spatially resolved tissue spectra. This database of colon microspectra comprised 4120 high-quality FT-IR point spectra from 28 patient samples and 12 different histological structures. The spectral information contained in the database was employed to teach and validate multilayer perceptron artificial neural network (MLP-ANN) models. These classification models were then employed for database analysis and utilised to produce false colour images from complete tissue maps of FT-IR microspectra. An important aspect of this study was also to demonstrate how the diagnostic sensitivity and specificity can be specifically optimised. An example is given which shows that changes of the number of teaching patterns per class can be used to modify these two interrelated test parameters. The definition of ANN topology turned out to be crucial to achieve a high degree of correspondence between the gold standard of histopathology and IR spectroscopy. Particularly, a hierarchical scheme of ANN classification proved to be superior for the reliable classification of tissue spectra. It was found that unsupervised methods of clustering, specifically agglomerative hierarchical clustering (AHC), were helpful in the initial phases of model generation. Optimal classification results could be achieved if the class definitions for the ANNs were carried out by considering the classification information provided by cluster analysis. PMID:19960119
Can artificial neural networks be used to predict the origin of ozone episodes?
Fontes, T., E-mail: trfontes@ua.pt [University Fernando Pessoa, Global Change, Energy, Environment and Bioengineering Center (CIAGEB), Praça 9 de Abril, 349, 4249-004 Porto (Portugal); University of Aveiro, Department of Mechanical Engineering/Centre for Mechanical Technology and Automation, Campus Universitário de Santiago, 3810-193 Aveiro (Portugal); Silva, L.M. [University of Aveiro, Department of Mathematics, Campus Universitário de Santiago, 3810-193 Aveiro (Portugal); INEB — Instituto de Engenharia Biomédica, Rua do Campo Alegre, 823, 4150-180 Porto (Portugal); Silva, M.P.; Barros, N. [University Fernando Pessoa, Global Change, Energy, Environment and Bioengineering Center (CIAGEB), Praça 9 de Abril, 349, 4249-004 Porto (Portugal); Carvalho, A.C. [New University of Lisbon, Faculty of Sciences and Technology/Center for Environmental and Sustainability Research (CENSE), Quinta da Torre, 2829-516 Caparica (Portugal)
2014-08-01
Tropospheric ozone is a secondary pollutant having a negative impact on health and environment. To control and minimize such impact the European Community established regulations to promote a clean air all over Europe. However, when an episode is related with natural mechanisms as Stratosphere–Troposphere Exchanges (STE), the benefits of an action plan to minimize precursor emissions are inefficient. Therefore, this work aims to develop a tool to identify the sources of ozone episodes in order to minimize misclassification and thus avoid the implementation of inappropriate air quality plans. For this purpose, an artificial neural network model – the Multilayer Perceptron – is used as a binary classifier of the source of an ozone episode. Long data series, between 2001 and 2010, considering the ozone precursors, {sup 7}Be activity and meteorological conditions were used. With this model, 2–7% of a mean error was achieved, which is considered as a good generalization. Accuracy measures for imbalanced data are also discussed. The MCC values show a good performance of the model (0.65–0.92). Precision and F{sub 1}-measure indicate that the model specifies a little better the rare class. Thus, the results demonstrate that such a tool can be used to help authorities in the management of ozone, namely when its thresholds are exceeded due natural causes, as the above mentioned STE. Therefore, the resources used to implement an action plan to minimize ozone precursors could be better managed avoiding the implementation of inappropriate measures. - Highlights: • ANN can classify the origin of an O{sub 3} episode with a mean error around 2-7%. • The best classification is obtained when a simpler input combination is used. • ANN can help authorities to foster O{sub 3} action plans to control exceedances.
This paper presents an application of Artificial Neural Networks (ANNs) to predict daily solar radiation. We look at the Multi-Layer Perceptron (MLP) network which is the most used of ANNs architectures. In previous studies, we have developed an ad-hoc time series preprocessing and optimized a MLP with endogenous inputs in order to forecast the solar radiation on a horizontal surface. We propose in this paper to study the contribution of exogenous meteorological data (multivariate method) as time series to our optimized MLP and compare with different forecasting methods: a naive forecaster (persistence), ARIMA reference predictor, an ANN with preprocessing using only endogenous inputs (univariate method) and an ANN with preprocessing using endogenous and exogenous inputs. The use of exogenous data generates an nRMSE decrease between 0.5% and 1% for two stations during 2006 and 2007 (Corsica Island, France). The prediction results are also relevant for the concrete case of a tilted PV wall (1.175 kWp). The addition of endogenous and exogenous data allows a 1% decrease of the nRMSE over a 6 months-cloudy period for the power production. While the use of exogenous data shows an interest in winter, endogenous data as inputs on a preprocessed ANN seem sufficient in summer. -- Research highlights: → Use of exogenous data as ANN inputs to forecast horizontal daily global irradiation data. → New methodology allowing to choice the adequate exogenous data - a systematic method comparing endogenous and exogenous data. → Different referenced mathematical predictors allows to conclude about the pertinence of the proposed methodology.
A Neural-Network-Based Nonlinear Adaptive State-Observer for Pressurized Water Reactors
Zhe Dong
2013-10-01
Full Text Available Although there have been some severe nuclear accidents such as Three Mile Island (USA, Chernobyl (Ukraine and Fukushima (Japan, nuclear fission energy is still a source of clean energy that can substitute for fossil fuels in a centralized way and in a great amount with commercial availability and economic competitiveness. Since the pressurized water reactor (PWR is the most widely used nuclear fission reactor, its safe, stable and efficient operation is meaningful to the current rebirth of the nuclear fission energy industry. Power-level regulation is an important technique which can deeply affect the operation stability and efficiency of PWRs. Compared with the classical power-level controllers, the advanced power-level regulators could strengthen both the closed-loop stability and control performance by feeding back the internal state-variables. However, not all of the internal state variables of a PWR can be obtained directly by measurements. To implement advanced PWR power-level control law, it is necessary to develop a state-observer to reconstruct the unmeasurable state-variables. Since a PWR is naturally a complex nonlinear system with parameters varying with power-level, fuel burnup, xenon isotope production, control rod worth and etc., it is meaningful to design a nonlinear observer for the PWR with adaptability to system uncertainties. Due to this and the strong learning capability of the multi-layer perceptron (MLP neural network, an MLP-based nonlinear adaptive observer is given for PWRs. Based upon Lyapunov stability theory, it is proved theoretically that this newly-built observer can provide bounded and convergent state-observation. This observer is then applied to the state-observation of a special PWR, i.e., the nuclear heating reactor (NHR, and numerical simulation results not only verify its feasibility but also give the relationship between the observation performance and observer parameters.
A morphological perceptron with gradient-based learning for Brazilian stock market forecasting.
Araújo, Ricardo de A
2012-04-01
Several linear and non-linear techniques have been proposed to solve the stock market forecasting problem. However, a limitation arises from all these techniques and is known as the random walk dilemma (RWD). In this scenario, forecasts generated by arbitrary models have a characteristic one step ahead delay with respect to the time series values, so that, there is a time phase distortion in stock market phenomena reconstruction. In this paper, we propose a suitable model inspired by concepts in mathematical morphology (MM) and lattice theory (LT). This model is generically called the increasing morphological perceptron (IMP). Also, we present a gradient steepest descent method to design the proposed IMP based on ideas from the back-propagation (BP) algorithm and using a systematic approach to overcome the problem of non-differentiability of morphological operations. Into the learning process we have included a procedure to overcome the RWD, which is an automatic correction step that is geared toward eliminating time phase distortions that occur in stock market phenomena. Furthermore, an experimental analysis is conducted with the IMP using four complex non-linear problems of time series forecasting from the Brazilian stock market. Additionally, two natural phenomena time series are used to assess forecasting performance of the proposed IMP with other non financial time series. At the end, the obtained results are discussed and compared to results found using models recently proposed in the literature. PMID:22391234
Amit, Yali; Walker, Jacob
2012-01-01
We describe an attractor network of binary perceptrons receiving inputs from a retinotopic visual feature layer. Each class is represented by a random subpopulation of the attractor layer, which is turned on in a supervised manner during learning of the feed forward connections. These are discrete three state synapses and are updated based on a simple field dependent Hebbian rule. For testing, the attractor layer is initialized by the feedforward inputs and then undergoes asynchronous random updating until convergence to a stable state. Classification is indicated by the sub-population that is persistently activated. The contribution of this paper is two-fold. This is the first example of competitive classification rates of real data being achieved through recurrent dynamics in the attractor layer, which is only stable if recurrent inhibition is introduced. Second, we demonstrate that employing three state synapses with feedforward inhibition is essential for achieving the competitive classification rates due to the ability to effectively employ both positive and negative informative features. PMID:22737121
Luciana C. Bucene
2004-12-01
Full Text Available Objetivando classificar terras para irrigação, faz-se necessário analisar e determinar alguns parâmetros, entre eles a produtividade do solo. A classificação de produtividade (comumente chamada fertilidade aparente é delimitada em cinco classes: muito alta, alta, média, baixa e muito baixa, e em cada classe é preciso avaliar certos atributos do solo, como pH, CTC (capacidade de troca de cátions, V% (índice de saturação por bases, P (fósforo, Mg (magnésio e K (potássio. Neste trabalho, objetivou-se identificar a produtividade na qual atributos do solo, da parte inicial da microbacia hidrográfica do Rio Pardo, localizada em Pardinho, SP, foram analisados e classificados nas classes que a delimitam, através de Redes Neurais Artificiais (RNAs utilizandose Perceptron Múltiplas Camadas (Multilayers Perceptrons - MLP com o algoritmo de treinamento "backpropagation"- classificador de padrões, obtendo-se um número ótimo de camadas intermediárias e de neurônios; resultando na classificação de produtividade, a situação ótima da rede obteve 78% dos resultados iguais aos desejados, com duas camadas de neurônios, uma das quais intermediária, com 5 neurônios, e uma camada de saída.Productivity data (commonly known as apparent fertility of the initial part of the river Pardo-SP watershed was analyzed and classified with Artificial Neural Networks (ANNs, in order to classify lands for irrigation. Soil attributes as pH, CEC (cation exchange capacity, V% (base saturation index, P (phosphorus, Mg (magnesium and K (potassium were defined in five classes: very high, high, medium, low and very low. Apparent fertility classification taking into account the five classes was performed by using Multiple Layers Perceptron (MLP. Backpropagation algorithm was performed with the training set. One hidden layer with 5 neurons was the situation that best performed.
System Identification, Prediction, Simulation and Control with Neural Networks
Sørensen, O.
1997-01-01
The intention of this paper is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: 1) Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. 2) Amongst numerous training algorithms, only the Recursive Prediction Error Method using...... a Gauss-Newton search direction is applied. 3) Amongst numerous model types, often met in control applications, only the Non-linear ARMAX (NARMAX) model, representing input/output description, is examined. A simulated example confirms that a neural network has the potential to perform excellent...
Back Propagation Neural Network Arabic Characters Classification Module Utilizing Microsoft Word
A. A. Hamza
2008-01-01
Full Text Available Problem statement: Arabic character recognition has been one of the last major languages to receive attention. This may be attributed to the inherent complexity of both printed and handwritten Arabic characters. The objectives of this study were to: (i summarize the main characteristics of Arabic language writing style. (ii suggest a neural network recognition circuit. Approach: A Neural network with back propagation training mechanism for classification was designed and trained to recognize any set of character combinations, sizes or fonts used in Microsoft word. Results: The proposed network recognition behaviours were compared with perceptron-like net that combines perceptron with ADALINE features. These circuits were tested for three character sets combinations; 28 basic Arabic characters plus 10 numerals set, 52 Latin characters and 10 numerals only. Conclusions: The method was robust and flexible and can be easily extended to any character set. The network exhibited recognition rates approaching 100% with reasonable noise tolerance.