Parallel multilayer perceptron neural network used for hyperspectral image classification
Garcia-Salgado, Beatriz P.; Ponomaryov, Volodymyr I.; Robles-Gonzalez, Marco A.
2016-04-01
This study is focused on time optimization for the classification problem presenting a comparison of five Artificial Neural Network Multilayer Perceptron (ANN-MLP) architectures. We use the Artificial Neural Network (ANN) because it allows to recognize patterns in data in a lower time rate. Time and classification accuracy are taken into account together for the comparison. According to time comparison, two paradigms in the computational field for each ANN-MLP architecture are analysed with three schemes. Firstly, sequential programming is applied by using a single CPU core. Secondly, parallel programming is employed over a multi-core CPU architecture. Finally, a programming model running on GPU architecture is implemented. Furthermore, the classification accuracy is compared between the proposed five ANN-MLP architectures and a state-of.the-art Support Vector Machine (SVM) with three classification frames: 50%,60% and 70% of the data set's observations are randomly selected to train the classifiers. Also, a visual comparison of the classified results is presented. The Peak Signal to Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) criteria are also calculated to characterise visual perception. The images employed were acquired by the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS), the Reflective Optics System Imaging Spectrometer (ROSIS) and the Hyperion sensor.
Classification of fused face images using multilayer perceptron neural network
Bhattacharjee, Debotosh; Nasipuri, Mita; Basu, Dipak Kumar; Kundu, Mahantapas
2010-01-01
This paper presents a concept of image pixel fusion of visual and thermal faces, which can significantly improve the overall performance of a face recognition system. Several factors affect face recognition performance including pose variations, facial expression changes, occlusions, and most importantly illumination changes. So, image pixel fusion of thermal and visual images is a solution to overcome the drawbacks present in the individual thermal and visual face images. Fused images are projected into eigenspace and finally classified using a multi-layer perceptron. In the experiments we have used Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database benchmark thermal and visual face images. Experimental results show that the proposed approach significantly improves the verification and identification performance and the success rate is 95.07%. The main objective of employing fusion is to produce a fused image that provides the most detailed and reliable information. Fusion of multip...
Directory of Open Access Journals (Sweden)
Flávio Clésio Silva de Souza
2014-06-01
Full Text Available The purpose of the present research is to apply a Multilayer Perceptron (MLP neural network technique to create classification models from a portfolio of Non-Performing Loans (NPLs to classify this type of credit derivative. These credit derivatives are characterized as the amount of loans that were not paid and are already overdue more than 90 days. Since these titles are, because of legislative motives, moved by losses, Credit Rights Investment Funds (FDIC performs the purchase of these debts and the recovery of the credits. Using the Multilayer Perceptron (MLP architecture of Artificial Neural Network (ANN, classification models regarding the posterior recovery of these debts were created. To evaluate the performance of the models, evaluation metrics of classification relating to the neural networks with different architectures were presented. The results of the classifications were satisfactory, given the classification models were successful in the presented economics costs structure.
Ceballos-Magaña, Silvia G; de Pablos, Fernando; Jurado, José Marcos; Martín, María Jesús; Alcázar, Ángela; Muñiz-Valencia, Roberto; Gonzalo-Lumbreras, Raquel; Izquierdo-Hornillos, Roberto
2013-02-15
Differentiation of silver, gold, aged and extra-aged tequila using 1-propanol, ethyl acetate, 2-methyl-1-propanol, 3-methyl-1-butanol and 2-methyl-1-butanol and furan derivatives like 5-(hydroxymethyl)-2-furaldehyde and 2-furaldehyde has been carried out. The content of 1-propanol, ethyl acetate, 2-methyl-1-propanol, 3-methyl-1-butanol and 2-methyl-1-butanol was determined by means of head space solid phase microextraction gas chromatography mass-spectrometry. 5-(Hydroxymethyl)-2-furaldehyde and 2-furaldehyde were determined by high performance liquid chromatography with diode array detection. Kruskal-Wallis test was used to highlight significant differences between types of tequila. Principal component analysis was applied as visualisation technique. Linear discriminant analysis and multilayer perceptron artificial neural networks were used to construct classification models. The best classification performance was obtained when multilayer perceptron model was applied.
Classification of fuels using multilayer perceptron neural networks
International Nuclear Information System (INIS)
Electrical impedance data obtained with an array of conducting polymer chemical sensors was used by a neural network (ANN) to classify fuel adulteration. Real samples were classified with accuracy greater than 90% in two groups: approved and adulterated.
Zhang, Haowei; Gao, Yanni; Yuan, Chengmei; Liu, Ying; Ding, Yuqing
2015-06-01
Multi-layer perceptron (MLP) neural network belongs to multi-layer feedforward neural network, and has the ability and characteristics of high intelligence. It can realize the complex nonlinear mapping by its own learning through the network. Bipolar disorder is a serious mental illness with high recurrence rate, high self-harm rate and high suicide rate. Most of the onset of the bipolar disorder starts with depressive episode, which can be easily misdiagnosed as unipolar depression and lead to a delayed treatment so as to influence the prognosis. The early identifica- tion of bipolar disorder is of great importance for patients with bipolar disorder. Due to the fact that the process of early identification of bipolar disorder is nonlinear, we in this paper discuss the MLP neural network application in early identification of bipolar disorder. This study covered 250 cases, including 143 cases with recurrent depression and 107 cases with bipolar disorder, and clinical features were statistically analyzed between the two groups. A total of 42 variables with significant differences were screened as the input variables of the neural network. Part of the samples were randomly selected as the learning sample, and the other as the test sample. By choosing different neu- ral network structures, all results of the identification of bipolar disorder were relatively good, which showed that MLP neural network could be used in the early identification of bipolar disorder.
Directory of Open Access Journals (Sweden)
Mohammad Fathian
2012-04-01
Full Text Available In this paper, the problem of predicting the exchange rate time series in the foreign exchange rate market is going to be solved using a time-delayed multilayer perceptron neural network with gold price as external factor. The input for the learning phase of the artificial neural network are the exchange rate data of the last five days plus the gold price in two different currencies of the exchange rate as the external factor for helping the artificial neural network improving its forecast accuracy. The five-day delay has been chosen because of the weekly cyclic behavior of the exchange rate time series with the consideration of two holidays in a week. The result of forecasts are then compared with using the multilayer peceptron neural network without gold price external factor by two most important evaluation techniques in the literature of exchange rate prediction. For the experimental analysis phase, the data of three important exchange rates of EUR/USD, GBP/USD, and USD/JPY are used.
An Analog Multilayer Perceptron Neural Network for a Portable Electronic Nose
Directory of Open Access Journals (Sweden)
Chih-Heng Pan
2012-12-01
Full Text Available This study examines an analog circuit comprising a multilayer perceptron neural network (MLPNN. This study proposes a low-power and small-area analog MLP circuit to implement in an E-nose as a classifier, such that the E-nose would be relatively small, power-efficient, and portable. The analog MLP circuit had only four input neurons, four hidden neurons, and one output neuron. The circuit was designed and fabricated using a 0.18 μm standard CMOS process with a 1.8 V supply. The power consumption was 0.553 mW, and the area was approximately 1.36 × 1.36 mm2. The chip measurements showed that this MLPNN successfully identified the fruit odors of bananas, lemons, and lychees with 91.7% accuracy.
International Nuclear Information System (INIS)
SMEs (Small and Medium Sized Enterprises) sector is facing problems relating to implementation of international quality standards. These SMEs need to identify factors affecting business success abroad for intelligent allocation of resources to the process of internationalization. In this paper, MLP NN (Multi-Layer Perceptron Neural Network) has been used for identifying relative importance of key variables related to firm basics, manufacturing, quality inspection labs and level of education in determining the exporting status of Pakistani SMEs. A survey has been conducted for scoring out the pertinent variables in SMEs and coded in MLP NNs. It is found that firm registered with OEM (Original Equipment Manufacturer) and size of firm are the most important in determining exporting status of SMEs followed by other variables. For internationalization, the results aid policy makers in formulating strategies. (author)
Highly Accurate Multi-layer Perceptron Neural Network for Air Data System
Directory of Open Access Journals (Sweden)
H. S. Krishna
2009-11-01
Full Text Available The error backpropagation multi-layer perceptron algorithm is revisited. This algorithm is used to train and validate two models of three-layer neural networks that can be used to calibrate a 5-hole pressure probe. This paper addresses Occam's Razor problem as it describes the adhoc training methodology applied to improve accuracy and sensitivity. The trained outputs from 5-4-3 feed-forward network architecture with jump connection are comparable to second decimal digit (~0.05 accuracy, hitherto unreported in literature.Defence Science Journal, 2009, 59(6, pp.670-674, DOI:http://dx.doi.org/10.14429/dsj.59.1574
Directory of Open Access Journals (Sweden)
Umar Draz
2016-01-01
Full Text Available SMEs (Small and Medium Sized Enterprises sector is facing problems relating to implementation of international quality standards. These SMEs need to identify factors affecting business success abroad for intelligent allocation of resources to the process of internationalization. In this paper, MLP NN (Multi-Layer Perceptron Neural Network has been used for identifying relative importance of key variables related to firm basics, manufacturing, quality inspection labs and level of education in determining the exporting status of Pakistani SMEs. A survey has been conducted for scoring out the pertinent variables in SMEs and coded in MLP NNs. It is found that ?firm registered with OEM (Original Equipment Manufacturer and ?size of firm? are the most important in determining exporting status of SMEs followed by other variables. For internationalization, the results aid policy makers in formulating strategies
Vanzella, E; Fontana, A; Nonino, M; Arnouts, S; Giallongo, E; Grazian, A; Fasano, G; Popesso, P; Saracco, P; Zaggia, S R
2003-01-01
We present a technique for the estimation of photometric redshifts based on feed-forward neural networks. The Multilayer Perceptron (MLP) Artificial Neural Network is used to predict photometric redshifts in the HDF-S from an ultra deep multicolor catalog. Various possible approaches for the training of the neural network are explored, including the deepest and most complete spectroscopic redshift catalog currently available (the Hubble Deep Field North dataset) and models of the spectral energy distribution of galaxies available in the literature. The MLP can be trained on observed data, theoretical data and mixed samples. The prediction of the method is tested on the spectroscopic sample in the HDF-S (44 galaxies). Over the entire redshift range, $0.1
Geomagnetic Dst index forecast using a multilayer perceptrons artificial neural network
International Nuclear Information System (INIS)
Complete text of publication follows. The best known manifestations of the impact of solar wind on the magnetosphere are the geomagnetic storms. The prediction of geomagnetic field behavior allows the alert of geomagnetic storms occurrence, as those phenomena can cause many damages in the planet. The Artificial Intelligence tools have been applied in many multidisciplinary studies, covering several areas of knowledge, as a choice of approach to the solution of problems with characteristics like non-linearity, imprecision, and other features that can not be easily solved with conventional computational models. Techniques such as Artificial Neural Networks, Expert Systems and Decision Trees have been used in the Space Weather studies to perform tasks such as forecasting geomagnetic storms and the investigation of rules and parameters related on its occurrence. The main focus of this work is on forecasting the geomagnetic field behavior, represented this time by the Dst index, using for that task, mainly, the interplanetary magnetic field components and solar wind data. The tool chosen here to solve the non-linear problem was a Multi-layer Perceptrons Artificial Neural Network, trained with the backpropagation algorithm. Unlike what was done in other studies, we chose to predict calm and disturbed periods like, for example, a full month of data, for application in a real time forecasting system. It was possible to predict the geomagnetic Dst index one or two hours before with great percentage efficiency.
Ahmed, Kamal; Shahid, Shamsuddin; Haroon, Sobri Bin; Xiao-jun, Wang
2015-08-01
Downscaling rainfall in an arid region is much challenging compared to wet region due to erratic and infrequent behaviour of rainfall in the arid region. The complexity is further aggregated due to scarcity of data in such regions. A multilayer perceptron (MLP) neural network has been proposed in the present study for the downscaling of rainfall in the data scarce arid region of Baluchistan province of Pakistan, which is considered as one of the most vulnerable areas of Pakistan to climate change. The National Center for Environmental Prediction (NCEP) reanalysis datasets from 20 grid points surrounding the study area were used to select the predictors using principal component analysis. Monthly rainfall data for the time periods 1961-1990 and 1991-2001 were used for the calibration and validation of the MLP model, respectively. The performance of the model was assessed using various statistics including mean, variance, quartiles, root mean square error (RMSE), mean bias error (MBE), coefficient of determination (R 2) and Nash-Sutcliffe efficiency (NSE). Comparisons of mean monthly time series of observed and downscaled rainfall showed good agreement during both calibration and validation periods, while the downscaling model was found to underpredict rainfall variance in both periods. Other statistical parameters also revealed good agreement between observed and downscaled rainfall during both calibration and validation periods in most of the stations.
Indian Academy of Sciences (India)
Kamal Ahmed; Shamsuddin Shahid; Sobri Bin Haroon; Wang Xiao-Jun
2015-08-01
Downscaling rainfall in an arid region is much challenging compared to wet region due to erratic and infrequent behaviour of rainfall in the arid region. The complexity is further aggregated due to scarcity of data in such regions. A multilayer perceptron (MLP) neural network has been proposed in the present study for the downscaling of rainfall in the data scarce arid region of Baluchistan province of Pakistan, which is considered as one of the most vulnerable areas of Pakistan to climate change. The National Center for Environmental Prediction (NCEP) reanalysis datasets from 20 grid points surrounding the study area were used to select the predictors using principal component analysis. Monthly rainfall data for the time periods 1961–1990 and 1991–2001 were used for the calibration and validation of the MLP model, respectively. The performance of the model was assessed using various statistics including mean, variance, quartiles, root mean square error (RMSE), mean bias error (MBE), coefficient of determination (R2) and Nash–Sutcliffe efficiency (NSE). Comparisons of mean monthly time series of observed and downscaled rainfall showed good agreement during both calibration and validation periods, while the downscaling model was found to underpredict rainfall variance in both periods. Other statistical parameters also revealed good agreement between observed and downscaled rainfall during both calibration and validation periods in most of the stations.
Institute of Scientific and Technical Information of China (English)
无
2007-01-01
Anaerobic treatability of synthetic sago wastewater was investigated in a laboratory anaerobic tapered fluidized bed reactor (ATFBR) with a mesoporous granular activated carbon (GAC) as a support material. The experimental protocol was defined to examine the effect of the maximum organic loading rate (OLR), hydraulic retention time (HRT), the efficiency of the reactor and to report on its steady-state performance. The reactor was subjected to a steady-state operation over a range of OLR up to 85.44 kg COD/(m3·d). The COD removal efficiency was found to be 92% in the reactor while the biogas produced in the digester reached 25.38 m3/(m3·d) of the reactor. With the increase of OLR from 83.7 kg COD/(m3·d), the COD removal efficiency decreases. Also an artificial neural network (ANN) model using multilayer perceptron (MLP) has been developed for a system of two input variable and five output dependent variables. For the training of the input-output data, the experimental values obtained have been used. The output parameters predicted have been found to be much closer to the corresponding experimental ones and the model was validated for 30% of the untrained data. The mean square error (MSE) was found to be only 0.0146.
Quaternionic Multilayer Perceptron with Local Analyticity
Directory of Open Access Journals (Sweden)
Nobuyuki Matsui
2012-11-01
Full Text Available A multi-layered perceptron type neural network is presented and analyzed in this paper. All neuronal parameters such as input, output, action potential and connection weight are encoded by quaternions, which are a class of hypercomplex number system. Local analytic condition is imposed on the activation function in updating neurons’ states in order to construct learning algorithm for this network. An error back-propagation algorithm is introduced for modifying the connection weights of the network.
Directory of Open Access Journals (Sweden)
Alireza Taravat
2014-12-01
Full Text Available Oil spills represent a major threat to ocean ecosystems and their environmental status. Previous studies have shown that Synthetic Aperture Radar (SAR, as its recording is independent of clouds and weather, can be effectively used for the detection and classification of oil spills. Dark formation detection is the first and critical stage in oil-spill detection procedures. In this paper, a novel approach for automated dark-spot detection in SAR imagery is presented. A new approach from the combination of adaptive Weibull Multiplicative Model (WMM and MultiLayer Perceptron (MLP neural networks is proposed to differentiate between dark spots and the background. The results have been compared with the results of a model combining non-adaptive WMM and pulse coupled neural networks. The presented approach overcomes the non-adaptive WMM filter setting parameters by developing an adaptive WMM model which is a step ahead towards a full automatic dark spot detection. The proposed approach was tested on 60 ENVISAT and ERS2 images which contained dark spots. For the overall dataset, an average accuracy of 94.65% was obtained. Our experimental results demonstrate that the proposed approach is very robust and effective where the non-adaptive WMM & pulse coupled neural network (PCNN model generates poor accuracies.
Directory of Open Access Journals (Sweden)
Murat Kayri
2010-01-01
Full Text Available Problem statement: The aim of the present study is to exemplify the use of Artificial Neural Networks (ANN for parameter prediction. Missing value or unreal approach to some questions in scale is a problem for unbiased findings. To learn a real pattern with ANN provides robust and unbiased parameter estimation. Approach: To this end, data was collected from 906 students using ?Scale of student views about the expected situations and the current expectations from their families during learning process? for the study entitled ?Student views about the expected situations and the current expectations from their families during learning process?. In the study, first the initial data set gathered using the measurement tool and the new data set produced by Multi-Layer Receptors algorithm, which was considered as the highest predictive level of ANN for the research were individually analyzed by Chaid analysis and the results of the two analyses were compared. Results: The findings showed that as a result of Chaid analysis with the initial data set the variable ?education level of mother? had a considerable effect on total score dependent variable, while ?education level of father? was the influential variable on the attitude level in the data set predicted by ANN, unlike the previous model. Conclusion/Recommendations: The findings of the research show Artificial Neural Networks could be used for parameter estimation in cause-effect based studies. It is also thought the research will contribute to extensive use of advanced statistical methods.
Directory of Open Access Journals (Sweden)
Mawloud GUERMOUI
2016-07-01
Full Text Available Accurate estimation of Daily Global Solar Radiation (DGSR has been a major goal for solar energy application. However, solar radiation measurements are not a simple task for several reasons. In the cases where data are not available, it is very common the use of computational models to estimate the missing data, which are based mainly of the search for relationships between weather variables, such as temperature, humidity, sunshine duration, etc. In this respect, the present study focuses on the development of artificial neural network (ANN model for estimation of daily global solar radiation on horizontal surface in Ghardaia city (South Algeria. In this analysis back-propagation algorithm is applied. Daily mean air temperature, relative humidity and sunshine duration was used as climatic inputs parameters, while the daily global solar radiation (DGSR was the only output of the ANN. We have evaluated Multi-Layer Perceptron (MLP models to estimate DGSR using three year of measurement (2005-2008. It was found that MLP-model based on sunshine duration and mean air temperature give accurate results in term of Mean Absolute Bias Error, Root Mean Square Error, Relative Square Error and Correlation Coefficient. The obtained values of these indicators are 0.67 MJ/m², 1.28 MJ/m², 6.12%and 98.18%, respectively which shows that MLP is highly qualified for DGSR estimation in semi-arid climates.
Extreme Learning Machine for Multilayer Perceptron.
Tang, Jiexiong; Deng, Chenwei; Huang, Guang-Bin
2016-04-01
Extreme learning machine (ELM) is an emerging learning algorithm for the generalized single hidden layer feedforward neural networks, of which the hidden node parameters are randomly generated and the output weights are analytically computed. However, due to its shallow architecture, feature learning using ELM may not be effective for natural signals (e.g., images/videos), even with a large number of hidden nodes. To address this issue, in this paper, a new ELM-based hierarchical learning framework is proposed for multilayer perceptron. The proposed architecture is divided into two main components: 1) self-taught feature extraction followed by supervised feature classification and 2) they are bridged by random initialized hidden weights. The novelties of this paper are as follows: 1) unsupervised multilayer encoding is conducted for feature extraction, and an ELM-based sparse autoencoder is developed via l1 constraint. By doing so, it achieves more compact and meaningful feature representations than the original ELM; 2) by exploiting the advantages of ELM random feature mapping, the hierarchically encoded outputs are randomly projected before final decision making, which leads to a better generalization with faster learning speed; and 3) unlike the greedy layerwise training of deep learning (DL), the hidden layers of the proposed framework are trained in a forward manner. Once the previous layer is established, the weights of the current layer are fixed without fine-tuning. Therefore, it has much better learning efficiency than the DL. Extensive experiments on various widely used classification data sets show that the proposed algorithm achieves better and faster convergence than the existing state-of-the-art hierarchical learning methods. Furthermore, multiple applications in computer vision further confirm the generality and capability of the proposed learning scheme. PMID:25966483
Conventional modeling of the multilayer perceptron using polynomial basis functions
Chen, Mu-Song; Manry, Michael T.
1993-01-01
A technique for modeling the multilayer perceptron (MLP) neural network, in which input and hidden units are represented by polynomial basis functions (PBFs), is presented. The MLP output is expressed as a linear combination of the PBFs and can therefore be expressed as a polynomial function of its inputs. Thus, the MLP is isomorphic to conventional polynomial discriminant classifiers or Volterra filters. The modeling technique was successfully applied to several trained MLP networks.
KLASIFIKASI WEBSITE MENGGUNAKAN ALGORITMA MULTILAYER PERCEPTRON
Directory of Open Access Journals (Sweden)
Nyoman Purnama
2014-12-01
Full Text Available Sistem klasifikasi merupakan proses temu balik informasi yang sangat bergantung dari elemen-elemen penyusunnya.Sistem ini banyak digunakan untuk mengatasi permasalahan segmentasi data. Klasifikasi dapat digunakan pada website sebagaimetode untuk mengelompokkan website. Website merupakan salah satu data yang memiliki informasi yang beraneka-ragam,sehingga pengelompokan data ini penting untuk diteliti. Sistem klasifikasi dimulai dengan melakukan proses pengumpulaninformasi dari halaman website (parsing dan untuk setiap hasil parsing dilakukan proses penghapusan kata henti, stemming,feature selection dengan tf-idf. Hasil dari proses ini berupa fitur yang menjadi inputan algoritma Multilayer Perceptron. Dalamalgoritma ini terjadi proses pembelajaran terhadap pola input masukan dan pembuatan bobot pelatihan. Bobot ini akandigunakan pada proses klasifikasi. Hasil dari penelitian menunjukkan bahwa algoritma Multilayer Perceptron dapatmenghasilkan klasifikasi website dengan akurasi yang bagus. Hal ini dibuktikan dengan beberapa tahapan penelitian yangberbeda dan didapatkan nilai akurasi rata-rata diatas 70%.
Cheng, Jie; Xiao, Qing; Li, Xiao-Wen; Liu, Qin-Huo; Du, Yong-Ming
2008-04-01
The present paper firstly points out the defect of typical temperature and emissivity separation algorithms when dealing with hyperspectral FTIR data: the conventional temperature and emissivity algorithms can not reproduce correct emissivity value when the difference between the ground-leaving radiance and object's blackbody radiation at its true temperature and the instrument random noise are on the same order, and this phenomenon is very prone to occur rence near 714 and 1 250 cm(-1) in the field measurements. In order to settle this defect, a three-layer perceptron neural network has been introduced into the simultaneous inversion of temperature and emissivity from hyperspectral FTIR data. The soil emissivity spectra from the ASTER spectral library were used to produce the training data, the soil emissivity spectra from the MODIS spectral library were used to produce the test data, and the result of network test shows the MLP is robust. Meanwhile, the ISSTES algorithm was used to retrieve the temperature and emissivity form the test data. By comparing the results of MLP and ISSTES, we found the MLP can overcome the disadvantage of typical temperature and emisivity separation, although the rmse of derived emissivity using MLP is lower than the ISSTES as a whole. Hence, the MLP can be regarded as a beneficial complementarity of the typical temperature and emissivity separation.
Cheng, Jie; Xiao, Qing; Li, Xiao-Wen; Liu, Qin-Huo; Du, Yong-Ming
2008-04-01
The present paper firstly points out the defect of typical temperature and emissivity separation algorithms when dealing with hyperspectral FTIR data: the conventional temperature and emissivity algorithms can not reproduce correct emissivity value when the difference between the ground-leaving radiance and object's blackbody radiation at its true temperature and the instrument random noise are on the same order, and this phenomenon is very prone to occur rence near 714 and 1 250 cm(-1) in the field measurements. In order to settle this defect, a three-layer perceptron neural network has been introduced into the simultaneous inversion of temperature and emissivity from hyperspectral FTIR data. The soil emissivity spectra from the ASTER spectral library were used to produce the training data, the soil emissivity spectra from the MODIS spectral library were used to produce the test data, and the result of network test shows the MLP is robust. Meanwhile, the ISSTES algorithm was used to retrieve the temperature and emissivity form the test data. By comparing the results of MLP and ISSTES, we found the MLP can overcome the disadvantage of typical temperature and emisivity separation, although the rmse of derived emissivity using MLP is lower than the ISSTES as a whole. Hence, the MLP can be regarded as a beneficial complementarity of the typical temperature and emissivity separation. PMID:18619297
A Parallel Framework for Multilayer Perceptron for Human Face Recognition
Bhowmik, M K; Nasipuri, M; Basu, D K; Kundu, M
2010-01-01
Artificial neural networks have already shown their success in face recognition and similar complex pattern recognition tasks. However, a major disadvantage of the technique is that it is extremely slow during training for larger classes and hence not suitable for real-time complex problems such as pattern recognition. This is an attempt to develop a parallel framework for the training algorithm of a perceptron. In this paper, two general architectures for a Multilayer Perceptron (MLP) have been demonstrated. The first architecture is All-Class-in-One-Network (ACON) where all the classes are placed in a single network and the second one is One-Class-in-One-Network (OCON) where an individual single network is responsible for each and every class. Capabilities of these two architectures were compared and verified in solving human face recognition, which is a complex pattern recognition task where several factors affect the recognition performance like pose variations, facial expression changes, occlusions, and ...
IDENTIFIKASI GORESAN DASAR MANDARIN DENGAN METODE MULTILAYER PERCEPTRON
Directory of Open Access Journals (Sweden)
Dewi
2015-02-01
Full Text Available Mandarin Language is the second international language after English Language. Mandarin Language is different with English Language. Mandarin Language consists of stroke, intonation and pin yin. The basic strokes in Mandarin Language are eleven strokes. In this research, author identifies the basic stroke of Mandarin using Multilayer Perceptron to determine how the accuracy of Multilayer Perceptron to recognize the strokes. Data of the basic stroke of Mandarin that used are strokes from several different people.The data has been saved in image with size 80x80 pixel and changed into black and white image. Then taking the FFT and Mean Citra value from the image. The next step is training the data, determining the target and implementation the multilayer perceptron method. The accuracy that reached by multilayer perceptron method in identifying the basic stroke of Mandarin is 59.09% with 45 node of hidden layer. The node amount of hidden layer very affect the output value.
Institute of Scientific and Technical Information of China (English)
Bharatendra RAI; Nanua SINGH
2005-01-01
Automobile companies that spend billions of dollars annually towards warranty cost, give high priority to warranty reduction programs. Forecasting of automobile warranty performance plays an important role towards these efforts. The forecasting process involves prediction of not only the specific months-in-service (MIS) warranty performance at certain future time, but also at future MIS values. However, 'maturing data' (also called warranty growth) phenomena that causes warranty performance at specific MIS values to change with time, makes such a forecasting task challenging.Although warranty forecasting methods such as log-log plots and dynamic linear models appear in this paper we use an artificial neural network for the forecasting of warranty performance in presence testing errors using response surface methodology. This application shows the effectiveness of neural phenomena.
A Parallel Framework for Multilayer Perceptron for Human Face Recognition
Directory of Open Access Journals (Sweden)
Mita Nasipuri
2010-01-01
Full Text Available Artificial neural networks have already shown their success in face recognition and similar complex pattern recognition tasks. However, a major disadvantage of the technique is that it is extremely slow during training for larger classes and hence not suitable for real-time complex problems such as pattern recognition. This is an attempt to develop a parallel framework for the training algorithm of a perceptron. In this paper, two general architectures for a Multilayer Perceptron (MLP have been demonstrated. The first architecture is All-Class-in-One-Network (ACON where all the classes are placed in a single network and the second one is One-Class-in-One-Network (OCON where an individual single network is responsible for each and every class. Capabilities of these two architectures were compared and verified in solving human face recognition, which is a complex pattern recognition task where several factors affect the recognition performance like pose variations, facial expression changes, occlusions, and most importantly illumination changes. Experimental results show that the proposed OCON structure performs better than the conventional ACON in terms of network training convergence speed and which can be easily exercised in a parallel environment.
Forecasting PM10 in Algiers: efficacy of multilayer perceptron networks.
Abderrahim, Hamza; Chellali, Mohammed Reda; Hamou, Ahmed
2016-01-01
Air quality forecasting system has acquired high importance in atmospheric pollution due to its negative impacts on the environment and human health. The artificial neural network is one of the most common soft computing methods that can be pragmatic for carving such complex problem. In this paper, we used a multilayer perceptron neural network to forecast the daily averaged concentration of the respirable suspended particulates with aerodynamic diameter of not more than 10 μm (PM10) in Algiers, Algeria. The data for training and testing the network are based on the data sampled from 2002 to 2006 collected by SAMASAFIA network center at El Hamma station. The meteorological data, air temperature, relative humidity, and wind speed, are used as inputs network parameters in the formation of model. The training patterns used correspond to 41 days data. The performance of the developed models was evaluated on the basis index of agreement and other statistical parameters. It was seen that the overall performance of model with 15 neurons is better than the ones with 5 and 10 neurons. The results of multilayer network with as few as one hidden layer and 15 neurons were quite reasonable than the ones with 5 and 10 neurons. Finally, an error around 9% has been reached.
Directory of Open Access Journals (Sweden)
Khuat Thanh Tung
2016-11-01
Full Text Available Optical Character Recognition plays an important role in data storage and data mining when the number of documents stored as images is increasing. It is expected to find the ways to convert images of typewritten or printed text into machine-encoded text effectively in order to support for the process of information handling effectively. In this paper, therefore, the techniques which are being used to convert image into editable text in the computer such as principal component analysis, multilayer perceptron network, self-organizing maps, and improved multilayer neural network using principal component analysis are experimented. The obtained results indicated the effectiveness and feasibility of the proposed methods.
Validation of Infinite Impulse Response Multilayer Perceptron for Modelling Nuclear Dynamics
Directory of Open Access Journals (Sweden)
F. Cadini
2008-01-01
Full Text Available Artificial neural networks are powerful algorithms for constructing nonlinear empirical models from operational data. Their use is becoming increasingly popular in the complex modeling tasks required by diagnostic, safety, and control applications in complex technologies such as those employed in the nuclear industry. In this paper, the nonlinear modeling capabilities of an infinite impulse response multilayer perceptron (IIR-MLP for nuclear dynamics are considered in comparison to static modeling by a finite impulse response multilayer perceptron (FIR-MLP and a conventional static MLP. The comparison is made with respect to the nonlinear dynamics of a nuclear reactor as investigated by IIR-MLP in a previous paper. The superior performance of the locally recurrent scheme is demonstrated.
Implementing Semantic Deduction of Propositional Knowledge in an Extension Multi-layer Perceptron
Institute of Scientific and Technical Information of China (English)
HUANGTian-min; PEIZheng
2003-01-01
The paper presents an extension multi-layer perceptron model that is capable of representing and reasoning propositional knowledge base. An extended version of propositional calculus is developed,and its some properties is discussed. Formulas of the extended calculus can be expressed in the extension multi-layer perceptron. Naturally, semantic deduction of propositional knowledge base can be imple-ment by the extension multi-layer perceptron, and by learning, an unknown formula set can be found.
Sartori, Michael A.; Passino, Kevin M.; Antsaklis, Panos J.
1992-01-01
In rule-based AI planning, expert, and learning systems, it is often the case that the left-hand-sides of the rules must be repeatedly compared to the contents of some 'working memory'. The traditional approach to solve such a 'match phase problem' for production systems is to use the Rete Match Algorithm. Here, a new technique using a multilayer perceptron, a particular artificial neural network model, is presented to solve the match phase problem for rule-based AI systems. A syntax for premise formulas (i.e., the left-hand-sides of the rules) is defined, and working memory is specified. From this, it is shown how to construct a multilayer perceptron that finds all of the rules which can be executed for the current situation in working memory. The complexity of the constructed multilayer perceptron is derived in terms of the maximum number of nodes and the required number of layers. A method for reducing the number of layers to at most three is also presented.
Pham, Binh Thai; Tien Bui, Dieu; Pourghasemi, Hamid Reza; Indra, Prakash; Dholakia, M. B.
2015-12-01
The objective of this study is to make a comparison of the prediction performance of three techniques, Functional Trees (FT), Multilayer Perceptron Neural Networks (MLP Neural Nets), and Naïve Bayes (NB) for landslide susceptibility assessment at the Uttarakhand Area (India). Firstly, a landslide inventory map with 430 landslide locations in the study area was constructed from various sources. Landslide locations were then randomly split into two parts (i) 70 % landslide locations being used for training models (ii) 30 % landslide locations being employed for validation process. Secondly, a total of eleven landslide conditioning factors including slope angle, slope aspect, elevation, curvature, lithology, soil, land cover, distance to roads, distance to lineaments, distance to rivers, and rainfall were used in the analysis to elucidate the spatial relationship between these factors and landslide occurrences. Feature selection of Linear Support Vector Machine (LSVM) algorithm was employed to assess the prediction capability of these conditioning factors on landslide models. Subsequently, the NB, MLP Neural Nets, and FT models were constructed using training dataset. Finally, success rate and predictive rate curves were employed to validate and compare the predictive capability of three used models. Overall, all the three models performed very well for landslide susceptibility assessment. Out of these models, the MLP Neural Nets and the FT models had almost the same predictive capability whereas the MLP Neural Nets (AUC = 0.850) was slightly better than the FT model (AUC = 0.849). The NB model (AUC = 0.838) had the lowest predictive capability compared to other models. Landslide susceptibility maps were final developed using these three models. These maps would be helpful to planners and engineers for the development activities and land-use planning.
Classification of Log-Polar-Visual Eigenfaces using Multilayer Perceptron
Bhowmik, Mrinal Kanti; Nasipuri, Mita; Kundu, Mahantapas; Basu, Dipak Kumar
2010-01-01
In this paper we present a simple novel approach to tackle the challenges of scaling and rotation of face images in face recognition. The proposed approach registers the training and testing visual face images by log-polar transformation, which is capable to handle complicacies introduced by scaling and rotation. Log-polar images are projected into eigenspace and finally classified using an improved multi-layer perceptron. In the experiments we have used ORL face database and Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database for visual face images. Experimental results show that the proposed approach significantly improves the recognition performances from visual to log-polar-visual face images. In case of ORL face database, recognition rate for visual face images is 89.5% and that is increased to 97.5% for log-polar-visual face images whereas for OTCBVS face database recognition rate for visual images is 87.84% and 96.36% for log-polar-visual face images.
Digital modulation classification using multi-layer perceptron and time-frequency features
Institute of Scientific and Technical Information of China (English)
Yuan Ye; Mei Wenbo
2007-01-01
Considering that real communication signals corrupted by noise are generally nonstationary, and time-frequency distributions are especially suitable for the analysis of nonstationary signals, time-frequency distributions are introduced for the modulation classification of communication signals.The extracted time-frequency features have good classification information, and they are insensitive to signal to noise ratio (SNR) variation.According to good classification by the correct rate of a neural network classifier, a multilayer perceptron (MLP) classifier with better generalization, as well as, addition of time-frequency features set for classifying six different modulation types has been proposed.Computer simulations show that the MLP classifier outperforms the decision-theoretic classifier at low SNRs, and the classification experiments for real MPSK signals verify engineering significance of the MLP classifier.
An application of the multilayer perceptron: Solar radiation maps in Spain
Energy Technology Data Exchange (ETDEWEB)
Hontoria, L.; Aguilera, J. [Grupo Investigacion y Desarrollo en Energia Solar y Automatica, Dpto. de Ingenieria Electronica, de Telecomunicaciones y Automatica, Escuela Politecnica Superior de Jaen, Campus de las Lagunillas, Universidad de Jaen, 23071 Jaen (Spain); Zufiria, P. [Grupo de Redes Neuronales, Dpto. de Matematica Aplicada a las Tecnologias de la Informacion, ETSI Telecomunicaciones, UPM Ciudad Universitaria s/n, 28040 Madrid (Spain)
2005-11-01
In this work an application of a methodology to obtain solar radiation maps is presented. This methodology is based on a neural network system [Lippmann, R.P., 1987. An introduction to computing with neural nets. IEEE ASSP Magazine, 4-22] called Multi-Layer Perceptron (MLP) [Haykin, S., 1994. Neural Networks. A Comprehensive Foundation. Macmillan Publishing Company; Hornik, K., Stinchcombe, M., White, H., 1989. Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359-366]. To obtain a solar radiation map it is necessary to know the solar radiation of many points spread wide across the zone of the map where it is going to be drawn. For most of the locations all over the world the records of these data (solar radiation in whatever scale, daily or hourly values) are non-existent. Only very few locations have the privilege of having good meteorological stations where records of solar radiation have being registered. But even in those locations with historical records of solar data, the quality of these solar series is not as good as it should be for most purposes. In addition, to draw solar radiation maps the number of points on the maps (real sites) that it is necessary to work with makes this problem difficult to solve. Nevertheless, with the application of the methodology proposed in this paper, this problem has been solved and solar radiation maps have been obtained for a small region of Spain: Jaen province, a southern province of Spain between parallels 38{sup o}25' N and 37{sup o}25' N, and meridians 4{sup o}10' W and 2{sup o}10' W, and for a larger region: Andalucia, the most southern region of Spain situated between parallels 38{sup o}40' N and 36{sup o}00' N, and meridians 7{sup o}30' W and 1{sup o}40' W. (author)
Landslide Occurrence Prediction Using Trainable Cascade Forward Network and Multilayer Perceptron
Directory of Open Access Journals (Sweden)
Mohammad Subhi Al-batah
2015-01-01
Full Text Available Landslides are one of the dangerous natural phenomena that hinder the development in Penang Island, Malaysia. Therefore, finding the reliable method to predict the occurrence of landslides is still the research of interest. In this paper, two models of artificial neural network, namely, Multilayer Perceptron (MLP and Cascade Forward Neural Network (CFNN, are introduced to predict the landslide hazard map of Penang Island. These two models were tested and compared using eleven machine learning algorithms, that is, Levenberg Marquardt, Broyden Fletcher Goldfarb, Resilient Back Propagation, Scaled Conjugate Gradient, Conjugate Gradient with Beale, Conjugate Gradient with Fletcher Reeves updates, Conjugate Gradient with Polakribiere updates, One Step Secant, Gradient Descent, Gradient Descent with Momentum and Adaptive Learning Rate, and Gradient Descent with Momentum algorithm. Often, the performance of the landslide prediction depends on the input factors beside the prediction method. In this research work, 14 input factors were used. The prediction accuracies of networks were verified using the Area under the Curve method for the Receiver Operating Characteristics. The results indicated that the best prediction accuracy of 82.89% was achieved using the CFNN network with the Levenberg Marquardt learning algorithm for the training data set and 81.62% for the testing data set.
Classification of frozen soil blastability by using perceptron neural network
Institute of Scientific and Technical Information of China (English)
马芹永; 张志红
2002-01-01
Influence factors of frozen soil blastability are analyzed which mainly conclude the strain energy coefficient, tensile strength, compressive strength, longitudinal wave velocity and transverse wave velocity. According to the principle of perceptron neural network, at first the index factors are standardized by the aid of the efficient function theory, then the blastability of frozen sand at -7, -12 and -17 ℃ are classified three categories. Through adjusting the weight value and threshold value, we can obtain that the clay blastability at -7 ℃ is close to the sand blastability at -12 ℃, they belong to the second category, the clay blastability at -12 ℃ is close to the sand blastability at -17 ℃, thus they are divided into the third category.
Multilayer Perceptron for Robust Nonlinear Interval Regression Analysis Using Genetic Algorithms
2014-01-01
On the basis of fuzzy regression, computational models in intelligence such as neural networks have the capability to be applied to nonlinear interval regression analysis for dealing with uncertain and imprecise data. When training data are not contaminated by outliers, computational models perform well by including almost all given training data in the data interval. Nevertheless, since training data are often corrupted by outliers, robust learning algorithms employed to resist outliers for interval regression analysis have been an interesting area of research. Several approaches involving computational intelligence are effective for resisting outliers, but the required parameters for these approaches are related to whether the collected data contain outliers or not. Since it seems difficult to prespecify the degree of contamination beforehand, this paper uses multilayer perceptron to construct the robust nonlinear interval regression model using the genetic algorithm. Outliers beyond or beneath the data interval will impose slight effect on the determination of data interval. Simulation results demonstrate that the proposed method performs well for contaminated datasets. PMID:25110755
Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
Mimura, Kazushi; Cousseau, Florent; Okada, Masato
2011-01-01
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limitation, while the theoretical results seems a bit promising. Instead, it reveals it might have a ri...
Classification of Parking Spots Using Multilayer Perceptron Networks
Directory of Open Access Journals (Sweden)
FALCAO, H. S.
2013-12-01
Full Text Available This project intends to develop a prototype for the identification of free spots in open air parking area where there is a good aerial view without obstacles, allowing for the identification of occupied and free spots. We used image processing techniques and pattern recognition using Artificial Neural Networks (ANN. In order to help implement the prototype, we used Matlab. In order to simulate the parking area, we created a model so that we could acquire the images using a webcam, process them, train the neural network, classify the spots and finally, show the results. The results show that it is viable to apply pattern recognition through image capture to classify parking spots
Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
Mimura, Kazushi; Cousseau, Florent; Okada, Masato
2011-03-01
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limitation, while the theoretical results seems a bit promising. Instead, it reveals it might have a rich and complex structure of the solution space via the BP-based algorithms.
Experts Fusion and Multilayer Perceptron Based on Belief Learning for Sonar Image Classification
Martin, Arnaud
2008-01-01
The sonar images provide a rapid view of the seabed in order to characterize it. However, in such as uncertain environment, real seabed is unknown and the only information we can obtain, is the interpretation of different human experts, sometimes in conflict. In this paper, we propose to manage this conflict in order to provide a robust reality for the learning step of classification algorithms. The classification is conducted by a multilayer perceptron, taking into account the uncertainty of the reality in the learning stage. The results of this seabed characterization are presented on real sonar images.
Quantum perceptron over a field and neural network architecture selection in a quantum computer.
da Silva, Adenilton José; Ludermir, Teresa Bernarda; de Oliveira, Wilson Rosa
2016-04-01
In this work, we propose a quantum neural network named quantum perceptron over a field (QPF). Quantum computers are not yet a reality and the models and algorithms proposed in this work cannot be simulated in actual (or classical) computers. QPF is a direct generalization of a classical perceptron and solves some drawbacks found in previous models of quantum perceptrons. We also present a learning algorithm named Superposition based Architecture Learning algorithm (SAL) that optimizes the neural network weights and architectures. SAL searches for the best architecture in a finite set of neural network architectures with linear time over the number of patterns in the training set. SAL is the first learning algorithm to determine neural network architectures in polynomial time. This speedup is obtained by the use of quantum parallelism and a non-linear quantum operator. PMID:26878722
Quantum perceptron over a field and neural network architecture selection in a quantum computer.
da Silva, Adenilton José; Ludermir, Teresa Bernarda; de Oliveira, Wilson Rosa
2016-04-01
In this work, we propose a quantum neural network named quantum perceptron over a field (QPF). Quantum computers are not yet a reality and the models and algorithms proposed in this work cannot be simulated in actual (or classical) computers. QPF is a direct generalization of a classical perceptron and solves some drawbacks found in previous models of quantum perceptrons. We also present a learning algorithm named Superposition based Architecture Learning algorithm (SAL) that optimizes the neural network weights and architectures. SAL searches for the best architecture in a finite set of neural network architectures with linear time over the number of patterns in the training set. SAL is the first learning algorithm to determine neural network architectures in polynomial time. This speedup is obtained by the use of quantum parallelism and a non-linear quantum operator.
Approximating Gaussian mixture model or radial basis function network with multilayer perceptron.
Patrikar, Ajay M
2013-07-01
Gaussian mixture models (GMMs) and multilayer perceptron (MLP) are both popular pattern classification techniques. This brief shows that a multilayer perceptron with quadratic inputs (MLPQ) can accurately approximate GMMs with diagonal covariance matrices. The mapping equations between the parameters of GMM and the weights of MLPQ are presented. A similar approach is applied to radial basis function networks (RBFNs) to show that RBFNs with Gaussian basis functions and Euclidean norm can be approximated accurately with MLPQ. The mapping equations between RBFN and MLPQ weights are presented. There are well-established training procedures for GMMs, such as the expectation maximization (EM) algorithm. The GMM parameters obtained by the EM algorithm can be used to generate a set of initial weights of MLPQ. Similarly, a trained RBFN can be used to generate a set of initial weights of MLPQ. MLPQ training can be continued further with gradient-descent based methods, which can lead to improvement in performance compared to the GMM or RBFN from which it is initialized. Thus, the MLPQ can always perform as well as or better than the GMM or RBFN.
Multilayer Perceptron applied to Data Assimilation for the Global FSU Atmospheric Model
Cocke, S.; Cintra, R. S.; Campos Velho, H. F.
2015-12-01
The better quality of forecasts is given the more accurate of the initial conditions. Data assimilation (DA) is the process by which short-forecast and observations are combined to obtain an accurate representation of the state of the modeled system, e.g. is a technique to generate an initial condition to a weather forecasts. This paper shows the results of a DA technique using artificial neural networks (NN) to obtain the analysis to the atmospheric model for the Florida State University. The Local Ensemble Transform Kalman filter (LETKF) is implemented with Florida State University Global Spectral Model (FSUGSM). The ANN data assimilation is made to emulate the initial condition from LETKF to run the FSUGSM. LETKF is a version of Kalman filter with Monte-Carlo ensembles of short-term forecasts to solve the data assimilation problem. The model FSUGSM is a multilevel spectral primitive equation model with vertical sigma coordinates, at resolution T63L27. The data assimilation experiments are based in simulated observations data and FSUGSM 6-hours forecasts. For the NN data assimilation, we use Multilayer Perceptron (MLP) with supervised training algorithm where NN receives input vectors with their corresponding response from LETKF data assimilation. The surface pressure, absolute temperature, zonal component wind, meridional component wind and humidity results are presented. A self-configuration method finds the optimal NN and configures a set of 52 MLPs to DA experiment, referred as MLP-DA. A methodology developed with self-configuration using a meta-heuristic called the Multiple Particle Collision Algorithm to compute the optimal topology for NN. The MLP presents four input nodes, two nodes coordinates vector, one for the 6-hours forecast vector and one node for observation vector; one output node for the analysis vector results. The vector represents the values for one grid model point. The ANNs were trained with data from each month of 2001, 2002, and 2003. The
Classification of Polar-Thermal Eigenfaces using Multilayer Perceptron for Human Face Recognition
Bhowmik, Mrinal Kanti; Nasipuri, Mita; Basu, Dipak Kumar; Kundu, Mahantapas
2010-01-01
This paper presents a novel approach to handle the challenges of face recognition. In this work thermal face images are considered, which minimizes the affect of illumination changes and occlusion due to moustache, beards, adornments etc. The proposed approach registers the training and testing thermal face images in polar coordinate, which is capable to handle complicacies introduced by scaling and rotation. Polar images are projected into eigenspace and finally classified using a multi-layer perceptron. In the experiments we have used Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database benchmark thermal face images. Experimental results show that the proposed approach significantly improves the verification and identification performance and the success rate is 97.05%.
A Rejection Model Based on Multi-Layer Perceptrons forMandarin Digit Recognition
Institute of Scientific and Technical Information of China (English)
钟林; 刘加; 刘润生
2002-01-01
High performance Mandarin digit recognition (MDR) is much more difficult to achieve than its English counterpart, especially on inexpensive hardware implementation In this paper, a new Multi-Layer Perceptrons (MLP) based postprocessor, an a posteriori probability estimator, is presented and used for the rejection model of the speaker independent Mandarin digit recognition system based on hidden Markov model (HMM). Poor utterances,which are recognized by HMMs but have low a posteriori probability, will be rejected. After rejecting about 4.9% of the tested utterances, the MLP rejection model can boost the digit recognition accuracy from 97.1% to 99.6%. The performance is better than those rejection models based on linear discrimination, likelihood ratio or anti-digit.
A New Approach to Predicting Bankruptcy: Combining DEA and Multi-Layer Perceptron
Directory of Open Access Journals (Sweden)
Ayan Mukhopadhyay
2012-07-01
Full Text Available The question of financial health and sustenance of a firm is so intriguing that it has spanned numerous studies. For investors,stakeholders and lenders, assessing the risk associated with an enterprise is vital. Several tools have been formulated to deal with predicting the solvency of a firm. This paper attempts to combine Data Envelopment Analysis and Multi-Layer Perceptron (MLP to suggest a new method for prediction of bankruptcy that not only focusses on historical financial data of firms that filed for bankruptcy like other past studies but also takes into account the data of those firms that were likely to do so. This method thus identifies firms that have a high chance of facing bankruptcy along with those that have filed for bankruptcy. The performance of this procedure is compared with MLP. The suggested method outperforms MLP in prediction of bankruptcy.
Image Binarization Using Multi-Layer Perceptron: A Semi-Supervised Approach
Directory of Open Access Journals (Sweden)
Amlan Raychaudhuri
2012-04-01
Full Text Available In this paper, we have discussed the Image Binarization technique using Multilayer Perceptron (MLP. The purpose of Image Binarization is to extract the lightness (brightness, density as a feature amount from the Image. It converts a gray-scale image of up to 256 gray levels to a black and white image. We use Backpropagation algorithm for training MLP. It is a supervised learning technique. Here Kmeans clustering algorithm has been used for clustering a 256 × 256 gray-level image. The dataset obtained by this is fed to the MLP and processed in a Semi-Supervised way where some training samples are taken as Known patterns (for training and others as Unknown patterns. Finally through this approach a Binarized image is produced.
Institute of Scientific and Technical Information of China (English)
黄天民; 裴峥
2003-01-01
The paper presents an extension multi-layer perceptron model that is capable of representing and reasoning propositional knowledge base. An extended version of propositional calculus is developed, and its some properties is discussed. Formulas of the extended calculus can be expressed in the extension multi-layer perceptron. Naturally, semantic deduction of propositional knowledge base can be implement by the extension multi-layer perceptron, and by learning, an unknown formula set can be found.
Prediction of Parametric Roll Resonance by Multilayer Perceptron Neural Network
DEFF Research Database (Denmark)
Míguez González, M; López Peña, F.; Díaz Casás, V.;
2011-01-01
Parametric roll resonance is a ship stability related phenomenon that generates sudden large amplitude oscillations up to 30-40 degrees of roll. This can cause severe damage, and it can put the crew in serious danger. The need for a parametric rolling real time prediction system has been acknowle...
Cebrian, Manuel
2007-01-01
The random initialization of weights of a multilayer perceptron makes it possible to model its training process as a Las Vegas algorithm, i.e. a randomized algorithm which stops when some required training error is obtained, and whose execution time is a random variable. This modelling is used to perform a case study on a well-known pattern recognition benchmark: the UCI Thyroid Disease Database. Empirical evidence is presented of the training time probability distribution exhibiting a heavy tail behavior, meaning a big probability mass of long executions. This fact is exploited to reduce the training time cost by applying two simple restart strategies. The first assumes full knowledge of the distribution yielding a 40% cut down in expected time with respect to the training without restarts. The second, assumes null knowledge, yielding a reduction ranging from 9% to 23%.
Institute of Scientific and Technical Information of China (English)
无
2007-01-01
Owing to continuous production lines with large amount of consecutive controls, various control signals and huge logistic relations, this paper introduced the methods and principles of the development of knowledge base in a fault diagnosis expert system that was based on machine learning by the four-layer perceptron neural network. An example was presented. By combining differential function with not differentia function and back propagation of error with back propagation of expectation, the four-layer perceptron neural network was established. And it was good for solving such a bottleneck problem in knowledge acquisition in expert system and enhancing real-time on-line diagnosis. A method of synthetic back propagation was designed, which broke the limit to non-differentiable function in BP neural network.
Institute of Scientific and Technical Information of China (English)
LI Chang-ping; ZHI Xin-yue; MA Jun; CUI Zhuang; ZHU Zi-long; ZHANG Cui; HU Liang-ping
2012-01-01
Background Various methods can be applied to build predictive models for the clinical data with binary outcome variable.This research aims to explore the process of constructing common predictive models,Logistic regression (LR),decision tree (DT) and multilayer perceptron (MLP),as well as focus on specific details when applying the methods mentioned above:what preconditions should be satisfied,how to set parameters of the model,how to screen variables and build accuracy models quickly and efficiently,and how to assess the generalization ability (that is,prediction performance) reliably by Monte Carlo method in the case of small sample size.Methods All the 274 patients (include 137 type 2 diabetes mellitus with diabetic peripheral neuropathy and 137 type 2 diabetes mellitus without diabetic peripheral neuropathy) from the Metabolic Disease Hospital in Tianjin participated in the study.There were 30 variables such as sex,age,glycosylated hemoglobin,etc.On account of small sample size,the classification and regression tree (CART) with the chi-squared automatic interaction detector tree (CHAID) were combined by means of the 100 times 5-7 fold stratified cross-validation to build DT.The MLP was constructed by Schwarz Bayes Criterion to choose the number of hidden layers and hidden layer units,alone with levenberg-marquardt (L-M) optimization algorithm,weight decay and preliminary training method.Subsequently,LR was applied by the best subset method with the Akaike Information Criterion (AIC) to make the best used of information and avoid overfitting.Eventually,a 10 to 100 times 3-10 fold stratified cross-validation method was used to compare the generalization ability of DT,MLP and LR in view of the areas under the receiver operating characteristic (ROC) curves (AUC).Results The AUC of DT,MLP and LR were 0.8863,0.8536 and 0.8802,respectively.As the larger the AUC of a specific prediction model is,the higher diagnostic ability presents,MLP performed optimally,and then
Hybrid Optimized Back propagation Learning Algorithm For Multi-layer Perceptron
Chakraborty, Mriganka; Ghosh, Arka
2012-01-01
Standard neural network based on general back propagation learning using delta method or gradient descent method has some great faults like poor optimization of error-weight objective function, low learning rate, instability .This paper introduces a hybrid supervised back propagation learning algorithm which uses trust-region method of unconstrained optimization of the error objective function by using quasi-newton method .This optimization leads to more accurate weight update system for mini...
A multilayer perceptron hazard detector for vision-based autonomous planetary landing
Lunghi, Paolo; Ciarambino, Marco; Lavagna, Michèle
2016-07-01
A hazard detection and target selection algorithm for autonomous spacecraft planetary landing, based on Artificial Neural Networks, is presented. From a single image of the landing area, acquired by a VIS camera during the descent, the system computes a hazard map, exploited to select the best target, in terms of safety, guidance constraints, and scientific interest. ANNs generalization properties allow the system to correctly operate also in conditions not explicitly considered during calibration. The net architecture design, training, verification and results are critically presented. Performances are assessed in terms of recognition accuracy and selected target safety. Results for a lunar landing scenario are discussed to highlight the effectiveness of the system.
Benrekia, Fayçal; Attari, Mokhtar; Bouhedda, Mounir
2013-01-01
This paper develops a primitive gas recognition system for discriminating between industrial gas species. The system under investigation consists of an array of eight micro-hotplate-based SnO2 thin film gas sensors with different selectivity patterns. The output signals are processed through a signal conditioning and analyzing system. These signals feed a decision-making classifier, which is obtained via a Field Programmable Gate Array (FPGA) with Very High-Speed Integrated Circuit Hardware Description Language. The classifier relies on a multilayer neural network based on a back propagation algorithm with one hidden layer of four neurons and eight neurons at the input and five neurons at the output. The neural network designed after implementation consists of twenty thousand gates. The achieved experimental results seem to show the effectiveness of the proposed classifier, which can discriminate between five industrial gases. PMID:23529119
Wave transmission prediction of multilayer floating breakwater using neural network
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Patil, S.G.; Hegde, A.V.
In the present study, an artificial neural network method has been applied for wave transmission prediction of multilayer floating breakwater. Two neural network models are constructed based on the parameters which influence the wave transmission...
Supervised Learning in Multilayer Spiking Neural Networks
Sporea, Ioana
2012-01-01
The current article introduces a supervised learning algorithm for multilayer spiking neural networks. The algorithm presented here overcomes some limitations of existing learning algorithms as it can be applied to neurons firing multiple spikes and it can in principle be applied to any linearisable neuron model. The algorithm is applied successfully to various benchmarks, such as the XOR problem and the Iris data set, as well as complex classifications problems. The simulations also show the flexibility of this supervised learning algorithm which permits different encodings of the spike timing patterns, including precise spike trains encoding.
Membership generation using multilayer neural network
Kim, Jaeseok
1992-01-01
There has been intensive research in neural network applications to pattern recognition problems. Particularly, the back-propagation network has attracted many researchers because of its outstanding performance in pattern recognition applications. In this section, we describe a new method to generate membership functions from training data using a multilayer neural network. The basic idea behind the approach is as follows. The output values of a sigmoid activation function of a neuron bear remarkable resemblance to membership values. Therefore, we can regard the sigmoid activation values as the membership values in fuzzy set theory. Thus, in order to generate class membership values, we first train a suitable multilayer network using a training algorithm such as the back-propagation algorithm. After the training procedure converges, the resulting network can be treated as a membership generation network, where the inputs are feature values and the outputs are membership values in the different classes. This method allows fairly complex membership functions to be generated because the network is highly nonlinear in general. Also, it is to be noted that the membership functions are generated from a classification point of view. For pattern recognition applications, this is highly desirable, although the membership values may not be indicative of the degree of typicality of a feature value in a particular class.
Bahi, Jacques M; Couchot, Jean-François; Guyeux, Christophe; Salomon, Michel
2012-03-01
Many research works deal with chaotic neural networks for various fields of application. Unfortunately, up to now, these networks are usually claimed to be chaotic without any mathematical proof. The purpose of this paper is to establish, based on a rigorous theoretical framework, an equivalence between chaotic iterations according to Devaney and a particular class of neural networks. On the one hand, we show how to build such a network, on the other hand, we provide a method to check if a neural network is a chaotic one. Finally, the ability of classical feedforward multilayer perceptrons to learn sets of data obtained from a dynamical system is regarded. Various boolean functions are iterated on finite states. Iterations of some of them are proven to be chaotic as it is defined by Devaney. In that context, important differences occur in the training process, establishing with various neural networks that chaotic behaviors are far more difficult to learn.
Self-Organizing Multilayered Neural Networks of Optimal Complexity
Schetinin, V.
2005-01-01
The principles of self-organizing the neural networks of optimal complexity is considered under the unrepresentative learning set. The method of self-organizing the multi-layered neural networks is offered and used to train the logical neural networks which were applied to the medical diagnostics.
Data assimilation: Particle filter and artificial neural networks
International Nuclear Information System (INIS)
The goal of this work is to present the performance of the Neural Network Multilayer Perceptrons trained to emulate a Particle Filter in the context of data assimilation. Techniques for data assimilation are applied for the Lorenz system, which presents a strong nonlinearity and chaotic nature. The cross validation method was used for training the network. Good results were obtained applying the multilayer perceptrons neural network.
Directory of Open Access Journals (Sweden)
Chudech Losiri
2016-07-01
Full Text Available Urban expansion is considered as one of the most important problems in several developing countries. Bangkok Metropolitan Region (BMR is the urbanized and agglomerated area of Bangkok Metropolis (BM and its vicinity, which confronts the expansion problem from the center of the city. Landsat images of 1988, 1993, 1998, 2003, 2008, and 2011 were used to detect the land use and land cover (LULC changes. The demographic and economic data together with corresponding maps were used to determine the driving factors for land conversions. This study applied Cellular Automata-Markov Chain (CA-MC and Multi-Layer Perceptron-Markov Chain (MLP-MC to model LULC and urban expansions. The performance of the CA-MC and MLP-MC yielded more than 90% overall accuracy to predict the LULC, especially the MLP-MC method. Further, the annual population and economic growth rates were considered to produce the land demand for the LULC in 2014 and 2035 using the statistical extrapolation and system dynamics (SD. It was evident that the simulated map in 2014 resulting from the SD yielded the highest accuracy. Therefore, this study applied the SD method to generate the land demand for simulating LULC in 2035. The outcome showed that urban occupied the land around a half of the BMR.
An Automated MR Image Segmentation System Using Multi-layer Perceptron Neural Network
Amiri, S.; Movahedi, M M; Kazemi, K; Parsaei, H
2013-01-01
Background: Brain tissue segmentation for delineation of 3D anatomical structures from magnetic resonance (MR) images can be used for neuro-degenerative disorders, characterizing morphological differences between subjects based on volumetric analysis of gray matter (GM), white matter (WM) and cerebrospinal fluid (CSF), but only if the obtained segmentation results are correct. Due to image artifacts such as noise, low contrast and intensity non-uniformity, there are some classification errors...
Preference of echo features for classification of seafloor sediments using neural networks
Digital Repository Service at National Institute of Oceanography (India)
De, C.; Chakraborty, B.
Selection of a set of dominant echo features to classify seafloor sediments using a multilayer perceptron neural network is investigated at two acoustic frequencies (33 and 210 kHz). Several sets of inputs with different combinations of two, three...
Speech Recognition Method Based on Multilayer Chaotic Neural Network
Institute of Scientific and Technical Information of China (English)
REN Xiaolin; HU Guangrui
2001-01-01
In this paper,speech recognitionusing neural networks is investigated.Especially,chaotic dynamics is introduced to neurons,and a mul-tilayer chaotic neural network (MLCNN) architectureis built.A learning algorithm is also derived to trainthe weights of the network.We apply the MLCNNto speech recognition and compare the performanceof the network with those of recurrent neural net-work (RNN) and time-delay neural network (TDNN).Experimental results show that the MLCNN methodoutperforms the other neural networks methods withrespect to average recognition rate.
Mosaic Face Image Recognition on Multi-Layer Neural Network
Yamamori, Kuhihito; Nogawa, Reo; Yoshihara, Ikuo
2003-01-01
Face image recognition is an impotant technology for security,communication area,etc.. In this reserch,###we try to show the optimal parameters in multi-layer neural network for mosaic face image recognition.###By using of mosaic face images,the amount of image dara can be reduced,and it can also avoid###the affect of noise.Through our experiments,a multi-layer neural network showed 98.7% of recognition###on 8 x 8 mosaic images.
Optimization of multilayer neural network parameters for speaker recognition
Tovarek, Jaromir; Partila, Pavol; Rozhon, Jan; Voznak, Miroslav; Skapa, Jan; Uhrin, Dominik; Chmelikova, Zdenka
2016-05-01
This article discusses the impact of multilayer neural network parameters for speaker identification. The main task of speaker identification is to find a specific person in the known set of speakers. It means that the voice of an unknown speaker (wanted person) belongs to a group of reference speakers from the voice database. One of the requests was to develop the text-independent system, which means to classify wanted person regardless of content and language. Multilayer neural network has been used for speaker identification in this research. Artificial neural network (ANN) needs to set parameters like activation function of neurons, steepness of activation functions, learning rate, the maximum number of iterations and a number of neurons in the hidden and output layers. ANN accuracy and validation time are directly influenced by the parameter settings. Different roles require different settings. Identification accuracy and ANN validation time were evaluated with the same input data but different parameter settings. The goal was to find parameters for the neural network with the highest precision and shortest validation time. Input data of neural networks are a Mel-frequency cepstral coefficients (MFCC). These parameters describe the properties of the vocal tract. Audio samples were recorded for all speakers in a laboratory environment. Training, testing and validation data set were split into 70, 15 and 15 %. The result of the research described in this article is different parameter setting for the multilayer neural network for four speakers.
Ferreira, B D L; Sebastião, R C O; Yoshida, M I; Mussel, W N; Fialho, S L; Barbosa, J
2016-01-01
Kinetic study by thermal decomposition of antiretroviral drugs, Efavirenz (EFV) and Lamivudine (3TC), usually present in the HIV cocktail, can be done by individual adjustment of the solid decomposition models. However, in some cases unacceptable errors are found using this methodology. To circumvent this problem, here is proposed to use a multilayer perceptron neural network (MLP), with an appropriate algorithm, which constitutes a linearization of the network by setting weights between the input layer and the intermediate one and the use of Kinetic models as activation functions of neurons in the hidden layer. The interconnection weights between that intermediate layer and output layer determines the contribution of each model in the overall fit of the experimental data. Thus, the decomposition is assumed to be a phenomenon that can occur following different kinetic processes. In the investigated data, the kinetic thermal decomposition process was best described by R1 and D4 model for all temperatures to EF...
Memristive Perceptron for Combinational Logic Classification
Directory of Open Access Journals (Sweden)
Lidan Wang
2013-01-01
Full Text Available The resistance of the memristor depends upon the past history of the input current or voltage; so it can function as synapse in neural networks. In this paper, a novel perceptron combined with the memristor is proposed to implement the combinational logic classification. The relationship between the memristive conductance change and the synapse weight update is deduced, and the memristive perceptron model and its synaptic weight update rule are explored. The feasibility of the novel memristive perceptron for implementing the combinational logic classification (NAND, NOR, XOR, and NXOR is confirmed by MATLAB simulation.
Directory of Open Access Journals (Sweden)
Schwindling Jerome
2010-04-01
Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Phase Transitions of Neural Networks
Kinzel, Wolfgang
1997-01-01
The cooperative behaviour of interacting neurons and synapses is studied using models and methods from statistical physics. The competition between training error and entropy may lead to discontinuous properties of the neural network. This is demonstrated for a few examples: Perceptron, associative memory, learning from examples, generalization, multilayer networks, structure recognition, Bayesian estimate, on-line training, noise estimation and time series generation.
Aphasia Classification Using Neural Networks
DEFF Research Database (Denmark)
Axer, H.; Jantzen, Jan; Berks, G.;
2000-01-01
A web-based software model (http://fuzzy.iau.dtu.dk/aphasia.nsf) was developed as an example for classification of aphasia using neural networks. Two multilayer perceptrons were used to classify the type of aphasia (Broca, Wernicke, anomic, global) according to the results in some subtests...
Aryadoust, Vahid; Baghaei, Purya
2016-01-01
This study aims to examine the relationship between reading comprehension and lexical and grammatical knowledge among English as a foreign language students by using an Artificial Neural Network (ANN). There were 825 test takers administered both a second-language reading test and a set of psychometrically validated grammar and vocabulary tests.…
Building a Chaotic Proved Neural Network
Bahi, Jacques M; Salomon, Michel
2011-01-01
Chaotic neural networks have received a great deal of attention these last years. In this paper we establish a precise correspondence between the so-called chaotic iterations and a particular class of artificial neural networks: global recurrent multi-layer perceptrons. We show formally that it is possible to make these iterations behave chaotically, as defined by Devaney, and thus we obtain the first neural networks proven chaotic. Several neural networks with different architectures are trained to exhibit a chaotical behavior.
Artificial neural networks in predicting current in electric arc furnaces
Panoiu, M.; Panoiu, C.; Iordan, A.; Ghiormez, L.
2014-03-01
The paper presents a study of the possibility of using artificial neural networks for the prediction of the current and the voltage of Electric Arc Furnaces. Multi-layer perceptron and radial based functions Artificial Neural Networks implemented in Matlab were used. The study is based on measured data items from an Electric Arc Furnace in an industrial plant in Romania.
Multilayer neural networks with extensively many hidden units.
Rosen-Zvi, M; Engel, A; Kanter, I
2001-08-13
The information processing abilities of a multilayer neural network with a number of hidden units scaling as the input dimension are studied using statistical mechanics methods. The mapping from the input layer to the hidden units is performed by general symmetric Boolean functions, whereas the hidden layer is connected to the output by either discrete or continuous couplings. Introducing an overlap in the space of Boolean functions as order parameter, the storage capacity is found to scale with the logarithm of the number of implementable Boolean functions. The generalization behavior is smooth for continuous couplings and shows a discontinuous transition to perfect generalization for discrete ones. PMID:11497920
A multilayer neural network model for perception of rotational motion
Institute of Scientific and Technical Information of China (English)
郭爱克; 孙海坚; 杨先一
1997-01-01
A multilayer neural nerwork model for the perception of rotational motion has been developed usingReichardt’s motion detector array of correlation type, Kohonen’s self-organized feature map and Schuster-Wagner’s oscillating neural network. It is shown that the unsupervised learning could make the neurons on the second layer of the network tend to be self-organized in a form resembling columnar organization of selective directions in area MT of the primate’s visual cortex. The output layer can interpret rotation information and give the directions and velocities of rotational motion. The computer simulation results are in agreement with some psychophysical observations of rotation-al perception. It is demonstrated that the temporal correlation between the oscillating neurons would be powerful for solving the "binding problem" of shear components of rotational motion.
Oku, Makito; Aihara, Kazuyuki
2010-11-01
A modularly-structured neural network model is considered. Each module, which we call a ‘cell’, consists of two parts: a Hopfield neural network model and a multilayered perceptron. An array of such cells is used to simulate the Rule 110 cellular automaton with high accuracy even when all the units of neural networks are replaced by stochastic binary ones. We also find that noise not only degrades but also facilitates computation if the outputs of multilayered perceptrons are below the threshold required to update the states of the cells, which is a stochastic resonance in computation.
Directory of Open Access Journals (Sweden)
E. T. Venkatesh
2008-01-01
Full Text Available Study on characteristics of soil, to determine the types of crops suitable for cultivation in a particular region can increase the yield to greater extent, which minimizes the expenditures involved in irrigation and application of fertilizers. With the tested techniques available for calibrating the quality of soil and the crops suitable for cultivation in it, it is possible to determine the exact crop, irrigation patterns and even the cycle and quantity of fertilizer application. This paper dealt with the application of SOM based clustering and Artificial Intelligence techniques, to analyze the patterns of soils distributed across huge geographical area and identify the suitable types of crops for the particular soil. Estimation of exact crop(s suitable for a particular region can help stave off redundant maintenance and the inherent expenditures that would occur due to over irrigation and over usage of fertilizers, to fulfill the natural deficiencies. Our Focus is to improve the optimal utilization of innate characteristics in a soil through cultivation of appropriate crops, which will increase the volume and quality of yield, in particular for a developing country like India, where the huge majority of the population depends primarily on agriculture for livelihood.
DEFF Research Database (Denmark)
Kucuk, Nil; Manohara, S.R.; Hanagodimath, S.M.;
2013-01-01
V, and for penetration depths up to 10 mfp (mean-free-path). The MLPNNs have been trained by a Levenberg–Marquardt learning algorithm. The developed model is in 99% agreement with the ANSI/ANS-6.4.3 standard data set. Furthermore, the model is fast and does not require tremendous computational efforts. The estimated BA...
Standard Cell-Based Implementation of a Digital Optoelectronic Neural-Network Hardware
Maier, Klaus D.; Beckstein, Clemens; Blickhan, Reinhard; Erhard, Werner
2001-03-01
A standard cell-based implementation of a digital optoelectronic neural-network architecture is presented. The overall structure of the multilayer perceptron network that was used, the optoelectronic interconnection system between the layers, and all components required in each layer are defined. The design process from VHDL-based modeling from synthesis and partly automatic placing and routing to the final editing of one layer of the circuit of the multilayer perceptrons are described. A suitable approach for the standard cell-based design of optoelectronic systems is presented, and shortcomings of the design tool that was used are pointed out. The layout for the microelectronic circuit of one layer in a multilayer perceptron neural network with a performance potential 1 magnitude higher than neural networks that are purely electronic based has been successfully designed.
Multi-Layered Neural Networks Infer Fundamental Stellar Parameters
Verma, Kuldeep; Bhattacharya, Jishnu; Antia, H M; Krishnamurthy, Ganapathy
2016-01-01
The advent of space-based observatories such as CoRoT and Kepler has enabled the testing of our understanding of stellar evolution on thousands of stars. Evolutionary models typically require five input parameters, the mass, initial Helium abundance, initial metallicity, mixing-length (assumed to be constant over time) and the age to which the star must be evolved. These parameters are also very useful in characterizing the associated planets and in studying galactic archaeology. How to obtain the parameters from observations rapidly and accurately, specifically in the context of surveys of thousands of stars, is an outstanding question, one that has eluded straightforward resolution. For a given star, we typically measure the effective temperature and surface metallicity spectroscopically and low-degree oscillation frequencies through space observatories. Here we demonstrate that statistical learning, using multi-layered neural networks, is successful in determining the evolutionary parameters based on spect...
Directory of Open Access Journals (Sweden)
Vânia Medianeira Flores Costa
2012-04-01
Full Text Available When investors decide to “adventure” through stock markets they search for a method to provide safety on making decision. In fact, there is no precise way to know which stocks will became a profitable investiment. Technical analysis is a discipline that support the investors on making decisions. Such a discipline uses a set of tools and statistical methods to forecast the market’s movement. Such a paper presents the develpment of a robotical Trade System, using a heuristic method. The system has a Neural Network multilayer perceptron, trained with an algorithm for back propagation error. Thus, approaching to the technical analysis without emotional aspects, using the Neural Network forecast on supporting the decisions of a investor on stock market. In analyzing the results of the neural network can be seen that the neural network got a result of 42.6% higher than the diagnostic of the technical analysis.Quando investidores decidem se “aventurar” pelo mercado de renda variável, como pelo mercado de ações, buscam um método de ter mais segurança na tomada de decisão. Na prática, não há como saber quais ativos tornar-se-ão um investimento lucrativo. No mercado acionário, a Análise Técnica procura auxiliar o investidor na tomada de decisão. Para isso, utiliza-se de ferramentas e de métodos estatísticos para tentar predizer os movimentos do mercado. Este artigo apresenta o desenvolvimento de um Trade System robótico, utilizando um método heurístico. O sistema conta com uma rede neural multilayer perceptron, treinada com o algoritmo de retro propagação de erro, aproximando-se da análise técnica sem o fator emoção. Ao avaliar os resultados da rede neural, pode ser visto que a mesma obteve um resultado de 42,6% maior do que o diagnóstico da análise técnica.
A MULTILAYER COMPLEX NEURAL NETWORK TRAINING ALGORITHM AND ITS APPLICATION IN ADAPTIVE EQUALIZATION
Institute of Scientific and Technical Information of China (English)
Li Chunguang; Liao Xiaofeng; Wu Zhongfu; Yu Juebang
2001-01-01
In this paper, the layer-by-layer optimizing algorithm for training multilayer neural network is extended for the case of a multilayer neural network whose inputs, weights, and activation functions are all complex. The updating of the weights of each layer in the network is based on the recursive least squares method. The performance of the proposed algorithm is demonstrated with application in adaptive complex communication channel equalization.
A neural network based seafloor classification using acoustic backscatter
Digital Repository Service at National Institute of Oceanography (India)
Chakraborty, B.
This paper presents a study results of the Artificial Neural Network (ANN) architectures [Self-Organizing Map (SOM) and Multi-Layer Perceptron (MLP)] using single beam echosounding data. The single beam echosounder, operable at 12 kHz, has been used...
A multilayer recurrent neural network for solving continuous-time algebraic Riccati equations.
Wang, Jun; Wu, Guang
1998-07-01
A multilayer recurrent neural network is proposed for solving continuous-time algebraic matrix Riccati equations in real time. The proposed recurrent neural network consists of four bidirectionally connected layers. Each layer consists of an array of neurons. The proposed recurrent neural network is shown to be capable of solving algebraic Riccati equations and synthesizing linear-quadratic control systems in real time. Analytical results on stability of the recurrent neural network and solvability of algebraic Riccati equations by use of the recurrent neural network are discussed. The operating characteristics of the recurrent neural network are also demonstrated through three illustrative examples.
Neural Networks Applied to Thermal Damage Classification in Grinding Process
Spadotto, Marcelo M.; Aguiar, Paulo Roberto de; Sousa, Carlos C. P.; Bianchi, Eduardo C.
2008-01-01
The utilization of neural network of type multi-layer perceptron using the back-propagation algorithm guaranteed very good results. Tests carried out in order to optimize the learning capacity of neural networks were of utmost importance in the training phase, where the optimum values for the number of neurons of the hidden layer, learning rate and momentum for each structure were determined. Once the architecture of the neural network was established with those optimum values, the mean squar...
Performance Comparison of Neural Networks for HRTFs Approximation
Institute of Scientific and Technical Information of China (English)
无
2000-01-01
In order to approach to head-related transfer functions (HRTFs), this paper employs and compares three kinds of one-input neural network models, namely, multi-layer perceptron (MLP) networks, radial basis function (RBF) networks and wavelet neural networks (WNN) so as to select the best network model for further HRTFs approximation. Experimental results demonstrate that wavelet neural networks are more efficient and useful.
Discrete Orthogonal Transforms and Neural Networks for Image Interpolation
Directory of Open Access Journals (Sweden)
J. Polec
1999-09-01
Full Text Available In this contribution we present transform and neural network approaches to the interpolation of images. From transform point of view, the principles from [1] are modified for 1st and 2nd order interpolation. We present several new interpolation discrete orthogonal transforms. From neural network point of view, we present interpolation possibilities of multilayer perceptrons. We use various configurations of neural networks for 1st and 2nd order interpolation. The results are compared by means of tables.
Neural Boundary Conditions in Optic Guides
Özkan-Bakbak, Pınar
2015-01-01
In this study, the boundary coefficients of Transverse Electric (TE) and Transverse Magnetic (TM) modes at a planar slab optic guides are modeled by Neural Networks (NN). After modal analysis, train and test files are prepared for NN. Multi-Layer Perceptron (MLP) and Radial Basis Function (RBF) neural networks are performed and compared with each other. NNs are expected to be capable of modeling optical fiber technology in industry based on the same approaches as a result of this study.
Institute of Scientific and Technical Information of China (English)
鄢田云; 张翠芳; 靳蕃
2003-01-01
Identification simulation for dynamical system which is based on genetic algorithm (GA) and recurrent multilayer neural network (RMNN) is presented. In order to reduce the inputs of the model, RMNN which can remember and store some previous parameters is used for identifier. And for its high efficiency and optimization, genetic algorithm is introduced into training RMNN. Simulation results show the effectiveness of the proposed scheme. Under the same training algorithm, the identification performance of RMNN is superior to that of nonrecurrent multilayer neural network (NRMNN).
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving...
Neural Network Modelling and Predictive Control of a Milk Pasteurisation Plant
Khadir, M.T.; RINGWOOD, John
2001-01-01
This paper investigates the possible use of artificial neural networks (ANN), more precisely multi-layer perceptrons (MLPs), for the nonlinear modelling and predictive control of a milk pasteurisation plant. Model predictive control (MPC) schemes require the development of a predictive model. Using data gathered from an industrial milk plant, a nonlinear multi-step ahead neural network predictor model (NNM) was established. A neural predictive controller (NPC) was then designed on the same...
ESTIMATION OF INPUT IMPEDANCE OF MICROSTRIP PATCH ANTENNA USING FUZZY NEURAL NETWORK
Directory of Open Access Journals (Sweden)
VANDANA VIKAS THAKARE
2010-10-01
Full Text Available The paper presents the use of fuzzy neural network (FNN as a fast and better technique for the determination of input impedance of coaxial feed rectangular microstrip antenna. The fuzzy parameter ensures better performance as compared to three layer multilayered perceptron feed forward back propagation artificial neural network (MLPFFBP ANN and radial basis function artificial neural network (RBF ANN in the determination of input impedance of the coaxial feed microstrip antenna.
Stacked Heterogeneous Neural Networks for Time Series Forecasting
Directory of Open Access Journals (Sweden)
Florin Leon
2010-01-01
Full Text Available A hybrid model for time series forecasting is proposed. It is a stacked neural network, containing one normal multilayer perceptron with bipolar sigmoid activation functions, and the other with an exponential activation function in the output layer. As shown by the case studies, the proposed stacked hybrid neural model performs well on a variety of benchmark time series. The combination of weights of the two stack components that leads to optimal performance is also studied.
Institute of Scientific and Technical Information of China (English)
CHAI Yu-hua; PAN Wei; NING Hai-long
2005-01-01
In the paper, a method of building mathematic model employing genetic multilayer feed forward neural network is presented, and the quantitative relationship of chemical measured values and near-infrared spectral data is established. In the paper, quantitative mathematic model related chemical assayed values and near-infrared spectral data is established by means of genetic multilayer feed forward neural network, acquired near-infrared spectral data are taken as input of network with the content of five kinds of fat acids tested from chemical method as output,weight values of multilayer feed forward neural network are trained by genetic algorithms and detection model of neural network of soybean is built. A kind of multilayer feed forward neural network trained by genetic algorithms is designed in the paper. Through experiments, all the related coefficients of five fat acids can approach 0.9 which satisfies the preliminary test of soybean breeding.
Pengenalan Pola Pin Barcode Menggunakan Metode Backpropagation dan Metode Perceptron
Hasiholan, Ardi
2015-01-01
Pattern recognition is one of the functions of the neural networks, where objects maybe identified by their patterns. This may assist in recognition of objects which patterns are damaged. Pattern recognition in neural networkcan make by using backpropagation and perceptron methods. In Backpropagation method, the network is trained with the pattern through three phases, namely forward propagation, backward propagation, and weights adjustment phases, repeated until the termination condition is ...
Forecasting SPEI and SPI Drought Indices Using the Integrated Artificial Neural Networks.
Maca, Petr; Pech, Pavel
2016-01-01
The presented paper compares forecast of drought indices based on two different models of artificial neural networks. The first model is based on feedforward multilayer perceptron, sANN, and the second one is the integrated neural network model, hANN. The analyzed drought indices are the standardized precipitation index (SPI) and the standardized precipitation evaporation index (SPEI) and were derived for the period of 1948-2002 on two US catchments. The meteorological and hydrological data were obtained from MOPEX experiment. The training of both neural network models was made by the adaptive version of differential evolution, JADE. The comparison of models was based on six model performance measures. The results of drought indices forecast, explained by the values of four model performance indices, show that the integrated neural network model was superior to the feedforward multilayer perceptron with one hidden layer of neurons.
Forecasting SPEI and SPI Drought Indices Using the Integrated Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Petr Maca
2016-01-01
Full Text Available The presented paper compares forecast of drought indices based on two different models of artificial neural networks. The first model is based on feedforward multilayer perceptron, sANN, and the second one is the integrated neural network model, hANN. The analyzed drought indices are the standardized precipitation index (SPI and the standardized precipitation evaporation index (SPEI and were derived for the period of 1948–2002 on two US catchments. The meteorological and hydrological data were obtained from MOPEX experiment. The training of both neural network models was made by the adaptive version of differential evolution, JADE. The comparison of models was based on six model performance measures. The results of drought indices forecast, explained by the values of four model performance indices, show that the integrated neural network model was superior to the feedforward multilayer perceptron with one hidden layer of neurons.
Institute of Scientific and Technical Information of China (English)
FANG Jun-long; ZHANG Chang-li; WANG Shu-wen
2004-01-01
We set up computer vision system for tomato images. By using this system, the RGB value of tomato image was converted into HIS value whose H was used to acquire the color character of the surface of tomato. To use multilayer feed forward neural network with GA can finish automatic identification of tomato maturation. The results of experiment showed that the accuracy was upto 94%.
Polanco, Xavier; François, Claire; Keim, Jean-Pierre
1998-01-01
This paper describes the implementation of multivariate data analysis: NEURODOC applies the axial k-means method for automatic, non-hierarchical cluster analysis and a Principal Component Analysis (PCA) for representing the clusters on a map. We next introduce Artificial Neural Networks (ANNs) to extend NEURODOC into a neural platform for the cluster analysis and cartography of bibliographic data. The ANNs tested are: the Adaptive Resonance Theory (ART 1), a Multilayer Perceptron (MLP), and a...
Directory of Open Access Journals (Sweden)
A. Piotrowski
2006-01-01
Full Text Available In this paper, Multi-Layer Perceptron and Radial-Basis Function Neural Networks, along with the Nearest Neighbour approach and linear regression are utilized for flash-flood forecasting in the mountainous Nysa Klodzka river catchment. It turned out that the Radial-Basis Function Neural Network is the best model for 3- and 6-h lead time prediction and the only reliable one for 9-h lead time forecasting for the largest flood used as a test case.
Berlich, Rüdiger; Kunze, Marcel
1997-02-01
The Supervised Growing Neural Gas algorithm (SGNG) provides an interesting alternative to standard Multi-Layer Perceptrons (MLP). A comparison is drawn between the performance of SGNG and MLP in the domain of function mapping. A further field of interest is classification power, which has been investigated with real data taken by PS197 at CERN. The characteristics of the two network models will be discussed from a practical point of view as well as their advantages and disadvantages.
Higher-order probabilistic perceptrons as Bayesian inference engines
International Nuclear Information System (INIS)
This letter makes explicit a structural connection between the Bayes optimal classifier operating on K binary input variables and corresponding two-layer perceptron having normalized output activities and couplings from input to output units of all orders up to K. Given a large and unbiased training set and an effective learning algorithm, such a neural network should be able to learn the statistics of the classification problem and match the a posteriori probabilities given by the Bayes optimal classifier. (author). 18 refs
Directory of Open Access Journals (Sweden)
Md. Abdullah-al-mamun
2015-08-01
Full Text Available Abstract Humans are capable to identifying diverse shape in the different pattern in the real world as effortless fashion due to their intelligence is grow since born with facing several learning process. Same way we can prepared an machine using human like brain called Artificial Neural Network that can be recognize different pattern from the real world object. Although the various techniques is exists to implementation the pattern recognition but recently the artificial neural network approaches have been giving the significant attention. Because the approached of artificial neural network is like a human brain that is learn from different observation and give a decision the previously learning rule. Over the 50 years research now a days pattern recognition for machine learning using artificial neural network got a significant achievement. For this reason many real world problem can be solve by modeling the pattern recognition process. The objective of this paper is to present the theoretical concept for pattern recognition design using Multi-Layer Perceptorn neural networkin the algorithm of artificial Intelligence as the best possible way of utilizing available resources to make a decision that can be a human like performance.
NEURAL NETWORK TRAINING WITH PARALLEL PARTICLE SWARM OPTIMIZER
Institute of Scientific and Technical Information of China (English)
无
2006-01-01
Feed forward neural net works such as multi-layer perceptron,radial basis function neural net-works,have been widely applied to classification,function approxi mation and data mining.Evolu-tionary computation has been explored to train neu-ral net works as a very promising and competitive al-ternative learning method,because it has potentialto produce global mini mum in the weight space.Recently,an emerging evolutionary computationtechnique,Particle Swar m Opti mization(PSO)be-comes a hot topic because of i...
A Novel Training Algorithm of Genetic Neural Networks and Its Application to Classification
Institute of Scientific and Technical Information of China (English)
无
2001-01-01
First of all, this paper discusses the drawbacks of multilayer perceptron (MLP), which is trained by the traditional back propagation (BP) algorithm and used in a special classification problem. A new training algorithm for neural networks based on genetic algorithm and BP algorithm is developed. The difference between the new training algorithm and BP algorithm in the ability of nonlinear approaching is expressed through an example, and the application foreground is illustrated by an example.
Hossein Naderi; Mojtaba Moradpour; Mehdi Zangeneh; Farzad Khani
2012-01-01
Stock market prediction is one of the most important interesting areas of research in business. Stock markets prediction is normally assumed as tedious task since there are many factors influencing the market. The primary objective of this paper is to forecast trend closing price movement of Tehran Stock Exchange (TSE) using financial accounting ratios from year 2003 to year 2008. The proposed study of this paper uses two approaches namely Artificial Neural Networks and multi-layer perceptron...
Perancangan Pengenal QR (Quick Response) Code Dengan Jaringan Syaraf Tiruan Metode Perceptron
Novalia
2013-01-01
Quick Response (QR) Code is used to store important information of an item or product. QR Code has a very random pattern and can not be distinguished. QR Code can also be dirty and damaged. Research conducted on the pattern of QR Code in order to find out the information stored in the QR Code. The method used to identify patterns of QR Code is to use Artificial Neural Networks Perceptron method. Perceptron is a neural network method is often used for pattern recognition. The input to the syst...
Directory of Open Access Journals (Sweden)
Zhekang Dong
2014-01-01
Full Text Available In this paper, we present an implementation scheme of memristor-based multilayer feedforward small-world neural network (MFSNN inspirited by the lack of the hardware realization of the MFSNN on account of the need of a large number of electronic neurons and synapses. More specially, a mathematical closed-form charge-governed memristor model is presented with derivation procedures and the corresponding Simulink model is presented, which is an essential block for realizing the memristive synapse and the activation function in electronic neurons. Furthermore, we investigate a more intelligent memristive PID controller by incorporating the proposed MFSNN into intelligent PID control based on the advantages of the memristive MFSNN on computation speed and accuracy. Finally, numerical simulations have demonstrated the effectiveness of the proposed scheme.
Video Traffic Prediction Using Neural Networks
Directory of Open Access Journals (Sweden)
Miloš Oravec
2008-10-01
Full Text Available In this paper, we consider video stream prediction for application in services likevideo-on-demand, videoconferencing, video broadcasting, etc. The aim is to predict thevideo stream for an efficient bandwidth allocation of the video signal. Efficient predictionof traffic generated by multimedia sources is an important part of traffic and congestioncontrol procedures at the network edges. As a tool for the prediction, we use neuralnetworks – multilayer perceptron (MLP, radial basis function networks (RBF networksand backpropagation through time (BPTT neural networks. At first, we briefly introducetheoretical background of neural networks, the prediction methods and the differencebetween them. We propose also video time-series processing using moving averages.Simulation results for each type of neural network together with final comparisons arepresented. For comparison purposes, also conventional (non-neural prediction isincluded. The purpose of our work is to construct suitable neural networks for variable bitrate video prediction and evaluate them. We use video traces from [1].
Development of Al2O3/TiN Ceramic Cutting Tool Materials by Artificial Neural Networks
Institute of Scientific and Technical Information of China (English)
Ning FAN; Xiangbo ZE; Zihui GAO
2004-01-01
The artificial neural networks (ANN) which have broad application were proposed to develop multiphase ceramic cutting tool materials. Based on the back propagation algorithm of the forward multilayer perceptron, the models to predict volume content of composition in particle reinforced ceramics are established. The Al2O3/TiNl ceramic cutting tool material was developed by ANN, whose mechanical properties fully satisfy the cutting requirements.
Design and FPGA-implementation of multilayer neural networks with on-chip learning
International Nuclear Information System (INIS)
Artificial Neural Networks (ANN) is used in many applications in the industry because of their parallel structure, high speed, and their ability to give easy solution to complicated problems. For example identifying the orange and apple in the sorting machine with neural network is easier than using image processing techniques to do the same thing. There are different software for designing, training, and testing the ANN, but in order to use the ANN in the industry, it should be implemented on hardware outside the computer. Neural networks are artificial systems inspired on the brain's cognitive behavior, which can learn tasks with some degree of complexity, such as signal processing, diagnosis, robotics, image processing, and pattern recognition. Many applications demand a high computing power and the traditional software implementation are not sufficient.This thesis presents design and FPGA implementation of Multilayer Neural Networks with On-chip learning in re-configurable hardware. Hardware implementation of neural network algorithm is very interesting due their high performance and they can easily be made parallel. The architecture proposed herein takes advantage of distinct data paths for the forward and backward propagation stages and a pipelined adaptation of the on- line backpropagation algorithm to significantly improve the performance of the learning phase. The architecture is easily scalable and able to cope with arbitrary network sizes with the same hardware. The implementation is targeted diagnosis of the Research Reactor accidents to avoid the risk of occurrence of a nuclear accident. The proposed designed circuits are implemented using Xilinx FPGA Chip XC40150xv and occupied 73% of Chip CLBs. It achieved 10.8 μs to take decision in the forward propagation compared with current software implemented of RPS which take 24 ms. The results show that the proposed architecture leads to significant speed up comparing to high end software solutions. On
Digital Repository Service at National Institute of Oceanography (India)
Singh, Y.; Nair, R.R.; Singh, H.; Datta, P.; Jaiswal, P.; Dewangan, P.; Ramprasad, T.
Stepwise linear regression, multi-layer feed forward neural (MLFN) network method was used to predict the 2D distribution of P-wave velocity, resistivity, porosity, and gas hydrate saturation throughout seismic section NGHP-01 in the Krishna...
A Deterministic and Polynomial Modified Perceptron Algorithm
Directory of Open Access Journals (Sweden)
Olof Barr
2006-01-01
Full Text Available We construct a modified perceptron algorithm that is deterministic, polynomial and also as fast as previous known algorithms. The algorithm runs in time O(mn3lognlog(1/ρ, where m is the number of examples, n the number of dimensions and ρ is approximately the size of the margin. We also construct a non-deterministic modified perceptron algorithm running in timeO(mn2lognlog(1/ρ.
Institute of Scientific and Technical Information of China (English)
JunJun Yang; ZhiBin He; WeiJun Zhao; Jun Du; LongFei Chen; Xi Zhu
2016-01-01
Soil moisture simulation and prediction in semi-arid regions are important for agricultural production, soil conservation and climate change. However, considerable heterogeneity in the spatial distribution of soil moisture, and poor ability of distributed hydrological models to estimate it, severely impact the use of soil moisture models in research and practical applications. In this study, a newly-developed technique of coupled (WA-ANN) wavelet analysis (WA) and artificial neural network (ANN) was applied for a multi-layer soil moisture simulation in the Pailugou catchment of the Qilian Mountains, Gansu Province, China. Datasets included seven meteorological factors: air and land surface temperatures, relative humidity, global radiation, atmospheric pressure, wind speed, precipitation, and soil water content at 20, 40, 60, 80, 120 and 160 cm. To investigate the effectiveness of WA-ANN, ANN was applied by itself to conduct a comparison. Three main findings of this study were: (1) ANN and WA-ANN provided a statistically reliable and robust prediction of soil moisture in both the root zone and deepest soil layer studied (NSE >0.85, NSE means Nash-Sutcliffe Efficiency coefficient); (2) when input meteorological factors were transformed using maximum signal to noise ratio (SNR) and one-dimensional auto de-noising algorithm (heursure) in WA, the coupling technique improved the performance of ANN especially for soil moisture at 160 cm depth; (3) the results of multi-layer soil moisture prediction indicated that there may be different sources of water at different soil layers, and this can be used as an indicator of the maximum impact depth of meteorological factors on the soil water content at this study site. We conclude that our results show that appropriate simulation methodology can provide optimal simulation with a minimum distortion of the raw-time series; the new method used here is applicable to soil sciences and management applications.
Neural networks and statistical learning
Du, Ke-Lin
2014-01-01
Providing a broad but in-depth introduction to neural network and machine learning in a statistical framework, this book provides a single, comprehensive resource for study and further research. All the major popular neural network models and statistical learning approaches are covered with examples and exercises in every chapter to develop a practical working understanding of the content. Each of the twenty-five chapters includes state-of-the-art descriptions and important research results on the respective topics. The broad coverage includes the multilayer perceptron, the Hopfield network, associative memory models, clustering models and algorithms, the radial basis function network, recurrent neural networks, principal component analysis, nonnegative matrix factorization, independent component analysis, discriminant analysis, support vector machines, kernel methods, reinforcement learning, probabilistic and Bayesian networks, data fusion and ensemble learning, fuzzy sets and logic, neurofuzzy models, hardw...
Directory of Open Access Journals (Sweden)
Eduardo O. de Cerqueira
2001-12-01
Full Text Available Neural Networks are a set of mathematical methods and computer programs designed to simulate the information process and the knowledge acquisition of the human brain. In last years its application in chemistry is increasing significantly, due the special characteristics for model complex systems. The basic principles of two types of neural networks, the multi-layer perceptrons and radial basis functions, are introduced, as well as, a pruning approach to architecture optimization. Two analytical applications based on near infrared spectroscopy are presented, the first one for determination of nitrogen content in wheat leaves using multi-layer perceptrons networks and second one for determination of BRIX in sugar cane juices using radial basis functions networks.
A Novel Technique to Image Annotation using Neural Network
Directory of Open Access Journals (Sweden)
Pankaj Savita
2013-03-01
Full Text Available : Automatic annotation of digital pictures is a key technology for managing and retrieving images from large image collection. Traditional image semantics extraction and representation schemes were commonly divided into two categories, namely visual features and text annotations. However, visual feature scheme are difficult to extract and are often semantically inconsistent. On the other hand, the image semantics can be well represented by text annotations. It is also easier to retrieve images according to their annotations. Traditional image annotation techniques are time-consuming and requiring lots of human effort. In this paper we propose Neural Network based a novel approach to the problem of image annotation. These approaches are applied to the Image data set. Our main work is focused on the image annotation by using multilayer perceptron, which exhibits a clear-cut idea on application of multilayer perceptron with special features. MLP Algorithm helps us to discover the concealed relations between image data and annotation data, and annotate image according to such relations. By using this algorithm we can save more memory space, and in case of web applications, transferring of images and download should be fast. This paper reviews 50 image annotation systems using supervised machine learning Techniques to annotate images for image retrieval. Results obtained show that the multi layer perceptron Neural Network classifier outperforms conventional DST Technique.
The Use of Artificial Neural Network for Prediction of Dissolution Kinetics
Directory of Open Access Journals (Sweden)
H. Elçiçek
2014-01-01
Full Text Available Colemanite is a preferred boron mineral in industry, such as boric acid production, fabrication of heat resistant glass, and cleaning agents. Dissolution of the mineral is one of the most important processes for these industries. In this study, dissolution of colemanite was examined in water saturated with carbon dioxide solutions. Also, prediction of dissolution rate was determined using artificial neural networks (ANNs which are based on the multilayered perceptron. Reaction temperature, total pressure, stirring speed, solid/liquid ratio, particle size, and reaction time were selected as input parameters to predict the dissolution rate. Experimental dataset was used to train multilayer perceptron (MLP networks to allow for prediction of dissolution kinetics. Developing ANNs has provided highly accurate predictions in comparison with an obtained mathematical model used through regression method. We conclude that ANNs may be a preferred alternative approach instead of conventional statistical methods for prediction of boron minerals.
Memristor-based multilayer neural networks with online gradient descent training.
Soudry, Daniel; Di Castro, Dotan; Gal, Asaf; Kolodny, Avinoam; Kvatinsky, Shahar
2015-10-01
Learning in multilayer neural networks (MNNs) relies on continuous updating of large matrices of synaptic weights by local rules. Such locality can be exploited for massive parallelism when implementing MNNs in hardware. However, these update rules require a multiply and accumulate operation for each synaptic weight, which is challenging to implement compactly using CMOS. In this paper, a method for performing these update operations simultaneously (incremental outer products) using memristor-based arrays is proposed. The method is based on the fact that, approximately, given a voltage pulse, the conductivity of a memristor will increment proportionally to the pulse duration multiplied by the pulse magnitude if the increment is sufficiently small. The proposed method uses a synaptic circuit composed of a small number of components per synapse: one memristor and two CMOS transistors. This circuit is expected to consume between 2% and 8% of the area and static power of previous CMOS-only hardware alternatives. Such a circuit can compactly implement hardware MNNs trainable by scalable algorithms based on online gradient descent (e.g., backpropagation). The utility and robustness of the proposed memristor-based circuit are demonstrated on standard supervised learning tasks. PMID:25594981
Fernández-Delgado, Manuel; Cernadas, Eva; Barro, Senén; Ribeiro, Jorge; Neves, José
2014-02-01
The Direct Kernel Perceptron (DKP) (Fernández-Delgado et al., 2010) is a very simple and fast kernel-based classifier, related to the Support Vector Machine (SVM) and to the Extreme Learning Machine (ELM) (Huang, Wang, & Lan, 2011), whose α-coefficients are calculated directly, without any iterative training, using an analytical closed-form expression which involves only the training patterns. The DKP, which is inspired by the Direct Parallel Perceptron, (Auer et al., 2008), uses a Gaussian kernel and a linear classifier (perceptron). The weight vector of this classifier in the feature space minimizes an error measure which combines the training error and the hyperplane margin, without any tunable regularization parameter. This weight vector can be translated, using a variable change, to the α-coefficients, and both are determined without iterative calculations. We calculate solutions using several error functions, achieving the best trade-off between accuracy and efficiency with the linear function. These solutions for the α coefficients can be considered alternatives to the ELM with a new physical meaning in terms of error and margin: in fact, the linear and quadratic DKP are special cases of the two-class ELM when the regularization parameter C takes the values C=0 and C=∞. The linear DKP is extremely efficient and much faster (over a vast collection of 42 benchmark and real-life data sets) than 12 very popular and accurate classifiers including SVM, Multi-Layer Perceptron, Adaboost, Random Forest and Bagging of RPART decision trees, Linear Discriminant Analysis, K-Nearest Neighbors, ELM, Probabilistic Neural Networks, Radial Basis Function neural networks and Generalized ART. Besides, despite its simplicity and extreme efficiency, DKP achieves higher accuracies than 7 out of 12 classifiers, exhibiting small differences with respect to the best ones (SVM, ELM, Adaboost and Random Forest), which are much slower. Thus, the DKP provides an easy and fast way
Neural Network-Based Model for Landslide Susceptibility and Soil Longitudinal Profile Analyses
DEFF Research Database (Denmark)
Farrokhzad, F.; Barari, Amin; Choobbasti, A. J.;
2011-01-01
The purpose of this study was to create an empirical model for assessing the landslide risk potential at Savadkouh Azad University, which is located in the rural surroundings of Savadkouh, about 5 km from the city of Pol-Sefid in northern Iran. The soil longitudinal profile of the city of Babol......, located 25 km from the Caspian Sea, also was predicted with an artificial neural network (ANN). A multilayer perceptron neural network model was applied to the landslide area and was used to analyze specific elements in the study area that contributed to previous landsliding events. The ANN models were...... studies in landslide susceptibility zonation....
A Neural Auto-depth Controller for an Unmanned Underwater Vehicle
Sutton, R.; Johnson, C.; Roberts, G. N.
Artificial neural networks offer an alternative strategy for the nonlinear control of unmanned underwater vehicles (UUVS). This paper investigates the use of a multi-layered perceptron (MLP) network in controlling an UUV over a sea-bed profile and compares the use of applying chemotaxis learning to that of the more commonly employed back propagation algorithm. The results show that, for differing sized MLPs, the chemotaxis algorithm produces a successful controller over the sea-bed profile in an improved training time. Also it will be shown that, in the presence of noise and change in vehicle mass, the neural controller out-performed a classical proportional-integral-derivative controller.
APPLICATION OF NEURAL NETWORK ALGORITHMS FOR BPM LINEARIZATION
Energy Technology Data Exchange (ETDEWEB)
Musson, John C. [JLAB; Seaton, Chad [JLAB; Spata, Mike F. [JLAB; Yan, Jianxun [JLAB
2012-11-01
Stripline BPM sensors contain inherent non-linearities, as a result of field distortions from the pickup elements. Many methods have been devised to facilitate corrections, often employing polynomial fitting. The cost of computation makes real-time correction difficult, particulalry when integer math is utilized. The application of neural-network technology, particularly the multi-layer perceptron algorithm, is proposed as an efficient alternative for electrode linearization. A process of supervised learning is initially used to determine the weighting coefficients, which are subsequently applied to the incoming electrode data. A non-linear layer, known as an activation layer, is responsible for the removal of saturation effects. Implementation of a perceptron in an FPGA-based software-defined radio (SDR) is presented, along with performance comparisons. In addition, efficient calculation of the sigmoidal activation function via the CORDIC algorithm is presented.
Generalization and capacity of extensively large two-layered perceptrons.
Rosen-Zvi, Michal; Engel, Andreas; Kanter, Ido
2002-09-01
The generalization ability and storage capacity of a treelike two-layered neural network with a number of hidden units scaling as the input dimension is examined. The mapping from the input to the hidden layer is via Boolean functions; the mapping from the hidden layer to the output is done by a perceptron. The analysis is within the replica framework where an order parameter characterizing the overlap between two networks in the combined space of Boolean functions and hidden-to-output couplings is introduced. The maximal capacity of such networks is found to scale linearly with the logarithm of the number of Boolean functions per hidden unit. The generalization process exhibits a first-order phase transition from poor to perfect learning for the case of discrete hidden-to-output couplings. The critical number of examples per input dimension, alpha(c), at which the transition occurs, again scales linearly with the logarithm of the number of Boolean functions. In the case of continuous hidden-to-output couplings, the generalization error decreases according to the same power law as for the perceptron, with the prefactor being different. PMID:12366215
Using neural networks for prediction of nuclear parameters
International Nuclear Information System (INIS)
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Empirical modeling of nuclear power plants using neural networks
International Nuclear Information System (INIS)
A summary of a procedure for nonlinear identification of process dynamics encountered in nuclear power plant components is presented in this paper using artificial neural systems. A hybrid feedforward/feedback neural network, namely, a recurrent multilayer perceptron, is used as the nonlinear structure for system identification. In the overall identification process, the feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of time-dependent system nonlinearities. The standard backpropagation learning algorithm is modified and is used to train the proposed hybrid network in a supervised manner. The performance of recurrent multilayer perceptron networks in identifying process dynamics is investigated via the case study of a U-tube steam generator. The nonlinear response of a representative steam generator is predicted using a neural network and is compared to the response obtained from a sophisticated physical model during both high- and low-power operation. The transient responses compare well, though further research is warranted for training and testing of recurrent neural networks during more severe operational transients and accident scenarios
Using neural networks for prediction of nuclear parameters
Energy Technology Data Exchange (ETDEWEB)
Pereira Filho, Leonidas; Souto, Kelling Cabral, E-mail: leonidasmilenium@hotmail.com, E-mail: kcsouto@bol.com.br [Instituto Federal de Educacao, Ciencia e Tecnologia do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ (Brazil); Machado, Marcelo Dornellas, E-mail: dornemd@eletronuclear.gov.br [Eletrobras Termonuclear S.A. (GCN.T/ELETRONUCLEAR), Rio de Janeiro, RJ (Brazil). Gerencia de Combustivel Nuclear
2013-07-01
Dating from 1943, the earliest work on artificial neural networks (ANN), when Warren Mc Cullock and Walter Pitts developed a study on the behavior of the biological neuron, with the goal of creating a mathematical model. Some other work was done until after the 80 witnessed an explosion of interest in ANNs, mainly due to advances in technology, especially microelectronics. Because ANNs are able to solve many problems such as approximation, classification, categorization, prediction and others, they have numerous applications in various areas, including nuclear. Nodal method is adopted as a tool for analyzing core parameters such as boron concentration and pin power peaks for pressurized water reactors. However, this method is extremely slow when it is necessary to perform various core evaluations, for example core reloading optimization. To overcome this difficulty, in this paper a model of Multi-layer Perceptron (MLP) artificial neural network type backpropagation will be trained to predict these values. The main objective of this work is the development of Multi-layer Perceptron (MLP) artificial neural network capable to predict, in very short time, with good accuracy, two important parameters used in the core reloading problem - Boron Concentration and Power Peaking Factor. For the training of the neural networks are provided loading patterns and nuclear data used in cycle 19 of Angra 1 nuclear power plant. Three models of networks are constructed using the same input data and providing the following outputs: 1- Boron Concentration and Power Peaking Factor, 2 - Boron Concentration and 3 - Power Peaking Factor. (author)
Learning Dynamic Classes of Events using Stacked Multilayer Perceptron Networks
Kanhabua, Nattiya; Ren, Huamin; Moeslund, Thomas B
2016-01-01
People often use a web search engine to find information about events of interest, for example, sport competitions, political elections, festivals and entertainment news. In this paper, we study a problem of detecting event-related queries, which is the first step before selecting a suitable time-aware retrieval model. In general, event-related information needs can be observed in query streams through various temporal patterns of user search behavior, e.g., spiky peaks for popular events, an...
Option Pricing Using Bayesian Neural Networks
Pires, Michael Maio
2007-01-01
Options have provided a field of much study because of the complexity involved in pricing them. The Black-Scholes equations were developed to price options but they are only valid for European styled options. There is added complexity when trying to price American styled options and this is why the use of neural networks has been proposed. Neural Networks are able to predict outcomes based on past data. The inputs to the networks here are stock volatility, strike price and time to maturity with the output of the network being the call option price. There are two techniques for Bayesian neural networks used. One is Automatic Relevance Determination (for Gaussian Approximation) and one is a Hybrid Monte Carlo method, both used with Multi-Layer Perceptrons.
Exponential synchronization of general chaotic delayed neural networks via hybrid feedback
Institute of Scientific and Technical Information of China (English)
无
2008-01-01
This paper investigates the exponential synchronization problem of some chaotic delayed neural networks based on the proposed general neural network model, which is the interconnection of a linear delayed dynamic system and a bounded static nonlinear operator, and covers several well-known neural networks, such as Hopfield neural networks, cellular neural networks (CNNs), bidirectional associative memory (BAM) networks, recurrent multilayer perceptrons (RMLPs). By virtue of LyapunovKrasovskii stability theory and linear matrix inequality (LMI) technique, some exponential synchronization criteria are derived.Using the drive-response concept, hybrid feedback controllers are designed to synchronize two identical chaotic neural networks based on those synchronization criteria. Finally, detailed comparisons with existing results are made and numerical simulations are carried out to demonstrate the effectiveness of the established synchronization laws.
Inflow forecasting using Artificial Neural Networks for reservoir operation
Chiamsathit, Chuthamat; Adeloye, Adebayo J.; Bankaru-Swamy, Soundharajan
2016-01-01
In this study, multi-layer perceptron (MLP) artificial neural networks have been applied to forecast one-month-ahead inflow for the Ubonratana reservoir, Thailand. To assess how well the forecast inflows have performed in the operation of the reservoir, simulations were carried out guided by the systems rule curves. As basis of comparison, four inflow situations were considered: (1) inflow known and assumed to be the historic (Type A); (2) inflow known and assumed to be the ...
Prediction of total resistance coefficients using neural networks
Ortigosa Barragán, Inma; Revilla López, Guillermo; García Espinosa, Julio
2009-01-01
The Holtrop & Mennen method is widely used at the initial design stage of ships for estimating the resistance of the ship (Holtrop and Mennen, 1982). The Holtrop & Mennen method provide a prediction of the total resistance’s components. In this work we present a neural network model which performs the same task as the Holtrop & Mennem’s method, for two of the total resistance’s components. A multilayer perceptron has been therefore trained to learn the relationship between the input (length-d...
Advances in Artificial Neural Networks – Methodological Development and Application
Directory of Open Access Journals (Sweden)
Yanbo Huang
2009-08-01
Full Text Available Artificial neural networks as a major soft-computing technology have been extensively studied and applied during the last three decades. Research on backpropagation training algorithms for multilayer perceptron networks has spurred development of other neural network training algorithms for other networks such as radial basis function, recurrent network, feedback network, and unsupervised Kohonen self-organizing network. These networks, especially the multilayer perceptron network with a backpropagation training algorithm, have gained recognition in research and applications in various scientific and engineering areas. In order to accelerate the training process and overcome data over-fitting, research has been conducted to improve the backpropagation algorithm. Further, artificial neural networks have been integrated with other advanced methods such as fuzzy logic and wavelet analysis, to enhance the ability of data interpretation and modeling and to avoid subjectivity in the operation of the training algorithm. In recent years, support vector machines have emerged as a set of high-performance supervised generalized linear classifiers in parallel with artificial neural networks. A review on development history of artificial neural networks is presented and the standard architectures and algorithms of artificial neural networks are described. Furthermore, advanced artificial neural networks will be introduced with support vector machines, and limitations of ANNs will be identified. The future of artificial neural network development in tandem with support vector machines will be discussed in conjunction with further applications to food science and engineering, soil and water relationship for crop management, and decision support for precision agriculture. Along with the network structures and training algorithms, the applications of artificial neural networks will be reviewed as well, especially in the fields of agricultural and biological
Fast lossless color image compression method using perceptron
Institute of Scientific and Technical Information of China (English)
贾克斌; 张延华; 庄新月
2004-01-01
The technique of lossless image compression plays an important role in image transmission and storage for high quality. At present, both the compression ratio and processing speed should be considered in a real-time multimedia system. A novel lossless compression algorithm is researched. A low complexity predictive model is proposed using the correlation of pixels and color components. In the meantime, perceptron in neural network is used to rectify the prediction values adaptively. It makes the prediction residuals smaller and in a small dynamic scope. Also a color space transform is used and good decorrelation is obtained in our algorithm. The compared experimental results have shown that our algorithm has a noticeably better performance than traditional algorithms. Compared to the new standard JPEG-LS, this predictive model reduces its computational complexity. And its speed is faster than the JPEG-LS with negligible performance sacrifice.
Energy Technology Data Exchange (ETDEWEB)
Bordieu, Ch.; Rebiere, D. [Bordeaux-1 Univ., Lab. IXL, UMR CNRS 5818, 33 (France); Pistre, J.; Planata, R. [Centre d' Etudes du Bouchet, 91 - Vert-le-Petit (France)
1999-07-01
The association of artificial neural networks (multilayer perceptrons) with a real time pattern recognition technique (shifting windows) allowed the development of systems for the detection and the quantification of gases. Shifting window technique is presented and offers an interesting way to improve the detection response time. The partial detector characterization with regard to its parameters was realized. Applications dealing with the detection of gas compounds using surface acoustic sensors permit to show the shifting window technique feasibility. (author)
Energy Technology Data Exchange (ETDEWEB)
Furini, M.A.; Araujo, P.B. de; Pereira, A.L.S. [Universidade Estadual Paulista (FEIS/UNESP), Ilha Solteira, SP (Brazil). Fac. de Engenharia. Dept. Engenharia Eletrica], Emails: mafurini@aluno.feis.unesp.br, percival@dee.feis.unesp.br, andspa@gmail.com
2009-07-01
This paper aims at analyzing the main operation and design of operationally robust controllers in order to damp the electromechanics oscillations type inter area. For this we used an intelligent control technique based on artificial neural networks, where a multilayer perceptron it was implemented. We used a symmetrical test system of four generators, ten bars and nine transmission lines to verify the performance of the power system stabilizers and power oscillation damping (POD) for the FACTS devices, unified power flow controller (UPFC), designed for neural networks. The results show the superiority in the operation and control of oscillations in power systems using UPFC equipped with the POD.
Neural Networks for Non-linear Control
DEFF Research Database (Denmark)
Sørensen, O.
1994-01-01
This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process.......This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process....
Radial basis function neural network for power system load-flow
Energy Technology Data Exchange (ETDEWEB)
Karami, A.; Mohammadi, M.S. [Faculty of Engineering, The University of Guilan, P.O. Box 41635-3756, Rasht (Iran)
2008-01-15
This paper presents a method for solving the load-flow problem of the electric power systems using radial basis function (RBF) neural network with a fast hybrid training method. The main idea is that some operating conditions (values) are needed to solve the set of non-linear algebraic equations of load-flow by employing an iterative numerical technique. Therefore, we may view the outputs of a load-flow program as functions of the operating conditions. Indeed, we are faced with a function approximation problem and this can be done by an RBF neural network. The proposed approach has been successfully applied to the 10-machine and 39-bus New England test system. In addition, this method has been compared with that of a multi-layer perceptron (MLP) neural network model. The simulation results show that the RBF neural network is a simpler method to implement and requires less training time to converge than the MLP neural network. (author)
File access prediction using neural networks.
Patra, Prashanta Kumar; Sahu, Muktikanta; Mohapatra, Subasish; Samantray, Ronak Kumar
2010-06-01
One of the most vexing issues in design of a high-speed computer is the wide gap of access times between the memory and the disk. To solve this problem, static file access predictors have been used. In this paper, we propose dynamic file access predictors using neural networks to significantly improve upon the accuracy, success-per-reference, and effective-success-rate-per-reference by using neural-network-based file access predictor with proper tuning. In particular, we verified that the incorrect prediction has been reduced from 53.11% to 43.63% for the proposed neural network prediction method with a standard configuration than the recent popularity (RP) method. With manual tuning for each trace, we are able to improve upon the misprediction rate and effective-success-rate-per-reference using a standard configuration. Simulations on distributed file system (DFS) traces reveal that exact fit radial basis function (RBF) gives better prediction in high end system whereas multilayer perceptron (MLP) trained with Levenberg-Marquardt (LM) backpropagation outperforms in system having good computational capability. Probabilistic and competitive predictors are the most suitable for work stations having limited resources to deal with and the former predictor is more efficient than the latter for servers having maximum system calls. Finally, we conclude that MLP with LM backpropagation algorithm has better success rate of file prediction than those of simple perceptron, last successor, stable successor, and best k out of m predictors.
Directory of Open Access Journals (Sweden)
Ratnadip Dey
2013-02-01
Full Text Available A Threshold Logic Unit (TLU is a mathematical function conceived as a crude model, or abstraction of biological neurons. Threshold logic units are the constitutive units in an artificial neural network. In this paper a positive clock-edge triggered T flip-flop is designed using Perceptron Learning Algorithm, which is a basic design algorithm of threshold logic units. Then this T flip-flop is used to design a two-bit up-counter that goes through the states 0, 1, 2, 3, 0, 1… Ultimately, the goal is to show how to design simple logic units based on threshold logic based perceptron concepts.
STAND-LEVEL PROGNOSIS OF EUCALYPTUS CLONES USING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Mayra Luiza Marques da Silva Binoti
2015-03-01
Full Text Available The objective of this study was to train, implement and evaluate the efficiency of artificial neural networks (ANN to perform production prognosis of even-aged stands of eucalyptus clones. The data used were from plantations located in southern Bahia, totaling about 2,000 acres of forest. Numeric variables, such as age, basal area, volume and categorical variables, such as soil class texture, spacing, land relief, project and clone were used. The data were randomly divided into two groups: training (80% and generalization (20%. Three types of networks were trained: perceptron, multilayer perceptron networks and radial basis function. The RNA that showed the best performance in training and generalization were selected to perform the prognosis with data from the first forest inventory. We conclude that the RNA had satisfactory results, showing the potential and applicability of the technique in solving measurement and forest management problems.
Chattopadhyay, Surajit; Chattopadhyay, Goutami
2012-10-01
In the work discussed in this paper we considered total ozone time series over Kolkata (22°34'10.92″N, 88°22'10.92″E), an urban area in eastern India. Using cloud cover, average temperature, and rainfall as the predictors, we developed an artificial neural network, in the form of a multilayer perceptron with sigmoid non-linearity, for prediction of monthly total ozone concentrations from values of the predictors in previous months. We also estimated total ozone from values of the predictors in the same month. Before development of the neural network model we removed multicollinearity by means of principal component analysis. On the basis of the variables extracted by principal component analysis, we developed three artificial neural network models. By rigorous statistical assessment it was found that cloud cover and rainfall can act as good predictors for monthly total ozone when they are considered as the set of input variables for the neural network model constructed in the form of a multilayer perceptron. In general, the artificial neural network has good potential for predicting and estimating monthly total ozone on the basis of the meteorological predictors. It was further observed that during pre-monsoon and winter seasons, the proposed models perform better than during and after the monsoon.
Directory of Open Access Journals (Sweden)
Mustafa Ahmet Beyazıt Ocaktan
2013-06-01
Full Text Available Real life problems are generally large-scale and difficult to model. Therefore, these problems can't be mostly solved by classical optimisation methods. This paper presents a reinforcement learning algorithm using a multi-layer artificial neural network to find an approximate solution for large-scale semi Markov decision problems. Performance of the developed algorithm is measured and compared to the classical reinforcement algorithm on a small-scale numerical example. According to results of numerical examples, a number of hidden layer are the key success factors, and average cost of the solution generated by the developed algorithm is approximately equal to that generated by the classical reinforcement algorithm.
A Neural Network Approach for Inverse Kinematic of a SCARA Manipulator
Directory of Open Access Journals (Sweden)
Panchanand Jha
2014-07-01
Full Text Available Inverse kinematic is one of the most interesting problems of industrial robot. The inverse kinematics problem in robotics is about the determination of joint angles for a desired Cartesian position of the end effector. It comprises of the computation need to find the joint angles for a given Cartesian position and orientation of the end effectors to control a robot arm. There is no unique solution for the inverse kinematics thus necessitating application of appropriate predictive models from the soft computing domain. Artificial neural network is one such technique which can be gainfully used to yield the acceptable results. This paper proposes a structured artificial neural network (ANN model to find the inverse kinematics solution of a 4-dof SCARA manipulator. The ANN model used is a multi-layered perceptron neural network (MLPNN, wherein gradient descent type of learning rules is applied. An attempt has been made to find the best ANN configuration for the problem. It is found that multi-layered perceptron neural network gives minimum mean square error.
Stochastic resonance in an intracellular genetic perceptron
Bates, Russell; Blyuss, Oleg; Zaikin, Alexey
2014-03-01
Intracellular genetic networks are more intelligent than was first assumed due to their ability to learn. One of the manifestations of this intelligence is the ability to learn associations of two stimuli within gene-regulating circuitry: Hebbian-type learning within the cellular life. However, gene expression is an intrinsically noisy process; hence, we investigate the effect of intrinsic and extrinsic noise on this kind of intracellular intelligence. We report a stochastic resonance in an intracellular associative genetic perceptron, a noise-induced phenomenon, which manifests itself in noise-induced increase of response in efficiency after the learning event under the conditions of optimal stochasticity.
Dual adaptive dynamic control of mobile robots using neural networks.
Bugeja, Marvin K; Fabri, Simon G; Camilleri, Liberato
2009-02-01
This paper proposes two novel dual adaptive neural control schemes for the dynamic control of nonholonomic mobile robots. The two schemes are developed in discrete time, and the robot's nonlinear dynamic functions are assumed to be unknown. Gaussian radial basis function and sigmoidal multilayer perceptron neural networks are used for function approximation. In each scheme, the unknown network parameters are estimated stochastically in real time, and no preliminary offline neural network training is used. In contrast to other adaptive techniques hitherto proposed in the literature on mobile robots, the dual control laws presented in this paper do not rely on the heuristic certainty equivalence property but account for the uncertainty in the estimates. This results in a major improvement in tracking performance, despite the plant uncertainty and unmodeled dynamics. Monte Carlo simulation and statistical hypothesis testing are used to illustrate the effectiveness of the two proposed stochastic controllers as applied to the trajectory-tracking problem of a differentially driven wheeled mobile robot.
Practical Application of Neural Networks in State Space Control
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon
In the present thesis we address some problems in discrete-time state space control of nonlinear dynamical systems and attempt to solve them using generic nonlinear models based on artificial neural networks. The main aim of the work is to examine how well such control algorithms perform when...... applied to a realistic process. The thesis therefore strives to provide a thorough treatment of two classes of neural network-based controllers, and to make a rigorous comparison between them and a classical linear controller. Thus, the thesis starts out with a short review of some relevant system...... theoretic notions followed by a detailed description of the topology, neuron functions and learning rules of the two types of neural networks treated in the thesis, the multilayer perceptron and the neurofuzzy networks. In both cases, a Least Squares second-order gradient method is used to train...
Metzler, R; Kinzel, W; Kanter, I
2000-08-01
Several scenarios of interacting neural networks which are trained either in an identical or in a competitive way are solved analytically. In the case of identical training each perceptron receives the output of its neighbor. The symmetry of the stationary state as well as the sensitivity to the used training algorithm are investigated. Two competitive perceptrons trained on mutually exclusive learning aims and a perceptron which is trained on the opposite of its own output are examined analytically. An ensemble of competitive perceptrons is used as decision-making algorithms in a model of a closed market (El Farol Bar problem or the Minority Game. In this game, a set of agents who have to make a binary decision is considered.); each network is trained on the history of minority decisions. This ensemble of perceptrons relaxes to a stationary state whose performance can be better than random. PMID:11088736
Institute of Scientific and Technical Information of China (English)
Liu Ranbing; Liu Leiming; Zhang Faqiang; Li Changhua
2008-01-01
This paper creates a LM (Levenberg-Marquardt) algorithm model which is appropriate to solve the problem a-bout weights value of feedforward neural network. On the base of this model, we provide two applications in the oilfield production. Firstly, we simulated the functional relationships between the petrophysical and electrical properties of the rock by neural networks model, and studied oil saturation. Under the precision of data is confirmed, this method can re-duce the number of experiments. Secondly, we simulated the relationships between investment and income by the neural networks model, and studied invest saturation point and income growth rate. It is very significant to guide the investment decision. The research result shows that the model is suitable for the modeling and identification of nonlinear systems due to the great fit characteristic of neural network and very fast convergence speed of LM algorithm.
Training a multilayer neural network for the Euro-dollar (EUR/ USD) exchange rate
Jaime Alberto Villamil Torres; Jesús Alberto Delgado Rivera
2010-01-01
A mathematical tool or model for predicting how an economic variable like the exchange rate (relative price between two currencies) will respond is a very important need for investors and policy-makers. Most current techniques are based on statistics, particularly linear time series theory. Artificial neural networks (ANNs) are mathematical models which try to emulate biological neural networks’ parallelism and nonlinearity; these models have been successfully applied in Economics and Enginee...
Neural networks in front-end processing and control
International Nuclear Information System (INIS)
Research into neural networks has gained a large following in recent years. In spite of the long term timescale of this Artificial Intelligence research, the tools which the community is developing can already find useful applications to real practical problems in experimental research. One of the main advantages of the parallel algorithms being developed in AI is the structural simplicity of the required hardware implementation, and the simple nature of the calculations involved. This makes these techniques ideal for problems in which both speed and data volume reduction are important, the case for most front-end processing tasks. In this paper the authors illustrate the use of a particular neural network known as the Multi-Layer Perceptron as a method for solving several different tasks, all drawn from the field of Tokamak research. The authors also briefly discuss the use of the Multi-Layer Perceptron as a non-linear controller in a feedback loop. The authors outline the type of problem which can be usefully addressed by these techniques, even before the large-scale parallel processing hardware currently under development becomes cheaply available. The authors also present some of the difficulties encountered in applying these networks
Alternative Sensor System and MLP Neural Network for Vehicle Pedal Activity Estimation
Directory of Open Access Journals (Sweden)
Ahmed M. Wefky
2010-04-01
Full Text Available It is accepted that the activity of the vehicle pedals (i.e., throttle, brake, clutch reflects the driver’s behavior, which is at least partially related to the fuel consumption and vehicle pollutant emissions. This paper presents a solution to estimate the driver activity regardless of the type, model, and year of fabrication of the vehicle. The solution is based on an alternative sensor system (regime engine, vehicle speed, frontal inclination and linear acceleration that reflects the activity of the pedals in an indirect way, to estimate that activity by means of a multilayer perceptron neural network with a single hidden layer.
International Nuclear Information System (INIS)
The artificial neural network technique was used to identify drugs and plastic explosives, from a tomography composed by a set of six neutrongraphic projections obtained in real time. Bidimensional tomographic images of samples of drugs, explosives and other materials, when digitally processed, yield the characteristic spectra of each type of material. The information contained in those spectra was then used for ANN training, the best images being obtained when the multilayer perceptron model, the back-propagation training algorithm and the Cross-validation interruption criterion were used. ANN showed to be useful in forecasting presence of drugs and explosives hitting a rate of success above 97 %. (author)
Application of Artificial Neural Network For Path Loss Prediction In Urban Macrocellular Environment
Directory of Open Access Journals (Sweden)
Joseph M. Mom
2016-07-01
Full Text Available An artificial neural network model for the prediction of path loss in urban macrocellular environment is presented. The model consists of a multilayer perceptron trained with measured data using Scaled Conjugate Gradient algorithm. Comparison between the proposed model on one hand, and the free space, Hata and Egli models on the other hand shows a better prediction result. With the proposed ANN model a good generalization is achieved, and it is accurate in environments different from the one used in training the network.
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
Directory of Open Access Journals (Sweden)
A. El-Shafie
2012-04-01
Full Text Available Rainfall is considered as one of the major components of the hydrological process; it takes significant part in evaluating drought and flooding events. Therefore, it is important to have an accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting tasks as multi-layer perceptron neural networks (MLP-NN. In fact, the rainfall time series modeling involves an important temporal dimension. On the other hand, the classical MLP-NN is a static and has a memoryless network architecture that is effective for complex nonlinear static mapping. This research focuses on investigating the potential of introducing a neural network that could address the temporal relationships of the rainfall series.
Two different static neural networks and one dynamic neural network, namely the multi-layer perceptron neural network (MLP-NN, radial basis function neural network (RBFNN and input delay neural network (IDNN, respectively, have been examined in this study. Those models had been developed for the two time horizons for monthly and weekly rainfall forecasting at Klang River, Malaysia. Data collected over 12 yr (1997–2008 on a weekly basis and 22 yr (1987–2008 on a monthly basis were used to develop and examine the performance of the proposed models. Comprehensive comparison analyses were carried out to evaluate the performance of the proposed static and dynamic neural networks. Results showed that the MLP-NN neural network model is able to follow trends of the actual rainfall, however, not very accurately. RBFNN model achieved better accuracy than the MLP-NN model. Moreover, the forecasting accuracy of the IDNN model was better than that of static network during both training and testing stages, which proves a consistent level of accuracy with seen and unseen data.
Heinke, D; Hamker, F H
1998-01-01
This article compares the performance of some recently developed incremental neural networks with the wellknown multilayer perceptron (MLP) on real-world data. The incremental networks are fuzzy ARTMAP (FAM), growing neural gas (GNG) and growing cell structures (GCS). The real-world datasets consist of four different datasets posing different challenges to the networks in terms of complexity of decision boundaries, overlapping between classes, and size of the datasets. The performance of the networks on the datasets is reported with respect to measure classification error, number of training epochs, and sensitivity toward variation of parameters. Statistical evaluations are applied to examine the significance of the results. The overall performance ranks in the following descending order: GNG, GCS, MLP, FAM. PMID:18255809
Directory of Open Access Journals (Sweden)
Hossein Naderi
2012-08-01
Full Text Available Stock market prediction is one of the most important interesting areas of research in business. Stock markets prediction is normally assumed as tedious task since there are many factors influencing the market. The primary objective of this paper is to forecast trend closing price movement of Tehran Stock Exchange (TSE using financial accounting ratios from year 2003 to year 2008. The proposed study of this paper uses two approaches namely Artificial Neural Networks and multi-layer perceptron. Independent variables are accounting ratios and dependent variable of stock price , so the latter was gathered for the industry of Motor Vehicles and Auto Parts. The results of this study show that neural networks models are useful tools in forecasting stock price movements in emerging markets but multi-layer perception provides better results in term of lowering error terms.
An Intelligent Ensemble Neural Network Model for Wind Speed Prediction in Renewable Energy Systems.
Ranganayaki, V; Deepa, S N
2016-01-01
Various criteria are proposed to select the number of hidden neurons in artificial neural network (ANN) models and based on the criterion evolved an intelligent ensemble neural network model is proposed to predict wind speed in renewable energy applications. The intelligent ensemble neural model based wind speed forecasting is designed by averaging the forecasted values from multiple neural network models which includes multilayer perceptron (MLP), multilayer adaptive linear neuron (Madaline), back propagation neural network (BPN), and probabilistic neural network (PNN) so as to obtain better accuracy in wind speed prediction with minimum error. The random selection of hidden neurons numbers in artificial neural network results in overfitting or underfitting problem. This paper aims to avoid the occurrence of overfitting and underfitting problems. The selection of number of hidden neurons is done in this paper employing 102 criteria; these evolved criteria are verified by the computed various error values. The proposed criteria for fixing hidden neurons are validated employing the convergence theorem. The proposed intelligent ensemble neural model is applied for wind speed prediction application considering the real time wind data collected from the nearby locations. The obtained simulation results substantiate that the proposed ensemble model reduces the error value to minimum and enhances the accuracy. The computed results prove the effectiveness of the proposed ensemble neural network (ENN) model with respect to the considered error factors in comparison with that of the earlier models available in the literature.
Learning algorithms for perceptrons from statistical physics
Gordon, Mirta B.; Peretto, Pierre; Berchier, Dominique
1993-02-01
Learning algorithms for perceptrons are deduced from statistical mechanics. Thermodynamical quantities are used as cost functions which may be extremalized by gradient dynamics to find the synaptic efficacies that store the learning set of patterns. The learning rules so obtained are classified in two categories, following the statistics used to derive the cost functions, namely, Boltzmann statistics, and Fermi statistics. In the limits of zero or infinite temperatures some of the rules behave like already known algorithms, but new strategies for learning are obtained at finite temperatures, which minimize the number of errors on the training set. Nous déduisons des algorithmes d'apprentissage pour des perceptrons à partir de considérations de mécanique statistique. Des quantités thermodynamiques sont considérées comme des fonctions de coût, dont on obtient, par une dynamique de gradient, les efficacités synaptiques qui apprennent l'ensemble d'apprentissage. Les règles ainsi obtenues sont classées en deux catégories suivant les statistiques, de Boltzmann ou de Fermi, utilisées pour dériver les fonctions de coût. Dans les limites de températures nulle ou infinie, la plupart des règles trouvées tendent vers les algorithmes connus, mais à température finie on trouve des stratégies nouvelles, qui minimisent le nombre d'erreurs dans l'ensemble d'apprentissage.
MIMO transmit scheme based on morphological perceptron with competitive learning.
Valente, Raul Ambrozio; Abrão, Taufik
2016-08-01
This paper proposes a new multi-input multi-output (MIMO) transmit scheme aided by artificial neural network (ANN). The morphological perceptron with competitive learning (MP/CL) concept is deployed as a decision rule in the MIMO detection stage. The proposed MIMO transmission scheme is able to achieve double spectral efficiency; hence, in each time-slot the receiver decodes two symbols at a time instead one as Alamouti scheme. Other advantage of the proposed transmit scheme with MP/CL-aided detector is its polynomial complexity according to modulation order, while it becomes linear when the data stream length is greater than modulation order. The performance of the proposed scheme is compared to the traditional MIMO schemes, namely Alamouti scheme and maximum-likelihood MIMO (ML-MIMO) detector. Also, the proposed scheme is evaluated in a scenario with variable channel information along the frame. Numerical results have shown that the diversity gain under space-time coding Alamouti scheme is partially lost, which slightly reduces the bit-error rate (BER) performance of the proposed MP/CL-NN MIMO scheme. PMID:27135805
Training a multilayer neural network for the Euro-dollar (EUR/ USD exchange rate
Directory of Open Access Journals (Sweden)
Jaime Alberto Villamil Torres
2010-04-01
Full Text Available A mathematical tool or model for predicting how an economic variable like the exchange rate (relative price between two currencies will respond is a very important need for investors and policy-makers. Most current techniques are based on statistics, particularly linear time series theory. Artificial neural networks (ANNs are mathematical models which try to emulate biological neural networks’ parallelism and nonlinearity; these models have been successfully applied in Economics and Engineering since the 1980s. ANNs appear to be an alternative for modelling the behaviour of financial variables which resemble (as first approximation a random walk. This paper reports the results of using ANNs for Euro/USD exchange rate trading and the usefulness of the algorithm for chemotaxis leading to training networks thereby maximising an objective function re predicting a trader’s profits. JEL: F310, C450.
Identification of Non-Linear Structures using Recurrent Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Nielsen, Søren R. K.; Hansen, H. I.
1995-01-01
Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure.......Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure....
Identification of Non-Linear Structures using Recurrent Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Nielsen, Søren R. K.; Hansen, H. I.
Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure.......Two different partially recurrent neural networks structured as Multi Layer Perceptrons (MLP) are investigated for time domain identification of a non-linear structure....
Implementation of multi-layer feed forward neural network on PIC16F877 microcontroller
International Nuclear Information System (INIS)
Artificial Neural Network (ANN) is an electronic model based on the neural structure of the brain. Similar to human brain, ANN consists of interconnected simple processing units or neurons that process input to generate output signals. ANN operation is divided into 2 categories; training mode and service mode. This project aims to implement ANN on PIC micro-controller that enable on-chip or stand alone training and service mode. The input can varies from sensors or switches, while the output can be used to control valves, motors, light source and a lot more. As partial development of the project, this paper reports the current status and results of the implemented ANN. The hardware fraction of this project incorporates Microchip PIC16F877A microcontrollers along with uM-FPU math co-processor. uM-FPU is a 32-bit floating point co-processor utilized to execute complex calculation requires by the sigmoid activation function for neuron. ANN algorithm is converted to software program written in assembly language. The implemented ANN structure is three layer with one hidden layer, and five neurons with two hidden neurons. To prove the operability and functionality, the network is trained to solve three common logic gate operations; AND, OR, and XOR. This paper concludes that the ANN had been successfully implemented on PIC16F877a and uM-FPU math co-processor hardware that works accordingly on both training and service mode. (Author)
Regional application of multi-layer artificial neural networks in 3-D ionosphere tomography
Ghaffari Razin, Mir Reza; Voosoghi, Behzad
2016-08-01
Tomography is a very cost-effective method to study physical properties of the ionosphere. In this paper, residual minimization training neural network (RMTNN) is used in voxel-based tomography to reconstruct of 3-D ionosphere electron density with high spatial resolution. For numerical experiments, observations collected at 37 GPS stations from Iranian permanent GPS network (IPGN) are used. A smoothed TEC approach was used for absolute STEC recovery. To improve the vertical resolution, empirical orthogonal functions (EOFs) obtained from international reference ionosphere 2012 (IRI-2012) used as object function in training neural network. Ionosonde observations is used for validate reliability of the proposed method. Minimum relative error for RMTNN is 1.64% and maximum relative error is 15.61%. Also root mean square error (RMSE) of 0.17 × 1011 (electrons/m3) is computed for RMTNN which is less than RMSE of IRI2012. The results show that RMTNN has higher accuracy and compiles speed than other ionosphere reconstruction methods.
Perceptrons with Hebbian Learning Based on Wave Ensembles in Spatially Patterned Potentials
Espinosa-Ortega, T.; Liew, T. C. H.
2015-03-01
A general scheme to realize a perceptron for hardware neural networks is presented, where multiple interconnections are achieved by a superposition of Schrödinger waves. Spatially patterned potentials process information by coupling different points of reciprocal space. The necessary potential shape is obtained from the Hebbian learning rule, either through exact calculation or construction from a superposition of known optical inputs. This allows implementation in a wide range of compact optical systems, including (1) any nonlinear optical system, (2) optical systems patterned by optical lithography, and (3) exciton-polariton systems with phonon or nuclear spin interactions.
Directory of Open Access Journals (Sweden)
Therasa Chandrasekar
2015-10-01
Full Text Available This paper provides an exposition about application of neural networks in the context of research to find out the contribution of individual job satisfiers towards work commitment. The purpose of the current study is to build a predictive model to estimate the normalized importance of individual job satisfiers towards work commitment of employees working in TVS Group, an Indian automobile company. The study is based on the tool developed by Spector (1985 and Sue Hayday (2003.The input variable of the study consists of nine independent individual job satisfiers which includes Pay, Promotion, Supervision, Benefits, Rewards, Operating procedures, Co-workers, Work-itself and Communication of Spector (1985 and dependent variable as work commitment of Sue Hayday (2003.The primary data has been collected using a closed-ended questionnaire based on simple random sampling approach. This study employed the multilayer Perceptron neural network model to envisage the level of job satisfiers towards work commitment. The result from the multilayer Perceptron neural network model displayed with four hidden layer with correct classification rate of 70% and 30% for training and testing data set. The normalized importance shows high value for coworkers, superior satisfaction and communication and which acts as most significant attributes of job satisfiers that predicts the overall work commitment of employees.
A Multilayer Recurrent Fuzzy Neural Network for Accurate Dynamic System Modeling
Institute of Scientific and Technical Information of China (English)
LIU He; HUANG Dao
2008-01-01
A muitilayer recurrent fuzzy neural network (MRFNN)is proposed for accurate dynamic system modeling.The proposed MRFNN has six layers combined with T-S fuzzy model.The recurrent structures are formed by local feedback connections in the membership layer and the rule layer.With these feedbacks,the fuzzy sets are time-varying and the temporal problem of dynamic system can he solved well.The parameters of MRFNN are learned by chaotic search(CS)and least square estimation(LSE)simultaneously,where CS is for tuning the premise parameters and LSE is for updating the consequent coefficients accordingly.Results of simulations show the proposed approach is effective for dynamic system modeling with high accuracy.
An Efficient Rescaled Perceptron Algorithm for Conic Systems
Vempala, Santosh; Belloni, Alexandre; Freund, Robert Michael.
2009-01-01
The classical perceptron algorithm is an elementary row-action/relaxation algorithm for solving a homogeneous linear inequality system Ax > 0. A natural condition measure associated with this algorithm is the Euclidean width {tau} of the cone of feasible solutions, and the iteration complexity of the perceptron algorithm is bounded by 1/{tau}2 [see Rosenblatt, F. 1962. Principles of Neurodynamics. Spartan Books, Washington, DC]. Dunagan and Vempala [Dunagan, J., S. Vempala. 2007. A simple pol...
Spatial Data Mining Toolbox for Mapping Suitability of Landfill Sites Using Neural Networks
Abujayyab, S. K. M.; Ahamad, M. S. S.; Yahya, A. S.; Aziz, H. A.
2016-09-01
Mapping the suitability of landfill sites is a complex field and is involved with multidiscipline. The purpose of this research is to create an ArcGIS spatial data mining toolbox for mapping the suitability of landfill sites at a regional scale using neural networks. The toolbox is constructed from six sub-tools to prepare, train, and process data. The employment of the toolbox is straightforward. The multilayer perceptron (MLP) neural networks structure with a backpropagation learning algorithm is used. The dataset is mined from the north states in Malaysia. A total of 14 criteria are utilized to build the training dataset. The toolbox provides a platform for decision makers to implement neural networks for mapping the suitability of landfill sites in the ArcGIS environment. The result shows the ability of the toolbox to produce suitability maps for landfill sites.
CONTROL OF NONLINEAR PROCESS USING NEURAL NETWORK BASED MODEL PREDICTIVE CONTROL
Directory of Open Access Journals (Sweden)
Dr.A.TRIVEDI
2011-04-01
Full Text Available This paper presents a Neural Network based Model Predictive Control (NNMPC strategy to control nonlinear process. Multilayer Perceptron Neural Network (MLP is chosen to represent a Nonlinear Auto Regressive with eXogenous signal (NARX model of a nonlinear system. NARX dynamic model is based on feed-forward architecture and offers good approximation capabilities along with robustness and accuracy. Based on the identified neural model, a generalized predictive control (GPC algorithm is implemented to control the composition in acontinuous stirred tank reactor (CSTR, whose parameters are optimally determined by solving quadratic performance index using well known Levenberg-Marquardt and Quasi-Newton algorithm. NNMPC is tuned by selecting few horizon parameters and weighting factor. The tracking performance of the NNMPC is tested using different amplitude function as a reference signal on CSTR application. Also the robustness and performance is tested in the presence of disturbance on random reference signal.
SPATIAL DATA MINING TOOLBOX FOR MAPPING SUITABILITY OF LANDFILL SITES USING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
S. K. M. Abujayyab
2016-09-01
Full Text Available Mapping the suitability of landfill sites is a complex field and is involved with multidiscipline. The purpose of this research is to create an ArcGIS spatial data mining toolbox for mapping the suitability of landfill sites at a regional scale using neural networks. The toolbox is constructed from six sub-tools to prepare, train, and process data. The employment of the toolbox is straightforward. The multilayer perceptron (MLP neural networks structure with a backpropagation learning algorithm is used. The dataset is mined from the north states in Malaysia. A total of 14 criteria are utilized to build the training dataset. The toolbox provides a platform for decision makers to implement neural networks for mapping the suitability of landfill sites in the ArcGIS environment. The result shows the ability of the toolbox to produce suitability maps for landfill sites.
Robert, Stéphane; Battie, Yann; Jamon, Damien; Royer, Francois
2007-04-10
Optimal performances of integrated optical devices are obtained by the use of an accurate and reliable characterization method. The parameters of interest, i.e., optical indices and thickness of the waveguide structure, are calculated from effective indices by means of an inversion procedure. We demonstrate how an artificial neural network can achieve such a process. The artificial neural network used is a multilayer perceptron. The first result concerns a simulated anisotropic waveguide. The accuracy in the determination of optical indices and waveguide thickness is 5 x 10(-5) and 4 nm, respectively. Then an experimental application on a silica-titania thin film is performed. In addition, effective indices are measured by m-lines spectroscopy. Finally, a comparison with a classical optimization algorithm demonstrates the robustness of the neural method. PMID:17384718
PREDICTION OF BOD AND COD OF A REFINERY WASTEWATER USING MULTILAYER ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Eldon Raj Rene
2008-06-01
Full Text Available In the recent past, artificial neural networks (ANNs have shown the ability to learn and capture non-linear static or dynamic behaviour among variables based on the given set of data. Since the knowledge of internal procedure is not necessary, the modelling can take place with minimum previous knowledge about the process through proper training of the network. In the present study, 12 ANN based models were proposed to predict the Biochemical Oxygen Demand (BOD5 and Chemical Oxygen Demand (COD concentrations of wastewater generated from the effluent treatment plant of a petrochemical industry. By employing the standard back error propagation (BEP algorithm, the network was trained with 103 data points for water quality indices such as Total Suspended Solids (TSS, Total Dissolved Solids (TDS, Phenol concentration, Ammoniacal Nitrogen (AMN, Total Organic Carbon (TOC and Kjeldahl’s Nitrogen (KJN to predict BOD and COD. After appropriate training, the network was tested with a separate test data and the best model was chosen based on the sum square error (training and percentage average relative error (% ARE for testing. The results from this study reveal that ANNs can be accurate and efficacious in predicting unknown concentrations of water quality parameters through its versatile training process.
Verma, Kuldeep; Hanasoge, Shravan; Bhattacharya, Jishnu; Antia, H. M.; Krishnamurthi, Ganapathy
2016-10-01
The advent of space-based observatories such as Convection, Rotation and planetary Transits (CoRoT) and Kepler has enabled the testing of our understanding of stellar evolution on thousands of stars. Evolutionary models typically require five input parameters, the mass, initial helium abundance, initial metallicity, mixing length (assumed to be constant over time), and the age to which the star must be evolved. Some of these parameters are also very useful in characterizing the associated planets and in studying Galactic archaeology. How to obtain these parameters from observations rapidly and accurately, specifically in the context of surveys of thousands of stars, is an outstanding question, one that has eluded straightforward resolution. For a given star, we typically measure the effective temperature and surface metallicity spectroscopically and low-degree oscillation frequencies through space observatories. Here we demonstrate that statistical learning, using artificial neural networks, is successful in determining the evolutionary parameters based on spectroscopic and seismic measurements. Our trained networks show robustness over a broad range of parameter space, and critically, are entirely computationally inexpensive and fully automated. We analyse the observations of a few stars using this method and the results compare well to inferences obtained using other techniques. This method is both computationally cheap and inferentially accurate, paving the way for analysing the vast quantities of stellar observations from past, current, and future missions.
Shoaib, Muhammad; Shamseldin, Asaad Y.; Melville, Bruce W.; Khan, Mudasser Muneer
2016-04-01
In order to predict runoff accurately from a rainfall event, the multilayer perceptron type of neural network models are commonly used in hydrology. Furthermore, the wavelet coupled multilayer perceptron neural network (MLPNN) models has also been found superior relative to the simple neural network models which are not coupled with wavelet. However, the MLPNN models are considered as static and memory less networks and lack the ability to examine the temporal dimension of data. Recurrent neural network models, on the other hand, have the ability to learn from the preceding conditions of the system and hence considered as dynamic models. This study for the first time explores the potential of wavelet coupled time lagged recurrent neural network (TLRNN) models for runoff prediction using rainfall data. The Discrete Wavelet Transformation (DWT) is employed in this study to decompose the input rainfall data using six of the most commonly used wavelet functions. The performance of the simple and the wavelet coupled static MLPNN models is compared with their counterpart dynamic TLRNN models. The study found that the dynamic wavelet coupled TLRNN models can be considered as alternative to the static wavelet MLPNN models. The study also investigated the effect of memory depth on the performance of static and dynamic neural network models. The memory depth refers to how much past information (lagged data) is required as it is not known a priori. The db8 wavelet function is found to yield the best results with the static MLPNN models and with the TLRNN models having small memory depths. The performance of the wavelet coupled TLRNN models with large memory depths is found insensitive to the selection of the wavelet function as all wavelet functions have similar performance.
Institute of Scientific and Technical Information of China (English)
纪亚洲; 顾和和; 李保杰
2015-01-01
针对土地利用数据库更新规则复杂、不同更新类型与更新规则自动匹配困难等问题，该文提出并构建了一种基于多层感知器神经网络的土地利用要素自适应更新模型。该模型将土地利用要素的每个变更类型判断及更新行为判断过程均设计成一个神经元，同类神经元组织成一个网络层，所有网络层采用全连接方式构成一个多层感知更新策略判断模型。该模型可以自动完成变更类型与更新规则的正确快速匹配，且可根据更新规则的变化，灵活改变知识库并产生新的推理机。试验表明：该模型明显减少了人工交互环节，综合更新效率较各基地软件可以提高30%左右，一次性更新正确率可以提高5个百分点以上，研究成果可为土地利用数据库的高效自动更新提供一整套新的解决方案。%Land use database is the basis for the government departments at all levels to regulate land use, and the currency and quality of land use database directly determine the level and effect of land supervision. However, at present, the land use database updating technology and means are not advanced enough yet. The currency of the land use database significantly lags our economic development level. In light of the automatic matching complexity of change type and update strategy, artificial neural network is introduced into update strategy judgment field. According to the structure and main updating content, from the horizontal, land use database adaptive updating model is divided into land class polygon, linear feature and isolated feature. Then, in accordance with annual update implementation program of land use database and current updating progress, methods and habits, from the vertical, the above-mentioned updating model is divided into spatial analysis layer, input layer, change type judgment layer, spatial update strategy judgment layer and attribute update strategy judgment
Directory of Open Access Journals (Sweden)
Mustafa Yıldız
2012-08-01
Full Text Available Introduction: We aimed to develop a classification method to discriminate ventricular septal defect and atrial septal defect by using severalhemodynamic parameters.Patients and Methods: Forty three patients (30 atrial septal defect, 13 ventricular septal defect; 26 female, 17 male with documentedhemodynamic parameters via cardiac catheterization are included to study. Such parameters as blood pressure values of different areas,gender, age and Qp/Qs ratios are used for classification. Parameters, we used in classification are determined by divergence analysismethod. Those parameters are; i pulmonary artery diastolic pressure, ii Qp/Qs ratio, iii right atrium pressure, iv age, v pulmonary arterysystolic pressure, vi left ventricular sistolic pressure, vii aorta mean pressure, viii left ventricular diastolic pressure, ix aorta diastolicpressure, x aorta systolic pressure. Those parameters detected from our study population, are uploaded to multi-layered artificial neuralnetwork and the network was trained by genetic algorithm.Results: Trained cluster consists of 14 factors (7 atrial septal defect and 7 ventricular septal defect. Overall success ratio is 79.2%, andwith a proper instruction of artificial neural network this ratio increases up to 89%.Conclusion: Parameters, belonging to artificial neural network, which are needed to be detected by the investigator in classical methods,can easily be detected with the help of genetic algorithms. During the instruction of artificial neural network by genetic algorithms, boththe topology of network and factors of network can be determined. During the test stage, elements, not included in instruction cluster, areassumed as in test cluster, and as a result of this study, we observed that multi-layered artificial neural network can be instructed properly,and neural network is a successful method for aimed classification.
Evaluation of convolutional neural networks for visual recognition.
Nebauer, C
1998-01-01
Convolutional neural networks provide an efficient method to constrain the complexity of feedforward neural networks by weight sharing and restriction to local connections. This network topology has been applied in particular to image classification when sophisticated preprocessing is to be avoided and raw images are to be classified directly. In this paper two variations of convolutional networks--neocognitron and a modification of neocognitron--are compared with classifiers based on fully connected feedforward layers (i.e., multilayer perceptron, nearest neighbor classifier, auto-encoding network) with respect to their visual recognition performance. Beside the original neocognitron a modification of the neocognitron is proposed which combines neurons from perceptron with the localized network structure of neocognitron. Instead of training convolutional networks by time-consuming error backpropagation, in this work a modular procedure is applied whereby layers are trained sequentially from the input to the output layer in order to recognize features of increasing complexity. For a quantitative experimental comparison with standard classifiers two very different recognition tasks have been chosen: handwritten digit recognition and face recognition. In the first example on handwritten digit recognition the generalization of convolutional networks is compared to fully connected networks. In several experiments the influence of variations of position, size, and orientation of digits is determined and the relation between training sample size and validation error is observed. In the second example recognition of human faces is investigated under constrained and variable conditions with respect to face orientation and illumination and the limitations of convolutional networks are discussed.
Financial time series prediction using spiking neural networks.
Reid, David; Hussain, Abir Jaafar; Tawfik, Hissam
2014-01-01
In this paper a novel application of a particular type of spiking neural network, a Polychronous Spiking Network, was used for financial time series prediction. It is argued that the inherent temporal capabilities of this type of network are suited to non-stationary data such as this. The performance of the spiking neural network was benchmarked against three systems: two "traditional", rate-encoded, neural networks; a Multi-Layer Perceptron neural network and a Dynamic Ridge Polynomial neural network, and a standard Linear Predictor Coefficients model. For this comparison three non-stationary and noisy time series were used: IBM stock data; US/Euro exchange rate data, and the price of Brent crude oil. The experiments demonstrated favourable prediction results for the Spiking Neural Network in terms of Annualised Return and prediction error for 5-Step ahead predictions. These results were also supported by other relevant metrics such as Maximum Drawdown and Signal-To-Noise ratio. This work demonstrated the applicability of the Polychronous Spiking Network to financial data forecasting and this in turn indicates the potential of using such networks over traditional systems in difficult to manage non-stationary environments. PMID:25170618
Financial time series prediction using spiking neural networks.
Reid, David; Hussain, Abir Jaafar; Tawfik, Hissam
2014-01-01
In this paper a novel application of a particular type of spiking neural network, a Polychronous Spiking Network, was used for financial time series prediction. It is argued that the inherent temporal capabilities of this type of network are suited to non-stationary data such as this. The performance of the spiking neural network was benchmarked against three systems: two "traditional", rate-encoded, neural networks; a Multi-Layer Perceptron neural network and a Dynamic Ridge Polynomial neural network, and a standard Linear Predictor Coefficients model. For this comparison three non-stationary and noisy time series were used: IBM stock data; US/Euro exchange rate data, and the price of Brent crude oil. The experiments demonstrated favourable prediction results for the Spiking Neural Network in terms of Annualised Return and prediction error for 5-Step ahead predictions. These results were also supported by other relevant metrics such as Maximum Drawdown and Signal-To-Noise ratio. This work demonstrated the applicability of the Polychronous Spiking Network to financial data forecasting and this in turn indicates the potential of using such networks over traditional systems in difficult to manage non-stationary environments.
Financial time series prediction using spiking neural networks.
Directory of Open Access Journals (Sweden)
David Reid
Full Text Available In this paper a novel application of a particular type of spiking neural network, a Polychronous Spiking Network, was used for financial time series prediction. It is argued that the inherent temporal capabilities of this type of network are suited to non-stationary data such as this. The performance of the spiking neural network was benchmarked against three systems: two "traditional", rate-encoded, neural networks; a Multi-Layer Perceptron neural network and a Dynamic Ridge Polynomial neural network, and a standard Linear Predictor Coefficients model. For this comparison three non-stationary and noisy time series were used: IBM stock data; US/Euro exchange rate data, and the price of Brent crude oil. The experiments demonstrated favourable prediction results for the Spiking Neural Network in terms of Annualised Return and prediction error for 5-Step ahead predictions. These results were also supported by other relevant metrics such as Maximum Drawdown and Signal-To-Noise ratio. This work demonstrated the applicability of the Polychronous Spiking Network to financial data forecasting and this in turn indicates the potential of using such networks over traditional systems in difficult to manage non-stationary environments.
Applying Neural Networks to Prices Prediction of Crude Oil Futures
Directory of Open Access Journals (Sweden)
John Wei-Shan Hu
2012-01-01
Full Text Available The global economy experienced turbulent uneasiness for the past five years owing to large increases in oil prices and terrorist’s attacks. While accurate prediction of oil price is important but extremely difficult, this study attempts to accurately forecast prices of crude oil futures by adopting three popular neural networks methods including the multilayer perceptron, the Elman recurrent neural network (ERNN, and recurrent fuzzy neural network (RFNN. Experimental results indicate that the use of neural networks to forecast the crude oil futures prices is appropriate and consistent learning is achieved by employing different training times. Our results further demonstrate that, in most situations, learning performance can be improved by increasing the training time. Moreover, the RFNN has the best predictive power and the MLP has the worst one among the three underlying neural networks. This finding shows that, under ERNNs and RFNNs, the predictive power improves when increasing the training time. The exceptional case involved BPNs, suggesting that the predictive power improves when reducing the training time. To sum up, we conclude that the RFNN outperformed the other two neural networks in forecasting crude oil futures prices.
Prediction of stock market characteristics using neural networks
Pandya, Abhijit S.; Kondo, Tadashi; Shah, Trupti U.; Gandhi, Viraf R.
1999-03-01
International stocks trading, currency and derivative contracts play an increasingly important role for many investors. Neural network is playing a dominant role in predicting the trends in stock markets and in currency speculation. In most economic applications, the success rate using neural networks is limited to 70 - 80%. By means of the new approach of GMDH (Group Method of Data Handling) neural network predictions can be improved further by 10 - 15%. It was observed in our study, that using GMDH for short, noisy or inaccurate data sample resulted in the best-simplified model. In the GMDH model accuracy of prediction is higher and the structure is simpler than that of the usual full physical model. As an example, prediction of the activity on the stock exchange in New York was considered. On the basis of observations in the period of Jan '95 to July '98, several variables of the stock market (S&P 500, Small Cap, Dow Jones, etc.) were predicted. A model portfolio using various stocks (Amgen, Merck, Office Depot, etc.) was built and its performance was evaluated based on neural network forecasting of the closing prices. Comparison of results was made with various neural network models such as Multilayer Perceptrons with Back Propagation, and the GMDH neural network. Variations of GMDH were studied and analysis of their performance is reported in the paper.
Minimal perceptrons for memorizing complex patterns
Pastor, Marissa; Song, Juyong; Hoang, Danh-Tai; Jo, Junghyo
2016-11-01
Feedforward neural networks have been investigated to understand learning and memory, as well as applied to numerous practical problems in pattern classification. It is a rule of thumb that more complex tasks require larger networks. However, the design of optimal network architectures for specific tasks is still an unsolved fundamental problem. In this study, we consider three-layered neural networks for memorizing binary patterns. We developed a new complexity measure of binary patterns, and estimated the minimal network size for memorizing them as a function of their complexity. We formulated the minimal network size for regular, random, and complex patterns. In particular, the minimal size for complex patterns, which are neither ordered nor disordered, was predicted by measuring their Hamming distances from known ordered patterns. Our predictions agree with simulations based on the back-propagation algorithm.
Energy Technology Data Exchange (ETDEWEB)
Guia, Jose G.C. da; Araujo, Adevid L. de [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia Mecanica; Irmao, Marcos A. da Silva [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia de Processos; Silva, Antonio A. [Universidade Federal de Campina Grande, PB (Brazil). Dept. de Engenharia Mecanica
2003-07-01
The condition monitoring and diagnostic of structural faults in pipelines are an important problem for the petroleum's industry, being necessary to develop supervisory systems for detection, prediction and evaluation of a fault in the pipelines to avoid environmental and financial damages. In this work, three types of Artificial Neural Networks (ANNs) are reviewed and used to detect and locate a fault in a simulated pipe. The simulated pipe was modeled through the Finite Elements Method. In Neural Networks' analysis, the first six natural frequencies of the pipe are used as networks' inputs. The used ANNs were the Multi-Layer Perceptron Network with backpropagation, the Probabilistic Neural Network and the Generalized Regression Neural Network. After the analysis, it was concluded that the ANN are a good computational tool in problems of faults detection on pipelines with a great precision. In the localization of the faults were obtained errors smaller than 5%. (author)
Cutting force signal pattern recognition using hybrid neural network in end milling
Institute of Scientific and Technical Information of China (English)
Song-Tae SEONG; Ko-Tae JO; Young-Moon LEE
2009-01-01
Under certain cutting conditions in end milling, the signs of cutting forces change from positive to negative during a revolution of the tool. The change of force direction causes the cutting dynamics to be unstable which results in chatter vibration. Therefore, cutting force signal monitoring and classification are needed to determine the optimal cutting conditions and to improve the efficiency of cut. Artificial neural networks are powerful tools for solving highly complex and nonlinear problems. It can be divided into supervised and unsupervised learning machines based on the availability of a teacher. Hybrid neural network was introduced with both of functions of multilayer perceptron (MLP) trained with the back-propagation algorithm for monitoring and detecting abnormal state, and self organizing feature map (SOFM) for treating huge datum such as image processing and pattern recognition, for predicting and classifying cutting force signal patterns simultaneously. The validity of the results is verified with cutting experiments and simulation tests.
A Comparison between Neural Networks and Wavelet Networks in Nonlinear System Identification
Directory of Open Access Journals (Sweden)
S. Ehsan Razavi
2012-01-01
Full Text Available In this study, identification of a nonlinear function will be presented by neural network and wavelet network methods. Behavior of a nonlinear system can be identified by intelligent methods. Two groups of the most common and at the same time the most effective of neural networks methods are multilayer perceptron and radial basis function that will be used for nonlinear system identification. The selected structure is series - parallel method that after network training by a series of training random data, the output is estimated and the nonlinear function is compared to a sinusoidal input. Then, wavelet network is used for identification and we will use Orthogonal Least Squares (OLS method for wavelet selection to reduce the volume of calculations and increase the convergence speed.
Foreground removal from Planck Sky Model temperature maps using a MLP neural network
DEFF Research Database (Denmark)
Nørgaard-Nielsen, Hans Ulrik; Hebert, K.
2009-01-01
Unfortunately, the Cosmic Microwave Background (CMB) radiation is contaminated by emission originating in the Milky Way (synchrotron, free-free and dust emission). Since the cosmological information is statistically in nature, it is essential to remove this foreground emission and leave the CMB...... with no systematic errors. To demonstrate the feasibility of a simple multilayer perceptron (MLP) neural network for extracting the CMB temperature signal, we have analyzed a specific data set, namely the Planck Sky Model maps, developed for evaluation of different component separation methods before including them...... in the Planck data analysis pipeline. It is found that a MLP neural network can provide a CMB map of about 80% of the sky to a very high degree uncorrelated with the foreground components. Also the derived power spectrum shows little evidence for systematic errors....
Foreground removal from CMB temperature maps using an MLP neural network
DEFF Research Database (Denmark)
Nørgaard-Nielsen, Hans Ulrik; Jørgensen, H.E.
2008-01-01
One of the main obstacles for extracting the Cosmic Microwave Background (CMB) signal from observations in the mm-submm range is the foreground contamination by emission from Galactic components: mainly synchrotron, free-free and thermal dust emission. Due to the statistical nature of the intrinsic...... CMB signal it is essential to minimize the systematic errors in the CMB temperature determinations. Following the available knowledge of the spectral behavior of the Galactic foregrounds simple power law-like spectra have been assumed. The feasibility of using a simple neural network for extracting...... the CMB temperature signal from the combined signal CMB and the foregrounds has been investigated. As a specific example, we have analysed simulated data, as expected from the ESA Planck CMB mission. A simple multilayer perceptron neural network with 2 hidden layers can provide temperature estimates over...
Neural Network on Photodegradation of Octylphenol using Natural and Artificial UV Radiation
Directory of Open Access Journals (Sweden)
Lorentz JÄNTSCHI
2011-09-01
Full Text Available The present paper comes up with an experimental design meant to point out the factors interferingin octylphenol’s degradation in surface waters under solar radiation, underlining each factor’sinfluence on the process observable (concentration of p-octylphenol. Multiple linear regressionanalysis and artificial neural network (Multi-Layer Perceptron type were applied in order to obtaina mathematical model capable to explain the action of UV-light upon synthetic solutions of OP inultra-pure water (MilliQ type. Neural network proves to be the most efficient method in predictingthe evolution of OP concentration during photodegradation process. Thus, determination in neuralnetwork’s case has almost double value versus the regression analysis.
A hybrid Evolutionary Functional Link Artificial Neural Network for Data mining and Classification
Directory of Open Access Journals (Sweden)
Faissal MILI
2012-08-01
Full Text Available This paper presents a specific structure of neural network as the functional link artificial neural network (FLANN. This technique has been employed for classification tasks of data mining. In fact, there are a few studies that used this tool for solving classification problems. In this present research, we propose a hybrid FLANN (HFLANN model, where the optimization process is performed using 3 known population based techniques such as genetic algorithms, particle swarm and differential evolution. This model will be empirically compared to FLANN based back-propagation algorithm and to others classifiers as decision tree, multilayer perceptron based back-propagation algorithm, radical basic function, support vector machine, and K-nearest Neighbor. Our results proved that the proposed model outperforms the other single model. (Abstract
Artificial neural network for modeling the extraction of aromatic hydrocarbons from lube oil cuts
Energy Technology Data Exchange (ETDEWEB)
Mehrkesh, A.H.; Hajimirzaee, S. [Islamic Azad University, Majlesi Branch, Isfahan (Iran, Islamic Republic of); Hatamipour, M.S.; Tavakoli, T. [Department of Chemical Engineering, University of Isfahan, Isfahan (Iran, Islamic Republic of)
2011-03-15
An artificial neural network (ANN) approach was used to obtain a simulation model to predict the rotating disc contactor (RDC) performance during the extraction of aromatic hydrocarbons from lube oil cuts, to produce a lubricating base oil using furfural as solvent. The field data used for training the ANN model was obtained from a lubricating oil production company. The input parameters of the ANN model were the volumetric flow rates of feed and solvent, the temperatures of feed and solvent, and the disc rotation rate. The output parameters were the volumetric flow rate of the raffinate phase and the extraction yield. In this study, a feed-forward multi-layer perceptron neural network was successfully used to demonstrate the complex relationship between the mentioned input and output parameters. (Copyright copyright 2011 WILEY-VCH Verlag GmbH and Co. KGaA, Weinheim)
Evaluation of artificial neural network techniques for flow forecasting in the River Yangtze, China
Directory of Open Access Journals (Sweden)
C. W. Dawson
2002-01-01
Full Text Available While engineers have been quantifying rainfall-runoff processes since the mid-19th century, it is only in the last decade that artificial neural network models have been applied to the same task. This paper evaluates two neural networks in this context: the popular multilayer perceptron (MLP, and the radial basis function network (RBF. Using six-hourly rainfall-runoff data for the River Yangtze at Yichang (upstream of the Three Gorges Dam for the period 1991 to 1993, it is shown that both neural network types can simulate river flows beyond the range of the training set. In addition, an evaluation of alternative RBF transfer functions demonstrates that the popular Gaussian function, often used in RBF networks, is not necessarily the ‘best’ function to use for river flow forecasting. Comparisons are also made between these neural networks and conventional statistical techniques; stepwise multiple linear regression, auto regressive moving average models and a zero order forecasting approach. Keywords: Artificial neural network, multilayer perception, radial basis function, flood forecasting
Vibration Based Damage Assessment of a Cantilever using a Neural Network
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated.......In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with with the Backpropagation Algorithm as a non-destructive damage assessment technique to locate and quantify a damage in structures is investigated....
Parameter estimation in space systems using recurrent neural networks
Parlos, Alexander G.; Atiya, Amir F.; Sunkel, John W.
1991-01-01
The identification of time-varying parameters encountered in space systems is addressed, using artificial neural systems. A hybrid feedforward/feedback neural network, namely a recurrent multilayer perception, is used as the model structure in the nonlinear system identification. The feedforward portion of the network architecture provides its well-known interpolation property, while through recurrency and cross-talk, the local information feedback enables representation of temporal variations in the system nonlinearities. The standard back-propagation-learning algorithm is modified and it is used for both the off-line and on-line supervised training of the proposed hybrid network. The performance of recurrent multilayer perceptron networks in identifying parameters of nonlinear dynamic systems is investigated by estimating the mass properties of a representative large spacecraft. The changes in the spacecraft inertia are predicted using a trained neural network, during two configurations corresponding to the early and late stages of the spacecraft on-orbit assembly sequence. The proposed on-line mass properties estimation capability offers encouraging results, though, further research is warranted for training and testing the predictive capabilities of these networks beyond nominal spacecraft operations.
Recognition of Japanese finger spelling gestures using neural networks.
Machacon, H T C; Shiga, S
2010-05-01
Effective communication with the hearing and speech impaired often requires at least a basic working knowledge of sign language gestures, without which a memo pad and pen, or a mobile phone's notepad is indispensable. The aim of this study was to build a neural network that could be used to recognize static finger-hand gestures of the yubimoji, the Japanese sign language syllabary. To build the network, signal inputs from a data glove interface were taken for each of the static yubimoji gestures. The network was trained and tested 10 times using a multilayer perceptron model. Overall, only 18 of the 41 static gestures were successfully recognized. One of the reasons was attributed to the inability of the data glove to measure gesture directions particularly for yubimoji gestures with similar finger configurations. Future work will focus on these problems as well as the inclusion of dynamic yubimoji gestures. PMID:20143958
Practical application of artificial neural networks in the neurosciences
Pinti, Antonio
1995-04-01
This article presents a practical application of artificial multi-layer perceptron (MLP) neural networks in neurosciences. The data that are processed are labeled data from the visual analysis of electrical signals of human sleep. The objective of this work is to automatically classify into sleep stages the electrophysiological signals recorded from electrodes placed on a sleeping patient. Two large data bases were designed by experts in order to realize this study. One data base was used to train the network and the other to test its generalization capacity. The classification results obtained with the MLP network were compared to a type K nearest neighbor Knn non-parametric classification method. The MLP network gave a better result in terms of classification than the Knn method. Both classification techniques were implemented on a transputer system. With both networks in their final configuration, the MLP network was 160 times faster than the Knn model in classifying a sleep period.
Handwritten Farsi Character Recognition using Artificial Neural Network
Ahangar, Reza Gharoie
2009-01-01
Neural Networks are being used for character recognition from last many years but most of the work was confined to English character recognition. Till date, a very little work has been reported for Handwritten Farsi Character recognition. In this paper, we have made an attempt to recognize handwritten Farsi characters by using a multilayer perceptron with one hidden layer. The error backpropagation algorithm has been used to train the MLP network. In addition, an analysis has been carried out to determine the number of hidden nodes to achieve high performance of backpropagation network in the recognition of handwritten Farsi characters. The system has been trained using several different forms of handwriting provided by both male and female participants of different age groups. Finally, this rigorous training results an automatic HCR system using MLP network. In this work, the experiments were carried out on two hundred fifty samples of five writers. The results showed that the MLP networks trained by the err...
Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia
Directory of Open Access Journals (Sweden)
A. El-Shafie
2011-07-01
Full Text Available Rainfall is considered as one of the major component of the hydrological process, it takes significant part of evaluating drought and flooding events. Therefore, it is important to have accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting task such as Multi-Layer Perceptron Neural Networks (MLP-NN. In fact, the rainfall time series modeling involves an important temporal dimension. On the other hand, the classical MLP-NN is a static and memoryless network architecture that is effective for complex nonlinear static mapping. This research focuses on investigating the potential of introducing a neural network that could address the temporal relationships of the rainfall series.
Two different static neural networks and one dynamic neural network namely; Multi-Layer Peceptron Neural network (MLP-NN, Radial Basis Function Neural Network (RBFNN and Input Delay Neural Network (IDNN, respectively, have been examined in this study. Those models had been developed for two time horizon in monthly and weekly rainfall basis forecasting at Klang River, Malaysia. Data collected over 12 yr (1997–2008 on weekly basis and 22 yr (1987–2008 for monthly basis were used to develop and examine the performance of the proposed models. Comprehensive comparison analyses were carried out to evaluate the performance of the proposed static and dynamic neural network. Results showed that MLP-NN neural network model able to follow the similar trend of the actual rainfall, yet it still relatively poor. RBFNN model achieved better accuracy over the MLP-NN model. Moreover, the forecasting accuracy of the IDNN model outperformed during training and testing stage which prove a consistent level of accuracy with seen and unseen data. Furthermore, the IDNN significantly enhance the forecasting accuracy if compared with the other static neural network model as they could memorize the
Institute of Scientific and Technical Information of China (English)
张长江; 付梦印; 金梅
2003-01-01
A kind of second-order algorithm--recursive approximate Newton algorithm was given by Karayiannis. The algorithm was simplified when it was formulated. Especially, the simplification to matrix Hessian was very reluctant, which led to the loss of valuable information and affected performance of the algorithm to certain extent. For multi-layer feed-forward neural networks, the second-order back-propagation recursive algorithm based generalized cost criteria was proposed. It is proved that it is equivalent to Newton recursive algorithm and has a second-order convergent rate. The performance and application prospect are analyzed. Lots of simulation experiments indicate that the calculation of the new algorithm is almost equivalent to the recursive least square multiple algorithm. The algorithm and selection of networks parameters are significant and the performance is more excellent than BP algorithm and the second-order learning algorithm that was given by Karayiannis.
Directory of Open Access Journals (Sweden)
2009-03-01
Full Text Available An electrocardiogram (ECG beat classification scheme based on multiple signal classification (MUSIC algorithm, morphological descriptors, and neural networks is proposed for discriminating nine ECG beat types. These are normal, fusion of ventricular and normal, fusion of paced and normal, left bundle branch block, right bundle branch block, premature ventricular concentration, atrial premature contraction, paced beat, and ventricular flutter. ECG signal samples from MIT-BIH arrhythmia database are used to evaluate the scheme. MUSIC algorithm is used to calculate pseudospectrum of ECG signals. The low-frequency samples are picked to have the most valuable heartbeat information. These samples along with two morphological descriptors, which deliver the characteristics and features of all parts of the heart, form an input feature vector. This vector is used for the initial training of a classifier neural network. The neural network is designed to have nine sample outputs which constitute the nine beat types. Two neural network schemes, namely multilayered perceptron (MLP neural network and a probabilistic neural network (PNN, are employed. The experimental results achieved a promising accuracy of 99.03% for classifying the beat types using MLP neural network. In addition, our scheme recognizes NORMAL class with 100% accuracy and never misclassifies any other classes as NORMAL.
Naghsh-Nilchi, Ahmad R.; Kadkhodamohammadi, A. Rahim
2009-12-01
An electrocardiogram (ECG) beat classification scheme based on multiple signal classification (MUSIC) algorithm, morphological descriptors, and neural networks is proposed for discriminating nine ECG beat types. These are normal, fusion of ventricular and normal, fusion of paced and normal, left bundle branch block, right bundle branch block, premature ventricular concentration, atrial premature contraction, paced beat, and ventricular flutter. ECG signal samples from MIT-BIH arrhythmia database are used to evaluate the scheme. MUSIC algorithm is used to calculate pseudospectrum of ECG signals. The low-frequency samples are picked to have the most valuable heartbeat information. These samples along with two morphological descriptors, which deliver the characteristics and features of all parts of the heart, form an input feature vector. This vector is used for the initial training of a classifier neural network. The neural network is designed to have nine sample outputs which constitute the nine beat types. Two neural network schemes, namely multilayered perceptron (MLP) neural network and a probabilistic neural network (PNN), are employed. The experimental results achieved a promising accuracy of 99.03% for classifying the beat types using MLP neural network. In addition, our scheme recognizes NORMAL class with 100% accuracy and never misclassifies any other classes as NORMAL.
Energy Technology Data Exchange (ETDEWEB)
Altran, A.B.; Lotufo, A.D.P.; Minussi, C.R. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil). Dept. de Engenharia Eletrica], Emails: lealtran@yahoo.com.br, annadiva@dee.feis.unesp.br, minussi@dee.feis.unesp.br; Lopes, M.L.M. [Universidade Estadual Paulista Julio de Mesquita Filho (UNESP), Ilha Solteira, SP (Brazil). Dept. de Matematica], E-mail: mara@mat.feis.unesp.br
2009-07-01
This paper presents a methodology for electrical load forecasting, using radial base functions as activation function in artificial neural networks with the training by backpropagation algorithm. This methodology is applied to short term electrical load forecasting (24 h ahead). Therefore, results are presented analyzing the use of radial base functions substituting the sigmoid function as activation function in multilayer perceptron neural networks. However, the main contribution of this paper is the proposal of a new formulation of load forecasting dedicated to the forecasting in several points of the electrical network, as well as considering several types of users (residential, commercial, industrial). It deals with the MLF (Multimodal Load Forecasting), with the same processing time as the GLF (Global Load Forecasting). (author)
Jung, Jun-Young; Heo, Wonho; Yang, Hyundae; Park, Hyunsub
2015-10-30
An exact classification of different gait phases is essential to enable the control of exoskeleton robots and detect the intentions of users. We propose a gait phase classification method based on neural networks using sensor signals from lower limb exoskeleton robots. In such robots, foot sensors with force sensing registers are commonly used to classify gait phases. We describe classifiers that use the orientation of each lower limb segment and the angular velocities of the joints to output the current gait phase. Experiments to obtain the input signals and desired outputs for the learning and validation process are conducted, and two neural network methods (a multilayer perceptron and nonlinear autoregressive with external inputs (NARX)) are used to develop an optimal classifier. Offline and online evaluations using four criteria are used to compare the performance of the classifiers. The proposed NARX-based method exhibits sufficiently good performance to replace foot sensors as a means of classifying gait phases.
Directory of Open Access Journals (Sweden)
Jun-Young Jung
2015-10-01
Full Text Available An exact classification of different gait phases is essential to enable the control of exoskeleton robots and detect the intentions of users. We propose a gait phase classification method based on neural networks using sensor signals from lower limb exoskeleton robots. In such robots, foot sensors with force sensing registers are commonly used to classify gait phases. We describe classifiers that use the orientation of each lower limb segment and the angular velocities of the joints to output the current gait phase. Experiments to obtain the input signals and desired outputs for the learning and validation process are conducted, and two neural network methods (a multilayer perceptron and nonlinear autoregressive with external inputs (NARX are used to develop an optimal classifier. Offline and online evaluations using four criteria are used to compare the performance of the classifiers. The proposed NARX-based method exhibits sufficiently good performance to replace foot sensors as a means of classifying gait phases.
Directory of Open Access Journals (Sweden)
Mahmoud Akbarian
2015-07-01
Results: Twelve features with P<0.05 and four features with P<0.1 were identified by using binary logistic regression as effective features. These sixteen features were used as input variables in artificial neural networks. The accuracy, sensitivity and specificity of the test data for the MLP network were 90.9%, 80.0%, and 94.1% respectively and for the total data were 97.3%, 93.5%, and 99.0% respectively. Conclusion: According to the results, we concluded that feed-forward Multi-Layer Perceptron (MLP neural network with scaled conjugate gradient (trainscg back propagation learning algorithm can help physicians to predict the pregnancy outcomes (spontaneous abortion and live birth among pregnant women with lupus by using identified effective variables.
The Role of Weight Shrinking in Large Margin Perceptron Learning
Panagiotakopoulos, Constantinos
2012-01-01
We introduce into the classical perceptron algorithm with margin a mechanism that shrinks the current weight vector as a first step of the update. If the shrinking factor is constant the resulting algorithm may be regarded as a margin-error-driven version of NORMA with constant learning rate. In this case we show that the allowed strength of shrinking depends on the value of the maximum margin. We also consider variable shrinking factors for which there is no such dependence. In both cases we obtain new generalizations of the perceptron with margin able to provably attain in a finite number of steps any desirable approximation of the maximal margin hyperplane. The new approximate maximum margin classifiers appear experimentally to be very competitive in 2-norm soft margin tasks involving linear kernels.
A coherent perceptron for all-optical learning
International Nuclear Information System (INIS)
We present nonlinear photonic circuit models for constructing programmable linear transformations and use these to realize a coherent perceptron, i.e., an all-optical linear classifier capable of learning the classification boundary iteratively from training data through a coherent feedback rule. Through extensive semi-classical stochastic simulations we demonstrate that the device nearly attains the theoretical error bound for a model classification problem. (orig.)
A coherent perceptron for all-optical learning
Energy Technology Data Exchange (ETDEWEB)
Tezak, Nikolas; Mabuchi, Hideo [Stanford University, Edward L. Ginzton Laboratory, Stanford, CA (United States)
2015-12-15
We present nonlinear photonic circuit models for constructing programmable linear transformations and use these to realize a coherent perceptron, i.e., an all-optical linear classifier capable of learning the classification boundary iteratively from training data through a coherent feedback rule. Through extensive semi-classical stochastic simulations we demonstrate that the device nearly attains the theoretical error bound for a model classification problem. (orig.)
Garagnani, Max; Wennekers, Thomas; Pulvermüller, Friedemann
2009-06-01
Current cognitive theories postulate either localist representations of knowledge or fully overlapping, distributed ones. We use a connectionist model that closely replicates known anatomical properties of the cerebral cortex and neurophysiological principles to show that Hebbian learning in a multi-layer neural network leads to memory traces (cell assemblies) that are both distributed and anatomically distinct. Taking the example of word learning based on action-perception correlation, we document mechanisms underlying the emergence of these assemblies, especially (i) the recruitment of neurons and consolidation of connections defining the kernel of the assembly along with (ii) the pruning of the cell assembly's halo (consisting of very weakly connected cells). We found that, whereas a learning rule mapping covariance led to significant overlap and merging of assemblies, a neurobiologically grounded synaptic plasticity rule with fixed LTP/LTD thresholds produced minimal overlap and prevented merging, exhibiting competitive learning behaviour. Our results are discussed in light of current theories of language and memory. As simulations with neurobiologically realistic neural networks demonstrate here spontaneous emergence of lexical representations that are both cortically dispersed and anatomically distinct, both localist and distributed cognitive accounts receive partial support.
Face recognition: a convolutional neural-network approach.
Lawrence, S; Giles, C L; Tsoi, A C; Back, A D
1997-01-01
We present a hybrid neural-network for human face recognition which compares favourably with other methods. The system combines local image sampling, a self-organizing map (SOM) neural network, and a convolutional neural network. The SOM provides a quantization of the image samples into a topological space where inputs that are nearby in the original space are also nearby in the output space, thereby providing dimensionality reduction and invariance to minor changes in the image sample, and the convolutional neural network provides partial invariance to translation, rotation, scale, and deformation. The convolutional network extracts successively larger features in a hierarchical set of layers. We present results using the Karhunen-Loeve transform in place of the SOM, and a multilayer perceptron (MLP) in place of the convolutional network for comparison. We use a database of 400 images of 40 individuals which contains quite a high degree of variability in expression, pose, and facial details. We analyze the computational complexity and discuss how new classes could be added to the trained recognizer.
Mathematically Reduced Chemical Reaction Mechanism Using Neural Networks
Energy Technology Data Exchange (ETDEWEB)
Ziaul Huque
2007-08-31
This is the final technical report for the project titled 'Mathematically Reduced Chemical Reaction Mechanism Using Neural Networks'. The aim of the project was to develop an efficient chemistry model for combustion simulations. The reduced chemistry model was developed mathematically without the need of having extensive knowledge of the chemistry involved. To aid in the development of the model, Neural Networks (NN) was used via a new network topology known as Non-linear Principal Components Analysis (NPCA). A commonly used Multilayer Perceptron Neural Network (MLP-NN) was modified to implement NPCA-NN. The training rate of NPCA-NN was improved with the GEneralized Regression Neural Network (GRNN) based on kernel smoothing techniques. Kernel smoothing provides a simple way of finding structure in data set without the imposition of a parametric model. The trajectory data of the reaction mechanism was generated based on the optimization techniques of genetic algorithm (GA). The NPCA-NN algorithm was then used for the reduction of Dimethyl Ether (DME) mechanism. DME is a recently discovered fuel made from natural gas, (and other feedstock such as coal, biomass, and urban wastes) which can be used in compression ignition engines as a substitute for diesel. An in-house two-dimensional Computational Fluid Dynamics (CFD) code was developed based on Meshfree technique and time marching solution algorithm. The project also provided valuable research experience to two graduate students.
A neural network device for on-line particle identification in cosmic ray experiments
International Nuclear Information System (INIS)
On-line particle identification is one of the main goals of many experiments in space both for rare event studies and for optimizing measurements along the orbital trajectory. Neural networks can be a useful tool for signal processing and real time data analysis in such experiments. In this document we report on the performances of a programmable neural device which was developed in VLSI analog/digital technology. Neurons and synapses were accomplished by making use of Operational Transconductance Amplifier (OTA) structures. In this paper we report on the results of measurements performed in order to verify the agreement of the characteristic curves of each elementary cell with simulations and on the device performances obtained by implementing simple neural structures on the VLSI chip. A feed-forward neural network (Multi-Layer Perceptron, MLP) was implemented on the VLSI chip and trained to identify particles by processing the signals of two-dimensional position-sensitive Si detectors. The radiation monitoring device consisted of three double-sided silicon strip detectors. From the analysis of a set of simulated data it was found that the MLP implemented on the neural device gave results comparable with those obtained with the standard method of analysis confirming that the implemented neural network could be employed for real time particle identification
Control on a 2-D Wing Flutter Using an AdaptiveNonlinear Neural Controller
Directory of Open Access Journals (Sweden)
Hayder S. Abd Al-Amir
2011-01-01
Full Text Available An adaptive nonlinear neural controller to reduce the nonlinear flutter in 2-D wing is proposed in the paper. The nonlinearities in the system come from the quasi steady aerodynamic model and torsional spring in pitch direction. Time domain simulations are used to examine the dynamic aero elastic instabilities of the system (e.g. the onset of flutter and limit cycle oscillation, LCO. The structure of the controller consists of two models :the modified Elman neural network (MENN and the feed forward multi-layer Perceptron (MLP. The MENN model is trained with off-line and on-line stages to guarantee that the outputs of the model accurately represent the plunge and pitch motion of the wing and this neural model acts as the identifier. The feed forward neural controller is trained off-line and adaptive weights are implemented on-line to find the flap angles, which controls the plunge and pitch motion of the wing. The general back propagation algorithm is used to learn the feed forward neural controller and the neural identifier. The simulation results show the effectiveness of the proposed control algorithm; this is demonstrated by the minimized tracking error to zero approximation with very acceptable settling time even with the existence of bounded external disturbances.
Dziuba, B
2013-01-01
Fourier transform infrared spectroscopy (FTIR) and artificial neural networks (ANN's) were used to identify species of Propionibacteria strains. The aim of the study was to improve the methodology to identify species of Propionibacteria strains, in which the differentiation index D, calculated based on Pearson's correlation and cluster analyses were used to describe the correlation between the Fourier transform infrared spectra and bacteria as molecular systems brought unsatisfactory results. More advanced statistical methods of identification of the FTIR spectra with application of artificial neural networks (ANN's) were used. In this experiment, the FTIR spectra of Propionibacteria strains stored in the library were used to develop artificial neural networks for their identification. Several multilayer perceptrons (MLP) and probabilistic neural networks (PNN) were tested. The practical value of selected artificial neural networks was assessed based on identification results of spectra of 9 reference strains and 28 isolates. To verify results of isolates identification, the PCR based method with the pairs of species-specific primers was used. The use of artificial neural networks in FTIR spectral analyses as the most advanced chemometric method supported correct identification of 93% bacteria of the genus Propionibacterium to the species level.
Directory of Open Access Journals (Sweden)
J. C. Ochoa-Rivera
2002-01-01
Full Text Available A model for multivariate streamflow generation is presented, based on a multilayer feedforward neural network. The structure of the model results from two components, the neural network (NN deterministic component and a random component which is assumed to be normally distributed. It is from this second component that the model achieves the ability to incorporate effectively the uncertainty associated with hydrological processes, making it valuable as a practical tool for synthetic generation of streamflow series. The NN topology and the corresponding analytical explicit formulation of the model are described in detail. The model is calibrated with a series of monthly inflows to two reservoir sites located in the Tagus River basin (Spain, while validation is performed through estimation of a set of statistics that is relevant for water resources systems planning and management. Among others, drought and storage statistics are computed and compared for both the synthetic and historical series. The performance of the NN-based model was compared to that of a standard autoregressive AR(2 model. Results show that NN represents a promising modelling alternative for simulation purposes, with interesting potential in the context of water resources systems management and optimisation. Keywords: neural networks, perceptron multilayer, error backpropagation, hydrological scenario generation, multivariate time-series..
Margins, Kernels and Non-linear Smoothed Perceptrons
Ramdas, Aaditya; Peña, Javier
2015-01-01
We focus on the problem of finding a non-linear classification function that lies in a Reproducing Kernel Hilbert Space (RKHS) both from the primal point of view (finding a perfect separator when one exists) and the dual point of view (giving a certificate of non-existence), with special focus on generalizations of two classical schemes - the Perceptron (primal) and Von-Neumann (dual) algorithms. We cast our problem as one of maximizing the regularized normalized hard-margin ($\\rho$) in an RK...
Neural networks for emulation variational method for data assimilation in nonlinear dynamics
International Nuclear Information System (INIS)
Description of a physical phenomenon through differential equations has errors involved, since the mathematical model is always an approximation of reality. For an operational prediction system, one strategy to improve the prediction is to add some information from the real dynamics into mathematical model. This additional information consists of observations on the phenomenon. However, the observational data insertion should be done carefully, for avoiding a worse performance of the prediction. Technical data assimilation are tools to combine data from physical-mathematics model with observational data to obtain a better forecast. The goal of this work is to present the performance of the Neural Network Multilayer Perceptrons trained to emulate a Variational method in context of data assimilation. Techniques for data assimilation are applied for the Lorenz systems; which presents a strong nonlinearity and chaotic nature.
PREDICTING STUDENT ACADEMIC PERFORMANCE IN BLENDED LEARNING USING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Nick Z. Zacharis
2016-09-01
Full Text Available Along with the spreading of online education, the importance of active support of students involved in online learning processes has grown. The application of artificial intelligence in education allows instructors to analyze data extracted from university servers, identify patterns of student behavior and develop interventions for struggling students. This study used student data stored in a Moodle server and predicted student success in course, based on four learning activities - communication via emails, collaborative content creation with wiki, content interaction measured by files viewed and self-evaluation through online quizzes. Next, a model based on the Multi-Layer Perceptron Neural Network was trained to predict student performance on a blended learning course environment. The model predicted the performance of students with correct classification rate, CCR, of 98.3%.
Directory of Open Access Journals (Sweden)
J. Pavlovicova
2007-04-01
Full Text Available In this contribution, human face as biometric is considered. Original method of feature extraction from image data is introduced using MLP (multilayer perceptron and PCA (principal component analysis. This method is used in human face recognition system and results are compared to face recognition system using PCA directly, to a system with direct classification of input images by MLP and RBF (radial basis function networks, and to a system using MLP as a feature extractor and MLP and RBF networks in the role of classifier. Also a two-stage method for face recognition is presented, in which Kohonen self-organizing map is used as a feature extractor. MLP and RBF network are used as classifiers. In order to obtain deeper insight into presented methods, also visualizations of internal representation of input data obtained by neural networks are presented.
Flores, J. L.; Martel, I.; Jiménez, R.; Galán, J.; Salmerón, P.
2016-09-01
The new generation of nuclear physics detectors that used to study nuclear reactions is considering the use of digital pulse shape analysis techniques (DPSA) to obtain the (A,Z) values of the reaction products impinging in solid state detectors. This technique can be an important tool for selecting the relevant reaction channels at the HYDE (HYbrid DEtector ball array) silicon array foreseen for the Low Energy Branch of the FAIR facility (Darmstadt, Germany). In this work we study the feasibility of using artificial neural networks (ANNs) for particle identification with silicon detectors. Multilayer Perceptron networks were trained and tested with recent experimental data, showing excellent identification capabilities with signals of several isotopes ranging from 12C up to 84Kr, yielding higher discrimination rates than any other previously reported.
Static sign language recognition using 1D descriptors and neural networks
Solís, José F.; Toxqui, Carina; Padilla, Alfonso; Santiago, César
2012-10-01
A frame work for static sign language recognition using descriptors which represents 2D images in 1D data and artificial neural networks is presented in this work. The 1D descriptors were computed by two methods, first one consists in a correlation rotational operator.1 and second is based on contour analysis of hand shape. One of the main problems in sign language recognition is segmentation; most of papers report a special color in gloves or background for hand shape analysis. In order to avoid the use of gloves or special clothing, a thermal imaging camera was used to capture images. Static signs were picked up from 1 to 9 digits of American Sign Language, a multilayer perceptron reached 100% recognition with cross-validation.
Energy and Carbon Flux Coupling: Multi-ecosystem Comparisons Using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Assefa M. Melesse
2005-01-01
Full Text Available A multi-ecosystems carbon flux simulation from energy fluxes is presented. A new statistical learning technique based on Artificial Neural Network (ANN back propagation algorithm and multi-layer perceptron architecture was used in the CO2 simulation. Four input layers (net radiation, soil heat flux, sensible and latent heat flux were used for training (calibration and testing (verification of model outputs. The 15-days half-hourly (grassland and hourly (forest and cropland micrometeorological data from eddy covariance observations of AmeriFlux towers were divided into training (5-days and testing (10-days sets. Results show that the ANN-based technique predicts CO2 flux with testing R2 values of 0.86, 0.75 and 0.94 for forest, grassland and cropland ecosystems, respectively. The technique is reliable and efficient to estimate regional or global CO2 fluxes from point measurements and understand the spatiotemporal budget of the CO2 fluxes.
Evaluation of Starting Current of Induction Motors Using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Iman Sadeghkhani
2014-07-01
Full Text Available Induction motors (IMs are widely used in industry including it be an electrical or not. However during starting period, their starting currents are so large that can damage equipment. Therefore, this current should be estimated accurately to prevent hazards caused by it. In this paper, the artificial neural network (ANN as an intelligent tool is used to evaluate starting current peak of IMs. Both Multilayer Perceptron (MLP and Radial Basis Function (RBF structures have been analyzed. Six learning algorithms, backpropagation (BP, delta-bar-delta (DBD, extended delta-bar-delta (EDBD, directed random search (DRS, quick propagation (QP, and levenberg marquardt (LM were used to train the MLP. The simulation results using MATLAB show that most developed ANNs can estimate the starting current peak of IMs with good accuracy. However, it is proven that LM and EDBD algorithms present better performance for starting current evaluation based on average of relative and absolute errors.
Prediction of Atmospheric Pressure at Ground Level using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Angshuman Ray
2013-01-01
Full Text Available Prediction of Atmospheric Pressure is one important and challenging task that needs lot of attention and study for analyzing atmospheric conditions. Advent of digital computers and development of data driven artificial intelligence approaches like Artificial Neural Networks (ANN have helped in numerical prediction of pressure. However, very few works have been done till now in this area. The present study developed an ANN model based on the past observations of several meteorological parameters like temperature, humidity, air pressure and vapour pressure as an input for training the model. The novel architecture of the proposed model contains several multilayer perceptron network (MLP to realize better performance. The model is enriched by analysis of alternative hybrid model of k-means clustering and MLP. The improvement of the performance in the prediction accuracy has been demonstrated by the automatic selection of the appropriate cluster
A new approach for sizing stand alone photovoltaic systems based in neural networks
Energy Technology Data Exchange (ETDEWEB)
Hontoria, L.; Aguilera, J. [Universidad de Jaen, Dept. de Electronica, Jaen (Spain); Zufiria, P. [UPM Ciudad Universitaria, Dept. de Matematica Aplicada a las Tecnologias de la Informacion, Madrid (Spain)
2005-02-01
Several methods for sizing stand alone photovoltaic (pv) systems has been developed. The more simplistic are called intuitive methods. They are a useful tool for a first approach in sizing stand alone photovoltaic systems. Nevertheless they are very inaccurate. Analytical methods use equations to describe the pv system size as a function of reliability. These ones are more accurate than the previous ones but they are also not accurate enough for sizing of high reliability. In a third group there are methods which use system simulations. These ones are called numerical methods. Many of the analytical methods employ the concept of reliability of the system or the complementary term: loss of load probability (LOLP). In this paper an improvement for obtaining LOLP curves based on the neural network called Multilayer Perceptron (MLP) is presented. A unique MLP for many locations of Spain has been trained and after the training, the MLP is able to generate LOLP curves for any value and location. (Author)
Entropy landscape of solutions in the binary perceptron problem
International Nuclear Information System (INIS)
The statistical picture of the solution space for a binary perceptron is studied. The binary perceptron learns a random classification of input random patterns by a set of binary synaptic weights. The learning of this network is difficult especially when the pattern (constraint) density is close to the capacity, which is supposed to be intimately related to the structure of the solution space. The geometrical organization is elucidated by the entropy landscape from a reference configuration and of solution-pairs separated by a given Hamming distance in the solution space. We evaluate the entropy at the annealed level as well as replica symmetric level and the mean field result is confirmed by the numerical simulations on single instances using the proposed message passing algorithms. From the first landscape (a random configuration as a reference), we see clearly how the solution space shrinks as more constraints are added. From the second landscape of solution-pairs, we deduce the coexistence of clustering and freezing in the solution space. (paper)
Khoshgoftaar, Taghi M; Van Hulse, Jason; Napolitano, Amri
2010-05-01
Neural network algorithms such as multilayer perceptrons (MLPs) and radial basis function networks (RBFNets) have been used to construct learners which exhibit strong predictive performance. Two data related issues that can have a detrimental impact on supervised learning initiatives are class imbalance and labeling errors (or class noise). Imbalanced data can make it more difficult for the neural network learning algorithms to distinguish between examples of the various classes, and class noise can lead to the formulation of incorrect hypotheses. Both class imbalance and labeling errors are pervasive problems encountered in a wide variety of application domains. Many studies have been performed to investigate these problems in isolation, but few have focused on their combined effects. This study presents a comprehensive empirical investigation using neural network algorithms to learn from imbalanced data with labeling errors. In particular, the first component of our study investigates the impact of class noise and class imbalance on two common neural network learning algorithms, while the second component considers the ability of data sampling (which is commonly used to address the issue of class imbalance) to improve their performances. Our results, for which over two million models were trained and evaluated, show that conclusions drawn using the more commonly studied C4.5 classifier may not apply when using neural networks.
A new source difference artificial neural network for enhanced positioning accuracy
International Nuclear Information System (INIS)
Integrated inertial navigation system (INS) and global positioning system (GPS) units provide reliable navigation solution compared to standalone INS or GPS. Traditional Kalman filter-based INS/GPS integration schemes have several inadequacies related to sensor error model and immunity to noise. Alternatively, multi-layer perceptron (MLP) neural networks with three layers have been implemented to improve the position accuracy of the integrated system. However, MLP neural networks show poor accuracy for low-cost INS because of the large inherent sensor errors. For the first time the paper demonstrates the use of knowledge-based source difference artificial neural network (SDANN) to improve navigation performance of low-cost sensor, with or without external aiding sources. Unlike the conventional MLP or artificial neural networks (ANN), the structure of SDANN consists of two MLP neural networks called the coarse model and the difference model. The coarse model learns the input–output data relationship whereas the difference model adds knowledge to the system and fine-tunes the coarse model output by learning the associated training or estimation error. Our proposed SDANN model illustrated a significant improvement in navigation accuracy of up to 81% over conventional MLP. The results demonstrate that the proposed SDANN method is effective for GPS/INS integration schemes using low-cost inertial sensors, with and without GPS
Review On Applications Of Neural Network To Computer Vision
Li, Wei; Nasrabadi, Nasser M.
1989-03-01
Neural network models have many potential applications to computer vision due to their parallel structures, learnability, implicit representation of domain knowledge, fault tolerance, and ability of handling statistical data. This paper demonstrates the basic principles, typical models and their applications in this field. Variety of neural models, such as associative memory, multilayer back-propagation perceptron, self-stabilized adaptive resonance network, hierarchical structured neocognitron, high order correlator, network with gating control and other models, can be applied to visual signal recognition, reinforcement, recall, stereo vision, motion, object tracking and other vision processes. Most of the algorithms have been simulated on com-puters. Some have been implemented with special hardware. Some systems use features, such as edges and profiles, of images as the data form for input. Other systems use raw data as input signals to the networks. We will present some novel ideas contained in these approaches and provide a comparison of these methods. Some unsolved problems are mentioned, such as extracting the intrinsic properties of the input information, integrating those low level functions to a high-level cognitive system, achieving invariances and other problems. Perspectives of applications of some human vision models and neural network models are analyzed.
Prediction of the local power factor in BWR fuel cells by means of a multilayer neural network
International Nuclear Information System (INIS)
To the beginning of a new operation cycle in a BWR reactor the reactivity of this it increases by means of the introduction of fresh fuel, the one denominated reload fuel. The problem of the definition of the characteristics of this reload fuel represents a combinatory optimization problem that requires significantly a great quantity of CPU time for their determination. This situation has motivated to study the possibility to substitute the Helios code, the one which is used to generate the new cells of the reload fuel parameters, by an artificial neuronal network, with the purpose of predicting the parameters of the fuel reload cell of a BWR reactor. In this work the results of the one training of a multilayer neuronal net that can predict the local power factor (LPPF) in such fuel cells are presented. The prediction of the LPPF is carried out in those condition of beginning of the life of the cell (0.0 MWD/T, to 40% of holes in the one moderator, temperature of 793 K in the fuel and a moderator temperature of 560 K. The cells considered in the present study consist of an arrangement of 10x10 bars, of those which 92 contains U235, some of these bars also contain a concentration of Gd2O3 and 8 of them contain only water. The axial location inside the one assembles of recharge of these cells it is exactly up of the cells that contain natural uranium in the base of the reactor core. The training of the neuronal net is carried out by means of a retro-propagation algorithm that uses a space of training formed starting from previous evaluations of cells by means of the Helios code. They are also presented the results of the application of the neuronal net found for the prediction of the LPPF of some cells used in the real operation of the Unit One of the Laguna Verde Nuclear Power station. (Author)
Directory of Open Access Journals (Sweden)
Boulbaba Ben Ammar
2013-09-01
Full Text Available This paper gives the definition of Transparent Neural Network “TNN” for the simulation of the globallocal vision and its application to the segmentation of administrative document image. We have developed and have adapted a recognition method which models the contextual effects reported from studies in experimental psychology. Then, we evaluated and tested the TNN and the multi-layer perceptron “MLP”, which showed its effectiveness in the field of the recognition, in order to show that the TNN is clearer for the user and more powerful on the level of the recognition. Indeed, the TNN is the only system which makes it possible to recognize the document and its structure.
Directory of Open Access Journals (Sweden)
Fatma Zohra Chelali
2015-01-01
Full Text Available Face recognition has received a great attention from a lot of researchers in computer vision, pattern recognition, and human machine computer interfaces in recent years. Designing a face recognition system is a complex task due to the wide variety of illumination, pose, and facial expression. A lot of approaches have been developed to find the optimal space in which face feature descriptors are well distinguished and separated. Face representation using Gabor features and discrete wavelet has attracted considerable attention in computer vision and image processing. We describe in this paper a face recognition system using artificial neural networks like multilayer perceptron (MLP and radial basis function (RBF where Gabor and discrete wavelet based feature extraction methods are proposed for the extraction of features from facial images using two facial databases: the ORL and computer vision. Good recognition rate was obtained using Gabor and DWT parameterization with MLP classifier applied for computer vision dataset.
Handwritten Arabic Numeral Recognition using a Multi Layer Perceptron
Das, Nibaran; Saha, Sudip; Haque, Syed Sahidul
2010-01-01
Handwritten numeral recognition is in general a benchmark problem of Pattern Recognition and Artificial Intelligence. Compared to the problem of printed numeral recognition, the problem of handwritten numeral recognition is compounded due to variations in shapes and sizes of handwritten characters. Considering all these, the problem of handwritten numeral recognition is addressed under the present work in respect to handwritten Arabic numerals. Arabic is spoken throughout the Arab World and the fifth most popular language in the world slightly before Portuguese and Bengali. For the present work, we have developed a feature set of 88 features is designed to represent samples of handwritten Arabic numerals for this work. It includes 72 shadow and 16 octant features. A Multi Layer Perceptron (MLP) based classifier is used here for recognition handwritten Arabic digits represented with the said feature set. On experimentation with a database of 3000 samples, the technique yields an average recognition rate of 94....
Neural Networks and Photometric Redshifts
Tagliaferri, Roberto; Longo, Giuseppe; Andreon, Stefano; Capozziello, Salvatore; Donalek, Ciro; Giordano, Gerardo
2002-01-01
We present a neural network based approach to the determination of photometric redshift. The method was tested on the Sloan Digital Sky Survey Early Data Release (SDSS-EDR) reaching an accuracy comparable and, in some cases, better than SED template fitting techniques. Different neural networks architecture have been tested and the combination of a Multi Layer Perceptron with 1 hidden layer (22 neurons) operated in a Bayesian framework, with a Self Organizing Map used to estimate the accuracy...
Implementation of a spike-based Perceptron learning rule using TiO2-x memristors
Directory of Open Access Journals (Sweden)
Hesham eMostafa
2015-10-01
Full Text Available Synaptic plasticity plays a crucial role in allowing neural networks to learn and adapt to various input environments. Neuromorphic systems need to implement plastic synapses to obtain basic 'cognitive' capabilities such as learning. One promising and scalable approach for implementing neuromorphic synapses is to use nano-scale memristors as synaptic elements. In this paper we propose a hybrid CMOS-memristor system comprising CMOS neurons interconnected through TiO$_{2-x}$ memristors, and spike-based learning circuits that modulate the conductance of the memristive synapse elements according to a spike-based Perceptron plasticity rule. We highlight a number of advantages for using this spike-based plasticity rule as compared to other forms of spike timing dependent plasticity (STDP rules. We provide experimental proof-of-concept results with two silicon neurons connected through a memristive synapse that show how the CMOS plasticity circuits can induce stable changes in memristor conductances, giving rise to increased synaptic strength after a potentiation episode and to decreased strength after a depression episode.
Implementation of a spike-based perceptron learning rule using TiO2-x memristors.
Mostafa, Hesham; Khiat, Ali; Serb, Alexander; Mayr, Christian G; Indiveri, Giacomo; Prodromakis, Themis
2015-01-01
Synaptic plasticity plays a crucial role in allowing neural networks to learn and adapt to various input environments. Neuromorphic systems need to implement plastic synapses to obtain basic "cognitive" capabilities such as learning. One promising and scalable approach for implementing neuromorphic synapses is to use nano-scale memristors as synaptic elements. In this paper we propose a hybrid CMOS-memristor system comprising CMOS neurons interconnected through TiO2-x memristors, and spike-based learning circuits that modulate the conductance of the memristive synapse elements according to a spike-based Perceptron plasticity rule. We highlight a number of advantages for using this spike-based plasticity rule as compared to other forms of spike timing dependent plasticity (STDP) rules. We provide experimental proof-of-concept results with two silicon neurons connected through a memristive synapse that show how the CMOS plasticity circuits can induce stable changes in memristor conductances, giving rise to increased synaptic strength after a potentiation episode and to decreased strength after a depression episode. PMID:26483629
Petrović, Jelena; Ibrić, Svetlana; Betz, Gabriele; Đurić, Zorica
2012-05-30
The main objective of the study was to develop artificial intelligence methods for optimization of drug release from matrix tablets regardless of the matrix type. Static and dynamic artificial neural networks of the same topology were developed to model dissolution profiles of different matrix tablets types (hydrophilic/lipid) using formulation composition, compression force used for tableting and tablets porosity and tensile strength as input data. Potential application of decision trees in discovering knowledge from experimental data was also investigated. Polyethylene oxide polymer and glyceryl palmitostearate were used as matrix forming materials for hydrophilic and lipid matrix tablets, respectively whereas selected model drugs were diclofenac sodium and caffeine. Matrix tablets were prepared by direct compression method and tested for in vitro dissolution profiles. Optimization of static and dynamic neural networks used for modeling of drug release was performed using Monte Carlo simulations or genetic algorithms optimizer. Decision trees were constructed following discretization of data. Calculated difference (f(1)) and similarity (f(2)) factors for predicted and experimentally obtained dissolution profiles of test matrix tablets formulations indicate that Elman dynamic neural networks as well as decision trees are capable of accurate predictions of both hydrophilic and lipid matrix tablets dissolution profiles. Elman neural networks were compared to most frequently used static network, Multi-layered perceptron, and superiority of Elman networks have been demonstrated. Developed methods allow simple, yet very precise way of drug release predictions for both hydrophilic and lipid matrix tablets having controlled drug release.
Neural networks type MLP in the process of identification chosen varieties of maize
Boniecki, P.; Nowakowski, K.; Tomczak, R.
2011-06-01
During the adaptation process of the weights vector that occurs in the iterative presentation of the teaching vector, the the MLP type artificial neural network (MultiLayer Perceptron) attempts to learn the structure of the data. Such a network can learn to recognise aggregates of input data occurring in the input data set regardless of the assumed criteria of similarity and the quantity of the data explored. The MLP type neural network can be also used to detect regularities occurring in the obtained graphic empirical data. The neuronal image analysis is then a new field of digital processing of signals. It is possible to use it to identify chosen objects given in the form of bitmap. If at the network input, a new unknown case appears which the network is unable to recognise, it means that it is different from all the classes known previously. The MLP type artificial neural network taught in this way can serve as a detector signalling the appearance of a widely understood novelty. Such a network can also look for similarities between the known data and the noisy data. In this way, it is able to identify fragments of images presented in photographs of e.g. maze's grain. The purpose of the research was to use the MLP neural networks in the process of identification of chosen varieties of maize with the use of image analysis method. The neuronal classification shapes of grains was performed with the use of the Johan Gielis super formula.
Gas Turbine Engine Control Design Using Fuzzy Logic and Neural Networks
Directory of Open Access Journals (Sweden)
M. Bazazzadeh
2011-01-01
Full Text Available This paper presents a successful approach in designing a Fuzzy Logic Controller (FLC for a specific Jet Engine. At first, a suitable mathematical model for the jet engine is presented by the aid of SIMULINK. Then by applying different reasonable fuel flow functions via the engine model, some important engine-transient operation parameters (such as thrust, compressor surge margin, turbine inlet temperature, etc. are obtained. These parameters provide a precious database, which train a neural network. At the second step, by designing and training a feedforward multilayer perceptron neural network according to this available database; a number of different reasonable fuel flow functions for various engine acceleration operations are determined. These functions are used to define the desired fuzzy fuel functions. Indeed, the neural networks are used as an effective method to define the optimum fuzzy fuel functions. At the next step, we propose a FLC by using the engine simulation model and the neural network results. The proposed control scheme is proved by computer simulation using the designed engine model. The simulation results of engine model with FLC illustrate that the proposed controller achieves the desired performance and stability.
Directory of Open Access Journals (Sweden)
José Antonio Vázquez-López
2012-06-01
Full Text Available In this article the Perceptron artificial neural network is applied as a classifier system of out of control points, in the field of contrlol chart for individual measurements. The use of geometric properties of the Perceptron as a training method is introduced, replacing in consequence to the known training methods. Some experiments with numerical databases contaminated with altered data in global average was performed, and the ability of the detection of \\out of control points" of the control chart with the implementation of the Perceptron trained by geometry was compared. The results reveal greater capacity in the Perceptron. This approach can be generalized to other types of control charts and patterns of natural and special variation, not considered in this research. // RESUMEN: En este artículo se aplica la red neuronal artificial Perceptrón como sistema clasificador de puntos fuera de control en el ámbito de la carta de control de mediciones individuales. Se introduce el uso de las propiedades geométricas de la Perceptrón como método de entrenamiento para sustituir, en consecuencia, a los métodos de entrenamiento conocidos. Se experimentó con bases de datos numéricas contaminadas con datos alterados en su media global y se comparó la capacidad de la detección de puntos fuera de control de la carta de control con la aplicación de la Perceptrón entrenada por geometría. Los resultados revelan mayor capacidad en la Perceptrón en diferentes porcentajes de contaminación. Esta propuesta puede ser generalizada a otros tipos de gráficos de control y a patrones de variación especial y natural no considerados en esta investigación.
Energy Technology Data Exchange (ETDEWEB)
Lobato, Justo; Canizares, Pablo; Rodrigo, Manuel A.; Linares, Jose J. [Chemical Engineering Department, University of Castilla-La Mancha, Campus Universitario s/n, 13004 Ciudad Real (Spain); Piuleac, Ciprian-George; Curteanu, Silvia [Faculty of Chemical Engineering and Environmental Protection, Department of Chemical Engineering, ' ' Gh. Asachi' ' Technical University Iasi Bd. D. Mangeron, No. 71A, 700050 IASI (Romania)
2010-08-15
This article shows the application of a very useful mathematical tool, artificial neural networks, to predict the fuel cells results (the value of the tortuosity and the cell voltage, at a given current density, and therefore, the power) on the basis of several properties that define a Gas Diffusion Layer: Teflon content, air permeability, porosity, mean pore size, hydrophobia level. Four neural networks types (multilayer perceptron, generalized feedforward network, modular neural network, and Jordan-Elman neural network) have been applied, with a good fitting between the predicted and the experimental values in the polarization curves. A simple feedforward neural network with one hidden layer proved to be an accurate model with good generalization capability (error about 1% in the validation phase). A procedure based on inverse neural network modelling was able to determine, with small errors, the initial conditions leading to imposed values for characteristics of the fuel cell. In addition, the use of this tool has been proved to be very attractive in order to predict the cell performance, and more interestingly, the influence of the properties of the gas diffusion layer on the cell performance, allowing possible enhancements of this material by changing some of its properties. (author)
Directory of Open Access Journals (Sweden)
G. Sánchez
2004-01-01
Full Text Available Este artículo propone una red neuronal de tipo perceptron multicapas (MLP que optimiza tanto su matriz de pesos como el número de neuronas ocultas. Inicialmente el sistema propuesto usa un número reducido de neuronas ocultas, optimizándose la matriz de pesos mediante un algoritmo de perturbación simultánea. Una vez que la red converge se analiza su funcionamiento y si este no es el esperado se agrega una neurona oculta. Este proceso se repite hasta obtener el funcionamiento deseado. Los resultados obtenidos muestran que el sistema propuesto presenta un funcionamiento muy similar al de un MLP convencional, cuando éste tiene un número óptimo de nodos en la capa oculta y disminuye la complejidad computacional durante la etapa de entrenamiento.This paper proposes a multilayer perceptron neural network (MLP which optimizes both the matrix weights and the numbers of hidden neurons. Initially, the proposed system uses a reduced number of hidden neurons, optimizing the matrix weights by using a simultaneous perturbation algorithm. Once the network converges, its function is analyzed and if this is not as expected, a hidden neuron is added. This process is repeated until achieving the desired functioning. The results obtained show that the proposed system functions similarly to that of a conventional MLP when this has an optimal number of nodes in the hidden layer, decreasing the computational complexity during the training step.
Penza, Michele; Suriano, Domenico; Cassano, Gennaro; Rossi, Riccardo; Alvisi, Marco; Pfister, Valerio; Trizio, Livia; Brattoli, Magda; De Gennaro, Gianluigi
2011-09-01
An array of commercial gas sensors and nanotechnology sensors has been integrated to quantify gas concentration of air-pollutants. A variety of chemoresistive gas sensors, commercial (Figaro and Fis) and developed at ENEA laboratories (metal-modified carbon nanotubes) were tested to implement a database useful for applied artificial neural networks (ANNs). The ANN algorithm used is the common perceptron multi-layer feed-forward network based on error back-propagation. Electronic Noses based on various sensor arrays related to mammalian olfactory systems have been largely reported [1,2]. Here, we reported on the perceptron-based ANNs applied to a large database of 3875 datapoints for environmental air monitoring. The ANNs performance has been individually assessed for any targeted gas. The response of the classifier has been measured for NO2, CO, CO2, SO2, and H2S gas. The NO2 characteristics exhibit that real concentrations and predicted concentrations are very close with a normalized mean square error (NMSE) in the test set as low as 6%.
Fast cosmological parameter estimation using neural networks
Auld, T; Hobson, M P; Gull, S F
2006-01-01
We present a method for accelerating the calculation of CMB power spectra, matter power spectra and likelihood functions for use in cosmological parameter estimation. The algorithm, called CosmoNet, is based on training a multilayer perceptron neural network and shares all the advantages of the recently released Pico algorithm of Fendt & Wandelt, but has several additional benefits in terms of simplicity, computational speed, memory requirements and ease of training. We demonstrate the capabilities of CosmoNet by computing CMB power spectra over a box in the parameter space of flat \\Lambda CDM models containing the 3\\sigma WMAP1 confidence region. We also use CosmoNet to compute the WMAP3 likelihood for flat \\Lambda CDM models and show that marginalised posteriors on parameters derived are very similar to those obtained using CAMB and the WMAP3 code. We find that the average error in the power spectra is typically 2-3% of cosmic variance, and that CosmoNet is \\sim 7 \\times 10^4 faster than CAMB (for flat ...
Computational capabilities of recurrent NARX neural networks.
Siegelmann, H T; Horne, B G; Giles, C L
1997-01-01
Recently, fully connected recurrent neural networks have been proven to be computationally rich-at least as powerful as Turing machines. This work focuses on another network which is popular in control applications and has been found to be very effective at learning a variety of problems. These networks are based upon Nonlinear AutoRegressive models with eXogenous Inputs (NARX models), and are therefore called NARX networks. As opposed to other recurrent networks, NARX networks have a limited feedback which comes only from the output neuron rather than from hidden states. They are formalized by y(t)=Psi(u(t-n(u)), ..., u(t-1), u(t), y(t-n(y)), ..., y(t-1)) where u(t) and y(t) represent input and output of the network at time t, n(u) and n(y) are the input and output order, and the function Psi is the mapping performed by a Multilayer Perceptron. We constructively prove that the NARX networks with a finite number of parameters are computationally as strong as fully connected recurrent networks and thus Turing machines. We conclude that in theory one can use the NARX models, rather than conventional recurrent networks without any computational loss even though their feedback is limited. Furthermore, these results raise the issue of what amount of feedback or recurrence is necessary for any network to be Turing equivalent and what restrictions on feedback limit computational power. PMID:18255858
Neural network based daily precipitation generator (NNGEN-P)
Energy Technology Data Exchange (ETDEWEB)
Boulanger, Jean-Philippe [LODYC, UMR CNRS/IRD/UPMC, Paris (France); University of Buenos Aires, Departamento de Ciencias de la Atmosfera y los Oceanos, Facultad de Ciencias Exactas y Naturales, Buenos Aires (Argentina); Martinez, Fernando; Segura, Enrique C. [University of Buenos Aires, Departamento de Computacion, Facultad de Ciencias Exactas y Naturales, Buenos Aires (Argentina); Penalba, Olga [University of Buenos Aires, Departamento de Ciencias de la Atmosfera y los Oceanos, Facultad de Ciencias Exactas y Naturales, Buenos Aires (Argentina)
2007-02-15
Daily weather generators are used in many applications and risk analyses. The present paper explores the potential of neural network architectures to design daily weather generator models. Focusing this first paper on precipitation, we design a collection of neural networks (multi-layer perceptrons in the present case), which are trained so as to approximate the empirical cumulative distribution (CDF) function for the occurrence of wet and dry spells and for the precipitation amounts. This approach contributes to correct some of the biases of the usual two-step weather generator models. As compared to a rainfall occurrence Markov model, NNGEN-P represents fairly well the mean and standard deviation of the number of wet days per month, and it significantly improves the simulation of the longest dry and wet periods. Then, we compared NNGEN-P to three parametric distribution functions usually applied to fit rainfall cumulative distribution functions (Gamma, Weibull and double-exponential). A data set of 19 Argentine stations was used. Also, data corresponding to stations in the United States, in Europe and in the Tropics were included to confirm the results. One of the advantages of NNGEN-P is that it is non-parametric. Unlike other parametric function, which adapt to certain types of climate regimes, NNGEN-P is fully adaptive to the observed cumulative distribution functions, which, on some occasions, may present complex shapes. On-going works will soon produce an extended version of NNGEN to temperature and radiation. (orig.)
Chaotic diagonal recurrent neural network
Institute of Scientific and Technical Information of China (English)
Wang Xing-Yuan; Zhang Yi
2012-01-01
We propose a novel neural network based on a diagonal recurrent neural network and chaos,and its structure andlearning algorithm are designed.The multilayer feedforward neural network,diagonal recurrent neural network,and chaotic diagonal recurrent neural network are used to approach the cubic symmetry map.The simulation results show that the approximation capability of the chaotic diagonal recurrent neural network is better than the other two neural networks.
Directory of Open Access Journals (Sweden)
Valérie Bourdès
2010-01-01
Full Text Available The aim of this study was to compare multilayer perceptron neural networks (NNs with standard logistic regression (LR to identify key covariates impacting on mortality from cancer causes, disease-free survival (DFS, and disease recurrence using Area Under Receiver-Operating Characteristics (AUROC in breast cancer patients. From 1996 to 2004, 2,535 patients diagnosed with primary breast cancer entered into the study at a single French centre, where they received standard treatment. For specific mortality as well as DFS analysis, the ROC curves were greater with the NN models compared to LR model with better sensitivity and specificity. Four predictive factors were retained by both approaches for mortality: clinical size stage, Scarff Bloom Richardson grade, number of invaded nodes, and progesterone receptor. The results enhanced the relevance of the use of NN models in predictive analysis in oncology, which appeared to be more accurate in prediction in this French breast cancer cohort.
How to keep the HG weights non-negative: the truncated Perceptron reweighing rule
Directory of Open Access Journals (Sweden)
Giorgio Magri
2015-12-01
Full Text Available The literature on error-driven learning in Harmonic Grammar (HG has adopted the Perceptron reweighing rule. Yet, this rule is not suited to HG, as it fails at ensuring non-negative weights. A variant is thus considered which truncates the updates at zero, keeping the weights non-negative. Convergence guarantees and error bounds for the original Perceptron are shown to extend to its truncated variant.
Remote Sensing Image Segmentation with Probabilistic Neural Networks
Institute of Scientific and Technical Information of China (English)
LIU Gang
2005-01-01
This paper focuses on the image segmentation with probabilistic neural networks (PNNs). Back propagation neural networks (BpNNs) and multi perceptron neural networks (MLPs) are also considered in this study. Especially, this paper investigates the implementation of PNNs in image segmentation and optimal processing of image segmentation with a PNN. The comparison between image segmentations with PNNs and with other neural networks is given. The experimental results show that PNNs can be successfully applied to image segmentation for good results.
Institute of Scientific and Technical Information of China (English)
张瑞成; 李冲
2011-01-01
关于优化神经网络模型的快速性和精度,为了寻找最优的神经网络结构,在复杂网络的研究方法对多层前向神经网络模型的基础上,提出一种在层次结构上处于规则型到随机型神经网络过渡的中间网络模型-NW型多层前向小世界人工神经网络模型.利用对多层前向规则神经网络中神经元以某一概率p随机化向后层跨层连接,构建新的神经网络模型,然后将不同跨层概率下的小世界人工神经网络应用于函数逼近.在设定精度相同情况下对不同概率下的收敛次数做比较,仿真发现随机化加边概率p处于p =0.08附近时的小世界人工神经网络比同规模的规则网络和随机网络具有更好的收敛速度,实验证实采用NW型小世界多层前向人工神经网络模型,在精度和收敛速度上均得到提高.%To find the optimal neural network structure, based on the research methods from the complex network , the structure of multi - layer forward neural networks model was studied, and a new neural networks model, NW multi-layer forward small world artificial neural networks was proposed, whose structure of layer was between the regular model and the stochastic model. At first, the regular of multilayer feed -forward neural network neurons randomized cross-layer link back layer with a probability p, and constructed the new neural network model. Second-ly, the cross -layer small world artificial neural networks were used for function approximation under different re-wiring probability. The count of convergence under different probability was compared by setting a same precision. Simulation shows that the small-world neural network has a better convergence speed than regular network and random network nearly p = 0. 08, and the optimum performance of the NW multi-layer forward small world artificial neural network is proved in the right side of probability increases.
Directory of Open Access Journals (Sweden)
Satish Kumar
2012-09-01
Full Text Available In this study, a method of artificial neural network applied for the solution of inverse kinematics of 2-link serial chain manipulator. The method is multilayer perceptrons neural network has applied. This unsupervised method learns the functional relationship between input (Cartesian space and output (joint space based on a localized adaptation of the mapping, by using the manipulator itself under joint control and adapting the solution based on a comparison between the resulting locations of the manipulator's end effectors in Cartesian space with the desired location. Even when a manipulator is not available; the approach is still valid if the forward kinematic equations are used as a model of the manipulator. The forward kinematic equations always have a unique solution, and the resulting Neural net can be used as a starting point for further refinement when the manipulator does become available. Artificial neural network especially MLP are used to learn the forward and the inverse kinematic equations of two degrees freedom robot arm. A set of some data sets were first generated as per the formula equation for this the input parameter X and Y coordinates in inches. Using these data sets was basis for the training and evaluation or testing the MLP model. Out of the sets data points, maximum were used as training data and some were used for testing for MLP. Backpropagation algorithm was used for training the network and for updating the desired weights. In this work epoch based training method was applied.
Adaptive Wavelet Neural Networks for Signal Detection in DS-CDMA System
Institute of Scientific and Technical Information of China (English)
WANGLing; JIAOLichengt; TAOHaihong; LIUFang
2004-01-01
The Multiple access interference (MAI) is the major factor that limits the performance and capacity of a nonorthogonal Direct sequence Code division multiple access (DS-CDMA) system. By using the adaptability of highly parallel structure neural networks and the excellent approximation ability of wavelets, two kinds of Adaptive wavelets neural networks (AWNN) signal detectors are proposed in the paper, in which the inputs of detectors are the received signal vector corresponding to a single interesting user sampled at the chip rate, named by AWNN single-user detector, respectively, and to all or partial active users sampled at the bit rate after passing through a matched filter, named by AWNN multiuser detector and partial users AWNN multiuser detector. The complexity of the multiuser detectors only depends on that of wavelet networks. The performance analysis of the proposed detectors compared with the matched filters under single-user and multiuser systems and the multiuser detector based on multilayer perceptrons are carried out by Monte Carlo simulations. Results show that the adaptive wavelet neural networks multiuser detectors are superior to other detectors mentioned above.
Wang, Baijie; Wang, Xin; Chen, Zhangxin
2013-08-01
Reservoir characterization refers to the process of quantitatively assigning reservoir properties using all available field data. Artificial neural networks (ANN) have recently been introduced to solve reservoir characterization problems dealing with the complex underlying relationships inherent in well log data. Despite the utility of ANNs, the current limitation is that most existing applications simply focus on directly implementing existing ANN models instead of improving/customizing them to fit the specific reservoir characterization tasks at hand. In this paper, we propose a novel intelligent framework that integrates fuzzy ranking (FR) and multilayer perceptron (MLP) neural networks for reservoir characterization. FR can automatically identify a minimum subset of well log data as neural inputs, and the MLP is trained to learn the complex correlations from the selected well log data to a target reservoir property. FR guarantees the selection of the optimal subset of representative data from the overall well log data set for the characterization of a specific reservoir property; and, this implicitly improves the modeling and predication accuracy of the MLP. In addition, a growing number of industrial agencies are implementing geographic information systems (GIS) in field data management; and, we have designed the GFAR solution (GIS-based FR ANN Reservoir characterization solution) system, which integrates the proposed framework into a GIS system that provides an efficient characterization solution. Three separate petroleum wells from southwestern Alberta, Canada, were used in the presented case study of reservoir porosity characterization. Our experiments demonstrate that our method can generate reliable results.
Artificial neural network as the tool in prediction rheological features of raw minced meat
Directory of Open Access Journals (Sweden)
Edyta Balejko
2012-09-01
Full Text Available Background. The aim of the study was to elaborate a method of modelling and forecasting rheological features which could be applied to raw minced meat at the stage of mixture preparation with a given ingredient composition. Material and methods. The investigated material contained pork and beef meat, pork fat, fat substitutes, ice and curing mixture in various proportions. Seven texture parameters were measured for each sample of raw minced meat. The data obtained were processed using the artificial neural network module in Statistica 9.0 software. Results. The model that reached the lowest training error was a multi-layer perceptron MLP with three neural layers and architecture 7:7-11-7:7. Correlation coefficients between the experimental and calculated values in training, verification and testing subsets were similar and rather high (around 0.65 which indicated good network performance. Conclusion. High percentage of the total variance explained in PCA analysis (73.5% indicated that the percentage composition of raw minced meat can be successfully used in the prediction of its rheological features. Statistical analysis of the results revealed, that artificial neural network model is able to predict rheological parameters and thus a complete texture profile of raw minced meat.
Directory of Open Access Journals (Sweden)
Benjamin W. Y. Lo
2013-01-01
Full Text Available Objective. The novel clinical prediction approach of Bayesian neural networks with fuzzy logic inferences is created and applied to derive prognostic decision rules in cerebral aneurysmal subarachnoid hemorrhage (aSAH. Methods. The approach of Bayesian neural networks with fuzzy logic inferences was applied to data from five trials of Tirilazad for aneurysmal subarachnoid hemorrhage (3551 patients. Results. Bayesian meta-analyses of observational studies on aSAH prognostic factors gave generalizable posterior distributions of population mean log odd ratios (ORs. Similar trends were noted in Bayesian and linear regression ORs. Significant outcome predictors include normal motor response, cerebral infarction, history of myocardial infarction, cerebral edema, history of diabetes mellitus, fever on day 8, prior subarachnoid hemorrhage, admission angiographic vasospasm, neurological grade, intraventricular hemorrhage, ruptured aneurysm size, history of hypertension, vasospasm day, age and mean arterial pressure. Heteroscedasticity was present in the nontransformed dataset. Artificial neural networks found nonlinear relationships with 11 hidden variables in 1 layer, using the multilayer perceptron model. Fuzzy logic decision rules (centroid defuzzification technique denoted cut-off points for poor prognosis at greater than 2.5 clusters. Discussion. This aSAH prognostic system makes use of existing knowledge, recognizes unknown areas, incorporates one's clinical reasoning, and compensates for uncertainty in prognostication.
A research about breast cancer detection using different neural networks and K-MICA algorithm.
Kalteh, A A; Zarbakhsh, Payam; Jirabadi, Meysam; Addeh, Jalil
2013-01-01
Breast cancer is the second leading cause of death for women all over the world. The correct diagnosis of breast cancer is one of the major problems in the medical field. From the literature it has been found that different pattern recognition techniques can help them to improve in this domain. This paper presents a novel hybrid intelligent method for detection of breast cancer. The proposed method includes two main modules: Clustering module and the classifier module. In the clustering module, first the input data will be clustered by a new technique. This technique is a suitable combination of the modified imperialist competitive algorithm (MICA) and K-means algorithm. Then the Euclidean distance of each pattern is computed from the determined clusters. The classifier module determines the membership of the patterns using the computed distance. In this module, several neural networks, such as the multilayer perceptron, probabilistic neural networks and the radial basis function neural networks are investigated. Using the experimental study, we choose the best classifier in order to recognize the breast cancer. The proposed system is tested on Wisconsin Breast Cancer (WBC) database and the simulation results show that the recommended system has high accuracy.
A research about breast cancer detection using different neural networks and K-MICA algorithm
Directory of Open Access Journals (Sweden)
A A Kalteh
2013-01-01
Full Text Available Breast cancer is the second leading cause of death for women all over the world. The correct diagnosis of breast cancer is one of the major problems in the medical field. From the literature it has been found that different pattern recognition techniques can help them to improve in this domain. This paper presents a novel hybrid intelligent method for detection of breast cancer. The proposed method includes two main modules: Clustering module and the classifier module. In the clustering module, first the input data will be clustered by a new technique. This technique is a suitable combination of the modified imperialist competitive algorithm (MICA and K-means algorithm. Then the Euclidean distance of each pattern is computed from the determined clusters. The classifier module determines the membership of the patterns using the computed distance. In this module, several neural networks, such as the multilayer perceptron, probabilistic neural networks and the radial basis function neural networks are investigated. Using the experimental study, we choose the best classifier in order to recognize the breast cancer. The proposed system is tested on Wisconsin Breast Cancer (WBC database and the simulation results show that the recommended system has high accuracy.
Artificial neural nets application in the cotton yarn industry
Directory of Open Access Journals (Sweden)
Gilberto Clóvis Antoneli
2016-06-01
Full Text Available The competitiveness in the yarn production sector has led companies to search for solutions to attain quality yarn at a low cost. Today, the difference between them, and thus the sector, is in the raw material, meaning processed cotton and its characteristics. There are many types of cotton with different characteristics due to its production region, harvest, storage and transportation. Yarn industries work with cotton mixtures, which makes it difficult to determine the quality of the yarn produced from the characteristics of the processed fibers. This study uses data from a conventional spinning, from a raw material made of 100% cotton, and presents a solution with artificial neural nets that determine the thread quality information, using the fibers’ characteristics values and settings of some process adjustments. In this solution a neural net of the type MultiLayer Perceptron with 11 entry neurons (8 characteristics of the fiber and 3 process adjustments, 7 output neurons (yarn quality and two types of training, Back propagation and Conjugate gradient descent. The selection and organization of the production data of the yarn industry of the cocamar® indústria de fios company are described, to apply the artificial neural nets developed. In the application of neural nets to determine yarn quality, one concludes that, although the ideal precision of absolute values is lacking, the presented solution represents an excellent tool to define yarn quality variations when modifying the raw material composition. The developed system enables a simulation to define the raw material percentage mixture to be processed in the plant using the information from the stocked cotton packs, thus obtaining a mixture that maintains the stability of the entire productive process.
Synapse:neural network for predict power consumption: users guide
Energy Technology Data Exchange (ETDEWEB)
Muller, C.; Mangeas, M.; Perrot, N.
1994-08-01
SYNAPSE is forecasting tool designed to predict power consumption in metropolitan France on the half hour time scale. Some characteristics distinguish this forecasting model from those which already exist. In particular, it is composed of numerous neural networks. The idea for using many neural networks arises from past tests. These tests showed us that a single neural network is not able to solve the problem correctly. From this result, we decided to perform unsupervised classification of the 24 consumption curves. From this classification, six classes appeared, linked with the weekdays: Mondays, Tuesdays, Wednesdays, Thursdays, Fridays, Saturdays, Sundays, holidays and bridge days. For each class and for each half hour, two multilayer perceptrons are built. The two of them forecast the power for one particular half hour, and for a day including one of the determined class. The input of these two network are different: the first one (short time forecasting) includes the powers for the most recent half hour and relative power of the previous day; the second (medium time forecasting) includes only the relative power of the previous day. A process connects the results of every networks and allows one to forecast more than one half-hour in advance. In this process, short time forecasting networks and medium time forecasting networks are used differently. The first kind of neural networks gives good results on the scale of one day. The second one gives good forecasts for the next predicted powers. In this note, the organization of the SYNAPSE program is detailed, and the user`s menu is described. This first version of synapse works and should allow the APC group to evaluate its utility. (authors). 6 refs., 2 appends.
Identifing Atmospheric Pollutant Sources Using Artificial Neural Networks
Paes, F. F.; Campos, H. F.; Luz, E. P.; Carvalho, A. R.
2008-05-01
The estimation of the area source pollutant strength is a relevant issue for atmospheric environment. This characterizes an inverse problem in the atmospheric pollution dispersion. In the inverse analysis, an area source domain is considered, where the strength of such area source term is assumed unknown. The inverse problem is solved by using a supervised artificial neural network: multi-layer perceptron. The conection weights of the neural network are computed from delta rule - learning process. The neural network inversion is compared with results from standard inverse analysis (regularized inverse solution). In the regularization method, the inverse problem is formulated as a non-linear optimization approach, whose the objective function is given by the square difference between the measured pollutant concentration and the mathematical models, associated with a regularization operator. In our numerical experiments, the forward problem is addressed by a source-receptor scheme, where a regressive Lagrangian model is applied to compute the transition matrix. The second order maximum entropy regularization is used, and the regularization parameter is calculated by the L-curve technique. The objective function is minimized employing a deterministic scheme (a quasi-Newton algorithm) [1] and a stochastic technique (PSO: particle swarm optimization) [2]. The inverse problem methodology is tested with synthetic observational data, from six measurement points in the physical domain. The best inverse solutions were obtained with neural networks. References: [1] D. R. Roberti, D. Anfossi, H. F. Campos Velho, G. A. Degrazia (2005): Estimating Emission Rate and Pollutant Source Location, Ciencia e Natura, p. 131-134. [2] E.F.P. da Luz, H.F. de Campos Velho, J.C. Becceneri, D.R. Roberti (2007): Estimating Atmospheric Area Source Strength Through Particle Swarm Optimization. Inverse Problems, Desing and Optimization Symposium IPDO-2007, April 16-18, Miami (FL), USA, vol 1, p
Statistical Mechanics of On-line Ensemble Teacher Learning through a Novel Perceptron Learning Rule
Hara, Kazuyuki; Miyoshi, Seiji
2012-06-01
In ensemble teacher learning, ensemble teachers have only uncertain information about the true teacher, and this information is given by an ensemble consisting of an infinite number of ensemble teachers whose variety is sufficiently rich. In this learning, a student learns from an ensemble teacher that is iteratively selected randomly from a pool of many ensemble teachers. An interesting point of ensemble teacher learning is the asymptotic behavior of the student to approach the true teacher by learning from ensemble teachers. The student performance is improved by using the Hebbian learning rule in the learning. However, the perceptron learning rule cannot improve the student performance. On the other hand, we proposed a perceptron learning rule with a margin. This learning rule is identical to the perceptron learning rule when the margin is zero and identical to the Hebbian learning rule when the margin is infinity. Thus, this rule connects the perceptron learning rule and the Hebbian learning rule continuously through the size of the margin. Using this rule, we study changes in the learning behavior from the perceptron learning rule to the Hebbian learning rule by considering several margin sizes. From the results, we show that by setting a margin of κ>0, the effect of an ensemble appears and becomes significant when a larger margin κ is used.
Comparison of four Adaboost algorithm based artificial neural networks in wind speed predictions
International Nuclear Information System (INIS)
Highlights: • Four hybrid algorithms are proposed for the wind speed decomposition. • Adaboost algorithm is adopted to provide a hybrid training framework. • MLP neural networks are built to do the forecasting computation. • Four important network training algorithms are included in the MLP networks. • All the proposed hybrid algorithms are suitable for the wind speed predictions. - Abstract: The technology of wind speed prediction is important to guarantee the safety of wind power utilization. In this paper, four different hybrid methods are proposed for the high-precision multi-step wind speed predictions based on the Adaboost (Adaptive Boosting) algorithm and the MLP (Multilayer Perceptron) neural networks. In the hybrid Adaboost–MLP forecasting architecture, four important algorithms are adopted for the training and modeling of the MLP neural networks, including GD-ALR-BP algorithm, GDM-ALR-BP algorithm, CG-BP-FR algorithm and BFGS algorithm. The aim of the study is to investigate the promoted forecasting percentages of the MLP neural networks by the Adaboost algorithm’ optimization under various training algorithms. The hybrid models in the performance comparison include Adaboost–GD-ALR-BP–MLP, Adaboost–GDM-ALR-BP–MLP, Adaboost–CG-BP-FR–MLP, Adaboost–BFGS–MLP, GD-ALR-BP–MLP, GDM-ALR-BP–MLP, CG-BP-FR–MLP and BFGS–MLP. Two experimental results show that: (1) the proposed hybrid Adaboost–MLP forecasting architecture is effective for the wind speed predictions; (2) the Adaboost algorithm has promoted the forecasting performance of the MLP neural networks considerably; (3) among the proposed Adaboost–MLP forecasting models, the Adaboost–CG-BP-FR–MLP model has the best performance; and (4) the improved percentages of the MLP neural networks by the Adaboost algorithm decrease step by step with the following sequence of training algorithms as: GD-ALR-BP, GDM-ALR-BP, CG-BP-FR and BFGS
Directory of Open Access Journals (Sweden)
F. Anctil
2004-01-01
Full Text Available Since the 1990s, neural networks have been applied to many studies in hydrology and water resources. Extensive reviews on neural network modelling have identified the major issues affecting modelling performance; one of the most important is generalisation, which refers to building models that can infer the behaviour of the system under study for conditions represented not only in the data employed for training and testing but also for those conditions not present in the data sets but inherent to the system. This work compares five generalisation approaches: stop training, Bayesian regularisation, stacking, bagging and boosting. All have been tested with neural networks in various scientific domains; stop training and stacking having been applied regularly in hydrology and water resources for some years, while Bayesian regularisation, bagging and boosting have been less common. The comparison is applied to streamflow modelling with multi-layer perceptron neural networks and the Levenberg-Marquardt algorithm as training procedure. Six catchments, with diverse hydrological behaviours, are employed as test cases to draw general conclusions and guidelines on the use of the generalisation techniques for practitioners in hydrology and water resources. All generalisation approaches provide improved performance compared with standard neural networks without generalisation. Stacking, bagging and boosting, which affect the construction of training sets, provide the best improvement from standard models, compared with stop-training and Bayesian regularisation, which regulate the training algorithm. Stacking performs better than the others although the benefit in performance is slight compared with bagging and boosting; furthermore, it is not consistent from one catchment to another. For a good combination of improvement and stability in modelling performance, the joint use of stop training or Bayesian regularisation with either bagging or boosting is
Directory of Open Access Journals (Sweden)
hojat moayedi rad
2012-02-01
Full Text Available Due to simplicity and low cost, induction motors are more useful than direct current motors. Hence the control of these motors is important. The pervious methods are fitted normally for a limited speed range and could not be used for high, low and very low speeds. The voltage model is suitable for high speed because the voltage drop of stator resistance is not small in low speed. The current model is suitable for low speed because of the problems of flux saturation at high speed. This research presents a new method of PWM pulse generating in induction motors based on artificial neural networks in which, the switching pulses are generated by a multilayer feed-forward neural network that is trained by the voltage and current references. Also, for the estimation of required torque and flux information a multilayer perceptron is used. By application of this new method, there is no problem of stability at low and high speeds. The simulation results by matlab-simulink verify the proposed method in transient and steady-state operating modes.
Acir, Nurettin; Oztura, Ibrahim; Kuntalp, Mehmet; Baklan, Bariş; Güzeliş, Cüneyt
2005-01-01
This paper introduces a three-stage procedure based on artificial neural networks for the automatic detection of epileptiform events (EVs) in a multichannel electroencephalogram (EEG) signal. In the first stage, two discrete perceptrons fed by six features are used to classify EEG peaks into three subgroups: 1) definite epileptiform transients (ETs); 2) definite non-ETs; and 3) possible ETs and possible non-ETs. The pre-classification done in the first stage not only reduces the computation time but also increases the overall detection performance of the procedure. In the second stage, the peaks falling into the third group are aimed to be separated from each other by a nonlinear artificial neural network that would function as a postclassifier whose input is a vector of 41 consecutive sample values obtained from each peak. Different networks, i.e., a backpropagation multilayer perceptron and two radial basis function networks trained by a hybrid method and a support vector method, respectively, are constructed as the postclassifier and then compared in terms of their classification performances. In the third stage, multichannel information is integrated into the system for contributing to the process of identifying an EV by the electroencephalographers (EEGers). After the integration of multichannel information, the overall performance of the system is determined with respect to EVs. Visual evaluation, by two EEGers, of 19 channel EEG records of 10 epileptic patients showed that the best performance is obtained with a radial basis support vector machine providing an average sensitivity of 89.1%, an average selectivity of 85.9%, and a false detection rate (per hour) of 7.5.
Directory of Open Access Journals (Sweden)
Bahman O. Taha
2015-06-01
Full Text Available The reinforced concrete with fiber reinforced polymer (FRP bars (carbon, aramid, basalt and glass is used in places where a high ratio of strength to weight is required and corrosion is not acceptable. Behavior of structural members using (FRP bars is hard to be modeled using traditional methods because of the high non-linearity relationship among factors influencing the strength of structural members. Back-propagation neural network is a very effective method for modeling such complicated relationships. In this paper, back-propagation neural network is used for modeling the flexural behavior of beams reinforced with (FRP bars. 101 samples of beams reinforced with fiber bars were collected from literatures. Five important factors are taken in consideration for predicting the strength of beams. Two models of Multilayer Perceptron (MLP are created, first with single-hidden layer and the second with two-hidden layers. The two-hidden layer model showed better accuracy ratio than the single-hidden layer model. Parametric study has been done for two-hidden layer model only. Equations are derived to be used instead of the model and the importance of input factors is determined. Results showed that the neural network is successful in modeling the behavior of concrete beams reinforced with different types of (FRP bars.
International Nuclear Information System (INIS)
In computational physics proton transfer phenomena could be viewed as pattern classification problems based on a set of input features allowing classification of the proton motion into two categories: transfer ‘occurred’ and transfer ‘not occurred’. The goal of this paper is to evaluate the use of artificial neural networks in the classification of proton transfer events, based on the feed-forward back propagation neural network, used as a classifier to distinguish between the two transfer cases. In this paper, we use a new developed data mining and pattern recognition tool for automating, controlling, and drawing charts of the output data of an Empirical Valence Bond existing code. The study analyzes the need for pattern recognition in aqueous proton transfer processes and how the learning approach in error back propagation (multilayer perceptron algorithms) could be satisfactorily employed in the present case. We present a tool for pattern recognition and validate the code including a real physical case study. The results of applying the artificial neural networks methodology to crowd patterns based upon selected physical properties (e.g., temperature, density) show the abilities of the network to learn proton transfer patterns corresponding to properties of the aqueous environments, which is in turn proved to be fully compatible with previous proton transfer studies. (condensed matter: structural, mechanical, and thermal properties)
Directory of Open Access Journals (Sweden)
Ozren Bukovac
2016-01-01
Full Text Available Compared to the other marine engines for ship propulsion, turbocharged two-stroke low speed diesel engines have advantages due to their high efficiency and reliability. Modern low speed ”intelligent” marine diesel engines have a flexibility in its operation due to the variable fuel injection strategy and management of the exhaust valve drive. This paper carried out verified zerodimensional numerical simulations which have been used for MLP (Multilayer Perceptron neural network predictions of marine two-stroke low speed diesel engine steady state performances. The developed MLP neural network was used for marine engine optimized operation control. The paper presents an example of achieving lowest specific fuel consumption and for minimization of the cylinder process highest temperature for reducing NOx emission. Also, the developed neural network was used to achieve optimal exhaust gases heat flow for utilization. The obtained data maps give insight into the optimal working areas of simulated marine diesel engine, depending on the selected start of the fuel injection (SOI and the time of the exhaust valve opening (EVO.
AN APPLICATION OF SPEAKER RECOGNITION USING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Murat CANER
2006-02-01
Full Text Available In this study an artificial neural network (ANN is implemented, which has been used frequently as an implementation model in recent years, to recognize speaker identification. Generally, recognition is consist of three stages that, processing of signal, obtaining attributes and comparing them. Speech samples are transformed into digital data according to voice card of PC. In the analysis of voice stage, recurrent periods and white noise of voice data are trimmed by hamming window method and voice attribute part of the digital data is obtained. For obtaining attribute of voice data LPC (linear predictive coding and DFT (discrete fourier transform methods are used. Of those 28 coefficents, that is used for speaker recognition, 16 were obtained by the analysis of DFT and 12 were obtained by the analysis of LPC. The parameters that represent speaker voice, is used for training and test of ANN. Multilayer perceptron model is used as an architecture of ANN and backpropagation algorithm is used for training method. Voices of "a" is taken from 7 different person and their attributes are found. ANN is trained with these features to find the speaker who is the owner of the sample voice. And then using the test data that is not used for training part, recognition achievement of ANN is tested. As a result, good results were obtained with low failure rate.
QSO Selection and Photometric Redshifts with Neural Networks
Yeche, Ch; Rich, J; Aubourg, E; Busca, N; Hamilton, J -Ch; Goff, J -M Le; Paris, I; Peirani, S; Pichon, Ch; Rollinde, E; Vargas-Magana, M
2009-01-01
Baryonic Acoustic Oscillations (BAO) and their effects on the matter power spectrum can be studied by using the Lyman-alpha absorption signature of the matter density field along quasar (QSO) lines of sight. A measurement sufficiently accurate to provide useful cosmological constraints requires the observation of ~100000 quasars in the redshift range 2.2
Customer Credit Risk Assessment using Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Nasser Mohammadi
2016-03-01
Full Text Available Since the granting of banking facilities in recent years has faced problems such as customer credit risk and affects the profitability directly, customer credit risk assessment has become imperative for banks and it is used to distinguish good applicants from those who will probably default on repayments. In credit risk assessment, a score is assigned to each customer then by comparing it with the cut-off point score which distinguishes two classes of the applicants, customers are classified into two credit statuses either a good or bad applicant. Regarding good performance and their ability of classification, generalization and learning patterns, Multilayer Perceptron Neural Network model trained using various Back-Propagation (BP algorithms considered in designing an evaluation model in this study. The BP algorithms, Levenberg-Marquardt (LM, Gradient descent, Conjugate gradient, Resilient, BFGS Quasinewton, and One-step secant were utilized. Each of these six networks runs and trains for different numbers of neurons within their hidden layer. Mean squared error (MSE is used as a criterion to specify optimum number of neurons in the hidden layer. The results showed that LM algorithm converges faster to the network and achieves better performance than the other algorithms. At last, by comparing classification performance of neural network with a number of classification algorithms such as Logistic Regression and Decision Tree, the neural network model outperformed the others in customer credit risk assessment. In credit models, because the cost that Type II error rate imposes to the model is too high, therefore, Receiver Operating Characteristic curve is used to find appropriate cut-off point for a model that in addition to high Accuracy, has lower Type II error rate.
APPROXIMATION CAPABILITIES OF MULTILAYER FEEDFORWARD REGULAR FUZZY NEURAL NETWORKS%多层前向正则模糊神经网络的逼近能力
Institute of Scientific and Technical Information of China (English)
刘普寅
2001-01-01
Four-layer feedforward regular fuzzy neural networks are constructed. Universal approximations to some continuous fuzzy functions defined on F0(R)n by the four-layer fuzzy neural networks are shown. At first,multivariate Bernstein polynomials associated with fuzzy valued functions are empolyed to approximate continuous fuzzy valued functions defined on each compact set of Rn. Secondly,by introducing cut-preserving fuzzy mapping,the equivalent conditions for continuous fuzzy functions that can be arbitrarily closely approximated by regular fuzzy neural networks are shown. Finally a few of sufficient and necessary conditions for characterizing approximation capabilities of regular fuzzy neural networks are obtained. And some concrete fuzzy functions demonstrate our conclusions.
Jokar, Ali; Godarzi, Ali Abbasi; Saber, Mohammad; Shafii, Mohammad Behshad
2016-01-01
In this paper, a novel approach has been presented to simulate and optimize the pulsating heat pipes (PHPs). The used pulsating heat pipe setup was designed and constructed for this study. Due to the lack of a general mathematical model for exact analysis of the PHPs, a method has been applied for simulation and optimization using the natural algorithms. In this way, the simulator consists of a kind of multilayer perceptron neural network, which is trained by experimental results obtained from our PHP setup. The results show that the complex behavior of PHPs can be successfully described by the non-linear structure of this simulator. The input variables of the neural network are input heat flux to evaporator (q″), filling ratio (FR) and inclined angle (IA) and its output is thermal resistance of PHP. Finally, based upon the simulation results and considering the heat pipe's operating constraints, the optimum operating point of the system is obtained by using genetic algorithm (GA). The experimental results show that the optimum FR (38.25 %), input heat flux to evaporator (39.93 W) and IA (55°) that obtained from GA are acceptable.
Predicting Asthma Outcome Using Partial Least Square Regression and Artificial Neural Networks
Directory of Open Access Journals (Sweden)
E. Chatzimichail
2013-01-01
Full Text Available The long-term solution to the asthma epidemic is believed to be prevention and not treatment of the established disease. Most cases of asthma begin during the first years of life; thus the early determination of which young children will have asthma later in their life counts as an important priority. Artificial neural networks (ANN have been already utilized in medicine in order to improve the performance of the clinical decision-making tools. In this study, a new computational intelligence technique for the prediction of persistent asthma in children is presented. By employing partial least square regression, 9 out of 48 prognostic factors correlated to the persistent asthma have been chosen. Multilayer perceptron and probabilistic neural networks topologies have been investigated in order to obtain the best prediction accuracy. Based on the results, it is shown that the proposed system is able to predict the asthma outcome with a success of 96.77%. The ANN, with which these high rates of reliability were obtained, will help the doctors to identify which of the young patients are at a high risk of asthma disease progression. Moreover, this may lead to better treatment opportunities and hopefully better disease outcomes in adulthood.
Archambeau, Cédric; Delbeke, Jean; Veraart, Claude; Verleysen, Michel
2004-11-01
Within the framework of the OPTIVIP project, an optic nerve based visual prosthesis is developed in order to restore partial vision to the blind. One of the main challenges is to understand, decode and model the physiological process linking the stimulating parameters to the visual sensations produced in the visual field of a blind volunteer. We propose to use adaptive neural techniques. Two prediction models are investigated. The first one is a grey-box model exploiting the neurophysiological knowledge available up to now. It combines a neurophysiological model with artificial neural networks, such as multi-layer perceptrons and radial basis function networks, in order to predict the features of the visual perceptions. The second model is entirely of the black-box type. We show that both models provide satisfactory prediction tools and achieve similar prediction accuracies. Moreover, we demonstrate that significant improvement (25%) was gained with respect to linear statistical methods, suggesting that the biological process is strongly non-linear.
Delogu, P; Kasae, P; Retico, A
2008-01-01
The computer-aided diagnosis system we developed for the mass characterization is mainly based on a segmentation algorithm and on the neural classification of several features computed on the segmented mass. Mass segmentation plays a key role in most computerized systems. Our technique is a gradient-based one, showing the main characteristic that no free parameters have been evaluated on the dataset used in this analysis, thus it can directly be applied to datasets acquired in different conditions without any ad-hoc modification. A dataset of 226 masses (109 malignant and 117 benign) has been used in this study. The segmentation algorithm works with a comparable efficiency both on malignant and benign masses. Sixteen features based on shape, size and intensity of the segmented masses are analyzed by a multi-layered perceptron neural network. A feature selection procedure has been carried out on the basis of the feature discriminating power and of the linear correlations interplaying among them. The comparison...
On-line control of the COMPASS-D tokamak using a neural network
International Nuclear Information System (INIS)
Multi-layer perceptron (MLP) networks are particularly appropriate for performing rapid non-linear mapping. In the application discussed in this Paper the position and shape of the plasma within the experimental fusion research tokamak COMPASS-D at UKAEA's Culham Laboratory is determined from a series of magnetic sensors placed around the vacuum vessel, close to the plasma boundary. By using a real-time analogue neural network it is possible to achieve control within a sub-millisecond time-scale. In this application the neural network is needed to solve an inverse problem. Numerical codes exist that are able to calculate the signals expected on the magnetic sensors for a given plasma position and profile. The problem is well defined from the solution of the Grad-Shafranov equation. However, no easy analytical formalism exists to reverse the problem - to calculate the plasma parameters given the magnetic signals. It is this mapping, from the set of magnetic diagnostic input signals to the parameters of the plasma, that an MLP network can be trained to solve. The training data are some 2000 example plasma equilibria, covering the likely possible configurations of the plasma, solved by numerical methods. The desired aim, to control the plasma boundary position to within a few millimetres, has now been achieved. (author)
Jokar, Ali; Godarzi, Ali Abbasi; Saber, Mohammad; Shafii, Mohammad Behshad
2016-11-01
In this paper, a novel approach has been presented to simulate and optimize the pulsating heat pipes (PHPs). The used pulsating heat pipe setup was designed and constructed for this study. Due to the lack of a general mathematical model for exact analysis of the PHPs, a method has been applied for simulation and optimization using the natural algorithms. In this way, the simulator consists of a kind of multilayer perceptron neural network, which is trained by experimental results obtained from our PHP setup. The results show that the complex behavior of PHPs can be successfully described by the non-linear structure of this simulator. The input variables of the neural network are input heat flux to evaporator (q″), filling ratio (FR) and inclined angle (IA) and its output is thermal resistance of PHP. Finally, based upon the simulation results and considering the heat pipe's operating constraints, the optimum operating point of the system is obtained by using genetic algorithm (GA). The experimental results show that the optimum FR (38.25 %), input heat flux to evaporator (39.93 W) and IA (55°) that obtained from GA are acceptable.
Energy Technology Data Exchange (ETDEWEB)
Garg, A. [Department of Mechanical Engineering, Indian Institute of Technology Guwahati, Guwahati 781039, Assam (India); Sastry, P.S. [Department of Mechanical Engineering, Indian Institute of Technology Guwahati, Guwahati 781039, Assam (India); Pandey, M. [Department of Mechanical Engineering, Indian Institute of Technology Guwahati, Guwahati 781039, Assam (India)]. E-mail: manmohan@iitg.ac.in; Dixit, U.S. [Department of Mechanical Engineering, Indian Institute of Technology Guwahati, Guwahati 781039, Assam (India); Gupta, S.K. [Atomic Energy Regulatory Board, Mumbai 400085 (India)
2007-02-15
Numerical simulation of natural circulation boiling water reactor is important in order to study its performance for different designs and under various off-design conditions. Numerical simulations can be performed by using thermal-hydraulic codes. Very fast numerical simulations, useful for extensive parametric studies and for solving design optimization problems, can be achieved by using an artificial neural network (ANN) model of the system. In the present work, numerical simulations of natural circulation boiling water reactor have been performed with RELAP5 code for different values of design parameters and operational conditions. Parametric trends observed have been discussed. The data obtained from these simulations have been used to train artificial neural networks, which in turn have been used for further parametric studies and design optimization. The ANN models showed error within {+-}5% for all the simulated data. Two most popular methods, multilayer perceptron (MLP) and radial basis function (RBF) networks, have been used for the training of ANN model. Sequential quadratic programming (SQP) has been used for optimization.
Directory of Open Access Journals (Sweden)
N. Sriraam
2011-01-01
Full Text Available A telemedicine system using communication and information technology to deliver medical signals such as ECG, EEG for long distance medical services has become reality. In either the urgent treatment or ordinary healthcare, it is necessary to compress these signals for the efficient use of bandwidth. This paper discusses a quality on demand compression of EEG signals using neural network predictors for telemedicine applications. The objective is to obtain a greater compression gains at a low bit rate while preserving the clinical information content. A two-stage compression scheme with a predictor and an entropy encoder is used. The residue signals obtained after prediction is first thresholded using various levels of thresholds and are further quantized and then encoded using an arithmetic encoder. Three neural network models, single-layer and multi-layer perceptrons and Elman network are used and the results are compared with linear predictors such as FIR filters and AR modeling. The fidelity of the reconstructed EEG signal is assessed quantitatively using parameters such as PRD, SNR, cross correlation and power spectral density. It is found from the results that the quality of the reconstructed signal is preserved at a low PRD thereby yielding better compression results compared to results obtained using lossless scheme.
Artificial Neural Networks to Predict the Power Output of a PV Panel
Directory of Open Access Journals (Sweden)
Valerio Lo Brano
2014-01-01
Full Text Available The paper illustrates an adaptive approach based on different topologies of artificial neural networks (ANNs for the power energy output forecasting of photovoltaic (PV modules. The analysis of the PV module’s power output needed detailed local climate data, which was collected by a dedicated weather monitoring system. The Department of Energy, Information Engineering, and Mathematical Models of the University of Palermo (Italy has built up a weather monitoring system that worked together with a data acquisition system. The power output forecast is obtained using three different types of ANNs: a one hidden layer Multilayer perceptron (MLP, a recursive neural network (RNN, and a gamma memory (GM trained with the back propagation. In order to investigate the influence of climate variability on the electricity production, the ANNs were trained using weather data (air temperature, solar irradiance, and wind speed along with historical power output data available for the two test modules. The model validation was performed by comparing model predictions with power output data that were not used for the network's training. The results obtained bear out the suitability of the adopted methodology for the short-term power output forecasting problem and identified the best topology.
Audio Classification in Speech and Music: A Comparison between a Statistical and a Neural Approach
Directory of Open Access Journals (Sweden)
Bugatti Alessandro
2002-01-01
Full Text Available We focus the attention on the problem of audio classification in speech and music for multimedia applications. In particular, we present a comparison between two different techniques for speech/music discrimination. The first method is based on Zero crossing rate and Bayesian classification. It is very simple from a computational point of view, and gives good results in case of pure music or speech. The simulation results show that some performance degradation arises when the music segment contains also some speech superimposed on music, or strong rhythmic components. To overcome these problems, we propose a second method, that uses more features, and is based on neural networks (specifically a multi-layer Perceptron. In this case we obtain better performance, at the expense of a limited growth in the computational complexity. In practice, the proposed neural network is simple to be implemented if a suitable polynomial is used as the activation function, and a real-time implementation is possible even if low-cost embedded systems are used.
Artificial neural networks for simulating wind effects on sprinkler distribution patterns
Energy Technology Data Exchange (ETDEWEB)
Sayyadi, H.; Sadraddini, A. A.; Farsadi Zadeh, D.; Montero, J.
2012-07-01
A new approach based on Artificial Neural Networks (ANNs) is presented to simulate the effects of wind on the distribution pattern of a single sprinkler under a center pivot or block irrigation system. Field experiments were performed under various wind conditions (speed and direction). An experimental data from different distribution patterns using a Nelson R3000 Rotator sprinkler have been split into three and used for model training, validation and testing. Parameters affecting the distribution pattern were defined. To find an optimal structure, various networks with different architectures have been trained using an Early Stopping method. The selected structure produced R2 0.929 and RMSE = 6.69 mL for the test subset, consisting of a Multi-Layer Perceptron (MLP) neural network with a backpropagation training algorithm; two hidden layers (twenty neurons in the first hidden layer and six neurons in the second hidden layer) and a tangent-sigmoid transfer function. This optimal network was implemented in MATLAB to develop a model termed ISSP (Intelligent Simulator of Sprinkler Pattern). ISSP uses wind speed and direction as input variables and is able to simulate the distorted distribution pattern from a R3000 Rotator sprinkler with reasonable accuracy (R{sup 2} > 0.935). Results of model evaluation confirm the accuracy and robustness of ANNs for simulation of a single sprinkler distribution pattern under real field conditions. (Author) 41 refs.
Directory of Open Access Journals (Sweden)
E. Khalilzadeh Vahidi
2016-01-01
Full Text Available The effects of different parameters on steel plate shear wall (SPSW are investigated. The studied parameters are thickness of plate, location of the opening, thickness of diagonal stiffeners, and thickness of circular stiffener. Load-carrying capacity of the SPSW is studied under static load using nonlinear geometrical and material analysis in ABAQUS and the obtained simulation results are verified. An artificial neural network (ANN is proposed to model the effects of these parameters. According to the results the circular stiffener has more effect compared with the diagonal stiffeners. However, the thickness of the plate has the most significant effect on the SPSW behavior. The results show that the best place for the opening location is the center of SPSW. Multilayer perceptron (MLP neural network was used to predict the maximum load in SPSW with opening. The predicted maximum load values using the proposed MLP model were compared with the simulated validated data. The obtained results show that the proposed ANN model has achieved good agreement with the validated simulated data, with correlation coefficient of more than 0.9975. Therefore, the proposed model is useful, reliable, fast, and cheap tools to predict the maximum load in SPSW.
Presenting an Appropriate Neural Network for Optimal Mix Design of Roller Compacted Concrete Dams
Directory of Open Access Journals (Sweden)
Taha Mehmannavaz
2014-03-01
Full Text Available In general, one of the main targets to achieve the optimal mix design of concrete dams is to reduce the amount of cement, heat of hydration, increasing the size of aggregate (coarse and reduced the permeability. Thus, one of the methods which is used in construction of concrete and soil dams as a suitable replacement is construction of dams in roller compacted concrete method. Spending fewer budgets, using road building machinery, short time of construction and continuation of construction all are the specifications of this construction method, which have caused priority of these two methods and finally this method has been known as a suitable replacement for constructing dams in different parts of the world. On the other hand, expansion of the materials used in this type of concrete, complexity of its mix design, effect of different parameters on its mix design and also finding relations between different parameters of its mix design have necessitated the presentation of a model for roller compacted concretemix design. Artificial neural networks are one of the modeling methods which have shown very high power for adjustment to engineering problems. A kind of these networks, called Multi-Layer Perceptron (MLP neural networks, was used as the main core of modeling in this study along with error-back propagation training algorithm, which is mostly applied in modeling mapping behaviors.
Tahavvor, Ali Reza
2016-06-01
In the present study artificial neural network and fractal geometry are used to predict frost thickness and density on a cold flat plate having constant surface temperature under forced convection for different ambient conditions. These methods are very applicable in this area because phase changes such as melting and solidification are simulated by conventional methods but frost formation is a most complicated phase change phenomenon consists of coupled heat and mass transfer. Therefore conventional mathematical techniques cannot capture the effects of all parameters on its growth and development because this process influenced by many factors and it is a time dependent process. Therefore, in this work soft computing method such as artificial neural network and fractal geometry are used to do this manner. The databases for modeling are generated from the experimental measurements. First, multilayer perceptron network is used and it is found that the back-propagation algorithm with Levenberg-Marquardt learning rule is the best choice to estimate frost growth properties due to accurate and faster training procedure. Second, fractal geometry based on the Von-Koch curve is used to model frost growth procedure especially in frost thickness and density. Comparison is performed between experimental measurements and soft computing methods. Results show that soft computing methods can be used more efficiently to determine frost properties over a flat plate. Based on the developed models, wide range of frost formation over flat plates can be determined for various conditions.
Creep Crack Growth Modeling of Low Alloy Steel using Artificial Neural Network
Directory of Open Access Journals (Sweden)
F. Djavanroodi
2013-07-01
Full Text Available Prediction of crack growth under creep condition is prime requirement in order to avoid costly and time-consuming creep crack growth tests. To predict, in a reliable way, the growth of a major crack in a structural components operating at high temperatures, requires a fracture mechanics based approach. In this Study a novel technique, which uses Finite Element Method (FEM together with Artificial Neural Networks (ANN has been developed to predict the fracture mechanics parameter (C* in a 1%Cr1%MoV low alloy rotor steel under wide range of loading and temperatures. After confirming the validity of the FEM model with experimental data, a collection of numerical and experimental data has been used for training the various neural networks models. Three networks have been used to simulate the process, the perceptron multilayer network with tangent transfer function that uses 9 neurons in the hidden layer, gives the best results. Finally, for validation three case studies at 538°C, 550°C and 594°C temperatures are employed. The proposed model has proved that a combinations of ANN and FEM simulation performs well in estimation of C* and it is a powerful designing tool for creep crack growth characterization.
Implementation of a spike-based perceptron learning rule using TiO2−x memristors
Mostafa, Hesham; Khiat, Ali; Serb, Alexander; Mayr, Christian G.; Indiveri, Giacomo; Prodromakis, Themis
2015-01-01
Synaptic plasticity plays a crucial role in allowing neural networks to learn and adapt to various input environments. Neuromorphic systems need to implement plastic synapses to obtain basic “cognitive” capabilities such as learning. One promising and scalable approach for implementing neuromorphic synapses is to use nano-scale memristors as synaptic elements. In this paper we propose a hybrid CMOS-memristor system comprising CMOS neurons interconnected through TiO2−x memristors, and spike-based learning circuits that modulate the conductance of the memristive synapse elements according to a spike-based Perceptron plasticity rule. We highlight a number of advantages for using this spike-based plasticity rule as compared to other forms of spike timing dependent plasticity (STDP) rules. We provide experimental proof-of-concept results with two silicon neurons connected through a memristive synapse that show how the CMOS plasticity circuits can induce stable changes in memristor conductances, giving rise to increased synaptic strength after a potentiation episode and to decreased strength after a depression episode. PMID:26483629
Neural network sensor fusion: Creation of a virtual sensor for cloud-base height estimation
Pasika, Hugh Joseph Christopher
2000-10-01
Sensor fusion has become a significant area of signal processing research that draws on a variety of tools. Its goals are many, however in this thesis, the creation of a virtual sensor is paramount. In particular, neural networks are used to simulate the output of a LIDAR (LASER. RADAR) that measures cloud-base height. Eye-safe LIDAR is more accurate than the standard tool that would be used for such measurement; the ceilometer. The desire is to make cloud-base height information available at a network of ground-based meteorological stations without actually installing LIDAR sensors. To accomplish this, fifty-seven sensors ranging from multispectral satellite information to standard atmospheric measurements such as temperature and humidity, are fused in what can only be termed as a very complex, nonlinear environment. The result is an accurate prediction of cloud-base height. Thus, a virtual sensor is created. A total of four different learning algorithms were studied; two global and two local. In each case, the very best state-of-the-art learning algorithms have been selected. Local methods investigated are the regularized radial basis function network, and the support vector machine. Global methods include the standard backpropagation with momentum trained multilayer perceptron (used as a benchmark) and the multilayer perceptron trained via the Kalman filter algorithm. While accuracy is the primary concern, computational considerations potentially limit the application of several of the above techniques. Thus, in all cases care was taken to minimize computational cost. For example in the case of the support vector machine, a method of partitioning the problem in order to reduce memory requirements and make the optimization over a large data set feasible was employed and in the Kalman algorithm case, node-decoupling was used to dramatically reduce the number of operations required. Overall, the methods produced somewhat equivalent mean squared errors indicating
Coding design for error correcting output codes based on perceptron
Zhou, Jin-Deng; Wang, Xiao-Dan; Zhou, Hong-Jian; Cui, Yong-Hua; Jing, Sun
2012-05-01
It is known that error-correcting output codes (ECOC) is a common way to model multiclass classification problems, in which the research of encoding based on data is attracting more and more attention. We propose a method for learning ECOC with the help of a single-layered perception neural network. To achieve this goal, the code elements of ECOC are mapped to the weights of network for the given decoding strategy, and an object function with the constrained weights is used as a cost function of network. After the training, we can obtain a coding matrix including lots of subgroups of class. Experimental results on artificial data and University of California Irvine with logistic linear classifier and support vector machine as the binary learner show that our scheme provides better performance of classification with shorter length of coding matrix than other state-of-the-art encoding strategies.
Temporal Difference Learning for the Game Tic-Tac-Toe 3D: Applying Structure to Neural Networks
van de Steeg, Michiel; Drugan, Madalina; Wiering, Marco
2015-01-01
When reinforcement learning is applied to large state spaces, such as those occurring in playing board games, the use of a good function approximator to learn to approximate the value function is very important. In previous research, multilayer perceptrons have often been quite successfully used as
Rai, H. M.; Trivedi, A.; Chatterjee, K.; Shukla, S.
2014-01-01
This paper employed the Daubechies wavelet transform (WT) for R-peak detection and radial basis function neural network (RBFNN) to classify the electrocardiogram (ECG) signals. Five types of ECG beats: normal beat, paced beat, left bundle branch block (LBBB) beat, right bundle branch block (RBBB) beat and premature ventricular contraction (PVC) were classified. 500 QRS complexes were arbitrarily extracted from 26 records in Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) arrhythmia database, which are available on Physionet website. Each and every QRS complex was represented by 21 points from p1 to p21 and these QRS complexes of each record were categorized according to types of beats. The system performance was computed using four types of parameter evaluation metrics: sensitivity, positive predictivity, specificity and classification error rate. The experimental result shows that the average values of sensitivity, positive predictivity, specificity and classification error rate are 99.8%, 99.60%, 99.90% and 0.12%, respectively with RBFNN classifier. The overall accuracy achieved for back propagation neural network (BPNN), multilayered perceptron (MLP), support vector machine (SVM) and RBFNN classifiers are 97.2%, 98.8%, 99% and 99.6%, respectively. The accuracy levels and processing time of RBFNN is higher than or comparable with BPNN, MLP and SVM classifiers.
Directory of Open Access Journals (Sweden)
M. Aquilino
2014-01-01
The historical archive of LANDSAT imagery dating back to the launch of ERTS in 1972 provides a comprehensive and permanent data source for tracking change on the planet‟s land surface. In this study case the imagery acquisition dates of 1987, 2002 and 2011 were selected to cover a time trend of 24 years. Land cover categories were based on classes outlined by the Curve Number method with the aim of characterizing land use according to the level of surface imperviousness. After comparing two land use classification methods, i.e. Maximum Likelihood Classifier (MLC and Multi-Layer Perceptron (MLP neural network, the Artificial Neural Networks (ANN approach was found the best reliable and efficient method in the absence of ground reference data. The ANN approach has a distinct advantage over statistical classification methods in that it is non-parametric and requires little or no a priori knowledge on the distribution model of input data. The results quantify land cover change patterns in the river basin area under study and demonstrate the potential of multitemporal LANDSAT data to provide an accurate and cost-effective means to map and analyse land cover changes over time that can be used as input in land management and policy decision-making.
Braga, C C
2001-01-01
A neural network structure has been used for unfolding neutron spectra measured by means of a Bonner Sphere Spectrometer set and a foil activation set using several neutron induced reactions. The present work used the SNNS (Stuttgart Neural Network Simulator) as the interface for designing, training and validation of the Multilayer Perceptron network. The back-propagation algorithm was applied. The Bonner Sphere set chosen has been calibrated at the National Physical Laboratory, United Kingdom, and uses gold activation foils as thermal neutron detectors. The neutron energy covered by the response functions goes from 0.0001 eV to 14 MeV. The foil activation set chosen has been irradiated at the IEA-R1 research reactor and measured at the Nuclear Metrology Laboratory of IPEN-CNEN/SP. Two types of neutron spectra were numerically investigated: monoenergetic and continuous The unfolded spectra were compared to a conventional method using code SAND-II as part of the neutron dosimetry system SAIPS. Good results wer...
Directory of Open Access Journals (Sweden)
Edia E.O.
2010-10-01
Full Text Available Despite their importance in stream management, the aquatic insect assemblages are still little known in West Africa. This is particularly true in South-Eastern Ivory Coast, where aquatic insect assemblages were hardly studied. We therefore aimed at characterising aquatic insect assemblages on four coastal rivers in South-Eastern Ivory Coast. Patterning aquatic insect assemblages was achieved using a Self-Organizing Map (SOM, an unsupervised Artificial Neural Networks (ANN method. This method was applied to pattern the samples based on the richness of five major orders of aquatic insects (Diptera, Ephemeroptera, Coleoptera, Trichoptera and Odonata. This permitted to identify three clusters that were mainly related to the local environmental status of sampling sites. Then, we used the environmental characteristics of the sites to predict, using a multilayer perceptron neural network (MLP, trained by BackPropagation algorithm (BP, a supervised ANN, the richness of the five insect orders. The BP showed high predictability (0.90 for both Diptera and Trichoptera, 0.84 for both Coleoptera and Odonata, 0.69 for Ephemeroptera. The most contributing variables in predicting the five insect order richness were pH, conductivity, total dissolved solids, water temperature, percentage of rock and the canopy. This underlines the crucial influence of both instream characteristics and riparian context.
Directory of Open Access Journals (Sweden)
Hacene MELLAH
2016-07-01
Full Text Available The objective of this paper is to develop an Artificial Neural Network (ANN model to estimate simultaneously, parameters and state of a brushed DC machine. The proposed ANN estimator is novel in the sense that his estimates simultaneously temperature, speed and rotor resistance based only on the measurement of the voltage and current inputs. Many types of ANN estimators have been designed by a lot of researchers during the last two decades. Each type is designed for a specific application. The thermal behavior of the motor is very slow, which leads to large amounts of data sets. The standard ANN use often Multi-Layer Perceptron (MLP with Levenberg-Marquardt Backpropagation (LMBP, among the limits of LMBP in the case of large number of data, so the use of MLP based on LMBP is no longer valid in our case. As solution, we propose the use of Cascade-Forward Neural Network (CFNN based Bayesian Regulation backpropagation (BRBP. To test our estimator robustness a random white-Gaussian noise has been added to the sets. The proposed estimator is in our viewpoint accurate and robust.
Directory of Open Access Journals (Sweden)
Namık KılıÇ
2015-06-01
Full Text Available Determination of ballistic performance of an armor solution is a complicated task and evolved significantly with the application of finite element methods (FEM in this research field. The traditional armor design studies performed with FEM requires sophisticated procedures and intensive computational effort, therefore simpler and accurate numerical approaches are always worthwhile to decrease armor development time. This study aims to apply a hybrid method using FEM simulation and artificial neural network (ANN analysis to approximate ballistic limit thickness for armor steels. To achieve this objective, a predictive model based on the artificial neural networks is developed to determine ballistic resistance of high hardness armor steels against 7.62 mm armor piercing ammunition. In this methodology, the FEM simulations are used to create training cases for Multilayer Perceptron (MLP three layer networks. In order to validate FE simulation methodology, ballistic shot tests on 20 mm thickness target were performed according to standard Stanag 4569. Afterwards, the successfully trained ANN(s is used to predict the ballistic limit thickness of 500 HB high hardness steel armor. Results show that even with limited number of data, FEM-ANN approach can be used to predict ballistic penetration depth with adequate accuracy.
Pan, Sha-sha; Huang, Fu-rong; Xiao, Chi; Xian, Rui-yi; Ma, Zhi-guo
2015-10-01
To explore rapid reliable methods for detection of Epicarpium citri grandis (ECG), the experiment using Fourier Transform Attenuated Total Reflection Infrared Spectroscopy (FTIR/ATR) and Fluorescence Spectrum Imaging Technology combined with Multilayer Perceptron (MLP) Neural Network pattern recognition, for the identification of ECG, and the two methods are compared. Infrared spectra and fluorescence spectral images of 118 samples, 81 ECG and 37 other kinds of ECG, are collected. According to the differences in tspectrum, the spectra data in the 550-1 800 cm(-1) wavenumber range and 400-720 nm wavelength are regarded as the study objects of discriminant analysis. Then principal component analysis (PCA) is applied to reduce the dimension of spectroscopic data of ECG and MLP Neural Network is used in combination to classify them. During the experiment were compared the effects of different methods of data preprocessing on the model: multiplicative scatter correction (MSC), standard normal variable correction (SNV), first-order derivative(FD), second-order derivative(SD) and Savitzky-Golay (SG). The results showed that: after the infrared spectra data via the Savitzky-Golay (SG) pretreatment through the MLP Neural Network with the hidden layer function as sigmoid, we can get the best discrimination of ECG, the correct percent of training set and testing set are both 100%. Using fluorescence spectral imaging technology, corrected by the multiple scattering (MSC) results in the pretreatment is the most ideal. After data preprocessing, the three layers of the MLP Neural Network of the hidden layer function as sigmoid function can get 100% correct percent of training set and 96.7% correct percent of testing set. It was shown that the FTIR/ATR and fluorescent spectral imaging technology combined with MLP Neural Network can be used for the identification study of ECG and has the advantages of rapid, reliable effect. PMID:26904814
Committee neural network model for rock permeability prediction
Bagheripour, Parisa
2014-05-01
Quantitative formulation between conventional well log data and rock permeability, undoubtedly the most critical parameter of hydrocarbon reservoir, could be a potent tool for solving problems associated with almost all tasks involved in petroleum engineering. The present study proposes a novel approach in charge of the quest for high-accuracy method of permeability prediction. At the first stage, overlapping of conventional well log data (inputs) was eliminated by means of principal component analysis (PCA). Subsequently, rock permeability was predicted from extracted PCs using multi-layer perceptron (MLP), radial basis function (RBF), and generalized regression neural network (GRNN). Eventually, a committee neural network (CNN) was constructed by virtue of genetic algorithm (GA) to enhance the precision of ultimate permeability prediction. The values of rock permeability, derived from the MPL, RBF, and GRNN models, were used as inputs of CNN. The proposed CNN combines results of different ANNs to reap beneficial advantages of all models and consequently producing more accurate estimations. The GA, embedded in the structure of the CNN assigns a weight factor to each ANN which shows relative involvement of each ANN in overall prediction of rock permeability from PCs of conventional well logs. The proposed methodology was applied in Kangan and Dalan Formations, which are the major carbonate reservoir rocks of South Pars Gas Field-Iran. A group of 350 data points was used to establish the CNN model, and a group of 245 data points was employed to assess the reliability of constructed CNN model. Results showed that the CNN method performed better than individual intelligent systems performing alone.
Vassiliadis, Vassilios S.
2006-01-01
A novel algorithm for tunable compression to within the precision of reproduction targets, or storage, is proposed. The new algorithm is termed the `Perceptron Algorithm', which utilises simple existing concepts in a novel way, has multiple immediate commercial application aspects as well as it opens up a multitude of fronts in computational science and technology. The aims of this paper are to present the concepts underlying the algorithm, observations by its application to some example case...
Neural Networks in Control Applications
DEFF Research Database (Denmark)
Sørensen, O.
The intention of this report is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: - Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. - Amongst numerous training algorithms, only four algorithms are examined, all...... in a recursive form (sample updating). The simplest is the Back Probagation Error Algorithm, and the most complex is the recursive Prediction Error Method using a Gauss-Newton search direction. - Over-fitting is often considered to be a serious problem when training neural networks. This problem is specifically...
Institute of Scientific and Technical Information of China (English)
韩明红; 韩捷; 关惠玲
2001-01-01
The reasons for the slowness in convergence of standard backpropagation algorithm and the imperfection of conventional improved algorithms have been fully analyzed. In order to improve the convergence rate of multilayer feedforward neural networks, a new highly efficent unitary backpropagation algorithm based on the unitary-function is proposed. Numerical simulation and experimental results show that the algorithm can greatly increase the convergence rate and highly improve their imminent accurary.%分析了引起标准BP算法收敛速度慢的原因，以及传统改进方法的不足之处，探讨了解决的途径。为了提高BP算法的收敛速度，定义并引入了基量函数的概念，并将其运用到BP算法中，给出了一种高效的单位BP算法。仿真和实例结构均表明该算法能够较好地克服标准BP算法收敛速度慢的缺点，并可以达到很高的网络逼近精度。
Shafizadeh Moghadam, H; Hagenauer, J; Farajzadeh, M; Helbich, M
2015-01-01
The majority of cities are rapidly growing. This makes the monitoring and modeling of urban change’s spatial patterns critical to urban planners, decision makers, and environment protection activists. Although a wide range of methods exists for modeling and simulating urban growth, machine learning
Energy Technology Data Exchange (ETDEWEB)
Herget, Philipp; O' Sullivan, Eugene J.; Romankiw, Lubomyr T.; Wang, Naigang; Webb, Bucknell C.
2016-07-05
A mechanism is provided for an integrated laminated magnetic device. A substrate and a multilayer stack structure form the device. The multilayer stack structure includes alternating magnetic layers and diode structures formed on the substrate. Each magnetic layer in the multilayer stack structure is separated from another magnetic layer in the multilayer stack structure by a diode structure.
Directory of Open Access Journals (Sweden)
Luiz Henry Monken e Silva
2005-01-01
Full Text Available Neste artigo a habilidade das redes neurais perceptron multicamada eminterpolar foi utilizada para analisar duas classes de problemas de contorno. A primeira classe é formada por equações diferenciais em que a solução pode apresentar gradientes elevados e a segunda classe é formada de equações diferenciais definidas em domínios arbitrários. As metodologias propostas por Lagaris et al. (1998 foram estendidas para casos de equações diferenciais sujeitas às condições de Cauchy e condições de contorno mistas. Os resultados fornecidos pelo método da rede neural se apresentam precisos quando comparados com os resultados analíticos ou por métodos numéricos de resolução deequações diferenciais. A precisão alcançada nos resultados e a facilidade no manuseio do método para resolver estes problemas de contorno encorajaram a continuidade da pesquisa, particularmente no tocante à convergência e estabilidade numérica.In this paper, the ability of the multilayer perceptron neural network (MLP in interpolation was used to analyze two classes of boundary value problems. The first class is formed by differential equations, with solutions which can have high gradients and the second are partial differential equations, defined on arbitrary shaped domain. Also, the methodologies proposed by Lagaris et al. (1998 were enlarged for differential equations subjected to Cauchy and mix boundary conditions type. The results of the artificial neural network method are very precise when comparison to the analytical ones or those of classical numerical methods to solve differential equations. The precision achieved in the results and the ability to handle the method, to solve those boundary value problems, were encouraging to keep the research, particularly on an important direction, concerning convergence and numerical stability.
Directory of Open Access Journals (Sweden)
Santana Isabel
2011-08-01
Full Text Available Abstract Background Dementia and cognitive impairment associated with aging are a major medical and social concern. Neuropsychological testing is a key element in the diagnostic procedures of Mild Cognitive Impairment (MCI, but has presently a limited value in the prediction of progression to dementia. We advance the hypothesis that newer statistical classification methods derived from data mining and machine learning methods like Neural Networks, Support Vector Machines and Random Forests can improve accuracy, sensitivity and specificity of predictions obtained from neuropsychological testing. Seven non parametric classifiers derived from data mining methods (Multilayer Perceptrons Neural Networks, Radial Basis Function Neural Networks, Support Vector Machines, CART, CHAID and QUEST Classification Trees and Random Forests were compared to three traditional classifiers (Linear Discriminant Analysis, Quadratic Discriminant Analysis and Logistic Regression in terms of overall classification accuracy, specificity, sensitivity, Area under the ROC curve and Press'Q. Model predictors were 10 neuropsychological tests currently used in the diagnosis of dementia. Statistical distributions of classification parameters obtained from a 5-fold cross-validation were compared using the Friedman's nonparametric test. Results Press' Q test showed that all classifiers performed better than chance alone (p Conclusions When taking into account sensitivity, specificity and overall classification accuracy Random Forests and Linear Discriminant analysis rank first among all the classifiers tested in prediction of dementia using several neuropsychological tests. These methods may be used to improve accuracy, sensitivity and specificity of Dementia predictions from neuropsychological testing.
Shahinfar, Saleh; Mehrabani-Yeganeh, Hassan; Lucas, Caro; Kalhor, Ahmad; Kazemian, Majid; Weigel, Kent A
2012-01-01
Developing machine learning and soft computing techniques has provided many opportunities for researchers to establish new analytical methods in different areas of science. The objective of this study is to investigate the potential of two types of intelligent learning methods, artificial neural networks and neuro-fuzzy systems, in order to estimate breeding values (EBV) of Iranian dairy cattle. Initially, the breeding values of lactating Holstein cows for milk and fat yield were estimated using conventional best linear unbiased prediction (BLUP) with an animal model. Once that was established, a multilayer perceptron was used to build ANN to predict breeding values from the performance data of selection candidates. Subsequently, fuzzy logic was used to form an NFS, a hybrid intelligent system that was implemented via a local linear model tree algorithm. For milk yield the correlations between EBV and EBV predicted by the ANN and NFS were 0.92 and 0.93, respectively. Corresponding correlations for fat yield were 0.93 and 0.93, respectively. Correlations between multitrait predictions of EBVs for milk and fat yield when predicted simultaneously by ANN were 0.93 and 0.93, respectively, whereas corresponding correlations with reference EBV for multitrait NFS were 0.94 and 0.95, respectively, for milk and fat production.
Fernández Caballero, Juan Carlos; Martínez, Francisco José; Hervás, César; Gutiérrez, Pedro Antonio
2010-05-01
This paper proposes a multiclassification algorithm using multilayer perceptron neural network models. It tries to boost two conflicting main objectives of multiclassifiers: a high correct classification rate level and a high classification rate for each class. This last objective is not usually optimized in classification, but is considered here given the need to obtain high precision in each class in real problems. To solve this machine learning problem, we use a Pareto-based multiobjective optimization methodology based on a memetic evolutionary algorithm. We consider a memetic Pareto evolutionary approach based on the NSGA2 evolutionary algorithm (MPENSGA2). Once the Pareto front is built, two strategies or automatic individual selection are used: the best model in accuracy and the best model in sensitivity (extremes in the Pareto front). These methodologies are applied to solve 17 classification benchmark problems obtained from the University of California at Irvine (UCI) repository and one complex real classification problem. The models obtained show high accuracy and a high classification rate for each class.
Directory of Open Access Journals (Sweden)
GEMAN, O.
2014-02-01
Full Text Available Neurological diseases like Alzheimer, epilepsy, Parkinson's disease, multiple sclerosis and other dementias influence the lives of patients, their families and society. Parkinson's disease (PD is a neurodegenerative disease that occurs due to loss of dopamine, a neurotransmitter and slow destruction of neurons. Brain area affected by progressive destruction of neurons is responsible for controlling movements, and patients with PD reveal rigid and uncontrollable gestures, postural instability, small handwriting and tremor. Commercial activity-promoting gaming systems such as the Nintendo Wii and Xbox Kinect can be used as tools for tremor, gait or other biomedical signals acquisitions. They also can aid for rehabilitation in clinical settings. This paper emphasizes the use of intelligent optical sensors or accelerometers in biomedical signal acquisition, and of the specific nonlinear dynamics parameters or fuzzy logic in Parkinson's disease tremor analysis. Nowadays, there is no screening test for early detection of PD. So, we investigated a method to predict PD, based on the image processing of the handwriting belonging to a candidate of PD. For classification and discrimination between healthy people and PD people we used Artificial Neural Networks (Radial Basis Function - RBF and Multilayer Perceptron - MLP and an Adaptive Neuro-Fuzzy Classifier (ANFC. In general, the results may be expressed as a prognostic (risk degree to contact PD.
Neural network based approach for time to crash prediction to cope with software aging
Institute of Scientific and Technical Information of China (English)
Moona Yakhchi; Javier Alonso; Mahdi Fazeli; Amir Akhavan Bitaraf; Ahmad Patooghy
2015-01-01
Recent studies have shown that software is one of the main reasons for computer systems unavailability. A growing ac-cumulation of software errors with time causes a phenomenon cal ed software aging. This phenomenon can result in system per-formance degradation and eventual y system hang/crash. To cope with software aging, software rejuvenation has been proposed. Software rejuvenation is a proactive technique which leads to re-moving the accumulated software errors by stopping the system, cleaning up its internal state, and resuming its normal operation. One of the main chal enges of software rejuvenation is accurately predicting the time to crash due to aging factors such as me-mory leaks. In this paper, different machine learning techniques are compared to accurately predict the software time to crash un-der different aging scenarios. Final y, by comparing the accuracy of different techniques, it can be concluded that the multilayer per-ceptron neural network has the highest prediction accuracy among al techniques studied.
Rodrigo, J.; Hontoria, L.; Almonacid, F.; Fernández, Eduardo F.; Rodrigo, P. M.; Pérez-Higueras, P. J.
2012-10-01
The use of concentrators implies that CPV systems only work with the Direct Normal Irradiance (DNI). So it is necessary to know DNI data in order to estimate the energy that will be produced by the system, perform economic analysis, supervise plant operation, etc. However, DNI Typical Meteorological Year datasets are expensive and rarely available due to the cost and sophistication of measurement devices and data processing requirements. Particularly, there is a lack of data on the Sunbelt countries, which are more favorable for the use of CPV. In this work, an artificial neural network is used for the generation of DNI hourly time series for some Spanish locations. The model was trained and tested with different locations and different year's data. Although several authors have proposed different methods for the generation of solar radiation synthetic series, these methods are for global radiation and flat panel, nevertheless, we calculate them for direct normal solar radiation and used for CPV systems. A Multilayer Perceptron is explained, looking over the first rudimentary initial version and the last more elaborated final version. Finally, an application of this methodology is presented.
Artificial neural networks for analysis of process states in fluidized bed combustion
Energy Technology Data Exchange (ETDEWEB)
Liukkonen, M.; Heikkinen, M.; Hiltunen, T.; Halikka, E.; Kuivalainen, R.; Hiltunen, Y. [University of Eastern Finland, Kuopio (Finland). Dept. of Environmental Science
2011-01-15
There are several challenges confronting energy production nowadays, such as increasing the efficiency of combustion processes and at the same time reducing harmful emissions. The latter, however, often necessitates process improvement, which requires knowledge of the behavior of the process. It is therefore important to develop and implement novel methods for process diagnostics that can respond to the challenges of modern-day energy plants. In this study the formation of nitrogen oxides (NOx) in a circulating fluidized bed (CFB) boiler is modeled by using artificial neural networks (ANN). In the approach used, the process data are first arranged using self-organizing maps (SOM) and k-means clustering to create subsets representing the separate process states in the boiler, including load increase and load decrease situations and conditions of high or low boiler load. After the determination of these process states, variable selection based on multilayer perceptrons (MLP) is performed to obtain information on the factors affecting the formation of NOx in those states. The results show that this approach provides a useful way of monitoring a combustion process.
Comparative Study of Artificial Neural Network and ARIMA Models in Predicting Exchange Rate
Directory of Open Access Journals (Sweden)
karamollah Bagherifard
2012-11-01
Full Text Available Capital market as an organized market has an effective role in mobilizing financial resources due to have growth and economic development of countries and many countries now in the finance firms is responsible for the required credits. In the stock market, shareholders are always seeking the highest efficiency, so the stock price prediction is important for them. Since the stock market is a nonlinear system under conditions of political, economic and psychological, it is difficult to predict the correct stock price. Thus, in the present study artificial intelligence and ARIMA method has been used to predict stock prices. Multilayer Perceptron neural network and radial basis functions are two methods used in this research. Evaluation methods, selection methods and exponential smoothing methods are compared to random walk. The results showed that AI-based methods used in predicting stock performance are more accurate. Between two methods used in artificial intelligence, a method based on radial basis functions is capable to estimate stock prices in the future with higher accuracy.
Artificial Neural Network Based Method to Mitigate Temporary Over-voltages
Directory of Open Access Journals (Sweden)
Iman Sadeghkhani
2011-09-01
Full Text Available Uncontrolled energization of large power transformers may result in magnetizing inrush current of high amplitude and switching over-voltages. The most effective method for the limitation of the switching over-voltages is controlled switching since the magnitudes of the produced transients are strongly dependent on the closing instants of the switch. We introduce a harmonic index that its minimum value is corresponding to the best-case switching time. Also, this paper presents an Artificial Neural Network (ANN-based approach to estimate the optimum switching instants for real time applications. In the proposed ANN, second order Levenberg–Marquardt method is used to train the multilayer perceptron. ANN training is performed based on equivalent circuit parameters of the network. Thus, trained ANN is applicable to every studied system. To verify the effectiveness of the proposed index and accuracy of the ANN-based approach, two case studies are presented and demonstrated.
Stamenković, Lidija J; Antanasijević, Davor Z; Ristić, Mirjana Đ; Perić-Grujić, Aleksandra A; Pocajt, Viktor V
2015-12-01
Ammonia emissions at the national level are frequently estimated by applying the emission inventory approach, which includes the use of emission factors, which are difficult and expensive to determine. Emission factors are therefore the subject of estimation, and as such they contribute to inherent uncertainties in the estimation of ammonia emissions. This paper presents an alternative approach for the prediction of ammonia emissions at the national level based on artificial neural networks and broadly available sustainability and economical/agricultural indicators as model inputs. The Multilayer Perceptron (MLP) architecture was optimized using a trial-and-error procedure, including the number of hidden neurons, activation function, and a back-propagation algorithm. Principal component analysis (PCA) was applied to reduce mutual correlation between the inputs. The obtained results demonstrate that the MLP model created using the PCA transformed inputs (PCA-MLP) provides a more accurate prediction than the MLP model based on the original inputs. In the validation stage, the MLP and PCA-MLP models were tested for ammonia emission predictions for up to 2 years and compared with a principal component regression model. Among the three models, the PCA-MLP demonstrated the best performance, providing predictions for the USA and the majority of EU countries with a relative error of less than 20%.
Directory of Open Access Journals (Sweden)
Khanchoul Kamel
2014-01-01
Full Text Available Knowledge of sediment yield and the factors controlling it provides useful information for estimating erosion intensities within river basins. The objective of this study was to build a model from which suspended sediment yield could be estimated from ungauged rivers using computed sediment yield and physical factors. Researchers working on suspended sediment transported by wadis in the Maghreb are usually facing the lack of available data for such river types. Further study of the prediction of sediment transport in these regions and its variability is clearly required. In this work, ANNs were built between sediment yield established from longterm measurement series at gauging stations in Algerian catchments and corresponding basic physiographic parameters such as rainfall, runoff, lithology index, coefficient of torrentiality, and basin area. The proposed Levenberg-Marquardt and Multilayer Perceptron algorithms to train the neural networks of the current research study was based on the feed-forward backpropagation method with combinations of number of neurons in each hidden layer, transfer function, error goal. Additionally, three statistical measurements, namely the root mean square error (RMSE, the coefficient of determination (R², and the efficiency factor (EF have been reported for examining the forecasting accuracy of the developed model. Single plot displays of network outputs with respect to targets for training have provided good performance results and good fitting . Thus, ANNs were a promising method for predicting suspended sediment yield in ungauged Algerian catchments.
Optical bandgap modeling of thermal annealed ZnO:Ga thin films using neural networks
Energy Technology Data Exchange (ETDEWEB)
Kim, Chang Eun; Moon, Pyung; Yun, Ilgu [School of Electrical and Electronic Engineering, Yonsei University, 262 Seongsanno, Seodaemoon-gu, Seoul 120-749 (Korea); Kim, Sungyeon; Myoung, Jae-Min [Department of Materials Science and Engineering, Yonsei University, 262 Seongsanno, Seodaemoon-gu, Seoul 120-749 (Korea); Jang, Hyeon Woo; Bang, Jungsik [LG Chem, Ltd., Research Park, 104-1 Moonji-Dong, Yuseng-Gu, Daejeon 305-380 (Korea)
2010-07-15
In this paper, the thermal annealing process modeling for the optical bandgap of ZnO:Ga thin films for transparent conductive oxide was presented using neural network (NNets) based on error backpropagation (BPNN) algorithm and multilayer perceptron (MLP). The thermal annealing process of ZnO:Ga thin films were analyzed by general factorial experimental design. The annealing temperature and film thickness were considered as input factors. To model the nonlinear annealing process, 6 experiments were trained by BPNN which has 2-4-1 structures and 2 additional samples were experimented to verify the predicted models. The output response model on optical bandgap and carrier concentration of ZnO:Ga thin films trained by BPNN was represented by surface plot of response surface model. Based on the modeling results, NNets can provide sufficient correspondence between the predicted output values and the measured. The optical bandgap variation of ZnO:Ga thin films by annealing is due to increased carrier concentration and explained by Burstein-Moss effect. The thermal annealing process is nonlinear and complex but the output response can be predicted by the NNets model. (Abstract Copyright [2010], Wiley Periodicals, Inc.)
Use of artificial neural networks and geographic objects for classifying remote sensing imagery
Directory of Open Access Journals (Sweden)
Pedro Resende Silva
2014-06-01
Full Text Available The aim of this study was to develop a methodology for mapping land use and land cover in the northern region of Minas Gerais state, where, in addition to agricultural land, the landscape is dominated by native cerrado, deciduous forests, and extensive areas of vereda. Using forest inventory data, as well as RapidEye, Landsat TM and MODIS imagery, three specific objectives were defined: 1 to test use of image segmentation techniques for an object-based classification encompassing spectral, spatial and temporal information, 2 to test use of high spatial resolution RapidEye imagery combined with Landsat TM time series imagery for capturing the effects of seasonality, and 3 to classify data using Artificial Neural Networks. Using MODIS time series and forest inventory data, time signatures were extracted from the dominant vegetation formations, enabling selection of the best periods of the year to be represented in the classification process. Objects created with the segmentation of RapidEye images, along with the Landsat TM time series images, were classified by ten different Multilayer Perceptron network architectures. Results showed that the methodology in question meets both the purposes of this study and the characteristics of the local plant life. With excellent accuracy values for native classes, the study showed the importance of a well-structured database for classification and the importance of suitable image segmentation to meet specific purposes.
Aspects of artificial neural networks - with applications in high energy physics
International Nuclear Information System (INIS)
Different aspects of artificial neural networks are studied and discussed. They are demonstrated to be powerful general purpose algorithms, applicable to many different problem areas like pattern recognition, function fitting and prediction. Multi-layer perceptron (MPL) models are shown to out perform previous standard approaches on both off-line and on-line analysis tasks in high energy physics, like quark flavour tagging and mass reconstruction, as well as being powerful tools for prediction tasks. It is also demonstrated how a self-organizing network can be employed to extract information from data, for instance to track down origins of unexpected model discrepancies. Furthermore, it is proved that the MPL is more efficient than the learning vector quantization technique on classification problems, by producing smoother discrimination surfaces, and that an MPL network should be trained with a noisy updating schedule if the Hessian is ill-conditioned - A result that is especially important for MPL network with more than just one hidden layer. 81 refs, 6 figs
Design and Modeling of RF Power Amplifiers with Radial Basis Function Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Ali Reza Zirak
2016-06-01
Full Text Available A radial basis function (RBF artificial neural network model for a designed high efficiency radio frequency class-F power amplifier (PA is presented in this paper. The presented amplifier is designed at 1.8 GHz operating frequency with 12 dB of gain and 36 dBm of 1dB output compression point. The obtained power added efficiency (PAE for the presented PA is 76% under 26 dBm input power. The proposed RBF model uses input and DC power of the PA as inputs variables and considers output power as the output variable. The presented RBF network models the designed class-F PA as a block, which could be applied in circuit design. The presented model could be used to model any RF power amplifier. The obtained results show a good agreement between real data and predicted values by RBF model. The results clearly show that the presented RBF network is more precise than multilayer perceptron (MLP model. According to the results, better than 84% and 92% improvement is achieved in MAE and RMSE, respectively.
Modeling of Soft sensor based on Artificial Neural Network for Galactic Cosmic Rays Application
International Nuclear Information System (INIS)
For successful designing of space radiation Galactic Cosmic Rays (GCRs) model, we develop a soft sensor based on the Artificial Neural Network (ANN) model. At the first step, the soft sensor based ANN was constructed as an alternative to model space radiation environment. The structure of ANN in this model is using Multilayer Perceptron (MLP) and Levenberg Marquardt algorithms with 3 inputs and 2 outputs. In the input variable, we use 12 years data (Corr, Uncorr and Press) of GCR particles obtained from Neutron Monitor of Bartol University (Fort Smith area) and the target output is (Corr and Press) from the same source but for Inuvik area in the Polar Regions. In the validation step, we obtained the Root Mean Square Error (RMSE) value of Corr 3.8670e-004 and Press 1.3414e-004 and Variance Accounted For (VAF) of Corr 99.9839 % and Press 99.9831% during the training section. After all the results obtained, then we applied into a Matlab GUI simulation (soft sensor simulation). This simulation will display the estimation of output value from input (Corr and Press). Testing results showed an error of 0.133% and 0.014% for Corr and Press, respectively
Alidoost, F.; Arefi, H.
2016-06-01
In recent years, with the development of the high resolution data acquisition technologies, many different approaches and algorithms have been presented to extract the accurate and timely updated 3D models of buildings as a key element of city structures for numerous applications in urban mapping. In this paper, a novel and model-based approach is proposed for automatic recognition of buildings' roof models such as flat, gable, hip, and pyramid hip roof models based on deep structures for hierarchical learning of features that are extracted from both LiDAR and aerial ortho-photos. The main steps of this approach include building segmentation, feature extraction and learning, and finally building roof labeling in a supervised pre-trained Convolutional Neural Network (CNN) framework to have an automatic recognition system for various types of buildings over an urban area. In this framework, the height information provides invariant geometric features for convolutional neural network to localize the boundary of each individual roofs. CNN is a kind of feed-forward neural network with the multilayer perceptron concept which consists of a number of convolutional and subsampling layers in an adaptable structure and it is widely used in pattern recognition and object detection application. Since the training dataset is a small library of labeled models for different shapes of roofs, the computation time of learning can be decreased significantly using the pre-trained models. The experimental results highlight the effectiveness of the deep learning approach to detect and extract the pattern of buildings' roofs automatically considering the complementary nature of height and RGB information.
Directory of Open Access Journals (Sweden)
F. Alidoost
2016-06-01
Full Text Available In recent years, with the development of the high resolution data acquisition technologies, many different approaches and algorithms have been presented to extract the accurate and timely updated 3D models of buildings as a key element of city structures for numerous applications in urban mapping. In this paper, a novel and model-based approach is proposed for automatic recognition of buildings’ roof models such as flat, gable, hip, and pyramid hip roof models based on deep structures for hierarchical learning of features that are extracted from both LiDAR and aerial ortho-photos. The main steps of this approach include building segmentation, feature extraction and learning, and finally building roof labeling in a supervised pre-trained Convolutional Neural Network (CNN framework to have an automatic recognition system for various types of buildings over an urban area. In this framework, the height information provides invariant geometric features for convolutional neural network to localize the boundary of each individual roofs. CNN is a kind of feed-forward neural network with the multilayer perceptron concept which consists of a number of convolutional and subsampling layers in an adaptable structure and it is widely used in pattern recognition and object detection application. Since the training dataset is a small library of labeled models for different shapes of roofs, the computation time of learning can be decreased significantly using the pre-trained models. The experimental results highlight the effectiveness of the deep learning approach to detect and extract the pattern of buildings’ roofs automatically considering the complementary nature of height and RGB information.
Trépanier, Sylvain; Mathieu, Lucie; Daigneault, Réal; Faure, Stéphane
2016-04-01
This study proposes an artificial neural networks-based method for predicting the unaltered (precursor) chemical compositions of hydrothermally altered volcanic rock. The method aims at predicting precursor's major components contents (SiO2, FeOT, MgO, CaO, Na2O, and K2O). The prediction is based on ratios of elements generally immobile during alteration processes; i.e. Zr, TiO2, Al2O3, Y, Nb, Th, and Cr, which are provided as inputs to the neural networks. Multi-layer perceptron neural networks were trained on a large dataset of least-altered volcanic rock samples that document a wide range of volcanic rock types, tectonic settings and ages. The precursors thus predicted are then used to perform mass balance calculations. Various statistics were calculated to validate the predictions of precursors' major components, which indicate that, overall, the predictions are precise and accurate. For example, rank-based correlation coefficients were calculated to compare predicted and analysed values from a least-altered test dataset that had not been used to train the networks. Coefficients over 0.87 were obtained for all components, except for Na2O (0.77), indicating that predictions for alkali might be less performant. Also, predictions are performant for most volcanic rock compositions, except for ultra-K rocks. The proposed method provides an easy and rapid solution to the often difficult task of determining appropriate volcanic precursor compositions to rocks modified by hydrothermal alteration. It is intended for large volcanic rock databases and is most useful, for example, to mineral exploration performed in complex or poorly known volcanic settings. The method is implemented as a simple C++ console program.
Increasing spatial resolution of CHIRPS rainfall datasets for Cyprus with artificial neural networks
Tymvios, Filippos; Michaelides, Silas; Retalis, Adrianos; Katsanos, Dimitrios; Lelieveld, Jos
2016-08-01
The use of high resolution rainfall datasets is an alternative way of studying climatological regions where conventional rain measurements are sparse or not available. Starting in 1981 to near-present, the CHIRPS (Climate Hazards Group InfraRed Precipitation with Station data) dataset incorporates a 5km×5km resolution satellite imagery with in-situ station data to create gridded rainfall time series for trend analysis, severe events and seasonal drought monitoring. The aim of this work is to further increase the resolution of the rainfall dataset for Cyprus to 1km×1km, by correlating the CHIRPS dataset with elevation information, the NDVI index (Normalized Difference Vegetation Index) from satellite images at 1km×1km and precipitation measurements from the official raingauge network of the Cyprus' Department of Meteorology, utilizing Artificial Neural Networks. The Artificial Neural Networks' architecture that was implemented is the Multi-Layer Perceptron (MLP) trained with the back propagation method, which is widely used in environmental studies. Seven different network architectures were tested, all with two hidden layers. The number of neurons ranged from 3 to10 in the first hidden layer and from 5 to 25 in the second hidden layer. The dataset was separated into a randomly selected training set, a validation set and a testing set; the latter is independently used for the final assessment of the models' performance. Using the Artificial Neural Network approach, a new map of the spatial analysis of rainfall is constructed which exhibits a considerable increase in its spatial resolution. A statistical assessment of the new spatial analysis was made using the rainfall ground measurements from the raingauge network. The assessment indicates that the methodology is promising for several applications.
Amozegar, M; Khorasani, K
2016-04-01
In this paper, a new approach for Fault Detection and Isolation (FDI) of gas turbine engines is proposed by developing an ensemble of dynamic neural network identifiers. For health monitoring of the gas turbine engine, its dynamics is first identified by constructing three separate or individual dynamic neural network architectures. Specifically, a dynamic multi-layer perceptron (MLP), a dynamic radial-basis function (RBF) neural network, and a dynamic support vector machine (SVM) are trained to individually identify and represent the gas turbine engine dynamics. Next, three ensemble-based techniques are developed to represent the gas turbine engine dynamics, namely, two heterogeneous ensemble models and one homogeneous ensemble model. It is first shown that all ensemble approaches do significantly improve the overall performance and accuracy of the developed system identification scheme when compared to each of the stand-alone solutions. The best selected stand-alone model (i.e., the dynamic RBF network) and the best selected ensemble architecture (i.e., the heterogeneous ensemble) in terms of their performances in achieving an accurate system identification are then selected for solving the FDI task. The required residual signals are generated by using both a single model-based solution and an ensemble-based solution under various gas turbine engine health conditions. Our extensive simulation studies demonstrate that the fault detection and isolation task achieved by using the residuals that are obtained from the dynamic ensemble scheme results in a significantly more accurate and reliable performance as illustrated through detailed quantitative confusion matrix analysis and comparative studies. PMID:26881999
Amozegar, M; Khorasani, K
2016-04-01
In this paper, a new approach for Fault Detection and Isolation (FDI) of gas turbine engines is proposed by developing an ensemble of dynamic neural network identifiers. For health monitoring of the gas turbine engine, its dynamics is first identified by constructing three separate or individual dynamic neural network architectures. Specifically, a dynamic multi-layer perceptron (MLP), a dynamic radial-basis function (RBF) neural network, and a dynamic support vector machine (SVM) are trained to individually identify and represent the gas turbine engine dynamics. Next, three ensemble-based techniques are developed to represent the gas turbine engine dynamics, namely, two heterogeneous ensemble models and one homogeneous ensemble model. It is first shown that all ensemble approaches do significantly improve the overall performance and accuracy of the developed system identification scheme when compared to each of the stand-alone solutions. The best selected stand-alone model (i.e., the dynamic RBF network) and the best selected ensemble architecture (i.e., the heterogeneous ensemble) in terms of their performances in achieving an accurate system identification are then selected for solving the FDI task. The required residual signals are generated by using both a single model-based solution and an ensemble-based solution under various gas turbine engine health conditions. Our extensive simulation studies demonstrate that the fault detection and isolation task achieved by using the residuals that are obtained from the dynamic ensemble scheme results in a significantly more accurate and reliable performance as illustrated through detailed quantitative confusion matrix analysis and comparative studies.
Krajišnik, Danina; Stepanović-Petrović, Radica; Tomić, Maja; Micov, Ana; Ibrić, Svetlana; Milić, Jela
2014-04-01
In this study, utilization of artificial neural network (ANN) models [static-multilayer perceptron (MLP) and generalized regression neural networks and dynamic-gamma one-layer network and recurrent one-layer network] for prediction of diclofenac sodium (DS) release from drug-cationic surfactant-modified zeolites physical mixtures comprising different surfactant/drug molar ratio (0.2-2.5) was performed. The inputs for ANNs trainings were surfactant/drug molar ratios, that is, drug loadings in the drug-modified zeolite mixtures, whereas the outputs were percents of drug release in predetermined time points during drug release test (8 h). The obtained results revealed that MLP showed the highest correlation between experimental and predicted drug release. The safety of both natural and cationic surfactant-modified zeolite as a potential excipient was confirmed in an acute toxicity testing during 72 h. DS (1.5, 5, 10, mg/kg, p.o.) as well as DS-modified zeolites mixtures produced a significant dose-dependent reduction of the rat paw edema induced by proinflammatory agent carrageenan. DS antiedematous effect was intensified and prolonged significantly by modified zeolite. These results could suggest the potential improvement in the treatment of inflammation by DS-modified zeolite mixtures. PMID:24496922
International Nuclear Information System (INIS)
Performances of three neural networks, consisting of a multi-layer perceptron, a radial basis function, and a neuro-fuzzy network with local linear model tree training algorithm, in modeling and extracting discriminative features from the response patterns of a temperature-modulated resistive gas sensor are quantitatively compared. For response pattern recording, a voltage staircase containing five steps each with a 20 s plateau is applied to the micro-heater of the sensor, when 12 different target gases, each at 11 concentration levels, are present. In each test, the hidden layer neuron weights are taken as the discriminatory feature vector of the target gas. These vectors are then mapped to a 3D feature space using linear discriminant analysis. The discriminative information content of the feature vectors are determined by the calculation of the Fisher’s discriminant ratio, affording quantitative comparison among the success rates achieved by the different neural network structures. The results demonstrate a superior discrimination ratio for features extracted from local linear neuro-fuzzy and radial-basis-function networks with recognition rates of 96.27% and 90.74%, respectively. (paper)
International Conference on Artificial Neural Networks (ICANN)
Mladenov, Valeri; Kasabov, Nikola; Artificial Neural Networks : Methods and Applications in Bio-/Neuroinformatics
2015-01-01
The book reports on the latest theories on artificial neural networks, with a special emphasis on bio-neuroinformatics methods. It includes twenty-three papers selected from among the best contributions on bio-neuroinformatics-related issues, which were presented at the International Conference on Artificial Neural Networks, held in Sofia, Bulgaria, on September 10-13, 2013 (ICANN 2013). The book covers a broad range of topics concerning the theory and applications of artificial neural networks, including recurrent neural networks, super-Turing computation and reservoir computing, double-layer vector perceptrons, nonnegative matrix factorization, bio-inspired models of cell communities, Gestalt laws, embodied theory of language understanding, saccadic gaze shifts and memory formation, and new training algorithms for Deep Boltzmann Machines, as well as dynamic neural networks and kernel machines. It also reports on new approaches to reinforcement learning, optimal control of discrete time-delay systems, new al...
Nimura, Yukitaka; Hayashi, Yuichiro; Kitasaka, Takayuki; Mori, Kensaku
2015-03-01
This paper presents a method for torso organ segmentation from abdominal CT images using structured perceptron and dual decomposition. A lot of methods have been proposed to enable automated extraction of organ regions from volumetric medical images. However, it is necessary to adjust empirical parameters of them to obtain precise organ regions. This paper proposes an organ segmentation method using structured output learning. Our method utilizes a graphical model and binary features which represent the relationship between voxel intensities and organ labels. Also we optimize the weights of the graphical model by structured perceptron and estimate the best organ label for a given image by dynamic programming and dual decomposition. The experimental result revealed that the proposed method can extract organ regions automatically using structured output learning. The error of organ label estimation was 4.4%. The DICE coeﬃcients of left lung, right lung, heart, liver, spleen, pancreas, left kidney, right kidney, and gallbladder were 0.91, 0.95, 0.77, 0.81, 0.74, 0.08, 0.83, 0.84, and 0.03, respectively.
Introduction to neural networks
International Nuclear Information System (INIS)
This lecture is a presentation of today's research in neural computation. Neural computation is inspired by knowledge from neuro-science. It draws its methods in large degree from statistical physics and its potential applications lie mainly in computer science and engineering. Neural networks models are algorithms for cognitive tasks, such as learning and optimization, which are based on concepts derived from research into the nature of the brain. The lecture first gives an historical presentation of neural networks development and interest in performing complex tasks. Then, an exhaustive overview of data management and networks computation methods is given: the supervised learning and the associative memory problem, the capacity of networks, the Perceptron networks, the functional link networks, the Madaline (Multiple Adalines) networks, the back-propagation networks, the reduced coulomb energy (RCE) networks, the unsupervised learning and the competitive learning and vector quantization. An example of application in high energy physics is given with the trigger systems and track recognition system (track parametrization, event selection and particle identification) developed for the CPLEAR experiment detectors from the LEAR at CERN. (J.S.). 56 refs., 20 figs., 1 tab., 1 appendix
International Nuclear Information System (INIS)
A technique for level measurement in pressure vessels was developed using thermal probes with internal cooling and artificial neural networks (ANN's). This new concept of thermal probes was experimentally tested in an experimental facility (BETSNI) with two test sections, ST1 and ST2. Two different thermal probes were designed and constructed: concentric tubes probe and U tube probe. A data acquisition system (DAS) was assembled to record the experimental data during the tests. Steady state and transient level tests were carried out and the experimental data obtained were used as learning and recall data sets in the ANN's program RETRO-05 that simulate a multilayer perceptron with backpropagation. The results of the analysis show that the technique can be applied for level measurements in pressure vessel. The technique is applied for a less input temperature data than the initially designed to the probes. The technique is robust and can be used in case of lack of some temperature data. Experimental data available in literature from electrically heated thermal probe were also used in the ANN's analysis producing good results. The results of the ANN's analysis show that the technique can be improved and applied to level measurements in pressure vessels. (author)
International Nuclear Information System (INIS)
An ion polymer metal composite (IPMC) is an electroactive polymer that bends in response to a small applied electric field as a result of mobility of cations in the polymer network and vice versa. This paper presents an innovative and accurate nonlinear black-box model (NBBM) for estimating the bending behavior of IPMC actuators. The model is constructed via a general multilayer perceptron neural network (GMLPNN) integrated with a smart learning mechanism (SLM) that is based on an extended Kalman filter with self-decoupling ability (SDEKF). Here the GMLPNN is built with an ability to autoadjust its structure based on its characteristic vector. Furthermore, by using the SLM based on the SDEKF, the GMLPNN parameters are optimized with small computational effort, and the modeling accuracy is improved. An apparatus employing an IPMC actuator is first set up to investigate the IPMC characteristics and to generate the data for training and validating the model. The advanced NBBM model for the IPMC system is then created with the proper inputs to estimate IPMC tip displacement. Next, the model is optimized using the SLM mechanism with the training data. Finally, the optimized NBBM model is verified with the validating data. A comparison between this model and the previously developed model is also carried out to prove the effectiveness of the proposed modeling technique. (paper)
Lee, Su Jeong; Ahn, Myoung-Hwan; Lee, Yeonjin
2016-02-01
Atmospheric instability information derived from satellites plays an important role in short-term weather forecasting, especially the forecasting of severe convective storms. For the next generation of weather satellites for Korea's multi-purpose geostationary satellite program, a new imaging instrument has been developed. Although this imaging instrument is not designed to perform full sounding missions and its capability is limited, its multi-spectral infrared channels provide information on vertical sounding. To take full advantage of the observation data from the much improved spatiotemporal resolution of the imager, the feasibility of an artificial neural network approach for the derivation of the atmospheric instability is investigated. The multi-layer perceptron model with a feed-forward and back-propagation training algorithm shows quite a sensitive response to the selection of the training dataset and model architecture. Through an extensive performance test with a carefully selected training dataset of 7197 independent profiles, the model architectures are selected to be 12, 5000, and 0.3 for the number of hidden nodes, number of epochs, and learning rate, respectively. The selected model gives a mean absolute error, RMSE, and correlation coefficient of 330 J kg-1, 420 J kg-1, and 0.9, respectively. The feasibility is further demonstrated via application of the model to real observation data from a similar instrument that has comparable observation channels with the planned imager.
Birsan, Marius-Victor; Dumitrescu, Alexandru; Cǎrbunaru, Felicia
2016-04-01
The role of statistical downscaling is to model the relationship between large-scale atmospheric circulation and climatic variables on a regional and sub-regional scale, making use of the predictions of future circulation generated by General Circulation Models (GCMs) in order to capture the effects of climate change on smaller areas. The study presents a statistical downscaling model based on a neural network-based approach, by means of multi-layer perceptron networks. Sub-daily temperature data series from 81 meteorological stations over Romania, with full data records are used as predictands. As large-scale predictor, the NCEP/NCAD air temperature data at 850 hPa over the domain 20-30E / 40-50N was used, at a spatial resolution of 2.5×2.5 degrees. The period 1961-1990 was used for calibration, while the validation was realized over the 1991-2010 interval. Further, in order to estimate future changes in air temperature for 2021-2050 and 2071-2100, air temperature data at 850 hPa corresponding to the IPCC A1B scenario was extracted from the CNCM33 model (Meteo-France) and used as predictor. This work has been realized within the research project "Changes in climate extremes and associated impact in hydrological events in Romania" (CLIMHYDEX), code PN II-ID-2011-2-0073, financed by the Romanian Executive Agency for Higher Education Research, Development and Innovation Funding (UEFISCDI).
Anderson, R. B.; Morris, Richard V.; Clegg, S. M.; Humphries, S. D.; Wiens, R. C.; Bell, J. F., III; Mertzman, S. A.
2010-01-01
The ChemCam instrument [1] on the Mars Science Laboratory (MSL) rover will be used to obtain the chemical composition of surface targets within 7 m of the rover using Laser Induced Breakdown Spectroscopy (LIBS). ChemCam analyzes atomic emission spectra (240-800 nm) from a plasma created by a pulsed Nd:KGW 1067 nm laser. The LIBS spectra can be used in a semiquantitative way to rapidly classify targets (e.g., basalt, andesite, carbonate, sulfate, etc.) and in a quantitative way to estimate their major and minor element chemical compositions. Quantitative chemical analysis from LIBS spectra is complicated by a number of factors, including chemical matrix effects [2]. Recent work has shown promising results using multivariate techniques such as partial least squares (PLS) regression and artificial neural networks (ANN) to predict elemental abundances in samples [e.g. 2-6]. To develop, refine, and evaluate analysis schemes for LIBS spectra of geologic materials, we collected spectra of a diverse set of well-characterized natural geologic samples and are comparing the predictive abilities of PLS, cascade correlation ANN (CC-ANN) and multilayer perceptron ANN (MLP-ANN) analysis procedures.
Directory of Open Access Journals (Sweden)
Zhe Dong
2014-02-01
Full Text Available Small modular reactors (SMRs could be beneficial in providing electricity power safely and also be viable for applications such as seawater desalination and heat production. Due to its inherent safety features, the modular high temperature gas-cooled reactor (MHTGR has been seen as one of the best candidates for building SMR-based nuclear power plants. Since the MHTGR dynamics display high nonlinearity and parameter uncertainty, it is necessary to develop a nonlinear adaptive power-level control law which is not only beneficial to the safe, stable, efficient and autonomous operation of the MHTGR, but also easy to implement practically. In this paper, based on the concept of shifted-ectropy and the physically-based control design approach, it is proved theoretically that the simple proportional-differential (PD output-feedback power-level control can provide asymptotic closed-loop stability. Then, based on the strong approximation capability of the multi-layer perceptron (MLP artificial neural network (ANN, a compensator is established to suppress the negative influence caused by system parameter uncertainty. It is also proved that the MLP-compensated PD power-level control law constituted by an experientially-tuned PD regulator and this MLP-based compensator can guarantee bounded closed-loop stability. Numerical simulation results not only verify the theoretical results, but also illustrate the high performance of this MLP-compensated PD power-level controller in suppressing the oscillation of process variables caused by system parameter uncertainty.
Energy Technology Data Exchange (ETDEWEB)
Labrador, I.; Carrasco, R.; Martinez, L.
1996-07-01
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs.
International Nuclear Information System (INIS)
This paper describes a practical introduction to the use of Artificial Neural Networks. Artificial Neural Nets are often used as an alternative to the traditional symbolic manipulation and first order logic used in Artificial Intelligence, due the high degree of difficulty to solve problems that can not be handled by programmers using algorithmic strategies. As a particular case of Neural Net a Multilayer Perception developed by programming in C language on OS9 real time operating system is presented. A detailed description about the program structure and practical use are included. Finally, several application examples that have been treated with the tool are presented, and some suggestions about hardware implementations. (Author) 15 refs
Isomorphisms in Multilayer Networks
Kivelä, Mikko
2015-01-01
We extend the concept of graph isomorphisms to multilayer networks, and we identify multiple types of isomorphisms. For example, in multilayer networks with a single "aspect" (i.e., type of layering), permuting vertex labels, layer labels, and both of types of layers each yield a different type of isomorphism. We discuss how multilayer network isomorphisms naturally lead to defining isomorphisms in any type of network that can be represented as a multilayer network. This thereby yields isomorphisms for multiplex networks, temporal networks, networks with both such features, and more. We reduce each of the multilayer network isomorphism problems to a graph isomorphism problem, and we use this reduction to prove that the multilayer network isomorphism problem is computationally equally hard as the graph isomorphism problem. One can thus use software that has been developed to solve graph isomorphism problems as a practical means for solving multilayer network isomorphism problems.
A Neural Network Based Hybrid Mixture Model to Extract Information from Non-linear Mixed Pixels
Directory of Open Access Journals (Sweden)
Uttam Kumar
2012-09-01
Full Text Available Signals acquired by sensors in the real world are non-linear combinations, requiring non-linear mixture models to describe the resultant mixture spectra for the endmember’s (pure pixel’s distribution. This communication discusses inferring class fraction through a novel hybrid mixture model (HMM. HMM is a three-step process, where the endmembers are first derived from the images themselves using the N-FINDR algorithm. These endmembers are used by the linear mixture model (LMM in the second step that provides an abundance estimation in a linear fashion. Finally, the abundance values along with the training samples representing the actual ground proportions are fed into neural network based multi-layer perceptron (MLP architecture as input to train the neurons. The neural output further refines the abundance estimates to account for the non-linear nature of the mixing classes of interest. HMM is first implemented and validated on simulated hyper spectral data of 200 bands and subsequently on real time MODIS data with a spatial resolution of 250 m. The results on computer simulated data show that the method gives acceptable results for unmixing pixels with an overall RMSE of 0.0089 ± 0.0022 with LMM and 0.0030 ± 0.0001 with the HMM when compared to actual class proportions. The unmixed MODIS images showed overall RMSE with HMM as 0.0191 ± 0.022 as compared to the LMM output considered alone that had an overall RMSE of 0.2005 ± 0.41, indicating that individual class abundances obtained from HMM are very close to the real observations.
Monthly evaporation forecasting using artificial neural networks and support vector machines
Tezel, Gulay; Buyukyildiz, Meral
2016-04-01
Evaporation is one of the most important components of the hydrological cycle, but is relatively difficult to estimate, due to its complexity, as it can be influenced by numerous factors. Estimation of evaporation is important for the design of reservoirs, especially in arid and semi-arid areas. Artificial neural network methods and support vector machines (SVM) are frequently utilized to estimate evaporation and other hydrological variables. In this study, usability of artificial neural networks (ANNs) (multilayer perceptron (MLP) and radial basis function network (RBFN)) and ɛ-support vector regression (SVR) artificial intelligence methods was investigated to estimate monthly pan evaporation. For this aim, temperature, relative humidity, wind speed, and precipitation data for the period 1972 to 2005 from Beysehir meteorology station were used as input variables while pan evaporation values were used as output. The Romanenko and Meyer method was also considered for the comparison. The results were compared with observed class A pan evaporation data. In MLP method, four different training algorithms, gradient descent with momentum and adaptive learning rule backpropagation (GDX), Levenberg-Marquardt (LVM), scaled conjugate gradient (SCG), and resilient backpropagation (RBP), were used. Also, ɛ-SVR model was used as SVR model. The models were designed via 10-fold cross-validation (CV); algorithm performance was assessed via mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R 2). According to the performance criteria, the ANN algorithms and ɛ-SVR had similar results. The ANNs and ɛ-SVR methods were found to perform better than the Romanenko and Meyer methods. Consequently, the best performance using the test data was obtained using SCG(4,2,2,1) with R 2 = 0.905.
Directory of Open Access Journals (Sweden)
Chau Sen Shia
2016-07-01
Full Text Available - Classical methods for software development require high costs and problems of communication between development teams, project risks and delays in the delivery of its services. In this work, the aim is to develop a perceptron model to demonstrate the ability to control, service quality assessment and decision-making in IT (Information Technology. For this, we used perceptron network techniques, standards of service quality measures and risk analysis model of applied projects in software engineering. With the network perceptron model implementation was possible to simulate the application of development in several requests for applications for software, in order to meet the management of schedules in all phases of the life cycle of the projects carried out. The tests with the perceptron model were applied in it environments to meet service requests from various fields. The results and analyses presented in these projects demonstrate that communication between development teams were more consistent. It was also possible to predict with more accuracy the delivery of services, decision making and risk reduction projects.
Directory of Open Access Journals (Sweden)
Juan David Velásquez Henao
2007-12-01
Full Text Available En este artículo, se modela el precio promedio mensual del café colombiano en la Bolsa de Nueva York, usando varios modelos alternativos. El modelo final seleccionado está compuesto por una componente lineal autorregresiva más una red neuronal artificial tipo perceptron multicapa con dos neuronas en la capa oculta, que permite representar la dinámica que sigue el valor esperado de la serie de precios; mientras que la dinámica de los residuales es especificada usando un proceso heterocedástico condicional autoregresivo de primer orden. Los residuales normalizados del modelo son incorrelacionados y homocedásticos, y siguen aproximadamente una distribución normal. Los resultados indican que el precio actual depende de los precios ocurridos en los últimos cuatro meses.In this paper, the monthly average price of the Colombian coffee in the New York Stock Exchange, is modelling by means of several alternative models. The preferred model is composed by a lineal autoregressive component plus a multilayer perceptron neural network with two neurons in the hidden layer, that allow us to representing the dynamic following by the expected value of the price time series; while, the dynamic of the residuals is specified by an autoregressive conditional heterocedastic model of first order. The normalized residuals of the preferred model are uncorrelated, homocedastic and are distributed following a normal distribution. The results indicate that the current price depend of the prices in the previous four months.
Institute of Scientific and Technical Information of China (English)
王秀坤; 张晓峰
2001-01-01
In this paper,a new architecture of single output multilayered feedforward neural networks array and a learning algorithm based this architecture are proposed. This architecture can be used to re-place of a multiple outputs multilayered feedforward neural networks. Theoretical analyses show this mothed outperforms the traditional multiple outputs multilayered feedforward neural networks.
A three-threshold learning rule approaches the maximal capacity of recurrent neural networks
Alireza Alemi; Carlo Baldassi; Nicolas Brunel; Riccardo Zecchina
2015-01-01
Understanding the theoretical foundations of how memories are encoded and retrieved in neural populations is a central challenge in neuroscience. A popular theoretical scenario for modeling memory function is the attractor neural network scenario, whose prototype is the Hopfield model. The model simplicity and the locality of the synaptic update rules come at the cost of a poor storage capacity, compared with the capacity achieved with perceptron learning algorithms. Here, by transforming the...
A Three-Threshold Learning Rule Approaches the Maximal Capacity of Recurrent Neural Networks
Brunel, Nicolas; Zecchina, Riccardo; Baldassi, Carlo
2015-01-01
Understanding the theoretical foundations of how memories are encoded and retrieved in neural populations is a central challenge in neuroscience. A popular theoretical scenario for modeling memory function is the attractor neural network scenario, whose prototype is the Hopfield model. The model simplicity and the locality of the synaptic update rules come at the cost of a poor storage capacity, compared with the capacity achieved with perceptron learning algorithms. Here, by transforming the...
Transformation of Neural State Space Models into LFT Models for Robust Control Design
DEFF Research Database (Denmark)
Bendtsen, Jan Dimon; Trangbæk, Klaus
2000-01-01
This paper considers the extraction of linear state space models and uncertainty models from neural networks trained as state estimators with direct application to robust control. A new method for writing a neural state space model in a linear fractional transformation form in a non......-conservative way is proposed, and it is demonstrated how a standard robust control law can be designed for a system described by means of a multi layer perceptron....
Tran Hoai Linh; Pham Van Nam; Vuong Hoang Nam
2014-01-01
The paper presents a new system for ECG (ElectroCardioGraphy) signal recognition using different neural classifiers and a binary decision tree to provide one more processing stage to give the final recognition result. As the base classifiers, the three classical neural models, i.e., the MLP (Multi Layer Perceptron), modified TSK (Takagi-Sugeno-Kang) and the SVM (Support Vector Machine), will be applied. The coefficients in ECG signal decomposition using Hermite basis functions and the peak-to...
Neural Networks and Photometric Redshifts
Tagliaferri, R; Andreon, S; Capozziello, S; Donalek, C; Giordano, G; Tagliaferri, Roberto; Longo, Giuseppe; Andreon, Stefano; Capozziello, Salvatore; Donalek, Ciro; Giordano, Gerardo
2002-01-01
We present a neural network based approach to the determination of photometric redshift. The method was tested on the Sloan Digital Sky Survey Early Data Release (SDSS-EDR) reaching an accuracy comparable and, in some cases, better than SED template fitting techniques. Different neural networks architecture have been tested and the combination of a Multi Layer Perceptron with 1 hidden layer (22 neurons) operated in a Bayesian framework, with a Self Organizing Map used to estimate the accuracy of the results, turned out to be the most effective. In the best experiment, the implemented network reached an accuracy of 0.020 (interquartile error) in the range 0
Applying Artificial Neural Networks for Face Recognition
Directory of Open Access Journals (Sweden)
Thai Hoang Le
2011-01-01
Full Text Available This paper introduces some novel models for all steps of a face recognition system. In the step of face detection, we propose a hybrid model combining AdaBoost and Artificial Neural Network (ABANN to solve the process efficiently. In the next step, labeled faces detected by ABANN will be aligned by Active Shape Model and Multi Layer Perceptron. In this alignment step, we propose a new 2D local texture model based on Multi Layer Perceptron. The classifier of the model significantly improves the accuracy and the robustness of local searching on faces with expression variation and ambiguous contours. In the feature extraction step, we describe a methodology for improving the efficiency by the association of two methods: geometric feature based method and Independent Component Analysis method. In the face matching step, we apply a model combining many Neural Networks for matching geometric features of human face. The model links many Neural Networks together, so we call it Multi Artificial Neural Network. MIT + CMU database is used for evaluating our proposed methods for face detection and alignment. Finally, the experimental results of all steps on CallTech database show the feasibility of our proposed model.
Utilizando uma rede neural artificial para aproximação da função de evolução do sistema de Lorentz
Directory of Open Access Journals (Sweden)
Andrea Martiniano
2016-04-01
Full Text Available O objetivo principal deste artigo é realizar a aproximação da função de evolução temporal do Sistema de Lorenz utilizando uma Rede Neural Artificial do tipo MLP (Multilayer Perceptron. Além deste objetivo principal, como objetivo específico, apresentam-se os conceitos básicos das Redes Neurais Artificiais (RNAs, um breve histórico da Teoria do Caos e o Sistema de Lorentz. A metodologia adotada na estruturação deste artigo foi definida como bibliográfica e experimental. Atualmente, existe grande interesse nos modelos de redes neurais para resolver problemas não convencionais e complexos, nesse contexto, as Redes Neurais Artificiais têm surgido como alternativa para inúmeras aplicações em diversas áreas do conhecimento. Os resultados obtidos nos experimentos apontam positivamente para a utilização das RNAs. Espera-se com esse artigo incentive a utilização das RNAs em aplicações complexas em que a aprendizagem, associação, generalização e abstração são necessárias para apoio à tomada de decisão.
Guo, Zhiqiang; Wang, Huaiqing; Yang, Jie; Miller, David J
2015-01-01
In this paper, we propose and implement a hybrid model combining two-directional two-dimensional principal component analysis ((2D)2PCA) and a Radial Basis Function Neural Network (RBFNN) to forecast stock market behavior. First, 36 stock market technical variables are selected as the input features, and a sliding window is used to obtain the input data of the model. Next, (2D)2PCA is utilized to reduce the dimension of the data and extract its intrinsic features. Finally, an RBFNN accepts the data processed by (2D)2PCA to forecast the next day's stock price or movement. The proposed model is used on the Shanghai stock market index, and the experiments show that the model achieves a good level of fitness. The proposed model is then compared with one that uses the traditional dimension reduction method principal component analysis (PCA) and independent component analysis (ICA). The empirical results show that the proposed model outperforms the PCA-based model, as well as alternative models based on ICA and on the multilayer perceptron. PMID:25849483
Kumari, Amrita; Das, Suchandan Kumar; Srivastava, Prem Kumar
2016-04-01
Application of computational intelligence for predicting industrial processes has been in extensive use in various industrial sectors including power sector industry. An ANN model using multi-layer perceptron philosophy has been proposed in this paper to predict the deposition behaviors of oxide scale on waterwall tubes of a coal fired boiler. The input parameters comprises of boiler water chemistry and associated operating parameters, such as, pH, alkalinity, total dissolved solids, specific conductivity, iron and dissolved oxygen concentration of the feed water and local heat flux on boiler tube. An efficient gradient based network optimization algorithm has been employed to minimize neural predictions errors. Effects of heat flux, iron content, pH and the concentrations of total dissolved solids in feed water and other operating variables on the scale deposition behavior have been studied. It has been observed that heat flux, iron content and pH of the feed water have a relatively prime influence on the rate of oxide scale deposition in water walls of an Indian boiler. Reasonably good agreement between ANN model predictions and the measured values of oxide scale deposition rate has been observed which is corroborated by the regression fit between these values.
International Nuclear Information System (INIS)
Highlights: ► Solar radiation estimation based on Gene Expression Programming is unexplored. ► This approach is evaluated for the first time in this study. ► Other artificial intelligence models (ANN and ANFIS) are also included in the study. ► New alternatives for solar radiation estimation based on temperatures are provided. - Abstract: Surface incoming solar radiation is a key variable for many agricultural, meteorological and solar energy conversion related applications. In absence of the required meteorological sensors for the detection of global solar radiation it is necessary to estimate this variable. Temperature based modeling procedures are reported in this study for estimating daily incoming solar radiation by using Gene Expression Programming (GEP) for the first time, and other artificial intelligence models such as Artificial Neural Networks (ANNs), and Adaptive Neuro-Fuzzy Inference System (ANFIS). A comparison was also made among these techniques and traditional temperature based global solar radiation estimation equations. Root mean square error (RMSE), mean absolute error (MAE) RMSE-based skill score (SSRMSE), MAE-based skill score (SSMAE) and r2 criterion of Nash and Sutcliffe criteria were used to assess the models’ performances. An ANN (a four-input multilayer perceptron with 10 neurons in the hidden layer) presented the best performance among the studied models (2.93 MJ m−2 d−1 of RMSE). The ability of GEP approach to model global solar radiation based on daily atmospheric variables was found to be satisfactory.
Biyanto, Totok R.
2016-06-01
Fouling in a heat exchanger in Crude Preheat Train (CPT) refinery is an unsolved problem that reduces the plant efficiency, increases fuel consumption and CO2 emission. The fouling resistance behavior is very complex. It is difficult to develop a model using first principle equation to predict the fouling resistance due to different operating conditions and different crude blends. In this paper, Artificial Neural Networks (ANN) MultiLayer Perceptron (MLP) with input structure using Nonlinear Auto-Regressive with eXogenous (NARX) is utilized to build the fouling resistance model in shell and tube heat exchanger (STHX). The input data of the model are flow rates and temperatures of the streams of the heat exchanger, physical properties of product and crude blend data. This model serves as a predicting tool to optimize operating conditions and preventive maintenance of STHX. The results show that the model can capture the complexity of fouling characteristics in heat exchanger due to thermodynamic conditions and variations in crude oil properties (blends). It was found that the Root Mean Square Error (RMSE) are suitable to capture the nonlinearity and complexity of the STHX fouling resistance during phases of training and validation.
Directory of Open Access Journals (Sweden)
Ivana Đurđević Babić
2015-03-01
Full Text Available Student satisfaction with courses in academic institutions is an important issue and is recognized as a form of support in ensuring effective and quality education, as well as enhancing student course experience. This paper investigates whether there is a connection between student satisfaction with courses and log data on student courses in a virtual learning environment. Furthermore, it explores whether a successful classification model for predicting student satisfaction with course can be developed based on course log data and compares the results obtained from implemented methods. The research was conducted at the Faculty of Education in Osijek and included analysis of log data and course satisfaction on a sample of third and fourth year students. Multilayer Perceptron (MLP with different activation functions and Radial Basis Function (RBF neural networks as well as classification tree models were developed, trained and tested in order to classify students into one of two categories of course satisfaction. Type I and type II errors, and input variable importance were used for model comparison and classification accuracy. The results indicate that a successful classification model using tested methods can be created. The MLP model provides the highest average classification accuracy and the lowest preference in misclassification of students with a low level of course satisfaction, although a t-test for the difference in proportions showed that the difference in performance between the compared models is not statistically significant. Student involvement in forum discussions is recognized as a valuable predictor of student satisfaction with courses in all observed models.
Ghanbari, Keyvan; Khakian Ghomi, Mehdi; Mohammadi, Mohammad; Marbouti, Marjan; Tan, Le Minh
2016-08-01
The ionized atmosphere lying from 50 to 600 km above surface, known as ionosphere, contains high amount of electrons and ions. Very Low Frequency (VLF) radio waves with frequencies between 3 and 30 kHz are reflected from the lower ionosphere specifically D-region. A lot of applications in long range communications and navigation systems have been inspired by this characteristic of ionosphere. There are several factors which affect the ionization rate in this region, such as: time of day (presence of sun in the sky), solar zenith angle (seasons) and solar activities. Due to nonlinear response of ionospheric reflection coefficient to these factors, finding an accurate relation between these parameters and reflection coefficient is an arduous task. In order to model these kinds of nonlinear functionalities, some numerical methods are employed. One of these methods is artificial neural network (ANN). In this paper, the VLF radio wave data of 4 sudden ionospheric disturbance (SID) stations are given to a multi-layer perceptron ANN in order to simulate the variations of reflection coefficient of D region ionosphere. After training, validation and testing the ANN, outputs of ANN and observed values are plotted together for 2 random cases of each station. By evaluating the results using 2 parameters of pearson correlation coefficient and root mean square error, a satisfying agreement was found between ANN outputs and real observed data.
Directory of Open Access Journals (Sweden)
Zhiqiang Guo
Full Text Available In this paper, we propose and implement a hybrid model combining two-directional two-dimensional principal component analysis ((2D2PCA and a Radial Basis Function Neural Network (RBFNN to forecast stock market behavior. First, 36 stock market technical variables are selected as the input features, and a sliding window is used to obtain the input data of the model. Next, (2D2PCA is utilized to reduce the dimension of the data and extract its intrinsic features. Finally, an RBFNN accepts the data processed by (2D2PCA to forecast the next day's stock price or movement. The proposed model is used on the Shanghai stock market index, and the experiments show that the model achieves a good level of fitness. The proposed model is then compared with one that uses the traditional dimension reduction method principal component analysis (PCA and independent component analysis (ICA. The empirical results show that the proposed model outperforms the PCA-based model, as well as alternative models based on ICA and on the multilayer perceptron.
Shared Representation of SAR Target and Shadow Based on Multilayer Auto-encoder
Sun Zhi-jun; Xue Lei; Xu Yang-ming; Sun Zhi-yong
2013-01-01
Automatic Target Recognition (ATR) of Synthetic Aperture Radar (SAR) image is investigated. A SAR feature extraction algorithm based on multilayer auto-encoder is proposed. The method makes use of a probabilistic neural network, Restricted Boltzmann Machine (RBM) modeling probability distribution of environment. Through the formation of more expressive multilayer neural network, the deep learning model learns shared representation of the target and its shadow outline reflecting the target sha...
Tien Bui, Dieu; Pradhan, Biswajeet; Nampak, Haleh; Bui, Quang-Thanh; Tran, Quynh-An; Nguyen, Quoc-Phi
2016-09-01
This paper proposes a new artificial intelligence approach based on neural fuzzy inference system and metaheuristic optimization for flood susceptibility modeling, namely MONF. In the new approach, the neural fuzzy inference system was used to create an initial flood susceptibility model and then the model was optimized using two metaheuristic algorithms, Evolutionary Genetic and Particle Swarm Optimization. A high-frequency tropical cyclone area of the Tuong Duong district in Central Vietnam was used as a case study. First, a GIS database for the study area was constructed. The database that includes 76 historical flood inundated areas and ten flood influencing factors was used to develop and validate the proposed model. Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Receiver Operating Characteristic (ROC) curve, and area under the ROC curve (AUC) were used to assess the model performance and its prediction capability. Experimental results showed that the proposed model has high performance on both the training (RMSE = 0.306, MAE = 0.094, AUC = 0.962) and validation dataset (RMSE = 0.362, MAE = 0.130, AUC = 0.911). The usability of the proposed model was evaluated by comparing with those obtained from state-of-the art benchmark soft computing techniques such as J48 Decision Tree, Random Forest, Multi-layer Perceptron Neural Network, Support Vector Machine, and Adaptive Neuro Fuzzy Inference System. The results show that the proposed MONF model outperforms the above benchmark models; we conclude that the MONF model is a new alternative tool that should be used in flood susceptibility mapping. The result in this study is useful for planners and decision makers for sustainable management of flood-prone areas.
Training neural networks using sequential extended Kalman filtering
Energy Technology Data Exchange (ETDEWEB)
Plumer, E.S.
1995-03-01
Recent work has demonstrated the use of the extended Kalman filter (EKF) as an alternative to gradient-descent backpropagation when training multi-layer perceptrons. The EKF approach significantly improves convergence properties but at the cost of greater storage and computational complexity. Feldkamp et al. have described a decoupled version of the EKF which preserves the training advantages of the general EKF but which reduces the storage and computational requirements. This paper reviews the general and decoupled EKF approaches and presents sequentialized versions which provide further computational savings over the batch forms. The usefulness of the sequentialized EKF algorithms is demonstrated on a pattern classification problem.
Directory of Open Access Journals (Sweden)
M. R. Mustafa
2015-01-01
Full Text Available Knowledge of spatial and temporal variations of soil pore-water pressure in a slope is vital in hydrogeological and hillslope related processes (i.e., slope failure, slope stability analysis, etc.. Measurements of soil pore-water pressure data are challenging, expensive, time consuming, and difficult task. This paper evaluates the applicability of artificial neural network (ANN technique for modeling soil pore-water pressure variations at multiple soil depths from the knowledge of rainfall patterns. A multilayer perceptron neural network model was constructed using Levenberg-Marquardt training algorithm for prediction of soil pore-water pressure variations. Time series records of rainfall and pore-water pressures at soil depth of 0.5 m were used to develop the ANN model. To investigate applicability of the model for prediction of spatial and temporal variations of pore-water pressure, the model was tested for the time series data of pore-water pressure at multiple soil depths (i.e., 0.5 m, 1.1 m, 1.7 m, 2.3 m, and 2.9 m. The performance of the ANN model was evaluated by root mean square error, mean absolute error, coefficient of correlation, and coefficient of efficiency. The results revealed that the ANN performed satisfactorily implying that the model can be used to examine the spatial and temporal behavior of time series of pore-water pressures with respect to multiple soil depths from knowledge of rainfall patterns and pore-water pressure with some antecedent conditions.
Prediction of roadheaders' performance using artificial neural network approaches (MLP and KOSFM
Directory of Open Access Journals (Sweden)
Arash Ebrahimabadi
2015-10-01
Full Text Available Application of mechanical excavators is one of the most commonly used excavation methods because it can bring the project more productivity, accuracy and safety. Among the mechanical excavators, roadheaders are mechanical miners which have been extensively used in tunneling, mining and civil industries. Performance prediction is an important issue for successful roadheader application and generally deals with machine selection, production rate and bit consumption. The main aim of this research is to investigate the cutting performance (instantaneous cutting rates (ICRs of medium-duty roadheaders by using artificial neural network (ANN approach. There are different categories for ANNs, but based on training algorithm there are two main kinds: supervised and unsupervised. The multi-layer perceptron (MLP and Kohonen self-organizing feature map (KSOFM are the most widely used neural networks for supervised and unsupervised ones, respectively. For gaining this goal, a database was primarily provided from roadheaders' performance and geomechanical characteristics of rock formations in tunnels and drift galleries in Tabas coal mine, the largest and the only fully-mechanized coal mine in Iran. Then the database was analyzed in order to yield the most important factor for ICR by using relatively important factor in which Garson equation was utilized. The MLP network was trained by 3 input parameters including rock mass properties, rock quality designation (RQD, intact rock properties such as uniaxial compressive strength (UCS and Brazilian tensile strength (BTS, and one output parameter (ICR. In order to have more validation on MLP outputs, KSOFM visualization was applied. The mean square error (MSE and regression coefficient (R of MLP were found to be 5.49 and 0.97, respectively. Moreover, KSOFM network has a map size of 8 × 5 and final quantization and topographic errors were 0.383 and 0.032, respectively. The results show that MLP neural networks
Prediction of roadheaders’ performance using artificial neural network approaches (MLP and KOSFM)
Institute of Scientific and Technical Information of China (English)
Arash Ebrahimabadi; Mohammad Azimipour; Ali Bahreini
2015-01-01
Application of mechanical excavators is one of the most commonly used excavation methods because it can bring the project more productivity, accuracy and safety. Among the mechanical excavators, road-headers are mechanical miners which have been extensively used in tunneling, mining and civil in-dustries. Performance prediction is an important issue for successful roadheader application and generally deals with machine selection, production rate and bit consumption. The main aim of this research is to investigate the cutting performance (instantaneous cutting rates (ICRs)) of medium-duty roadheaders by using artificial neural network (ANN) approach. There are different categories for ANNs, but based on training algorithm there are two main kinds: supervised and unsupervised. The multi-layer perceptron (MLP) and Kohonen self-organizing feature map (KSOFM) are the most widely used neural networks for supervised and unsupervised ones, respectively. For gaining this goal, a database was primarily provided from roadheaders’ performance and geomechanical characteristics of rock formations in tunnels and drift galleries in Tabas coal mine, the largest and the only fully-mechanized coal mine in Iran. Then the database was analyzed in order to yield the most important factor for ICR by using relatively important factor in which Garson equation was utilized. The MLP network was trained by 3 input parameters including rock mass properties, rock quality designation (RQD), intact rock properties such as uniaxial compressive strength (UCS) and Brazilian tensile strength (BTS), and one output parameter (ICR). In order to have more validation on MLP outputs, KSOFM visu-alization was applied. The mean square error (MSE) and regression coefficient (R) of MLP were found to be 5.49 and 0.97, respectively. Moreover, KSOFM network has a map size of 8 ? 5 and final quantization and topographic errors were 0.383 and 0.032, respectively. The results show that MLP neural networks have a
SOLVING INVERSE KINEMATICS OF REDUNDANT MANIPULATOR BASED ON NEURAL NETWORK
Institute of Scientific and Technical Information of China (English)
无
2003-01-01
For the redundant manipulators, neural network is used to tackle the velocity inverse kinematics of robot manipulators. The neural networks utilized are multi-layered perceptions with a back-propagation training algorithm. The weight table is used to save the weights solving the inverse kinematics based on the different optimization performance criteria. Simulations verify the effectiveness of using neural network.
DEFF Research Database (Denmark)
Dickison, Mark; Magnani, Matteo; Rossi, Luca
social network systems, the evolution of interconnected social networks, and dynamic processes such as information spreading. A single real dataset is used to illustrate the concepts presented throughout the book, demonstrating both the practical utility and the potential shortcomings of the various......Multilayer networks, in particular multilayer social networks, where users belong to and interact on different networks at the same time, are an active research area in social network analysis, computer science, and physics. These networks have traditionally been studied within these separate...... research communities, leading to the development of several independent models and methods to deal with the same set of problems. This book unifies and consolidates existing practical and theoretical knowledge on multilayer networks including data collection and analysis, modeling, and mining of multilayer...
A Neural-Network-Based Nonlinear Adaptive State-Observer for Pressurized Water Reactors
Directory of Open Access Journals (Sweden)
Zhe Dong
2013-10-01
Full Text Available Although there have been some severe nuclear accidents such as Three Mile Island (USA, Chernobyl (Ukraine and Fukushima (Japan, nuclear fission energy is still a source of clean energy that can substitute for fossil fuels in a centralized way and in a great amount with commercial availability and economic competitiveness. Since the pressurized water reactor (PWR is the most widely used nuclear fission reactor, its safe, stable and efficient operation is meaningful to the current rebirth of the nuclear fission energy industry. Power-level regulation is an important technique which can deeply affect the operation stability and efficiency of PWRs. Compared with the classical power-level controllers, the advanced power-level regulators could strengthen both the closed-loop stability and control performance by feeding back the internal state-variables. However, not all of the internal state variables of a PWR can be obtained directly by measurements. To implement advanced PWR power-level control law, it is necessary to develop a state-observer to reconstruct the unmeasurable state-variables. Since a PWR is naturally a complex nonlinear system with parameters varying with power-level, fuel burnup, xenon isotope production, control rod worth and etc., it is meaningful to design a nonlinear observer for the PWR with adaptability to system uncertainties. Due to this and the strong learning capability of the multi-layer perceptron (MLP neural network, an MLP-based nonlinear adaptive observer is given for PWRs. Based upon Lyapunov stability theory, it is proved theoretically that this newly-built observer can provide bounded and convergent state-observation. This observer is then applied to the state-observation of a special PWR, i.e., the nuclear heating reactor (NHR, and numerical simulation results not only verify its feasibility but also give the relationship between the observation performance and observer parameters.
Can artificial neural networks be used to predict the origin of ozone episodes?
International Nuclear Information System (INIS)
Tropospheric ozone is a secondary pollutant having a negative impact on health and environment. To control and minimize such impact the European Community established regulations to promote a clean air all over Europe. However, when an episode is related with natural mechanisms as Stratosphere–Troposphere Exchanges (STE), the benefits of an action plan to minimize precursor emissions are inefficient. Therefore, this work aims to develop a tool to identify the sources of ozone episodes in order to minimize misclassification and thus avoid the implementation of inappropriate air quality plans. For this purpose, an artificial neural network model – the Multilayer Perceptron – is used as a binary classifier of the source of an ozone episode. Long data series, between 2001 and 2010, considering the ozone precursors, 7Be activity and meteorological conditions were used. With this model, 2–7% of a mean error was achieved, which is considered as a good generalization. Accuracy measures for imbalanced data are also discussed. The MCC values show a good performance of the model (0.65–0.92). Precision and F1-measure indicate that the model specifies a little better the rare class. Thus, the results demonstrate that such a tool can be used to help authorities in the management of ozone, namely when its thresholds are exceeded due natural causes, as the above mentioned STE. Therefore, the resources used to implement an action plan to minimize ozone precursors could be better managed avoiding the implementation of inappropriate measures. - Highlights: • ANN can classify the origin of an O3 episode with a mean error around 2-7%. • The best classification is obtained when a simpler input combination is used. • ANN can help authorities to foster O3 action plans to control exceedances
Directory of Open Access Journals (Sweden)
Luciana C. Bucene
2004-12-01
Full Text Available Objetivando classificar terras para irrigação, faz-se necessário analisar e determinar alguns parâmetros, entre eles a produtividade do solo. A classificação de produtividade (comumente chamada fertilidade aparente é delimitada em cinco classes: muito alta, alta, média, baixa e muito baixa, e em cada classe é preciso avaliar certos atributos do solo, como pH, CTC (capacidade de troca de cátions, V% (índice de saturação por bases, P (fósforo, Mg (magnésio e K (potássio. Neste trabalho, objetivou-se identificar a produtividade na qual atributos do solo, da parte inicial da microbacia hidrográfica do Rio Pardo, localizada em Pardinho, SP, foram analisados e classificados nas classes que a delimitam, através de Redes Neurais Artificiais (RNAs utilizandose Perceptron Múltiplas Camadas (Multilayers Perceptrons - MLP com o algoritmo de treinamento "backpropagation"- classificador de padrões, obtendo-se um número ótimo de camadas intermediárias e de neurônios; resultando na classificação de produtividade, a situação ótima da rede obteve 78% dos resultados iguais aos desejados, com duas camadas de neurônios, uma das quais intermediária, com 5 neurônios, e uma camada de saída.Productivity data (commonly known as apparent fertility of the initial part of the river Pardo-SP watershed was analyzed and classified with Artificial Neural Networks (ANNs, in order to classify lands for irrigation. Soil attributes as pH, CEC (cation exchange capacity, V% (base saturation index, P (phosphorus, Mg (magnesium and K (potassium were defined in five classes: very high, high, medium, low and very low. Apparent fertility classification taking into account the five classes was performed by using Multiple Layers Perceptron (MLP. Backpropagation algorithm was performed with the training set. One hidden layer with 5 neurons was the situation that best performed.
Directory of Open Access Journals (Sweden)
Yugal kumar
2012-05-01
Full Text Available In today’s world, gigantic amount of data is available in science, industry, business and many other areas. This data can provide valuable information which can be used by management for making important decisions. But problem is that how can find valuable information. The answer is data mining. Data Mining is popular topic among researchers. There is lot of work that cannot be explored till now. But, this paper focuses on the fundamental concept of the Data mining i.e. Classification Techniques. In this paper BayesNet, NavieBayes, NavieBayes Uptable, Multilayer perceptron, Voted perceptron and J48 classifiers are used for the classification of data set. The performance of these classifiers analyzed with the help of Mean Absolute Error, Root Mean-Squared Error and Time Taken to build the model and the result can be shown statistical as well as graphically. For this purpose the WEKA data mining tool is used.
Representation of Functional Data in Neural Networks
Rossi, Fabrice; Conan-Guez, Brieuc; Verleysen, Michel
2005-01-01
Functional Data Analysis (FDA) is an extension of traditional data analysis to functional data, for example spectra, temporal series, spatio-temporal images, gesture recognition data, etc. Functional data are rarely known in practice; usually a regular or irregular sampling is known. For this reason, some processing is needed in order to benefit from the smooth character of functional data in the analysis methods. This paper shows how to extend the Radial-Basis Function Networks (RBFN) and Multi-Layer Perceptron (MLP) models to functional data inputs, in particular when the latter are known through lists of input-output pairs. Various possibilities for functional processing are discussed, including the projection on smooth bases, Functional Principal Component Analysis, functional centering and reduction, and the use of differential operators. It is shown how to incorporate these functional processing into the RBFN and MLP models. The functional approach is illustrated on a benchmark of spectrometric data ana...
The value of "black-box" neural network modeling in subsurface flow prediction
Paleologos, E.; Skitzi, I.; Katsifarakis, K.
2012-04-01
In several hydrologic cases the complexity of the processes involved tied in with the uncertainty in the subsurface geologic environment, geometries, and boundary conditions cannot be addressed by constitutive relationships, either in a deterministic or a stochastic framework. "Black-box" models are used routinely in surface hydrologic predictions, but in subsurface hydrology there is still a tendency to rely on physical descriptions, even in problems where the geometry, the medium, the processes, the boundary conditions are largely unknown. Subsurface flow in karstic environments exemplifies all the above complexities and uncertainties rendering the use of physical models impractical. The current study uses neural networks to exemplify that "black-box" models can provide useful predictions even in the absence of physical process descriptions. Daily discharges of two springs lying in a karstic environment were simulated for a period of two and a half years with the use of a multi-layer perceptron back-propagation neural network. Missing discharge values were supplemented by assuming linear relationships during base flow conditions, thus extending the length of the data record during the network's training phase and improving its performance. The time lag between precipitation and spring discharge differed significantly for the two springs indicating that in karstic environments hydraulic behavior is dominated, even within a few hundred meters, by local conditions. Optimum training results were attained with a Levenberg-Marquardt algorithm resulting in a network architecture consisting of two input layer neurons, four hidden layer neurons, and one output layer neuron, the spring's discharge. The neural network's predictions captured the behavior for both springs and followed very closely the discontinuities in the discharge time series. Under/over-estimation of observed discharges for the two springs remained below 3%, with the exception of a few local maxima where
System Identification, Prediction, Simulation and Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1997-01-01
a Gauss-Newton search direction is applied. 3) Amongst numerous model types, often met in control applications, only the Non-linear ARMAX (NARMAX) model, representing input/output description, is examined. A simulated example confirms that a neural network has the potential to perform excellent System...... study of the networks themselves. With this end in view the following restrictions have been made: 1) Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. 2) Amongst numerous training algorithms, only the Recursive Prediction Error Method using......The intention of this paper is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...
Control of Multilayer Networks
Menichetti, Giulia; Bianconi, Ginestra
2015-01-01
The controllability of a network is a theoretical problem of relevance in a variety of contexts ranging from financial markets to the brain. Until now, network controllability has been characterized only on isolated networks, while the vast majority of complex systems are formed by multilayer networks. Here we build a theoretical framework for the linear controllability of multilayer networks by mapping the problem into a combinatorial matching problem. We found that correlating the external signals in the different layers can significantly reduce the multiplex network robustness to node removal, as it can be seen in conjunction with a hybrid phase transition occurring in interacting Poisson networks. Moreover we observe that multilayer networks can stabilize the fully controllable multiplex network configuration that can be stable also when the full controllability of the single network is not stable.
Neural network-based software sensor: Data set design and application to a continuous pulp digester
Dufour, Pascal; Bhartiya, Sharad; Dhurjati, Prasad S.; Doyle Iii, Francis J.
2005-01-01
The authors acknowledge the Control Engineering Practice journal for his copyright policies & self-archiving. More open archives publications of Pascal Dufour are available on: http://hal.archives-ouvertes.fr/DUFOUR-PASCAL-C-3926-2008 International audience A neural network based strategy for detection of feedstock variations in a continuous pulp digester is presented. A feedforward two-layer perceptron network is trained to detect and isolate unmeasured variations in the feedstock. Tra...
Musa Abbagoni, Baba; Yeung, Hoi
2016-08-01
The identification of flow pattern is a key issue in multiphase flow which is encountered in the petrochemical industry. It is difficult to identify the gas-liquid flow regimes objectively with the gas-liquid two-phase flow. This paper presents the feasibility of a clamp-on instrument for an objective flow regime classification of two-phase flow using an ultrasonic Doppler sensor and an artificial neural network, which records and processes the ultrasonic signals reflected from the two-phase flow. Experimental data is obtained on a horizontal test rig with a total pipe length of 21 m and 5.08 cm internal diameter carrying air-water two-phase flow under slug, elongated bubble, stratified-wavy and, stratified flow regimes. Multilayer perceptron neural networks (MLPNNs) are used to develop the classification model. The classifier requires features as an input which is representative of the signals. Ultrasound signal features are extracted by applying both power spectral density (PSD) and discrete wavelet transform (DWT) methods to the flow signals. A classification scheme of ‘1-of-C coding method for classification’ was adopted to classify features extracted into one of four flow regime categories. To improve the performance of the flow regime classifier network, a second level neural network was incorporated by using the output of a first level networks feature as an input feature. The addition of the two network models provided a combined neural network model which has achieved a higher accuracy than single neural network models. Classification accuracies are evaluated in the form of both the PSD and DWT features. The success rates of the two models are: (1) using PSD features, the classifier missed 3 datasets out of 24 test datasets of the classification and scored 87.5% accuracy; (2) with the DWT features, the network misclassified only one data point and it was able to classify the flow patterns up to 95.8% accuracy. This approach has demonstrated the
Mekanik, F.; Imteaz, M. A.; Gato-Trinidad, S.; Elmahdi, A.
2013-10-01
In this study, the application of Artificial Neural Networks (ANN) and Multiple regression analysis (MR) to forecast long-term seasonal spring rainfall in Victoria, Australia was investigated using lagged El Nino Southern Oscillation (ENSO) and Indian Ocean Dipole (IOD) as potential predictors. The use of dual (combined lagged ENSO-IOD) input sets for calibrating and validating ANN and MR Models is proposed to investigate the simultaneous effect of past values of these two major climate modes on long-term spring rainfall prediction. The MR models that did not violate the limits of statistical significance and multicollinearity were selected for future spring rainfall forecast. The ANN was developed in the form of multilayer perceptron using Levenberg-Marquardt algorithm. Both MR and ANN modelling were assessed statistically using mean square error (MSE), mean absolute error (MAE), Pearson correlation (r) and Willmott index of agreement (d). The developed MR and ANN models were tested on out-of-sample test sets; the MR models showed very poor generalisation ability for east Victoria with correlation coefficients of -0.99 to -0.90 compared to ANN with correlation coefficients of 0.42-0.93; ANN models also showed better generalisation ability for central and west Victoria with correlation coefficients of 0.68-0.85 and 0.58-0.97 respectively. The ability of multiple regression models to forecast out-of-sample sets is compatible with ANN for Daylesford in central Victoria and Kaniva in west Victoria (r = 0.92 and 0.67 respectively). The errors of the testing sets for ANN models are generally lower compared to multiple regression models. The statistical analysis suggest the potential of ANN over MR models for rainfall forecasting using large scale climate modes.
Directory of Open Access Journals (Sweden)
L.O. Murta Jr.
2006-01-01
Full Text Available The present study describes an auxiliary tool in the diagnosis of left ventricular (LV segmental wall motion (WM abnormalities based on color-coded echocardiographic WM images. An artificial neural network (ANN was developed and validated for grading LV segmental WM using data from color kinesis (CK images, a technique developed to display the timing and magnitude of global and regional WM in real time. We evaluated 21 normal subjects and 20 patients with LVWM abnormalities revealed by two-dimensional echocardiography. CK images were obtained in two sets of viewing planes. A method was developed to analyze CK images, providing quantitation of fractional area change in each of the 16 LV segments. Two experienced observers analyzed LVWM from two-dimensional images and scored them as: 1 normal, 2 mild hypokinesia, 3 moderate hypokinesia, 4 severe hypokinesia, 5 akinesia, and 6 dyskinesia. Based on expert analysis of 10 normal subjects and 10 patients, we trained a multilayer perceptron ANN using a back-propagation algorithm to provide automated grading of LVWM, and this ANN was then tested in the remaining subjects. Excellent concordance between expert and ANN analysis was shown by ROC curve analysis, with measured area under the curve of 0.975. An excellent correlation was also obtained for global LV segmental WM index by expert and ANN analysis (R² = 0.99. In conclusion, ANN showed high accuracy for automated semi-quantitative grading of WM based on CK images. This technique can be an important aid, improving diagnostic accuracy and reducing inter-observer variability in scoring segmental LVWM.
Murta, L O; Ruiz, E E S; Pazin-Filho, A; Schmidt, A; Almeida-Filho, O C; Simões, M V; Marin-Neto, J A; Maciel, B C
2006-01-01
The present study describes an auxiliary tool in the diagnosis of left ventricular (LV) segmental wall motion (WM) abnormalities based on color-coded echocardiographic WM images. An artificial neural network (ANN) was developed and validated for grading LV segmental WM using data from color kinesis (CK) images, a technique developed to display the timing and magnitude of global and regional WM in real time. We evaluated 21 normal subjects and 20 patients with LVWM abnormalities revealed by two-dimensional echocardiography. CK images were obtained in two sets of viewing planes. A method was developed to analyze CK images, providing quantitation of fractional area change in each of the 16 LV segments. Two experienced observers analyzed LVWM from two-dimensional images and scored them as: 1) normal, 2) mild hypokinesia, 3) moderate hypokinesia, 4) severe hypokinesia, 5) akinesia, and 6) dyskinesia. Based on expert analysis of 10 normal subjects and 10 patients, we trained a multilayer perceptron ANN using a back-propagation algorithm to provide automated grading of LVWM, and this ANN was then tested in the remaining subjects. Excellent concordance between expert and ANN analysis was shown by ROC curve analysis, with measured area under the curve of 0.975. An excellent correlation was also obtained for global LV segmental WM index by expert and ANN analysis (R2 = 0.99). In conclusion, ANN showed high accuracy for automated semi-quantitative grading of WM based on CK images. This technique can be an important aid, improving diagnostic accuracy and reducing inter-observer variability in scoring segmental LVWM.
Directory of Open Access Journals (Sweden)
R Noori
2009-03-01
Full Text Available "nBackground: Municipal solid waste (MSW is the natural result of human activities. MSW generation modeling is of prime importance in designing and programming municipal solid waste management system. This study tests the short-term prediction of waste generation by artificial neural network (ANN and principal component-regression analysis."nMethods: Two forecasting techniques are presented in this paper for prediction of waste generation (WG. One of them, multivariate linear regression (MLR, is based on principal component analysis (PCA. The other technique is ANN model. For ANN, a feed-forward multi-layer perceptron was considered the best choice for this study. However, in this research after removing the problem of multicolinearity of independent variables by PCA, an appropriate model (PCA-MLR was developed for predicting WG."nResults: Correlation coefficient (R and average absolute relative error (AARE in ANN model obtained as equal to 0.837 and 4.4% respectively. In comparison whit PCA-MLR model (R= 0.445, MARE= 6.6%, ANN model has a better results. However, threshold statistic error is done for the both models in the testing stage that the maximum absolute relative error (ARE for 50% of prediction is 3.7% in ANN model but it is 6.2% for PCA-MLR model. Also we can say that the maximum ARE for 90% of prediction in testing step of ANN model is about 8.6% but it is 10.5% for PCA-MLR model."nConclusion: The ANN model has better results in comparison with the PCA-MLR model therefore this model is selected for prediction of WG in Tehran.
Investigation of periodic multilayers
Bodnarchuck, V; Ignatovich, V; Veres, T; Yaradaykin, S
2009-01-01
Periodic multilayers of various periods were prepared according to an algorithm proposed by the authors. The reflectivity properties of these systems were investigated using neutron reflectometry.The obtained experimental results were compared with the theoretical expectations. In first approximation, the results proved the main features of the theoretical predictions. These promising results initiate further research of such systems.
A new approach to the analysis of alpha spectra based on neural network techniques
Energy Technology Data Exchange (ETDEWEB)
Baeza, A.; Miranda, J. [LARUEX, Environmental Radioactivity Laboratory, Dept. Applied Physics, Faculty of Veterinary Science, University of Extremadura, Avda. Universidad s/n, 10003 Caceres (Spain); Guillen, J., E-mail: fguillen@unex.es [LARUEX, Environmental Radioactivity Laboratory, Dept. Applied Physics, Faculty of Veterinary Science, University of Extremadura, Avda. Universidad s/n, 10003 Caceres (Spain); Corbacho, J.A. [LARUEX, Environmental Radioactivity Laboratory, Dept. Applied Physics, Faculty of Veterinary Science, University of Extremadura, Avda. Universidad s/n, 10003 Caceres (Spain); Perez, R. [Dept. Technology of Computers and Communications, Polytechnics School, University of Extremadura, Avda. Universidad s/n, 10003 Caceres (Spain)
2011-10-01
The analysis of alpha spectra requires good radiochemical procedures in order to obtain well differentiated alpha peaks in the spectrum, and the easiest way to analyze them is by directly summing the counts obtained in the Regions of Interest (ROIs). However, the low-energy tails of the alpha peaks frequently make this simple approach unworkable because some peaks partially overlap. Many fitting procedures have been proposed to solve this problem, most of them based on semi-empirical mathematical functions that emulate the shape of a theoretical alpha peak. The main drawback of these methods is that the great number of fitting parameters used means that their physical meaning is obscure or completely lacking. We propose another approach-the application of an artificial neural network. Instead of fitting the experimental data to a mathematical function, the fit is carried out by an artificial neural network (ANN) that has previously been trained to model the shape of an alpha peak using as training patterns several polonium spectra obtained from actual samples analyzed in our laboratory. In this sense, the ANN is able to learn the shape of an actual alpha peak. We have designed such an ANN as a feed-forward multi-layer perceptron with supervised training based on a back-propagation algorithm. The fitting procedure is based on the experimental observables that are characteristic of alpha peaks-the number of counts of the maximum and several peak widths at different heights. Polonium isotope spectra were selected because the alpha peaks corresponding to {sup 208}Po, {sup 209}Po, and {sup 210}Po are monoenergetic and well separated. The uncertainties introduced by this fitting procedure were less than the counting uncertainties. This new approach was applied to the problem of resolving overlapping peaks. Firstly, a theoretical study was carried out by artificially overlapping alpha peaks from actual samples in order to test the ability of the ANN to resolve each peak
Uysal, Gokcen; Arda Sorman, Ali; Sensoy, Aynur
2014-05-01
Contribution of snowmelt and correspondingly snow observations are highly important in mountainous basins for modelers who deal with conceptual, physical or soft computing models in terms of effective water resources management. Long term archived continuous data are needed for appropriate training and testing of data driven approaches like artificial neural networks (ANN). Data is scarce at the upper elevations due to the difficulty of installing sufficient automated SNOTEL stations; thus in literatures many attempts are made on the rainfall dominated basins for streamflow estimation studies. On the other hand, optical satellites can easily detect snow because of its high reflectance property. MODIS (Moderate Resolution Imaging Spectroradiometer) satellite that has two platforms (Terra and Aqua) provides daily and 8-daily snow images for different time periods since 2000, therefore snow cover data (SCA) may be useful as an input layer for ANN applications. In this study, a multi-layer perceptron (MLP) model is trained and tested with precipitation, temperature, radiation, previous day discharges as well as MODIS daily SCA data. The weights and biases are optimized with fastest and robust Levenberg-Marquardt backpropagation algorithm. MODIS snow cover images are removed from cloud coverage using certain filtering techniques. The Upper Euphrates River Basin in eastern part of Turkey (10 250 km2) is selected as the application area since it is fed by snowmelt approximately 2/3 of total annual volume during spring and early summer. Several input models and ANN structures are investigated to see the effect of the contributions using 10 years of data (2001-2010) for training and validation. The accuracy of the streamflow estimations is checked with statistical criteria (coefficient of determination, Nash-Sutcliffe model efficiency, root mean square error, mean absolute error) and the results seem to improve when SCA data is introduced. Furthermore, a forecast study is
Artificial Neural Network Models for Long Lead Streamflow Forecasts using Climate Information
Kumar, J.; Devineni, N.
2007-12-01
developed between the identified predictors and the predictand. Predictors used are the scores of Principal Components Analysis (PCA). The models were tested and validated. The feed- forward multi-layer perceptron (MLP) type neural networks trained using the back-propagation algorithms are employed in the current study. The performance of the ANN-model forecasts are evaluated using various performance evaluation measures such as correlation coefficient, root mean square error (RMSE). The preliminary results shows that ANNs are efficient to forecast long lead time streamflows using climatic predictors.
Multilayer polymer microspot targets
International Nuclear Information System (INIS)
Last year the authors reported on the development of a seeded microspot x-ray diagnostic target. This target consisted of a 300-μm-diam, 2-μm-thick disk of silicon or sulfur-seeded hydrocarbon polymer nested tightly in a hole in a 2-μm-thick film of pure hydrocarbon polymer. This year they extended our work on the microspot target, fully encapsulating the microspot in what they call the multilayer polymer microspot target
Hybrid Neural Network Architecture for On-Line Learning
Chen, Yuhua; Wang, Lei
2008-01-01
Approaches to machine intelligence based on brain models have stressed the use of neural networks for generalization. Here we propose the use of a hybrid neural network architecture that uses two kind of neural networks simultaneously: (i) a surface learning agent that quickly adapt to new modes of operation; and, (ii) a deep learning agent that is very accurate within a specific regime of operation. The two networks of the hybrid architecture perform complementary functions that improve the overall performance. The performance of the hybrid architecture has been compared with that of back-propagation perceptrons and the CC and FC networks for chaotic time-series prediction, the CATS benchmark test, and smooth function approximation. It has been shown that the hybrid architecture provides a superior performance based on the RMS error criterion.
Shared Representation of SAR Target and Shadow Based on Multilayer Auto-encoder
Directory of Open Access Journals (Sweden)
Sun Zhi-jun
2013-06-01
Full Text Available Automatic Target Recognition (ATR of Synthetic Aperture Radar (SAR image is investigated. A SAR feature extraction algorithm based on multilayer auto-encoder is proposed. The method makes use of a probabilistic neural network, Restricted Boltzmann Machine (RBM modeling probability distribution of environment. Through the formation of more expressive multilayer neural network, the deep learning model learns shared representation of the target and its shadow outline reflecting the target shape characteristics. Targets are classified automatically through two recognition models. The experiment results based on the MSTAR verify the effectiveness of proposed algorithm.
Dawson, Michael R W; Dupuis, Brian; Spetch, Marcia L; Kelly, Debbie M
2009-08-01
The matching law (Herrnstein 1961) states that response rates become proportional to reinforcement rates; this is related to the empirical phenomenon called probability matching (Vulkan 2000). Here, we show that a simple artificial neural network generates responses consistent with probability matching. This behavior was then used to create an operant procedure for network learning. We use the multiarmed bandit (Gittins 1989), a classic problem of choice behavior, to illustrate that operant training balances exploiting the bandit arm expected to pay off most frequently with exploring other arms. Perceptrons provide a medium for relating results from neural networks, genetic algorithms, animal learning, contingency theory, reinforcement learning, and theories of choice. PMID:19596631
Directory of Open Access Journals (Sweden)
Teodorico Alves Sobrinho
2011-06-01
Full Text Available A estimativa da evapotranspiração por métodos indiretos propicia, de modo facilitado, a geração de dados para o planejamento de sistemas de irrigação e aplicação de modelos meteorológicos e hidrológicos, ambos, úteis na gestão de bacias hidrográficas. O objetivo deste trabalho foi elaborar uma Rede Neural Artificial (RNA para estimar a evapotranspiração de referência (Eto em função de dados diários de temperatura do ar. A RNA, do tipo FeedForward Multilayer Perceptron, foi treinada tomando-se por referência a Eto diária obtida pelo método de Penman-Monteith. Nas camadas intermediárias e de saída foram utilizadas funções de ativação do tipo tan-sigmóide e lineares, respectivamente. Os valores de Eto gerados pela RNA foram comparados com os obtidos pelos métodos de Blanney-Criddle e Hargreaves considerando meses referentes às quatro estações do ano. Em relação aos outros métodos analisados, os resultados obtidos a partir da RNA foram mais próximos ao método padrão Penman-Monteith. Assim, o desempenho da RNA desenvolvida foi satisfatório, podendo-se considerá-la como integrante do conjunto de métodos indiretos para estimativa da evapotranspiração, além de representar uma diminuição dos custos de aquisição de dados para estimativa desta variável.The estimation of evapotranspiration by indirect methods provides synthetic data for planning irrigation systems and application on meteorological and hydrological models, both useful in watershed management. The objective of this study was to develop an Artificial Neural Network (ANN to estimate the reference evapotranspiration (Eto based on daily air temperature data. The ANN model of Feedforward Multilayer Perceptron type, was trained using as a reference the daily Eto obtained by the Penman-Monteith method. In the intermediate and output layers were used activation functions like tan-sigmoid and linear, respectively. Eto values generated by ANN were
Bouyer, Charlène; Chen, Pu; Güven, Sinan; Demirtaş, Tuğrul Tolga; Nieland, Thomas J F; Padilla, Frédéric; Demirci, Utkan
2016-01-01
A bio-acoustic levitational assembly method for engineering of multilayered, 3D brainlike constructs is presented. Acoustic radiation forces are used to levitate neuroprogenitors derived from human embryonic stem cells in 3D multilayered fibrin tissue constructs. The neuro-progenitor cells are subsequently differentiated in neural cells, resulting in a 3D neuronal construct with inter and intralayer neurite elongations.
Bade, Richard; Bijlsma, Lubertus; Miller, Thomas H; Barron, Leon P; Sancho, Juan Vicente; Hernández, Felix
2015-12-15
The recent development of broad-scope high resolution mass spectrometry (HRMS) screening methods has resulted in a much improved capability for new compound identification in environmental samples. However, positive identifications at the ng/L concentration level rely on analytical reference standards for chromatographic retention time (tR) and mass spectral comparisons. Chromatographic tR prediction can play a role in increasing confidence in suspect screening efforts for new compounds in the environment, especially when standards are not available, but reliable methods are lacking. The current work focuses on the development of artificial neural networks (ANNs) for tR prediction in gradient reversed-phase liquid chromatography and applied along with HRMS data to suspect screening of wastewater and environmental surface water samples. Based on a compound tR dataset of >500 compounds, an optimized 4-layer back-propagation multi-layer perceptron model enabled predictions for 85% of all compounds to within 2min of their measured tR for training (n=344) and verification (n=100) datasets. To evaluate the ANN ability for generalization to new data, the model was further tested using 100 randomly selected compounds and revealed 95% prediction accuracy within the 2-minute elution interval. Given the increasing concern on the presence of drug metabolites and other transformation products (TPs) in the aquatic environment, the model was applied along with HRMS data for preliminary identification of pharmaceutically-related compounds in real samples. Examples of compounds where reference standards were subsequently acquired and later confirmed are also presented. To our knowledge, this work presents for the first time, the successful application of an accurate retention time predictor and HRMS data-mining using the largest number of compounds to preliminarily identify new or emerging contaminants in wastewater and surface waters.
Multilayer motif analysis of brain networks
Battiston, Federico; Chavez, Mario; Latora, Vito
2016-01-01
In the last decade network science has shed new light on the anatomical connectivity and on correlations in the activity of different areas of the human brain. The study of brain networks has made possible in fact to detect the central areas of a neural system, and to identify its building blocks by looking at overabundant small subgraphs, known as motifs. However, network analysis of the brain has so far mainly focused on structural and functional networks as separate entities. The recently developed mathematical framework of multi-layer networks allows to perform a multiplex analysis of the human brain where the structural and functional layers are considered at the same time. In this work we describe how to classify subgraphs in multiplex networks, and we extend motif analysis to networks with many layers. We then extract multi-layer motifs in brain networks of healthy subjects by considering networks with two layers, respectively obtained from diffusion and functional magnetic resonance imaging. Results i...
Energy Technology Data Exchange (ETDEWEB)
Montes, J.L.; Ortiz, J.J.; Perusquia C, R. [ININ, Carretera Mexico-Toluca s/n, 52750 La Marquesa, Ocoyoacac, Estado de Mexico (Mexico); Francois, J.L.; Martin del Campo M, C. [Departamento de Sistemas Energeticos, Facultad de Ingenieria, Universidad Nacional Autonoma de Mexico, Paseo Cuauhnahuac 8532, 62550 Jiutepec, Morelos (Mexico)]. e-mail: jlmt@nuclear.inin.mx
2007-07-01
To the beginning of a new operation cycle in a BWR reactor the reactivity of this it increases by means of the introduction of fresh fuel, the one denominated reload fuel. The problem of the definition of the characteristics of this reload fuel represents a combinatory optimization problem that requires significantly a great quantity of CPU time for their determination. This situation has motivated to study the possibility to substitute the Helios code, the one which is used to generate the new cells of the reload fuel parameters, by an artificial neuronal network, with the purpose of predicting the parameters of the fuel reload cell of a BWR reactor. In this work the results of the one training of a multilayer neuronal net that can predict the local power factor (LPPF) in such fuel cells are presented. The prediction of the LPPF is carried out in those condition of beginning of the life of the cell (0.0 MWD/T, to 40% of holes in the one moderator, temperature of 793 K in the fuel and a moderator temperature of 560 K. The cells considered in the present study consist of an arrangement of 10x10 bars, of those which 92 contains U{sup 235}, some of these bars also contain a concentration of Gd{sub 2}O{sub 3} and 8 of them contain only water. The axial location inside the one assembles of recharge of these cells it is exactly up of the cells that contain natural uranium in the base of the reactor core. The training of the neuronal net is carried out by means of a retro-propagation algorithm that uses a space of training formed starting from previous evaluations of cells by means of the Helios code. They are also presented the results of the application of the neuronal net found for the prediction of the LPPF of some cells used in the real operation of the Unit One of the Laguna Verde Nuclear Power station. (Author)
International Nuclear Information System (INIS)
We have developed a new multilayer a-tC material that is thick stress-free, adherent, low friction, and with hardness and stiffness near that of diamond. The new a-tC material is deposited by J pulsed-laser deposition (PLD) at room temperature, and fully stress-relieved by a short thermal anneal at 600 ampersand deg;C. A thick multilayer is built up by repeated deposition and annealing steps. We measured 88 GPa hardness, 1100 GPa Young's modulus, and 0.1 friction coefficient (under high load). Significantly, these results are all well within the range reported for crystalline diamond. In fact, this material, if considered separate from crystalline diamond, is the 2nd hardest material known to man. Stress-free a-tC also has important advantages over thin film diamond; namely, it is smooth, processed at lower temperature, and can be grown on a much broader range of substrates. This breakthrough will enable a host of applications that we are actively pursuing in MEMs, sensors, LIGA, etc
Dye, Scott A.
2015-01-01
New NASA vehicles, such as Earth Departure Stage (EDS), Orion, landers, and orbiting fuel depots, need improved cryogenic propellant transfer and storage for long-duration missions. Current cryogen feed line multilayer insulation (MLI) performance is 10 times worse per area than tank MLI insulation. During each launch, cryogenic piping loses approximately 150,000 gallons (equivalent to $300,000) in boil-off during transfer, chill down, and ground hold. Quest Product Development Corp., teaming with Ball Aerospace, developed an innovative advanced insulation system, Wrapped MLI (wMLI), to provide improved thermal insulation for cryogenic feed lines. wMLI is high-performance multilayer insulation designed for cryogenic piping. It uses Quest's innovative discrete-spacer technology to control layer spacing/ density and reduce heat leak. The Phase I project successfully designed, built, and tested a wMLI prototype with a measured heat leak 3.6X lower than spiral-wrapped conventional MLI widely used for piping insulation. A wMLI prototype had a heat leak of 7.3 W/m2, or 27 percent of the heat leak of conventional MLI (26.7 W/m2). The Phase II project is further developing wMLI technology with custom, molded polymer spacers and advancing the product toward commercialization via a rigorous testing program, including developing advanced vacuuminsulated pipe for ground support equipment.
Energy Technology Data Exchange (ETDEWEB)
Chrzan, D.C.; Dugger, M.; Follstaedt, D.M.; Friedman, Lawrence H.; Friedmann, T.A.; Knapp, J.A.; McCarty, K.F.; Medlin, D.L.; Mirkarimi, P.B.; Missert, N.; Newcomer, P.P.; Sullivan, J.P.; Tallant, D.R.
1999-05-01
We have developed a new multilayer a-tC material that is thick stress-free, adherent, low friction, and with hardness and stiffness near that of diamond. The new a-tC material is deposited by J pulsed-laser deposition (PLD) at room temperature, and fully stress-relieved by a short thermal anneal at 600°C. A thick multilayer is built up by repeated deposition and annealing steps. We measured 88 GPa hardness, 1100 GPa Young's modulus, and 0.1 friction coefficient (under high load). Significantly, these results are all well within the range reported for crystalline diamond. In fact, this material, if considered separate from crystalline diamond, is the 2nd hardest material known to man. Stress-free a-tC also has important advantages over thin film diamond; namely, it is smooth, processed at lower temperature, and can be grown on a much broader range of substrates. This breakthrough will enable a host of applications that we are actively pursuing in MEMs, sensors, LIGA, etc.
Energy Technology Data Exchange (ETDEWEB)
Hood, R.Q.
1994-04-01
Utilizing self-consistent Hartree-Fock calculations, several aspects of multilayers and interfaces are explored: enhancement and reduction of the local magnetic moments, magnetic coupling at the interfaces, magnetic arrangements within each film and among non-neighboring films, global symmetry of the systems, frustration, orientation of the various moments with respect to an outside applied field, and magnetic-field induced transitions. Magnetoresistance of ferromagnetic-normal-metal multilayers is found by solving the Boltzmann equation. Results explain the giant negative magnetoresistance encountered in these systems when an initial antiparallel arrangement is changed into a parallel configuration by an external magnetic field. The calculation depends on (1) geometric parameters (thicknesses of layers), (2) intrinsic metal parameters (number of conduction electrons, magnetization, and effective masses in layers), (3) bulk sample properties (conductivity relaxation times), (4) interface scattering properties (diffuse scattering versus potential scattering at the interfaces, and (5) outer surface scattering properties (specular versus diffuse surface scattering). It is found that a large negative magnetoresistance requires considerable asymmetry in interface scattering for the two spin orientations. Features of the interfaces that may produce an asymmetrical spin-dependent scattering are studied: varying interfacial geometric random roughness with no lateral coherence, correlated (quasi-periodic) roughness, and varying chemical composition of the interfaces. The interplay between these aspects of the interfaces may enhance or suppress the magnetoresistance, depending on whether it increases or decreases the asymmetry in the spin-dependent scattering of the conduction electrons.
Classification of radar clutter using neural networks.
Haykin, S; Deng, C
1991-01-01
A classifier that incorporates both preprocessing and postprocessing procedures as well as a multilayer feedforward network (based on the back-propagation algorithm) in its design to distinguish between several major classes of radar returns including weather, birds, and aircraft is described. The classifier achieves an average classification accuracy of 89% on generalization for data collected during a single scan of the radar antenna. The procedures of feature selection for neural network training, the classifier design considerations, the learning algorithm development, the implementation, and the experimental results of the neural clutter classifier, which is simulated on a Warp systolic computer, are discussed. A comparative evaluation of the multilayer neural network with a traditional Bayes classifier is presented.
Modeling of the height control system using artificial neural networks
Directory of Open Access Journals (Sweden)
A. R Tahavvor
2016-09-01
action. The mechanical parts were computer-generated by engineering software in assembled, exploded and standard two-dimensional drawing required for the manufacturing process. Carrier and framework of control unit and actuator mainly designed to have the capability to support and hold the hardware and sensor assembly in an easy mountable fashion. This arrangement performed feasibility of the movement and allocating of control unit along the travel length of belt above the conveyor unit. In this work a multilayer perceptron network with different training algorithm was used and it is found that the backpropagation algorithm with Levenberge-Marquardt learning rule was the best choice for this analysis because of the accurate and faster training procedure. The Levenberg-Marquardt algorithm was an iterative technique that locates the minimum of a multivariate function that was expressed as the sum of squares of nonlinear real-valued functions. It has become a standard technique for non-linear least-squares problems, widely adopted in a broad spectrum of disciplines. LM can be thought of as a combination of steepest descent and the Gauss-Newton method. When the current solution was far from the correct one, the algorithm behaves like a steepest descent method: slow, but guaranteed to converge. When the current solution is close to the correct solution, it becomes a Gauss-Newton method. The Levenberg algorithm is: 1. Do an update as directed by the rule above. 2. Evaluate the error at the new parameter vector. 3. If the error has increased as a result the update, then retract the step (i.e. reset the weights to their previous values and increase l by a factor of 10 or some such significant factor, then goes to (1 and try an update again. 4. If the error has decreased as a result of the update, then accept the step (i.e. keep the weights at their new values and decrease l by a factor of 10 or so. Results and Discussion The study of multi artificial neural network learning
Multilayer graphene condenser microphone
Todorović, Dejan; Matković, Aleksandar; Milićević, Marijana; Jovanović, Djordje; Gajić, Radoš; Salom, Iva; Spasenović, Marko
2015-12-01
Vibrating membranes are the cornerstone of acoustic technology, forming the backbone of modern loudspeakers and microphones. Acoustic performance of a condenser microphone is derived mainly from the membrane’s size, surface mass and achievable static tension. The widely studied and available nickel has been a dominant membrane material for professional microphones for several decades. In this paper we introduce multilayer graphene as a membrane material for condenser microphones. The graphene device outperforms a high end commercial nickel-based microphone over a significant part of the audio spectrum, with a larger than 10 dB enhancement of sensitivity. Our experimental results are supported with numerical simulations, which also show that a 300 layer thick graphene membrane under maximum tension would offer excellent extension of the frequency range, up to 1 MHz.
Directory of Open Access Journals (Sweden)
J. Szajnar
2010-01-01
Full Text Available In paper is presented the possibility of making of multi-layers cast steel castings in result of connection of casting and welding coating technologies. First layer was composite surface layer on the basis of Fe-Cr-C alloy, which was put directly in founding process of cast carbon steel 200–450 with use of preparation of mould cavity method. Second layer were padding welds, which were put with use of TIG – Tungsten Inert Gas surfacing by welding technology with filler on Ni matrix, Ni and Co matrix with wolfram carbides WC and on the basis on Fe-Cr-C alloy, which has the same chemical composition with alloy, which was used for making of composite surface layer. Usability for industrial applications of surface layers of castings were estimated by criterion of hardness and abrasive wear resistance of type metal-mineral.
Multilayer Multidimensional Extension Set Theory
Institute of Scientific and Technical Information of China (English)
CAO Shao-zhong; YANG Guo-wei; TU Xu-yan
2006-01-01
In order to study the contradiction problem of multilayer multidimensional complex systems, the concepts of extension field and stable field of intersection and union of multilayer multidimensional extension set are given. Then the related operations and properties are discussed. The results of study expand the concepts of intersection and union of extension set to a general situation, and provide the theoretical basis for production of the concepts of intersection and union of multilayer multidimensional matter element system extension set. In this way, it will be possible that matter element system theory is used to creative designs of complex systems.
Integrated Multilayer Insulation
Dye, Scott
2009-01-01
Integrated multilayer insulation (IMLI) is being developed as an improved alternative to conventional multilayer insulation (MLI), which is more than 50 years old. A typical conventional MLI blanket comprises between 10 and 120 metallized polymer films separated by polyester nets. MLI is the best thermal- insulation material for use in a vacuum, and is the insulation material of choice for spacecraft and cryogenic systems. However, conventional MLI has several disadvantages: It is difficult or impossible to maintain the desired value of gap distance between the film layers (and consequently, it is difficult or impossible to ensure consistent performance), and fabrication and installation are labor-intensive and difficult. The development of IMLI is intended to overcome these disadvantages to some extent and to offer some additional advantages over conventional MLI. The main difference between IMLI and conventional MLI lies in the method of maintaining the gaps between the film layers. In IMLI, the film layers are separated by what its developers call a micro-molded discrete matrix, which can be loosely characterized as consisting of arrays of highly engineered, small, lightweight, polymer (typically, thermoplastic) frames attached to, and placed between, the film layers. The term "micro-molded" refers to both the smallness of the frames and the fact that they are fabricated in a process that forms precise small features, described below, that are essential to attainment of the desired properties. The term "discrete" refers to the nature of the matrix as consisting of separate frames, in contradistinction to a unitary frame spanning entire volume of an insulation blanket.
Neural networks approach v/s Algorithmic approach : A study through pattern recognition
Directory of Open Access Journals (Sweden)
Namrata Aneja
2011-12-01
Full Text Available There is a great scope of expansion in the field of Neural Network, as it can be viewed as massivelyparallel computing systems consisting of an extremely large number of simple processors with manyinterconnections. NN models attempt to use some organizational principles in a weighted directedgraphs in which nodes are artificial neurons and directed edges are connections between neuron outputsand neuron inputs. The main characteristic of neural network is that they have the ability to learncomplex non- linear input output relationships. A single artificial neuron is a simulation of a neuron(basic human brain cell and scientists have tried to emulate the neuron in a form of artificial neuroncalled perceptron. Pattern recognition is one of the areas where the neural approach has beensuccessfully tried. This study is concerned to see the journey of pattern recognition from algorithmicapproach to neural network approach.
A Neural Network Approach for Misuse and Anomaly Intrusion Detection
Institute of Scientific and Technical Information of China (English)
YAO Yu; YU Ge; GAO Fu-xiang
2005-01-01
An MLP(Multi-Layer Perceptron)/Elman neural network is proposed in this paper, which realizes classification with memory of past events using the real-time classification of MLP and the memorial functionality of Elman. The system's sensitivity for the memory of past events can be easily reconfigured without retraining the whole network. This approach can be used for both misuse and anomaly detection system. The intrusion detection systems(IDSs) using the hybrid MLP/Elman neural network are evaluated by the intrusion detection evaluation data sponsored by U. S. Defense Advanced Research Projects Agency (DARPA). The results of experiment are presented in Receiver Operating Characteristic (ROC) curves. The capabilites of these IDSs to identify Deny of Service(DOS) and probing attacks are enhanced.
A Neural Network Model for Prediction of Sound Quality
DEFF Research Database (Denmark)
Nielsen,, Lars Bramsløw
An artificial neural network structure has been specified, implemented and optimized for the purpose of predicting the perceived sound quality for normal-hearing and hearing-impaired subjects. The network was implemented by means of commercially available software and optimized to predict results...... error on the test set. The overall concept proved functional, but further testing with data obtained from a new rating experiment is necessary to better assess the utility of this measure. The weights in the trained neural networks were analyzed to qualitatively interpret the relation between...... obtained in subjective sound quality rating experiments based on input data from an auditory model. Various types of input data and data representations from the auditory model were used as input data for the chosen network structure, which was a three-layer perceptron. This network was trained by means...
Multilayered Magnetic Gelatin Membrane Scaffolds
Samal, Sangram K.; Goranov, Vitaly; Dash, Mamoni; Russo, Alessandro; Shelyakova, Tatiana; Graziosi, Patrizio; Lungaro, Lisa; Riminucci, Alberto; Uhlarz, Marc; Bañobre-López, Manuel; Rivas, Jose; Herrmannsdörfer, Thomas; Rajadas, Jayakumar; De Smedt, Stefaan; Braeckmans, Kevin; Kaplan, David L.; Dediu, V. Alek
2016-01-01
A versatile approach for the design and fabrication of multilayer magnetic scaffolds with tunable magnetic gradients is described. Multilayer magnetic gelatin membrane scaffolds with intrinsic magnetic gradients were designed to encapsulate magnetized bioagents under an externally applied magnetic field for use in magnetic-field-assisted tissue engineering. The temperature of the individual membranes increased up to 43.7 °C under an applied oscillating magnetic field for 70 s by magnetic hyperthermia, enabling the possibility of inducing a thermal gradient inside the final 3D multilayer magnetic scaffolds. On the basis of finite element method simulations, magnetic gelatin membranes with different concentrations of magnetic nanoparticles were assembled into 3D multilayered scaffolds. A magnetic-gradient-controlled distribution of magnetically labeled stem cells was demonstrated in vitro. This magnetic biomaterial–magnetic cell strategy can be expanded to a number of different magnetic biomaterials for various tissue engineering applications. PMID:26451743
Neural network simulation of soil NO3 dynamic under potato crop system
Goulet-Fortin, Jérôme; Morais, Anne; Anctil, François; Parent, Léon-Étienne; Bolinder, Martin
2013-04-01
Nitrate leaching is a major issue in sandy soils intensively cropped to potato. Modelling could test and improve management practices, particularly as regard to the optimal N application rates. Lack of input data is an important barrier for the application of classical process-based models to predict soil NO3 content (SNOC) and NO3 leaching (NOL). Alternatively, data driven models such as neural networks (NN) could better take into account indicators of spatial soil heterogeneity and plant growth pattern such as the leaf area index (LAI), hence reducing the amount of soil information required. The first objective of this study was to evaluate NN and hybrid models to simulate SNOC in the 0-40 cm soil layer considering inter-annual variations, spatial soil heterogeneity and differential N application rates. The second objective was to evaluate the same methodology to simulate seasonal NOL dynamic at 1 m deep. To this aim, multilayer perceptrons with different combinations of driving meteorological variables, functions of the LAI and state variables of external deterministic models have been trained and evaluated. The state variables from external models were: drainage estimated by the CLASS model and the soil temperature estimated by an ICBM subroutine. Results of SNOC simulations were compared to field data collected between 2004 and 2011 at several experimental plots under potato cropping systems in Québec, Eastern Canada. Results of NOL simulation were compared to data obtained in 2012 from 11 suction lysimeters installed in 2 experimental plots under potato cropping systems in the same region. The most performing model for SNOC simulation was obtained using a 4-input hybrid model composed of 1) cumulative LAI, 2) cumulative drainage, 3) soil temperature and 4) day of year. The most performing model for NOL simulation was obtained using a 5-input NN model composed of 1) N fertilization rate at spring, 2) LAI, 3) cumulative rainfall, 4) the day of year and 5) the
Optical transmittance of multilayer graphene
Zhu, Shou-En; Yuan, Shengjun; Janssen, G. C. A. M.
2014-01-01
We study the optical transmittance of multilayer graphene films up to 65 layers thick. By combing large-scale tight-binding simulation and optical measurement on CVD multilayer graphene, the optical transmission through graphene films in the visible region is found to be solely determined by the number of graphene layers. We argue that the optical transmittance measurement is more reliable in the determination of the number of layers than the commonly used Raman Spectroscopy. Moreover, optica...
Directory of Open Access Journals (Sweden)
Mayra Luiza Marques da Silva
2009-12-01
Full Text Available Objetivou-se, neste trabalho, avaliar o ajuste do modelo volumétrico de Schumacher e Hall por diferentes algoritmos, bem como a aplicação de redes neurais artificiais para estimação do volume de madeira de eucalipto em função do diâmetro a 1,30 m do solo (DAP, da altura total (Ht e do clone. Foram utilizadas 21 cubagens de povoamentos de clones de eucalipto com DAP variando de 4,5 a 28,3 cm e altura total de 6,6 a 33,8 m, num total de 862 árvores. O modelo volumétrico de Schumacher e Hall foi ajustado nas formas linear e não linear, com os seguintes algoritmos: Gauss-Newton, Quasi-Newton, Levenberg-Marquardt, Simplex, Hooke-Jeeves Pattern, Rosenbrock Pattern, Simplex, Hooke-Jeeves e Rosenbrock, utilizado simultaneamente com o método Quasi-Newton e com o princípio da Máxima Verossimilhança. Diferentes arquiteturas e modelos (Multilayer Perceptron MLP e Radial Basis Function RBF de redes neurais artificiais foram testados, sendo selecionadas as redes que melhor representaram os dados. As estimativas dos volumes foram avaliadas por gráficos de volume estimado em função do volume observado e pelo teste estatístico L&O. Assim, conclui-se que o ajuste do modelo de Schumacher e Hall pode ser usado na sua forma linear, com boa representatividade e sem apresentar tendenciosidade; os algoritmos Gauss-Newton, Quasi-Newton e Levenberg-Marquardt mostraram-se eficientes para o ajuste do modelo volumétrico de Schumacher e Hall, e as redes neurais artificiais apresentaram boa adequação ao problema, sendo elas altamente recomendadas para realizar prognose da produção de florestas plantadas.This research aimed at evaluating the adjustment of Schumacher and Hall volumetric model by different algorithms and the application of artificial neural networks to estimate the volume of wood of eucalyptus according to the diameter at breast height (DBH, total height (Ht of the clone. For such, 21 scalings of stands of eucalyptus clones were used with
Directory of Open Access Journals (Sweden)
Carlos Cassiano Denipotti Veronezi
2011-04-01
Full Text Available OBJETIVOS: Conhecer as vantagens da utilização das redes neurais artificiais no reconhecimento de padrões em radiografias de coluna lombar na incidência perfil para auxiliar no diagnóstico da osteoartrite primária. MÉTODO: Estudo transversal, descritivo, analítico, de abordagem quantitativa e com ênfase diagnóstica. O conjunto de treinamento foi composto por imagens coletadas no período de janeiro a julho de 2009 de pacientes submetidos a radiografias digitais de coluna lombar na incidência em perfil provenientes de um serviço de radiologia localizado no município de Criciúma (SC. Das 260 imagens coletadas, foram excluídas: as radiografias distorcidas, as patologias que alteram a arquitetura da coluna lombar e os padrões de difícil caracterização, resultando em um total de 206 imagens. O banco de imagens (n = 206 foi subdividido, resultando em 68 radiografias para a etapa de treinamento, 68 para testes e 70 para validação. Foi utilizada uma rede neural híbrida baseada em mapas auto-organizáveis de Kohonen e redes Multilayer Perceptron. RESULTADOS: Após 90 ciclos, foi realizada a validação com o melhor teste, alcançando acurácia de 62,85%, sensibilidade de 65,71% e especificidade de 60%. CONCLUSÃO: Apesar da demonstração de uma eficácia mediana, por se tratar de estudo de caráter inovador, seus valores mostram um futuro promissor da técnica utilizada, com sugestão para trabalhos futuros com abrangência na metodologia de processamento das imagens e ciclos com uma quantidade maior de radiografias.OBJECTIVE: To ascertain the advantages of applying artificial neural networks to recognize patterns on lumbar column radiographs in order to aid in the process of diagnosing primary osteoarthritis. METHODS: This was a cross-sectional descriptive analytical study with a quantitative approach and an emphasis on diagnosis. The training set was composed of images collected between January and July 2009 from patients who had
Energy Technology Data Exchange (ETDEWEB)
Pilato, V
1999-07-01
The possibility of improving by neuronal techniques the preparation and interpretation of nuclear measurements was investigated. A general methodology was developed and applied to various problems in this field. Whatever the problem to be treated, to solve it comes to determine the relation which binds the inputs to the outputs. Neural networks based on supervised training, like the multilayer Perceptron, have the capability to calculate any relation between a set of input and output data. On the other hand, the training phase is often a long and delicate operation whose difficulties grow with the size of the network:it is thus interesting to reduce it by introducing knowledge a priori and/or by reducing the number of inputs in order to extract the relevant information. If the correlations between the inputs are linear, the Principal Components Analysis (PCA) and its neuronal equivalents make it possible to obtain by orthogonal projection a reduced number of input components while preserving the maximum of initial information. If the correlations are nonlinear, the Curvilinear Components Analysis (CCA) allows, by a unsupervised training, to carry out a nonlinear projection of the inputs in a space of reduced size. Besides, it is noticed that when the dimension of the input space is equal to the intrinsic dimension of the problem, this last is practically solved by CCA. We propose a general method which consists in characterizing as well as possible the problem by its inputs and then to extract and classify the information contained in those by projection in a space of reduced size. Association between the projected data and the problem outputs is then carried out by a supervised training network. Certain results having to be provided with their associated uncertainty, a statistical method based on the bootstrap algorithm is proposed. Potential applications other that those treated are considered. (author)
Neural Network Inverse Adaptive Controller Based on Davidon Least Square
Institute of Scientific and Technical Information of China (English)
无
2000-01-01
General neural network inverse adaptive controller haa two flaws: the first is the slow convergence speed; the second is the invalidation to the non-minimum phase system.These defects limit the scope in which the neural network inverse adaptive controller is used.We employ Davidon least squares in training the multi-layer feedforward neural network used in approximating the inverse model of plant to expedite the convergence,and then through constructing the pseudo-plant,a neural network inverse adaptive controller is put forward which is still effective to the nonlinear non-minimum phase system.The simulation results show the validity of this scheme.
Multilayer optical calculations
Byrnes, Steven J
2016-01-01
When light hits a multilayer planar stack, it is reflected, refracted, and absorbed in a way that can be derived from the Fresnel equations. The analysis is treated in many textbooks, and implemented in many software programs, but certain aspects of it are difficult to find explicitly and consistently worked out in the literature. Here, we derive the formulas underlying the transfer-matrix method of calculating the optical properties of these stacks, including oblique-angle incidence, absorption-vs-position profiles, and ellipsometry parameters. We discuss and explain some strange consequences of the formulas in the situation where the incident and/or final (semi-infinite) medium are absorptive, such as calculating $T>1$ in the absence of gain. We also discuss some implementation details like complex-plane branch cuts. Finally, we derive modified formulas for including one or more "incoherent" layers, i.e. very thick layers in which interference can be neglected. This document was written in conjunction with ...
Razavi, S.; Tolson, B.; Burn, D.; Seglenieks, F.
2012-04-01
Reformulated Neural Network (ReNN) has been recently developed as an efficient and more effective alternative to feedforward multi-layer perceptron (MLP) neural networks [Razavi, S., and Tolson, B. A. (2011). "A new formulation for feedforward neural networks." IEEE Transactions on Neural Networks, 22(10), 1588-1598, DOI: 1510.1109/TNN.2011.2163169]. This presentation initially aims to introduce the ReNN to the water resources community and then demonstrates ReNN applications to water resources related problems. ReNN is essentially equivalent to a single-hidden-layer MLP neural network but defined on a new set of network variables which is more effective than the traditional set of network weights and biases. The main features of the new network variables are that they are geometrically interpretable and each variable has a distinct role in forming the network response. ReNN is more efficiently trained as it has a less complex error response surface. In addition to the ReNN training efficiency, the interpretability of the ReNN variables enables the users to monitor and understand the internal behaviour of the network while training. Regularization in the ReNN response can be also directly measured and controlled. This feature improves the generalization ability of the network. The appeal of the ReNN is demonstrated with two ReNN applications to water resources engineering problems. In the first application, the ReNN is used to model the rainfall-runoff relationships in multiple watersheds in the Great Lakes basin located in northeastern North America. Modelling inflows to the Great Lakes are of great importance to the management of the Great Lakes system. Due to the lack of some detailed physical data about existing control structures in many subwatersheds of this huge basin, the data-driven approach to modelling such as the ReNN are required to replace predictions from a physically-based rainfall runoff model. Unlike traditional MLPs, the ReNN does not necessarily
From neural-based object recognition toward microelectronic eyes
Sheu, Bing J.; Bang, Sa Hyun
1994-01-01
Engineering neural network systems are best known for their abilities to adapt to the changing characteristics of the surrounding environment by adjusting system parameter values during the learning process. Rapid advances in analog current-mode design techniques have made possible the implementation of major neural network functions in custom VLSI chips. An electrically programmable analog synapse cell with large dynamic range can be realized in a compact silicon area. New designs of the synapse cells, neurons, and analog processor are presented. A synapse cell based on Gilbert multiplier structure can perform the linear multiplication for back-propagation networks. A double differential-pair synapse cell can perform the Gaussian function for radial-basis network. The synapse cells can be biased in the strong inversion region for high-speed operation or biased in the subthreshold region for low-power operation. The voltage gain of the sigmoid-function neurons is externally adjustable which greatly facilitates the search of optimal solutions in certain networks. Various building blocks can be intelligently connected to form useful industrial applications. Efficient data communication is a key system-level design issue for large-scale networks. We also present analog neural processors based on perceptron architecture and Hopfield network for communication applications. Biologically inspired neural networks have played an important role towards the creation of powerful intelligent machines. Accuracy, limitations, and prospects of analog current-mode design of the biologically inspired vision processing chips and cellular neural network chips are key design issues.
Transient Stability Assessment of a Power System Using Probabilistic Neural Network
Directory of Open Access Journals (Sweden)
Noor I.A. Wahab
2008-01-01
Full Text Available This study presents transient stability assessment of electrical power system using Probabilistic Neural Network (PNN and principle component analysis. Transient stability of a power system is first determined based on the generator relative rotor angles obtained from time domain simulation outputs. Simulations were carried out on the IEEE 9-bus test system considering three phase faults on the system. The data collected from the time domain simulations are then used as inputs to the PNN in which PNN is used as a classifier to determine whether the power system is stable or unstable. Principle component analysis is applied to extract useful input features to the PNN so that training time of the PNN can be reduced. To verify the effectiveness of the proposed PNN method, it is compared with the multi layer perceptron neural network. Results show that the PNN gives faster and more accurate transient stability assessment compared to the multi layer perceptron neural network in terms of classification results.
Jet analysis by neural networks in high energy hadron-hadron collisions
De Felice, P; Pasquariello, G; De Felice, P; Nardulli, G; Pasquariello, G
1995-01-01
We study the possibility to employ neural networks to simulate jet clustering procedures in high energy hadron-hadron collisions. We concentrate our analysis on the Fermilab Tevatron energy and on the k_\\bot algorithm. We consider both supervised multilayer feed-forward network trained by the backpropagation algorithm and unsupervised learning, where the neural network autonomously organizes the events in clusters.
Multilayer monochromators for neutron scattering
International Nuclear Information System (INIS)
In an earlier paper Schoenborn, Caspar, and Kammerer (J. Appl. Cryst. 7, 508-10(1974)) reported the fabrication of thin film monochromators for neutrons. They showed that a multilayer consisting of alternating films of two materials acts as a good monochromator with large and adjustable periodicity and wide bandwidth. The diffraction properties of these multilayers have been studied with the objective of using them as monochromators, filters and polarizers for neutrons. A theoretical understanding of these multilayers has been developed by using the kinematical and dynamical approaches. In order to compare these expressions with the observed properties, the effects of beam divergence and wavelength distribution for the spectrometer have been determined. The influence of some aperiodicity on the diffraction data has also been studied within the framework of kinematical theory. (auth)
Directory of Open Access Journals (Sweden)
Juan D Velásquez
2008-12-01
Full Text Available Una red neuronal autorregresiva es estimada para el precio mensual brasileño de corto plazo de la electricidad, la cual describe mejor la dinámica de los precios que un modelo lineal autorregresivo y que un perceptrón multicapa clásico que usan las mismas entradas y neuronas en la capa oculta. El modelo propuesto es especificado usando un procedimiento estadístico basado en el contraste del radio de verosimilitud. El modelo pasa una batería de pruebas de diagnóstico. El procedimiento de especificación propuesto permite seleccionar el número de unidades en la capa oculta y las entradas a la red neuronal, usando pruebas estadísticas que tienen en cuenta la cantidad de los datos y el ajuste del modelo a la serie de precios. La especificación del modelo final demuestra que el precio para el próximo mes es una función no lineal del precio actual, de la energía afluente actual y de la energía almacenada en el embalse equivalente en el mes actual y dos meses atrás.An autoregressive neural network model is estimated for the monthly Brazilian electricity spot price, which describes the prices dynamics better than a linear autoregressive model and a classical multilayer perceptron using the same input and neurons in the hidden layer. The proposed model is specified using a statistical procedure based on a likelihood ratio test. The model passes a battery of diagnostic tests. The proposed specification procedure allows us to select the number of units in hidden layer and the inputs to the neural network based on statistical tests, taking into account the number of data and the model fitting to the price time series. The final model specification demonstrates that the price for the next month is a nonlinear function of the current price, the current energy inflow, and the energy saved in the equivalent reservoir in the current month and two months ago.
AUTOMATED DEFECT CLASSIFICATION USING AN ARTIFICIAL NEURAL NETWORK
International Nuclear Information System (INIS)
The automated defect classification algorithm based on artificial neural network with multilayer backpropagation structure was utilized. The selected features of flaws were used as input data. In order to train the neural network it is necessary to prepare learning data which is representative database of defects. Database preparation requires the following steps: image acquisition and pre-processing, image enhancement, defect detection and feature extraction. The real digital radiographs of welded parts of a ship were used for this purpose.
Mobility Prediction in Wireless Ad Hoc Networks using Neural Networks
Kaaniche, Heni
2010-01-01
Mobility prediction allows estimating the stability of paths in a mobile wireless Ad Hoc networks. Identifying stable paths helps to improve routing by reducing the overhead and the number of connection interruptions. In this paper, we introduce a neural network based method for mobility prediction in Ad Hoc networks. This method consists of a multi-layer and recurrent neural network using back propagation through time algorithm for training.
Loss-efficiency model of single and variable-speed compressors using neural networks
Energy Technology Data Exchange (ETDEWEB)
Yang, Liang [Institute of Refrigeration and Cryogenics, Shanghai Jiaotong University, Shanghai 200240 (China); China R and D Center, Carrier Corporation, No.3239 Shen Jiang Road, Shanghai 201206 (China); Zhao, Ling-Xiao; Gu, Bo [Institute of Refrigeration and Cryogenics, Shanghai Jiaotong University, Shanghai 200240 (China); Zhang, Chun-Lu [China R and D Center, Carrier Corporation, No.3239 Shen Jiang Road, Shanghai 201206 (China)
2009-09-15
Compressor is the critical component to the performance of a vapor-compression refrigeration system. The loss-efficiency model including the volumetric efficiency and the isentropic efficiency is widely used for representing the compressor performance. A neural network loss-efficiency model is developed to simulate the performance of positive displacement compressors like the reciprocating, screw and scroll compressors. With one more input, frequency, it can be easily extended to the variable speed compressors. The three-layer polynomial perceptron network is developed because the polynomial transfer function is found very effective in training and free of over-learning. The selection of input parameters of neural networks is also found critical to the network prediction accuracy. The proposed neural networks give less than 0.4% standard deviations and {+-}1.3% maximum deviations against the manufacturer data. (author)
The Use of Artificial Neural Networks to Assess the Capacity of Transport Measures
Directory of Open Access Journals (Sweden)
Duchaczek Artur
2015-06-01
Full Text Available In the area of logistics management both managers and engineers rely primarily on proven computational algorithms, for this reason, it is often difficult to convince them to the use of artificial neural networks in solving decision problems. The paper presents the possibilities of using the FANN library in building of a computer application applied in the area of logistics. The possibilities of the component are presented on the example of applications of artificial neural networks to estimate the capacity of transport vehicles based on their dimensions. The example presented in the work was solved with the use of a multi-network Layered Perceptron. The example depicted not only the possibility of using artificial neural networks for solving poorly structured tasks but also practical application of the TFannNetwork component
Butterfly Classification by HSI and RGB Color Models Using Neural Networks
Directory of Open Access Journals (Sweden)
Jorge E. Grajales-Múnera
2013-11-01
Full Text Available This study aims the classification of Butterfly species through the implementation of Neural Networks and Image Processing. A total of 9 species of Morpho genre which has blue as a characteristic color are processed. For Butterfly segmentation we used image processing tools such as: Binarization, edge processing and mathematical morphology. For data processing RGB values are obtained for every image which are converted to HSI color model to identify blue pixels and obtain the data to the proposed Neural Networks: Back-Propagation and Perceptron. For analysis and verification of results confusion matrix are built and analyzed with the results of neural networks with the lowest error levels. We obtain error levels close to 1% in classification of some Butterfly species.
Modeling and prediction of Turkey's electricity consumption using Artificial Neural Networks
Energy Technology Data Exchange (ETDEWEB)
Kavaklioglu, Kadir; Ozturk, Harun Kemal; Canyurt, Olcay Ersel [Pamukkale University, Mechanical Engineering Department, Denizli (Turkey); Ceylan, Halim [Pamukkale University, Civil Engineering Department, Denizli (Turkey)
2009-11-15
Artificial Neural Networks are proposed to model and predict electricity consumption of Turkey. Multi layer perceptron with backpropagation training algorithm is used as the neural network topology. Tangent-sigmoid and pure-linear transfer functions are selected in the hidden and output layer processing elements, respectively. These input-output network models are a result of relationships that exist among electricity consumption and several other socioeconomic variables. Electricity consumption is modeled as a function of economic indicators such as population, gross national product, imports and exports. It is also modeled using export-import ratio and time input only. Performance comparison among different models is made based on absolute and percentage mean square error. Electricity consumption of Turkey is predicted until 2027 using data from 1975 to 2006 along with other economic indicators. The results show that electricity consumption can be modeled using Artificial Neural Networks, and the models can be used to predict future electricity consumption. (author)
Directory of Open Access Journals (Sweden)
Małgorzata Pawul
2016-09-01
Full Text Available Recently, a lot of attention was paid to the improvement of methods which are used to air quality forecasting. Artificial neural networks can be applied to model these problems. Their advantage is that they can solve the problem in the conditions of incomplete information, without the knowledge of the analytical relationship between the input and output data. In this paper we applied artificial neural networks to predict the PM 10 concentrations as factors determining the occurrence of smog phenomena. To create these networks we used meteorological data and concentrations of PM 10. The data were recorded in 2014 and 2015 at three measuring stations operating in Krakow under the State Environmental Monitoring. The best results were obtained by three-layer perceptron with back-propagation algorithm. The neural networks received a good fit in all cases.
Fuzzy neural network with fast backpropagation learning
Wang, Zhiling; De Sario, Marco; Guerriero, Andrea; Mugnuolo, Raffaele
1995-03-01
Neural filters with multilayer backpropagation network have been proved to be able to define mostly all linear or non-linear filters. Because of the slowness of the networks' convergency, however, the applicable fields have been limited. In this paper, fuzzy logic is introduced to adjust learning rate and momentum parameter depending upon output errors and training times. This makes the convergency of the network greatly improved. Test curves are shown to prove the fast filters' performance.
Fastest learning in small world neural networks
Simard, D.; Nadeau, L; Kröger, H.
2004-01-01
We investigate supervised learning in neural networks. We consider a multi-layered feed-forward network with back propagation. We find that the network of small-world connectivity reduces the learning error and learning time when compared to the networks of regular or random connectivity. Our study has potential applications in the domain of data-mining, image processing, speech recognition, and pattern recognition.
Multilingual Text Detection with Nonlinear Neural Network
Lin Li; Shengsheng Yu; Luo Zhong; Xiaozhen Li
2015-01-01
Multilingual text detection in natural scenes is still a challenging task in computer vision. In this paper, we apply an unsupervised learning algorithm to learn language-independent stroke feature and combine unsupervised stroke feature learning and automatically multilayer feature extraction to improve the representational power of text feature. We also develop a novel nonlinear network based on traditional Convolutional Neural Network that is able to detect multilingual text regions in th...
Context dependent learning in neural networks
Spreeuwers, L.J.; Zwaag, van der, Berend Jan; Heijden, van der, M.
1995-01-01
In this paper an extension to the standard error backpropagation learning rule for multi-layer feed forward neural networks is proposed, that enables them to be trained for context dependent information. The context dependent learning is realised by using a different error function (called Average Risk: AVR) in stead of the sum of squared errors (SQE) normally used in error backpropagation and by adapting the update rules. It is shown that for applications where this context dependent informa...
Permutation parity machines for neural cryptography
International Nuclear Information System (INIS)
Recently, synchronization was proved for permutation parity machines, multilayer feed-forward neural networks proposed as a binary variant of the tree parity machines. This ability was already used in the case of tree parity machines to introduce a key-exchange protocol. In this paper, a protocol based on permutation parity machines is proposed and its performance against common attacks (simple, geometric, majority and genetic) is studied.
Permutation parity machines for neural cryptography.
Reyes, Oscar Mauricio; Zimmermann, Karl-Heinz
2010-06-01
Recently, synchronization was proved for permutation parity machines, multilayer feed-forward neural networks proposed as a binary variant of the tree parity machines. This ability was already used in the case of tree parity machines to introduce a key-exchange protocol. In this paper, a protocol based on permutation parity machines is proposed and its performance against common attacks (simple, geometric, majority and genetic) is studied.
APPROACH TO FAULT ON-LINE DETECTION AND DIAGNOSIS BASED ON NEURAL NETWORKS FOR ROBOT IN FMS
Institute of Scientific and Technical Information of China (English)
1998-01-01
Based on radial basis function (RBF) neural networks, the healthy working model of each sub-system of robot in FMS is established. A new approach to fault on-line detection and diagnosis according to neural networks model is presented. Fault double detection based on neural network model and threshold judgement and quick fault identification based on multi-layer feedforward neural networks are applied, which can meet quickness and reliability of fault detection and diagnosis for robot in FMS.
Gap-filling eddy-covariance data using a complex system of neural networks
Dúbrava, Matúš; Rebok, Tomáš; Havránková, Kateřina; Pavelka, Marian
2014-05-01
applications of ANNs on the gap-filling problem do not take the precise spike estimation into consideration, limiting their ability to get as precise seasonal and annual sums of carbon dioxide flux as possible. Our research focuses on an application of various types of ANNs to the gap-filling of eddy-covariance data problem, aiming to improve the precision of the ANNs reliability through keeping their generalization ability as well as better fitting the spikes in the NEE dataset. We present an evaluation of several different types of up-to-date ANNs -- e.g., multilayer perceptron, wavelet neural networks, focused time-lagged neural networks, etc., -- including their variants, as well as the main aim of our research: an elaborated framework, which is able to precisely fit the spikes by building a system of several ANNs of a particular type where each one had been trained for special conditions. To achieve the best precision possible, several types of ANNs simultaneously estimating the particular NEE value are supported -- the final value is then chosen according to several statistical properties. The current results show a considerable improvement, resulting in greater than 90 percent correlation between synthetic and real NEE values as well as significantly improving the precision of the spike fitting.
Landeras, G.; López, J. J.; Kisi, O.; Shiri, J.
2012-04-01
The correct observation/estimation of surface incoming solar radiation (RS) is very important for many agricultural, meteorological and hydrological related applications. While most weather stations are provided with sensors for air temperature detection, the presence of sensors necessary for the detection of solar radiation is not so habitual and the data quality provided by them is sometimes poor. In these cases it is necessary to estimate this variable. Temperature based modeling procedures are reported in this study for estimating daily incoming solar radiation by using Gene Expression Programming (GEP) for the first time, and other artificial intelligence models such as Artificial Neural Networks (ANNs), and Adaptive Neuro-Fuzzy Inference System (ANFIS). Traditional temperature based solar radiation equations were also included in this study and compared with artificial intelligence based approaches. Root mean square error (RMSE), mean absolute error (MAE) RMSE-based skill score (SSRMSE), MAE-based skill score (SSMAE) and r2 criterion of Nash and Sutcliffe criteria were used to assess the models' performances. An ANN (a four-input multilayer perceptron with ten neurons in the hidden layer) presented the best performance among the studied models (2.93 MJ m-2 d-1 of RMSE). A four-input ANFIS model revealed as an interesting alternative to ANNs (3.14 MJ m-2 d-1 of RMSE). Very limited number of studies has been done on estimation of solar radiation based on ANFIS, and the present one demonstrated the ability of ANFIS to model solar radiation based on temperatures and extraterrestrial radiation. By the way this study demonstrated, for the first time, the ability of GEP models to model solar radiation based on daily atmospheric variables. Despite the accuracy of GEP models was slightly lower than the ANFIS and ANN models the genetic programming models (i.e., GEP) are superior to other artificial intelligence models in giving a simple explicit equation for the
Biologically plausible multi-dimensional reinforcement learning in neural networks
Rombouts, J.O.; Ooyen, A. van; Roelfsema, P.R.; Bohte, S.M.
2012-01-01
How does the brain learn to map multi-dimensional sensory inputs to multi-dimensional motor outputs when it can only observe single rewards for the coordinated outputs of the whole network of neurons that make up the brain? We introduce Multi-AGREL, a novel, biologically plausible multi-layer neural
DEFF Research Database (Denmark)
Fotiadis, Panagiotis; Polignano, Michele; Gimenez, Lucas Chavarria;
2013-01-01
This paper investigates the potentials of traffic steering in the Radio Resource Control (RRC) Idle state by evaluating the Absolute Priorities (AP) framework in a multilayer Long Term Evolution (LTE) macrocell scenario. Frequency priorities are broadcast on the system information and RRC Idle...
Multilayer Controller for Outdoor Vehicle
DEFF Research Database (Denmark)
Reske-Nielsen, Anders; Mejnertsen, Asbjørn; Andersen, Nils Axel;
2006-01-01
A full software and hardware solution has been designed, implemented and tested for control of a small agricultural automatic tractor. The objective was to realise a user-friendly, multi-layer controller architecture for an outdoor platform. The collaborative research work was done as a part of a...
New developments in Ni/Ti multilayers
Energy Technology Data Exchange (ETDEWEB)
Anderson, I.; Hoghoj, P. [Institut Max von Laue - Paul Langevin (ILL), 38 - Grenoble (France)
1997-04-01
It is now 20 years since super-mirrors were first used as a neutron optical element. Since then the field of multilayer neutron-optics has matured with multilayers finding their way to application in many neutron scattering instruments. However, there is still room for progress in terms of multilayer quality, performance and application. Along with work on multilayers for neutron polarisation Ni/Ti super-mirrors have been optimised. The state-of-the-art Ni/Ti super-mirror performance and the results obtained in two neutron-optics applications of Ni/Ti multilayers are presented. (author).
Energy Technology Data Exchange (ETDEWEB)
Peixoto, Philippe Netto Belache
2016-07-01
This study presents a methodology based on the principles of gamma ray attenuation to identify volume fractions in biphasic systems composed of oil-gas-water and gas which are found in the offshore oil industry. This methodology is based on the acknowledgment counts per second on the photopeak energy using a detection system composed of a NaI (Tl) detector, a source of {sup 137}Cs without collimation positioned at 180 ° relative to the detector on a smooth stratified flow regime. The mathematical modeling for computational simulation using the code MCNP-X was performed using the experimental measurements of the detector characteristics (energy resolution and efficiency), characteristics of the material water and oil (density and coefficient attenuation) and measurement of the volume fractions. To predict these fractions were used artificial neural networks (ANNs), and to obtain an adequate training the ANNs for the prediction of volume fractions were simulated a larger number of volume fractions in MCNP-X. The experimental data were used in the set data necessary for validation of ANNs and the data generated using the computer code MCNP-X were used in training and test sets of the ANNs. Were used ANNs of type feed-forward Multilayer Perceptron (MLP) and analyzed two functions of training, Levenberg-Marquardt (LM) and gradient descent with momentum (GDM), both using the Backpropagation training algorithm. The ANNs identified correctly the volume fractions of the multiphase system with mean relative errors lower than 1.21 %, enabling the application of this methodology for this purpose. (author)
Introduction to neural networks; Introduction aux reseaux de neurones
Energy Technology Data Exchange (ETDEWEB)
Pavlopoulos, P. [European Organization for Nuclear Research, Geneva (Switzerland)
1996-08-01
This lecture is a presentation of today`s research in neural computation. Neural computation is inspired by knowledge from neuro-science. It draws its methods in large degree from statistical physics and its potential applications lie mainly in computer science and engineering. Neural networks models are algorithms for cognitive tasks, such as learning and optimization, which are based on concepts derived from research into the nature of the brain. The lecture first gives an historical presentation of neural networks development and interest in performing complex tasks. Then, an exhaustive overview of data management and networks computation methods is given: the supervised learning and the associative memory problem, the capacity of networks, the Perceptron networks, the functional link networks, the Madaline (Multiple Adalines) networks, the back-propagation networks, the reduced coulomb energy (RCE) networks, the unsupervised learning and the competitive learning and vector quantization. An example of application in high energy physics is given with the trigger systems and track recognition system (track parametrization, event selection and particle identification) developed for the CPLEAR experiment detectors from the LEAR at CERN. (J.S.). 56 refs., 20 figs., 1 tab., 1 appendix.
Model of Information Security Risk Assessment based on Improved Wavelet Neural Network
Gang Chen; Dawei Zhao
2013-01-01
This paper concentrates on the information security risk assessment model utilizing the improved wavelet neural network. The structure of wavelet neural network is similar to the multi-layer neural network, which is a feed-forward neural network with one or more inputs. Afterwards, we point out that the training process of wavelet neural networks is made up of four steps until the value of error function can satisfy a pre-defined error criteria. In order to enhance the quality of information ...
Deep Extreme Learning Machine and Its Application in EEG Classification
Shifei Ding; Nan Zhang; Xinzheng Xu; Lili Guo; Jian Zhang
2015-01-01
Recently, deep learning has aroused wide interest in machine learning fields. Deep learning is a multilayer perceptron artificial neural network algorithm. Deep learning has the advantage of approximating the complicated function and alleviating the optimization difficulty associated with deep models. Multilayer extreme learning machine (MLELM) is a learning algorithm of an artificial neural network which takes advantages of deep learning and extreme learning machine. Not only does MLELM appr...
Coronary Artery Diagnosis Aided by Neural Network
Stefko, Kamil
2007-01-01
Coronary artery disease is due to atheromatous narrowing and subsequent occlusion of the coronary vessel. Application of optimised feed forward multi-layer back propagation neural network (MLBP) for detection of narrowing in coronary artery vessels is presented in this paper. The research was performed using 580 data records from traditional ECG exercise test confirmed by coronary arteriography results. Each record of training database included description of the state of a patient providing input data for the neural network. Level and slope of ST segment of a 12 lead ECG signal recorded at rest and after effort (48 floating point values) was the main component of input data for neural network was. Coronary arteriography results (verified the existence or absence of more than 50% stenosis of the particular coronary vessels) were used as a correct neural network training output pattern. More than 96% of cases were correctly recognised by especially optimised and a thoroughly verified neural network. Leave one out method was used for neural network verification so 580 data records could be used for training as well as for verification of neural network.
Making Weed Management Maps by Artificial Neural Networks for Using in Precision Agriculture
Directory of Open Access Journals (Sweden)
A Rohani
2016-04-01
Full Text Available With the rise of new powerful statistical techniques and neural networks models, the development of predictive species distribution models has rapidly increased in ecology. In this research, a learning vector quantization (LVQ and multi layer perceptron (MLP neural network models have been employed to predict, classify and map the spatial distribution of A. repens L. density. This method was evaluated based on data of weed density counted at 550 points of a fallow field located in Faculty of Agriculture, Shahrood University of Technology, Semnan, Iran, in 2010. Some statistical tests, such as comparisions of the means, variance, statistical distribution as well as coefficient of determination in linear regression were used between the observed point sample data and the estimated weed seedling density surfaces by two neural networks to evaluate the performance of the pattern recognition method. Results showed that in the training and test phases non significant different was observed between average, variance, statistical distribution in the observed and the estimated weed density by using LVQ neural network. While this comparisions was significant except statistical distribution by using MLP neural network. In addition, results indicated that trained LVQ neural network has a high capability in predicting weed density with recognition erorr less than 0.64 percent at unsampled points. While, MLP neural network recognition erorr was less than 14.6 percent at unsampled points. The maps showed that, patchy weed distribution offers large potential for using site-specific weed control on this field.
Metallic multilayers at the nanoscale
Energy Technology Data Exchange (ETDEWEB)
Jankowski, A.F.
1994-11-01
The development of multilayer structures has been driven by a wide range of commercial applications requiring enhanced material behaviors. Innovations in physical vapor deposition technologies, in particular magnetron sputtering, have enabled the synthesis of metallic-based structures with nanoscaled layer dimensions as small as one-to-two monolayers. Parameters used in the deposition process are paramount to the Formation of these small layer dimensions and the stability of the structure. Therefore, optimization of the desired material properties must be related to assessment of the actual microstructure. Characterization techniques as x-ray diffraction and high resolution microscopy are useful to reveal the interface and layer structure-whether ordered or disordered crystalline, amorphous, compositionally abrupt or graded, and/or lattice strained Techniques for the synthesis of metallic multilayers with subnanometric layers will be reviewed with applications based on enhancing material behaviors as reflectivity and magnetic anisotropy but with emphasis on experimental studies of mechanical properties.
XPS Studies of Magnetic Multilayers
Institute of Scientific and Technical Information of China (English)
无
2001-01-01
NiOx/Ni81Fe19 and Co/AlOx/Co magnetic multilayers were fabri cated by reactive RF/DC magnetron sputtering on clean glass substrates and oxidized Si (100) substrates, respectively. The exchange biasing field (Hex) between NiOx and Ni81Fe19 as a function of oxidation stat es was studied by X-ray photoelectron spectroscopy (XPS). The oxidatio n states and the oxide thickness of Al layers in magnetic multilayer f ilms consisting of Co/AlOx/Co were also analyzed. It is found that the Hex of NiOx/Ni81Fe19 films only depends on Ni2+ but not on Ni3+ or Ni . The bottom Co can be completely covered by depositing an Al layer th icker than 2.0nm. The oxide layer was Al2O3, and its thickness was 1.1 5nm.
Anomalous magnetoresistance in Fibonacci multilayers.
Energy Technology Data Exchange (ETDEWEB)
Machado, L. D.; Bezerra, C. G.; Correa, M. A.; Chesman, C.; Pearson, J. E.; Hoffmann, A. (Materials Science Division); (Universidade Federal do Rio Grande do Norte)
2012-01-01
We theoretically investigated magnetoresistance curves in quasiperiodic magnetic multilayers for two different growth directions, namely, [110] and [100]. We considered identical ferromagnetic layers separated by nonmagnetic layers with two different thicknesses chosen based on the Fibonacci sequence. Using parameters for Fe/Cr multilayers, four terms were included in our description of the magnetic energy: Zeeman, cubic anisotropy, bilinear coupling, and biquadratic coupling. The minimum energy was determined by the gradient method and the equilibrium magnetization directions found were used to calculate magnetoresistance curves. By choosing spacers with a thickness such that biquadratic coupling is stronger than bilinear coupling, unusual behaviors for the magnetoresistance were observed: (i) for the [110] case, there is a different behavior for structures based on even and odd Fibonacci generations, and, more interesting, (ii) for the [100] case, we found magnetic field ranges for which the magnetoresistance increases with magnetic field.
Multilayer weighted social network model
Murase, Yohsuke; Török, János; Jo, Hang-Hyun; Kaski, Kimmo; Kertész, János
2014-11-01
Recent empirical studies using large-scale data sets have validated the Granovetter hypothesis on the structure of the society in that there are strongly wired communities connected by weak ties. However, as interaction between individuals takes place in diverse contexts, these communities turn out to be overlapping. This implies that the society has a multilayered structure, where the layers represent the different contexts. To model this structure we begin with a single-layer weighted social network (WSN) model showing the Granovetterian structure. We find that when merging such WSN models, a sufficient amount of interlayer correlation is needed to maintain the relationship between topology and link weights, while these correlations destroy the enhancement in the community overlap due to multiple layers. To resolve this, we devise a geographic multilayer WSN model, where the indirect interlayer correlations due to the geographic constraints of individuals enhance the overlaps between the communities and, at the same time, the Granovetterian structure is preserved.
Spreading processes in Multilayer Networks
Salehi, Mostafa; Sharma, Rajesh; Marzolla, Moreno; Magnani, Matteo; Siyari, Payam; Montesi, Danilo
2014-01-01
Several systems can be modeled as sets of interconnected networks or networks with multiple types of connections, here generally called multilayer networks. Spreading processes such as information propagation among users of an online social networks, or the diffusion of pathogens among individuals through their contact network, are fundamental phenomena occurring in these networks. However, while information diffusion in single networks has received considerable attention from various discipl...
Multilayer coating for high gradients
Kubo, Takayuki
2016-01-01
The multilayer coating for high gradients is reviewed. Not only the S-I-S structure, but also the S-S bilayer structure are also treated. This is an incomplete manuscript of an invited article which will be submitted to a journal. I have uploaded this version in order to help the understanding on my talk at the TESLA Technology Collaboration meeting at Saclay, France.
Ultra-thin multilayer capacitors.
Energy Technology Data Exchange (ETDEWEB)
Renk, Timothy Jerome; Monson, Todd C.
2009-06-01
The fabrication of ultra-thin lanthanum-doped lead zirconium titanate (PLZT) multilayer ceramic capacitors (MLCCs) using a high-power pulsed ion beam was studied. The deposition experiments were conducted on the RHEPP-1 facility at Sandia National Laboratories. The goal of this work was to increase the energy density of ceramic capacitors through the formation of a multilayer device with excellent materials properties, dielectric constant, and standoff voltage. For successful device construction, there are a number of challenging requirements including achieving correct stoichiometric and crystallographic composition of the deposited PLZT, as well as the creation of a defect free homogenous film. This report details some success in satisfying these requirements, although 900 C temperatures were necessary for PLZT perovskite phase formation. These temperatures were applied to a previously deposited multi-layer film which was then post-annealed to this temperature. The film exhibited mechanical distress attributable to differences in the coefficient of thermal expansion (CTE) of the various layers. This caused significant defects in the deposited films that led to shorts across devices. A follow-on single layer deposition without post-anneal produced smooth layers with good interface behavior, but without the perovskite phase formation. These issues will need to be addressed in order for ion beam deposited MLCCs to become a viable technology. It is possible that future in-situ heating during deposition may address both the CTE issue, and result in lowered processing temperatures, which in turn could raise the probability of successful MLCC formation.
Directory of Open Access Journals (Sweden)
Sidney S. Zanetti
2008-04-01
Full Text Available Propor uma rede neural artificial (RNA para estimar a evapotranspiração de referência (ETo em função das coordenadas de posição geográfica e da temperatura do ar no Estado do Rio de Janeiro, motivou a realização do presente estudo. Os dados utilizados no treinamento da rede foram obtidos de 17 séries históricas de elementos climáticos localizadas nesse Estado. A ETo diária calculada pelo método de Penman-Monteith (FAO-56 foi utilizada como referência para treinar as redes. As RNAs, do tipo perceptron de múltiplas camadas, foram treinadas para estimar a ETo em função da latitude, longitude, altitude, temperatura média do ar, amplitude térmica diária e dia do ano. Após o treinamento com várias configurações de rede, selecionou-se a que apresentou o melhor desempenho, a qual é composta de apenas uma camada intermediária (com vinte neurônios e função de ativação do tipo sigmóide logística e uma camada de saída (com um neurônio e função de ativação linear. Pelos resultados obtidos conclui-se que, levando-se em consideração apenas as coordenadas de posição geográfica e a temperatura do ar, pode-se estimar a ETo (valores diários em 17 localidades do Estado do Rio de Janeiro usando uma RNA.This work was performed with the aim of proposing an artificial neural network (ANN to estimate the reference evapotranspiration (ETo as a function of geographic position coordinates and air temperature in the State of Rio de Janeiro. Data used for the network training were collected from 17 historical time series of climatic elements located in the State of Rio de Janeiro. The daily ETo calculated by Penman-Monteith (FAO-56 method was used as a reference for network training. ANNs of multilayer perceptron type were trained to estimate ETo as a function of latitude, longitude, altitude, mean air temperature, thermal daily amplitude and day of the year. After training with different network configurations, the one showing
DEFF Research Database (Denmark)
S. Nadimi, Esmaeil; Nyholm Jørgensen, Rasmus; Blanes-Vidal, Victoria;
2012-01-01
perceptron (MLP)-based artificial neural network (ANN). The best performance of the ANN in terms of the mean squared error (MSE) and the convergence speed was achieved when it was initialized and trained using the Nguyen–Widrow and Levenberg–Marquardt back-propagation algorithms, respectively. The success...... into their corresponding behavioral modes. However, network unreliability and high-energy consumption have limited the applicability of those systems. In this study, a 2.4-GHz ZigBee-based mobile ad hoc wireless sensor network (MANET) that is able to overcome those problems is presented. The designed MANET showed high...
DEFF Research Database (Denmark)
Ahmadi, Seyed Hamid; Sepaskhah, Ali Reza; Andersen, Mathias Neumann;
2014-01-01
Root length density (RLD) is a highly wanted parameter for use in crop growth modeling but difficult to measure under field conditions. Therefore, artificial neural networks (ANNs) were implemented to predict the RLD of field grown potatoes that were subject to three irrigation strategies and three......% of the data) and testing (20% of the data). A feed forward three-layer perceptron network and the sigmoid, hyperbolic tangent, and linear transfer functions were used for the ANN modeling. The RLDs (target variable) in different soil layers were predicted by nine ANNs representing combinations (models...
Evolvable synthetic neural system
Curtis, Steven A. (Inventor)
2009-01-01
An evolvable synthetic neural system includes an evolvable neural interface operably coupled to at least one neural basis function. Each neural basis function includes an evolvable neural interface operably coupled to a heuristic neural system to perform high-level functions and an autonomic neural system to perform low-level functions. In some embodiments, the evolvable synthetic neural system is operably coupled to one or more evolvable synthetic neural systems in a hierarchy.
Directory of Open Access Journals (Sweden)
Vahab Iranmanesh
2014-01-01
Full Text Available One of the main difficulties in designing online signature verification (OSV system is to find the most distinctive features with high discriminating capabilities for the verification, particularly, with regard to the high variability which is inherent in genuine handwritten signatures, coupled with the possibility of skilled forgeries having close resemblance to the original counterparts. In this paper, we proposed a systematic approach to online signature verification through the use of multilayer perceptron (MLP on a subset of principal component analysis (PCA features. The proposed approach illustrates a feature selection technique on the usually discarded information from PCA computation, which can be significant in attaining reduced error rates. The experiment is performed using 4000 signature samples from SIGMA database, which yielded a false acceptance rate (FAR of 7.4% and a false rejection rate (FRR of 6.4%.
Parameter estimation using compensatory neural networks
Indian Academy of Sciences (India)
M Sinha; P K Kalra; K Kumar
2000-04-01
Proposed here is a new neuron model, a basis for Compensatory Neural Network Architecture (CNNA), which not only reduces the total number of interconnections among neurons but also reduces the total computing time for training. The suggested model has properties of the basic neuron model as well as the higher neuron model (multiplicative aggregation function). It can adapt to standard neuron and higher order neuron, as well as a combination of the two. This approach is found to estimate the orbit with accuracy significantly better than Kalman Filter (KF) and Feedforward Multilayer Neural Network (FMNN) (also simply referred to as Artificial Neural Network, ANN) with lambda-gamma learning. The typical simulation runs also bring out the superiority of the proposed scheme over Kalman filter from the standpoint of computation time and the amount of data needed for the desired degree of estimated accuracy for the specific problem of orbit determination.
Electrical conductivity of collapsed multilayer graphene tubes
Mendoza, D.
2011-01-01
Synthesis of multilayer graphene on copper wires by a chemical vapor deposition method is reported. After copper etching, the multilayer tube collapses forming stripes of graphitic films, their electrical conductance as a function of temperature indicate a semiconductor-like behavior. Using the multilayer graphene stripes, a cross junction is built and owing to its electrical behavior we propose that a tunneling process exists in the device.
Multi-layer seal for electrochemical devices
Chou, Yeong-Shyung [Richland, WA; Meinhardt, Kerry D [Kennewick, WA; Stevenson, Jeffry W [Richland, WA
2010-11-16
Multi-layer seals are provided that find advantageous use for reducing leakage of gases between adjacent components of electrochemical devices. Multi-layer seals of the invention include a gasket body defining first and second opposing surfaces and a compliant interlayer positioned adjacent each of the first and second surfaces. Also provided are methods for making and using the multi-layer seals, and electrochemical devices including said seals.
Multilayer Analysis and Visualization of Networks
De Domenico, Manlio; Arenas, Alex
2014-01-01
Multilayer relationships among and information about biological entities must be accompanied by the means to analyze, visualize, and obtain insights from such data. We report a methodology and a collection of algorithms for the analysis of multilayer networks in our new open-source software (muxViz). We demonstrate the ability of muxViz to analyze and interactively visualize multilayer data using empirical genetic and neuronal networks.
Magnetoresistive multilayers deposited on the AAO membranes
Energy Technology Data Exchange (ETDEWEB)
Malkinski, Leszek M. [Advanced Materials Research Institute, University of New Orleans, 2000 Lakeshore Drive, New Orleans, LA 70148 (United States)]. E-mail: lmalkins@uno.edu; Chalastaras, Athanasios [Advanced Materials Research Institute, University of New Orleans, 2000 Lakeshore Drive, New Orleans, LA 70148 (United States); Vovk, Andriy [Advanced Materials Research Institute, University of New Orleans, 2000 Lakeshore Drive, New Orleans, LA 70148 (United States); Jung, Jin-Seung [Department of Chemistry, Kangnung National University, Kangnung 210702 (Korea, Republic of) ; Kim, Eun-Mee [Department of Chemistry, Kangnung National University, Kangnung 210702 (Korea, Republic of) ; Jun, Jong-Ho [Department of Applied Chemistry, Kunkuk University, Chungju 151747 (Korea, Republic of) ; Ventrice, Carl A. [Advanced Materials Research Institute, University of New Orleans, 2000 Lakeshore Drive, New Orleans, LA 70148 (United States)
2005-02-01
Silicon and GaAs wafers are the most commonly used substrates for deposition of giant magnetoresistive (GMR) multilayers. We explored a new type of a substrate, prepared electrochemically by anodization of aluminum sheets, for deposition of GMR multilayers. The surface of this AAO substrate consists of nanosized hemispheres organized in a regular hexagonal array. The current applied along the substrate surface intersects many magnetic layers in the multilayered structure, which results in enhancement of giant magnetoresistance effect. The GMR effect in uncoupled Co/Cu multilayers was significantly larger than the magnetoresistance of similar structures deposited on Si.
A multi-layer network approach to MEG connectivity analysis.
Brookes, Matthew J; Tewarie, Prejaas K; Hunt, Benjamin A E; Robson, Sian E; Gascoyne, Lauren E; Liddle, Elizabeth B; Liddle, Peter F; Morris, Peter G
2016-05-15
Recent years have shown the critical importance of inter-regional neural network connectivity in supporting healthy brain function. Such connectivity is measurable using neuroimaging techniques such as MEG, however the richness of the electrophysiological signal makes gaining a complete picture challenging. Specifically, connectivity can be calculated as statistical interdependencies between neural oscillations within a large range of different frequency bands. Further, connectivity can be computed between frequency bands. This pan-spectral network hierarchy likely helps to mediate simultaneous formation of multiple brain networks, which support ongoing task demand. However, to date it has been largely overlooked, with many electrophysiological functional connectivity studies treating individual frequency bands in isolation. Here, we combine oscillatory envelope based functional connectivity metrics with a multi-layer network framework in order to derive a more complete picture of connectivity within and between frequencies. We test this methodology using MEG data recorded during a visuomotor task, highlighting simultaneous and transient formation of motor networks in the beta band, visual networks in the gamma band and a beta to gamma interaction. Having tested our method, we use it to demonstrate differences in occipital alpha band connectivity in patients with schizophrenia compared to healthy controls. We further show that these connectivity differences are predictive of the severity of persistent symptoms of the disease, highlighting their clinical relevance. Our findings demonstrate the unique potential of MEG to characterise neural network formation and dissolution. Further, we add weight to the argument that dysconnectivity is a core feature of the neuropathology underlying schizophrenia. PMID:26908313
A new backpropagation learning algorithm for layered neural networks with nondifferentiable units.
Oohori, Takahumi; Naganuma, Hidenori; Watanabe, Kazuhisa
2007-05-01
We propose a digital version of the backpropagation algorithm (DBP) for three-layered neural networks with nondifferentiable binary units. This approach feeds teacher signals to both the middle and output layers, whereas with a simple perceptron, they are given only to the output layer. The additional teacher signals enable the DBP to update the coupling weights not only between the middle and output layers but also between the input and middle layers. A neural network based on DBP learning is fast and easy to implement in hardware. Simulation results for several linearly nonseparable problems such as XOR demonstrate that the DBP performs favorably when compared to the conventional approaches. Furthermore, in large-scale networks, simulation results indicate that the DBP provides high performance. PMID:17381272
Directory of Open Access Journals (Sweden)
Tran Hoai Linh
2014-09-01
Full Text Available The paper presents a new system for ECG (ElectroCardioGraphy signal recognition using different neural classifiers and a binary decision tree to provide one more processing stage to give the final recognition result. As the base classifiers, the three classical neural models, i.e., the MLP (Multi Layer Perceptron, modified TSK (Takagi-Sugeno-Kang and the SVM (Support Vector Machine, will be applied. The coefficients in ECG signal decomposition using Hermite basis functions and the peak-to-peak periods of the ECG signals will be used as features for the classifiers. Numerical experiments will be performed for the recognition of different types of arrhythmia in the ECG signals taken from the MIT-BIH (Massachusetts Institute of Technology and Boston’s Beth Israel Hospital Arrhythmia Database. The results will be compared with individual base classifiers’ performances and with other integration methods to show the high quality of the proposed solution
Artificial neural network based approach to transmission lines protection
International Nuclear Information System (INIS)
The aim of this paper is to present and accurate fault detection technique for high speed distance protection using artificial neural networks. The feed-forward multi-layer neural network with the use of supervised learning and the common training rule of error back-propagation is chosen for this study. Information available locally at the relay point is passed to a neural network in order for an assessment of the fault location to be made. However in practice there is a large amount of information available, and a feature extraction process is required to reduce the dimensionality of the pattern vectors, whilst retaining important information that distinguishes the fault point. The choice of features is critical to the performance of the neural networks learning and operation. A significant feature in this paper is that an artificial neural network has been designed and tested to enhance the precision of the adaptive capabilities for distance protection
Photon spectrometry utilizing neural networks
International Nuclear Information System (INIS)
Having in mind the time spent on the uneventful work of characterization of the radiation beams used in a ionizing radiation metrology laboratory, the Metrology Service of the Centro Regional de Ciencias Nucleares do Nordeste - CRCN-NE verified the applicability of artificial intelligence (artificial neural networks) to perform the spectrometry in photon fields. For this, was developed a multilayer neural network, as an application for the classification of patterns in energy, associated with a thermoluminescent dosimetric system (TLD-700 and TLD-600). A set of dosimeters was initially exposed to various well known medium energies, between 40 keV and 1.2 MeV, coinciding with the beams determined by ISO 4037 standard, for the dose of 10 mSv in the quantity Hp(10), on a chest phantom (ISO slab phantom) with the purpose of generating a set of training data for the neural network. Subsequently, a new set of dosimeters irradiated in unknown energies was presented to the network with the purpose to test the method. The methodology used in this work was suitable for application in the classification of energy beams, having obtained 100% of the classification performed. (authors)
Directory of Open Access Journals (Sweden)
Mónica Bocco
2010-09-01
Full Text Available The incident solar radiation on soil is an important variable used in agricultural applications; it is also relevant in hydrology, meteorology and soil physics, among others. To estimate this variable, empirical models have been developed using several parameters and, recently, prognostic and prediction models based on artificial intelligence techniques such as neural networks. The aim of this work was to develop linear models and neural networks, multilayer perceptron, to estimate daily global solar radiation and compare their efficiency in its application to a region of the Province of Salta, Argentina. Relative sunshine duration, maximum and minimum temperature, rainfall, binary rainfall and extraterrestrial solar radiation data for the period 1996-2002, were used. All data were supplied by Experimental Station Salta, Instituto Nacional de Tecnología Agropecuaria (INTA, Argentina. For both, neural networks models and linear regressions, three alternative combinations of meteorological parameters were considered. Good results with both prediction methods were obtained, with root mean square error (RMSE values between 1.99 and 1.66 MJ m-2 d-1 for linear regressions and neural networks, and coefficients of correlation (r² between 0.88 and 0.92, respectively. Even though neural networks and linear regression models can be used to predict the daily global solar radiation appropriately, neural networks produced better estimates.La radiación solar incidente en el suelo es una variable importante usada en aplicaciones agronómicas, además es relevante en hidrología, meteorología y física del suelo, entre otros. Para estimarla se han desarrollado modelos empíricos que utilizan distintos parámetros meteorológicos y, recientemente, modelos de pronóstico y predicción basados en técnicas de inteligencia artificial tales como redes neuronales. El objetivo de este trabajo fue desarrollar modelos lineales y de redes neuronales, del tipo perceptr
Artificial Neural Networks for Diagnosis of Kidney Stones Disease
Directory of Open Access Journals (Sweden)
Koushal Kumar
2012-07-01
Full Text Available Artificial Neural networks are often used as a powerful discriminating classifier for tasks in medical diagnosis for early detection of diseases. They have several advantages over parametric classifiers such as discriminate analysis. The objective of this paper is to diagnose kidney stone disease by using three different neural network algorithms which have different architecture and characteristics. The aim of this work is to compare the performance of all three neural networks on the basis of its accuracy, time taken to build model, and training data set size. We will use Learning vector quantization (LVQ, two layers feed forward perceptron trained with back propagation training algorithm and Radial basis function (RBF networks for diagnosis of kidney stone disease. In this work we used Waikato Environment for Knowledge Analysis (WEKA version 3.7.5 as simulation tool which is an open source tool. The data set we used for diagnosis is real world data with 1000 instances and 8 attributes. In the end part we check the performance comparison of different algorithms to propose the best algorithm for kidney stone diagnosis. So this will helps in early identification of kidney stone in patients and reduces the diagnosis time.
Multilayer Graphene for Waveguide Terahertz Modulator
DEFF Research Database (Denmark)
Khromova, I.; Andryieuski, Andrei; Lavrinenko, Andrei
2014-01-01
We study terahertz to infrared electromagnetic properties of multilayer graphene/dielectric artificial medium and present a novel concept of terahertz modulation at midinfrared wavelengths. This approach allows the realization of high-speed electrically controllable terahertz modulators based on ...... on hollow waveguide sections filled with multilayer graphene....
Multi-Layer E-Textile Circuits
Dunne, Lucy E.; Bibeau, Kaila; Mulligan, Lucie; Frith, Ashton; Simon, Cory
2012-01-01
Stitched e-textile circuits facilitate wearable, flexible, comfortable wearable technology. However, while stitched methods of e-textile circuits are common, multi-layer circuit creation remains a challenge. Here, we present methods of stitched multi-layer circuit creation using accessible tools and techniques.
Robust giant magnetoresistive effect type multilayer sensor
Lenssen, K.M.H.; Kuiper, A.E.T.; Roozeboom, F.
2002-01-01
A robust Giant Magneto Resistive effect type multilayer sensor comprising a free and a pinned ferromagnetic layer, which can withstand high temperatures and strong magnetic fields as required in automotive applications. The GMR multi-layer has an asymmetric magneto-resistive curve and enables sensor
Superhard nano-multilayers and nanocomposite coatings
Institute of Scientific and Technical Information of China (English)
BAI Xiaoming; ZHENG Weitao; AN Tao
2005-01-01
This paper reviews the recent development of nano-multilayers and nanocomposite coatings. The hardening mechanisms and design of hard coating are discussed in details. Recent research on Ti/TiN and nitride/nitride multilayer, Ti-Si-N and Ti-Al-Si-N nanocomposite coatings is described, and the perspectives of the related research are proposed.
Figure correction of multilayer coated optics
Chapman; Henry N. , Taylor; John S.
2010-02-16
A process is provided for producing near-perfect optical surfaces, for EUV and soft-x-ray optics. The method involves polishing or otherwise figuring the multilayer coating that has been deposited on an optical substrate, in order to correct for errors in the figure of the substrate and coating. A method such as ion-beam milling is used to remove material from the multilayer coating by an amount that varies in a specified way across the substrate. The phase of the EUV light that is reflected from the multilayer will be affected by the amount of multilayer material removed, but this effect will be reduced by a factor of 1-n as compared with height variations of the substrate, where n is the average refractive index of the multilayer.
Parallel and Mixed Hardware Implementation of Artificial Neuron Network on the FPGA Platform
Directory of Open Access Journals (Sweden)
ATIBI Mohamed
2014-10-01
Full Text Available Most applications in different fields (automotive, robotics, medical… take advantage of the proven performance by artificial neural networks to solve their most complex problems. The architecture chosen for implementation is the multilayer perceptron that uses retro propagation as a learning algorithm. This article presents modular hardware implementation of multilayer perceptron architecture of artificial neuron network ‘ANN’, in the FPGA platform according to two models (parallel and mixed hardware implementation, and the comparison between these two implementations in terms of hardware resources and execution time. The two implementations are based on the proposed module of a formal neuron with the sigmoid activation function.
Application of Classification Models to Pharyngeal High-Resolution Manometry
Mielens, Jason D.; Hoffman, Matthew R.; Ciucci, Michelle R.; McCulloch, Timothy M.; Jiang, Jack J.
2012-01-01
Purpose: The authors present 3 methods of performing pattern recognition on spatiotemporal plots produced by pharyngeal high-resolution manometry (HRM). Method: Classification models, including the artificial neural networks (ANNs) multilayer perceptron (MLP) and learning vector quantization (LVQ), as well as support vector machines (SVM), were…
Deep Learning för finansiella tidsserier
Batres-Estrada, Bilberto
2015-01-01
Deep learning is a framework for training and modelling neural networks which recently have surpassed all conventional methods in many learning tasks, prominently image and voice recognition. This thesis uses deep learning algorithms to forecast financial data. The deep learning framework is used to train a neural network. The deep neural network is a Deep Belief Network (DBN) coupled to a Multilayer Perceptron (MLP). It is used to choose stocks to form portfolios. The portfolios have better ...
Multilingual Text Detection with Nonlinear Neural Network
Directory of Open Access Journals (Sweden)
Lin Li
2015-01-01
Full Text Available Multilingual text detection in natural scenes is still a challenging task in computer vision. In this paper, we apply an unsupervised learning algorithm to learn language-independent stroke feature and combine unsupervised stroke feature learning and automatically multilayer feature extraction to improve the representational power of text feature. We also develop a novel nonlinear network based on traditional Convolutional Neural Network that is able to detect multilingual text regions in the images. The proposed method is evaluated on standard benchmarks and multilingual dataset and demonstrates improvement over the previous work.
Neural network method for characterizing video cameras
Zhou, Shuangquan; Zhao, Dazun
1998-08-01
This paper presents a neural network method for characterizing color video camera. A multilayer feedforward network with the error back-propagation learning rule for training, is used as a nonlinear transformer to model a camera, which realizes a mapping from the CIELAB color space to RGB color space. With SONY video camera, D65 illuminant, Pritchard Spectroradiometer, 410 JIS color charts as training data and 36 charts as testing data, results show that the mean error of training data is 2.9 and that of testing data is 4.0 in a 2563 RGB space.
Thermal stability of nanoscale metallic multilayers
Energy Technology Data Exchange (ETDEWEB)
Ramos, A.S., E-mail: sofia.ramos@dem.uc.pt [CEMUC, Departamento de Engenharia Mecânica, Universidade de Coimbra, 3030-788 Coimbra (Portugal); Cavaleiro, A.J.; Vieira, M.T. [CEMUC, Departamento de Engenharia Mecânica, Universidade de Coimbra, 3030-788 Coimbra (Portugal); Morgiel, J. [Institute of Metallurgy and Materials Science, Polish Academy of Sciences, Reymonta 25, 30-059 Cracow (Poland); Safran, G. [Research Institute for Technical Physics and Materials Science, Hungarian Academy of Sciences, H-1121 Budapest (Hungary)
2014-11-28
Metallic nanolayered thin films/foils, in particular Ni/Al multilayers, have been used to promote joining. The objective of this work is to evaluate the thermal stability of nanoscale metallic multilayers with potential for joining applications. Multilayers thin films with low (Ti/Al and Ni/Ti), medium (Ni/Al) and high (Pd/Al) enthalpies of exothermic reaction were prepared by dual cathode magnetron sputtering. Their thermal stability was studied by: i) differential scanning calorimetry combined with X-ray diffraction (XRD), ii) in-situ XRD using cobalt radiation, and iii) in-situ transmission electron microscopy. It was possible to detect traces of intermetallic or amorphous phases in the as-deposited short period (bilayer thickness) multilayers, except for the Ti/Al films where no reaction products that might be formed during deposition were identified. For short periods (below 20 nm) the equilibrium phases are directly achieved upon annealing, whereas for higher periods intermediate trialuminide phases are present for Ti/Al and Ni/Al multilayers. The formation of B2-NiTi from Ni/Ti multilayers occurs without the formation of intermediate phases. On the contrary, for the Pd–Al system the formation of intermediate phases was never avoided. The viability of nanoscale multilayers as “filler” materials for joining macro or microparts/devices was demonstrated. - Highlights: • Me1 and Me2 (Me—metal) alternated nanolayers deposited by magnetron sputtering • Reactive Me1/Me2 multilayer thin films with nanometric modulation period • By heat treatment the films always evolve to the equilibrium intermetallic phase. • For some Me1–Me2 systems and periods, the formation of intermediate phases occurs. • Me1/Me2 multilayer thin films can be used as filler materials to enhance joining.
He, Bin
About the Series: Bioelectric Engineering presents state-of-the-art discussions on modern biomedical engineering with respect to applications of electrical engineering and information technology in biomedicine. This focus affirms Springer's commitment to publishing important reviews of the broadest interest to biomedical engineers, bioengineers, and their colleagues in affiliated disciplines. Recent volumes have covered modeling and imaging of bioelectric activity, neural engineering, biosignal processing, bionanotechnology, among other topics.
Centrality in Interconnected Multilayer Networks
De Domenico, Manlio; Omodei, Elisa; Gómez, Sergio; Arenas, Alex
2013-01-01
Real-world complex systems exhibit multiple levels of relationships. In many cases, they require to be modeled by interconnected multilayer networks, characterizing interactions on several levels simultaneously. It is of crucial importance in many fields, from economics to biology, from urban planning to social sciences, to identify the most (or the less) influent nodes in a network. However, defining the centrality of actors in an interconnected structure is not trivial. In this paper, we capitalize on the tensorial formalism, recently proposed to characterize and investigate this kind of complex topologies, to show how several centrality measures -- well-known in the case of standard ("monoplex") networks -- can be extended naturally to the realm of interconnected multiplexes. We consider diagnostics widely used in different fields, e.g., computer science, biology, communication and social sciences, to cite only some of them. We show, both theoretically and numerically, that using the weighted monoplex obta...
The physics of multilayer networks
De Domenico, Manlio; Porter, Mason A; Arenas, Alex
2016-01-01
The study of networks plays a crucial role in investigating the structure, dynamics, and function of a wide variety of complex systems in myriad disciplines. Despite the success of traditional network analysis, standard networks provide a limited representation of these systems, which often includes different types of relationships (i.e., "multiplexity") among their constituent components and/or multiple interacting subsystems. Such structural complexity has a significant effect on both dynamics and function. Throwing away or aggregating available structural information can generate misleading results and provide a major obstacle towards attempts to understand the system under analysis. The recent "multilayer' approach for modeling networked systems explicitly allows the incorporation of multiplexity and other features of realistic networked systems. On one hand, it allows one to couple different structural relationships by encoding them in a convenient mathematical object. On the other hand, it also allows o...
A Three-Threshold Learning Rule Approaches the Maximal Capacity of Recurrent Neural Networks.
Alemi, Alireza; Baldassi, Carlo; Brunel, Nicolas; Zecchina, Riccardo
2015-08-01
Understanding the theoretical foundations of how memories are encoded and retrieved in neural populations is a central challenge in neuroscience. A popular theoretical scenario for modeling memory function is the attractor neural network scenario, whose prototype is the Hopfield model. The model simplicity and the locality of the synaptic update rules come at the cost of a poor storage capacity, compared with the capacity achieved with perceptron learning algorithms. Here, by transforming the perceptron learning rule, we present an online learning rule for a recurrent neural network that achieves near-maximal storage capacity without an explicit supervisory error signal, relying only upon locally accessible information. The fully-connected network consists of excitatory binary neurons with plastic recurrent connections and non-plastic inhibitory feedback stabilizing the network dynamics; the memory patterns to be memorized are presented online as strong afferent currents, producing a bimodal distribution for the neuron synaptic inputs. Synapses corresponding to active inputs are modified as a function of the value of the local fields with respect to three thresholds. Above the highest threshold, and below the lowest threshold, no plasticity occurs. In between these two thresholds, potentiation/depression occurs when the local field is above/below an intermediate threshold. We simulated and analyzed a network of binary neurons implementing this rule and measured its storage capacity for different sizes of the basins of attraction. The storage capacity obtained through numerical simulations is shown to be close to the value predicted by analytical calculations. We also measured the dependence of capacity on the strength of external inputs. Finally, we quantified the statistics of the resulting synaptic connectivity matrix, and found that both the fraction of zero weight synapses and the degree of symmetry of the weight matrix increase with the number of stored
A Three-Threshold Learning Rule Approaches the Maximal Capacity of Recurrent Neural Networks.
Directory of Open Access Journals (Sweden)
Alireza Alemi
2015-08-01
Full Text Available Understanding the theoretical foundations of how memories are encoded and retrieved in neural populations is a central challenge in neuroscience. A popular theoretical scenario for modeling memory function is the attractor neural network scenario, whose prototype is the Hopfield model. The model simplicity and the locality of the synaptic update rules come at the cost of a poor storage capacity, compared with the capacity achieved with perceptron learning algorithms. Here, by transforming the perceptron learning rule, we present an online learning rule for a recurrent neural network that achieves near-maximal storage capacity without an explicit supervisory error signal, relying only upon locally accessible information. The fully-connected network consists of excitatory binary neurons with plastic recurrent connections and non-plastic inhibitory feedback stabilizing the network dynamics; the memory patterns to be memorized are presented online as strong afferent currents, producing a bimodal distribution for the neuron synaptic inputs. Synapses corresponding to active inputs are modified as a function of the value of the local fields with respect to three thresholds. Above the highest threshold, and below the lowest threshold, no plasticity occurs. In between these two thresholds, potentiation/depression occurs when the local field is above/below an intermediate threshold. We simulated and analyzed a network of binary neurons implementing this rule and measured its storage capacity for different sizes of the basins of attraction. The storage capacity obtained through numerical simulations is shown to be close to the value predicted by analytical calculations. We also measured the dependence of capacity on the strength of external inputs. Finally, we quantified the statistics of the resulting synaptic connectivity matrix, and found that both the fraction of zero weight synapses and the degree of symmetry of the weight matrix increase with the
A Three-Threshold Learning Rule Approaches the Maximal Capacity of Recurrent Neural Networks.
Alemi, Alireza; Baldassi, Carlo; Brunel, Nicolas; Zecchina, Riccardo
2015-08-01
Understanding the theoretical foundations of how memories are encoded and retrieved in neural populations is a central challenge in neuroscience. A popular theoretical scenario for modeling memory function is the attractor neural network scenario, whose prototype is the Hopfield model. The model simplicity and the locality of the synaptic update rules come at the cost of a poor storage capacity, compared with the capacity achieved with perceptron learning algorithms. Here, by transforming the perceptron learning rule, we present an online learning rule for a recurrent neural network that achieves near-maximal storage capacity without an explicit supervisory error signal, relying only upon locally accessible information. The fully-connected network consists of excitatory binary neurons with plastic recurrent connections and non-plastic inhibitory feedback stabilizing the network dynamics; the memory patterns to be memorized are presented online as strong afferent currents, producing a bimodal distribution for the neuron synaptic inputs. Synapses corresponding to active inputs are modified as a function of the value of the local fields with respect to three thresholds. Above the highest threshold, and below the lowest threshold, no plasticity occurs. In between these two thresholds, potentiation/depression occurs when the local field is above/below an intermediate threshold. We simulated and analyzed a network of binary neurons implementing this rule and measured its storage capacity for different sizes of the basins of attraction. The storage capacity obtained through numerical simulations is shown to be close to the value predicted by analytical calculations. We also measured the dependence of capacity on the strength of external inputs. Finally, we quantified the statistics of the resulting synaptic connectivity matrix, and found that both the fraction of zero weight synapses and the degree of symmetry of the weight matrix increase with the number of stored