Neural Based Orthogonal Data Fitting The EXIN Neural Networks
Cirrincione, Giansalvo
2008-01-01
Written by three leaders in the field of neural based algorithms, Neural Based Orthogonal Data Fitting proposes several neural networks, all endowed with a complete theory which not only explains their behavior, but also compares them with the existing neural and traditional algorithms. The algorithms are studied from different points of view, including: as a differential geometry problem, as a dynamic problem, as a stochastic problem, and as a numerical problem. All algorithms have also been analyzed on real time problems (large dimensional data matrices) and have shown accurate solutions. Wh
Neural network based multiscale image restoration approach
de Castro, Ana Paula A.; da Silva, José D. S.
2007-02-01
This paper describes a neural network based multiscale image restoration approach. Multilayer perceptrons are trained with artificial images of degraded gray level circles, in an attempt to make the neural network learn inherent space relations of the degraded pixels. The present approach simulates the degradation by a low pass Gaussian filter blurring operation and the addition of noise to the pixels at pre-established rates. The training process considers the degraded image as input and the non-degraded image as output for the supervised learning process. The neural network thus performs an inverse operation by recovering a quasi non-degraded image in terms of least squared. The main difference of the approach to existing ones relies on the fact that the space relations are taken from different scales, thus providing relational space data to the neural network. The approach is an attempt to come up with a simple method that leads to an optimum solution to the problem. Considering different window sizes around a pixel simulates the multiscale operation. In the generalization phase the neural network is exposed to indoor, outdoor, and satellite degraded images following the same steps use for the artificial circle image.
Analysis of neural networks through base functions
van der Zwaag, B.J.; Slump, Cornelis H.; Spaanenburg, L.
Problem statement. Despite their success-story, neural networks have one major disadvantage compared to other techniques: the inability to explain comprehensively how a trained neural network reaches its output; neural networks are not only (incorrectly) seen as a "magic tool" but possibly even more
Neural network based facial recognition system
Luebbers, Paul G.; Uwechue, Okechukwu A.; Pandya, Abhijit S.
1994-03-01
Researchers have for many years tried to develop machine recognition systems using video images of the human face as the input, with limited success. This paper presents a technique for recognizing individuals based on facial features using a novel multi-layer neural network architecture called `PWRNET'. We envision a real-time version of this technique to be used for high security applications. Two systems are proposed. One involves taking a grayscale video image and using it directly, the other involves decomposing the grayscale image into a series of binary images using the isodensity regions of the image. Isodensity regions are the areas within an image where the intensity is within a certain range. The binary image is produced by setting the pixels inside this intensity range to one, and the rest of the pixels in the image to zero. Features based on moments are subsequently extracted from these grayscale images. These features are then used for classification of the image. The classification is accomplished using an artificial neural network called `PWRNET', which produces a polynomial expression of the trained network. There is one neural network for each individual to be identified, with an output value which is either positive or negative identification. A detailed development of the design is presented, and identification for small population of individuals is presented. It is shown that the system is effective for variations in both scale and translation, which are considered to be reasonable variations for this type of facial identification.
Neural network based system for equipment surveillance
Vilim, R.B.; Gross, K.C.; Wegerich, S.W.
1998-04-28
A method and system are disclosed for performing surveillance of transient signals of an industrial device to ascertain the operating state. The method and system involves the steps of reading into a memory training data, determining neural network weighting values until achieving target outputs close to the neural network output. If the target outputs are inadequate, wavelet parameters are determined to yield neural network outputs close to the desired set of target outputs and then providing signals characteristic of an industrial process and comparing the neural network output to the industrial process signals to evaluate the operating state of the industrial process. 33 figs.
Neural Network Classifier Based on Growing Hyperspheres
Czech Academy of Sciences Publication Activity Database
Jiřina Jr., Marcel; Jiřina, Marcel
2000-01-01
Roč. 10, č. 3 (2000), s. 417-428 ISSN 1210-0552. [Neural Network World 2000. Prague, 09.07.2000-12.07.2000] Grant - others:MŠMT ČR(CZ) VS96047; MPO(CZ) RP-4210 Institutional research plan: AV0Z1030915 Keywords : neural network * classifier * hyperspheres * big -dimensional data Subject RIV: BA - General Mathematics
Insulator recognition based on convolution neural network
Directory of Open Access Journals (Sweden)
Yang Yanli
2017-01-01
Full Text Available Insulator fault detection plays an important role in maintaining the safety of transmission lines. Insulator recognition is a prerequisite for its fault detection. An insulator recognition algorithm based on convolution neural network (CNN is proposed. A dataset is established to train the constructed CNN. The correct rate is 98.52% for 1220 training samples and the accuracy rate of testing is 89.04% on 1305 samples. The classification result of the CNN is further used to segment the insulator image. The test results show that the proposed method can realize the effective segmentation of insulators.
Cancer classification based on gene expression using neural networks.
Hu, H P; Niu, Z J; Bai, Y P; Tan, X H
2015-12-21
Based on gene expression, we have classified 53 colon cancer patients with UICC II into two groups: relapse and no relapse. Samples were taken from each patient, and gene information was extracted. Of the 53 samples examined, 500 genes were considered proper through analyses by S-Kohonen, BP, and SVM neural networks. Classification accuracy obtained by S-Kohonen neural network reaches 91%, which was more accurate than classification by BP and SVM neural networks. The results show that S-Kohonen neural network is more plausible for classification and has a certain feasibility and validity as compared with BP and SVM neural networks.
Object Classification Using Substance Based Neural Network
Directory of Open Access Journals (Sweden)
P. Sengottuvelan
2014-01-01
Full Text Available Object recognition has shown tremendous increase in the field of image analysis. The required set of image objects is identified and retrieved on the basis of object recognition. In this paper, we propose a novel classification technique called substance based image classification (SIC using a wavelet neural network. The foremost task of SIC is to remove the surrounding regions from an image to reduce the misclassified portion and to effectively reflect the shape of an object. At first, the image to be extracted is performed with SIC system through the segmentation of the image. Next, in order to attain more accurate information, with the extracted set of regions, the wavelet transform is applied for extracting the configured set of features. Finally, using the neural network classifier model, misclassification over the given natural images and further background images are removed from the given natural image using the LSEG segmentation. Moreover, to increase the accuracy of object classification, SIC system involves the removal of the regions in the surrounding image. Performance evaluation reveals that the proposed SIC system reduces the occurrence of misclassification and reflects the exact shape of an object to approximately 10–15%.
Time Series Prediction based on Hybrid Neural Networks
Directory of Open Access Journals (Sweden)
S. A. Yarushev
2016-01-01
Full Text Available In this paper, we suggest to use hybrid approach to time series forecasting problem. In first part of paper, we create a literature review of time series forecasting methods based on hybrid neural networks and neuro-fuzzy approaches. Hybrid neural networks especially effective for specific types of applications such as forecasting or classification problem, in contrast to traditional monolithic neural networks. These classes of problems include problems with different characteristics in different modules. The main part of paper create a detailed overview of hybrid networks benefits, its architectures and performance under traditional neural networks. Hybrid neural networks models for time series forecasting are discussed in the paper. Experiments with modular neural networks are given.
A Neural Network-Based Interval Pattern Matcher
Directory of Open Access Journals (Sweden)
Jing Lu
2015-07-01
Full Text Available One of the most important roles in the machine learning area is to classify, and neural networks are very important classifiers. However, traditional neural networks cannot identify intervals, let alone classify them. To improve their identification ability, we propose a neural network-based interval matcher in our paper. After summarizing the theoretical construction of the model, we take a simple and a practical weather forecasting experiment, which show that the recognizer accuracy reaches 100% and that is promising.
Target recognition based on convolutional neural network
Wang, Liqiang; Wang, Xin; Xi, Fubiao; Dong, Jian
2017-11-01
One of the important part of object target recognition is the feature extraction, which can be classified into feature extraction and automatic feature extraction. The traditional neural network is one of the automatic feature extraction methods, while it causes high possibility of over-fitting due to the global connection. The deep learning algorithm used in this paper is a hierarchical automatic feature extraction method, trained with the layer-by-layer convolutional neural network (CNN), which can extract the features from lower layers to higher layers. The features are more discriminative and it is beneficial to the object target recognition.
Optical-Correlator Neural Network Based On Neocognitron
Chao, Tien-Hsin; Stoner, William W.
1994-01-01
Multichannel optical correlator implements shift-invariant, high-discrimination pattern-recognizing neural network based on paradigm of neocognitron. Selected as basic building block of this neural network because invariance under shifts is inherent advantage of Fourier optics included in optical correlators in general. Neocognitron is conceptual electronic neural-network model for recognition of visual patterns. Multilayer processing achieved by iteratively feeding back output of feature correlator to input spatial light modulator and updating Fourier filters. Neural network trained by use of characteristic features extracted from target images. Multichannel implementation enables parallel processing of large number of selected features.
Based on BP Neural Network Stock Prediction
Liu, Xiangwei; Ma, Xin
2012-01-01
The stock market has a high profit and high risk features, on the stock market analysis and prediction research has been paid attention to by people. Stock price trend is a complex nonlinear function, so the price has certain predictability. This article mainly with improved BP neural network (BPNN) to set up the stock market prediction model, and…
International Nuclear Information System (INIS)
Smith, Patrick I.
2003-01-01
information [2]. Each one of these cells acts as a simple processor. When individual cells interact with one another, the complex abilities of the brain are made possible. In neural networks, the input or data are processed by a propagation function that adds up the values of all the incoming data. The ending value is then compared with a threshold or specific value. The resulting value must exceed the activation function value in order to become output. The activation function is a mathematical function that a neuron uses to produce an output referring to its input value. [8] Figure 1 depicts this process. Neural networks usually have three components an input, a hidden, and an output. These layers create the end result of the neural network. A real world example is a child associating the word dog with a picture. The child says dog and simultaneously looks a picture of a dog. The input is the spoken word ''dog'', the hidden is the brain processing, and the output will be the category of the word dog based on the picture. This illustration describes how a neural network functions
RBF neural network based H∞ H∞ H∞ synchronization for ...
Indian Academy of Sciences (India)
In this paper, we propose a new H ∞ synchronization strategy, called a Radial Basis Function Neural Network H ∞ synchronization (RBFNNHS) strategy, for ... Based on this neural network and linear matrix inequality (LMI) formulation, the RBFNNHS controller and the learning laws are presented to reduce the effect of ...
A fuzzy art neural network based color image processing and ...
African Journals Online (AJOL)
A fuzzy art neural network based color image processing and recognition scheme. ... color image pixels, which enables a Fuzzy ART neural network to process the RGB color images. The application of the algorithm was implemented and tested on a set of RGB color face images. Keywords: Color image processing, RGB, ...
Face recognition based on improved BP neural network
Directory of Open Access Journals (Sweden)
Yue Gaili
2017-01-01
Full Text Available In order to improve the recognition rate of face recognition, face recognition algorithm based on histogram equalization, PCA and BP neural network is proposed. First, the face image is preprocessed by histogram equalization. Then, the classical PCA algorithm is used to extract the features of the histogram equalization image, and extract the principal component of the image. And then train the BP neural network using the trained training samples. This improved BP neural network weight adjustment method is used to train the network because the conventional BP algorithm has the disadvantages of slow convergence, easy to fall into local minima and training process. Finally, the BP neural network with the test sample input is trained to classify and identify the face images, and the recognition rate is obtained. Through the use of ORL database face image simulation experiment, the analysis results show that the improved BP neural network face recognition method can effectively improve the recognition rate of face recognition.
Neural Network Based Intelligent Sootblowing System
Energy Technology Data Exchange (ETDEWEB)
Mark Rhode
2005-04-01
. Due to the composition of coal, particulate matter is also a by-product of coal combustion. Modern day utility boilers are usually fitted with electrostatic precipitators to aid in the collection of particulate matter. Although extremely efficient, these devices are sensitive to rapid changes in inlet mass concentration as well as total mass loading. Traditionally, utility boilers are equipped with devices known as sootblowers, which use, steam, water or air to dislodge and clean the surfaces within the boiler and are operated based upon established rule or operator's judgment. Poor sootblowing regimes can influence particulate mass loading to the electrostatic precipitators. The project applied a neural network intelligent sootblowing system in conjunction with state-of-the-art controls and instruments to optimize the operation of a utility boiler and systematically control boiler slagging/fouling. This optimization process targeted reduction of NOx of 30%, improved efficiency of 2% and a reduction in opacity of 5%. The neural network system proved to be a non-invasive system which can readily be adapted to virtually any utility boiler. Specific conclusions from this neural network application are listed below. These conclusions should be used in conjunction with the specific details provided in the technical discussions of this report to develop a thorough understanding of the process.
Architecture Analysis of an FPGA-Based Hopfield Neural Network
Directory of Open Access Journals (Sweden)
Miguel Angelo de Abreu de Sousa
2014-01-01
Full Text Available Interconnections between electronic circuits and neural computation have been a strongly researched topic in the machine learning field in order to approach several practical requirements, including decreasing training and operation times in high performance applications and reducing cost, size, and energy consumption for autonomous or embedded developments. Field programmable gate array (FPGA hardware shows some inherent features typically associated with neural networks, such as, parallel processing, modular executions, and dynamic adaptation, and works on different types of FPGA-based neural networks were presented in recent years. This paper aims to address different aspects of architectural characteristics analysis on a Hopfield Neural Network implemented in FPGA, such as maximum operating frequency and chip-area occupancy according to the network capacity. Also, the FPGA implementation methodology, which does not employ multipliers in the architecture developed for the Hopfield neural model, is presented, in detail.
Image Restoration Technology Based on Discrete Neural network
Directory of Open Access Journals (Sweden)
Zhou Duoying
2015-01-01
Full Text Available With the development of computer science and technology, the development of artificial intelligence advances rapidly in the field of image restoration. Based on the MATLAB platform, this paper constructs a kind of image restoration technology of artificial intelligence based on the discrete neural network and feedforward network, and carries out simulation and contrast of the restoration process by the use of the bionic algorithm. Through the application of simulation restoration technology, this paper verifies that the discrete neural network has a good convergence and identification capability in the image restoration technology with a better effect than that of the feedforward network. The restoration technology based on the discrete neural network can provide a reliable mathematical model for this field.
Seismic noise filtering based on Generalized Regression Neural Networks
Djarfour, Nouredine; Ferahtia, Jalal; Babaia, Foudel; Baddari, Kamel; Said, El-adj; Farfour, Mohammed
2014-08-01
This paper deals with the application of Generalized Regression Neural Networks to the seismic data filtering. The proposed system is a class of neural networks widely used for the continuous function mapping. They are based on the well known nonparametric kernel statistical estimators. The main advantages of this neural network include adaptability, simplicity and rapid training. Several synthetic tests are performed in order to highlight the merit of the proposed topology of neural network. In this work, the filtering strategy has been applied to remove random noises as well as source-related noises from real seismic data extracted from a field in the South of Algeria. The obtained results are very promising and indicate the high performance of the proposed filter in comparison to the well known frequency-wavenumber filter.
Numeral eddy current sensor modelling based on genetic neural network
International Nuclear Information System (INIS)
Yu Along
2008-01-01
This paper presents a method used to the numeral eddy current sensor modelling based on the genetic neural network to settle its nonlinear problem. The principle and algorithms of genetic neural network are introduced. In this method, the nonlinear model parameters of the numeral eddy current sensor are optimized by genetic neural network (GNN) according to measurement data. So the method remains both the global searching ability of genetic algorithm and the good local searching ability of neural network. The nonlinear model has the advantages of strong robustness, on-line modelling and high precision. The maximum nonlinearity error can be reduced to 0.037% by using GNN. However, the maximum nonlinearity error is 0.075% using the least square method
Adaptive Neural Network Based Control of Noncanonical Nonlinear Systems.
Zhang, Yanjun; Tao, Gang; Chen, Mou
2016-09-01
This paper presents a new study on the adaptive neural network-based control of a class of noncanonical nonlinear systems with large parametric uncertainties. Unlike commonly studied canonical form nonlinear systems whose neural network approximation system models have explicit relative degree structures, which can directly be used to derive parameterized controllers for adaptation, noncanonical form nonlinear systems usually do not have explicit relative degrees, and thus their approximation system models are also in noncanonical forms. It is well-known that the adaptive control of noncanonical form nonlinear systems involves the parameterization of system dynamics. As demonstrated in this paper, it is also the case for noncanonical neural network approximation system models. Effective control of such systems is an open research problem, especially in the presence of uncertain parameters. This paper shows that it is necessary to reparameterize such neural network system models for adaptive control design, and that such reparameterization can be realized using a relative degree formulation, a concept yet to be studied for general neural network system models. This paper then derives the parameterized controllers that guarantee closed-loop stability and asymptotic output tracking for noncanonical form neural network system models. An illustrative example is presented with the simulation results to demonstrate the control design procedure, and to verify the effectiveness of such a new design method.
Adaptive Control for Robotic Manipulators Base on RBF Neural Network
Directory of Open Access Journals (Sweden)
MA Jing
2013-09-01
Full Text Available An adaptive neural network controller is brought forward by the paper to solve trajectory tracking problems of robotic manipulators with uncertainties. The first scheme consists of a PD feedback and a dynamic compensator which is composed by neural network controller and variable structure controller. Neutral network controller is designed to adaptive learn and compensate the unknown uncertainties, variable structure controller is designed to eliminate approach errors of neutral network. The adaptive weight learning algorithm of neural network is designed to ensure online real-time adjustment, offline learning phase is not need; Global asymptotic stability (GAS of system base on Lyapunov theory is analysised to ensure the convergence of the algorithm. The simulation result s show that the kind of the control scheme is effective and has good robustness.
Chaotic diagonal recurrent neural network
International Nuclear Information System (INIS)
Wang Xing-Yuan; Zhang Yi
2012-01-01
We propose a novel neural network based on a diagonal recurrent neural network and chaos, and its structure and learning algorithm are designed. The multilayer feedforward neural network, diagonal recurrent neural network, and chaotic diagonal recurrent neural network are used to approach the cubic symmetry map. The simulation results show that the approximation capability of the chaotic diagonal recurrent neural network is better than the other two neural networks. (interdisciplinary physics and related areas of science and technology)
International Nuclear Information System (INIS)
Denby, Bruce; Lindsey, Clark; Lyons, Louis
1992-01-01
The 1980s saw a tremendous renewal of interest in 'neural' information processing systems, or 'artificial neural networks', among computer scientists and computational biologists studying cognition. Since then, the growth of interest in neural networks in high energy physics, fueled by the need for new information processing technologies for the next generation of high energy proton colliders, can only be described as explosive
Implementation of neural network based non-linear predictive control
DEFF Research Database (Denmark)
Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole
1999-01-01
This paper describes a control method for non-linear systems based on generalized predictive control. Generalized predictive control (GPC) was developed to control linear systems, including open-loop unstable and non-minimum phase systems, but has also been proposed to be extended for the control...... of non-linear systems. GPC is model based and in this paper we propose the use of a neural network for the modeling of the system. Based on the neural network model, a controller with extended control horizon is developed and the implementation issues are discussed, with particular emphasis...
Implementation of neural network based non-linear predictive
DEFF Research Database (Denmark)
Sørensen, Paul Haase; Nørgård, Peter Magnus; Ravn, Ole
1998-01-01
The paper describes a control method for non-linear systems based on generalized predictive control. Generalized predictive control (GPC) was developed to control linear systems including open loop unstable and non-minimum phase systems, but has also been proposed extended for the control of non-linear...... systems. GPC is model-based and in this paper we propose the use of a neural network for the modeling of the system. Based on the neural network model a controller with extended control horizon is developed and the implementation issues are discussed, with particular emphasis on an efficient Quasi...
Research on Fault Diagnosis Method Based on Rule Base Neural Network
Directory of Open Access Journals (Sweden)
Zheng Ni
2017-01-01
Full Text Available The relationship between fault phenomenon and fault cause is always nonlinear, which influences the accuracy of fault location. And neural network is effective in dealing with nonlinear problem. In order to improve the efficiency of uncertain fault diagnosis based on neural network, a neural network fault diagnosis method based on rule base is put forward. At first, the structure of BP neural network is built and the learning rule is given. Then, the rule base is built by fuzzy theory. An improved fuzzy neural construction model is designed, in which the calculated methods of node function and membership function are also given. Simulation results confirm the effectiveness of this method.
Iris double recognition based on modified evolutionary neural network
Liu, Shuai; Liu, Yuan-Ning; Zhu, Xiao-Dong; Huo, Guang; Liu, Wen-Tao; Feng, Jia-Kai
2017-11-01
Aiming at multicategory iris recognition under illumination and noise interference, this paper proposes a method of iris double recognition based on a modified evolutionary neural network. An equalization histogram and Laplace of Gaussian operator are used to process the iris to suppress illumination and noise interference and Haar wavelet to convert the iris feature to binary feature encoding. Calculate the Hamming distance for the test iris and template iris , and compare with classification threshold, determine the type of iris. If the iris cannot be identified as a different type, there needs to be a secondary recognition. The connection weights in back-propagation (BP) neural network use modified evolutionary neural network to adaptively train. The modified neural network is composed of particle swarm optimization with mutation operator and BP neural network. According to different iris libraries in different circumstances of experimental results, under illumination and noise interference, the correct recognition rate of this algorithm is higher, the ROC curve is closer to the coordinate axis, the training and recognition time is shorter, and the stability and the robustness are better.
Image Restoration Technology Based on Discrete Neural network
Zhou Duoying
2015-01-01
With the development of computer science and technology, the development of artificial intelligence advances rapidly in the field of image restoration. Based on the MATLAB platform, this paper constructs a kind of image restoration technology of artificial intelligence based on the discrete neural network and feedforward network, and carries out simulation and contrast of the restoration process by the use of the bionic algorithm. Through the application of simulation restoration technology, ...
ANOMALY NETWORK INTRUSION DETECTION SYSTEM BASED ON DISTRIBUTED TIME-DELAY NEURAL NETWORK (DTDNN
Directory of Open Access Journals (Sweden)
LAHEEB MOHAMMAD IBRAHIM
2010-12-01
Full Text Available In this research, a hierarchical off-line anomaly network intrusion detection system based on Distributed Time-Delay Artificial Neural Network is introduced. This research aims to solve a hierarchical multi class problem in which the type of attack (DoS, U2R, R2L and Probe attack detected by dynamic neural network. The results indicate that dynamic neural nets (Distributed Time-Delay Artificial Neural Network can achieve a high detection rate, where the overall accuracy classification rate average is equal to 97.24%.
Numerical Analysis of Modeling Based on Improved Elman Neural Network
Directory of Open Access Journals (Sweden)
Shao Jie
2014-01-01
Full Text Available A modeling based on the improved Elman neural network (IENN is proposed to analyze the nonlinear circuits with the memory effect. The hidden layer neurons are activated by a group of Chebyshev orthogonal basis functions instead of sigmoid functions in this model. The error curves of the sum of squared error (SSE varying with the number of hidden neurons and the iteration step are studied to determine the number of the hidden layer neurons. Simulation results of the half-bridge class-D power amplifier (CDPA with two-tone signal and broadband signals as input have shown that the proposed behavioral modeling can reconstruct the system of CDPAs accurately and depict the memory effect of CDPAs well. Compared with Volterra-Laguerre (VL model, Chebyshev neural network (CNN model, and basic Elman neural network (BENN model, the proposed model has better performance.
Feature extraction for deep neural networks based on decision boundaries
Woo, Seongyoun; Lee, Chulhee
2017-05-01
Feature extraction is a process used to reduce data dimensions using various transforms while preserving the discriminant characteristics of the original data. Feature extraction has been an important issue in pattern recognition since it can reduce the computational complexity and provide a simplified classifier. In particular, linear feature extraction has been widely used. This method applies a linear transform to the original data to reduce the data dimensions. The decision boundary feature extraction method (DBFE) retains only informative directions for discriminating among the classes. DBFE has been applied to various parametric and non-parametric classifiers, which include the Gaussian maximum likelihood classifier (GML), the k-nearest neighbor classifier, support vector machines (SVM) and neural networks. In this paper, we apply DBFE to deep neural networks. This algorithm is based on the nonparametric version of DBFE, which was developed for neural networks. Experimental results with the UCI database show improved classification accuracy with reduced dimensionality.
Voice activity detection based on deep neural networks and Viterbi
Bai, Liang; Zhang, Zhen; Hu, Jun
2017-09-01
Voice Activity Detection (VAD) is important in speech processing. In the applications, the systems usually need to separate speech/non-speech parts, so that only the speech part can be dealt with. How to improve the performances of VAD in different noisy environments is an important issue in speech processing. Deep Neural network, which proves its efficiency in speech recognition, has been widely used in recent years. This paper studies the present typical VAD algorithms, and presents a new VAD algorithm based on deep neural networks and Viterbi algorithm. The result demonstrates the effectiveness of the deep neural network with Viterbi used in VAD. In addition, it shows the flexibility and the real-time performance of the algorithms.
A NEURAL NETWORK BASED IRIS RECOGNITION SYSTEM FOR PERSONAL IDENTIFICATION
Directory of Open Access Journals (Sweden)
Usham Dias
2010-10-01
Full Text Available This paper presents biometric personal identification based on iris recognition using artificial neural networks. Personal identification system consists of localization of the iris region, normalization, enhancement and then iris pattern recognition using neural network. In this paper, through results obtained, we have shown that a person’s left and right eye are unique. In this paper, we also show that the network is sensitive to the initial weights and that over-training gives bad results. We also propose a fast algorithm for the localization of the inner and outer boundaries of the iris region. Results of simulations illustrate the effectiveness of the neural system in personal identification. Finally a hardware iris recognition model is proposed and implementation aspects are discussed.
Hazardous Odor Recognition by CMAC Based Neural Networks
Directory of Open Access Journals (Sweden)
Bekir Karlık
2009-09-01
Full Text Available Electronic noses are being developed as systems for the automated detection and classification of odors, vapors, and gases. Artificial neural networks (ANNs have been used to analyze complex data and to recognize patterns, and have shown promising results in recognition of volatile compounds and odors in electronic nose applications. When an ANN is combined with a sensor array, the number of detectable chemicals is generally greater than the number of unique sensor types. The odor sensing system should be extended to new areas since its standard style where the output pattern from multiple sensors with partially overlapped specificity is recognized by a neural network or multivariate analysis. This paper describes the design, implementation and performance evaluations of the application developed for hazardous odor recognition using Cerebellar Model Articulation Controller (CMAC based neural networks.
Numerical analysis of modeling based on improved Elman neural network.
Jie, Shao; Li, Wang; WeiSong, Zhao; YaQin, Zhong; Malekian, Reza
2014-01-01
A modeling based on the improved Elman neural network (IENN) is proposed to analyze the nonlinear circuits with the memory effect. The hidden layer neurons are activated by a group of Chebyshev orthogonal basis functions instead of sigmoid functions in this model. The error curves of the sum of squared error (SSE) varying with the number of hidden neurons and the iteration step are studied to determine the number of the hidden layer neurons. Simulation results of the half-bridge class-D power amplifier (CDPA) with two-tone signal and broadband signals as input have shown that the proposed behavioral modeling can reconstruct the system of CDPAs accurately and depict the memory effect of CDPAs well. Compared with Volterra-Laguerre (VL) model, Chebyshev neural network (CNN) model, and basic Elman neural network (BENN) model, the proposed model has better performance.
Hand gesture recognition based on convolutional neural networks
Hu, Yu-lu; Wang, Lian-ming
2017-11-01
Hand gesture has been considered a natural, intuitive and less intrusive way for Human-Computer Interaction (HCI). Although many algorithms for hand gesture recognition have been proposed in literature, robust algorithms have been pursued. A recognize algorithm based on the convolutional neural networks is proposed to recognize ten kinds of hand gestures, which include rotation and turnover samples acquired from different persons. When 6000 hand gesture images were used as training samples, and 1100 as testing samples, a 98% recognition rate was achieved with the convolutional neural networks, which is higher than that with some other frequently-used recognition algorithms.
Electronic implementation of associative memory based on neural network models
Moopenn, A.; Lambe, John; Thakoor, A. P.
1987-01-01
An electronic embodiment of a neural network based associative memory in the form of a binary connection matrix is described. The nature of false memory errors, their effect on the information storage capacity of binary connection matrix memories, and a novel technique to eliminate such errors with the help of asymmetrical extra connections are discussed. The stability of the matrix memory system incorporating a unique local inhibition scheme is analyzed in terms of local minimization of an energy function. The memory's stability, dynamic behavior, and recall capability are investigated using a 32-'neuron' electronic neural network memory with a 1024-programmable binary connection matrix.
UNMANNED AIR VEHICLE STABILIZATION BASED ON NEURAL NETWORK REGULATOR
Directory of Open Access Journals (Sweden)
S. S. Andropov
2016-09-01
Full Text Available A problem of stabilizing for the multirotor unmanned aerial vehicle in an environment with external disturbances is researched. A classic proportional-integral-derivative controller is analyzed, its flaws are outlined: inability to respond to changing of external conditions and the need for manual adjustment of coefficients. The paper presents an adaptive adjustment method for coefficients of the proportional-integral-derivative controller based on neural networks. A neural network structure, its input and output data are described. Neural networks with three layers are used to create an adaptive stabilization system for the multirotor unmanned aerial vehicle. Training of the networks is done with the back propagation method. Each neural network produces regulator coefficients for each angle of stabilization as its output. A method for network training is explained. Several graphs of transition process on different stages of learning, including processes with external disturbances, are presented. It is shown that the system meets stabilization requirements with sufficient number of iterations. Described adjustment method for coefficients can be used in remote control of unmanned aerial vehicles, operating in the changing environment.
neural network based load frequency control for restructuring power
African Journals Online (AJOL)
2012-03-01
Mar 1, 2012 ... Abstract. In this study, an artificial neural network (ANN) application of load frequency control. (LFC) of a Multi-Area power system by using a neural network controller is presented. The comparison between a conventional Proportional Integral (PI) controller and the proposed artificial neural networks ...
Detecting danger labels with RAM-based neural networks
DEFF Research Database (Denmark)
Jørgensen, T.M.; Christensen, S.S.; Andersen, A.W.
1996-01-01
An image processing system for the automatic location of danger labels on the back of containers is presented. The system uses RAM-based neural networks to locate and classify labels after a pre-processing step involving specially designed non-linear edge filters and RGB-to-HSV conversion. Results...
Neural network based system for script identification in Indian ...
Indian Academy of Sciences (India)
2016-08-26
Aug 26, 2016 ... The paper describes a neural network-based script identiﬁcation system which can be used in the machine reading of documents written in English, Hindi and Kannada language scripts. Script identiﬁcation is a basic requirement in automation of document processing, in multi-script, multi-lingual ...
The harmonics detection method based on neural network applied ...
African Journals Online (AJOL)
The harmonics detection method based on neural network applied to harmonics compensation. R Dehini, A Bassou, B Ferdi. Abstract. Several different methods have been used to sense load currents and extract its harmonic component in order to produce a reference current in shunt active power filters (SAPF), and to ...
Neural network-based retrieval from software reuse repositories
Eichmann, David A.; Srinivas, Kankanahalli
1992-01-01
A significant hurdle confronts the software reuser attempting to select candidate components from a software repository - discriminating between those components without resorting to inspection of the implementation(s). We outline an approach to this problem based upon neural networks which avoids requiring the repository administrators to define a conceptual closeness graph for the classification vocabulary.
VoIP attacks detection engine based on neural network
Safarik, Jakub; Slachta, Jiri
2015-05-01
The security is crucial for any system nowadays, especially communications. One of the most successful protocols in the field of communication over IP networks is Session Initiation Protocol. It is an open-source project used by different kinds of applications, both open-source and proprietary. High penetration and text-based principle made SIP number one target in IP telephony infrastructure, so security of SIP server is essential. To keep up with hackers and to detect potential malicious attacks, security administrator needs to monitor and evaluate SIP traffic in the network. But monitoring and following evaluation could easily overwhelm the security administrator in networks, typically in networks with a number of SIP servers, users and logically or geographically separated networks. The proposed solution lies in automatic attack detection systems. The article covers detection of VoIP attacks through a distributed network of nodes. Then the gathered data analyze aggregation server with artificial neural network. Artificial neural network means multilayer perceptron network trained with a set of collected attacks. Attack data could also be preprocessed and verified with a self-organizing map. The source data is detected by distributed network of detection nodes. Each node contains a honeypot application and traffic monitoring mechanism. Aggregation of data from each node creates an input for neural networks. The automatic classification on a centralized server with low false positive detection reduce the cost of attack detection resources. The detection system uses modular design for easy deployment in final infrastructure. The centralized server collects and process detected traffic. It also maintains all detection nodes.
Liu, Qingshan; Cao, Jinde
2010-06-01
Based on the projection operator, a recurrent neural network is proposed for solving extended general variational inequalities (EGVIs). Sufficient conditions are provided to ensure the global convergence of the proposed neural network based on Lyapunov methods. Compared with the existing neural networks for variational inequalities, the proposed neural network is a modified version of the general projection neural network existing in the literature and capable of solving the EGVI problems. In addition, simulation results on numerical examples show the effectiveness and performance of the proposed neural network.
Directory of Open Access Journals (Sweden)
Smith Ann E
2002-01-01
Full Text Available Abstract Background Classification of the electrocardiogram using Neural Networks has become a widely used method in recent years. The efficiency of these classifiers depends upon a number of factors including network training. Unfortunately, there is a shortage of evidence available to enable specific design choices to be made and as a consequence, many designs are made on the basis of trial and error. In this study we develop prediction models to indicate the point at which training should stop for Neural Network based Electrocardiogram classifiers in order to ensure maximum generalisation. Methods Two prediction models have been presented; one based on Neural Networks and the other on Genetic Programming. The inputs to the models were 5 variable training parameters and the output indicated the point at which training should stop. Training and testing of the models was based on the results from 44 previously developed bi-group Neural Network classifiers, discriminating between Anterior Myocardial Infarction and normal patients. Results Our results show that both approaches provide close fits to the training data; p = 0.627 and p = 0.304 for the Neural Network and Genetic Programming methods respectively. For unseen data, the Neural Network exhibited no significant differences between actual and predicted outputs (p = 0.306 while the Genetic Programming method showed a marginally significant difference (p = 0.047. Conclusions The approaches provide reverse engineering solutions to the development of Neural Network based Electrocardiogram classifiers. That is given the network design and architecture, an indication can be given as to when training should stop to obtain maximum network generalisation.
Parametric Jominy profiles predictor based on neural networks
Directory of Open Access Journals (Sweden)
Valentini, R.
2005-12-01
Full Text Available The paper presents a method for the prediction of the Jominy hardness profiles of steels for microalloyed Boron steel which is based on neural networks. The Jominy profile has been parameterized and the parameters, which are a sort of "compact representation" of the profile itself, are linked to the steel chemical composition through a neural network. Numerical results are presented and discussed.
El trabajo presenta un método de estimación de perfiles de dureza Jominy para aceros microaleados al boro basado en redes neuronales. Los parámetros de perfil Jominy, que constituyen una especie de "representación compacta" del perfil mismo, son determinados y puestos en relación con la composición química del acero mediante una red neuronal. Los resultados numéricos son expuestos y discutidos.
Research on Transformer Fault Based on Probabilistic Neural Network
Directory of Open Access Journals (Sweden)
Li Yingshun
2015-01-01
Full Text Available With the development of computer science and technology, and increasingly intelligent industrial production, the application of big data in industry also advances rapidly, and the development of artificial intelligence in the aspect of fault diagnosis is particularly prominent. On the basis of MATLAB platform, this paper constructs a fault diagnosis expert system of artificial intelligence machine based on the probabilistic neural network, and it also carries out a simulation of production process by the use of bionic algorithm. This paper makes a diagnosis of transformer fault by the use of an expert system developed by this paper, and verifies that the probabilistic neural network has a good convergence, fault-tolerant ability and big data handling capability in the fault diagnosis. It is suitable for industrial production, which can provide a reliable mathematical model for the construction of fault diagnosis expert system in the industrial production.
Vehicle Sideslip Angle Estimation Based on General Regression Neural Network
Directory of Open Access Journals (Sweden)
Wang Wei
2016-01-01
Full Text Available Aiming at the accuracy of estimation of vehicle’s mass center sideslip angle, an estimation method of slip angle based on general regression neural network (GRNN and driver-vehicle closed-loop system has been proposed: regarding vehicle’s sideslip angle as time series mapping of yaw speed and lateral acceleration; using homogeneous design project to optimize the training samples; building the mapping relationship among sideslip angle, yaw speed, and lateral acceleration; at the same time, using experimental method to measure vehicle’s sideslip angle to verify validity of this method. Estimation results of neural network and real vehicle experiment show the same changing tendency. The mean of error is within 10% of test result’s amplitude. Results show GRNN can estimate vehicle’s sideslip angle correctly. It can offer a reference to the application of vehicle’s stability control system on vehicle’s state estimation.
Motion model identification of rescue robot based on optimized Jordan neural network
Zhang, Guangbin; Zhang, Runmei; Wang, Guangyin; Wu, Yulu
2017-06-01
Considering the influence of various factors, such as speed, angle, depth of water, weight, and water flow, on the underwater rescue robot, a method based on neural network is proposed. According to the characteristics of Elman and Jordan neural network, a new dynamic neural network is constructed. The network can be used to remember the state of the hidden layer and increase the feedback of the output node. The improved Jordan network is optimized by chaos particle swarm optimization algorithm. The optimized neural network is applied to identify the dynamic model of the underwater rescue robot. The simulation results show that the neural network has good convergence speed and accuracy.
Chinese Sentence Classification Based on Convolutional Neural Network
Gu, Chengwei; Wu, Ming; Zhang, Chuang
2017-10-01
Sentence classification is one of the significant issues in Natural Language Processing (NLP). Feature extraction is often regarded as the key point for natural language processing. Traditional ways based on machine learning can not take high level features into consideration, such as Naive Bayesian Model. The neural network for sentence classification can make use of contextual information to achieve greater results in sentence classification tasks. In this paper, we focus on classifying Chinese sentences. And the most important is that we post a novel architecture of Convolutional Neural Network (CNN) to apply on Chinese sentence classification. In particular, most of the previous methods often use softmax classifier for prediction, we embed a linear support vector machine to substitute softmax in the deep neural network model, minimizing a margin-based loss to get a better result. And we use tanh as an activation function, instead of ReLU. The CNN model improve the result of Chinese sentence classification tasks. Experimental results on the Chinese news title database validate the effectiveness of our model.
SOFM Neural Network Based Hierarchical Topology Control for Wireless Sensor Networks
Directory of Open Access Journals (Sweden)
Zhi Chen
2014-01-01
Full Text Available Well-designed network topology provides vital support for routing, data fusion, and target tracking in wireless sensor networks (WSNs. Self-organization feature map (SOFM neural network is a major branch of artificial neural networks, which has self-organizing and self-learning features. In this paper, we propose a cluster-based topology control algorithm for WSNs, named SOFMHTC, which uses SOFM neural network to form a hierarchical network structure, completes cluster head selection by the competitive learning among nodes, and takes the node residual energy and the distance to the neighbor nodes into account in the clustering process. In addition, the approach of dynamically adjusting the transmitting power of the cluster head nodes is adopted to optimize the network topology. Simulation results show that SOFMHTC may get a better energy-efficient performance and make more balanced energy consumption compared with some existing algorithms in WSNs.
Recursive Neural Networks Based on PSO for Image Parsing
Directory of Open Access Journals (Sweden)
Guo-Rong Cai
2013-01-01
Full Text Available This paper presents an image parsing algorithm which is based on Particle Swarm Optimization (PSO and Recursive Neural Networks (RNNs. State-of-the-art method such as traditional RNN-based parsing strategy uses L-BFGS over the complete data for learning the parameters. However, this could cause problems due to the nondifferentiable objective function. In order to solve this problem, the PSO algorithm has been employed to tune the weights of RNN for minimizing the objective. Experimental results obtained on the Stanford background dataset show that our PSO-based training algorithm outperforms traditional RNN, Pixel CRF, region-based energy, simultaneous MRF, and superpixel MRF.
A Neural Network Based Dutch Part of Speech Tagger
Boschman, E.; op den Akker, Hendrikus J.A.; Nijholt, A.; Nijholt, Antinus; Pantic, Maja; Pantic, M.; Poel, M.; Poel, Mannes; Hondorp, G.H.W.
2008-01-01
In this paper a Neural Network is designed for Part-of-Speech Tagging of Dutch text. Our approach uses the Corpus Gesproken Nederlands (CGN) consisting of almost 9 million transcribed words of spoken Dutch, divided into 15 different categories. The outcome of the design is a Neural Network with an
Optical supervised filtering technique based on Hopfield neural network
Bal, Abdullah
2004-11-01
Hopfield neural network is commonly preferred for optimization problems. In image segmentation, conventional Hopfield neural networks (HNN) are formulated as a cost-function-minimization problem to perform gray level thresholding on the image histogram or the pixels' gray levels arranged in a one-dimensional array [R. Sammouda, N. Niki, H. Nishitani, Pattern Rec. 30 (1997) 921-927; K.S. Cheng, J.S. Lin, C.W. Mao, IEEE Trans. Med. Imag. 15 (1996) 560-567; C. Chang, P. Chung, Image and Vision comp. 19 (2001) 669-678]. In this paper, a new high speed supervised filtering technique is proposed for image feature extraction and enhancement problems by modifying the conventional HNN. The essential improvement in this technique is to use 2D convolution operation instead of weight-matrix multiplication. Thereby, neural network based a new filtering technique has been obtained that is required just 3 × 3 sized filter mask matrix instead of large size weight coefficient matrix. Optical implementation of the proposed filtering technique is executed easily using the joint transform correlator. The requirement of non-negative data for optical implementation is provided by bias technique to convert the bipolar data to non-negative data. Simulation results of the proposed optical supervised filtering technique are reported for various feature extraction problems such as edge detection, corner detection, horizontal and vertical line extraction, and fingerprint enhancement.
Artificial neural network based approach to transmission lines protection
International Nuclear Information System (INIS)
Joorabian, M.
1999-05-01
The aim of this paper is to present and accurate fault detection technique for high speed distance protection using artificial neural networks. The feed-forward multi-layer neural network with the use of supervised learning and the common training rule of error back-propagation is chosen for this study. Information available locally at the relay point is passed to a neural network in order for an assessment of the fault location to be made. However in practice there is a large amount of information available, and a feature extraction process is required to reduce the dimensionality of the pattern vectors, whilst retaining important information that distinguishes the fault point. The choice of features is critical to the performance of the neural networks learning and operation. A significant feature in this paper is that an artificial neural network has been designed and tested to enhance the precision of the adaptive capabilities for distance protection
Directory of Open Access Journals (Sweden)
Schwindling Jerome
2010-04-01
Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Traffic sign recognition based on deep convolutional neural network
Yin, Shi-hao; Deng, Ji-cai; Zhang, Da-wei; Du, Jing-yuan
2017-11-01
Traffic sign recognition (TSR) is an important component of automated driving systems. It is a rather challenging task to design a high-performance classifier for the TSR system. In this paper, we propose a new method for TSR system based on deep convolutional neural network. In order to enhance the expression of the network, a novel structure (dubbed block-layer below) which combines network-in-network and residual connection is designed. Our network has 10 layers with parameters (block-layer seen as a single layer): the first seven are alternate convolutional layers and block-layers, and the remaining three are fully-connected layers. We train our TSR network on the German traffic sign recognition benchmark (GTSRB) dataset. To reduce overfitting, we perform data augmentation on the training images and employ a regularization method named "dropout". The activation function we employ in our network adopts scaled exponential linear units (SELUs), which can induce self-normalizing properties. To speed up the training, we use an efficient GPU to accelerate the convolutional operation. On the test dataset of GTSRB, we achieve the accuracy rate of 99.67%, exceeding the state-of-the-art results.
Neural Network Based Montioring and Control of Fluidized Bed.
Energy Technology Data Exchange (ETDEWEB)
Bodruzzaman, M.; Essawy, M.A.
1996-04-01
The goal of this project was to develop chaos analysis and neural network-based modeling techniques and apply them to the pressure-drop data obtained from the Fluid Bed Combustion (FBC) system (a small scale prototype model) located at the Federal Energy Technology Center (FETC)-Morgantown. The second goal was to develop neural network-based chaos control techniques and provide a suggestive prototype for possible real-time application to the FBC system. The experimental pressure data were collected from a cold FBC experimental set-up at the Morgantown Center. We have performed several analysis on these data in order to unveil their dynamical and chaotic characteristics. The phase-space attractors were constructed from the one dimensional time series data, using the time-delay embedding method, for both normal and abnormal conditions. Several identifying parameters were also computed from these attractors such as the correlation dimension, the Kolmogorov entropy, and the Lyapunov exponents. These chaotic attractor parameters can be used to discriminate between the normal and abnormal operating conditions of the FBC system. It was found that, the abnormal data has higher correlation dimension, larger Kolmogorov entropy and larger positive Lyapunov exponents as compared to the normal data. Chaotic system control using neural network based techniques were also investigated and compared to conventional chaotic system control techniques. Both types of chaotic system control techniques were applied to some typical chaotic systems such as the logistic, the Henon, and the Lorenz systems. A prototype model for real-time implementation of these techniques has been suggested to control the FBC system. These models can be implemented for real-time control in a next phase of the project after obtaining further measurements from the experimental model. After testing the control algorithms developed for the FBC model, the next step is to implement them on hardware and link them to
Introduction to Artificial Neural Networks
DEFF Research Database (Denmark)
Larsen, Jan
1999-01-01
The note addresses introduction to signal analysis and classification based on artificial feed-forward neural networks.......The note addresses introduction to signal analysis and classification based on artificial feed-forward neural networks....
EFFICIENT LANE DETECTION BASED ON ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
F. Arce
2017-09-01
Full Text Available Lane detection is a problem that has attracted in the last years the attention of the computer vision community. Most of approaches used until now to face this problem combine conventional image processing, image analysis and pattern classification techniques. In this paper, we propose a methodology based on so-called Ellipsoidal Neural Networks with Dendritic Processing (ENNDPs as a new approach to provide a solution to this important problem. The functioning and performance of the proposed methodology is validated with a real video taken by a camera mounted on a car circulating on urban highway of Mexico City.
Efficient Lane Detection Based on Artificial Neural Networks
Arce, F.; Zamora, E.; Hernández, G.; Sossa, H.
2017-09-01
Lane detection is a problem that has attracted in the last years the attention of the computer vision community. Most of approaches used until now to face this problem combine conventional image processing, image analysis and pattern classification techniques. In this paper, we propose a methodology based on so-called Ellipsoidal Neural Networks with Dendritic Processing (ENNDPs) as a new approach to provide a solution to this important problem. The functioning and performance of the proposed methodology is validated with a real video taken by a camera mounted on a car circulating on urban highway of Mexico City.
Artificial Neural Network Based State Estimators Integrated into Kalmtool
DEFF Research Database (Denmark)
Bayramoglu, Enis; Ravn, Ole; Poulsen, Niels Kjølstad
2012-01-01
In this paper we present a toolbox enabling easy evaluation and comparison of dierent ltering algorithms. The toolbox is called Kalmtool and is a set of MATLAB tools for state estimation of nonlinear systems. The toolbox now contains functions for Articial Neural Network Based State Estimation...... as well as for DD1 lter and the DD2 lter, as well as functions for Unscented Kalman lters and several versions of particle lters. The toolbox requires MATLAB version 7, but no additional toolboxes are required....
Using fuzzy logic to integrate neural networks and knowledge-based systems
Yen, John
1991-01-01
Outlined here is a novel hybrid architecture that uses fuzzy logic to integrate neural networks and knowledge-based systems. The author's approach offers important synergistic benefits to neural nets, approximate reasoning, and symbolic processing. Fuzzy inference rules extend symbolic systems with approximate reasoning capabilities, which are used for integrating and interpreting the outputs of neural networks. The symbolic system captures meta-level information about neural networks and defines its interaction with neural networks through a set of control tasks. Fuzzy action rules provide a robust mechanism for recognizing the situations in which neural networks require certain control actions. The neural nets, on the other hand, offer flexible classification and adaptive learning capabilities, which are crucial for dynamic and noisy environments. By combining neural nets and symbolic systems at their system levels through the use of fuzzy logic, the author's approach alleviates current difficulties in reconciling differences between low-level data processing mechanisms of neural nets and artificial intelligence systems.
Comparison Of Power Quality Disturbances Classification Based On Neural Network
Directory of Open Access Journals (Sweden)
Nway Nway Kyaw Win
2015-07-01
Full Text Available Abstract Power quality disturbances PQDs result serious problems in the reliability safety and economy of power system network. In order to improve electric power quality events the detection and classification of PQDs must be made type of transient fault. Software analysis of wavelet transform with multiresolution analysis MRA algorithm and feed forward neural network probabilistic and multilayer feed forward neural network based methodology for automatic classification of eight types of PQ signals flicker harmonics sag swell impulse fluctuation notch and oscillatory will be presented. The wavelet family Db4 is chosen in this system to calculate the values of detailed energy distributions as input features for classification because it can perform well in detecting and localizing various types of PQ disturbances. This technique classifies the types of PQDs problem sevents.The classifiers classify and identify the disturbance type according to the energy distribution. The results show that the PNN can analyze different power disturbance types efficiently. Therefore it can be seen that PNN has better classification accuracy than MLFF.
Rank-based pooling for deep convolutional neural networks.
Shi, Zenglin; Ye, Yangdong; Wu, Yunpeng
2016-11-01
Pooling is a key mechanism in deep convolutional neural networks (CNNs) which helps to achieve translation invariance. Numerous studies, both empirically and theoretically, show that pooling consistently boosts the performance of the CNNs. The conventional pooling methods are operated on activation values. In this work, we alternatively propose rank-based pooling. It is derived from the observations that ranking list is invariant under changes of activation values in a pooling region, and thus rank-based pooling operation may achieve more robust performance. In addition, the reasonable usage of rank can avoid the scale problems encountered by value-based methods. The novel pooling mechanism can be regarded as an instance of weighted pooling where a weighted sum of activations is used to generate the pooling output. This pooling mechanism can also be realized as rank-based average pooling (RAP), rank-based weighted pooling (RWP) and rank-based stochastic pooling (RSP) according to different weighting strategies. As another major contribution, we present a novel criterion to analyze the discriminant ability of various pooling methods, which is heavily under-researched in machine learning and computer vision community. Experimental results on several image benchmarks show that rank-based pooling outperforms the existing pooling methods in classification performance. We further demonstrate better performance on CIFAR datasets by integrating RSP into Network-in-Network. Copyright © 2016 Elsevier Ltd. All rights reserved.
Data systems and computer science: Neural networks base R/T program overview
Gulati, Sandeep
1991-01-01
The research base, in the U.S. and abroad, for the development of neural network technology is discussed. The technical objectives are to develop and demonstrate adaptive, neural information processing concepts. The leveraging of external funding is also discussed.
Video-based face recognition via convolutional neural networks
Bao, Tianlong; Ding, Chunhui; Karmoshi, Saleem; Zhu, Ming
2017-06-01
Face recognition has been widely studied recently while video-based face recognition still remains a challenging task because of the low quality and large intra-class variation of video captured face images. In this paper, we focus on two scenarios of video-based face recognition: 1)Still-to-Video(S2V) face recognition, i.e., querying a still face image against a gallery of video sequences; 2)Video-to-Still(V2S) face recognition, in contrast to S2V scenario. A novel method was proposed in this paper to transfer still and video face images to an Euclidean space by a carefully designed convolutional neural network, then Euclidean metrics are used to measure the distance between still and video images. Identities of still and video images that group as pairs are used as supervision. In the training stage, a joint loss function that measures the Euclidean distance between the predicted features of training pairs and expanding vectors of still images is optimized to minimize the intra-class variation while the inter-class variation is guaranteed due to the large margin of still images. Transferred features are finally learned via the designed convolutional neural network. Experiments are performed on COX face dataset. Experimental results show that our method achieves reliable performance compared with other state-of-the-art methods.
Directory of Open Access Journals (Sweden)
Mohammad Taghi Ameli
2012-01-01
Full Text Available Transmission Network Expansion Planning (TNEP is a basic part of power network planning that determines where, when and how many new transmission lines should be added to the network. So, the TNEP is an optimization problem in which the expansion purposes are optimized. Artificial Intelligence (AI tools such as Genetic Algorithm (GA, Simulated Annealing (SA, Tabu Search (TS and Artificial Neural Networks (ANNs are methods used for solving the TNEP problem. Today, by using the hybridization models of AI tools, we can solve the TNEP problem for large-scale systems, which shows the effectiveness of utilizing such models. In this paper, a new approach to the hybridization model of Probabilistic Neural Networks (PNNs and Harmony Search Algorithm (HSA was used to solve the TNEP problem. Finally, by considering the uncertain role of the load based on a scenario technique, this proposed model was tested on the Garver’s 6-bus network.
Adaptive PID control based on orthogonal endocrine neural networks.
Milovanović, Miroslav B; Antić, Dragan S; Milojković, Marko T; Nikolić, Saša S; Perić, Staniša Lj; Spasić, Miodrag D
2016-12-01
A new intelligent hybrid structure used for online tuning of a PID controller is proposed in this paper. The structure is based on two adaptive neural networks, both with built-in Chebyshev orthogonal polynomials. First substructure network is a regular orthogonal neural network with implemented artificial endocrine factor (OENN), in the form of environmental stimuli, to its weights. It is used for approximation of control signals and for processing system deviation/disturbance signals which are introduced in the form of environmental stimuli. The output values of OENN are used to calculate artificial environmental stimuli (AES), which represent required adaptation measure of a second network-orthogonal endocrine adaptive neuro-fuzzy inference system (OEANFIS). OEANFIS is used to process control, output and error signals of a system and to generate adjustable values of proportional, derivative, and integral parameters, used for online tuning of a PID controller. The developed structure is experimentally tested on a laboratory model of the 3D crane system in terms of analysing tracking performances and deviation signals (error signals) of a payload. OENN-OEANFIS performances are compared with traditional PID and 6 intelligent PID type controllers. Tracking performance comparisons (in transient and steady-state period) showed that the proposed adaptive controller possesses performances within the range of other tested controllers. The main contribution of OENN-OEANFIS structure is significant minimization of deviation signals (17%-79%) compared to other controllers. It is recommended to exploit it when dealing with a highly nonlinear system which operates in the presence of undesirable disturbances. Copyright © 2016 Elsevier Ltd. All rights reserved.
The Dissolved Oxygen Prediction Method Based on Neural Network
Directory of Open Access Journals (Sweden)
Zhong Xiao
2017-01-01
Full Text Available The dissolved oxygen (DO is oxygen dissolved in water, which is an important factor for the aquaculture. Using BP neural network method with the combination of purelin, logsig, and tansig activation functions is proposed for the prediction of aquaculture’s dissolved oxygen. The input layer, hidden layer, and output layer are introduced in detail including the weight adjustment process. The breeding data of three ponds in actual 10 consecutive days were used for experiments; these ponds were located in Beihai, Guangxi, a traditional aquaculture base in southern China. The data of the first 7 days are used for training, and the data of the latter 3 days are used for the test. Compared with the common prediction models, curve fitting (CF, autoregression (AR, grey model (GM, and support vector machines (SVM, the experimental results show that the prediction accuracy of the neural network is the highest, and all the predicted values are less than 5% of the error limit, which can meet the needs of practical applications, followed by AR, GM, SVM, and CF. The prediction model can help to improve the water quality monitoring level of aquaculture which will prevent the deterioration of water quality and the outbreak of disease.
Deep Neural Network Based Demand Side Short Term Load Forecasting
Directory of Open Access Journals (Sweden)
Seunghyoung Ryu
2016-12-01
Full Text Available In the smart grid, one of the most important research areas is load forecasting; it spans from traditional time series analyses to recent machine learning approaches and mostly focuses on forecasting aggregated electricity consumption. However, the importance of demand side energy management, including individual load forecasting, is becoming critical. In this paper, we propose deep neural network (DNN-based load forecasting models and apply them to a demand side empirical load database. DNNs are trained in two different ways: a pre-training restricted Boltzmann machine and using the rectified linear unit without pre-training. DNN forecasting models are trained by individual customer’s electricity consumption data and regional meteorological elements. To verify the performance of DNNs, forecasting results are compared with a shallow neural network (SNN, a double seasonal Holt–Winters (DSHW model and the autoregressive integrated moving average (ARIMA. The mean absolute percentage error (MAPE and relative root mean square error (RRMSE are used for verification. Our results show that DNNs exhibit accurate and robust predictions compared to other forecasting models, e.g., MAPE and RRMSE are reduced by up to 17% and 22% compared to SNN and 9% and 29% compared to DSHW.
Artificial Neural Networks for SCADA Data based Load Reconstruction (poster)
Hofemann, C.; Van Bussel, G.J.W.; Veldkamp, H.
2011-01-01
If at least one reference wind turbine is available, which provides sufficient information about the wind turbine loads, the loads acting on the neighbouring wind turbines can be predicted via an artificial neural network (ANN). This research explores the possibilities to apply such a network not
A Neural Networks-Based Hybrid Routing Protocol for Wireless Mesh Networks
Kojić, Nenad; Reljin, Irini; Reljin, Branimir
2012-01-01
The networking infrastructure of wireless mesh networks (WMNs) is decentralized and relatively simple, but they can display reliable functioning performance while having good redundancy. WMNs provide Internet access for fixed and mobile wireless devices. Both in urban and rural areas they provide users with high-bandwidth networks over a specific coverage area. The main problems affecting these networks are changes in network topology and link quality. In order to provide regular functioning, the routing protocol has the main influence in WMN implementations. In this paper we suggest a new routing protocol for WMN, based on good results of a proactive and reactive routing protocol, and for that reason it can be classified as a hybrid routing protocol. The proposed solution should avoid flooding and creating the new routing metric. We suggest the use of artificial logic—i.e., neural networks (NNs). This protocol is based on mobile agent technologies controlled by a Hopfield neural network. In addition to this, our new routing metric is based on multicriteria optimization in order to minimize delay and blocking probability (rejected packets or their retransmission). The routing protocol observes real network parameters and real network environments. As a result of artificial logic intelligence, the proposed routing protocol should maximize usage of network resources and optimize network performance. PMID:22969360
Advanced neural network-based computational schemes for robust fault diagnosis
Mrugalski, Marcin
2014-01-01
The present book is devoted to problems of adaptation of artificial neural networks to robust fault diagnosis schemes. It presents neural networks-based modelling and estimation techniques used for designing robust fault diagnosis schemes for non-linear dynamic systems. A part of the book focuses on fundamental issues such as architectures of dynamic neural networks, methods for designing of neural networks and fault diagnosis schemes as well as the importance of robustness. The book is of a tutorial value and can be perceived as a good starting point for the new-comers to this field. The book is also devoted to advanced schemes of description of neural model uncertainty. In particular, the methods of computation of neural networks uncertainty with robust parameter estimation are presented. Moreover, a novel approach for system identification with the state-space GMDH neural network is delivered. All the concepts described in this book are illustrated by both simple academic illustrative examples and practica...
International Nuclear Information System (INIS)
Elaraby, S.M.; Zaky, M.M.; Emara, M.M.; El-metwally, K.
2004-01-01
Nuclear plant accidents can cause injuries to operators, public as well as environment. Hence, advanced fault diagnosis techniques for nuclear plants are necessary to early detect, isolate and diagnose faults and accidents. This paper presents a new technique for accidents diagnosis of nuclear plants based on artificial neural networks. A new training technique based on particle swarm optimization (PSO) has been investigated to train the neural network. Results show the effectiveness of the technique for neural network training to diagnose nuclear reactor accidents
Neural network-based nonlinear model predictive control vs. linear quadratic gaussian control
Cho, C.; Vance, R.; Mardi, N.; Qian, Z.; Prisbrey, K.
1997-01-01
One problem with the application of neural networks to the multivariable control of mineral and extractive processes is determining whether and how to use them. The objective of this investigation was to compare neural network control to more conventional strategies and to determine if there are any advantages in using neural network control in terms of set-point tracking, rise time, settling time, disturbance rejection and other criteria. The procedure involved developing neural network controllers using both historical plant data and simulation models. Various control patterns were tried, including both inverse and direct neural network plant models. These were compared to state space controllers that are, by nature, linear. For grinding and leaching circuits, a nonlinear neural network-based model predictive control strategy was superior to a state space-based linear quadratic gaussian controller. The investigation pointed out the importance of incorporating state space into neural networks by making them recurrent, i.e., feeding certain output state variables into input nodes in the neural network. It was concluded that neural network controllers can have better disturbance rejection, set-point tracking, rise time, settling time and lower set-point overshoot, and it was also concluded that neural network controllers can be more reliable and easy to implement in complex, multivariable plants.
Reward-based training of recurrent neural networks for cognitive and value-based tasks.
Song, H Francis; Yang, Guangyu R; Wang, Xiao-Jing
2017-01-13
Trained neural network models, which exhibit features of neural activity recorded from behaving animals, may provide insights into the circuit mechanisms of cognitive functions through systematic analysis of network activity and connectivity. However, in contrast to the graded error signals commonly used to train networks through supervised learning, animals learn from reward feedback on definite actions through reinforcement learning. Reward maximization is particularly relevant when optimal behavior depends on an animal's internal judgment of confidence or subjective preferences. Here, we implement reward-based training of recurrent neural networks in which a value network guides learning by using the activity of the decision network to predict future reward. We show that such models capture behavioral and electrophysiological findings from well-known experimental paradigms. Our work provides a unified framework for investigating diverse cognitive and value-based computations, and predicts a role for value representation that is essential for learning, but not executing, a task.
Design of an adaptive neural network based power system stabilizer.
Liu, Wenxin; Venayagamoorthy, Ganesh K; Wunsch, Donald C
2003-01-01
Power system stabilizers (PSS) are used to generate supplementary control signals for the excitation system in order to damp the low frequency power system oscillations. To overcome the drawbacks of conventional PSS (CPSS), numerous techniques have been proposed in the literature. Based on the analysis of existing techniques, this paper presents an indirect adaptive neural network based power system stabilizer (IDNC) design. The proposed IDNC consists of a neuro-controller, which is used to generate a supplementary control signal to the excitation system, and a neuro-identifier, which is used to model the dynamics of the power system and to adapt the neuro-controller parameters. The proposed method has the features of a simple structure, adaptivity and fast response. The proposed IDNC is evaluated on a single machine infinite bus power system under different operating conditions and disturbances to demonstrate its effectiveness and robustness.
Short-Term Load Forecasting Model Based on Quantum Elman Neural Networks
Directory of Open Access Journals (Sweden)
Zhisheng Zhang
2016-01-01
Full Text Available Short-term load forecasting model based on quantum Elman neural networks was constructed in this paper. The quantum computation and Elman feedback mechanism were integrated into quantum Elman neural networks. Quantum computation can effectively improve the approximation capability and the information processing ability of the neural networks. Quantum Elman neural networks have not only the feedforward connection but also the feedback connection. The feedback connection between the hidden nodes and the context nodes belongs to the state feedback in the internal system, which has formed specific dynamic memory performance. Phase space reconstruction theory is the theoretical basis of constructing the forecasting model. The training samples are formed by means of K-nearest neighbor approach. Through the example simulation, the testing results show that the model based on quantum Elman neural networks is better than the model based on the quantum feedforward neural network, the model based on the conventional Elman neural network, and the model based on the conventional feedforward neural network. So the proposed model can effectively improve the prediction accuracy. The research in the paper makes a theoretical foundation for the practical engineering application of the short-term load forecasting model based on quantum Elman neural networks.
Probabilistic Neural Network-Based Sensor Configuration in a Wireless Ad Hoc Network
National Research Council Canada - National Science Library
Stevens, Thomas J; Sundareshan, Malur K
2004-01-01
This paper describes a novel application of a probabilistic neural network for overcoming the computational complexity involved in performing sensor configuration management in a collaborative sensor network...
The Energy Coding of a Structural Neural Network Based on the Hodgkin-Huxley Model.
Zhu, Zhenyu; Wang, Rubin; Zhu, Fengyun
2018-01-01
Based on the Hodgkin-Huxley model, the present study established a fully connected structural neural network to simulate the neural activity and energy consumption of the network by neural energy coding theory. The numerical simulation result showed that the periodicity of the network energy distribution was positively correlated to the number of neurons and coupling strength, but negatively correlated to signal transmitting delay. Moreover, a relationship was established between the energy distribution feature and the synchronous oscillation of the neural network, which showed that when the proportion of negative energy in power consumption curve was high, the synchronous oscillation of the neural network was apparent. In addition, comparison with the simulation result of structural neural network based on the Wang-Zhang biophysical model of neurons showed that both models were essentially consistent.
Classification of urine sediment based on convolution neural network
Pan, Jingjing; Jiang, Cunbo; Zhu, Tiantian
2018-04-01
By designing a new convolution neural network framework, this paper breaks the constraints of the original convolution neural network framework requiring large training samples and samples of the same size. Move and cropping the input images, generate the same size of the sub-graph. And then, the generated sub-graph uses the method of dropout, increasing the diversity of samples and preventing the fitting generation. Randomly select some proper subset in the sub-graphic set and ensure that the number of elements in the proper subset is same and the proper subset is not the same. The proper subsets are used as input layers for the convolution neural network. Through the convolution layer, the pooling, the full connection layer and output layer, we can obtained the classification loss rate of test set and training set. In the red blood cells, white blood cells, calcium oxalate crystallization classification experiment, the classification accuracy rate of 97% or more.
A link prediction method for heterogeneous networks based on BP neural network
Li, Ji-chao; Zhao, Dan-ling; Ge, Bing-Feng; Yang, Ke-Wei; Chen, Ying-Wu
2018-04-01
Most real-world systems, composed of different types of objects connected via many interconnections, can be abstracted as various complex heterogeneous networks. Link prediction for heterogeneous networks is of great significance for mining missing links and reconfiguring networks according to observed information, with considerable applications in, for example, friend and location recommendations and disease-gene candidate detection. In this paper, we put forward a novel integrated framework, called MPBP (Meta-Path feature-based BP neural network model), to predict multiple types of links for heterogeneous networks. More specifically, the concept of meta-path is introduced, followed by the extraction of meta-path features for heterogeneous networks. Next, based on the extracted meta-path features, a supervised link prediction model is built with a three-layer BP neural network. Then, the solution algorithm of the proposed link prediction model is put forward to obtain predicted results by iteratively training the network. Last, numerical experiments on the dataset of examples of a gene-disease network and a combat network are conducted to verify the effectiveness and feasibility of the proposed MPBP. It shows that the MPBP with very good performance is superior to the baseline methods.
Prediction of flow boiling curves based on artificial neural network
International Nuclear Information System (INIS)
Wu Junmei; Xi'an Jiaotong Univ., Xi'an; Su Guanghui
2007-01-01
The effects of the main system parameters on flow boiling curves were analyzed by using an artificial neural network (ANN) based on the database selected from the 1960s. The input parameters of the ANN are system pressure, mass flow rate, inlet subcooling, wall superheat and steady/transition boiling, and the output parameter is heat flux. The results obtained by the ANN show that the heat flux increases with increasing inlet sub cooling for all heat transfer modes. Mass flow rate has no significant effects on nucleate boiling curves. The transition boiling and film boiling heat fluxes will increase with an increase of mass flow rate. The pressure plays a predominant role and improves heat transfer in whole boiling regions except film boiling. There are slight differences between the steady and the transient boiling curves in all boiling regions except the nucleate one. (authors)
Deep neural network and noise classification-based speech enhancement
Shi, Wenhua; Zhang, Xiongwei; Zou, Xia; Han, Wei
2017-07-01
In this paper, a speech enhancement method using noise classification and Deep Neural Network (DNN) was proposed. Gaussian mixture model (GMM) was employed to determine the noise type in speech-absent frames. DNN was used to model the relationship between noisy observation and clean speech. Once the noise type was determined, the corresponding DNN model was applied to enhance the noisy speech. GMM was trained with mel-frequency cepstrum coefficients (MFCC) and the parameters were estimated with an iterative expectation-maximization (EM) algorithm. Noise type was updated by spectrum entropy-based voice activity detection (VAD). Experimental results demonstrate that the proposed method could achieve better objective speech quality and smaller distortion under stationary and non-stationary conditions.
Multivariate Cryptography Based on Clipped Hopfield Neural Network.
Wang, Jia; Cheng, Lee-Ming; Su, Tong
2018-02-01
Designing secure and efficient multivariate public key cryptosystems [multivariate cryptography (MVC)] to strengthen the security of RSA and ECC in conventional and quantum computational environment continues to be a challenging research in recent years. In this paper, we will describe multivariate public key cryptosystems based on extended Clipped Hopfield Neural Network (CHNN) and implement it using the MVC (CHNN-MVC) framework operated in space. The Diffie-Hellman key exchange algorithm is extended into the matrix field, which illustrates the feasibility of its new applications in both classic and postquantum cryptography. The efficiency and security of our proposed new public key cryptosystem CHNN-MVC are simulated and found to be NP-hard. The proposed algorithm will strengthen multivariate public key cryptosystems and allows hardware realization practicality.
Finger vein recognition based on convolutional neural network
Directory of Open Access Journals (Sweden)
Meng Gesi
2017-01-01
Full Text Available Biometric Authentication Technology has been widely used in this information age. As one of the most important technology of authentication, finger vein recognition attracts our attention because of its high security, reliable accuracy and excellent performance. However, the current finger vein recognition system is difficult to be applied widely because its complicated image pre-processing and not representative feature vectors. To solve this problem, a finger vein recognition method based on the convolution neural network (CNN is proposed in the paper. The image samples are directly input into the CNN model to extract its feature vector so that we can make authentication by comparing the Euclidean distance between these vectors. Finally, the Deep Learning Framework Caffe is adopted to verify this method. The result shows that there are great improvements in both speed and accuracy rate compared to the previous research. And the model has nice robustness in illumination and rotation.
Route Selection Problem Based on Hopfield Neural Network
Directory of Open Access Journals (Sweden)
N. Kojic
2013-12-01
Full Text Available Transport network is a key factor of economic, social and every other form of development in the region and the state itself. One of the main conditions for transport network development is the construction of new routes. Often, the construction of regional roads is dominant, since the design and construction in urban areas is quite limited. The process of analysis and planning the new roads is a complex process that depends on many factors (the physical characteristics of the terrain, the economic situation, political decisions, environmental impact, etc. and can take several months. These factors directly or indirectly affect the final solution, and in combination with project limitations and requirements, sometimes can be mutually opposed. In this paper, we present one software solution that aims to find Pareto optimal path for preliminary design of the new roadway. The proposed algorithm is based on many different factors (physical and social with the ability of their increase. This solution is implemented using Hopfield's neural network, as a kind of artificial intelligence, which has shown very good results for solving complex optimization problems.
RAM-based neural networks for data mining applications
Agehed, Kenneth I.; Eide, Age J.; Lindblad, Thomas; Lindsey, Clark S.; Szekely, Geza; Waldemark, Joakim T. A.; Waldemark, Karina E.
1999-03-01
We discuss possible new hardware and software techniques for handling very large databases such as image archives. In particular, we investigate how high capacity solid-state `disks' could be used to speed the database processing by algorithms that require considerably memory space. One such algorithm, for example, called the RAM neural network, or weightless neural network, needs a number of large lookup tables to perform most efficiently. The solid state disks could provide fast storage both for the algorithm and the data. We also briefly discuss development of an algorithm to cluster images of similar objects. This algorithm could also benefit from a large cache of fast memory storage.
Introduction to neural networks
James, Frederick E
1994-02-02
1. Introduction and overview of Artificial Neural Networks. 2,3. The Feed-forward Network as an inverse Problem, and results on the computational complexity of network training. 4.Physics applications of neural networks.
Padgett, Mary L.; Desai, Utpal; Roppel, T.A.; White, Charles R.
1993-01-01
A design procedure is suggested for neural networks which accommodates the inclusion of such knowledge-based systems techniques as fuzzy logic and pairwise comparisons. The use of these procedures in the design of applications combines qualitative and quantitative factors with empirical data to yield a model with justifiable design and parameter selection procedures. The procedure is especially relevant to areas of back-propagation neural network design which are highly responsive to the use of precisely recorded expert knowledge.
Directory of Open Access Journals (Sweden)
Haibo Zhang
2016-08-01
Full Text Available The security incidents ion networks are sudden and uncertain, it is very hard to precisely predict the network security situation by traditional methods. In order to improve the prediction accuracy of the network security situation, we build a network security situation prediction model based on Wavelet Neural Network (WNN with optimized parameters by the Improved Niche Genetic Algorithm (INGA. The proposed model adopts WNN which has strong nonlinear ability and fault-tolerance performance. Also, the parameters for WNN are optimized through the adaptive genetic algorithm (GA so that WNN searches more effectively. Considering the problem that the adaptive GA converges slowly and easily turns to the premature problem, we introduce a novel niche technology with a dynamic fuzzy clustering and elimination mechanism to solve the premature convergence of the GA. Our final simulation results show that the proposed INGA-WNN prediction model is more reliable and effective, and it achieves faster convergence-speed and higher prediction accuracy than the Genetic Algorithm-Wavelet Neural Network (GA-WNN, Genetic Algorithm-Back Propagation Neural Network (GA-BPNN and WNN.
Web based educational tool for neural network robot control
Directory of Open Access Journals (Sweden)
Jure Čas
2007-05-01
Full Text Available Abstract— This paper describes the application for teleoperations of the SCARA robot via the internet. The SCARA robot is used by students of mehatronics at the University of Maribor as a remote educational tool. The developed software consists of two parts i.e. the continuous neural network sliding mode controller (CNNSMC and the graphical user interface (GUI. Application is based on two well-known commercially available software packages i.e. MATLAB/Simulink and LabVIEW. Matlab/Simulink and the DSP2 Library for Simulink are used for control algorithm development, simulation and executable code generation. While this code is executing on the DSP-2 Roby controller and through the analog and digital I/O lines drives the real process, LabVIEW virtual instrument (VI, running on the PC, is used as a user front end. LabVIEW VI provides the ability for on-line parameter tuning, signal monitoring, on-line analysis and via Remote Panels technology also teleoperation. The main advantage of a CNNSMC is the exploitation of its self-learning capability. When friction or an unexpected impediment occurs for example, the user of a remote application has no information about any changed robot dynamic and thus is unable to dispatch it manually. This is not a control problem anymore because, when a CNNSMC is used, any approximation of changed robot dynamic is estimated independently of the remote’s user. Index Terms—LabVIEW; Matlab/Simulink; Neural network control; remote educational tool; robotics
Spiking neural network-based control chart pattern recognition
Directory of Open Access Journals (Sweden)
Medhat H.A. Awadalla
2012-03-01
Full Text Available Due to an increasing competition in products, consumers have become more critical in choosing products. The quality of products has become more important. Statistical Process Control (SPC is usually used to improve the quality of products. Control charting plays the most important role in SPC. Control charts help to monitor the behavior of the process to determine whether it is stable or not. Unnatural patterns in control charts mean that there are some unnatural causes for variations in SPC. Spiking neural networks (SNNs are the third generation of artificial neural networks that consider time as an important feature for information representation and processing. In this paper, a spiking neural network architecture is proposed to be used for control charts pattern recognition (CCPR. Furthermore, enhancements to the SpikeProp learning algorithm are proposed. These enhancements provide additional learning rules for the synaptic delays, time constants and for the neurons thresholds. Simulated experiments have been conducted and the achieved results show a remarkable improvement in the overall performance compared with artificial neural networks.
Active Control of Sound based on Diagonal Recurrent Neural Network
Jayawardhana, Bayu; Xie, Lihua; Yuan, Shuqing
2002-01-01
Recurrent neural network has been known for its dynamic mapping and better suited for nonlinear dynamical system. Nonlinear controller may be needed in cases where the actuators exhibit the nonlinear characteristics, or in cases when the structure to be controlled exhibits nonlinear behavior. The
Artificial-neural-network-based failure detection and isolation
Sadok, Mokhtar; Gharsalli, Imed; Alouani, Ali T.
1998-03-01
This paper presents the design of a systematic failure detection and isolation system that uses the concept of failure sensitive variables (FSV) and artificial neural networks (ANN). The proposed approach was applied to tube leak detection in a utility boiler system. Results of the experimental testing are presented in the paper.
RBF neural network based H∞ synchronization for unknown chaotic ...
Indian Academy of Sciences (India)
Radial Basis Function Neural Network H∞ synchronization (RBFNNHS) strategy, for unknown chaotic systems in ... lation, the RBFNNHS controller and the learning laws are presented to reduce the effect of disturbance to an ... unknown chaotic systems; linear matrix inequality (LMI); learning law. 1. Introduction. Since the ...
The harmonics detection method based on neural network applied ...
African Journals Online (AJOL)
user
with MATLAB Simulink Power System Toolbox. The simulation study results of this novel technique compared to other similar methods are found quite satisfactory by assuring good filtering characteristics and high system stability. Keywords: Artificial Neural Networks (ANN), p-q theory, (SAPF), Harmonics, Total Harmonic ...
A neural network based seafloor classification using acoustic backscatter
Digital Repository Service at National Institute of Oceanography (India)
Chakraborty, B.
This paper presents a study results of the Artificial Neural Network (ANN) architectures [Self-Organizing Map (SOM) and Multi-Layer Perceptron (MLP)] using single beam echosounding data. The single beam echosounder, operable at 12 kHz, has been used...
RBF neural network based H∞ synchronization for unknown chaotic ...
Indian Academy of Sciences (India)
control (Bai & Lonngen 1997, Bai & Lonngren 2000), time-delay feedback approach (Park. 2005, Ahn 2010), backstepping design technique (Wu & Lu 2003, Hu et al 2005), complete synchronization (Zhan et al 2003), and so on, have been successfully applied to the chaos synchronization. In recent years, neural networks ...
Neural Network Based Load Frequency Control for Restructuring ...
African Journals Online (AJOL)
The comparison between a conventional Proportional Integral (PI) controller and the proposed artificial neural networks controller is showed that the proposed controller can generate an improved ... The same technique is then applied to control a system compose of two single units tied together though a power line.
International Nuclear Information System (INIS)
Peng Yafu; Hsu, C.-F.
2009-01-01
This paper proposes an identification-based adaptive backstepping control (IABC) for the chaotic systems. The IABC system is comprised of a neural backstepping controller and a robust compensation controller. The neural backstepping controller containing a self-organizing fuzzy neural network (SOFNN) identifier is the principal controller, and the robust compensation controller is designed to dispel the effect of minimum approximation error introduced by the SOFNN identifier. The SOFNN identifier is used to online estimate the chaotic dynamic function with structure and parameter learning phases of fuzzy neural network. The structure learning phase consists of the growing and pruning of fuzzy rules; thus the SOFNN identifier can avoid the time-consuming trial-and-error tuning procedure for determining the neural structure of fuzzy neural network. The parameter learning phase adjusts the interconnection weights of neural network to achieve favorable approximation performance. Finally, simulation results verify that the proposed IABC can achieve favorable tracking performance.
Toward Content Based Image Retrieval with Deep Convolutional Neural Networks.
Sklan, Judah E S; Plassard, Andrew J; Fabbri, Daniel; Landman, Bennett A
2015-03-19
Content-based image retrieval (CBIR) offers the potential to identify similar case histories, understand rare disorders, and eventually, improve patient care. Recent advances in database capacity, algorithm efficiency, and deep Convolutional Neural Networks (dCNN), a machine learning technique, have enabled great CBIR success for general photographic images. Here, we investigate applying the leading ImageNet CBIR technique to clinically acquired medical images captured by the Vanderbilt Medical Center. Briefly, we (1) constructed a dCNN with four hidden layers, reducing dimensionality of an input scaled to 128×128 to an output encoded layer of 4×384, (2) trained the network using back-propagation 1 million random magnetic resonance (MR) and computed tomography (CT) images, (3) labeled an independent set of 2100 images, and (4) evaluated classifiers on the projection of the labeled images into manifold space. Quantitative results were disappointing (averaging a true positive rate of only 20%); however, the data suggest that improvements would be possible with more evenly distributed sampling across labels and potential re-grouping of label structures. This prelimainry effort at automated classification of medical images with ImageNet is promising, but shows that more work is needed beyond direct adaptation of existing techniques.
Three neural network based sensor systems for environmental monitoring
International Nuclear Information System (INIS)
Keller, P.E.; Kouzes, R.T.; Kangas, L.J.
1994-05-01
Compact, portable systems capable of quickly identifying contaminants in the field are of great importance when monitoring the environment. One of the missions of the Pacific Northwest Laboratory is to examine and develop new technologies for environmental restoration and waste management at the Hanford Site. In this paper, three prototype sensing systems are discussed. These prototypes are composed of sensing elements, data acquisition system, computer, and neural network implemented in software, and are capable of automatically identifying contaminants. The first system employs an array of tin-oxide gas sensors and is used to identify chemical vapors. The second system employs an array of optical sensors and is used to identify the composition of chemical dyes in liquids. The third system contains a portable gamma-ray spectrometer and is used to identify radioactive isotopes. In these systems, the neural network is used to identify the composition of the sensed contaminant. With a neural network, the intense computation takes place during the training process. Once the network is trained, operation consists of propagating the data through the network. Since the computation involved during operation consists of vector-matrix multiplication and application of look-up tables unknown samples can be rapidly identified in the field
Neural network predicts sequence of TP53 gene based on DNA chip
DEFF Research Database (Denmark)
Spicker, J.S.; Wikman, F.; Lu, M.L.
2002-01-01
We have trained an artificial neural network to predict the sequence of the human TP53 tumor suppressor gene based on a p53 GeneChip. The trained neural network uses as input the fluorescence intensities of DNA hybridized to oligonucleotides on the surface of the chip and makes between zero...
Introduction to neural networks
International Nuclear Information System (INIS)
Pavlopoulos, P.
1996-01-01
This lecture is a presentation of today's research in neural computation. Neural computation is inspired by knowledge from neuro-science. It draws its methods in large degree from statistical physics and its potential applications lie mainly in computer science and engineering. Neural networks models are algorithms for cognitive tasks, such as learning and optimization, which are based on concepts derived from research into the nature of the brain. The lecture first gives an historical presentation of neural networks development and interest in performing complex tasks. Then, an exhaustive overview of data management and networks computation methods is given: the supervised learning and the associative memory problem, the capacity of networks, the Perceptron networks, the functional link networks, the Madaline (Multiple Adalines) networks, the back-propagation networks, the reduced coulomb energy (RCE) networks, the unsupervised learning and the competitive learning and vector quantization. An example of application in high energy physics is given with the trigger systems and track recognition system (track parametrization, event selection and particle identification) developed for the CPLEAR experiment detectors from the LEAR at CERN. (J.S.). 56 refs., 20 figs., 1 tab., 1 appendix
Variance decomposition-based sensitivity analysis via neural networks
International Nuclear Information System (INIS)
Marseguerra, Marzio; Masini, Riccardo; Zio, Enrico; Cojazzi, Giacomo
2003-01-01
This paper illustrates a method for efficiently performing multiparametric sensitivity analyses of the reliability model of a given system. These analyses are of great importance for the identification of critical components in highly hazardous plants, such as the nuclear or chemical ones, thus providing significant insights for their risk-based design and management. The technique used to quantify the importance of a component parameter with respect to the system model is based on a classical decomposition of the variance. When the model of the system is realistically complicated (e.g. by aging, stand-by, maintenance, etc.), its analytical evaluation soon becomes impractical and one is better off resorting to Monte Carlo simulation techniques which, however, could be computationally burdensome. Therefore, since the variance decomposition method requires a large number of system evaluations, each one to be performed by Monte Carlo, the need arises for possibly substituting the Monte Carlo simulation model with a fast, approximated, algorithm. Here we investigate an approach which makes use of neural networks appropriately trained on the results of a Monte Carlo system reliability/availability evaluation to quickly provide with reasonable approximation, the values of the quantities of interest for the sensitivity analyses. The work was a joint effort between the Department of Nuclear Engineering of the Polytechnic of Milan, Italy, and the Institute for Systems, Informatics and Safety, Nuclear Safety Unit of the Joint Research Centre in Ispra, Italy which sponsored the project
Electromyogram-based neural network control of transhumeral prostheses.
Pulliam, Christopher L; Lambrecht, Joris M; Kirsch, Robert F
2011-01-01
Upper-limb amputation can cause a great deal of functional impairment for patients, particularly for those with amputation at or above the elbow. Our long-term objective is to improve functional outcomes for patients with amputation by integrating a fully implanted electromyographic (EMG) recording system with a wireless telemetry system that communicates with the patient's prosthesis. We believe that this should generate a scheme that will allow patients to robustly control multiple degrees of freedom simultaneously. The goal of this study is to evaluate the feasibility of predicting dynamic arm movements (both flexion/extension and pronation/supination) based on EMG signals from a set of muscles that would likely be intact in patients with transhumeral amputation. We recorded movement kinematics and EMG signals from seven muscles during a variety of movements with different complexities. Time-delayed artificial neural networks were then trained offline to predict the measured arm trajectories based on features extracted from the measured EMG signals. We evaluated the relative effectiveness of various muscle subsets. Predicted movement trajectories had average root-mean-square errors of approximately 15.7° and 24.9° and average R(2) values of approximately 0.81 and 0.46 for elbow flexion/extension and forearm pronation/supination, respectively.
Neural Network Based Indexing and Recognition of Power Quality Disturbances
Directory of Open Access Journals (Sweden)
Ram Awtar Gupta
2011-08-01
Full Text Available Power quality (PQ analysis has become imperative for utilities as well as for consumers due to huge cost burden of poor power quality. Accurate recognition of PQ disturbances is still a challenging task, whereas methods for its indexing are not much investigated yet. This paper expounds a system, which includes generation of unique patterns called signatures of various PQ disturbances using continuous wavelet transform (CWT and recognition of these signatures using feed-forward neural network. It is also corroborated that the size of signatures of PQ disturbances are proportional to its magnitude, so this feature of the signature is used for indexing the level of PQ disturbance in three sub-classes viz. high, medium, and low. Further, the effect of number of neurons used by neural network on the performance of recognition is also analyzed. Almost 100% accuracy of recognition substantiates the effectiveness of the proposed system.
Memristor-based neural networks: Synaptic versus neuronal stochasticity
Naous, Rawan
2016-11-02
In neuromorphic circuits, stochasticity in the cortex can be mapped into the synaptic or neuronal components. The hardware emulation of these stochastic neural networks are currently being extensively studied using resistive memories or memristors. The ionic process involved in the underlying switching behavior of the memristive elements is considered as the main source of stochasticity of its operation. Building on its inherent variability, the memristor is incorporated into abstract models of stochastic neurons and synapses. Two approaches of stochastic neural networks are investigated. Aside from the size and area perspective, the impact on the system performance, in terms of accuracy, recognition rates, and learning, among these two approaches and where the memristor would fall into place are the main comparison points to be considered.
Automatic Pavement Crack Recognition Based on BP Neural Network
Li, Li; Sun, Lijun; Ning, Guobao; Tan, Shengguang
2014-01-01
A feasible pavement crack detection system plays an important role in evaluating the road condition and providing the necessary road maintenance. In this paper, a back propagation neural network (BPNN) is used to recognize pavement cracks from images. To improve the recognition accuracy of the BPNN, a complete framework of image processing is proposed including image preprocessing and crack information extraction. In this framework, the redundant image information is reduced as much as possib...
Hazardous Odor Recognition by CMAC Based Neural Networks
Bucak, İhsan Ömür; Karlık, Bekir
2009-01-01
Electronic noses are being developed as systems for the automated detection and classification of odors, vapors, and gases. Artificial neural networks (ANNs) have been used to analyze complex data and to recognize patterns, and have shown promising results in recognition of volatile compounds and odors in electronic nose applications. When an ANN is combined with a sensor array, the number of detectable chemicals is generally greater than the number of unique sensor types. The odor sensing sy...
An Attractor-Based Complexity Measurement for Boolean Recurrent Neural Networks
Cabessa, Jérémie; Villa, Alessandro E. P.
2014-01-01
We provide a novel refined attractor-based complexity measurement for Boolean recurrent neural networks that represents an assessment of their computational power in terms of the significance of their attractor dynamics. This complexity measurement is achieved by first proving a computational equivalence between Boolean recurrent neural networks and some specific class of -automata, and then translating the most refined classification of -automata to the Boolean neural network context. As a result, a hierarchical classification of Boolean neural networks based on their attractive dynamics is obtained, thus providing a novel refined attractor-based complexity measurement for Boolean recurrent neural networks. These results provide new theoretical insights to the computational and dynamical capabilities of neural networks according to their attractive potentialities. An application of our findings is illustrated by the analysis of the dynamics of a simplified model of the basal ganglia-thalamocortical network simulated by a Boolean recurrent neural network. This example shows the significance of measuring network complexity, and how our results bear new founding elements for the understanding of the complexity of real brain circuits. PMID:24727866
Risk assessment of logistics outsourcing based on BP neural network
Liu, Xiaofeng; Tian, Zi-you
The purpose of this article is to evaluate the risk of the enterprises logistics outsourcing. To get this goal, the paper first analysed he main risks existing in the logistics outsourcing, and then set up a risk evaluation index system of the logistics outsourcing; second applied BP neural network into the logistics outsourcing risk evaluation and used MATLAB to the simulation. It proved that the network error is small and has strong practicability. And this method can be used by enterprises to evaluate the risks of logistics outsourcing.
Neural-network-based depth computation for blind navigation
Wong, Farrah; Nagarajan, Ramachandran R.; Yaacob, Sazali
2004-12-01
A research undertaken to help blind people to navigate autonomously or with minimum assistance is termed as "Blind Navigation". In this research, an aid that could help blind people in their navigation is proposed. Distance serves as an important clue during our navigation. A stereovision navigation aid implemented with two digital video cameras that are spaced apart and fixed on a headgear to obtain the distance information is presented. In this paper, a neural network methodology is used to obtain the required parameters of the camera which is known as camera calibration. These parameters are not known but obtained by adjusting the weights in the network. The inputs to the network consist of the matching features in the stereo pair images. A back propagation network with 16-input neurons, 3 hidden neurons and 1 output neuron, which gives depth, is created. The distance information is incorporated into the final processed image as four gray levels such as white, light gray, dark gray and black. Preliminary results have shown that the percentage errors fall below 10%. It is envisaged that the distance provided by neural network shall enable blind individuals to go near and pick up an object of interest.
Animal Recognition System Based on Convolutional Neural Network
Directory of Open Access Journals (Sweden)
Tibor Trnovszky
2017-01-01
Full Text Available In this paper, the performances of well-known image recognition methods such as Principal Component Analysis (PCA, Linear Discriminant Analysis (LDA, Local Binary Patterns Histograms (LBPH and Support Vector Machine (SVM are tested and compared with proposed convolutional neural network (CNN for the recognition rate of the input animal images. In our experiments, the overall recognition accuracy of PCA, LDA, LBPH and SVM is demonstrated. Next, the time execution for animal recognition process is evaluated. The all experimental results on created animal database were conducted. This created animal database consist of 500 different subjects (5 classes/ 100 images for each class. The experimental result shows that the PCA features provide better results as LDA and LBPH for large training set. On the other hand, LBPH is better than PCA and LDA for small training data set. For proposed CNN we have obtained a recognition accuracy of 98%. The proposed method based on CNN outperforms the state of the art methods.
Heartbeat classification system based on neural networks and dimensionality reduction
Directory of Open Access Journals (Sweden)
Rodolfo de Figueiredo Dalvi
Full Text Available Abstract Introduction This paper presents a complete approach for the automatic classification of heartbeats to assist experts in the diagnosis of typical arrhythmias, such as right bundle branch block, left bundle branch block, premature ventricular beats, premature atrial beats and paced beats. Methods A pre-processing step was performed on the electrocardiograms (ECG for baseline removal. Next, a QRS complex detection algorithm was implemented to detect the heartbeats, which contain the primary information that is employed in the classification approach. Next, ECG segmentation was performed, by which a set of features based on the RR interval and the beat waveform morphology were extracted from the ECG signal. The size of the feature vector was reduced by principal component analysis. Finally, the reduced feature vector was employed as the input to an artificial neural network. Results Our approach was tested on the Massachusetts Institute of Technology arrhythmia database. The classification performance on a test set of 18 ECG records of 30 min each achieved an accuracy of 96.97%, a sensitivity of 95.05%, a specificity of 90.88%, a positive predictive value of 95.11%, and a negative predictive value of 92.7%. Conclusion The proposed approach achieved high accuracy for classifying ECG heartbeats and could be used to assist cardiologists in telecardiology services. The main contribution of our classification strategy is in the feature selection step, which reduced classification complexity without major changes in the performance.
Artificial Neural Network-Based System for PET Volume Segmentation
Directory of Open Access Journals (Sweden)
Mhd Saeed Sharif
2010-01-01
Full Text Available Tumour detection, classification, and quantification in positron emission tomography (PET imaging at early stage of disease are important issues for clinical diagnosis, assessment of response to treatment, and radiotherapy planning. Many techniques have been proposed for segmenting medical imaging data; however, some of the approaches have poor performance, large inaccuracy, and require substantial computation time for analysing large medical volumes. Artificial intelligence (AI approaches can provide improved accuracy and save decent amount of time. Artificial neural networks (ANNs, as one of the best AI techniques, have the capability to classify and quantify precisely lesions and model the clinical evaluation for a specific problem. This paper presents a novel application of ANNs in the wavelet domain for PET volume segmentation. ANN performance evaluation using different training algorithms in both spatial and wavelet domains with a different number of neurons in the hidden layer is also presented. The best number of neurons in the hidden layer is determined according to the experimental results, which is also stated Levenberg-Marquardt backpropagation training algorithm as the best training approach for the proposed application. The proposed intelligent system results are compared with those obtained using conventional techniques including thresholding and clustering based approaches. Experimental and Monte Carlo simulated PET phantom data sets and clinical PET volumes of nonsmall cell lung cancer patients were utilised to validate the proposed algorithm which has demonstrated promising results.
Artificial Neural Network-Based System for PET Volume Segmentation.
Sharif, Mhd Saeed; Abbod, Maysam; Amira, Abbes; Zaidi, Habib
2010-01-01
Tumour detection, classification, and quantification in positron emission tomography (PET) imaging at early stage of disease are important issues for clinical diagnosis, assessment of response to treatment, and radiotherapy planning. Many techniques have been proposed for segmenting medical imaging data; however, some of the approaches have poor performance, large inaccuracy, and require substantial computation time for analysing large medical volumes. Artificial intelligence (AI) approaches can provide improved accuracy and save decent amount of time. Artificial neural networks (ANNs), as one of the best AI techniques, have the capability to classify and quantify precisely lesions and model the clinical evaluation for a specific problem. This paper presents a novel application of ANNs in the wavelet domain for PET volume segmentation. ANN performance evaluation using different training algorithms in both spatial and wavelet domains with a different number of neurons in the hidden layer is also presented. The best number of neurons in the hidden layer is determined according to the experimental results, which is also stated Levenberg-Marquardt backpropagation training algorithm as the best training approach for the proposed application. The proposed intelligent system results are compared with those obtained using conventional techniques including thresholding and clustering based approaches. Experimental and Monte Carlo simulated PET phantom data sets and clinical PET volumes of nonsmall cell lung cancer patients were utilised to validate the proposed algorithm which has demonstrated promising results.
A neural network based model for urban noise prediction.
Genaro, N; Torija, A; Ramos-Ridao, A; Requena, I; Ruiz, D P; Zamorano, M
2010-10-01
Noise is a global problem. In 1972 the World Health Organization (WHO) classified noise as a pollutant. Since then, most industrialized countries have enacted laws and local regulations to prevent and reduce acoustic environmental pollution. A further aim is to alert people to the dangers of this type of pollution. In this context, urban planners need to have tools that allow them to evaluate the degree of acoustic pollution. Scientists in many countries have modeled urban noise, using a wide range of approaches, but their results have not been as good as expected. This paper describes a model developed for the prediction of environmental urban noise using Soft Computing techniques, namely Artificial Neural Networks (ANN). The model is based on the analysis of variables regarded as influential by experts in the field and was applied to data collected on different types of streets. The results were compared to those obtained with other models. The study found that the ANN system was able to predict urban noise with greater accuracy, and thus, was an improvement over those models. The principal component analysis (PCA) was also used to try to simplify the model. Although there was a slight decline in the accuracy of the results, the values obtained were also quite acceptable.
Didactic Strategy Discussion Based on Artificial Neural Networks Results.
Andina, D.; Bermúdez-Valbuena, R.
2009-04-01
Artificial Neural Networks (ANNs) are a mathematical model of the main known characteristics of biological brian dynamics. ANNs inspired in biological reality have been useful to design machines that show some human-like behaviours. Based on them, many experimentes have been succesfully developed emulating several biologial neurons characteristics, as learning how to solve a given problem. Sometimes, experimentes on ANNs feedback to biology and allow advances in understanding the biological brian behaviour, allowing the proposal of new therapies for medical problems involving neurons performing. Following this line, the author present results on artificial learning on ANN, and interpret them aiming to reinforce one of this two didactic estrategies to learn how to solve a given difficult task: a) To train with clear, simple, representative examples and feel confidence in brian generalization capabilities to achieve succes in more complicated cases. b) To teach with a set of difficult cases of the problem feeling confidence that the brian will efficiently solve the rest of cases if it is able to solve the difficult ones. Results may contribute in the discussion of how to orientate the design innovative succesful teaching strategies in the education field.
Noisy Ocular Recognition Based on Three Convolutional Neural Networks
Directory of Open Access Journals (Sweden)
Min Beom Lee
2017-12-01
Full Text Available In recent years, the iris recognition system has been gaining increasing acceptance for applications such as access control and smartphone security. When the images of the iris are obtained under unconstrained conditions, an issue of undermined quality is caused by optical and motion blur, off-angle view (the user’s eyes looking somewhere else, not into the front of the camera, specular reflection (SR and other factors. Such noisy iris images increase intra-individual variations and, as a result, reduce the accuracy of iris recognition. A typical iris recognition system requires a near-infrared (NIR illuminator along with an NIR camera, which are larger and more expensive than fingerprint recognition equipment. Hence, many studies have proposed methods of using iris images captured by a visible light camera without the need for an additional illuminator. In this research, we propose a new recognition method for noisy iris and ocular images by using one iris and two periocular regions, based on three convolutional neural networks (CNNs. Experiments were conducted by using the noisy iris challenge evaluation-part II (NICE.II training dataset (selected from the university of Beira iris (UBIRIS.v2 database, mobile iris challenge evaluation (MICHE database, and institute of automation of Chinese academy of sciences (CASIA-Iris-Distance database. As a result, the method proposed by this study outperformed previous methods.
Low-dimensional recurrent neural network-based Kalman filter for speech enhancement.
Xia, Youshen; Wang, Jun
2015-07-01
This paper proposes a new recurrent neural network-based Kalman filter for speech enhancement, based on a noise-constrained least squares estimate. The parameters of speech signal modeled as autoregressive process are first estimated by using the proposed recurrent neural network and the speech signal is then recovered from Kalman filtering. The proposed recurrent neural network is globally asymptomatically stable to the noise-constrained estimate. Because the noise-constrained estimate has a robust performance against non-Gaussian noise, the proposed recurrent neural network-based speech enhancement algorithm can minimize the estimation error of Kalman filter parameters in non-Gaussian noise. Furthermore, having a low-dimensional model feature, the proposed neural network-based speech enhancement algorithm has a much faster speed than two existing recurrent neural networks-based speech enhancement algorithms. Simulation results show that the proposed recurrent neural network-based speech enhancement algorithm can produce a good performance with fast computation and noise reduction. Copyright © 2015 Elsevier Ltd. All rights reserved.
Forecasting of Market Clearing Price by Using GA Based Neural Network
Yang, Bo; Chen, Yun-Ping; Zhao, Zun-Lian; Han, Qi-Ye
Forecasting of Market Clearing Price (MCP) is important to economic benefits of electricity market participants. To accurately forecast MCP, a novel two-stage GA-based neural network model (GA-NN) is proposed. In the first stage, GA chromosome is designed into two parts: boolean coding part for neural network topology and real coding part for connection weights. By hybrid genetic operation of selection, crossover and mutation under the criterion of error minimization between the actual output and the desired output, optimal architecture of neural network is obtained. In the second stage, gradient learning algorithm with momentum rate is imposed on neural network with optimal architecture. After learning process, optimal connection weights are obtained. The proposed model is tested on MCP forecasting in California electricity market. The test results show that GA-NN has self-adaptive ability in its topology and connection weights and can obtain more accurate MCP forecasting values than BP neural network.
PID Neural Network Based Speed Control of Asynchronous Motor Using Programmable Logic Controller
Directory of Open Access Journals (Sweden)
MARABA, V. A.
2011-11-01
Full Text Available This paper deals with the structure and characteristics of PID Neural Network controller for single input and single output systems. PID Neural Network is a new kind of controller that includes the advantages of artificial neural networks and classic PID controller. Functioning of this controller is based on the update of controller parameters according to the value extracted from system output pursuant to the rules of back propagation algorithm used in artificial neural networks. Parameters obtained from the application of PID Neural Network training algorithm on the speed model of the asynchronous motor exhibiting second order linear behavior were used in the real time speed control of the motor. Programmable logic controller (PLC was used as real time controller. The real time control results show that reference speed successfully maintained under various load conditions.
Extended Kalman Filter Based Neural Networks Controller For Hot Strip Rolling mill
International Nuclear Information System (INIS)
Moussaoui, A. K.; Abbassi, H. A.; Bouazza, S.
2008-01-01
The present paper deals with the application of an Extended Kalman filter based adaptive Neural-Network control scheme to improve the performance of a hot strip rolling mill. The suggested Neural Network model was implemented using Bayesian Evidence based training algorithm. The control input was estimated iteratively by an on-line extended Kalman filter updating scheme basing on the inversion of the learned neural networks model. The performance of the controller is evaluated using an accurate model estimated from real rolling mill input/output data, and the usefulness of the suggested method is proved
Research on quasi-dynamic calibration model of plastic sensitive element based on neural networks
Wang, Fang; Kong, Deren; Yang, Lixia; Zhang, Zouzou
2017-08-01
Quasi-dynamic calibration accuracy of the plastic sensitive element depends on the accuracy of the fitting model between pressure and deformation. By using the excellent nonlinear mapping ability of RBF (Radial Basis Function) neural network, a calibration model is established which use the peak pressure as the input and use the deformation of the plastic sensitive element as the output in this paper. The calibration experiments of a batch of copper cylinders are carried out on the quasi-dynamic pressure calibration device, which pressure range is within the range of 200MPa to 700MPa. The experiment data are acquired according to the standard pressure monitoring system. The network train and study are done to quasi dynamic calibration model based on neural network by using MATLAB neural network toolbox. Taking the testing samples as the research object, the prediction accuracy of neural network model is compared with the exponential fitting model and the second-order polynomial fitting model. The results show that prediction of the neural network model is most close to the testing samples, and the accuracy of prediction model based on neural network is better than 0.5%, respectively one order higher than the second-order polynomial fitting model and two orders higher than the exponential fitting model. The quasi-dynamic calibration model between pressure peak and deformation of plastic sensitive element, which is based on neural network, provides important basis for creating higher accuracy quasi-dynamic calibration table.
Energy Technology Data Exchange (ETDEWEB)
Ritter, G.X.; Sussner, P. [Univ. of Florida, Gainesville, FL (United States)
1996-12-31
The theory of artificial neural networks has been successfully applied to a wide variety of pattern recognition problems. In this theory, the first step in computing the next state of a neuron or in performing the next layer neural network computation involves the linear operation of multiplying neural values by their synaptic strengths and adding the results. Thresholding usually follows the linear operation in order to provide for nonlinearity of the network. In this paper we introduce a novel class of neural networks, called morphological neural networks, in which the operations of multiplication and addition are replaced by addition and maximum (or minimum), respectively. By taking the maximum (or minimum) of sums instead of the sum of products, morphological network computation is nonlinear before thresholding. As a consequence, the properties of morphological neural networks are drastically different than those of traditional neural network models. In this paper we consider some of these differences and provide some particular examples of morphological neural network.
Neural network based adaptive control for nonlinear dynamic regimes
Shin, Yoonghyun
Adaptive control designs using neural networks (NNs) based on dynamic inversion are investigated for aerospace vehicles which are operated at highly nonlinear dynamic regimes. NNs play a key role as the principal element of adaptation to approximately cancel the effect of inversion error, which subsequently improves robustness to parametric uncertainty and unmodeled dynamics in nonlinear regimes. An adaptive control scheme previously named 'composite model reference adaptive control' is further developed so that it can be applied to multi-input multi-output output feedback dynamic inversion. It can have adaptive elements in both the dynamic compensator (linear controller) part and/or in the conventional adaptive controller part, also utilizing state estimation information for NN adaptation. This methodology has more flexibility and thus hopefully greater potential than conventional adaptive designs for adaptive flight control in highly nonlinear flight regimes. The stability of the control system is proved through Lyapunov theorems, and validated with simulations. The control designs in this thesis also include the use of 'pseudo-control hedging' techniques which are introduced to prevent the NNs from attempting to adapt to various actuation nonlinearities such as actuator position and rate saturations. Control allocation is introduced for the case of redundant control effectors including thrust vectoring nozzles. A thorough comparison study of conventional and NN-based adaptive designs for a system under a limit cycle, wing-rock, is included in this research, and the NN-based adaptive control designs demonstrate their performances for two highly maneuverable aerial vehicles, NASA F-15 ACTIVE and FQM-117B unmanned aerial vehicle (UAV), operated under various nonlinearities and uncertainties.
Neural network based detection of hard exudates in retinal images.
García, María; Sánchez, Clara I; López, María I; Abásolo, Daniel; Hornero, Roberto
2009-01-01
Diabetic retinopathy (DR) is an important cause of visual impairment in developed countries. Automatic recognition of DR lesions in fundus images can contribute to the diagnosis of the disease. The aim of this study is to automatically detect one of these lesions, hard exudates (EXs), in order to help ophthalmologists in the diagnosis and follow-up of the disease. We propose an algorithm which includes a neural network (NN) classifier for this task. Three NN classifiers were investigated: multilayer perceptron (MLP), radial basis function (RBF) and support vector machine (SVM). Our database was composed of 117 images with variable colour, brightness, and quality. 50 of them (from DR patients) were used to train the NN classifiers and 67 (40 from DR patients and 27 from healthy retinas) to test the method. Using a lesion-based criterion, we achieved a mean sensitivity (SE(l)) of 88.14% and a mean positive predictive value (PPV(l)) of 80.72% for MLP. With RBF we obtained SE(l)=88.49% and PPV(l)=77.41%, while we reached SE(l)=87.61% and PPV(l)=83.51% using SVM. With an image-based criterion, a mean sensitivity (SE(i)) of 100%, a mean specificity (SP(i)) of 92.59% and a mean accuracy (AC(i)) of 97.01% were obtained with MLP. Using RBF we achieved SE(i)=100%, SP(i)=81.48% and AC(i)=92.54%. With SVM the image-based results were SE(i)=100%, SP(i)=77.78% and AC(i)=91.04%.
Moradi, Mohsen
2017-01-01
In this study we determined neural network weights and biases by Imperialist Competitive Algorithm (ICA) in order to train network for predicting earthquake intensity in Richter. For this reason, we used dependent parameters like earthquake occurrence time, epicenter's latitude and longitude in degree, focal depth in kilometer, and the seismological center distance from epicenter and earthquake focal center in kilometer which has been provided by Berkeley data base. The studied neural network...
Xue, Y.; Liu, S.; Hu, Y.; Yang, J.; Chen, Q.
2007-01-01
To improve the accuracy in prediction, Genetic Algorithm based Adaptive Neural Network Ensemble (GA-ANNE) is presented. Intersections are allowed between different training sets based on the fuzzy clustering analysis, which ensures the diversity as well as the accuracy of individual Neural Networks (NNs). Moreover, to improve the accuracy of the adaptive weights of individual NNs, GA is used to optimize the cluster centers. Empirical results in predicting carbon flux of Duke Forest reveal that GA-ANNE can predict the carbon flux more accurately than Radial Basis Function Neural Network (RBFNN), Bagging NN ensemble, and ANNE. ?? 2007 IEEE.
Neuronal spike sorting based on radial basis function neural networks
Directory of Open Access Journals (Sweden)
Taghavi Kani M
2011-02-01
Full Text Available "nBackground: Studying the behavior of a society of neurons, extracting the communication mechanisms of brain with other tissues, finding treatment for some nervous system diseases and designing neuroprosthetic devices, require an algorithm to sort neuralspikes automatically. However, sorting neural spikes is a challenging task because of the low signal to noise ratio (SNR of the spikes. The main purpose of this study was to design an automatic algorithm for classifying neuronal spikes that are emitted from a specific region of the nervous system."n "nMethods: The spike sorting process usually consists of three stages: detection, feature extraction and sorting. We initially used signal statistics to detect neural spikes. Then, we chose a limited number of typical spikes as features and finally used them to train a radial basis function (RBF neural network to sort the spikes. In most spike sorting devices, these signals are not linearly discriminative. In order to solve this problem, the aforesaid RBF neural network was used."n "nResults: After the learning process, our proposed algorithm classified any arbitrary spike. The obtained results showed that even though the proposed Radial Basis Spike Sorter (RBSS reached to the same error as the previous methods, however, the computational costs were much lower compared to other algorithms. Moreover, the competitive points of the proposed algorithm were its good speed and low computational complexity."n "nConclusion: Regarding the results of this study, the proposed algorithm seems to serve the purpose of procedures that require real-time processing and spike sorting.
Boosting feature selection for Neural Network based regression.
Bailly, Kevin; Milgram, Maurice
2009-01-01
The head pose estimation problem is well known to be a challenging task in computer vision and is a useful tool for several applications involving human-computer interaction. This problem can be stated as a regression one where the input is an image and the output is pan and tilt angles. Finding the optimal regression is a hard problem because of the high dimensionality of the input (number of image pixels) and the large variety of morphologies and illumination. We propose a new method combining a boosting strategy for feature selection and a neural network for the regression. Potential features are a very large set of Haar-like wavelets which are well known to be adapted to face image processing. To achieve the feature selection, a new Fuzzy Functional Criterion (FFC) is introduced which is able to evaluate the link between a feature and the output without any estimation of the joint probability density function as in the Mutual Information. The boosting strategy uses this criterion at each step: features are evaluated by the FFC using weights on examples computed from the error produced by the neural network trained at the previous step. Tests are carried out on the commonly used Pointing 04 database and compared with three state-of-the-art methods. We also evaluate the accuracy of the estimation on FacePix, a database with a high angular resolution. Our method is compared positively to a Convolutional Neural Network, which is well known to incorporate feature extraction in its first layers.
Experimental method to predict avalanches based on neural networks
Directory of Open Access Journals (Sweden)
V. V. Zhdanov
2016-01-01
Full Text Available The article presents results of experimental use of currently available statistical methods to classify the avalanche‑dangerous precipitations and snowfalls in the Kishi Almaty river basin. The avalanche service of Kazakhstan uses graphical methods for prediction of avalanches developed by I.V. Kondrashov and E.I. Kolesnikov. The main objective of this work was to develop a modern model that could be used directly at the avalanche stations. Classification of winter precipitations into dangerous snowfalls and non‑dangerous ones was performed by two following ways: the linear discriminant function (canonical analysis and artificial neural networks. Observational data on weather and avalanches in the gorge Kishi Almaty in the gorge Kishi Almaty were used as a training sample. Coefficients for the canonical variables were calculated by the software «Statistica» (Russian version 6.0, and then the necessary formula had been constructed. The accuracy of the above classification was 96%. Simulator by the authors L.N. Yasnitsky and F.М. Cherepanov was used to learn the neural networks. The trained neural network demonstrated 98% accuracy of the classification. Prepared statistical models are recommended to be tested at the snow‑avalanche stations. Results of the tests will be used for estimation of the model quality and its readiness for the operational work. In future, we plan to apply these models for classification of the avalanche danger by the five‑point international scale.
Computational neural network regression model for Host based Intrusion Detection System
Directory of Open Access Journals (Sweden)
Sunil Kumar Gautam
2016-09-01
Full Text Available The current scenario of information gathering and storing in secure system is a challenging task due to increasing cyber-attacks. There exists computational neural network techniques designed for intrusion detection system, which provide security to single machine and entire network's machine. In this paper, we have used two types of computational neural network models, namely, Generalized Regression Neural Network (GRNN model and Multilayer Perceptron Neural Network (MPNN model for Host based Intrusion Detection System using log files that are generated by a single personal computer. The simulation results show correctly classified percentage of normal and abnormal (intrusion class using confusion matrix. On the basis of results and discussion, we found that the Host based Intrusion Systems Model (HISM significantly improved the detection accuracy while retaining minimum false alarm rate.
artificial neural network (ann)
African Journals Online (AJOL)
2004-08-18
Aug 18, 2004 ... forecasting models and artificial intelligence techniques and have become one of the major research fields (Kher and Joshin, 2003). (a) Artificial Neural Network and Electrical Load. Prediction. Neural network analysis is an Artificial Intelligence. (AI) approach to mathematical modeling. Neural. Networks ...
Effects of Some Neurobiological Factors in a Self-organized Critical Model Based on Neural Networks
International Nuclear Information System (INIS)
Zhou Liming; Zhang Yingyue; Chen Tianlun
2005-01-01
Based on an integrate-and-fire mechanism, we investigate the effect of changing the efficacy of the synapse, the transmitting time-delayed, and the relative refractoryperiod on the self-organized criticality in our neural network model.
Study on pattern recognition of Raman spectrum based on fuzzy neural network
Zheng, Xiangxiang; Lv, Xiaoyi; Mo, Jiaqing
2017-10-01
Hydatid disease is a serious parasitic disease in many regions worldwide, especially in Xinjiang, China. Raman spectrum of the serum of patients with echinococcosis was selected as the research object in this paper. The Raman spectrum of blood samples from healthy people and patients with echinococcosis are measured, of which the spectrum characteristics are analyzed. The fuzzy neural network not only has the ability of fuzzy logic to deal with uncertain information, but also has the ability to store knowledge of neural network, so it is combined with the Raman spectrum on the disease diagnosis problem based on Raman spectrum. Firstly, principal component analysis (PCA) is used to extract the principal components of the Raman spectrum, reducing the network input and accelerating the prediction speed and accuracy of Network based on remaining the original data. Then, the information of the extracted principal component is used as the input of the neural network, the hidden layer of the network is the generation of rules and the inference process, and the output layer of the network is fuzzy classification output. Finally, a part of samples are randomly selected for the use of training network, then the trained network is used for predicting the rest of the samples, and the predicted results are compared with general BP neural network to illustrate the feasibility and advantages of fuzzy neural network. Success in this endeavor would be helpful for the research work of spectroscopic diagnosis of disease and it can be applied in practice in many other spectral analysis technique fields.
Ramamoorthy, P. A.; Huang, Song; Govind, Girish
1991-01-01
In fault diagnosis, control and real-time monitoring, both timing and accuracy are critical for operators or machines to reach proper solutions or appropriate actions. Expert systems are becoming more popular in the manufacturing community for dealing with such problems. In recent years, neural networks have revived and their applications have spread to many areas of science and engineering. A method of using neural networks to implement rule-based expert systems for time-critical applications is discussed here. This method can convert a given rule-based system into a neural network with fixed weights and thresholds. The rules governing the translation are presented along with some examples. We also present the results of automated machine implementation of such networks from the given rule-base. This significantly simplifies the translation process to neural network expert systems from conventional rule-based systems. Results comparing the performance of the proposed approach based on neural networks vs. the classical approach are given. The possibility of very large scale integration (VLSI) realization of such neural network expert systems is also discussed.
A teachable neural network based on an unorthodox neuron
Hoffmann, Geoffrey W.; Benson, Maurice W.; Bree, Geoffrey M.; Kinahan, Paul E.
1986-10-01
The analogy between the immune system network and the central nervous system network is the basis for the formulation of an unorthodox neural network model. A variation of a mathematical model that was developed for the immune system network is interpreted in the context of the central nervous system. This model involves a hypothetical neuron that exhibits hysteresis. The mathematical model of a network of N neurons is a system of N coupled ordinary differential equations that has almost 2N attractors. Numerical experiments are described that show it is possible to “teach” such a system to exhibit prespecified stimulus-response behavior, without the occurrence of changes in synaptic connection strengths. The learned information in this system resides in an N-dimensional state vector rather than in the N2 strengths of connections between neurons, which are held fixed. For the purposes of artificial intelligence applications, it is therefore possible to use synaptic connection matrices that have special symmetry properties, and for which rapid convolution computational techniques are applicable.
Parametrical neural network based on the four-wave mixing process
International Nuclear Information System (INIS)
Kryzhanovsky, B.V.; Litinskii, L.B.; Fonarev, A.
2003-01-01
We develop a formalism allowing us to describe operating of a network based on the parametrical four-wave mixing process that is well-known in nonlinear optics. It is shown that the storage capacity of such a network is higher compared with the Potts-glass neural networks
Battery Performance Modelling ad Simulation: a Neural Network Based Approach
Ottavianelli, Giuseppe; Donati, Alessandro
2002-01-01
This project has developed on the background of ongoing researches within the Control Technology Unit (TOS-OSC) of the Special Projects Division at the European Space Operations Centre (ESOC) of the European Space Agency. The purpose of this research is to develop and validate an Artificial Neural Network tool (ANN) able to model, simulate and predict the Cluster II battery system's performance degradation. (Cluster II mission is made of four spacecraft flying in tetrahedral formation and aimed to observe and study the interaction between sun and earth by passing in and out of our planet's magnetic field). This prototype tool, named BAPER and developed with a commercial neural network toolbox, could be used to support short and medium term mission planning in order to improve and maximise the batteries lifetime, determining which are the future best charge/discharge cycles for the batteries given their present states, in view of a Cluster II mission extension. This study focuses on the five Silver-Cadmium batteries onboard of Tango, the fourth Cluster II satellite, but time restrains have allowed so far to perform an assessment only on the first battery. In their most basic form, ANNs are hyper-dimensional curve fits for non-linear data. With their remarkable ability to derive meaning from complicated or imprecise history data, ANN can be used to extract patterns and detect trends that are too complex to be noticed by either humans or other computer techniques. ANNs learn by example, and this is why they can be described as an inductive, or data-based models for the simulation of input/target mappings. A trained ANN can be thought of as an "expert" in the category of information it has been given to analyse, and this expert can then be used, as in this project, to provide projections given new situations of interest and answer "what if" questions. The most appropriate algorithm, in terms of training speed and memory storage requirements, is clearly the Levenberg
The Evolution of Neural Network-Based Chart Patterns: A Preliminary Study
Ha, Myoung Hoon; Moon, Byung-Ro
2017-01-01
A neural network-based chart pattern represents adaptive parametric features, including non-linear transformations, and a template that can be applied in the feature space. The search of neural network-based chart patterns has been unexplored despite its potential expressiveness. In this paper, we formulate a general chart pattern search problem to enable cross-representational quantitative comparison of various search schemes. We suggest a HyperNEAT framework applying state-of-the-art deep n...
High Speed PAM -8 Optical Interconnects with Digital Equalization based on Neural Network
DEFF Research Database (Denmark)
Gaiarin, Simone; Pang, Xiaodan; Ozolins, Oskars
2016-01-01
We experimentally evaluate a high-speed optical interconnection link with neural network equalization. Enhanced equalization performances are shown comparing to standard linear FFE for an EML-based 32 GBd PAM-8 signal after 4-km SMF transmission.......We experimentally evaluate a high-speed optical interconnection link with neural network equalization. Enhanced equalization performances are shown comparing to standard linear FFE for an EML-based 32 GBd PAM-8 signal after 4-km SMF transmission....
Feature Fusion Based on Convolutional Neural Network for SAR ATR
Directory of Open Access Journals (Sweden)
Chen Shi-Qi
2017-01-01
Full Text Available Recent breakthroughs in algorithms related to deep convolutional neural networks (DCNN have stimulated the development of various of signal processing approaches, where the specific application of Automatic Target Recognition (ATR using Synthetic Aperture Radar (SAR data has spurred widely attention. Inspired by the more efficient distributed training such as inception architecture and residual network, a new feature fusion structure which jointly exploits all the merits of each version is proposed to reduce the data dimensions and the complexity of computation. The detailed procedure presented in this paper consists of the fused features, which make the representation of SAR images more distinguishable after the extraction of a set of features from DCNN, followed by a trainable classifier. In particular, the obtained results on the 10-class benchmark data set demonstrate that the presented architecture can achieve remarkable classification performance to the current state-of-the-art methods.
Huang, Wei; Oh, Sung-Kwun; Pedrycz, Witold
2017-08-11
This paper presents a hybrid fuzzy wavelet neural network (HFWNN) realized with the aid of polynomial neural networks (PNNs) and fuzzy inference-based wavelet neurons (FIWNs). Two types of FIWNs including fuzzy set inference-based wavelet neurons (FSIWNs) and fuzzy relation inference-based wavelet neurons (FRIWNs) are proposed. In particular, a FIWN without any fuzzy set component (viz., a premise part of fuzzy rule) becomes a wavelet neuron (WN). To alleviate the limitations of the conventional wavelet neural networks or fuzzy wavelet neural networks whose parameters are determined based on a purely random basis, the parameters of wavelet functions standing in FIWNs or WNs are initialized by using the C-Means clustering method. The overall architecture of the HFWNN is similar to the one of the typical PNNs. The main strategies in the design of HFWNN are developed as follows. First, the first layer of the network consists of FIWNs (e.g., FSIWN or FRIWN) that are used to reflect the uncertainty of data, while the second and higher layers consist of WNs, which exhibit a high level of flexibility and realize a linear combination of wavelet functions. Second, the parameters used in the design of the HFWNN are adjusted through genetic optimization. To evaluate the performance of the proposed HFWNN, several publicly available data are considered. Furthermore a thorough comparative analysis is covered.
International Nuclear Information System (INIS)
Zhou Jin; Chen Tianping; Xiang Lan
2006-01-01
This paper investigates synchronization dynamics of delayed neural networks with all the parameters unknown. By combining the adaptive control and linear feedback with the updated law, some simple yet generic criteria for determining the robust synchronization based on the parameters identification of uncertain chaotic delayed neural networks are derived by using the invariance principle of functional differential equations. It is shown that the approaches developed here further extend the ideas and techniques presented in recent literature, and they are also simple to implement in practice. Furthermore, the theoretical results are applied to a typical chaotic delayed Hopfied neural networks, and numerical simulation also demonstrate the effectiveness and feasibility of the proposed technique
Prediction of Industrial Electric Energy Consumption in Anhui Province Based on GA-BP Neural Network
Zhang, Jiajing; Yin, Guodong; Ni, Youcong; Chen, Jinlan
2018-01-01
In order to improve the prediction accuracy of industrial electrical energy consumption, a prediction model of industrial electrical energy consumption was proposed based on genetic algorithm and neural network. The model use genetic algorithm to optimize the weights and thresholds of BP neural network, and the model is used to predict the energy consumption of industrial power in Anhui Province, to improve the prediction accuracy of industrial electric energy consumption in Anhui province. By comparing experiment of GA-BP prediction model and BP neural network model, the GA-BP model is more accurate with smaller number of neurons in the hidden layer.
Artificial neural network based particle size prediction of polymeric nanoparticles.
Youshia, John; Ali, Mohamed Ehab; Lamprecht, Alf
2017-10-01
Particle size of nanoparticles and the respective polydispersity are key factors influencing their biopharmaceutical behavior in a large variety of therapeutic applications. Predicting these attributes would skip many preliminary studies usually required to optimize formulations. The aim was to build a mathematical model capable of predicting the particle size of polymeric nanoparticles produced by a pharmaceutical polymer of choice. Polymer properties controlling the particle size were identified as molecular weight, hydrophobicity and surface activity, and were quantified by measuring polymer viscosity, contact angle and interfacial tension, respectively. A model was built using artificial neural network including these properties as input with particle size and polydispersity index as output. The established model successfully predicted particle size of nanoparticles covering a range of 70-400nm prepared from other polymers. The percentage bias for particle prediction was 2%, 4% and 6%, for the training, validation and testing data, respectively. Polymer surface activity was found to have the highest impact on the particle size followed by viscosity and finally hydrophobicity. Results of this study successfully highlighted polymer properties affecting particle size and confirmed the usefulness of artificial neural networks in predicting the particle size and polydispersity of polymeric nanoparticles. Copyright © 2017 Elsevier B.V. All rights reserved.
Image Finder Mobile Application Based on Neural Networks
Directory of Open Access Journals (Sweden)
Nabil M. Hewahi
2017-04-01
Full Text Available Nowadays taking photos via mobile phone has become a very important part of everyone’s life. Almost each and every person who has a smart phone also has thousands of photos in their mobile device. At times it becomes very difficult to find a particular photo from thousands of photos, and it takes time. This research was done to come up with an innovative solution that could solve this problem. The solution will allow the user to find the required photo by simply drawing a sketch on the objects in the required picture, for example a tree or car, etc. Two types of supervised Artificial Neural Networks are used for this purpose; one is trained to identify the handmade sketches and other is trained to identify the images. The proposed approach introduces a mechanism to relate the sketches with the images by matching them after training. The experimentation results for testing the trained neural networks reached 100% for the sketches, and 84% for the images of two objects as a case study.
Naghsh-Nilchi, Ahmad R.; Kadkhodamohammadi, A. Rahim
2009-12-01
An electrocardiogram (ECG) beat classification scheme based on multiple signal classification (MUSIC) algorithm, morphological descriptors, and neural networks is proposed for discriminating nine ECG beat types. These are normal, fusion of ventricular and normal, fusion of paced and normal, left bundle branch block, right bundle branch block, premature ventricular concentration, atrial premature contraction, paced beat, and ventricular flutter. ECG signal samples from MIT-BIH arrhythmia database are used to evaluate the scheme. MUSIC algorithm is used to calculate pseudospectrum of ECG signals. The low-frequency samples are picked to have the most valuable heartbeat information. These samples along with two morphological descriptors, which deliver the characteristics and features of all parts of the heart, form an input feature vector. This vector is used for the initial training of a classifier neural network. The neural network is designed to have nine sample outputs which constitute the nine beat types. Two neural network schemes, namely multilayered perceptron (MLP) neural network and a probabilistic neural network (PNN), are employed. The experimental results achieved a promising accuracy of 99.03% for classifying the beat types using MLP neural network. In addition, our scheme recognizes NORMAL class with 100% accuracy and never misclassifies any other classes as NORMAL.
Directory of Open Access Journals (Sweden)
2009-03-01
Full Text Available An electrocardiogram (ECG beat classification scheme based on multiple signal classification (MUSIC algorithm, morphological descriptors, and neural networks is proposed for discriminating nine ECG beat types. These are normal, fusion of ventricular and normal, fusion of paced and normal, left bundle branch block, right bundle branch block, premature ventricular concentration, atrial premature contraction, paced beat, and ventricular flutter. ECG signal samples from MIT-BIH arrhythmia database are used to evaluate the scheme. MUSIC algorithm is used to calculate pseudospectrum of ECG signals. The low-frequency samples are picked to have the most valuable heartbeat information. These samples along with two morphological descriptors, which deliver the characteristics and features of all parts of the heart, form an input feature vector. This vector is used for the initial training of a classifier neural network. The neural network is designed to have nine sample outputs which constitute the nine beat types. Two neural network schemes, namely multilayered perceptron (MLP neural network and a probabilistic neural network (PNN, are employed. The experimental results achieved a promising accuracy of 99.03% for classifying the beat types using MLP neural network. In addition, our scheme recognizes NORMAL class with 100% accuracy and never misclassifies any other classes as NORMAL.
Recurrent neural network based hybrid model for reconstructing gene regulatory network.
Raza, Khalid; Alam, Mansaf
2016-10-01
One of the exciting problems in systems biology research is to decipher how genome controls the development of complex biological system. The gene regulatory networks (GRNs) help in the identification of regulatory interactions between genes and offer fruitful information related to functional role of individual gene in a cellular system. Discovering GRNs lead to a wide range of applications, including identification of disease related pathways providing novel tentative drug targets, helps to predict disease response, and also assists in diagnosing various diseases including cancer. Reconstruction of GRNs from available biological data is still an open problem. This paper proposes a recurrent neural network (RNN) based model of GRN, hybridized with generalized extended Kalman filter for weight update in backpropagation through time training algorithm. The RNN is a complex neural network that gives a better settlement between biological closeness and mathematical flexibility to model GRN; and is also able to capture complex, non-linear and dynamic relationships among variables. Gene expression data are inherently noisy and Kalman filter performs well for estimation problem even in noisy data. Hence, we applied non-linear version of Kalman filter, known as generalized extended Kalman filter, for weight update during RNN training. The developed model has been tested on four benchmark networks such as DNA SOS repair network, IRMA network, and two synthetic networks from DREAM Challenge. We performed a comparison of our results with other state-of-the-art techniques which shows superiority of our proposed model. Further, 5% Gaussian noise has been induced in the dataset and result of the proposed model shows negligible effect of noise on results, demonstrating the noise tolerance capability of the model. Copyright © 2016 Elsevier Ltd. All rights reserved.
Leak monitoring method for pressurizer based on integrated neural networks and fuzzy logic fusion
International Nuclear Information System (INIS)
Han Long; Zhou Gang; Sun Xusheng
2014-01-01
A new leak monitoring method based on integration neural networks (INN) and the fuzzy logic fusion (FLF) was proposed to solve the problem of pressurizer leak monitoring. In this approach, a pressurizer leaking diagnosis model was established by a radial basis function neural network (RBF-NN). Two Elman neural networks (Elman-NN) were used to establish pressurizer parameters prediction model and pressurizer leak diagnosis model respectively. Then, the fuzzy logical method was used to fuse the diagnosed results of RBF-NN and Elman-NN. The fusion results were the final monitoring results. The nuclear power simulator was used to test the feasibility of the proposed method. The results show that compared with the diagnosis method based on single neural network, the proposed method is simple and reliable. (authors)
Design of intelligent systems based on fuzzy logic, neural networks and nature-inspired optimization
Castillo, Oscar; Kacprzyk, Janusz
2015-01-01
This book presents recent advances on the design of intelligent systems based on fuzzy logic, neural networks and nature-inspired optimization and their application in areas such as, intelligent control and robotics, pattern recognition, time series prediction and optimization of complex problems. The book is organized in eight main parts, which contain a group of papers around a similar subject. The first part consists of papers with the main theme of theoretical aspects of fuzzy logic, which basically consists of papers that propose new concepts and algorithms based on fuzzy systems. The second part contains papers with the main theme of neural networks theory, which are basically papers dealing with new concepts and algorithms in neural networks. The third part contains papers describing applications of neural networks in diverse areas, such as time series prediction and pattern recognition. The fourth part contains papers describing new nature-inspired optimization algorithms. The fifth part presents div...
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks
Goodfellow, Ian J.; Mirza, Mehdi; Xiao, Da; Courville, Aaron; Bengio, Yoshua
2013-01-01
Catastrophic forgetting is a problem faced by many machine learning models and algorithms. When trained on one task, then trained on a second task, many machine learning models "forget" how to perform the first task. This is widely believed to be a serious problem for neural networks. Here, we investigate the extent to which the catastrophic forgetting problem occurs for modern neural networks, comparing both established and recent gradient-based training algorithms and activation functions. ...
ReSeg: A Recurrent Neural Network-based Model for Semantic Segmentation
Visin, Francesco; Ciccone, Marco; Romero, Adriana; Kastner, Kyle; Cho, Kyunghyun; Bengio, Yoshua; Matteucci, Matteo; Courville, Aaron
2015-01-01
We propose a structured prediction architecture, which exploits the local generic features extracted by Convolutional Neural Networks and the capacity of Recurrent Neural Networks (RNN) to retrieve distant dependencies. The proposed architecture, called ReSeg, is based on the recently introduced ReNet model for image classification. We modify and extend it to perform the more challenging task of semantic segmentation. Each ReNet layer is composed of four RNN that sweep the image horizontally ...
Neural Network based Minimization of BER in Multi-User Detection in SDMA
VENKATA REDDY METTU; KRISHAN KUMAR,; SRIKANTH PULLABHATLA
2011-01-01
In this paper we investigate the use of neural network based minimization of BER in MUD. Neural networks can be used for linear design, Adaptive prediction, Amplitude detection, Character Recognition and many other applications. Adaptive prediction is used in detecting the errors caused in AWGN channel. These errors are rectified by using Widrow-Hoff algorithm by updating their weights andAdaptive prediction methods. Both Widrow-Hoff and Adaptive prediction have been used for rectifying the e...
Neural network based adaptive output feedback control: Applications and improvements
Kutay, Ali Turker
Application of recently developed neural network based adaptive output feedback controllers to a diverse range of problems both in simulations and experiments is investigated in this thesis. The purpose is to evaluate the theory behind the development of these controllers numerically and experimentally, identify the needs for further development in practical applications, and to conduct further research in directions that are identified to ultimately enhance applicability of adaptive controllers to real world problems. We mainly focus our attention on adaptive controllers that augment existing fixed gain controllers. A recently developed approach holds great potential for successful implementations on real world applications due to its applicability to systems with minimal information concerning the plant model and the existing controller. In this thesis the formulation is extended to the multi-input multi-output case for distributed control of interconnected systems and successfully tested on a formation flight wind tunnel experiment. The command hedging method is formulated for the approach to further broaden the class of systems it can address by including systems with input nonlinearities. Also a formulation is adopted that allows the approach to be applied to non-minimum phase systems for which non-minimum phase characteristics are modeled with sufficient accuracy and treated properly in the design of the existing controller. It is shown that the approach can also be applied to augment nonlinear controllers under certain conditions and an example is presented where the nonlinear guidance law of a spinning projectile is augmented. Simulation results on a high fidelity 6 degrees-of-freedom nonlinear simulation code are presented. The thesis also presents a preliminary adaptive controller design for closed loop flight control with active flow actuators. Behavior of such actuators in dynamic flight conditions is not known. To test the adaptive controller design in
A Gain-Scheduling PI Control Based on Neural Networks
Directory of Open Access Journals (Sweden)
Stefania Tronci
2017-01-01
Full Text Available This paper presents a gain-scheduling design technique that relies upon neural models to approximate plant behaviour. The controller design is based on generic model control (GMC formalisms and linearization of the neural model of the process. As a result, a PI controller action is obtained, where the gain depends on the state of the system and is adapted instantaneously on-line. The algorithm is tested on a nonisothermal continuous stirred tank reactor (CSTR, considering both single-input single-output (SISO and multi-input multi-output (MIMO control problems. Simulation results show that the proposed controller provides satisfactory performance during set-point changes and disturbance rejection.
Ensemble neural network-based particle filtering for prognostics
Baraldi, P.; Compare, M.; Sauco, S.; Zio, E.
2013-12-01
Particle Filtering (PF) is used in prognostics applications by reason of its capability of robustly predicting the future behavior of an equipment and, on this basis, its Residual Useful Life (RUL). It is a model-driven approach, as it resorts to analytical models of both the degradation process and the measurement acquisition system. This prevents its applicability to the cases, very common in industry, in which reliable models are lacking. In this work, we propose an original method to extend PF to the case in which an analytical measurement model is not available whereas, instead, a dataset containing pairs «state-measurement» is available. The dataset is used to train a bagged ensemble of Artificial Neural Networks (ANNs) which is, then, embedded in the PF as empirical measurement model.
A Study for Snoring Detection Based Artificial Neural Network
Energy Technology Data Exchange (ETDEWEB)
Jang, W.K. [Samsung Techwin Co., Ltd., Seoul (Korea); Cho, S.P.; Lee, K.J. [Yonsei University, Seoul (Korea)
2002-07-01
In this study, we developed a snoring detection algorithm that detects snores automatically. It consists of preprocessing and snoring detection part. The preprocessing part is composed of a noise removal part using spectrum subtraction, and segmentation part, and computation part of temporal and spectral features. And, The snoring detection part decides whether detected blocks are snores with BPNN(Back-Propagation Neural Network). BPNN with one hidden layer and one output layer, is trained with data of 7 subjects and tested with data of 11 subjects of total 18 subjects. The proposed algorithm showed a Sensitivity of 90.41% and a Predictive Positive Value of 84.95%. (author). 18 refs., 9 figs., 3 tabs.
High power fuel cell simulator based on artificial neural network
Energy Technology Data Exchange (ETDEWEB)
Chavez-Ramirez, Abraham U.; Munoz-Guerrero, Roberto [Departamento de Ingenieria Electrica, CINVESTAV-IPN. Av. Instituto Politecnico Nacional No. 2508, D.F. CP 07360 (Mexico); Duron-Torres, S.M. [Unidad Academica de Ciencias Quimicas, Universidad Autonoma de Zacatecas, Campus Siglo XXI, Edif. 6 (Mexico); Ferraro, M.; Brunaccini, G.; Sergi, F.; Antonucci, V. [CNR-ITAE, Via Salita S. Lucia sopra Contesse 5-98126 Messina (Italy); Arriaga, L.G. [Centro de Investigacion y Desarrollo Tecnologico en Electroquimica S.C., Parque Tecnologico Queretaro, Sanfandila, Pedro Escobedo, Queretaro (Mexico)
2010-11-15
Artificial Neural Network (ANN) has become a powerful modeling tool for predicting the performance of complex systems with no well-known variable relationships due to the inherent properties. A commercial Polymeric Electrolyte Membrane fuel cell (PEMFC) stack (5 kW) was modeled successfully using this tool, increasing the number of test into the 7 inputs - 2 outputs-dimensional spaces in the shortest time, acquiring only a small amount of experimental data. Some parameters could not be measured easily on the real system in experimental tests; however, by receiving the data from PEMFC, the ANN could be trained to learn the internal relationships that govern this system, and predict its behavior without any physical equations. Confident accuracy was achieved in this work making possible to import this tool to complex systems and applications. (author)
Stability Analysis of Neural Networks-Based System Identification
Directory of Open Access Journals (Sweden)
Talel Korkobi
2008-01-01
Full Text Available This paper treats some problems related to nonlinear systems identification. A stability analysis neural network model for identifying nonlinear dynamic systems is presented. A constrained adaptive stable backpropagation updating law is presented and used in the proposed identification approach. The proposed backpropagation training algorithm is modified to obtain an adaptive learning rate guarantying convergence stability. The proposed learning rule is the backpropagation algorithm under the condition that the learning rate belongs to a specified range defining the stability domain. Satisfying such condition, unstable phenomena during the learning process are avoided. A Lyapunov analysis leads to the computation of the expression of a convenient adaptive learning rate verifying the convergence stability criteria. Finally, the elaborated training algorithm is applied in several simulations. The results confirm the effectiveness of the CSBP algorithm.
Neural Networks and Micromechanics
Kussul, Ernst; Baidyk, Tatiana; Wunsch, Donald C.
The title of the book, "Neural Networks and Micromechanics," seems artificial. However, the scientific and technological developments in recent decades demonstrate a very close connection between the two different areas of neural networks and micromechanics. The purpose of this book is to demonstrate this connection. Some artificial intelligence (AI) methods, including neural networks, could be used to improve automation system performance in manufacturing processes. However, the implementation of these AI methods within industry is rather slow because of the high cost of conducting experiments using conventional manufacturing and AI systems. To lower the cost, we have developed special micromechanical equipment that is similar to conventional mechanical equipment but of much smaller size and therefore of lower cost. This equipment could be used to evaluate different AI methods in an easy and inexpensive way. The proved methods could be transferred to industry through appropriate scaling. In this book, we describe the prototypes of low cost microequipment for manufacturing processes and the implementation of some AI methods to increase precision, such as computer vision systems based on neural networks for microdevice assembly and genetic algorithms for microequipment characterization and the increase of microequipment precision.
MapReduce Based Parallel Neural Networks in Enabling Large Scale Machine Learning.
Liu, Yang; Yang, Jie; Huang, Yuan; Xu, Lixiong; Li, Siguang; Qi, Man
2015-01-01
Artificial neural networks (ANNs) have been widely used in pattern recognition and classification applications. However, ANNs are notably slow in computation especially when the size of data is large. Nowadays, big data has received a momentum from both industry and academia. To fulfill the potentials of ANNs for big data applications, the computation process must be speeded up. For this purpose, this paper parallelizes neural networks based on MapReduce, which has become a major computing model to facilitate data intensive applications. Three data intensive scenarios are considered in the parallelization process in terms of the volume of classification data, the size of the training data, and the number of neurons in the neural network. The performance of the parallelized neural networks is evaluated in an experimental MapReduce computer cluster from the aspects of accuracy in classification and efficiency in computation.
MapReduce Based Parallel Neural Networks in Enabling Large Scale Machine Learning
Directory of Open Access Journals (Sweden)
Yang Liu
2015-01-01
Full Text Available Artificial neural networks (ANNs have been widely used in pattern recognition and classification applications. However, ANNs are notably slow in computation especially when the size of data is large. Nowadays, big data has received a momentum from both industry and academia. To fulfill the potentials of ANNs for big data applications, the computation process must be speeded up. For this purpose, this paper parallelizes neural networks based on MapReduce, which has become a major computing model to facilitate data intensive applications. Three data intensive scenarios are considered in the parallelization process in terms of the volume of classification data, the size of the training data, and the number of neurons in the neural network. The performance of the parallelized neural networks is evaluated in an experimental MapReduce computer cluster from the aspects of accuracy in classification and efficiency in computation.
A Predictive Neural Network-Based Cascade Control for pH Reactors
Directory of Open Access Journals (Sweden)
Mujahed AlDhaifallah
2016-01-01
Full Text Available This paper is concerned with the development of predictive neural network-based cascade control for pH reactors. The cascade structure consists of a master control loop (fuzzy proportional-integral and a slave one (predictive neural network. The master loop is chosen to be more accurate but slower than the slave one. The strong features found in cascade structure have been added to the inherent features in model predictive neural network. The neural network is used to alleviate modeling difficulties found with pH reactor and to predict its behavior. The parameters of predictive algorithm are determined using an optimization algorithm. The effectiveness and feasibility of the proposed design have been demonstrated using MatLab.
Optoelectronic Implementation of Neural Networks
Indian Academy of Sciences (India)
optical neural network using photo refractive crystals and realized interconnection density of 10 8 to. 1010 per cm3. • B Javidi and others designed a correlato.,. based two-layer neural network associated with a supervised perceptron learning algorithm for r~al-time face recognition. electronic wiring altogether and replace it ...
Error Concealment using Neural Networks for Block-Based Image Coding
Directory of Open Access Journals (Sweden)
M. Mokos
2006-06-01
Full Text Available In this paper, a novel adaptive error concealment (EC algorithm, which lowers the requirements for channel coding, is proposed. It conceals errors in block-based image coding systems by using neural network. In this proposed algorithm, only the intra-frame information is used for reconstruction of the image with separated damaged blocks. The information of pixels surrounding a damaged block is used to recover the errors using the neural network models. Computer simulation results show that the visual quality and the MSE evaluation of a reconstructed image are significantly improved using the proposed EC algorithm. We propose also a simple non-neural approach for comparison.
Chao, Tien-Hsin; Stoner, William W.
1993-01-01
An optical neural network based on the neocognitron paradigm is introduced. A novel aspect of the architecture design is shift-invariant multichannel Fourier optical correlation within each processing layer. Multilayer processing is achieved by feeding back the ouput of the feature correlator interatively to the input spatial light modulator and by updating the Fourier filters. By training the neural net with characteristic features extracted from the target images, successful pattern recognition with intraclass fault tolerance and interclass discrimination is achieved. A detailed system description is provided. Experimental demonstrations of a two-layer neural network for space-object discrimination is also presented.
Automatic target recognition using a feature-based optical neural network
Chao, Tien-Hsin
1992-01-01
An optical neural network based upon the Neocognitron paradigm (K. Fukushima et al. 1983) is introduced. A novel aspect of the architectural design is shift-invariant multichannel Fourier optical correlation within each processing layer. Multilayer processing is achieved by iteratively feeding back the output of the feature correlator to the input spatial light modulator and updating the Fourier filters. By training the neural net with characteristic features extracted from the target images, successful pattern recognition with intra-class fault tolerance and inter-class discrimination is achieved. A detailed system description is provided. Experimental demonstration of a two-layer neural network for space objects discrimination is also presented.
Liu, Xuan; Jia, Hui-Bo; Cheng, Ming
2006-11-01
A new analytical method for improving the performance of a network attached optical jukebox is presented by means of artificial neural networks. Through analyzing operation (request) process in this system, the mathematics model and algorithm are built for this storage system, and then a classified method based on artificial neural networks for this system is proposed. Simulation results testified the feasibility and validity of the proposed method that it could overcome the drawbacks of the frequent I/O operation and provide an effective way for using the Network Attached Optical Jukebox.
Sun, Ran; Wang, Jihe; Zhang, Dexin; Shao, Xiaowei
2018-02-01
This paper presents an adaptive neural networks-based control method for spacecraft formation with coupled translational and rotational dynamics using only aerodynamic forces. It is assumed that each spacecraft is equipped with several large flat plates. A coupled orbit-attitude dynamic model is considered based on the specific configuration of atmospheric-based actuators. For this model, a neural network-based adaptive sliding mode controller is implemented, accounting for system uncertainties and external perturbations. To avoid invalidation of the neural networks destroying stability of the system, a switching control strategy is proposed which combines an adaptive neural networks controller dominating in its active region and an adaptive sliding mode controller outside the neural active region. An optimal process is developed to determine the control commands for the plates system. The stability of the closed-loop system is proved by a Lyapunov-based method. Comparative results through numerical simulations illustrate the effectiveness of executing attitude control while maintaining the relative motion, and higher control accuracy can be achieved by using the proposed neural-based switching control scheme than using only adaptive sliding mode controller.
Directory of Open Access Journals (Sweden)
Bahita Mohamed
2011-01-01
Full Text Available In this work, we introduce an adaptive neural network controller for a class of nonlinear systems. The approach uses two Radial Basis Functions, RBF networks. The first RBF network is used to approximate the ideal control law which cannot be implemented since the dynamics of the system are unknown. The second RBF network is used for on-line estimating the control gain which is a nonlinear and unknown function of the states. The updating laws for the combined estimator and controller are derived through Lyapunov analysis. Asymptotic stability is established with the tracking errors converging to a neighborhood of the origin. Finally, the proposed method is applied to control and stabilize the inverted pendulum system.
Seismic Failure Probability of a Curved Bridge Based on Analytical and Neural Network Approaches
Directory of Open Access Journals (Sweden)
K. Karimi-Moridani
2017-01-01
Full Text Available This study focuses on seismic fragility assessment of horizontal curved bridge, which has been derived by neural network prediction. The objective is the optimization of structural responses of metaheuristic solutions. A regression model for the responses of the horizontal curved bridge with variable coefficients is built in the neural networks simulation environment based on the existing NTHA data. In order to achieve accurate results in a neural network, 1677 seismic analysis was performed in OpenSees. To achieve better performance of neural network and reduce the dimensionality of input data, dimensionality reduction techniques such as factor analysis approach were applied. Different types of neural network training algorithm were used and the best algorithm was adopted. The developed ANN approach is then used to verify the fragility curves of NTHA. The obtained results indicated that neural network approach could be used for predicting the seismic behavior of bridge elements and fragility, with enough feature extraction of ground motion records and response of structure according to the statistical works. Fragility curves extracted from the two approaches generally show proper compliance.
Passivity analysis of memristor-based impulsive inertial neural networks with time-varying delays.
Wan, Peng; Jian, Jigui
2018-03-01
This paper focuses on delay-dependent passivity analysis for a class of memristive impulsive inertial neural networks with time-varying delays. By choosing proper variable transformation, the memristive inertial neural networks can be rewritten as first-order differential equations. The memristive model presented here is regarded as a switching system rather than employing the theory of differential inclusion and set-value map. Based on matrix inequality and Lyapunov-Krasovskii functional method, several delay-dependent passivity conditions are obtained to ascertain the passivity of the addressed networks. In addition, the results obtained here contain those on the passivity for the addressed networks without impulse effects as special cases and can also be generalized to other neural networks with more complex pulse interference. Finally, one numerical example is presented to show the validity of the obtained results. Copyright © 2018 ISA. Published by Elsevier Ltd. All rights reserved.
Design and Implementation of Behavior Recognition System Based on Convolutional Neural Network
Directory of Open Access Journals (Sweden)
Yu Bo
2017-01-01
Full Text Available We build a set of human behavior recognition system based on the convolution neural network constructed for the specific human behavior in public places. Firstly, video of human behavior data set will be segmented into images, then we process the images by the method of background subtraction to extract moving foreground characters of body. Secondly, the training data sets are trained into the designed convolution neural network, and the depth learning network is constructed by stochastic gradient descent. Finally, the various behaviors of samples are classified and identified with the obtained network model, and the recognition results are compared with the current mainstream methods. The result show that the convolution neural network can study human behavior model automatically and identify human’s behaviors without any manually annotated trainings.
Nuclear reactors project optimization based on neural network and genetic algorithm
International Nuclear Information System (INIS)
Pereira, Claudio M.N.A.; Schirru, Roberto; Martinez, Aquilino S.
1997-01-01
This work presents a prototype of a system for nuclear reactor core design optimization based on genetic algorithms and artificial neural networks. A neural network is modeled and trained in order to predict the flux and the neutron multiplication factor values based in the enrichment, network pitch and cladding thickness, with average error less than 2%. The values predicted by the neural network are used by a genetic algorithm in this heuristic search, guided by an objective function that rewards the high flux values and penalizes multiplication factors far from the required value. Associating the quick prediction - that may substitute the reactor physics calculation code - with the global optimization capacity of the genetic algorithm, it was obtained a quick and effective system for nuclear reactor core design optimization. (author). 11 refs., 8 figs., 3 tabs
Quantum Neural Network Based Machine Translator for Hindi to English
Directory of Open Access Journals (Sweden)
Ravi Narayan
2014-01-01
Full Text Available This paper presents the machine learning based machine translation system for Hindi to English, which learns the semantically correct corpus. The quantum neural based pattern recognizer is used to recognize and learn the pattern of corpus, using the information of part of speech of individual word in the corpus, like a human. The system performs the machine translation using its knowledge gained during the learning by inputting the pair of sentences of Devnagri-Hindi and English. To analyze the effectiveness of the proposed approach, 2600 sentences have been evaluated during simulation and evaluation. The accuracy achieved on BLEU score is 0.7502, on NIST score is 6.5773, on ROUGE-L score is 0.9233, and on METEOR score is 0.5456, which is significantly higher in comparison with Google Translation and Bing Translation for Hindi to English Machine Translation.
Quantum neural network based machine translator for Hindi to English.
Narayan, Ravi; Singh, V P; Chakraverty, S
2014-01-01
This paper presents the machine learning based machine translation system for Hindi to English, which learns the semantically correct corpus. The quantum neural based pattern recognizer is used to recognize and learn the pattern of corpus, using the information of part of speech of individual word in the corpus, like a human. The system performs the machine translation using its knowledge gained during the learning by inputting the pair of sentences of Devnagri-Hindi and English. To analyze the effectiveness of the proposed approach, 2600 sentences have been evaluated during simulation and evaluation. The accuracy achieved on BLEU score is 0.7502, on NIST score is 6.5773, on ROUGE-L score is 0.9233, and on METEOR score is 0.5456, which is significantly higher in comparison with Google Translation and Bing Translation for Hindi to English Machine Translation.
Neural networks for triggering
International Nuclear Information System (INIS)
Denby, B.; Campbell, M.; Bedeschi, F.; Chriss, N.; Bowers, C.; Nesti, F.
1990-01-01
Two types of neural network beauty trigger architectures, based on identification of electrons in jets and recognition of secondary vertices, have been simulated in the environment of the Fermilab CDF experiment. The efficiencies for B's and rejection of background obtained are encouraging. If hardware tests are successful, the electron identification architecture will be tested in the 1991 run of CDF. 10 refs., 5 figs., 1 tab
Control of GMA Butt Joint Welding Based on Neural Networks
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2004-01-01
variations from 0.5 mm to 2.3 mm - scanned 10 mm in front of the electrode location. In this research, the mapping from joint geometry and reference weld quality to significant welding parameters has been based on a static multi-layer feed-forward network. The Levenberg-Marquardt algorithm, for non......-linear least square error minimization, has been used with the back-propagation algorithm for training the network, while a Bayesian regularization technique has been successfully applied for minimizing the risk of inexpedient over-training....
Mandal, Sudip; Saha, Goutam; Pal, Rajat Kumar
2017-08-01
Correct inference of genetic regulations inside a cell from the biological database like time series microarray data is one of the greatest challenges in post genomic era for biologists and researchers. Recurrent Neural Network (RNN) is one of the most popular and simple approach to model the dynamics as well as to infer correct dependencies among genes. Inspired by the behavior of social elephants, we propose a new metaheuristic namely Elephant Swarm Water Search Algorithm (ESWSA) to infer Gene Regulatory Network (GRN). This algorithm is mainly based on the water search strategy of intelligent and social elephants during drought, utilizing the different types of communication techniques. Initially, the algorithm is tested against benchmark small and medium scale artificial genetic networks without and with presence of different noise levels and the efficiency was observed in term of parametric error, minimum fitness value, execution time, accuracy of prediction of true regulation, etc. Next, the proposed algorithm is tested against the real time gene expression data of Escherichia Coli SOS Network and results were also compared with others state of the art optimization methods. The experimental results suggest that ESWSA is very efficient for GRN inference problem and performs better than other methods in many ways.
Automatic Pavement Crack Recognition Based on BP Neural Network
Directory of Open Access Journals (Sweden)
Li Li
2014-02-01
Full Text Available A feasible pavement crack detection system plays an important role in evaluating the road condition and providing the necessary road maintenance. In this paper, a back propagation neural network (BPNN is used to recognize pavement cracks from images. To improve the recognition accuracy of the BPNN, a complete framework of image processing is proposed including image preprocessing and crack information extraction. In this framework, the redundant image information is reduced as much as possible and two sets of feature parameters are constructed to classify the crack images. Then a BPNN is adopted to distinguish pavement images between linear and alligator cracks to acquire high recognition accuracy. Besides, the linear cracks can be further classified into transversal and longitudinal cracks according to the direction angle. Finally, the proposed method is evaluated on the data of 400 pavement images obtained by the Automatic Road Analyzer (ARAN in Northern China and the results show that the proposed method seems to be a powerful tool for pavement crack recognition. The rates of correct classification for alligator, transversal and longitudinal cracks are 97.5%, 100% and 88.0%, respectively. Compared to some previous studies, the method proposed in this paper is effective for all three kinds of cracks and the results are also acceptable for engineering application.
Classification of Two Comic Books based on Convolutional Neural Networks
Directory of Open Access Journals (Sweden)
Miki UENO
2017-03-01
Full Text Available Unphotographic images are the powerful representations described various situations. Thus, understanding intellectual products such as comics and picture books is one of the important topics in the field of artificial intelligence. Hence, stepwise analysis of a comic story, i.e., features of a part of the image, information features, features relating to continuous scene etc., was pursued. Especially, the length and each scene of four-scene comics are limited so as to ensure a clear interpretation of the contents.In this study, as the first step in this direction, the problem to classify two four-scene comics by the same artists were focused as the example. Several classifiers were constructed by utilizing a Convolutional Neural Network(CNN, and the results of classification by a human annotator and by a computational method were compared.From these experiments, we have clearly shown that CNN is efficient way to classify unphotographic gray scaled images and found that characteristic features of images to classify incorrectly.
Research on Environmental Adjustment of Cloud Ranch Based on BP Neural Network PID Control
Ren, Jinzhi; Xiang, Wei; Zhao, Lin; Wu, Jianbo; Huang, Lianzhen; Tu, Qinggang; Zhao, Heming
2018-01-01
In order to make the intelligent ranch management mode replace the traditional artificial one gradually, this paper proposes a pasture environment control system based on cloud server, and puts forward the PID control algorithm based on BP neural network to control temperature and humidity better in the pasture environment. First, to model the temperature and humidity (controlled object) of the pasture, we can get the transfer function. Then the traditional PID control algorithm and the PID one based on BP neural network are applied to the transfer function. The obtained step tracking curves can be seen that the PID controller based on BP neural network has obvious superiority in adjusting time and error, etc. This algorithm, calculating reasonable control parameters of the temperature and humidity to control environment, can be better used in the cloud service platform.
Cellular Neural Network-Based Methods for Distributed Network Intrusion Detection
Directory of Open Access Journals (Sweden)
Kang Xie
2015-01-01
Full Text Available According to the problems of current distributed architecture intrusion detection systems (DIDS, a new online distributed intrusion detection model based on cellular neural network (CNN was proposed, in which discrete-time CNN (DTCNN was used as weak classifier in each local node and state-controlled CNN (SCCNN was used as global detection method, respectively. We further proposed a new method for design template parameters of SCCNN via solving Linear Matrix Inequality. Experimental results based on KDD CUP 99 dataset show its feasibility and effectiveness. Emerging evidence has indicated that this new approach is affordable to parallelism and analog very large scale integration (VLSI implementation which allows the distributed intrusion detection to be performed better.
Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm
International Nuclear Information System (INIS)
Yu, Lean; Wang, Shouyang; Lai, Kin Keung
2008-01-01
In this study, an empirical mode decomposition (EMD) based neural network ensemble learning paradigm is proposed for world crude oil spot price forecasting. For this purpose, the original crude oil spot price series were first decomposed into a finite, and often small, number of intrinsic mode functions (IMFs). Then a three-layer feed-forward neural network (FNN) model was used to model each of the extracted IMFs, so that the tendencies of these IMFs could be accurately predicted. Finally, the prediction results of all IMFs are combined with an adaptive linear neural network (ALNN), to formulate an ensemble output for the original crude oil price series. For verification and testing, two main crude oil price series, West Texas Intermediate (WTI) crude oil spot price and Brent crude oil spot price, are used to test the effectiveness of the proposed EMD-based neural network ensemble learning methodology. Empirical results obtained demonstrate attractiveness of the proposed EMD-based neural network ensemble learning paradigm. (author)
Adaptive online state-of-charge determination based on neuro-controller and neural network
Energy Technology Data Exchange (ETDEWEB)
Shen Yanqing, E-mail: network_hawk@126.co [Department of Automation, Chongqing Industry Polytechnic College, Jiulongpo District, Chongqing 400050 (China)
2010-05-15
This paper presents a novel approach using adaptive artificial neural network based model and neuro-controller for online cell State of Charge (SOC) determination. Taking cell SOC as model's predictive control input unit, radial basis function neural network, which can adjust its structure to prediction error with recursive least square algorithm, is used to simulate battery system. Besides that, neuro-controller based on Back-Propagation Neural Network (BPNN) and modified PID controller is used to decide the control input of battery system, i.e., cell SOC. Finally this algorithm is applied for the SOC determination of lead-acid batteries, and results of lab tests on physical cells, compared with model prediction, are presented. Results show that the ANN based battery system model adaptively simulates battery system with great accuracy, and the predicted SOC simultaneously converges to the real value quickly within the error of +-1 as time goes on.
H∞state estimation of stochastic memristor-based neural networks with time-varying delays.
Bao, Haibo; Cao, Jinde; Kurths, Jürgen; Alsaedi, Ahmed; Ahmad, Bashir
2018-03-01
This paper addresses the problem of H ∞ state estimation for a class of stochastic memristor-based neural networks with time-varying delays. Under the framework of Filippov solution, the stochastic memristor-based neural networks are transformed into systems with interval parameters. The present paper is the first to investigate the H ∞ state estimation problem for continuous-time Itô-type stochastic memristor-based neural networks. By means of Lyapunov functionals and some stochastic technique, sufficient conditions are derived to ensure that the estimation error system is asymptotically stable in the mean square with a prescribed H ∞ performance. An explicit expression of the state estimator gain is given in terms of linear matrix inequalities (LMIs). Compared with other results, our results reduce control gain and control cost effectively. Finally, numerical simulations are provided to demonstrate the efficiency of the theoretical results. Copyright © 2018 Elsevier Ltd. All rights reserved.
Stability and synchronization of memristor-based fractional-order delayed neural networks.
Chen, Liping; Wu, Ranchao; Cao, Jinde; Liu, Jia-Bao
2015-11-01
Global asymptotic stability and synchronization of a class of fractional-order memristor-based delayed neural networks are investigated. For such problems in integer-order systems, Lyapunov-Krasovskii functional is usually constructed, whereas similar method has not been well developed for fractional-order nonlinear delayed systems. By employing a comparison theorem for a class of fractional-order linear systems with time delay, sufficient condition for global asymptotic stability of fractional memristor-based delayed neural networks is derived. Then, based on linear error feedback control, the synchronization criterion for such neural networks is also presented. Numerical simulations are given to demonstrate the effectiveness of the theoretical results. Copyright © 2015 Elsevier Ltd. All rights reserved.
Pinning synchronization of memristor-based neural networks with time-varying delays.
Yang, Zhanyu; Luo, Biao; Liu, Derong; Li, Yueheng
2017-09-01
In this paper, the synchronization of memristor-based neural networks with time-varying delays via pinning control is investigated. A novel pinning method is introduced to synchronize two memristor-based neural networks which denote drive system and response system, respectively. The dynamics are studied by theories of differential inclusions and nonsmooth analysis. In addition, some sufficient conditions are derived to guarantee asymptotic synchronization and exponential synchronization of memristor-based neural networks via the presented pinning control. Furthermore, some improvements about the proposed control method are also discussed in this paper. Finally, the effectiveness of the obtained results is demonstrated by numerical simulations. Copyright © 2017 Elsevier Ltd. All rights reserved.
Ding, Weifu; Zhang, Jiangshe; Leung, Yee
2016-10-01
In this paper, we predict air pollutant concentration using a feedforward artificial neural network inspired by the mechanism of the human brain as a useful alternative to traditional statistical modeling techniques. The neural network is trained based on sparse response back-propagation in which only a small number of neurons respond to the specified stimulus simultaneously and provide a high convergence rate for the trained network, in addition to low energy consumption and greater generalization. Our method is evaluated on Hong Kong air monitoring station data and corresponding meteorological variables for which five air quality parameters were gathered at four monitoring stations in Hong Kong over 4 years (2012-2015). Our results show that our training method has more advantages in terms of the precision of the prediction, effectiveness, and generalization of traditional linear regression algorithms when compared with a feedforward artificial neural network trained using traditional back-propagation.
Ozasa, Kazunari; Aono, Masashi; Maeda, Mizuo; Hara, Masahiko
In order to develop an adaptive computing system, we investigate microscopic optical feedback to a group of microbes (Euglena gracilis in this study) with a neural network algorithm, expecting that the unique characteristics of microbes, especially their strategies to survive/adapt against unfavorable environmental stimuli, will explicitly determine the temporal evolution of the microbe-based feedback system. The photophobic reactions of Euglena are extracted from experiments, and built in the Monte-Carlo simulation of a microbe-based neurocomputing. The simulation revealed a good performance of Euglena-based neurocomputing. Dynamic transition among the solutions is discussed from the viewpoint of feedback instability.
Fibrous dysplasia of the cranial vault: quantitative analysis based on neural networks
International Nuclear Information System (INIS)
Arana, E.; Marti-Bonmati, L.; Paredes, R.; Molla, E.
1998-01-01
To assess the utility of statistical analysis and neural networks in the quantitative analysis of fibrous dysplasia of the cranial vault. Ten patients with fibrous dysplasia (six women and four men with a mean age of 23.60±17.85 years) were selected from a series of 167 patients with lesions of the cranial vault evaluated by plain radiography and computed tomography (CT). Nineteen variables were taken from their medical records and radiological study. Their characterization was based on statistical analysis and neural network, and was validated by means of the leave-one-out method. The performance of the neural network was estimated by means of receiver operating characteristics (ROC) curves, using as a parameter the area under the curve A z . Bivariate analysis identified age, duration of symptoms, lytic and sclerotic patterns, sclerotic margin, ovoid shape, soft-tissue mas and periosteal reaction as significant variables. The area under the neural network curve was 0.9601±0.0435. The network selected the matrix and soft-tissue mass a variables that were indispensable for diagnosis. The neural network presents a high performance in the characterization of fibrous dysplasia of the cranial vault, disclosing occult interactions among the variables. (Author) 24 refs
Joung, Semin; Kwak, Sehyun; Ghim, Y.-C.
2017-10-01
Obtaining plasma shapes during tokamak discharges requires real-time estimation of magnetic configuration using Grad-Shafranov solver such as EFIT. Since off-line EFIT is computationally intensive and the real-time reconstructions do not agree with the results of off-line EFIT within our desired accuracy, we use a neural network to generate an off-line-quality equilibrium in real time. To train the neural network (two hidden layers with 30 and 20 nodes for each layer), we create database consisting of the magnetic signals and off-line EFIT results from KSTAR as inputs and targets, respectively. To compensate drifts in the magnetic signals originated from electronic circuits, we develop a Bayesian-based two-step real-time correction method. Additionally, we infer missing inputs, i.e. when some of inputs to the network are not usable, using Gaussian process coupled with Bayesian model. The likelihood of this model is determined based on the Maxwell's equations. We find that our network can withstand at least up to 20% of input errors. Note that this real-time reconstruction scheme is not yet implemented for KSTAR operation.
A prediction method for the wax deposition rate based on a radial basis function neural network
Directory of Open Access Journals (Sweden)
Ying Xie
2017-06-01
Full Text Available The radial basis function neural network is a popular supervised learning tool based on machinery learning technology. Its high precision having been proven, the radial basis function neural network has been applied in many areas. The accumulation of deposited materials in the pipeline may lead to the need for increased pumping power, a decreased flow rate or even to the total blockage of the line, with losses of production and capital investment, so research on predicting the wax deposition rate is significant for the safe and economical operation of an oil pipeline. This paper adopts the radial basis function neural network to predict the wax deposition rate by considering four main influencing factors, the pipe wall temperature gradient, pipe wall wax crystal solubility coefficient, pipe wall shear stress and crude oil viscosity, by the gray correlational analysis method. MATLAB software is employed to establish the RBF neural network. Compared with the previous literature, favorable consistency exists between the predicted outcomes and the experimental results, with a relative error of 1.5%. It can be concluded that the prediction method of wax deposition rate based on the RBF neural network is feasible.
Neural Networks: Implementations and Applications
Vonk, E.; Veelenturf, L.P.J.; Jain, L.C.
1996-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
Wang, B. S.; He, Z. C.
2007-05-01
This paper presents the numerical simulation and the model experiment upon a hypothetical concrete arch dam for the research of crack detection based on the reduction of natural frequencies. The influence of cracks on the dynamic property of the arch dam is analyzed. A statistical neural network is proposed to detect the crack through measuring the reductions of natural frequencies. Numerical analysis and model experiment show that the crack occurring in the arch dam will reduce natural frequencies and can be detected by using the statistical neural network based on the information of such reduction.
Grantham, Katie
2003-01-01
Reusable Launch Vehicles (RLVs) have different mission requirements than the Space Shuttle, which is used for benchmark guidance design. Therefore, alternative Terminal Area Energy Management (TAEM) and Approach and Landing (A/L) Guidance schemes can be examined in the interest of cost reduction. A neural network based solution for a finite horizon trajectory optimization problem is presented in this paper. In this approach the optimal trajectory of the vehicle is produced by adaptive critic based neural networks, which were trained off-line to maintain a gradual glideslope.
Development of Novel Gas Brand Anti-Piracy System based on BP Neural Networks
International Nuclear Information System (INIS)
Wang, L; Zhang, Y Y; Ding, L
2006-01-01
The Wireless-net Close-loop gas brand anti-piracy system introduced in this paper is a new type of brand piracy technical product based on BP neural network. It is composed by gas brand piracy label possessing gas exhalation resource, ARM embedded gas-detector, GPRS wireless module and data base of merchandise information. First, the system obtains the information on the special label through gas sensor array ,then the attained signals are transferred into ARM Embedded board and identified by artificial neural network, and finally turns back the outcome of data collection and identification to the manufactures with the help of GPRS module
Development of Novel Gas Brand Anti-Piracy System based on BP Neural Networks
Energy Technology Data Exchange (ETDEWEB)
Wang, L [School of Aeronautics and Astronautics, Tongji University, Shanghai (China); Zhang, Y Y [Chinese-German School of Postgraduate Studies, Tongji University (China); Ding, L [Chinese-German School of Postgraduate Studies, Tongji University (China)
2006-10-15
The Wireless-net Close-loop gas brand anti-piracy system introduced in this paper is a new type of brand piracy technical product based on BP neural network. It is composed by gas brand piracy label possessing gas exhalation resource, ARM embedded gas-detector, GPRS wireless module and data base of merchandise information. First, the system obtains the information on the special label through gas sensor array ,then the attained signals are transferred into ARM Embedded board and identified by artificial neural network, and finally turns back the outcome of data collection and identification to the manufactures with the help of GPRS module.
Development of Novel Gas Brand Anti-Piracy System based on BP Neural Networks
Wang, L.; Zhang, Y. Y.; Ding, L.
2006-10-01
The Wireless-net Close-loop gas brand anti-piracy system introduced in this paper is a new type of brand piracy technical product based on BP neural network. It is composed by gas brand piracy label possessing gas exhalation resource, ARM embedded gas-detector, GPRS wireless module and data base of merchandise information. First, the system obtains the information on the special label through gas sensor array ,then the attained signals are transferred into ARM Embedded board and identified by artificial neural network, and finally turns back the outcome of data collection and identification to the manufactures with the help of GPRS module.
An Artificial Neural Network Based Short-term Dynamic Prediction of Algae Bloom
Directory of Open Access Journals (Sweden)
Yao Junyang
2014-06-01
Full Text Available This paper proposes a method of short-term prediction of algae bloom based on artificial neural network. Firstly, principal component analysis is applied to water environmental factors in algae bloom raceway ponds to get main factors that influence the formation of algae blooms. Then, a model of short-term dynamic prediction based on neural network is built with the current chlorophyll_a values as input and the chlorophyll_a values in the next moment as output to realize short-term dynamic prediction of algae bloom. Simulation results show that the model can realize short-term prediction of algae bloom effectively.
Structured Pyramidal Neural Networks.
Soares, Alessandra M; Fernandes, Bruno J T; Bastos-Filho, Carmelo J A
2017-02-09
The Pyramidal Neural Networks (PNN) are an example of a successful recently proposed model inspired by the human visual system and deep learning theory. PNNs are applied to computer vision and based on the concept of receptive fields. This paper proposes a variation of PNN, named here as Structured Pyramidal Neural Network (SPNN). SPNN has self-adaptive variable receptive fields, while the original PNNs rely on the same size for the fields of all neurons, which limits the model since it is not possible to put more computing resources in a particular region of the image. Another limitation of the original approach is the need to define values for a reasonable number of parameters, which can turn difficult the application of PNNs in contexts in which the user does not have experience. On the other hand, SPNN has a fewer number of parameters. Its structure is determined using a novel method with Delaunay Triangulation and k-means clustering. SPNN achieved better results than PNNs and similar performance when compared to Convolutional Neural Network (CNN) and Support Vector Machine (SVM), but using lower memory capacity and processing time.
D-FNN Based Modeling and BP Neural Network Decoupling Control of PVC Stripping Process
Directory of Open Access Journals (Sweden)
Shu-zhi Gao
2014-01-01
Full Text Available PVC stripping process is a kind of complicated industrial process with characteristics of highly nonlinear and time varying. Aiming at the problem of establishing the accurate mathematics model due to the multivariable coupling and big time delay, the dynamic fuzzy neural network (D-FNN is adopted to establish the PVC stripping process model based on the actual process operation datum. Then, the PVC stripping process is decoupled by the distributed neural network decoupling module to obtain two single-input-single-output (SISO subsystems (slurry flow to top tower temperature and steam flow to bottom tower temperature. Finally, the PID controller based on BP neural networks is used to control the decoupled PVC stripper system. Simulation results show the effectiveness of the proposed integrated intelligent control method.
Study on adaptive BTT reentry speed depletion guidance law based on BP neural network
Zheng, Zongzhun; Wang, Yongji; Wu, Hao
2007-11-01
Reentry guidance is one of the key technologies in hypersonic vehicle research field. In addition to the constraints on its final position coordinates, the vehicle must also impact the target from a specified direction with high precision. And therefore the adaptability of guidance law is critical to control the velocity of hypersonic vehicle and firing accuracy properly in different surroundings of large airspace. In this paper, a new adaptive guidance strategy based on Back Propagation (BP) neural network for the reentry mission of a generic hypersonic vehicle is presented. Depending on the nicer self-learn ability of BP neural network, the guidance law considers the influence of biggish mis-modeling of aerodynamics, structure error and other initial disturbances on the flight capability of vehicle. Consequently, terminal position accuracy and velocity are guaranteed, while many constraints are satisfied. Numerical simulation results clearly bring out the fact that the proposed reentry guidance law based on BP neural network is rational and effective.
Machine learning of radial basis function neural network based on Kalman filter: Implementation
Directory of Open Access Journals (Sweden)
Vuković Najdan L.
2014-01-01
Full Text Available In this paper we test three new sequential machine learning algorithms for radial basis function (RBF neural network based on Kalman filter theory. Three new algorithms are derived: linearized Kalman filter, linearized information filter and unscented Kalman filter. Having introduced and derived mathematical model of each algorithm in the previous part of the paper, in this part we test and assess their performance using standard test sets from machine learning community. RBF neural network and three developed algorithms are implemented in MATLAB® programming environment. Experimental results obtained on real data sets as well as on real engineering problem show that developed algorithms result in more accurate models of the problem being investigated based on radial basis function neural network.
Directory of Open Access Journals (Sweden)
Lijun Zhang
2018-02-01
Full Text Available Aiming at the pitting fault of deep groove ball bearing during service, this paper uses the vibration signal of five different states of deep groove ball bearing and extracts the relevant features, then uses a neural network to model the degradation for identifying and classifying the fault type. By comparing the effects of training samples with different capacities through performance indexes such as the accuracy and convergence speed, it is proven that an increase in the sample size can improve the performance of the model. Based on the polynomial fitting principle and Pearson correlation coefficient, fusion features based on the skewness index are proposed, and the performance improvement of the model after incorporating the fusion features is also validated. A comparison of the performance of the support vector machine (SVM model and the neural network model on this dataset is given. The research shows that neural networks have more potential for complex and high-volume datasets.
Multi-AUV Hunting Algorithm Based on Bio-inspired Neural Network in Unknown Environments
Directory of Open Access Journals (Sweden)
Daqi Zhu
2015-11-01
Full Text Available The multi-AUV hunting problem is one of the key issues in multi-robot system research. In order to hunt the target efficiently a new hunting algorithm based on a bio-inspired neural network has been proposed in this paper. Firstly, the AUV's working environment can be represented, based on the biological-inspired neural network model. There is one-to-one correspondence between each neuron in the neural network and the position of the grid map in the underwater environment. The activity values of biological neurons then guide the AUV's sailing path and finally the target is surrounded by AUVs. In addition, a method called negotiation is used to solve the AUV's allocation of hunting points. The simulation results show that the algorithm used in the paper can provide rapid and highly efficient path planning in the unknown environment with obstacles and non-obstacles.
Novel quantum inspired binary neural network algorithm
Indian Academy of Sciences (India)
In this paper, a quantum based binary neural network algorithm is proposed, named as novel quantum binary neural network algorithm (NQ-BNN). It forms a neural network structure by deciding weights and separability parameter in quantum based manner. Quantum computing concept represents solution probabilistically ...
Neural network web-based system for promoting rural education in ...
African Journals Online (AJOL)
... workplace, the key to unraffle these issues is the use of information and communication technology (ICT). This paper presents the neural network of a web-based learning that will increase access to high quality university education especially in rural areas based on the principle of active learning and knowledge building.
Comparison of four Adaboost algorithm based artificial neural networks in wind speed predictions
International Nuclear Information System (INIS)
Liu, Hui; Tian, Hong-qi; Li, Yan-fei; Zhang, Lei
2015-01-01
Highlights: • Four hybrid algorithms are proposed for the wind speed decomposition. • Adaboost algorithm is adopted to provide a hybrid training framework. • MLP neural networks are built to do the forecasting computation. • Four important network training algorithms are included in the MLP networks. • All the proposed hybrid algorithms are suitable for the wind speed predictions. - Abstract: The technology of wind speed prediction is important to guarantee the safety of wind power utilization. In this paper, four different hybrid methods are proposed for the high-precision multi-step wind speed predictions based on the Adaboost (Adaptive Boosting) algorithm and the MLP (Multilayer Perceptron) neural networks. In the hybrid Adaboost–MLP forecasting architecture, four important algorithms are adopted for the training and modeling of the MLP neural networks, including GD-ALR-BP algorithm, GDM-ALR-BP algorithm, CG-BP-FR algorithm and BFGS algorithm. The aim of the study is to investigate the promoted forecasting percentages of the MLP neural networks by the Adaboost algorithm’ optimization under various training algorithms. The hybrid models in the performance comparison include Adaboost–GD-ALR-BP–MLP, Adaboost–GDM-ALR-BP–MLP, Adaboost–CG-BP-FR–MLP, Adaboost–BFGS–MLP, GD-ALR-BP–MLP, GDM-ALR-BP–MLP, CG-BP-FR–MLP and BFGS–MLP. Two experimental results show that: (1) the proposed hybrid Adaboost–MLP forecasting architecture is effective for the wind speed predictions; (2) the Adaboost algorithm has promoted the forecasting performance of the MLP neural networks considerably; (3) among the proposed Adaboost–MLP forecasting models, the Adaboost–CG-BP-FR–MLP model has the best performance; and (4) the improved percentages of the MLP neural networks by the Adaboost algorithm decrease step by step with the following sequence of training algorithms as: GD-ALR-BP, GDM-ALR-BP, CG-BP-FR and BFGS
Finite-Time Stabilization and Adaptive Control of Memristor-Based Delayed Neural Networks.
Wang, Leimin; Shen, Yi; Zhang, Guodong
Finite-time stability problem has been a hot topic in control and system engineering. This paper deals with the finite-time stabilization issue of memristor-based delayed neural networks (MDNNs) via two control approaches. First, in order to realize the stabilization of MDNNs in finite time, a delayed state feedback controller is proposed. Then, a novel adaptive strategy is applied to the delayed controller, and finite-time stabilization of MDNNs can also be achieved by using the adaptive control law. Some easily verified algebraic criteria are derived to ensure the stabilization of MDNNs in finite time, and the estimation of the settling time functional is given. Moreover, several finite-time stability results as our special cases for both memristor-based neural networks (MNNs) without delays and neural networks are given. Finally, three examples are provided for the illustration of the theoretical results.Finite-time stability problem has been a hot topic in control and system engineering. This paper deals with the finite-time stabilization issue of memristor-based delayed neural networks (MDNNs) via two control approaches. First, in order to realize the stabilization of MDNNs in finite time, a delayed state feedback controller is proposed. Then, a novel adaptive strategy is applied to the delayed controller, and finite-time stabilization of MDNNs can also be achieved by using the adaptive control law. Some easily verified algebraic criteria are derived to ensure the stabilization of MDNNs in finite time, and the estimation of the settling time functional is given. Moreover, several finite-time stability results as our special cases for both memristor-based neural networks (MNNs) without delays and neural networks are given. Finally, three examples are provided for the illustration of the theoretical results.
A neutron spectrum unfolding computer code based on artificial neural networks
International Nuclear Information System (INIS)
Ortiz-Rodríguez, J.M.; Reyes Alfaro, A.; Reyes Haro, A.; Cervantes Viramontes, J.M.; Vega-Carrillo, H.R.
2014-01-01
The Bonner Spheres Spectrometer consists of a thermal neutron sensor placed at the center of a number of moderating polyethylene spheres of different diameters. From the measured readings, information can be derived about the spectrum of the neutron field where measurements were made. Disadvantages of the Bonner system are the weight associated with each sphere and the need to sequentially irradiate the spheres, requiring long exposure periods. Provided a well-established response matrix and adequate irradiation conditions, the most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. The drawbacks associated with traditional unfolding procedures have motivated the need of complementary approaches. Novel methods based on Artificial Intelligence, mainly Artificial Neural Networks, have been widely investigated. In this work, a neutron spectrum unfolding code based on neural nets technology is presented. This code is called Neutron Spectrometry and Dosimetry with Artificial Neural networks unfolding code that was designed in a graphical interface. The core of the code is an embedded neural network architecture previously optimized using the robust design of artificial neural networks methodology. The main features of the code are: easy to use, friendly and intuitive to the user. This code was designed for a Bonner Sphere System based on a 6 LiI(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. The main feature of the code is that as entrance data, for unfolding the neutron spectrum, only seven rate counts measured with seven Bonner spheres are required; simultaneously the code calculates 15 dosimetric quantities as well as the total flux for radiation protection purposes. This code generates a full report with all information of the unfolding
Selected Flight Test Results for Online Learning Neural Network-Based Flight Control System
Williams-Hayes, Peggy S.
2004-01-01
The NASA F-15 Intelligent Flight Control System project team developed a series of flight control concepts designed to demonstrate neural network-based adaptive controller benefits, with the objective to develop and flight-test control systems using neural network technology to optimize aircraft performance under nominal conditions and stabilize the aircraft under failure conditions. This report presents flight-test results for an adaptive controller using stability and control derivative values from an online learning neural network. A dynamic cell structure neural network is used in conjunction with a real-time parameter identification algorithm to estimate aerodynamic stability and control derivative increments to baseline aerodynamic derivatives in flight. This open-loop flight test set was performed in preparation for a future phase in which the learning neural network and parameter identification algorithm output would provide the flight controller with aerodynamic stability and control derivative updates in near real time. Two flight maneuvers are analyzed - pitch frequency sweep and automated flight-test maneuver designed to optimally excite the parameter identification algorithm in all axes. Frequency responses generated from flight data are compared to those obtained from nonlinear simulation runs. Flight data examination shows that addition of flight-identified aerodynamic derivative increments into the simulation improved aircraft pitch handling qualities.
Directory of Open Access Journals (Sweden)
Suryanita Reni
2017-01-01
Full Text Available The strong motion earthquake could cause the building damage in case of the building not considered in the earthquake design of the building. The study aims to predict the damage-level of building due to earthquake using Artificial Neural Networks method. The building model is a reinforced concrete building with ten floors and height between floors is 3.6 m. The model building received a load of the earthquake based on nine earthquake time history records. Each time history scaled to 0,5g, 0,75g, and 1,0g. The Artificial Neural Networks are designed in 4 architectural models using the MATLAB program. Model 1 used the displacement, velocity, and acceleration as input and Model 2 used the displacement only as the input. Model 3 used the velocity as input, and Model 4 used the acceleration just as input. The output of the Neural Networks is the damage level of the building with the category of Safe (1, Immediate Occupancy (2, Life Safety (3 or in a condition of Collapse Prevention (4. According to the results, Neural Network models have the prediction rate of the damage level between 85%-95%. Therefore, one of the solutions for analyzing the structural responses and the damage level promptly and efficiently when the earthquake occurred is by using Artificial Neural Network
Link prediction in author collaboration network based on BP neural network
Directory of Open Access Journals (Sweden)
Chen Chaoqun
2017-01-01
Full Text Available Recently, more and more authors have been encouraged for collaboration because it often produces good results. However, the author collaboration network contains experts in various research directions within various fields, and it is difficult for individual authors to decide which authors are best suited to their expertise. This paper uses the relationships among authors to predict new relationships that may arise, recommending each author with the collaborators they may be interested in. The data source comes from 4-year data in DBLP from 2001 to 2004. After data cleaning, the training set and test set are constructed and then used BP neural network to build model. At the same time, this article compares the performance with Logistic Regression, SVM and Random Forest. The experiment shows that the BP neural network can get better result, and it is feasible to predict links in the author collaboration network.
International Nuclear Information System (INIS)
Abdel-Aal, M.M.Z.
2004-01-01
Automation in large, complex systems such as chemical plants, electrical power generation, aerospace and nuclear plants has been steadily increasing in the recent past. automated diagnosis and control forms a necessary part of these systems,this contains thousands of alarms processing in every component, subsystem and system. so the accurate and speed of diagnosis of faults is an important factors in operation and maintaining their health and continued operation and in reducing of repair and recovery time. using of artificial intelligence facilitates the alarm classifications and faults diagnosis to control any abnormal events during the operation cycle of the plant. thesis work uses the artificial neural network as a powerful classification tool. the work basically is has two components, the first is to effectively train the neural network using particle swarm optimization, which non-derivative based technique. to achieve proper training of the neural network to fault classification problem and comparing this technique to already existing techniques
A novel controller based on robust backstepping and neural network for flight motion simulator
Liu, Zhenghua; Wu, Yunjie; Wang, Weihong
2008-10-01
The flight motion simulator is one kind of servo system with uncertainties and disturbances. To obtain high performance and good robustness for the flight simulator, we present a robust compound controller base on Backstepping controller and BP neural network. Firstly, the design procedure of the robust Backstepping controller is described and correlative problems are proposed. Secondly, the principle and the design process of BP neural network are analyzed and expatiated respectively. Finally, simulation results on the flight simulator show that the BP neural network can compensate external disturbances including system input and output disturbance and the system performance can be improved. Therefore both robustness and high performance of the flight simulator are achieved. It is an applied technology for the control of servo system, such as the flight motion simulator.
Recurrent Neural Network Based Boolean Factor Analysis and its Application to Word Clustering
Czech Academy of Sciences Publication Activity Database
Frolov, A. A.; Húsek, Dušan; Polyakov, P.Y.
2009-01-01
Roč. 20, č. 7 (2009), s. 1073-1086 ISSN 1045-9227 R&D Projects: GA MŠk(CZ) 1M0567 Institutional research plan: CEZ:AV0Z10300504 Keywords : recurrent neural network * Hopfield-like neural network * associative memory * unsupervised learning * neural network architecture * neural network application * statistics * Boolean factor analysis * concepts search * information retrieval Subject RIV: BB - Applied Statistics, Operational Research Impact factor: 2.889, year: 2009
A neutron spectrum unfolding code based on generalized regression artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Ortiz R, J. M.; Martinez B, M. R.; Castaneda M, R.; Solis S, L. O. [Universidad Autonoma de Zacatecas, Unidad Academica de Ingenieria Electrica, Av. Ramon Lopez Velarde 801, Col. Centro, 98000 Zacatecas, Zac. (Mexico); Vega C, H. R., E-mail: morvymm@yahoo.com.mx [Universidad Autonoma de Zacatecas, Unidad Academica de Estudios Nucleares, Cipres No. 10, Fracc. La Penuela, 98068 Zacatecas, Zac. (Mexico)
2015-10-15
The most delicate part of neutron spectrometry, is the unfolding process. Then derivation of the spectral information is not simple because the unknown is not given directly as result of the measurements. Novel methods based on Artificial Neural Networks have been widely investigated. In prior works, back propagation neural networks (BPNN) have been used to solve the neutron spectrometry problem, however, some drawbacks still exist using this kind of neural nets, as the optimum selection of the network topology and the long training time. Compared to BPNN, is usually much faster to train a generalized regression neural network (GRNN). That is mainly because spread constant is the only parameter used in GRNN. Another feature is that the network will converge to a global minimum. In addition, often are more accurate than BPNN in prediction. These characteristics make GRNN be of great interest in the neutron spectrometry domain. In this work is presented a computational tool based on GRNN, capable to solve the neutron spectrometry problem. This computational code, automates the pre-processing, training and testing stages, the statistical analysis and the post-processing of the information, using 7 Bonner spheres rate counts as only entrance data. The code was designed for a Bonner Spheres System based on a {sup 6}LiI(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. (Author)
A neutron spectrum unfolding code based on generalized regression artificial neural networks
International Nuclear Information System (INIS)
Ortiz R, J. M.; Martinez B, M. R.; Castaneda M, R.; Solis S, L. O.; Vega C, H. R.
2015-10-01
The most delicate part of neutron spectrometry, is the unfolding process. Then derivation of the spectral information is not simple because the unknown is not given directly as result of the measurements. Novel methods based on Artificial Neural Networks have been widely investigated. In prior works, back propagation neural networks (BPNN) have been used to solve the neutron spectrometry problem, however, some drawbacks still exist using this kind of neural nets, as the optimum selection of the network topology and the long training time. Compared to BPNN, is usually much faster to train a generalized regression neural network (GRNN). That is mainly because spread constant is the only parameter used in GRNN. Another feature is that the network will converge to a global minimum. In addition, often are more accurate than BPNN in prediction. These characteristics make GRNN be of great interest in the neutron spectrometry domain. In this work is presented a computational tool based on GRNN, capable to solve the neutron spectrometry problem. This computational code, automates the pre-processing, training and testing stages, the statistical analysis and the post-processing of the information, using 7 Bonner spheres rate counts as only entrance data. The code was designed for a Bonner Spheres System based on a 6 LiI(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. (Author)
Chen, Yinchao; Yang, Wei
2009-12-01
A dynamic inversion control method based on neural network compensation for UAV automatic landing is introduced. Aimed at the nonlinear characteristic of automatic landing procedure, the dynamic inversion method is used for feedback linearization. The on-line neural network is introduced to compensation dynamic inversion error caused by the disturbance factors during automatic landing and improves the controller performance. Numerical simulation presents that the control method can make the UAV follow the expected trace properly and have good dynamic performance and robust performance.
PID Control of Miniature Unmanned Helicopter Yaw System Based on RBF Neural Network
Pan, Yue; Song, Ping; Li, Kejie
The yaw dynamics of a miniature unmanned helicopter exhibits a complex, nonlinear, time-varying and coupling dynamic behavior. In this paper, simplified yaw dynamics model of MUH in hovering or low-velocity flight mode is established. The SISO model of yaw dynamics is obtained by mechanism modeling and system identification modeling method. PID control based on RBF neural network method combines the advantages of traditional PID controller and neural network controller. It has fast response, good robustness and self-adapting ability. It is suitable to control the yaw system of MUH. Simulation results show that the control system works well with quick response, good robustness and self adaptation.
An MLP neural network for ECG noise removal based on Kalman filter.
Moein, Sara
2010-01-01
In this paper, application of Artificial Neural Network (ANN) for electrocardiogram (ECG) signal noise removal has been investigated. First, 100 number of ECG signals are selected from Physikalisch-Technische Bundesanstalt (PTB) database and Kalman filter is applied to remove their low pass noise. Then a suitable dataset based on denoised ECG signal is configured and used to a Multilayer Perceptron (MLP) neural network to be trained. Finally, results and experiences are discussed and the effect of changing different parameters for MLP training is shown.
Audio Watermarking Based on HAS and Neural Networks in DCT Domain
Directory of Open Access Journals (Sweden)
Hung-Hsu Tsai
2003-03-01
Full Text Available We propose a new intelligent audio watermarking method based on the characteristics of the HAS and the techniques of neural networks in the DCT domain. The method makes the watermark imperceptible by using the audio masking characteristics of the HAS. Moreover, the method exploits a neural network for memorizing the relationships between the original audio signals and the watermarked audio signals. Therefore, the method is capable of extracting watermarks without original audio signals. Finally, the experimental results are also included to illustrate that the method significantly possesses robustness to be immune against common attacks for the copyright protection of digital audio.
Directory of Open Access Journals (Sweden)
Valentin Potapov
2016-12-01
Full Text Available Purpose: This work presents a method of diagnosing the technical condition of turbofan engines using hybrid neural network algorithm based on software developed for the analysis of data obtained in the aircraft life. Methods: allows the engine diagnostics with deep recognition to the structural assembly in the presence of single structural damage components of the engine running and the multifaceted damage. Results: of the optimization of neural network structure to solve the problems of evaluating technical state of the bypass turbofan engine, when used with genetic algorithms.
Promoter prediction in E. coli based on SIDD profiles and Artificial Neural Networks.
Bland, Charles; Newsome, Abigail S; Markovets, Aleksandra A
2010-10-07
One of the major challenges in biology is the correct identification of promoter regions. Computational methods based on motif searching have been the traditional approach taken. Recent studies have shown that DNA structural properties, such as curvature, stacking energy, and stress-induced duplex destabilization (SIDD) are useful in promoter prediction, as well. In this paper, the currently used SIDD energy threshold method is compared to the proposed artificial neural network (ANN) approach for finding promoters based on SIDD profile data. When compared to the SIDD threshold prediction method, artificial neural networks showed noticeable improvements for precision, recall, and F-score over a range of values. The maximal F-score for the ANN classifier was 62.3 and 56.8 for the threshold-based classifier. Artificial neural networks were used to predict promoters based on SIDD profile data. Results using this technique were an improvement over the previous SIDD threshold approach. Over a wide range of precision-recall values, artificial neural networks were more capable of identifying distinctive characteristics of promoter regions than threshold based methods.
Efficient shortest-path-tree computation in network routing based on pulse-coupled neural networks.
Qu, Hong; Yi, Zhang; Yang, Simon X
2013-06-01
Shortest path tree (SPT) computation is a critical issue for routers using link-state routing protocols, such as the most commonly used open shortest path first and intermediate system to intermediate system. Each router needs to recompute a new SPT rooted from itself whenever a change happens in the link state. Most commercial routers do this computation by deleting the current SPT and building a new one using static algorithms such as the Dijkstra algorithm at the beginning. Such recomputation of an entire SPT is inefficient, which may consume a considerable amount of CPU time and result in a time delay in the network. Some dynamic updating methods using the information in the updated SPT have been proposed in recent years. However, there are still many limitations in those dynamic algorithms. In this paper, a new modified model of pulse-coupled neural networks (M-PCNNs) is proposed for the SPT computation. It is rigorously proved that the proposed model is capable of solving some optimization problems, such as the SPT. A static algorithm is proposed based on the M-PCNNs to compute the SPT efficiently for large-scale problems. In addition, a dynamic algorithm that makes use of the structure of the previously computed SPT is proposed, which significantly improves the efficiency of the algorithm. Simulation results demonstrate the effective and efficient performance of the proposed approach.
A neural network-based estimator for the mixture ratio of the Space Shuttle Main Engine
Guo, T. H.; Musgrave, J.
1992-01-01
In order to properly utilize the available fuel and oxidizer of a liquid propellant rocket engine, the mixture ratio is closed loop controlled during main stage (65 percent - 109 percent power) operation. However, because of the lack of flight-capable instrumentation for measuring mixture ratio, the value of mixture ratio in the control loop is estimated using available sensor measurements such as the combustion chamber pressure and the volumetric flow, and the temperature and pressure at the exit duct on the low pressure fuel pump. This estimation scheme has two limitations. First, the estimation formula is based on an empirical curve fitting which is accurate only within a narrow operating range. Second, the mixture ratio estimate relies on a few sensor measurements and loss of any of these measurements will make the estimate invalid. In this paper, we propose a neural network-based estimator for the mixture ratio of the Space Shuttle Main Engine. The estimator is an extension of a previously developed neural network based sensor failure detection and recovery algorithm (sensor validation). This neural network uses an auto associative structure which utilizes the redundant information of dissimilar sensors to detect inconsistent measurements. Two approaches have been identified for synthesizing mixture ratio from measurement data using a neural network. The first approach uses an auto associative neural network for sensor validation which is modified to include the mixture ratio as an additional output. The second uses a new network for the mixture ratio estimation in addition to the sensor validation network. Although mixture ratio is not directly measured in flight, it is generally available in simulation and in test bed firing data from facility measurements of fuel and oxidizer volumetric flows. The pros and cons of these two approaches will be discussed in terms of robustness to sensor failures and accuracy of the estimate during typical transients using
A neural network-based estimator for the mixture ratio of the Space Shuttle Main Engine
Guo, T. H.; Musgrave, J.
1992-11-01
In order to properly utilize the available fuel and oxidizer of a liquid propellant rocket engine, the mixture ratio is closed loop controlled during main stage (65 percent - 109 percent power) operation. However, because of the lack of flight-capable instrumentation for measuring mixture ratio, the value of mixture ratio in the control loop is estimated using available sensor measurements such as the combustion chamber pressure and the volumetric flow, and the temperature and pressure at the exit duct on the low pressure fuel pump. This estimation scheme has two limitations. First, the estimation formula is based on an empirical curve fitting which is accurate only within a narrow operating range. Second, the mixture ratio estimate relies on a few sensor measurements and loss of any of these measurements will make the estimate invalid. In this paper, we propose a neural network-based estimator for the mixture ratio of the Space Shuttle Main Engine. The estimator is an extension of a previously developed neural network based sensor failure detection and recovery algorithm (sensor validation). This neural network uses an auto associative structure which utilizes the redundant information of dissimilar sensors to detect inconsistent measurements. Two approaches have been identified for synthesizing mixture ratio from measurement data using a neural network. The first approach uses an auto associative neural network for sensor validation which is modified to include the mixture ratio as an additional output. The second uses a new network for the mixture ratio estimation in addition to the sensor validation network. Although mixture ratio is not directly measured in flight, it is generally available in simulation and in test bed firing data from facility measurements of fuel and oxidizer volumetric flows. The pros and cons of these two approaches will be discussed in terms of robustness to sensor failures and accuracy of the estimate during typical transients using
Intelligent harmonic load model based on neural networks
Ji, Pyeong-Shik; Lee, Dae-Jong; Lee, Jong-Pil; Park, Jae-Won; Lim, Jae-Yoon
2007-12-01
In this study, we developed a RBFNs(Radial Basis Function Networks) based load modeling method with harmonic components. The developed method implemented by using harmonic information as well as fundamental frequency and voltage which are essential input factors in conventional method. Thus, the proposed method makes it possible to effectively estimate load characteristics in power lines with harmonics. The RBFNs have certain advantage such as simple structure and rapid computation ability compared with multilayer perceptron which is extensively applied for load modeling. To show the effectiveness, the proposed method has been intensively tested with various dataset acquired under the different frequency and voltage and compared it with conventional methods such as polynominal 2nd equation method, MLP and RBF without considering harmonic components.
DEFF Research Database (Denmark)
Krogh, Anders Stærmose; Riis, Søren Kamaric
1999-01-01
A general framework for hybrids of hidden Markov models (HMMs) and neural networks (NNs) called hidden neural networks (HNNs) is described. The article begins by reviewing standard HMMs and estimation by conditional maximum likelihood, which is used by the HNN. In the HNN, the usual HMM probability...... parameters are replaced by the outputs of state-specific neural networks. As opposed to many other hybrids, the HNN is normalized globally and therefore has a valid probabilistic interpretation. All parameters in the HNN are estimated simultaneously according to the discriminative conditional maximum...... likelihood criterion. The HNN can be viewed as an undirected probabilistic independence network (a graphical model), where the neural networks provide a compact representation of the clique functions. An evaluation of the HNN on the task of recognizing broad phoneme classes in the TIMIT database shows clear...
DEFF Research Database (Denmark)
Soliman, Hammam Abdelaal Hammam; Wang, Huai; Gadalla, Brwene Salah Abdelkarim
2015-01-01
challenges. A capacitance estimation method based on Artificial Neural Network (ANN) algorithm is therefore proposed in this paper. The implemented ANN estimated the capacitance of the DC-link capacitor in a back-toback converter. Analysis of the error of the capacitance estimation is also given...
Condition Monitoring for DC-link Capacitors Based on Artificial Neural Network Algorithm
DEFF Research Database (Denmark)
Soliman, Hammam Abdelaal Hammam; Wang, Huai; Gadalla, Brwene Salah Abdelkarim
2015-01-01
hardware will reduce the cost, and therefore could be more promising for industry applications. A condition monitoring method based on Artificial Neural Network (ANN) algorithm is therefore proposed in this paper. The implementation of the ANN to the DC-link capacitor condition monitoring in a back...
A New Method for Studying the Periodic System Based on a Kohonen Neural Network
Chen, David Zhekai
2010-01-01
A new method for studying the periodic system is described based on the combination of a Kohonen neural network and a set of chemical and physical properties. The classification results are directly shown in a two-dimensional map and easy to interpret. This is one of the major advantages of this approach over other methods reported in the…
Neural network based data-driven predictor: Case study on clinker ...
African Journals Online (AJOL)
Soft sensors are key solutions in process industries. Important parameters which are difficult or cost a lot to measure can be predicted using soft sensors. In this paper neural network based clinker quality predictor is developed. The predictor genuinely estimates LSF, SM, AM and C3S values. There is a time delay while ...
Direction-of-change forecasting using a volatility-based recurrent neural network
Bekiros, S.D.; Georgoutsos, D.A.
2008-01-01
This paper investigates the profitability of a trading strategy, based on recurrent neural networks, that attempts to predict the direction-of-change of the market in the case of the NASDAQ composite index. The sample extends over the period 8 February 1971 to 7 April 1998, while the sub-period 8
Nonlinear Model Predictive Control Based on a Self-Organizing Recurrent Neural Network.
Han, Hong-Gui; Zhang, Lu; Hou, Ying; Qiao, Jun-Fei
2016-02-01
A nonlinear model predictive control (NMPC) scheme is developed in this paper based on a self-organizing recurrent radial basis function (SR-RBF) neural network, whose structure and parameters are adjusted concurrently in the training process. The proposed SR-RBF neural network is represented in a general nonlinear form for predicting the future dynamic behaviors of nonlinear systems. To improve the modeling accuracy, a spiking-based growing and pruning algorithm and an adaptive learning algorithm are developed to tune the structure and parameters of the SR-RBF neural network, respectively. Meanwhile, for the control problem, an improved gradient method is utilized for the solution of the optimization problem in NMPC. The stability of the resulting control system is proved based on the Lyapunov stability theory. Finally, the proposed SR-RBF neural network-based NMPC (SR-RBF-NMPC) is used to control the dissolved oxygen (DO) concentration in a wastewater treatment process (WWTP). Comparisons with other existing methods demonstrate that the SR-RBF-NMPC can achieve a considerably better model fitting for WWTP and a better control performance for DO concentration.
Petkov, Nikolay
1995-01-01
A preprocessor based on a computational model of simple cells in the mammalian primary visual cortex is combined with a self-organising artificial neural network classifier. After learning with a sequence of input images, the output units of the system turn out to correspond to classes of input
Fuzzy modeling based on generalized neural networks and fuzzy clustering objective functions
Sun, Chuen-Tsai; Jang, Jyh-Shing
1991-01-01
An approach to the formulation of fuzzy if-then rules based on clustering objective functions is proposed. The membership functions are then calibrated with the generalized neural networks technique to achieve a desired input-output mapping. The learning procedure is basically a gradient-descent algorithm. A Kalman filter algorithm is used to improve the overall performance.
A Deep Convolutional Neural Network for Location Recognition and Geometry based Information
Bidoia, Francesco; Sabatelli, Matthia; Shantia, Amir; Wiering, Marco A.; Schomaker, Lambert; De Marsico, Maria; Sanniti di Baja, Gabriella; Fred, Ana
2018-01-01
In this paper we propose a new approach to Deep Neural Networks (DNNs) based on the particular needs of navigation tasks. To investigate these needs we created a labeled image dataset of a test environment and we compare classical computer vision approaches with the state of the art in image
Decker, Arthur J.
2004-01-01
A completely optical calibration process has been developed at Glenn for calibrating a neural-network-based nondestructive evaluation (NDE) method. The NDE method itself detects very small changes in the characteristic patterns or vibration mode shapes of vibrating structures as discussed in many references. The mode shapes or characteristic patterns are recorded using television or electronic holography and change when a structure experiences, for example, cracking, debonds, or variations in fastener properties. An artificial neural network can be trained to be very sensitive to changes in the mode shapes, but quantifying or calibrating that sensitivity in a consistent, meaningful, and deliverable manner has been challenging. The standard calibration approach has been difficult to implement, where the response to damage of the trained neural network is compared with the responses of vibration-measurement sensors. In particular, the vibration-measurement sensors are intrusive, insufficiently sensitive, and not numerous enough. In response to these difficulties, a completely optical alternative to the standard calibration approach was proposed and tested successfully. Specifically, the vibration mode to be monitored for structural damage was intentionally contaminated with known amounts of another mode, and the response of the trained neural network was measured as a function of the peak-to-peak amplitude of the contaminating mode. The neural network calibration technique essentially uses the vibration mode shapes of the undamaged structure as standards against which the changed mode shapes are compared. The published response of the network can be made nearly independent of the contaminating mode, if enough vibration modes are used to train the net. The sensitivity of the neural network can be adjusted for the environment in which the test is to be conducted. The response of a neural network trained with measured vibration patterns for use on a vibration isolation
Machine learning of radial basis function neural network based on Kalman filter: Introduction
Directory of Open Access Journals (Sweden)
Vuković Najdan L.
2014-01-01
Full Text Available This paper analyzes machine learning of radial basis function neural network based on Kalman filtering. Three algorithms are derived: linearized Kalman filter, linearized information filter and unscented Kalman filter. We emphasize basic properties of these estimation algorithms, demonstrate how their advantages can be used for optimization of network parameters, derive mathematical models and show how they can be applied to model problems in engineering practice.
Neural network based system for script identification in Indian ...
Indian Academy of Sciences (India)
R. Narasimhan (Krishtel eMaging) 1461 1996 Oct 15 13:05:22
With the recent emergence and widespread application of multimedia technologies, there is increasing demand to create a paperless ... implicit assumption that the language or script of the document to be processed is known beforehand. ... In order to take advantage of the learning and generalization abilities of the neural ...
Unconventional optical imaging using a high-speed neural network based smart sensor
Arrasmith, William W.
2006-05-01
The advancement of neural network methods and technologies is finding applications in many fields and disciplines of interest to the defense, intelligence, and homeland security communities. Rapidly reconfigurable sensors for real or near-real time signal or image processing can be used for multi-functional purposes such as image compression, target tracking, image fusion, edge detection, thresholding, pattern recognition, and atmospheric turbulence compensation to name a few. A neural network based smart sensor is described that can accomplish these tasks individually or in combination, in real-time or near real-time. As a computationally intensive example, the case of optical imaging through volume turbulence is addressed. For imaging systems in the visible and near infrared part of the electromagnetic spectrum, the atmosphere is often the dominant factor in reducing the imaging system's resolution and image quality. The neural network approach described in this paper is shown to present a viable means for implementing turbulence compensation techniques for near-field and distributed turbulence scenarios. Representative high-speed neural network hardware is presented. Existing 2-D cellular neural network (CNN) hardware is capable of 3 trillion operations per second with peta-operations per second possible using current 3-D manufacturing processes. This hardware can be used for high-speed applications that require fast convolutions and de-convolutions. Existing 3-D artificial neural network technology is capable of peta-operations per second and can be used for fast array processing operations. Methods for optical imaging through distributed turbulence are discussed, simulation results are presented and computational and performance assessments are provided.
Fuzzy wavelet plus a quantum neural network as a design base for power system stability enhancement.
Ganjefar, Soheil; Tofighi, Morteza; Karami, Hamidreza
2015-11-01
In this study, we introduce an indirect adaptive fuzzy wavelet neural controller (IAFWNC) as a power system stabilizer to damp inter-area modes of oscillations in a multi-machine power system. Quantum computing is an efficient method for improving the computational efficiency of neural networks, so we developed an identifier based on a quantum neural network (QNN) to train the IAFWNC in the proposed scheme. All of the controller parameters are tuned online based on the Lyapunov stability theory to guarantee the closed-loop stability. A two-machine, two-area power system equipped with a static synchronous series compensator as a series flexible ac transmission system was used to demonstrate the effectiveness of the proposed controller. The simulation and experimental results demonstrated that the proposed IAFWNC scheme can achieve favorable control performance. Copyright © 2015 Elsevier Ltd. All rights reserved.
Neural networks for aircraft control
Linse, Dennis
1990-01-01
Current research in Artificial Neural Networks indicates that networks offer some potential advantages in adaptation and fault tolerance. This research is directed at determining the possible applicability of neural networks to aircraft control. The first application will be to aircraft trim. Neural network node characteristics, network topology and operation, neural network learning and example histories using neighboring optimal control with a neural net are discussed.
DEFF Research Database (Denmark)
Hansen, Lars Kai; Salamon, Peter
1990-01-01
We propose several means for improving the performance an training of neural networks for classification. We use crossvalidation as a tool for optimizing network parameters and architecture. We show further that the remaining generalization error can be reduced by invoking ensembles of similar...... networks....
Directory of Open Access Journals (Sweden)
Mohammad S. Islam
2017-01-01
Full Text Available Decoding neural activities related to voluntary and involuntary movements is fundamental to understanding human brain motor circuits and neuromotor disorders and can lead to the development of neuromotor prosthetic devices for neurorehabilitation. This study explores using recorded deep brain local field potentials (LFPs for robust movement decoding of Parkinson’s disease (PD and Dystonia patients. The LFP data from voluntary movement activities such as left and right hand index finger clicking were recorded from patients who underwent surgeries for implantation of deep brain stimulation electrodes. Movement-related LFP signal features were extracted by computing instantaneous power related to motor response in different neural frequency bands. An innovative neural network ensemble classifier has been proposed and developed for accurate prediction of finger movement and its forthcoming laterality. The ensemble classifier contains three base neural network classifiers, namely, feedforward, radial basis, and probabilistic neural networks. The majority voting rule is used to fuse the decisions of the three base classifiers to generate the final decision of the ensemble classifier. The overall decoding performance reaches a level of agreement (kappa value at about 0.729±0.16 for decoding movement from the resting state and about 0.671±0.14 for decoding left and right visually cued movements.
DeepNano: Deep recurrent neural networks for base calling in MinION nanopore reads.
Directory of Open Access Journals (Sweden)
Vladimír Boža
Full Text Available The MinION device by Oxford Nanopore produces very long reads (reads over 100 kBp were reported; however it suffers from high sequencing error rate. We present an open-source DNA base caller based on deep recurrent neural networks and show that the accuracy of base calling is much dependent on the underlying software and can be improved by considering modern machine learning methods. By employing carefully crafted recurrent neural networks, our tool significantly improves base calling accuracy on data from R7.3 version of the platform compared to the default base caller supplied by the manufacturer. On R9 version, we achieve results comparable to Nanonet base caller provided by Oxford Nanopore. Availability of an open source tool with high base calling accuracy will be useful for development of new applications of the MinION device, including infectious disease detection and custom target enrichment during sequencing.
Directory of Open Access Journals (Sweden)
Manjunath Patel Gowdru Chandrashekarappa
2014-01-01
Full Text Available The present research work is focussed to develop an intelligent system to establish the input-output relationship utilizing forward and reverse mappings of artificial neural networks. Forward mapping aims at predicting the density and secondary dendrite arm spacing (SDAS from the known set of squeeze cast process parameters such as time delay, pressure duration, squeezes pressure, pouring temperature, and die temperature. An attempt is also made to meet the industrial requirements of developing the reverse model to predict the recommended squeeze cast parameters for the desired density and SDAS. Two different neural network based approaches have been proposed to carry out the said task, namely, back propagation neural network (BPNN and genetic algorithm neural network (GA-NN. The batch mode of training is employed for both supervised learning networks and requires huge training data. The requirement of huge training data is generated artificially at random using regression equation derived through real experiments carried out earlier by the same authors. The performances of BPNN and GA-NN models are compared among themselves with those of regression for ten test cases. The results show that both models are capable of making better predictions and the models can be effectively used in shop floor in selection of most influential parameters for the desired outputs.
[Study on meteorological factors-based neural network model of malaria].
Gao, Chun-yu; Xiong, Hong-yan; Yi, Dong; Chai, Guang-jun; Yang, Xiao-wei; Liu, Li
2003-09-01
In order to provide reliable data for strategies development on prevention, a meteorological factors-based predicating model for malaria forecast was studied. Data on malaria occurrence and climate changes from 1994 to 1999 in counties in Yunnan province was collected and analyzed with software packages of FoxPro 6.0 and Excel 5.0. The forecasting model for malaria occurrence was established, using the Neural Network Toolbox of Matlab 6.1 software package. In the studies of forecasting model, data of malaria and meteorological factors from 1994 to 1999 in Honghe state in Yunnan province was chosen. The meteorological factors included average monthly pressure, air temperature, relative humidity, monthly maximum air temperature, minimum air temperature, rainfall, rainday, evaporation and sunshine hours in the study. The established forecasting model was also tested and verified. The BP network model was established according to data of diseases and meteorological factors from Honghe state in Yunnan province. After training the neural network for 100 times, the error of performance decreased from 3.23608 to 0.035862. Verified by fact data of malaria, the efficiency of malaria forecasting was 84.85%. Neural network model was effective for forecasting malaria. It showed advantages as: strong ability for analysis, lower claim for data, convenient and easy to apply etc. Neural network model might be used as a new method for malaria forecasting.
Zhang, Wei; Huang, Tingwen; He, Xing; Li, Chuandong
2017-11-01
In this study, we investigate the global exponential stability of inertial memristor-based neural networks with impulses and time-varying delays. We construct inertial memristor-based neural networks based on the characteristics of the inertial neural networks and memristor. Impulses with and without delays are considered when modeling the inertial neural networks simultaneously, which are of great practical significance in the current study. Some sufficient conditions are derived under the framework of the Lyapunov stability method, as well as an extended Halanay differential inequality and a new delay impulsive differential inequality, which depend on impulses with and without delays, in order to guarantee the global exponential stability of the inertial memristor-based neural networks. Finally, two numerical examples are provided to illustrate the efficiency of the proposed methods. Copyright © 2017 Elsevier Ltd. All rights reserved.
Critical Branching Neural Networks
Kello, Christopher T.
2013-01-01
It is now well-established that intrinsic variations in human neural and behavioral activity tend to exhibit scaling laws in their fluctuations and distributions. The meaning of these scaling laws is an ongoing matter of debate between isolable causes versus pervasive causes. A spiking neural network model is presented that self-tunes to critical…
Tomography using neural networks
International Nuclear Information System (INIS)
Demeter, G.; Zoletnik, S.
1997-01-01
Neural networks have been used for fast measurement evaluation in plasma physics, including nonlinear curve fitting to experimental data. Such an approach for fast evaluation of tomographic measurements was utilized on the MT-1M tokamak, especially in the study of impurity injection using laser accelerated pellets and of the transport of these injected impurities. Neural networks were studied for fast processing of tomographic data and large numbers of tomographic data
Neural Network Based Real-time Correction of Transducer Dynamic Errors
Roj, J.
2013-12-01
In order to carry out real-time dynamic error correction of transducers described by a linear differential equation, a novel recurrent neural network was developed. The network structure is based on solving this equation with respect to the input quantity when using the state variables. It is shown that such a real-time correction can be carried out using simple linear perceptrons. Due to the use of a neural technique, knowledge of the dynamic parameters of the transducer is not necessary. Theoretical considerations are illustrated by the results of simulation studies performed for the modeled second order transducer. The most important properties of the neural dynamic error correction, when emphasizing the fundamental advantages and disadvantages, are discussed.
Adaptive Sliding Mode Control of MEMS Gyroscope Based on Neural Network Approximation
Directory of Open Access Journals (Sweden)
Yuzheng Yang
2014-01-01
Full Text Available An adaptive sliding controller using radial basis function (RBF network to approximate the unknown system dynamics microelectromechanical systems (MEMS gyroscope sensor is proposed. Neural controller is proposed to approximate the unknown system model and sliding controller is employed to eliminate the approximation error and attenuate the model uncertainties and external disturbances. Online neural network (NN weight tuning algorithms, including correction terms, are designed based on Lyapunov stability theory, which can guarantee bounded tracking errors as well as bounded NN weights. The tracking error bound can be made arbitrarily small by increasing a certain feedback gain. Numerical simulation for a MEMS angular velocity sensor is investigated to verify the effectiveness of the proposed adaptive neural control scheme and demonstrate the satisfactory tracking performance and robustness.
An Artificial Neural Network Based Robot Controller that Uses Rat’s Brain Signals
Directory of Open Access Journals (Sweden)
Marsel Mano
2013-04-01
Full Text Available Brain machine interface (BMI has been proposed as a novel technique to control prosthetic devices aimed at restoring motor functions in paralyzed patients. In this paper, we propose a neural network based controller that maps rat’s brain signals and transforms them into robot movement. First, the rat is trained to move the robot by pressing the right and left lever in order to get food. Next, we collect brain signals with four implanted electrodes, two in the motor cortex and two in the somatosensory cortex area. The collected data are used to train and evaluate different artificial neural controllers. Trained neural controllers are employed online to map brain signals and transform them into robot motion. Offline and online classification results of rat’s brain signals show that the Radial Basis Function Neural Networks (RBFNN outperforms other neural networks. In addition, online robot control results show that even with a limited number of electrodes, the robot motion generated by RBFNN matched the motion generated by the left and right lever position.
Evolution of an artificial neural network based autonomous land vehicle controller.
Baluja, S
1996-01-01
This paper presents an evolutionary method for creating an artificial neural network based autonomous land vehicle controller. The evolved controllers perform better in unseen situations than those trained with an error backpropagation learning algorithm designed for this task. In this paper, an overview of the previous connectionist based approaches to this task is given, and the evolutionary algorithms used in this study are described in detail. Methods for reducing the high computational costs of training artificial neural networks with evolutionary algorithms are explored. Error metrics specific to the task of autonomous vehicle control are introduced; the evolutionary algorithms guided by these error metrics reveal improved performance over those guided by the standard sum-squared error metric. Finally, techniques for integrating evolutionary search and error backpropagation are presented. The evolved networks are designed to control Carnegie Mellon University's NAVLAB vehicles in road following tasks.
An Adaptive-PSO-Based Self-Organizing RBF Neural Network.
Han, Hong-Gui; Lu, Wei; Hou, Ying; Qiao, Jun-Fei
2018-01-01
In this paper, a self-organizing radial basis function (SORBF) neural network is designed to improve both accuracy and parsimony with the aid of adaptive particle swarm optimization (APSO). In the proposed APSO algorithm, to avoid being trapped into local optimal values, a nonlinear regressive function is developed to adjust the inertia weight. Furthermore, the APSO algorithm can optimize both the network size and the parameters of an RBF neural network simultaneously. As a result, the proposed APSO-SORBF neural network can effectively generate a network model with a compact structure and high accuracy. Moreover, the analysis of convergence is given to guarantee the successful application of the APSO-SORBF neural network. Finally, multiple numerical examples are presented to illustrate the effectiveness of the proposed APSO-SORBF neural network. The results demonstrate that the proposed method is more competitive in solving nonlinear problems than some other existing SORBF neural networks.
Neural network-based control of an intelligent solar Stirling pump
International Nuclear Information System (INIS)
Tavakolpour-Saleh, A.R.; Jokar, H.
2016-01-01
In this paper, an ANN (artificial neural network) control system is applied to a novel solar-powered active LTD (low temperature differential) Stirling pump. First, a mathematical description of the proposed Stirling pump is presented. Then, optimum operating frequencies of the converter corresponding to different operating conditions (i.e. different sink and source temperatures and water heads) are investigated using the proposed mathematical framework. It is found that the proposed complex mathematical scheme has a very slow convergence and thus, is not appropriate for real-time implementation of the model-based controller. Consequently, a NN (neural network) model with a lower complexity is proposed to learn the simulation data obtained from the mathematical model. The designed neural network controller is thus applied to a digital processor to effectively tune the converter frequency so that a maximum output power is acquired. Finally, the performance of the proposed mechatronic system is evaluated experimentally. The experimental results clearly demonstrate the feasibility of pumping water at low temperature difference under variable operating conditions using the proposed intelligent Stirling converter. - Highlights: • A novel intelligent solar-powered active LTD Stirling pump was introduced. • A neural network controller was used to tune the converter speed. • The intelligent converter was able to adapt itself to different operating conditions. • It was possible to excite the water column with its resonance mode. • Experimental results showed the effectiveness of the proposed converter.
A neutron spectrum unfolding code based on generalized regression artificial neural networks
International Nuclear Information System (INIS)
Rosario Martinez-Blanco, Ma. del
2016-01-01
The most delicate part of neutron spectrometry, is the unfolding process. The derivation of the spectral information is not simple because the unknown is not given directly as a result of the measurements. Novel methods based on Artificial Neural Networks have been widely investigated. In prior works, back propagation neural networks (BPNN) have been used to solve the neutron spectrometry problem, however, some drawbacks still exist using this kind of neural nets, i.e. the optimum selection of the network topology and the long training time. Compared to BPNN, it's usually much faster to train a generalized regression neural network (GRNN). That's mainly because spread constant is the only parameter used in GRNN. Another feature is that the network will converge to a global minimum, provided that the optimal values of spread has been determined and that the dataset adequately represents the problem space. In addition, GRNN are often more accurate than BPNN in the prediction. These characteristics make GRNNs to be of great interest in the neutron spectrometry domain. This work presents a computational tool based on GRNN capable to solve the neutron spectrometry problem. This computational code, automates the pre-processing, training and testing stages using a k-fold cross validation of 3 folds, the statistical analysis and the post-processing of the information, using 7 Bonner spheres rate counts as only entrance data. The code was designed for a Bonner Spheres System based on a 6 LiI(Eu) neutron detector and a response matrix expressed in 60 energy bins taken from an International Atomic Energy Agency compilation. - Highlights: • Main drawback of neutron spectrometry with BPNN is network topology optimization. • Compared to BPNN, it’s usually much faster to train a (GRNN). • GRNN are often more accurate than BPNN in the prediction. These characteristics make GRNNs to be of great interest. • This computational code, automates the pre
Gross domestic product estimation based on electricity utilization by artificial neural network
Stevanović, Mirjana; Vujičić, Slađana; Gajić, Aleksandar M.
2018-01-01
The main goal of the paper was to estimate gross domestic product (GDP) based on electricity estimation by artificial neural network (ANN). The electricity utilization was analyzed based on different sources like renewable, coal and nuclear sources. The ANN network was trained with two training algorithms namely extreme learning method and back-propagation algorithm in order to produce the best prediction results of the GDP. According to the results it can be concluded that the ANN model with extreme learning method could produce the acceptable prediction of the GDP based on the electricity utilization.
Directory of Open Access Journals (Sweden)
A. S. Raja
2012-08-01
Full Text Available The word biometrics refers to the use of physiological or biological characteristics of human to recognize and verify the identity of an individual. Palmprint has become a new class of human biometrics for passive identification with uniqueness and stability. This is considered to be reliable due to the lack of expressions and the lesser effect of aging. In this manuscript a new Palmprint based biometric system based on neural networks self organizing maps (SOM is presented. The method is named as SOMP. The paper shows that the proposed SOMP method improves the performance and robustness of recognition. The proposed method is applied to a variety of datasets and the results are shown.
Heiden, Uwe
1980-01-01
The purpose of this work is a unified and general treatment of activity in neural networks from a mathematical pOint of view. Possible applications of the theory presented are indica ted throughout the text. However, they are not explored in de tail for two reasons : first, the universal character of n- ral activity in nearly all animals requires some type of a general approach~ secondly, the mathematical perspicuity would suffer if too many experimental details and empirical peculiarities were interspersed among the mathematical investigation. A guide to many applications is supplied by the references concerning a variety of specific issues. Of course the theory does not aim at covering all individual problems. Moreover there are other approaches to neural network theory (see e.g. Poggio-Torre, 1978) based on the different lev els at which the nervous system may be viewed. The theory is a deterministic one reflecting the average be havior of neurons or neuron pools. In this respect the essay is writt...
Short-term PV/T module temperature prediction based on PCA-RBF neural network
Li, Jiyong; Zhao, Zhendong; Li, Yisheng; Xiao, Jing; Tang, Yunfeng
2018-02-01
Aiming at the non-linearity and large inertia of temperature control in PV/T system, short-term temperature prediction of PV/T module is proposed, to make the PV/T system controller run forward according to the short-term forecasting situation to optimize control effect. Based on the analysis of the correlation between PV/T module temperature and meteorological factors, and the temperature of adjacent time series, the principal component analysis (PCA) method is used to pre-process the original input sample data. Combined with the RBF neural network theory, the simulation results show that the PCA method makes the prediction accuracy of the network model higher and the generalization performance stronger than that of the RBF neural network without the main component extraction.
Research on wind field algorithm of wind lidar based on BP neural network and grey prediction
Chen, Yong; Chen, Chun-Li; Luo, Xiong; Zhang, Yan; Yang, Ze-hou; Zhou, Jie; Shi, Xiao-ding; Wang, Lei
2018-01-01
This paper uses the BP neural network and grey algorithm to forecast and study radar wind field. In order to reduce the residual error in the wind field prediction which uses BP neural network and grey algorithm, calculating the minimum value of residual error function, adopting the residuals of the gray algorithm trained by BP neural network, using the trained network model to forecast the residual sequence, using the predicted residual error sequence to modify the forecast sequence of the grey algorithm. The test data show that using the grey algorithm modified by BP neural network can effectively reduce the residual value and improve the prediction precision.
Kim, Nakwan
Utilizing the universal approximation property of neural networks, we develop several novel approaches to neural network-based adaptive output feedback control of nonlinear systems, and illustrate these approaches for several flight control applications. In particular, we address the problem of non-affine systems and eliminate the fixed point assumption present in earlier work. All of the stability proofs are carried out in a form that eliminates an algebraic loop in the neural network implementation. An approximate input/output feedback linearizing controller is augmented with a neural network using input/output sequences of the uncertain system. These approaches permit adaptation to both parametric uncertainty and unmodeled dynamics. All physical systems also have control position and rate limits, which may either deteriorate performance or cause instability for a sufficiently high control bandwidth. Here we apply a method for protecting an adaptive process from the effects of input saturation and time delays, known as "pseudo control hedging". This method was originally developed for the state feedback case, and we provide a stability analysis that extends its domain of applicability to the case of output feedback. The approach is illustrated by the design of a pitch-attitude flight control system for a linearized model of an R-50 experimental helicopter, and by the design of a pitch-rate control system for a 58-state model of a flexible aircraft consisting of rigid body dynamics coupled with actuator and flexible modes. A new approach to augmentation of an existing linear controller is introduced. It is especially useful when there is limited information concerning the plant model, and the existing controller. The approach is applied to the design of an adaptive autopilot for a guided munition. Design of a neural network adaptive control that ensures asymptotically stable tracking performance is also addressed.
A patch-based convolutional neural network for remote sensing image classification.
Sharma, Atharva; Liu, Xiuwen; Yang, Xiaojun; Shi, Di
2017-11-01
Availability of accurate land cover information over large areas is essential to the global environment sustainability; digital classification using medium-resolution remote sensing data would provide an effective method to generate the required land cover information. However, low accuracy of existing per-pixel based classification methods for medium-resolution data is a fundamental limiting factor. While convolutional neural networks (CNNs) with deep layers have achieved unprecedented improvements in object recognition applications that rely on fine image structures, they cannot be applied directly to medium-resolution data due to lack of such fine structures. In this paper, considering the spatial relation of a pixel to its neighborhood, we propose a new deep patch-based CNN system tailored for medium-resolution remote sensing data. The system is designed by incorporating distinctive characteristics of medium-resolution data; in particular, the system computes patch-based samples from multidimensional top of atmosphere reflectance data. With a test site from the Florida Everglades area (with a size of 771 square kilometers), the proposed new system has outperformed pixel-based neural network, pixel-based CNN and patch-based neural network by 24.36%, 24.23% and 11.52%, respectively, in overall classification accuracy. By combining the proposed deep CNN and the huge collection of medium-resolution remote sensing data, we believe that much more accurate land cover datasets can be produced over large areas. Copyright © 2017 Elsevier Ltd. All rights reserved.
ECG Prediction Based on Classification via Neural Networks and Linguistic Fuzzy Logic Forecaster.
Volna, Eva; Kotyrba, Martin; Habiballa, Hashim
2015-01-01
The paper deals with ECG prediction based on neural networks classification of different types of time courses of ECG signals. The main objective is to recognise normal cycles and arrhythmias and perform further diagnosis. We proposed two detection systems that have been created with usage of neural networks. The experimental part makes it possible to load ECG signals, preprocess them, and classify them into given classes. Outputs from the classifiers carry a predictive character. All experimental results from both of the proposed classifiers are mutually compared in the conclusion. We also experimented with the new method of time series transparent prediction based on fuzzy transform with linguistic IF-THEN rules. Preliminary results show interesting results based on the unique capability of this approach bringing natural language interpretation of particular prediction, that is, the properties of time series.
Silicon synaptic transistor for hardware-based spiking neural network and neuromorphic system
Kim, Hyungjin; Hwang, Sungmin; Park, Jungjin; Park, Byung-Gook
2017-10-01
Brain-inspired neuromorphic systems have attracted much attention as new computing paradigms for power-efficient computation. Here, we report a silicon synaptic transistor with two electrically independent gates to realize a hardware-based neural network system without any switching components. The spike-timing dependent plasticity characteristics of the synaptic devices are measured and analyzed. With the help of the device model based on the measured data, the pattern recognition capability of the hardware-based spiking neural network systems is demonstrated using the modified national institute of standards and technology handwritten dataset. By comparing systems with and without inhibitory synapse part, it is confirmed that the inhibitory synapse part is an essential element in obtaining effective and high pattern classification capability.
Pandey, Daya Shankar; Das, Saptarshi; Pan, Indranil; Leahy, James J; Kwapinski, Witold
2016-12-01
In this paper, multi-layer feed forward neural networks are used to predict the lower heating value of gas (LHV), lower heating value of gasification products including tars and entrained char (LHV p ) and syngas yield during gasification of municipal solid waste (MSW) during gasification in a fluidized bed reactor. These artificial neural networks (ANNs) with different architectures are trained using the Levenberg-Marquardt (LM) back-propagation algorithm and a cross validation is also performed to ensure that the results generalise to other unseen datasets. A rigorous study is carried out on optimally choosing the number of hidden layers, number of neurons in the hidden layer and activation function in a network using multiple Monte Carlo runs. Nine input and three output parameters are used to train and test various neural network architectures in both multiple output and single output prediction paradigms using the available experimental datasets. The model selection procedure is carried out to ascertain the best network architecture in terms of predictive accuracy. The simulation results show that the ANN based methodology is a viable alternative which can be used to predict the performance of a fluidized bed gasifier. Copyright © 2016 Elsevier Ltd. All rights reserved.
Niessner, R.; Schilling, H.; Jutzi, B.
2017-05-01
In recent years, there has been a significant improvement in the detection, identification and classification of objects and images using Convolutional Neural Networks. To study the potential of the Convolutional Neural Network, in this paper three approaches are investigated to train classifiers based on Convolutional Neural Networks. These approaches allow Convolutional Neural Networks to be trained on datasets containing only a few hundred training samples, which results in a successful classification. Two of these approaches are based on the concept of transfer learning. In the first approach features, created by a pretrained Convolutional Neural Network, are used for a classification using a support vector machine. In the second approach a pretrained Convolutional Neural Network gets fine-tuned on a different data set. The third approach includes the design and training for flat Convolutional Neural Networks from the scratch. The evaluation of the proposed approaches is based on a data set provided by the IEEE Geoscience and Remote Sensing Society (GRSS) which contains RGB and LiDAR data of an urban area. In this work it is shown that these Convolutional Neural Networks lead to classification results with high accuracy both on RGB and LiDAR data. Features which are derived by RGB data transferred into LiDAR data by transfer learning lead to better results in classification in contrast to RGB data. Using a neural network which contains fewer layers than common neural networks leads to the best classification results. In this framework, it can furthermore be shown that the practical application of LiDAR images results in a better data basis for classification of vehicles than the use of RGB images.
Song, Mengmeng; Song, Haixia; Xiao, Shungen
2017-12-01
In this paper, rolling bearing fault diagnosis method is proposed based on wavelet packet threshold de-noising and improved BP neural network. It achieves the goal of signal de-noising by setting the appropriate threshold, and then the denoised signal is decomposed into three layers by wavelet packet. The energy characteristics of the 8 frequency bands are calculated respectively. Levenberg-Maquardt algorithm which is improved the traditional BP neural network to improve the diagnosis efficiency of BP neural network, is proposed. Taking the outer ring fault of rolling bearings as an example, the experimental results show that the wavelet packet threshold de-noising can effectively improve the signal-to-noise ratio. Compared with the traditional BP neural network, the improved BP neural network has better diagnosis efficiency.
Neural networks-based modeling applied to a process of heavy metals removal from wastewaters.
Suditu, Gabriel D; Curteanu, Silvia; Bulgariu, Laura
2013-01-01
This article approaches the problem of environment pollution with heavy metals from disposal of industrial wastewaters, namely removal of these metals by means of biosorbents, particularly with Romanian peat (from Poiana Stampei). The study is carried out by simulation using feed-forward and modular neural networks with one or two hidden layers, pursuing the influence of certain operating parameters (metal nature, sorbent dose, pH, temperature, initial concentration of metal ion, contact time) on the amount of metal ions retained on the unit mass of sorbent. In neural network modeling, a consistent data set was used, including five metals: lead, mercury, cadmium, nickel and cobalt, the quantification of the metal nature being done by its electronegativity. Even if based on successive trials, the method of designing neural models was systematically conducted, recording and comparing the errors obtained with different types of neural networks, having various numbers of hidden layers and neurons, number of training epochs, or using various learning methods. The errors with values under 5% make clear the efficiency of the applied method.
EEG signal classification based on artificial neural networks and amplitude spectra features
Chojnowski, K.; FrÄ czek, J.
BCI (called Brain-Computer Interface) is an interface that allows direct communication between human brain and an external device. It bases on EEG signal collection, processing and classification. In this paper a complete BCI system is presented which classifies EEG signal using artificial neural networks. For this purpose we used a multi-layered perceptron architecture trained with the RProp algorithm. Furthermore a simple multi-threaded method for automatic network structure optimizing was shown. We presented the results of our system in the opening and closing eyes recognition task. We also showed how our system could be used for controlling devices basing on imaginary hand movements.
Directory of Open Access Journals (Sweden)
Pouraria Hassan
2016-01-01
Full Text Available In this study, artificial neural networks (ANNs have been used to model the effects of four important parameters consist of the ratio of the length to diameter(L/D, the ratio of the cold outlet diameter to the tube diameter(d/D, inlet pressure(P, and cold mass fraction (Y on the cooling performance of counter flow vortex tube. In this approach, experimental data have been used to train and validate the neural network model with MATLAB software. Also, genetic algorithm (GA has been used to find the optimal network architecture. In this model, temperature drop at the cold outlet has been considered as the cooling performance of the vortex tube. Based on experimental data, cooling performance of the vortex tube has been predicted by four inlet parameters (L/D, d/D, P, Y. The results of this study indicate that the genetic algorithm-based artificial neural network model is capable of predicting the cooling performance of vortex tube in a wide operating range and with satisfactory precision.
COMPOSITE MATERIALS' CONDITION CLASSIFIER BASED ON NEURAL NETWORK OF ADAPTIVE RESONANCE THEORY
Directory of Open Access Journals (Sweden)
В. Єременко
2012-04-01
Full Text Available In this article proposed to use a modified neural network Fuzzy-ART for classification of thetechnical condition of composite materials. This neural network is used as a part of nondestructivetesting system to perform diagnosis of composite materials and provides cluster analysis andclassification of units under test. The advantage of the described neural network and the system ingeneral is its flexible architecture, high performance and high reliability of data processing
A Neural Networks Based Operation Guidance System for Procedure Presentation and Validation
International Nuclear Information System (INIS)
Seung, Kun Mo; Lee, Seung Jun; Seong, Poong Hyun
2006-01-01
In this paper, a neural network based operator support system is proposed to reduce operator's errors in abnormal situations in nuclear power plants (NPPs). There are many complicated situations, in which regular and suitable operations should be done by operators accordingly. In order to regulate and validate operators' operations, it is necessary to develop an operator support system which includes computer based procedures with the functions for operation validation. Many computerized procedures systems (CPS) have been recently developed. Focusing on the human machine interface (HMI) design and procedures' computerization, most of CPSs used various methodologies to enhance system's convenience, reliability and accessibility. Other than only showing procedures, the proposed system integrates a simple CPS and an operation validation system (OVS) by using artificial neural network (ANN) for operational permission and quantitative evaluation
Directory of Open Access Journals (Sweden)
Heryanto M Ary
2015-01-01
Full Text Available UAVs are mostly used for surveillance, inspection and data acquisition. We have developed a Quadrotor UAV that is constructed based on a four motors with a lift-generating propeller at each motors. In this paper, we discuss the development of a quadrotor and its neural networks direct inverse control model using the actual flight data. To obtain a better performance of the control system of the UAV, we proposed an Optimized Direct Inverse controller based on re-training the neural networks with the new data generated from optimal maneuvers of the quadrotor. Through simulation of the quadrotor using the developed DIC and Optimized DIC model, results show that both models have the ability to stabilize the quadrotor with a good tracking performance. The optimized DIC model, however, has shown a better performance, especially in the settling time parameter.
Improved ultrasonic differentiation model for structural coal types based on neural network
Energy Technology Data Exchange (ETDEWEB)
Zi-jian Tian; Fu-zhong Wang; Tao Li; Shan-shan Bai [China University of Mining & Technology, Beijing (China). School of Electromechanical and Information Engineering
2009-03-15
In order to solve the difficulty of detailed recognition of subdivisions of structural coal types, a differentiation model that combines BP neural network with an ultrasonic reflection method is proposed. Structural coal types are recognized based on a suitable consideration of ultrasonic speed, an ultrasonic attenuation coefficient, characteristics of ultrasonic transmission and other parameters relating to structural coal types. We have focused on a computational model of ultrasonic speed, attenuation coefficient in coal and differentiation algorithm of structural coal types based on a BP neural network. Experiments demonstrate that the model can distinguish structural coal types effectively. It is important for the improved ultrasonic differentiation model to predict coal and gas outbursts. 12 refs., 1 fig., 5 tabs.
Zhu, Aichun; Wang, Tian; Snoussi, Hichem
2018-03-01
This paper addresses the problems of the graphical-based human pose estimation in still images, including the diversity of appearances and confounding background clutter. We present a new architecture for estimating human pose using a Convolutional Neural Network (CNN). Firstly, a Relative Mixture Deformable Model (RMDM) is defined by each pair of connected parts to compute the relative spatial information in the graphical model. Secondly, a Local Multi-Resolution Convolutional Neural Network (LMR-CNN) is proposed to train and learn the multi-scale representation of each body parts by combining different levels of part context. Thirdly, a LMR-CNN based hierarchical model is defined to explore the context information of limb parts. Finally, the experimental results demonstrate the effectiveness of the proposed deep learning approach for human pose estimation.
Directory of Open Access Journals (Sweden)
Aichun Zhu
2018-03-01
Full Text Available This paper addresses the problems of the graphical-based human pose estimation in still images, including the diversity of appearances and confounding background clutter. We present a new architecture for estimating human pose using a Convolutional Neural Network (CNN. Firstly, a Relative Mixture Deformable Model (RMDM is defined by each pair of connected parts to compute the relative spatial information in the graphical model. Secondly, a Local Multi-Resolution Convolutional Neural Network (LMR-CNN is proposed to train and learn the multi-scale representation of each body parts by combining different levels of part context. Thirdly, a LMR-CNN based hierarchical model is defined to explore the context information of limb parts. Finally, the experimental results demonstrate the effectiveness of the proposed deep learning approach for human pose estimation.
Decoherence and Entanglement Simulation in a Model of Quantum Neural Network Based on Quantum Dots
Directory of Open Access Journals (Sweden)
Altaisky Mikhail V.
2016-01-01
Full Text Available We present the results of the simulation of a quantum neural network based on quantum dots using numerical method of path integral calculation. In the proposed implementation of the quantum neural network using an array of single-electron quantum dots with dipole-dipole interaction, the coherence is shown to survive up to 0.1 nanosecond in time and up to the liquid nitrogen temperature of 77K.We study the quantum correlations between the quantum dots by means of calculation of the entanglement of formation in a pair of quantum dots on the GaAs based substrate with dot size of 100 ÷ 101 nanometer and interdot distance of 101 ÷ 102 nanometers order.
Manipulator inverse kinematics control based on particle swarm optimization neural network
Wen, Xiulan; Sheng, Danghong; Guo, Jing
2008-10-01
The inverse kinematics control of a robotic manipulator requires solving non-linear equations having transcendental functions and involving time-consuming calculations. Particle Swarm Optimization (PSO), which is based on the behaviour of insect swarms and exploits the solution space by taking into account the experience of the single particle as well as that of the entire swarm, is similar to the genetic algorithm (GA) in that it performs a structured randomized search of an unknown parameter space by manipulating a population of parameter estimates to converge on a suitable solution. In this paper, PSO is firstly proposed to optimize feed-forward neural network for manipulator inverse kinematics. Compared with the results of the fast back propagation learning algorithm (FBP), conventional GA genetic algorithm based elitist reservation (EGA), improved GA (IGA) and immune evolutionary computation (IEC), the simulation results verify the particle swarm optimization neural network (PSONN) is effective for manipulator inverse kinematics control.
Directory of Open Access Journals (Sweden)
Regina J. Meszlényi
2017-10-01
Full Text Available Machine learning techniques have become increasingly popular in the field of resting state fMRI (functional magnetic resonance imaging network based classification. However, the application of convolutional networks has been proposed only very recently and has remained largely unexplored. In this paper we describe a convolutional neural network architecture for functional connectome classification called connectome-convolutional neural network (CCNN. Our results on simulated datasets and a publicly available dataset for amnestic mild cognitive impairment classification demonstrate that our CCNN model can efficiently distinguish between subject groups. We also show that the connectome-convolutional network is capable to combine information from diverse functional connectivity metrics and that models using a combination of different connectivity descriptors are able to outperform classifiers using only one metric. From this flexibility follows that our proposed CCNN model can be easily adapted to a wide range of connectome based classification or regression tasks, by varying which connectivity descriptor combinations are used to train the network.
Meszlényi, Regina J.; Buza, Krisztian; Vidnyánszky, Zoltán
2017-01-01
Machine learning techniques have become increasingly popular in the field of resting state fMRI (functional magnetic resonance imaging) network based classification. However, the application of convolutional networks has been proposed only very recently and has remained largely unexplored. In this paper we describe a convolutional neural network architecture for functional connectome classification called connectome-convolutional neural network (CCNN). Our results on simulated datasets and a publicly available dataset for amnestic mild cognitive impairment classification demonstrate that our CCNN model can efficiently distinguish between subject groups. We also show that the connectome-convolutional network is capable to combine information from diverse functional connectivity metrics and that models using a combination of different connectivity descriptors are able to outperform classifiers using only one metric. From this flexibility follows that our proposed CCNN model can be easily adapted to a wide range of connectome based classification or regression tasks, by varying which connectivity descriptor combinations are used to train the network. PMID:29089883
Recurrent-neural-network-based Boolean factor analysis and its application to word clustering.
Frolov, Alexander A; Husek, Dusan; Polyakov, Pavel Yu
2009-07-01
The objective of this paper is to introduce a neural-network-based algorithm for word clustering as an extension of the neural-network-based Boolean factor analysis algorithm (Frolov , 2007). It is shown that this extended algorithm supports even the more complex model of signals that are supposed to be related to textual documents. It is hypothesized that every topic in textual data is characterized by a set of words which coherently appear in documents dedicated to a given topic. The appearance of each word in a document is coded by the activity of a particular neuron. In accordance with the Hebbian learning rule implemented in the network, sets of coherently appearing words (treated as factors) create tightly connected groups of neurons, hence, revealing them as attractors of the network dynamics. The found factors are eliminated from the network memory by the Hebbian unlearning rule facilitating the search of other factors. Topics related to the found sets of words can be identified based on the words' semantics. To make the method complete, a special technique based on a Bayesian procedure has been developed for the following purposes: first, to provide a complete description of factors in terms of component probability, and second, to enhance the accuracy of classification of signals to determine whether it contains the factor. Since it is assumed that every word may possibly contribute to several topics, the proposed method might be related to the method of fuzzy clustering. In this paper, we show that the results of Boolean factor analysis and fuzzy clustering are not contradictory, but complementary. To demonstrate the capabilities of this attempt, the method is applied to two types of textual data on neural networks in two different languages. The obtained topics and corresponding words are at a good level of agreement despite the fact that identical topics in Russian and English conferences contain different sets of keywords.
A Toxicity Evaluation and Predictive System Based on Neural Networks and Wavelets
Energy Technology Data Exchange (ETDEWEB)
Piotrowski, Pamela L [ORNL; Sumpter, Bobby G [ORNL; Malling, Heinrich [YAHSGS LLC, Richland, WA; Wassom, John [YAHSGS LLC, Richland, WA; Lu, Po-Yung [ORNL; Bothers, Robin [YAHSGS LLC, Richland, WA; Sega, Gary [YAHSGS LLC, Richland, WA; Martin, Sheryl A [ORNL; Parang, Morey [YAHSGS LLC, Richland, WA
2007-01-01
A computational approach has been developed for performing efficient and reasonably accurate toxicity evaluation and prediction. The approach is based on computational neural networks linked to modern computational chemistry and wavelet methods. In this paper we present details of this approach and results demonstrating its accuracy and flexibility for predicting diverse biological endpoints including metabolic processes, mode of action, and hepato- and neurotoxicity. The approach also can be used for automatic processing of microarray data to predict modes of action.
REAL-TIME VIDEO SCALING BASED ON CONVOLUTION NEURAL NETWORK ARCHITECTURE
S Safinaz; A V Ravi Kumar
2017-01-01
In recent years, video super resolution techniques becomes mandatory requirements to get high resolution videos. Many super resolution techniques researched but still video super resolution or scaling is a vital challenge. In this paper, we have presented a real-time video scaling based on convolution neural network architecture to eliminate the blurriness in the images and video frames and to provide better reconstruction quality while scaling of large datasets from lower resolution frames t...
Recognition of underground nuclear explosion and natural earthquake based on neural network
International Nuclear Information System (INIS)
Yang Hong; Jia Weimin
2000-01-01
Many features are extracted to improve the identified rate and reliability of underground nuclear explosion and natural earthquake. But how to synthesize these characters is the key of pattern recognition. Based on the improved Delta algorithm, features of underground nuclear explosion and natural earthquake are inputted into BP neural network, and friendship functions are constructed to identify the output values. The identified rate is up to 92.0%, which shows that: the way is feasible
Gene Expression Based Leukemia Sub-Classification Using Committee Neural Networks
Sewak, Mihir S.; Reddy, Narender P.; Duan, Zhong-Hui
2009-01-01
Analysis of gene expression data provides an objective and efficient technique for sub‑classification of leukemia. The purpose of the present study was to design a committee neural networks based classification systems to subcategorize leukemia gene expression data. In the study, a binary classification system was considered to differentiate acute lymphoblastic leukemia from acute myeloid leukemia. A ternary classification system which classifies leukemia expression data into three subclasses...
Directory of Open Access Journals (Sweden)
Zorins Aleksejs
2016-12-01
Full Text Available The article presents an introductory analysis of relevant research topic for Latvian deaf society, which is the development of the Latvian Sign Language Recognition System. More specifically the data preprocessing methods are discussed in the paper and several approaches are shown with a focus on systems based on artificial neural networks, which are one of the most successful solutions for sign language recognition task.
An End-to-End Compression Framework Based on Convolutional Neural Networks
Jiang, Feng; Tao, Wen; Liu, Shaohui; Ren, Jie; Guo, Xun; Zhao, Debin
2017-01-01
Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, it is rarely used to solve low-level vision problems such as image compression studied in this paper. Here, we move forward a step and propose a novel compression framework based on CNNs. To achieve high-quality image compression at low bit rates, two CNNs are seamlessly integr...
A new method of machine vision reprocessing based on cellular neural networks
International Nuclear Information System (INIS)
Jianhua, W.; Liping, Z.; Fenfang, Z.; Guojian, H.
1996-01-01
This paper proposed a method of image preprocessing in machine vision based on Cellular Neural Network (CNN). CNN is introduced to design image smoothing, image recovering, image boundary detecting and other image preprocessing problems. The proposed methods are so simple that the speed of algorithms are increased greatly to suit the needs of real-time image processing. The experimental results show a satisfactory reply
Antenna analysis using neural networks
Smith, William T.
1992-01-01
Conventional computing schemes have long been used to analyze problems in electromagnetics (EM). The vast majority of EM applications require computationally intensive algorithms involving numerical integration and solutions to large systems of equations. The feasibility of using neural network computing algorithms for antenna analysis is investigated. The ultimate goal is to use a trained neural network algorithm to reduce the computational demands of existing reflector surface error compensation techniques. Neural networks are computational algorithms based on neurobiological systems. Neural nets consist of massively parallel interconnected nonlinear computational elements. They are often employed in pattern recognition and image processing problems. Recently, neural network analysis has been applied in the electromagnetics area for the design of frequency selective surfaces and beam forming networks. The backpropagation training algorithm was employed to simulate classical antenna array synthesis techniques. The Woodward-Lawson (W-L) and Dolph-Chebyshev (D-C) array pattern synthesis techniques were used to train the neural network. The inputs to the network were samples of the desired synthesis pattern. The outputs are the array element excitations required to synthesize the desired pattern. Once trained, the network is used to simulate the W-L or D-C techniques. Various sector patterns and cosecant-type patterns (27 total) generated using W-L synthesis were used to train the network. Desired pattern samples were then fed to the neural network. The outputs of the network were the simulated W-L excitations. A 20 element linear array was used. There were 41 input pattern samples with 40 output excitations (20 real parts, 20 imaginary). A comparison between the simulated and actual W-L techniques is shown for a triangular-shaped pattern. Dolph-Chebyshev is a different class of synthesis technique in that D-C is used for side lobe control as opposed to pattern
Zhang, Li
With the deregulation of the electric power market in New England, an independent system operator (ISO) has been separated from the New England Power Pool (NEPOOL). The ISO provides a regional spot market, with bids on various electricity-related products and services submitted by utilities and independent power producers. A utility can bid on the spot market and buy or sell electricity via bilateral transactions. Good estimation of market clearing prices (MCP) will help utilities and independent power producers determine bidding and transaction strategies with low risks, and this is crucial for utilities to compete in the deregulated environment. MCP prediction, however, is difficult since bidding strategies used by participants are complicated and MCP is a non-stationary process. The main objective of this research is to provide efficient short-term load and MCP forecasting and corresponding confidence interval estimation methodologies. In this research, the complexity of load and MCP with other factors is investigated, and neural networks are used to model the complex relationship between input and output. With improved learning algorithm and on-line update features for load forecasting, a neural network based load forecaster was developed, and has been in daily industry use since summer 1998 with good performance. MCP is volatile because of the complexity of market behaviors. In practice, neural network based MCP predictors usually have a cascaded structure, as several key input factors need to be estimated first. In this research, the uncertainties involved in a cascaded neural network structure for MCP prediction are analyzed, and prediction distribution under the Bayesian framework is developed. A fast algorithm to evaluate the confidence intervals by using the memoryless Quasi-Newton method is also developed. The traditional back-propagation algorithm for neural network learning needs to be improved since MCP is a non-stationary process. The extended Kalman
Gene expression based leukemia sub-classification using committee neural networks.
Sewak, Mihir S; Reddy, Narender P; Duan, Zhong-Hui
2009-09-03
Analysis of gene expression data provides an objective and efficient technique for sub-classification of leukemia. The purpose of the present study was to design a committee neural networks based classification systems to subcategorize leukemia gene expression data. In the study, a binary classification system was considered to differentiate acute lymphoblastic leukemia from acute myeloid leukemia. A ternary classification system which classifies leukemia expression data into three subclasses including B-cell acute lymphoblastic leukemia, T-cell acute lymphoblastic leukemia and acute myeloid leukemia was also developed. In each classification system gene expression profiles of leukemia patients were first subjected to a sequence of simple preprocessing steps. This resulted in filtering out approximately 95 percent of the non-informative genes. The remaining 5 percent of the informative genes were used to train a set of artificial neural networks with different parameters and architectures. The networks that gave the best results during initial testing were recruited into a committee. The committee decision was by majority voting. The committee neural network system was later evaluated using data not used in training. The binary classification system classified microarray gene expression profiles into two categories with 100 percent accuracy and the ternary system correctly predicted the three subclasses of leukemia in over 97 percent of the cases.
Model for a flexible motor memory based on a self-active recurrent neural network.
Boström, Kim Joris; Wagner, Heiko; Prieske, Markus; de Lussanet, Marc
2013-10-01
Using recent recurrent network architecture based on the reservoir computing approach, we propose and numerically simulate a model that is focused on the aspects of a flexible motor memory for the storage of elementary movement patterns into the synaptic weights of a neural network, so that the patterns can be retrieved at any time by simple static commands. The resulting motor memory is flexible in that it is capable to continuously modulate the stored patterns. The modulation consists in an approximately linear inter- and extrapolation, generating a large space of possible movements that have not been learned before. A recurrent network of thousand neurons is trained in a manner that corresponds to a realistic exercising scenario, with experimentally measured muscular activations and with kinetic data representing proprioceptive feedback. The network is "self-active" in that it maintains recurrent flow of activation even in the absence of input, a feature that resembles the "resting-state activity" found in the human and animal brain. The model involves the concept of "neural outsourcing" which amounts to the permanent shifting of computational load from higher to lower-level neural structures, which might help to explain why humans are able to execute learned skills in a fluent and flexible manner without the need for attention to the details of the movement. Copyright © 2013 Elsevier B.V. All rights reserved.
Rotor Resistance Online Identification of Vector Controlled Induction Motor Based on Neural Network
Directory of Open Access Journals (Sweden)
Bo Fan
2014-01-01
Full Text Available Rotor resistance identification has been well recognized as one of the most critical factors affecting the theoretical study and applications of AC motor’s control for high performance variable frequency speed adjustment. This paper proposes a novel model for rotor resistance parameters identification based on Elman neural networks. Elman recurrent neural network is capable of performing nonlinear function approximation and possesses the ability of time-variable characteristic adaptation. Those influencing factors of specified parameter are analyzed, respectively, and various work states are covered to ensure the completeness of the training samples. Through signal preprocessing on samples and training dataset, different input parameters identifications with one network are compared and analyzed. The trained Elman neural network, applied in the identification model, is able to efficiently predict the rotor resistance in high accuracy. The simulation and experimental results show that the proposed method owns extensive adaptability and performs very well in its application to vector controlled induction motor. This identification method is able to enhance the performance of induction motor’s variable-frequency speed regulation.
Gene Expression Based Leukemia Sub‑Classification Using Committee Neural Networks
Directory of Open Access Journals (Sweden)
Mihir S. Sewak
2009-09-01
Full Text Available Analysis of gene expression data provides an objective and efficient technique for sub‑classification of leukemia. The purpose of the present study was to design a committee neural networks based classification systems to subcategorize leukemia gene expression data. In the study, a binary classification system was considered to differentiate acute lymphoblastic leukemia from acute myeloid leukemia. A ternary classification system which classifies leukemia expression data into three subclasses including B‑cell acute lymphoblastic leukemia, T‑cell acute lymphoblastic leukemia and acute myeloid leukemia was also developed. In each classification system gene expression profiles of leukemia patients were first subjected to a sequence of simple preprocessing steps. This resulted in filtering out approximately 95 percent of the non‑informative genes. The remaining 5 percent of the informative genes were used to train a set of artificial neural networks with different parameters and architectures. The networks that gave the best results during initial testing were recruited into a committee. The committee decision was by majority voting. The committee neural network system was later evaluated using data not used in training. The binary classification system classified microarray gene expression profiles into two categories with 100 percent accuracy and the ternary system correctly predicted the three subclasses of leukemia in over 97 percent of the cases.
Optimization of Component Based Software Engineering Model Using Neural Network
Gaurav Kumar; Pradeep Kumar Bhatia
2014-01-01
The goal of Component Based Software Engineering (CBSE) is to deliver high quality, more reliable and more maintainable software systems in a shorter time and within limited budget by reusing and combining existing quality components. A high quality system can be achieved by using quality components, framework and integration process that plays a significant role. So, techniques and methods used for quality assurance and assessment of a component based system is different from those of the tr...
Automatic brain MR image denoising based on texture feature-based artificial neural networks.
Chang, Yu-Ning; Chang, Herng-Hua
2015-01-01
Noise is one of the main sources of quality deterioration not only for visual inspection but also in computerized processing in brain magnetic resonance (MR) image analysis such as tissue classification, segmentation and registration. Accordingly, noise removal in brain MR images is important for a wide variety of subsequent processing applications. However, most existing denoising algorithms require laborious tuning of parameters that are often sensitive to specific image features and textures. Automation of these parameters through artificial intelligence techniques will be highly beneficial. In the present study, an artificial neural network associated with image texture feature analysis is proposed to establish a predictable parameter model and automate the denoising procedure. In the proposed approach, a total of 83 image attributes were extracted based on four categories: 1) Basic image statistics. 2) Gray-level co-occurrence matrix (GLCM). 3) Gray-level run-length matrix (GLRLM) and 4) Tamura texture features. To obtain the ranking of discrimination in these texture features, a paired-samples t-test was applied to each individual image feature computed in every image. Subsequently, the sequential forward selection (SFS) method was used to select the best texture features according to the ranking of discrimination. The selected optimal features were further incorporated into a back propagation neural network to establish a predictable parameter model. A wide variety of MR images with various scenarios were adopted to evaluate the performance of the proposed framework. Experimental results indicated that this new automation system accurately predicted the bilateral filtering parameters and effectively removed the noise in a number of MR images. Comparing to the manually tuned filtering process, our approach not only produced better denoised results but also saved significant processing time.
Neural networks in signal processing
International Nuclear Information System (INIS)
Govil, R.
2000-01-01
Nuclear Engineering has matured during the last decade. In research and design, control, supervision, maintenance and production, mathematical models and theories are used extensively. In all such applications signal processing is embedded in the process. Artificial Neural Networks (ANN), because of their nonlinear, adaptive nature are well suited to such applications where the classical assumptions of linearity and second order Gaussian noise statistics cannot be made. ANN's can be treated as nonparametric techniques, which can model an underlying process from example data. They can also adopt their model parameters to statistical change with time. Algorithms in the framework of Neural Networks in Signal processing have found new applications potentials in the field of Nuclear Engineering. This paper reviews the fundamentals of Neural Networks in signal processing and their applications in tasks such as recognition/identification and control. The topics covered include dynamic modeling, model based ANN's, statistical learning, eigen structure based processing and generalization structures. (orig.)
Automatic Classification of volcano-seismic events based on Deep Neural Networks.
Titos Luzón, M.; Bueno Rodriguez, A.; Garcia Martinez, L.; Benitez, C.; Ibáñez, J. M.
2017-12-01
Seismic monitoring of active volcanoes is a popular remote sensing technique to detect seismic activity, often associated to energy exchanges between the volcano and the environment. As a result, seismographs register a wide range of volcano-seismic signals that reflect the nature and underlying physics of volcanic processes. Machine learning and signal processing techniques provide an appropriate framework to analyze such data. In this research, we propose a new classification framework for seismic events based on deep neural networks. Deep neural networks are composed by multiple processing layers, and can discover intrinsic patterns from the data itself. Internal parameters can be initialized using a greedy unsupervised pre-training stage, leading to an efficient training of fully connected architectures. We aim to determine the robustness of these architectures as classifiers of seven different types of seismic events recorded at "Volcán de Fuego" (Colima, Mexico). Two deep neural networks with different pre-training strategies are studied: stacked denoising autoencoder and deep belief networks. Results are compared to existing machine learning algorithms (SVM, Random Forest, Multilayer Perceptron). We used 5 LPC coefficients over three non-overlapping segments as training features in order to characterize temporal evolution, avoid redundancy and encode the signal, regardless of its duration. Experimental results show that deep architectures can classify seismic events with higher accuracy than classical algorithms, attaining up to 92% recognition accuracy. Pre-training initialization helps these models to detect events that occur simultaneously in time (such explosions and rockfalls), increase robustness against noisy inputs, and provide better generalization. These results demonstrate deep neural networks are robust classifiers, and can be deployed in real-environments to monitor the seismicity of restless volcanoes.
Evaluation and prediction of solar radiation for energy management based on neural networks
Aldoshina, O. V.; Van Tai, Dinh
2017-08-01
Currently, there is a high rate of distribution of renewable energy sources and distributed power generation based on intelligent networks; therefore, meteorological forecasts are particularly useful for planning and managing the energy system in order to increase its overall efficiency and productivity. The application of artificial neural networks (ANN) in the field of photovoltaic energy is presented in this article. Implemented in this study, two periodically repeating dynamic ANS, that are the concentration of the time delay of a neural network (CTDNN) and the non-linear autoregression of a network with exogenous inputs of the NAEI, are used in the development of a model for estimating and daily forecasting of solar radiation. ANN show good productivity, as reliable and accurate models of daily solar radiation are obtained. This allows to successfully predict the photovoltaic output power for this installation. The potential of the proposed method for controlling the energy of the electrical network is shown using the example of the application of the NAEI network for predicting the electric load.
Pani, Ajaya Kumar; Vadlamudi, Vamsi Krishna; Mohanta, Hare Krishna
2013-01-01
The online estimation of process outputs mostly related to quality, as opposed to their belated measurement by means of hardware measuring devices and laboratory analysis, represents the most valuable feature of soft sensors. As of now there have been very few attempts for soft sensing of cement clinker quality which is mostly done by offline laboratory analysis resulting at times in low quality clinker. In the present work three different neural network based soft sensors have been developed for online estimation of cement clinker properties. Different input and output data for a rotary cement kiln were collected from a cement plant producing 10,000 tons of clinker per day. The raw data were pre-processed to remove the outliers and the resulting missing data were imputed. The processed data were then used to develop a back propagation neural network model, a radial basis network model and a regression network model to estimate the clinker quality online. A comparison of the estimation capabilities of the three models has been done by simulation of the developed models. It was observed that radial basis network model produced better estimation capabilities than the back propagation and regression network models. Copyright © 2012 ISA. Published by Elsevier Ltd. All rights reserved.
Gas metal arc welding of butt joint with varying gap width based on neural networks
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2005-01-01
This paper describes the application of the neural network technology for gas metal arc welding (GMAW) control. A system has been developed for modeling and online adjustment of welding parameters, appropriate to guarantee a certain degree of quality in the field of butt joint welding with full...... penetration, when the gap width is varying during the welding process. The process modeling to facilitate the mapping from joint geometry and reference weld quality to significant welding parameters, has been based on a multi-layer feed-forward network. The Levenberg-Marquardt algorithm for non-linear least...
[Research on electrocardiogram de-noising algorithm based on wavelet neural networks].
Wan, Xiangkui; Zhang, Jun
2010-12-01
In this paper, the ECG de-noising technology based on wavelet neural networks (WNN) is used to deal with the noises in Electrocardiogram (ECG) signal. The structure of WNN, which has the outstanding nonlinear mapping capability, is designed as a nonlinear filter used for ECG to cancel the baseline wander, electromyo-graphical interference and powerline interference. The network training algorithm and de-noising experiments results are presented, and some key points of the WNN filter using ECG de-noising are discussed.
Directory of Open Access Journals (Sweden)
Renzhi Cao
2017-10-01
Full Text Available With the development of next generation sequencing techniques, it is fast and cheap to determine protein sequences but relatively slow and expensive to extract useful information from protein sequences because of limitations of traditional biological experimental techniques. Protein function prediction has been a long standing challenge to fill the gap between the huge amount of protein sequences and the known function. In this paper, we propose a novel method to convert the protein function problem into a language translation problem by the new proposed protein sequence language “ProLan” to the protein function language “GOLan”, and build a neural machine translation model based on recurrent neural networks to translate “ProLan” language to “GOLan” language. We blindly tested our method by attending the latest third Critical Assessment of Function Annotation (CAFA 3 in 2016, and also evaluate the performance of our methods on selected proteins whose function was released after CAFA competition. The good performance on the training and testing datasets demonstrates that our new proposed method is a promising direction for protein function prediction. In summary, we first time propose a method which converts the protein function prediction problem to a language translation problem and applies a neural machine translation model for protein function prediction.
Cao, Renzhi; Freitas, Colton; Chan, Leong; Sun, Miao; Jiang, Haiqing; Chen, Zhangxin
2017-10-17
With the development of next generation sequencing techniques, it is fast and cheap to determine protein sequences but relatively slow and expensive to extract useful information from protein sequences because of limitations of traditional biological experimental techniques. Protein function prediction has been a long standing challenge to fill the gap between the huge amount of protein sequences and the known function. In this paper, we propose a novel method to convert the protein function problem into a language translation problem by the new proposed protein sequence language "ProLan" to the protein function language "GOLan", and build a neural machine translation model based on recurrent neural networks to translate "ProLan" language to "GOLan" language. We blindly tested our method by attending the latest third Critical Assessment of Function Annotation (CAFA 3) in 2016, and also evaluate the performance of our methods on selected proteins whose function was released after CAFA competition. The good performance on the training and testing datasets demonstrates that our new proposed method is a promising direction for protein function prediction. In summary, we first time propose a method which converts the protein function prediction problem to a language translation problem and applies a neural machine translation model for protein function prediction.
Based on Artificial Neural Network to Realize K-Parameter Analysis of Vehicle Air Spring System
Hung, San-Shan; Hsu, Chia-Ning; Hwang, Chang-Chou; Chen, Wen-Jan
2017-10-01
In recent years, because of the air-spring control technique is more mature, that air- spring suspension systems already can be used to replace the classical vehicle suspension system. Depend on internal pressure variation of the air-spring, thestiffnessand the damping factor can be adjusted. Because of air-spring has highly nonlinear characteristic, therefore it isn’t easy to construct the classical controller to control the air-spring effectively. The paper based on Artificial Neural Network to propose a feasible control strategy. By using offline way for the neural network design and learning to the air-spring in different initial pressures and different loads, offline method through, predict air-spring stiffness parameter to establish a model. Finally, through adjusting air-spring internal pressure to change the K-parameter of the air-spring, realize the well dynamic control performance of air-spring suspension.
Chaotic Extension Neural Network-Based Fault Diagnosis Method for Solar Photovoltaic Systems
Directory of Open Access Journals (Sweden)
Kuo-Nan Yu
2014-01-01
Full Text Available At present, the solar photovoltaic system is extensively used. However, once a fault occurs, it is inspected manually, which is not economical. In order to remedy the defect of unavailable fault diagnosis at any irradiance and temperature in the literature with chaos synchronization based intelligent fault diagnosis for photovoltaic systems proposed by Hsieh et al., this study proposed a chaotic extension fault diagnosis method combined with error back propagation neural network to overcome this problem. It used the nn toolbox of matlab 2010 for simulation and comparison, measured current irradiance and temperature, and used the maximum power point tracking (MPPT for chaotic extraction of eigenvalue. The range of extension field was determined by neural network. Finally, the voltage eigenvalue obtained from current temperature and irradiance was used for the fault diagnosis. Comparing the diagnostic rates with the results by Hsieh et al., this scheme can obtain better diagnostic rates when the irradiances or the temperatures are changed.
International Nuclear Information System (INIS)
Erkaymaz, Hande; Ozer, Mahmut; Orak, İlhami Muharrem
2015-01-01
The electrooculogram signals are very important at extracting information about detection of directional eye movements. Therefore, in this study, we propose a new intelligent detection model involving an artificial neural network for the eye movements based on the electrooculogram signals. In addition to conventional eye movements, our model also involves the detection of tic and blinking of an eye. We extract only two features from the electrooculogram signals, and use them as inputs for a feed-forwarded artificial neural network. We develop a new approach to compute these two features, which we call it as a movement range. The results suggest that the proposed model have a potential to become a new tool to determine the directional eye movements accurately
Control Strategy Based on Wavelet Transform and Neural Network for Hybrid Power System
Directory of Open Access Journals (Sweden)
Y. D. Song
2013-01-01
Full Text Available This paper deals with an energy management of a hybrid power generation system. The proposed control strategy for the energy management is based on the combination of wavelet transform and neural network arithmetic. The hybrid system in this paper consists of an emulated wind turbine generator, PV panels, DC and AC loads, lithium ion battery, and super capacitor, which are all connected on a DC bus with unified DC voltage. The control strategy is responsible for compensating the difference between the generated power from the wind and solar generators and the demanded power by the loads. Wavelet transform decomposes the power difference into smoothed component and fast fluctuated component. In consideration of battery protection, the neural network is introduced to calculate the reference power of battery. Super capacitor (SC is controlled to regulate the DC bus voltage. The model of the hybrid system is developed in detail under Matlab/Simulink software environment.
Directory of Open Access Journals (Sweden)
Janmenjoy Nayak
2015-09-01
Full Text Available In this paper, a Chemical Reaction Optimization (CRO based higher order neural network with a single hidden layer called Pi–Sigma Neural Network (PSNN has been proposed for data classification which maintains fast learning capability and avoids the exponential increase of number of weights and processing units. CRO is a recent metaheuristic optimization algorithm inspired by chemical reactions, free from intricate operator and parameter settings such as other algorithms and loosely couples chemical reactions with optimization. The performance of the proposed CRO-PSNN has been tested with various benchmark datasets from UCI machine learning repository and compared with the resulting performance of PSNN, GA-PSNN, PSO-PSNN. The methods have been implemented in MATLAB and the accuracy measures have been tested by using the ANOVA statistical tool. Experimental results show that the proposed method is fast, steady and reliable and provides better classification accuracy than others.
International Nuclear Information System (INIS)
Ekkachai, Kittipong; Nilkhamhang, Itthisek; Tungpimolrut, Kanokvate
2013-01-01
An inverse controller is proposed for a magnetorheological (MR) damper that consists of a hysteresis model and a voltage controller. The force characteristics of the MR damper caused by excitation signals are represented by a feedforward neural network (FNN) with an elementary hysteresis model (EHM). The voltage controller is constructed using another FNN to calculate a suitable input signal that will allow the MR damper to produce the desired damping force. The performance of the proposed EHM-based FNN controller is experimentally compared to existing control methodologies, such as clipped-optimal control, signum function control, conventional FNN, and recurrent neural network with displacement or velocity inputs. The results show that the proposed controller, which does not require force feedback to implement, provides excellent accuracy, fast response time, and lower energy consumption. (paper)
A Lateral Control Method of Intelligent Vehicle Based on Fuzzy Neural Network
Directory of Open Access Journals (Sweden)
Linhui Li
2015-01-01
Full Text Available A lateral control method is proposed for intelligent vehicle to track the desired trajectory. Firstly, a lateral control model is established based on the visual preview and dynamic characteristics of intelligent vehicle. Then, the lateral error and orientation error are melded into an integrated error. Considering the system parameter perturbation and the external interference, a sliding model control is introduced in this paper. In order to design a sliding surface, the integrated error is chosen as the parameter of the sliding mode switching function. The sliding mode switching function and its derivative are selected as two inputs of the controller, and the front wheel angle is selected as the output. Next, a fuzzy neural network is established, and the self-learning functions of neural network is utilized to construct the fuzzy rules. Finally, the simulation results demonstrate the effectiveness and robustness of the proposed method.
Multiple Linear Regression Model Based on Neural Network and Its Application in the MBR Simulation
Directory of Open Access Journals (Sweden)
Chunqing Li
2012-01-01
Full Text Available The computer simulation of the membrane bioreactor MBR has become the research focus of the MBR simulation. In order to compensate for the defects, for example, long test period, high cost, invisible equipment seal, and so forth, on the basis of conducting in-depth study of the mathematical model of the MBR, combining with neural network theory, this paper proposed a three-dimensional simulation system for MBR wastewater treatment, with fast speed, high efficiency, and good visualization. The system is researched and developed with the hybrid programming of VC++ programming language and OpenGL, with a multifactor linear regression model of affecting MBR membrane fluxes based on neural network, applying modeling method of integer instead of float and quad tree recursion. The experiments show that the three-dimensional simulation system, using the above models and methods, has the inspiration and reference for the future research and application of the MBR simulation technology.
Effective Multifocus Image Fusion Based on HVS and BP Neural Network
Directory of Open Access Journals (Sweden)
Yong Yang
2014-01-01
Full Text Available The aim of multifocus image fusion is to fuse the images taken from the same scene with different focuses to obtain a resultant image with all objects in focus. In this paper, a novel multifocus image fusion method based on human visual system (HVS and back propagation (BP neural network is presented. Three features which reflect the clarity of a pixel are firstly extracted and used to train a BP neural network to determine which pixel is clearer. The clearer pixels are then used to construct the initial fused image. Thirdly, the focused regions are detected by measuring the similarity between the source images and the initial fused image followed by morphological opening and closing operations. Finally, the final fused image is obtained by a fusion rule for those focused regions. Experimental results show that the proposed method can provide better performance and outperform several existing popular fusion methods in terms of both objective and subjective evaluations.
Directory of Open Access Journals (Sweden)
Pengyu Gao
2016-03-01
Full Text Available It is difficult to forecast the well productivity because of the complexity of vertical and horizontal developments in fluvial facies reservoir. This paper proposes a method based on Principal Component Analysis and Artificial Neural Network to predict well productivity of fluvial facies reservoir. The method summarizes the statistical reservoir factors and engineering factors that affect the well productivity, extracts information by applying the principal component analysis method and approximates arbitrary functions of the neural network to realize an accurate and efficient prediction on the fluvial facies reservoir well productivity. This method provides an effective way for forecasting the productivity of fluvial facies reservoir which is affected by multi-factors and complex mechanism. The study result shows that this method is a practical, effective, accurate and indirect productivity forecast method and is suitable for field application.
Directory of Open Access Journals (Sweden)
Haorui Liu
2016-01-01
Full Text Available In the car control systems, it is hard to measure some key vehicle states directly and accurately when running on the road and the cost of the measurement is high as well. To address these problems, a vehicle state estimation method based on the kernel principal component analysis and the improved Elman neural network is proposed. Combining with nonlinear vehicle model of three degrees of freedom (3 DOF, longitudinal, lateral, and yaw motion, this paper applies the method to the soft sensor of the vehicle states. The simulation results of the double lane change tested by Matlab/SIMULINK cosimulation prove the KPCA-IENN algorithm (kernel principal component algorithm and improved Elman neural network to be quick and precise when tracking the vehicle states within the nonlinear area. This algorithm method can meet the software performance requirements of the vehicle states estimation in precision, tracking speed, noise suppression, and other aspects.
Directory of Open Access Journals (Sweden)
Ming-Shyan Wang
2015-01-01
Full Text Available An automatic guided vehicle (AGV is extensively used for productions in a flexible manufacture system with high efficiency and high flexibility. A servomotor-based AGV is designed and implemented in this paper. In order to steer the AGV to go along a predefined path with corner or arc, the conventional proportional-integral-derivative (PID control is used in the system. However, it is difficult to tune PID gains at various conditions. As a result, the neural network (NN control is considered to assist the PID control for gain tuning. The experimental results are first provided to verify the correctness of the neural network plus PID control for 400 W-motor control system. Secondly, the AGV includes two sets of the designed motor systems and CAN BUS transmission so that it can move along the straight line and curve paths shown in the taped videos.
International Nuclear Information System (INIS)
Cao Jinde; Ho, Daniel W.C.
2005-01-01
In this paper, global asymptotic stability is discussed for neural networks with time-varying delay. Several new criteria in matrix inequality form are given to ascertain the uniqueness and global asymptotic stability of equilibrium point for neural networks with time-varying delay based on Lyapunov method and Linear Matrix Inequality (LMI) technique. The proposed LMI approach has the advantage of considering the difference of neuronal excitatory and inhibitory efforts, which is also computationally efficient as it can be solved numerically using recently developed interior-point algorithm. In addition, the proposed results generalize and improve previous works. The obtained criteria also combine two existing conditions into one generalized condition in matrix form. An illustrative example is also given to demonstrate the effectiveness of the proposed results
Permeability Estimation of Rock Reservoir Based on PCA and Elman Neural Networks
Shi, Ying; Jian, Shaoyong
2018-03-01
an intelligent method which based on fuzzy neural networks with PCA algorithm, is proposed to estimate the permeability of rock reservoir. First, the dimensionality reduction process is utilized for these parameters by principal component analysis method. Further, the mapping relationship between rock slice characteristic parameters and permeability had been found through fuzzy neural networks. The estimation validity and reliability for this method were tested with practical data from Yan’an region in Ordos Basin. The result showed that the average relative errors of permeability estimation for this method is 6.25%, and this method had the better convergence speed and more accuracy than other. Therefore, by using the cheap rock slice related information, the permeability of rock reservoir can be estimated efficiently and accurately, and it is of high reliability, practicability and application prospect.
VINE: A Variational Inference -Based Bayesian Neural Network Engine
2018-01-01
functions and learning rates. The Python implementation that will be turned in is a parameterized implementation of the EASI algorithm in the sense that...Inference (VI) engine to perform inference and learning (statically and on-the-fly) under uncertain or incomplete input and output features. A secondary...realization, and that can not only do inference but also can be retrained on-the-fly based on incoming data. 15. SUBJECT TERMS Machine learning
Tagliaferri, Roberto; Longo, Giuseppe; Milano, Leopoldo; Acernese, Fausto; Barone, Fabrizio; Ciaramella, Angelo; De Rosa, Rosario; Donalek, Ciro; Eleuteri, Antonio; Raiconi, Giancarlo; Sessa, Salvatore; Staiano, Antonino; Volpicelli, Alfredo
2003-01-01
In the last decade, the use of neural networks (NN) and of other soft computing methods has begun to spread also in the astronomical community which, due to the required accuracy of the measurements, is usually reluctant to use automatic tools to perform even the most common tasks of data reduction and data mining. The federation of heterogeneous large astronomical databases which is foreseen in the framework of the astrophysical virtual observatory and national virtual observatory projects, is, however, posing unprecedented data mining and visualization problems which will find a rather natural and user friendly answer in artificial intelligence tools based on NNs, fuzzy sets or genetic algorithms. This review is aimed to both astronomers (who often have little knowledge of the methodological background) and computer scientists (who often know little about potentially interesting applications), and therefore will be structured as follows: after giving a short introduction to the subject, we shall summarize the methodological background and focus our attention on some of the most interesting fields of application, namely: object extraction and classification, time series analysis, noise identification, and data mining. Most of the original work described in the paper has been performed in the framework of the AstroNeural collaboration (Napoli-Salerno).
REAL-TIME VIDEO SCALING BASED ON CONVOLUTION NEURAL NETWORK ARCHITECTURE
Directory of Open Access Journals (Sweden)
S Safinaz
2017-08-01
Full Text Available In recent years, video super resolution techniques becomes mandatory requirements to get high resolution videos. Many super resolution techniques researched but still video super resolution or scaling is a vital challenge. In this paper, we have presented a real-time video scaling based on convolution neural network architecture to eliminate the blurriness in the images and video frames and to provide better reconstruction quality while scaling of large datasets from lower resolution frames to high resolution frames. We compare our outcomes with multiple exiting algorithms. Our extensive results of proposed technique RemCNN (Reconstruction error minimization Convolution Neural Network shows that our model outperforms the existing technologies such as bicubic, bilinear, MCResNet and provide better reconstructed motioning images and video frames. The experimental results shows that our average PSNR result is 47.80474 considering upscale-2, 41.70209 for upscale-3 and 36.24503 for upscale-4 for Myanmar dataset which is very high in contrast to other existing techniques. This results proves our proposed model real-time video scaling based on convolution neural network architecture’s high efficiency and better performance.
Directory of Open Access Journals (Sweden)
J. C. Ochoa-Rivera
2002-01-01
Full Text Available A model for multivariate streamflow generation is presented, based on a multilayer feedforward neural network. The structure of the model results from two components, the neural network (NN deterministic component and a random component which is assumed to be normally distributed. It is from this second component that the model achieves the ability to incorporate effectively the uncertainty associated with hydrological processes, making it valuable as a practical tool for synthetic generation of streamflow series. The NN topology and the corresponding analytical explicit formulation of the model are described in detail. The model is calibrated with a series of monthly inflows to two reservoir sites located in the Tagus River basin (Spain, while validation is performed through estimation of a set of statistics that is relevant for water resources systems planning and management. Among others, drought and storage statistics are computed and compared for both the synthetic and historical series. The performance of the NN-based model was compared to that of a standard autoregressive AR(2 model. Results show that NN represents a promising modelling alternative for simulation purposes, with interesting potential in the context of water resources systems management and optimisation. Keywords: neural networks, perceptron multilayer, error backpropagation, hydrological scenario generation, multivariate time-series..
Neural-Network-Based Fuzzy Logic Navigation Control for Intelligent Vehicles
Directory of Open Access Journals (Sweden)
Ahcene Farah
2002-06-01
Full Text Available This paper proposes a Neural-Network-Based Fuzzy logic system for navigation control of intelligent vehicles. First, the use of Neural Networks and Fuzzy Logic to provide intelligent vehicles with more autonomy and intelligence is discussed. Second, the system for the obstacle avoidance behavior is developed. Fuzzy Logic improves Neural Networks (NN obstacle avoidance approach by handling imprecision and rule-based approximate reasoning. This system must make the vehicle able, after supervised learning, to achieve two tasks: 1- to make one’s way towards its target by a NN, and 2- to avoid static or dynamic obstacles by a Fuzzy NN capturing the behavior of a human expert. Afterwards, two association phases between each task and the appropriate actions are carried out by Trial and Error learning and their coordination allows to decide the appropriate action. Finally, the simulation results display the generalization and adaptation abilities of the system by testing it in new unexplored environments.
Directory of Open Access Journals (Sweden)
Tienfuan Kerh
2013-01-01
Full Text Available This study proposes an improved computational neural network model that uses three seismic parameters (i.e., local magnitude, epicentral distance, and epicenter depth and two geological conditions (i.e., shear wave velocity and standard penetration test value as the inputs for predicting peak ground acceleration—the key element for evaluating earthquake response. Initial comparison results show that a neural network model with three neurons in the hidden layer can achieve relatively better performance based on the evaluation index of correlation coefficient or mean square error. This study further develops a new weight-based neural network model for estimating peak ground acceleration at unchecked sites. Four locations identified to have higher estimated peak ground accelerations than that of the seismic design value in the 24 subdivision zones are investigated in Taiwan. Finally, this study develops a new equation for the relationship of horizontal peak ground acceleration and focal distance by the curve fitting method. This equation represents seismic characteristics in Taiwan region more reliably and reasonably. The results of this study provide an insight into this type of nonlinear problem, and the proposed method may be applicable to other areas of interest around the world.
Directory of Open Access Journals (Sweden)
Somaye Yeylaghi
2017-06-01
Full Text Available In this paper, a novel hybrid method based on interval-valued fuzzy neural network for approximate of interval-valued fuzzy regression models, is presented. The work of this paper is an expansion of the research of real fuzzy regression models. In this paper interval-valued fuzzy neural network (IVFNN can be trained with crisp and interval-valued fuzzy data. Here a neural network is considered as a part of a large field called neural computing or soft computing. Moreover, in order to find the approximate parameters, a simple algorithm from the cost function of the fuzzy neural network is proposed. Finally, we illustrate our approach by some numerical examples and compare this method with existing methods.
Dynamic training algorithm for dynamic neural networks
International Nuclear Information System (INIS)
Tan, Y.; Van Cauwenberghe, A.; Liu, Z.
1996-01-01
The widely used backpropagation algorithm for training neural networks based on the gradient descent has a significant drawback of slow convergence. A Gauss-Newton method based recursive least squares (RLS) type algorithm with dynamic error backpropagation is presented to speed-up the learning procedure of neural networks with local recurrent terms. Finally, simulation examples concerning the applications of the RLS type algorithm to identification of nonlinear processes using a local recurrent neural network are also included in this paper
Temperature prediction and analysis based on BP and Elman neural network for cement rotary kiln
Yang, Baosheng; Ma, Xiushui
2011-05-01
In order to reduce energy consumption and improve the stability of cement burning system production, it is necessary to conduct in-depth analysis of the cement burning system, control the operation state and law of the system. In view of the rotary kiln consumes most of the fuel, we establish the simulation model of the cement kiln used to find effective control methods. It is difficult to construct mathematical model for the rotary cement kiln as the complex parameters, so we expressed directly using neural network method to establish the simulation model for the kiln. Choosing reasonable state and control variables and collecting actual operation data to train neural network weights. We first in-depth analyze mechanism and working parameters correlation to determine factors of the yield and quality as the model input variables; then constructed cement kiln model based on BP and Elman network, both achieved good fitting results. Elman network model has a faster convergence speed, high precision and good generalization ability. So the Elman network based model can be used as simulation model of the cement rotary kiln for exploring new control method.
Knowledge base and neural network approach for protein secondary structure prediction.
Patel, Maulika S; Mazumdar, Himanshu S
2014-11-21
Protein structure prediction is of great relevance given the abundant genomic and proteomic data generated by the genome sequencing projects. Protein secondary structure prediction is addressed as a sub task in determining the protein tertiary structure and function. In this paper, a novel algorithm, KB-PROSSP-NN, which is a combination of knowledge base and modeling of the exceptions in the knowledge base using neural networks for protein secondary structure prediction (PSSP), is proposed. The knowledge base is derived from a proteomic sequence-structure database and consists of the statistics of association between the 5-residue words and corresponding secondary structure. The predicted results obtained using knowledge base are refined with a Backpropogation neural network algorithm. Neural net models the exceptions of the knowledge base. The Q3 accuracy of 90% and 82% is achieved on the RS126 and CB396 test sets respectively which suggest improvement over existing state of art methods. Copyright © 2014 Elsevier Ltd. All rights reserved.
Li, Hongfei; Jiang, Haijun; Hu, Cheng
2016-03-01
In this paper, we investigate a class of memristor-based BAM neural networks with time-varying delays. Under the framework of Filippov solutions, boundedness and ultimate boundedness of solutions of memristor-based BAM neural networks are guaranteed by Chain rule and inequalities technique. Moreover, a new method involving Yoshizawa-like theorem is favorably employed to acquire the existence of periodic solution. By applying the theory of set-valued maps and functional differential inclusions, an available Lyapunov functional and some new testable algebraic criteria are derived for ensuring the uniqueness and global exponential stability of periodic solution of memristor-based BAM neural networks. The obtained results expand and complement some previous work on memristor-based BAM neural networks. Finally, a numerical example is provided to show the applicability and effectiveness of our theoretical results. Copyright © 2015 Elsevier Ltd. All rights reserved.
A Brief Review of Neural Networks Based Learning and Control and Their Applications for Robots
Directory of Open Access Journals (Sweden)
Yiming Jiang
2017-01-01
Full Text Available As an imitation of the biological nervous systems, neural networks (NNs, which have been characterized as powerful learning tools, are employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification, and patterns recognition. This article aims to bring a brief review of the state-of-the-art NNs for the complex nonlinear systems by summarizing recent progress of NNs in both theory and practical applications. Specifically, this survey also reviews a number of NN based robot control algorithms, including NN based manipulator control, NN based human-robot interaction, and NN based cognitive control.
Research on Daily Objects Detection Based on Deep Neural Network
Ding, Sheng; Zhao, Kun
2018-03-01
With the rapid development of deep learning, great breakthroughs have been made in the field of object detection. In this article, the deep learning algorithm is applied to the detection of daily objects, and some progress has been made in this direction. Compared with traditional object detection methods, the daily objects detection method based on deep learning is faster and more accurate. The main research work of this article: 1. collect a small data set of daily objects; 2. in the TensorFlow framework to build different models of object detection, and use this data set training model; 3. the training process and effect of the model are improved by fine-tuning the model parameters.
Design of FPGA Based Neural Network Controller for Earth Station Power System
Hassen T. Dorrah; Ninet M. A. El-Rahman; Faten H. Fahmy; Hanaa T. El-Madany
2012-01-01
Automation of generating hardware description language code from neural networks models can highly decrease time of implementation those networks into a digital devices, thus significant money savings. To implement the neural network into hardware designer, it is required to translate generated model into device structure. VHDL language is used to describe those networks into hardware. VHDL code has been proposed to implement ANNs as well as to present simulation results with floating point a...
Deconvolution using a neural network
Energy Technology Data Exchange (ETDEWEB)
Lehman, S.K.
1990-11-15
Viewing one dimensional deconvolution as a matrix inversion problem, we compare a neural network backpropagation matrix inverse with LMS, and pseudo-inverse. This is a largely an exercise in understanding how our neural network code works. 1 ref.
2016-07-13
AFRL-RH-WP-TR-2016-0075 Evaluation of Physiologically – Based Artificial Neural Network Models to Detect Operator Workload in Remotely...16 Interim Report 1 August 2015 – 8 July 2016 4. TITLE AND SUBTITLE Evaluation of Physiologically – Based Artificial Neural Network Models to...One proposal to accomplish this is to allow operators to control multiple aircraft simultaneously (Rose, Arnold, & Howse, 2013). However, piloting
Artificial neural network modelling
Samarasinghe, Sandhya
2016-01-01
This book covers theoretical aspects as well as recent innovative applications of Artificial Neural networks (ANNs) in natural, environmental, biological, social, industrial and automated systems. It presents recent results of ANNs in modelling small, large and complex systems under three categories, namely, 1) Networks, Structure Optimisation, Robustness and Stochasticity 2) Advances in Modelling Biological and Environmental Systems and 3) Advances in Modelling Social and Economic Systems. The book aims at serving undergraduates, postgraduates and researchers in ANN computational modelling. .
Recurrent Neural Network Approach Based on the Integral Representation of the Drazin Inverse.
Stanimirović, Predrag S; Živković, Ivan S; Wei, Yimin
2015-10-01
In this letter, we present the dynamical equation and corresponding artificial recurrent neural network for computing the Drazin inverse for arbitrary square real matrix, without any restriction on its eigenvalues. Conditions that ensure the stability of the defined recurrent neural network as well as its convergence toward the Drazin inverse are considered. Several illustrative examples present the results of computer simulations.
Ahmed, Rounaq; Srinivasa Pai, P.; Sriram, N. S.; Bhat, Vasudeva
2018-02-01
Vibration Analysis has been extensively used in recent past for gear fault diagnosis. The vibration signals extracted is usually contaminated with noise and may lead to wrong interpretation of results. The denoising of extracted vibration signals helps the fault diagnosis by giving meaningful results. Wavelet Transform (WT) increases signal to noise ratio (SNR), reduces root mean square error (RMSE) and is effective to denoise the gear vibration signals. The extracted signals have to be denoised by selecting a proper denoising scheme in order to prevent the loss of signal information along with noise. An approach has been made in this work to show the effectiveness of Principal Component Analysis (PCA) to denoise gear vibration signal. In this regard three selected wavelet based denoising schemes namely PCA, Empirical Mode Decomposition (EMD), Neighcoeff Coefficient (NC), has been compared with Adaptive Threshold (AT) an extensively used wavelet based denoising scheme for gear vibration signal. The vibration signals acquired from a customized gear test rig were denoised by above mentioned four denoising schemes. The fault identification capability as well as SNR, Kurtosis and RMSE for the four denoising schemes have been compared. Features extracted from the denoised signals have been used to train and test artificial neural network (ANN) models. The performances of the four denoising schemes have been evaluated based on the performance of the ANN models. The best denoising scheme has been identified, based on the classification accuracy results. PCA is effective in all the regards as a best denoising scheme.
Wang, Fen; Chen, Yuanlong; Liu, Meichun
2018-02-01
Stochastic memristor-based bidirectional associative memory (BAM) neural networks with time delays play an increasingly important role in the design and implementation of neural network systems. Under the framework of Filippov solutions, the issues of the pth moment exponential stability of stochastic memristor-based BAM neural networks are investigated. By using the stochastic stability theory, Itô's differential formula and Young inequality, the criteria are derived. Meanwhile, with Lyapunov approach and Cauchy-Schwarz inequality, we derive some sufficient conditions for the mean square exponential stability of the above systems. The obtained results improve and extend previous works on memristor-based or usual neural networks dynamical systems. Four numerical examples are provided to illustrate the effectiveness of the proposed results. Copyright © 2017 Elsevier Ltd. All rights reserved.
Li, Xiaofan; Fang, Jian-An; Li, Huiyuan
2017-09-01
This paper investigates master-slave exponential synchronization for a class of complex-valued memristor-based neural networks with time-varying delays via discontinuous impulsive control. Firstly, the master and slave complex-valued memristor-based neural networks with time-varying delays are translated to two real-valued memristor-based neural networks. Secondly, an impulsive control law is constructed and utilized to guarantee master-slave exponential synchronization of the neural networks. Thirdly, the master-slave synchronization problems are transformed into the stability problems of the master-slave error system. By employing linear matrix inequality (LMI) technique and constructing an appropriate Lyapunov-Krasovskii functional, some sufficient synchronization criteria are derived. Finally, a numerical simulation is provided to illustrate the effectiveness of the obtained theoretical results. Copyright © 2017 Elsevier Ltd. All rights reserved.
1993-07-01
simpler linearly separable majority function (Ahmad, Tesauro , 1988), the former has limited applicability to realistic problems and the latter has been...anwered. 6. References Ahmad, S., G. Tesauro , "Scaling and Generalization in Neural Networks: A Case Study", Proceedings of the 1988 Connectionist
Generalized in vitro-in vivo relationship (IVIVR model based on artificial neural networks
Directory of Open Access Journals (Sweden)
Mendyk A
2013-03-01
Full Text Available Aleksander Mendyk,1 Pawel Tuszynski,1 Sebastian Polak,2 Renata Jachowicz1 1Department of Pharmaceutical Technology and Biopharmaceutics, 2Department of Social Pharmacy, Faculty of Pharmacy, Jagiellonian University Medical College, Kraków, Poland Background: The aim of this study was to develop a generalized in vitro-in vivo relationship (IVIVR model based on in vitro dissolution profiles together with quantitative and qualitative composition of dosage formulations as covariates. Such a model would be of substantial aid in the early stages of development of a pharmaceutical formulation, when no in vivo results are yet available and it is impossible to create a classical in vitro-in vivo correlation (IVIVC/IVIVR. Methods: Chemoinformatics software was used to compute the molecular descriptors of drug substances (ie, active pharmaceutical ingredients and excipients. The data were collected from the literature. Artificial neural networks were used as the modeling tool. The training process was carried out using the 10-fold cross-validation technique. Results: The database contained 93 formulations with 307 inputs initially, and was later limited to 28 in a course of sensitivity analysis. The four best models were introduced into the artificial neural network ensemble. Complete in vivo profiles were predicted accurately for 37.6% of the formulations. Conclusion: It has been shown that artificial neural networks can be an effective predictive tool for constructing IVIVR in an integrated generalized model for various formulations. Because IVIVC/IVIVR is classically conducted for 2–4 formulations and with a single active pharmaceutical ingredient, the approach described here is unique in that it incorporates various active pharmaceutical ingredients and dosage forms into a single model. Thus, preliminary IVIVC/IVIVR can be available without in vivo data, which is impossible using current IVIVC/IVIVR procedures. Keywords: artificial neural networks
Directory of Open Access Journals (Sweden)
Jilin Zhang
2017-01-01
Full Text Available With the development of the mobile systems, we gain a lot of benefits and convenience by leveraging mobile devices; at the same time, the information gathered by smartphones, such as location and environment, is also valuable for business to provide more intelligent services for customers. More and more machine learning methods have been used in the field of mobile information systems to study user behavior and classify usage patterns, especially convolutional neural network. With the increasing of model training parameters and data scale, the traditional single machine training method cannot meet the requirements of time complexity in practical application scenarios. The current training framework often uses simple data parallel or model parallel method to speed up the training process, which is why heterogeneous computing resources have not been fully utilized. To solve these problems, our paper proposes a delay synchronization convolutional neural network parallel strategy, which leverages the heterogeneous system. The strategy is based on both synchronous parallel and asynchronous parallel approaches; the model training process can reduce the dependence on the heterogeneous architecture in the premise of ensuring the model convergence, so the convolution neural network framework is more adaptive to different heterogeneous system environments. The experimental results show that the proposed delay synchronization strategy can achieve at least three times the speedup compared to the traditional data parallelism.
Sun, Xun; Zhang, Weiguo; Yin, Wei; Li, Aijun
2006-11-01
As enlarging of the flight envelop, the aerodynamic derivative of the airplane varies enormous. The gain scheduling method is usually used to deal with it. But the workload is enormously and the stability is difficulty to be assured. To solve the above problem, a large envelope wavelet neural network gain scheduling flight control law design method based on genetic algorithm is presented in this paper. Wavelet has good time accuracy in high frequency-domain and the good frequency accuracy in low frequency-domain. Neural network has the self-learning character. In this method, wavelet function instead of Sigmoid function as the excitation function. So the two merits are merged and the high nonlinear function approximation capability could be achieved. In order to obtain higher accuracy and faster speed, genetic algorithm is used to optimize the parameters of the wavelet neural network. This method is used in design the large envelope gain scheduling flight control law. This simulation results show that good control capability could be achieved in large envelope and the system is still stable when modeling error is 20%. In the situation of 20% modeling error, the maximum overshoot is only 12m and it is 35% of the maximum overshoot using normal method.
Fault Diagnosis Method of Polymerization Kettle Equipment Based on Rough Sets and BP Neural Network
Directory of Open Access Journals (Sweden)
Shu-zhi Gao
2013-01-01
Full Text Available Polyvinyl chloride (PVC polymerizing production process is a typical complex controlled object, with complexity features, such as nonlinear, multivariable, strong coupling, and large time-delay. Aiming at the real-time fault diagnosis and optimized monitoring requirements of the large-scale key polymerization equipment of PVC production process, a real-time fault diagnosis strategy is proposed based on rough sets theory with the improved discernibility matrix and BP neural networks. The improved discernibility matrix is adopted to reduct the attributes of rough sets in order to decrease the input dimensionality of fault characteristics effectively. Levenberg-Marquardt BP neural network is trained to diagnose the polymerize faults according to the reducted decision table, which realizes the nonlinear mapping from fault symptom set to polymerize fault set. Simulation experiments are carried out combining with the industry history datum to show the effectiveness of the proposed rough set neural networks fault diagnosis method. The proposed strategy greatly increased the accuracy rate and efficiency of the polymerization fault diagnosis system.
Maizir, H.; Suryanita, R.
2018-01-01
A few decades, many methods have been developed to predict and evaluate the bearing capacity of driven piles. The problem of the predicting and assessing the bearing capacity of the pile is very complicated and not yet established, different soil testing and evaluation produce a widely different solution. However, the most important thing is to determine methods used to predict and evaluate the bearing capacity of the pile to the required degree of accuracy and consistency value. Accurate prediction and evaluation of axial bearing capacity depend on some variables, such as the type of soil, diameter, and length of pile, etc. The aims of the study of Artificial Neural Networks (ANNs) are utilized to obtain more accurate and consistent axial bearing capacity of a driven pile. ANNs can be described as mapping an input to the target output data. The method using the ANN model developed to predict and evaluate the axial bearing capacity of the pile based on the pile driving analyzer (PDA) test data for more than 200 selected data. The results of the predictions obtained by the ANN model and the PDA test were then compared. This research as the neural network models give a right prediction and evaluation of the axial bearing capacity of piles using neural networks.
Xia, Peng; Hu, Jie; Peng, Yinghong
2017-10-25
A novel model based on deep learning is proposed to estimate kinematic information for myoelectric control from multi-channel electromyogram (EMG) signals. The neural information of limb movement is embedded in EMG signals that are influenced by all kinds of factors. In order to overcome the negative effects of variability in signals, the proposed model employs the deep architecture combining convolutional neural networks (CNNs) and recurrent neural networks (RNNs). The EMG signals are transformed to time-frequency frames as the input to the model. The limb movement is estimated by the model that is trained with the gradient descent and backpropagation procedure. We tested the model for simultaneous and proportional estimation of limb movement in eight healthy subjects and compared it with support vector regression (SVR) and CNNs on the same data set. The experimental studies show that the proposed model has higher estimation accuracy and better robustness with respect to time. The combination of CNNs and RNNs can improve the model performance compared with using CNNs alone. The model of deep architecture is promising in EMG decoding and optimization of network structures can increase the accuracy and robustness. © 2017 International Center for Artificial Organs and Transplantation and Wiley Periodicals, Inc.
A clustering-based fuzzy wavelet neural network model for short-term load forecasting.
Kodogiannis, Vassilis S; Amina, Mahdi; Petrounias, Ilias
2013-10-01
Load forecasting is a critical element of power system operation, involving prediction of the future level of demand to serve as the basis for supply and demand planning. This paper presents the development of a novel clustering-based fuzzy wavelet neural network (CB-FWNN) model and validates its prediction on the short-term electric load forecasting of the Power System of the Greek Island of Crete. The proposed model is obtained from the traditional Takagi-Sugeno-Kang fuzzy system by replacing the THEN part of fuzzy rules with a "multiplication" wavelet neural network (MWNN). Multidimensional Gaussian type of activation functions have been used in the IF part of the fuzzyrules. A Fuzzy Subtractive Clustering scheme is employed as a pre-processing technique to find out the initial set and adequate number of clusters and ultimately the number of multiplication nodes in MWNN, while Gaussian Mixture Models with the Expectation Maximization algorithm are utilized for the definition of the multidimensional Gaussians. The results corresponding to the minimum and maximum power load indicate that the proposed load forecasting model provides significantly accurate forecasts, compared to conventional neural networks models.
Directory of Open Access Journals (Sweden)
Wodziński Marek
2017-06-01
Full Text Available This paper presents an alternative approach to the sequential data classification, based on traditional machine learning algorithms (neural networks, principal component analysis, multivariate Gaussian anomaly detector and finding the shortest path in a directed acyclic graph, using A* algorithm with a regression-based heuristic. Palm gestures were used as an example of the sequential data and a quadrocopter was the controlled object. The study includes creation of a conceptual model and practical construction of a system using the GPU to ensure the realtime operation. The results present the classification accuracy of chosen gestures and comparison of the computation time between the CPU- and GPU-based solutions.
Cao, Jianfang; Cui, Hongyan; Shi, Hao; Jiao, Lijuan
2016-01-01
A back-propagation (BP) neural network can solve complicated random nonlinear mapping problems; therefore, it can be applied to a wide range of problems. However, as the sample size increases, the time required to train BP neural networks becomes lengthy. Moreover, the classification accuracy decreases as well. To improve the classification accuracy and runtime efficiency of the BP neural network algorithm, we proposed a parallel design and realization method for a particle swarm optimization (PSO)-optimized BP neural network based on MapReduce on the Hadoop platform using both the PSO algorithm and a parallel design. The PSO algorithm was used to optimize the BP neural network's initial weights and thresholds and improve the accuracy of the classification algorithm. The MapReduce parallel programming model was utilized to achieve parallel processing of the BP algorithm, thereby solving the problems of hardware and communication overhead when the BP neural network addresses big data. Datasets on 5 different scales were constructed using the scene image library from the SUN Database. The classification accuracy of the parallel PSO-BP neural network algorithm is approximately 92%, and the system efficiency is approximately 0.85, which presents obvious advantages when processing big data. The algorithm proposed in this study demonstrated both higher classification accuracy and improved time efficiency, which represents a significant improvement obtained from applying parallel processing to an intelligent algorithm on big data.
Directory of Open Access Journals (Sweden)
Itziar Alonso-González
2018-03-01
Full Text Available Indoor localization estimation has become an attractive research topic due to growing interest in location-aware services. Many research works have proposed solving this problem by using wireless communication systems based on radiofrequency. Nevertheless, those approaches usually deliver an accuracy of up to two metres, since they are hindered by multipath propagation. On the other hand, in the last few years, the increasing use of light-emitting diodes in illumination systems has provided the emergence of Visible Light Communication technologies, in which data communication is performed by transmitting through the visible band of the electromagnetic spectrum. This brings a brand new approach to high accuracy indoor positioning because this kind of network is not affected by electromagnetic interferences and the received optical power is more stable than radio signals. Our research focus on to propose a fingerprinting indoor positioning estimation system based on neural networks to predict the device position in a 3D environment. Neural networks are an effective classification and predictive method. The localization system is built using a dataset of received signal strength coming from a grid of different points. From the these values, the position in Cartesian coordinates ( x , y , z is estimated. The use of three neural networks is proposed in this work, where each network is responsible for estimating the position by each axis. Experimental results indicate that the proposed system leads to substantial improvements to accuracy over the widely-used traditional fingerprinting methods, yielding an accuracy above 99% and an average error distance of 0.4 mm.
Chen, Min; Yin, Xuezhi
2011-07-01
This paper descries a new non-invasive method for diagnosis of breathing disorders based on adaptive-network-based fuzzy inference system (ANFIS). In this method, PetCO2, SpO2 and HR are chosen as inputs, and the breathing condition is selected as output ofANFIS. The inputs and output are then classified into fuzzy subsets by experts' knowledge. After, the fuzzy IF-THEN rules are built up according to the corresponding membership functions by set up of fuzzy subsets. The neural network was finally established and the membership functions and fuzzy rules were optimized by training. The results of experiment shows that ANFIS is more effective than BP Network regarding the diagnosis of breathing disorders.
A robust neural network-based approach for microseismic event detection
Akram, Jubran
2017-08-17
We present an artificial neural network based approach for robust event detection from low S/N waveforms. We use a feed-forward network with a single hidden layer that is tuned on a training dataset and later applied on the entire example dataset for event detection. The input features used include the average of absolute amplitudes, variance, energy-ratio and polarization rectilinearity. These features are calculated in a moving-window of same length for the entire waveform. The output is set as a user-specified relative probability curve, which provides a robust way of distinguishing between weak and strong events. An optimal network is selected by studying the weight-based saliency and effect of number of neurons on the predicted results. Using synthetic data examples, we demonstrate that this approach is effective in detecting weaker events and reduces the number of false positives.
Wan'e, Wu; Zuoming, Zhu
2012-01-01
A practical scheme for selecting characterization parameters of boron-based fuel-rich propellant formulation was put forward; a calculation model for primary combustion characteristics of boron-based fuel-rich propellant based on backpropagation neural network was established, validated, and then was used to predict primary combustion characteristics of boron-based fuel-rich propellant. The results show that the calculation error of burning rate is less than ± 7 . 3 %; in the formulation rang...
Multispectral embedding-based deep neural network for three-dimensional human pose recovery
Yu, Jialin; Sun, Jifeng
2018-01-01
Monocular image-based three-dimensional (3-D) human pose recovery aims to retrieve 3-D poses using the corresponding two-dimensional image features. Therefore, the pose recovery performance highly depends on the image representations. We propose a multispectral embedding-based deep neural network (MSEDNN) to automatically obtain the most discriminative features from multiple deep convolutional neural networks and then embed their penultimate fully connected layers into a low-dimensional manifold. This compact manifold can explore not only the optimum output from multiple deep networks but also the complementary properties of them. Furthermore, the distribution of each hierarchy discriminative manifold is sufficiently smooth so that the training process of our MSEDNN can be effectively implemented only using few labeled data. Our proposed network contains a body joint detector and a human pose regressor that are jointly trained. Extensive experiments conducted on four databases show that our proposed MSEDNN can achieve the best recovery performance compared with the state-of-the-art methods.
A Self-Organizing Incremental Neural Network based on local distribution learning.
Xing, Youlu; Shi, Xiaofeng; Shen, Furao; Zhou, Ke; Zhao, Jinxi
2016-12-01
In this paper, we propose an unsupervised incremental learning neural network based on local distribution learning, which is called Local Distribution Self-Organizing Incremental Neural Network (LD-SOINN). The LD-SOINN combines the advantages of incremental learning and matrix learning. It can automatically discover suitable nodes to fit the learning data in an incremental way without a priori knowledge such as the structure of the network. The nodes of the network store rich local information regarding the learning data. The adaptive vigilance parameter guarantees that LD-SOINN is able to add new nodes for new knowledge automatically and the number of nodes will not grow unlimitedly. While the learning process continues, nodes that are close to each other and have similar principal components are merged to obtain a concise local representation, which we call a relaxation data representation. A denoising process based on density is designed to reduce the influence of noise. Experiments show that the LD-SOINN performs well on both artificial and real-word data. Copyright © 2016 Elsevier Ltd. All rights reserved.
Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks
DEFF Research Database (Denmark)
Kirkegaard, Poul Henning; Rytter, A.
In this paper the possibility of using a Multilayer Perceptron (MLP) network trained with the Backpropagation Algorith as a non-destructive damage assessment technique to locate and quantify a damage in Civil Engineering structures is investigated. Since artificial neural networks are proving...... to be an effective tool for pattern recognition, the basic idea is to train a neural network with simulated values of modal parameters in order to recognize the behaviour of the damaged as well as the undamaged structure. Subjecting this trained neural network to measured modal parameters should imply information...
Adaptive optimization and control using neural networks
Energy Technology Data Exchange (ETDEWEB)
Mead, W.C.; Brown, S.K.; Jones, R.D.; Bowling, P.S.; Barnes, C.W.
1993-10-22
Recent work has demonstrated the ability of neural-network-based controllers to optimize and control machines with complex, non-linear, relatively unknown control spaces. We present a brief overview of neural networks via a taxonomy illustrating some capabilities of different kinds of neural networks. We present some successful control examples, particularly the optimization and control of a small-angle negative ion source.
Oil reservoir properties estimation using neural networks
Energy Technology Data Exchange (ETDEWEB)
Toomarian, N.B. [California Inst. of Tech., Pasadena, CA (United States); Barhen, J.; Glover, C.W. [Oak Ridge National Lab., TN (United States). Center for Engineering Systems Advanced Research; Aminzadeh, F. [UNOCAL Corp., Sugarland, TX (United States)
1997-02-01
This paper investigates the applicability as well as the accuracy of artificial neural networks for estimating specific parameters that describe reservoir properties based on seismic data. This approach relies on JPL`s adjoint operators general purpose neural network code to determine the best suited architecture. The authors believe that results presented in this work demonstrate that artificial neural networks produce surprisingly accurate estimates of the reservoir parameters.
A fast button surface defects detection method based on convolutional neural network
Liu, Lizhe; Cao, Danhua; Wu, Songlin; Wu, Yubin; Wei, Taoran
2018-01-01
Considering the complexity of the button surface texture and the variety of buttons and defects, we propose a fast visual method for button surface defect detection, based on convolutional neural network (CNN). CNN has the ability to extract the essential features by training, avoiding designing complex feature operators adapted to different kinds of buttons, textures and defects. Firstly, we obtain the normalized button region and then use HOG-SVM method to identify the front and back side of the button. Finally, a convolutional neural network is developed to recognize the defects. Aiming at detecting the subtle defects, we propose a network structure with multiple feature channels input. To deal with the defects of different scales, we take a strategy of multi-scale image block detection. The experimental results show that our method is valid for a variety of buttons and able to recognize all kinds of defects that have occurred, including dent, crack, stain, hole, wrong paint and uneven. The detection rate exceeds 96%, which is much better than traditional methods based on SVM and methods based on template match. Our method can reach the speed of 5 fps on DSP based smart camera with 600 MHz frequency.
Neural Network Based Modeling and Analysis of LP Control Surface Allocation
Langari, Reza; Krishnakumar, Kalmanje; Gundy-Burlet, Karen
2003-01-01
This paper presents an approach to interpretive modeling of LP based control allocation in intelligent flight control. The emphasis is placed on a nonlinear interpretation of the LP allocation process as a static map to support analytical study of the resulting closed loop system, albeit in approximate form. The approach makes use of a bi-layer neural network to capture the essential functioning of the LP allocation process. It is further shown via Lyapunov based analysis that under certain relatively mild conditions the resulting closed loop system is stable. Some preliminary conclusions from a study at Ames are stated and directions for further research are given at the conclusion of the paper.
International Nuclear Information System (INIS)
Chai, Soo H.; Lim, Joon S.
2016-01-01
This study presents a forecasting model of cyclical fluctuations of the economy based on the time delay coordinate embedding method. The model uses a neuro-fuzzy network called neural network with weighted fuzzy membership functions (NEWFM). The preprocessed time series of the leading composite index using the time delay coordinate embedding method are used as input data to the NEWFM to forecast the business cycle. A comparative study is conducted using other methods based on wavelet transform and Principal Component Analysis for the performance comparison. The forecasting results are tested using a linear regression analysis to compare the approximation of the input data against the target class, gross domestic product (GDP). The chaos based model captures nonlinear dynamics and interactions within the system, which other two models ignore. The test results demonstrated that chaos based method significantly improved the prediction capability, thereby demonstrating superior performance to the other methods.
Energy Technology Data Exchange (ETDEWEB)
Pereira, Claudio M.N.A. [Instituto de Engenharia Nuclear (IEN), Rio de Janeiro, RJ (Brazil); Schirru, Roberto; Martinez, Aquilino S. [Universidade Federal, Rio de Janeiro, RJ (Brazil). Coordenacao dos Programas de Pos-graduacao de Engenharia
1997-12-01
This work presents a prototype of a system for nuclear reactor core design optimization based on genetic algorithms and artificial neural networks. A neural network is modeled and trained in order to predict the flux and the neutron multiplication factor values based in the enrichment, network pitch and cladding thickness, with average error less than 2%. The values predicted by the neural network are used by a genetic algorithm in this heuristic search, guided by an objective function that rewards the high flux values and penalizes multiplication factors far from the required value. Associating the quick prediction - that may substitute the reactor physics calculation code - with the global optimization capacity of the genetic algorithm, it was obtained a quick and effective system for nuclear reactor core design optimization. (author). 11 refs., 8 figs., 3 tabs.
Parametric motion control of robotic arms: A biologically based approach using neural networks
Bock, O.; D'Eleuterio, G. M. T.; Lipitkas, J.; Grodski, J. J.
1993-01-01
A neural network based system is presented which is able to generate point-to-point movements of robotic manipulators. The foundation of this approach is the use of prototypical control torque signals which are defined by a set of parameters. The parameter set is used for scaling and shaping of these prototypical torque signals to effect a desired outcome of the system. This approach is based on neurophysiological findings that the central nervous system stores generalized cognitive representations of movements called synergies, schemas, or motor programs. It has been proposed that these motor programs may be stored as torque-time functions in central pattern generators which can be scaled with appropriate time and magnitude parameters. The central pattern generators use these parameters to generate stereotypical torque-time profiles, which are then sent to the joint actuators. Hence, only a small number of parameters need to be determined for each point-to-point movement instead of the entire torque-time trajectory. This same principle is implemented for controlling the joint torques of robotic manipulators where a neural network is used to identify the relationship between the task requirements and the torque parameters. Movements are specified by the initial robot position in joint coordinates and the desired final end-effector position in Cartesian coordinates. This information is provided to the neural network which calculates six torque parameters for a two-link system. The prototypical torque profiles (one per joint) are then scaled by those parameters. After appropriate training of the network, our parametric control design allowed the reproduction of a trained set of movements with relatively high accuracy, and the production of previously untrained movements with comparable accuracy. We conclude that our approach was successful in discriminating between trained movements and in generalizing to untrained movements.
R-POPTVR: a novel reinforcement-based POPTVR fuzzy neural network for pattern classification.
Wong, Wing-Cheong; Cho, Siu-Yeung; Quek, Chai
2009-11-01
In general, a fuzzy neural network (FNN) is characterized by its learning algorithm and its linguistic knowledge representation. However, it does not necessarily interact with its environment when the training data is assumed to be an accurate description of the environment under consideration. In interactive problems, it would be more appropriate for an agent to learn from its own experience through interactions with the environment, i.e., reinforcement learning. In this paper, three clustering algorithms are developed based on the reinforcement learning paradigm. This allows a more accurate description of the clusters as the clustering process is influenced by the reinforcement signal. They are the REINFORCE clustering technique I (RCT-I), the REINFORCE clustering technique II (RCT-II), and the episodic REINFORCE clustering technique (ERCT). The integrations of the RCT-I, the RCT-II, and the ERCT within the pseudo-outer product truth value restriction (POPTVR), which is a fuzzy neural network integrated with the truth restriction value (TVR) inference scheme in its five layered feedforward neural network, form the RPOPTVR-I, the RPOPTVR-II, and the ERPOPTVR, respectively. The Iris, Phoneme, and Spiral data sets are used for benchmarking. For both Iris and Phoneme data, the RPOPTVR is able to yield better classification results which are higher than the original POPTVR and the modified POPTVR over the three test trials. For the Spiral data set, the RPOPTVR-II is able to outperform the others by at least a margin of 5.8% over multiple test trials. The three reinforcement-based clustering techniques applied to the POPTVR network are able to exhibit the trial-and-error search characteristic that yields higher qualitative performance.
Wireless Indoor Location Estimation Based on Neural Network RSS Signature Recognition (LENSR)
Energy Technology Data Exchange (ETDEWEB)
Kurt Derr; Milos Manic
2008-06-01
Location Based Services (LBS), context aware applications, and people and object tracking depend on the ability to locate mobile devices, also known as localization, in the wireless landscape. Localization enables a diverse set of applications that include, but are not limited to, vehicle guidance in an industrial environment, security monitoring, self-guided tours, personalized communications services, resource tracking, mobile commerce services, guiding emergency workers during fire emergencies, habitat monitoring, environmental surveillance, and receiving alerts. This paper presents a new neural network approach (LENSR) based on a competitive topological Counter Propagation Network (CPN) with k-nearest neighborhood vector mapping, for indoor location estimation based on received signal strength. The advantage of this approach is both speed and accuracy. The tested accuracy of the algorithm was 90.6% within 1 meter and 96.4% within 1.5 meters. Several approaches for location estimation using WLAN technology were reviewed for comparison of results.
Yan, Liang; Zhang, Lu; Zhu, Bo; Zhang, Jingying; Jiao, Zongxia
2017-10-01
Permanent magnet spherical actuator (PMSA) is a multi-variable featured and inter-axis coupled nonlinear system, which unavoidably compromises its motion control implementation. Uncertainties such as external load and friction torque of ball bearing and manufacturing errors also influence motion performance significantly. Therefore, the objective of this paper is to propose a controller based on a single neural adaptive (SNA) algorithm and a neural network (NN) identifier optimized with a particle swarm optimization (PSO) algorithm to improve the motion stability of PMSA with three-dimensional magnet arrays. The dynamic model and computed torque model are formulated for the spherical actuator, and a dynamic decoupling control algorithm is developed. By utilizing the global-optimization property of the PSO algorithm, the NN identifier is trained to avoid locally optimal solution and achieve high-precision compensations to uncertainties. The employment of the SNA controller helps to reduce the effect of compensation errors and convert the system to a stable one, even if there is difference between the compensations and uncertainties due to external disturbances. A simulation model is established, and experiments are conducted on the research prototype to validate the proposed control algorithm. The amplitude of the parameter perturbation is set to 5%, 10%, and 15%, respectively. The strong robustness of the proposed hybrid algorithm is validated by the abundant simulation data. It shows that the proposed algorithm can effectively compensate the influence of uncertainties and eliminate the effect of inter-axis couplings of the spherical actuator.
Bomben, Craig R.; Smolka, James W.; Bosworth, John T.; Silliams-Hayes, Peggy S.; Burken, John J.; Larson, Richard R.; Buschbacher, Mark J.; Maliska, Heather A.
2006-01-01
The Intelligent Flight Control System (IFCS) project at the NASA Dryden Flight Research Center, Edwards AFB, CA, has been investigating the use of neural network based adaptive control on a unique NF-15B test aircraft. The IFCS neural network is a software processor that stores measured aircraft response information to dynamically alter flight control gains. In 2006, the neural network was engaged and allowed to learn in real time to dynamically alter the aircraft handling qualities characteristics in the presence of actual aerodynamic failure conditions injected into the aircraft through the flight control system. The use of neural network and similar adaptive technologies in the design of highly fault and damage tolerant flight control systems shows promise in making future aircraft far more survivable than current technology allows. This paper will present the results of the IFCS flight test program conducted at the NASA Dryden Flight Research Center in 2006, with emphasis on challenges encountered and lessons learned.
Veronezi, Carlos Cassiano Denipotti; de Azevedo Simões, Priscyla Waleska Targino; dos Santos, Robson Luiz; da Rocha, Edroaldo Lummertz; Meláo, Suelen; de Mattos, Merisandra Côrtes; Cechinel, Cristian
2015-01-01
Objective: To ascertain the advantages of applying artificial neural networks to recognize patterns on lumbar spine radiographies in order to aid in the process of diagnosing primary osteoarthritis. Methods: This was a cross-sectional descriptive analytical study with a quantitative approach and an emphasis on diagnosis. The training set was composed of images collected between January and July 2009 from patients who had undergone lateral-view digital radiographies of the lumbar spine, which were provided by a radiology clinic located in the municipality of Criciúma (SC). Out of the total of 260 images gathered, those with distortions, those presenting pathological conditions that altered the architecture of the lumbar spine and those with patterns that were difficult to characterize were discarded, resulting in 206 images. The image data base (n = 206) was then subdivided, resulting in 68 radiographies for the training stage, 68 images for tests and 70 for validation. A hybrid neural network based on Kohonen self-organizing maps and on Multilayer Perceptron networks was used. Results: After 90 cycles, the validation was carried out on the best results, achieving accuracy of 62.85%, sensitivity of 65.71% and specificity of 60%. Conclusions: Even though the effectiveness shown was moderate, this study is still innovative. The values show that the technique used has a promising future, pointing towards further studies on image and cycle processing methodology with a larger quantity of radiographies. PMID:27027010
Veronezi, Carlos Cassiano Denipotti; de Azevedo Simões, Priscyla Waleska Targino; Dos Santos, Robson Luiz; da Rocha, Edroaldo Lummertz; Meláo, Suelen; de Mattos, Merisandra Côrtes; Cechinel, Cristian
2011-01-01
To ascertain the advantages of applying artificial neural networks to recognize patterns on lumbar spine radiographies in order to aid in the process of diagnosing primary osteoarthritis. This was a cross-sectional descriptive analytical study with a quantitative approach and an emphasis on diagnosis. The training set was composed of images collected between January and July 2009 from patients who had undergone lateral-view digital radiographies of the lumbar spine, which were provided by a radiology clinic located in the municipality of Criciúma (SC). Out of the total of 260 images gathered, those with distortions, those presenting pathological conditions that altered the architecture of the lumbar spine and those with patterns that were difficult to characterize were discarded, resulting in 206 images. The image data base (n = 206) was then subdivided, resulting in 68 radiographies for the training stage, 68 images for tests and 70 for validation. A hybrid neural network based on Kohonen self-organizing maps and on Multilayer Perceptron networks was used. After 90 cycles, the validation was carried out on the best results, achieving accuracy of 62.85%, sensitivity of 65.71% and specificity of 60%. Even though the effectiveness shown was moderate, this study is still innovative. The values show that the technique used has a promising future, pointing towards further studies on image and cycle processing methodology with a larger quantity of radiographies.
[Segmentation of whole body bone SPECT image based on BP neural network].
Zhu, Chunmei; Tian, Lianfang; Chen, Ping; He, Yuanlie; Wang, Lifei; Ye, Guangchun; Mao, Zongyuan
2007-10-01
In this paper, BP neural network is used to segment whole body bone SPECT image so that the lesion area can be recognized automatically. For the uncertain characteristics of SPECT images, it is hard to achieve good segmentation result if only the BP neural network is employed. Therefore, the segmentation process is divided into three steps: first, the optimal gray threshold segmentation method is employed for preprocessing, then BP neural network is used to roughly identify the lesions, and finally template match method and symmetry-removing program are adopted to delete the wrongly recognized areas.
Directory of Open Access Journals (Sweden)
Shawq Malik Mehibs
2017-12-01
Full Text Available Cloud computing is distributed architecture, providing computing facilities and storage resource as a service over the internet. This low-cost service fulfills the basic requirements of users. Because of the open nature and services introduced by cloud computing intruders impersonate legitimate users and misuse cloud resource and services. To detect intruders and suspicious activities in and around the cloud computing environment, intrusion detection system used to discover the illegitimate users and suspicious action by monitors different user activities on the network .this work proposed based back propagation artificial neural network to construct t network intrusion detection in the cloud environment. The proposed module evaluated with kdd99 dataset the experimental results shows promising approach to detect attack with high detection rate and low false alarm rate
Ansari, Nirwan; Liu, Dequan
1991-01-01
A neural-network-based traffic management scheme for a satellite communication network is described. The scheme consists of two levels of management. The front end of the scheme is a derivation of Kohonen's self-organization model to configure maps for the satellite communication network dynamically. The model consists of three stages. The first stage is the pattern recognition task, in which an exemplar map that best meets the current network requirements is selected. The second stage is the analysis of the discrepancy between the chosen exemplar map and the state of the network, and the adaptive modification of the chosen exemplar map to conform closely to the network requirement (input data pattern) by means of Kohonen's self-organization. On the basis of certain performance criteria, whether a new map is generated to replace the original chosen map is decided in the third stage. A state-dependent routing algorithm, which arranges the incoming call to some proper path, is used to make the network more efficient and to lower the call block rate. Simulation results demonstrate that the scheme, which combines self-organization and the state-dependent routing mechanism, provides better performance in terms of call block rate than schemes that only have either the self-organization mechanism or the routing mechanism.
Automatic construction of a recurrent neural network based classifier for vehicle passage detection
Burnaev, Evgeny; Koptelov, Ivan; Novikov, German; Khanipov, Timur
2017-03-01
Recurrent Neural Networks (RNNs) are extensively used for time-series modeling and prediction. We propose an approach for automatic construction of a binary classifier based on Long Short-Term Memory RNNs (LSTM-RNNs) for detection of a vehicle passage through a checkpoint. As an input to the classifier we use multidimensional signals of various sensors that are installed on the checkpoint. Obtained results demonstrate that the previous approach to handcrafting a classifier, consisting of a set of deterministic rules, can be successfully replaced by an automatic RNN training on an appropriately labelled data.
A Pressure Control Method for Emulsion Pump Station Based on Elman Neural Network
Directory of Open Access Journals (Sweden)
Chao Tan
2015-01-01
Full Text Available In order to realize pressure control of emulsion pump station which is key equipment of coal mine in the safety production, the control requirements were analyzed and a pressure control method based on Elman neural network was proposed. The key techniques such as system framework, pressure prediction model, pressure control model, and the flowchart of proposed approach were presented. Finally, a simulation example was carried out and comparison results indicated that the proposed approach was feasible and efficient and outperformed others.
A research on scenic information prediction method based on RBF neural network
Li, Jingwen; Yin, Shouqiang; Wang, Ke
2015-12-01
Based on the rapid development of the wisdom tourism, it is conform to the trend of the development of the wisdom tourism through the scientific method to realize the prediction of the scenic information. The article,using the super nonlinear fitting ability of RBF neural network[1-2],builds a prediction and inference method of comprehensive information for the complex geographic time, space and attribute of scenic through the hyper-surface data organization of the scenic geographic entity information[3]. And it uses Guilin scenic area as an example to deduce the process of the forecasting of the whole information.
Kiran, A Uma Maheshwar; Jana, Asim Kumar
2009-10-01
Cell growth and metabolite production greatly depend on the feeding of the nutrients in fed-batch fermentations. A strategy for controlling the glucose feed rate in fed-batch baker's yeast fermentation and a novel controller was studied. The difference between the specific carbon dioxide evolution rate and oxygen uptake rate (Qc - Qo) was used as controller variable. The controller evaluated was neural network based model predictive controller and optimizer. The performance of the controller was evaluated by the set point tracking. Results showed good performance of the controller.
Zhang, Xian-Ming; Lin, Wen-Juan; Han, Qing-Long; He, Yong; Wu, Min
2017-10-03
This brief is concerned with global asymptotic stability of a neural network with a time-varying delay. First, by introducing an auxiliary vector with some nonorthogonal polynomials, a slack-matrix-based integral inequality is established, which includes some existing one as its special case. Second, a novel Lyapunov-Krasovskii functional is constructed to suit for the use of the obtained integral inequality. As a result, a less conservative stability criterion is derived, whose effectiveness is finally demonstrated through two well-used numerical examples.
The 3-D image recognition based on fuzzy neural network technology
Hirota, Kaoru; Yamauchi, Kenichi; Murakami, Jun; Tanaka, Kei
1993-01-01
Three dimensional stereoscopic image recognition system based on fuzzy-neural network technology was developed. The system consists of three parts; preprocessing part, feature extraction part, and matching part. Two CCD color camera image are fed to the preprocessing part, where several operations including RGB-HSV transformation are done. A multi-layer perception is used for the line detection in the feature extraction part. Then fuzzy matching technique is introduced in the matching part. The system is realized on SUN spark station and special image input hardware system. An experimental result on bottle images is also presented.
A method to estimate emission rates from industrial stacks based on neural networks.
Olcese, Luis E; Toselli, Beatriz M
2004-11-01
This paper presents a technique based on artificial neural networks (ANN) to estimate pollutant rates of emission from industrial stacks, on the basis of pollutant concentrations measured on the ground. The ANN is trained on data generated by the ISCST3 model, widely accepted for evaluation of dispersion of primary pollutants as a part of an environmental impact study. Simulations using theoretical values and comparison with field data are done, obtaining good results in both cases at predicting emission rates. The application of this technique would allow the local environment authority to control emissions from industrial plants without need of performing direct measurements inside the plant. copyright 2004 Elsevier Ltd.
Gómez-Adorno, Helena; Markov, Ilia; Sidorov, Grigori; Posadas-Durán, Juan-Pablo; Sanchez-Perez, Miguel A; Chanona-Hernandez, Liliana
2016-01-01
We introduce a lexical resource for preprocessing social media data. We show that a neural network-based feature representation is enhanced by using this resource. We conducted experiments on the PAN 2015 and PAN 2016 author profiling corpora and obtained better results when performing the data preprocessing using the developed lexical resource. The resource includes dictionaries of slang words, contractions, abbreviations, and emoticons commonly used in social media. Each of the dictionaries was built for the English, Spanish, Dutch, and Italian languages. The resource is freely available.
BrainCrafter: An investigation into human-based neural network engineering
DEFF Research Database (Denmark)
Piskur, J.; Greve, P.; Togelius, J.
2015-01-01
This paper presents the online application Brain-Crafter, in which users can manually build artificial neural networks (ANNs) to control a robot in a maze environment. Users can either start to construct networks from scratch or elaborate on networks created by other users. In particular, Brain...
International Nuclear Information System (INIS)
Yang Xinglin; Wang Huacen; Chen Nan; Dai Wenhua; Li Jin
2006-01-01
High current linear induction accelerator (LIA) is a complicated experimental physics device. It is difficult to evaluate and predict its performance. this paper presents a method which combines wavelet packet transform and radial basis function (RBF) neural network to build fault diagnosis and performance evaluation in order to improve reliability of high current LIA. The signal characteristics vectors which are extracted based on energy parameters of wavelet packet transform can well present the temporal and steady features of pulsed power signal, and reduce data dimensions effectively. The fault diagnosis system for accelerating cell and the trend classification system for the beam current based on RBF networks can perform fault diagnosis and evaluation, and provide predictive information for precise maintenance of high current LIA. (authors)
Neural Network-Based Receiver in Band-Limited Communication System with MPPSK Modulation
Directory of Open Access Journals (Sweden)
Wang Zixin
2018-01-01
Full Text Available As a type of the spectrally efficient modulation, the m-ary phase position shift keying (MPPSK has been considered to meet the increasing spectrum requirement in the future wireless system. To limit the signal bandwidth and cancel the out-band interference the band-pass filters are used, which introduce the waveform distortion and inter-symbol interference (ISI. Therefore, a single hidden-layer neural network (NN-based receiver is proposed to jointly equalize and demodulate the received signal. The impulse response of the system is static and the network parameters can be obtained after off-line training. The number of the hidden nodes is also determined through simulations. Simulation results show that the NN-based receiver works well in the communication system with different allocated bandwidths. By observing the modified confusion matrix, the false symbol decision is relevant to modulation index, waveform distortions and the ISI.
Intelligent control a hybrid approach based on fuzzy logic, neural networks and genetic algorithms
Siddique, Nazmul
2014-01-01
Intelligent Control considers non-traditional modelling and control approaches to nonlinear systems. Fuzzy logic, neural networks and evolutionary computing techniques are the main tools used. The book presents a modular switching fuzzy logic controller where a PD-type fuzzy controller is executed first followed by a PI-type fuzzy controller thus improving the performance of the controller compared with a PID-type fuzzy controller. The advantage of the switching-type fuzzy controller is that it uses one rule-base thus minimises the rule-base during execution. A single rule-base is developed by merging the membership functions for change of error of the PD-type controller and sum of error of the PI-type controller. Membership functions are then optimized using evolutionary algorithms. Since the two fuzzy controllers were executed in series, necessary further tuning of the differential and integral scaling factors of the controller is then performed. Neural-network-based tuning for the scaling parameters of t...
Directory of Open Access Journals (Sweden)
Saleh Mohammed Al-Alawi
2002-06-01
Full Text Available Artificial Neural Networks (ANNs are computer software programs that mimic the human brain's ability to classify patterns or to make forecasts or decisions based on past experience. The development of this research area can be attributed to two factors, sufficient computer power to begin practical ANN-based research in the late 1970s and the development of back-propagation in 1986 that enabled ANN models to solve everyday business, scientific, and industrial problems. Since then, significant applications have been implemented in several fields of study, and many useful intelligent applications and systems have been developed. The objective of this paper is to generate awareness and to encourage applications development using artificial intelligence-based systems. Therefore, this paper provides basic ANN concepts, outlines steps used for ANN model development, and lists examples of engineering applications based on the use of the back-propagation paradigm conducted in Oman. The paper is intended to provide guidelines and necessary references and resources for novice individuals interested in conducting research in engineering or other fields of study using back-propagation artificial neural networks.
Kesharaju, Manasa; Nagarajah, Romesh
2015-09-01
The motivation for this research stems from a need for providing a non-destructive testing method capable of detecting and locating any defects and microstructural variations within armour ceramic components before issuing them to the soldiers who rely on them for their survival. The development of an automated ultrasonic inspection based classification system would make possible the checking of each ceramic component and immediately alert the operator about the presence of defects. Generally, in many classification problems a choice of features or dimensionality reduction is significant and simultaneously very difficult, as a substantial computational effort is required to evaluate possible feature subsets. In this research, a combination of artificial neural networks and genetic algorithms are used to optimize the feature subset used in classification of various defects in reaction-sintered silicon carbide ceramic components. Initially wavelet based feature extraction is implemented from the region of interest. An Artificial Neural Network classifier is employed to evaluate the performance of these features. Genetic Algorithm based feature selection is performed. Principal Component Analysis is a popular technique used for feature selection and is compared with the genetic algorithm based technique in terms of classification accuracy and selection of optimal number of features. The experimental results confirm that features identified by Principal Component Analysis lead to improved performance in terms of classification percentage with 96% than Genetic algorithm with 94%. Copyright © 2015 Elsevier B.V. All rights reserved.
Scene Text Detection and Segmentation based on Cascaded Convolution Neural Networks.
Tang, Youbao; Wu, Xiangqian
2017-01-20
Scene text detection and segmentation are two important and challenging research problems in the field of computer vision. This paper proposes a novel method for scene text detection and segmentation based on cascaded convolution neural networks (CNNs). In this method, a CNN based text-aware candidate text region (CTR) extraction model (named detection network, DNet) is designed and trained using both the edges and the whole regions of text, with which coarse CTRs are detected. A CNN based CTR refinement model (named segmentation network, SNet) is then constructed to precisely segment the coarse CTRs into text to get the refined CTRs. With DNet and SNet, much fewer CTRs are extracted than with traditional approaches while more true text regions are kept. The refined CTRs are finally classified using a CNN based CTR classification model (named classification network, CNet) to get the final text regions. All of these CNN based models are modified from VGGNet-16. Extensive experiments on three benchmark datasets demonstrate that the proposed method achieves state-of-the-art performance and greatly outperforms other scene text detection and segmentation approaches.
Artificial neural/chemical networks
Caulfield, H. John
2001-11-01
What strikes the attention of a neural network designer is that the chemicals seem to work not so much on individual neural circuits as on neural cell assemblies. These are large blocks of neural networks that carry out high level tasks using their constituent networks as needed. It follows to us that we might seek ways of achieving that same sort of behavior in an artificial neural network. In what follows, we provide two examples of how that might be done in an artificial system.
Zhang, Gaowei; Xu, Lingyu; Wang, Lei
2018-04-01
The purpose of this chapter is to analyze the investor's psychological characteristics and investment decision-making behavior characteristics, to study the investor sentiment under the network public opinion, and then analyze from three aspects: First, investor sentiment analysis and how to spread in the online media; The influence mechanism of investor's emotion on the stock market and its effect; the third one is to measure the investor's emotion based on the degree of attention, trying hard to sort out the internal relations between the investor's sentiment and the network public opinion and the stock market, in order to lay the theoretical foundation of this article.
Directory of Open Access Journals (Sweden)
Erna Rusliana Muhamad Saleh
2014-02-01
Full Text Available Wafer is type of biscuit frequently found on expired condition in market, therefore prediction method should be implemented to avoid this condition. apart from the prediction of shelf-life of wafer done by laboratory test, which were time-consuming, expensive, required trained panelists, complex equipment and suitable ambience, artificial neural network (ANN based dielectric parameters was proposed in nthis study. The aim of study was to develop model to predict shelf-life employing aNN based capacitance parameter. Back propagation algorithm with trial and error was applied in variations of nodes per hidden layer, number of hidden layers, activation functions, the function of learnings and epochs. The result of study was the model was able to predict wafer shelf-life. The accuracy level was shown by low MSE value (0.01 and high coefficient correlation value (89.25%. Keywords: artificial Neural Network, shelf-life, waffer, dielectric, capacitance ABSTRAK Wafer adalah jenis makanan kering yang sering ditemukan kedaluwarsa. Penentuan masa kedaluwarsa dengan observasi laboratorium memiliki beberapa kelemahan, diantaranya memakan waktu, panelis terlatih, suasana yang tepat, biaya dan alat uji yang kompleks. alternatif solusinya adalah penggunaan artificial Neural Network (ANN berbasiskan parameter kapasitansi. Tujuan kerja ilmiah ini adalah untuk memprediksi masa kedaluwarsa wafer menggunakan aNN berbasiskan parameter kapasitansi. algoritma pembelajaran yang digunakan adalah Backpropagation dengan trial and error variasi jumlah node per hidden layer, jumlah hidden layer, fungsi aktivasi, fungsi pembelajaran dan epoch. Hasil prediksi menunjukkan bahwa aNN hasil pelatihan yang dikombinasikan dengan parameter kapasitansi mampu memprediksi masa kedaluwarsa wafer dengan MSE terendah 0,01 dan R tertinggi 89,25%. Kata kunci: Jaringan Syaraf Tiruan, masa kedaluwarsa, wafer, dielektrik, kapasitansi
Li, Yongcheng; Sun, Rong; Wang, Yuechao; Li, Hongyi; Zheng, Xiongfei
2016-01-01
We propose the architecture of a novel robot system merging biological and artificial intelligence based on a neural controller connected to an external agent. We initially built a framework that connected the dissociated neural network to a mobile robot system to implement a realistic vehicle. The mobile robot system characterized by a camera and two-wheeled robot was designed to execute the target-searching task. We modified a software architecture and developed a home-made stimulation generator to build a bi-directional connection between the biological and the artificial components via simple binomial coding/decoding schemes. In this paper, we utilized a specific hierarchical dissociated neural network for the first time as the neural controller. Based on our work, neural cultures were successfully employed to control an artificial agent resulting in high performance. Surprisingly, under the tetanus stimulus training, the robot performed better and better with the increasement of training cycle because of the short-term plasticity of neural network (a kind of reinforced learning). Comparing to the work previously reported, we adopted an effective experimental proposal (i.e. increasing the training cycle) to make sure of the occurrence of the short-term plasticity, and preliminarily demonstrated that the improvement of the robot's performance could be caused independently by the plasticity development of dissociated neural network. This new framework may provide some possible solutions for the learning abilities of intelligent robots by the engineering application of the plasticity processing of neural networks, also for the development of theoretical inspiration for the next generation neuro-prostheses on the basis of the bi-directional exchange of information within the hierarchical neural networks.
Directory of Open Access Journals (Sweden)
Yongcheng Li
Full Text Available We propose the architecture of a novel robot system merging biological and artificial intelligence based on a neural controller connected to an external agent. We initially built a framework that connected the dissociated neural network to a mobile robot system to implement a realistic vehicle. The mobile robot system characterized by a camera and two-wheeled robot was designed to execute the target-searching task. We modified a software architecture and developed a home-made stimulation generator to build a bi-directional connection between the biological and the artificial components via simple binomial coding/decoding schemes. In this paper, we utilized a specific hierarchical dissociated neural network for the first time as the neural controller. Based on our work, neural cultures were successfully employed to control an artificial agent resulting in high performance. Surprisingly, under the tetanus stimulus training, the robot performed better and better with the increasement of training cycle because of the short-term plasticity of neural network (a kind of reinforced learning. Comparing to the work previously reported, we adopted an effective experimental proposal (i.e. increasing the training cycle to make sure of the occurrence of the short-term plasticity, and preliminarily demonstrated that the improvement of the robot's performance could be caused independently by the plasticity development of dissociated neural network. This new framework may provide some possible solutions for the learning abilities of intelligent robots by the engineering application of the plasticity processing of neural networks, also for the development of theoretical inspiration for the next generation neuro-prostheses on the basis of the bi-directional exchange of information within the hierarchical neural networks.
DEFF Research Database (Denmark)
Kolbæk, Morten; Tan, Zheng-Hua; Jensen, Jesper
2017-01-01
In this paper, we study aspects of single microphone speech enhancement (SE) based on deep neural networks (DNNs). Specifically, we explore the generalizability capabilities of state-of-the-art DNN-based SE systems with respect to the background noise type, the gender of the target speaker...... general. Finally, we compare how a DNN-based SE system trained to be noise type general, speaker general, and SNR general performs relative to a state-of-the-art short-time spectral amplitude minimum mean square error (STSA-MMSE) based SE algorithm. We show that DNN-based SE systems, when trained...... specifically to handle certain speakers, noise types and SNRs, are capable of achieving large improvements in estimated speech quality (SQ) and speech intelligibility (SI), when tested in matched conditions. Furthermore, we show that improvements in estimated SQ and SI can be achieved by a DNN-based SE system...
Neural Network Based Model of an Industrial Oil-Fired Boiler System ...
African Journals Online (AJOL)
The neural network model when subjected to test, using the validation input data; shows that the simulated model outputs for both temperature and pressure agree closely with the actual plant outputs, with regression value of 0.97. Furthermore, Proportional Integral Derivative (PID) Controller is used to control the neural ...
Fine-grained vehicle type recognition based on deep convolution neural networks
Directory of Open Access Journals (Sweden)
Hongcai CHEN
2017-12-01
Full Text Available Public security and traffic department put forward higher requirements for real-time performance and accuracy of vehicle type recognition in complex traffic scenes. Aiming at the problems of great plice forces occupation, low retrieval efficiency, and lacking of intelligence for dealing with false license, fake plate vehicles and vehicles without plates, this paper proposes a vehicle type fine-grained recognition method based GoogleNet deep convolution neural networks. The filter size and numbers of convolution neural network are designed, the activation function and vehicle type classifier are optimally selected, and a new network framework is constructed for vehicle type fine-grained recognition. The experimental results show that the proposed method has 97% accuracy for vehicle type fine-grained recognition and has greater improvement than the original GoogleNet model. Moreover, the new model effectively reduces the number of training parameters, and saves computer memory. Fine-grained vehicle type recognition can be used in intelligent traffic management area, and has important theoretical research value and practical significance.
Stable neural-network-based adaptive control for sampled-data nonlinear systems.
Sun, F; Sun, Z; Woo, P Y
1998-01-01
For a class of multiinput-multioutput (MIMO) sampled-data nonlinear systems with unknown dynamic nonlinearities, a stable neural-network (NN)-based adaptive control approach which is an integration of an NN approach and the adaptive implementation of the variable structure control with a sector, is developed. The sampled-data nonlinear system is assumed to be controllable and its state vector is available for measurement. The variable structure control with a sector serves two purposes. One is to force the system state to be within the state region in which the NN's are used when the system goes out of neural control; and the other is to provide an additional control until the system tracking error metric is controlled inside the sector within the network approximation region. The proof of a complete stability and a tracking error convergence is given and the setting of the sector and the NN parameters is discussed. It is demonstrated that the asymptotic error of the system can be made dependent only on inherent network approximation errors and the frequency range of unmodeled dynamics. Simulation studies of a two-link manipulator show the effectiveness of the proposed control approach.
Neural electrical activity and neural network growth.
Gafarov, F M
2018-02-09
The development of central and peripheral neural system depends in part on the emergence of the correct functional connectivity in its input and output pathways. Now it is generally accepted that molecular factors guide neurons to establish a primary scaffold that undergoes activity-dependent refinement for building a fully functional circuit. However, a number of experimental results obtained recently shows that the neuronal electrical activity plays an important role in the establishing of initial interneuronal connections. Nevertheless, these processes are rather difficult to study experimentally, due to the absence of theoretical description and quantitative parameters for estimation of the neuronal activity influence on growth in neural networks. In this work we propose a general framework for a theoretical description of the activity-dependent neural network growth. The theoretical description incorporates a closed-loop growth model in which the neural activity can affect neurite outgrowth, which in turn can affect neural activity. We carried out the detailed quantitative analysis of spatiotemporal activity patterns and studied the relationship between individual cells and the network as a whole to explore the relationship between developing connectivity and activity patterns. The model, developed in this work will allow us to develop new experimental techniques for studying and quantifying the influence of the neuronal activity on growth processes in neural networks and may lead to a novel techniques for constructing large-scale neural networks by self-organization. Copyright © 2018 Elsevier Ltd. All rights reserved.
DEFF Research Database (Denmark)
Di Canio, Giuliano; Larsen, Jørgen Christian; Wörgötter, Florentin
2016-01-01
Robotic systems inspired from humans have always been lightening up the curiosity of engineers and scientists. Of many challenges, human locomotion is a very difficult one where a number of different systems needs to interact in order to generate a correct and balanced pattern. To simulate...... the interaction of these systems, implementations with reflexbased or central pattern generator (CPG)-based controllers have been tested on bipedal robot systems. In this paper we will combine the two controller types, into a controller that works with both reflex and CPG signals. We use a reflex-based neural...... network to generate basic walking patterns of a dynamic bipedal walking robot (DACBOT) and then a CPG-based neural network to ensure robust walking behavior...
Nondestructive pavement evaluation using ILLI-PAVE based artificial neural network models.
2008-09-01
The overall objective in this research project is to develop advanced pavement structural analysis models for more accurate solutions with fast computation schemes. Soft computing and modeling approaches, specifically the Artificial Neural Network (A...
Model-Based Fault Diagnosis in Electric Drive Inverters Using Artificial Neural Network
National Research Council Canada - National Science Library
Masrur, Abul; Chen, ZhiHang; Zhang, Baifang; Jia, Hongbin; Murphey, Yi-Lu
2006-01-01
.... A normal model and various faulted models of the inverter-motor combination were developed, and voltages and current signals were generated from those models to train an artificial neural network for fault diagnosis...
Satisfiability of logic programming based on radial basis function neural networks
International Nuclear Information System (INIS)
Hamadneh, Nawaf; Sathasivam, Saratha; Tilahun, Surafel Luleseged; Choon, Ong Hong
2014-01-01
In this paper, we propose a new technique to test the Satisfiability of propositional logic programming and quantified Boolean formula problem in radial basis function neural networks. For this purpose, we built radial basis function neural networks to represent the proportional logic which has exactly three variables in each clause. We used the Prey-predator algorithm to calculate the output weights of the neural networks, while the K-means clustering algorithm is used to determine the hidden parameters (the centers and the widths). Mean of the sum squared error function is used to measure the activity of the two algorithms. We applied the developed technique with the recurrent radial basis function neural networks to represent the quantified Boolean formulas. The new technique can be applied to solve many applications such as electronic circuits and NP-complete problems
Satisfiability of logic programming based on radial basis function neural networks
Energy Technology Data Exchange (ETDEWEB)
Hamadneh, Nawaf; Sathasivam, Saratha; Tilahun, Surafel Luleseged; Choon, Ong Hong [School of Mathematical Sciences, Universiti Sains Malaysia, 11800 USM, Penang (Malaysia)
2014-07-10
In this paper, we propose a new technique to test the Satisfiability of propositional logic programming and quantified Boolean formula problem in radial basis function neural networks. For this purpose, we built radial basis function neural networks to represent the proportional logic which has exactly three variables in each clause. We used the Prey-predator algorithm to calculate the output weights of the neural networks, while the K-means clustering algorithm is used to determine the hidden parameters (the centers and the widths). Mean of the sum squared error function is used to measure the activity of the two algorithms. We applied the developed technique with the recurrent radial basis function neural networks to represent the quantified Boolean formulas. The new technique can be applied to solve many applications such as electronic circuits and NP-complete problems.
Matlab for Forecasting of Electric Power Load Based on BP Neural Network
Wang, Xi-Ping; Shi, Ming-Xi
Modeling and predicting electricity consumption play a vital role both in developed and developing countries for policy makers and related organizations. Improve load forecasting technology level is not only beneficial to plan power management and make reasonable construction plan, but also good for saving energy and reducing power cost, and then, it can improve the economic benefits and social benefit for power system. BP neural network is one of the most widely used neural networks and it has many advantages in the power load forecasting. Matlab has become the best technology application software which has been internationally recognized, the software has many characteristics, such as data visualization function and neural network toolbox, for these, it is the essential software when we do some research on neural network.
Recognizing changing seasonal patterns using neural networks
Ph.H.B.F. Franses (Philip Hans); G. Draisma (Gerrit)
1997-01-01
textabstractIn this paper we propose a graphical method based on an artificial neural network model to investigate how and when seasonal patterns in macroeconomic time series change over time. Neural networks are useful since the hidden layer units may become activated only in certain seasons or
Some Examples of Identification with Neural Networks
Sjöberg, Jonas
1994-01-01
In this report some examples on system identification of non-linear systems with neural networks are presented. The systems being identified all have different kinds of non-linearities, more or less known. The examples in this paper show that these non-linearities can be successfully modeled by non-linear models based on neural networks.
Rakkiyappan, Rajan; Chandrasekar, Arunachalam; Cao, Jinde
2015-09-01
This paper presents a new design scheme for the passivity and passification of a class of memristor-based recurrent neural networks (MRNNs) with additive time-varying delays. The predictable assumptions on the boundedness and Lipschitz continuity of activation functions are formulated. The systems considered here are based on a different time-delay model suggested recently, which includes additive time-varying delay components in the state. The connection between the time-varying delay and its upper bound is considered when estimating the upper bound of the derivative of Lyapunov functional. It is recognized that the passivity condition can be expressed in a linear matrix inequality (LMI) format and by using characteristic function method. For state feedback passification, it is verified that it is apathetic to use immediate or delayed state feedback. By constructing a Lyapunov-Krasovskii functional and employing Jensen's inequality and reciprocal convex combination technique together with a tighter estimation of the upper bound of the cross-product terms derived from the derivatives of the Lyapunov functional, less conventional delay-dependent passivity criteria are established in terms of LMIs. Moreover, second-order reciprocally convex approach is employed for deriving the upper bound for terms with inverses of squared convex parameters. The model based on the memristor with additive time-varying delays widens the application scope for the design of neural networks. Finally, pertinent examples are given to show the advantages of the derived passivity criteria and the significant improvement of the theoretical approaches.
Directory of Open Access Journals (Sweden)
Manoj Tripathy
2012-01-01
Full Text Available This paper describes a new approach for power transformer differential protection which is based on the wave-shape recognition technique. An algorithm based on neural network principal component analysis (NNPCA with back-propagation learning is proposed for digital differential protection of power transformer. The principal component analysis is used to preprocess the data from power system in order to eliminate redundant information and enhance hidden pattern of differential current to discriminate between internal faults from inrush and overexcitation conditions. This algorithm has been developed by considering optimal number of neurons in hidden layer and optimal number of neurons at output layer. The proposed algorithm makes use of ratio of voltage to frequency and amplitude of differential current for transformer operating condition detection. This paper presents a comparative study of power transformer differential protection algorithms based on harmonic restraint method, NNPCA, feed forward back propagation neural network (FFBPNN, space vector analysis of the differential signal, and their time characteristic shapes in Park’s plane. The algorithms are compared as to their speed of response, computational burden, and the capability to distinguish between a magnetizing inrush and power transformer internal fault. The mathematical basis for each algorithm is briefly described. All the algorithms are evaluated using simulation performed with PSCAD/EMTDC and MATLAB.
Raman, M R Gauthama; Somu, Nivethitha; Kirthivasan, Kannan; Sriram, V S Shankar
2017-08-01
Over the past few decades, the design of an intelligent Intrusion Detection System (IDS) remains an open challenge to the research community. Continuous efforts by the researchers have resulted in the development of several learning models based on Artificial Neural Network (ANN) to improve the performance of the IDSs. However, there exists a tradeoff with respect to the stability of ANN architecture and the detection rate for less frequent attacks. This paper presents a novel approach based on Helly property of Hypergraph and Arithmetic Residue-based Probabilistic Neural Network (HG AR-PNN) to address the classification problem in IDS. The Helly property of Hypergraph was exploited for the identification of the optimal feature subset and the arithmetic residue of the optimal feature subset was used to train the PNN. The performance of HG AR-PNN was evaluated using KDD CUP 1999 intrusion dataset. Experimental results prove the dominance of HG AR-PNN classifier over the existing classifiers with respect to the stability and improved detection rate for less frequent attacks. Copyright © 2017 Elsevier Ltd. All rights reserved.
Course Control of Underactuated Ship Based on Nonlinear Robust Neural Network Backstepping Method.
Yuan, Junjia; Meng, Hao; Zhu, Qidan; Zhou, Jiajia
2016-01-01
The problem of course control for underactuated surface ship is addressed in this paper. Firstly, neural networks are adopted to determine the parameters of the unknown part of ideal virtual backstepping control, even the weight values of neural network are updated by adaptive technique. Then uniform stability for the convergence of course tracking errors has been proven through Lyapunov stability theory. Finally, simulation experiments are carried out to illustrate the effectiveness of proposed control method.
An industrial robot singular trajectories planning based on graphs and neural networks
Łęgowski, Adrian; Niezabitowski, Michał
2016-06-01
Singular trajectories are rarely used because of issues during realization. A method of planning trajectories for given set of points in task space with use of graphs and neural networks is presented. In every desired point the inverse kinematics problem is solved in order to derive all possible solutions. A graph of solutions is made. The shortest path is determined to define required nodes in joint space. Neural networks are used to define the path between these nodes.
Measuring human emotions with modular neural networks and computer vision based applications
Directory of Open Access Journals (Sweden)
Veaceslav Albu
2015-05-01
Full Text Available This paper describes a neural network architecture for emotion recognition for human-computer interfaces and applied systems. In the current research, we propose a combination of the most recent biometric techniques with the neural networks (NN approach for real-time emotion and behavioral analysis. The system will be tested in real-time applications of customers' behavior for distributed on-land systems, such as kiosks and ATMs.
Mustafa DEMETGÜL
2008-01-01
In this study, an artificial neural network is developed to find an error rapidly on pneumatic system. Also the ANN prevents the system versus the failure. The error on the experimental bottle filling plant can be defined without any interference using analog values taken from pressure sensors and linear potentiometers. The sensors and potentiometers are placed on different places of the plant. Neural network diagnosis faults on plant, where no bottle, cap closing cylinder B is not working, b...
A new wind power prediction method based on chaotic theory and Bernstein Neural Network
International Nuclear Information System (INIS)
Wang, Cong; Zhang, Hongli; Fan, Wenhui; Fan, Xiaochao
2016-01-01
The accuracy of wind power prediction is important for assessing the security and economy of the system operation when wind power connects to the grids. However, multiple factors cause a long delay and large errors in wind power prediction. Hence, efficient wind power forecasting approaches are still required for practical applications. In this paper, a new wind power forecasting method based on Chaos Theory and Bernstein Neural Network (BNN) is proposed. Firstly, the largest Lyapunov exponent as a judgment for wind power system's chaotic behavior is made. Secondly, Phase Space Reconstruction (PSR) is used to reconstruct the wind power series' phase space. Thirdly, the prediction model is constructed using the Bernstein polynomial and neural network. Finally, the weights and thresholds of the model are optimized by Primal Dual State Transition Algorithm (PDSTA). The practical hourly data of wind power generation in Xinjiang is used to test this forecaster. The proposed forecaster is compared with several current prominent research findings. Analytical results indicate that the forecasting error of PDSTA + BNN is 3.893% for 24 look-ahead hours, and has lower errors obtained compared with the other forecast methods discussed in this paper. The results of all cases studying confirm the validity of the new forecast method. - Highlights: • Lyapunov exponent is used to verify chaotic behavior of wind power series. • Phase Space Reconstruction is used to reconstruct chaotic wind power series. • A new Bernstein Neural Network to predict wind power series is proposed. • Primal dual state transition algorithm is chosen as the training strategy of BNN.
Generalized in vitro-in vivo relationship (IVIVR) model based on artificial neural networks.
Mendyk, Aleksander; Tuszyński, Paweł K; Polak, Sebastian; Jachowicz, Renata
2013-01-01
The aim of this study was to develop a generalized in vitro-in vivo relationship (IVIVR) model based on in vitro dissolution profiles together with quantitative and qualitative composition of dosage formulations as covariates. Such a model would be of substantial aid in the early stages of development of a pharmaceutical formulation, when no in vivo results are yet available and it is impossible to create a classical in vitro-in vivo correlation (IVIVC)/IVIVR. Chemoinformatics software was used to compute the molecular descriptors of drug substances (ie, active pharmaceutical ingredients) and excipients. The data were collected from the literature. Artificial neural networks were used as the modeling tool. The training process was carried out using the 10-fold cross-validation technique. The database contained 93 formulations with 307 inputs initially, and was later limited to 28 in a course of sensitivity analysis. The four best models were introduced into the artificial neural network ensemble. Complete in vivo profiles were predicted accurately for 37.6% of the formulations. It has been shown that artificial neural networks can be an effective predictive tool for constructing IVIVR in an integrated generalized model for various formulations. Because IVIVC/IVIVR is classically conducted for 2-4 formulations and with a single active pharmaceutical ingredient, the approach described here is unique in that it incorporates various active pharmaceutical ingredients and dosage forms into a single model. Thus, preliminary IVIVC/IVIVR can be available without in vivo data, which is impossible using current IVIVC/IVIVR procedures.
Respiratory signal prediction based on adaptive boosting and multi-layer perceptron neural network
Sun, W. Z.; Jiang, M. Y.; Ren, L.; Dang, J.; You, T.; Yin, F.-F.
2017-09-01
To improve the prediction accuracy of respiratory signals using adaptive boosting and multi-layer perceptron neural network (ADMLP-NN) for gated treatment of moving target in radiation therapy. The respiratory signals acquired using a real-time position management (RPM) device from 138 previous 4DCT scans were retrospectively used in this study. The ADMLP-NN was composed of several artificial neural networks (ANNs) which were used as weaker predictors to compose a stronger predictor. The respiratory signal was initially smoothed using a Savitzky-Golay finite impulse response smoothing filter (S-G filter). Then, several similar multi-layer perceptron neural networks (MLP-NNs) were configured to estimate future respiratory signal position from its previous positions. Finally, an adaptive boosting (Adaboost) decision algorithm was used to set weights for each MLP-NN based on the sample prediction error of each MLP-NN. Two prediction methods, MLP-NN and ADMLP-NN (MLP-NN plus adaptive boosting), were evaluated by calculating correlation coefficient and root-mean-square-error between true and predicted signals. For predicting 500 ms ahead of prediction, average correlation coefficients were improved from 0.83 (MLP-NN method) to 0.89 (ADMLP-NN method). The average of root-mean-square-error (relative unit) for 500 ms ahead of prediction using ADMLP-NN were reduced by 27.9%, compared to those using MLP-NN. The preliminary results demonstrate that the ADMLP-NN respiratory prediction method is more accurate than the MLP-NN method and can improve the respiration prediction accuracy.
GARCH based artificial neural networks in forecasting conditional variance of stock returns
Directory of Open Access Journals (Sweden)
Josip Arnerić
2014-12-01
Full Text Available Portfolio managers, option traders and market makers are all interested in volatility forecasting in order to get higher profits or less risky positions. Based on the fact that volatility is time varying in high frequency data and that periods of high volatility tend to cluster, the most popular models in modelling volatility are GARCH type models because they can account excess kurtosis and asymmetric effects of financial time series. A standard GARCH(1,1 model usually indicates high persistence in the conditional variance, which may originate from structural changes. The first objective of this paper is to develop a parsimonious neural networks (NN model, which can capture the nonlinear relationship between past return innovations and conditional variance. Therefore, the goal is to develop a neural network with an appropriate recurrent connection in the context of nonlinear ARMA models, i.e., the Jordan neural network (JNN. The second objective of this paper is to determine if JNN outperforms the standard GARCH model. Out-of-sample forecasts of the JNN and the GARCH model will be compared to determine their predictive accuracy. The data set consists of returns of the CROBEX index daily closing prices obtained from the Zagreb Stock Exchange. The results indicate that the selected JNN(1,1,1 model has superior performances compared to the standard GARCH(1,1 model. The contribution of this paper can be seen in determining the appropriate NN that is comparable to the standard GARCH(1,1 model and its application in forecasting conditional variance of stock returns. Moreover, from the econometric perspective, NN models are used as a semi-parametric method that combines flexibility of nonparametric methods and the interpretability of parameters of parametric methods.
Comparison of Artificial Neural Networks and GIS Based Solar Analysis for Solar Potential Estimation
Konakoǧlu, Berkant; Usta, Ziya; Cömert, Çetin; Gökalp, Ertan
2016-04-01
Nowadays, estimation of solar potential plays an important role in planning process for sustainable cities. The use of solar panels, which produces electricity directly from the sun, has become popular in accordance with developing technologies. Since the use of solar panels enables the users to decrease costs and increase yields, the use of solar panels will be more popular in the future. Production of electricity is not convenient for all circumstances. Shading effects, massive clouds and rainy weather are some factors that directly affect the production of electricity from solar energy. Hence, before the installation of solar panels, it is crucial to conduct spatial analysis and estimate the solar potential of the place that the solar panel will be installed. There are several approaches to determine the solar potential. Examination of the applications in the literature reveals that the applications conducted for determining the solar potential are divided into two main categories. Solar potential is estimated either by using artificial neural network approach in which statistical parameters such as the duration of sun shine, number of clear days, solar radiation etc. are used, or by spatial analysis conducted in GIS approaches in which spatial parameters such as, latitude, longitude, slope, aspect etc. are used. In the literature, there are several studies that use both approaches but the literature lacks of a study related to the comparison of these approaches. In this study, Karadeniz Technical University campus has been selected as study area. Monthly average values of the number of clear sky days, air temperature, atmospheric pressure, relative humidity, sunshine duration and solar radiation parameters obtained for the years between 2005 and 2015 will be used to perform artificial neural network analysis to estimate the solar potential of the study area. The solar potential will also be estimated by using GIS-based solar analysis modules. The results of
Program Helps Simulate Neural Networks
Villarreal, James; Mcintire, Gary
1993-01-01
Neural Network Environment on Transputer System (NNETS) computer program provides users high degree of flexibility in creating and manipulating wide variety of neural-network topologies at processing speeds not found in conventional computing environments. Supports back-propagation and back-propagation-related algorithms. Back-propagation algorithm used is implementation of Rumelhart's generalized delta rule. NNETS developed on INMOS Transputer(R). Predefines back-propagation network, Jordan network, and reinforcement network to assist users in learning and defining own networks. Also enables users to configure other neural-network paradigms from NNETS basic architecture. Small portion of software written in OCCAM(R) language.
Liu, Xiaolin; Li, Lanfei; Sun, Hanxu
2017-12-01
Spherical flying robot can perform various tasks in the complex and varied environment to reduce labor costs. However, it is difficult to guarantee the stability of the spherical flying robot in the case of strong coupling and time-varying disturbance. In this paper, an artificial neural network controller (ANNC) based on MPSO-BFGS hybrid optimization algorithm is proposed. The MPSO algorithm is used to optimize the initial weights of the controller to avoid the local optimal solution. The BFGS algorithm is introduced to improve the convergence ability of the network. We use Lyapunov method to analyze the stability of ANNC. The controller is simulated under the condition of nonlinear coupling disturbance. The experimental results show that the proposed controller can obtain the expected value in shoter time compared with the other considered methods.
Fluid region segmentation in OCT images based on convolution neural network
Liu, Dong; Liu, Xiaoming; Fu, Tianyu; Yang, Zhou
2017-07-01
In the retinal image, characteristics of fluid have great significance for diagnosis in eye disease. In the clinical, the segmentation of fluid is usually conducted manually, but is time-consuming and the accuracy is highly depend on the expert's experience. In this paper, we proposed a segmentation method based on convolution neural network (CNN) for segmenting the fluid from fundus image. The B-scans of OCT are segmented into layers, and patches from specific region with annotation are used for training. After the data set being divided into training set and test set, network training is performed and a good segmentation result is obtained, which has a significant advantage over traditional methods such as threshold method.
Supplier selection based on a neural network model using genetic algorithm.
Golmohammadi, Davood; Creese, Robert C; Valian, Haleh; Kolassa, John
2009-09-01
In this paper, a decision-making model was developed to select suppliers using neural networks (NNs). This model used historical supplier performance data for selection of vendor suppliers. Input and output were designed in a unique manner for training purposes. The managers' judgments about suppliers were simulated by using a pairwise comparisons matrix for output estimation in the NN. To obtain the benefit of a search technique for model structure and training, genetic algorithm (GA) was applied for the initial weights and architecture of the network. The suppliers' database information (input) can be updated over time to change the suppliers' score estimation based on their performance. The case study illustrated shows how the model can be applied for suppliers' selection.
Pancreas Segmentation in MRI using Graph-Based Decision Fusion on Convolutional Neural Networks.
Cai, Jinzheng; Lu, Le; Zhang, Zizhao; Xing, Fuyong; Yang, Lin; Yin, Qian
2016-10-01
Automated pancreas segmentation in medical images is a prerequisite for many clinical applications, such as diabetes inspection, pancreatic cancer diagnosis, and surgical planing. In this paper, we formulate pancreas segmentation in magnetic resonance imaging (MRI) scans as a graph based decision fusion process combined with deep convolutional neural networks (CNN). Our approach conducts pancreatic detection and boundary segmentation with two types of CNN models respectively: 1) the tissue detection step to differentiate pancreas and non-pancreas tissue with spatial intensity context; 2) the boundary detection step to allocate the semantic boundaries of pancreas. Both detection results of the two networks are fused together as the initialization of a conditional random field (CRF) framework to obtain the final segmentation output. Our approach achieves the mean dice similarity coefficient (DSC) 76.1% with the standard deviation of 8.7% in a dataset containing 78 abdominal MRI scans. The proposed algorithm achieves the best results compared with other state of the arts.
Neural network based expert system for fault diagnosis of particle accelerators
International Nuclear Information System (INIS)
Dewidar, M.M.
1997-01-01
Particle accelerators are generators that produce beams of charged particles, acquiring different energies, depending on the accelerator type. The MGC-20 cyclotron is a cyclic particle accelerator used for accelerating protons, deuterons, alpha particles, and helium-3 to different energies. Its applications include isotope production, nuclear reaction, and mass spectroscopy studies. It is a complicated machine, it consists of five main parts, the ion source, the deflector, the beam transport system, the concentric and harmonic coils, and the radio frequency system. The diagnosis of this device is a very complex task. it depends on the conditions of 27 indicators of the control panel of the device. The accurate diagnosis can lead to a high system reliability and save maintenance costs. so an expert system for the cyclotron fault diagnosis is necessary to be built. In this thesis , a hybrid expert system was developed for the fault diagnosis of the MGC-20 cyclotron. Two intelligent techniques, multilayer feed forward back propagation neural network and the rule based expert system, are integrated as a pre-processor loosely coupled model to build the proposed hybrid expert system. The architecture of the developed hybrid expert system consists of two levels. The first level is two feed forward back propagation neural networks, used for isolating the faulty part of the cyclotron. The second level is the rule based expert system, used for troubleshooting the faults inside the isolated faulty part. 4-6 tabs., 4-5 figs., 36 refs
Neural network Hilbert transform based filtered backprojection for fast inline x-ray inspection
Janssens, Eline; De Beenhouwer, Jan; Van Dael, Mattias; De Schryver, Thomas; Van Hoorebeke, Luc; Verboven, Pieter; Nicolai, Bart; Sijbers, Jan
2018-03-01
X-ray imaging is an important tool for quality control since it allows to inspect the interior of products in a non-destructive way. Conventional x-ray imaging, however, is slow and expensive. Inline x-ray inspection, on the other hand, can pave the way towards fast and individual quality control, provided that a sufficiently high throughput can be achieved at a minimal cost. To meet these criteria, an inline inspection acquisition geometry is proposed where the object moves and rotates on a conveyor belt while it passes a fixed source and detector. Moreover, for this acquisition geometry, a new neural-network-based reconstruction algorithm is introduced: the neural network Hilbert transform based filtered backprojection. The proposed algorithm is evaluated both on simulated and real inline x-ray data and has shown to generate high quality reconstructions of 400 × 400 reconstruction pixels within 200 ms, thereby meeting the high throughput criteria.
Deep Recurrent Neural Network-Based Autoencoders for Acoustic Novelty Detection
Directory of Open Access Journals (Sweden)
Erik Marchi
2017-01-01
Full Text Available In the emerging field of acoustic novelty detection, most research efforts are devoted to probabilistic approaches such as mixture models or state-space models. Only recent studies introduced (pseudo-generative models for acoustic novelty detection with recurrent neural networks in the form of an autoencoder. In these approaches, auditory spectral features of the next short term frame are predicted from the previous frames by means of Long-Short Term Memory recurrent denoising autoencoders. The reconstruction error between the input and the output of the autoencoder is used as activation signal to detect novel events. There is no evidence of studies focused on comparing previous efforts to automatically recognize novel events from audio signals and giving a broad and in depth evaluation of recurrent neural network-based autoencoders. The present contribution aims to consistently evaluate our recent novel approaches to fill this white spot in the literature and provide insight by extensive evaluations carried out on three databases: A3Novelty, PASCAL CHiME, and PROMETHEUS. Besides providing an extensive analysis of novel and state-of-the-art methods, the article shows how RNN-based autoencoders outperform statistical approaches up to an absolute improvement of 16.4% average F-measure over the three databases.
Predicting subcontractor performance using web-based Evolutionary Fuzzy Neural Networks.
Ko, Chien-Ho
2013-01-01
Subcontractor performance directly affects project success. The use of inappropriate subcontractors may result in individual work delays, cost overruns, and quality defects throughout the project. This study develops web-based Evolutionary Fuzzy Neural Networks (EFNNs) to predict subcontractor performance. EFNNs are a fusion of Genetic Algorithms (GAs), Fuzzy Logic (FL), and Neural Networks (NNs). FL is primarily used to mimic high level of decision-making processes and deal with uncertainty in the construction industry. NNs are used to identify the association between previous performance and future status when predicting subcontractor performance. GAs are optimizing parameters required in FL and NNs. EFNNs encode FL and NNs using floating numbers to shorten the length of a string. A multi-cut-point crossover operator is used to explore the parameter and retain solution legality. Finally, the applicability of the proposed EFNNs is validated using real subcontractors. The EFNNs are evolved using 22 historical patterns and tested using 12 unseen cases. Application results show that the proposed EFNNs surpass FL and NNs in predicting subcontractor performance. The proposed approach improves prediction accuracy and reduces the effort required to predict subcontractor performance, providing field operators with web-based remote access to a reliable, scientific prediction mechanism.
Neural Networks-Based Forecasting Regarding the Convergence Process of CEE Countries to the Eurozone
Directory of Open Access Journals (Sweden)
Magdalena RĂDULESCU
2014-06-01
Full Text Available In the crisis frame, many forecasts failed to provide well determined ratios. What we tried to explain in this paper is how some selected Central and Eastern European countries will perform in the near future: Romania, Bulgaria, Hungary, Poland and Czech Republic, using neural networks- based forecasting model which we created for the nominal and real convergence ratios. As a methodology, we propose the forecasting based on artificial neural network (ANN, using the well-known software tool GMDH Shell. For each output variable, we obtain a forecast model, according to previous values and other input related variables, and we applied the model to all countries. Our forecasts are much closer to the partial results of 2013 in the analyzed countries than the European Commission’s or other international organizations’ forecasts. The results of the forecast are important both for governments to design their financial strategies and for the investors in these selected countries. According to our results, the Czech Republic seems to be closer to achieve its nominal convergence in the next two years, but it faces great difficulties in the real convergence area, because it did not overpass the recession.
Deep Recurrent Neural Network-Based Autoencoders for Acoustic Novelty Detection.
Marchi, Erik; Vesperini, Fabio; Squartini, Stefano; Schuller, Björn
2017-01-01
In the emerging field of acoustic novelty detection, most research efforts are devoted to probabilistic approaches such as mixture models or state-space models. Only recent studies introduced (pseudo-)generative models for acoustic novelty detection with recurrent neural networks in the form of an autoencoder. In these approaches, auditory spectral features of the next short term frame are predicted from the previous frames by means of Long-Short Term Memory recurrent denoising autoencoders. The reconstruction error between the input and the output of the autoencoder is used as activation signal to detect novel events. There is no evidence of studies focused on comparing previous efforts to automatically recognize novel events from audio signals and giving a broad and in depth evaluation of recurrent neural network-based autoencoders. The present contribution aims to consistently evaluate our recent novel approaches to fill this white spot in the literature and provide insight by extensive evaluations carried out on three databases: A3Novelty, PASCAL CHiME, and PROMETHEUS. Besides providing an extensive analysis of novel and state-of-the-art methods, the article shows how RNN-based autoencoders outperform statistical approaches up to an absolute improvement of 16.4% average F -measure over the three databases.
Deep convolutional neural network based antenna selection in multiple-input multiple-output system
Cai, Jiaxin; Li, Yan; Hu, Ying
2018-03-01
Antenna selection of wireless communication system has attracted increasing attention due to the challenge of keeping a balance between communication performance and computational complexity in large-scale Multiple-Input MultipleOutput antenna systems. Recently, deep learning based methods have achieved promising performance for large-scale data processing and analysis in many application fields. This paper is the first attempt to introduce the deep learning technique into the field of Multiple-Input Multiple-Output antenna selection in wireless communications. First, the label of attenuation coefficients channel matrix is generated by minimizing the key performance indicator of training antenna systems. Then, a deep convolutional neural network that explicitly exploits the massive latent cues of attenuation coefficients is learned on the training antenna systems. Finally, we use the adopted deep convolutional neural network to classify the channel matrix labels of test antennas and select the optimal antenna subset. Simulation experimental results demonstrate that our method can achieve better performance than the state-of-the-art baselines for data-driven based wireless antenna selection.
Classification of polycystic ovary based on ultrasound images using competitive neural network
Dewi, R. M.; Adiwijaya; Wisesty, U. N.; Jondri
2018-03-01
Infertility in the women reproduction system due to inhibition of follicles maturation process causing the number of follicles which is called polycystic ovaries (PCO). PCO detection is still operated manually by a gynecologist by counting the number and size of follicles in the ovaries, so it takes a long time and needs high accuracy. In general, PCO can be detected by calculating stereology or feature extraction and classification. In this paper, we designed a system to classify PCO by using the feature extraction (Gabor Wavelet method) and Competitive Neural Network (CNN). CNN was selected because this method is the combination between Hemming Net and The Max Net so that the data classification can be performed based on the specific characteristics of ultrasound data. Based on the result of system testing, Competitive Neural Network obtained the highest accuracy is 80.84% and the time process is 60.64 seconds (when using 32 feature vectors as well as weight and bias values respectively of 0.03 and 0.002).
Electron tomography based on highly limited data using a neural network reconstruction technique
Energy Technology Data Exchange (ETDEWEB)
Bladt, Eva [Electron Microscopy for Materials Research (EMAT), University of Antwerp, Groenenborgerlaan 171, B-2020 Antwerp (Belgium); Pelt, Daniël M. [CWI, Science Park 123, 1098 XG Amsterdam (Netherlands); Bals, Sara, E-mail: sara.bals@uantwerpen.be [Electron Microscopy for Materials Research (EMAT), University of Antwerp, Groenenborgerlaan 171, B-2020 Antwerp (Belgium); Batenburg, Kees Joost [CWI, Science Park 123, 1098 XG Amsterdam (Netherlands); Mathematical Institute, Leiden University, Niels Bohrweg 1, 2333 CA Leiden (Netherlands); iMinds-Visionlab, University of Antwerp, Universiteitsplein 1, B-2610 Wilrijk (Belgium)
2015-11-15
Gold nanoparticles are studied extensively due to their unique optical and catalytical properties. Their exact shape determines the properties and thereby the possible applications. Electron tomography is therefore often used to examine the three-dimensional (3D) shape of nanoparticles. However, since the acquisition of the experimental tilt series and the 3D reconstructions are very time consuming, it is difficult to obtain statistical results concerning the 3D shape of nanoparticles. Here, we propose a new approach for electron tomography that is based on artificial neural networks. The use of a new reconstruction approach enables us to reduce the number of projection images with a factor of 5 or more. The decrease in acquisition time of the tilt series and use of an efficient reconstruction algorithm allows us to examine a large amount of nanoparticles in order to retrieve statistical results concerning the 3D shape. - Highlights: • We propose a new approach for electron tomography based on artifical neural networks, which reduces the number of projection images with a factor of 5 or more. • This reconstruction algorithm allows us to examine the 3D shape of a broad range of nanostructures in a statistical manner. • NN-FBP reconstructions of highly limited data yield comparable quality to full data SIRT reconstructions.
ECG data compression using a neural network model based on multi-objective optimization.
Directory of Open Access Journals (Sweden)
Bo Zhang
Full Text Available Electrocardiogram (ECG data analysis is of great significance to the diagnosis of cardiovascular disease. ECG compression should be processed in real time, and the data should be based on lossless compression and have high predictability. In terms of the real time aspect, short-time Fourier transformation is applied to the processing of signal wave for reducing computational time. For the lossless compression requirement, wavelet-transformation that is a coding algorithm can be used to avoid loss of data. In practice, compression is required to avoid storing redundant recording data that are not useful in the diagnosis platform. The obtained data can be preprocessed to remove noise by using wavelet transform, and then a multi-objective optimize neural network model is used to extract feature information. Compared with the existing traditional methods such as direct data processing method and transform method, our proposed compression model has self-learning ability to achieve high data compression ratio at 1:19 without losing important ECG information and compromising quality. Upon testing, we demonstrated that the proposed ECG data compression method based on multi-objective optimization neural network is effective and efficient in clinical practice.
Edge detection for optical synthetic aperture based on deep neural network
Tan, Wenjie; Hui, Mei; Liu, Ming; Kong, Lingqin; Dong, Liquan; Zhao, Yuejin
2017-09-01
Synthetic aperture optics systems can meet the demands of the next-generation space telescopes being lighter, larger and foldable. However, the boundaries of segmented aperture systems are much more complex than that of the whole aperture. More edge regions mean more imaging edge pixels, which are often mixed and discretized. In order to achieve high-resolution imaging, it is necessary to identify the gaps between the sub-apertures and the edges of the projected fringes. In this work, we introduced the algorithm of Deep Neural Network into the edge detection of optical synthetic aperture imaging. According to the detection needs, we constructed image sets by experiments and simulations. Based on MatConvNet, a toolbox of MATLAB, we ran the neural network, trained it on training image set and tested its performance on validation set. The training was stopped when the test error on validation set stopped declining. As an input image is given, each intra-neighbor area around the pixel is taken into the network, and scanned pixel by pixel with the trained multi-hidden layers. The network outputs make a judgment on whether the center of the input block is on edge of fringes. We experimented with various pre-processing and post-processing techniques to reveal their influence on edge detection performance. Compared with the traditional algorithms or their improvements, our method makes decision on a much larger intra-neighbor, and is more global and comprehensive. Experiments on more than 2,000 images are also given to prove that our method outperforms classical algorithms in optical images-based edge detection.
Acoustic Performance of Exhaust Muffler based Genetic Algorithms and Artificial Neural Network
Directory of Open Access Journals (Sweden)
Wang Xiao Li
2013-07-01
Full Text Available The noise level was one of the important indicators as a measure of the quality and performance of the diesel engine, exhaust noise in diesel engines machine noise accounted for an important proportion of installed performance exhaust mufflerwas an effective way to control exhaust noise. This article using orthogonal test program was to the muffler structure parameters as input to the sound pressure level and diesel fuel each output artificial neural network (BP network learning sample. Matlab artificial neural network toolbox to complete the training of the network, and better noise performance and fuel consumption rate performance muffler internal structure parameters combination was obtained through genetic algorithm gifted collaborative validation of artificial neural networks and genetic algorithms to optimize application exhaust muffler design is entirely feasible
FRICTION MODELING OF Al-Mg ALLOY SHEETS BASED ON MULTIPLE REGRESSION ANALYSIS AND NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Hirpa G. Lemu
2017-03-01
Full Text Available This article reports a proposed approach to a frictional resistance description in sheet metal forming processes that enables determination of the friction coefficient value under a wide range of friction conditions without performing time-consuming experiments. The motivation for this proposal is the fact that there exists a considerable amount of factors affect the friction coefficient value and as a result building analytical friction model for specified process conditions is practically impossible. In this proposed approach, a mathematical model of friction behaviour is created using multiple regression analysis and artificial neural networks. The regression analysis was performed using a subroutine in MATLAB programming code and STATISTICA Neural Networks was utilized to build an artificial neural networks model. The effect of different training strategies on the quality of neural networks was studied. As input variables for regression model and training of radial basis function networks, generalized regression neural networks and multilayer networks the results of strip drawing friction test were utilized. Four kinds of Al-Mg alloy sheets were used as a test material.
He, Yong; Ji, Meng-Di; Zhang, Chuan-Ke; Wu, Min
2016-05-01
This paper is concerned with global exponential stability problem for a class of neural networks with time-varying delays. Using a new proposed inequality called free-matrix-based integral inequality, a less conservative criterion is proposed, which is expressed by linear matrix inequalities. Two numerical examples are given to show the effectiveness and superiority of the obtained criterion. Copyright © 2016 Elsevier Ltd. All rights reserved.
Genetic algorithm-based neural network for accidents diagnosis of research reactors on FPGA
International Nuclear Information System (INIS)
Ghuname, A.A.A.
2012-01-01
The Nuclear Research Reactors plants are expected to be operated with high levels of reliability, availability and safety. In order to achieve and maintain system stability and assure satisfactory and safe operation, there is increasing demand for automated systems to detect and diagnose such failures. Artificial Neural Networks (ANNs) are one of the most popular solutions because of their parallel structure, high speed, and their ability to give easy solution to complicated problems. The genetic algorithms (GAs) which are search algorithms (optimization techniques), in recent years, have been used to find the optimum construction of a neural network for definite application, as one of the advantages of its usage. Nowadays, Field Programmable Gate Arrays (FPGAs) are being an important implementation method of neural networks due to their high performance and they can easily be made parallel. The VHDL, which stands for VHSIC (Very High Speed Integrated Circuits) Hardware Description Language, have been used to describe the design behaviorally in addition to schematic and other description languages. The description of designs in synthesizable language such as VHDL make them reusable and be implemented in upgradeable systems like the Nuclear Research Reactors plants. In this thesis, the work was carried out through three main parts.In the first part, the Nuclear Research Reactors accident's pattern recognition is tackled within the artificial neural network approach. Such patterns are introduced initially without noise. And, to increase the reliability of such neural network, the noise ratio up to 50% was added for training in order to ensure the recognition of these patterns if it introduced with noise.The second part is concerned with the construction of Artificial Neural Networks (ANNs) using Genetic algorithms (GAs) for the nuclear accidents diagnosis. MATLAB ANNs toolbox and GAs toolbox are employed to optimize an ANN for this purpose. The results obtained show
Hayashi, Hideaki; Shibanoki, Taro; Shima, Keisuke; Kurita, Yuichi; Tsuji, Toshio
2015-12-01
This paper proposes a probabilistic neural network (NN) developed on the basis of time-series discriminant component analysis (TSDCA) that can be used to classify high-dimensional time-series patterns. TSDCA involves the compression of high-dimensional time series into a lower dimensional space using a set of orthogonal transformations and the calculation of posterior probabilities based on a continuous-density hidden Markov model with a Gaussian mixture model expressed in the reduced-dimensional space. The analysis can be incorporated into an NN, which is named a time-series discriminant component network (TSDCN), so that parameters of dimensionality reduction and classification can be obtained simultaneously as network coefficients according to a backpropagation through time-based learning algorithm with the Lagrange multiplier method. The TSDCN is considered to enable high-accuracy classification of high-dimensional time-series patterns and to reduce the computation time taken for network training. The validity of the TSDCN is demonstrated for high-dimensional artificial data and electroencephalogram signals in the experiments conducted during the study.
White blood cells identification system based on convolutional deep neural learning networks.
Shahin, A I; Guo, Yanhui; Amin, K M; Sharawi, Amr A
2017-11-16
White blood cells (WBCs) differential counting yields valued information about human health and disease. The current developed automated cell morphology equipments perform differential count which is based on blood smear image analysis. Previous identification systems for WBCs consist of successive dependent stages; pre-processing, segmentation, feature extraction, feature selection, and classification. There is a real need to employ deep learning methodologies so that the performance of previous WBCs identification systems can be increased. Classifying small limited datasets through deep learning systems is a major challenge and should be investigated. In this paper, we propose a novel identification system for WBCs based on deep convolutional neural networks. Two methodologies based on transfer learning are followed: transfer learning based on deep activation features and fine-tuning of existed deep networks. Deep acrivation featues are extracted from several pre-trained networks and employed in a traditional identification system. Moreover, a novel end-to-end convolutional deep architecture called "WBCsNet" is proposed and built from scratch. Finally, a limited balanced WBCs dataset classification is performed through the WBCsNet as a pre-trained network. During our experiments, three different public WBCs datasets (2551 images) have been used which contain 5 healthy WBCs types. The overall system accuracy achieved by the proposed WBCsNet is (96.1%) which is more than different transfer learning approaches or even the previous traditional identification system. We also present features visualization for the WBCsNet activation which reflects higher response than the pre-trained activated one. a novel WBCs identification system based on deep learning theory is proposed and a high performance WBCsNet can be employed as a pre-trained network. Copyright © 2017. Published by Elsevier B.V.
International Nuclear Information System (INIS)
Soezen, Adnan; Arcaklioglu, Erol; Oezalp, Mehmet
2005-01-01
This paper presents a new approach based on artificial neural networks (ANNs) to determine the properties of liquid and two phase boiling and condensing of two alternative refrigerant/absorbent couples (methanol/LiBr and methanol/LiCl). These couples do not cause ozone depletion and use in the absorption thermal systems (ATSs). ANNs are able to learn the key information patterns within multidimensional information domain. ANNs operate such as a 'black box' model, requiring no detailed information about the system. On the other hand, they learn the relationship between the input and the output. In order to train the neural network, limited experimental measurements were used as training data and test data. In this study, in input layer, there are temperatures in the range of 298-498 K, pressures (0.1-40 MPa) and concentrations of 2%, 7%, 12% of the couples; specific volume is in output layer. The back-propagation learning algorithm with three different variants, namely scaled conjugate gradient (SCG), Pola-Ribiere conjugate gradient (CGP), and Levenberg-Marquardt (LM), and logistic sigmoid transfer function were used in the network so that the best approach can find. The most suitable algorithm and neuron number in the hidden layer are found as SCG with 8 neurons. For this number level, after the training, it is found that maximum error is less than 3%, average error is about 1% and R 2 value are 99.999%. As seen from the results obtained the thermodynamic equations for each pair by using the weights of network have been obviously predicted within acceptable errors. This paper shows that values predicted with ANN can be used to define the thermodynamic properties instead of approximate and complex analytic equations
Auto-control of pumping operations in sewerage systems by rule-based fuzzy neural networks
Directory of Open Access Journals (Sweden)
Y.-M. Chiang
2011-01-01
Full Text Available Pumping stations play an important role in flood mitigation in metropolitan areas. The existing sewerage systems, however, are facing a great challenge of fast rising peak flow resulting from urbanization and climate change. It is imperative to construct an efficient and accurate operating prediction model for pumping stations to simulate the drainage mechanism for discharging the rainwater in advance. In this study, we propose two rule-based fuzzy neural networks, adaptive neuro-fuzzy inference system (ANFIS and counterpropagation fuzzy neural network for on-line predicting of the number of open and closed pumps of a pivotal pumping station in Taipei city up to a lead time of 20 min. The performance of ANFIS outperforms that of CFNN in terms of model efficiency, accuracy, and correctness. Furthermore, the results not only show the predictive water levels do contribute to the successfully operating pumping stations but also demonstrate the applicability and reliability of ANFIS in automatically controlling the urban sewerage systems.
An Inverse Neural Controller Based on the Applicability Domain of RBF Network Models
Directory of Open Access Journals (Sweden)
Alex Alexandridis
2018-01-01
Full Text Available This paper presents a novel methodology of generic nature for controlling nonlinear systems, using inverse radial basis function neural network models, which may combine diverse data originating from various sources. The algorithm starts by applying the particle swarm optimization-based non-symmetric variant of the fuzzy means (PSO-NSFM algorithm so that an approximation of the inverse system dynamics is obtained. PSO-NSFM offers models of high accuracy combined with small network structures. Next, the applicability domain concept is suitably tailored and embedded into the proposed control structure in order to ensure that extrapolation is avoided in the controller predictions. Finally, an error correction term, estimating the error produced by the unmodeled dynamics and/or unmeasured external disturbances, is included to the control scheme to increase robustness. The resulting controller guarantees bounded input-bounded state (BIBS stability for the closed loop system when the open loop system is BIBS stable. The proposed methodology is evaluated on two different control problems, namely, the control of an experimental armature-controlled direct current (DC motor and the stabilization of a highly nonlinear simulated inverted pendulum. For each one of these problems, appropriate case studies are tested, in which a conventional neural controller employing inverse models and a PID controller are also applied. The results reveal the ability of the proposed control scheme to handle and manipulate diverse data through a data fusion approach and illustrate the superiority of the method in terms of faster and less oscillatory responses.
An Inverse Neural Controller Based on the Applicability Domain of RBF Network Models.
Alexandridis, Alex; Stogiannos, Marios; Papaioannou, Nikolaos; Zois, Elias; Sarimveis, Haralambos
2018-01-22
This paper presents a novel methodology of generic nature for controlling nonlinear systems, using inverse radial basis function neural network models, which may combine diverse data originating from various sources. The algorithm starts by applying the particle swarm optimization-based non-symmetric variant of the fuzzy means (PSO-NSFM) algorithm so that an approximation of the inverse system dynamics is obtained. PSO-NSFM offers models of high accuracy combined with small network structures. Next, the applicability domain concept is suitably tailored and embedded into the proposed control structure in order to ensure that extrapolation is avoided in the controller predictions. Finally, an error correction term, estimating the error produced by the unmodeled dynamics and/or unmeasured external disturbances, is included to the control scheme to increase robustness. The resulting controller guarantees bounded input-bounded state (BIBS) stability for the closed loop system when the open loop system is BIBS stable. The proposed methodology is evaluated on two different control problems, namely, the control of an experimental armature-controlled direct current (DC) motor and the stabilization of a highly nonlinear simulated inverted pendulum. For each one of these problems, appropriate case studies are tested, in which a conventional neural controller employing inverse models and a PID controller are also applied. The results reveal the ability of the proposed control scheme to handle and manipulate diverse data through a data fusion approach and illustrate the superiority of the method in terms of faster and less oscillatory responses.
Study on a Biometric Authentication Model based on ECG using a Fuzzy Neural Network
Kim, Ho J.; Lim, Joon S.
2018-03-01
Traditional authentication methods use numbers or graphic passwords and thus involve the risk of loss or theft. Various studies are underway regarding biometric authentication because it uses the unique biometric data of a human being. Biometric authentication technology using ECG from biometric data involves signals that record electrical stimuli from the heart. It is difficult to manipulate and is advantageous in that it enables unrestrained measurements from sensors that are attached to the skin. This study is on biometric authentication methods using the neural network with weighted fuzzy membership functions (NEWFM). In the biometric authentication process, normalization and the ensemble average is applied during preprocessing, characteristics are extracted using Haar-wavelets, and a registration process called “training” is performed in the fuzzy neural network. In the experiment, biometric authentication was performed on 73 subjects in the Physionet Database. 10-40 ECG waveforms were tested for use in the registration process, and 15 ECG waveforms were deemed the appropriate number for registering ECG waveforms. 1 ECG waveforms were used during the authentication stage to conduct the biometric authentication test. Upon testing the proposed biometric authentication method based on 73 subjects from the Physionet Database, the TAR was 98.32% and FAR was 5.84%.
Thufailah, I. F.; Adiwijaya; Wisesty, U. N.; Jondri
2018-03-01
Polycystic Ovary Syndrome (PCOS) is a reproduction problem that causes irregular menstruation period. Insulin and androgen hormone have big roles for this problem. This syndrome should be detected shortly, since it is able to cause a more serious disease, such as cardiovascular, diabetes, and obesity. The detection of this syndrome is done by analyzing ovary morphology and hormone test. However, the more economical way of test is by identifying the ovary morphology using ultrasonography. To classify whether one ovary is normal or it has polycystic ovary (PCO) follicle, the analysis will be done manually by a gynecologist. This paper will design a system to detect PCO using Gabor Wavelet method for feature extraction and Elman Neural Network is used to classify PCO and non-PCO. Elman Neural Network is chosen because it contains context layer to recall the previous condition. This paper compared the accuracy and process time of each dataset, then also did testing on elman’s parameters, such as layer delay, hidden layer, and training function. Based on tests done in this paper, the most accurate number is 78.1% with 32 features.
Monitoring the Freshness of Moroccan Sardines with a Neural-Network Based Electronic Nose
Directory of Open Access Journals (Sweden)
Benachir Bouchikhi
2006-10-01
Full Text Available An electronic nose was developed and used as a rapid technique to classify thefreshness of sardine samples according to the number of days spent under cold storage (4 Ã‚Â±1Ã‚Â°C, in air. The volatile compounds present in the headspace of weighted sardine sampleswere introduced into a sensor chamber and the response signals of the sensors wererecorded as a function of time. Commercially available gas sensors based on metal oxidesemiconductors were used and both static and dynamic features from the sensorconductance response were input to the pattern recognition engine. Data analysis wasperformed by three different pattern recognition methods such as probabilistic neuralnetworks (PNN, fuzzy ARTMAP neural networks (FANN and support vector machines(SVM. The objective of this study was to find, among these three pattern recognitionmethods, the most suitable one for accurately identifying the days of cold storage undergoneby sardine samples. The results show that the electronic nose can monitor the freshness ofsardine samples stored at 4Ã‚Â°C, and that the best classification and prediction are obtainedwith SVM neural network. The SVM approach shows improved classificationperformances, reducing the amount of misclassified samples down to 3.75 %.
Optimization of steel casting feeding system based on BP neural network and genetic algorithm
Directory of Open Access Journals (Sweden)
Xue-dan Gong
2016-05-01
Full Text Available The trial-and-error method is widely used for the current optimization of the steel casting feeding system, which is highly random, subjective and thus inefficient. In the present work, both the theoretical and the experimental research on the modeling and optimization methods of the process are studied. An approximate alternative model is established based on the Back Propagation (BP neural network and experimental design. The process parameters of the feeding system are taken as the input, the volumes of shrinkage cavities and porosities calculated by simulation are simultaneously taken as the output. Thus, a mathematical model is established by the BP neural network to combine the input variables with the output response. Then, this model is optimized by the nonlinear optimization function of the genetic algorithm. Finally, a feeding system optimization of a steel traveling wheel is conducted. No shrinkage cavities and porosities are induced through the optimization. Compared to the initial design scheme, the process yield is increased by 4.1% and the volume of the riser is decreased by 5.48×106 mm3.
Directory of Open Access Journals (Sweden)
Idris Khan
2017-01-01
Full Text Available High concentration of greenhouse gases in the atmosphere has increased dependency on photovoltaic (PV power, but its random nature poses a challenge for system operators to precisely predict and forecast PV power. The conventional forecasting methods were accurate for clean weather. But when the PV plants worked under heavy haze, the radiation is negatively impacted and thus reducing PV power; therefore, to deal with haze weather, Air Quality Index (AQI is introduced as a parameter to predict PV power. AQI, which is an indication of how polluted the air is, has been known to have a strong correlation with power generated by the PV panels. In this paper, a hybrid method based on the model of conventional back propagation (BP neural network for clear weather and BP AQI model for haze weather is used to forecast PV power with conventional parameters like temperature, wind speed, humidity, solar radiation, and an extra parameter of AQI as input. The results show that the proposed method has less error under haze condition as compared to conventional model of neural network.
Modeling and Computing of Stock Index Forecasting Based on Neural Network and Markov Chain
Dai, Yonghui; Han, Dongmei; Dai, Weihui
2014-01-01
The stock index reflects the fluctuation of the stock market. For a long time, there have been a lot of researches on the forecast of stock index. However, the traditional method is limited to achieving an ideal precision in the dynamic market due to the influences of many factors such as the economic situation, policy changes, and emergency events. Therefore, the approach based on adaptive modeling and conditional probability transfer causes the new attention of researchers. This paper presents a new forecast method by the combination of improved back-propagation (BP) neural network and Markov chain, as well as its modeling and computing technology. This method includes initial forecasting by improved BP neural network, division of Markov state region, computing of the state transition probability matrix, and the prediction adjustment. Results of the empirical study show that this method can achieve high accuracy in the stock index prediction, and it could provide a good reference for the investment in stock market. PMID:24782659
Cellular neural network-based hybrid approach toward automatic image registration
Arun, Pattathal VijayaKumar; Katiyar, Sunil Kumar
2013-01-01
Image registration is a key component of various image processing operations that involve the analysis of different image data sets. Automatic image registration domains have witnessed the application of many intelligent methodologies over the past decade; however, inability to properly model object shape as well as contextual information has limited the attainable accuracy. A framework for accurate feature shape modeling and adaptive resampling using advanced techniques such as vector machines, cellular neural network (CNN), scale invariant feature transform (SIFT), coreset, and cellular automata is proposed. CNN has been found to be effective in improving feature matching as well as resampling stages of registration and complexity of the approach has been considerably reduced using coreset optimization. The salient features of this work are cellular neural network approach-based SIFT feature point optimization, adaptive resampling, and intelligent object modelling. Developed methodology has been compared with contemporary methods using different statistical measures. Investigations over various satellite images revealed that considerable success was achieved with the approach. This system has dynamically used spectral and spatial information for representing contextual knowledge using CNN-prolog approach. This methodology is also illustrated to be effective in providing intelligent interpretation and adaptive resampling.
Wind Turbine Fault Detection based on Artificial Neural Network Analysis of SCADA Data
DEFF Research Database (Denmark)
Herp, Jürgen; S. Nadimi, Esmaeil
2015-01-01
Slowly developing faults in wind turbine can, when not detected and fixed on time, cause severe damage and downtime. We are proposing a fault detection method based on Artificial Neural Networks (ANN) and the recordings from Supervisory Control and Data Acquisition (SCADA) systems installed in wind...... farms. We establish a model for the normal behaviour of a wind turbine from considered fault-free data and test the proposed model on further data. We show that ANN can be used for early fault detection in wind turbines monitoring. Concerning vibrational levels in x and y directions we base our fault...... detection upon a generalized-likelihood-test. An upper and a lower control bounds are established for x and y respectively, given a minimum false alarm probability η based on the statistical characteristics of the data....
[Artificial neural networks in Neurosciences].
Porras Chavarino, Carmen; Salinas Martínez de Lecea, José María
2011-11-01
This article shows that artificial neural networks are used for confirming the relationships between physiological and cognitive changes. Specifically, we explore the influence of a decrease of neurotransmitters on the behaviour of old people in recognition tasks. This artificial neural network recognizes learned patterns. When we change the threshold of activation in some units, the artificial neural network simulates the experimental results of old people in recognition tasks. However, the main contributions of this paper are the design of an artificial neural network and its operation inspired by the nervous system and the way the inputs are coded and the process of orthogonalization of patterns.
Accelerating Learning By Neural Networks
Toomarian, Nikzad; Barhen, Jacob
1992-01-01
Electronic neural networks made to learn faster by use of terminal teacher forcing. Method of supervised learning involves addition of teacher forcing functions to excitations fed as inputs to output neurons. Initially, teacher forcing functions are strong enough to force outputs to desired values; subsequently, these functions decay with time. When learning successfully completed, terminal teacher forcing vanishes, and dynamics or neural network become equivalent to those of conventional neural network. Simulated neural network with terminal teacher forcing learned to produce close approximation of circular trajectory in 400 iterations.
Anomaly based intrusion detection for a biometric identification system using neural networks
CSIR Research Space (South Africa)
Mgabile, T
2012-10-01
Full Text Available detection technique that analyses the fingerprint biometric network traffic for evidence of intrusion. The neural network algorithm that imitates the way a human brain works is used in this study to classify normal traffic and learn the correct traffic...
Neural network-based survey analysis of risk management practices in new product development
DEFF Research Database (Denmark)
Kampianakis, Andreas N.; Oehmen, Josef
2017-01-01
Neural Networks. Dataset used is a filtered survey of 291 product development programs. Answers of this survey are used as training input and target output, in pattern recognition two-layer feed forward networks, using various transfer functions. Using this method, relations among 6 project practices...
Genetic Optimization of Neural Networks for Person Recognition based on the Iris
Directory of Open Access Journals (Sweden)
Oscar Castillo
2012-06-01
Full Text Available This paper describes the application of modular neural network architectures for person recognition using the human iris images as a biometric measure. The iris database was obtained from the Institute of Automation of the Academy of Sciences China (CASIA. We show simulation results with the modular neural network approach, its optimization using genetic algorithms, and the integration with different methods, such as: the gating network method, type-1 fuzzy integration and optimized fuzzy integration using genetic algorithms. Simulation results show a good identification rate using fuzzy integrators and the best structure found by the genetic algorithm.
Fault Diagnosis of Hydraulic Servo Valve Based on Genetic Optimization RBF-BP Neural Network
Directory of Open Access Journals (Sweden)
Li-Ping FAN
2014-04-01
Full Text Available Electro-hydraulic servo valves are core components of the hydraulic servo system of rolling mills. It is necessary to adopt an effective fault diagnosis method to keep the hydraulic servo valve in a good work state. In this paper, RBF and BP neural network are integrated effectively to build a double hidden layers RBF-BP neural network for fault diagnosis. In the process of training the neural network, genetic algorithm (GA is used to initialize and optimize the connection weights and thresholds of the network. Several typical fault states are detected by the constructed GA-optimized fault diagnosis scheme. Simulation results shown that the proposed fault diagnosis scheme can give satisfactory effect.
Towards an Irritable Bowel Syndrome Control System Based on Artificial Neural Networks
Podolski, Ina; Rettberg, Achim
To solve health problems with medical applications that use complex algorithms is a trend nowadays. It could also be a chance to help patients with critical problems caused from nerve irritations to overcome them and provide a better living situation. In this paper a system for monitoring and controlling the nerves from the intestine is described on a theoretical basis. The presented system could be applied to the irritable bowel syndrome. For control a neural network is used. The advantages for using a neural network for the control of irritable bowel syndrome are the adaptation and learning. These two aspects are important because the syndrome behavior varies from patient to patient and have also concerning the time a lot of variations with respect to each patient. The developed neural network is implemented and can be simulated. Therefore, it can be shown how the network monitor and control the nerves for individual input parameters.
Tran, Tung; Kavuluru, Ramakanth
2017-11-01
Applications of natural language processing to mental health notes are not common given the sensitive nature of the associated narratives. The CEGS N-GRID 2016 Shared Task in Clinical Natural Language Processing (NLP) changed this scenario by providing the first set of neuropsychiatric notes to participants. This study summarizes our efforts and results in proposing a novel data use case for this dataset as part of the third track in this shared task. We explore the feasibility and effectiveness of predicting a set of common mental conditions a patient has based on the short textual description of patient's history of present illness typically occurring in the beginning of a psychiatric initial evaluation note. We clean and process the 1000 records made available through the N-GRID clinical NLP task into a key-value dictionary and build a dataset of 986 examples for which there is a narrative for history of present illness as well as Yes/No responses with regards to presence of specific mental conditions. We propose two independent deep neural network models: one based on convolutional neural networks (CNN) and another based on recurrent neural networks with hierarchical attention (ReHAN), the latter of which allows for interpretation of model decisions. We conduct experiments to compare these methods to each other and to baselines based on linear models and named entity recognition (NER). Our CNN model with optimized thresholding of output probability estimates achieves best overall mean micro-F score of 63.144% for 11 common mental conditions with statistically significant gains (p<0.05) over all other models. The ReHAN model with interpretable attention mechanism scored 61.904% mean micro-F1 score. Both models' improvements over baseline models (support vector machines and NER) are statistically significant. The ReHAN model additionally aids in interpretation of the results by surfacing important words and sentences that lead to a particular prediction for each
Yang, Yun; Zhang, Weigang; Guo, Pan
2010-07-01
The proposed approach in this paper is divided into three steps namely the location of plate, the segmentation of the characters and the recognition of the characters. The location algorithm is firstly consisted of two video captures to get high quality images, and estimates the size of vehicle plate in these images via parallel binocular stereo vision algorithm. Then the segmentation method extracts the edge of vehicle plate based on second generation non-orthogonal Haar wavelet transformation, and locates the vehicle plate according to the estimated result in the first step. Finally, the recognition algorithm is realized based on the Radial Basis Function Fuzzy Neural Network. Experiments have been conducted for real images. The results show this method can decrease the error recognition rate of Chinese license plate recognition.
Energy Technology Data Exchange (ETDEWEB)
Edelen, A. L.; Biedron, S. G.; Milton, S. V.; Edelen, J. P.
2016-12-16
At present, a variety of image-based diagnostics are used in particle accelerator systems. Often times, these are viewed by a human operator who then makes appropriate adjustments to the machine. Given recent advances in using convolutional neural networks (CNNs) for image processing, it should be possible to use image diagnostics directly in control routines (NN-based or otherwise). This is especially appealing for non-intercepting diagnostics that could run continuously during beam operation. Here, we show results of a first step toward implementing such a controller: our trained CNN can predict multiple simulated downstream beam parameters at the Fermilab Accelerator Science and Technology (FAST) facility's low energy beamline using simulated virtual cathode laser images, gun phases, and solenoid strengths.
Passivity and passification of memristor-based recurrent neural networks with time-varying delays.
Guo, Zhenyuan; Wang, Jun; Yan, Zheng
2014-11-01
This paper presents new theoretical results on the passivity and passification of a class of memristor-based recurrent neural networks (MRNNs) with time-varying delays. The casual assumptions on the boundedness and Lipschitz continuity of neuronal activation functions are relaxed. By constructing appropriate Lyapunov-Krasovskii functionals and using the characteristic function technique, passivity conditions are cast in the form of linear matrix inequalities (LMIs), which can be checked numerically using an LMI toolbox. Based on these conditions, two procedures for designing passification controllers are proposed, which guarantee that MRNNs with time-varying delays are passive. Finally, two illustrative examples are presented to show the characteristics of the main results in detail.
Global detection of live virtual machine migration based on cellular neural networks.
Xie, Kang; Yang, Yixian; Zhang, Ling; Jing, Maohua; Xin, Yang; Li, Zhongxian
2014-01-01
In order to meet the demands of operation monitoring of large scale, autoscaling, and heterogeneous virtual resources in the existing cloud computing, a new method of live virtual machine (VM) migration detection algorithm based on the cellular neural networks (CNNs), is presented. Through analyzing the detection process, the parameter relationship of CNN is mapped as an optimization problem, in which improved particle swarm optimization algorithm based on bubble sort is used to solve the problem. Experimental results demonstrate that the proposed method can display the VM migration processing intuitively. Compared with the best fit heuristic algorithm, this approach reduces the processing time, and emerging evidence has indicated that this new approach is affordable to parallelism and analog very large scale integration (VLSI) implementation allowing the VM migration detection to be performed better.
Global Detection of Live Virtual Machine Migration Based on Cellular Neural Networks
Directory of Open Access Journals (Sweden)
Kang Xie
2014-01-01
Full Text Available In order to meet the demands of operation monitoring of large scale, autoscaling, and heterogeneous virtual resources in the existing cloud computing, a new method of live virtual machine (VM migration detection algorithm based on the cellular neural networks (CNNs, is presented. Through analyzing the detection process, the parameter relationship of CNN is mapped as an optimization problem, in which improved particle swarm optimization algorithm based on bubble sort is used to solve the problem. Experimental results demonstrate that the proposed method can display the VM migration processing intuitively. Compared with the best fit heuristic algorithm, this approach reduces the processing time, and emerging evidence has indicated that this new approach is affordable to parallelism and analog very large scale integration (VLSI implementation allowing the VM migration detection to be performed better.
Drogue detection for autonomous aerial refueling based on convolutional neural networks
Directory of Open Access Journals (Sweden)
Xufeng Wang
2017-02-01
Full Text Available Drogue detection is a fundamental issue during the close docking phase of autonomous aerial refueling (AAR. To cope with this issue, a novel and effective method based on deep learning with convolutional neural networks (CNNs is proposed. In order to ensure its robustness and wide application, a deep learning dataset of images was prepared by utilizing real data of “Probe and Drogue” aerial refueling, which contains diverse drogues in various environmental conditions without artificial features placed on the drogues. By employing deep learning ideas and graphics processing units (GPUs, a model for drogue detection using a Caffe deep learning framework with CNNs was designed to ensure the method’s accuracy and real-time performance. Experiments were conducted to demonstrate the effectiveness of the proposed method, and results based on real AAR data compare its performance to other methods, validating the accuracy, speed, and robustness of its drogue detection ability.
Zhukovskiy, Yu L.; Korolev, N. A.; Babanova, I. S.; Boikov, A. V.
2017-10-01
This article is devoted to the prediction of the residual life based on an estimate of the technical state of the induction motor. The proposed system allows to increase the accuracy and completeness of diagnostics by using an artificial neural network (ANN), and also identify and predict faulty states of an electrical equipment in dynamics. The results of the proposed system for estimation the technical condition are probability technical state diagrams and a quantitative evaluation of the residual life, taking into account electrical, vibrational, indirect parameters and detected defects. Based on the evaluation of the technical condition and the prediction of the residual life, a decision is made to change the control of the operating and maintenance modes of the electric motors.
Image segmentation based on random neural network model and Gabor filters.
Lu, Rong; Shen, Yi
2005-01-01
Image segmentation is a fundamental image process technique and plays an essential role in ultrasound image analysis. In this article, we propose an algorithm for image segmentation which is based on the random neural network (RNN) and features extracted by a bank of Gabor filters. With the scientists' work, it is revealed that Gabor functions act as some functions of human vision. And the RNN model proposed by Gelenbe is closer to biophysical reality and mathematically more tractable, in which signals in the form of impulses are transmitted with a certain probability. The segmentation algorithm based on these two techniques provide a good distinguish and classification capability for textures in the image. Furthermore, a strategy which is named as quartered segmentation strategy is also presented here in order to reduce the computation and speed up our approach. The presented algorithm is tested on an image produced by using Brodatz album and an ultrasound image, and the results are promising.
A Method for Recognizing Fatigue Driving Based on Dempster-Shafer Theory and Fuzzy Neural Network
Directory of Open Access Journals (Sweden)
WenBo Zhu
2017-01-01
Full Text Available This study proposes a method based on Dempster-Shafer theory (DST and fuzzy neural network (FNN to improve the reliability of recognizing fatigue driving. This method measures driving states using multifeature fusion. First, FNN is introduced to obtain the basic probability assignment (BPA of each piece of evidence given the lack of a general solution to the definition of BPA function. Second, a modified algorithm that revises conflict evidence is proposed to reduce unreasonable fusion results when unreliable information exists. Finally, the recognition result is given according to the combination of revised evidence based on Dempster’s rule. Experiment results demonstrate that the recognition method proposed in this paper can obtain reasonable results with the combination of information given by multiple features. The proposed method can also effectively and accurately describe driving states.
Luo, Junhui; Wu, Chao; Liu, Xianlin; Mi, Decai; Zeng, Fuquan; Zeng, Yongjun
2018-01-01
At present, the prediction of soft foundation settlement mostly use the exponential curve and hyperbola deferred approximation method, and the correlation between the results is poor. However, the application of neural network in this area has some limitations, and none of the models used in the existing cases adopted the TS fuzzy neural network of which calculation combines the characteristics of fuzzy system and neural network to realize the mutual compatibility methods. At the same time, the developed and optimized calculation program is convenient for engineering designers. Taking the prediction and analysis of soft foundation settlement of gully soft soil in granite area of Guangxi Guihe road as an example, the fuzzy neural network model is established and verified to explore the applicability. The TS fuzzy neural network is used to construct the prediction model of settlement and deformation, and the corresponding time response function is established to calculate and analyze the settlement of soft foundation. The results show that the prediction of short-term settlement of the model is accurate and the final settlement prediction result has certain engineering reference value.
International Nuclear Information System (INIS)
Liu Yongkuo; Xia Hong; Xie Chunli; Chen Zhihui; Chen Hongxia
2007-01-01
Rough set theory and fuzzy neural network are combined, to take full advantages of the two of them. Based on the reduction technology to knowledge of Rough set method, and by drawing the simple rule from a large number of initial data, the fuzzy neural network was set up, which was with better topological structure, improved study speed, accurate judgment, strong fault-tolerant ability, and more practical. In order to test the validity of the method, the inverted U-tubes break accident of Steam Generator and etc are used as examples, and many simulation experiments are performed. The test result shows that it is feasible to incorporate the fault intelligence diagnosis method based on rough set and fuzzy neural network in the nuclear power plant equipment, and the method is simple and convenience, with small calculation amount and reliable result. (authors)
Barzegar, Rahim; Fijani, Elham; Asghari Moghaddam, Asghar; Tziritis, Evangelos
2017-12-01
Accurate prediction of groundwater level (GWL) fluctuations can play an important role in water resources management. The aims of the research are to evaluate the performance of different hybrid wavelet-group method of data handling (WA-GMDH) and wavelet-extreme learning machine (WA-ELM) models and to combine different wavelet based models for forecasting the GWL for one, two and three months step-ahead in the Maragheh-Bonab plain, NW Iran, as a case study. The research used totally 367 monthly GWLs (m) datasets (Sep 1985-Mar 2016) which were split into two subsets; the first 312 datasets (85% of total) were used for model development (training) and the remaining 55 ones (15% of total) for model evaluation (testing). The stepwise selection was used to select appropriate lag times as the inputs of the proposed models. The performance criteria such as coefficient of determination (R 2 ), root mean square error (RMSE) and Nash-Sutcliffe efficiency coefficient (NSC) were used for assessing the efficiency of the models. The results indicated that the ELM models outperformed GMDH models. To construct the hybrid wavelet based models, the inputs and outputs were decomposed into sub-time series employing different maximal overlap discrete wavelet transform (MODWT) functions, namely Daubechies, Symlet, Haar and Dmeyer of different orders at level two. Subsequently, these sub-time series were served in the GMDH and ELM models as an input dataset to forecast the multi-step-ahead GWL. The wavelet based models improved the performances of GMDH and ELM models for multi-step-ahead GWL forecasting. To combine the advantages of different wavelets, a least squares boosting (LSBoost) algorithm was applied. The use of the boosting multi-WA-neural network models provided the best performances for GWL forecasts in comparison with single WA-neural network-based models. Copyright © 2017 Elsevier B.V. All rights reserved.
Matsubara, Takashi; Torikai, Hiroyuki
2016-04-01
Modeling and implementation approaches for the reproduction of input-output relationships in biological nervous tissues contribute to the development of engineering and clinical applications. However, because of high nonlinearity, the traditional modeling and implementation approaches encounter difficulties in terms of generalization ability (i.e., performance when reproducing an unknown data set) and computational resources (i.e., computation time and circuit elements). To overcome these difficulties, asynchronous cellular automaton-based neuron (ACAN) models, which are described as special kinds of cellular automata that can be implemented as small asynchronous sequential logic circuits have been proposed. This paper presents a novel type of such ACAN and a theoretical analysis of its excitability. This paper also presents a novel network of such neurons, which can mimic input-output relationships of biological and nonlinear ordinary differential equation model neural networks. Numerical analyses confirm that the presented network has a higher generalization ability than other major modeling and implementation approaches. In addition, Field-Programmable Gate Array-implementations confirm that the presented network requires lower computational resources.
Chen, Jiajia; Zhao, Pan; Liang, Huawei; Mei, Tao
2014-09-18
The autonomous vehicle is an automated system equipped with features like environment perception, decision-making, motion planning, and control and execution technology. Navigating in an unstructured and complex environment is a huge challenge for autonomous vehicles, due to the irregular shape of road, the requirement of real-time planning, and the nonholonomic constraints of vehicle. This paper presents a motion planning method, based on the Radial Basis Function (RBF) neural network, to guide the autonomous vehicle in unstructured environments. The proposed algorithm extracts the drivable region from the perception grid map based on the global path, which is available in the road network. The sample points are randomly selected in the drivable region, and a gradient descent method is used to train the RBF network. The parameters of the motion-planning algorithm are verified through the simulation and experiment. It is observed that the proposed approach produces a flexible, smooth, and safe path that can fit any road shape. The method is implemented on autonomous vehicle and verified against many outdoor scenes; furthermore, a comparison of proposed method with the existing well-known Rapidly-exploring Random Tree (RRT) method is presented. The experimental results show that the proposed method is highly effective in planning the vehicle path and offers better motion quality.
Acceleration of spiking neural network based pattern recognition on NVIDIA graphics processors.
Han, Bing; Taha, Tarek M
2010-04-01
There is currently a strong push in the research community to develop biological scale implementations of neuron based vision models. Systems at this scale are computationally demanding and generally utilize more accurate neuron models, such as the Izhikevich and the Hodgkin-Huxley models, in favor of the more popular integrate and fire model. We examine the feasibility of using graphics processing units (GPUs) to accelerate a spiking neural network based character recognition network to enable such large scale systems. Two versions of the network utilizing the Izhikevich and Hodgkin-Huxley models are implemented. Three NVIDIA general-purpose (GP) GPU platforms are examined, including the GeForce 9800 GX2, the Tesla C1060, and the Tesla S1070. Our results show that the GPGPUs can provide significant speedup over conventional processors. In particular, the fastest GPGPU utilized, the Tesla S1070, provided a speedup of 5.6 and 84.4 over highly optimized implementations on the fastest central processing unit (CPU) tested, a quadcore 2.67 GHz Xeon processor, for the Izhikevich and the Hodgkin-Huxley models, respectively. The CPU implementation utilized all four cores and the vector data parallelism offered by the processor. The results indicate that GPUs are well suited for this application domain.
Kang, Tianyu; Ding, Wei; Zhang, Luoyan; Ziemek, Daniel; Zarringhalam, Kourosh
2017-12-19
Stratification of patient subpopulations that respond favorably to treatment or experience and adverse reaction is an essential step toward development of new personalized therapies and diagnostics. It is currently feasible to generate omic-scale biological measurements for all patients in a study, providing an opportunity for machine learning models to identify molecular markers for disease diagnosis and progression. However, the high variability of genetic background in human populations hampers the reproducibility of omic-scale markers. In this paper, we develop a biological network-based regularized artificial neural network model for prediction of phenotype from transcriptomic measurements in clinical trials. To improve model sparsity and the overall reproducibility of the model, we incorporate regularization for simultaneous shrinkage of gene sets based on active upstream regulatory mechanisms into the model. We benchmark our method against various regression, support vector machines and artificial neural network models and demonstrate the ability of our method in predicting the clinical outcomes using clinical trial data on acute rejection in kidney transplantation and response to Infliximab in ulcerative colitis. We show that integration of prior biological knowledge into the classification as developed in this paper, significantly improves the robustness and generalizability of predictions to independent datasets. We provide a Java code of our algorithm along with a parsed version of the STRING DB database. In summary, we present a method for prediction of clinical phenotypes using baseline genome-wide expression data that makes use of prior biological knowledge on gene-regulatory interactions in order to increase robustness and reproducibility of omic-scale markers. The integrated group-wise regularization methods increases the interpretability of biological signatures and gives stable performance estimates across independent test sets.
Shoaib, Muhammad; Shamseldin, Asaad Y.; Melville, Bruce W.; Khan, Mudasser Muneer
2016-04-01
In order to predict runoff accurately from a rainfall event, the multilayer perceptron type of neural network models are commonly used in hydrology. Furthermore, the wavelet coupled multilayer perceptron neural network (MLPNN) models has also been found superior relative to the simple neural network models which are not coupled with wavelet. However, the MLPNN models are considered as static and memory less networks and lack the ability to examine the temporal dimension of data. Recurrent neural network models, on the other hand, have the ability to learn from the preceding conditions of the system and hence considered as dynamic models. This study for the first time explores the potential of wavelet coupled time lagged recurrent neural network (TLRNN) models for runoff prediction using rainfall data. The Discrete Wavelet Transformation (DWT) is employed in this study to decompose the input rainfall data using six of the most commonly used wavelet functions. The performance of the simple and the wavelet coupled static MLPNN models is compared with their counterpart dynamic TLRNN models. The study found that the dynamic wavelet coupled TLRNN models can be considered as alternative to the static wavelet MLPNN models. The study also investigated the effect of memory depth on the performance of static and dynamic neural network models. The memory depth refers to how much past information (lagged data) is required as it is not known a priori. The db8 wavelet function is found to yield the best results with the static MLPNN models and with the TLRNN models having small memory depths. The performance of the wavelet coupled TLRNN models with large memory depths is found insensitive to the selection of the wavelet function as all wavelet functions have similar performance.
An intelligent switch with back-propagation neural network based hybrid power system
Perdana, R. H. Y.; Fibriana, F.
2018-03-01
The consumption of conventional energy such as fossil fuels plays the critical role in the global warming issues. The carbon dioxide, methane, nitrous oxide, etc. could lead the greenhouse effects and change the climate pattern. In fact, 77% of the electrical energy is generated from fossil fuels combustion. Therefore, it is necessary to use the renewable energy sources for reducing the conventional energy consumption regarding electricity generation. This paper presents an intelligent switch to combine both energy resources, i.e., the solar panels as the renewable energy with the conventional energy from the State Electricity Enterprise (PLN). The artificial intelligence technology with the back-propagation neural network was designed to control the flow of energy that is distributed dynamically based on renewable energy generation. By the continuous monitoring on each load and source, the dynamic pattern of the intelligent switch was better than the conventional switching method. The first experimental results for 60 W solar panels showed the standard deviation of the trial at 0.7 and standard deviation of the experiment at 0.28. The second operation for a 900 W of solar panel obtained the standard deviation of the trial at 0.05 and 0.18 for the standard deviation of the experiment. Moreover, the accuracy reached 83% using this method. By the combination of the back-propagation neural network with the observation of energy usage of the load using wireless sensor network, each load can be evenly distributed and will impact on the reduction of conventional energy usage.
Ni, Jianjun; Wu, Liuying; Shi, Pengfei; Yang, Simon X
2017-01-01
Real-time path planning for autonomous underwater vehicle (AUV) is a very difficult and challenging task. Bioinspired neural network (BINN) has been used to deal with this problem for its many distinct advantages: that is, no learning process is needed and realization is also easy. However, there are some shortcomings when BINN is applied to AUV path planning in a three-dimensional (3D) unknown environment, including complex computing problem when the environment is very large and repeated path problem when the size of obstacles is bigger than the detection range of sensors. To deal with these problems, an improved dynamic BINN is proposed in this paper. In this proposed method, the AUV is regarded as the core of the BINN and the size of the BINN is based on the detection range of sensors. Then the BINN will move with the AUV and the computing could be reduced. A virtual target is proposed in the path planning method to ensure that the AUV can move to the real target effectively and avoid big-size obstacles automatically. Furthermore, a target attractor concept is introduced to improve the computing efficiency of neural activities. Finally, some experiments are conducted under various 3D underwater environments. The experimental results show that the proposed BINN based method can deal with the real-time path planning problem for AUV efficiently.
2017-01-01
Real-time path planning for autonomous underwater vehicle (AUV) is a very difficult and challenging task. Bioinspired neural network (BINN) has been used to deal with this problem for its many distinct advantages: that is, no learning process is needed and realization is also easy. However, there are some shortcomings when BINN is applied to AUV path planning in a three-dimensional (3D) unknown environment, including complex computing problem when the environment is very large and repeated path problem when the size of obstacles is bigger than the detection range of sensors. To deal with these problems, an improved dynamic BINN is proposed in this paper. In this proposed method, the AUV is regarded as the core of the BINN and the size of the BINN is based on the detection range of sensors. Then the BINN will move with the AUV and the computing could be reduced. A virtual target is proposed in the path planning method to ensure that the AUV can move to the real target effectively and avoid big-size obstacles automatically. Furthermore, a target attractor concept is introduced to improve the computing efficiency of neural activities. Finally, some experiments are conducted under various 3D underwater environments. The experimental results show that the proposed BINN based method can deal with the real-time path planning problem for AUV efficiently. PMID:28255297
An Inventory Controlled Supply Chain Model Based on Improved BP Neural Network
Directory of Open Access Journals (Sweden)
Wei He
2013-01-01
Full Text Available Inventory control is a key factor for reducing supply chain cost and increasing customer satisfaction. However, prediction of inventory level is a challenging task for managers. As one of the widely used techniques for inventory control, standard BP neural network has such problems as low convergence rate and poor prediction accuracy. Aiming at these problems, a new fast convergent BP neural network model for predicting inventory level is developed in this paper. By adding an error offset, this paper deduces the new chain propagation rule and the new weight formula. This paper also applies the improved BP neural network model to predict the inventory level of an automotive parts company. The results show that the improved algorithm not only significantly exceeds the standard algorithm but also outperforms some other improved BP algorithms both on convergence rate and prediction accuracy.
Smart-phone based electrocardiogram wavelet decomposition and neural network classification
International Nuclear Information System (INIS)
Jannah, N; Hadjiloucas, S; Hwang, F; Galvão, R K H
2013-01-01
This paper discusses ECG classification after parametrizing the ECG waveforms in the wavelet domain. The aim of the work is to develop an accurate classification algorithm that can be used to diagnose cardiac beat abnormalities detected using a mobile platform such as smart-phones. Continuous time recurrent neural network classifiers are considered for this task. Records from the European ST-T Database are decomposed in the wavelet domain using discrete wavelet transform (DWT) filter banks and the resulting DWT coefficients are filtered and used as inputs for training the neural network classifier. Advantages of the proposed methodology are the reduced memory requirement for the signals which is of relevance to mobile applications as well as an improvement in the ability of the neural network in its generalization ability due to the more parsimonious representation of the signal to its inputs.
Multi-step-prediction of chaotic time series based on co-evolutionary recurrent neural network
International Nuclear Information System (INIS)
Ma Qianli; Zheng Qilun; Peng Hong; Qin Jiangwei; Zhong Tanwei
2008-01-01
This paper proposes a co-evolutionary recurrent neural network (CERNN) for the multi-step-prediction of chaotic time series, it estimates the proper parameters of phase space reconstruction and optimizes the structure of recurrent neural networks by co-evolutionary strategy. The searching space was separated into two subspaces and the individuals are trained in a parallel computational procedure. It can dynamically combine the embedding method with the capability of recurrent neural network to incorporate past experience due to internal recurrence. The effectiveness of CERNN is evaluated by using three benchmark chaotic time series data sets: the Lorenz series, Mackey-Glass series and real-world sun spot series. The simulation results show that CERNN improves the performances of multi-step-prediction of chaotic time series
Development of Artificial Neural-Network-Based Models for the Simulation of Spring Discharge
Directory of Open Access Journals (Sweden)
M. Mohan Raju
2011-01-01
Full Text Available The present study demonstrates the application of artificial neural networks (ANNs in predicting the weekly spring discharge. The study was based on the weekly spring discharge from a spring located near Ranichauri in Tehri Garhwal district of Uttarakhand, India. Five models were developed for predicting the spring discharge based on a weekly interval using rainfall, evaporation, temperature with a specified lag time. All models were developed both with one and two hidden layers. Each model was developed with many trials by selecting different network architectures and different number of hidden neurons; finally a best predicting model presented against each developed model. The models were trained with three different algorithms, that is, quick-propagation algorithm, batch backpropagation algorithm, and Levenberg-Marquardt algorithm using weekly data from 1999 to 2005. A best model for the simulation was selected from the three presented algorithms using the statistical criteria such as correlation coefficient (, determination coefficient, or Nash Sutcliff's efficiency (DC. Finally, optimized number of neurons were considered for the best model. Training and testing results revealed that the models were predicting the weekly spring discharge satisfactorily. Based on these criteria, ANN-based model results in better agreement for the computation of spring discharge. LMR models were also developed in the study, and they also gave good results, but, when compared with the ANN methodology, ANN resulted in better optimized values.
Directory of Open Access Journals (Sweden)
M. S. Müller
2017-08-01
Full Text Available The number of unmanned aerial vehicles (UAVs is increasing since low-cost airborne systems are available for a wide range of users. The outdoor navigation of such vehicles is mostly based on global navigation satellite system (GNSS methods to gain the vehicles trajectory. The drawback of satellite-based navigation are failures caused by occlusions and multi-path interferences. Beside this, local image-based solutions like Simultaneous Localization and Mapping (SLAM and Visual Odometry (VO can e.g. be used to support the GNSS solution by closing trajectory gaps but are computationally expensive. However, if the trajectory estimation is interrupted or not available a re-localization is mandatory. In this paper we will provide a novel method for a GNSS-free and fast image-based pose regression in a known area by utilizing a small convolutional neural network (CNN. With on-board processing in mind, we employ a lightweight CNN called SqueezeNet and use transfer learning to adapt the network to pose regression. Our experiments show promising results for GNSS-free and fast localization.