Additive Feed Forward Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1999-01-01
This paper demonstrates a method to control a non-linear, multivariable, noisy process using trained neural networks. The basis for the method is a trained neural network controller acting as the inverse process model. A training method for obtaining such an inverse process model is applied....... A suitable 'shaped' (low-pass filtered) reference is used to overcome problems with excessive control action when using a controller acting as the inverse process model. The control concept is Additive Feed Forward Control, where the trained neural network controller, acting as the inverse process model......, is placed in a supplementary pure feed-forward path to an existing feedback controller. This concept benefits from the fact, that an existing, traditional designed, feedback controller can be retained without any modifications, and after training the connection of the neural network feed-forward controller...
Additive Feed Forward Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1999-01-01
This paper demonstrates a method to control a non-linear, multivariable, noisy process using trained neural networks. The basis for the method is a trained neural network controller acting as the inverse process model. A training method for obtaining such an inverse process model is applied....... A suitable 'shaped' (low-pass filtered) reference is used to overcome problems with excessive control action when using a controller acting as the inverse process model. The control concept is Additive Feed Forward Control, where the trained neural network controller, acting as the inverse process model......, is placed in a supplementary pure feed-forward path to an existing feedback controller. This concept benefits from the fact, that an existing, traditional designed, feedback controller can be retained without any modifications, and after training the connection of the neural network feed-forward controller...
Patterns of synchrony for feed-forward and auto-regulation feed-forward neural networks.
Aguiar, Manuela A D; Dias, Ana Paula S; Ferreira, Flora
2017-01-01
We consider feed-forward and auto-regulation feed-forward neural (weighted) coupled cell networks. In feed-forward neural networks, cells are arranged in layers such that the cells of the first layer have empty input set and cells of each other layer receive only inputs from cells of the previous layer. An auto-regulation feed-forward neural coupled cell network is a feed-forward neural network where additionally some cells of the first layer have auto-regulation, that is, they have a self-loop. Given a network structure, a robust pattern of synchrony is a space defined in terms of equalities of cell coordinates that is flow-invariant for any coupled cell system (with additive input structure) associated with the network. In this paper, we describe the robust patterns of synchrony for feed-forward and auto-regulation feed-forward neural networks. Regarding feed-forward neural networks, we show that only cells in the same layer can synchronize. On the other hand, in the presence of auto-regulation, we prove that cells in different layers can synchronize in a robust way and we give a characterization of the possible patterns of synchrony that can occur for auto-regulation feed-forward neural networks.
A new C++ implemented feed forward neural network simulator
Directory of Open Access Journals (Sweden)
J. Sütő
2013-12-01
Full Text Available This paper presents the implementation of a simulator application for feed forward neural networks which was made in Qt application framework. The paper demonstrates the object oriented design and the performance of the software. The main topics cover the class organization and some test results where the Matlab neural network toolbox was used as reference.
PSO optimized Feed Forward Neural Network for offline Signature Classification
Directory of Open Access Journals (Sweden)
Pratik R. Hajare
2015-07-01
Full Text Available The paper is based on feed forward neural network (FFNN optimization by particle swarm intelligence (PSI used to provide initial weights and biases to train neural network. Once the weights and biases are found using Particle swarm optimization (PSO with neural network used as training algorithm for specified epoch, the same are used to train the neural network for training and classification of benchmark problems. Further the approach is tested for offline signature classifications. A comparison is made between normal FFNN with random weights and biases and FFNN with particle swarm optimized weights and biases. Firstly, the performance is tested on two benchmark databases for neural network, The Breast Cancer Database and the Diabetic Database. Result shows that neural network performs better with initial weights and biases obtained by Particle Swarm optimization. The network converges faster with PSO obtained initial weights and biases for FFNN and classification accuracy is increased.
Review of feed forward neural network classification preprocessing techniques
Asadi, Roya; Kareem, Sameem Abdul
2014-06-01
The best feature of artificial intelligent Feed Forward Neural Network (FFNN) classification models is learning of input data through their weights. Data preprocessing and pre-training are the contributing factors in developing efficient techniques for low training time and high accuracy of classification. In this study, we investigate and review the powerful preprocessing functions of the FFNN models. Currently initialization of the weights is at random which is the main source of problems. Multilayer auto-encoder networks as the latest technique like other related techniques is unable to solve the problems. Weight Linear Analysis (WLA) is a combination of data pre-processing and pre-training to generate real weights through the use of normalized input values. The FFNN model by using the WLA increases classification accuracy and improve training time in a single epoch without any training cycle, the gradient of the mean square error function, updating the weights. The results of comparison and evaluation show that the WLA is a powerful technique in the FFNN classification area yet.
Feed-forward neural network model for hunger and satiety related VAS score prediction
Krishnan, S.; Hendriks, H.F.J.; Hartvigsen, M.L.; Graaf, A.A. de
2016-01-01
Background: An artificial neural network approach was chosen to model the outcome of the complex signaling pathways in the gastro-intestinal tract and other peripheral organs that eventually produce the satiety feeling in the brain upon feeding. Methods: A multilayer feed-forward neural network was
Feed-forward neural network model for hunger and satiety related VAS score prediction
Krishnan, S.; Hendriks, H.F.J.; Hartvigsen, M.L.; Graaf, A.A. de
2016-01-01
Background: An artificial neural network approach was chosen to model the outcome of the complex signaling pathways in the gastro-intestinal tract and other peripheral organs that eventually produce the satiety feeling in the brain upon feeding. Methods: A multilayer feed-forward neural network was
Using Hybrid Algorithm to Improve Intrusion Detection in Multi Layer Feed Forward Neural Networks
Ray, Loye Lynn
2014-01-01
The need for detecting malicious behavior on a computer networks continued to be important to maintaining a safe and secure environment. The purpose of this study was to determine the relationship of multilayer feed forward neural network architecture to the ability of detecting abnormal behavior in networks. This involved building, training, and…
Using Hybrid Algorithm to Improve Intrusion Detection in Multi Layer Feed Forward Neural Networks
Ray, Loye Lynn
2014-01-01
The need for detecting malicious behavior on a computer networks continued to be important to maintaining a safe and secure environment. The purpose of this study was to determine the relationship of multilayer feed forward neural network architecture to the ability of detecting abnormal behavior in networks. This involved building, training, and…
Feed-forward neural network model for hunger and satiety related VAS score prediction
Krishnan, S.; Hendriks, H. F. J.; Hartvigsen, M.L.; Graaf, A.A. de
2016-01-01
Background: An artificial neural network approach was chosen to model the outcome of the complex signaling pathways in the gastro-intestinal tract and other peripheral organs that eventually produce the satiety feeling in the brain upon feeding. Methods: A multilayer feed-forward neural network was trained with sets of experimental data relating concentration-time courses of plasma satiety hormones to Visual Analog Scales (VAS) scores. The network successfully predicted VAS responses from set...
Instantaneous Gradient Based Dual Mode Feed-Forward Neural Network Blind Equalization Algorithm
Directory of Open Access Journals (Sweden)
Ying Xiao
2013-01-01
Full Text Available To further improve the performance of feed-forward neural network blind equalization based on Constant Modulus Algorithm (CMA cost function, an instantaneous gradient based dual mode between Modified Constant Modulus Algorithm (MCMA and Decision Directed (DD algorithm was proposed. The neural network weights change quantity of the adjacent iterative process is defined as instantaneous gradient. After the network converges, the weights of neural network to achieve a stable energy state and the instantaneous gradient would be zero. Therefore dual mode algorithm can be realized by criterion which set according to the instantaneous gradient. Computer simulation results show that the dual mode feed-forward neural network blind equalization algorithm proposed in this study improves the convergence rate and convergence precision effectively, at the same time, has good restart and tracking ability under channel burst interference condition.
Single-hidden-layer feed-forward quantum neural network based on Grover learning.
Liu, Cheng-Yi; Chen, Chein; Chang, Ching-Ter; Shih, Lun-Min
2013-09-01
In this paper, a novel single-hidden-layer feed-forward quantum neural network model is proposed based on some concepts and principles in the quantum theory. By combining the quantum mechanism with the feed-forward neural network, we defined quantum hidden neurons and connected quantum weights, and used them as the fundamental information processing unit in a single-hidden-layer feed-forward neural network. The quantum neurons make a wide range of nonlinear functions serve as the activation functions in the hidden layer of the network, and the Grover searching algorithm outstands the optimal parameter setting iteratively and thus makes very efficient neural network learning possible. The quantum neuron and weights, along with a Grover searching algorithm based learning, result in a novel and efficient neural network characteristic of reduced network, high efficient training and prospect application in future. Some simulations are taken to investigate the performance of the proposed quantum network and the result show that it can achieve accurate learning.
Directory of Open Access Journals (Sweden)
Jingzhou Fei
2016-01-01
Full Text Available In this article, a novel artificial neural network integrating feed-forward back-propagation neural network with Gaussian kernel function is proposed for the prediction of compressor performance map. To demonstrate the potential capability of the proposed approach for the typical interpolated and extrapolated predictions, other two classical data-driven modeling methods including feed-forward back-propagation neural network and support vector machine are compared. An assessment is performed and discussed on the sensitivity of different models to the number of training samples (48 training samples, 32 training samples, and 18 training samples. All the results indicate that the proposed neural network in this article has superior prediction performance to the existing feed-forward back-propagation neural network and support vector machine, especially for the extrapolation with small samples. Furthermore, this study can be utilized in refining the existing performance-based modeling for improved simulation analysis, condition monitoring, and fault diagnosis of gas turbine compressor.
Feed Forward Neural Network and Optimal Control Problem with Control and State Constraints
Kmet', Tibor; Kmet'ová, Mária
2009-09-01
A feed forward neural network based optimal control synthesis is presented for solving optimal control problems with control and state constraints. The paper extends adaptive critic neural network architecture proposed by [5] to the optimal control problems with control and state constraints. The optimal control problem is transcribed into a nonlinear programming problem which is implemented with adaptive critic neural network. The proposed simulation method is illustrated by the optimal control problem of nitrogen transformation cycle model. Results show that adaptive critic based systematic approach holds promise for obtaining the optimal control with control and state constraints.
Selection of hadronic W-decays in DELPHI with feed forward neural networks - An update
Becks, K H; Müller, U; Wahlen, H
2003-01-01
Since 1998 feed forward neural networks have been successfully applied to select candidates of hadronic W-decays measured at different center of mass-energies by the DELPHI collaboration at the Large Electron Positron collider at CERN. To prepare the final publication, the neural network was adapted to all center of mass- energies. Detailed studies were performed concerning the level of preselection, the choice of network parameters and especially of the network architecture. The number of hidden nodes was optimized by testing different pruning methods. All studies and results will be discussed.
Institute of Scientific and Technical Information of China (English)
FANG Jun-long; ZHANG Chang-li; WANG Shu-wen
2004-01-01
We set up computer vision system for tomato images. By using this system, the RGB value of tomato image was converted into HIS value whose H was used to acquire the color character of the surface of tomato. To use multilayer feed forward neural network with GA can finish automatic identification of tomato maturation. The results of experiment showed that the accuracy was upto 94%.
Automatic identification of terpenoid skeletons by feed-forward neural networks
Energy Technology Data Exchange (ETDEWEB)
Emerenciano, Vicente P. [Instituto de Quimica, Universidade de Sao Paulo, Caixa Postal 26077, 05513-970 Sao Paulo, SP (Brazil)]. E-mail: vdpemere@iq.usp.br; Alvarenga, Sandra A.V. [Faculdade de Engenharia de Guaratingueta, UNESP, CEP 12516-410, Guaratingueta, Sao Paulo (Brazil); Scotti, Marcus Tullius [Instituto de Quimica, Universidade de Sao Paulo, Caixa Postal 26077, 05513-970 Sao Paulo, SP (Brazil); Ferreira, Marcelo J.P. [Instituto de Quimica, Universidade de Sao Paulo, Caixa Postal 26077, 05513-970 Sao Paulo, SP (Brazil); Stefani, Ricardo [Departamento de Quimica, FFCLRP, USP, Av. Bandeirantes 3900, CEP 14040-905, Ribeirao Preto, Sao Paulo (Brazil); Nuzillard, Jean-Marc [FRE 2715, University of Reims, Moulin de la Housse, BP 1039, 51687 REIMS Cedex 2 (France)
2006-10-10
Feed-forward neural networks (FFNNs) were used to predict the skeletal type of molecules belonging to six classes of terpenoids. A database that contains the {sup 13}C NMR spectra of about 5000 compounds was used to train the FFNNs. An efficient representation of the spectra was designed and the constitution of the best FFNN input vector format resorted from an heuristic approach. The latter was derived from general considerations on terpenoid structures.
Institute of Scientific and Technical Information of China (English)
CHAI Yu-hua; PAN Wei; NING Hai-long
2005-01-01
In the paper, a method of building mathematic model employing genetic multilayer feed forward neural network is presented, and the quantitative relationship of chemical measured values and near-infrared spectral data is established. In the paper, quantitative mathematic model related chemical assayed values and near-infrared spectral data is established by means of genetic multilayer feed forward neural network, acquired near-infrared spectral data are taken as input of network with the content of five kinds of fat acids tested from chemical method as output,weight values of multilayer feed forward neural network are trained by genetic algorithms and detection model of neural network of soybean is built. A kind of multilayer feed forward neural network trained by genetic algorithms is designed in the paper. Through experiments, all the related coefficients of five fat acids can approach 0.9 which satisfies the preliminary test of soybean breeding.
Improving the character recognition efficiency of feed forward BP neural network
Choudhary, Amit
2011-01-01
This work is focused on improving the character recognition capability of feed-forward back-propagation neural network by using one, two and three hidden layers and the modified additional momentum term. 182 English letters were collected for this work and the equivalent binary matrix form of these characters was applied to the neural network as training patterns. While the network was getting trained, the connection weights were modified at each epoch of learning. For each training sample, the error surface was examined for minima by computing the gradient descent. We started the experiment by using one hidden layer and the number of hidden layers was increased up to three and it has been observed that accuracy of the network was increased with low mean square error but at the cost of training time. The recognition accuracy was improved further when modified additional momentum term was used.
Single-Iteration Learning Algorithm for Feed-Forward Neural Networks
Energy Technology Data Exchange (ETDEWEB)
Barhen, J.; Cogswell, R.; Protopopescu, V.
1999-07-31
A new methodology for neural learning is presented, whereby only a single iteration is required to train a feed-forward network with near-optimal results. To this aim, a virtual input layer is added to the multi-layer architecture. The virtual input layer is connected to the nominal input layer by a specird nonlinear transfer function, and to the fwst hidden layer by regular (linear) synapses. A sequence of alternating direction singular vrdue decompositions is then used to determine precisely the inter-layer synaptic weights. This algorithm exploits the known separability of the linear (inter-layer propagation) and nonlinear (neuron activation) aspects of information &ansfer within a neural network.
An Adaptive Recursive Least Square Algorithm for Feed Forward Neural Network and Its Application
Qing, Xi-Hong; Xu, Jun-Yi; Guo, Fen-Hong; Feng, Ai-Mu; Nin, Wei; Tao, Hua-Xue
In high dimension data fitting, it is difficult task to insert new training samples and remove old-fashioned samples for feed forward neural network (FFNN). This paper, therefore, studies dynamical learning algorithms with adaptive recursive regression (AR) and presents an advanced adaptive recursive (AAR) least square algorithm. This algorithm can efficiently handle new samples inserting and old samples removing. This AAR algorithm is applied to train FFNN and makes FFNN be capable of simultaneously implementing three processes of new samples dynamical learning, old-fashioned samples removing and neural network (NN) synchronization computing. It efficiently solves the problem of dynamically training of FFNN. This FFNN algorithm is carried out to compute residual oil distribution.
3D Polygon Mesh Compression with Multi Layer Feed Forward Neural Networks
Directory of Open Access Journals (Sweden)
Emmanouil Piperakis
2003-06-01
Full Text Available In this paper, an experiment is conducted which proves that multi layer feed forward neural networks are capable of compressing 3D polygon meshes. Our compression method not only preserves the initial accuracy of the represented object but also enhances it. The neural network employed includes the vertex coordinates, the connectivity and normal information in one compact form, converting the discrete and surface polygon representation into an analytic, solid colloquial. Furthermore, the 3D object in its compressed neural form can be directly - without decompression - used for rendering. The neural compression - representation is viable to 3D transformations without the need of any anti-aliasing techniques - transformations do not disrupt the accuracy of the geometry. Our method does not su.er any scaling problem and was tested with objects of 300 to 107 polygons - such as the David of Michelangelo - achieving in all cases an order of O(b3 less bits for the representation than any other commonly known compression method. The simplicity of our algorithm and the established mathematical background of neural networks combined with their aptness for hardware implementation can establish this method as a good solution for polygon compression and if further investigated, a novel approach for 3D collision, animation and morphing.
Content Based Image Retrieval using Novel Gaussian Fuzzy Feed Forward-Neural Network
Directory of Open Access Journals (Sweden)
C. R.B. Durai
2011-01-01
Full Text Available Problem statement: With extensive digitization of images, diagrams and paintings, traditional keyword based search has been found to be inefficient for retrieval of the required data. Content-Based Image Retrieval (CBIR system responds to image queries as input and relies on image content, using techniques from computer vision and image processing to interpret and understand it, while using techniques from information retrieval and databases to rapidly locate and retrieve images suiting an input query. CBIR finds extensive applications in the field of medicine as it assists a doctor to make better decisions by referring the CBIR system and gain confidence. Approach: Various methods have been proposed for CBIR using image low level image features like histogram, color layout, texture and analysis of the image in the frequency domain. Similarly various classification algorithms like Naïve Bayes classifier, Support Vector Machine, Decision tree induction algorithms and Neural Network based classifiers have been studied extensively. We proposed to extract features from an image using Discrete Cosine Transform, extract relevant features using information gain and Gaussian Fuzzy Feed Forward Neural Network algorithm for classification. Results and Conclusion: We apply our proposed procedure to 180 brain MRI images of which 72 images were used for testing and the remaining for training. The classification accuracy obtained was 95.83% for a three class problem. This research focused on a narrow search, where further investigation is needed to evaluate larger classes.
Forecasting Performance of Random Walk with Drift and Feed Forward Neural Network Models
Directory of Open Access Journals (Sweden)
Augustine D. Pwasong
2015-08-01
Full Text Available In this study, linear and nonlinear methods were used to model forecasting performances on the daily crude oil production data of the Nigerian National Petroleum Corporation (NNPC. The linear model considered here is the random walk with drift, while the nonlinear model is the feed forward neural network model. The results indicate that nonlinear methods have better forecasting performance greater than linear methods based on the mean error square sense. The root mean square error (RMSE and the mean absolute error (MAE were applied to ascertain the assertion that nonlinear methods have better forecasting performance greater than linear methods. Autocorrelation functions emerging from the increment series, that is, log difference series and difference series of the daily crude oil production data of the NNPC indicates significant autocorrelations. As a result of the foregoing assertion we deduced that the daily crude oil production series of the NNPC is not firmly a random walk process. However, the original daily crude oil production series of the NNPC was considered to be a random walk with drift when we are not trying to forecast immediate values. The analysis for this study was simulated using MATLAB software, version 8.03
Feed Forward Neural Network Based Eye Localization and Recognition Using Hough Transform
Directory of Open Access Journals (Sweden)
Shylaja S S, K N Balasubramanya Murthy, S Natarajan Nischith, Muthuraj R, Ajay S
2011-03-01
Full Text Available Eye detection is a pre-requisite stage for many applications such as face recognition, iris recognition, eye tracking, fatigue detection based on eye-blink count and eye-directed instruction control. As the location of the eyes is a dominant feature of the face it can be used as an input to the face recognition engine. In this direction, the paper proposed here localizes eye positions using Hough Transformed (HT coefficients, which are found to be good at extracting geometrical components from any given object. The method proposed here uses circular and elliptical features of eyes in localizing them from a given face. Such geometrical features can be very efficiently extracted using the HT technique. The HT is based on a evidence gathering approach where the evidence is the ones cast in an accumulator array. The purpose of the technique is to find imperfect instances of objects within a certain class of shapes by a voting procedure. Feed forward neural network has been used for classification of eyes and non-eyes as the dimension of the data is large in nature. Experiments have been carried out on standard databases as well as on local DB consisting of gray scale images. The outcome of this technique has yielded very satisfactory results with an accuracy of 98.68%
Directory of Open Access Journals (Sweden)
Hossein Jafari Mansoorian
2017-01-01
Full Text Available Background & Aims of the Study: A feed forward artificial neural network (FFANN was developed to predict the efficiency of total petroleum hydrocarbon (TPH removal from a contaminated soil, using soil washing process with Tween 80. The main objective of this study was to assess the performance of developed FFANN model for the estimation of TPH removal. Materials and Methods: Several independent repressors including pH, shaking speed, surfactant concentration and contact time were used to describe the removal of TPH as a dependent variable in a FFANN model. 85% of data set observations were used for training the model and remaining 15% were used for model testing, approximately. The performance of the model was compared with linear regression and assessed, using Root of Mean Square Error (RMSE as goodness-of-fit measure Results: For the prediction of TPH removal efficiency, a FANN model with a three-hidden-layer structure of 4-3-1 and a learning rate of 0.01 showed the best predictive results. The RMSE and R2 for the training and testing steps of the model were obtained to be 2.596, 0.966, 10.70 and 0.78, respectively. Conclusion: For about 80% of the TPH removal efficiency can be described by the assessed regressors the developed model. Thus, focusing on the optimization of soil washing process regarding to shaking speed, contact time, surfactant concentration and pH can improve the TPH removal performance from polluted soils. The results of this study could be the basis for the application of FANN for the assessment of soil washing process and the control of petroleum hydrocarbon emission into the environments.
Directory of Open Access Journals (Sweden)
Mr. M. Karthik
2014-05-01
Full Text Available Artificial Neural Network (ANN has become a significant modeling tool for predicting the performance of complex systems that provide appropriate mapping between input-output variables without acquiring any empirical relationship due to the intrinsic properties. This paper is focussed towards the modeling of Proton Exchange Membrane (PEM Fuel Cell system using Artificial Neural Networks especially for automotive applications. Three different neural networks such as Static Feed Forward Network (SFFN, Cascaded Feed Forward Network (CFFN & Fully Connected Dynamic Recurrent Network (FCRN are discussed in this paper for modeling the PEM Fuel Cell System. The numerical analysis is carried out between the three Neural Network architectures for predicting the output performance of the PEM Fuel Cell. The performance of the proposed Networks is evaluated using various error criteria such as Mean Square Error, Mean Absolute Percentage Error, Mean Absolute Error, Coefficient of correlation and Iteration Values. The optimum network with high performance indices (low prediction error values and iteration values can be used as an ancillary model in developing the PEM Fuel Cell powered vehicle system. The development of the fuel cell driven vehicle model also incorporates the modeling of DC-DC Power Converter and Vehicle Dynamics. Finally the Performance of the Electric vehicle model is analyzed for two different drive cycle such as M-NEDC & M-UDDS.
Han, Ruixue; Wang, Jiang; Yu, Haitao; Deng, Bin; Wei, Xilei; Qin, Yingmei; Wang, Haixu
2015-04-01
Reliable signal propagation across distributed brain areas is an essential requirement for cognitive function, and it has been investigated extensively in computational studies where feed-forward network (FFN) is taken as a generic model. But it is still unclear how distinct local network states, which are intrinsically generated by synaptic interactions within each layer, would affect the ability of FFN to transmit information. Here we investigate the impact of such network states on propagating transient synchrony (synfire) and firing rate by a combination of numerical simulations and analytical approach. Specifically, local network dynamics is attributed to the competition between excitatory and inhibitory neurons within each layer. Our results show that concomitant with different local network states, the performance of signal propagation differs dramatically. For both synfire propagation and firing rate propagation, there exists an optimal local excitability state, respectively, that optimizes the performance of signal propagation. Furthermore, we find that long-range connections strongly change the dependence of spiking activity propagation on local network state and propose that these two factors work jointly to determine information transmission across distributed networks. Finally, a simple mean field approach that bridges response properties of long-range connectivity and local subnetworks is utilized to reveal the underlying mechanism.
Spike-timing computation properties of a feed-forward neural network model
Directory of Open Access Journals (Sweden)
Drew Benjamin Sinha
2014-01-01
Full Text Available Brain function is characterized by dynamical interactions among networks of neurons. These interactions are mediated by network topology at many scales ranging from microcircuits to brain areas. Understanding how networks operate can be aided by understanding how the transformation of inputs depends upon network connectivity patterns, e.g. serial and parallel pathways. To tractably determine how single synapses or groups of synapses in such pathways shape transformations, we modeled feed-forward networks of 7-22 neurons in which synaptic strength changed according to a spike-timing dependent plasticity rule. We investigated how activity varied when dynamics were perturbed by an activity-dependent electrical stimulation protocol (spike-triggered stimulation; STS in networks of different topologies and background input correlations. STS can successfully reorganize functional brain networks in vivo, but with a variability in effectiveness that may derive partially from the underlying network topology. In a simulated network with a single disynaptic pathway driven by uncorrelated background activity, structured spike-timing relationships between polysynaptically connected neurons were not observed. When background activity was correlated or parallel disynaptic pathways were added, however, robust polysynaptic spike timing relationships were observed, and application of STS yielded predictable changes in synaptic strengths and spike-timing relationships. These observations suggest that precise input-related or topologically induced temporal relationships in network activity are necessary for polysynaptic signal propagation. Such constraints for polysynaptic computation suggest potential roles for higher-order topological structure in network organization, such as maintaining polysynaptic correlation in the face of relatively weak synapses.
Directory of Open Access Journals (Sweden)
P. Pahlavani
2017-09-01
Full Text Available This paper presents an indoor positioning technique based on a multi-layer feed-forward (MLFF artificial neural networks (ANN. Most of the indoor received signal strength (RSS-based WLAN positioning systems use the fingerprinting technique that can be divided into two phases: the offline (calibration phase and the online (estimation phase. In this paper, RSSs were collected for all references points in four directions and two periods of time (Morning and Evening. Hence, RSS readings were sampled at a regular time interval and specific orientation at each reference point. The proposed ANN based model used Levenberg–Marquardt algorithm for learning and fitting the network to the training data. This RSS readings in all references points and the known position of these references points was prepared for training phase of the proposed MLFF neural network. Eventually, the average positioning error for this network using 30% check and validation data was computed approximately 2.20 meter.
Multilayered feed forward neural network based on particle swarm optimizer algorithm
Institute of Scientific and Technical Information of China (English)
无
2005-01-01
BP is a commonly used neural network training method, which has some disadvantages, such as local minima,sensitivity of initial value of weights, total dependence on gradient information. This paper presents some methods to train a neural network, including standard particle swarm optimizer (PSO), guaranteed convergence particle swarm optimizer (GCPSO), an improved PSO algorithm, and GCPSO-BP, an algorithm combined GCPSO with BP. The simulation results demonstrate the effectiveness of the three algorithms for neural network training.
Asal Kzar, Ahmed; Mat Jafri, M. Z.; Hwee San, Lim; Al-Zuky, Ali A.; Mutter, Kussay N.; Hassan Al-Saleh, Anwar
2016-06-01
There are many techniques that have been given for water quality problem, but the remote sensing techniques have proven their success, especially when the artificial neural networks are used as mathematical models with these techniques. Hopfield neural network is one type of artificial neural networks which is common, fast, simple, and efficient, but it when it deals with images that have more than two colours such as remote sensing images. This work has attempted to solve this problem via modifying the network that deals with colour remote sensing images for water quality mapping. A Feed-forward Hopfield Neural Network Algorithm (FHNNA) was modified and used with a satellite colour image from type of Thailand earth observation system (THEOS) for TSS mapping in the Penang strait, Malaysia, through the classification of TSS concentrations. The new algorithm is based essentially on three modifications: using HNN as feed-forward network, considering the weights of bitplanes, and non-self-architecture or zero diagonal of weight matrix, in addition, it depends on a validation data. The achieved map was colour-coded for visual interpretation. The efficiency of the new algorithm has found out by the higher correlation coefficient (R=0.979) and the lower root mean square error (RMSE=4.301) between the validation data that were divided into two groups. One used for the algorithm and the other used for validating the results. The comparison was with the minimum distance classifier. Therefore, TSS mapping of polluted water in Penang strait, Malaysia, can be performed using FHNNA with remote sensing technique (THEOS). It is a new and useful application of HNN, so it is a new model with remote sensing techniques for water quality mapping which is considered important environmental problem.
Lary, David J.; Mussa, Yussuf
2004-01-01
In this study a new extended Kalman filter (EKF) learning algorithm for feed-forward neural networks (FFN) is used. With the EKF approach, the training of the FFN can be seen as state estimation for a non-linear stationary process. The EKF method gives excellent convergence performances provided that there is enough computer core memory and that the machine precision is high. Neural networks are ideally suited to describe the spatial and temporal dependence of tracer-tracer correlations. The neural network performs well even in regions where the correlations are less compact and normally a family of correlation curves would be required. For example, the CH4-N2O correlation can be well described using a neural network trained with the latitude, pressure, time of year, and CH4 volume mixing ratio (v.m.r.). The neural network was able to reproduce the CH4-N2O correlation with a correlation coefficient between simulated and training values of 0.9997. The neural network Fortran code used is available for download.
Directory of Open Access Journals (Sweden)
D. J. Lary
2004-06-01
Full Text Available In this study a new extended Kalman filter (EKF learning algorithm for feed-forward neural networks (FFN is used. With the EKF approach, the training of the FFN can be seen as state estimation for a non-linear stationary process. The EKF method gives excellent convergence performances provided that there is enough computer core memory and that the machine precision is high. Neural networks are ideally suited to describe the spatial and temporal dependence of tracer-tracer correlations. The neural network performs well even in regions where the correlations are less compact and normally a family of correlation curves would be required. For example, the CH_{4}-N_{2}O correlation can be well described using a neural network trained with the latitude, pressure, time of year, and CH_{4} volume mixing ratio (v.m.r.. The neural network was able to reproduce the CH_{4}-N_{2}O correlation with a correlation coefficient between simulated and training values of 0.9997. The neural network Fortran code used is available for download.
Directory of Open Access Journals (Sweden)
Fereydoon Sarmadian
2014-01-01
Full Text Available The two common methods used to develop PTFs are multiple-linear regression method and Artificial Neural Network. One of the advantages of neural networks compared to traditional regression PTFs is that they do not require a priori regression model, which relates input and output data and in general is difficult because these models are not known. So at present research, we compare performance of feed-forward back-propagation network to predict soil properties. Soil samples were collected from different horizons profiles located in the Gorgan Province, North of Iran. Measured soil variables included texture, organic carbon, water saturation percentage Bulk density, Infiltration rate and deep percolation. Then, multiple linear regression and neural network model were employed to develop a pedotransfer function for predicting soil parameters using easily measurable characteristics of clay, silt, SP, Bd and organic carbon. The performance of the multiple linear regression and neural network model was evaluated using a test data set by R2, RMSE and RSE. Results showed that artificial neural network with two and five neurons in hidden layer had better performance in predicting soil hydraulic properties than multivariate regression. In conclusion, the result of this study showed that both ANN and regression predicted soil properties with relatively high accuracy that showed that strong relationship between input and output data and also high accuracy in determining of data.
Wang, Jiang; Han, Ruixue; Wei, Xilei; Qin, Yingmei; Yu, Haitao; Deng, Bin
2016-12-01
Reliable signal propagation across distributed brain areas provides the basis for neural circuit function. Modeling studies on cortical circuits have shown that multilayered feed-forward networks (FFNs), if strongly and/or densely connected, can enable robust signal propagation. However, cortical networks are typically neither densely connected nor have strong synapses. This paper investigates under which conditions spiking activity can be propagated reliably across diluted FFNs. Extending previous works, we model each layer as a recurrent sub-network constituting both excitatory (E) and inhibitory (I) neurons and consider the effect of interactions between local excitation and inhibition on signal propagation. It is shown that elevation of cellular excitation-inhibition (EI) balance in the local sub-networks (layers) softens the requirement for dense/strong anatomical connections and thereby promotes weak signal propagation in weakly connected networks. By means of iterated maps, we show how elevated local excitability state compensates for the decreased gain of synchrony transfer function that is due to sparse long-range connectivity. Finally, we report that modulations of EI balance and background activity provide a mechanism for selectively gating and routing neural signal. Our results highlight the essential role of intrinsic network states in neural computation.
FPGA Implementations of Feed Forward Neural Network by using Floating Point Hardware Accelerators
Directory of Open Access Journals (Sweden)
Gabriele-Maria Lozito
2014-01-01
Full Text Available This paper documents the research towards the analysis of different solutions to implement a Neural Network architecture on a FPGA design by using floating point accelerators. In particular, two different implementations are investigated: a high level solution to create a neural network on a soft processor design, with different strategies for enhancing the performance of the process; a low level solution, achieved by a cascade of floating point arithmetic elements. Comparisons of the achieved performance in terms of both time consumptions and FPGA resources employed for the architectures are presented.
Indian Academy of Sciences (India)
A Bhavani Sankar; J Arputha Vijaya Selvi; D Kumar; K Seetha Lakshmi
2013-06-01
In biomedical signal analysis, Artiﬁcial Neural Networks are frequently used for classiﬁcation, owing to their capability to resolve nonlinearly separable problems and the ﬂexibility to implement them on-chip processor, competently. Artiﬁcial Neural Network for a classiﬁcation task attempts to hand design a network topology and to ﬁnd a set of network parameters using a back propagation training algorithm. This work presents an intelligent diagnosis system using artiﬁcial neural network. Features were extracted from respiratory effort signal based on the threshold-based scheme and the respiratory states were classiﬁed into normal, sleep apnea and motion artifacts. The introduced neural classiﬁer was then trained with different back propagation training algorithms and the classiﬁed output was compared with the hand designed results. Five different back propagation training algorithms were used for training, such as Levenberg–Marquardt, scaled conjugate gradient, BFGS algorithm, one step secant and Powell–Beale restarts. Our results revealed that the system could correctly classify at an average of 98.7%, when the LM training method was used. Receiver Operating Characteristic (ROC) analysis and confusion matrix showed that the LM method conferred a more balanced and an apt classiﬁcation of sleep apnea and normal states.
Precision requirements for single-layer feed-forward neural networks
Annema, Anne J.; Hoen, K.; Hoen, Klaas; Wallinga, Hans
1994-01-01
This paper presents a mathematical analysis of the effect of limited precision analog hardware for weight adaptation to be used in on-chip learning feedforward neural networks. Easy-to-read equations and simple worst-case estimations for the maximum tolerable imprecision are presented. As an
Directory of Open Access Journals (Sweden)
Roger A. Kemp
1997-01-01
Full Text Available Normal cells in the presence of a precancerous lesion undergo subtle changes of their DNA distribution when observed by visible microscopy. These changes have been termed Malignancy Associated Changes (MACs. Using statistical models such as neural networks and discriminant functions it is possible to design classifiers that can separate these objects from truly normal cells. The correct classification rate using feed‐forward neural networks is compared to linear discriminant analysis when applied to detecting MACs. Classifiers were designed using 53 nuclear features calculated from images for each of 25,360 normal appearing cells taken from 344 slides diagnosed as normal or containing severe dysplasia. A linear discriminant function achieved a correct classification rate of 61.6% on the test data while neural networks scored as high as 72.5% on a cell‐by‐cell basis. The cell classifiers were applied to a library of 93,494 cells from 395 slides, and the results were jackknifed using a single slide feature. The discriminant function achieved a correct classification rate of 67.6% while the neural networks managed as high as 76.2%.
Training a Feed-Forward Neural Network with Artificial Bee Colony based Backpropagation Method
Directory of Open Access Journals (Sweden)
Sudarshan Nandy
2012-09-01
Full Text Available Back-propagation algorithm is one of the most widely used and popular techniques to optimize the feedforward neural network training. Nature inspired meta-heuristic algorithms also provide derivative-freesolution to optimize complex problem. Artificial bee colony algorithm is a nature inspired meta-heuristicalgorithm, mimicking the foraging or food source searching behaviour of bees in a bee colony and thisalgorithm is implemented in several applications for an improved optimized outcome. The proposedmethod in this paper includes an improved artificial bee colony algorithm based back-propagation neuralnetwork training method for fast and improved convergence rate of the hybrid neural network learningmethod. The result is analysed with the genetic algorithm based back-propagation method, and it isanother hybridized procedure of its kind. Analysis is performed over standard data sets, reflecting the lightof efficiency of proposed method in terms of convergence speed and rate.
Stromatias, Evangelos
2011-01-01
Spiking neural networks have been referred to as the third generation of artificial neural networks where the information is coded as time of the spikes. There are a number of different spiking neuron models available and they are categorized based on their level of abstraction. In addition, there are two known learning methods, unsupervised and supervised learning. This thesis focuses on supervised learning where a new algorithm is proposed, based on genetic algorithms. The proposed algorithm is able to train both synaptic weights and delays and also allow each neuron to emit multiple spikes thus taking full advantage of the spatial-temporal coding power of the spiking neurons. In addition, limited synaptic precision is applied; only six bits are used to describe and train a synapse, three bits for the weights and three bits for the delays. Two limited precision schemes are investigated. The proposed algorithm is tested on the XOR classification problem where it produces better results for even smaller netwo...
Feature Extraction of Olive Ridley Sea Turtle Using Feed Forward neural Network
Directory of Open Access Journals (Sweden)
Capt. Dr.S.Santhosh Baboo
2014-10-01
Full Text Available The paper deals with the computer based auto detection of particular species of sea turtles. In this process, three parameters have been taken and trained in artificial neural network for detecting the particular species among the popular seven species of the world. The existing algorithm for auto photo identification of detecting the particular species is much complicated due to classification process in the algorithm. To improve this algorithm, new technique has been used in feature extraction of the image and there are 10 images where trained and then finally particular species Olive Ridely is retrieved. These images are trained through artificial neural network and result of the images is plotted in the graphs.
Directory of Open Access Journals (Sweden)
K. Gayathri Devi
2015-01-01
Full Text Available Purpose. Colon segmentation is an essential step in the development of computer-aided diagnosis systems based on computed tomography (CT images. The requirement for the detection of the polyps which lie on the walls of the colon is much needed in the field of medical imaging for diagnosis of colorectal cancer. Methods. The proposed work is focused on designing an efficient automatic colon segmentation algorithm from abdominal slices consisting of colons, partial volume effect, bowels, and lungs. The challenge lies in determining the exact colon enhanced with partial volume effect of the slice. In this work, adaptive thresholding technique is proposed for the segmentation of air packets, machine learning based cascade feed forward neural network enhanced with boundary detection algorithms are used which differentiate the segments of the lung and the fluids which are sediment at the side wall of colon and by rejecting bowels based on the slice difference removal method. The proposed neural network method is trained with Bayesian regulation algorithm to determine the partial volume effect. Results. Experiment was conducted on CT database images which results in 98% accuracy and minimal error rate. Conclusions. The main contribution of this work is the exploitation of neural network algorithm for removal of opacified fluid to attain desired colon segmentation result.
Kumar, Somesh; Pratap Singh, Manu; Goel, Rajkumar; Lavania, Rajesh
2013-12-01
In this work, the performance of feedforward neural network with a descent gradient of distributed error and the genetic algorithm (GA) is evaluated for the recognition of handwritten 'SWARS' of Hindi curve script. The performance index for the feedforward multilayer neural networks is considered here with distributed instantaneous unknown error i.e. different error for different layers. The objective of the GA is to make the search process more efficient to determine the optimal weight vectors from the population. The GA is applied with the distributed error. The fitness function of the GA is considered as the mean of square distributed error that is different for each layer. Hence the convergence is obtained only when the minimum of different errors is determined. It has been analysed that the proposed method of a descent gradient of distributed error with the GA known as hybrid distributed evolutionary technique for the multilayer feed forward neural performs better in terms of accuracy, epochs and the number of optimal solutions for the given training and test pattern sets of the pattern recognition problem.
Digital Repository Service at National Institute of Oceanography (India)
Singh, Y.; Nair, R.R.; Singh, H.; Datta, P.; Jaiswal, P.; Dewangan, P.; Ramprasad, T.
-Godavari basin. Log prediction process, with uncertainties based on root mean square error properties, was implemented by way of a multi-layer feed forward neural network. The log properties were merged with seismic data by applying a non-linear transform...
Gaonkar, Bilwaj; Hovda, David; Martin, Neil; Macyszyn, Luke
2016-03-01
Deep Learning, refers to large set of neural network based algorithms, have emerged as promising machine- learning tools in the general imaging and computer vision domains. Convolutional neural networks (CNNs), a specific class of deep learning algorithms, have been extremely effective in object recognition and localization in natural images. A characteristic feature of CNNs, is the use of a locally connected multi layer topology that is inspired by the animal visual cortex (the most powerful vision system in existence). While CNNs, perform admirably in object identification and localization tasks, typically require training on extremely large datasets. Unfortunately, in medical image analysis, large datasets are either unavailable or are extremely expensive to obtain. Further, the primary tasks in medical imaging are organ identification and segmentation from 3D scans, which are different from the standard computer vision tasks of object recognition. Thus, in order to translate the advantages of deep learning to medical image analysis, there is a need to develop deep network topologies and training methodologies, that are geared towards medical imaging related tasks and can work in a setting where dataset sizes are relatively small. In this paper, we present a technique for stacked supervised training of deep feed forward neural networks for segmenting organs from medical scans. Each `neural network layer' in the stack is trained to identify a sub region of the original image, that contains the organ of interest. By layering several such stacks together a very deep neural network is constructed. Such a network can be used to identify extremely small regions of interest in extremely large images, inspite of a lack of clear contrast in the signal or easily identifiable shape characteristics. What is even more intriguing is that the network stack achieves accurate segmentation even when it is trained on a single image with manually labelled ground truth. We validate
Neuronal networks: enhanced feedback feeds forward.
Calabrese, Ronald L
2012-09-25
Modulatory projection neurons gate neuronal networks, such as those comprising motor central pattern generators; in turn, they receive feedback from the networks they gate. A recent study has shown that, in the crab stomatogastric ganglion, this feedback is also subject to modulation: the enhanced feedback feeds forward through the projection neurons to modify circuit output.
Energy Technology Data Exchange (ETDEWEB)
Meier, E., E-mail: evelyne.meier@synchrotron.org.a [School of Physics, Monash University, Wellington Rd, Clayton, VIC 3800 (Australia) and Australian Synchrotron, 800 Blackburn Rd, Clayton, VIC 3168 (Australia) and FERMI-Elettra, Sincrotrone Trieste, S.S. 14km 163.5 in AREA Science Park, 34012 Basovizza, Trieste (Italy); Biedron, S.G., E-mail: biedron@anl.go [Department of Defense Project Office, Argonne National Laboratory, IL 60439 (United States); FERMI-Elettra, Sincrotrone Trieste, S.S. 14km 163.5 in AREA Science Park, 34012 Basovizza, Trieste (Italy); LeBlanc, G., E-mail: Greg.LeBlanc@synchrotron.org.a [Australian Synchrotron, 800 Blackburn Rd, Clayton, VIC 3168 (Australia); Morgan, M.J., E-mail: Michael.Morgan@sci.monash.edu.a [School of Physics, Monash University, Wellington Rd, Clayton, VIC 3800 (Australia); Wu, J., E-mail: jhwu@slac.stanford.ed [LCLS, SLAC National Accelerator Laboratory, 2575 Sand Hill Rd, Menlo Park, CA 94025 (United States)
2009-11-11
This paper describes the results of an advanced control algorithm for the stabilization of electron beam energy in a Linac. The approach combines a conventional Proportional-Integral (PI) controller with a neural network (NNET) feed forward algorithm; it utilizes the robustness of PI control and the ability of a feed forward system in order to exert control over a wider range of frequencies. The NNET is trained to recognize jitter occurring in the phase and voltage of one of the klystrons, based on a record of these parameters, and predicts future energy deviations. A systematic approach is developed to determine the optimal NNET parameters that are then applied to the Australian Synchrotron Linac. The system's capability to fully cancel multi-frequency jitter is demonstrated. The NNET system is then augmented with the PI algorithm, and further jitter attenuation is achieved when the NNET is not operating optimally.
Rishi, Rahul; Choudhary, Amit; Singh, Ravinder; Dhaka, Vijaypal Singh; Ahlawat, Savita; Rao, Mukta
2010-02-01
In this paper we propose a system for classification problem of handwritten text. The system is composed of preprocessing module, supervised learning module and recognition module on a very broad level. The preprocessing module digitizes the documents and extracts features (tangent values) for each character. The radial basis function network is used in the learning and recognition modules. The objective is to analyze and improve the performance of Multi Layer Perceptron (MLP) using RBF transfer functions over Logarithmic Sigmoid Function. The results of 35 experiments indicate that the Feed Forward MLP performs accurately and exhaustively with RBF. With the change in weight update mechanism and feature-drawn preprocessing module, the proposed system is competent with good recognition show.
Nguyen-Truong, Hieu T.; Le, Hung M.
2015-06-01
We present in this study a new and robust algorithm for feed-forward neural network (NN) fitting. This method is developed for the application in potential energy surface (PES) construction, in which simultaneous energy-gradient fitting is implemented using the well-established Levenberg-Marquardt (LM) algorithm. Three fitting examples are demonstrated, which include the vibrational PES of H2O, reactive PESs of O3 and ClOOCl. In the three testing cases, our new LM implementation has been shown to work very efficiently. Not only increasing fitting accuracy, it also offers two other advantages: less training iterations are utilized and less data points are required for fitting.
Directory of Open Access Journals (Sweden)
Dr.J.P.Ganjigatti
2016-05-01
Full Text Available The development of an intelligent system for the establishment of relationship between input parameters and the responses utilizing both reverse and forward modeling of artificial neural networks is the main objective of the present research work. Prediction of quality characteristics such as front width, back width, front height and back height of the weld bead geometry in Tungsten Inert Gas welding process of AA5083; H111 Aluminum alloy is the aim in forward modeling from known set of process parameters such as current, %balance, welding speed, arc gap, gas flow rate, and frequency. Reverse modeling meets the industrial requirements of automatic welding to predict the recommended weld bead geometry characteristics. Comprehensive approach for the development of two back propagation networks viz. feed forward back propagation (FFBP and Elman back propagation (EBP neural networks is adopted. 212 Face centered central composite design based experimental data is utilized for the development of both supervised learning networks with batch mode training approach. A comparison of performance of FFBPP and EBP neural networks are made with that of stepwise multiple regression statistical modeling. Analysis of results showed that both neural network modeling outperformed the statistical approach in making better predictions and the models are efficient in selection of parameters effectively for the desired responses. FFBP performance found to marginally better than that of EBP neural network. Also the forward modeling performance was better than that of reverse modeling in both neural networks
Directory of Open Access Journals (Sweden)
Y. Srinivas
2012-09-01
Full Text Available The applications of intelligent techniques have increased exponentially in recent days to study most of the non-linear parameters. In particular, the behavior of earth resembles the non-linearity applications. An efficient tool is needed for the interpretation of geophysical parameters to study the subsurface of the earth. Artificial Neural Networks (ANN perform certain tasks if the structure of the network is modified accordingly for the purpose it has been used. The three most robust networks were taken and comparatively analyzed for their performance to choose the appropriate network. The single-layer feed-forward neural network with the back propagation algorithm is chosen as one of the well-suited networks after comparing the results. Initially, certain synthetic data sets of all three-layer curves have been taken for training the network, and the network is validated by the field datasets collected from Tuticorin Coastal Region (78°7′30"E and 8°48′45"N, Tamil Nadu, India. The interpretation has been done successfully using the corresponding learning algorithm in the present study. With proper training of back propagation networks, it tends to give the resistivity and thickness of the subsurface layer model of the field resistivity data concerning the synthetic data trained earlier in the appropriate network. The network is trained with more Vertical Electrical Sounding (VES data, and this trained network is demonstrated by the field data. Groundwater table depth also has been modeled.
Institute of Scientific and Technical Information of China (English)
张长江; 付梦印; 金梅
2003-01-01
A kind of second-order algorithm--recursive approximate Newton algorithm was given by Karayiannis. The algorithm was simplified when it was formulated. Especially, the simplification to matrix Hessian was very reluctant, which led to the loss of valuable information and affected performance of the algorithm to certain extent. For multi-layer feed-forward neural networks, the second-order back-propagation recursive algorithm based generalized cost criteria was proposed. It is proved that it is equivalent to Newton recursive algorithm and has a second-order convergent rate. The performance and application prospect are analyzed. Lots of simulation experiments indicate that the calculation of the new algorithm is almost equivalent to the recursive least square multiple algorithm. The algorithm and selection of networks parameters are significant and the performance is more excellent than BP algorithm and the second-order learning algorithm that was given by Karayiannis.
Mörchen, Fabian
2004-03-01
The performance of feed-forward neural networks trained with the backpropagation algorithm on a dedicated Beowulf cluster is analyzed. The concept of training set parallelism is applied. A new model for run time and speedup prediction is developed. With the model the speedup and efficiency of one iteration of the neural networks can be estimated as a function of block size and cluster size. The model is applied to three example problems representing different applications and network architectures. The estimation of the model has a higher accuracy than traditional methods for run time estimation and can be efficiently calculated. Experiments show that speedup of one iteration does not necessarily translate to a shorter training time toward a given error level. To overcome this problem a heuristic extension to training set parallelism called weight averaging is developed. The results show that training in parallel should only be done on clusters with high performance network connections or a multiprocessor machine. A rule of thumb is given for how much network performance of the cluster is needed to achieve speedup of the training time for a neural network.
Energy Technology Data Exchange (ETDEWEB)
Gentili, Pier Luigi, E-mail: pierluigi.gentili@unipg.it [Department of Chemistry, Biology and Biotechnology, University of Perugia, 06123 Perugia (Italy); Gotoda, Hiroshi [Department of Mechanical Engineering, Ritsumeikan University, 1-1-1 Nojihigashi, Kusatsu-shi, Shiga 525-8577 (Japan); Dolnik, Milos; Epstein, Irving R. [Department of Chemistry, Brandeis University, Waltham, Massachusetts 02454-9110 (United States)
2015-01-15
Forecasting of aperiodic time series is a compelling challenge for science. In this work, we analyze aperiodic spectrophotometric data, proportional to the concentrations of two forms of a thermoreversible photochromic spiro-oxazine, that are generated when a cuvette containing a solution of the spiro-oxazine undergoes photoreaction and convection due to localized ultraviolet illumination. We construct the phase space for the system using Takens' theorem and we calculate the Lyapunov exponents and the correlation dimensions to ascertain the chaotic character of the time series. Finally, we predict the time series using three distinct methods: a feed-forward neural network, fuzzy logic, and a local nonlinear predictor. We compare the performances of these three methods.
Directory of Open Access Journals (Sweden)
Jie-Sheng Wang
2015-01-01
Full Text Available For predicting the key technology indicators (concentrate grade and tailings recovery rate of flotation process, a feed-forward neural network (FNN based soft-sensor model optimized by the hybrid algorithm combining particle swarm optimization (PSO algorithm and gravitational search algorithm (GSA is proposed. Although GSA has better optimization capability, it has slow convergence velocity and is easy to fall into local optimum. So in this paper, the velocity vector and position vector of GSA are adjusted by PSO algorithm in order to improve its convergence speed and prediction accuracy. Finally, the proposed hybrid algorithm is adopted to optimize the parameters of FNN soft-sensor model. Simulation results show that the model has better generalization and prediction accuracy for the concentrate grade and tailings recovery rate to meet the online soft-sensor requirements of the real-time control in the flotation process.
Jafri, Madiha; Ely, Jay; Vahala, Linda
2006-01-01
Neural Network Modeling is introduced in this paper to classify and predict Interference Path Loss measurements on Airbus 319 and 320 airplanes. Interference patterns inside the aircraft are classified and predicted based on the locations of the doors, windows, aircraft structures and the communication/navigation system-of-concern. Modeled results are compared with measured data and a plan is proposed to enhance the modeling for better prediction of electromagnetic coupling problems inside aircraft.
Afkhami, Abbas; Abbasi-Tarighat, Maryam
2008-06-01
In the present study, chemometric analysis of visible spectral data of phospho-and silico-molybdenum blue complexes was used to develop artificial neural networks (ANNs) for the simultaneous determination of the phosphate and silicate. Combinations of principal component analysis (PCA) with feed-forward neural networks (FFNNs) and radial basis function networks (RBFNs) were built and investigated. The structures of the models were simplified by using the corresponding important principal components as input instead of the original spectra. Number of inputs and hidden nodes, learning rate, transfer functions and number of epochs and SPREAD values were optimized. Performances of methods were tested with root mean square errors prediction (RMSEP, %), using synthetic solutions. The obtained satisfactory results indicate the applicability of this ANN approach based on PCA input selection for determination in highly spectral overlapping. The results obtained by FFNNs and by RBF networks were compared. The applicability of methods was investigated for synthetic samples, for detergent formulations, and for a river water sample.
Sudibyo, Aji, B. B.; Priyanto, S.
2017-03-01
Cobalt is one of the precious ferromagnetic metals, which widely used in the preparation of magnetic, wear-resistant and high-strength alloys. This metal was not found naturally in single metal form but is found as impurities in nickel or copper ore. The extraction process is one of the methods to separate cobalt from its impurities. However, this process needs an expensive organic solution. In practice, changing the composition of chemicals composition in extraction process always affect at a high cost. Therefore, the development of the artificial neural network (ANN) model to model the cobalt extraction process can serve as an important tool for predicting and investigating the optimum production for the cobalt extraction without the need to run the actual experiment. Hence, the development of the ANN model of cobalt extraction model is essential to simulate the process, which can lead to high yields of cobalt production. In this work a selected optimum multiple-input-single-output (MISO) model of feed forward neural network (FFNN) was used to predict the percentage of cobalt extraction. MISO FFNN with 20, 30 and 50 hidden nodes were used to simulate cobalt extraction process. The simulation results achieved was compared with data available in the literature. The results show that MISO FFNN with 50 hidden nodes has the best performance. The optimum result of MISO FFNN then exported to Simulink model in Matlab environment, hence make it easy to use in predicting and investigating for the optimum production of the cobalt extraction.
自适应前馈神经网络结构优化设计%An adaptive algorithm for designing optimal feed-forward neural network architecture
Institute of Scientific and Technical Information of China (English)
张昭昭; 乔俊飞; 杨刚
2011-01-01
针对多数前馈神经网络结构设计算法采取贪婪搜索策略而易陷入局部最优结构的问题,提出一种自适应前馈神经网络结构设计算法.该算法在网络训练过程中采取自适应寻优策略合并和分裂隐节点,达到设计最优神经网络结构的目的.在合并操作中,以互信息为准则对输出线性相关的隐节点进行合并；在分裂操作中,引入变异系数,有助于跳出局部最优网络结构.算法将合并和分裂操作之后的权值调整与网络对样本的学习过程结合,减少了网络对样本的学习次数,提高了网络的学习速度,增强了网络的泛化性能.非线性函数逼近结果表明,所提算法能得到更小的检测误差,最终网络结构紧凑.%Due to the fact that most algorithms use a greedy strategy in designing artificial neural networks which are susceptible to becoming trapped at the architectural local optimal point, an adaptive algorithm for designing an optimal feed-forward neural network was proposed. During the training process of the neural network, the adaptive optimization strategy was adopted to merge and split the hidden unit to design optimal neural network architecture. In the merge operation, the hidden units were merged based on mutual information criterion. In the split operation, a mutation coefficient was introduced to help jump out of locally optimal network. The process of adjusting the connection weight after merge and split operations was combined with the process of training the neural network. Therefore, the number of training samples was reduced, the training speed was increased, and the generalization performance was improved. The results of approximating non-linear functions show that the proposed algorithm can limit testing errors and a compact neural network structure.
Directory of Open Access Journals (Sweden)
P.V.V.Kishore
2013-10-01
Full Text Available This research paper highlights the use of shape and texture information for recognizing gestures of Indian sign language. The proposed method involves extracting the hand segments from theoriginal color gesture images and subjecting them to further processing. In the next stage texture information of the hands in extracted using gabor filter. Again from the segmented hand portions shape is modeled using Chan-Vese(CV active contour model. Finally both the shape and texture information are merged together to produce a feature vector that essentially represents a sign in Indian SignLanguage. To reduce the dimensionality of the feature matrix principle component analysis is applied on the feature matrix. The obtained feature matrix will train a artificial neural network the learns using error back propagation algorithm. Indian sign language database was created for around 36 signs with 10 different signers. For training 4 sets gesture images were used and the remaining 6 sets were used for testing. After extensive testing under various conditions the average recognition rate stands at 98.2%.
Topological reversibility and causality in feed-forward networks
Energy Technology Data Exchange (ETDEWEB)
Corominas-Murtra, Bernat; RodrIguez-Caso, Carlos; Sole, Ricard [ICREA-Complex Systems Lab, Universitat Pompeu Fabra (Parc de Recerca Biomedica de Barcelona), Dr Aiguader 88, 08003 Barcelona (Spain); Goni, JoaquIn, E-mail: bernat.corominas@upf.ed [Functional Neuroimaging Laboratory, Department of Neurosciences, Center for Applied Medical Research, University of Navarra, Pamplona (Spain)
2010-11-15
Systems whose organization displays causal asymmetry constraints, from evolutionary trees to river basins or transport networks, can often be described in terms of directed paths on a discrete set of arbitrary units including states in state spaces, feed-forward neural nets, the evolutionary history of a given collection of events or the chart of computational states visited along a complex computation. Such a set of paths defines a feed-forward, acyclic network. A key problem associated with these systems involves characterizing their intrinsic degree of path reversibility: given an end node in the graph, what is the uncertainty of recovering the process backwards until the origin? Here, we propose a novel concept, topological reversibility, which is a measure of the complexity of the net that rigorously weights such uncertainty in path dependency, quantifying the minimum amount of information required to successfully reverse a causal path. Within the proposed framework, we also analytically characterize limit cases for both topologically reversible and maximally entropic structures. The relevance of these measures within the context of evolutionary dynamics is highlighted.
The mechanism of synchronization in feed-forward neuronal networks
Energy Technology Data Exchange (ETDEWEB)
Goedeke, S; Diesmann, M [Bernstein Center for Computational Neuroscience, Albert-Ludwigs-University, Freiburg (Germany)], E-mail: diesmann@brain.riken.jp
2008-01-15
Synchronization in feed-forward subnetworks of the brain has been proposed to explain the precisely timed spike patterns observed in experiments. While the attractor dynamics of these networks is now well understood, the underlying single neuron mechanisms remain unexplained. Previous attempts have captured the effects of the highly fluctuating membrane potential by relating spike intensity f(U) to the instantaneous voltage U generated by the input. This article shows that f is high during the rise and low during the decay of U(t), demonstrating that the U-dot-dependence of f, not refractoriness, is essential for synchronization. Moreover, the bifurcation scenario is quantitatively described by a simple f(U,U-dot) relationship. These findings suggest f(U,U-dot) as the relevant model class for the investigation of neural synchronization phenomena in a noisy environment.
Afkhami, Abbas; Abbasi-Tarighat, Maryam; Bahram, Morteza
2008-03-15
In this work feed-forward neural networks and radial basis function networks were used for the determination of enantiomeric composition of alpha-phenylglycine using UV spectra of cyclodextrin host-guest complexes and the data provided by two techniques were compared. Wavelet transformation (WT) and principal component analysis (PCA) were used for data compression prior to neural network construction and their efficiencies were compared. The structures of the wavelet transformation-radial basis function networks (WT-RBFNs) and wavelet transformation-feed-forward neural networks (WT-FFNNs), were simplified by using the corresponding wavelet coefficients of three mother wavelets (Mexican hat, daubechies and symlets). Dilation parameters, number of inputs, hidden nodes, learning rate, transfer functions, number of epochs and SPREAD values were optimized. Performances of the proposed methods were tested with regard to root mean square errors of prediction (RMSE%), using synthetic solutions containing a fixed concentration of beta-cyclodextrin (beta-CD) and fixed concentration of alpha-phenylglycine (alpha-Gly) with different enantiomeric compositions. Although satisfactory results with regard to some statistical parameters were obtained for all the investigated methods but the best results were achieved by WT-RBFNs.
Introduction to Artificial Neural Networks
DEFF Research Database (Denmark)
Larsen, Jan
1999-01-01
The note addresses introduction to signal analysis and classification based on artificial feed-forward neural networks.......The note addresses introduction to signal analysis and classification based on artificial feed-forward neural networks....
2014-03-27
security-conference/. [Accessed 10 January 2014]. [3] "The Economic Impact of Cybercrime and Cyber Espionage," 2013. [4] "Department of Homeland...Technology in Automation, Control and Intelligent Systems (CYBER), Bangkok , 2012. [38] M. Panda and M. R. Patra, "Network Intrusion Detection
Optimizing information flow in small genetic networks. II. Feed-forward interactions.
Walczak, Aleksandra M; Tkacik, Gasper; Bialek, William
2010-04-01
Central to the functioning of a living cell is its ability to control the readout or expression of information encoded in the genome. In many cases, a single transcription factor protein activates or represses the expression of many genes. As the concentration of the transcription factor varies, the target genes thus undergo correlated changes, and this redundancy limits the ability of the cell to transmit information about input signals. We explore how interactions among the target genes can reduce this redundancy and optimize information transmission. Our discussion builds on recent work [Tkacik, Phys. Rev. E 80, 031920 (2009)], and there are connections to much earlier work on the role of lateral inhibition in enhancing the efficiency of information transmission in neural circuits; for simplicity we consider here the case where the interactions have a feed forward structure, with no loops. Even with this limitation, the networks that optimize information transmission have a structure reminiscent of the networks found in real biological systems.
Constructive neural network learning
Lin, Shaobo; Zeng, Jinshan; Zhang, Xiaoqin
2016-01-01
In this paper, we aim at developing scalable neural network-type learning systems. Motivated by the idea of "constructive neural networks" in approximation theory, we focus on "constructing" rather than "training" feed-forward neural networks (FNNs) for learning, and propose a novel FNNs learning system called the constructive feed-forward neural network (CFN). Theoretically, we prove that the proposed method not only overcomes the classical saturation problem for FNN approximation, but also ...
Nicola, Victor F.; Zaburnenko, Tatiana S.
2006-01-01
In this paper we propose a state-dependent importance sampling heuristic to estimate the probability of population overﬂow in feed-forward networks. This heuristic attempts to approximate the “optimal” state-dependent change of measure without the need for difficult analysis or costly optimization i
Directory of Open Access Journals (Sweden)
V. Rezan USLU
2010-01-01
Full Text Available Obtaining the inflation prediction is an important problem. Having this prediction accurately will lead to more accurate decisions. Various time series techniques have been used in the literature for inflation prediction. Recently, Artificial Neural Network (ANN is being preferred in the time series prediction problem due to its flexible modeling capacity. Artificial neural network can be applied easily to any time series since it does not require prior conditions such as a linear or curved specific model pattern, stationary and normal distribution. In this study, the predictions have been obtained using the feed forward and recurrent artificial neural network for the Consumer Price Index (CPI. A new combined forecast has been proposed based on ANN in which the ANN model predictions employed in analysis were used as data.
Compressive sensing reconstruction of feed-forward connectivity in pulse-coupled nonlinear networks
Barranca, Victor J.; Zhou, Douglas; Cai, David
2016-06-01
Utilizing the sparsity ubiquitous in real-world network connectivity, we develop a theoretical framework for efficiently reconstructing sparse feed-forward connections in a pulse-coupled nonlinear network through its output activities. Using only a small ensemble of random inputs, we solve this inverse problem through the compressive sensing theory based on a hidden linear structure intrinsic to the nonlinear network dynamics. The accuracy of the reconstruction is further verified by the fact that complex inputs can be well recovered using the reconstructed connectivity. We expect this Rapid Communication provides a new perspective for understanding the structure-function relationship as well as compressive sensing principle in nonlinear network dynamics.
Compressive sensing reconstruction of feed-forward connectivity in pulse-coupled nonlinear networks.
Barranca, Victor J; Zhou, Douglas; Cai, David
2016-06-01
Utilizing the sparsity ubiquitous in real-world network connectivity, we develop a theoretical framework for efficiently reconstructing sparse feed-forward connections in a pulse-coupled nonlinear network through its output activities. Using only a small ensemble of random inputs, we solve this inverse problem through the compressive sensing theory based on a hidden linear structure intrinsic to the nonlinear network dynamics. The accuracy of the reconstruction is further verified by the fact that complex inputs can be well recovered using the reconstructed connectivity. We expect this Rapid Communication provides a new perspective for understanding the structure-function relationship as well as compressive sensing principle in nonlinear network dynamics.
Directory of Open Access Journals (Sweden)
Zeinab eBirjandian
2013-11-01
Full Text Available The inhibition of excitatory (pyramidal neurons directly dampens their activity resulting in a suppression of neural network output. The inhibition of inhibitory cells is more complex. Inhibitory drive is known to gate neural network synchrony, but there is also a widely held view that it may augment excitability by reducing inhibitory cell activity, a process termed disinhibition. Surprisingly, however, disinhibition has never been demonstrated to be an important mechanism that augments or drives the activity of excitatory neurons in a functioning neural circuit. Using voltage sensitive dye imaging (VSDI we show that 20-80 Hz stimulus trains, (beta-gamma activation, of the olfactory cortex pyramidal cells in layer II leads to a subsequent reduction in inhibitory interneuron activity that augments the efficacy of the initial stimulus. This disinhibition occurs with a lag of about 150-250 ms after the initial excitation of the layer 2 pyramidal cell layer. In addition activation of the endopiriform nucleus also arises just before the disinhibitory phase with a lag of about 40-80 ms. Preventing the spread of action potentials from layer II stopped the excitation of the endopiriform nucleus, abolished the disinhibitory activity and reduced the excitation of layer II cells. After the induction of experimental epilepsy the disinhibition was more intense with a concomitant increase in excitatory cell activity. Our observations provide the first evidence of feed forward disinhibition loop that augments excitatory neurotransmission, a mechanism that could play an important role in the development of epileptic seizures.
Learning Processes of Layered Neural Networks
Fujiki, Sumiyoshi; FUJIKI, Nahomi, M.
1995-01-01
A positive reinforcement type learning algorithm is formulated for a stochastic feed-forward neural network, and a learning equation similar to that of the Boltzmann machine algorithm is obtained. By applying a mean field approximation to the same stochastic feed-forward neural network, a deterministic analog feed-forward network is obtained and the back-propagation learning rule is re-derived.
Learning Algorithms of Multilayer Neural Networks
Fujiki, Sumiyoshi; FUJIKI, Nahomi, M.
1996-01-01
A positive reinforcement type learning algorithm is formulated for a stochastic feed-forward multilayer neural network, with far interlayer synaptic connections, and we obtain a learning rule similar to that of the Boltzmann machine on the same multilayer structure. By applying a mean field approximation to the stochastic feed-forward neural network, the generalized error back-propagation learning rule is derived for a deterministic analog feed-forward multilayer network with the far interlay...
Simulation of Wave Forces on A Semi-Circular Breakwater Using Multilayer Feed Forward Network
Institute of Scientific and Technical Information of China (English)
徐杰; 陶建华
2003-01-01
In this paper, the Artificial Neural Network (ANN) is used to study the wave forces on a semi-circular breakwater. The process of establishing the network model for a specific physical problem is presented. Networks with double implicit layers have been studied by numerical experiments. 117 sets of experimental data are used to train and test the ANN. According to the results of ANN simulation, this method is proved to have good precision compared with experimental and numerical results.
Improved Cuckoo Search Algorithm for Feed forward Neural Network Training
Ehsan Valian; Shahram Mohanna; Saeed Tavakoli
2011-01-01
The cuckoo search algorithm is a recently developed meta-heuristic optimization algorithm, which is suitable for solving optimization problems. To enhance the accuracy and convergence rate of this algorithm, an improved cuckoo search algorithm is proposed in this paper. Normally, the parameters of the cuckoo search are kept constant. This may lead to decreasing the efficiency of the algorithm. To cope with this issue, a proper strategy for tuning the cuckoo search parameters is pr...
Stability prediction of berm breakwater using neural network
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Rao, S.; Manjunath, Y.R.
. In order to allow the network to learn both non-linear and linear relationships between input nodes and output nodes, multiple-layer networks are often used. Among many neural network architectures, the three layers feed forward backpropagation neural...
Deep Networks Can Resemble Human Feed-forward Vision in Invariant Object Recognition
Kheradpisheh, Saeed Reza; Ghodrati, Masoud; Ganjtabesh, Mohammad; Masquelier, Timothée
2016-09-01
Deep convolutional neural networks (DCNNs) have attracted much attention recently, and have shown to be able to recognize thousands of object categories in natural image databases. Their architecture is somewhat similar to that of the human visual system: both use restricted receptive fields, and a hierarchy of layers which progressively extract more and more abstracted features. Yet it is unknown whether DCNNs match human performance at the task of view-invariant object recognition, whether they make similar errors and use similar representations for this task, and whether the answers depend on the magnitude of the viewpoint variations. To investigate these issues, we benchmarked eight state-of-the-art DCNNs, the HMAX model, and a baseline shallow model and compared their results to those of humans with backward masking. Unlike in all previous DCNN studies, we carefully controlled the magnitude of the viewpoint variations to demonstrate that shallow nets can outperform deep nets and humans when variations are weak. When facing larger variations, however, more layers were needed to match human performance and error distributions, and to have representations that are consistent with human behavior. A very deep net with 18 layers even outperformed humans at the highest variation level, using the most human-like representations.
Application of Neural Networks for Energy Reconstruction
Damgov, Jordan
2002-01-01
The possibility to use Neural Networks for reconstruction ofthe energy deposited in the calorimetry system of the CMS detector is investigated. It is shown that using feed-forward neural network, good linearity, Gaussian energy distribution and good energy resolution can be achieved. Significant improvement of the energy resolution and linearity is reached in comparison with other weighting methods for energy reconstruction.
Trinh, Hung-Cuong; Le, Duc-Hau; Kwon, Yung-Keun
2014-01-01
It has been a challenge in systems biology to unravel relationships between structural properties and dynamic behaviors of biological networks. A Cytoscape plugin named NetDS was recently proposed to analyze the robustness-related dynamics and feed-forward/feedback loop structures of biological networks. Despite such a useful function, limitations on the network size that can be analyzed exist due to high computational costs. In addition, the plugin cannot verify an intrinsic property which can be induced by an observed result because it has no function to simulate the observation on a large number of random networks. To overcome these limitations, we have developed a novel software tool, PANET. First, the time-consuming parts of NetDS were redesigned to be processed in parallel using the OpenCL library. This approach utilizes the full computing power of multi-core central processing units and graphics processing units. Eventually, this made it possible to investigate a large-scale network such as a human signaling network with 1,609 nodes and 5,063 links. We also developed a new function to perform a batch-mode simulation where it generates a lot of random networks and conducts robustness calculations and feed-forward/feedback loop examinations of them. This helps us to determine if the findings in real biological networks are valid in arbitrary random networks or not. We tested our plugin in two case studies based on two large-scale signaling networks and found interesting results regarding relationships between coherently coupled feed-forward/feedback loops and robustness. In addition, we verified whether or not those findings are consistently conserved in random networks through batch-mode simulations. Taken together, our plugin is expected to effectively investigate various relationships between dynamics and structural properties in large-scale networks. Our software tool, user manual and example datasets are freely available at http://panet-csc.sourceforge.net/.
Directory of Open Access Journals (Sweden)
Hung-Cuong Trinh
Full Text Available It has been a challenge in systems biology to unravel relationships between structural properties and dynamic behaviors of biological networks. A Cytoscape plugin named NetDS was recently proposed to analyze the robustness-related dynamics and feed-forward/feedback loop structures of biological networks. Despite such a useful function, limitations on the network size that can be analyzed exist due to high computational costs. In addition, the plugin cannot verify an intrinsic property which can be induced by an observed result because it has no function to simulate the observation on a large number of random networks. To overcome these limitations, we have developed a novel software tool, PANET. First, the time-consuming parts of NetDS were redesigned to be processed in parallel using the OpenCL library. This approach utilizes the full computing power of multi-core central processing units and graphics processing units. Eventually, this made it possible to investigate a large-scale network such as a human signaling network with 1,609 nodes and 5,063 links. We also developed a new function to perform a batch-mode simulation where it generates a lot of random networks and conducts robustness calculations and feed-forward/feedback loop examinations of them. This helps us to determine if the findings in real biological networks are valid in arbitrary random networks or not. We tested our plugin in two case studies based on two large-scale signaling networks and found interesting results regarding relationships between coherently coupled feed-forward/feedback loops and robustness. In addition, we verified whether or not those findings are consistently conserved in random networks through batch-mode simulations. Taken together, our plugin is expected to effectively investigate various relationships between dynamics and structural properties in large-scale networks. Our software tool, user manual and example datasets are freely available at http://panet-csc.sourceforge.net/.
Chaotic behavior of a layered neural network
Energy Technology Data Exchange (ETDEWEB)
Derrida, B.; Meir, R.
1988-09-15
We consider the evolution of configurations in a layered feed-forward neural network. Exact expressions for the evolution of the distance between two configurations are obtained in the thermodynamic limit. Our results show that the distance between two arbitrarily close configurations always increases, implying chaotic behavior, even in the phase of good retrieval.
Estimation of concrete compressive strength using artificial neural network
Kostić, Srđan; Vasović, Dejan
2015-01-01
In present paper, concrete compressive strength is evaluated using back propagation feed-forward artificial neural network. Training of neural network is performed using Levenberg-Marquardt learning algorithm for four architectures of artificial neural networks, one, three, eight and twelve nodes in a hidden layer in order to avoid the occurrence of overfitting. Training, validation and testing of neural network is conducted for 75 concrete samples with distinct w/c ratio and amount of superp...
Neural Networks in Control Applications
DEFF Research Database (Denmark)
Sørensen, O.
The intention of this report is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: - Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. - Amongst numerous training algorithms, only four algorithms are examined, all...... in a recursive form (sample updating). The simplest is the Back Probagation Error Algorithm, and the most complex is the recursive Prediction Error Method using a Gauss-Newton search direction. - Over-fitting is often considered to be a serious problem when training neural networks. This problem is specifically...
Application of neural networks in coastal engineering - An overview
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Patil, S.G.; Manjunatha, Y.R.; Hegde, A.V.
prediction, wave tranquility studies and near shore morphology are highlighted in this paper. 2 Feed forward neural network A neural network model is interconnected by several neurons. Generally, neuron model consists of three layers namely input layer.... Three-layered feed forward neural network INPUT LAYER HIDDEN LAYER OUTPUT LAYER WEIGHTS BIAS SINGLE NEURON NODE 2 0 )( 2 1 ∑ = −= N k kkp tOE (3) ko M i rKjk bzTwxy +×= ∑ −1 )()( ∑ − +×= D i jiiji bxwz 1 (1) (2) (4) ∑ = = P p p E p E 1 1...
neural network based model o work based model of an industrial oil ...
African Journals Online (AJOL)
eobe
Marquardt. Marquardt Back Propagation Algorithm ..... Ioan I. et al “The Optimization of Feed Forward. Neural Networks ... Controller Design of an Industrial Oil-Fired Boiler. Plant” ... Mechanical Engineering Purdue University, 2006. [38].
Boundness of a Neural Network Weights Using the Notion of a Limit of a Sequence
Directory of Open Access Journals (Sweden)
Hazem Migdady
2014-06-01
Full Text Available feed forward neural network with backpropagation learning algorithm is considered as a black box learning classifier since there is no certain interpretation or nticipation of the behavior of a neural network weights. The weights of a neural network ar e considered as the learning tool of the classifier, and the learning task is performed by the repetition modification of those weights. This modification is performed using the delta rule which is mainly usedin the gradient descent technique. In this article a proof is provided that helps to understand and explain the behavior of the weights in a feed forward neural network with backpropagation learning algorithm. Also, it illustrates why a feed forward neural network is not always guaranteed to converge in a global minimum. Moreover, the proof shows that the weights in t he neural network are upper bounded (i.e. they do not approach infinity.
Boundness of a Neural Network Weights Using the Notion of a Limit of a Sequence
Directory of Open Access Journals (Sweden)
Hazem Migdady
2014-05-01
Full Text Available feed forward neural network with backpropagation learning algorithm is considered as a black box learning classifier since there is no certain interpretation or anticipation of the behavior of a neural network weights. The weights of a neural network are considered as the learning tool of the classifier, and the learning task is performed by the repetition modification of those weights. This modification is performed using the delta rule which is mainly used in the gradient descent technique. In this article a proof is provided that helps to understand and explain the behavior of the weights in a feed forward neural network with backpropagation learning algorithm. Also, it illustrates why a feed forward neural network is not always guaranteed to converge in a global minimum. Moreover, the proof shows that the weights in the neural network are upper bounded (i.e. they do not approach infinity.
Genetic algorithm for neural networks optimization
Setyawati, Bina R.; Creese, Robert C.; Sahirman, Sidharta
2004-11-01
This paper examines the forecasting performance of multi-layer feed forward neural networks in modeling a particular foreign exchange rates, i.e. Japanese Yen/US Dollar. The effects of two learning methods, Back Propagation and Genetic Algorithm, in which the neural network topology and other parameters fixed, were investigated. The early results indicate that the application of this hybrid system seems to be well suited for the forecasting of foreign exchange rates. The Neural Networks and Genetic Algorithm were programmed using MATLAB«.
Prediction of littoral drift with artificial neural networks
Digital Repository Service at National Institute of Oceanography (India)
Singh, A.K.; Deo, M.C.; SanilKumar, V.
of the rate of sand drift has still remained as a problem. The current study addresses this issue through the use of artificial neural networks (ANN). Feed forward networks were developed to predict the sand drift from a variety of causative variables...
Systolic implementation of neural networks
Energy Technology Data Exchange (ETDEWEB)
De Groot, A.J.; Parker, S.R.
1989-01-01
The backpropagation algorithm for error gradient calculations in multilayer, feed-forward neural networks is derived in matrix form involving inner and outer products. It is demonstrated that these calculations can be carried out efficiently using systolic processing techniques, particularly using the SPRINT, a 64-element systolic processor developed at Lawrence Livermore National Laboratory. This machine contains one million synapses, and forward-propagates 12 million connections per second, using 100 watts of power. When executing the algorithm, each SPRINT processor performs useful work 97% of the time. The theory and applications are confirmed by some nontrivial examples involving seismic signal recognition. 4 refs., 7 figs.
Jet analysis by neural networks in high energy hadron-hadron collisions
De Felice, P; Pasquariello, G; De Felice, P; Nardulli, G; Pasquariello, G
1995-01-01
We study the possibility to employ neural networks to simulate jet clustering procedures in high energy hadron-hadron collisions. We concentrate our analysis on the Fermilab Tevatron energy and on the k_\\bot algorithm. We consider both supervised multilayer feed-forward network trained by the backpropagation algorithm and unsupervised learning, where the neural network autonomously organizes the events in clusters.
Temporal solar irradiance variability analysis using neural networks
Tebabal, Ambelu; Damtie, Baylie; Nigussie, Melessew
A feed-forward neural network which can account for nonlinear relationship was used to model total solar irradiance (TSI). A single layer feed-forward neural network with Levenberg-marquardt back-propagation algorithm have been implemented for modeling daily total solar irradiance from daily photometric sunspot index, and core-to-wing ratio of Mg II index data. In order to obtain the optimum neural network for TSI modeling, the root mean square error (RMSE) and mean absolute error (MAE) have been taken into account. The modeled and measured TSI have the correlation coefficient of about R=0.97. The neural networks (NNs) model output indicates that reconstructed TSI from solar proxies (photometric sunspot index and Mg II) can explain 94% of the variance of TSI. This modeled TSI using NNs further strengthens the view that surface magnetism indeed plays a dominant role in modulating solar irradiance.
Tutorial on neural network applications in high energy physics: A 1992 perspective
Energy Technology Data Exchange (ETDEWEB)
Denby, B.
1992-04-01
Feed forward and recurrent neural networks are introduced and related to standard data analysis tools. Tips are given on applications of neural nets to various areas of high energy physics. A review of applications within high energy physics and a summary of neural net hardware status are given.
Suppressing Halo-chaos for Intense Ion Beamby Neural Network Adaptation Control Strategy
Institute of Scientific and Technical Information of China (English)
FANGJin-qing; LUOXiao-shu; WENGJia-qiang; ZHULun-wu
2003-01-01
Neural network has some advantages of adaptation, learn-self, self-organization and suitable for high-dimension for various applications in many fields, especially among them the feed-forward back-propagating neural network self-adaptation method is suitable for control of nonlinear systems.
Development of a combined feed forward-feedback system for an electron Linac
Energy Technology Data Exchange (ETDEWEB)
Meier, E. [School of Physics, Monash University, Wellington Rd, Clayton VIC 3800 (Australia) and Australian Synchrotron, 800 Blackburn Rd, Clayton VIC 3168 (Australia); FERMI-Elettra, Sincrotrone Trieste, S.S. 14km 163.5 in AREA Science Park, 34012 Basovizza, Trieste (Italy)], E-mail: evelyne.meier@synchrotron.org.au; Biedron, S.G. [Department of Defense Project Office, Argonne National Laboratory, IL 60439 (United States); FERMI-Elettra, Sincrotrone Trieste, S.S. 14km 163.5 in AREA Science Park, 34012 Basovizza, Trieste (Italy)], E-mail: biedron@anl.gov; LeBlanc, G. [Australian Synchrotron, 800 Blackburn Rd, Clayton VIC 3168 (Australia)], E-mail: Greg.LeBlanc@synchrotron.org.au; Morgan, M.J. [School of Physics, Monash University, Wellington Rd, Clayton VIC 3800 (Australia)], E-mail: Michael.Morgan@sci.monash.edu.au; Wu, J. [LCLS, SLAC National Accelerator Laboratory, 2575 Sand Hill Rd, Menlo Park, CA 94025 (United States)], E-mail: jhwu@slac.stanford.edu
2009-10-11
This paper describes the results of an advanced control algorithm for the stabilization of electron beam energy in a Linac. The approach combines a conventional Proportional-Integral (PI) controller with a neural network (NNET) feed forward algorithm; it utilizes the robustness of PI control and the ability of a feed forward system in order to exert control over a wider range of frequencies. The NNET is trained to recognize jitter occurring in the phase and voltage of one of the klystrons, based on a record of these parameters, and predicts future energy deviations. A systematic approach is developed to determine the optimal NNET parameters that are then applied to the Australian Synchrotron Linac. The system's capability to fully cancel multi-frequency jitter is demonstrated. The NNET system is then augmented with the PI algorithm, and further jitter attenuation is achieved when the NNET is not operating optimally.
TIME SERIES FORECASTING USING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
BOGDAN OANCEA
2013-05-01
Full Text Available Recent studies have shown the classification and prediction power of the Neural Networks. It has been demonstrated that a NN can approximate any continuous function. Neural networks have been successfully used for forecasting of financial data series. The classical methods used for time series prediction like Box-Jenkins or ARIMA assumes that there is a linear relationship between inputs and outputs. Neural Networks have the advantage that can approximate nonlinear functions. In this paper we compared the performances of different feed forward and recurrent neural networks and training algorithms for predicting the exchange rate EUR/RON and USD/RON. We used data series with daily exchange rates starting from 2005 until 2013.
Wind Resource Assessment and Forecast Planning with Neural Networks
Directory of Open Access Journals (Sweden)
Nicolus K. Rotich
2014-06-01
Full Text Available In this paper we built three types of artificial neural networks, namely: Feed forward networks, Elman networks and Cascade forward networks, for forecasting wind speeds and directions. A similar network topology was used for all the forecast horizons, regardless of the model type. All the models were then trained with real data of collected wind speeds and directions over a period of two years in the municipal of Puumala, Finland. Up to 70th percentile of the data was used for training, validation and testing, while 71–85th percentile was presented to the trained models for validation. The model outputs were then compared to the last 15% of the original data, by measuring the statistical errors between them. The feed forward networks returned the lowest errors for wind speeds. Cascade forward networks gave the lowest errors for wind directions; Elman networks returned the lowest errors when used for short term forecasting.
Hardware implementation of stochastic spiking neural networks.
Rosselló, Josep L; Canals, Vincent; Morro, Antoni; Oliver, Antoni
2012-08-01
Spiking Neural Networks, the last generation of Artificial Neural Networks, are characterized by its bio-inspired nature and by a higher computational capacity with respect to other neural models. In real biological neurons, stochastic processes represent an important mechanism of neural behavior and are responsible of its special arithmetic capabilities. In this work we present a simple hardware implementation of spiking neurons that considers this probabilistic nature. The advantage of the proposed implementation is that it is fully digital and therefore can be massively implemented in Field Programmable Gate Arrays. The high computational capabilities of the proposed model are demonstrated by the study of both feed-forward and recurrent networks that are able to implement high-speed signal filtering and to solve complex systems of linear equations.
An integrated architecture of adaptive neural network control for dynamic systems
Energy Technology Data Exchange (ETDEWEB)
Ke, Liu; Tokar, R.; Mcvey, B.
1994-07-01
In this study, an integrated neural network control architecture for nonlinear dynamic systems is presented. Most of the recent emphasis in the neural network control field has no error feedback as the control input which rises the adaptation problem. The integrated architecture in this paper combines feed forward control and error feedback adaptive control using neural networks. The paper reveals the different internal functionality of these two kinds of neural network controllers for certain input styles, e.g., state feedback and error feedback. Feed forward neural network controllers with state feedback establish fixed control mappings which can not adapt when model uncertainties present. With error feedbacks, neural network controllers learn the slopes or the gains respecting to the error feedbacks, which are error driven adaptive control systems. The results demonstrate that the two kinds of control scheme can be combined to realize their individual advantages. Testing with disturbances added to the plant shows good tracking and adaptation.
用于本构模型的新的神经网络%NEW NEURAL NETWORK FOR CONSTITU- TIVE MODELING
Institute of Scientific and Technical Information of China (English)
赵启林; 王思敬; 金广谦
2003-01-01
In this paper,a new neural network is developed to connect FE analysis with the feed-forward neural network. With this new neural network,the constitutive model of material may be determined from the information of nodal's force and displacement. In this methodology,the stage which takes long time to obtain stress and strain by FE analysis is prevented.
Kannada character recognition system using neural network
Kumar, Suresh D. S.; Kamalapuram, Srinivasa K.; Kumar, Ajay B. R.
2013-03-01
Handwriting recognition has been one of the active and challenging research areas in the field of pattern recognition. It has numerous applications which include, reading aid for blind, bank cheques and conversion of any hand written document into structural text form. As there is no sufficient number of works on Indian language character recognition especially Kannada script among 15 major scripts in India. In this paper an attempt is made to recognize handwritten Kannada characters using Feed Forward neural networks. A handwritten Kannada character is resized into 20x30 Pixel. The resized character is used for training the neural network. Once the training process is completed the same character is given as input to the neural network with different set of neurons in hidden layer and their recognition accuracy rate for different Kannada characters has been calculated and compared. The results show that the proposed system yields good recognition accuracy rates comparable to that of other handwritten character recognition systems.
Multiobjective training of artificial neural networks for rainfall-runoff modeling
De Vos, N.J.; Rientjes, T.H.M.
2008-01-01
This paper presents results on the application of various optimization algorithms for the training of artificial neural network rainfall-runoff models. Multilayered feed-forward networks for forecasting discharge from two mesoscale catchments in different climatic regions have been developed for thi
Multiobjective training of artificial neural networks for rainfall-runoff modeling
De Vos, N.J.; Rientjes, T.H.M.
2008-01-01
This paper presents results on the application of various optimization algorithms for the training of artificial neural network rainfall-runoff models. Multilayered feed-forward networks for forecasting discharge from two mesoscale catchments in different climatic regions have been developed for
Directory of Open Access Journals (Sweden)
Schwindling Jerome
2010-04-01
Full Text Available This course presents an overview of the concepts of the neural networks and their aplication in the framework of High energy physics analyses. After a brief introduction on the concept of neural networks, the concept is explained in the frame of neuro-biology, introducing the concept of multi-layer perceptron, learning and their use as data classifer. The concept is then presented in a second part using in more details the mathematical approach focussing on typical use cases faced in particle physics. Finally, the last part presents the best way to use such statistical tools in view of event classifers, putting the emphasis on the setup of the multi-layer perceptron. The full article (15 p. corresponding to this lecture is written in french and is provided in the proceedings of the book SOS 2008.
Neural networks and particle physics
Peterson, Carsten
1993-01-01
1. Introduction : Structure of the Central Nervous System Generics2. Feed-forward networks, Perceptions, Function approximators3. Self-organisation, Feature Maps4. Feed-back Networks, The Hopfield model, Optimization problems, Feed-back, Networks, Deformable templates, Graph bisection
Role of neural networks in the search of the Higgs boson at LHC
Maggipinto, T.; Nardulli, G.; Dusini, S.; Ferrari, F.; Lazzizzera, I.; Sidoti, A.; Sartori, A.; Tecchiolli, G. P.
1997-02-01
We show that neural network classifiers can be helpful to discriminate Higgs production from background at LHC in the Higgs mass range MH ~ 200 GeV. We employ a common feed-forward neural network trained by the backpropagation algorithm for off-line analysis and the neural chip Totem, trained by the Reactive Tabu Search algorithm, which could be used for on-line analysis.
Modeling Broadband Microwave Structures by Artificial Neural Networks
Directory of Open Access Journals (Sweden)
V. Otevrel
2004-06-01
Full Text Available The paper describes the exploitation of feed-forward neural networksand recurrent neural networks for replacing full-wave numerical modelsof microwave structures in complex microwave design tools. Building aneural model, attention is turned to the modeling accuracy and to theefficiency of building a model. Dealing with the accuracy, we describea method of increasing it by successive completing a training set.Neural models are mutually compared in order to highlight theiradvantages and disadvantages. As a reference model for comparisons,approximations based on standard cubic splines are used. Neural modelsare used to replace both the time-domain numeric models and thefrequency-domain ones.
A Fuzzy-Neural Network Control of Nonlinear Dynamic Systems
Institute of Scientific and Technical Information of China (English)
无
2000-01-01
In this paper,an adaptive dynamic control scheme based on a fuzzy neural network is presented,that presents utilizes both feed-forward and feedback controller elements.The former of the two elements comprises a neural network with both identification and control role,and the latter is a fuzzy neural algorithm,which is introduced to provide additional control enhancement.The feedforward controller provides only coarse control,whereas the feedback oontroller can generate on-line conditional proposition rule automatically to improve the overall control action.These properties make the design very versatile and applicable to a range of industrial applications.
Successful prediction of horse racing results using a neural network
Allinson, N. M.; Merritt, D.
1991-01-01
Most application work within neural computing continues to employ multi-layer perceptrons (MLP). Though many variations of the fully interconnected feed-forward MLP, and even more variations of the back propagation learning rule, exist; the first section of the paper attempts to highlight several properties of these standard networks. The second section outlines an application-namely the prediction of horse racing results
Optimize Short Term load Forcasting Anomalous Based Feed Forward Backpropagation
Mulyadi, Y.; Abdullah, A. G.; Rohmah, K. A.
2017-03-01
This paper contains the Short-Term Load Forecasting (STLF) using artificial neural network especially feed forward back propagation algorithm which is particularly optimized in order to getting a reduced error value result. Electrical load forecasting target is a holiday that hasn’t identical pattern and different from weekday’s pattern, in other words the pattern of holiday load is an anomalous. Under these conditions, the level of forecasting accuracy will be decrease. Hence we need a method that capable to reducing error value in anomalous load forecasting. Learning process of algorithm is supervised or controlled, then some parameters are arranged before performing computation process. Momentum constant a value is set at 0.8 which serve as a reference because it has the greatest converge tendency. Learning rate selection is made up to 2 decimal digits. In addition, hidden layer and input component are tested in several variation of number also. The test result leads to the conclusion that the number of hidden layer impact on the forecasting accuracy and test duration determined by the number of iterations when performing input data until it reaches the maximum of a parameter value.
a Heterosynaptic Learning Rule for Neural Networks
Emmert-Streib, Frank
In this article we introduce a novel stochastic Hebb-like learning rule for neural networks that is neurobiologically motivated. This learning rule combines features of unsupervised (Hebbian) and supervised (reinforcement) learning and is stochastic with respect to the selection of the time points when a synapse is modified. Moreover, the learning rule does not only affect the synapse between pre- and postsynaptic neuron, which is called homosynaptic plasticity, but effects also further remote synapses of the pre- and postsynaptic neuron. This more complex form of synaptic plasticity has recently come under investigations in neurobiology and is called heterosynaptic plasticity. We demonstrate that this learning rule is useful in training neural networks by learning parity functions including the exclusive-or (XOR) mapping in a multilayer feed-forward network. We find, that our stochastic learning rule works well, even in the presence of noise. Importantly, the mean learning time increases with the number of patterns to be learned polynomially, indicating efficient learning.
A survey on RBF Neural Network for Intrusion Detection System
Directory of Open Access Journals (Sweden)
Henali Sheth
2014-12-01
Full Text Available Network security is a hot burning issue nowadays. With the help of technology advancement intruders or hackers are adopting new methods to create different attacks in order to harm network security. Intrusion detection system (IDS is a kind of security software which inspects all incoming and outgoing network traffic and it will generate alerts if any attack or unusual behavior is found in a network. Various approaches are used for IDS such as data mining, neural network, genetic and statistical approach. Among this Neural Network is more suitable approach for IDS. This paper describes RBF neural network approach for Intrusion detection system. RBF is a feed forward and supervise technique of neural network.RBF approach has good classification ability but its performance depends on its parameters. Based on survey we find that RBF approach has some short comings. In order to overcome this we need to do proper optimization of RBF parameters.
An Improved Back Propagation Neural Network Algorithm on Classification Problems
Nawi, Nazri Mohd; Ransing, R. S.; Salleh, Mohd Najib Mohd; Ghazali, Rozaida; Hamid, Norhamreeza Abdul
The back propagation algorithm is one the most popular algorithms to train feed forward neural networks. However, the convergence of this algorithm is slow, it is mainly because of gradient descent algorithm. Previous research demonstrated that in 'feed forward' algorithm, the slope of the activation function is directly influenced by a parameter referred to as 'gain'. This research proposed an algorithm for improving the performance of the back propagation algorithm by introducing the adaptive gain of the activation function. The gain values change adaptively for each node. The influence of the adaptive gain on the learning ability of a neural network is analysed. Multi layer feed forward neural networks have been assessed. Physical interpretation of the relationship between the gain value and the learning rate and weight values is given. The efficiency of the proposed algorithm is compared with conventional Gradient Descent Method and verified by means of simulation on four classification problems. In learning the patterns, the simulations result demonstrate that the proposed method converged faster on Wisconsin breast cancer with an improvement ratio of nearly 2.8, 1.76 on diabetes problem, 65% better on thyroid data sets and 97% faster on IRIS classification problem. The results clearly show that the proposed algorithm significantly improves the learning speed of the conventional back-propagation algorithm.
Sha, Daohang
2010-01-01
Back-propagation with gradient method is the most popular learning algorithm for feed-forward neural networks. However, it is critical to determine a proper fixed learning rate for the algorithm. In this paper, an optimized recursive algorithm is presented for online learning based on matrix operation and optimization methods analytically, which can avoid the trouble to select a proper learning rate for the gradient method. The proof of weak convergence of the proposed algorithm also is given. Although this approach is proposed for three-layer, feed-forward neural networks, it could be extended to multiple layer feed-forward neural networks. The effectiveness of the proposed algorithms applied to the identification of behavior of a two-input and two-output non-linear dynamic system is demonstrated by simulation experiments.
Vonk, E.; Jain, L.C.; Veelenturf, L.P.J.
1995-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
DEFF Research Database (Denmark)
Bhowmik, Subrata; Weber, Felix; Høgsberg, Jan Becker
2013-01-01
This paper presents a systematic design and training procedure for the feed-forward backpropagation neural network (NN) modeling of both forward and inverse behavior of a rotary magnetorheological (MR) damper based on experimental data. For the forward damper model, with damper force as output an...
DEFF Research Database (Denmark)
Prato, Carlo Giacomo; Gitelman, Victoria; Bekhor, Shlomo
2011-01-01
on 1,793 fatal traffic accidents occurred during the period between 2003 and 2006 and applies Kohonen and feed-forward back-propagation neural networks with the objective of extracting from the data typical patterns and relevant factors. Kohonen neural networks reveal five compelling accident patterns....... Feed-forward back-propagation neural networks indicate that sociodemographic characteristics of drivers and victims, accident location, and period of the day are extremely relevant factors. Accident patterns suggest that countermeasures are necessary for identified problems concerning mainly vulnerable...... road users such as pedestrians, cyclists, motorcyclists and young drivers. A “safe-system” integrating a system approach for the design of countermeasures and a monitoring process of performance indicators might address the priorities highlighted by the neural networks....
Multimodality image registration and fusion using neural network
Institute of Scientific and Technical Information of China (English)
Mostafa G Mostafa; Aly A Farag; Edward Essock
2003-01-01
Multimodality image registration and fusion are essential steps in building 3-D models from remotesensing data. We present in this paper a neural network technique for the registration and fusion of multimodali-ty remote sensing data for the reconstruction of 3-D models of terrain regions. A FeedForward neural network isused to fuse the intensity data sets with the spatial data set after learning its geometry. Results on real data arepresented. Human performance evaluation is assessed on several perceptual tests in order to evaluate the fusionresults.
Dynamic Pricing in Electronic Commerce Using Neural Network
Ghose, Tapu Kumar; Tran, Thomas T.
In this paper, we propose an approach where feed-forward neural network is used for dynamically calculating a competitive price of a product in order to maximize sellers’ revenue. In the approach we considered that along with product price other attributes such as product quality, delivery time, after sales service and seller’s reputation contribute in consumers purchase decision. We showed that once the sellers, by using their limited prior knowledge, set an initial price of a product our model adjusts the price automatically with the help of neural network so that sellers’ revenue is maximized.
System Identification, Prediction, Simulation and Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1997-01-01
The intention of this paper is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...... study of the networks themselves. With this end in view the following restrictions have been made: 1) Amongst numerous neural network structures, only the Multi Layer Perceptron (a feed-forward network) is applied. 2) Amongst numerous training algorithms, only the Recursive Prediction Error Method using...... a Gauss-Newton search direction is applied. 3) Amongst numerous model types, often met in control applications, only the Non-linear ARMAX (NARMAX) model, representing input/output description, is examined. A simulated example confirms that a neural network has the potential to perform excellent System...
Analysis and optimization of gas-centrifugal separation of uranium isotopes by neural networks
Directory of Open Access Journals (Sweden)
Migliavacca S.C.P.
2002-01-01
Full Text Available Neural networks are an attractive alternative for modeling complex problems with too many difficulties to be solved by a phenomenological model. A feed-forward neural network was used to model a gas-centrifugal separation of uranium isotopes. The prediction showed good agreement with the experimental data. An optimization study was carried out. The optimal operational condition was tested by a new experiment and a difference of less than 1% was found.
ECO INVESTMENT PROJECT MANAGEMENT THROUGH TIME APPLYING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Tamara Gvozdenović
2007-06-01
Full Text Available he concept of project management expresses an indispensable approach to investment projects. Time is often the most important factor in these projects. The artificial neural network is the paradigm of data processing, which is inspired by the one used by the biological brain, and it is used in numerous, different fields, among which is the project management. This research is oriented to application of artificial neural networks in managing time of investment project. The artificial neural networks are used to define the optimistic, the most probable and the pessimistic time in PERT method. The program package Matlab: Neural Network Toolbox is used in data simulation. The feed-forward back propagation network is chosen.
FPGA Implementation of Feed-Forward MLP Neural Networks%前向MLP网络的FPGA实现
Institute of Scientific and Technical Information of China (English)
都军伟; 王永纲; 杨阳; 李凯
2010-01-01
分别采用CORDIC(Coordinate rotation digital computer)算法和分布式算法实现多层感知器网络的传输函数计算和输入与权重乘积和计算,通过模块复用的方法构造了一个用于函数逼近的、无需乘法器的神经网络,并在NoisⅡ开发平台上测试了该网络的性能.该网络每17个时钟周期输出一个数据,占用FPGA的7781个LE(Logic element)和8976 bit存储器,具有良好的扩展性.
Feed forward control of estimated wind speed
Energy Technology Data Exchange (ETDEWEB)
Van Engelen, T.G.; Van der Hooft, E.L. [ECN Wind Energy, Petten (Netherlands)
2003-12-01
A control structure 'feed forward of estimated wind speed' is described, as it were: 'the wind turbine rotor will be used as a wind meter'. The control structure is based on 'estimation' of wind speed as well as a non-linear compensation of a wind speed dependent pitch speed setpoint, which is optimised to maintain (stationary) rated electric power. It is required to know the rotor properties with moderate accuracy. In time domain simulations, inclusion of a feed forward of estimated wind speed control action has shown to be a powerful extension to current ECN wind turbine control structures: reduction of rotor speed variations: 0.2 rpm decreased standard deviation; improved turbine behaviour to large wind gusts; increase of energy yield of 0.9%; For reasons of simplicity and robustness, a tabular implementation approach is preferred above polynomial implementation. The resulting brief algorithm uses small sized tables, requires low hardware requirements and needs a minimum of easy interpretable parameters for design and tuning. Both stability, robustness and parametric uncertainties were observed. The addition control loop has a slightly positive effect on overall stability and robustness. Appeared offsets in the estimated wind speed value due to parameter uncertainties do not have impact on the effectuation of the wind speed feed forward loop.
Neural networks for predicting breeding values and genetic gains
Directory of Open Access Journals (Sweden)
Gabi Nunes Silva
2014-12-01
Full Text Available Analysis using Artificial Neural Networks has been described as an approach in the decision-making process that, although incipient, has been reported as presenting high potential for use in animal and plant breeding. In this study, we introduce the procedure of using the expanded data set for training the network. Wealso proposed using statistical parameters to estimate the breeding value of genotypes in simulated scenarios, in addition to the mean phenotypic value in a feed-forward back propagation multilayer perceptron network. After evaluating artificial neural network configurations, our results showed its superiority to estimates based on linear models, as well as its applicability in the genetic value prediction process. The results further indicated the good generalization performance of the neural network model in several additional validation experiments.
Energy Technology Data Exchange (ETDEWEB)
Ritter, G.X.; Sussner, P. [Univ. of Florida, Gainesville, FL (United States)
1996-12-31
The theory of artificial neural networks has been successfully applied to a wide variety of pattern recognition problems. In this theory, the first step in computing the next state of a neuron or in performing the next layer neural network computation involves the linear operation of multiplying neural values by their synaptic strengths and adding the results. Thresholding usually follows the linear operation in order to provide for nonlinearity of the network. In this paper we introduce a novel class of neural networks, called morphological neural networks, in which the operations of multiplication and addition are replaced by addition and maximum (or minimum), respectively. By taking the maximum (or minimum) of sums instead of the sum of products, morphological network computation is nonlinear before thresholding. As a consequence, the properties of morphological neural networks are drastically different than those of traditional neural network models. In this paper we consider some of these differences and provide some particular examples of morphological neural network.
Time-Delay Neural Network for Smart MIMO Channel Estimation in Downlink 4G-LTE-Advance System
Nirmalkumar S. Reshamwala; Pooja S. Suratia; Satish K. Shah
2014-01-01
Long-Term Evolution (LTE) is the next generation of current mobile telecommunication networks. LTE has a new ﬂat radio-network architecture and signiﬁcant increase in spectrum efficiency. In this paper, main focus on throughput performance analysis of robust MIMO channel estimators for Downlink Long Term Evolution-Advance (DL LTE-A)-4G system using three Artificial Neural Networks: Feed-forward neural network (FFNN), Cascade-forward neural network (CFNN) and Time-Delay neural network (TDNN) a...
Learning feed-forward multi-nets
Venema, RS; Spaanenburg, L; Kurkova,; Steele, NC; Neruda, R; Karny, M
2001-01-01
Multi-nets promise an improved performance over monolithic neural networks by virtue of their distributed implementation. This potential lacks popularity as, without precautions, the learning rate has to drop considerably to eliminate the occurrence of unlearning. This paper introduces extensions of
Detection of Denial of Service Attacks against Domain Name System Using Neural Networks
Directory of Open Access Journals (Sweden)
Mohd Fadlee A. Rasid
2009-11-01
Full Text Available In this paper we introduce an intrusion detection system for Denial of Service (DoS attacks against Domain Name System (DNS. Our system architecture consists of two most important parts: a statistical preprocessor and a neural network classifier. The preprocessor extracts required statistical features in a short-time frame from traffic received by the target name server. We compared three different neural networks for detecting and classifying different types of DoS attacks. The proposed system is evaluated in a simulated network and showed that the best performed neural network is a feed-forward backpropagation with an accuracy of 99%.
Microstructural characterization of materials by neural network technique
Energy Technology Data Exchange (ETDEWEB)
Barat, P. [Variable Energy Cyclotron Centre, 1/AF Bidhan Nagar, Kolkata 700064 (India); Chatterjee, A., E-mail: arnomitra@veccal.ernet.i [Variable Energy Cyclotron Centre, 1/AF Bidhan Nagar, Kolkata 700064 (India); Mukherjee, P.; Gayathri, N. [Variable Energy Cyclotron Centre, 1/AF Bidhan Nagar, Kolkata 700064 (India); Jayakumar, T.; Raj, Baldev [Indira Gandhi Centre for Atomic Research, Kalpakkam 603102 (India)
2010-11-15
Ultrasonic signals received by pulse echo technique from plane parallel Zircaloy 2 samples of fixed thickness and of three different microstructures, were subjected to signal analysis, as conventional parameters like velocity and attenuation could not reliably discriminate them. The signals, obtained from these samples, were first sampled and digitized. Modified Karhunen Loeve Transform was used to reduce their dimensionality. A multilayered feed forward Artificial Neural Network was trained using a few signals in their reduced domain from the three different microstructures. The rest of the signals from the three samples with different microstructures were classified satisfactorily using this network.
Neural networks in windprofiler data processing
Weber, H.; Richner, H.; Kretzschmar, R.; Ruffieux, D.
2003-04-01
Wind profilers are basically Doppler radars yielding 3-dimensional wind profiles that are deduced from the Doppler shift caused by turbulent elements in the atmosphere. These signals can be contaminated by other airborne elements such as birds or hydrometeors. Using a feed-forward neural network with one hidden layer and one output unit, birds and hydrometeors can be successfully identified in non-averaged single spectra; theses are subsequently removed in the wind computation. An infrared camera was used to identify birds in one of the beams of the wind profiler. After training the network with about 6000 contaminated data sets, it was able to identify contaminated data in a test data set with a reliability of 96 percent. The assumption was made that the neural network parameters obtained in the beam for which bird data was collected can be transferred to the other beams (at least three beams are needed for computing wind vectors). Comparing the evolution of a wind field with and without the neural network shows a significant improvement of wind data quality. Current work concentrates on training the network also for hydrometeors. It is hoped that the instrument's capability can thus be expanded to measure not only correct winds, but also observe bird migration, estimate precipitation and -- by combining precipitation information with vertical velocity measurement -- the monitoring of the height of the melting layer.
Chen, Chau-Kuang
2010-01-01
Artificial Neural Network (ANN) and Support Vector Machine (SVM) approaches have been on the cutting edge of science and technology for pattern recognition and data classification. In the ANN model, classification accuracy can be achieved by using the feed-forward of inputs, back-propagation of errors, and the adjustment of connection weights. In…
Short Term Load Forecast Using Wavelet Neural Network
Institute of Scientific and Technical Information of China (English)
Gui Min; Rong Fei; Luo An
2005-01-01
This paper presents a wavelet neural network (WNN) model combining wavelet transform and artificial neural networks for short term load forecast (STLF). Both historical load and temperature data having important impacts on load level were used in the proposed forecasting model. The model used the three-layer feed forward network trained by the error back-propagation algorithm. To enhance the forecasting accuracy by neural networks, wavelet multi-resolution analysis method was introduced to pre-process these data and reconstruct the predicted output. The proposed model has been evaluated with actual data of electricity load and temperature of Hunan Province. The simulation results show that the model is capable of providing a reasonable forecasting accuracy in STLF.
Generalized classifier neural network.
Ozyildirim, Buse Melis; Avci, Mutlu
2013-03-01
In this work a new radial basis function based classification neural network named as generalized classifier neural network, is proposed. The proposed generalized classifier neural network has five layers, unlike other radial basis function based neural networks such as generalized regression neural network and probabilistic neural network. They are input, pattern, summation, normalization and output layers. In addition to topological difference, the proposed neural network has gradient descent based optimization of smoothing parameter approach and diverge effect term added calculation improvements. Diverge effect term is an improvement on summation layer calculation to supply additional separation ability and flexibility. Performance of generalized classifier neural network is compared with that of the probabilistic neural network, multilayer perceptron algorithm and radial basis function neural network on 9 different data sets and with that of generalized regression neural network on 3 different data sets include only two classes in MATLAB environment. Better classification performance up to %89 is observed. Improved classification performances proved the effectivity of the proposed neural network.
Pruning Neural Networks with Distribution Estimation Algorithms
Energy Technology Data Exchange (ETDEWEB)
Cantu-Paz, E
2003-01-15
This paper describes the application of four evolutionary algorithms to the pruning of neural networks used in classification problems. Besides of a simple genetic algorithm (GA), the paper considers three distribution estimation algorithms (DEAs): a compact GA, an extended compact GA, and the Bayesian Optimization Algorithm. The objective is to determine if the DEAs present advantages over the simple GA in terms of accuracy or speed in this problem. The experiments used a feed forward neural network trained with standard back propagation and public-domain and artificial data sets. The pruned networks seemed to have better or equal accuracy than the original fully-connected networks. Only in a few cases, pruning resulted in less accurate networks. We found few differences in the accuracy of the networks pruned by the four EAs, but found important differences in the execution time. The results suggest that a simple GA with a small population might be the best algorithm for pruning networks on the data sets we tested.
A Comparison between Neural Networks and Traditional Forecasting Methods: A Case Study
Directory of Open Access Journals (Sweden)
C. A. Mitrea
2009-10-01
Full Text Available Forecasting accuracy drives the performance of inventory management. This study is to investigate and compare different forecasting methods like Moving Average (MA and Autoregressive Integrated Moving Average (ARIMA with Neural Networks (NN models as Feed-forward NN and Nonlinear Autoregressive network with eXogenous inputs (NARX. Data used to forecast is acquired from inventory database of Panasonic Refrigeration Devices Company located in Singapore. Results have shown that forecasting with NN offers better performance in comparison with traditional methods.
Determining the input dimension of a neural network for nonlinear time series prediction
Institute of Scientific and Technical Information of China (English)
张胜; 刘红星; 高敦堂; 都思丹
2003-01-01
Determining the input dimension of a feed-forward neural network for nonlinear time series prediction plays an important role in the modelling.The paper first summarizes the current methods for determining the input dimension of the neural network.Then inspired by the fact that the correlation dimension of a nonlinear dynamic system is the mostimportant feature of it,the paper presents a new idea that the input dimension of the neural network for nonlinear time series prediction can be taken as an integer just greater than or equal to the correlation dimension.Finally,some wlidation examples and results are given.
Transient stability Assessment using Artificial Neural Network Considering Fault Location
Directory of Open Access Journals (Sweden)
P.K.Olulope
2010-06-01
Full Text Available This paper describes the capability of artificial neural network for predicting the critical clearing time of power system. It combines the advantages of time domain integration schemes with artificial neural network for real time transient stability assessment. The training of ANN is done using selected features as input and critical fault clearing time (CCT as desire target. A single contingency was applied and the target CCT was found using time domain simulation. Multi layer feed forward neural network trained with Levenberg Marquardt (LM back propagation algorithm is used to provide the estimated CCT. The effectiveness of ANN, the method is demonstrated on single machine infinite bus system (SMIB. The simulation shows that ANN can provide fast and accurate mapping which makes it applicable to real time scenario.
Earth slope reliability analysis under seismic loadings using neural network
Institute of Scientific and Technical Information of China (English)
PENG Huai-sheng; DENG Jian; GU De-sheng
2005-01-01
A new method was proposed to cope with the earth slope reliability problem under seismic loadings. The algorithm integrates the concepts of artificial neural network, the first order second moment reliability method and the deterministic stability analysis method of earth slope. The performance function and its derivatives in slope stability analysis under seismic loadings were approximated by a trained multi-layer feed-forward neural network with differentiable transfer functions. The statistical moments calculated from the performance function values and the corresponding gradients using neural network were then used in the first order second moment method for the calculation of the reliability index in slope safety analysis. Two earth slope examples were presented for illustrating the applicability of the proposed approach. The new method is effective in slope reliability analysis. And it has potential application to other reliability problems of complicated engineering structure with a considerably large number of random variables.
Implementation of neural network for color properties of polycarbonates
Saeed, U.; Ahmad, S.; Alsadi, J.; Ross, D.; Rizvi, G.
2014-05-01
In present paper, the applicability of artificial neural networks (ANN) is investigated for color properties of plastics. The neural networks toolbox of Matlab 6.5 is used to develop and test the ANN model on a personal computer. An optimal design is completed for 10, 12, 14,16,18 & 20 hidden neurons on single hidden layer with five different algorithms: batch gradient descent (GD), batch variable learning rate (GDX), resilient back-propagation (RP), scaled conjugate gradient (SCG), levenberg-marquardt (LM) in the feed forward back-propagation neural network model. The training data for ANN is obtained from experimental measurements. There were twenty two inputs including resins, additives & pigments while three tristimulus color values L*, a* and b* were used as output layer. Statistical analysis in terms of Root-Mean-Squared (RMS), absolute fraction of variance (R squared), as well as mean square error is used to investigate the performance of ANN. LM algorithm with fourteen neurons on hidden layer in Feed Forward Back-Propagation of ANN model has shown best result in the present study. The degree of accuracy of the ANN model in reduction of errors is proven acceptable in all statistical analysis and shown in results. However, it was concluded that ANN provides a feasible method in error reduction in specific color tristimulus values.
Vertex Reconstructing Neural Network at the ZEUS Central Tracking Detector
Dror, G; Dror, Gideon; Etzion, Erez
2001-01-01
An unconventional solution for finding the location of event creation is presented. It is based on two feed-forward neural networks with fixed architecture, whose parameters are chosen so as to reach a high accuracy. The interaction point location is a parameter that can be used to select events of interest from the very high rate of events created at the current experiments in High Energy Physics. The system suggested here is tested on simulated data sets of the ZEUS Central Tracking Detector, and is shown to perform better than conventional algorithms.
Optimal Feed Forward MLPArchitecture for Off-Line Cursive Numeral Recognition
Directory of Open Access Journals (Sweden)
Vijaypal Singh Dhaka
2010-01-01
Full Text Available The purpose of this work is to analyze the performance of back-propagation feed-forward algorithm using various different activation functions for the neurons of hidden and output layer and varying the number of neurons in the hidden layer. For sample creation, 250 numerals were gathered form 35 people of different ages including male and female. After binarization, these numerals were clubbed together to form training patterns for the neural network. Network was trained to learn its behavior by adjusting the connection strengths at every iteration. The conjugate gradient descent of each presented training pattern was calculated to identify the minima on the error surface for each training pattern. Experiments were performed by selecting different combinations of two activation functions out of the three activation functions logsig, tansig and purelin for the neurons of the hidden and output layers and the results revealed that as the number of neurons in the hidden layer is increased, the network gets trained in small number of epochs and the percentage recognition accuracy of the neural network was observed to increase up to certain level and then it starts decreasing when number of hidden neurons exceeds a certain level.
Chaotic diagonal recurrent neural network
Institute of Scientific and Technical Information of China (English)
Wang Xing-Yuan; Zhang Yi
2012-01-01
We propose a novel neural network based on a diagonal recurrent neural network and chaos,and its structure andlearning algorithm are designed.The multilayer feedforward neural network,diagonal recurrent neural network,and chaotic diagonal recurrent neural network are used to approach the cubic symmetry map.The simulation results show that the approximation capability of the chaotic diagonal recurrent neural network is better than the other two neural networks.
Chung-Ming Kuan
2006-01-01
Artificial neural networks (ANNs) constitute a class of flexible nonlinear models designed to mimic biological neural systems. In this entry, we introduce ANN using familiar econometric terminology and provide an overview of ANN modeling approach and its implementation methods.
A case for spiking neural network simulation based on configurable multiple-FPGA systems.
Yang, Shufan; Wu, Qiang; Li, Renfa
2011-09-01
Recent neuropsychological research has begun to reveal that neurons encode information in the timing of spikes. Spiking neural network simulations are a flexible and powerful method for investigating the behaviour of neuronal systems. Simulation of the spiking neural networks in software is unable to rapidly generate output spikes in large-scale of neural network. An alternative approach, hardware implementation of such system, provides the possibility to generate independent spikes precisely and simultaneously output spike waves in real time, under the premise that spiking neural network can take full advantage of hardware inherent parallelism. We introduce a configurable FPGA-oriented hardware platform for spiking neural network simulation in this work. We aim to use this platform to combine the speed of dedicated hardware with the programmability of software so that it might allow neuroscientists to put together sophisticated computation experiments of their own model. A feed-forward hierarchy network is developed as a case study to describe the operation of biological neural systems (such as orientation selectivity of visual cortex) and computational models of such systems. This model demonstrates how a feed-forward neural network constructs the circuitry required for orientation selectivity and provides platform for reaching a deeper understanding of the primate visual system. In the future, larger scale models based on this framework can be used to replicate the actual architecture in visual cortex, leading to more detailed predictions and insights into visual perception phenomenon.
Directory of Open Access Journals (Sweden)
Yasir Hassan Ali
2015-01-01
Full Text Available The thickness of an oil film lubricant can contribute to less gear tooth wear and surface failure. The purpose of this research is to use artificial neural network (ANN computational modelling to correlate spur gear data from acoustic emissions, lubricant temperature, and specific film thickness (λ. The approach is using an algorithm to monitor the oil film thickness and to detect which lubrication regime the gearbox is running either hydrodynamic, elastohydrodynamic, or boundary. This monitoring can aid identification of fault development. Feed-forward and recurrent Elman neural network algorithms were used to develop ANN models, which are subjected to training, testing, and validation process. The Levenberg-Marquardt back-propagation algorithm was applied to reduce errors. Log-sigmoid and Purelin were identified as suitable transfer functions for hidden and output nodes. The methods used in this paper shows accurate predictions from ANN and the feed-forward network performance is superior to the Elman neural network.
ESTIMATION OF PV MODULE SURFACE TEMPERATURE USING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Can Coskun
2016-12-01
Full Text Available This study aimed to use the artificial neural network (ANN method to estimate the surface temperature of a photovoltaic (PV panel. Using the experimentally obtained PV data, the accuracy of the ANN model was evaluated. To train the artificial neural network (ANN, outer temperature solar radiation and wind speed values were inputs and surface temperature was an output. The ANN was used to estimate PV panel surface temperature. Using the Levenberg-Marquardt (LM algorithm the feed forward artificial neural network was trained. Two back propagation type ANN algorithms were used and their performance was compared with the estimate from the LM algorithm. To train the artificial neural network, experimental data were used for two thirds with the remaining third used for testing. Additionally scaled conjugate gradient (SCG back propagation and resilient back propagation (RB type ANN algorithms were used for comparison with the LM algorithm. The performances of these three types of artificial neural network were compared and mean error rates of between 0.005962 and 0.012177% were obtained. The best estimate was produced by the LM algorithm. Estimation of PV surface temperature with artificial neural networks provides better results than conventional correlation methods. This study showed that artificial neural networks may be effectively used to estimate PV surface temperature.
Feed forward control: An implementation at CIRFEL
Energy Technology Data Exchange (ETDEWEB)
Krishnaswamy, J.; Lehrman, I.S.; Hartley, R. [Northrop Grumman Advanced Technology and Development Center, Princeton, NJ (United States)] [and others
1995-12-31
An integral part of the Compact InfraRed Free Electron LASER (CIRFEL) is control of the phase and amplitude stability in the RF power system. We have implemented such a Feed Forward system using the LabView software package, by National Instruments. We will discuss implementation and performance data of the Feed Forward control of the RF power system at CIRFEL. We will also briefly discuss some conditions under which the problem is ill-conditioned, and what idealizations can be made to remedy these ill-conditioned systems. Using an arbitrary function generator, we generate a driving signal for a voltage-controlled attenuator at the input side of the RF system, and we monitor the RF voltage in cell I of the photocathode gun using a digital storage oscilliscope in averaging mode. The system is stable enough to use data from one shot to modify the inputs for future shots. After downloading the averaged data to a personal computer via a GPIB (IEEE 488) bus, we use a simple linear transformation on the difference waveform between the current shot and the target to produce a correction signal. This signal is added to the driving signal in the arbitrary function generator, and the process is repeated until we get the flatness we need in the output signals from cell 1. The system for phase control is similar, with a voltage-controlled phase shifter replacing the attenuator, and monitoring of the RF phase in cell I replacing the monitoring of RF voltage. By repeatedly alternating between correcting the RF voltage (equivalent to correcting the RF power) and RF phase in cell 1, we are able to achieve simultaneous phase variations of <{+-}1{degrees} and amplitude variations of <{+-}0.1% over a 3{mu}sec pulse.
Modeling, Optimization and simulation of Rotary Furnace using Artificial Neural Network
Directory of Open Access Journals (Sweden)
Dr. R, K. Jain,
2011-04-01
Full Text Available This paper deals with modeling and simulation of LDO fired rotary furnace using feed forward modeling method of artificial neural network (ANN.The authors conducted experimental investigations onfuel consumption in a rotary furnace in an industry. It was observed that 6% oxygen enrichment of the air preheated up to 4600C simultaneously with reduction of air volume to 75% of its theoretical requirement lowered the specific fuel consumption to 0.260 lit/kg..The compact heat exchanger with 533 fins was used for preheating the air. Accordingly the emission level was also considerably reduced. The feed forward modeling method of artificial neural network contained in MAT LAB software was used for modeling andoptimization of specific fuel consumption. The percentage variation, between actual experimental data and same data when simulated is +1.730%, and other feasible simulated datas is +6.192%,-3.038%,-5.692%,and+0.115%which is fairly acceptable.
Fuel economy and torque tracking in camless engines through optimization of neural networks
Energy Technology Data Exchange (ETDEWEB)
Ashhab, Moh' d Sami S. [Department of Mechanical Engineering, The Hashemite University, Zarqa 13115 (Jordan)
2008-02-15
The feed forward controller of a camless internal combustion engine is modeled by inverting a multi-input multi-output feed forward artificial neural network (ANN) model of the engine. The engine outputs, pumping loss and cylinder air charge, are related to the inputs, intake valve lift and closing timing, by the artificial neural network model, which is trained with historical input-output data. The controller selects the intake valve lift and closing timing that will mimimize the pumping loss and achieve engine torque tracking. Lower pumping loss means better fuel economy, whereas engine torque tracking guarantees the driver's torque demand. The inversion of the ANN is performed with the complex method constrained optimization. How the camless engine inverse controller can be augmented with adaptive techniques to maintain accuracy even when the engine parts degrade is discussed. The simulation results demonstrate the effectiveness of the developed camless engine controller. (author)
PERFORMANCE COMPARISON FOR INTRUSION DETECTION SYSTEM USING NEURAL NETWORK WITH KDD DATASET
Directory of Open Access Journals (Sweden)
S. Devaraju
2014-04-01
Full Text Available Intrusion Detection Systems are challenging task for finding the user as normal user or attack user in any organizational information systems or IT Industry. The Intrusion Detection System is an effective method to deal with the kinds of problem in networks. Different classifiers are used to detect the different kinds of attacks in networks. In this paper, the performance of intrusion detection is compared with various neural network classifiers. In the proposed research the four types of classifiers used are Feed Forward Neural Network (FFNN, Generalized Regression Neural Network (GRNN, Probabilistic Neural Network (PNN and Radial Basis Neural Network (RBNN. The performance of the full featured KDD Cup 1999 dataset is compared with that of the reduced featured KDD Cup 1999 dataset. The MATLAB software is used to train and test the dataset and the efficiency and False Alarm Rate is measured. It is proved that the reduced dataset is performing better than the full featured dataset.
Reliability analysis of C-130 turboprop engine components using artificial neural network
Qattan, Nizar A.
In this study, we predict the failure rate of Lockheed C-130 Engine Turbine. More than thirty years of local operational field data were used for failure rate prediction and validation. The Weibull regression model and the Artificial Neural Network model including (feed-forward back-propagation, radial basis neural network, and multilayer perceptron neural network model); will be utilized to perform this study. For this purpose, the thesis will be divided into five major parts. First part deals with Weibull regression model to predict the turbine general failure rate, and the rate of failures that require overhaul maintenance. The second part will cover the Artificial Neural Network (ANN) model utilizing the feed-forward back-propagation algorithm as a learning rule. The MATLAB package will be used in order to build and design a code to simulate the given data, the inputs to the neural network are the independent variables, the output is the general failure rate of the turbine, and the failures which required overhaul maintenance. In the third part we predict the general failure rate of the turbine and the failures which require overhaul maintenance, using radial basis neural network model on MATLAB tool box. In the fourth part we compare the predictions of the feed-forward back-propagation model, with that of Weibull regression model, and radial basis neural network model. The results show that the failure rate predicted by the feed-forward back-propagation artificial neural network model is closer in agreement with radial basis neural network model compared with the actual field-data, than the failure rate predicted by the Weibull model. By the end of the study, we forecast the general failure rate of the Lockheed C-130 Engine Turbine, the failures which required overhaul maintenance and six categorical failures using multilayer perceptron neural network (MLP) model on DTREG commercial software. The results also give an insight into the reliability of the engine
Institute of Scientific and Technical Information of China (English)
CHEN Xi; ZHAO Guo-zhu
2005-01-01
In the paper, an artificial neural network (ANN) method is put forward to optimize melting temperature control, which reveals the nonlinear relationships of tank melting temperature disturbances with secondary wind flow and fuel pressure, implements dynamic feed-forward complementation and dynamic correctional ratio between air and fuel in the main control system. The application to Anhui Fuyang Glass Factory improved the control character of the melting temperature greatly.
Comparison Of Power Quality Disturbances Classification Based On Neural Network
Directory of Open Access Journals (Sweden)
Nway Nway Kyaw Win
2015-07-01
Full Text Available Abstract Power quality disturbances PQDs result serious problems in the reliability safety and economy of power system network. In order to improve electric power quality events the detection and classification of PQDs must be made type of transient fault. Software analysis of wavelet transform with multiresolution analysis MRA algorithm and feed forward neural network probabilistic and multilayer feed forward neural network based methodology for automatic classification of eight types of PQ signals flicker harmonics sag swell impulse fluctuation notch and oscillatory will be presented. The wavelet family Db4 is chosen in this system to calculate the values of detailed energy distributions as input features for classification because it can perform well in detecting and localizing various types of PQ disturbances. This technique classifies the types of PQDs problem sevents.The classifiers classify and identify the disturbance type according to the energy distribution. The results show that the PNN can analyze different power disturbance types efficiently. Therefore it can be seen that PNN has better classification accuracy than MLFF.
Sondhiya, Deepak Kumar; Gwal, Ashok Kumar; Verma, Shivali; Kasde, Satish Kumar
Abstract: In this paper, a wavelet-based neural network system for the detection and identification of four types of VLF whistler’s transients (i.e. dispersive, diffuse, spiky and multipath) is implemented and tested. The discrete wavelet transform (DWT) technique is integrated with the feed forward neural network (FFNN) model to construct the identifier. First, the multi-resolution analysis (MRA) technique of DWT and the Parseval’s theorem are employed to extract the characteristics features of the transients at different resolution levels. Second, the FFNN identifies these extracted features to identify the transients according to the features extracted. The proposed methodology can reduce a great quantity of the features of transients without losing its original property; less memory space and computing time are required. Various transient events are tested; the results show that the identifier can detect whistler transients efficiently. Keywords: Discrete wavelets transform, Multi-resolution analysis, Parseval’s theorem and Feed forward neural network
An Artificial Neural Network for Data Forecasting Purposes
Directory of Open Access Journals (Sweden)
Catalina Lucia COCIANU
2015-01-01
Full Text Available Considering the fact that markets are generally influenced by different external factors, the stock market prediction is one of the most difficult tasks of time series analysis. The research reported in this paper aims to investigate the potential of artificial neural networks (ANN in solving the forecast task in the most general case, when the time series are non-stationary. We used a feed-forward neural architecture: the nonlinear autoregressive network with exogenous inputs. The network training function used to update the weight and bias parameters corresponds to gradient descent with adaptive learning rate variant of the backpropagation algorithm. The results obtained using this technique are compared with the ones resulted from some ARIMA models. We used the mean square error (MSE measure to evaluate the performances of these two models. The comparative analysis leads to the conclusion that the proposed model can be successfully applied to forecast the financial data.
A dendritic lattice neural network for color image segmentation
Urcid, Gonzalo; Lara-Rodríguez, Luis David; López-Meléndez, Elizabeth
2015-09-01
A two-layer dendritic lattice neural network is proposed to segment color images in the Red-Green-Blue (RGB) color space. The two layer neural network is a fully interconnected feed forward net consisting of an input layer that receives color pixel values, an intermediate layer that computes pixel interdistances, and an output layer used to classify colors by hetero-association. The two-layer net is first initialized with a finite small subset of the colors present in the input image. These colors are obtained by means of an automatic clustering procedure such as k-means or fuzzy c-means. In the second stage, the color image is scanned on a pixel by pixel basis where each picture element is treated as a vector and feeded into the network. For illustration purposes we use public domain color images to show the performance of our proposed image segmentation technique.
APPLIED CRYPTOGRAPHY IN PASSWORD ENCRYPTION USING NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Venkata Karthik Gullapalli
2015-09-01
Full Text Available Today the world depends on computers and information systems for processing information in various fields. These systems must be developed in such a way that they are less vulnerable to attacks and more reliable and secured. These systems are more vulnerable to technical issues and many cases of data trawling have been reported as a result of password breaches. Encryption and decryption plays a major role in the modern era as the rate of data flow increased tremendously. Social networking sites such as Facebook and Google stores the most important and private data of people electronically in the servers. Artificial intelligence took over many functions of computer systems in different fields including data security. Neural networks process information with care and certainty like human mind does. This paper proposes a methodology to implement encryption and decryption using the feed forward neural networks and to improve the security of information systems.
Khaled Mammar; Abdelkader Chaker
2012-01-01
The paper is focused especially on presenting possibilities of applying artificial neural networks at creating the optimal model PEM fuel cell. Various ANN approaches have been tested; the back-propagation feed-forward networks show satisfactory performance with regard to cell voltage prediction. The model is then used in a power system for residential application. This models include an ANN fuel cell stack model, reformer model and DC/AC inverter model. Furthermore a neural network (NNTC) an...
Energy Technology Data Exchange (ETDEWEB)
Meier, E.; Morgan, M. J.; Biedron, S. G.; LeBlanc, G.; Wu, J. (OTD-ESE); (Monash Univ.); (Australian Synchrotron Project); (SLAC National Accelerator Lab.)
2009-01-01
This paper describes the implementation of a neural network hybrid controller for energy stabilization at the Australian Synchrotron Linac. The structure of the controller consists of a neural network (NNET) feed forward control, augmented by a conventional Proportional-Integral (PI) feedback controller to ensure stability of the system. The system is provided with past states of the machine in order to predict its future state, and therefore apply appropriate feed forward control. The NNET is able to cancel multiple frequency jitter in real-time. When it is not performing optimally due to jitter changes, the system can successfully be augmented by the PI controller to attenuate the remaining perturbations. With a view to control the energy and bunch length at the FERMI{at}Elettra Free Electron Laser (FEL), the present study considers a neural network hybrid feed forward-feedback type of control to rectify limitations related to feedback systems, such as poor response for high jitter frequencies or limited bandwidth, while ensuring robustness of control. The Australian Synchrotron Linac is equipped with a beam position monitor (BPM), that was provided by Sincrotrone Trieste from a former transport line thus allowing energy measurements and energy control experiments. The present study will consequently focus on correcting energy jitter induced by variations in klystron phase and voltage.
Neural Networks: Implementations and Applications
Vonk, E.; Veelenturf, L.P.J.; Jain, L.C.
1996-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
Neural Networks: Implementations and Applications
Vonk, E.; Veelenturf, L.P.J.; Jain, L.C.
1996-01-01
Artificial neural networks, also called neural networks, have been used successfully in many fields including engineering, science and business. This paper presents the implementation of several neural network simulators and their applications in character recognition and other engineering areas
Forecasting the Tehran Stock Market by Artificial Neural Network
Directory of Open Access Journals (Sweden)
Reza Aghababaeyan
2011-09-01
Full Text Available One of the most important problems in modern finance is finding efficient ways to summarize and visualize the stock market data to give individuals or institutions useful information about the market behavior for investment decisions. The enormous amount of valuable data generated by the stock market has attracted researchers to explore this problem domain using different methodologies. Potential significant benefits of solving these problems motivated extensive research for years. In this paper, computational data mining methodology was used to predict seven major stock market indexes. Two learning algorithms including Linear Regression and Neural Network Standard feed-forward back prop (FFB were tested and compared. The models were trained from four years of historical data from March 2007 to February 2011 in order to predict the major stock prices indexes in the Iran (Tehran Stock Exchange. The performance of these prediction models was evaluated using two widely used statistical metrics. We can show that using Neural Network Standard feed-forward back prop (FFB algorithm resulted in better prediction accuracy. In addition, traditional knowledge shows that a longer training period with more training data could help to build a more accurate prediction model. However, as the stock market in Iran has been highly fluctuating in the past two years, this paper shows that data collected from a closer and shorter period could help to reduce the prediction error for such highly speculated fast changing environment.
D Coordinate Transformation Using Artificial Neural Networks
Konakoglu, B.; Cakır, L.; Gökalp, E.
2016-10-01
Two coordinate systems used in Turkey, namely the ED50 (European Datum 1950) and ITRF96 (International Terrestrial Reference Frame 1996) coordinate systems. In most cases, it is necessary to conduct transformation from one coordinate system to another. The artificial neural network (ANN) is a new method for coordinate transformation. One of the biggest advantages of the ANN is that it can determine the relationship between two coordinate systems without a mathematical model. The aim of this study was to investigate the performances of three different ANN models (Feed Forward Back Propagation (FFBP), Cascade Forward Back Propagation (CFBP) and Radial Basis Function Neural Network (RBFNN)) with regard to 2D coordinate transformation. To do this, three data sets were used for the same study area, the city of Trabzon. The coordinates of data sets were measured in the ED50 and ITRF96 coordinate systems by using RTK-GPS technique. Performance of each transformation method was investigated by using the coordinate differences between the known and estimated coordinates. The results showed that the ANN algorithms can be used for 2D coordinate transformation in cases where optimum model parameters are selected.
Mandarin Chinese Tone Recognition with an Artificial Neural Network
Institute of Scientific and Technical Information of China (English)
XU Li; ZHANG Wenle; ZHOU Ning; LEE Chaoyang; LI Yongxin; CHEN Xiuwu; ZHAO Xiaoyan
2006-01-01
Mandarin Chinese tone patterns vary in one of the four ways, i.e, (1) high level; (2) rising; (3) low falling and rising; and (4) high falling. The present study is to examine the efficacy of an artificial neural network in recognizing these tone patterns. Speech data were recorded from 12 children (3-6 years of age) and 15 adults. All subjects were native Mandarin Chinese speakers. The fundamental frequencies (FO) of each monosyllabic word of the speech data were extracted with an autocorrelation method. The pitch data(i.e., the FO contours) were the inputs to a feed-forward backpropagation artificial neural network. The number of inputs to the neural network varied from 1 to 16 and the hidden layer of the network contained neurons that varied from 1 to 16 in number. The output of the network consisted of four neurons representing the four tone patterns of Mandarin Chinese. After being trained with the Levenberg-Marquardt optimization, the neural network was able to successfully classify the tone patterns with an accuracy of about 90% correct for speech samples from both adults and children. The artificial neural network may provide an objective and effective way of assessing tone production in prelingually-deafened children who have received cochlear implants.
Using Feature Weights to Improve Performance of Neural Networks
Iqbal, Ridwan Al
2011-01-01
Different features have different relevance to a particular learning problem. Some features are less relevant; while some very important. Instead of selecting the most relevant features using feature selection, an algorithm can be given this knowledge of feature importance based on expert opinion or prior learning. Learning can be faster and more accurate if learners take feature importance into account. Correlation aided Neural Networks (CANN) is presented which is such an algorithm. CANN treats feature importance as the correlation coefficient between the target attribute and the features. CANN modifies normal feed-forward Neural Network to fit both correlation values and training data. Empirical evaluation shows that CANN is faster and more accurate than applying the two step approach of feature selection and then using normal learning algorithms.
Diagonal Based Feature Extraction for Handwritten Alphabets Recognition System using Neural Network
Pradeep, J; Himavathi, S; 10.5121/ijcsit.2011.3103
2011-01-01
An off-line handwritten alphabetical character recognition system using multilayer feed forward neural network is described in the paper. A new method, called, diagonal based feature extraction is introduced for extracting the features of the handwritten alphabets. Fifty data sets, each containing 26 alphabets written by various people, are used for training the neural network and 570 different handwritten alphabetical characters are used for testing. The proposed recognition system performs quite well yielding higher levels of recognition accuracy compared to the systems employing the conventional horizontal and vertical methods of feature extraction. This system will be suitable for converting handwritten documents into structural text form and recognizing handwritten names.
Neural networks within multi-core optic fibers.
Cohen, Eyal; Malka, Dror; Shemer, Amir; Shahmoon, Asaf; Zalevsky, Zeev; London, Michael
2016-07-07
Hardware implementation of artificial neural networks facilitates real-time parallel processing of massive data sets. Optical neural networks offer low-volume 3D connectivity together with large bandwidth and minimal heat production in contrast to electronic implementation. Here, we present a conceptual design for in-fiber optical neural networks. Neurons and synapses are realized as individual silica cores in a multi-core fiber. Optical signals are transferred transversely between cores by means of optical coupling. Pump driven amplification in erbium-doped cores mimics synaptic interactions. We simulated three-layered feed-forward neural networks and explored their capabilities. Simulations suggest that networks can differentiate between given inputs depending on specific configurations of amplification; this implies classification and learning capabilities. Finally, we tested experimentally our basic neuronal elements using fibers, couplers, and amplifiers, and demonstrated that this configuration implements a neuron-like function. Therefore, devices similar to our proposed multi-core fiber could potentially serve as building blocks for future large-scale small-volume optical artificial neural networks.
Neural networks within multi-core optic fibers
Cohen, Eyal; Malka, Dror; Shemer, Amir; Shahmoon, Asaf; Zalevsky, Zeev; London, Michael
2016-07-01
Hardware implementation of artificial neural networks facilitates real-time parallel processing of massive data sets. Optical neural networks offer low-volume 3D connectivity together with large bandwidth and minimal heat production in contrast to electronic implementation. Here, we present a conceptual design for in-fiber optical neural networks. Neurons and synapses are realized as individual silica cores in a multi-core fiber. Optical signals are transferred transversely between cores by means of optical coupling. Pump driven amplification in erbium-doped cores mimics synaptic interactions. We simulated three-layered feed-forward neural networks and explored their capabilities. Simulations suggest that networks can differentiate between given inputs depending on specific configurations of amplification; this implies classification and learning capabilities. Finally, we tested experimentally our basic neuronal elements using fibers, couplers, and amplifiers, and demonstrated that this configuration implements a neuron-like function. Therefore, devices similar to our proposed multi-core fiber could potentially serve as building blocks for future large-scale small-volume optical artificial neural networks.
DEFF Research Database (Denmark)
Krogh, Anders Stærmose; Riis, Søren Kamaric
1999-01-01
A general framework for hybrids of hidden Markov models (HMMs) and neural networks (NNs) called hidden neural networks (HNNs) is described. The article begins by reviewing standard HMMs and estimation by conditional maximum likelihood, which is used by the HNN. In the HNN, the usual HMM probability...... parameters are replaced by the outputs of state-specific neural networks. As opposed to many other hybrids, the HNN is normalized globally and therefore has a valid probabilistic interpretation. All parameters in the HNN are estimated simultaneously according to the discriminative conditional maximum...... likelihood criterion. The HNN can be viewed as an undirected probabilistic independence network (a graphical model), where the neural networks provide a compact representation of the clique functions. An evaluation of the HNN on the task of recognizing broad phoneme classes in the TIMIT database shows clear...
A hardware implementation of artificial neural networks using field programmable gate arrays
Won, E.
2007-11-01
An artificial neural network algorithm is implemented using a low-cost field programmable gate array hardware. One hidden layer is used in the feed-forward neural network structure in order to discriminate one class of patterns from the other class in real time. In this work, the training of the network is performed in the off-line computing environment and the results of the training are configured to the hardware in order to minimize the latency of the neural computation. With five 8-bit input patterns, six hidden nodes, and one 8-bit output, the implemented hardware neural network makes decisions on a set of input patterns in 11 clock cycles, or less than 200 ns with a 60 MHz clock. The result from the hardware neural computation is well predictable based on the off-line computation. This implementation may be used in level 1 hardware triggers in high energy physics experiments.
DEFF Research Database (Denmark)
Hansen, Lars Kai; Salamon, Peter
1990-01-01
We propose several means for improving the performance an training of neural networks for classification. We use crossvalidation as a tool for optimizing network parameters and architecture. We show further that the remaining generalization error can be reduced by invoking ensembles of similar...... networks....
The Use of Neural Network Technology to Model Swimming Performance
Silva, António José; Costa, Aldo Manuel; Oliveira, Paulo Moura; Reis, Victor Machado; Saavedra, José; Perl, Jurgen; Rouboa, Abel; Marinho, Daniel Almeida
2007-01-01
The aims of the present study were: to identify the factors which are able to explain the performance in the 200 meters individual medley and 400 meters front crawl events in young swimmers, to model the performance in those events using non-linear mathematic methods through artificial neural networks (multi-layer perceptrons) and to assess the neural network models precision to predict the performance. A sample of 138 young swimmers (65 males and 73 females) of national level was submitted to a test battery comprising four different domains: kinanthropometric evaluation, dry land functional evaluation (strength and flexibility), swimming functional evaluation (hydrodynamics, hydrostatic and bioenergetics characteristics) and swimming technique evaluation. To establish a profile of the young swimmer non-linear combinations between preponderant variables for each gender and swim performance in the 200 meters medley and 400 meters font crawl events were developed. For this purpose a feed forward neural network was used (Multilayer Perceptron) with three neurons in a single hidden layer. The prognosis precision of the model (error lower than 0.8% between true and estimated performances) is supported by recent evidence. Therefore, we consider that the neural network tool can be a good approach in the resolution of complex problems such as performance modeling and the talent identification in swimming and, possibly, in a wide variety of sports. Key pointsThe non-linear analysis resulting from the use of feed forward neural network allowed us the development of four performance models.The mean difference between the true and estimated results performed by each one of the four neural network models constructed was low.The neural network tool can be a good approach in the resolution of the performance modeling as an alternative to the standard statistical models that presume well-defined distributions and independence among all inputs.The use of neural networks for sports
Critical Branching Neural Networks
Kello, Christopher T.
2013-01-01
It is now well-established that intrinsic variations in human neural and behavioral activity tend to exhibit scaling laws in their fluctuations and distributions. The meaning of these scaling laws is an ongoing matter of debate between isolable causes versus pervasive causes. A spiking neural network model is presented that self-tunes to critical…
Critical Branching Neural Networks
Kello, Christopher T.
2013-01-01
It is now well-established that intrinsic variations in human neural and behavioral activity tend to exhibit scaling laws in their fluctuations and distributions. The meaning of these scaling laws is an ongoing matter of debate between isolable causes versus pervasive causes. A spiking neural network model is presented that self-tunes to critical…
Input data preprocessing method for exchange rate forecasting via neural network
Directory of Open Access Journals (Sweden)
Antić Dragan S.
2014-01-01
Full Text Available The aim of this paper is to present a method for neural network input parameters selection and preprocessing. The purpose of this network is to forecast foreign exchange rates using artificial intelligence. Two data sets are formed for two different economic systems. Each system is represented by six categories with 70 economic parameters which are used in the analysis. Reduction of these parameters within each category was performed by using the principal component analysis method. Component interdependencies are established and relations between them are formed. Newly formed relations were used to create input vectors of a neural network. The multilayer feed forward neural network is formed and trained using batch training. Finally, simulation results are presented and it is concluded that input data preparation method is an effective way for preprocessing neural network data. [Projekat Ministarstva nauke Republike Srbije, br.TR 35005, br. III 43007 i br. III 44006
Jamil, Majid; Sharma, Sanjeev Kumar; Singh, Rajveer
2015-01-01
This paper focuses on the detection and classification of the faults on electrical power transmission line using artificial neural networks. The three phase currents and voltages of one end are taken as inputs in the proposed scheme. The feed forward neural network along with back propagation algorithm has been employed for detection and classification of the fault for analysis of each of the three phases involved in the process. A detailed analysis with varying number of hidden layers has been performed to validate the choice of the neural network. The simulation results concluded that the present method based on the neural network is efficient in detecting and classifying the faults on transmission lines with satisfactory performances. The different faults are simulated with different parameters to check the versatility of the method. The proposed method can be extended to the Distribution network of the Power System. The various simulations and analysis of signals is done in the MATLAB(®) environment.
Precipitation Nowcast using Deep Recurrent Neural Network
Akbari Asanjan, A.; Yang, T.; Gao, X.; Hsu, K. L.; Sorooshian, S.
2016-12-01
An accurate precipitation nowcast (0-6 hours) with a fine temporal and spatial resolution has always been an important prerequisite for flood warning, streamflow prediction and risk management. Most of the popular approaches used for forecasting precipitation can be categorized into two groups. One type of precipitation forecast relies on numerical modeling of the physical dynamics of atmosphere and another is based on empirical and statistical regression models derived by local hydrologists or meteorologists. Given the recent advances in artificial intelligence, in this study a powerful Deep Recurrent Neural Network, termed as Long Short-Term Memory (LSTM) model, is creatively used to extract the patterns and forecast the spatial and temporal variability of Cloud Top Brightness Temperature (CTBT) observed from GOES satellite. Then, a 0-6 hours precipitation nowcast is produced using a Precipitation Estimation from Remote Sensing Information using Artificial Neural Network (PERSIANN) algorithm, in which the CTBT nowcast is used as the PERSIANN algorithm's raw inputs. Two case studies over the continental U.S. have been conducted that demonstrate the improvement of proposed approach as compared to a classical Feed Forward Neural Network and a couple simple regression models. The advantages and disadvantages of the proposed method are summarized with regard to its capability of pattern recognition through time, handling of vanishing gradient during model learning, and working with sparse data. The studies show that the LSTM model performs better than other methods, and it is able to learn the temporal evolution of the precipitation events through over 1000 time lags. The uniqueness of PERSIANN's algorithm enables an alternative precipitation nowcast approach as demonstrated in this study, in which the CTBT prediction is produced and used as the inputs for generating precipitation nowcast.
A Neural Network Approach for GMA Butt Joint Welding
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2003-01-01
squares has been used with the back-propagation algorithm for training the network, while a Bayesian regularization technique has been successfully applied for minimizing the risk of inexpedient over-training. Finally, a predictive closed-loop control strategy based on a so-called single-neuron self......This paper describes the application of the neural network technology for gas metal arc welding (GMAW) control. A system has been developed for modeling and online adjustment of welding parameters, appropriate to guarantee a certain degree of quality in the field of butt joint welding with full...... penetration, when the gap width is varying during the welding process. The process modeling to facilitate the mapping from joint geometry and reference weld quality to significant welding parameters has been based on a multi-layer feed-forward network. The Levenberg-Marquardt algorithm for non-linear least...
Analyzing rocket plume spectral data with neural networks
Whitaker, Kevin W.; Krishnakumar, K. S.; Benzing, Daniel A.
1995-01-01
The Optical Plume Anomaly Detection (OPAD) system is under development to provide early-warning failure detection in support of ground-level testing of the Space Shuttle Main Engine (SSME). Failure detection is to be achieved through the acquisition of spectrally resolved plume emissions and subsequent identification of abnormal levels indicative of engine corrosion or component failure. Two computer codes (one linear and the other non-linear) are used by the OPAD system to iteratively determine specific element concentrations in the SSME plume, given emission intensity and wavelength information. Since this analysis is extremely labor intensive, a study was initiated to develop neural networks that would model the 'inverse' of these computer codes. Optimally connected feed-forward networks with imperceptible prediction error have been developed for each element modeled by the linear code, SPECTRA4. Radial basis function networks were developed for the non-linear code, SPECTRA5, and predict combustion temperature in addition to element concentrations.
Analyzing rocket plume spectral data with neural networks
Energy Technology Data Exchange (ETDEWEB)
Whitaker, K.W.; Krishnakumar, K.S.; Benzing, D.A.
1995-09-01
The Optical Plume Anomaly Detection (OPAD) system is under development to provide early-warning failure detection in support of ground-level testing of the Space Shuttle Main Engine (SSME). Failure detection is to be achieved through the acquisition of spectrally resolved plume emissions and subsequent identification of abnormal levels indicative of engine corrosion or component failure. Two computer codes (one linear and the other non-linear) are used by the OPAD system to iteratively determine specific element concentrations in the SSME plume, given emission intensity and wavelength information. Since this analysis is extremely labor intensive, a study was initiated to develop neural networks that would model the `inverse` of these computer codes. Optimally connected feed-forward networks with imperceptible prediction error have been developed for each element modeled by the linear code, SPECTRA4. Radial basis function networks were developed for the non-linear code, SPECTRA5, and predict combustion temperature in addition to element concentrations.
Analyzing rocket plume spectral data with neural networks
Whitaker, Kevin W.; Krishnakumar, K. S.; Benzing, Daniel A.
The Optical Plume Anomaly Detection (OPAD) system is under development to provide early-warning failure detection in support of ground-level testing of the Space Shuttle Main Engine (SSME). Failure detection is to be achieved through the acquisition of spectrally resolved plume emissions and subsequent identification of abnormal levels indicative of engine corrosion or component failure. Two computer codes (one linear and the other non-linear) are used by the OPAD system to iteratively determine specific element concentrations in the SSME plume, given emission intensity and wavelength information. Since this analysis is extremely labor intensive, a study was initiated to develop neural networks that would model the 'inverse' of these computer codes. Optimally connected feed-forward networks with imperceptible prediction error have been developed for each element modeled by the linear code, SPECTRA4. Radial basis function networks were developed for the non-linear code, SPECTRA5, and predict combustion temperature in addition to element concentrations.
Backpropagation Artificial Neural Network To Detect Hyperthermic Seizures In Rats
Directory of Open Access Journals (Sweden)
Rakesh Kumar Sinha
2003-02-01
Full Text Available A three-layered feed-forward back-propagation Artificial Neural Network was used to classify the seizure episodes in rats. Seizure patterns were induced by subjecting anesthetized rats to a Biological Oxygen Demand incubator at 45-47ºC for 30 to 60 minutes. Selected fast Fourier transform data of one second epochs of electroencephalogram were used to train and test the network for the classification of seizure and normal patterns. The results indicate that the present network with the architecture of 40-12-1 (input-hidden-output nodes agrees with manual scoring of seizure and normal patterns with a high recognition rate of 98.6%.
Unlearning in feed-forward multi-nets
Spaanenburg, L; Kurkova,; Steele, NC; Neruda, R; Karny, M
2001-01-01
Multi-nets promise an improved performance over monolithic neural networks by virtue of their distributed implementation. Modular neural networks are multi-nets based on an judicious assembly of functionally different parts. This can be viewed as again a monolithic network, but with more complex neu
Neural networks and graph theory
Institute of Scientific and Technical Information of China (English)
许进; 保铮
2002-01-01
The relationships between artificial neural networks and graph theory are considered in detail. The applications of artificial neural networks to many difficult problems of graph theory, especially NP-complete problems, and the applications of graph theory to artificial neural networks are discussed. For example graph theory is used to study the pattern classification problem on the discrete type feedforward neural networks, and the stability analysis of feedback artificial neural networks etc.
Neural Network Control of a Magnetically Suspended Rotor System
Choi, Benjamin B.
1998-01-01
Magnetic bearings offer significant advantages because they do not come into contact with other parts during operation, which can reduce maintenance. Higher speeds, no friction, no lubrication, weight reduction, precise position control, and active damping make them far superior to conventional contact bearings. However, there are technical barriers that limit the application of this technology in industry. One of them is the need for a nonlinear controller that can overcome the system nonlinearity and uncertainty inherent in magnetic bearings. At the NASA Lewis Research Center, a neural network was selected as a nonlinear controller because it generates a neural model without any detailed information regarding the internal working of the magnetic bearing system. It can be used even for systems that are too complex for an accurate system model to be derived. A feed-forward architecture with a back-propagation learning algorithm was selected because of its proven performance, accuracy, and relatively easy implementation.
Somatosensory integration controlled by dynamic thalamocortical feed-forward inhibition.
Gabernet, Laetitia; Jadhav, Shantanu P; Feldman, Daniel E; Carandini, Matteo; Scanziani, Massimo
2005-10-20
The temporal features of tactile stimuli are faithfully represented by the activity of neurons in the somatosensory cortex. However, the cellular mechanisms that enable cortical neurons to report accurate temporal information are not known. Here, we show that in the rodent barrel cortex, the temporal window for integration of thalamic inputs is under the control of thalamocortical feed-forward inhibition and can vary from 1 to 10 ms. A single thalamic fiber can trigger feed-forward inhibition and contacts both excitatory and inhibitory cortical neurons. The dynamics of feed-forward inhibition exceed those of each individual synapse in the circuit and are captured by a simple disynaptic model of the thalamocortical projection. The variations in the integration window produce changes in the temporal precision of cortical responses to whisker stimulation. Hence, feed-forward inhibitory circuits, classically known to sharpen spatial contrast of tactile inputs, also increase the temporal resolution in the somatosensory cortex.
Neural networks in seismic discrimination
Energy Technology Data Exchange (ETDEWEB)
Dowla, F.U.
1995-01-01
Neural networks are powerful and elegant computational tools that can be used in the analysis of geophysical signals. At Lawrence Livermore National Laboratory, we have developed neural networks to solve problems in seismic discrimination, event classification, and seismic and hydrodynamic yield estimation. Other researchers have used neural networks for seismic phase identification. We are currently developing neural networks to estimate depths of seismic events using regional seismograms. In this paper different types of network architecture and representation techniques are discussed. We address the important problem of designing neural networks with good generalization capabilities. Examples of neural networks for treaty verification applications are also described.
IMPLEMENTATION OF ARTIFICIAL NEURAL NETWORK FOR FACE RECOGNITION USING GABOR FEATURE EXTRACTION
Directory of Open Access Journals (Sweden)
Muthukannan K
2013-11-01
Full Text Available Face detection and recognition is the first step for many applications in various fields such as identification and is used as a key to enter into the various electronic devices, video surveillance, and human computer interface and image database management. This paper focuses on feature extraction in an image using Gabor filter and the extracted image feature vector is then given as an input to the neural network. The neural network is trained with the input data. The Gabor wavelet concentrates on the important components of the face including eye, mouth, nose, cheeks. The main requirement of this technique is the threshold, which gives privileged sensitivity. The threshold values are the feature vectors taken from the faces. These feature vectors are given into the feed forward neural network to train the network. Using the feed forward neural network as a classifier, the recognized and unrecognized faces are classified. This classifier attains a higher face deduction rate. By training more input vectors the system proves to be effective. The effectiveness of the proposed method is demonstrated by the experimental results.
Feed-Forward versus Feedback Inhibition in a Basic Olfactory Circuit.
Directory of Open Access Journals (Sweden)
Tiffany Kee
2015-10-01
Full Text Available Inhibitory interneurons play critical roles in shaping the firing patterns of principal neurons in many brain systems. Despite difference in the anatomy or functions of neuronal circuits containing inhibition, two basic motifs repeatedly emerge: feed-forward and feedback. In the locust, it was proposed that a subset of lateral horn interneurons (LHNs, provide feed-forward inhibition onto Kenyon cells (KCs to maintain their sparse firing--a property critical for olfactory learning and memory. But recently it was established that a single inhibitory cell, the giant GABAergic neuron (GGN, is the main and perhaps sole source of inhibition in the mushroom body, and that inhibition from this cell is mediated by a feedback (FB loop including KCs and the GGN. To clarify basic differences in the effects of feedback vs. feed-forward inhibition in circuit dynamics we here use a model of the locust olfactory system. We found both inhibitory motifs were able to maintain sparse KCs responses and provide optimal odor discrimination. However, we further found that only FB inhibition could create a phase response consistent with data recorded in vivo. These findings describe general rules for feed-forward versus feedback inhibition and suggest GGN is potentially capable of providing the primary source of inhibition to the KCs. A better understanding of how inhibitory motifs impact post-synaptic neuronal activity could be used to reveal unknown inhibitory structures within biological networks.
2010-01-01
Back-propagation with gradient method is the most popular learning algorithm for feed-forward neural networks. However, it is critical to determine a proper fixed learning rate for the algorithm. In this paper, an optimized recursive algorithm is presented for online learning based on matrix operation and optimization methods analytically, which can avoid the trouble to select a proper learning rate for the gradient method. The proof of weak convergence of the proposed algorithm also is given...
Xi, Jun; Xue, Yujing; Xu, Yinxiang; Shen, Yuhong
2013-11-01
In this study, the ultrahigh pressure extraction of green tea polyphenols was modeled and optimized by a three-layer artificial neural network. A feed-forward neural network trained with an error back-propagation algorithm was used to evaluate the effects of pressure, liquid/solid ratio and ethanol concentration on the total phenolic content of green tea extracts. The neural network coupled with genetic algorithms was also used to optimize the conditions needed to obtain the highest yield of tea polyphenols. The obtained optimal architecture of artificial neural network model involved a feed-forward neural network with three input neurons, one hidden layer with eight neurons and one output layer including single neuron. The trained network gave the minimum value in the MSE of 0.03 and the maximum value in the R(2) of 0.9571, which implied a good agreement between the predicted value and the actual value, and confirmed a good generalization of the network. Based on the combination of neural network and genetic algorithms, the optimum extraction conditions for the highest yield of green tea polyphenols were determined as follows: 498.8 MPa for pressure, 20.8 mL/g for liquid/solid ratio and 53.6% for ethanol concentration. The total phenolic content of the actual measurement under the optimum predicated extraction conditions was 582.4 ± 0.63 mg/g DW, which was well matched with the predicted value (597.2mg/g DW). This suggests that the artificial neural network model described in this work is an efficient quantitative tool to predict the extraction efficiency of green tea polyphenols. Crown Copyright © 2013. Published by Elsevier Ltd. All rights reserved.
Fuzzy Multiresolution Neural Networks
Ying, Li; Qigang, Shang; Na, Lei
A fuzzy multi-resolution neural network (FMRANN) based on particle swarm algorithm is proposed to approximate arbitrary nonlinear function. The active function of the FMRANN consists of not only the wavelet functions, but also the scaling functions, whose translation parameters and dilation parameters are adjustable. A set of fuzzy rules are involved in the FMRANN. Each rule either corresponding to a subset consists of scaling functions, or corresponding to a sub-wavelet neural network consists of wavelets with same dilation parameters. Incorporating the time-frequency localization and multi-resolution properties of wavelets with the ability of self-learning of fuzzy neural network, the approximation ability of FMRANN can be remarkable improved. A particle swarm algorithm is adopted to learn the translation and dilation parameters of the wavelets and adjusting the shape of membership functions. Simulation examples are presented to validate the effectiveness of FMRANN.
THE USE OF NEURAL NETWORK TECHNOLOGY TO MODEL SWIMMING PERFORMANCE
Directory of Open Access Journals (Sweden)
António José Silva
2007-03-01
Full Text Available The aims of the present study were: to identify the factors which are able to explain the performance in the 200 meters individual medley and 400 meters front crawl events in young swimmers, to model the performance in those events using non-linear mathematic methods through artificial neural networks (multi-layer perceptrons and to assess the neural network models precision to predict the performance. A sample of 138 young swimmers (65 males and 73 females of national level was submitted to a test battery comprising four different domains: kinanthropometric evaluation, dry land functional evaluation (strength and flexibility, swimming functional evaluation (hydrodynamics, hydrostatic and bioenergetics characteristics and swimming technique evaluation. To establish a profile of the young swimmer non-linear combinations between preponderant variables for each gender and swim performance in the 200 meters medley and 400 meters font crawl events were developed. For this purpose a feed forward neural network was used (Multilayer Perceptron with three neurons in a single hidden layer. The prognosis precision of the model (error lower than 0.8% between true and estimated performances is supported by recent evidence. Therefore, we consider that the neural network tool can be a good approach in the resolution of complex problems such as performance modeling and the talent identification in swimming and, possibly, in a wide variety of sports
Rule Extraction:Using Neural Networks or for Neural Networks?
Institute of Scientific and Technical Information of China (English)
Zhi-Hua Zhou
2004-01-01
In the research of rule extraction from neural networks, fidelity describes how well the rules mimic the behavior of a neural network while accuracy describes how well the rules can be generalized. This paper identifies the fidelity-accuracy dilemma. It argues to distinguish rule extraction using neural networks and rule extraction for neural networks according to their different goals, where fidelity and accuracy should be excluded from the rule quality evaluation framework, respectively.
Unsupervised neural networks for solving Troesch's problem
Muhammad, Asif Zahoor Raja
2014-01-01
In this study, stochastic computational intelligence techniques are presented for the solution of Troesch's boundary value problem. The proposed stochastic solvers use the competency of a feed-forward artificial neural network for mathematical modeling of the problem in an unsupervised manner, whereas the learning of unknown parameters is made with local and global optimization methods as well as their combinations. Genetic algorithm (GA) and pattern search (PS) techniques are used as the global search methods and the interior point method (IPM) is used for an efficient local search. The combination of techniques like GA hybridized with IPM (GA-IPM) and PS hybridized with IPM (PS-IPM) are also applied to solve different forms of the equation. A comparison of the proposed results obtained from GA, PS, IPM, PS-IPM and GA-IPM has been made with the standard solutions including well known analytic techniques of the Adomian decomposition method, the variational iterational method and the homotopy perturbation method. The reliability and effectiveness of the proposed schemes, in term of accuracy and convergence, are evaluated from the results of statistical analysis based on sufficiently large independent runs.
Neural network surface acoustic wave RF signal processor for digital modulation recognition.
Kavalov, Dimitar; Kalinin, Victor
2002-09-01
An architecture of a surface acoustic wave (SAW) processor based on an artificial neural network is proposed for an automatic recognition of different types of digital passband modulation. Three feed-forward networks are trained to recognize filtered and unfiltered binary phase shift keying (BPSK) and quadrature phase shift keying (QPSK) signals, as well as unfiltered BPSK, QPSK, and 16 quadrature amplitude (16QAM) signals. Performance of the processor in the presence of additive white Gaussian noise (AWGN) is simulated. The influence of second-order effects in SAW devices, phase, and amplitude errors on the performance of the processor also is studied.
Time-of-flight discrimination between gamma-rays and neutrons by neural networks
2012-01-01
In gamma-ray spectroscopy, a number of neutrons are emitted from the nuclei together with the gamma-rays and these neutrons influence gamma-ray spectra. An obvious method of separating between neutrons and gamma-rays is based on the time-of-flight (tof) technique. This work aims obtaining tof distributions of gamma-rays and neutrons by using feed-forward artificial neural network (ANN). It was shown that, ANN can correctly classify gamma-ray and neutron events. Testing of trained networks on ...
Compressing Convolutional Neural Networks
Chen, Wenlin; Wilson, James T.; Tyree, Stephen; Weinberger, Kilian Q.; Chen, Yixin
2015-01-01
Convolutional neural networks (CNN) are increasingly used in many areas of computer vision. They are particularly attractive because of their ability to "absorb" great quantities of labeled data through millions of parameters. However, as model sizes increase, so do the storage and memory requirements of the classifiers. We present a novel network architecture, Frequency-Sensitive Hashed Nets (FreshNets), which exploits inherent redundancy in both convolutional layers and fully-connected laye...
Artificial neural network modelling
Samarasinghe, Sandhya
2016-01-01
This book covers theoretical aspects as well as recent innovative applications of Artificial Neural networks (ANNs) in natural, environmental, biological, social, industrial and automated systems. It presents recent results of ANNs in modelling small, large and complex systems under three categories, namely, 1) Networks, Structure Optimisation, Robustness and Stochasticity 2) Advances in Modelling Biological and Environmental Systems and 3) Advances in Modelling Social and Economic Systems. The book aims at serving undergraduates, postgraduates and researchers in ANN computational modelling. .
Critical branching neural networks.
Kello, Christopher T
2013-01-01
It is now well-established that intrinsic variations in human neural and behavioral activity tend to exhibit scaling laws in their fluctuations and distributions. The meaning of these scaling laws is an ongoing matter of debate between isolable causes versus pervasive causes. A spiking neural network model is presented that self-tunes to critical branching and, in doing so, simulates observed scaling laws as pervasive to neural and behavioral activity. These scaling laws are related to neural and cognitive functions, in that critical branching is shown to yield spiking activity with maximal memory and encoding capacities when analyzed using reservoir computing techniques. The model is also shown to account for findings of pervasive 1/f scaling in speech and cued response behaviors that are difficult to explain by isolable causes. Issues and questions raised by the model and its results are discussed from the perspectives of physics, neuroscience, computer and information sciences, and psychological and cognitive sciences.
A Global Model of $\\beta^-$-Decay Half-Lives Using Neural Networks
Costiris, N; Gernoth, K A; Mavrommatis, E
2007-01-01
Statistical modeling of nuclear data using artificial neural networks (ANNs) and, more recently, support vector machines (SVMs), is providing novel approaches to systematics that are complementary to phenomenological and semi-microscopic theories. We present a global model of $\\beta^-$-decay halflives of the class of nuclei that decay 100% by $\\beta^-$ mode in their ground states. A fully-connected multilayered feed forward network has been trained using the Levenberg-Marquardt algorithm, Bayesian regularization, and cross-validation. The halflife estimates generated by the model are discussed and compared with the available experimental data, with previous results obtained with neural networks, and with estimates coming from traditional global nuclear models. Predictions of the new neural-network model are given for nuclei far from stability, with particular attention to those involved in r-process nucleosynthesis. This study demonstrates that in the framework of the $\\beta^-$-decay problem considered here, ...
Prediction of operational parameters effect on coal flotation using artificial neural network
Institute of Scientific and Technical Information of China (English)
E. Jorjani; Sh. Mesroghli; S. Chehreh Chelgani
2008-01-01
Artificial neural network procedures were used to predict the combustible value (i.e. 100-Ash) and combustible recovery of coal flotation concentrate in different operational conditions. The pulp density, pH, rotation rate, coal particle size, dosage of collector, frother and conditioner were used as inputs to the network. Feed-forward artificial neural networks with 5-30-2-1 and 7-10-3-1 arrangements were capable to estimate the combustible value and combustible recovery of coal flotation concentrate respectively as the outputs. Quite satisfactory correlations of 1 and 0.91 in training and testing stages for combustible value and of 1 and 0.95 in training and testing stages for combustible recovery prediction were achieved. The proposed neural network models can be used to determine the most advantageous operational conditions for the expected concentrate assay and recovery in the coal flotation process.
Generalized Adaptive Artificial Neural Networks
Tawel, Raoul
1993-01-01
Mathematical model of supervised learning by artificial neural network provides for simultaneous adjustments of both temperatures of neurons and synaptic weights, and includes feedback as well as feedforward synaptic connections. Extension of mathematical model described in "Adaptive Neurons For Artificial Neural Networks" (NPO-17803). Dynamics of neural network represented in new model by less-restrictive continuous formalism.
Analysis of surface ozone using a recurrent neural network.
Biancofiore, Fabio; Verdecchia, Marco; Di Carlo, Piero; Tomassetti, Barbara; Aruffo, Eleonora; Busilacchio, Marcella; Bianco, Sebastiano; Di Tommaso, Sinibaldo; Colangeli, Carlo
2015-05-01
Hourly concentrations of ozone (O₃) and nitrogen dioxide (NO₂) have been measured for 16 years, from 1998 to 2013, in a seaside town in central Italy. The seasonal trends of O₃ and NO₂ recorded in this period have been studied. Furthermore, we used the data collected during one year (2005), to define the characteristics of a multiple linear regression model and a neural network model. Both models are used to model the hourly O₃ concentration, using, two scenarios: 1) in the first as inputs, only meteorological parameters and 2) in the second adding photochemical parameters at those of the first scenario. In order to evaluate the performance of the model four statistical criteria are used: correlation coefficient, fractional bias, normalized mean squared error and a factor of two. All the criteria show that the neural network gives better results, compared to the regression model, in all the model scenarios. Predictions of O₃ have been carried out by many authors using a feed forward neural architecture. In this paper we show that a recurrent architecture significantly improves the performances of neural predictors. Using only the meteorological parameters as input, the recurrent architecture shows performance better than the multiple linear regression model that uses meteorological and photochemical data as input, making the neural network model with recurrent architecture a more useful tool in areas where only weather measurements are available. Finally, we used the neural network model to forecast the O₃ hourly concentrations 1, 3, 6, 12, 24 and 48 h ahead. The performances of the model in predicting O₃ levels are discussed. Emphasis is given to the possibility of using the neural network model in operational ways in areas where only meteorological data are available, in order to predict O₃ also in sites where it has not been measured yet. Copyright © 2015 Elsevier B.V. All rights reserved.
Gupta, S; Gupta, Sanjay
2002-01-01
This paper initiates the study of quantum computing within the constraints of using a polylogarithmic ($O(\\log^k n), k\\geq 1$) number of qubits and a polylogarithmic number of computation steps. The current research in the literature has focussed on using a polynomial number of qubits. A new mathematical model of computation called \\emph{Quantum Neural Networks (QNNs)} is defined, building on Deutsch's model of quantum computational network. The model introduces a nonlinear and irreversible gate, similar to the speculative operator defined by Abrams and Lloyd. The precise dynamics of this operator are defined and while giving examples in which nonlinear Schr\\"{o}dinger's equations are applied, we speculate on its possible implementation. The many practical problems associated with the current model of quantum computing are alleviated in the new model. It is shown that QNNs of logarithmic size and constant depth have the same computational power as threshold circuits, which are used for modeling neural network...
Meetei Mayek Unicode Modeling Using Swarm Intelligence and Neural Networks
Directory of Open Access Journals (Sweden)
Wahengbam Kanan Kumar
2014-04-01
Full Text Available The Different techniques have evolved for better optical character recognition for many scripts, yet very little literature has been found for Meetei Mayek script. The current paper exhibits a new approach to model and simulate handwritten Meetei mayek script by using advanced segmentation tools and recognition algorithms. Preprocessing of the acquired images is needed before segmentation and recognition steps; segmentation is done by using PSOFCM segmentation, while multilayer feed forward neural network with back propagation learning is used for the recognition purpose. It may be noted that PSOFCM segmentation proved useful for MRI image processing in our previous paper, the same technique is used for enhancing the characters. The detailed procedures along with the results are discussed in the sections shown below
Strawberry Maturity Neural Network Detectng System Based on Genetic Algorithm
Xu, Liming
The quick and non-detective detection of agriculture product is one of the measures to increase the precision and productivity of harvesting and grading. Having analyzed H frequency of different maturities in different light intensities, the results show that H frequency for the same maturity has little influence in different light intensities; Under the same light intensity, three strawberry maturities are changing in order. After having confirmed the H frequency section to distinguish the different strawberry maturity, the triplelayer feed-forward neural network system to detect strawberry maturity was designed by using genetic algorithm. The test results show that the detecting precision ratio is 91.7%, it takes 160ms to distinguish one strawberry. Therefore, the online non-detective detecting the strawberry maturity could be realized.
WLAN indoor location method based on artificial neural network
Institute of Scientific and Technical Information of China (English)
Zhou Mu; Sun Ying; Xu Yubin; Deng Zhian; Meng Weixiao
2010-01-01
WLAN indoor location method based on artificial neural network (ANN) is analyzed.A three layer feed-forward ANN model offers the benefits of reducing time cost of the layout of an indoor location system, saving storage cost of the radio map establishment and enhancing real-time capacity in the on-line phase.According to the analysis of SNR distributions of recorded beacon signal samples and discussion about the multi-mode phenomenon, the one map method is proposed for the purpose of simplifying ANN input values and increasing location performances.Based on the simulations and comparison analysis with other two typical indoor location methods, K-nearest neighbor (KNN) and probability, the feasibility and effectiveness of ANN-based indoor location method are verified with average location error of 2.37m and location accuracy of 78.6% in 3m.
Artificial Neural Networks for Diagnosis of Kidney Stones Disease
Directory of Open Access Journals (Sweden)
Koushal Kumar
2012-07-01
Full Text Available Artificial Neural networks are often used as a powerful discriminating classifier for tasks in medical diagnosis for early detection of diseases. They have several advantages over parametric classifiers such as discriminate analysis. The objective of this paper is to diagnose kidney stone disease by using three different neural network algorithms which have different architecture and characteristics. The aim of this work is to compare the performance of all three neural networks on the basis of its accuracy, time taken to build model, and training data set size. We will use Learning vector quantization (LVQ, two layers feed forward perceptron trained with back propagation training algorithm and Radial basis function (RBF networks for diagnosis of kidney stone disease. In this work we used Waikato Environment for Knowledge Analysis (WEKA version 3.7.5 as simulation tool which is an open source tool. The data set we used for diagnosis is real world data with 1000 instances and 8 attributes. In the end part we check the performance comparison of different algorithms to propose the best algorithm for kidney stone diagnosis. So this will helps in early identification of kidney stone in patients and reduces the diagnosis time.
Çebi, A.; Akdoğan, E.; Celen, A.; Dalkilic, A. S.
2017-02-01
An artificial neural network (ANN) model of friction factor in smooth and microfin tubes under heating, cooling and isothermal conditions was developed in this study. Data used in ANN was taken from a vertically positioned heat exchanger experimental setup. Multi-layered feed-forward neural network with backpropagation algorithm, radial basis function networks and hybrid PSO-neural network algorithm were applied to the database. Inputs were the ratio of cross sectional flow area to hydraulic diameter, experimental condition number depending on isothermal, heating, or cooling conditions and mass flow rate while the friction factor was the output of the constructed system. It was observed that such neural network based system could effectively predict the friction factor values of the flows regardless of their tube types. A dependency analysis to determine the strongest parameter that affected the network and database was also performed and tube geometry was found to be the strongest parameter of all as a result of analysis.
Çebi, A.; Akdoğan, E.; Celen, A.; Dalkilic, A. S.
2016-06-01
An artificial neural network (ANN) model of friction factor in smooth and microfin tubes under heating, cooling and isothermal conditions was developed in this study. Data used in ANN was taken from a vertically positioned heat exchanger experimental setup. Multi-layered feed-forward neural network with backpropagation algorithm, radial basis function networks and hybrid PSO-neural network algorithm were applied to the database. Inputs were the ratio of cross sectional flow area to hydraulic diameter, experimental condition number depending on isothermal, heating, or cooling conditions and mass flow rate while the friction factor was the output of the constructed system. It was observed that such neural network based system could effectively predict the friction factor values of the flows regardless of their tube types. A dependency analysis to determine the strongest parameter that affected the network and database was also performed and tube geometry was found to be the strongest parameter of all as a result of analysis.
Interval probabilistic neural network.
Kowalski, Piotr A; Kulczycki, Piotr
2017-01-01
Automated classification systems have allowed for the rapid development of exploratory data analysis. Such systems increase the independence of human intervention in obtaining the analysis results, especially when inaccurate information is under consideration. The aim of this paper is to present a novel approach, a neural networking, for use in classifying interval information. As presented, neural methodology is a generalization of probabilistic neural network for interval data processing. The simple structure of this neural classification algorithm makes it applicable for research purposes. The procedure is based on the Bayes approach, ensuring minimal potential losses with regard to that which comes about through classification errors. In this article, the topological structure of the network and the learning process are described in detail. Of note, the correctness of the procedure proposed here has been verified by way of numerical tests. These tests include examples of both synthetic data, as well as benchmark instances. The results of numerical verification, carried out for different shapes of data sets, as well as a comparative analysis with other methods of similar conditioning, have validated both the concept presented here and its positive features.
Directory of Open Access Journals (Sweden)
S. Ramasundaram
2013-02-01
Full Text Available Prediction of compressive strength of concrete is very useful for economic constructions. The compressive strength can be estimated after 28 days of casting the specimen cubes or may be predictedbased on the quantum and quality of ingredients used in making the concrete. When the first one requires a 28-day time, the second one does have problem of accuracy. Hence, a hybrid model is proposed in which the concrete cube is cured using the microwave based accelerated curing procedure and the early strength is used to predict the 28-day strength. Feed-forward neural network model was used to predict compressive strength of the concrete after the microwave curing to ascertain the predictability of neural network models. The results indicate that the neural network models have a good scope for further study and implementations.
Artificial neural networks for modeling time series of beach litter in the southern North Sea.
Schulz, Marcus; Matthies, Michael
2014-07-01
In European marine waters, existing monitoring programs of beach litter need to be improved concerning litter items used as indicators of pollution levels, efficiency, and effectiveness. In order to ease and focus future monitoring of beach litter on few important litter items, feed-forward neural networks consisting of three layers were developed to relate single litter items to general categories of marine litter. The neural networks developed were applied to seven beaches in the southern North Sea and modeled time series of five general categories of marine litter, such as litter from fishing, shipping, and tourism. Results of regression analyses show that general categories were predicted significantly moderately to well. Measured and modeled data were in the same order of magnitude, and minima and maxima overlapped well. Neural networks were found to be eligible tools to deliver reliable predictions of marine litter with low computational effort and little input of information. Copyright © 2014 Elsevier Ltd. All rights reserved.
Directory of Open Access Journals (Sweden)
Neera Saxena
2011-07-01
Full Text Available This paper presents an ensemble of neo-cognitron neural network base classifiers to enhance the accuracy of the system, along the experimental results. The method offers lesser computational preprocessing in comparison to other ensemble techniques as it ex-preempts feature extraction process before feeding the data into base classifiers. This is achieved by the basic nature of neo-cognitron, it is a multilayer feed-forward neural network. Ensemble of such base classifiers gives class labels for each pattern that in turn is combined to give the final class label for that pattern. The purpose of this paper is not only to exemplify learning behaviour of neo-cognitron as base classifiers, but also to purport better fashion to combine neural network based ensemble classifiers.
Bayesian Regularization in a Neural Network Model to Estimate Lines of Code Using Function Points
Directory of Open Access Journals (Sweden)
K. K. Aggarwal
2005-01-01
Full Text Available It is a well known fact that at the beginning of any project, the software industry needs to know, how much will it cost to develop and what would be the time required ? . This paper examines the potential of using a neural network model for estimating the lines of code, once the functional requirements are known. Using the International Software Benchmarking Standards Group (ISBSG Repository Data (release 9 for the experiment, this paper examines the performance of back propagation feed forward neural network to estimate the Source Lines of Code. Multiple training algorithms are used in the experiments. Results demonstrate that the neural network models trained using Bayesian Regularization provide the best results and are suitable for this purpose.
Directory of Open Access Journals (Sweden)
Kapil Nahar
2012-12-01
Full Text Available An artificial neural network is an information-processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information.The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurons working in unison to solve specific problems.Ann’s, like people, learn by example.
Neural networks for triggering
Energy Technology Data Exchange (ETDEWEB)
Denby, B. (Fermi National Accelerator Lab., Batavia, IL (USA)); Campbell, M. (Michigan Univ., Ann Arbor, MI (USA)); Bedeschi, F. (Istituto Nazionale di Fisica Nucleare, Pisa (Italy)); Chriss, N.; Bowers, C. (Chicago Univ., IL (USA)); Nesti, F. (Scuola Normale Superiore, Pisa (Italy))
1990-01-01
Two types of neural network beauty trigger architectures, based on identification of electrons in jets and recognition of secondary vertices, have been simulated in the environment of the Fermilab CDF experiment. The efficiencies for B's and rejection of background obtained are encouraging. If hardware tests are successful, the electron identification architecture will be tested in the 1991 run of CDF. 10 refs., 5 figs., 1 tab.
Directory of Open Access Journals (Sweden)
Kapil Nahar
2012-12-01
Full Text Available An artificial neural network is an information-processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information. The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurons working in unison to solve specific problems. Ann’s, like people, learn by example.
Estimating Type Ia Supernova Metallicities Using Neural Networks
Villar, V. Ashley
2017-01-01
Normal Type Ia supernovae (SNe) can be used as standardizable candles because their progenitors, white dwarfs, are a fairly homogenous class of objects. However, intrinsic variability in these events arise from a number of factors, including metallicity. Recent studies have investigated the effects of metallicity on Type Ia SNe observables from both a theoretical approach, by tuning model metallicity to analyze spectral features, and an observational approach, by studying the effect of host metallicity on light curves. In this work, we take a new, data-driven approach to the problem. Inspired by the success of neural networks in the field of image processing, we aim to estimate the metallicities of Type Ia SNe progenitors from their near-maximum spectra using feed-forward neural networks. We first collect a sample of near-maximum Type Ia SNe spectra from the literature to be smoothed and down-sampled. We then estimate the metallicities of the SNe hosts using the B-band magnitudes. We build a multilayer perceptron to generate a model that takes as input the down-sampled spectra and returns a scalar metallicity. Finally, we discuss basic considerations to be taken when working with spectral (as opposed to image) data using neural networks.
Software Aging Analysis of Web Server Using Neural Networks
Directory of Open Access Journals (Sweden)
G.Sumathi
2012-05-01
Full Text Available Software aging is a phenomenon that refers to progressive performance degradation or transient failures or even crashes in long running software systems such as web servers. It mainly occurs due to the deterioration of operating system resource, fragmentation and numerical error accumulation. A primitive method to fight against software aging is software rejuvenation. Software rejuvenation is a proactive fault management technique aimed at cleaning up the system internal state to prevent the occurrence of more severe crash failures in the future. It involves occasionally stopping the running software, cleaning its internal state and restarting it. An optimized schedule for performing the software rejuvenation has to be derived in advance because a long running application could not be put down now and then as it may lead to waste of cost. This paper proposes a method to derive an accurate and optimized schedule for rejuvenation of a web server (Apache by using Radial Basis Function (RBF based Feed Forward Neural Network, a variant of Artificial Neural Networks (ANN. Aging indicators are obtained through experimental setup involving Apache web server and clients, which acts as input to the neural network model. This method is better than existing ones because usage of RBF leads to better accuracy and speed in convergence.
Artificial Neural Network Model for Predicting Ultimate Tensile Capacity of Adhesive Anchors
Institute of Scientific and Technical Information of China (English)
XU Bo; WU Zhi-min; SONG Zhi-fei
2007-01-01
To predict the tensile capacity of adhesive anchors, a multilayered feed-forward neural network trained with the backpropagation algorithm is constructed. The ANN model have 5 inputs, including the compressive strength of concrete, tensile strength of concrete, anchor diameter, hole diameter, embedment of anchors, and ultimate load. The predictions obtained from the trained ANN show a good agreement with the experiments. Meanwhile, the predicted ultinate tensile capacity of anchors is close to the one calculated from the strength formula of the combined cone-bond failure model.
A Neural Network Based Recognition and Classification of Commonly Used Indian Non Leafy Vegetables
Directory of Open Access Journals (Sweden)
Ajit Danti
2014-09-01
Full Text Available A methodology to characterize the commonly used Indian non-leafy vegetables’ images is developed. From the captured images of Indian non-leafy vegetables, color components, namely, RGB and HSV features are extracted, analyzed and classified. A feed forward backpropagation artificial neural network (BPNN is used for the classification. The results show that it has good robustness and a very high success rate in the range of 96-100% for eight types of vegetables. The work finds usefulness in developing recognition system for super market, automatic vending, packing and grading of vegetables, food preparation and Agriculture Produce Market Committee (APMC.
VOLTAGE COMPENSATION USING ARTIFICIAL NEURAL NETWORK
African Journals Online (AJOL)
VOLTAGE COMPENSATION USING ARTIFICIAL NEURAL NETWORK: A CASE STUDY OF RUMUOLA DISTRIBUTION NETWORK. ... The artificial neural networks controller engaged to controlling the dynamic voltage ... Article Metrics.
Model of Information Security Risk Assessment based on Improved Wavelet Neural Network
Directory of Open Access Journals (Sweden)
Gang Chen
2013-09-01
Full Text Available This paper concentrates on the information security risk assessment model utilizing the improved wavelet neural network. The structure of wavelet neural network is similar to the multi-layer neural network, which is a feed-forward neural network with one or more inputs. Afterwards, we point out that the training process of wavelet neural networks is made up of four steps until the value of error function can satisfy a pre-defined error criteria. In order to enhance the quality of information security risk assessment, we proposed a modified version of wavelet neural network which can effectively combine all influencing factors in assessing information security risk by linear integrating several weights. Furthermore, the proposed wavelet neural network is trained by the BP algorithm with batch mode, and the weight coefficients of the wavelet are modified with the adopting mode. Finally, a series of experiments are conduct to make performance evaluation. From the experimental results, we can see that the proposed model can assess information security risk accurately and rapidly
SKYNET: an efficient and robust neural network training tool for machine learning in astronomy
Graff, Philip; Hobson, Michael P; Lasenby, Anthony N
2013-01-01
We present the first public release of our generic neural network training algorithm, called SKYNET. This efficient and robust machine-learning tool is able to train large and deep feed-forward neural networks, including autoencoders, for use in a wide range of supervised and unsupervised learning applications, such as regression, classification, density estimation, clustering and dimensionality reduction. SKYNET uses a powerful 'pre-training' method, to obtain a set of network parameters close to the true global maximum of the training objective function, followed by further optimisation using an automatically-regularised variant of Newton's method; the latter uses second-order derivative information to improve convergence, but without the need to evaluate or store the full Hessian matrix, by using a fast approximate method to calculate Hessian-vector products. This combination of methods allows for the training of complicated networks that are difficult to optimise using standard backpropagation techniques....
A novel nature inspired firefly algorithm with higher order neural network: Performance analysis
Directory of Open Access Journals (Sweden)
Janmenjoy Nayak
2016-03-01
Full Text Available The applications of both Feed Forward Neural network and Multilayer perceptron are very diverse and saturated. But the linear threshold unit of feed forward networks causes fast learning with limited capabilities, while due to multilayering, the back propagation of errors exhibits slow training speed in MLP. So, a higher order network can be constructed by correlating between the input variables to perform nonlinear mapping using the single layer of input units for overcoming the above drawbacks. In this paper, a Firefly based higher order neural network has been proposed for data classification for maintaining fast learning and avoids the exponential increase of processing units. A vast literature survey has been conducted to review the state of the art of the previous developed models. The performance of the proposed method has been tested with various benchmark datasets from UCI machine learning repository and compared with the performance of other established models. Experimental results imply that the proposed method is fast, steady, reliable and provides better classification accuracy than others.
CONTROL OF NONLINEAR PROCESS USING NEURAL NETWORK BASED MODEL PREDICTIVE CONTROL
Directory of Open Access Journals (Sweden)
Dr.A.TRIVEDI
2011-04-01
Full Text Available This paper presents a Neural Network based Model Predictive Control (NNMPC strategy to control nonlinear process. Multilayer Perceptron Neural Network (MLP is chosen to represent a Nonlinear Auto Regressive with eXogenous signal (NARX model of a nonlinear system. NARX dynamic model is based on feed-forward architecture and offers good approximation capabilities along with robustness and accuracy. Based on the identified neural model, a generalized predictive control (GPC algorithm is implemented to control the composition in acontinuous stirred tank reactor (CSTR, whose parameters are optimally determined by solving quadratic performance index using well known Levenberg-Marquardt and Quasi-Newton algorithm. NNMPC is tuned by selecting few horizon parameters and weighting factor. The tracking performance of the NNMPC is tested using different amplitude function as a reference signal on CSTR application. Also the robustness and performance is tested in the presence of disturbance on random reference signal.
Directory of Open Access Journals (Sweden)
K. Duraiswamy
2012-01-01
Full Text Available The moving object or vehicle location prediction based on their spatial and temporal information is an important task in many applications. Different methods were utilized for performing the vehicle movement detection and prediction process. In such works, there is a lack of analysis in predicting the vehicles location in current as well as in future. Moreover, such methods compute the vehicles movement by finding the topological relationships among trajectories and locations, whereas the representative GPS points are determined by the 30 m circular window. Due to this process, the performance of the method is degraded because such 30 m circular window is selected by calculating the error range in the given input image and such error range may vary from image to image. To reduce the drawback presented in the existing method, in this study a heuristic moving vehicle location prediction algorithm is proposed. The proposed heuristic algorithm mainly comprises two techniques namely, optimization GA algorithm and FFBNN. In this proposed technique, initially the vehicles frequent paths are collected by monitoring all the vehicles movement in a specific period. Among the frequent paths, the vehicles optimal paths are computed by the GA algorithm. The selected optimal paths for each vehicle are utilized to train the FFBNN. The well trained FFBNN is then utilized to find the vehicle movement from the current location. By combining the proposed heuristic algorithm with GA and FFBNN, the vehicles location is predicted efficiently. The implementation result shows the effectiveness of the proposed heuristic algorithm in predicting the vehicles future location from the current location. The performance of the heuristic algorithm is evaluated by comparing the result with the RBF classifier. The comparison result shows our proposed technique acquires an accurate vehicle location prediction ratio than the RBF prediction ratio, in terms of accuracy.
Artificial Neural Network Analysis in Preclinical Breast Cancer
Directory of Open Access Journals (Sweden)
Gholamreza Motalleb
2013-01-01
Full Text Available Objective: In this study, artificial neural network (ANN analysis of virotherapy in preclinical breast cancer was investigated.Materials and Methods: In this research article, a multilayer feed-forward neural network trained with an error back-propagation algorithm was incorporated in order to develop a predictive model. The input parameters of the model were virus dose, week and tamoxifen citrate, while tumor weight was included in the output parameter. Two different training algorithms, namely quick propagation (QP and Levenberg-Marquardt (LM, were used to train ANN.Results: The results showed that the LM algorithm, with 3-9-1 arrangement is more efficient compared to QP. Using LM algorithm, the coefficient of determination (R2 between the actual and predicted values was determined as 0.897118 for all data.Conclusion: It can be concluded that this ANN model may provide good ability to predict the biometry information of tumor in preclinical breast cancer virotherapy. The results showed that the LM algorithm employed by Neural Power software gave the better performance compared with the QP and virus dose, and it is more important factor compared to tamoxifen and time (week.
Trimaran Resistance Artificial Neural Network
2011-01-01
11th International Conference on Fast Sea Transportation FAST 2011, Honolulu, Hawaii, USA, September 2011 Trimaran Resistance Artificial Neural Network Richard...Trimaran Resistance Artificial Neural Network 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) 5d. PROJECT NUMBER 5e... Artificial Neural Network and is restricted to the center and side-hull configurations tested. The value in the parametric model is that it is able to
Global Feed-Forward Vibration Isolation in a km scale Interferometer
DeRosa, Ryan; Atkinson, Dani; Miao, Haixing; Frolov, Valery; Landry, Michael; Giaime, Joseph; Adhikari, Rana
2012-01-01
Using a network of seismometers and sets of optimal filters, we implemented a feed-forward control technique to minimize the seismic contribution to multiple interferometric degrees of freedom of the LIGO interferometers. The filters are constructed by using the Levinson-Durbin recursion relation to approximate the optimal Wiener filter. By reducing the RMS of the interferometer feedback signals below \\sim10 Hz, we have improved the stability and duty cycle of the joint network of gravitational wave detectors. By suppressing the large control forces and mirror motions, we have dramatically reduced the rate of non-Gaussian transients in the gravitational wave signal stream.
[Artificial neural networks in Neurosciences].
Porras Chavarino, Carmen; Salinas Martínez de Lecea, José María
2011-11-01
This article shows that artificial neural networks are used for confirming the relationships between physiological and cognitive changes. Specifically, we explore the influence of a decrease of neurotransmitters on the behaviour of old people in recognition tasks. This artificial neural network recognizes learned patterns. When we change the threshold of activation in some units, the artificial neural network simulates the experimental results of old people in recognition tasks. However, the main contributions of this paper are the design of an artificial neural network and its operation inspired by the nervous system and the way the inputs are coded and the process of orthogonalization of patterns.
Directory of Open Access Journals (Sweden)
J. Reyes-Reyes
2000-01-01
Full Text Available In this paper, an adaptive technique is suggested to provide the passivity property for a class of partially known SISO nonlinear systems. A simple Dynamic Neural Network (DNN, containing only two neurons and without any hidden-layers, is used to identify the unknown nonlinear system. By means of a Lyapunov-like analysis the new learning law for this DNN, guarantying both successful identification and passivation effects, is derived. Based on this adaptive DNN model, an adaptive feedback controller, serving for wide class of nonlinear systems with an a priori incomplete model description, is designed. Two typical examples illustrate the effectiveness of the suggested approach.
Prediction of littoral drift with artificial neural networks
Directory of Open Access Journals (Sweden)
A. K. Singh
2007-07-01
Full Text Available The amount of sand moving parallel to a coastline forms a prerequisite for many harbour design projects. Such information is currently obtained through various empirical formulae. Despite much research in the past an accurate and reliable estimation of the rate of sand drift has still remained as a problem. The current study addresses this issue through the use of artificial neural networks (ANN. Feed forward networks were developed to predict the sand drift from a variety of causative variables. The best network was selected after trying out many alternatives. In order to improve the accuracy further its outcome was used to develop another network. Such simple two-stage training yielded most satisfactory results. An equation combining the network and a non-linear regression is presented for quick field usage. An attempt was made to see how both ANN and statistical regression differ in processing the input information. The network was validated by confirming its consistency with the underlying physical process.
Prediction of littoral drift with artificial neural networks
Directory of Open Access Journals (Sweden)
A. K. Singh
2008-02-01
Full Text Available The amount of sand moving parallel to a coastline forms a prerequisite for many harbor design projects. Such information is currently obtained through various empirical formulae. Despite so many works in the past an accurate and reliable estimation of the rate of sand drift has still remained as a problem. The current study addresses this issue through the use of artificial neural networks (ANN. Feed forward networks were developed to predict the sand drift from a variety of causative variables. The best network was selected after trying out many alternatives. In order to improve the accuracy further its outcome was used to develop another network. Such simple two-stage training yielded most satisfactory results. An equation combining the network and a non-linear regression is presented for quick field usage. An attempt was made to see how both ANN and statistical regression differ in processing the input information. The network was validated by confirming its consistency with underlying physical process.
Gap Filling of Daily Sea Levels by Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Lyubka Pashova
2013-06-01
Full Text Available In the recent years, intelligent methods as artificial neural networks are successfully applied for data analysis from different fields of the geosciences. One of the encountered practical problems is the availability of gaps in the time series that prevent their comprehensive usage for the scientific and practical purposes. The article briefly describes two types of the artificial neural network (ANN architectures - Feed-Forward Backpropagation (FFBP and recurrent Echo state network (ESN. In some cases, the ANN can be used as an alternative on the traditional methods, to fill in missing values in the time series. We have been conducted several experiments to fill the missing values of daily sea levels spanning a 5-years period using both ANN architectures. A multiple linear regression for the same purpose has been also applied. The sea level data are derived from the records of the tide gauge Burgas, which is located on the western Black Sea coast. The achieved results have shown that the performance of ANN models is better than that of the classical one and they are very promising for the real-time interpolation of missing data in the time series.
Consistently Trained Artificial Neural Network for Automatic Ship Berthing Control
Directory of Open Access Journals (Sweden)
Y.A. Ahmed
2015-09-01
Full Text Available In this paper, consistently trained Artificial Neural Network controller for automatic ship berthing is discussed. Minimum time course changing manoeuvre is utilised to ensure such consistency and a new concept named ‘virtual window’ is introduced. Such consistent teaching data are then used to train two separate multi-layered feed forward neural networks for command rudder and propeller revolution output. After proper training, several known and unknown conditions are tested to judge the effectiveness of the proposed controller using Monte Carlo simulations. After getting acceptable percentages of success, the trained networks are implemented for the free running experiment system to judge the network’s real time response for Esso Osaka 3-m model ship. The network’s behaviour during such experiments is also investigated for possible effect of initial conditions as well as wind disturbances. Moreover, since the final goal point of the proposed controller is set at some distance from the actual pier to ensure safety, therefore a study on automatic tug assistance is also discussed for the final alignment of the ship with actual pier.
A Deep Web Query Interfaces Classification Method Based on RBF Neural Network
Institute of Scientific and Technical Information of China (English)
YUAN Fang; ZHAO Yao; ZHOU Xu
2007-01-01
This paper proposes a new approach for classification for query interfaces of Deep Web, which extracts features from the form's text data on the query interfaces, assisted with the synonym library, and uses radial basic function neural network (RBFNN) algorithm to classify the query interfaces. The applied RBFNN is a kind of effective feed-forward artificial neural network, which has a simple networking structure but features with strength of excellent nonlinear approximation, fast convergence and global convergence. A TEL_8 query interfaces' data set from UIUC on-line database is used in our experiments, which consists of 477 query interfaces in 8 typical domains. Experimental results proved that the proposed approach can efficiently classify the query interfaces with an accuracy of 95.67%.
Kolla, Sri R; Altman, Shawn D
2007-04-01
This paper presents results from the implementation and testing of a PC based monitoring and fault identification scheme for a three-phase induction motor using artificial neural networks (ANNs). To accomplish the task, a hardware system is designed and built to acquire three-phase voltages and currents from a 1/3 HP squirrel-cage, three-phase induction motor. A software program is written to read the voltages and currents, which are first used to train a feed-forward neural network structure using the JavaNNS program. The trained network is placed in a LabVIEW based program formula node that monitors the voltages and currents online and displays the fault conditions and turns the motor off. The complete system is successfully tested in real time by creating different faults on the motor.
Energy Technology Data Exchange (ETDEWEB)
Eswari J, Satya; Chandrakar, Neha [National Institute of Technology Raipur, Raipur (India)
2016-04-15
Artificial neural networks (ANNs) can be used to develop a technique to classify lymph node negative breast cancer that is prone to distant metastases based on gene expression signatures. The neural network used is a multilayered feed forward network that employs back propagation algorithm. Once trained with DNA microarraybased gene expression profiles of genes that were predictive of distant metastasis recurrence of lymph node negative breast cancer, the ANNs became capable of correctly classifying all samples and recognizing the genes most appropriate to the classification. To test the ability of the trained ANN models in recognizing lymph node negative breast cancer, we analyzed additional idle samples that were not used beforehand for the training procedure and obtained the correctly classified result in the validation set. For more substantial result, bootstrapping of training and testing dataset was performed as external validation. This study illustrates the potential application of ANN for breast tumor diagnosis and the identification of candidate targets in patients for therapy.
Fuzzy Optimization of an Elevator Mechanism Applying the Genetic Algorithm and Neural Networks
Institute of Scientific and Technical Information of China (English)
无
2005-01-01
Considering the indefinite character of the value of design parameters and being satisfied with load-bearing capacity and stiffness, the fuzzy optimization mathematical model is set up to minimize the volume of tooth corona of a worm gear in an elevator mechanism. The method of second-class comprehensive evaluation was used based on the optimal level cut set, thus the optimal level value of every fuzzy constraint can be attained; the fuzzy optimization is transformed into the usual optimization.The Fast Back Propagation of the neural networks algorithm are adopted to train feed-forward networks so as to fit a relative coefficient. Then the fitness function with penalty terms is built by a penalty strategy, a neural networks program is recalled, and solver functions of the Genetic Algorithm Toolbox of Matlab software are adopted to solve the optimization model.
Bunnoon, Pituk; Chalermyanont, Kusumal; Limsakul, Chusak
2010-02-01
This paper proposed the discrete transform and neural network algorithms to obtain the monthly peak load demand in mid term load forecasting. The mother wavelet daubechies2 (db2) is employed to decomposed, high pass filter and low pass filter signals from the original signal before using feed forward back propagation neural network to determine the forecasting results. The historical data records in 1997-2007 of Electricity Generating Authority of Thailand (EGAT) is used as reference. In this study, historical information of peak load demand(MW), mean temperature(Tmean), consumer price index (CPI), and industrial index (economic:IDI) are used as feature inputs of the network. The experimental results show that the Mean Absolute Percentage Error (MAPE) is approximately 4.32%. This forecasting results can be used for fuel planning and unit commitment of the power system in the future.
Directory of Open Access Journals (Sweden)
Mona A. Hagras
2013-08-01
Full Text Available In the present study, Artificial Neural Networks (ANNs with different topologies have been evaluated to be used to predict hydrodynamic coefficients of permeable paneled breakwater. Two neural network models are constructed, one to predict wave transmission coefficient (Kt and another for the prediction of wave reflectioncoefficient (Kr. Back propagation algorithm was used to train a multi-layer feed-forward network (Levenberg Marquardt algorithm. The capability of ANN topologies to estimate these coefficients is evaluated using the Mean Squared Error (MSE. Based on training patterns of different ANNs, a 5-7-1 topology has been selected topredict both coefficients. The results of the developed ANN models proved that this technique is reliable in such field. A good match between the measured and predicted values was observed with correlation values varying in the range (0.9508-0.9805 for the training set and (0.9159-0.9877 for the testing set.
Directory of Open Access Journals (Sweden)
Nirmalkumar S. Reshamwala
2014-02-01
Full Text Available Long-Term Evolution (LTE is the next generation of current mobile telecommunication networks. LTE has a ?at radio-network architecture and signi?cant increase in spectrum efficiency, throughput and user capacity. In this paper, performance analysis of robust channel estimators for Downlink Long Term Evolution-Advanced (DL LTE-A system using three Artificial Neural Networks: Feed-forward neural network (FFNN, Cascade-forward neural network (CFNN and Layered Recurrent Neural Network (LRN are trained separately using Back-Propagation Algorithm and also ANN is trained by Genetic Algorithm (GA. The methods use the information got by the received reference symbols to estimate the total frequency response of the channel in two important phases. In the first phase, the proposed ANN based method learns to adapt to the channel variations, and in the second phase it estimates the channel matrix to improve performance of LTE. The performance of the estimation methods is evaluated by simulations in Vienna LTE-A DL Link Level Simulator in MATLAB software. Performance of the proposed channel estimator, ANN trained by Genetic Algorithm (ANN-GA is compared with traditional Least Square (LS algorithm and ANN based other estimator like Feed-forward neural network, Layered Recurrent Neural Network and Cascade-forward neural network for Closed Loop Spatial Multiplexing (CLSM-Single User Multi-input Multi-output (MIMO-2×2 and 4×4 in terms of throughput. Simulation result shows proposed ANN-GA gives better performance than other ANN based estimations methods and LS.
Heiden, Uwe
1980-01-01
The purpose of this work is a unified and general treatment of activity in neural networks from a mathematical pOint of view. Possible applications of the theory presented are indica ted throughout the text. However, they are not explored in de tail for two reasons : first, the universal character of n- ral activity in nearly all animals requires some type of a general approach~ secondly, the mathematical perspicuity would suffer if too many experimental details and empirical peculiarities were interspersed among the mathematical investigation. A guide to many applications is supplied by the references concerning a variety of specific issues. Of course the theory does not aim at covering all individual problems. Moreover there are other approaches to neural network theory (see e.g. Poggio-Torre, 1978) based on the different lev els at which the nervous system may be viewed. The theory is a deterministic one reflecting the average be havior of neurons or neuron pools. In this respect the essay is writt...
Neural Networks for Optimal Control
DEFF Research Database (Denmark)
Sørensen, O.
1995-01-01
Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process.......Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process....
Neural Networks for Optimal Control
DEFF Research Database (Denmark)
Sørensen, O.
1995-01-01
Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process.......Two neural networks are trained to act as an observer and a controller, respectively, to control a non-linear, multi-variable process....
Markopoulos, Angelos P.; Georgiopoulos, Sotirios; Manolakos, Dimitrios E.
2016-03-01
Various artificial neural networks types are examined and compared for the prediction of surface roughness in manufacturing technology. The aim of the study is to evaluate different kinds of neural networks and observe their performance and applicability on the same problem. More specifically, feed-forward artificial neural networks are trained with three different back propagation algorithms, namely the adaptive back propagation algorithm of the steepest descent with the use of momentum term, the back propagation Levenberg-Marquardt algorithm and the back propagation Bayesian algorithm. Moreover, radial basis function neural networks are examined. All the aforementioned algorithms are used for the prediction of surface roughness in milling, trained with the same input parameters and output data so that they can be compared. The advantages and disadvantages, in terms of the quality of the results, computational cost and time are identified. An algorithm for the selection of the spread constant is applied and tests are performed for the determination of the neural network with the best performance. The finally selected neural networks can satisfactorily predict the quality of the manufacturing process performed, through simulation and input-output surfaces for combinations of the input data, which correspond to milling cutting conditions.
PREDICTION OF FIGHT OR FLIGHT RESPONSE USING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
Abhijit Suresh
2014-01-01
Full Text Available The modern society has posed several threats to the public. Public security is declining with increasing anti-social behaviour. Cases of rape and terrorist attacks have become increasingly common and there is a strong demand for a security system to control such modalities. Anti-social behaviour is a key issue of public concern. Public perceptions, however, have been improving recently. The vital response to physical and emotional danger is called fight or flight response. It is a basic survival mechanism occurring in response to a specific stimulus, such as pain or the threat of danger. Predicting the flight and fight response is an important aspect to identify possible areas susceptible to such events and provide emergency assistance to the victims involved. This study analyses various physiological changes associated with fight or flight response and proposes an approach to predict measures that determines whether an individual is under fear caused due the perceived threat. The proposed approach uses feed forward neural networks with back propagation algorithm. With the physiological changes such as blood pressure, heart rate and respiratory rate as inputs, the optimal configuration of neural network was configured and the proposed system is able to predict the measure of fight or flight response with minimal error. By monitoring and identifying the fear measure it is possible to prevent or reduce the damage to the society by activities such as rape and terrorist attacks.
SIMULATION AND PREDICTION OF DEBRIS FLOW USING ARTIFICIAL NEURAL NETWORK
Institute of Scientific and Technical Information of China (English)
WANG Xie-kang; HUANG Er; CUI Peng
2003-01-01
Debris flow is one of the most destructive phenomena of natural hazards. Recently, major natural haz-ard, claiming human lives and assets, is due to debris flow in the world. Several practical methods for forecasting de-bris flow have been proposed, however, the accuracy of these methods is not high enough for practical use because of the stochastic and non-linear characteristics of debris flow. Artificial neural network has proven to be feasible and use-ful in developing models for nonlinear systems. On the other hand, predicting the future behavior based on a time se-ries of collected historical data is also an important tool in many scientific applications. In this study we present a three-layer feed-forward neural network model to forecast surge of debris flow according to the time series data collect-ed in the Jiangjia Ravine, situated in north part of Yunnan Province of China. The simulation and prediction of debris flow using the proposed approach shows this model is feasible, however, further studies are needed.
2D COORDINATE TRANSFORMATION USING ARTIFICIAL NEURAL NETWORKS
Directory of Open Access Journals (Sweden)
B. Konakoglu
2016-10-01
Full Text Available Two coordinate systems used in Turkey, namely the ED50 (European Datum 1950 and ITRF96 (International Terrestrial Reference Frame 1996 coordinate systems. In most cases, it is necessary to conduct transformation from one coordinate system to another. The artificial neural network (ANN is a new method for coordinate transformation. One of the biggest advantages of the ANN is that it can determine the relationship between two coordinate systems without a mathematical model. The aim of this study was to investigate the performances of three different ANN models (Feed Forward Back Propagation (FFBP, Cascade Forward Back Propagation (CFBP and Radial Basis Function Neural Network (RBFNN with regard to 2D coordinate transformation. To do this, three data sets were used for the same study area, the city of Trabzon. The coordinates of data sets were measured in the ED50 and ITRF96 coordinate systems by using RTK-GPS technique. Performance of each transformation method was investigated by using the coordinate differences between the known and estimated coordinates. The results showed that the ANN algorithms can be used for 2D coordinate transformation in cases where optimum model parameters are selected.
Neural Network Target Identification System for False Alarm Reduction
Ye, David; Edens, Weston; Lu, Thomas T.; Chao, Tien-Hsin
2009-01-01
A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feed forward back propagation neural network (NN) is then trained to classify each feature vector and remove false positives. This paper discusses the test of the system performance and parameter optimizations process which adapts the system to various targets and datasets. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar image dataset.
Online performance assessment of heat exchanger using artificial neural networks
Directory of Open Access Journals (Sweden)
C. Ahilan, S. Kumanan, N. Sivakumaran
2011-09-01
Full Text Available Heat exchanger is a device in which heat is transferred from one medium to another across a solid surface. The performance of heat exchanger deteriorates with time due to fouling on the heat transfer surface. It is necessary to assess periodically the heat exchanger performance, in order to maintain at high efficiency level. Industries follow adopted practices to monitor but it is limited to some degree. Online monitoring has an advantage to understand and improve the heat exchanger performance. In this paper, online performance monitoring system for shell and tube heat exchanger is developed using artificial neural networks (ANNs. Experiments are conducted based on full factorial design of experiments to develop a model using the parameters such as temperatures and flow rates. ANN model for overall heat transfer coefficient of a design/ clean heat exchanger system is developed using a feed forward back propagation neural network and trained. The developed model is validated and tested by comparing the results with the experimental results. This model is used to assess the performance of heat exchanger with the real/fouled system. The performance degradation is expressed using fouling factor (FF, which is derived from the overall heat transfer coefficient of design system and real system. It supports the system to improve the performance by asset utilization, energy efficient and cost reduction interms of production loss.
Neural Network Target Identification System for False Alarm Reduction
Ye, David; Edens, Weston; Lu, Thomas T.; Chao, Tien-Hsin
2009-01-01
A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feed forward back propagation neural network (NN) is then trained to classify each feature vector and remove false positives. This paper discusses the test of the system performance and parameter optimizations process which adapts the system to various targets and datasets. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar image dataset.
Directory of Open Access Journals (Sweden)
Lukas Falat
2014-01-01
Full Text Available In this paper, authors apply feed-forward artificial neural network (ANN of RBF type into the process of modelling and forecasting the future value of USD/CAD time series. Authors test the customized version of the RBF and add the evolutionary approach into it. They also combine the standard algorithm for adapting weights in neural network with an unsupervised clustering algorithm called K-means. Finally, authors suggest the new hybrid model as a combination of a standard ANN and a moving average for error modeling that is used to enhance the outputs of the network using the error part of the original RBF. Using high-frequency data, they examine the ability to forecast exchange rate values for the horizon of one day. To determine the forecasting efficiency, authors perform the comparative out-of-sample analysis of the suggested hybrid model with statistical models and the standard neural network.
Tagliaferri, Roberto; Longo, Giuseppe; Milano, Leopoldo; Acernese, Fausto; Barone, Fabrizio; Ciaramella, Angelo; De Rosa, Rosario; Donalek, Ciro; Eleuteri, Antonio; Raiconi, Giancarlo; Sessa, Salvatore; Staiano, Antonino; Volpicelli, Alfredo
2003-01-01
In the last decade, the use of neural networks (NN) and of other soft computing methods has begun to spread also in the astronomical community which, due to the required accuracy of the measurements, is usually reluctant to use automatic tools to perform even the most common tasks of data reduction and data mining. The federation of heterogeneous large astronomical databases which is foreseen in the framework of the astrophysical virtual observatory and national virtual observatory projects, is, however, posing unprecedented data mining and visualization problems which will find a rather natural and user friendly answer in artificial intelligence tools based on NNs, fuzzy sets or genetic algorithms. This review is aimed to both astronomers (who often have little knowledge of the methodological background) and computer scientists (who often know little about potentially interesting applications), and therefore will be structured as follows: after giving a short introduction to the subject, we shall summarize the methodological background and focus our attention on some of the most interesting fields of application, namely: object extraction and classification, time series analysis, noise identification, and data mining. Most of the original work described in the paper has been performed in the framework of the AstroNeural collaboration (Napoli-Salerno).
Logic Mining Using Neural Networks
Sathasivam, Saratha
2008-01-01
Knowledge could be gained from experts, specialists in the area of interest, or it can be gained by induction from sets of data. Automatic induction of knowledge from data sets, usually stored in large databases, is called data mining. Data mining methods are important in the management of complex systems. There are many technologies available to data mining practitioners, including Artificial Neural Networks, Regression, and Decision Trees. Neural networks have been successfully applied in wide range of supervised and unsupervised learning applications. Neural network methods are not commonly used for data mining tasks, because they often produce incomprehensible models, and require long training times. One way in which the collective properties of a neural network may be used to implement a computational task is by way of the concept of energy minimization. The Hopfield network is well-known example of such an approach. The Hopfield network is useful as content addressable memory or an analog computer for s...
AN INTELLIGENT CONTROL SYSTEM BASED ON RECURRENT NEURAL FUZZY NETWORK AND ITS APPLICATION TO CSTR
Institute of Scientific and Technical Information of China (English)
JIA Li; YU Jinshou
2005-01-01
In this paper, an intelligent control system based on recurrent neural fuzzy network is presented for complex, uncertain and nonlinear processes, in which a recurrent neural fuzzy network is used as controller (RNFNC) to control a process adaptively and a recurrent neural network based on recursive predictive error algorithm (RNNM) is utilized to estimate the gradient information (ey)/(e)u for optimizing the parameters of controller.Compared with many neural fuzzy control systems, it uses recurrent neural network to realize the fuzzy controller. Moreover, recursive predictive error algorithm (RPE) is implemented to construct RNNM on line. Lastly, in order to evaluate the performance of theproposed control system, the presented control system is applied to continuously stirred tank reactor (CSTR). Simulation comparisons, based on control effect and output error,with general fuzzy controller and feed-forward neural fuzzy network controller (FNFNC),are conducted. In addition, the rates of convergence of RNNM respectively using RPE algorithm and gradient learning algorithm are also compared. The results show that the proposed control system is better for controlling uncertain and nonlinear processes.
Directory of Open Access Journals (Sweden)
S.Praveena
2015-06-01
Full Text Available This paper presents a hybrid clustering algorithm and feed-forward neural network classifier for land-cover mapping of trees, shade, building and road. It starts with the single step preprocessing procedure to make the image suitable for segmentation. The pre-processed image is segmented using the hybrid genetic-Artificial Bee Colony(ABC algorithm that is developed by hybridizing the ABC and FCM to obtain the effective segmentation in satellite image and classified using neural network . The performance of the proposed hybrid algorithm is compared with the algorithms like, k-means, Fuzzy C means(FCM, Moving K-means, Artificial Bee Colony(ABC algorithm, ABC-GA algorithm, Moving KFCM and KFCM algorithm.
Directory of Open Access Journals (Sweden)
Daniel Madan Raja S,
2011-02-01
Full Text Available In this paper we are trying to classify a war scene from the natural scene. For this purpose two set of image categories are taken viz., opencountry & war tank. By using Invariant Moments and Gray LevelCo-occurrence Matrix (GLCM, features are extracted from the images. The extracted features are trained and tested with Artificial Neural Networks (ANN using feed forward back propagation algorithm. The comparative results are proving efficiency of Artificial Neural Networks towards war scene classification problems by using Gray Level Co-occurrence Matrix (GLCM feature extraction method. It can be concluded that the proposed work significantly and directly contributes to scene classification and its new applications. The complete work is experimented in Matlab 7.6.0 using real world dataset.
Maulidah, Rifa'atul; Purqon, Acep
2016-08-01
Mendong (Fimbristylis globulosa) has a potentially industrial application. We investigate a predictive model for heat and mass transfer in drying kinetics during drying a Mendong. We experimentally dry the Mendong by using a microwave oven. In this study, we analyze three mathematical equations and feed forward neural network (FNN) with back propagation to describe the drying behavior of Mendong. Our results show that the experimental data and the artificial neural network model has a good agreement and better than a mathematical equation approach. The best FNN for the prediction is 3-20-1-1 structure with Levenberg- Marquardt training function. This drying kinetics modeling is potentially applied to determine the optimal parameters during mendong drying and to estimate and control of drying process.
Directory of Open Access Journals (Sweden)
Sunday Olusanya Olatunji
2013-10-01
Full Text Available In this work, a new identification model, based on extreme learning machine (ELM, to better identify Erythemato – Squamous skin diseases have been proposed and implemented and the results compared to that of the classical artificial neural network (ANN. ELMs provide solutions to single- and multi- hidden layer feed-forward neural networks. ELMs can achieve high learning speed, good generalization performance, and ease of implementation. Experimental results indicated that ELM outperformed the classical ANN in all fronts both for the training and testing cases. The effect of varying size of training and testing set on the performance of classifiers were also investigated in this study. The proposed classifier demonstrated to be a viable tool in this germane field of medical diagnosis as indicated by its high accuracy and consistency of result.
Manipulator inverse kinematics control based on particle swarm optimization neural network
Wen, Xiulan; Sheng, Danghong; Guo, Jing
2008-10-01
The inverse kinematics control of a robotic manipulator requires solving non-linear equations having transcendental functions and involving time-consuming calculations. Particle Swarm Optimization (PSO), which is based on the behaviour of insect swarms and exploits the solution space by taking into account the experience of the single particle as well as that of the entire swarm, is similar to the genetic algorithm (GA) in that it performs a structured randomized search of an unknown parameter space by manipulating a population of parameter estimates to converge on a suitable solution. In this paper, PSO is firstly proposed to optimize feed-forward neural network for manipulator inverse kinematics. Compared with the results of the fast back propagation learning algorithm (FBP), conventional GA genetic algorithm based elitist reservation (EGA), improved GA (IGA) and immune evolutionary computation (IEC), the simulation results verify the particle swarm optimization neural network (PSONN) is effective for manipulator inverse kinematics control.
Artificial Neural Network based Body Posture Classification from EMG signal analysis
Directory of Open Access Journals (Sweden)
Rajesh Kumar Tripathy
2013-04-01
Full Text Available This paper deals with the body posture Classification from EMG signal analysis using artificial neural network (ANN. The various statistical features extracted from each EMG signal corresponding to different muscles associated with the different body postures are framed using LABVIEW software. Further-more, these features are taken as the input towards the ANN classifier and thus the corresponding output for the respective classifier predicts the postures like Bowing, Handshaking, and Hugging. The performance of the classifier is determined by the classification rate (CR. The outcome of result indicates that the CR of Multilayer Feed Forward Neural Network (MFNN type of ANN is rounded up to a percentage of 71.02%.
An artificial neural network based $b$ jet identification algorithm at the CDF Experiment
Freeman, J; Ketchum, W; Poprocki, S; Pronko, A; Rusu, V; Wittich, P
2011-01-01
We present the development and validation of a new multivariate $b$ jet identification algorithm ("$b$ tagger") used at the CDF experiment at the Fermilab Tevatron. At collider experiments, $b$ taggers allow one to distinguish particle jets containing $B$ hadrons from other jets. Employing feed-forward neural network architectures, this tagger is unique in its emphasis on using information from individual tracks. This tagger not only contains the usual advantages of a multivariate technique such as maximal use of information in a jet and tunable purity/efficiency operating points, but is also capable of evaluating jets with only a single track. To demonstrate the effectiveness of the tagger, we employ a novel method wherein we calculate the false tag rate and tag efficiency as a function of the placement of a lower threshold on a jet's neural network output value in $Z+1$ jet and $t\\bar{t}$ candidate samples, rich in light flavor and $b$ jets, respectively.
Medical diagnosis using neural network
Kamruzzaman, S M; Siddiquee, Abu Bakar; Mazumder, Md Ehsanul Hoque
2010-01-01
This research is to search for alternatives to the resolution of complex medical diagnosis where human knowledge should be apprehended in a general fashion. Successful application examples show that human diagnostic capabilities are significantly worse than the neural diagnostic system. This paper describes a modified feedforward neural network constructive algorithm (MFNNCA), a new algorithm for medical diagnosis. The new constructive algorithm with backpropagation; offer an approach for the incremental construction of near-minimal neural network architectures for pattern classification. The algorithm starts with minimal number of hidden units in the single hidden layer; additional units are added to the hidden layer one at a time to improve the accuracy of the network and to get an optimal size of a neural network. The MFNNCA was tested on several benchmarking classification problems including the cancer, heart disease and diabetes. Experimental results show that the MFNNCA can produce optimal neural networ...
Feed-forward mechanisms: addiction-like behavioral and molecular adaptations in overeating.
Alsiö, Johan; Olszewski, Pawel K; Levine, Allen S; Schiöth, Helgi B
2012-04-01
Food reward, not hunger, is the main driving force behind eating in the modern obesogenic environment. Palatable foods, generally calorie-dense and rich in sugar/fat, are thus readily overconsumed despite the resulting health consequences. Important advances have been made to explain mechanisms underlying excessive consumption as an immediate response to presentation of rewarding tastants. However, our understanding of long-term neural adaptations to food reward that oftentimes persist during even a prolonged absence of palatable food and contribute to the reinstatement of compulsive overeating of high-fat high-sugar diets, is much more limited. Here we discuss the evidence from animal and human studies for neural and molecular adaptations in both homeostatic and non-homeostatic appetite regulation that may underlie the formation of a "feed-forward" system, sensitive to palatable food and propelling the individual from a basic preference for palatable diets to food craving and compulsive, addiction-like eating behavior.
Quantum teleportation over 143 kilometres using active feed-forward.
Ma, Xiao-Song; Herbst, Thomas; Scheidl, Thomas; Wang, Daqing; Kropatschek, Sebastian; Naylor, William; Wittmann, Bernhard; Mech, Alexandra; Kofler, Johannes; Anisimova, Elena; Makarov, Vadim; Jennewein, Thomas; Ursin, Rupert; Zeilinger, Anton
2012-09-13
The quantum internet is predicted to be the next-generation information processing platform, promising secure communication and an exponential speed-up in distributed computation. The distribution of single qubits over large distances via quantum teleportation is a key ingredient for realizing such a global platform. By using quantum teleportation, unknown quantum states can be transferred over arbitrary distances to a party whose location is unknown. Since the first experimental demonstrations of quantum teleportation of independent external qubits, an internal qubit and squeezed states, researchers have progressively extended the communication distance. Usually this occurs without active feed-forward of the classical Bell-state measurement result, which is an essential ingredient in future applications such as communication between quantum computers. The benchmark for a global quantum internet is quantum teleportation of independent qubits over a free-space link whose attenuation corresponds to the path between a satellite and a ground station. Here we report such an experiment, using active feed-forward in real time. The experiment uses two free-space optical links, quantum and classical, over 143 kilometres between the two Canary Islands of La Palma and Tenerife. To achieve this, we combine advanced techniques involving a frequency-uncorrelated polarization-entangled photon pair source, ultra-low-noise single-photon detectors and entanglement-assisted clock synchronization. The average teleported state fidelity is well beyond the classical limit of two-thirds. Furthermore, we confirm the quality of the quantum teleportation procedure without feed-forward by complete quantum process tomography. Our experiment verifies the maturity and applicability of such technologies in real-world scenarios, in particular for future satellite-based quantum teleportation.
Hybrid neural network model for the design of beam subjected to bending and shear
Indian Academy of Sciences (India)
H Sudarsana Rao; B Ramesh Babu
2007-10-01
There is no direct method for design of beams. In general the dimensions of the beam and reinforcement are initially assumed and then the interaction formula is used to verify the suitability of chosen dimensions. This approach necessitates few trials for coming up with an economical and safe design. This paper demonstrates the applicability of Artiﬁcial Neural Networks (ANN) and Genetic Algorithms (GA) for the design of beams subjected to moment and shear. A hybrid neural network model which combines the features of feed forward neural networks and genetic algorithms has been developed for the design of beam subjected to moment and shear. The network has been trained with design data obtained from design experts in the ﬁeld. The hybrid neural network model learned the design of beam in just 1000 training cycles. After successful learning, the model predicted the depth of the beam, area of steel, spacing of stirrups required for new problems with accuracy satisfying all design constraints. The various stages involved in the development of a genetic algorithm based neural network model are addressed at length in this paper.
Artificial Neural Network Analysis System
2007-11-02
Contract No. DASG60-00-M-0201 Purchase request no.: Foot in the Door-01 Title Name: Artificial Neural Network Analysis System Company: Atlantic... Artificial Neural Network Analysis System 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) Powell, Bruce C 5d. PROJECT NUMBER 5e. TASK NUMBER...34) 27-02-2001 Report Type N/A Dates Covered (from... to) ("DD MON YYYY") 28-10-2000 27-02-2001 Title and Subtitle Artificial Neural Network Analysis
Lukić, M.; Ćojbašić, Ž.; Rabasović, M. D.; Markushev, D. D.; Todorović, D. M.
2013-09-01
This paper concerns with the possibilities of computational intelligence application for simultaneous determination of the laser beam spatial profile and vibrational-to-translational relaxation time of the polyatomic molecules in gases by pulsed photoacoustics. Results regarding the application of neural computing through the use of feed-forward multilayer perception networks are presented. Feed-forward multilayer perception networks are trained in an offline batch training regime to estimate simultaneously, and in real-time, the laser beam spatial profile (profile shape class) and the vibrational-to-translational relaxation time from given (theoretical) photoacoustic signals. The proposed method significantly shortens the time required for the simultaneous determination of the laser beam spatial profile and relaxation time and has the advantage of accurately calculating the aforementioned quantities.
Control of GMA Butt Joint Welding Based on Neural Networks
DEFF Research Database (Denmark)
Christensen, Kim Hardam; Sørensen, Torben
2004-01-01
variations from 0.5 mm to 2.3 mm - scanned 10 mm in front of the electrode location. In this research, the mapping from joint geometry and reference weld quality to significant welding parameters has been based on a static multi-layer feed-forward network. The Levenberg-Marquardt algorithm, for non...
Modular, Hierarchical Learning By Artificial Neural Networks
Baldi, Pierre F.; Toomarian, Nikzad
1996-01-01
Modular and hierarchical approach to supervised learning by artificial neural networks leads to neural networks more structured than neural networks in which all neurons fully interconnected. These networks utilize general feedforward flow of information and sparse recurrent connections to achieve dynamical effects. The modular organization, sparsity of modular units and connections, and fact that learning is much more circumscribed are all attractive features for designing neural-network hardware. Learning streamlined by imitating some aspects of biological neural networks.
Convolutional LSTM Networks for Subcellular Localization of Proteins
DEFF Research Database (Denmark)
Sønderby, Søren Kaae; Sønderby, Casper Kaae; Nielsen, Henrik;
2015-01-01
Machine learning is widely used to analyze biological sequence data. Non-sequential models such as SVMs or feed-forward neural networks are often used although they have no natural way of handling sequences of varying length. Recurrent neural networks such as the long short term memory (LSTM) mod...
Directory of Open Access Journals (Sweden)
B. Mondal
2015-06-01
Full Text Available Artificial Neural Network (ANN based pattern recognition technique is used for ensuring the reliable evaluation of responses from an array of Zinc Oxide (ZnO based sensors comprising of pure ZnO nano-rods and composites of ZnO–SnO2. All the sensors were fabricated in the lab. The paper first reports the development of an artificial neural network based model for successfully recognizing different concentration of hydrogen, methane and carbon mono-oxide. Feed forward back propagation neural network was used for the classification of the gases at critical concentrations. The optimized ANN algorithm is then embedded in the microcontroller based circuit and finally verified under lab conditions.
Institute of Scientific and Technical Information of China (English)
HuanqinLi; JieCheng; BaiwuWan
2004-01-01
A new architecture of wavelet neural network with multi-input-layer is proposed and implemented for modeling a class of large-scale industrial processes. Because the processes are very complicated and the number of technological parameters, which determine the final product quality, is quite large, and these parameters do not make actions at the same time but work in different procedures, the conventional feed-forward neural networks cannot model this set of problems efficiently. The network presented in this paper has several input-layers according to the sequence of work procedure in large-scale industrial production processes. The performance of such networks is analyzed and the network is applied to model the steel plate quality of continuous casting furnace and hot rolling mill. Simulation results indicate that the developed methodology is competent and has well prospects to this set of problems.
Top-level dynamics and the regulated gene response of feed-forward loop transcriptional motifs
Mayo, Michael; Abdelzaher, Ahmed; Perkins, Edward J.; Ghosh, Preetam
2014-09-01
Feed-forward loops are hierarchical three-node transcriptional subnetworks, wherein a top-level protein regulates the activity of a target gene via two paths: a direct-regulatory path, and an indirect route, whereby the top-level proteins act implicitly through an intermediate transcription factor. Using a transcriptional network of the model bacterium Escherichia coli, we confirmed that nearly all types of feed-forward loop were significantly overrepresented in the bacterial network. We then used mathematical modeling to study their dynamics by manipulating the rise times of the top-level protein concentration, termed the induction time, through alteration of the protein destruction rates. Rise times of the regulated proteins exhibited two qualitatively different regimes, depending on whether top-level inductions were "fast" or "slow." In the fast regime, rise times were nearly independent of rapid top-level inductions, indicative of biological robustness, and occurred when RNA production rate-limits the protein yield. Alternatively, the protein rise times were dependent upon slower top-level inductions, greater than approximately one bacterial cell cycle. An equation is given for this crossover, which depends upon three parameters of the direct-regulatory path: transcriptional cooperation at the DNA-binding site, a protein-DNA dissociation constant, and the relative magnitude of the top-level protien concentration.
Artificial neural network modeling of jatropha oil fueled diesel engine for emission predictions
Directory of Open Access Journals (Sweden)
Ganapathy Thirunavukkarasu
2009-01-01
Full Text Available This paper deals with artificial neural network modeling of diesel engine fueled with jatropha oil to predict the unburned hydrocarbons, smoke, and NOx emissions. The experimental data from the literature have been used as the data base for the proposed neural network model development. For training the networks, the injection timing, injector opening pressure, plunger diameter, and engine load are used as the input layer. The outputs are hydrocarbons, smoke, and NOx emissions. The feed forward back propagation learning algorithms with two hidden layers are used in the networks. For each output a different network is developed with required topology. The artificial neural network models for hydrocarbons, smoke, and NOx emissions gave R2 values of 0.9976, 0.9976, and 0.9984 and mean percent errors of smaller than 2.7603, 4.9524, and 3.1136, respectively, for training data sets, while the R2 values of 0.9904, 0.9904, and 0.9942, and mean percent errors of smaller than 6.5557, 6.1072, and 4.4682, respectively, for testing data sets. The best linear fit of regression to the artificial neural network models of hydrocarbons, smoke, and NOx emissions gave the correlation coefficient values of 0.98, 0.995, and 0.997, respectively.
Neural networks and statistical learning
Du, Ke-Lin
2014-01-01
Providing a broad but in-depth introduction to neural network and machine learning in a statistical framework, this book provides a single, comprehensive resource for study and further research. All the major popular neural network models and statistical learning approaches are covered with examples and exercises in every chapter to develop a practical working understanding of the content. Each of the twenty-five chapters includes state-of-the-art descriptions and important research results on the respective topics. The broad coverage includes the multilayer perceptron, the Hopfield network, associative memory models, clustering models and algorithms, the radial basis function network, recurrent neural networks, principal component analysis, nonnegative matrix factorization, independent component analysis, discriminant analysis, support vector machines, kernel methods, reinforcement learning, probabilistic and Bayesian networks, data fusion and ensemble learning, fuzzy sets and logic, neurofuzzy models, hardw...
Institute of Scientific and Technical Information of China (English)
E. Jorjani; A.H. Bagherieh; Sh. Mesroghli; S. Chehreh Chelgani
2008-01-01
The assay and recovery of rare earth elements (REEs) in the leaching process is being determined using expensive analytical methods: inductively coupled plasma atomic emission spectroscopy (ICP-AES) and inductively coupled plasma mass spectroscopy (ICP-MS). A neural network model to predict the effects of operational variables on the lanthanum, cerium, yttrium, and neodymium recovery in the leaching of apatite concentrate is presented in this article. The effects of leaching time (10 to 40 min),pulp densities (30% to 50%), acid concentrations (20% to 60%), and agitation rates (100 to 200 r/min), were investigated and optimized on the recovery of REEs in the laboratory at a leaching temperature of 60οC. The obtained data in the laboratory optimization process were used for training and testing the neural network. The feed-forward artificial neural network with a 4-5-5-1 arrangement was capable of estimating the leaching recovery of REEs. The neural network predicted values were in good agreement with the experimental results. The correlations of R=1 in training stages, and R=0.971, 0.952, 0.985, and 0.98 in testing stages were a result of Ce, Nd, La, and Y recovery prediction respectively, and these values were usually acceptable. It was shown that the proposed neural network model accurately reproduced all the effects of the operation variables, and could be used in the simulation of a leaching plant for REEs.
Directory of Open Access Journals (Sweden)
Shokoufe Tayyebi
2013-01-01
Full Text Available Biosurfactants are surface active compounds produced by various microorganisms. Production of biosurfactants via fermentation of immiscible wastes has the dual benefit of creating economic opportunities for manufacturers, while improving environmental health. A predictor system, recommended in such processes, must be scaled-up. Hence, four neural networks were developed for the dynamic modeling of the biosurfactant production kinetics, in presence of soybean oil or refinery wastes including acid oil, deodorizer distillate and soap stock. Each proposed feed forward neural network consists of three layers which are not fully connected. The input and output data for the training and validation of the neural network models were gathered from batch fermentation experiments. The proposed neural network models were evaluated by three statistical criteria (R2, RMSE and SE. The typical regression analysis showed high correlation coefficients greater than 0.971, demonstrating that the neural network is an excellent estimator for prediction of biosurfactant production kinetic data in a two phase liquid-liquid batch fermentation system. In addition, sensitivity analysis indicates that residual oil has the significant effect (i.e. 49% on the biosurfactant in the process.
Neural Networks in Control Applications
DEFF Research Database (Denmark)
Sørensen, O.
examined, and it appears that considering 'normal' neural network models with, say, 500 samples, the problem of over-fitting is neglible, and therefore it is not taken into consideration afterwards. Numerous model types, often met in control applications, are implemented as neural network models....... - Control concepts including parameter estimation - Control concepts including inverse modelling - Control concepts including optimal control For each of the three groups, different control concepts and specific training methods are detailed described.Further, all control concepts are tested on the same......The intention of this report is to make a systematic examination of the possibilities of applying neural networks in those technical areas, which are familiar to a control engineer. In other words, the potential of neural networks in control applications is given higher priority than a detailed...
The holographic neural network: Performance comparison with other neural networks
Klepko, Robert
1991-10-01
The artificial neural network shows promise for use in recognition of high resolution radar images of ships. The holographic neural network (HNN) promises a very large data storage capacity and excellent generalization capability, both of which can be achieved with only a few learning trials, unlike most neural networks which require on the order of thousands of learning trials. The HNN is specially designed for pattern association storage, and mathematically realizes the storage and retrieval mechanisms of holograms. The pattern recognition capability of the HNN was studied, and its performance was compared with five other commonly used neural networks: the Adaline, Hamming, bidirectional associative memory, recirculation, and back propagation networks. The patterns used for testing represented artificial high resolution radar images of ships, and appear as a two dimensional topology of peaks with various amplitudes. The performance comparisons showed that the HNN does not perform as well as the other neural networks when using the same test data. However, modification of the data to make it appear more Gaussian distributed, improved the performance of the network. The HNN performs best if the data is completely Gaussian distributed.
Neural Network Communications Signal Processing
1994-08-01
Technical Information Report for the Neural Network Communications Signal Processing Program, CDRL A003, 31 March 1993. Software Development Plan for...track changing jamming conditions to provide the decoder with the best log- likelihood ratio metrics at a given time. As part of our development plan we...Artificial Neural Networks (ICANN-91) Volume 2, June 24-28, 1991, pp. 1677-1680. Kohonen, Teuvo, Raivio, Kimmo, Simula, Oli, Venta , 011i, Henriksson
What are artificial neural networks?
DEFF Research Database (Denmark)
Krogh, Anders
2008-01-01
Artificial neural networks have been applied to problems ranging from speech recognition to prediction of protein secondary structure, classification of cancers and gene prediction. How do they work and what might they be good for? Udgivelsesdato: 2008-Feb......Artificial neural networks have been applied to problems ranging from speech recognition to prediction of protein secondary structure, classification of cancers and gene prediction. How do they work and what might they be good for? Udgivelsesdato: 2008-Feb...
Stochastic downscaling of precipitation with neural network conditional mixture models
Carreau, Julie; Vrac, Mathieu
2011-10-01
We present a new class of stochastic downscaling models, the conditional mixture models (CMMs), which builds on neural network models. CMMs are mixture models whose parameters are functions of predictor variables. These functions are implemented with a one-layer feed-forward neural network. By combining the approximation capabilities of mixtures and neural networks, CMMs can, in principle, represent arbitrary conditional distributions. We evaluate the CMMs at downscaling precipitation data at three stations in the French Mediterranean region. A discrete (Dirac) component is included in the mixture to handle the "no-rain" events. Positive rainfall is modeled with a mixture of continuous densities, which can be either Gaussian, log-normal, or hybrid Pareto (an extension of the generalized Pareto). CMMs are stochastic weather generators in the sense that they provide a model for the conditional density of local variables given large-scale information. In this study, we did not look for the most appropriate set of predictors, and we settled for a decent set as the basis to compare the downscaling models. The set of predictors includes the National Centers for Environmental Prediction/National Center for Atmospheric Research (NCEP/NCAR) reanalyses sea level pressure fields on a 6 × 6 grid cell region surrounding the stations plus three date variables. We compare the three distribution families of CMMs with a simpler benchmark model, which is more common in the downscaling community. The difference between the benchmark model and CMMs is that positive rainfall is modeled with a single Gamma distribution. The results show that CMM with hybrid Pareto components outperforms both the CMM with Gaussian components and the benchmark model in terms of log-likelihood. However, there is no significant difference with the log-normal CMM. In general, the additional flexibility of mixture models, as opposed to using a single distribution, allows us to better represent the
Khanmohammadi, Mohammadreza; Garmarudi, Amir Bagheri; Rouchi, Mohammad Babaei; Khoddami, Nafiseh
2011-01-01
A method has been established for simultaneous determination of sodium sulfate, sodium carbonate, and sodium tripolyphosphate in detergent washing powder samples based on attenuated total reflectance Fourier transform IR spectrometry in the mid-IR spectral region (800-1550 cm(-1)). Genetic algorithm (GA) wavelength selection followed by feed forward back-propagation artificial neural network (BP-ANN) was the chemometric approach. Root mean square error of prediction for BP-ANN and GA-BP-ANN was 0.0051 and 0.0048, respectively. The proposed method is simple, with no tedious pretreatment step, for simultaneous determination of the above-mentioned components in commercial washing powder samples.
A robust neural network-based approach for microseismic event detection
Akram, Jubran
2017-08-17
We present an artificial neural network based approach for robust event detection from low S/N waveforms. We use a feed-forward network with a single hidden layer that is tuned on a training dataset and later applied on the entire example dataset for event detection. The input features used include the average of absolute amplitudes, variance, energy-ratio and polarization rectilinearity. These features are calculated in a moving-window of same length for the entire waveform. The output is set as a user-specified relative probability curve, which provides a robust way of distinguishing between weak and strong events. An optimal network is selected by studying the weight-based saliency and effect of number of neurons on the predicted results. Using synthetic data examples, we demonstrate that this approach is effective in detecting weaker events and reduces the number of false positives.
A neural network device for on-line particle identification in cosmic ray experiments
Energy Technology Data Exchange (ETDEWEB)
Scrimaglio, R. E-mail: renato.scrimaglio@aquila.infn.it; Finetti, N.; D' Altorio, L.; Rantucci, E.; Raso, M.; Segreto, E.; Tassoni, A.; Cardarilli, G.C
2004-05-21
On-line particle identification is one of the main goals of many experiments in space both for rare event studies and for optimizing measurements along the orbital trajectory. Neural networks can be a useful tool for signal processing and real time data analysis in such experiments. In this document we report on the performances of a programmable neural device which was developed in VLSI analog/digital technology. Neurons and synapses were accomplished by making use of Operational Transconductance Amplifier (OTA) structures. In this paper we report on the results of measurements performed in order to verify the agreement of the characteristic curves of each elementary cell with simulations and on the device performances obtained by implementing simple neural structures on the VLSI chip. A feed-forward neural network (Multi-Layer Perceptron, MLP) was implemented on the VLSI chip and trained to identify particles by processing the signals of two-dimensional position-sensitive Si detectors. The radiation monitoring device consisted of three double-sided silicon strip detectors. From the analysis of a set of simulated data it was found that the MLP implemented on the neural device gave results comparable with those obtained with the standard method of analysis confirming that the implemented neural network could be employed for real time particle identification.
VLSI implementation of neural networks.
Wilamowski, B M; Binfet, J; Kaynak, M O
2000-06-01
Currently, fuzzy controllers are the most popular choice for hardware implementation of complex control surfaces because they are easy to design. Neural controllers are more complex and hard to train, but provide an outstanding control surface with much less error than that of a fuzzy controller. There are also some problems that have to be solved before the networks can be implemented on VLSI chips. First, an approximation function needs to be developed because CMOS neural networks have an activation function different than any function used in neural network software. Next, this function has to be used to train the network. Finally, the last problem for VLSI designers is the quantization effect caused by discrete values of the channel length (L) and width (W) of MOS transistor geometries. Two neural networks were designed in 1.5 microm technology. Using adequate approximation functions solved the problem of activation function. With this approach, trained networks were characterized by very small errors. Unfortunately, when the weights were quantized, errors were increased by an order of magnitude. However, even though the errors were enlarged, the results obtained from neural network hardware implementations were superior to the results obtained with fuzzy system approach.
Complex-Valued Neural Networks
Hirose, Akira
2012-01-01
This book is the second enlarged and revised edition of the first successful monograph on complex-valued neural networks (CVNNs) published in 2006, which lends itself to graduate and undergraduate courses in electrical engineering, informatics, control engineering, mechanics, robotics, bioengineering, and other relevant fields. In the second edition the recent trends in CVNNs research are included, resulting in e.g. almost a doubled number of references. The parametron invented in 1954 is also referred to with discussion on analogy and disparity. Also various additional arguments on the advantages of the complex-valued neural networks enhancing the difference to real-valued neural networks are given in various sections. The book is useful for those beginning their studies, for instance, in adaptive signal processing for highly functional sensing and imaging, control in unknown and changing environment, robotics inspired by human neural systems, and brain-like information processing, as well as interdisciplina...
Statistical downscaling rainfall using artificial neural network: significantly wetter Bangkok?
Vu, Minh Tue; Aribarg, Thannob; Supratid, Siriporn; Raghavan, Srivatsan V.; Liong, Shie-Yui
2016-11-01
Artificial neural network (ANN) is an established technique with a flexible mathematical structure that is capable of identifying complex nonlinear relationships between input and output data. The present study utilizes ANN as a method of statistically downscaling global climate models (GCMs) during the rainy season at meteorological site locations in Bangkok, Thailand. The study illustrates the applications of the feed forward back propagation using large-scale predictor variables derived from both the ERA-Interim reanalyses data and present day/future GCM data. The predictors are first selected over different grid boxes surrounding Bangkok region and then screened by using principal component analysis (PCA) to filter the best correlated predictors for ANN training. The reanalyses downscaled results of the present day climate show good agreement against station precipitation with a correlation coefficient of 0.8 and a Nash-Sutcliffe efficiency of 0.65. The final downscaled results for four GCMs show an increasing trend of precipitation for rainy season over Bangkok by the end of the twenty-first century. The extreme values of precipitation determined using statistical indices show strong increases of wetness. These findings will be useful for policy makers in pondering adaptation measures due to flooding such as whether the current drainage network system is sufficient to meet the changing climate and to plan for a range of related adaptation/mitigation measures.
Use of artificial neural network for spatial rainfall analysis
Indian Academy of Sciences (India)
Tsangaratos Paraskevas; Rozos Dimitrios; Benardos Andreas
2014-04-01
In the present study, the precipitation data measured at 23 rain gauge stations over the Achaia County, Greece, were used to estimate the spatial distribution of the mean annual precipitation values over a specific catchment area. The objective of this work was achieved by programming an Artificial Neural Network (ANN) that uses the feed-forward back-propagation algorithm as an alternative interpolating technique. A Geographic Information System (GIS) was utilized to process the data derived by the ANN and to create a continuous surface that represented the spatial mean annual precipitation distribution.The ANN introduced an optimization procedure that was implemented during training, adjusting the hidden number of neurons and the convergence of the ANN in order to select the best network architecture. The performance of the ANN was evaluated using three standard statistical evaluation criteria applied to the study area and showed good performance. The outcomes were also compared with the results obtained from a previous study in the area of research which used a linear regression analysis for the estimation of the mean annual precipitation values giving more accurate results. The information and knowledge gained from the present study could improve the accuracy of analysis concerning hydrology and hydrogeological models, ground water studies, flood related applications and climate analysis studies.
Feed-forward segmentation of figure-ground and assignment of border-ownership.
Directory of Open Access Journals (Sweden)
Hans Supèr
Full Text Available Figure-ground is the segmentation of visual information into objects and their surrounding backgrounds. Two main processes herein are boundary assignment and surface segregation, which rely on the integration of global scene information. Recurrent processing either by intrinsic horizontal connections that connect surrounding neurons or by feedback projections from higher visual areas provide such information, and are considered to be the neural substrate for figure-ground segmentation. On the contrary, a role of feedforward projections in figure-ground segmentation is unknown. To have a better understanding of a role of feedforward connections in figure-ground organization, we constructed a feedforward spiking model using a biologically plausible neuron model. By means of surround inhibition our simple 3-layered model performs figure-ground segmentation and one-sided border-ownership coding. We propose that the visual system uses feed forward suppression for figure-ground segmentation and border-ownership assignment.
Antenna analysis using neural networks
Smith, William T.
1992-01-01
Conventional computing schemes have long been used to analyze problems in electromagnetics (EM). The vast majority of EM applications require computationally intensive algorithms involving numerical integration and solutions to large systems of equations. The feasibility of using neural network computing algorithms for antenna analysis is investigated. The ultimate goal is to use a trained neural network algorithm to reduce the computational demands of existing reflector surface error compensation techniques. Neural networks are computational algorithms based on neurobiological systems. Neural nets consist of massively parallel interconnected nonlinear computational elements. They are often employed in pattern recognition and image processing problems. Recently, neural network analysis has been applied in the electromagnetics area for the design of frequency selective surfaces and beam forming networks. The backpropagation training algorithm was employed to simulate classical antenna array synthesis techniques. The Woodward-Lawson (W-L) and Dolph-Chebyshev (D-C) array pattern synthesis techniques were used to train the neural network. The inputs to the network were samples of the desired synthesis pattern. The outputs are the array element excitations required to synthesize the desired pattern. Once trained, the network is used to simulate the W-L or D-C techniques. Various sector patterns and cosecant-type patterns (27 total) generated using W-L synthesis were used to train the network. Desired pattern samples were then fed to the neural network. The outputs of the network were the simulated W-L excitations. A 20 element linear array was used. There were 41 input pattern samples with 40 output excitations (20 real parts, 20 imaginary). A comparison between the simulated and actual W-L techniques is shown for a triangular-shaped pattern. Dolph-Chebyshev is a different class of synthesis technique in that D-C is used for side lobe control as opposed to pattern
Fractional Hopfield Neural Networks: Fractional Dynamic Associative Recurrent Neural Networks.
Pu, Yi-Fei; Yi, Zhang; Zhou, Ji-Liu
2016-07-14
This paper mainly discusses a novel conceptual framework: fractional Hopfield neural networks (FHNN). As is commonly known, fractional calculus has been incorporated into artificial neural networks, mainly because of its long-term memory and nonlocality. Some researchers have made interesting attempts at fractional neural networks and gained competitive advantages over integer-order neural networks. Therefore, it is naturally makes one ponder how to generalize the first-order Hopfield neural networks to the fractional-order ones, and how to implement FHNN by means of fractional calculus. We propose to introduce a novel mathematical method: fractional calculus to implement FHNN. First, we implement fractor in the form of an analog circuit. Second, we implement FHNN by utilizing fractor and the fractional steepest descent approach, construct its Lyapunov function, and further analyze its attractors. Third, we perform experiments to analyze the stability and convergence of FHNN, and further discuss its applications to the defense against chip cloning attacks for anticounterfeiting. The main contribution of our work is to propose FHNN in the form of an analog circuit by utilizing a fractor and the fractional steepest descent approach, construct its Lyapunov function, prove its Lyapunov stability, analyze its attractors, and apply FHNN to the defense against chip cloning attacks for anticounterfeiting. A significant advantage of FHNN is that its attractors essentially relate to the neuron's fractional order. FHNN possesses the fractional-order-stability and fractional-order-sensitivity characteristics.
Improved neural network algorithm for classification of UAV imagery related to Wenchuan earthquake
Lin, Na; Yang, Wunian; Wang, Bin
2009-06-01
When Wenchuan earthquake struck, the terrain of the region changed violently. Unmanned aerial vehicles (UAV) remote sensing is effective in extracting first hand information. The high resolution images are of great importance in disaster management and relief operations. Back propagation (BP) neural network is an artificial neural network which combines multi-layer feed-forward network and error back-propagation algorithm. It has a strong input-output mapping capability, and does not require the object to be identified obeying certain distribution law. It has strong non-linear features and error-tolerant capabilities. Remotely-sensed image classification can achieve high accuracy and satisfactory error-tolerant capabilities. But it also has drawbacks such as slow convergence speed and can probably be trapped by local minimum points. In order to solve these problems, we have improved this algorithm through setting up self-adaptive training rate and adding momentum factor. UAV high-resolution aerial image in Taoguan District of Wenchuan County is used as data source. First, we preprocess UAV aerial images and rectify geometric distortion in images. Training samples were selected and purified. The image is then classified using the improved BP neural network algorithm. Finally, we compare such classification result with the maximum likelihood classification (MLC) result. Numerical comparison shows that the overall accuracy of maximum likelihood classification is 83.8%, while the improved BP neural network classification is 89.7%. The testing results indicate that the latter is better.
Directory of Open Access Journals (Sweden)
MALLESWARAN M,
2010-12-01
Full Text Available Global positioning System (GPS and Inertial Navigation System (INS data can be integrated together to provide a reliable navigation. GPS/INS data integration provides reliable navigation solutions by overcoming each of their shortcomings, including signal blockage for GPS and increase in position errors with time for INS. This paper aims to provide GPS/INS data integration utilizing Artificial Neural Network (ANN architecture. This architecture is based on Feed Forward Neural Networks, which generally includes Radial Basis Function (RBF neural network and Back Propagation neural network (BPN. These are systematic methods for training multi-layer artificial networks. The BPN-ANN and RBF-ANN modules are trained to predict the INS position error and provide accurate positioning of the moving vehicle. This paper also compares performance of theGPS/INS data integration system by using different activation function like Bipolar Sigmoidal Function (BPSF, Binary Sigmoidal Function (BISF, Hyperbolic Tangential Function (HTF and Gaussian Function (GF in BPN-ANN and using Gaussian function in RBF-ANN.
NEURAL NETWORK TRAINING WITH PARALLEL PARTICLE SWARM OPTIMIZER
Institute of Scientific and Technical Information of China (English)
无
2006-01-01
Feed forward neural net works such as multi-layer perceptron,radial basis function neural net-works,have been widely applied to classification,function approxi mation and data mining.Evolu-tionary computation has been explored to train neu-ral net works as a very promising and competitive al-ternative learning method,because it has potentialto produce global mini mum in the weight space.Recently,an emerging evolutionary computationtechnique,Particle Swar m Opti mization(PSO)be-comes a hot topic because of i...
Highly Accurate Multi-layer Perceptron Neural Network for Air Data System
Directory of Open Access Journals (Sweden)
H. S. Krishna
2009-11-01
Full Text Available The error backpropagation multi-layer perceptron algorithm is revisited. This algorithm is used to train and validate two models of three-layer neural networks that can be used to calibrate a 5-hole pressure probe. This paper addresses Occam's Razor problem as it describes the adhoc training methodology applied to improve accuracy and sensitivity. The trained outputs from 5-4-3 feed-forward network architecture with jump connection are comparable to second decimal digit (~0.05 accuracy, hitherto unreported in literature.Defence Science Journal, 2009, 59(6, pp.670-674, DOI:http://dx.doi.org/10.14429/dsj.59.1574
Design of alluvial Egyptian irrigation canals using artificial neural networks method
Directory of Open Access Journals (Sweden)
Hassan Ibrahim Mohamed
2013-06-01
Full Text Available In the present study, artificial neural networks method (ANNs is used to estimate the main parameters which used in design of stable alluvial channels. The capability of ANN models to predict the stable alluvial channels dimensions is investigated, where the flow rate and sediment mean grain size were considered as input variables and wetted perimeter, hydraulic radius, and water surface slope were considered as output variables. The used ANN models are based on a back propagation algorithm to train a multi-layer feed-forward network (Levenberg Marquardt algorithm. The proposed models were verified using 311 data sets of field data collected from 61 manmade canals and drains. Several statistical measures and graphical representation are used to check the accuracy of the models in comparison with previous empirical equations. The results of the developed ANN model proved that this technique is reliable in such field compared with previously developed methods.
INVESTIGATION OF FOSSIL FUEL AND LIQUID BIOFUEL BLEND PROPERTIES USING ARTIFICIAL NEURAL NETWORK
Directory of Open Access Journals (Sweden)
G. Najafi
2012-06-01
Full Text Available Gasoline fuel is the baseline fuel in this research, to which bioethanol, biodiesel and diesel are additives. The fuel blends were prepared based on different volumes and following which, ASTM (American Society for Testing and Materials test methods analysed some of the important properties of the blends, such as: density, dynamic viscosity, kinematic viscosity and water and sediment. Experimental data were analysed by means of Matlab software. The results obtained from artificial neural network analysis of the data showed that the network with feed forward back propagation of the Levenberg-Marquardt train LM function with 10 neurons in the hidden layer was the best for predicting the parameters, including: Water and sediment (W, dynamic viscosity (DV, kinematic viscosity (KV and density (De. The experimental data had a good correlation with ANN-predicted values according to 0.96448 for regression.
Multigradient for Neural Networks for Equalizers
Directory of Open Access Journals (Sweden)
Chulhee Lee
2003-06-01
Full Text Available Recently, a new training algorithm, multigradient, has been published for neural networks and it is reported that the multigradient outperforms the backpropagation when neural networks are used as a classifier. When neural networks are used as an equalizer in communications, they can be viewed as a classifier. In this paper, we apply the multigradient algorithm to train the neural networks that are used as equalizers. Experiments show that the neural networks trained using the multigradient noticeably outperforms the neural networks trained by the backpropagation.
Time-Delay Neural Network for Smart MIMO Channel Estimation in Downlink 4G-LTE-Advance System
Directory of Open Access Journals (Sweden)
Nirmalkumar S. Reshamwala
2014-05-01
Full Text Available Long-Term Evolution (LTE is the next generation of current mobile telecommunication networks. LTE has a new ﬂat radio-network architecture and signiﬁcant increase in spectrum efficiency. In this paper, main focus on throughput performance analysis of robust MIMO channel estimators for Downlink Long Term Evolution-Advance (DL LTE-A-4G system using three Artificial Neural Networks: Feed-forward neural network (FFNN, Cascade-forward neural network (CFNN and Time-Delay neural network (TDNN are adopted to train the constructed neural networks’ models separately using Back-Propagation Algorithm. The methods use the information received by the received reference symbols to estimate the total frequency response of the channel in two important phases. In the first phase, the proposed ANN based method learns to adapt to the channel variations, and in the second phase, it estimates the MIMO channel matrix and try to improve throughput of LTE. The performance of the estimation methods is evaluated by simulations in Vienna LTE-A DL Link Level Simulator. Performance of the proposed channel estimator, Time-Delay neural network (TDNN is compared with traditional Least Square (LS algorithm and ANN based other estimators for Closed Loop Spatial Multiplexing (CLSM - Single User Multi-input Multi-output (MIMO-2×2 and 4×4 in terms of throughput. Simulation result shows TDNN gives better performance than other ANN based estimations methods and LS.
Directory of Open Access Journals (Sweden)
Latha. S. C
2014-11-01
Full Text Available The portable devices development of semiconductor manufacturing technology, conversion efficiency, power consumption, and the size of devices have become the most important design criteria of switching power converters. For portable applications better conveniences extension of battery life and improves the conversion efficiency of power converters .It is essential to develop accurate switching power converters, which can reduce more wasted power energy. The proposed topology can achieve faster transient responses when the supply voltages are changed for the converter by making use of the feed forward network .With mode select circuit the conduction & switching losses are reduced the positive buck–boost converter operate in buck, buck–boost, or boost converter. By adding feed-forward techniques, the proposed converter can improve transient response when the supply voltages are changed. The designing, modeling & experimental results were verified in MATLAB/ Simulink. The fuzzy logic controller is used as controller.
Directory of Open Access Journals (Sweden)
Mahmoud Akbarian
2015-07-01
Results: Twelve features with P<0.05 and four features with P<0.1 were identified by using binary logistic regression as effective features. These sixteen features were used as input variables in artificial neural networks. The accuracy, sensitivity and specificity of the test data for the MLP network were 90.9%, 80.0%, and 94.1% respectively and for the total data were 97.3%, 93.5%, and 99.0% respectively. Conclusion: According to the results, we concluded that feed-forward Multi-Layer Perceptron (MLP neural network with scaled conjugate gradient (trainscg back propagation learning algorithm can help physicians to predict the pregnancy outcomes (spontaneous abortion and live birth among pregnant women with lupus by using identified effective variables.
Relations Between Wavelet Network and Feedforward Neural Network
Institute of Scientific and Technical Information of China (English)
刘志刚; 何正友; 钱清泉
2002-01-01
A comparison of construction forms and base functions is made between feedforward neural network and wavelet network. The relations between them are studied from the constructions of wavelet functions or dilation functions in wavelet network by different activation functions in feedforward neural network. It is concluded that some wavelet function is equal to the linear combination of several neurons in feedforward neural network.
Neural Network Based State of Health Diagnostics for an Automated Radioxenon Sampler/Analyzer
Energy Technology Data Exchange (ETDEWEB)
Keller, Paul E.; Kangas, Lars J.; Hayes, James C.; Schrom, Brian T.; Suarez, Reynold; Hubbard, Charles W.; Heimbigner, Tom R.; McIntyre, Justin I.
2009-05-13
Artificial neural networks (ANNs) are used to determine the state-of-health (SOH) of the Automated Radioxenon Analyzer/Sampler (ARSA). ARSA is a gas collection and analysis system used for non-proliferation monitoring in detecting radioxenon released during nuclear tests. SOH diagnostics are important for automated, unmanned sensing systems so that remote detection and identification of problems can be made without onsite staff. Both recurrent and feed-forward ANNs are presented. The recurrent ANN is trained to predict sensor values based on current valve states, which control air flow, so that with only valve states the normal SOH sensor values can be predicted. Deviation between modeled value and actual is an indication of a potential problem. The feed-forward ANN acts as a nonlinear version of principal components analysis (PCA) and is trained to replicate the normal SOH sensor values. Because of ARSA’s complexity, this nonlinear PCA is better able to capture the relationships among the sensors than standard linear PCA and is applicable to both sensor validation and recognizing off-normal operating conditions. Both models provide valuable information to detect impending malfunctions before they occur to avoid unscheduled shutdown. Finally, the ability of ANN methods to predict the system state is presented.
3D porosity prediction from seismic inversion and neural networks
Leite, Emilson Pereira; Vidal, Alexandre Campane
2011-08-01
In this work, we address the problem of transforming seismic reflection data into an intrinsic rock property model. Specifically, we present an application of a methodology that allows interpreters to obtain effective porosity 3D maps from post-stack 3D seismic amplitude data, using measured density and sonic well log data as constraints. In this methodology, a 3D acoustic impedance model is calculated from seismic reflection amplitudes by applying an L1-norm sparse-spike inversion algorithm in the time domain, followed by a recursive inversion performed in the frequency domain. A 3D low-frequency impedance model is estimated by kriging interpolation of impedance values calculated from well log data. This low-frequency model is added to the inversion result which otherwise provides only a relative numerical scale. To convert acoustic impedance into a single reservoir property, a feed-forward Neural Network (NN) is trained, validated and tested using gamma-ray and acoustic impedance values observed at the well log positions as input and effective porosity values as target. The trained NN is then applied for the whole reservoir volume in order to obtain a 3D effective porosity model. While the particular conclusions drawn from the results obtained in this work cannot be generalized, such results suggest that this workflow can be applied successfully as an aid in reservoir characterization, especially when there is a strong non-linear relationship between effective porosity and acoustic impedance.
Estimation of operative temperature in buildings using artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Soleimani-Mohseni, M.; Fahlen, P. [Department of Building Services Engineering, Chalmers University of Technology, Goeteborg (Sweden); Thomas, B. [Department of Signals and Systems, Chalmers University of Technology, Campus Lindholmen, Goeteborg (Sweden)
2006-07-01
In this article, the problem how to obtain models for estimation of the operative temperature in rooms and buildings is discussed. Identification experiments have been carried out in two different buildings and different linear and non-linear estimation models have been identified based on these experiments. For the buildings studied, it is shown that the operative temperature can be estimated fairly well by using variables, which are more easily measured, such as the indoor and outdoor temperatures, the electrical power use in the room, the wall temperatures, the ventilation flow rates and the time of day. It is also shown that non-linear artificial neural network models (ANN-models), in general, give better estimations than linear ARX-models. The most accurate estimation models were obtained using feed-forward ANN-models with one hidden layer of neurons and using Levenberg-Marquardt's training algorithms. In one of the buildings, it is shown that for non-linear models but not for linear, the estimations are improved much when using the time of day as an input signal. This shows that the time of day affects the operative temperature in a non-linear manner. (author)
Connectivity in the yeast cell cycle transcription network: inferences from neural networks.
Directory of Open Access Journals (Sweden)
Christopher E Hart
2006-12-01
Full Text Available A current challenge is to develop computational approaches to infer gene network regulatory relationships based on multiple types of large-scale functional genomic data. We find that single-layer feed-forward artificial neural network (ANN models can effectively discover gene network structure by integrating global in vivo protein:DNA interaction data (ChIP/Array with genome-wide microarray RNA data. We test this on the yeast cell cycle transcription network, which is composed of several hundred genes with phase-specific RNA outputs. These ANNs were robust to noise in data and to a variety of perturbations. They reliably identified and ranked 10 of 12 known major cell cycle factors at the top of a set of 204, based on a sum-of-squared weights metric. Comparative analysis of motif occurrences among multiple yeast species independently confirmed relationships inferred from ANN weights analysis. ANN models can capitalize on properties of biological gene networks that other kinds of models do not. ANNs naturally take advantage of patterns of absence, as well as presence, of factor binding associated with specific expression output; they are easily subjected to in silico "mutation" to uncover biological redundancies; and they can use the full range of factor binding values. A prominent feature of cell cycle ANNs suggested an analogous property might exist in the biological network. This postulated that "network-local discrimination" occurs when regulatory connections (here between MBF and target genes are explicitly disfavored in one network module (G2, relative to others and to the class of genes outside the mitotic network. If correct, this predicts that MBF motifs will be significantly depleted from the discriminated class and that the discrimination will persist through evolution. Analysis of distantly related Schizosaccharomyces pombe confirmed this, suggesting that network-local discrimination is real and complements well-known enrichment of
Optimized biogas-fermentation by neural network control.
Holubar, P; Zani, L; Hager, M; Fröschl, W; Radak, Z; Braun, R
2003-01-01
In this work several feed-forward back-propagation neural networks (FFBP) were trained in order to model, and subsequently control, methane production in anaerobic digesters. To produce data for the training of the neural nets, four anaerobic continuous stirred tank reactors (CSTR) were operated in steady-state conditions at organic loading rates (Br) of about 2 kg x m(-3) x d(-1) chemical oxygen demand (COD), and disturbed by pulse-like increase of the organic loading rate. For the pulses additional carbon sources were added to the basic feed (surplus- and primary sludge) to simulate cofermentation and to increase the COD. Measured parameters were: gas composition, methane production rate, volatile fatty acid concentration, pH, redox potential, volatile suspended solids and COD of feed and effluent. A hierarchical system of neural nets was developed and embedded in a Decision Support System (DSS). A 3-3-1 FFBP simulated the pH with a regression coefficient of 0.82. A 9-3-3 FFBP simulated the volatile fatty acid concentration in the sludge with a regression coefficient of 0.86. And a 9-3-2 FFBP simulated the gas production and gas composition with a regression coefficient of 0.90 and 0.80 respectively. A lab-scale anaerobic CSTR controlled by this tool was able to maintain a methane concentration of about 60% at a rather high gas production rate of between 5 to 5.6 m3 x m(-3) x d(-1).
Plant Growth Models Using Artificial Neural Networks
Bubenheim, David
1997-01-01
In this paper, we descrive our motivation and approach to devloping models and the neural network architecture. Initial use of the artificial neural network for modeling the single plant process of transpiration is presented.
Ocean wave forecasting using recurrent neural networks
Digital Repository Service at National Institute of Oceanography (India)
Mandal, S.; Prabaharan, N.
, merchant vessel routing, nearshore construction, etc. more efficiently and safely. This paper describes an artificial neural network, namely recurrent neural network with rprop update algorithm and is applied for wave forecasting. Measured ocean waves off...
Generalization performance of regularized neural network models
DEFF Research Database (Denmark)
Larsen, Jan; Hansen, Lars Kai
1994-01-01
Architecture optimization is a fundamental problem of neural network modeling. The optimal architecture is defined as the one which minimizes the generalization error. This paper addresses estimation of the generalization performance of regularized, complete neural network models. Regularization...
Improved transformer protection using probabilistic neural network ...
African Journals Online (AJOL)
user
This article presents a novel technique to distinguish between magnetizing inrush ... Protective relaying, Probabilistic neural network, Active power relays, Power ... Forward Neural Network (MFFNN) with back-propagation learning technique.
Neural Network for Sparse Reconstruction
Directory of Open Access Journals (Sweden)
Qingfa Li
2014-01-01
Full Text Available We construct a neural network based on smoothing approximation techniques and projected gradient method to solve a kind of sparse reconstruction problems. Neural network can be implemented by circuits and can be seen as an important method for solving optimization problems, especially large scale problems. Smoothing approximation is an efficient technique for solving nonsmooth optimization problems. We combine these two techniques to overcome the difficulties of the choices of the step size in discrete algorithms and the item in the set-valued map of differential inclusion. In theory, the proposed network can converge to the optimal solution set of the given problem. Furthermore, some numerical experiments show the effectiveness of the proposed network in this paper.
The Physics of Neural Networks
Gutfreund, Hanoch; Toulouse, Gerard
The following sections are included: * Introduction * Historical Perspective * Why Statistical Physics? * Purpose and Outline of the Paper * Basic Elements of Neural Network Models * The Biological Neuron * From the Biological to the Formal Neuron * The Formal Neuron * Network Architecture * Network Dynamics * Basic Functions of Neural Network Models * Associative Memory * Learning * Categorization * Generalization * Optimization * The Hopfield Model * Solution of the Model * The Merit of the Hopfield Model * Beyond the Standard Model * The Gardner Approach * A Microcanonical Formulation * The Case of Biased Patterns * A Canonical Formulation * Constraints on the Synaptic Weights * Learning with Errors * Learning with Noise * Hierarchically Correlated Data and Categorization * Hierarchical Data Structures * Storage of Hierarchical Data Structures * Categorization * Generalization * Learning a Classification Task * The Reference Perceptron Problem * The Contiguity Problem * Discussion - Issues of Relevance * The Notion of Attractors and Modes of Computation * The Nature of Attractors * Temporal versus Spatial Coding * Acknowledgements * References
Feed-forward regulation of phagocytosis by Entamoeba histolytica.
Sateriale, Adam; Vaithilingam, Archana; Donnelly, Liam; Miller, Peter; Huston, Christopher D
2012-12-01
The parasitic protozoan Entamoeba histolytica is aptly named for its capacity to destroy host tissue. When E. histolytica trophozoites invade the lamina propria of a host colon, extracellular matrices are degraded while host cells are killed and phagocytosed. The ability of E. histolytica to phagocytose host cells correlates with virulence in vivo. In order to better understand the mechanism of phagocytosis, we used an E. histolytica Affymetrix microarray chip to measure the total gene expression of phagocytic and nonphagocytic subpopulations. Using paramagnetic beads coated with a known host ligand that stimulates phagocytosis, phagocytic and nonphagocytic amoebae from a single culture were purified. Microarray analysis of the subpopulations identified 121 genes with >2-fold higher expression in phagocytic than in nonphagocytic amoebae. Functional annotation identified genes encoding proteins involved in actin binding and cytoskeletal organization as highly enriched gene clusters. Post hoc analyses of selected genes showed that the gene expression profile identified in the microarray experiment did not exist prior to cell sorting but rather was stimulated through phagocytosis. Further, these expression profiles correlated with an increase in phagocytic ability, as E. histolytica cultures exposed to an initial stimulus of phagocytosis showed increased phagocytic ability upon a second stimulus. To our knowledge, this is the first description of such feed-forward regulation of gene expression and phagocytic ability in a phagocyte.
Adaptive Feed-Forward Control of Low Frequency Interior Noise
Kletschkowski, Thomas
2012-01-01
This book presents a mechatronic approach to Active Noise Control (ANC). It describes the required elements of system theory, engineering acoustics, electroacoustics and adaptive signal processing in a comprehensive, consistent and systematic manner using a unified notation. Furthermore, it includes a design methodology for ANC-systems, explains its application and describes tools to be used for ANC-system design. From the research point of view, the book presents new approaches to sound source localization in weakly damped interiors. One is based on the inverse finite element method, the other is based on a sound intensity probe with an active free field. Furthermore, a prototype of an ANC-system able to reach the physical limits of local (feed-forward) ANC is described. This is one example for applied research in ANC-system design. Other examples are given for (i) local ANC in a semi-enclosed subspace of an aircraft cargo hold and (ii) for the combination of audio entertainment with ANC.
Institute of Scientific and Technical Information of China (English)
Mostafa Lashkarbolooki; Ali Zeinolabedini Hezave; Mahdi Bayat
2017-01-01
Accurate estimation of liquid thermal conductivity is highly necessary to appropriately design equipments in dif-ferent industries. Respect to this necessity, in the current investigation a feed-forward artificial neural network (ANN) model is examined to correlate the liquid thermal conductivity of normal and aromatic hydrocarbons at the temperatures range of 257–338 K and atmospheric pressure. For this purpose, 956 experimental thermal con-ductivities for normal and aromatic hydrocarbons are collected from different previously published literature. During the modeling stage, to discriminate different substances, critical temperature (Tc), critical pressure (Pc) and acentric factor (ω) are utilized as the network inputs besides the temperature. During the examination, ef-fects of different transfer functions and number of neurons in hidden layer are investigated to find the optimum network architecture. Besides, statistical error analysis considering the results obtained from available correla-tions and group contribution methods and proposed neural network is performed to reliably check the feasibility and accuracy of the proposed method. Respect to the obtained results, it can be concluded that the proposed neu-ral network consisted of three layers namely, input, hidden and output layers with 22 neurons in hidden layer was the optimum ANN model. Generally, the proposed model enables to correlate the thermal conductivity of normal and aromatic hydrocarbons with absolute average relative deviation percent (AARD), mean square error (MSE), and correlation coefficient (R2) of lower than 0.2%, 1.05 × 10?7 and 0.9994, respectively.
Pandey, Daya Shankar; Das, Saptarshi; Pan, Indranil; Leahy, James J; Kwapinski, Witold
2016-12-01
In this paper, multi-layer feed forward neural networks are used to predict the lower heating value of gas (LHV), lower heating value of gasification products including tars and entrained char (LHVp) and syngas yield during gasification of municipal solid waste (MSW) during gasification in a fluidized bed reactor. These artificial neural networks (ANNs) with different architectures are trained using the Levenberg-Marquardt (LM) back-propagation algorithm and a cross validation is also performed to ensure that the results generalise to other unseen datasets. A rigorous study is carried out on optimally choosing the number of hidden layers, number of neurons in the hidden layer and activation function in a network using multiple Monte Carlo runs. Nine input and three output parameters are used to train and test various neural network architectures in both multiple output and single output prediction paradigms using the available experimental datasets. The model selection procedure is carried out to ascertain the best network architecture in terms of predictive accuracy. The simulation results show that the ANN based methodology is a viable alternative which can be used to predict the performance of a fluidized bed gasifier. Copyright © 2016 Elsevier Ltd. All rights reserved.
Modeling Distillation Column Using ARX Model Structure and Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Reza Pirmoradi
2012-04-01
Full Text Available Distillation is a complex and highly nonlinear industrial process. In general it is not always possible to obtain accurate first principles models for high-purity distillation columns. On the other hand the development of first principles models is usually time consuming and expensive. To overcome these problems, empirical models such as neural networks can be used. One major drawback of empirical models is that the prediction is valid only inside the data domain that is sufficiently covered by measurement data. Modeling distillation columns by means of neural networks is reported in literature by using recursive networks. The recursive networks are proper for modeling purpose, but such models have the problems of high complexity and high computational cost. The objective of this paper is to propose a simple and reliable model for distillation column. The proposed model uses feed forward neural networks which results in a simple model with less parameters and faster training time. Simulation results demonstrate that predictions of the proposed model in all regions are close to outputs of the dynamic model and the error in negligible. This implies that the model is reliable in all regions.
Neural networks and applications tutorial
Guyon, I.
1991-09-01
The importance of neural networks has grown dramatically during this decade. While only a few years ago they were primarily of academic interest, now dozens of companies and many universities are investigating the potential use of these systems and products are beginning to appear. The idea of building a machine whose architecture is inspired by that of the brain has roots which go far back in history. Nowadays, technological advances of computers and the availability of custom integrated circuits, permit simulations of hundreds or even thousands of neurons. In conjunction, the growing interest in learning machines, non-linear dynamics and parallel computation spurred renewed attention in artificial neural networks. Many tentative applications have been proposed, including decision systems (associative memories, classifiers, data compressors and optimizers), or parametric models for signal processing purposes (system identification, automatic control, noise canceling, etc.). While they do not always outperform standard methods, neural network approaches are already used in some real world applications for pattern recognition and signal processing tasks. The tutorial is divided into six lectures, that where presented at the Third Graduate Summer Course on Computational Physics (September 3-7, 1990) on Parallel Architectures and Applications, organized by the European Physical Society: (1) Introduction: machine learning and biological computation. (2) Adaptive artificial neurons (perceptron, ADALINE, sigmoid units, etc.): learning rules and implementations. (3) Neural network systems: architectures, learning algorithms. (4) Applications: pattern recognition, signal processing, etc. (5) Elements of learning theory: how to build networks which generalize. (6) A case study: a neural network for on-line recognition of handwritten alphanumeric characters.
Meta-Learning Evolutionary Artificial Neural Networks
Abraham, Ajith
2004-01-01
In this paper, we present MLEANN (Meta-Learning Evolutionary Artificial Neural Network), an automatic computational framework for the adaptive optimization of artificial neural networks wherein the neural network architecture, activation function, connection weights; learning algorithm and its parameters are adapted according to the problem. We explored the performance of MLEANN and conventionally designed artificial neural networks for function approximation problems. To evaluate the compara...
Building a Chaotic Proved Neural Network
Bahi, Jacques M; Salomon, Michel
2011-01-01
Chaotic neural networks have received a great deal of attention these last years. In this paper we establish a precise correspondence between the so-called chaotic iterations and a particular class of artificial neural networks: global recurrent multi-layer perceptrons. We show formally that it is possible to make these iterations behave chaotically, as defined by Devaney, and thus we obtain the first neural networks proven chaotic. Several neural networks with different architectures are trained to exhibit a chaotical behavior.
Move Ordering using Neural Networks
Kocsis, L.; Uiterwijk, J.; Van Den Herik, J.
2001-01-01
© Springer-Verlag Berlin Heidelberg 2001. The efficiency of alpha-beta search algorithms heavily depends on the order in which the moves are examined. This paper focuses on using neural networks to estimate the likelihood of a move being the best in a certain position. The moves considered more like
Neural Network based Consumption Forecasting
DEFF Research Database (Denmark)
Madsen, Per Printz
2016-01-01
This paper describe a Neural Network based method for consumption forecasting. This work has been financed by the The ENCOURAGE project. The aims of The ENCOURAGE project is to develop embedded intelligence and integration technologies that will directly optimize energy use in buildings and enable...
Spin glasses and neural networks
Energy Technology Data Exchange (ETDEWEB)
Parga, N. (Comision Nacional de Energia Atomica, San Carlos de Bariloche (Argentina). Centro Atomico Bariloche; Universidad Nacional de Cuyo, San Carlos de Bariloche (Argentina). Inst. Balseiro)
1989-07-01
The mean-field theory of spin glass models has been used as a prototype of systems with frustration and disorder. One of the most interesting related systems are models of associative memories. In these lectures we review the main concepts developed to solve the Sherrington-Kirkpatrick model and its application to neural networks. (orig.).
Artificial neural networks in medicine
Energy Technology Data Exchange (ETDEWEB)
Keller, P.E.
1994-07-01
This Technology Brief provides an overview of artificial neural networks (ANN). A definition and explanation of an ANN is given and situations in which an ANN is used are described. ANN applications to medicine specifically are then explored and the areas in which it is currently being used are discussed. Included are medical diagnostic aides, biochemical analysis, medical image analysis and drug development.
Competition Based Neural Networks for Assignment Problems
Institute of Scientific and Technical Information of China (English)
李涛; LuyuanFang
1991-01-01
Competition based neural networks have been used to solve the generalized assignment problem and the quadratic assignment problem.Both problems are very difficult and are ε approximation complete.The neural network approach has yielded highly competitive performance and good performance for the quadratic assignment problem.These neural networks are guaranteed to produce feasible solutions.
Analysis of neural networks through base functions
van der Zwaag, B.J.; Slump, Cornelis H.; Spaanenburg, L.
Problem statement. Despite their success-story, neural networks have one major disadvantage compared to other techniques: the inability to explain comprehensively how a trained neural network reaches its output; neural networks are not only (incorrectly) seen as a "magic tool" but possibly even more
Simplified LQG Control with Neural Networks
DEFF Research Database (Denmark)
Sørensen, O.
1997-01-01
A new neural network application for non-linear state control is described. One neural network is modelled to form a Kalmann predictor and trained to act as an optimal state observer for a non-linear process. Another neural network is modelled to form a state controller and trained to produce...
Analysis of Neural Networks through Base Functions
Zwaag, van der B.J.; Slump, C.H.; Spaanenburg, L.
2002-01-01
Problem statement. Despite their success-story, neural networks have one major disadvantage compared to other techniques: the inability to explain comprehensively how a trained neural network reaches its output; neural networks are not only (incorrectly) seen as a "magic tool" but possibly even more
On Using a Support Vector Machine in Learning Feed-Forward Control
de Kruif, B.J.; de Vries, Theodorus J.A.
2001-01-01
For mechatronic motion systems, the performance increases significantly if, besides feedback control, also feed-forward control is used. This feed-forward part should contain the (stable part of the) inverse of the plant. This inverse is difficult to obtain if non-linear dynamics are present. To
On Using a Support Vector Machine in Learning Feed-Forward Control
Kruif, de Bas J.; Vries, de Theo J.A.
2001-01-01
For mechatronic motion systems, the performance increases significantly if, besides feedback control, also feed-forward control is used. This feed-forward part should contain the (stable part of the) inverse of the plant. This inverse is difficult to obtain if non-linear dynamics are present. To ove
DEFF Research Database (Denmark)
Conrad, Finn; Zhou, Jianjun; Gabacik, Andrzej;
1998-01-01
Invited paper presents a new control algorithm based on feed-forward geometrical compensation strategy combined with adaptive feedback control.......Invited paper presents a new control algorithm based on feed-forward geometrical compensation strategy combined with adaptive feedback control....
Murphy, Karen; Barry, Shane
2016-01-01
Presentation feedback can be limited in its feed-forward value, as students do not have their actual presentation available for review whilst reflecting upon the feedback. This study reports on students' perceptions of the learning and feed-forward value of an oral presentation assessment. Students self-marked their performance immediately after…
A direct inversion scheme for deep resistivity sounding data using artificial neural networks
Indian Academy of Sciences (India)
Jimmy Stephen; C Manoj; S B Singh
2004-03-01
Initialization of model parameters is crucial in the conventional 1D inversion of DC electrical data, since a poor guess may result in undesired parameter estimations. In the present work, we investigate the performance of neural networks in the direct inversion of DC sounding data, without the need of a priori information. We introduce a two-step network approach where the first network identifies the curve type, followed by the model parameter estimation using the second network. This approach provides the flexibility to accommodate all the characteristic sounding curve types with a wide range of resistivity and thickness. Here we realize a three layer feed-forward neural network with fast back propagation learning algorithms performing well. The basic data sets for training and testing were simulated on the basis of available deep resistivity sounding (DRS) data from the crystalline terrains of south India. The optimum network parameters and performance were decided as a function of the testing error convergence with respect to the network training error. On adequate training, the final weights simulate faithfully to recover resistivity and thickness on new data. The small discrepancies noticed, however, are well within the resolvability of resistivity sounding curve interpretations.
Empirical physical formula for potential energy curves of 38-66Ti isotopes by using neural networks
Akkoyun, S; Kara, S O; Yildiz, N
2012-01-01
Nuclear shape transition has been actively studied in the past decade. In particular, the understanding of this phenomenon from a microscopic point of view is of great importance. Because of this reason, many works have been employed to investigate shape phase transition in nuclei within the relativistic and non-relativistic mean field models by examining potential energy curves (PECs). In this paper, by using layered feed-forward neural networks (LFNNs), we have constructed consistent empirical physical formulas (EPFs) for the PECs of 38-66Ti calculated in Hartree-Fock-Bogoliubov (HFB) method with SLy4 Skyrme forces. It has been seen that the PECs obtained by neural network method are compatible with those of HFB calculations.
Directory of Open Access Journals (Sweden)
Tosun Erdi
2017-01-01
Full Text Available This study was aimed at estimating the variation of several engine control parameters within the rotational speed-load map, using regression analysis and artificial neural network techniques. Duration of injection, specific fuel consumption, exhaust gas at turbine inlet, and within the catalytic converter brick were chosen as the output parameters for the models, while engine speed and brake mean effective pressure were selected as independent variables for prediction. Measurements were performed on a turbocharged direct injection spark ignition engine fueled with gasoline. A three-layer feed-forward structure and back-propagation algorithm was used for training the artificial neural network. It was concluded that this technique is capable of predicting engine parameters with better accuracy than linear and non-linear regression techniques.
Institute of Scientific and Technical Information of China (English)
XIONG ZhiHua; DONG Jin; ZHANG Jie
2009-01-01
An optimal iterative learning control (ILC) strategy of improving endpoint products in semi-batch processes is presented by combining a neural network model. Control affine feed-forward neural network (CAFNN) is proposed to build a model of semi-batch process. The main advantage of CAFNN is to obtain analytically its gradient of endpoint products with respect to input. Therefore, an optimal ILC law with direct error feedback is obtained explicitly, and the convergence of tracking error can be analyzed theoretically. It has been proved that the tracking errors may converge to small values. The proposed modeling and control strategy is illustrated on a simulated isothermal semi-batch reactor, and the results show that the endpoint products can be improved gradually from batch to batch.
López-Rosales, L; Gallardo-Rodríguez, J J; Sánchez-Mirón, A; Contreras-Gómez, A; García-Camacho, F; Molina-Grima, E
2013-10-01
This study examines the use of artificial neural networks as predictive tools for the growth of the dinoflagellate microalga Protoceratium reticulatum. Feed-forward back-propagation neural networks (FBN), using Levenberg-Marquardt back-propagation or Bayesian regularization as training functions, offered the best results in terms of representing the nonlinear interactions among all nutrients in a culture medium containing 26 different components. A FBN configuration of 26-14-1 layers was selected. The FBN model was trained using more than 500 culture experiments on a shake flask scale. Garson's algorithm provided a valuable means of evaluating the relative importance of nutrients in terms of microalgal growth. Microelements and vitamins had a significant importance (approximately 70%) in relation to macronutrients (nearly 25%), despite their concentrations in the culture medium being various orders of magnitude smaller. The approach presented here may be useful for modelling multi-nutrient interactions in photobioreactors.
Neural network simulation of the atmospheric point spread function for the adjacency effect research
Ma, Xiaoshan; Wang, Haidong; Li, Ligang; Yang, Zhen; Meng, Xin
2016-10-01
Adjacency effect could be regarded as the convolution of the atmospheric point spread function (PSF) and the surface leaving radiance. Monte Carlo is a common method to simulate the atmospheric PSF. But it can't obtain analytic expression and the meaningful results can be only acquired by statistical analysis of millions of data. A backward Monte Carlo algorithm was employed to simulate photon emitting and propagating in the atmosphere under different conditions. The PSF was determined by recording the photon-receiving numbers in fixed bin at different position. A multilayer feed-forward neural network with a single hidden layer was designed to learn the relationship between the PSF's and the input condition parameters. The neural network used the back-propagation learning rule for training. Its input parameters involved atmosphere condition, spectrum range, observing geometry. The outputs of the network were photon-receiving numbers in the corresponding bin. Because the output units were too many to be allowed by neural network, the large network was divided into a collection of smaller ones. These small networks could be ran simultaneously on many workstations and/or PCs to speed up the training. It is important to note that the simulated PSF's by Monte Carlo technique in non-nadir viewing angles are more complicated than that in nadir conditions which brings difficulties in the design of the neural network. The results obtained show that the neural network approach could be very useful to compute the atmospheric PSF based on the simulated data generated by Monte Carlo method.
Automatic facial feature extraction and expression recognition based on neural network
Khandait, S P; Khandait, P D
2012-01-01
In this paper, an approach to the problem of automatic facial feature extraction from a still frontal posed image and classification and recognition of facial expression and hence emotion and mood of a person is presented. Feed forward back propagation neural network is used as a classifier for classifying the expressions of supplied face into seven basic categories like surprise, neutral, sad, disgust, fear, happy and angry. For face portion segmentation and localization, morphological image processing operations are used. Permanent facial features like eyebrows, eyes, mouth and nose are extracted using SUSAN edge detection operator, facial geometry, edge projection analysis. Experiments are carried out on JAFFE facial expression database and gives better performance in terms of 100% accuracy for training set and 95.26% accuracy for test set.
A neural network controller for hydronic heating systems of solar buildings.
Argiriou, Athanassios A; Bellas-Velidis, Ioannis; Kummert, Michaël; André, Philippe
2004-04-01
An artificial neural network (ANN)-based controller for hydronic heating plants of buildings is presented. The controller has forecasting capabilities: it includes a meteorological module, forecasting the ambient temperature and solar irradiance, an indoor temperature predictor module, a supply temperature predictor module and an optimizing module for the water supply temperature. All ANN modules are based on the Feed Forward Back Propagation (FFBP) model. The operation of the controller has been tested experimentally, on a real-scale office building during real operating conditions. The operation results were compared to those of a conventional controller. The performance was also assessed via numerical simulation. The detailed thermal simulation tool for solar systems and buildings TRNSYS was used. Both experimental and numerical results showed that the expected percentage of energy savings with respect to a conventional controller is of about 15% under North European weather conditions.
Biometric system for user authentication based on Hough transform and Neural Network
Directory of Open Access Journals (Sweden)
Rahul Dubey Dheeraj Agrawal
2011-10-01
Full Text Available Authentication of a person is the major concern in this era for security purposes. In biometric systems Signature is one of the behavioural features used for the authentication purpose. In this paper we work on the offline signature collected through different persons. Morphological operations are applied on these signature images with Hough transform to determine regular shape which assists in authentication process. The values extracted from this Hough space is used in the feed forward neural network which is trained using back-propagation algorithm. After the different training stages efficiency found above more than 95%. Application of this system will be in the security concerned fields, in the defence security, biometric authentication, as biometric computer protection or as
Prediction of primate splice site using inhomogeneous Markov chain and neural network.
Liu, Libin; Ho, Yee-Kin; Yau, Stephen
2007-07-01
The inhomogeneous Markov chain model is used to discriminate acceptor and donor sites in genomic DNA sequences. It outperforms statistical methods such as homogeneous Markov chain model, higher order Markov chain and interpolated Markov chain models, and machine-learning methods such as k-nearest neighbor and support vector machine as well. Besides its high accuracy, another advantage of inhomogeneous Markov chain model is its simplicity in computation. In the three states system (acceptor, donor, and neither), the inhomogeneous Markov chain model is combined with a three-layer feed forward neural network. Using this combined system 3175 primate splice-junction gene sequences have been tested, with a prediction accuracy of greater than 98%.
A multiple circular path convolution neural network system for detection of mammographic masses.
Lo, Shih-Chung B; Li, Huai; Wang, Yue; Kinnard, Lisa; Freedman, Matthew T
2002-02-01
A multiple circular path convolution neural network (MCPCNN) architecture specifically designed for the analysis of tumor and tumor-like structures has been constructed. We first divided each suspected tumor area into sectors and computed the defined mass features for each sector independently. These sector features were used on the input layer and were coordinated by convolution kernels of different sizes that propagated signals to the second layer in the neural network system. The convolution kernels were trained, as required, by presenting the training cases to the neural network. In this study, randomly selected mammograms were processed by a dual morphological enhancement technique. Radiodense areas were isolated and were delineated using a region growing algorithm. The boundary of each region of interest was then divided into 36 sectors using 36 equi-angular dividers radiated from the center of the region. A total of 144 Breast Imaging-Reporting and Data System-based features (i.e., four features per sector for 36 sectors) were computed as input values for the evaluation of this newly invented neural network system. The overall performance was 0.78-0.80 for the areas (Az) under the receiver operating characteristic curves using the conventional feed-forward neural network in the detection of mammographic masses. The performance was markedly improved with Az values ranging from 0.84 to 0.89 using the MCPCNN. This paper does not intend to claim the best mass detection system. Instead it reports a potentially better neural network structure for analyzing a set of the mass features defined by an investigator.
Koyuncu, A.; Cigeroglu, E.; Özgüven, H. N.
2017-10-01
In this study, a new approach is proposed for identification of structural nonlinearities by employing cascaded optimization and neural networks. Linear finite element model of the system and frequency response functions measured at arbitrary locations of the system are used in this approach. Using the finite element model, a training data set is created, which appropriately spans the possible nonlinear configurations space of the system. A classification neural network trained on these data sets then localizes and determines the types of all nonlinearities associated with the nonlinear degrees of freedom in the system. A new training data set spanning the parametric space associated with the determined nonlinearities is created to facilitate parametric identification. Utilizing this data set, initially, a feed forward regression neural network is trained, which parametrically identifies the classified nonlinearities. Then, the results obtained are further improved by carrying out an optimization which uses network identified values as starting points. Unlike identification methods available in literature, the proposed approach does not require data collection from the degrees of freedoms where nonlinear elements are attached, and furthermore, it is sufficiently accurate even in the presence of measurement noise. The application of the proposed approach is demonstrated on an example system with nonlinear elements and on a real life experimental setup with a local nonlinearity.
Neural Network Course Changing and Track Keeping Controller for a Submarine
Directory of Open Access Journals (Sweden)
Dur Muhammad Pathan
2012-10-01
Full Text Available This paper presents the performance of ANN (Artificial Neural Networks technique for the development of controller for heading motions of submarine. A MLP (Multi-Layer Preceptron FFNN (Feed-Forward Neural Network is used for development of controller. Supervised type of learning is used for training of network by using back-propagation Algorithm. The training is performed by providing a nonlinear sliding mode controller as a supervisor. The development of controller is based on nonlinear decoupled heading model of a submarine without consideration of external environmental disturbances. To demonstrate the robustness of controller the performance of controller is tested in different operating conditions: course changing, track keeping and under the influence of sea currents. Simulations results show that in all cases, the heading error comes to zero, which indicates that the actual heading converges to the desired heading in finite time. The maximum error is observed 0.5o for 45o command angle, in presence of sea currents. The result demonstrates that the performance neural network controller has been robust.
Directory of Open Access Journals (Sweden)
Hossein Vazifehdust
2013-08-01
Full Text Available This paper presents an empirical investigation on fluctuation and trend of added value changes in oil and gas industries and their products and also to anticipate the current added value of these industries. For this aim, fluctuation of added values of different subsidiaries such as oil group products, exporting crude oil, production of gas and petroleum is investigated over the period 1959-2004. The study selects the best network to anticipate added value in subsidiaries of energy section. For the training and testing the network, all data are divided into two groups. To define input layer neurons number which are equal to auto regressive vector rank in ARMA method, the rank of auto regressive (p and mobile mean (q have been used according to proposed method of Pesaran & Pesaran. The simulated results have been extracted by using neural networks, in feed forward network which had low compatibility with the real added value.
Deterministic quantum teleportation with feed-forward in a solid state system.
Steffen, L; Salathe, Y; Oppliger, M; Kurpiers, P; Baur, M; Lang, C; Eichler, C; Puebla-Hellmann, G; Fedorov, A; Wallraff, A
2013-08-15
Engineered macroscopic quantum systems based on superconducting electronic circuits are attractive for experimentally exploring diverse questions in quantum information science. At the current state of the art, quantum bits (qubits) are fabricated, initialized, controlled, read out and coupled to each other in simple circuits. This enables the realization of basic logic gates, the creation of complex entangled states and the demonstration of algorithms or error correction. Using different variants of low-noise parametric amplifiers, dispersive quantum non-demolition single-shot readout of single-qubit states with high fidelity has enabled continuous and discrete feedback control of single qubits. Here we realize full deterministic quantum teleportation with feed-forward in a chip-based superconducting circuit architecture. We use a set of two parametric amplifiers for both joint two-qubit and individual qubit single-shot readout, combined with flexible real-time digital electronics. Our device uses a crossed quantum bus technology that allows us to create complex networks with arbitrary connecting topology in a planar architecture. The deterministic teleportation process succeeds with order unit probability for any input state, as we prepare maximally entangled two-qubit states as a resource and distinguish all Bell states in a single two-qubit measurement with high efficiency and high fidelity. We teleport quantum states between two macroscopic systems separated by 6 mm at a rate of 10(4) s(-1), exceeding other reported implementations. The low transmission loss of superconducting waveguides is likely to enable the range of this and other schemes to be extended to significantly larger distances, enabling tests of non-locality and the realization of elements for quantum communication at microwave frequencies. The demonstrated feed-forward may also find application in error correction schemes.
Feed-forward motor control of ultrafast, ballistic movements.
Kagaya, K; Patek, S N
2016-02-01
To circumvent the limits of muscle, ultrafast movements achieve high power through the use of springs and latches. The time scale of these movements is too short for control through typical neuromuscular mechanisms, thus ultrafast movements are either invariant or controlled prior to movement. We tested whether mantis shrimp (Stomatopoda: Neogonodactylus bredini) vary their ultrafast smashing strikes and, if so, how this control is achieved prior to movement. We collected high-speed images of strike mechanics and electromyograms of the extensor and flexor muscles that control spring compression and latch release. During spring compression, lateral extensor and flexor units were co-activated. The strike initiated several milliseconds after the flexor units ceased, suggesting that flexor activity prevents spring release and determines the timing of strike initiation. We used linear mixed models and Akaike's information criterion to serially evaluate multiple hypotheses for control mechanisms. We found that variation in spring compression and strike angular velocity were statistically explained by spike activity of the extensor muscle. The results show that mantis shrimp can generate kinematically variable strikes and that their kinematics can be changed through adjustments to motor activity prior to the movement, thus supporting an upstream, central-nervous-system-based control of ultrafast movement. Based on these and other findings, we present a shishiodoshi model that illustrates alternative models of control in biological ballistic systems. The discovery of feed-forward control in mantis shrimp sets the stage for the assessment of targets, strategic variation in kinematics and the role of learning in ultrafast animals. © 2016. Published by The Company of Biologists Ltd.
Yeşilkanat, Cafer Mert; Kobya, Yaşar; Taşkın, Halim; Çevik, Uğur
2017-09-01
The aim of this study was to determine spatial risk dispersion of ambient gamma dose rate (AGDR) by using both artificial neural network (ANN) and fuzzy logic (FL) methods, compare the performances of methods, make dose estimations for intermediate stations with no previous measurements and create dose rate risk maps of the study area. In order to determine the dose distribution by using artificial neural networks, two main networks and five different network structures were used; feed forward ANN; Multi-layer perceptron (MLP), Radial basis functional neural network (RBFNN), Quantile regression neural network (QRNN) and recurrent ANN; Jordan networks (JN), Elman networks (EN). In the evaluation of estimation performance obtained for the test data, all models appear to give similar results. According to the cross-validation results obtained for explaining AGDR distribution, Pearson's r coefficients were calculated as 0.94, 0.91, 0.89, 0.91, 0.91 and 0.92 and RMSE values were calculated as 34.78, 43.28, 63.92, 44.86, 46.77 and 37.92 for MLP, RBFNN, QRNN, JN, EN and FL, respectively. In addition, spatial risk maps showing distributions of AGDR of the study area were created by all models and results were compared with geological, topological and soil structure. Copyright © 2017 Elsevier Ltd. All rights reserved.
Quantum computing in neural networks
Gralewicz, P
2004-01-01
According to the statistical interpretation of quantum theory, quantum computers form a distinguished class of probabilistic machines (PMs) by encoding n qubits in 2n pbits. This raises the possibility of a large-scale quantum computing using PMs, especially with neural networks which have the innate capability for probabilistic information processing. Restricting ourselves to a particular model, we construct and numerically examine the performance of neural circuits implementing universal quantum gates. A discussion on the physiological plausibility of proposed coding scheme is also provided.
Discontinuities in recurrent neural networks.
Gavaldá, R; Siegelmann, H T
1999-04-01
This article studies the computational power of various discontinuous real computational models that are based on the classical analog recurrent neural network (ARNN). This ARNN consists of finite number of neurons; each neuron computes a polynomial net function and a sigmoid-like continuous activation function. We introduce arithmetic networks as ARNN augmented with a few simple discontinuous (e.g., threshold or zero test) neurons. We argue that even with weights restricted to polynomial time computable reals, arithmetic networks are able to compute arbitrarily complex recursive functions. We identify many types of neural networks that are at least as powerful as arithmetic nets, some of which are not in fact discontinuous, but they boost other arithmetic operations in the net function (e.g., neurons that can use divisions and polynomial net functions inside sigmoid-like continuous activation functions). These arithmetic networks are equivalent to the Blum-Shub-Smale model, when the latter is restricted to a bounded number of registers. With respect to implementation on digital computers, we show that arithmetic networks with rational weights can be simulated with exponential precision, but even with polynomial-time computable real weights, arithmetic networks are not subject to any fixed precision bounds. This is in contrast with the ARNN that are known to demand precision that is linear in the computation time. When nontrivial periodic functions (e.g., fractional part, sine, tangent) are added to arithmetic networks, the resulting networks are computationally equivalent to a massively parallel machine. Thus, these highly discontinuous networks can solve the presumably intractable class of PSPACE-complete problems in polynomial time.
Fuzzy logic systems are equivalent to feedforward neural networks
Institute of Scientific and Technical Information of China (English)
李洪兴
2000-01-01
Fuzzy logic systems and feedforward neural networks are equivalent in essence. First, interpolation representations of fuzzy logic systems are introduced and several important conclusions are given. Then three important kinds of neural networks are defined, i.e. linear neural networks, rectangle wave neural networks and nonlinear neural networks. Then it is proved that nonlinear neural networks can be represented by rectangle wave neural networks. Based on the results mentioned above, the equivalence between fuzzy logic systems and feedforward neural networks is proved, which will be very useful for theoretical research or applications on fuzzy logic systems or neural networks by means of combining fuzzy logic systems with neural networks.
Fiber optic Adaline neural networks
Ghosh, Anjan K.; Trepka, Jim; Paparao, Palacharla
1993-02-01
Optoelectronic realization of adaptive filters and equalizers using fiber optic tapped delay lines and spatial light modulators has been discussed recently. We describe the design of a single layer fiber optic Adaline neural network which can be used as a bit pattern classifier. In our realization we employ as few electronic devices as possible and use optical computation to utilize the advantages of optics in processing speed, parallelism, and interconnection. The new optical neural network described in this paper is designed for optical processing of guided lightwave signals, not electronic signals. We analyzed the convergence or learning characteristics of the optically implemented Adaline in the presence of errors in the hardware, and we studied methods for improving the convergence rate of the Adaline.
Neural Networks Methodology and Applications
Dreyfus, Gérard
2005-01-01
Neural networks represent a powerful data processing technique that has reached maturity and broad application. When clearly understood and appropriately used, they are a mandatory component in the toolbox of any engineer who wants make the best use of the available data, in order to build models, make predictions, mine data, recognize shapes or signals, etc. Ranging from theoretical foundations to real-life applications, this book is intended to provide engineers and researchers with clear methodologies for taking advantage of neural networks in industrial, financial or banking applications, many instances of which are presented in the book. For the benefit of readers wishing to gain deeper knowledge of the topics, the book features appendices that provide theoretical details for greater insight, and algorithmic details for efficient programming and implementation. The chapters have been written by experts ands seemlessly edited to present a coherent and comprehensive, yet not redundant, practically-oriented...
Rajkumar, T.; Bardina, Jorge; Clancy, Daniel (Technical Monitor)
2002-01-01
coefficients to an accuracy of 110% . In our problem, we would like to get an optimized neural network architecture and minimum data set. This has been accomplished within 500 training cycles of a neural network. After removing training pairs (outliers), the GA has produced much better results. The neural network constructed is a feed forward neural network with a back propagation learning mechanism. The main goal has been to free the network design process from constraints of human biases, and to discover better forms of neural network architectures. The automation of the network architecture search by genetic algorithms seems to have been the best way to achieve this goal.
Tselentis, G.-A.; Sokos, E.
2012-01-01
In this paper we suggest the use of diffusion-neural-networks, (neural networks with intrinsic fuzzy logic abilities) to assess the relationship between isoseismal area and earthquake magnitude for the region of Greece. It is of particular importance to study historical earthquakes for which we often have macroseismic information in the form of isoseisms but it is statistically incomplete to assess magnitudes from an isoseismal area or to train conventional artificial neural networks for magnitude estimation. Fuzzy relationships are developed and used to train a feed forward neural network with a back propagation algorithm to obtain the final relationships. Seismic intensity data from 24 earthquakes in Greece have been used. Special attention is being paid to the incompleteness and contradictory patterns in scanty historical earthquake records. The results show that the proposed processing model is very effective, better than applying classical artificial neural networks since the magnitude macroseismic intensity target function has a strong nonlinearity and in most cases the macroseismic datasets are very small.
Energy Technology Data Exchange (ETDEWEB)
Ammi, Yamina; Khaouane, Latifa; Hanini, Salah [University of Medea, Medea (Algeria)
2015-11-15
This work investigates the use of neural networks in modeling the rejection processes of organic compounds (neutral and ionic) by nanofiltration and reverse osmosis membranes. Three feed-forward neural network (NN) models, characterized by a similar structure (eleven neurons for NN1 and NN2 and twelve neurons for NN3 in the input layer, one hidden layer and one neuron in the output layer), are constructed with the aim of predicting the rejection of organic compounds (neutral and ionic). A set of 956 data points for NN1 and 701 data points for NN2 and NN3 were used to test the neural networks. 80%, 10%, and 10% of the total data were used, respectively, for the training, the validation, and the test of the three models. For the most promising neural network models, the predicted rejection values of the test dataset were compared to measured rejections values; good correlations were found (R= 0.9128 for NN1, R=0.9419 for NN2, and R=0.9527 for NN3). The root mean squared errors for the total dataset were 11.2430% for NN1, 9.0742% for NN2, and 8.2047% for NN3. Furthermore, the comparison between the predicted results and QSAR models shows that the neural network models gave far better.
Neural Networks for Speech Application.
1987-11-01
operation and neurocrience theories of how neurons process information in the brain. design. Early studies by McCulloch and Pitts dunng the forties led to...developed the commercially available Mark III and Mark IV neurocom- established by McCulloch and Pits. puters that model neural networks and run...ORGANIZERS Infonuiaonienes (1986) FOR Lashley, K. Brain Mehaius and Cblali (129)SPEECHOTECH McCullch. W and Pitts . W, ’A Logical Calculusof the
Analog electronic neural network circuits
Energy Technology Data Exchange (ETDEWEB)
Graf, H.P.; Jackel, L.D. (AT and T Bell Labs., Holmdel, NJ (USA))
1989-07-01
The large interconnectivity and moderate precision required in neural network models present new opportunities for analog computing. This paper discusses analog circuits for a variety of problems such as pattern matching, optimization, and learning. Most of the circuits build so far are relatively small, exploratory designs. The most mature circuits are those for template matching. Chips performing this function are now being applied to pattern recognition problems.
Implementing color transformation across media based on color appearance model by neural networks
Chai, Binghua; Liao, Ningfang; Zhao, Dazun
2005-02-01
Interest in color appearance models (CAM) has been greatly stimulated recently by the need in handling digital images. This article demonstrates that a multi-layers feed-forward artificial neural network with the error back-propagation algorithm was used to approximate color appearance model CIECAM02 with different white points and different media. For the prediction of the forward and inverse model respectively, in order to realize accurate mapping, especially to the inverse model, color spaces conversion between input color space and output color space (that is cylindrical coordinates and rectangular coordinates) was implemented before training the neural networks. Meanwhile we approximated the combination of the forward and inverse CIECAM02 models employing a neural network for different conditions including whites (D65 or D50) and media (booth and CRT) in order to realize the color transformation from one medium to another conveniently. The experimental results indicated that the prediction could satisfy the accuracy requirement. So in practice we can choose these two kinds of different prediction ways to meet our need according to different situations.
Directory of Open Access Journals (Sweden)
G.Sankara Narayanan
2014-03-01
Full Text Available Unconventional machining process finds lot of application in aerospace and precision industries. It is preferred over other conventional methods because of the advent of composite and high strength to weight ratio materials, complex parts and also because of its high accuracy and precision. Usually in unconventional machine tools, trial and error method is used to fix the values of process parameters which increase the production time and material wastage. A mathematical model functionally relating process parameters and operating parameters of a wire cut electric discharge machine (WEDM is developed incorporating Artificial neural network (ANN and the work piece material is SKD11 tool steel. This is accomplished by training a feed forward neural network with back propagation learning Levenberg-Marquardt algorithm. The required data used for training and testing the ANN are obtained by conducting trial runs in wire cut electric discharge machine in a small scale industry from South India. The programs for training and testing the neural network are developed, using matlab 7.0.1 package. In this work, we have considered the parameters such as thickness, time and wear as the input values and from that the values of the process parameters are related and a algorithm is arrived. Hence, the proposed algorithm reduces the time taken by trial runs to set the input process parameters of WEDM and thus reduces the production time along with reduction in material wastage. Thus the cost of machining processes is reduced and thereby increases the overall productivity.
EPOXY INSULATORSâLIFETIME PREDICTION IMPLEMENTING NEURAL NETWORK TECHNIQUE
Directory of Open Access Journals (Sweden)
L. S. Nasrat
2012-01-01
Full Text Available Due to wide implementation of Epoxy insulators in industrial applications and its economic implications; development of various Epoxy insulator materials has to be evaluated along with a reliable prediction methodology of their lifetimes. In this study, a new methodology based on Artificial-Neural-Networks (ANN is developed to predict Epoxy insulators lifetime using laboratory measurements of their surface leakage current under accelerated aging. The effect of adding fillers with various concentration rates to the Epoxy insulators such as; Calcium Silicate (CaSiO2, Mica and Magnesium Oxide (Mg(OH2 on their lifetimes is compared with the base case (no filler and dry condition. Furthermore, the lifetime of each specimen under study is examined under various weather conditions such as dry, wet, salt wet (NaCl and hydro carbon solvent Naphtha. The obtained results are weighing against the experimental measured data based on two ANN techniques; i.e., Feed-Forward-Neural-Network (FNN and Recurrent-Neural-Network (RNN. The results obtained from the FNN and RNN are compared to validate the proposed methodology to predict the lifetime of epoxy insulators in terms of the type and percentage concentration of filler. The obtained Epoxy insulators predicted lifetime under various filler concentrations and weather conditions are compared and conclusions are reported.
Vanzella, E; Fontana, A; Nonino, M; Arnouts, S; Giallongo, E; Grazian, A; Fasano, G; Popesso, P; Saracco, P; Zaggia, S R
2003-01-01
We present a technique for the estimation of photometric redshifts based on feed-forward neural networks. The Multilayer Perceptron (MLP) Artificial Neural Network is used to predict photometric redshifts in the HDF-S from an ultra deep multicolor catalog. Various possible approaches for the training of the neural network are explored, including the deepest and most complete spectroscopic redshift catalog currently available (the Hubble Deep Field North dataset) and models of the spectral energy distribution of galaxies available in the literature. The MLP can be trained on observed data, theoretical data and mixed samples. The prediction of the method is tested on the spectroscopic sample in the HDF-S (44 galaxies). Over the entire redshift range, $0.1
Directory of Open Access Journals (Sweden)
Waleed
2009-01-01
Full Text Available Problem statement: Generalization feature enhancement of neural networks, especially feed forward structural model has limited progress. The major reason behind such limitation is attributed to the principal definition and the inability to interpret it into convenient structure. Traditional schemes, unfortunately have regarded generalization as an innate outcome of the simple association, referred to by Pavlov and had been modeled by piaget as the basis of assimilating conduct. Approach: A new generalization approach based on the addition of a supportive layer to the traditional neural network scheme (atomic scheme was presented. This approach extended the signal propagation of the whole net in order to generate the output in two modes, one deals with the required output of trained patterns with predefined settings, while the other tolerates output generation dynamically with tuning capability for any newly applied input. Results: Experiments and analysis showed that the new approach is not only simpler and easier, but also is very effective as the proportions promoting the generalization ability of neural networks have reached over 90% for some cases. Conclusion: Expanding neuron as the generalization essential construction denoted the accommodating capabilities involving all the innate structures in conjugation with Intelligence abilities and with the needs of further advanced learning phases. Cogent results were attained in comparison with that of the traditional schemes.
Kumar, Rajesh; Srivastava, Smriti; Gupta, J R P
2017-03-01
In this paper adaptive control of nonlinear dynamical systems using diagonal recurrent neural network (DRNN) is proposed. The structure of DRNN is a modification of fully connected recurrent neural network (FCRNN). Presence of self-recurrent neurons in the hidden layer of DRNN gives it an ability to capture the dynamic behaviour of the nonlinear plant under consideration (to be controlled). To ensure stability, update rules are developed using lyapunov stability criterion. These rules are then used for adjusting the various parameters of DRNN. The responses of plants obtained with DRNN are compared with those obtained when multi-layer feed forward neural network (MLFFNN) is used as a controller. Also, in example 4, FCRNN is also investigated and compared with DRNN and MLFFNN. Robustness of the proposed control scheme is also tested against parameter variations and disturbance signals. Four simulation examples including one-link robotic manipulator and inverted pendulum are considered on which the proposed controller is applied. The results so obtained show the superiority of DRNN over MLFFNN as a controller. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.
Tayyab, Muhammad; Zhou, Jianzhong; Dong, Xiaohua; Ahmad, Ijaz; Sun, Na
2017-09-01
Artificial neural network (ANN) models combined with time series decomposition are widely employed to calculate the river flows; however, the influence of the application of diverse decomposing approaches on assessing correctness is inadequately compared and examined. This study investigates the certainty of monthly streamflow by applying ANNs including feed forward back propagation neural network and radial basis function neural network (RBFNN) models integrated with discrete wavelet transform (DWT), at Jinsha River basin in the upper reaches of Yangtze River of China. The effect of the noise factor of the decomposed time series on the prediction correctness has also been argued in this paper. Data have been analyzed by comparing the simulation outputs of the models with the correlation coefficient (R) root mean square errors, mean absolute errors, mean absolute percentage error and Nash-Sutcliffe Efficiency. Results show that time series decomposition technique DWT contributes in improving the accuracy of streamflow prediction, as compared to single ANN's. The detailed comparative analysis showed that the RBFNN integrated with DWT has better forecasting capabilities as compared to other developed models. Moreover, for high-precision streamflow prediction, the high-frequency section of the original time series is very crucial, which is understandable in flood season.
Prediction of monthly mean daily global solar radiation using Artificial Neural Network
Indian Academy of Sciences (India)
V Sivamadhavi; R Samuel Selvaraj
2012-12-01
In this study, a multilayer feed forward (MLFF) neural network based on back propagation algorithm was developed, trained, and tested to predict monthly mean daily global radiation in Tamil Nadu, India. Various geographical, solar and meteorological parameters of three different locations with diverse climatic conditions were used as input parameters. Out of 565 available data, 530 were used for training and the rest were used for testing the artificial neural network (ANN). A 3-layer and a 4-layer MLFF networks were developed and the performance of the developed models was evaluated based on mean bias error, mean absolute percentage error, root mean squared error and Student’s -test. The 3-layer MLFF network developed in this study did not give uniform results for the three chosen locations. Hence, a 4-layer MLFF network was developed and the average value of the mean absolute percentage error was found to be 5.47%. Values of global radiation obtained using the model were in excellent agreement with measured values. Results of this study show that the designed ANN model can be used to estimate monthly mean daily global radiation of any place in Tamil Nadu where measured global radiation data are not available.
SKYNET: an efficient and robust neural network training tool for machine learning in astronomy
Graff, Philip; Feroz, Farhan; Hobson, Michael P.; Lasenby, Anthony
2014-06-01
We present the first public release of our generic neural network training algorithm, called SKYNET. This efficient and robust machine learning tool is able to train large and deep feed-forward neural networks, including autoencoders, for use in a wide range of supervised and unsupervised learning applications, such as regression, classification, density estimation, clustering and dimensionality reduction. SKYNET uses a `pre-training' method to obtain a set of network parameters that has empirically been shown to be close to a good solution, followed by further optimization using a regularized variant of Newton's method, where the level of regularization is determined and adjusted automatically; the latter uses second-order derivative information to improve convergence, but without the need to evaluate or store the full Hessian matrix, by using a fast approximate method to calculate Hessian-vector products. This combination of methods allows for the training of complicated networks that are difficult to optimize using standard backpropagation techniques. SKYNET employs convergence criteria that naturally prevent overfitting, and also includes a fast algorithm for estimating the accuracy of network outputs. The utility and flexibility of SKYNET are demonstrated by application to a number of toy problems, and to astronomical problems focusing on the recovery of structure from blurred and noisy images, the identification of gamma-ray bursters, and the compression and denoising of galaxy images. The SKYNET software, which is implemented in standard ANSI C and fully parallelized using MPI, is available at http://www.mrao.cam.ac.uk/software/skynet/.
The LILARTI neural network system
Energy Technology Data Exchange (ETDEWEB)
Allen, J.D. Jr.; Schell, F.M.; Dodd, C.V.
1992-10-01
The material of this Technical Memorandum is intended to provide the reader with conceptual and technical background information on the LILARTI neural network system of detail sufficient to confer an understanding of the LILARTI method as it is presently allied and to facilitate application of the method to problems beyond the scope of this document. Of particular importance in this regard are the descriptive sections and the Appendices which include operating instructions, partial listings of program output and data files, and network construction information.
Indian Academy of Sciences (India)
A Stanley Raj; Y Srinivas; D Hudson Oliver; D Muthuraj
2014-03-01
The non-linear apparent resistivity problem in the subsurface study of the earth takes into account the model parameters in terms of resistivity and thickness of individual subsurface layers using the trained synthetic data by means of Artificial Neural Networks (ANN). Here we used a single layer feed-forward neural network with fast back propagation learning algorithm. So on proper training of back propagation networks it tends to give the resistivity and thickness of the subsurface layer model of the field resistivity data with reference to the synthetic data trained in the appropriate network. During training, the weights and biases of the network are iteratively adjusted to make network performance function level more efficient. On adequate training, errors are minimized and the best result is obtained using the artificial neural networks. The network is trained with more number of VES data and this trained network is demonstrated by the field data. The accuracy of inversion depends upon the number of data trained. In this novel and specially designed algorithm, the interpretation of the vertical electrical sounding has been done successfully with the more accurate layer model.
Process Neural Networks Theory and Applications
He, Xingui
2010-01-01
"Process Neural Networks - Theory and Applications" proposes the concept and model of a process neural network for the first time, showing how it expands the mapping relationship between the input and output of traditional neural networks, and enhancing the expression capability for practical problems, with broad applicability to solving problems relating to process in practice. Some theoretical problems such as continuity, functional approximation capability, and computing capability, are strictly proved. The application methods, network construction principles, and optimization alg
Neural network subtyping of depression.
Florio, T M; Parker, G; Austin, M P; Hickie, I; Mitchell, P; Wilhelm, K
1998-10-01
To examine the applicability of a neural network classification strategy to examine the independent contribution of psychomotor disturbance (PMD) and endogeneity symptoms to the DSM-III-R definition of melancholia. We studied 407 depressed patients with the clinical dataset comprising 17 endogeneity symptoms and the 18-item CORE measure of behaviourally rated PMD. A multilayer perception neural network was used to fit non-linear models of varying complexity. A linear discriminant function analysis was also used to generate a model for comparison with the non-linear models. Models (linear and non-linear) using PMD items only and endogeneity symptoms only had similar rates of successful classification, while non-linear models combining both PMD and symptoms scores achieved the best classifications. Our current non-linear model was superior to a linear analysis, a finding which may have wider application to psychiatric classification. Our non-linear analysis of depressive subtypes supports the binary view that melancholic and non-melancholic depression are separate clinical disorders rather than different forms of the same entity. This study illustrates how non-linear modelling with neural networks is a potentially fruitful approach to the study of the diagnostic taxonomy of psychiatric disorders and to clinical decision-making.
Directory of Open Access Journals (Sweden)
Sudeep Sharma
2012-07-01
Full Text Available Generalized Adaptive Linear Element (GADALINE Artificial Neural Network (ANN as an Artificial Intelligence (AI technique is used in this paper to online adaptive control of a Non-linear Inverted Pendulum (IP system. The ANN controller is designed with specifications as: network type is three (Input, Hidden and Output layered Feed-Forward Network (FFN, training is done by Widrow-Hoffs delta rule or Least Mean Square algorithm (LMS, that updates weight and bias states to minimize the error function. The research is focused on how to adapt the control actions to solve the problem of “parameter variations”. The method is applied to the Nonlinear IP model with the application of some uncertainties, and the experimental results show that the system responds very well to handle those uncertainties.
Novel quantum inspired binary neural network algorithm
Indian Academy of Sciences (India)
OM PRAKASH PATEL; ARUNA TIWARI
2016-11-01
In this paper, a quantum based binary neural network algorithm is proposed, named as novel quantum binary neural network algorithm (NQ-BNN). It forms a neural network structure by deciding weights and separability parameter in quantum based manner. Quantum computing concept represents solution probabilistically and gives large search space to find optimal value of required parameters using Gaussian random number generator. The neural network structure forms constructively having three number of layers input layer: hidden layer and output layer. A constructive way of deciding the network eliminates the unnecessary training of neural network. A new parameter that is a quantum separability parameter (QSP) is introduced here, which finds an optimal separability plane to classify input samples. During learning, it searches for an optimal separability plane. This parameter is taken as the threshold of neuron for learning of neural network. This algorithm is tested with three benchmark datasets and produces improved results than existing quantum inspired and other classification approaches.
Practical neural network recipies in C++
Masters
2014-01-01
This text serves as a cookbook for neural network solutions to practical problems using C++. It will enable those with moderate programming experience to select a neural network model appropriate to solving a particular problem, and to produce a working program implementing that network. The book provides guidance along the entire problem-solving path, including designing the training set, preprocessing variables, training and validating the network, and evaluating its performance. Though the book is not intended as a general course in neural networks, no background in neural works is assum
Directory of Open Access Journals (Sweden)
Suhartono Suhartono
2009-07-01
Full Text Available Neural network (NN is one of many method used to predict the electricity consumption per hour in many countries. NN method which is used in many previous studies is Feed-Forward Neural Network (FFNN or Autoregressive Neural Network(AR-NN. AR-NN model is not able to capture and explain the effect of moving average (MA order on a time series of data. This research was conducted with the purpose of reviewing the application of other types of NN, that is Elman-Recurrent Neural Network (Elman-RNN which could explain MA order effect and compare the result of prediction accuracy with multiple seasonal ARIMA (Autoregressive Integrated Moving Average models. As a case study, we used data electricity consumption per hour in Mengare Gresik. Result of analysis showed that the best of double seasonal Arima models suited to short-term forecasting in the case study data is ARIMA([1,2,3,4,6,7,9,10,14,21,33],1,8(0,1,124 (1,1,0168. This model produces a white noise residuals, but it does not have a normal distribution due to suspected outlier. Outlier detection in iterative produce 14 innovation outliers. There are 4 inputs of Elman-RNN network that were examined and tested for forecasting the data, the input according to lag Arima, input such as lag Arima plus 14 dummy outlier, inputs are the lag-multiples of 24 up to lag 480, and the inputs are lag 1 and lag multiples of 24+1. All of four network uses one hidden layer with tangent sigmoid activation function and one output with a linear function. The result of comparative forecast accuracy through value of MAPE out-sample showed that the fourth networks, namely Elman-RNN (22, 3, 1, is the best model for forecasting electricity consumption per hour in short term in Mengare Gresik.
Understanding Neural Networks for Machine Learning using Microsoft Neural Network Algorithm
National Research Council Canada - National Science Library
Nagesh Ramprasad
2016-01-01
.... In this research, focus is on the Microsoft Neural System Algorithm. The Microsoft Neural System Algorithm is a simple implementation of the adaptable and popular neural networks that are used in the machine learning...
Neural network modeling of emotion
Levine, Daniel S.
2007-03-01
This article reviews the history and development of computational neural network modeling of cognitive and behavioral processes that involve emotion. The exposition starts with models of classical conditioning dating from the early 1970s. Then it proceeds toward models of interactions between emotion and attention. Then models of emotional influences on decision making are reviewed, including some speculative (not and not yet simulated) models of the evolution of decision rules. Through the late 1980s, the neural networks developed to model emotional processes were mainly embodiments of significant functional principles motivated by psychological data. In the last two decades, network models of these processes have become much more detailed in their incorporation of known physiological properties of specific brain regions, while preserving many of the psychological principles from the earlier models. Most network models of emotional processes so far have dealt with positive and negative emotion in general, rather than specific emotions such as fear, joy, sadness, and anger. But a later section of this article reviews a few models relevant to specific emotions: one family of models of auditory fear conditioning in rats, and one model of induced pleasure enhancing creativity in humans. Then models of emotional disorders are reviewed. The article concludes with philosophical statements about the essential contributions of emotion to intelligent behavior and the importance of quantitative theories and models to the interdisciplinary enterprise of understanding the interactions of emotion, cognition, and behavior.
MEMBRAIN NEURAL NETWORK FOR VISUAL PATTERN RECOGNITION
Directory of Open Access Journals (Sweden)
Artur Popko
2013-06-01
Full Text Available Recognition of visual patterns is one of significant applications of Artificial Neural Networks, which partially emulate human thinking in the domain of artificial intelligence. In the paper, a simplified neural approach to recognition of visual patterns is portrayed and discussed. This paper is dedicated for investigators in visual patterns recognition, Artificial Neural Networking and related disciplines. The document describes also MemBrain application environment as a powerful and easy to use neural networks’ editor and simulator supporting ANN.
Neural Network Technique for Continous Transition from Ocean to Coastal Retrackers
Hazrina Idris, Nurul; Deng, Xiaoli; Hawani Idris, Nurul
2017-04-01
This paper presents the development of neural network for continuous transition of altimeter sea surface heights when switching from ocean to coastal waveform retrackers. In attempting to produce precise coastal sea level anomaly (SLA) via retracking waveforms, issue arose when employing multiple retracking algorithms (i.e. MLE-4, sub-waveform and threshold). The existence of relative offset between those retrackers creates 'jump' in the retracked SLA profiles. In this study, the offset between retrackers is minimized using multi-layer feed forward neural network technique. The technique reduces the offset values by modelling the complicated functions of those retracked SLAs. The technique is tested over the region of the Great Barrier Reef (GBR), Australia. The validation with Townsville and Bundaberg tide gauges shows that the threshold retracker achieves temporal correlations (r) of 0.84 and 0.75, respectively, and root mean square (RMS) error is 16 cm for both stations, indicating that the retracker produces more accurate SLAs than those of two retrackers. Meanwhile, values of r (RMS error) for MLE-4 is only 0.79 (18 cm) and 0.71 (16 cm), respectively, and for sub-waveform is 0.82 (16 cm) and 0.67 (16 cm), respectively. Therefore, with the neural network, retracked SLAs from MLE-4 and sub-waveform are aligned to those of the threshold retracker. The performance of neural network is compared with the normal procedure of offset removal, which is based on the mean of SLA differences (mean method). The performance is assessed by computing the standard deviation of difference (STD) between the SLAs above a referenced ellipsoid and the geoidal height, and the improvement of percentage (IMP). The results indicate that the neural network provides improvement in SLA precision in all 12 cases, while the mean method provides improvement in 10 out of 12 cases and deterioration is seen in two cases. In terms of STD and IMP, neural network reduces the offset better than
Design of FPGA Based Neural Network Controller for Earth Station Power System
Directory of Open Access Journals (Sweden)
Hassen T. Dorrah
2012-06-01
Full Text Available Automation of generating hardware description language code from neural networks models can highly decrease time of implementation those networks into a digital devices, thus significant money savings. To implement the neural network into hardware designer, it is required to translate generated model into device structure. VHDL language is used to describe those networks into hardware. VHDL code has been proposed to implement ANNs as well as to present simulation results with floating point arithmetic of the earth station and the satellite power systems using ModelSim® PE 6.6 simulator tool. Integration between MATLAB® and VHDL is used to save execution time of computation. The results shows that a good agreement between MATLAB and VHDL and a fast/flexible feed forward NN which is capable of dealing with floating point arithmetic operations; minimum number of CLB slices; and good speed of performance. FPGA synthesis results are obtained with view RTL schematic and technology schematic from Xilinix tool. Minimum number of utilized resources is obtained by using Xilinix VERTIX5.
Salience-Affected Neural Networks
Remmelzwaal, Leendert A; Ellis, George F R
2010-01-01
We present a simple neural network model which combines a locally-connected feedforward structure, as is traditionally used to model inter-neuron connectivity, with a layer of undifferentiated connections which model the diffuse projections from the human limbic system to the cortex. This new layer makes it possible to model global effects such as salience, at the same time as the local network processes task-specific or local information. This simple combination network displays interactions between salience and regular processing which correspond to known effects in the developing brain, such as enhanced learning as a result of heightened affect. The cortex biases neuronal responses to affect both learning and memory, through the use of diffuse projections from the limbic system to the cortex. Standard ANNs do not model this non-local flow of information represented by the ascending systems, which are a significant feature of the structure of the brain, and although they do allow associational learning with...
Prediction of geomagnetic storms from solar wind data with the use of a neural network
Directory of Open Access Journals (Sweden)
H. Lundstedt
Full Text Available An artificial feed-forward neural network with one hidden layer and error back-propagation learning is used to predict the geomagnetic activity index (D_{st} one hour in advance. The B_{z}-component and Σ_{Bz}, the density, and the velocity of the solar wind are used as input to the network. The network is trained on data covering a total of 8700 h, extracted from the 25-year period from 1963 to 1987, taken from the NSSDC data base. The performance of the network is examined with test data, not included in the training set, which covers 386 h and includes four different storms. Whilst the network predicts the initial and main phase well, the recovery phase is not modelled correctly, implying that a single hidden layer error back-propagation network is not enough, if the measured D_{st} is not available instantaneously. The performance of the network is independent of whether the raw parameters are used, or the electric field and square root of the dynamical pressure.
Sasse, Sarah K; Gerber, Anthony N
2015-01-01
Nuclear receptors (NRs) are widely targeted to treat a range of human diseases. Feed-forward loops are an ancient mechanism through which single cell organisms organize transcriptional programming and modulate gene expression dynamics, but they have not been systematically studied as a regulatory paradigm for NR-mediated transcriptional responses. Here, we provide an overview of the basic properties of feed-forward loops as predicted by mathematical models and validated experimentally in single cell organisms. We review existing evidence implicating feed-forward loops as important in controlling clinically relevant transcriptional responses to estrogens, progestins, and glucocorticoids, among other NR ligands. We propose that feed-forward transcriptional circuits are a major mechanism through which NRs integrate signals, exert temporal control over gene regulation, and compartmentalize client transcriptomes into discrete subunits. Implications for the design and function of novel selective NR ligands are discussed.
Dynamic Analysis of Structures Using Neural Networks
Directory of Open Access Journals (Sweden)
N. Ahmadi
2008-01-01
Full Text Available In the recent years, neural networks are considered as the best candidate for fast approximation with arbitrary accuracy in the time consuming problems. Dynamic analysis of structures against earthquake has the time consuming process. We employed two kinds of neural networks: Generalized Regression neural network (GR and Back-Propagation Wavenet neural network (BPW, for approximating of dynamic time history response of frame structures. GR is a traditional radial basis function neural network while BPW categorized as a wavelet neural network. In BPW, sigmoid activation functions of hidden layer neurons are substituted with wavelets and weights training are achieved using Scaled Conjugate Gradient (SCG algorithm. Comparison the results of BPW with those of GR in the dynamic analysis of eight story steel frame indicates that accuracy of the properly trained BPW was better than that of GR and therefore, BPW can be efficiently used for approximate dynamic analysis of structures.
Fast Algorithms for Convolutional Neural Networks
Lavin, Andrew; Gray, Scott
2015-01-01
Deep convolutional neural networks take GPU days of compute time to train on large data sets. Pedestrian detection for self driving cars requires very low latency. Image recognition for mobile phones is constrained by limited processing resources. The success of convolutional neural networks in these situations is limited by how fast we can compute them. Conventional FFT based convolution is fast for large filters, but state of the art convolutional neural networks use small, 3x3 filters. We ...
Modelling Microwave Devices Using Artificial Neural Networks
Directory of Open Access Journals (Sweden)
Andrius Katkevičius
2012-04-01
Full Text Available Artificial neural networks (ANN have recently gained attention as fast and flexible equipment for modelling and designing microwave devices. The paper reviews the opportunities to use them for undertaking the tasks on the analysis and synthesis. The article focuses on what tasks might be solved using neural networks, what challenges might rise when using artificial neural networks for carrying out tasks on microwave devices and discusses problem-solving techniques for microwave devices with intermittent characteristics.Article in Lithuanian
Rule Extraction using Artificial Neural Networks
2010-01-01
Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions are not as interpretable as those of decision trees. In many applications, it is desirable to extract knowledge from trained neural networks so that the users can...
Adaptive optimization and control using neural networks
Energy Technology Data Exchange (ETDEWEB)
Mead, W.C.; Brown, S.K.; Jones, R.D.; Bowling, P.S.; Barnes, C.W.
1993-10-22
Recent work has demonstrated the ability of neural-network-based controllers to optimize and control machines with complex, non-linear, relatively unknown control spaces. We present a brief overview of neural networks via a taxonomy illustrating some capabilities of different kinds of neural networks. We present some successful control examples, particularly the optimization and control of a small-angle negative ion source.
Forecasting Exchange Rate Using Neural Networks
Raksaseree, Sukhita
2009-01-01
The artificial neural network models become increasingly popular among researchers and investors since many studies have shown that it has superior performance over the traditional statistical model. This paper aims to investigate the neural network performance in forecasting foreign exchange rates based on backpropagation algorithm. The forecast of Thai Baht against seven currencies are conducted to observe the performance of the neural network models using the performance criteria for both ...
Semantic Interpretation of An Artificial Neural Network
1995-12-01
ARTIFICIAL NEURAL NETWORK .7,’ THESIS Stanley Dale Kinderknecht Captain, USAF 770 DEAT7ET77,’H IR O C 7... ARTIFICIAL NEURAL NETWORK THESIS Stanley Dale Kinderknecht Captain, USAF AFIT/GCS/ENG/95D-07 Approved for public release; distribution unlimited The views...Government. AFIT/GCS/ENG/95D-07 SEMANTIC INTERPRETATION OF AN ARTIFICIAL NEURAL NETWORK THESIS Presented to the Faculty of the School of Engineering of
Feature Weight Tuning for Recursive Neural Networks
2014-01-01
This paper addresses how a recursive neural network model can automatically leave out useless information and emphasize important evidence, in other words, to perform "weight tuning" for higher-level representation acquisition. We propose two models, Weighted Neural Network (WNN) and Binary-Expectation Neural Network (BENN), which automatically control how much one specific unit contributes to the higher-level representation. The proposed model can be viewed as incorporating a more powerful c...
Directory of Open Access Journals (Sweden)
Jokić Aleksandar I.
2012-01-01
Full Text Available In this paper the bioethanol production in batch culture by free Saccharomyces cerevisiae cells from thick juice as intermediate product of sugar beet processing was examined. The obtained results suggest that it is possible to decrease fermentation time for the cultivation medium based on thick juice with starting sugar content of 5-15 g kg-1. For the fermentation of cultivation medium based on thick juice with starting sugar content of 20 and 25 g kg-1 significant increase in ethanol content was attained during the whole fermentation process, resulting in 12.51 and 10.95 dm3 m-3 ethanol contents after 48 h, respectively. Other goals of this work were to investigate the possibilities for experimental results prediction using artificial neural networks (ANNs and to find its optimal topology. A feed-forward back-propagation artificial neural network was used to test the hypothesis. As input variables fermentation time and starting sugar content were used. Neural networks had one output value, ethanol content, yeast cell number or sugar content. There was one hidden layer and the optimal number of neurons was found to be nine for all selected network outputs. In this study transfer function was tansig and the selected learning rule was Levenberg-Marquardt. Results suggest that artificial neural networks are good prediction tool for selected network outputs. It was found that experimental results are in very good agreement with computed ones. The coefficient of determination (the R-squared was found to be 0.9997, 0.9997 and 0.9999 for ethanol content, yeast cell number and sugar content, respectively.
Prediction of Weld Penetration in FCAW of HSLA steel using Artificial Neural Networks
Asl, Y. Dadgar; Mostafa, N. B.; Panahizadeh R., V.; Seyedkashi, S. M. H.
2011-01-01
Flux-cored arc welding (FCAW) is a semiautomatic or automatic arc welding process that requires a continuously-fed consumable tubular electrode containing a flux. The main FCAW process parameters affecting the depth of penetration are welding current, arc voltage, nozzle-to-work distance, torch angle and welding speed. Shallow depth of penetration may contribute to failure of a welded structure since penetration determines the stress-carrying capacity of a welded joint. To avoid such occurrences; the welding process parameters influencing the weld penetration must be properly selected to obtain an acceptable weld penetration and hence a high quality joint. Artificial neural networks (ANN), also called neural networks (NN), are computational models used to express complex non-linear relationships between input and output data. In this paper, artificial neural network (ANN) method is used to predict the effects of welding current, arc voltage, nozzle-to-work distance, torch angle and welding speed on weld penetration depth in gas shielded FCAW of a grade of high strength low alloy steel. 32 experimental runs were carried out using the bead-on-plate welding technique. Weld penetrations were measured and on the basis of these 32 sets of experimental data, a feed-forward back-propagation neural network was created. 28 sets of the experiments were used as the training data and the remaining 4 sets were used for the testing phase of the network. The ANN has one hidden layer with eight neurons and is trained after 840 iterations. The comparison between the experimental results and ANN results showed that the trained network could predict the effects of the FCAW process parameters on weld penetration adequately.
Noise processing by microRNA-mediated circuits: The Incoherent Feed-Forward Loop, revisited
Directory of Open Access Journals (Sweden)
Silvia Grigolon
2016-04-01
Full Text Available The intrinsic stochasticity of gene expression is usually mitigated in higher eukaryotes by post-transcriptional regulation channels that stabilise the output layer, most notably protein levels. The discovery of small non-coding RNAs (miRNAs in specific motifs of the genetic regulatory network has led to identifying noise buffering as the possible key function they exert in regulation. Recent in vitro and in silico studies have corroborated this hypothesis. It is however also known that miRNA-mediated noise reduction is hampered by transcriptional bursting in simple topologies. Here, using stochastic simulations validated by analytical calculations based on van Kampen's expansion, we revisit the noise-buffering capacity of the miRNA-mediated Incoherent Feed Forward Loop (IFFL, a small module that is widespread in the gene regulatory networks of higher eukaryotes, in order to account for the effects of intermittency in the transcriptional activity of the modulator gene. We show that bursting considerably alters the circuit's ability to control static protein noise. By comparing with other regulatory architectures, we find that direct transcriptional regulation significantly outperforms the IFFL in a broad range of kinetic parameters. This suggests that, under pulsatile inputs, static noise reduction may be less important than dynamical aspects of noise and information processing in characterising the performance of regulatory elements.
Fuzzy neural network theory and application
Liu, Puyin
2004-01-01
This book systematically synthesizes research achievements in the field of fuzzy neural networks in recent years. It also provides a comprehensive presentation of the developments in fuzzy neural networks, with regard to theory as well as their application to system modeling and image restoration. Special emphasis is placed on the fundamental concepts and architecture analysis of fuzzy neural networks. The book is unique in treating all kinds of fuzzy neural networks and their learning algorithms and universal approximations, and employing simulation examples which are carefully designed to he
Neural networks for nuclear spectroscopy
Energy Technology Data Exchange (ETDEWEB)
Keller, P.E.; Kangas, L.J.; Hashem, S.; Kouzes, R.T. [Pacific Northwest Lab., Richland, WA (United States)] [and others
1995-12-31
In this paper two applications of artificial neural networks (ANNs) in nuclear spectroscopy analysis are discussed. In the first application, an ANN assigns quality coefficients to alpha particle energy spectra. These spectra are used to detect plutonium contamination in the work environment. The quality coefficients represent the levels of spectral degradation caused by miscalibration and foreign matter affecting the instruments. A set of spectra was labeled with quality coefficients by an expert and used to train the ANN expert system. Our investigation shows that the expert knowledge of spectral quality can be transferred to an ANN system. The second application combines a portable gamma-ray spectrometer with an ANN. In this system the ANN is used to automatically identify, radioactive isotopes in real-time from their gamma-ray spectra. Two neural network paradigms are examined: the linear perception and the optimal linear associative memory (OLAM). A comparison of the two paradigms shows that OLAM is superior to linear perception for this application. Both networks have a linear response and are useful in determining the composition of an unknown sample when the spectrum of the unknown is a linear superposition of known spectra. One feature of this technique is that it uses the whole spectrum in the identification process instead of only the individual photo-peaks. For this reason, it is potentially more useful for processing data from lower resolution gamma-ray spectrometers. This approach has been tested with data generated by Monte Carlo simulations and with field data from sodium iodide and Germanium detectors. With the ANN approach, the intense computation takes place during the training process. Once the network is trained, normal operation consists of propagating the data through the network, which results in rapid identification of samples. This approach is useful in situations that require fast response where precise quantification is less important.
Neural Networks for Rapid Design and Analysis
Sparks, Dean W., Jr.; Maghami, Peiman G.
1998-01-01
Artificial neural networks have been employed for rapid and efficient dynamics and control analysis of flexible systems. Specifically, feedforward neural networks are designed to approximate nonlinear dynamic components over prescribed input ranges, and are used in simulations as a means to speed up the overall time response analysis process. To capture the recursive nature of dynamic components with artificial neural networks, recurrent networks, which use state feedback with the appropriate number of time delays, as inputs to the networks, are employed. Once properly trained, neural networks can give very good approximations to nonlinear dynamic components, and by their judicious use in simulations, allow the analyst the potential to speed up the analysis process considerably. To illustrate this potential speed up, an existing simulation model of a spacecraft reaction wheel system is executed, first conventionally, and then with an artificial neural network in place.
The algorithm study for using the back propagation neural network in CT image segmentation
Zhang, Peng; Liu, Jie; Chen, Chen; Li, Ying Qi
2017-01-01
Back propagation neural network(BP neural network) is a type of multi-layer feed forward network which spread positively, while the error spread backwardly. Since BP network has advantages in learning and storing the mapping between a large number of input and output layers without complex mathematical equations to describe the mapping relationship, it is most widely used. BP can iteratively compute the weight coefficients and thresholds of the network based on the training and back propagation of samples, which can minimize the error sum of squares of the network. Since the boundary of the computed tomography (CT) heart images is usually discontinuous, and it exist large changes in the volume and boundary of heart images, The conventional segmentation such as region growing and watershed algorithm can't achieve satisfactory results. Meanwhile, there are large differences between the diastolic and systolic images. The conventional methods can't accurately classify the two cases. In this paper, we introduced BP to handle the segmentation of heart images. We segmented a large amount of CT images artificially to obtain the samples, and the BP network was trained based on these samples. To acquire the appropriate BP network for the segmentation of heart images, we normalized the heart images, and extract the gray-level information of the heart. Then the boundary of the images was input into the network to compare the differences between the theoretical output and the actual output, and we reinput the errors into the BP network to modify the weight coefficients of layers. Through a large amount of training, the BP network tend to be stable, and the weight coefficients of layers can be determined, which means the relationship between the CT images and the boundary of heart.
Directory of Open Access Journals (Sweden)
A. Yeşim Yayla
2011-02-01
Full Text Available In this study, a-three layered feed-forward backpropagation Artificial Neural Network (ANN model is developed for the supplier firms in ceramic sector on the bases of user effectiveness for using concurrent engineering method. The developed model is also questioned for its usability in the supplier evaluation process. The network's independent variables of the developed model are considered as input variables of the network and dependent variables are used as output variables. The values of these variables are determined with factor analysis. For obtaining the date set to be used in the analysis, a questionnaire form with 34 questions explaining the network's input and output variables are prepared and sent out to 52 firms active in related sector. For obtaining more accurate results from the network, the questions having factor load below 0,6 are eliminated from the analysis. With the elimination of the questions from the analysis, the answers given for 22 questions explaining 8 input variables are used for the evaluation the network's inputs, the answers given for 3 questions explaining output variables are used for the evaluation the network's outputs. The data set of the network's are divided into four equal groups with k-fold method in order to get four different alternative network structures. As a conclusion, the forecasted firm scores giving the minimum error from the network test simulation and real firm scores are found to be very close to each other, thus, it is concluded that the developed artificial neural network model can be used effectively in the supplier evaluation process.
Magnitude Sensitive Competitive Neural Networks
Pelayo Campillos, Enrique; Buldain Pérez, David; Orrite Uruñuela, Carlos
2014-01-01
En esta Tesis se presentan un conjunto de redes neuronales llamadas Magnitude Sensitive Competitive Neural Networks (MSCNNs). Se trata de un conjunto de algoritmos de Competitive Learning que incluyen un término de magnitud como un factor de modulación de la distancia usada en la competición. Al igual que otros métodos competitivos, MSCNNs realizan la cuantización vectorial de los datos, pero el término de magnitud guía el entrenamiento de los centroides de modo que se representan con alto de...
The Learning of First and Second Person Pronouns in English: Network Models and Analysis.
Oshma-Takane, Yuriko; Takane, Hoshio; Shultz, Thomas R.
1999-01-01
Investigated young children's learning of the correct use of first and second person pronouns, using feed-forward neural networks. The study involved four computer simulations using the cascade-correlation (CC) learning algorithm. Results indicated that the CC networks could produce the correct pronouns without errors if children heard pronouns…
Surrogate Modeling of Deformable Joint Contact using Artificial Neural Networks
Eskinazi, Ilan; Fregly, Benjamin J.
2016-01-01
Deformable joint contact models can be used to estimate loading conditions for cartilage-cartilage, implant-implant, human-orthotic, and foot-ground interactions. However, contact evaluations are often so expensive computationally that they can be prohibitive for simulations or optimizations requiring thousands or even millions of contact evaluations. To overcome this limitation, we developed a novel surrogate contact modeling method based on artificial neural networks (ANNs). The method uses special sampling techniques to gather input-output data points from an original (slow) contact model in multiple domains of input space, where each domain represents a different physical situation likely to be encountered. For each contact force and torque output by the original contact model, a multi-layer feed-forward ANN is defined, trained, and incorporated into a surrogate contact model. As an evaluation problem, we created an ANN-based surrogate contact model of an artificial tibiofemoral joint using over 75,000 evaluations of a fine-grid elastic foundation (EF) contact model. The surrogate contact model computed contact forces and torques about 1000 times faster than a less accurate coarse grid EF contact model. Furthermore, the surrogate contact model was seven times more accurate than the coarse grid EF contact model within the input domain of a walking motion. For larger input domains, the surrogate contact model showed the expected trend of increasing error with increasing domain size. In addition, the surrogate contact model was able to identify out-of-contact situations with high accuracy. Computational contact models created using our proposed ANN approach may remove an important computational bottleneck from musculoskeletal simulations or optimizations incorporating deformable joint contact models. PMID:26220591
The Laplacian spectrum of neural networks.
de Lange, Siemon C; de Reus, Marcel A; van den Heuvel, Martijn P
2014-01-13
The brain is a complex network of neural interactions, both at the microscopic and macroscopic level. Graph theory is well suited to examine the global network architecture of these neural networks. Many popular graph metrics, however, encode average properties of individual network elements. Complementing these "conventional" graph metrics, the eigenvalue spectrum of the normalized Laplacian describes a network's structure directly at a systems level, without referring to individual nodes or connections. In this paper, the Laplacian spectra of the macroscopic anatomical neuronal networks of the macaque and cat, and the microscopic network of the Caenorhabditis elegans were examined. Consistent with conventional graph metrics, analysis of the Laplacian spectra revealed an integrative community structure in neural brain networks. Extending previous findings of overlap of network attributes across species, similarity of the Laplacian spectra across the cat, macaque and C. elegans neural networks suggests a certain level of consistency in the overall architecture of the anatomical neural networks of these species. Our results further suggest a specific network class for neural networks, distinct from conceptual small-world and scale-free models as well as several empirical networks.
The Laplacian spectrum of neural networks
de Lange, Siemon C.; de Reus, Marcel A.; van den Heuvel, Martijn P.
2014-01-01
The brain is a complex network of neural interactions, both at the microscopic and macroscopic level. Graph theory is well suited to examine the global network architecture of these neural networks. Many popular graph metrics, however, encode average properties of individual network elements. Complementing these “conventional” graph metrics, the eigenvalue spectrum of the normalized Laplacian describes a network's structure directly at a systems level, without referring to individual nodes or connections. In this paper, the Laplacian spectra of the macroscopic anatomical neuronal networks of the macaque and cat, and the microscopic network of the Caenorhabditis elegans were examined. Consistent with conventional graph metrics, analysis of the Laplacian spectra revealed an integrative community structure in neural brain networks. Extending previous findings of overlap of network attributes across species, similarity of the Laplacian spectra across the cat, macaque and C. elegans neural networks suggests a certain level of consistency in the overall architecture of the anatomical neural networks of these species. Our results further suggest a specific network class for neural networks, distinct from conceptual small-world and scale-free models as well as several empirical networks. PMID:24454286
Convolutional LSTM Networks for Subcellular Localization of Proteins
Sønderby, Søren Kaae; Sønderby, Casper Kaae; Nielsen, Henrik; Winther, Ole
2015-01-01
Machine learning is widely used to analyze biological sequence data. Non-sequential models such as SVMs or feed-forward neural networks are often used although they have no natural way of handling sequences of varying length. Recurrent neural networks such as the long short term memory (LSTM) model on the other hand are designed to handle sequences. In this study we demonstrate that LSTM networks predict the subcellular location of proteins given only the protein sequence with high accuracy (...
Modeling of ionosphere time series using wavelet neural networks (case study: N-W of Iran)
Ghaffari Razin, Mir Reza; Voosoghi, Behzad
2016-07-01
Wavelet neural networks (WNNs) are important tools for analyzing time series especially when it is non-linear and non-stationary. It takes advantage of high resolution of wavelets and feed forward nature of neural networks (NNs). Therefore, in this paper, WNNs is used for modeling of ionosphere time series in Iran. To apply the method, observations collected at 22 GPS stations in 12 successive days of 2012 (DOY# 219-230) from Azerbaijan local GPS network are used. For training of WNN, back-propagation (BP) algorithm is used. The results of WNN compared with results of international reference ionosphere 2012 (IRI-2012) and international GNSS service (IGS) products. To assess the error of WNN, statistical indicators, relative and absolute errors are used. Minimum relative error for WNN compared with GPS TEC is 6.37% and maximum relative error is 12.94%. Also the maximum and minimum absolute error computed 6.32 and 0.13 TECU, respectively. Comparison of diurnal predicted TEC values from the WNN model and the IRI-2012 with GPS TEC revealed that the WNN provides more accurate predictions than the IRI-2012 model and IGS products in the test area.
Predicting Global Solar Radiation Using an Artificial Neural Network Single-Parameter Model
Directory of Open Access Journals (Sweden)
Karoro Angela
2011-01-01
Full Text Available We used five years of global solar radiation data to estimate the monthly average of daily global solar irradiation on a horizontal surface based on a single parameter, sunshine hours, using the artificial neural network method. The station under the study is located in Kampala, Uganda at a latitude of 0.19°N, a longitude of 32.34°E, and an altitude of 1200 m above sea level. The five-year data was split into two parts in 2003–2006 and 2007-2008; the first part was used for training, and the latter was used for testing the neural network. Amongst the models tested, the feed-forward back-propagation network with one hidden layer (65 neurons and with the tangent sigmoid as the transfer function emerged as the more appropriate model. Results obtained using the proposed model showed good agreement between the estimated and actual values of global solar irradiation. A correlation coefficient of 0.963 was obtained with a mean bias error of 0.055 MJ/m2 and a root mean square error of 0.521 MJ/m2. The single-parameter ANN model shows promise for estimating global solar irradiation at places where monitoring stations are not established and stations where we have one common parameter (sunshine hours.
Energy Technology Data Exchange (ETDEWEB)
Saini, Lalit Mohan [Department of Electrical Engineering, National Institute of Technology, Kurukshetra, Haryana 136119 (India)
2008-07-15
Up to 7 days ahead electrical peak load forecasting has been done using feed forward neural network based on Steepest descent, Bayesian regularization, Resilient and adaptive backpropagation learning methods, by incorporating the effect of eleven weather parameters and past peak load information. To avoid trapping of network into a state of local minima, the optimization of user-defined parameters viz., learning rate and error goal has been performed. The sliding window concept has been incorporated for selection of training data set. It was then reduced as per relevant selection according to the day type and season for which the forecast is made. To reduce the dimensionality of input matrix, the Principal Component Analysis method of factor extraction or correlation analysis technique has been used and their performance has been compared. The resultant data set was used for training of three-layered neural network. In order to increase the learning speed, the weights and biases were initialized according to Nguyen and Widrow method. To avoid over fitting, early stopping of training was done at the minimum validation error. (author)
Sears, Edie S; Anthony, James C
2004-01-01
This article compares the performance of multiple logistic regression (MLR) with feed-forward, artificial neural network (ANN) models for the assessment of adolescent marijuana use and clinical features of dependence based on self-evaluation from recent National Household Surveys on Drug Abuse (NHSDA). The effect of training and testing the neural networks with randomly selected data was compared to data selected as a function of survey year. The technical aim of the study was to account for adolescent marijuana use and features of marijuana dependence based on experiences with alcohol and tobacco. Similarities observed in MLR and ANN model performance may indicate no major complex or nonlinear relationships in cross-sectional epidemiological data selected to model adolescent drug use and dependence in this specific application. We concluded that ANNs should be further studied in future longitudinal research, perhaps with modeling of recursive networks, allowing feedback from drug dependence to levels of marijuana use. The ANN models also have the potential to model drug use and dependence based on input parameters with no obvious direct link to drug involvement--e.g., polymorphisms associated with "openness to experience" or other personality traits hypothesized to function as distal antecedents, and could thus be implemented to identify higher risk youths using assessments indirectly related or nonlinearly associated to adolescent drug use and dependence but less sensitive to survey-related response tendencies.
Neural Network Controlled Visual Saccades
Johnson, Jeffrey D.; Grogan, Timothy A.
1989-03-01
The paper to be presented will discuss research on a computer vision system controlled by a neural network capable of learning through classical (Pavlovian) conditioning. Through the use of unconditional stimuli (reward and punishment) the system will develop scan patterns of eye saccades necessary to differentiate and recognize members of an input set. By foveating only those portions of the input image that the system has found to be necessary for recognition the drawback of computational explosion as the size of the input image grows is avoided. The model incorporates many features found in animal vision systems, and is governed by understandable and modifiable behavior patterns similar to those reported by Pavlov in his classic study. These behavioral patterns are a result of a neuronal model, used in the network, explicitly designed to reproduce this behavior.
Elizondo, David A; Birkenhead, Ralph; Góngora, Mario; Taillard, Eric; Luyima, Patrick
2007-12-01
The Recursive Deterministic Perceptron (RDP) feed-forward multilayer neural network is a generalisation of the single layer perceptron topology. This model is capable of solving any two-class classification problem as opposed to the single layer perceptron which can only solve classification problems dealing with linearly separable sets. For all classification problems, the construction of an RDP is done automatically and convergence is always guaranteed. Three methods for constructing RDP neural networks exist: Batch, Incremental, and Modular. The Batch method has been extensively tested and it has been shown to produce results comparable with those obtained with other neural network methods such as Back Propagation, Cascade Correlation, Rulex, and Ruleneg. However, no testing has been done before on the Incremental and Modular methods. Contrary to the Batch method, the complexity of these two methods is not NP-Complete. For the first time, a study on the three methods is presented. This study will allow the highlighting of the main advantages and disadvantages of each of these methods by comparing the results obtained while building RDP neural networks with the three methods in terms of the convergence time, the level of generalisation, and the topology size. The networks were trained and tested using the following standard benchmark classification datasets: IRIS, SOYBEAN, and Wisconsin Breast Cancer. The results obtained show the effectiveness of the Incremental and the Modular methods which are as good as that of the NP-Complete Batch method but with a much lower complexity level. The results obtained with the RDP are comparable to those obtained with the backpropagation and the Cascade Correlation algorithms.
Video Traffic Prediction Using Neural Networks
Directory of Open Access Journals (Sweden)
Miloš Oravec
2008-10-01
Full Text Available In this paper, we consider video stream prediction for application in services likevideo-on-demand, videoconferencing, video broadcasting, etc. The aim is to predict thevideo stream for an efficient bandwidth allocation of the video signal. Efficient predictionof traffic generated by multimedia sources is an important part of traffic and congestioncontrol procedures at the network edges. As a tool for the prediction, we use neuralnetworks – multilayer perceptron (MLP, radial basis function networks (RBF networksand backpropagation through time (BPTT neural networks. At first, we briefly introducetheoretical background of neural networks, the prediction methods and the differencebetween them. We propose also video time-series processing using moving averages.Simulation results for each type of neural network together with final comparisons arepresented. For comparison purposes, also conventional (non-neural prediction isincluded. The purpose of our work is to construct suitable neural networks for variable bitrate video prediction and evaluate them. We use video traces from [1].
Neural networks with discontinuous/impact activations
Akhmet, Marat
2014-01-01
This book presents as its main subject new models in mathematical neuroscience. A wide range of neural networks models with discontinuities are discussed, including impulsive differential equations, differential equations with piecewise constant arguments, and models of mixed type. These models involve discontinuities, which are natural because huge velocities and short distances are usually observed in devices modeling the networks. A discussion of the models, appropriate for the proposed applications, is also provided. This book also: Explores questions related to the biological underpinning for models of neural networks\\ Considers neural networks modeling using differential equations with impulsive and piecewise constant argument discontinuities Provides all necessary mathematical basics for application to the theory of neural networks Neural Networks with Discontinuous/Impact Activations is an ideal book for researchers and professionals in the field of engineering mathematics that have an interest in app...
Neural Networks for Emotion Classification
Sun, Yafei
2011-01-01
It is argued that for the computer to be able to interact with humans, it needs to have the communication skills of humans. One of these skills is the ability to understand the emotional state of the person. This thesis describes a neural network-based approach for emotion classification. We learn a classifier that can recognize six basic emotions with an average accuracy of 77% over the Cohn-Kanade database. The novelty of this work is that instead of empirically selecting the parameters of the neural network, i.e. the learning rate, activation function parameter, momentum number, the number of nodes in one layer, etc. we developed a strategy that can automatically select comparatively better combination of these parameters. We also introduce another way to perform back propagation. Instead of using the partial differential of the error function, we use optimal algorithm; namely Powell's direction set to minimize the error function. We were also interested in construction an authentic emotion databases. This...
Artificial neural networks in neurosurgery.
Azimi, Parisa; Mohammadi, Hasan Reza; Benzel, Edward C; Shahzadi, Sohrab; Azhari, Shirzad; Montazeri, Ali
2015-03-01
Artificial neural networks (ANNs) effectively analyze non-linear data sets. The aimed was A review of the relevant published articles that focused on the application of ANNs as a tool for assisting clinical decision-making in neurosurgery. A literature review of all full publications in English biomedical journals (1993-2013) was undertaken. The strategy included a combination of key words 'artificial neural networks', 'prognostic', 'brain', 'tumor tracking', 'head', 'tumor', 'spine', 'classification' and 'back pain' in the title and abstract of the manuscripts using the PubMed search engine. The major findings are summarized, with a focus on the application of ANNs for diagnostic and prognostic purposes. Finally, the future of ANNs in neurosurgery is explored. A total of 1093 citations were identified and screened. In all, 57 citations were found to be relevant. Of these, 50 articles were eligible for inclusion in this review. The synthesis of the data showed several applications of ANN in neurosurgery, including: (1) diagnosis and assessment of disease progression in low back pain, brain tumours and primary epilepsy; (2) enhancing clinically relevant information extraction from radiographic images, intracranial pressure processing, low back pain and real-time tumour tracking; (3) outcome prediction in epilepsy, brain metastases, lumbar spinal stenosis, lumbar disc herniation, childhood hydrocephalus, trauma mortality, and the occurrence of symptomatic cerebral vasospasm in patients with aneurysmal subarachnoid haemorrhage; (4) the use in the biomechanical assessments of spinal disease. ANNs can be effectively employed for diagnosis, prognosis and outcome prediction in neurosurgery.
Optimizing neural network forecast by immune algorithm
Institute of Scientific and Technical Information of China (English)
YANG Shu-xia; LI Xiang; LI Ning; YANG Shang-dong
2006-01-01
Considering multi-factor influence, a forecasting model was built. The structure of BP neural network was designed, and immune algorithm was applied to optimize its network structure and weight. After training the data of power demand from the year 1980 to 2005 in China, a nonlinear network model was obtained on the relationship between power demand and the factors which had impacts on it, and thus the above proposed method was verified. Meanwhile, the results were compared to those of neural network optimized by genetic algorithm. The results show that this method is superior to neural network optimized by genetic algorithm and is one of the effective ways of time series forecast.
Optimising the topology of complex neural networks
Jiang, Fei; Schoenauer, Marc
2007-01-01
In this paper, we study instances of complex neural networks, i.e. neural netwo rks with complex topologies. We use Self-Organizing Map neural networks whose n eighbourhood relationships are defined by a complex network, to classify handwr itten digits. We show that topology has a small impact on performance and robus tness to neuron failures, at least at long learning times. Performance may howe ver be increased (by almost 10%) by artificial evolution of the network topo logy. In our experimental conditions, the evolved networks are more random than their parents, but display a more heterogeneous degree distribution.
Forcast of TEXT plasma disruptions using soft X-rays as input signal in a neural network
Energy Technology Data Exchange (ETDEWEB)
Vannucci, A.; Oliveira, K.A.; Tajima, T.
1998-03-03
A feed-forward neural network with two hidden layers is used in this work to forecast major and minor disruptive instabilities in TEXT discharges. Using soft X-ray signals as input data, the neural net is trained with one disruptive plasma pulse, and a different disruptive discharge is used for validation. After being properly trained the networks, with the same set of weights. is then used to forecast disruptions in two others different plasma pulses. It is observed that the neural net is able to predict the incoming of a disruption more than 3 ms in advance. This time interval is almost three times longer than the one already obtained previously when magnetic signal from a Mirnov coil was used to feed the neural networks with. To our own eye we fail to see any indication of an upcoming disruption from the experimental data this far back from the time of disruption. Finally, from what we observe in the predictive behavior of our network, speculations are made whether the disruption triggering mechanism would be associated to an increase of the m = 2 magnetic island, that disturbs the central part of the plasma column afterwards or, in face of the results from this work, the initial perturbation would have occurred first in the central part of the plasma column, within the q = 1 magnetic surface, and then the m = 2 MHD mode would be destabilized afterwards.
A new formulation for feedforward neural networks.
Razavi, Saman; Tolson, Bryan A
2011-10-01
Feedforward neural network is one of the most commonly used function approximation techniques and has been applied to a wide variety of problems arising from various disciplines. However, neural networks are black-box models having multiple challenges/difficulties associated with training and generalization. This paper initially looks into the internal behavior of neural networks and develops a detailed interpretation of the neural network functional geometry. Based on this geometrical interpretation, a new set of variables describing neural networks is proposed as a more effective and geometrically interpretable alternative to the traditional set of network weights and biases. Then, this paper develops a new formulation for neural networks with respect to the newly defined variables; this reformulated neural network (ReNN) is equivalent to the common feedforward neural network but has a less complex error response surface. To demonstrate the learning ability of ReNN, in this paper, two training methods involving a derivative-based (a variation of backpropagation) and a derivative-free optimization algorithms are employed. Moreover, a new measure of regularization on the basis of the developed geometrical interpretation is proposed to evaluate and improve the generalization ability of neural networks. The value of the proposed geometrical interpretation, the ReNN approach, and the new regularization measure are demonstrated across multiple test problems. Results show that ReNN can be trained more effectively and efficiently compared to the common neural networks and the proposed regularization measure is an effective indicator of how a network would perform in terms of generalization.
Drift chamber tracking with neural networks
Energy Technology Data Exchange (ETDEWEB)
Lindsey, C.S.; Denby, B.; Haggerty, H.
1992-10-01
We discuss drift chamber tracking with a commercial log VLSI neural network chip. Voltages proportional to the drift times in a 4-layer drift chamber were presented to the Intel ETANN chip. The network was trained to provide the intercept and slope of straight tracks traversing the chamber. The outputs were recorded and later compared off line to conventional track fits. Two types of network architectures were studied. Applications of neural network tracking to high energy physics detector triggers is discussed.
The role of feed-forward and feedback processes for closed-loop prosthesis control
Directory of Open Access Journals (Sweden)
Saunders Ian
2011-10-01
Full Text Available Abstract Background It is widely believed that both feed-forward and feed-back mechanisms are required for successful object manipulation. Open-loop upper-limb prosthesis wearers receive no tactile feedback, which may be the cause of their limited dexterity and compromised grip force control. In this paper we ask whether observed prosthesis control impairments are due to lack of feedback or due to inadequate feed-forward control. Methods Healthy subjects were fitted with a closed-loop robotic hand and instructed to grasp and lift objects of different weights as we recorded trajectories and force profiles. We conducted three experiments under different feed-forward and feed-back configurations to elucidate the role of tactile feedback (i in ideal conditions, (ii under sensory deprivation, and (iii under feed-forward uncertainty. Results (i We found that subjects formed economical grasps in ideal conditions. (ii To our surprise, this ability was preserved even when visual and tactile feedback were removed. (iii When we introduced uncertainty into the hand controller performance degraded significantly in the absence of either visual or tactile feedback. Greatest performance was achieved when both sources of feedback were present. Conclusions We have introduced a novel method to understand the cognitive processes underlying grasping and lifting. We have shown quantitatively that tactile feedback can significantly improve performance in the presence of feed-forward uncertainty. However, our results indicate that feed-forward and feed-back mechanisms serve complementary roles, suggesting that to improve on the state-of-the-art in prosthetic hands we must develop prostheses that empower users to correct for the inevitable uncertainty in their feed-forward control.
Coherence resonance in bursting neural networks.
Kim, June Hoan; Lee, Ho Jun; Min, Cheol Hong; Lee, Kyoung J
2015-10-01
Synchronized neural bursts are one of the most noticeable dynamic features of neural networks, being essential for various phenomena in neuroscience, yet their complex dynamics are not well understood. With extrinsic electrical and optical manipulations on cultured neural networks, we demonstrate that the regularity (or randomness) of burst sequences is in many cases determined by a (few) low-dimensional attractor(s) working under strong neural noise. Moreover, there is an optimal level of noise strength at which the regularity of the interburst interval sequence becomes maximal-a phenomenon of coherence resonance. The experimental observations are successfully reproduced through computer simulations on a well-established neural network model, suggesting that the same phenomena may occur in many in vivo as well as in vitro neural networks.
Energy Technology Data Exchange (ETDEWEB)
Altan Dombayci, Oemer [Department of Technical Programmes, Denizli Vocational College, Pamukkale University, 20070 Denizli (Turkey); Goelcue, Mustafa [Department of Mechanical Education, Technical Education Faculty, Pamukkale University, 20070 Denizli (Turkey)
2009-04-15
The objective of this paper is to develop an artificial neural network (ANN) model which can be used to predict daily mean ambient temperatures in Denizli, south-western Turkey. In order to train the model, temperature values, measured by The Turkish State Meteorological Service over three years (2003-2005) were used as training data and the values of 2006 were used as testing data. In order to determine the optimal network architecture, various network architectures were designed; different training algorithms were used; the number of neuron and hidden layer and transfer functions in the hidden layer/output layer were changed. The predictions were performed by taking different number of hidden layer neurons between 3 and 30. The best result was obtained when the number of the neurons is 6. The selected ANN model of a multi-layer consists of 3 inputs, 6 hidden neurons and 1 output. Training of the network was performed by using Levenberg-Marquardt (LM) feed-forward backpropagation algorithms. A computer program was performed under Matlab 6.5 software. For each network, fraction of variance (R{sup 2}) and root-mean squared error (RMSE) values were calculated and compared. The results show that the ANN approach is a reliable model for ambient temperature prediction. (author)
Neural network classification - A Bayesian interpretation
Wan, Eric A.
1990-01-01
The relationship between minimizing a mean squared error and finding the optimal Bayesian classifier is reviewed. This provides a theoretical interpretation for the process by which neural networks are used in classification. A number of confidence measures are proposed to evaluate the performance of the neural network classifier within a statistical framework.
Adaptive Neurons For Artificial Neural Networks
Tawel, Raoul
1990-01-01
Training time decreases dramatically. In improved mathematical model of neural-network processor, temperature of neurons (in addition to connection strengths, also called weights, of synapses) varied during supervised-learning phase of operation according to mathematical formalism and not heuristic rule. Evidence that biological neural networks also process information at neuronal level.
Isolated Speech Recognition Using Artificial Neural Networks
2007-11-02
In this project Artificial Neural Networks are used as research tool to accomplish Automated Speech Recognition of normal speech. A small size...the first stage of this work are satisfactory and thus the application of artificial neural networks in conjunction with cepstral analysis in isolated word recognition holds promise.
Neural Network Algorithm for Particle Loading
Energy Technology Data Exchange (ETDEWEB)
J. L. V. Lewandowski
2003-04-25
An artificial neural network algorithm for continuous minimization is developed and applied to the case of numerical particle loading. It is shown that higher-order moments of the probability distribution function can be efficiently renormalized using this technique. A general neural network for the renormalization of an arbitrary number of moments is given.
Medical image analysis with artificial neural networks.
Jiang, J; Trundle, P; Ren, J
2010-12-01
Given that neural networks have been widely reported in the research community of medical imaging, we provide a focused literature survey on recent neural network developments in computer-aided diagnosis, medical image segmentation and edge detection towards visual content analysis, and medical image registration for its pre-processing and post-processing, with the aims of increasing awareness of how neural networks can be applied to these areas and to provide a foundation for further research and practical development. Representative techniques and algorithms are explained in detail to provide inspiring examples illustrating: (i) how a known neural network with fixed structure and training procedure could be applied to resolve a medical imaging problem; (ii) how medical images could be analysed, processed, and characterised by neural networks; and (iii) how neural networks could be expanded further to resolve problems relevant to medical imaging. In the concluding section, a highlight of comparisons among many neural network applications is included to provide a global view on computational intelligence with neural networks in medical imaging. Copyright © 2010 Elsevier Ltd. All rights reserved.
Creativity in design and artificial neural networks
Energy Technology Data Exchange (ETDEWEB)
Neocleous, C.C.; Esat, I.I. [Brunel Univ. Uxbridge (United Kingdom); Schizas, C.N. [Univ. of Cyprus, Nicosia (Cyprus)
1996-12-31
The creativity phase is identified as an integral part of the design phase. The characteristics of creative persons which are relevant to designing artificial neural networks manifesting aspects of creativity, are identified. Based on these identifications, a general framework of artificial neural network characteristics to implement such a goal are proposed.
Neural Networks for Non-linear Control
DEFF Research Database (Denmark)
Sørensen, O.
1994-01-01
This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process.......This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process....
Neural Networks for Non-linear Control
DEFF Research Database (Denmark)
Sørensen, O.
1994-01-01
This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process.......This paper describes how a neural network, structured as a Multi Layer Perceptron, is trained to predict, simulate and control a non-linear process....
Introduction to Concepts in Artificial Neural Networks
Niebur, Dagmar
1995-01-01
This introduction to artificial neural networks summarizes some basic concepts of computational neuroscience and the resulting models of artificial neurons. The terminology of biological and artificial neurons, biological and machine learning and neural processing is introduced. The concepts of supervised and unsupervised learning are explained with examples from the power system area. Finally, a taxonomy of different types of neurons and different classes of artificial neural networks is presented.
Rule Extraction using Artificial Neural Networks
Kamruzzaman, S M
2010-01-01
Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions are not as interpretable as those of decision trees. In many applications, it is desirable to extract knowledge from trained neural networks so that the users can gain a better understanding of the solution. This paper presents an efficient algorithm to extract rules from artificial neural networks. We use two-phase training algorithm for backpropagation learning. In the first phase, the number of hidden nodes of the network is determined automatically in a constructive fashion by adding nodes one after another based on the performance of the network on training data. In the second phase, the number of relevant input units of the network is determined using pruning algorithm. The ...
Comparison of Artificial Neural Network Architecture in Solving Ordinary Differential Equations
Directory of Open Access Journals (Sweden)
Susmita Mall
2013-01-01
Full Text Available This paper investigates the solution of Ordinary Differential Equations (ODEs with initial conditions using Regression Based Algorithm (RBA and compares the results with arbitrary- and regression-based initial weights for different numbers of nodes in hidden layer. Here, we have used feed forward neural network and error back propagation method for minimizing the error function and for the modification of the parameters (weights and biases. Initial weights are taken as combination of random as well as by the proposed regression based model. We present the method for solving a variety of problems and the results are compared. Here, the number of nodes in hidden layer has been fixed according to the degree of polynomial in the regression fitting. For this, the input and output data are fitted first with various degree polynomials using regression analysis and the coefficients involved are taken as initial weights to start with the neural training. Fixing of the hidden nodes depends upon the degree of the polynomial. For the example problems, the analytical results have been compared with neural results with arbitrary and regression based weights with four, five, and six nodes in hidden layer and are found to be in good agreement.
Neural Networks for Hydrological Modeling Tool for Operational Purposes
Bhatt, Divya; Jain, Ashu
2010-05-01
Hydrological models are useful in many water resources applications such as flood control, irrigation and drainage, hydro power generation, water supply, erosion and sediment control, etc. Estimates of runoff are needed in many water resources planning, design development, operation and maintenance activities. Runoff is generally computed using rainfall-runoff models. Computer based hydrologic models have become popular for obtaining hydrological forecasts and for managing water systems. Rainfall-runoff library (RRL) is computer software developed by Cooperative Research Centre for Catchment Hydrology (CRCCH), Australia consisting of five different conceptual rainfall-runoff models, and has been in operation in many water resources applications in Australia. Recently, soft artificial intelligence tools such as Artificial Neural Networks (ANNs) have become popular for research purposes but have not been adopted in operational hydrological forecasts. There is a strong need to develop ANN models based on real catchment data and compare them with the conceptual models actually in use in real catchments. In this paper, the results from an investigation on the use of RRL and ANNs are presented. Out of the five conceptual models in the RRL toolkit, SimHyd model has been used. Genetic Algorithm has been used as an optimizer in the RRL to calibrate the SimHyd model. Trial and error procedures were employed to arrive at the best values of various parameters involved in the GA optimizer to develop the SimHyd model. The results obtained from the best configuration of the SimHyd model are presented here. Feed-forward neural network model structure trained by back-propagation training algorithm has been adopted here to develop the ANN models. The daily rainfall and runoff data derived from Bird Creek Basin, Oklahoma, USA have been employed to develop all the models included here. A wide range of error statistics have been used to evaluate the performance of all the models
International Conference on Artificial Neural Networks (ICANN)
Mladenov, Valeri; Kasabov, Nikola; Artificial Neural Networks : Methods and Applications in Bio-/Neuroinformatics
2015-01-01
The book reports on the latest theories on artificial neural networks, with a special emphasis on bio-neuroinformatics methods. It includes twenty-three papers selected from among the best contributions on bio-neuroinformatics-related issues, which were presented at the International Conference on Artificial Neural Networks, held in Sofia, Bulgaria, on September 10-13, 2013 (ICANN 2013). The book covers a broad range of topics concerning the theory and applications of artificial neural networks, including recurrent neural networks, super-Turing computation and reservoir computing, double-layer vector perceptrons, nonnegative matrix factorization, bio-inspired models of cell communities, Gestalt laws, embodied theory of language understanding, saccadic gaze shifts and memory formation, and new training algorithms for Deep Boltzmann Machines, as well as dynamic neural networks and kernel machines. It also reports on new approaches to reinforcement learning, optimal control of discrete time-delay systems, new al...
Neural node network and model, and method of teaching same
Parlos, Alexander G. (Inventor); Atiya, Amir F. (Inventor); Fernandez, Benito (Inventor); Tsai, Wei K. (Inventor); Chong, Kil T. (Inventor)
1995-01-01
The present invention is a fully connected feed forward network that includes at least one hidden layer 16. The hidden layer 16 includes nodes 20 in which the output of the node is fed back to that node as an input with a unit delay produced by a delay device 24 occurring in the feedback path 22 (local feedback). Each node within each layer also receives a delayed output (crosstalk) produced by a delay unit 36 from all the other nodes within the same layer 16. The node performs a transfer function operation based on the inputs from the previous layer and the delayed outputs. The network can be implemented as analog or digital or within a general purpose processor. Two teaching methods can be used: (1) back propagation of weight calculation that includes the local feedback and the crosstalk or (2) more preferably a feed forward gradient decent which immediately follows the output computations and which also includes the local feedback and the crosstalk. Subsequent to the gradient propagation, the weights can be normalized, thereby preventing convergence to a local optimum. Education of the network can be incremental both on and off-line. An educated network is suitable for modeling and controlling dynamic nonlinear systems and time series systems and predicting the outputs as well as hidden states and parameters. The educated network can also be further educated during on-line processing.
Wavelet Neural Networks for Adaptive Equalization
Institute of Scientific and Technical Information of China (English)
JIANGMinghu; DENGBeixing; GIELENGeorges; ZHANGBo
2003-01-01
A structure based on the Wavelet neural networks (WNNs) is proposed for nonlinear channel equalization in a digital communication system. The construction algorithm of the Minimum error probability (MEP) is presented and applied as a performance criterion to update the parameter matrix of wavelet networks. Our experimental results show that performance of the proposed wavelet networks based on equalizer can significantly improve the neural modeling accuracy, perform quite well in compensating the nonlinear distortion introduced by the channel, and outperform the conventional neural networks in signal to noise ratio and channel non-llnearity.
An Artificial Neural Network for Analyzing Overall Uniformity in Outdoor Lighting Systems
Directory of Open Access Journals (Sweden)
Antonio del Corte-Valiente
2017-02-01
Full Text Available Street lighting installations are an essential service for modern life due to their capability of creating a welcoming feeling at nighttime. Nevertheless, several studies have highlighted that it is possible to improve the quality of the light significantly improving the uniformity of the illuminance. The main difficulty arises when trying to improve some of the installation’s characteristics based only on statistical analysis of the light distribution. This paper presents a new algorithm that is able to obtain the overall illuminance uniformity in order to improve this sort of installations. To develop this algorithm it was necessary to perform a detailed study of all the elements which are part of street lighting installations. Because classification is one of the most important tasks in the application areas of artificial neural networks, we compared the performances of six types of training algorithms in a feed forward neural network for analyzing the overall uniformity in outdoor lighting systems. We found that the best algorithm that minimizes the error is “Levenberg-Marquardt back-propagation”, which approximates the desired output of the training pattern. By means of this kind of algorithm, it is possible to help to lighting professionals optimize the quality of street lighting installations.
Sand/cement ratio evaluation on mortar using neural networks and ultrasonic transmission inspection.
Molero, M; Segura, I; Izquierdo, M A G; Fuente, J V; Anaya, J J
2009-02-01
The quality and degradation state of building materials can be determined by nondestructive testing (NDT). These materials are composed of a cementitious matrix and particles or fragments of aggregates. Sand/cement ratio (s/c) provides the final material quality; however, the sand content can mask the matrix properties in a nondestructive measurement. Therefore, s/c ratio estimation is needed in nondestructive characterization of cementitious materials. In this study, a methodology to classify the sand content in mortar is presented. The methodology is based on ultrasonic transmission inspection, data reduction, and features extraction by principal components analysis (PCA), and neural network classification. This evaluation is carried out with several mortar samples, which were made while taking into account different cement types and s/c ratios. The estimated s/c ratio is determined by ultrasonic spectral attenuation with three different broadband transducers (0.5, 1, and 2 MHz). Statistical PCA to reduce the dimension of the captured traces has been applied. Feed-forward neural networks (NNs) are trained using principal components (PCs) and their outputs are used to display the estimated s/c ratios in false color images, showing the s/c ratio distribution of the mortar samples.
Directory of Open Access Journals (Sweden)
M. Sreeshakthy
2016-01-01
Full Text Available Department of Computer Science and Engineering,Anna University Regional Centre, Coimbatore, Indiam.sribtechit@gmail.comJ. PreethiDepartment of Computer Science and EngineeringAnna University Regional Centre, Coimbatore, Indiapreethi17j@yahoo.comEmotions are very important in human decision handling, interaction and cognitive process. In this paper describes that recognize the human emotions from DEAP EEG dataset with different kind of methods. Audio – video based stimuli is used to extract the emotions. EEG signal is divided into different bands using discrete wavelet transformation with db8 wavelet function for further process. Statistical and energy based features are extracted from the bands, based on the features emotions are classified with feed forward neural network with weight optimized algorithm like PSO. Before that the particular band has to be selected based on the training performance of neural networks and then the emotions are classified. In this experimental result describes that the gamma and alpha bands are provides the accurate classification result with average classification rate of 90.3% of using NNRBF, 90.325% of using PNN, 96.3% of using PSO trained NN, 98.1 of using Cuckoo trained NN. At last the emotions are classified into two different groups like valence and arousal. Based on that identifies the person normal and abnormal behavioral using classified emotion.
Directory of Open Access Journals (Sweden)
Reza Azad
2014-06-01
Full Text Available In recent years, face detection has been thoroughly studied due to its wide potential applications, including face recognition, human-computer interaction, video surveillance, etc.In this paper, a new and illumination invariant face detection method, based on features inspired by the human's visual cortexand applying BP neural network on the extracted featureset is proposed.A feature set is extracted from face and non-face images, by means of a feed-forward model, which contains a view and illumination invariant C2 features from all images in the dataset. Then, these C2 feature vector which derived from a cortex-like mechanism passed to a BP neural network. In the result part, the proposed approach is applied on FEI and Wild face detection databases and high accuracy rate is achieved. In addition, experimental results have demonstrated our proposed face detector outperforms the most of the successful face detection algorithms in the literature and gives the first best result on all tested challenging face detection databases.
Detection of Pistachio Aflatoxin Using Raman Spectroscopy and Artificial Neural Networks
Directory of Open Access Journals (Sweden)
R Mohammadigol
2016-04-01
Full Text Available Pistachio contamination to aflatoxin has been known as a serious problem for pistachio exportation. With regards to the increasing demand for Raman spectroscopy to detect and classify different materials and also the current experimental and technical problems for measuring toxin (such as being expensive and time-consuming, the main objective of this study was to detect aflatoxin contamination in pistachio by using Raman spectroscopy technique and artificial neural networks. Three sets of samples were prepared: non-contaminated (healthy and contaminated samples with 20 and 100 ppb of the total aflatoxins (B1+B2+G1+G2. After spectral acquisition, considering to the results, spectral data were normalized and then principal components (PCs were extracted to reduce the data dimensions. For classification of the samples spectra, an artificial neural network was used with a feed forward back propagation algorithm for 4 inputs and 3 neurons in hidden layer. Mean overall accuracy was achieved to be 98 percent; therefore, non-liner Raman spectra data modeling by ANN for samples classification was successful.
Quantification of whey in fluid milk using confocal Raman microscopy and artificial neural network.
Alves da Rocha, Roney; Paiva, Igor Moura; Anjos, Virgílio; Furtado, Marco Antônio Moreira; Bell, Maria José Valenzuela
2015-06-01
In this work, we assessed the use of confocal Raman microscopy and artificial neural network as a practical method to assess and quantify adulteration of fluid milk by addition of whey. Milk samples with added whey (from 0 to 100%) were prepared, simulating different levels of fraudulent adulteration. All analyses were carried out by direct inspection at the light microscope after depositing drops from each sample on a microscope slide and drying them at room temperature. No pre- or posttreatment (e.g., sample preparation or spectral correction) was required in the analyses. Quantitative determination of adulteration was performed through a feed-forward artificial neural network (ANN). Different ANN configurations were evaluated based on their coefficient of determination (R2) and root mean square error values, which were criteria for selecting the best predictor model. In the selected model, we observed that data from both training and validation subsets presented R2>99.99%, indicating that the combination of confocal Raman microscopy and ANN is a rapid, simple, and efficient method to quantify milk adulteration by whey. Because sample preparation and postprocessing of spectra were not required, the method has potential applications in health surveillance and food quality monitoring.
Artificial Neural Network Based Model for Forecasting of Inflation in India
Directory of Open Access Journals (Sweden)
Gour Sundar Mitra Thakur
2016-03-01
Full Text Available Inflation can be attributed to both microeconomic and macroeconomic factors which influence the stability of the economy of any nation. With the raising of recession at the end of the year 2008, world communities started paying much contemplation on inflation and put enormous hard work to predict it accurately. Prediction of inflation is not a simple task. Moreover, the behavior of inflation is so complex and uncertain that both economists and statisticians have been striving to model and forecast inflation in an accurate way. As a result, many researchers have proposed inflation forecasting models based on different methods; however the accuracy is always being a major constraint. In this paper, we have analyzed the historical monthly economic data of India between January 2000 and December 2012 and constructed an inflation forecasting model based on feed forward back propagation neural network. Initially some critical factors that can considerably influence the inflation of India have been identified, then an efficient artificial neural network (ANN model has been proposed to forecast the inflation. Accuracy of the model is proved to be satisfactory when compared with the forecasting of some well-known agencies.
Akkoyun, Serkan
2012-01-01
The gamma-ray tracking technique is one of the highly efficient detection method in experimental nuclear structure physics. On the basis of this method, two gamma-ray tracking arrays, AGATA in Europe and GRETA in the USA, are currently being developed. The interactions of neutrons in these detectors lead to an unwanted background in the gamma-ray spectra. Thus, the interaction points of neutrons in these detectors have to be determined in the gamma-ray tracking process in order to improve photo-peak efficiencies and peak-to-total ratios of the gamma-ray peaks. Therefore, the recoil energy distributions of germanium nuclei due to inelastic scatterings of 1-5 MeV neutrons were obtained both experimentally and using artificial neural networks. Also, for highly nonlinear detector response for recoiling germanium nuclei, we have constructed consistent empirical physical formulas (EPFs) by appropriate layered feed-forward neural networks (LFNNs). These LFNN-EPFs can be used to derive further physical functions whic...
Miao, Zhiyong; Shi, Hongyang; Zhang, Yi; Xu, Fan
2017-10-01
In this paper, a new variational Bayesian adaptive cubature Kalman filter (VBACKF) is proposed for nonlinear state estimation. Although the conventional VBACKF performs better than cubature Kalman filtering (CKF) in solving nonlinear systems with time-varying measurement noise, its performance may degrade due to the uncertainty of the system model. To overcome this drawback, a multilayer feed-forward neural network (MFNN) is used to aid the conventional VBACKF, generalizing it to attain higher estimation accuracy and robustness. In the proposed neural-network-aided variational Bayesian adaptive cubature Kalman filter (NN-VBACKF), the MFNN is used to turn the state estimation of the VBACKF adaptively, and it is used for both state estimation and in the online training paradigm simultaneously. To evaluate the performance of the proposed method, it is compared with CKF and VBACKF via target tracking problems. The simulation results demonstrate that the estimation accuracy and robustness of the proposed method are better than those of the CKF and VBACKF.
Stellar Image Interpretation System using Artificial Neural Networks: Unipolar Function Case
Directory of Open Access Journals (Sweden)
F. I. Younis
2001-01-01
Full Text Available An artificial neural network based system for interpreting astronomical images has been developed. The system is based on feed-forward Artificial Neural Networks (ANNs with error back-propagation learning. Knowledge about images of stars, cosmic ray events and noise found in images is used to prepare two sets of input patterns to train and test our approach. The system has been developed and implemented to scan astronomical digital images in order to segregate stellar images from other entities. It has been coded in C language for users of personal computers. An astronomical image of a star cluster from other objects is undertaken as a test case. The obtained results are found to be in very good agreement with those derived from the DAOPHOTII package, which is widely used in the astronomical community. It is proved that our system is simpler, much faster and more reliable. Moreover, no prior knowledge, or initial data from the frame to be analysed is required.
Peak Ground Acceleration Prediction by Artificial Neural Networks for Northwestern Turkey
Directory of Open Access Journals (Sweden)
Kemal Günaydın
2008-01-01
Full Text Available Three different artificial neural network (ANN methods, namely, feed-forward back-propagation (FFBP, radial basis function (RBF, and generalized regression neural networks (GRNNs were applied to predict peak ground acceleration (PGA. Ninety five three-component records from 15 ground motions that occurred in Northwestern Turkey between 1999 and 2001 were used during the applications. The earthquake moment magnitude, hypocentral distance, focal depth, and site conditions were used as inputs to estimate PGA for vertical (U-D, east-west (E-W, and north-south (N-S directions. The direction of the maximum PGA of the three components was also added to the input layer to obtain the maximum PGA. Testing stage results of three ANN methods indicated that the FFBPs were superior to the GRNN and the RBF for all directions. The PGA values obtained from the FFBP were modified by linear regression analysis. The results showed that these modifications increased the prediction performances.
Directory of Open Access Journals (Sweden)
M. Sreeshakthy
2016-01-01
Full Text Available Department of Computer Science and Engineering,Anna University Regional Centre, Coimbatore, Indiam.sribtechit@gmail.comJ. PreethiDepartment of Computer Science and EngineeringAnna University Regional Centre, Coimbatore, Indiapreethi17j@yahoo.comEmotions are very important in human decision handling, interaction and cognitive process. In this paper describes that recognize the human emotions from DEAP EEG dataset with different kind of methods. Audio – video based stimuli is used to extract the emotions. EEG signal is divided into different bands using discrete wavelet transformation with db8 wavelet function for further process. Statistical and energy based features are extracted from the bands, based on the features emotions are classified with feed forward neural network with weight optimized algorithm like PSO. Before that the particular band has to be selected based on the training performance of neural networks and then the emotions are classified. In this experimental result describes that the gamma and alpha bands are provides the accurate classification result with average classification rate of 90.3% of using NNRBF, 90.325% of using PNN, 96.3% of using PSO trained NN, 98.1 of using Cuckoo trained NN. At last the emotions are classified into two different groups like valence and arousal. Based on that identifies the person normal and abnormal behavioral using classified emotion.
Directory of Open Access Journals (Sweden)
Manoj Tripathy
2012-01-01
Full Text Available This paper describes a new approach for power transformer differential protection which is based on the wave-shape recognition technique. An algorithm based on neural network principal component analysis (NNPCA with back-propagation learning is proposed for digital differential protection of power transformer. The principal component analysis is used to preprocess the data from power system in order to eliminate redundant information and enhance hidden pattern of differential current to discriminate between internal faults from inrush and overexcitation conditions. This algorithm has been developed by considering optimal number of neurons in hidden layer and optimal number of neurons at output layer. The proposed algorithm makes use of ratio of voltage to frequency and amplitude of differential current for transformer operating condition detection. This paper presents a comparative study of power transformer differential protection algorithms based on harmonic restraint method, NNPCA, feed forward back propagation neural network (FFBPNN, space vector analysis of the differential signal, and their time characteristic shapes in Park’s plane. The algorithms are compared as to their speed of response, computational burden, and the capability to distinguish between a magnetizing inrush and power transformer internal fault. The mathematical basis for each algorithm is briefly described. All the algorithms are evaluated using simulation performed with PSCAD/EMTDC and MATLAB.
Subspace learning of neural networks
Cheng Lv, Jian; Zhou, Jiliu
2010-01-01
PrefaceChapter 1. Introduction1.1 Introduction1.1.1 Linear Neural Networks1.1.2 Subspace Learning1.2 Subspace Learning Algorithms1.2.1 PCA Learning Algorithms1.2.2 MCA Learning Algorithms1.2.3 ICA Learning Algorithms1.3 Methods for Convergence Analysis1.3.1 SDT Method1.3.2 DCT Method1.3.3 DDT Method1.4 Block Algorithms1.5 Simulation Data Set and Notation1.6 ConclusionsChapter 2. PCA Learning Algorithms with Constants Learning Rates2.1 Oja's PCA Learning Algorithms2.1.1 The Algorithms2.1.2 Convergence Issue2.2 Invariant Sets2.2.1 Properties of Invariant Sets2.2.2 Conditions for Invariant Sets2.
Neural networks for damage identification
Energy Technology Data Exchange (ETDEWEB)
Paez, T.L.; Klenke, S.E.
1997-11-01
Efforts to optimize the design of mechanical systems for preestablished use environments and to extend the durations of use cycles establish a need for in-service health monitoring. Numerous studies have proposed measures of structural response for the identification of structural damage, but few have suggested systematic techniques to guide the decision as to whether or not damage has occurred based on real data. Such techniques are necessary because in field applications the environments in which systems operate and the measurements that characterize system behavior are random. This paper investigates the use of artificial neural networks (ANNs) to identify damage in mechanical systems. Two probabilistic neural networks (PNNs) are developed and used to judge whether or not damage has occurred in a specific mechanical system, based on experimental measurements. The first PNN is a classical type that casts Bayesian decision analysis into an ANN framework; it uses exemplars measured from the undamaged and damaged system to establish whether system response measurements of unknown origin come from the former class (undamaged) or the latter class (damaged). The second PNN establishes the character of the undamaged system in terms of a kernel density estimator of measures of system response; when presented with system response measures of unknown origin, it makes a probabilistic judgment whether or not the data come from the undamaged population. The physical system used to carry out the experiments is an aerospace system component, and the environment used to excite the system is a stationary random vibration. The results of damage identification experiments are presented along with conclusions rating the effectiveness of the approaches.
Oscillations via Spike-Timing Dependent Plasticity in a Feed-Forward Model.
Directory of Open Access Journals (Sweden)
Yotam Luz
2016-04-01
Full Text Available Neuronal oscillatory activity has been reported in relation to a wide range of cognitive processes including the encoding of external stimuli, attention, and learning. Although the specific role of these oscillations has yet to be determined, it is clear that neuronal oscillations are abundant in the central nervous system. This raises the question of the origin of these oscillations: are the mechanisms for generating these oscillations genetically hard-wired or can they be acquired via a learning process? Here, we study the conditions under which oscillatory activity emerges through a process of spike timing dependent plasticity (STDP in a feed-forward architecture. First, we analyze the effect of oscillations on STDP-driven synaptic dynamics of a single synapse, and study how the parameters that characterize the STDP rule and the oscillations affect the resultant synaptic weight. Next, we analyze STDP-driven synaptic dynamics of a pre-synaptic population of neurons onto a single post-synaptic cell. The pre-synaptic neural population is assumed to be oscillating at the same frequency, albeit with different phases, such that the net activity of the pre-synaptic population is constant in time. Thus, in the homogeneous case in which all synapses are equal, the post-synaptic neuron receives constant input and hence does not oscillate. To investigate the transition to oscillatory activity, we develop a mean-field Fokker-Planck approximation of the synaptic dynamics. We analyze the conditions causing the homogeneous solution to lose its stability. The findings show that oscillatory activity appears through a mechanism of spontaneous symmetry breaking. However, in the general case the homogeneous solution is unstable, and the synaptic dynamics does not converge to a different fixed point, but rather to a limit cycle. We show how the temporal structure of the STDP rule determines the stability of the homogeneous solution and the drift velocity of the
Oscillations via Spike-Timing Dependent Plasticity in a Feed-Forward Model.
Luz, Yotam; Shamir, Maoz
2016-04-01
Neuronal oscillatory activity has been reported in relation to a wide range of cognitive processes including the encoding of external stimuli, attention, and learning. Although the specific role of these oscillations has yet to be determined, it is clear that neuronal oscillations are abundant in the central nervous system. This raises the question of the origin of these oscillations: are the mechanisms for generating these oscillations genetically hard-wired or can they be acquired via a learning process? Here, we study the conditions under which oscillatory activity emerges through a process of spike timing dependent plasticity (STDP) in a feed-forward architecture. First, we analyze the effect of oscillations on STDP-driven synaptic dynamics of a single synapse, and study how the parameters that characterize the STDP rule and the oscillations affect the resultant synaptic weight. Next, we analyze STDP-driven synaptic dynamics of a pre-synaptic population of neurons onto a single post-synaptic cell. The pre-synaptic neural population is assumed to be oscillating at the same frequency, albeit with different phases, such that the net activity of the pre-synaptic population is constant in time. Thus, in the homogeneous case in which all synapses are equal, the post-synaptic neuron receives constant input and hence does not oscillate. To investigate the transition to oscillatory activity, we develop a mean-field Fokker-Planck approximation of the synaptic dynamics. We analyze the conditions causing the homogeneous solution to lose its stability. The findings show that oscillatory activity appears through a mechanism of spontaneous symmetry breaking. However, in the general case the homogeneous solution is unstable, and the synaptic dynamics does not converge to a different fixed point, but rather to a limit cycle. We show how the temporal structure of the STDP rule determines the stability of the homogeneous solution and the drift velocity of the limit cycle.
Edin, Benoni B.; Trulsson, Mats
1992-07-01
Understanding of the information processing in some sensory systems is hampered for several reasons. First, some of these systems may depend on several receptor types with different characteristics, and the crucial features of natural stimuli encoded by the receptors are rarely known with certainty. Second, the functional output of sensory processing is often not well defined. The human tooth is endowed with several types of sensory receptors. Among these, the mechanoreceptors located in the periodontal ligaments have been implicated in force encoding during chewing and biting. Individual receptors cannot, however, code unambiguously either the direction or the magnitude of the applied forces. Neuronal responses recorded in single human nerve fibers from periodontal receptors were fed to multi-layered feed-forward networks. The networks were trained with error back-propagation to identify specific features of the force stimuli that evoked the receptor responses. It was demonstrated that population responses in periodontal receptors contain information about both the point of attack and the direction of applied forces. It is concluded that networks may provide a powerful tool to investigate the information content in responses from biological receptor populations. As such, specific hypotheses with respect to information processing may be tested using neural networks also in sensory systems less well understood than, for instance, the visual system.
Corrigan, B W; Mayo, P R; Jamali, F
1997-02-01
Neural network (NN) computation is computer modeling based in part on simulation of the structure and function of the brain. These modeling techniques have been found useful as pattern recognition tools. In the present study, data including age, sex, height, weight, serum creatinine concentration, dose, dosing interval, and time of measurement were collected from 240 patients with various diseases being treated with gentamicin in a general hospital setting. The patient records were randomly divided into two sets: a training set of 220 patients used to develop relationships between input and output variables (peak and trough plasma concentrations) and a testing set (blinded from the NN) of 20 to test the NN. The network model was the back-propagation, feed-forward model. Various networks were tested, and the most accurate networks for peak and trough (calculated as mean percent error, root mean squared error of the testing group, and tau value between observed and predicted values) were reported. The results indicate that NNs can predict gentamicin serum concentrations accurately from various input data over a range of patient ages and renal function and may offer advantages over traditional dose prediction methods for gentamicin.
Directory of Open Access Journals (Sweden)
Katarína Hiľovská
2011-09-01
Full Text Available To a degree the financial crisis influenced all European countries but the most affected are the PIGS (Portugal, Ireland, Greece and Spain. We investigated the effect of the financial crisis on the prediction accuracy of artificial neural networks on the Portuguese, Irish, Athens and Madrid Stock Exchange. We applied three-layered feed-forward neural networks with backpropagation algorithm to forecast the next day prices and we compared the paper returns achieved before and after the recent financial crisis. This method failed in forecasting the direction of the next day price movement but performed well in absolute price changes. However, it achieved better results than the strategy based on technical analysis in the period before the crisis. On the other hand, technical analysis performed better during the crisis.
Nonlinear programming with feedforward neural networks.
Energy Technology Data Exchange (ETDEWEB)
Reifman, J.
1999-06-02
We provide a practical and effective method for solving constrained optimization problems by successively training a multilayer feedforward neural network in a coupled neural-network/objective-function representation. Nonlinear programming problems are easily mapped into this representation which has a simpler and more transparent method of solution than optimization performed with Hopfield-like networks and poses very mild requirements on the functions appearing in the problem. Simulation results are illustrated and compared with an off-the-shelf optimization tool.
Second-Order Feed-Forward Renderingfor Specular and Glossy Reflections.
Wang, Lili; Xie, Naiwen; Ke, Wei; Popescu, Voicu
2014-09-01
The feed-forward pipeline based on projection followed by rasterization handles the rays that leave the eye efficiently: these first-order rays are modeled with a simple camera that projects geometry to screen. Second-order rays however, as, for example, those resulting from specular reflections, are challenging for the feed-forward approach. We propose an extension of the feed-forward pipeline to handle second-order rays resulting from specular and glossy reflections. The coherence of second-order rays is leveraged through clustering, the geometry reflected by a cluster is approximated with a depth image, and the color samples captured by the second-order rays of a cluster are computed by intersection with the depth image. We achieve quality specular and glossy reflections at interactive rates in fully dynamic scenes.
Directory of Open Access Journals (Sweden)
Kai-Wei Chiang
2010-10-01
Full Text Available Mobile mapping systems have been widely applied for acquiring spatial information in applications such as spatial information systems and 3D city models. Nowadays the most common technologies used for positioning and orientation of a mobile mapping system include a Global Positioning System (GPS as the major positioning sensor and an Inertial Navigation System (INS as the major orientation sensor. In the classical approach, the limitations of the Kalman Filter (KF method and the overall price of multi-sensor systems have limited the popularization of most land-based mobile mapping applications. Although intelligent sensor positioning and orientation schemes consisting of Multi-layer Feed-forward Neural Networks (MFNNs, one of the most famous Artificial Neural Networks (ANNs, and KF/smoothers, have been proposed in order to enhance the performance of low cost Micro Electro Mechanical System (MEMS INS/GPS integrated systems, the automation of the MFNN applied has not proven as easy as initially expected. Therefore, this study not only addresses the problems of insufficient automation in the conventional methodology that has been applied in MFNN-KF/smoother algorithms for INS/GPS integrated systems proposed in previous studies, but also exploits and analyzes the idea of developing alternative intelligent sensor positioning and orientation schemes that integrate various sensors in more automatic ways. The proposed schemes are implemented using one of the most famous constructive neural networks––the Cascade Correlation Neural Network (CCNNs––to overcome the limitations of conventional techniques based on KF/smoother algorithms as well as previously developed MFNN-smoother schemes. The CCNNs applied also have the advantage of a more flexible topology compared to MFNNs. Based on the experimental data utilized the preliminary results presented in this article illustrate the effectiveness of the proposed schemes compared to smoother algorithms
Research of The Deeper Neural Networks
Directory of Open Access Journals (Sweden)
Xiao You Rong
2016-01-01
Full Text Available Neural networks (NNs have powerful computational abilities and could be used in a variety of applications; however, training these networks is still a difficult problem. With different network structures, many neural models have been constructed. In this report, a deeper neural networks (DNNs architecture is proposed. The training algorithm of deeper neural network insides searching the global optimal point in the actual error surface. Before the training algorithm is designed, the error surface of the deeper neural network is analyzed from simple to complicated, and the features of the error surface is obtained. Based on these characters, the initialization method and training algorithm of DNNs is designed. For the initialization, a block-uniform design method is proposed which separates the error surface into some blocks and finds the optimal block using the uniform design method. For the training algorithm, the improved gradient-descent method is proposed which adds a penalty term into the cost function of the old gradient descent method. This algorithm makes the network have a great approximating ability and keeps the network state stable. All of these improve the practicality of the neural network.
Phothisonothai, Montri; Nakagawa, Masahiro
In this study, we propose a method of classifying a spontaneous electroencephalogram (EEG) approach to a brain-computer interface. Ten subjects, aged 21-32 years, volunteered to imagine left-and right- hand movements. An independent component analysis based on a fixed-point algorithm is used to eliminate the activities found in the EEG signals. We use a fractal dimension value to reveal the embedded potential responses in the human brain. The different fractal dimension values between the relaxing and imaging periods are computed. Featured data is classified by a three-layer feed-forward neural network based on a simple backpropagation algorithm. Two conventional methods, namely, the use of the autoregressive (AR) model and the band power estimation (BPE) as features, and the linear discriminant analysis (LDA) as a classifier, are selected for comparison in this study. Experimental results show that the proposed method is more effective than the conventional methods.
Abbaspour, A; Baramakeh, L
2006-05-15
Determination of zirconium and hafnium were done by applying singular value decomposition and a feed forward Neural Network Algorithm with back propagation of error. The determination of trace amounts of mixtures of Zr(IV) and Hf(IV) in various matrices (river, tap and industrial wastewater) were investigated by PC-ANN using the complexes formed between Alizarin Red S, Zr and Hf. The results showed that measurement is possible in the ranges of 0.03-3.4 and 0.2-7.0 microg ml-1 for Zr(IV) and Hf(IV), respectively. The detection limits were 0.02 and 0.08 microg ml-1 for Zr(IV) and Hf(IV), respectively. The results also show very good agreement between true and predicted concentration values and have the ability to use in routine analysis.
Directory of Open Access Journals (Sweden)
J. Prakash Maran
2013-09-01
Full Text Available In this study, a comparative approach was made between artificial neural network (ANN and response surface methodology (RSM to predict the mass transfer parameters of osmotic dehydration of papaya. The effects of process variables such as temperature, osmotic solution concentration and agitation speed on water loss, weight reduction, and solid gain during osmotic dehydration were investigated using a three-level three-factor Box-Behnken experimental design. Same design was utilized to train a feed-forward multilayered perceptron (MLP ANN with back-propagation algorithm. The predictive capabilities of the two methodologies were compared in terms of root mean square error (RMSE, mean absolute error (MAE, standard error of prediction (SEP, model predictive error (MPE, chi square statistic (χ2, and coefficient of determination (R2 based on the validation data set. The results showed that properly trained ANN model is found to be more accurate in prediction as compared to RSM model.
Directory of Open Access Journals (Sweden)
E Arkan
2011-12-01
Full Text Available Background and the purpose of the study: A quantitative structure activity relationship (QSAR model based on artificial neural networks (ANN was developed to study the activities of 29 derivatives of 3-amino-4-(2-(2-(4-benzylpiperazin-1-yl-2-oxoethoxy phenylamino cyclobutenedione as C-C chemokine receptor type 1(CCR1 inhibitors. Methods: A feed-forward ANN with error back-propagation learning algorithm was used for model building which was achieved by optimizing initial learning rate, learning momentum, epoch and the number of hidden neurons. Results: Good results were obtained with a Root Mean Square Error (RMSE and correlation coefficients (R2 of 0.189 and 0.906 for the training and 0.103 and 0.932 prediction sets, respectively. Conclusion: The results reflect a nonlinear relationship between the Principal components obtained from calculated molecular descriptors and the inhibitory activities of the investigated molecules.
Permutation parity machines for neural cryptography.
Reyes, Oscar Mauricio; Zimmermann, Karl-Heinz
2010-06-01
Recently, synchronization was proved for permutation parity machines, multilayer feed-forward neural networks proposed as a binary variant of the tree parity machines. This ability was already used in the case of tree parity machines to introduce a key-exchange protocol. In this paper, a protocol based on permutation parity machines is proposed and its performance against common attacks (simple, geometric, majority and genetic) is studied.
Acute appendicitis diagnosis using artificial neural networks.
Park, Sung Yun; Kim, Sung Min
2015-01-01
Artificial neural networks is one of pattern analyzer method which are rapidly applied on a bio-medical field. The aim of this research was to propose an appendicitis diagnosis system using artificial neural networks (ANNs). Data from 801 patients of the university hospital in Dongguk were used to construct artificial neural networks for diagnosing appendicitis and acute appendicitis. A radial basis function neural network structure (RBF), a multilayer neural network structure (MLNN), and a probabilistic neural network structure (PNN) were used for artificial neural network models. The Alvarado clinical scoring system was used for comparison with the ANNs. The accuracy of the RBF, PNN, MLNN, and Alvarado was 99.80%, 99.41%, 97.84%, and 72.19%, respectively. The area under ROC (receiver operating characteristic) curve of RBF, PNN, MLNN, and Alvarado was 0.998, 0.993, 0.985, and 0.633, respectively. The proposed models using ANNs for diagnosing appendicitis showed good performances, and were significantly better than the Alvarado clinical scoring system (p < 0.001). With cooperation among facilities, the accuracy for diagnosing this serious health condition can be improved.
Institute of Scientific and Technical Information of China (English)
Lotfollahi-Yaghin, M. A.; Pourtaghi, A.; Sanaaty, B.; Lotfollahi-Yaghin, A.
2012-01-01
An approach based on artificial neural network (ANN) is used to develop predictive relations between hydrodynamic inline force on a vertical cylinder and some effective parameters.The data used to calibrate and validate the ANN models are obtained from an experiment.Multilayer feed-forward neural networks that are trained with the back-propagation algorithm are constructed by use of three design parameters (i.e.wave surface height,horizontal and vertical velocities) as network inputs and the ultimate inline force as the only output.A sensitivity analysis is conducted on the ANN models to investigate the generalization ability (robustness) of the developed models,and predictions from the ANN models are compared to those obtained from Morison equation which is usually used to determine inline force as a computational method.With the existing data,it is found that least square method (LSM) gives less error in determining drag and inertia coefficients of Morison equation.With regard to the predicted results agreeing with calculations achieved from Morison equation that used LSM method,neural network has high efficiency considering its convenience,simplicity and promptitude.The outcome of this study can contribute to reducing the errors in predicting hydrodynamic inline force by use of ANN and to improve the reliability of that in comparison with the more practical state of Morison equation.Therefore,this method can be applied to relevant engineering projects with satisfactory results.
Directory of Open Access Journals (Sweden)
G. N. Tiwari
2012-01-01
Full Text Available In this paper an attempt has been made to determine efficiency of semi transparent hybrid photovoltaic thermal double pass air collector for different PV technology and compare it with single pass air collector using artificial neural network (ANN technique for New Delhi weather station of India. The MATLAB 7.1 neural networks toolbox has been used for defining and training of ANN for determination of thermal, electrical, overall thermal and overall exergy efficiency of the system. The ANN model uses ambient air temperature, number of sunshine hours, number of clear days, temperature coefficient, cell efficiency, global and diffuse radiation as input parameters. The transfer function, neural network configuration and learning parameters have been selected based on highest convergence during training and testing of network. About 2000 sets of data from four weather stations (Bangalore, Mumbai, Srinagar and Jodhpur have been given as input for training and data of the fifth weather station (New Delhi has been used for testing purpose. It has been observed that the best transfer function for a given configuration is logsig. The feed forward back-propagation algorithm has been used in this analysis. Further the results of ANN model have been compared with analytical values on the basis of root mean square error.
Dragović, Snezana; Onjia, Antonije; Dragović, Ranko; Bacić, Goran
2007-07-01
Mosses and lichens have an important role in biomonitoring. The objective of this study is to develop a neural network model to classify these plants according to geographical origin. A three-layer feed-forward neural network was used. The activities of radionuclides ((226)Ra, (238)U, (235)U, (40)K, (232)Th, (134)Cs, (137)Cs and (7)Be) detected in plant samples by gamma-ray spectrometry were used as inputs for neural network. Five different training algorithms with different number of samples in training sets were tested and compared, in order to find the one with the minimum root mean square error. The best predictive power for the classification of plants from 12 regions was achieved using a network with 5 hidden layer nodes and 3,000 training epochs, using the online back-propagation randomized training algorithm. Implementation of this model to experimental data resulted in satisfactory classification of moss and lichen samples in terms of their geographical origin. The average classification rate obtained in this study was (90.7 +/- 4.8)%.
Mobility Prediction in Wireless Ad Hoc Networks using Neural Networks
Kaaniche, Heni
2010-01-01
Mobility prediction allows estimating the stability of paths in a mobile wireless Ad Hoc networks. Identifying stable paths helps to improve routing by reducing the overhead and the number of connection interruptions. In this paper, we introduce a neural network based method for mobility prediction in Ad Hoc networks. This method consists of a multi-layer and recurrent neural network using back propagation through time algorithm for training.
Neural network regulation driven by autonomous neural firings
Cho, Myoung Won
2016-07-01
Biological neurons naturally fire spontaneously due to the existence of a noisy current. Such autonomous firings may provide a driving force for network formation because synaptic connections can be modified due to neural firings. Here, we study the effect of autonomous firings on network formation. For the temporally asymmetric Hebbian learning, bidirectional connections lose their balance easily and become unidirectional ones. Defining the difference between reciprocal connections as new variables, we could express the learning dynamics as if Ising model spins interact with each other in magnetism. We present a theoretical method to estimate the interaction between the new variables in a neural system. We apply the method to some network systems and find some tendencies of autonomous neural network regulation.
Concatenated beam splitters, optical feed-forward and the nonlinear sign gate
Jacobs, K; Jacobs, Kurt; Dowling, Jonathan P.
2006-01-01
We consider a nonlinear sign gate implemented using a sequence of two beam splitters, and consider the use of further sequences of beam splitters to implement feed-forward so as to correct an error resulting from the first beam splitter. We obtain similar results to Scheel et al. [Scheel et al., Phys. Rev. A 73, 034301 (2006)], in that we also find that our feed-forward procedure is only able to produce a very minor improvement in the success probability of the original gate.
Simple Digital Feed-Forward Circuit to Compensate for AOM Thermal Lensing
Hill, Joshua; Aman, James; Killian, Thomas; Neutral Experiment Team
2016-05-01
I demonstrate a simple digital feed-forward circuit which, when combined with two-frequency radio frequency (RF) electronics, maintains constant total RF power driving an acousto-optic modulator (AOM). Consistency in total power is desirable to mitigate thermal lensing effects that otherwise displace and misshape the laser beam when the primary frequency drive RF power is changed to, for example, alter the laser power in a diffracted beam. The Arduino-based feed-forward circuit is cost-effective, quick to implement, and easily modified.
Neural networks techniques applied to reservoir engineering
Energy Technology Data Exchange (ETDEWEB)
Flores, M. [Gerencia de Proyectos Geotermoelectricos, Morelia (Mexico); Barragan, C. [RockoHill de Mexico, Indiana (Mexico)
1995-12-31
Neural Networks are considered the greatest technological advance since the transistor. They are expected to be a common household item by the year 2000. An attempt to apply Neural Networks to an important geothermal problem has been made, predictions on the well production and well completion during drilling in a geothermal field. This was done in Los Humeros geothermal field, using two common types of Neural Network models, available in commercial software. Results show the learning capacity of the developed model, and its precision in the predictions that were made.
Assessing Landslide Hazard Using Artificial Neural Network
DEFF Research Database (Denmark)
Farrokhzad, Farzad; Choobbasti, Asskar Janalizadeh; Barari, Amin
2011-01-01
neural network has been developed for use in the stability evaluation of slopes under various geological conditions and engineering requirements. The Artificial neural network model of this research uses slope characteristics as input and leads to the output in form of the probability of failure...... and factor of safety. It can be stated that the trained neural networks are capable of predicting the stability of slopes and safety factor of landslide hazard in study area with an acceptable level of confidence. Landslide hazard analysis and mapping can provide useful information for catastrophic loss...
Estimation of Conditional Quantile using Neural Networks
DEFF Research Database (Denmark)
Kulczycki, P.; Schiøler, Henrik
1999-01-01
The problem of estimating conditional quantiles using neural networks is investigated here. A basic structure is developed using the methodology of kernel estimation, and a theory guaranteeing con-sistency on a mild set of assumptions is provided. The constructed structure constitutes a basis...... for the design of a variety of different neural networks, some of which are considered in detail. The task of estimating conditional quantiles is related to Bayes point estimation whereby a broad range of applications within engineering, economics and management can be suggested. Numerical results illustrating...... the capabilities of the elaborated neural network are also given....
Estimation of Conditional Quantile using Neural Networks
DEFF Research Database (Denmark)
Kulczycki, P.; Schiøler, Henrik
1999-01-01
The problem of estimating conditional quantiles using neural networks is investigated here. A basic structure is developed using the methodology of kernel estimation, and a theory guaranteeing con-sistency on a mild set of assumptions is provided. The constructed structure constitutes a basis...... for the design of a variety of different neural networks, some of which are considered in detail. The task of estimating conditional quantiles is related to Bayes point estimation whereby a broad range of applications within engineering, economics and management can be suggested. Numerical results illustrating...... the capabilities of the elaborated neural network are also given....
Convolutional Neural Network for Image Recognition
Seifnashri, Sahand
2015-01-01
The aim of this project is to use machine learning techniques especially Convolutional Neural Networks for image processing. These techniques can be used for Quark-Gluon discrimination using calorimeters data, but unfortunately I didn’t manage to get the calorimeters data and I just used the Jet data fromminiaodsim(ak4 chs). The Jet data was not good enough for Convolutional Neural Network which is designed for ’image’ recognition. This report is made of twomain part, part one is mainly about implementing Convolutional Neural Network on unphysical data such as MNIST digits and CIFAR-10 dataset and part 2 is about the Jet data.
Threshold control of chaotic neural network.
He, Guoguang; Shrimali, Manish Dev; Aihara, Kazuyuki
2008-01-01
The chaotic neural network constructed with chaotic neurons exhibits rich dynamic behaviour with a nonperiodic associative memory. In the chaotic neural network, however, it is difficult to distinguish the stored patterns in the output patterns because of the chaotic state of the network. In order to apply the nonperiodic associative memory into information search, pattern recognition etc. it is necessary to control chaos in the chaotic neural network. We have studied the chaotic neural network with threshold activated coupling, which provides a controlled network with associative memory dynamics. The network converges to one of its stored patterns or/and reverse patterns which has the smallest Hamming distance from the initial state of the network. The range of the threshold applied to control the neurons in the network depends on the noise level in the initial pattern and decreases with the increase of noise. The chaos control in the chaotic neural network by threshold activated coupling at varying time interval provides controlled output patterns with different temporal periods which depend upon the control parameters.
Lugade, Vipul; Lin, Victor; Farley, Arthur; Chou, Li-Shan
2014-01-01
The use of motion analysis to assess balance is essential for determining the underlying mechanisms of falls during dynamic activities. Clinicians evaluate patients using clinical examinations of static balance control, gait performance, cognition, and neuromuscular ability. Mapping these data to measures of dynamic balance control, and the subsequent categorization and identification of community dwelling elderly fallers at risk of falls in a quick and inexpensive manner is needed. The purpose of this study was to demonstrate that given clinical measures, an artificial neural network (ANN) could determine dynamic balance control, as defined by the interaction of the center of mass (CoM) with the base of support (BoS), during gait. Fifty-six elderly adults were included in this study. Using a feed-forward neural network with back propagation, combinations of five functional domains, the number of hidden layers and error goals were evaluated to determine the best parameters to assess dynamic balance control. Functional domain input parameters included subject characteristics, clinical examinations, cognitive performance, muscle strength, and clinical balance performance. The use of these functional domains demonstrated the ability to quickly converge to a solution, with the network learning the mapping within 5 epochs, when using up to 30 hidden nodes and an error goal of 0.001. The ability to correctly identify the interaction of the CoM with BoS demonstrated correlation values up to 0.89 (Pbalance control. A neural network could provide physicians and patients with a cost effective means to identify dynamic balance issues and possible risk of falls from routinely collected clinical examinations.
Nonequilibrium landscape theory of neural networks.
Yan, Han; Zhao, Lei; Hu, Liang; Wang, Xidi; Wang, Erkang; Wang, Jin
2013-11-05
The brain map project aims to map out the neuron connections of the human brain. Even with all of the wirings mapped out, the global and physical understandings of the function and behavior are still challenging. Hopfield quantified the learning and memory process of symmetrically connected neural networks globally through equilibrium energy. The energy basins of attractions represent memories, and the memory retrieval dynamics is determined by the energy gradient. However, the realistic neural networks are asymmetrically connected, and oscillations cannot emerge from symmetric neural networks. Here, we developed a nonequilibrium landscape-flux theory for realistic asymmetrically connected neural networks. We uncovered the underlying potential landscape and the associated Lyapunov function for quantifying the global stability and function. We found the dynamics and oscillations in human brains responsible for cognitive processes and physiological rhythm regulations are determined not only by the landscape gradient but also by the flux. We found that the flux is closely related to the degrees of the asymmetric connections in neural networks and is the origin of the neural oscillations. The neural oscillation landscape shows a closed-ring attractor topology. The landscape gradient attracts the network down to the ring. The flux is responsible for coherent oscillations on the ring. We suggest the flux may provide the driving force for associations among memories. We applied our theory to rapid-eye movement sleep cycle. We identified the key regulation factors for function through global sensitivity analysis of landscape topography against wirings, which are in good agreements with experiments.
Nonequilibrium landscape theory of neural networks
Yan, Han; Zhao, Lei; Hu, Liang; Wang, Xidi; Wang, Erkang; Wang, Jin
2013-01-01
The brain map project aims to map out the neuron connections of the human brain. Even with all of the wirings mapped out, the global and physical understandings of the function and behavior are still challenging. Hopfield quantified the learning and memory process of symmetrically connected neural networks globally through equilibrium energy. The energy basins of attractions represent memories, and the memory retrieval dynamics is determined by the energy gradient. However, the realistic neural networks are asymmetrically connected, and oscillations cannot emerge from symmetric neural networks. Here, we developed a nonequilibrium landscape–flux theory for realistic asymmetrically connected neural networks. We uncovered the underlying potential landscape and the associated Lyapunov function for quantifying the global stability and function. We found the dynamics and oscillations in human brains responsible for cognitive processes and physiological rhythm regulations are determined not only by the landscape gradient but also by the flux. We found that the flux is closely related to the degrees of the asymmetric connections in neural networks and is the origin of the neural oscillations. The neural oscillation landscape shows a closed-ring attractor topology. The landscape gradient attracts the network down to the ring. The flux is responsible for coherent oscillations on the ring. We suggest the flux may provide the driving force for associations among memories. We applied our theory to rapid-eye movement sleep cycle. We identified the key regulation factors for function through global sensitivity analysis of landscape topography against wirings, which are in good agreements with experiments. PMID:24145451
Character Recognition Using Novel Optoelectronic Neural Network
1993-04-01
17 2.3.7. Learning rule ................................................................... 18 3. ADALINE ... ADALINE neuron and linear separability which provides a justification for multilayer networks. The MADALINE (many ADALINE ) multi layer network is also...element used In many neural networks (Figure 3.1). The ADALINE functions as an adaptive threshold logic element. In digital Implementation, an input
Neural Network for Estimating Conditional Distribution
DEFF Research Database (Denmark)
Schiøler, Henrik; Kulczycki, P.
Neural networks for estimating conditional distributions and their associated quantiles are investigated in this paper. A basic network structure is developed on the basis of kernel estimation theory, and consistency is proved from a mild set of assumptions. A number of applications within...... statistcs, decision theory and signal processing are suggested, and a numerical example illustrating the capabilities of the elaborated network is given...
Nonlinear System Control Using Neural Networks
Directory of Open Access Journals (Sweden)
Jaroslava Žilková
2006-10-01
Full Text Available The paper is focused especially on presenting possibilities of applying off-linetrained artificial neural networks at creating the system inverse models that are used atdesigning control algorithm for non-linear dynamic system. The ability of cascadefeedforward neural networks to model arbitrary non-linear functions and their inverses isexploited. This paper presents a quasi-inverse neural model, which works as a speedcontroller of an induction motor. The neural speed controller consists of two cascadefeedforward neural networks subsystems. The first subsystem provides desired statorcurrent components for control algorithm and the second subsystem providescorresponding voltage components for PWM converter. The availability of the proposedcontroller is verified through the MATLAB simulation. The effectiveness of the controller isdemonstrated for different operating conditions of the drive system.